-- Logs begin at Tue 2022-10-04 20:11:23 UTC, end at Tue 2022-10-04 22:58:33 UTC. -- Oct 04 20:54:37.747068 n-d-860282-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 20:54:37.755965 n-d-860282-1 devstack@n-api.service[106667]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 20:54:37.757978 n-d-860282-1 devstack@n-api.service[106667]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 20:54:37 2022] *** Oct 04 20:54:37.757978 n-d-860282-1 devstack@n-api.service[106667]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 20:54:37.757978 n-d-860282-1 devstack@n-api.service[106667]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 20:54:37.757978 n-d-860282-1 devstack@n-api.service[106667]: nodename: n-d-860282-1 Oct 04 20:54:37.757978 n-d-860282-1 devstack@n-api.service[106667]: machine: x86_64 Oct 04 20:54:37.757978 n-d-860282-1 devstack@n-api.service[106667]: clock source: unix Oct 04 20:54:37.757978 n-d-860282-1 devstack@n-api.service[106667]: pcre jit disabled Oct 04 20:54:37.757978 n-d-860282-1 devstack@n-api.service[106667]: detected number of CPU cores: 4 Oct 04 20:54:37.757978 n-d-860282-1 devstack@n-api.service[106667]: current working directory: / Oct 04 20:54:37.757978 n-d-860282-1 devstack@n-api.service[106667]: detected binary path: /usr/bin/uwsgi-core Oct 04 20:54:37.757978 n-d-860282-1 devstack@n-api.service[106667]: your processes number limit is 47680 Oct 04 20:54:37.757978 n-d-860282-1 devstack@n-api.service[106667]: your memory page size is 4096 bytes Oct 04 20:54:37.757978 n-d-860282-1 devstack@n-api.service[106667]: detected max file descriptor number: 2048 Oct 04 20:54:37.757978 n-d-860282-1 devstack@n-api.service[106667]: lock engine: pthread robust mutexes Oct 04 20:54:37.758866 n-d-860282-1 devstack@n-api.service[106667]: thunder lock: enabled Oct 04 20:54:37.758866 n-d-860282-1 devstack@n-api.service[106667]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 20:54:37.758866 n-d-860282-1 devstack@n-api.service[106667]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 20:54:37.797549 n-d-860282-1 devstack@n-api.service[106667]: Python main interpreter initialized at 0x55d9d7fd99c0 Oct 04 20:54:37.797549 n-d-860282-1 devstack@n-api.service[106667]: python threads support enabled Oct 04 20:54:37.797549 n-d-860282-1 devstack@n-api.service[106667]: your server socket listen backlog is limited to 100 connections Oct 04 20:54:37.797549 n-d-860282-1 devstack@n-api.service[106667]: your mercy for graceful operations on workers is 90 seconds Oct 04 20:54:37.797946 n-d-860282-1 devstack@n-api.service[106667]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 20:54:37.797946 n-d-860282-1 devstack@n-api.service[106667]: *** Operational MODE: preforking *** Oct 04 20:54:37.798150 n-d-860282-1 devstack@n-api.service[106667]: *** uWSGI is running in multiple interpreter mode *** Oct 04 20:54:37.798150 n-d-860282-1 devstack@n-api.service[106667]: spawned uWSGI master process (pid: 106667) Oct 04 20:54:37.798459 n-d-860282-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 20:54:37.801052 n-d-860282-1 devstack@n-api.service[106667]: spawned uWSGI worker 1 (pid: 106668, cores: 1) Oct 04 20:54:37.801052 n-d-860282-1 devstack@n-api.service[106667]: spawned uWSGI worker 2 (pid: 106669, cores: 1) Oct 04 20:54:37.801052 n-d-860282-1 devstack@n-api.service[106667]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 20:54:38.464149 n-d-860282-1 devstack@n-api.service[106669]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 20:54:38.464749 n-d-860282-1 devstack@n-api.service[106668]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 20:54:39.566610 n-d-860282-1 devstack@n-api.service[106669]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:54:39.566610 n-d-860282-1 devstack@n-api.service[106669]: from cryptography.utils import int_from_bytes Oct 04 20:54:39.567217 n-d-860282-1 devstack@n-api.service[106668]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:54:39.567217 n-d-860282-1 devstack@n-api.service[106668]: from cryptography.utils import int_from_bytes Oct 04 20:54:39.567625 n-d-860282-1 devstack@n-api.service[106669]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:54:39.567625 n-d-860282-1 devstack@n-api.service[106669]: from cryptography.utils import int_from_bytes Oct 04 20:54:39.567780 n-d-860282-1 devstack@n-api.service[106668]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:54:39.567780 n-d-860282-1 devstack@n-api.service[106668]: from cryptography.utils import int_from_bytes Oct 04 20:54:42.066067 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 20:54:42.066805 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 20:54:42.066915 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 20:54:42.067188 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 20:54:42.067311 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 20:54:42.067673 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 20:54:42.067769 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 20:54:42.067851 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.068059 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 20:54:42.068184 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.068421 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 20:54:42.068521 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.068679 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 20:54:42.068778 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.069057 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.069160 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.069368 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.069504 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.069712 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.069817 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.070031 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.070146 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.070354 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.070451 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.070613 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.070717 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.070923 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.071019 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.071240 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860282-1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.071337 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.071560 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.071669 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.071837 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.071934 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.072155 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.072290 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.072480 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860282-1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.072590 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.072794 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.072889 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.073098 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.073202 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.073405 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.073527 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.073757 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.073930 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.074045 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.074371 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.074506 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.074677 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.074800 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.074985 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.075176 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.075368 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.075486 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.075618 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.075792 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.075926 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.076100 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.076244 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.076436 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.076534 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.076751 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.076852 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.077060 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.077175 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.077384 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.077567 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860282-1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.077719 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.078131 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.078324 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.078447 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.078573 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.078760 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.078975 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860282-1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.079175 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.079294 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.079485 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.079608 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.079793 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.079922 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.080111 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.080332 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.080430 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.080643 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.080744 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.080955 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.081053 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.081276 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.081374 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.081624 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.081770 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.081933 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.082044 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.082258 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.082355 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.082567 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.082663 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.082871 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.082975 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.083188 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.083283 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.083489 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.083584 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.083791 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.083895 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.084040 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.084132 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.084345 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.084435 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.084664 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.084768 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.084978 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.085067 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.085230 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.085329 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.085555 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.085664 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.085807 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.085906 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.086121 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.086219 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.086438 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.086531 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.086723 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.086823 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.086976 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.087079 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.087294 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.087421 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.087673 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.087841 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.087978 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.088239 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.088325 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.088558 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.088661 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.088861 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.088960 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.089177 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.089273 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.089506 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.089610 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.089819 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.089921 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.090124 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.090262 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.090431 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.090530 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.090750 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.090852 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.091058 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.091161 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.091366 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.091467 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.091673 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.091773 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.091993 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.092086 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.092297 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.092392 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.092612 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.092711 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.092929 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.093025 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.093237 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.093328 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.093564 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.093668 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.093870 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.093968 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.094187 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.094284 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.094507 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.094605 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.094807 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.094895 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.095056 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.095146 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.095355 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.095446 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.095661 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.095758 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.095975 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.096077 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.096280 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.096371 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.096545 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.096633 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.096849 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.096952 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.097155 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.097245 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.097478 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.097569 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.097791 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.097910 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.098094 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.098188 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.098397 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.098492 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.098700 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.098805 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.099005 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.099101 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.099304 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.099400 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.099609 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.099710 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.099908 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.100004 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.100210 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.100346 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.100515 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.100675 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.100819 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.100909 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.101120 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.101215 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.101448 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.101551 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.101746 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.101844 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.102052 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.102145 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.102368 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.102466 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.102675 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.102776 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.103624 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.103733 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.103959 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.104058 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.104264 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.104397 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.104568 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.104750 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.104884 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.105085 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.105176 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.105415 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.105533 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.105783 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.105883 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.106098 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.106193 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.106403 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.106492 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.106720 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.106825 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.107027 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.107127 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.107331 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.107429 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.107633 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.107738 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.107939 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.108042 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.108239 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.108330 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.108542 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.108633 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.108845 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.108936 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.109146 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.109237 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.109533 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.109629 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.109855 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.109955 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.110165 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.110260 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.110471 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.110560 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.110777 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.110876 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.111082 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.111172 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.111397 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.111504 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.111712 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.111803 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.112039 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.112138 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.112353 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.112442 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.112668 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.112765 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.112980 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.113083 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.113303 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:54:42.113394 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.113644 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.113744 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.113955 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.114056 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.114269 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.114360 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.114593 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.114691 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.114903 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.115011 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.115213 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.115304 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.115524 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.115613 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.115843 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.115949 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.116161 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.116258 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.116487 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.116577 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.116802 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.116981 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.117114 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.117206 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.117458 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.117552 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.117759 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.117849 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.118076 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.118179 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.118400 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.118500 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.119349 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.119452 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.119667 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.119825 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.120010 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.120148 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.120354 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.120447 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.120666 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.120760 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.120989 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.121080 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.121310 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.121409 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.121646 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.121738 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.121954 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.122052 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.122265 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.122395 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.122602 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.122700 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.122916 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.123021 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.123229 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.123319 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.123548 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.123645 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.123858 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.123958 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.124176 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.124275 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.124488 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.124586 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.124794 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.124947 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.125104 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.125195 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.125413 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.125558 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.125744 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.125844 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.126074 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.126174 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.126387 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.126478 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.126706 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.126804 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.127017 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.127109 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.127325 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.127416 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.127636 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.127726 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.127943 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.128032 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.128251 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.128345 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.128557 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.128656 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.128860 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.128958 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.129160 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.129260 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.129480 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.129587 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.129794 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.129885 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.130095 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.130244 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.130411 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.130508 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.130717 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.130814 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.131024 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.131124 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.131332 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.131426 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.131636 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.131735 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.131940 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.132039 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.132244 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.132333 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.132549 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.132650 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.132850 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.132951 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.133159 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.133258 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.133484 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.133577 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.133789 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.133880 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.134108 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.134204 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.134475 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.134568 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.134777 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.134906 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.135095 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.135231 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.135396 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.135528 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.135697 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.135840 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.136005 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.136167 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.136309 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.136480 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.136614 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.136789 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.136923 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.137114 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.137228 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.137442 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.137572 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.137747 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.137881 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.138060 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.138189 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.138374 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.138519 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.138688 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.138842 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.139003 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.139142 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.139314 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.139459 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.139639 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.139787 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.139952 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.140099 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.140265 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.140398 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.140602 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.140692 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.140934 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.141034 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.141241 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.141339 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.141588 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.141692 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.141893 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.141991 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.142193 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.142291 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.142493 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.142590 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.142792 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.142896 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.143091 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.143189 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.143387 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.143485 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.143693 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.143858 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.143993 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.144090 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.144292 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.144388 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.144589 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.144679 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.144888 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.144979 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.145189 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.145286 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.145514 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.145624 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.145838 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.145930 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.146146 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.146242 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.146450 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.146617 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.146753 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.146833 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.147058 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.147159 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.147369 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.147459 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.147675 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.147773 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.147982 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.148082 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.148289 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.148424 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.148597 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.148696 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.148913 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.149013 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.149221 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.149320 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.149563 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.149669 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.149928 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.150076 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.150250 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.150423 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.150557 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.150754 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.150881 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.151071 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.151162 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.151393 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.151483 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.151708 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.151817 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.152032 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.152132 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.152343 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.152433 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.152667 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.152767 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.152980 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.153070 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.153287 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.153376 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.153617 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.153720 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.153924 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.154012 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.154230 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.154330 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.154535 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.154635 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.154849 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.154947 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.155155 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.155252 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.155468 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.155567 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.155772 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.155862 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.156086 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.156177 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.156390 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.156481 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.156698 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.156787 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.156995 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.157083 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.157303 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.157395 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.157636 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.157726 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.157955 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.158053 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.158258 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.158349 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.158564 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.158662 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.158870 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.158965 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.159177 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.159267 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.159480 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.159568 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.159790 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.159887 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.160093 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.160190 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.160396 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.160486 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.160702 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.160801 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.161012 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.161103 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.161320 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.161410 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.161651 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.161755 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.161954 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.162045 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.162263 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.162350 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.162567 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.162665 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.162868 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.162968 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.163172 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.163263 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.163481 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.163573 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.163792 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.163881 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.164097 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.164187 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.164401 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.164491 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.164716 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.164805 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.165016 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.165106 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.165317 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.165408 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.166229 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.166331 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.166536 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.166624 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.166827 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.166920 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.167130 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.167220 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.167430 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.167531 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.167767 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.167858 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.168075 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.168164 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.168376 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.168476 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.168690 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.168783 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.169007 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.169105 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.169310 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.169408 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.169642 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.169732 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.169944 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.170035 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.170255 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.170354 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.170571 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.170662 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.170873 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.170961 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.171174 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.171267 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.171481 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.171579 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.171787 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.171875 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.172092 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.172253 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.172399 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.172498 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.172708 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.172799 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.172998 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.173089 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.173305 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.173396 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.173637 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.173731 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.173939 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.174031 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.174280 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.174377 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.174557 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.174646 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.174865 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.175122 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.175221 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.175452 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.175549 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.175765 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.175856 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.176074 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.176162 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.176380 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.176470 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.176692 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.176795 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.177009 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.177100 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.177344 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.177595 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.177699 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.177935 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.178033 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.178254 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.178389 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.178553 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.178643 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.178856 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.178947 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.179163 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.179262 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.179468 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.179559 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.179772 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.179875 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.180074 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.180173 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.180384 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.180482 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.180684 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.180794 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.180983 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.181104 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.181894 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.182003 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.182179 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.182285 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.182491 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.182588 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.182790 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.182880 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.183094 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.183183 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.183394 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.183481 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.183698 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.183787 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.184003 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.184100 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.184305 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.184402 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.184602 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.184692 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.184901 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.185000 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.185204 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.185293 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.185546 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.185651 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.185859 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.185957 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.186180 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.186271 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.186488 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.186587 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.186795 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.186886 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.187092 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.187180 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.187394 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.187492 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.187700 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.187797 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.188000 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.188098 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.188299 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.188398 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.188603 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.188710 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.188907 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.188999 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.189203 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.189294 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.189533 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.189628 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.189841 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.189931 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.190147 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.190238 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.190456 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.190554 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.190755 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.190856 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.191059 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.191151 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.191359 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.191450 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.191658 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.191746 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.191962 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.192053 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.192262 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.192359 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.192562 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.192665 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.192866 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.192956 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.193169 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.193259 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.193486 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.193596 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.193794 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.193882 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.194090 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.194179 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.194401 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.194500 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.194702 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.194792 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.195000 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.195098 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.195298 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.195397 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.195601 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.195692 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.195900 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.195989 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.196196 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.196286 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.196496 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.196593 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.196870 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.196963 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.197176 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.197292 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.197499 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.197629 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.197807 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.197936 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.198105 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.198247 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.198405 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.198556 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.198711 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.198860 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.199029 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.199182 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.199339 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.199494 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.199640 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.199800 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.199945 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.200104 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.200249 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.200413 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.200551 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.200716 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.200852 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.201021 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.201157 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.201331 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.201496 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.201676 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.201768 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.201995 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.202087 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.202301 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.202392 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.202612 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.202704 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.203179 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.203318 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.203484 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.203583 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.203785 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.203883 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.204085 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.204173 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.204386 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.204485 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.204687 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.204777 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.204989 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.205080 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.205293 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.205392 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.205618 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.205710 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.205939 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.206029 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.206247 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.206351 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.206555 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.206645 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.206859 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.206948 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.207165 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.207256 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.207463 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.207553 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.207774 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.207865 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.208083 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.208182 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.208393 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.208484 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.208693 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.208783 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.208993 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.209084 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.209310 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.209400 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.209645 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.209737 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.209954 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.210054 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.210256 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.210345 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.210573 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.210673 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.210885 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.210984 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.211180 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.211269 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.211485 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.211584 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.211786 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.211883 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.212087 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.212176 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.212931 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.213081 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.213237 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.213375 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.213581 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.213699 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.213905 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.214005 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.214230 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.214321 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.214537 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.214628 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.214851 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.214950 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.215163 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.215263 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.215476 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.215568 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.215778 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.215877 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.216080 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.216171 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.216389 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.216478 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.216692 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.216782 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.216993 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.217082 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.217299 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.217391 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.217624 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.217725 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.217928 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.218018 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.218226 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.218316 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.218534 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.218645 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.218838 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.218955 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.219162 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.219262 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.219469 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.219561 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.219774 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.219864 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.220083 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.220183 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.220387 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.220487 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.220698 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.220788 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.221002 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.221106 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.221480 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.221574 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.221758 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.221848 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.222066 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.222173 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.222370 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.222459 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.222670 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.222767 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.222973 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.223064 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.223279 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.223369 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.223590 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.223686 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.223890 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.223979 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.224188 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.224305 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.224488 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.224620 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.224805 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.224940 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.225104 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.225254 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.225406 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.225585 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.225836 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.225928 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.226143 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.226233 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.226443 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.226611 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.226789 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.226886 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.227094 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.227185 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.227398 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.227521 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.227720 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.227820 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.228087 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.228667 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.228905 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.229192 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.229324 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.229535 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.229665 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.229856 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.229949 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.230169 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.230361 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.230493 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.230673 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.230814 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.230985 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.231131 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.231307 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.231446 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.231629 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.231757 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.231953 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.232045 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.232260 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.232351 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.232572 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.232663 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.232881 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.232971 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.233204 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.233362 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.233547 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.233709 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.233858 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.234020 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.234172 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.234341 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.234476 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.234664 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.234803 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.234970 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.235123 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.235273 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.235437 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.235564 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.235758 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.235867 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.236161 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.236252 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.236481 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.236572 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.236784 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.236883 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.237095 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.237194 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.237402 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.237560 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.237730 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.237902 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.238032 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.238123 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.238334 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.238433 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.238640 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.238744 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.238942 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.239039 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.239260 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.239352 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.239565 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.239656 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.239879 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.239970 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.240192 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.240282 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.240491 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.240582 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.240793 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.240882 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.241097 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.241195 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.241398 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.241545 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.241721 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.241812 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.242025 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.242115 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.242339 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.242431 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.242653 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.242742 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.242970 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.243070 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.243274 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.243371 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.243607 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.243745 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.244020 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.244124 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.244406 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.244497 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.244718 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.244817 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.245030 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.245135 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.245345 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.245455 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.245693 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.245783 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.246013 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.246116 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.246317 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.246415 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.246619 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.246710 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.246929 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.247020 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.247231 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.247329 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.247585 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.247687 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.247837 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.247929 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.248147 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.248237 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.248450 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.248540 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.248754 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.248859 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.249057 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.249156 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.249377 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.249521 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.249703 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.249796 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.250010 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.250107 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.250317 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.250416 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.250620 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.250709 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.250923 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.251013 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.251227 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.251325 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.251533 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.251624 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.251840 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.251969 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.252162 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.252260 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.252465 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.252555 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.252779 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.252876 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.253088 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.253191 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.253396 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.253559 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.253729 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.253856 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.254037 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.254129 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.254349 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.254438 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.254662 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.254754 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.254975 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.255067 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.255280 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.255371 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.255595 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.255687 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.255907 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.256006 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.256220 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.256311 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.256535 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.256739 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.256841 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.257069 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.257162 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.257382 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.257503 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.257723 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.257815 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.258036 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.258127 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.258350 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.258455 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.258665 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.258764 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.258977 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.259069 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.259346 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.259591 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.259699 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.259955 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.260047 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.260284 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.260375 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.260604 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.260697 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.260926 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.261017 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.261265 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.261358 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.261606 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.261701 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.261921 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.262010 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.262235 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.262325 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.262549 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.262640 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.262864 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.262956 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.263197 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.263297 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.263498 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.263588 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.263810 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.263939 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.264122 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.264224 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.264436 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.264528 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.264745 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.264845 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.265053 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.265147 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.265366 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.265504 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.265708 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.265800 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.266016 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.266109 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.266323 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.266414 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.266635 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.266726 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.266947 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.267048 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.267260 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.267349 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.267577 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.267682 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.267890 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.267981 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.268201 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.268293 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.268513 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.268612 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.268826 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.268915 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.269135 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.269343 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.269460 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.269755 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.269848 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.270085 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.270175 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.270407 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.270505 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.270729 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.270833 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.271041 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.271131 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.271358 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.271458 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.271674 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.271766 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.271977 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.272196 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.272294 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.272517 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.272608 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.272851 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.272955 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.273159 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.273248 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.273498 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.273604 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.273808 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.273900 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.274112 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.274216 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.274426 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.274524 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.274735 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.274827 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.275567 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.275877 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.275982 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.276184 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.276283 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.276490 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.276581 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.276812 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.276904 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.277124 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.277222 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.277443 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.277549 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.277771 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.277864 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.278083 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.278175 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.278459 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.278618 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.278769 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.278963 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.279090 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.279280 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.279403 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.279605 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.279695 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.279929 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.280021 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.280246 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.280337 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.280554 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.280655 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.280878 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.280970 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.281185 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.281284 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.281510 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.281605 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.281831 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.281934 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.282136 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.282240 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.282438 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.282528 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.282740 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.282829 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.283047 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.283146 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.283350 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.283440 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.283651 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.283751 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.283951 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.284054 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.284254 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.284351 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.284561 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.284652 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.284864 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.284956 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.285172 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.285261 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.285496 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.285589 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.285842 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.285942 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.286114 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.286206 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.286419 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.286510 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.286725 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.286817 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.287028 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.287119 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.287330 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.287426 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.287631 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.287731 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.287939 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.288028 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.288243 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.288333 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.288557 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.288649 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.288866 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.288945 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.289179 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.289278 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.289522 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.289614 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.289847 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.289950 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.290155 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.290374 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.290492 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.291314 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.291414 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.291643 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.291747 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.291974 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.292067 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.292306 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.292445 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.292611 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.292703 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.292918 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.293010 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.293223 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.293316 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.293575 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.293806 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.293908 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.294144 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.294286 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.294467 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.294572 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.294773 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.294864 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.295080 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.295179 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.295388 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.295480 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.295696 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.295797 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.296003 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.296096 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.296310 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.296415 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.296617 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.296710 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.296924 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.297016 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.297230 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.297398 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.297564 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.297652 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.297859 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.297958 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.298169 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.298268 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.298481 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.298722 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.298819 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.298903 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.299088 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.299189 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.299400 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.299499 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.299712 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.299810 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.300019 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.300119 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.300326 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.300416 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.300631 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.300721 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.300939 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.301032 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.301253 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.301344 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.301602 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.301715 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.301919 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.302011 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.302224 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.302315 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.302547 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.302855 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.303057 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.303149 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.303234 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.303462 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.303554 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.303773 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.303873 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.304092 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.304183 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.304411 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.304503 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.304726 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.304816 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.305032 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.305177 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.305348 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.305680 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.305773 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.306007 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.306130 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.306380 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.306489 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.306708 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.306801 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.307024 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.307115 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.307350 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.307441 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.307676 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.307777 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.307977 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.308067 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.308286 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.308386 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.308602 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.308701 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.308911 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.309003 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.309212 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.309310 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.309537 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.309633 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.309847 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.309947 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.310149 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.310252 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.310453 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.310545 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.310753 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.310845 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.311054 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.311153 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.311360 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.311452 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.311666 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.311765 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.311966 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.312059 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.312265 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.312366 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.312564 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.312655 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.312864 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.312956 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.313164 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.313255 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.313490 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.313584 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.313795 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.313900 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.314096 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.314195 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.314396 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.314497 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.314696 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.314798 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.314996 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.315088 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.315300 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.315403 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.315605 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.315697 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.315909 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.315999 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.316264 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.316371 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.316524 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.316616 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.316831 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.316923 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.317137 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.317242 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.317462 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.317557 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.317770 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.317860 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.318083 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.318174 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.318389 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.318480 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.318718 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.318810 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.319027 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.319119 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.319338 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.319429 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.319646 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.319738 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.319954 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.320054 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.320258 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.320351 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.320562 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.320655 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.320880 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.320970 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.321191 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.321283 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.321513 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.321619 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.321901 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.321995 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.322219 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.322308 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.322534 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.322634 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.322847 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.322947 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.323159 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.323250 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.323471 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.323571 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.323798 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.323889 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.324106 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.324195 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.324417 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.324557 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.324727 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.324818 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.325035 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.325126 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.325347 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.325460 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.325684 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.325788 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.325994 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.326093 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.326309 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.326404 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.326620 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.326721 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.326933 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.327033 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.327244 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.327335 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.327548 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.327638 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.328102 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.328210 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.328427 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.328518 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.328740 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.328830 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.329051 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.329151 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.329367 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.329518 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.329707 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.329798 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.330019 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.330117 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.330331 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.330423 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.330634 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.330725 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.330873 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 20:54:42.330966 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.331268 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.331615 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.331931 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.332274 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.332605 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.332920 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.333233 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.333558 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:54:42.333805 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 20:54:42.484839 n-d-860282-1 devstack@n-api.service[106668]: INFO dbcounter [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] Registered counter for database nova_api Oct 04 20:54:42.487295 n-d-860282-1 devstack@n-api.service[106669]: INFO dbcounter [None req-f59787b5-a696-4489-b119-312e5271e4b9 None None] Registered counter for database nova_api Oct 04 20:54:42.505635 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_db.sqlalchemy.engines [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106668) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:54:42.507428 n-d-860282-1 devstack@n-api.service[106669]: DEBUG oslo_db.sqlalchemy.engines [None req-f59787b5-a696-4489-b119-312e5271e4b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:54:42.512470 n-d-860282-1 devstack@n-api.service[106668]: DEBUG dbcounter [-] [106668] Writer thread running {{(pid=106668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:54:42.513887 n-d-860282-1 devstack@n-api.service[106669]: DEBUG dbcounter [-] [106669] Writer thread running {{(pid=106669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:54:42.570362 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.context [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),016bade6-ba85-4482-99c1-a6ee7c8937c1(cell1) {{(pid=106668) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 20:54:42.573326 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.context [None req-f59787b5-a696-4489-b119-312e5271e4b9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),016bade6-ba85-4482-99c1-a6ee7c8937c1(cell1) {{(pid=106669) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 20:54:42.574440 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_concurrency.lockutils [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:42.574918 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_concurrency.lockutils [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:42.576477 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_concurrency.lockutils [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:42.577153 n-d-860282-1 devstack@n-api.service[106669]: DEBUG oslo_concurrency.lockutils [None req-f59787b5-a696-4489-b119-312e5271e4b9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:42.577249 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_concurrency.lockutils [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:42.577659 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_concurrency.lockutils [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:42.577756 n-d-860282-1 devstack@n-api.service[106669]: DEBUG oslo_concurrency.lockutils [None req-f59787b5-a696-4489-b119-312e5271e4b9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:42.579480 n-d-860282-1 devstack@n-api.service[106669]: DEBUG oslo_concurrency.lockutils [None req-f59787b5-a696-4489-b119-312e5271e4b9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:42.579885 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_concurrency.lockutils [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:42.580330 n-d-860282-1 devstack@n-api.service[106669]: DEBUG oslo_concurrency.lockutils [None req-f59787b5-a696-4489-b119-312e5271e4b9 None None] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:42.580775 n-d-860282-1 devstack@n-api.service[106669]: DEBUG oslo_concurrency.lockutils [None req-f59787b5-a696-4489-b119-312e5271e4b9 None None] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:42.581944 n-d-860282-1 devstack@n-api.service[106668]: INFO dbcounter [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] Registered counter for database nova_cell0 Oct 04 20:54:42.582785 n-d-860282-1 devstack@n-api.service[106669]: DEBUG oslo_concurrency.lockutils [None req-f59787b5-a696-4489-b119-312e5271e4b9 None None] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:42.584843 n-d-860282-1 devstack@n-api.service[106669]: INFO dbcounter [None req-f59787b5-a696-4489-b119-312e5271e4b9 None None] Registered counter for database nova_cell0 Oct 04 20:54:42.585945 n-d-860282-1 devstack@n-api.service[106668]: INFO dbcounter [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] Registered counter for database nova_cell1 Oct 04 20:54:42.589631 n-d-860282-1 devstack@n-api.service[106669]: INFO dbcounter [None req-f59787b5-a696-4489-b119-312e5271e4b9 None None] Registered counter for database nova_cell1 Oct 04 20:54:42.596312 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_db.sqlalchemy.engines [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106668) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:54:42.597167 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_db.sqlalchemy.engines [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106668) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:54:42.597624 n-d-860282-1 devstack@n-api.service[106669]: DEBUG oslo_db.sqlalchemy.engines [None req-f59787b5-a696-4489-b119-312e5271e4b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:54:42.598895 n-d-860282-1 devstack@n-api.service[106669]: DEBUG oslo_db.sqlalchemy.engines [None req-f59787b5-a696-4489-b119-312e5271e4b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:54:42.604165 n-d-860282-1 devstack@n-api.service[106668]: DEBUG dbcounter [-] [106668] Writer thread running {{(pid=106668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:54:42.608373 n-d-860282-1 devstack@n-api.service[106669]: DEBUG dbcounter [-] [106669] Writer thread running {{(pid=106669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:54:42.610674 n-d-860282-1 devstack@n-api.service[106669]: DEBUG dbcounter [-] [106669] Writer thread running {{(pid=106669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:54:42.751276 n-d-860282-1 devstack@n-api.service[106668]: DEBUG dbcounter [-] [106668] Writer thread running {{(pid=106668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:54:42.761052 n-d-860282-1 devstack@n-api.service[106668]: INFO dbcounter [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] Registered counter for database nova_cell0 Oct 04 20:54:42.767852 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_db.sqlalchemy.engines [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106668) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:54:42.772266 n-d-860282-1 devstack@n-api.service[106668]: DEBUG dbcounter [-] [106668] Writer thread running {{(pid=106668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:54:42.773156 n-d-860282-1 devstack@n-api.service[106669]: INFO dbcounter [None req-f59787b5-a696-4489-b119-312e5271e4b9 None None] Registered counter for database nova_cell0 Oct 04 20:54:42.782895 n-d-860282-1 devstack@n-api.service[106669]: DEBUG oslo_db.sqlalchemy.engines [None req-f59787b5-a696-4489-b119-312e5271e4b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:54:42.787994 n-d-860282-1 devstack@n-api.service[106669]: DEBUG dbcounter [-] [106669] Writer thread running {{(pid=106669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:54:43.221637 n-d-860282-1 devstack@n-api.service[106668]: WARNING keystonemiddleware.auth_token [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:54:43.229686 n-d-860282-1 devstack@n-api.service[106668]: WARNING keystonemiddleware.auth_token [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:54:43.240114 n-d-860282-1 devstack@n-api.service[106669]: WARNING keystonemiddleware.auth_token [None req-f59787b5-a696-4489-b119-312e5271e4b9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:54:43.247601 n-d-860282-1 devstack@n-api.service[106669]: WARNING keystonemiddleware.auth_token [None req-f59787b5-a696-4489-b119-312e5271e4b9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:54:43.577155 n-d-860282-1 devstack@n-api.service[106668]: WARNING keystonemiddleware.auth_token [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:54:43.583450 n-d-860282-1 devstack@n-api.service[106668]: WARNING keystonemiddleware.auth_token [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:54:43.589492 n-d-860282-1 devstack@n-api.service[106668]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d9d7fd99c0 pid: 106668 (default app) Oct 04 20:54:43.591614 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:43.592810 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001715 Oct 04 20:54:43.593229 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Tue Oct 4 20:54:43 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:43.601081 n-d-860282-1 devstack@n-api.service[106669]: WARNING keystonemiddleware.auth_token [None req-f59787b5-a696-4489-b119-312e5271e4b9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:54:43.607486 n-d-860282-1 devstack@n-api.service[106669]: WARNING keystonemiddleware.auth_token [None req-f59787b5-a696-4489-b119-312e5271e4b9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:54:43.613106 n-d-860282-1 devstack@n-api.service[106669]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d9d7fd99c0 pid: 106669 (default app) Oct 04 20:56:08.794327 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:08.795926 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002036 Oct 04 20:56:08.796498 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 931 bytes} [Tue Oct 4 20:56:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:08.812288 n-d-860282-1 devstack@n-api.service[106669]: DEBUG dbcounter [-] [106669] Writing DB stats nova_api:SELECT=3 {{(pid=106669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:08.813337 n-d-860282-1 devstack@n-api.service[106669]: DEBUG dbcounter [-] [106669] Writing DB stats nova_cell1:SELECT=3 {{(pid=106669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:08.814479 n-d-860282-1 devstack@n-api.service[106669]: DEBUG dbcounter [-] [106669] Writing DB stats nova_cell0:SELECT=3 {{(pid=106669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:08.815517 n-d-860282-1 devstack@n-api.service[106669]: DEBUG dbcounter [-] [106669] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:09.690150 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-b62f70ec-3abb-4bec-978d-5257b48c4c45 admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:09.722239 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-b62f70ec-3abb-4bec-978d-5257b48c4c45 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.918712 Oct 04 20:56:09.723037 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Oct 4 20:56:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:12.381967 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:12.383104 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-cf241b44-9d57-4f8d-af38-e73e076764e1 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 04 20:56:12.383500 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 931 bytes} [Tue Oct 4 20:56:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:12.846996 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-3e366c0c-7fc7-4cc5-9b42-e1d6230eb557 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256"}} {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:12.967587 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-3e366c0c-7fc7-4cc5-9b42-e1d6230eb557 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.577968 Oct 04 20:56:12.968157 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Oct 4 20:56:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:56:12.983982 n-d-860282-1 devstack@n-api.service[106668]: DEBUG dbcounter [-] [106668] Writing DB stats nova_api:SELECT=3 {{(pid=106668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:12.984790 n-d-860282-1 devstack@n-api.service[106668]: DEBUG dbcounter [-] [106668] Writing DB stats nova_cell0:SELECT=3 {{(pid=106668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:12.985536 n-d-860282-1 devstack@n-api.service[106668]: DEBUG dbcounter [-] [106668] Writing DB stats nova_cell1:SELECT=3 {{(pid=106668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:12.986275 n-d-860282-1 devstack@n-api.service[106668]: DEBUG dbcounter [-] [106668] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:13.192888 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-91a1264b-bd69-4c6b-812c-451c4cd39bb7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:13.322922 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-91a1264b-bd69-4c6b-812c-451c4cd39bb7 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.346169 Oct 04 20:56:13.323539 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Oct 4 20:56:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:56:16.032096 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-3e366c0c-7fc7-4cc5-9b42-e1d6230eb557 admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:16.033130 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-3e366c0c-7fc7-4cc5-9b42-e1d6230eb557 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Oct 04 20:56:16.033931 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 931 bytes} [Tue Oct 4 20:56:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:16.946059 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-fb07ee60-4a7a-46b9-8f4d-0c31cada817f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "rxtx_factor": 1.0}} {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:17.088999 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-fb07ee60-4a7a-46b9-8f4d-0c31cada817f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.048363 Oct 04 20:56:17.090276 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Oct 4 20:56:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:56:17.103154 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-527753a4-2e33-4e6c-82eb-4a1e01d29f36 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:17.244115 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-527753a4-2e33-4e6c-82eb-4a1e01d29f36 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.144588 Oct 04 20:56:17.267231 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Oct 4 20:56:17 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:20.190020 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-fb07ee60-4a7a-46b9-8f4d-0c31cada817f admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:20.191036 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-fb07ee60-4a7a-46b9-8f4d-0c31cada817f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 04 20:56:20.191605 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 931 bytes} [Tue Oct 4 20:56:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:20.644600 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-3327d60a-dd50-40ea-948e-89ce917bb9c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d2", "vcpus": 1, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:20.746892 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-3327d60a-dd50-40ea-948e-89ce917bb9c8 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.547617 Oct 04 20:56:20.748084 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Oct 4 20:56:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:56:20.760128 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-f2146bda-70a7-4b5f-8a58-6681e959c790 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:20.854000 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-f2146bda-70a7-4b5f-8a58-6681e959c790 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097903 Oct 04 20:56:20.855039 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Oct 4 20:56:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:23.498539 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-3327d60a-dd50-40ea-948e-89ce917bb9c8 admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:23.499509 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-3327d60a-dd50-40ea-948e-89ce917bb9c8 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Oct 04 20:56:23.499919 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 931 bytes} [Tue Oct 4 20:56:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:23.988033 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-4724e931-6ced-4244-8c31-77f84cd4a786 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:24.080814 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-4724e931-6ced-4244-8c31-77f84cd4a786 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.571918 Oct 04 20:56:24.081575 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Oct 4 20:56:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:56:24.094565 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-68ff58db-58aa-4171-9b57-3bfb770a0002 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:24.203869 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-68ff58db-58aa-4171-9b57-3bfb770a0002 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113062 Oct 04 20:56:24.204882 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Oct 4 20:56:24 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:26.965975 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-4724e931-6ced-4244-8c31-77f84cd4a786 admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:26.967834 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-4724e931-6ced-4244-8c31-77f84cd4a786 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002326 Oct 04 20:56:26.974229 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 931 bytes} [Tue Oct 4 20:56:26 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:27.494859 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-f8a66613-491d-41de-9b4e-cd4e14a443fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:27.581362 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-f8a66613-491d-41de-9b4e-cd4e14a443fa admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.605574 Oct 04 20:56:27.584547 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Oct 4 20:56:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:56:27.595207 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-0e39f308-c631-454f-8f29-fbbc66ca5075 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:27.681777 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-0e39f308-c631-454f-8f29-fbbc66ca5075 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090216 Oct 04 20:56:27.696376 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Oct 4 20:56:27 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:56:30.450157 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-f8a66613-491d-41de-9b4e-cd4e14a443fa admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:30.451445 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-f8a66613-491d-41de-9b4e-cd4e14a443fa admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002052 Oct 04 20:56:30.452016 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 931 bytes} [Tue Oct 4 20:56:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:56:30.880612 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-9518e366-696e-414c-897c-a46ae8f836b2 admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:30.905931 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-9518e366-696e-414c-897c-a46ae8f836b2 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.447698 Oct 04 20:56:30.906402 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Oct 4 20:56:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:33.548565 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-f8a66613-491d-41de-9b4e-cd4e14a443fa admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:33.549630 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-f8a66613-491d-41de-9b4e-cd4e14a443fa admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 04 20:56:33.550050 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 931 bytes} [Tue Oct 4 20:56:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:33.967198 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-73b7d8c1-abba-4520-8d25-4c66085548d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:34.050729 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-73b7d8c1-abba-4520-8d25-4c66085548d0 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.493431 Oct 04 20:56:34.051349 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Oct 4 20:56:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:56:34.068514 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-ef56cfd0-15b3-4c9b-bfdb-4e6a9b52f168 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:34.153716 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-ef56cfd0-15b3-4c9b-bfdb-4e6a9b52f168 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091904 Oct 04 20:56:34.154669 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Oct 4 20:56:34 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:36.837687 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-73b7d8c1-abba-4520-8d25-4c66085548d0 admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:36.838622 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-73b7d8c1-abba-4520-8d25-4c66085548d0 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 04 20:56:36.839023 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 931 bytes} [Tue Oct 4 20:56:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:37.249690 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-45d01600-55dd-4bba-8660-8598098cc7aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "id": "2", "name": "m1.small", "swap": 0}} {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:37.320769 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-45d01600-55dd-4bba-8660-8598098cc7aa admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.475453 Oct 04 20:56:37.321351 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Oct 4 20:56:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:56:37.334838 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-9456868a-72f7-42e5-9df2-34ab73df2df2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:37.416537 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-9456868a-72f7-42e5-9df2-34ab73df2df2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085546 Oct 04 20:56:37.417041 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Oct 4 20:56:37 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:40.057269 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-45d01600-55dd-4bba-8660-8598098cc7aa admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:40.058324 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-45d01600-55dd-4bba-8660-8598098cc7aa admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 04 20:56:40.058732 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 931 bytes} [Tue Oct 4 20:56:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:40.426358 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-6325a78c-c5e3-41d8-9a38-80ceb25ef7ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "id": "3"}} {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:40.535503 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-6325a78c-c5e3-41d8-9a38-80ceb25ef7ee admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.470517 Oct 04 20:56:40.538630 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Oct 4 20:56:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:56:40.561250 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-11e169a9-fc18-4029-b530-672a1464f539 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:40.566510 n-d-860282-1 devstack@n-api.service[106669]: DEBUG dbcounter [-] [106669] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:41.475334 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-11e169a9-fc18-4029-b530-672a1464f539 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.924022 Oct 04 20:56:41.476002 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Oct 4 20:56:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:44.140964 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-6325a78c-c5e3-41d8-9a38-80ceb25ef7ee admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:44.142626 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-6325a78c-c5e3-41d8-9a38-80ceb25ef7ee admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002103 Oct 04 20:56:44.143031 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 931 bytes} [Tue Oct 4 20:56:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:44.594274 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-31f20bb7-efd0-44b8-9f37-07a308ce4f41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "id": "4", "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:44.683060 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-31f20bb7-efd0-44b8-9f37-07a308ce4f41 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.533792 Oct 04 20:56:44.683524 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Oct 4 20:56:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:56:44.697464 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-e029703f-93fe-4386-bd61-95d2b9e05724 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:44.703071 n-d-860282-1 devstack@n-api.service[106668]: DEBUG dbcounter [-] [106668] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:44.783215 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-e029703f-93fe-4386-bd61-95d2b9e05724 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091050 Oct 04 20:56:44.783815 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Oct 4 20:56:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:47.420233 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-31f20bb7-efd0-44b8-9f37-07a308ce4f41 admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:47.421261 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-31f20bb7-efd0-44b8-9f37-07a308ce4f41 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 04 20:56:47.421957 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 931 bytes} [Tue Oct 4 20:56:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:47.881748 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-9a59133a-92de-4d4f-a23a-473f1ca6ed41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "ram": 16384, "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge"}} {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:47.968395 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-9a59133a-92de-4d4f-a23a-473f1ca6ed41 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.540610 Oct 04 20:56:47.969196 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Oct 4 20:56:47 2022] POST /compute/v2.1/flavors => generated 408 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:56:47.980982 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-c3a96224-e09d-405d-a81d-1a13808356c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:48.064023 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-c3a96224-e09d-405d-a81d-1a13808356c3 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086615 Oct 04 20:56:48.064881 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Oct 4 20:56:47 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:57:08.172642 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-9a59133a-92de-4d4f-a23a-473f1ca6ed41 admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:08.173694 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-9a59133a-92de-4d4f-a23a-473f1ca6ed41 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 04 20:57:08.174149 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 931 bytes} [Tue Oct 4 20:57:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:08.184834 n-d-860282-1 devstack@n-api.service[106669]: DEBUG dbcounter [-] [106669] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:08.575760 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-0245360c-f1d2-404b-9261-c87e34033e37 admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:08.594396 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-0245360c-f1d2-404b-9261-c87e34033e37 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.414054 Oct 04 20:57:08.599115 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Oct 4 20:57:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:57:09.925080 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-9a59133a-92de-4d4f-a23a-473f1ca6ed41 admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:09.926110 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-9a59133a-92de-4d4f-a23a-473f1ca6ed41 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 04 20:57:09.926501 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Oct 4 20:57:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:10.468921 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-fdc50e5a-ce84-46cf-a624-dea086722b69 admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:10.474241 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.wsgi [None req-fdc50e5a-ce84-46cf-a624-dea086722b69 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-fdc50e5a-ce84-46cf-a624-dea086722b69 admin admin] Request method failure captured: Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: Accept: application/json Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: Accept-Encoding: gzip, deflate Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: Connection: keep-alive Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: Content-Length: 0 Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: Host: 10.222.0.30 Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: Openstack-Api-Version: compute 2.92 Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: Openstack-System-Scope: None Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: User-Agent: python-novaclient Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: X-Auth-Token: gAAAAABjPJ4lDczGsNYA7up3lX_Ho3vGSAmdz8HKDrBe7lbyfK-iYMvgn6A7ku8NWNpB_iAcsOeRDmJS9s2cPZslFS88Hv-TseL7-979DpuxSkoDnl7yQ7L3gaLNuuYFqjVWCKQmOh_qWdklkREvolIkdR1rDAoVtgCwyRLNp9ht-lQVOT2dAY4 Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: X-Domain-Id: None Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: X-Domain-Name: None Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: X-Identity-Status: Confirmed Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: X-Is-Admin-Project: True Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: X-Project-Domain-Id: default Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: X-Project-Domain-Name: Default Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: X-Project-Id: ee2cb706aa794d5caddeca9e51a50aa9 Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: X-Project-Name: admin Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: X-Role: reader,member,admin Oct 04 20:57:10.477415 n-d-860282-1 devstack@n-api.service[106669]: X-Roles: reader,member,admin Oct 04 20:57:10.479219 n-d-860282-1 devstack@n-api.service[106669]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ee2cb706aa794d5caddeca9e51a50aa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ee2cb706aa794d5caddeca9e51a50aa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ee2cb706aa794d5caddeca9e51a50aa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ee2cb706aa794d5caddeca9e51a50aa9"}]}] Oct 04 20:57:10.479219 n-d-860282-1 devstack@n-api.service[106669]: X-Tenant: admin Oct 04 20:57:10.479219 n-d-860282-1 devstack@n-api.service[106669]: X-Tenant-Id: ee2cb706aa794d5caddeca9e51a50aa9 Oct 04 20:57:10.479219 n-d-860282-1 devstack@n-api.service[106669]: X-Tenant-Name: admin Oct 04 20:57:10.479219 n-d-860282-1 devstack@n-api.service[106669]: X-User: admin Oct 04 20:57:10.479219 n-d-860282-1 devstack@n-api.service[106669]: X-User-Domain-Id: default Oct 04 20:57:10.479219 n-d-860282-1 devstack@n-api.service[106669]: X-User-Domain-Name: Default Oct 04 20:57:10.479219 n-d-860282-1 devstack@n-api.service[106669]: X-User-Id: bfd5700c1e884ccca16c0512dd2db79f Oct 04 20:57:10.479219 n-d-860282-1 devstack@n-api.service[106669]: X-User-Name: admin Oct 04 20:57:10.479219 n-d-860282-1 devstack@n-api.service[106669]: method: > Oct 04 20:57:10.479219 n-d-860282-1 devstack@n-api.service[106669]: exception: Flavor 42 could not be found. Oct 04 20:57:10.479219 n-d-860282-1 devstack@n-api.service[106669]: action_args: {'id': '42'} Oct 04 20:57:10.479219 n-d-860282-1 devstack@n-api.service[106669]: {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:10.479219 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:10.480462 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:57:10.480462 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:57:10.480462 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:57:10.480462 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:57:10.480462 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:57:10.480462 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:57:10.480462 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:57:10.480462 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:57:10.480462 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:57:10.480462 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:10.480462 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:57:10.480462 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:57:10.480462 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 20:57:10.480462 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Oct 04 20:57:10.480462 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:10.480462 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Oct 04 20:57:10.480462 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:10.480462 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:10.480462 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:10.481919 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:10.481919 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:10.481919 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:10.481919 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:10.481919 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:57:10.481919 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:10.481919 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 20:57:10.481919 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Oct 04 20:57:10.481919 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:10.481919 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Oct 04 20:57:10.481919 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:10.481919 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:10.481919 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:10.481919 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:10.481919 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:10.481919 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 20:57:10.481919 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Oct 04 20:57:10.481919 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-fdc50e5a-ce84-46cf-a624-dea086722b69 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:10.483260 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-fdc50e5a-ce84-46cf-a624-dea086722b69 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.400567 Oct 04 20:57:10.483260 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Oct 4 20:57:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:57:10.488518 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-1dd9ea59-33ff-4905-a543-4483bbb38cab admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:10.493141 n-d-860282-1 devstack@n-api.service[106668]: DEBUG dbcounter [-] [106668] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:10.511858 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-1dd9ea59-33ff-4905-a543-4483bbb38cab admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026860 Oct 04 20:57:10.512395 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Oct 4 20:57:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:57:10.529537 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-b092ea9b-c661-41f3-8844-13d4a2795ba4 admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:10.551394 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-b092ea9b-c661-41f3-8844-13d4a2795ba4 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026376 Oct 04 20:57:10.551953 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Oct 4 20:57:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:57:10.562644 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-31e25f5c-4e60-4614-9709-7286ea9397a5 admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:10.568254 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.wsgi [None req-31e25f5c-4e60-4614-9709-7286ea9397a5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-31e25f5c-4e60-4614-9709-7286ea9397a5 admin admin] Request method failure captured: Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: Accept: application/json Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: Accept-Encoding: gzip, deflate Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: Connection: keep-alive Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: Content-Length: 0 Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: Host: 10.222.0.30 Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: Openstack-Api-Version: compute 2.92 Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: Openstack-System-Scope: None Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: User-Agent: python-novaclient Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: X-Auth-Token: gAAAAABjPJ4lDczGsNYA7up3lX_Ho3vGSAmdz8HKDrBe7lbyfK-iYMvgn6A7ku8NWNpB_iAcsOeRDmJS9s2cPZslFS88Hv-TseL7-979DpuxSkoDnl7yQ7L3gaLNuuYFqjVWCKQmOh_qWdklkREvolIkdR1rDAoVtgCwyRLNp9ht-lQVOT2dAY4 Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: X-Domain-Id: None Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: X-Domain-Name: None Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: X-Identity-Status: Confirmed Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: X-Is-Admin-Project: True Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: X-Project-Domain-Id: default Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: X-Project-Domain-Name: Default Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: X-Project-Id: ee2cb706aa794d5caddeca9e51a50aa9 Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: X-Project-Name: admin Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: X-Role: reader,member,admin Oct 04 20:57:10.572291 n-d-860282-1 devstack@n-api.service[106668]: X-Roles: reader,member,admin Oct 04 20:57:10.575780 n-d-860282-1 devstack@n-api.service[106668]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ee2cb706aa794d5caddeca9e51a50aa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ee2cb706aa794d5caddeca9e51a50aa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ee2cb706aa794d5caddeca9e51a50aa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ee2cb706aa794d5caddeca9e51a50aa9"}]}] Oct 04 20:57:10.575780 n-d-860282-1 devstack@n-api.service[106668]: X-Tenant: admin Oct 04 20:57:10.575780 n-d-860282-1 devstack@n-api.service[106668]: X-Tenant-Id: ee2cb706aa794d5caddeca9e51a50aa9 Oct 04 20:57:10.575780 n-d-860282-1 devstack@n-api.service[106668]: X-Tenant-Name: admin Oct 04 20:57:10.575780 n-d-860282-1 devstack@n-api.service[106668]: X-User: admin Oct 04 20:57:10.575780 n-d-860282-1 devstack@n-api.service[106668]: X-User-Domain-Id: default Oct 04 20:57:10.575780 n-d-860282-1 devstack@n-api.service[106668]: X-User-Domain-Name: Default Oct 04 20:57:10.575780 n-d-860282-1 devstack@n-api.service[106668]: X-User-Id: bfd5700c1e884ccca16c0512dd2db79f Oct 04 20:57:10.575780 n-d-860282-1 devstack@n-api.service[106668]: X-User-Name: admin Oct 04 20:57:10.575780 n-d-860282-1 devstack@n-api.service[106668]: method: > Oct 04 20:57:10.575780 n-d-860282-1 devstack@n-api.service[106668]: exception: Flavor 42 could not be found. Oct 04 20:57:10.575780 n-d-860282-1 devstack@n-api.service[106668]: action_args: {'id': '42'} Oct 04 20:57:10.575780 n-d-860282-1 devstack@n-api.service[106668]: {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:10.575780 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:10.576669 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:57:10.576669 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:57:10.576669 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:57:10.576669 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:57:10.576669 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:57:10.576669 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:57:10.576669 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:57:10.576669 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:57:10.576669 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:57:10.576669 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:10.576669 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:57:10.576669 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:57:10.576669 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 20:57:10.576669 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Oct 04 20:57:10.576669 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:10.576669 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Oct 04 20:57:10.576669 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:10.576669 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:10.576669 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:10.577824 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:10.577824 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:10.577824 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:10.577824 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:10.577824 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:57:10.577824 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:10.577824 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 20:57:10.577824 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Oct 04 20:57:10.577824 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:10.577824 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Oct 04 20:57:10.577824 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:10.577824 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:10.577824 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:10.577824 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:10.577824 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:10.577824 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 20:57:10.577824 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Oct 04 20:57:10.577824 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-31e25f5c-4e60-4614-9709-7286ea9397a5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:10.578885 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-31e25f5c-4e60-4614-9709-7286ea9397a5 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015149 Oct 04 20:57:10.578885 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Oct 4 20:57:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 20:57:11.796821 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-b092ea9b-c661-41f3-8844-13d4a2795ba4 admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:11.797872 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-b092ea9b-c661-41f3-8844-13d4a2795ba4 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 04 20:57:11.798280 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Oct 4 20:57:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:12.327689 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-d6743208-2f9f-44ba-a291-8f86d75468bf admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:12.332674 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.wsgi [None req-d6743208-2f9f-44ba-a291-8f86d75468bf admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-d6743208-2f9f-44ba-a291-8f86d75468bf admin admin] Request method failure captured: Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: Accept: application/json Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: Accept-Encoding: gzip, deflate Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: Connection: keep-alive Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: Content-Length: 0 Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: Host: 10.222.0.30 Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: Openstack-Api-Version: compute 2.92 Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: Openstack-System-Scope: None Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: User-Agent: python-novaclient Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: X-Auth-Token: gAAAAABjPJ4nM7mosRatASKwvwOT8fy3gTRKni8ipMyZUbCnrdOFBaQTl8aFcDyl7cZLvmwxs1wOt-vqf8rlia2xmLKNg0Vz7x7uvcejiXvyQMSJ8xT27cbNKxlqadks9hIolrzeKyc2BUcU1VsKF29zNcvbNprV1mkzVxQK-rdYvT002Jxt_x4 Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: X-Domain-Id: None Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: X-Domain-Name: None Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: X-Identity-Status: Confirmed Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: X-Is-Admin-Project: True Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: X-Project-Domain-Id: default Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: X-Project-Domain-Name: Default Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: X-Project-Id: ee2cb706aa794d5caddeca9e51a50aa9 Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: X-Project-Name: admin Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: X-Role: reader,member,admin Oct 04 20:57:12.334195 n-d-860282-1 devstack@n-api.service[106668]: X-Roles: reader,member,admin Oct 04 20:57:12.336361 n-d-860282-1 devstack@n-api.service[106668]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ee2cb706aa794d5caddeca9e51a50aa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ee2cb706aa794d5caddeca9e51a50aa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ee2cb706aa794d5caddeca9e51a50aa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ee2cb706aa794d5caddeca9e51a50aa9"}]}] Oct 04 20:57:12.336361 n-d-860282-1 devstack@n-api.service[106668]: X-Tenant: admin Oct 04 20:57:12.336361 n-d-860282-1 devstack@n-api.service[106668]: X-Tenant-Id: ee2cb706aa794d5caddeca9e51a50aa9 Oct 04 20:57:12.336361 n-d-860282-1 devstack@n-api.service[106668]: X-Tenant-Name: admin Oct 04 20:57:12.336361 n-d-860282-1 devstack@n-api.service[106668]: X-User: admin Oct 04 20:57:12.336361 n-d-860282-1 devstack@n-api.service[106668]: X-User-Domain-Id: default Oct 04 20:57:12.336361 n-d-860282-1 devstack@n-api.service[106668]: X-User-Domain-Name: Default Oct 04 20:57:12.336361 n-d-860282-1 devstack@n-api.service[106668]: X-User-Id: bfd5700c1e884ccca16c0512dd2db79f Oct 04 20:57:12.336361 n-d-860282-1 devstack@n-api.service[106668]: X-User-Name: admin Oct 04 20:57:12.336361 n-d-860282-1 devstack@n-api.service[106668]: method: > Oct 04 20:57:12.336361 n-d-860282-1 devstack@n-api.service[106668]: exception: Flavor 84 could not be found. Oct 04 20:57:12.336361 n-d-860282-1 devstack@n-api.service[106668]: action_args: {'id': '84'} Oct 04 20:57:12.336361 n-d-860282-1 devstack@n-api.service[106668]: {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:12.336361 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:12.337480 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:57:12.337480 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:57:12.337480 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:57:12.337480 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:57:12.337480 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:57:12.337480 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:57:12.337480 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:57:12.337480 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:57:12.337480 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:57:12.337480 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:12.337480 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:57:12.337480 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:57:12.337480 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 20:57:12.337480 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Oct 04 20:57:12.337480 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:12.337480 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Oct 04 20:57:12.337480 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:12.337480 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:12.337480 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:12.338914 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:12.338914 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:12.338914 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:12.338914 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:12.338914 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:57:12.338914 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:12.338914 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 20:57:12.338914 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Oct 04 20:57:12.338914 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:12.338914 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Oct 04 20:57:12.338914 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:12.338914 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:12.338914 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:12.338914 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:12.338914 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:12.338914 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 20:57:12.338914 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Oct 04 20:57:12.338914 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-d6743208-2f9f-44ba-a291-8f86d75468bf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:12.340208 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-d6743208-2f9f-44ba-a291-8f86d75468bf admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.398632 Oct 04 20:57:12.340208 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Oct 4 20:57:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:57:12.345851 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-c45da348-d42f-4fe7-9e49-5f475d49edef admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:12.360550 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-c45da348-d42f-4fe7-9e49-5f475d49edef admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018257 Oct 04 20:57:12.361109 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Oct 4 20:57:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:57:12.370464 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-7a4e581d-0b15-46cf-b7ba-741d42f8c645 admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:12.386583 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-7a4e581d-0b15-46cf-b7ba-741d42f8c645 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019734 Oct 04 20:57:12.387114 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Oct 4 20:57:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:57:12.396300 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-aae04b3b-04fe-4067-9f51-453a5e8e1c32 admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:12.401926 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.wsgi [None req-aae04b3b-04fe-4067-9f51-453a5e8e1c32 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-aae04b3b-04fe-4067-9f51-453a5e8e1c32 admin admin] Request method failure captured: Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: Accept: application/json Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: Accept-Encoding: gzip, deflate Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: Connection: keep-alive Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: Content-Length: 0 Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: Host: 10.222.0.30 Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: Openstack-Api-Version: compute 2.92 Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: Openstack-System-Scope: None Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: User-Agent: python-novaclient Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: X-Auth-Token: gAAAAABjPJ4nM7mosRatASKwvwOT8fy3gTRKni8ipMyZUbCnrdOFBaQTl8aFcDyl7cZLvmwxs1wOt-vqf8rlia2xmLKNg0Vz7x7uvcejiXvyQMSJ8xT27cbNKxlqadks9hIolrzeKyc2BUcU1VsKF29zNcvbNprV1mkzVxQK-rdYvT002Jxt_x4 Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: X-Domain-Id: None Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: X-Domain-Name: None Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: X-Identity-Status: Confirmed Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: X-Is-Admin-Project: True Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: X-Project-Domain-Id: default Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: X-Project-Domain-Name: Default Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: X-Project-Id: ee2cb706aa794d5caddeca9e51a50aa9 Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: X-Project-Name: admin Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: X-Role: reader,member,admin Oct 04 20:57:12.403426 n-d-860282-1 devstack@n-api.service[106669]: X-Roles: reader,member,admin Oct 04 20:57:12.404975 n-d-860282-1 devstack@n-api.service[106669]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ee2cb706aa794d5caddeca9e51a50aa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ee2cb706aa794d5caddeca9e51a50aa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ee2cb706aa794d5caddeca9e51a50aa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ee2cb706aa794d5caddeca9e51a50aa9"}]}] Oct 04 20:57:12.404975 n-d-860282-1 devstack@n-api.service[106669]: X-Tenant: admin Oct 04 20:57:12.404975 n-d-860282-1 devstack@n-api.service[106669]: X-Tenant-Id: ee2cb706aa794d5caddeca9e51a50aa9 Oct 04 20:57:12.404975 n-d-860282-1 devstack@n-api.service[106669]: X-Tenant-Name: admin Oct 04 20:57:12.404975 n-d-860282-1 devstack@n-api.service[106669]: X-User: admin Oct 04 20:57:12.404975 n-d-860282-1 devstack@n-api.service[106669]: X-User-Domain-Id: default Oct 04 20:57:12.404975 n-d-860282-1 devstack@n-api.service[106669]: X-User-Domain-Name: Default Oct 04 20:57:12.404975 n-d-860282-1 devstack@n-api.service[106669]: X-User-Id: bfd5700c1e884ccca16c0512dd2db79f Oct 04 20:57:12.404975 n-d-860282-1 devstack@n-api.service[106669]: X-User-Name: admin Oct 04 20:57:12.404975 n-d-860282-1 devstack@n-api.service[106669]: method: > Oct 04 20:57:12.404975 n-d-860282-1 devstack@n-api.service[106669]: exception: Flavor 84 could not be found. Oct 04 20:57:12.404975 n-d-860282-1 devstack@n-api.service[106669]: action_args: {'id': '84'} Oct 04 20:57:12.404975 n-d-860282-1 devstack@n-api.service[106669]: {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:12.404975 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:12.405920 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:57:12.405920 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:57:12.405920 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:57:12.405920 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:57:12.405920 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:57:12.405920 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:57:12.405920 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:57:12.405920 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:57:12.405920 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:57:12.405920 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:12.405920 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:57:12.405920 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:57:12.405920 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 20:57:12.405920 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Oct 04 20:57:12.405920 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:12.405920 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Oct 04 20:57:12.405920 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:12.405920 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:12.405920 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:12.407046 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:12.407046 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:12.407046 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:12.407046 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:12.407046 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:57:12.407046 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:12.407046 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 20:57:12.407046 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Oct 04 20:57:12.407046 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:12.407046 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Oct 04 20:57:12.407046 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:12.407046 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:12.407046 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:12.407046 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:12.407046 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:12.407046 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 20:57:12.407046 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Oct 04 20:57:12.407046 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-aae04b3b-04fe-4067-9f51-453a5e8e1c32 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:12.408078 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-aae04b3b-04fe-4067-9f51-453a5e8e1c32 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011955 Oct 04 20:57:12.408078 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Oct 4 20:57:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:57:13.652207 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-7a4e581d-0b15-46cf-b7ba-741d42f8c645 admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:13.653213 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-7a4e581d-0b15-46cf-b7ba-741d42f8c645 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 04 20:57:13.653646 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Oct 4 20:57:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:14.184694 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-1847dcad-f3d2-4575-b711-772aa8a5f33f admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:14.190574 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.wsgi [None req-1847dcad-f3d2-4575-b711-772aa8a5f33f admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-1847dcad-f3d2-4575-b711-772aa8a5f33f admin admin] Request method failure captured: Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: Accept: application/json Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: Accept-Encoding: gzip, deflate Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: Connection: keep-alive Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: Content-Length: 0 Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: Host: 10.222.0.30 Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: Openstack-Api-Version: compute 2.92 Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: Openstack-System-Scope: None Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: User-Agent: python-novaclient Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: X-Auth-Token: gAAAAABjPJ4p2fONEqaaFUPvq5TxtAGJxWAnThTZkaMWJ8hSLfHdNfqDtOlVhXbI5uZnggci1vHE4I49IuNPm4f11k6Dwciov38cqR1xNUsXe8YzctOhRcg4BeyOnmxvZL1WwcCvv6jARZq_QYmGHocvYUxeWEgV7Dlad5PVAQmaU2IaOQggocU Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: X-Domain-Id: None Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: X-Domain-Name: None Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: X-Identity-Status: Confirmed Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: X-Is-Admin-Project: True Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: X-Project-Domain-Id: default Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: X-Project-Domain-Name: Default Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: X-Project-Id: ee2cb706aa794d5caddeca9e51a50aa9 Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: X-Project-Name: admin Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: X-Role: reader,member,admin Oct 04 20:57:14.192065 n-d-860282-1 devstack@n-api.service[106669]: X-Roles: reader,member,admin Oct 04 20:57:14.193795 n-d-860282-1 devstack@n-api.service[106669]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ee2cb706aa794d5caddeca9e51a50aa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ee2cb706aa794d5caddeca9e51a50aa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ee2cb706aa794d5caddeca9e51a50aa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ee2cb706aa794d5caddeca9e51a50aa9"}]}] Oct 04 20:57:14.193795 n-d-860282-1 devstack@n-api.service[106669]: X-Tenant: admin Oct 04 20:57:14.193795 n-d-860282-1 devstack@n-api.service[106669]: X-Tenant-Id: ee2cb706aa794d5caddeca9e51a50aa9 Oct 04 20:57:14.193795 n-d-860282-1 devstack@n-api.service[106669]: X-Tenant-Name: admin Oct 04 20:57:14.193795 n-d-860282-1 devstack@n-api.service[106669]: X-User: admin Oct 04 20:57:14.193795 n-d-860282-1 devstack@n-api.service[106669]: X-User-Domain-Id: default Oct 04 20:57:14.193795 n-d-860282-1 devstack@n-api.service[106669]: X-User-Domain-Name: Default Oct 04 20:57:14.193795 n-d-860282-1 devstack@n-api.service[106669]: X-User-Id: bfd5700c1e884ccca16c0512dd2db79f Oct 04 20:57:14.193795 n-d-860282-1 devstack@n-api.service[106669]: X-User-Name: admin Oct 04 20:57:14.193795 n-d-860282-1 devstack@n-api.service[106669]: method: > Oct 04 20:57:14.193795 n-d-860282-1 devstack@n-api.service[106669]: exception: Flavor 451 could not be found. Oct 04 20:57:14.193795 n-d-860282-1 devstack@n-api.service[106669]: action_args: {'id': '451'} Oct 04 20:57:14.193795 n-d-860282-1 devstack@n-api.service[106669]: {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:14.193795 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:14.194912 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:57:14.194912 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:57:14.194912 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:57:14.194912 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:57:14.194912 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:57:14.194912 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:57:14.194912 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:57:14.194912 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:57:14.194912 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:57:14.194912 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:14.194912 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:57:14.194912 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:57:14.194912 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 20:57:14.194912 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Oct 04 20:57:14.194912 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:14.194912 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Oct 04 20:57:14.194912 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:14.194912 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:14.194912 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:14.196914 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:14.196914 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:14.196914 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:14.196914 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:14.196914 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:57:14.196914 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:14.196914 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 20:57:14.196914 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Oct 04 20:57:14.196914 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:14.196914 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Oct 04 20:57:14.196914 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:14.196914 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:14.196914 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:14.196914 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:14.196914 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:14.196914 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 20:57:14.196914 n-d-860282-1 devstack@n-api.service[106669]: ERROR nova.api.openstack.wsgi Oct 04 20:57:14.196914 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-1847dcad-f3d2-4575-b711-772aa8a5f33f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:14.198311 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-1847dcad-f3d2-4575-b711-772aa8a5f33f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.401789 Oct 04 20:57:14.198311 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Oct 4 20:57:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:57:14.204189 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-d48693a4-dd24-4eac-bfd7-783d3755e6f3 admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:14.219405 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-d48693a4-dd24-4eac-bfd7-783d3755e6f3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018909 Oct 04 20:57:14.219959 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Oct 4 20:57:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:57:14.229660 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-e3c1e921-b29a-4069-8039-7bc651dec701 admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:14.245634 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-e3c1e921-b29a-4069-8039-7bc651dec701 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019554 Oct 04 20:57:14.246240 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Oct 4 20:57:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:57:14.260030 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-cab26026-a073-47d0-851e-38b280576883 admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:14.266448 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.wsgi [None req-cab26026-a073-47d0-851e-38b280576883 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-cab26026-a073-47d0-851e-38b280576883 admin admin] Request method failure captured: Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: Accept: application/json Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: Accept-Encoding: gzip, deflate Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: Connection: keep-alive Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: Content-Length: 0 Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: Host: 10.222.0.30 Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: Openstack-Api-Version: compute 2.92 Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: Openstack-System-Scope: None Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: User-Agent: python-novaclient Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: X-Auth-Token: gAAAAABjPJ4p2fONEqaaFUPvq5TxtAGJxWAnThTZkaMWJ8hSLfHdNfqDtOlVhXbI5uZnggci1vHE4I49IuNPm4f11k6Dwciov38cqR1xNUsXe8YzctOhRcg4BeyOnmxvZL1WwcCvv6jARZq_QYmGHocvYUxeWEgV7Dlad5PVAQmaU2IaOQggocU Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: X-Domain-Id: None Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: X-Domain-Name: None Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: X-Identity-Status: Confirmed Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: X-Is-Admin-Project: True Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: X-Project-Domain-Id: default Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: X-Project-Domain-Name: Default Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: X-Project-Id: ee2cb706aa794d5caddeca9e51a50aa9 Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: X-Project-Name: admin Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: X-Role: reader,member,admin Oct 04 20:57:14.267974 n-d-860282-1 devstack@n-api.service[106668]: X-Roles: reader,member,admin Oct 04 20:57:14.269744 n-d-860282-1 devstack@n-api.service[106668]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ee2cb706aa794d5caddeca9e51a50aa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ee2cb706aa794d5caddeca9e51a50aa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ee2cb706aa794d5caddeca9e51a50aa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ee2cb706aa794d5caddeca9e51a50aa9"}]}] Oct 04 20:57:14.269744 n-d-860282-1 devstack@n-api.service[106668]: X-Tenant: admin Oct 04 20:57:14.269744 n-d-860282-1 devstack@n-api.service[106668]: X-Tenant-Id: ee2cb706aa794d5caddeca9e51a50aa9 Oct 04 20:57:14.269744 n-d-860282-1 devstack@n-api.service[106668]: X-Tenant-Name: admin Oct 04 20:57:14.269744 n-d-860282-1 devstack@n-api.service[106668]: X-User: admin Oct 04 20:57:14.269744 n-d-860282-1 devstack@n-api.service[106668]: X-User-Domain-Id: default Oct 04 20:57:14.269744 n-d-860282-1 devstack@n-api.service[106668]: X-User-Domain-Name: Default Oct 04 20:57:14.269744 n-d-860282-1 devstack@n-api.service[106668]: X-User-Id: bfd5700c1e884ccca16c0512dd2db79f Oct 04 20:57:14.269744 n-d-860282-1 devstack@n-api.service[106668]: X-User-Name: admin Oct 04 20:57:14.269744 n-d-860282-1 devstack@n-api.service[106668]: method: > Oct 04 20:57:14.269744 n-d-860282-1 devstack@n-api.service[106668]: exception: Flavor 451 could not be found. Oct 04 20:57:14.269744 n-d-860282-1 devstack@n-api.service[106668]: action_args: {'id': '451'} Oct 04 20:57:14.269744 n-d-860282-1 devstack@n-api.service[106668]: {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:14.269744 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:14.270830 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:57:14.270830 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:57:14.270830 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:57:14.270830 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:57:14.270830 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:57:14.270830 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:57:14.270830 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:57:14.270830 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:57:14.270830 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:57:14.270830 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:14.270830 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:57:14.270830 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:57:14.270830 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 20:57:14.270830 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Oct 04 20:57:14.270830 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:14.270830 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Oct 04 20:57:14.270830 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:14.270830 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:14.270830 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:14.272243 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:14.272243 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:14.272243 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:14.272243 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:14.272243 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:57:14.272243 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:14.272243 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 20:57:14.272243 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Oct 04 20:57:14.272243 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:14.272243 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Oct 04 20:57:14.272243 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:14.272243 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:14.272243 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:14.272243 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:14.272243 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:14.272243 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 20:57:14.272243 n-d-860282-1 devstack@n-api.service[106668]: ERROR nova.api.openstack.wsgi Oct 04 20:57:14.272243 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-cab26026-a073-47d0-851e-38b280576883 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:14.273562 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-cab26026-a073-47d0-851e-38b280576883 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.015159 Oct 04 20:57:14.276986 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Oct 4 20:57:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:57:15.512309 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-e3c1e921-b29a-4069-8039-7bc651dec701 admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:15.513486 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-e3c1e921-b29a-4069-8039-7bc651dec701 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Oct 04 20:57:15.513888 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Oct 4 20:57:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:16.050619 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-2bae2051-6b9a-40cc-8f26-9db18c99f02b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:16.135763 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-2bae2051-6b9a-40cc-8f26-9db18c99f02b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.484329 Oct 04 20:57:16.136339 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Oct 4 20:57:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:57:17.364305 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-e3c1e921-b29a-4069-8039-7bc651dec701 admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:17.365306 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-e3c1e921-b29a-4069-8039-7bc651dec701 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 04 20:57:17.365744 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Oct 4 20:57:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:17.901023 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-264bcb46-296f-4f5a-a172-3a8ccc9c5759 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:17.970400 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-264bcb46-296f-4f5a-a172-3a8ccc9c5759 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.463726 Oct 04 20:57:17.970990 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Oct 4 20:57:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:57:19.192479 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-e3c1e921-b29a-4069-8039-7bc651dec701 admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:19.193513 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-e3c1e921-b29a-4069-8039-7bc651dec701 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 04 20:57:19.193916 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Oct 4 20:57:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:19.722570 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-ec644067-8b78-47cd-b18b-168c949895e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:19.812454 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-ec644067-8b78-47cd-b18b-168c949895e9 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.479211 Oct 04 20:57:19.813010 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Oct 4 20:57:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:57:21.029135 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-e3c1e921-b29a-4069-8039-7bc651dec701 admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:21.030172 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-e3c1e921-b29a-4069-8039-7bc651dec701 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 04 20:57:21.030567 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Oct 4 20:57:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:21.560770 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-1f3d636c-c509-446a-b9fa-af8fb4e35e53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:21.687094 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-1f3d636c-c509-446a-b9fa-af8fb4e35e53 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.519047 Oct 04 20:57:21.687650 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Oct 4 20:57:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:57:22.909898 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-e3c1e921-b29a-4069-8039-7bc651dec701 admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:22.910912 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-e3c1e921-b29a-4069-8039-7bc651dec701 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Oct 04 20:57:22.911310 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Oct 4 20:57:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:23.427630 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-76e13d43-dd85-41a4-89e8-f76cd036bc7b admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:23.448614 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-76e13d43-dd85-41a4-89e8-f76cd036bc7b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401211 Oct 04 20:57:23.449163 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Tue Oct 4 20:57:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:58:20.532387 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-e3c1e921-b29a-4069-8039-7bc651dec701 admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:20.533403 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-e3c1e921-b29a-4069-8039-7bc651dec701 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 04 20:58:20.533849 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 931 bytes} [Tue Oct 4 20:58:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:20.544912 n-d-860282-1 devstack@n-api.service[106668]: DEBUG dbcounter [-] [106668] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:20.923292 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-0616ed24-d034-447d-8c3e-5506fcd9b138 admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:20.944716 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-0616ed24-d034-447d-8c3e-5506fcd9b138 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404482 Oct 04 20:58:20.945262 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Oct 4 20:58:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:58:20.965884 n-d-860282-1 devstack@n-api.service[106669]: DEBUG dbcounter [-] [106669] Writing DB stats nova_api:SELECT=14 {{(pid=106669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:20.969558 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-0eddcd4d-fee4-4e51-9275-7a6c459ee055 admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:20.976624 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-0eddcd4d-fee4-4e51-9275-7a6c459ee055 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012180 Oct 04 20:58:20.981032 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1283 bytes} [Tue Oct 4 20:58:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:20.988323 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-13013400-3edf-4c6c-97e3-52898934beac admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:20.996374 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-13013400-3edf-4c6c-97e3-52898934beac admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011542 Oct 04 20:58:20.996893 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1286 bytes} [Tue Oct 4 20:58:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:21.008742 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-d3bbb877-fd73-4979-b337-87c36a8880be admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:21.015987 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-d3bbb877-fd73-4979-b337-87c36a8880be admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011229 Oct 04 20:58:21.016481 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1286 bytes} [Tue Oct 4 20:58:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:21.027784 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-c9e181e3-fc98-4025-ae22-54de27af41ca admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:21.034809 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-c9e181e3-fc98-4025-ae22-54de27af41ca admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010561 Oct 04 20:58:21.035321 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1283 bytes} [Tue Oct 4 20:58:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:01.826185 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-d3bbb877-fd73-4979-b337-87c36a8880be admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:01.827208 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-d3bbb877-fd73-4979-b337-87c36a8880be admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Oct 04 21:04:01.827614 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 34/69] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Oct 4 21:04:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:01.967588 n-d-860282-1 devstack@n-api.service[106668]: DEBUG dbcounter [-] [106668] Writing DB stats nova_api:SELECT=6 {{(pid=106668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:02.128126 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-fa0eb713-cab9-4839-8c6e-ce052715caa9 admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:02.132817 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_concurrency.lockutils [None req-fa0eb713-cab9-4839-8c6e-ce052715caa9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:02.133456 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_concurrency.lockutils [None req-fa0eb713-cab9-4839-8c6e-ce052715caa9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:02.133898 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_concurrency.lockutils [None req-fa0eb713-cab9-4839-8c6e-ce052715caa9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:02.134610 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_concurrency.lockutils [None req-fa0eb713-cab9-4839-8c6e-ce052715caa9 admin admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:02.135057 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_concurrency.lockutils [None req-fa0eb713-cab9-4839-8c6e-ce052715caa9 admin admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:02.135474 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_concurrency.lockutils [None req-fa0eb713-cab9-4839-8c6e-ce052715caa9 admin admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:02.174563 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-fa0eb713-cab9-4839-8c6e-ce052715caa9 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.208107 Oct 04 21:04:02.175117 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 36/70] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Oct 4 21:04:01 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:04:03.262745 n-d-860282-1 devstack@n-api.service[106669]: DEBUG nova.api.openstack.wsgi [None req-d3bbb877-fd73-4979-b337-87c36a8880be admin admin] Calling method '>' {{(pid=106669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:03.263757 n-d-860282-1 devstack@n-api.service[106669]: INFO nova.api.openstack.requestlog [None req-d3bbb877-fd73-4979-b337-87c36a8880be admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 04 21:04:03.264161 n-d-860282-1 devstack@n-api.service[106669]: [pid: 106669|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Oct 4 21:04:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:03.456912 n-d-860282-1 devstack@n-api.service[106668]: DEBUG nova.api.openstack.wsgi [None req-96ee20cd-b796-4574-a9b5-352580f04f12 admin admin] Calling method '>' {{(pid=106668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:03.460408 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_concurrency.lockutils [None req-96ee20cd-b796-4574-a9b5-352580f04f12 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:03.461654 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_concurrency.lockutils [None req-96ee20cd-b796-4574-a9b5-352580f04f12 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:03.462212 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_concurrency.lockutils [None req-96ee20cd-b796-4574-a9b5-352580f04f12 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:03.462946 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_concurrency.lockutils [None req-96ee20cd-b796-4574-a9b5-352580f04f12 admin admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:03.463397 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_concurrency.lockutils [None req-96ee20cd-b796-4574-a9b5-352580f04f12 admin admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:03.463851 n-d-860282-1 devstack@n-api.service[106668]: DEBUG oslo_concurrency.lockutils [None req-96ee20cd-b796-4574-a9b5-352580f04f12 admin admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:03.486907 n-d-860282-1 devstack@n-api.service[106668]: INFO nova.api.openstack.requestlog [None req-96ee20cd-b796-4574-a9b5-352580f04f12 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.082117 Oct 04 21:04:03.487398 n-d-860282-1 devstack@n-api.service[106668]: [pid: 106668|app: 0|req: 37/72] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Oct 4 21:04:03 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:50.089498 n-d-860282-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 21:04:50.090058 n-d-860282-1 devstack@n-api.service[106667]: Tue Oct 4 21:04:50 2022 - graceful shutdown triggered... Oct 04 21:04:50.090554 n-d-860282-1 devstack@n-api.service[106669]: Gracefully killing worker 2 (pid: 106669)... Oct 04 21:04:50.090932 n-d-860282-1 devstack@n-api.service[106668]: Gracefully killing worker 1 (pid: 106668)... Oct 04 21:04:50.216682 n-d-860282-1 devstack@n-api.service[106669]: DEBUG dbcounter [-] [106669] Writing DB stats nova_api:SELECT=4 {{(pid=106669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:51.090982 n-d-860282-1 devstack@n-api.service[106667]: worker 1 buried after 1 seconds Oct 04 21:04:51.090982 n-d-860282-1 devstack@n-api.service[106667]: worker 2 buried after 1 seconds Oct 04 21:04:51.091646 n-d-860282-1 devstack@n-api.service[106667]: goodbye to uWSGI. Oct 04 21:04:51.093153 n-d-860282-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 04 21:04:51.093757 n-d-860282-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 21:04:51.096628 n-d-860282-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 21:04:51.111642 n-d-860282-1 devstack@n-api.service[122749]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 21:04:51.135358 n-d-860282-1 devstack@n-api.service[122749]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 21:04:51 2022] *** Oct 04 21:04:51.135358 n-d-860282-1 devstack@n-api.service[122749]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 21:04:51.135358 n-d-860282-1 devstack@n-api.service[122749]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 21:04:51.135358 n-d-860282-1 devstack@n-api.service[122749]: nodename: n-d-860282-1 Oct 04 21:04:51.135358 n-d-860282-1 devstack@n-api.service[122749]: machine: x86_64 Oct 04 21:04:51.135358 n-d-860282-1 devstack@n-api.service[122749]: clock source: unix Oct 04 21:04:51.135358 n-d-860282-1 devstack@n-api.service[122749]: pcre jit disabled Oct 04 21:04:51.135358 n-d-860282-1 devstack@n-api.service[122749]: detected number of CPU cores: 4 Oct 04 21:04:51.135358 n-d-860282-1 devstack@n-api.service[122749]: current working directory: / Oct 04 21:04:51.135358 n-d-860282-1 devstack@n-api.service[122749]: detected binary path: /usr/bin/uwsgi-core Oct 04 21:04:51.135358 n-d-860282-1 devstack@n-api.service[122749]: your processes number limit is 47680 Oct 04 21:04:51.135358 n-d-860282-1 devstack@n-api.service[122749]: your memory page size is 4096 bytes Oct 04 21:04:51.136250 n-d-860282-1 devstack@n-api.service[122749]: detected max file descriptor number: 2048 Oct 04 21:04:51.136250 n-d-860282-1 devstack@n-api.service[122749]: lock engine: pthread robust mutexes Oct 04 21:04:51.136250 n-d-860282-1 devstack@n-api.service[122749]: thunder lock: enabled Oct 04 21:04:51.136250 n-d-860282-1 devstack@n-api.service[122749]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 21:04:51.136250 n-d-860282-1 devstack@n-api.service[122749]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 21:04:51.176345 n-d-860282-1 devstack@n-api.service[122749]: Python main interpreter initialized at 0x55e1c5e769c0 Oct 04 21:04:51.176345 n-d-860282-1 devstack@n-api.service[122749]: python threads support enabled Oct 04 21:04:51.176345 n-d-860282-1 devstack@n-api.service[122749]: your server socket listen backlog is limited to 100 connections Oct 04 21:04:51.176345 n-d-860282-1 devstack@n-api.service[122749]: your mercy for graceful operations on workers is 90 seconds Oct 04 21:04:51.176772 n-d-860282-1 devstack@n-api.service[122749]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 21:04:51.176772 n-d-860282-1 devstack@n-api.service[122749]: *** Operational MODE: preforking *** Oct 04 21:04:51.177035 n-d-860282-1 devstack@n-api.service[122749]: *** uWSGI is running in multiple interpreter mode *** Oct 04 21:04:51.177035 n-d-860282-1 devstack@n-api.service[122749]: spawned uWSGI master process (pid: 122749) Oct 04 21:04:51.177247 n-d-860282-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 21:04:51.178728 n-d-860282-1 devstack@n-api.service[122749]: spawned uWSGI worker 1 (pid: 122757, cores: 1) Oct 04 21:04:51.178728 n-d-860282-1 devstack@n-api.service[122749]: spawned uWSGI worker 2 (pid: 122758, cores: 1) Oct 04 21:04:51.178728 n-d-860282-1 devstack@n-api.service[122749]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 21:04:51.846091 n-d-860282-1 devstack@n-api.service[122757]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 21:04:51.848236 n-d-860282-1 devstack@n-api.service[122758]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 21:04:53.027002 n-d-860282-1 devstack@n-api.service[122757]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 21:04:53.027002 n-d-860282-1 devstack@n-api.service[122757]: from cryptography.utils import int_from_bytes Oct 04 21:04:53.027840 n-d-860282-1 devstack@n-api.service[122757]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 21:04:53.027840 n-d-860282-1 devstack@n-api.service[122757]: from cryptography.utils import int_from_bytes Oct 04 21:04:53.029760 n-d-860282-1 devstack@n-api.service[122758]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 21:04:53.029760 n-d-860282-1 devstack@n-api.service[122758]: from cryptography.utils import int_from_bytes Oct 04 21:04:53.030221 n-d-860282-1 devstack@n-api.service[122758]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 21:04:53.030221 n-d-860282-1 devstack@n-api.service[122758]: from cryptography.utils import int_from_bytes Oct 04 21:04:55.484599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 21:04:55.485221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 21:04:55.485440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 21:04:55.485819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 21:04:55.486082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 21:04:55.486485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.486835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.487151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.487715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.487990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.488310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.488644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.488974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.489320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.489631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.489955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.490287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860282-1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.490617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.490935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.491254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.491586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.491898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.492240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.492554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.493076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.493573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.493893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.494247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.494564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.494886 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.495206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.495535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.495847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.496185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.496504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.496925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860282-1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.497888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.498284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.498612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.499073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.499370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.499695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.500026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.500365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.500685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.501020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.501351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.501710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.502038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.502350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.502671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.502989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.503313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.503629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.503947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.504204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.504520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.504851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.505180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.505537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.505797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.506055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.506384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.506711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.507028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.507342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.507655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.507966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.508282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.508605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.508991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.509311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.509666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.509994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.510325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.510640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.510965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.511382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.511640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.511956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.512312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.512646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.513661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.513972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.514414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.514741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.515078 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.515378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.515709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.516053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.516368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.516628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.516942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.517259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.517634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.517947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.518262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.518581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.518894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.519213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.519528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.519841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.520155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.520470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.520783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.521095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.521408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.521746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.522059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.522397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.522739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.523037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.523353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.523667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.523990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.524315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.524629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.524940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.525272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.525614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.525928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.526257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.526568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.526884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.527225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.527529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.527840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.528169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.528568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.529102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.529477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.529834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.530075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.530391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.530717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.531047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.531352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.531685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.532017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.532336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.532651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.532953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.533282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.533660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.534006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.534362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.534687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.535029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.535412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.535696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.536011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.536336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.536671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.536985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.537305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.537663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.540592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.540592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.540592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.540592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.540592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.540592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.540592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.540592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.541942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.541942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.541942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.541942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.541942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.542371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.542471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.542724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.543045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.543365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.543688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.544831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.545049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.545221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.545581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.545903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.546237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.546559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.546877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.547196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.547515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.547834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.548180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.548505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.548836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.549159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.549508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.549838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.550159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.550476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.550795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.551109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.551420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.551733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.552094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.552423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.552770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.552876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 21:04:55.553292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 21:04:55.553414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.553414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.553624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 21:04:55.553751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.553925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 21:04:55.554065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.554193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 21:04:55.554387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.554586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.554699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.554923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.555043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.555255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.555372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.555610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.555715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.555929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.556101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.556247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.556398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.556541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.556774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.556871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.557022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.557171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.557326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.557513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.557665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.557861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.557959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.558133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.558262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860282-1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.558457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.558563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.558777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.558885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.559093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.559189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.559411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.559515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.560347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.560563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.560747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.560918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.561073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.561323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.561504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.561947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.562145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.562319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.562474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.562629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.562782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.562933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.563167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.563317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.563424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.563563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.563729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.563836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.564053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.564151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.564386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.564484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.564711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.564818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.565026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.565123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.565345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.565472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.566080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.566233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860282-1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.566389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.566548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.566699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.566852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.566995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.567143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.567296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.567462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.567618 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.567768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.567920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.568070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.568246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.568398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.568559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.568710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.568867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.569024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.569180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.569330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.569609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.569758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.569917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.570069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.570350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.570495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.570653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.570804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.570957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.571110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.571266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.571419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.571570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.571724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.571875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.572041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.572185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.572339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.572501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.572659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.572809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.572962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.573135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.573246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.573347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.573470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.573578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.573669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.573832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.573933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.574025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.574121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.574211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.574300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.574403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.574495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.574585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.574681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.574928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.575042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.575258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.575406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.575625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.575811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.575949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.576280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.576389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.576593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.576697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.576926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.577038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.577228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.577382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.577573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.577680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.577898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.578021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.578218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.578355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.578528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.578644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.578845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.578940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.579171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.579290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.579487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.579602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.579807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.579983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.580134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.580291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.580437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.580582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.580747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.580909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.581074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.581230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.581381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.581532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.581703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.581819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.582021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.582137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.582340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.582439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.582665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.582780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.582985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.583090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.583304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.583410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.583563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.583671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.583874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.584019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.584190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.584287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.584521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.584631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.584836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.584934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.585149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.585247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.585481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.585581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.585795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.585903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.586111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.586216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.586425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.586528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.586740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.586882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.587049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.587163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.587361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.587458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.587677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.587775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.587989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.588095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.588302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.588415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.588620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.588720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.588928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.589037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.589239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.589343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.589589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.589706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.589906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.590024 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.590214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.590317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.590525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.590630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.590833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.590959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.591313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.591424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.591634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.591869 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.591974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.592195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.592293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.592531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.592631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.592849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.592953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.593168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.593315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.593519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.593618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.593838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.593943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.594156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.594264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.594475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.594571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.594789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.594883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.595101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.595256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.595420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.595519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.595755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.595866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.596046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.596226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.596358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.596454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.596671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.596769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.596984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.597095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.597296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.597401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.597631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.597727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.597944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.598053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.598250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.598346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.599394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.599523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.599645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.599750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.599840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.599986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.600088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.600178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.600279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.600369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.600465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 21:04:55.600616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.600719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.600819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.600987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.601091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.601227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.601368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.601507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.601706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.601813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.602025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.602131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.602338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.602435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.602648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.602756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.602964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.603068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.603281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.603400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.603594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.603725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.603906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.604036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.604225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.604346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.604532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.604633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.604842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.604949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.605151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.605249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.605480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.605582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.605803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.605917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.606114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.606220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.606430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.607024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.607273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.607482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.607591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.608038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.608144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.608372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.608475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.608684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.608790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.608996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.609094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.609347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.609486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.609688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.609794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.610035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.610181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.610365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.610470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.610691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.610797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.611012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.611109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.611324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.611433 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.611656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.611762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.611966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.612072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.612276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.612384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.612586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.612682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.612902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.612998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.613218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.613317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.613551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.613653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.613877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.613974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.614193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.614292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.614512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.614618 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.614824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.614928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.615134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.615239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.615447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.615580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.615755 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.615891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.616077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.616175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.616390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.616488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.616699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.616795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.617006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.617104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.617321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.617465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.617660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.617771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.617968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.618073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.618280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.618377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.618584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.618689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.618901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.618997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.619207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.619311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.619516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.619623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.619827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.619925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.620142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.620276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.620456 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.620563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.620765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.620863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.621083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.621180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.621396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.621536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.621729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.621834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.622040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.622138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.622406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.622519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.622718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.622961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.623069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.623285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.623397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.623627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.623732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.623951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.624047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.624257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.624361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.624573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.624680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.624883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.624980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.625192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.625291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.625525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.625639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.625841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.625943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.626151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.626258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.626459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.626564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.626765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.626871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.627073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.627179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.627381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.627479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.627707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.627811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.628019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.628115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.628325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.628423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.628634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.628741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.628941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.629046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.629289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.629388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.629626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.629737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.629957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.630054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.630281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.630385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.630596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.630702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.630909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.631007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.631222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.631326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.631538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.631653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.631852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.631950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.632158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.632267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.632455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.632559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.632766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.632909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.633080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.633187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.633387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.633515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.633725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.633831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.634044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.634141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.634357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.634455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.634669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.634767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.634996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.635102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.635325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.635432 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.635658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.635763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.635970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.636081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.636361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.636461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.636591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.636689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.636908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.637019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.637229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.637327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.637572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.637672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.638763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.638893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.638893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.639116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.639217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.639357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.639600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.639815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.639918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.640182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.832008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.832311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.832512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.832678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.832826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.832984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.833077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.833196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.833288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.833374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.833486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.833569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.833569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.833733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.833821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.833821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.833974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.834058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.834138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.834221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.834296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.834387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.834524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.834653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.834653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.834859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.834859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.835192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.835355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.835444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.835505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.835505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.835622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.835686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.835686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.835826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.835889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.835970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.836048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.836129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.836190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.836249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.836306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.836375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.836487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.836567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.836639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.836639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.836768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.836848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.836910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.836980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.837051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.837122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.837201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.837274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.837346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.837436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.837513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.837585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.837731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.837808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.837808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.837935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.838055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.838132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.838212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.838212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.838348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.838419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.838419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.838556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.838629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.838701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.838772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.838844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.838923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.838996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.838996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.839125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.839125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.839125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.839125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.839125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.839125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.839125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.839125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.839604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.839604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.839736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.839808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.839887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.839960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.839960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.840089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.840160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.840231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.840360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.840438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.840510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.840580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.840651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.840729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.840804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.840876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.841637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.841770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.841896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.842064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.842195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.842327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.842458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.842539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.842612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.842693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.842789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.842926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.843044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.843131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.843207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.843280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.843360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.843435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.843508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.843581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.843653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.843725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.843805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.843880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.843954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.844026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.844098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.844178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.844253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.844326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.844401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.844473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.844546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.844627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.844712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.844837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.844914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.844987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.845060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.845140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.845216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.845289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.845361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.845455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.845455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.845603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.845680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.845752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.845826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.845899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.845980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.846056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.846151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.846224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.846350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.846432 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.846562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.846642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.846736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.846858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.846936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.847009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.847091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.847167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.847240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.847240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.847371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.847444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.847524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.847599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.847672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.847744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.847816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.847897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.847973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.848046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.848166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.848252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.848383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.848471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.848547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.848620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.848693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.848785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.848859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.849019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.849110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.849189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.849253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.849349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.849478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.849576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.849576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.849712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.849786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.849858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.849939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.850014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.850087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.850160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.850240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.850313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.850394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.850471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.850544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.850617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.850689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.850761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.850867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.850943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.850943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.851063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.851136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.851209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.851290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.851365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.851437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.851510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.851582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.851662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.851738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.851873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.851953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.852029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.852102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.852172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.852235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.852308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.852381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.852453 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.852525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.852632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.852632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.852771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.852844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.852917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.853010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.853080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.853143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.853218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.853295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.853390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.853573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.853664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.853664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.853958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.854094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.854242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.854377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.854522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.854656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.854790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.854924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.855058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.855191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.855333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.855468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.855602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.855735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.855867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.856018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.856153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.856286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.856420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.856621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.856890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.857122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.857343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.857557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.857697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.857831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.858100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.858271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.858412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.859610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.861843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.862994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.863186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.863336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.863479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.863619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.863758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.863901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.864048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.864198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.864334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.864470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.864605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.864749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.864885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.865021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.865156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.865290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.865444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.865598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.865735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.865869 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.866015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.866150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.866150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.866413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.866548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.866683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.866818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.866952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.867088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.867231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.867367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.867501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.867684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.867822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.867822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.868087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.868221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.868356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.868490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.868623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.868764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.868899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.869033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.869167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.869300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.869300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.869600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.869600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.869600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.869972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.870106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.870242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.870384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.870519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.870653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.870786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.870920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.871062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.871062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.871328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.871578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.871716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.871716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.871978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.872113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.872281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.872430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.872635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.872845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.873277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.873498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.873498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.873778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.873915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.874072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.874210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.874348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.874486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.874621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.874766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.874903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.875039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.875174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.875174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.875174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.875571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.875571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.875826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.875962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.876097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.876233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.876377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.876525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.876662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.876807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.876943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.877089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.877233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.877370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.877532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.877669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.877805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.877953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.878090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.878228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.878364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.878500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.878638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.878782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.878930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.879067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.879203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.879339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.879475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.879687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.879826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.879970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.880107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.880243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.880243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.880506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.880506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.880774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.880911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.881055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.881199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.881199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.881473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.881473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.881737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.881873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.882021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.882021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.882287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.882433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.882569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.882704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.882704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.882969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.882969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.883225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.883361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.883496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.883639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.883777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.883913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.884048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.884244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.884524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.884662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.884799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.884936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.885071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.885207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.885351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.885533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.885671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.885671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.885929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.886065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.886222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.886365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.886506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.886642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.886778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.886915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.887060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.887196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.887332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.887468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.887604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.887604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.888469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.888678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.888896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.889118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.889293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.889461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.889606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.889744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.889880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.890016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.890154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.890344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.890490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.890638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.890775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.890912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.891048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.891195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.891333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.891478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.891615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.891752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.891896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.892033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.892033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.892292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.892441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.892577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.892722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.892860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.892996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.893133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.893133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.893391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.893562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.893701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.893837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.893973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.894120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.894120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.894387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.894387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.894683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.894683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.894942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.894942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.895208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.895347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.895483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.895619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.895754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.895910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.896047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.896183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.896318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.896456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.896591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.896741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.896888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.897025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.897161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.897298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.897512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.897657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.897805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.897941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.898077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.898213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.898357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.898499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.898635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.898772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.898909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.899046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.899190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.899327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.899473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.899610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.899754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.899754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.900019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.900157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.900294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.900430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.900567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.900712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.900857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.900995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.901141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.901278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.901414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.901683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.901683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.901942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.902079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.902216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.902352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.902496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.902633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.902771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.902907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.903053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.903197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.903336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.904083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.904302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.904515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.904739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.904953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.905097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.905097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.905594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.905594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.906826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.907016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.908565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.908731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.908880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.909024 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.909166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.910326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.910488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.910629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.910767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.910904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.910904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.911255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.911405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.911542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.911678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.911815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.911960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.911960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.912219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.912355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.912491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.912628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.912773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.912910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.913057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.913195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.913331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.913486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.913642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.913779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.913915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.914052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.914189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.914333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.914333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.914591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.914729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.914875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.915011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.915155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.915293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.915429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.915565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.915701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.915837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.915981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.916118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.916254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.916390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.916525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.916676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.916820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.916957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.917093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.917228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.917513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.917667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.917806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.917943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.918079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.918216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.918352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.918508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.918646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.918783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.918919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.919076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.919076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.919403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.919403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.919823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.920017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.920157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.920314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.920452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.920452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.920729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.920867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.921004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.921004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.921270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.921407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.921571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.921709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.921846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.921994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.922132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.922132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.922399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.922535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.922672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.922816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.922954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.923090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.923090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.923346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.923491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.923629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.923765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.923901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.924047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.924183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.924327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.924464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.924600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.924737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.924873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.924873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.925137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.925275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.925411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.925602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.925739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.925886 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.926033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.926170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.926317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.926461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.926599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.926735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.926735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.927003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.927140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.927276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.927413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.927413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.927689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.927828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 21:04:55.927966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.927966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.927966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.927966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.927966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.927966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.927966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.927966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.928952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.928952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.928952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.928952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.928952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.928952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.929764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.929764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.930022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.930320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.930638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.930964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.931291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.931738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.932067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.932390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.932716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.933242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.933594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.933920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.934245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.934602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.935497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.936027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.936354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.937098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.937445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.937877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.938613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.938939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.939286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.939623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.939957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.940293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.940623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.941049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.941364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.941805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.942129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.942450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.942765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.943131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.943449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.943763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.944093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.944413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.944964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.945319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.945686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.946022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.946357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.946833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.947155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.947495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.947923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.948275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.948598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.948916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.949227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.949567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.949888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.950206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.951075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.951398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.951814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.952155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.952471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.952784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.953462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.953766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.954062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.954373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.954692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.955005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.955328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.955643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.955963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.956277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.956598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.957078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.957408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.957778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.958110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.958427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.958747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.959076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.959398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.959730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.960058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.960375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.960735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.961061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.961648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.962099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.962512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.962858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.963262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.963508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.963822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.964135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.964469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.964789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.965182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.965455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.965837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.966188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.966511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.966847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.967164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.967482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.967880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.968125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.968469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.968753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.969071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.969391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.969768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.970095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.970418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.970740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.971064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.971380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.971696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.972129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.972454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.972775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.973112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.973479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.973767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.974205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.974525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.974852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.975177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.975493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.975822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.976152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.976468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.976797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.977121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.977509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.977860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.978195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.978613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.978835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.979147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.979457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.979774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.980097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.980414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.980723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.981031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.981348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.981798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.982370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.982683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.982997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.983316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.983627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.983937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.984248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.984559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.984868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.985179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.985523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.985828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.986143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.986452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.986762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.987084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.987404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.987746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.988142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.988396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.988879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.989048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.989517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.989702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.990034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.990362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.990511 n-d-860282-1 devstack@n-api.service[122757]: INFO dbcounter [None req-dbfa8c00-902a-4e97-be32-5c14ffba2927 None None] Registered counter for database nova_api Oct 04 21:04:55.990672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.991007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.991323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.991643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.991960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.992395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.992720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.993038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.993374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.993956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.994122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.994364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.994690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.995019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.995350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.995667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.995999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.996317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.996635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.996954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.997840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.998160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.998565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.999056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.999220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.999517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:55.999835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:56.000171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:56.000503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:56.000821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:56.001154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:56.001519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:56.002040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:56.002483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:56.002846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:56.003188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:56.003508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:56.004482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:56.004482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 21:04:56.004790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 21:04:56.017500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_db.sqlalchemy.engines [None req-dbfa8c00-902a-4e97-be32-5c14ffba2927 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122757) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:04:56.025464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writer thread running {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:04:56.067750 n-d-860282-1 devstack@n-api.service[122758]: INFO dbcounter [None req-3ffc7a57-7113-429c-9bc2-7b5e95646e99 None None] Registered counter for database nova_api Oct 04 21:04:56.083028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.context [None req-dbfa8c00-902a-4e97-be32-5c14ffba2927 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),016bade6-ba85-4482-99c1-a6ee7c8937c1(cell1) {{(pid=122757) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 21:04:56.087102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbfa8c00-902a-4e97-be32-5c14ffba2927 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:56.087588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbfa8c00-902a-4e97-be32-5c14ffba2927 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:56.088663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_db.sqlalchemy.engines [None req-3ffc7a57-7113-429c-9bc2-7b5e95646e99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:04:56.089175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbfa8c00-902a-4e97-be32-5c14ffba2927 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:56.089956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbfa8c00-902a-4e97-be32-5c14ffba2927 None None] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:56.090403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbfa8c00-902a-4e97-be32-5c14ffba2927 None None] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:56.093253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbfa8c00-902a-4e97-be32-5c14ffba2927 None None] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:56.095981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writer thread running {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:04:56.098296 n-d-860282-1 devstack@n-api.service[122757]: INFO dbcounter [None req-dbfa8c00-902a-4e97-be32-5c14ffba2927 None None] Registered counter for database nova_cell0 Oct 04 21:04:56.102419 n-d-860282-1 devstack@n-api.service[122757]: INFO dbcounter [None req-dbfa8c00-902a-4e97-be32-5c14ffba2927 None None] Registered counter for database nova_cell1 Oct 04 21:04:56.115101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_db.sqlalchemy.engines [None req-dbfa8c00-902a-4e97-be32-5c14ffba2927 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122757) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:04:56.115670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_db.sqlalchemy.engines [None req-dbfa8c00-902a-4e97-be32-5c14ffba2927 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122757) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:04:56.122463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writer thread running {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:04:56.123884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writer thread running {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:04:56.156254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.context [None req-3ffc7a57-7113-429c-9bc2-7b5e95646e99 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),016bade6-ba85-4482-99c1-a6ee7c8937c1(cell1) {{(pid=122758) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 21:04:56.158002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ffc7a57-7113-429c-9bc2-7b5e95646e99 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:56.158486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ffc7a57-7113-429c-9bc2-7b5e95646e99 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:56.160264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ffc7a57-7113-429c-9bc2-7b5e95646e99 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:56.161017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ffc7a57-7113-429c-9bc2-7b5e95646e99 None None] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:56.161489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ffc7a57-7113-429c-9bc2-7b5e95646e99 None None] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:56.163482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ffc7a57-7113-429c-9bc2-7b5e95646e99 None None] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:56.165524 n-d-860282-1 devstack@n-api.service[122758]: INFO dbcounter [None req-3ffc7a57-7113-429c-9bc2-7b5e95646e99 None None] Registered counter for database nova_cell0 Oct 04 21:04:56.170169 n-d-860282-1 devstack@n-api.service[122758]: INFO dbcounter [None req-3ffc7a57-7113-429c-9bc2-7b5e95646e99 None None] Registered counter for database nova_cell1 Oct 04 21:04:56.177651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_db.sqlalchemy.engines [None req-3ffc7a57-7113-429c-9bc2-7b5e95646e99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:04:56.179016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_db.sqlalchemy.engines [None req-3ffc7a57-7113-429c-9bc2-7b5e95646e99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:04:56.184013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writer thread running {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:04:56.189619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writer thread running {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:04:56.275319 n-d-860282-1 devstack@n-api.service[122757]: INFO dbcounter [None req-dbfa8c00-902a-4e97-be32-5c14ffba2927 None None] Registered counter for database nova_cell0 Oct 04 21:04:56.283136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_db.sqlalchemy.engines [None req-dbfa8c00-902a-4e97-be32-5c14ffba2927 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122757) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:04:56.287807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writer thread running {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:04:56.343212 n-d-860282-1 devstack@n-api.service[122758]: INFO dbcounter [None req-3ffc7a57-7113-429c-9bc2-7b5e95646e99 None None] Registered counter for database nova_cell0 Oct 04 21:04:56.350241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_db.sqlalchemy.engines [None req-3ffc7a57-7113-429c-9bc2-7b5e95646e99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 21:04:56.354801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writer thread running {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 21:04:56.614797 n-d-860282-1 devstack@n-api.service[122757]: WARNING keystonemiddleware.auth_token [None req-dbfa8c00-902a-4e97-be32-5c14ffba2927 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 21:04:56.622200 n-d-860282-1 devstack@n-api.service[122757]: WARNING keystonemiddleware.auth_token [None req-dbfa8c00-902a-4e97-be32-5c14ffba2927 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 21:04:56.674980 n-d-860282-1 devstack@n-api.service[122758]: WARNING keystonemiddleware.auth_token [None req-3ffc7a57-7113-429c-9bc2-7b5e95646e99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 21:04:56.682420 n-d-860282-1 devstack@n-api.service[122758]: WARNING keystonemiddleware.auth_token [None req-3ffc7a57-7113-429c-9bc2-7b5e95646e99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 21:04:56.968691 n-d-860282-1 devstack@n-api.service[122757]: WARNING keystonemiddleware.auth_token [None req-dbfa8c00-902a-4e97-be32-5c14ffba2927 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 21:04:56.974723 n-d-860282-1 devstack@n-api.service[122757]: WARNING keystonemiddleware.auth_token [None req-dbfa8c00-902a-4e97-be32-5c14ffba2927 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 21:04:56.980021 n-d-860282-1 devstack@n-api.service[122757]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e1c5e769c0 pid: 122757 (default app) Oct 04 21:04:57.031736 n-d-860282-1 devstack@n-api.service[122758]: WARNING keystonemiddleware.auth_token [None req-3ffc7a57-7113-429c-9bc2-7b5e95646e99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 21:04:57.037875 n-d-860282-1 devstack@n-api.service[122758]: WARNING keystonemiddleware.auth_token [None req-3ffc7a57-7113-429c-9bc2-7b5e95646e99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 21:04:57.043244 n-d-860282-1 devstack@n-api.service[122758]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e1c5e769c0 pid: 122758 (default app) Oct 04 21:05:39.242549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:39.244196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:39.245354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:39.247484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:39.737973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:39.739937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:39.739937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:39.740610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:40.668059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8d39f02a-fb2d-4df8-93ad-483c9bff290a tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '.version_select at 0x7f5791d0b040>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:40.674787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8d39f02a-fb2d-4df8-93ad-483c9bff290a tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),016bade6-ba85-4482-99c1-a6ee7c8937c1(cell1) {{(pid=122757) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 21:05:40.676315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d39f02a-fb2d-4df8-93ad-483c9bff290a tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:40.676846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d39f02a-fb2d-4df8-93ad-483c9bff290a tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:40.677358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d39f02a-fb2d-4df8-93ad-483c9bff290a tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:40.705762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d39f02a-fb2d-4df8-93ad-483c9bff290a tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:40.706404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d39f02a-fb2d-4df8-93ad-483c9bff290a tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:40.706917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d39f02a-fb2d-4df8-93ad-483c9bff290a tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:40.720332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d39f02a-fb2d-4df8-93ad-483c9bff290a tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:40.721023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d39f02a-fb2d-4df8-93ad-483c9bff290a tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:40.721592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d39f02a-fb2d-4df8-93ad-483c9bff290a tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:40.729109 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8d39f02a-fb2d-4df8-93ad-483c9bff290a tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.496703 Oct 04 21:05:40.731349 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1/1] 10.222.0.30 () {58 vars in 1167 bytes} [Tue Oct 4 21:05:39 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:40.944308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6deef04a-b577-4a21-89ed-deac64d5d0d7 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Calling method '.version_select at 0x7f5791dc7940>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:40.950143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6deef04a-b577-4a21-89ed-deac64d5d0d7 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:40.950850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6deef04a-b577-4a21-89ed-deac64d5d0d7 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:40.951464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6deef04a-b577-4a21-89ed-deac64d5d0d7 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:40.952353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6deef04a-b577-4a21-89ed-deac64d5d0d7 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:40.952951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6deef04a-b577-4a21-89ed-deac64d5d0d7 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:40.953552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6deef04a-b577-4a21-89ed-deac64d5d0d7 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:41.021106 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6deef04a-b577-4a21-89ed-deac64d5d0d7 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 1.288378 Oct 04 21:05:41.030717 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1/2] 10.222.0.30 () {58 vars in 1128 bytes} [Tue Oct 4 21:05:39 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:41.036621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e94fb70d-dae4-4b72-8660-f2e5d6778ee4 tempest-FlavorsAccessTestJSON-1954615998 tempest-FlavorsAccessTestJSON-1954615998-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-369437850", "id": 1156302279, "os-flavor-access:is_public": "False"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:41.193206 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e94fb70d-dae4-4b72-8660-f2e5d6778ee4 tempest-FlavorsAccessTestJSON-1954615998 tempest-FlavorsAccessTestJSON-1954615998-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.459363 Oct 04 21:05:41.193922 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2/3] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:40 2022] POST /compute/v2.1/flavors => generated 430 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:41.200048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bbaf90a7-ffa4-475d-9911-55d38b402955 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Calling method '.version_select at 0x7f5791bb1a60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:41.231020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bbaf90a7-ffa4-475d-9911-55d38b402955 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),016bade6-ba85-4482-99c1-a6ee7c8937c1(cell1) {{(pid=122758) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 21:05:41.231762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbaf90a7-ffa4-475d-9911-55d38b402955 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:41.233029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbaf90a7-ffa4-475d-9911-55d38b402955 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:41.236716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbaf90a7-ffa4-475d-9911-55d38b402955 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:41.303599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbaf90a7-ffa4-475d-9911-55d38b402955 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:41.304283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbaf90a7-ffa4-475d-9911-55d38b402955 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:41.306224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbaf90a7-ffa4-475d-9911-55d38b402955 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:41.329800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbaf90a7-ffa4-475d-9911-55d38b402955 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:41.330669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbaf90a7-ffa4-475d-9911-55d38b402955 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:41.331752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbaf90a7-ffa4-475d-9911-55d38b402955 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:41.340366 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bbaf90a7-ffa4-475d-9911-55d38b402955 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.307062 Oct 04 21:05:41.341537 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2/4] 10.222.0.30 () {60 vars in 1208 bytes} [Tue Oct 4 21:05:41 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:41.387255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-29a4a8a5-3478-4edf-a45e-0423880d67a6 tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-13951426", "ram": 512, "vcpus": 1, "disk": 10, "id": 1589211073, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:41.496169 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-29a4a8a5-3478-4edf-a45e-0423880d67a6 tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.300830 Oct 04 21:05:41.497523 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3/5] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:41 2022] POST /compute/v2.1/flavors => generated 414 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:41.502098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0c7ca976-c3d7-4369-abcd-ab7359bba958 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1418620599", "name": "tempest-test_aggregate-457160623"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:41.525098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b486a6b6-5e0c-4c62-89be-b752dee7fe5c tempest-AZAdminNegativeTestJSON-1284762742 tempest-AZAdminNegativeTestJSON-1284762742-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:41.529657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b486a6b6-5e0c-4c62-89be-b752dee7fe5c tempest-AZAdminNegativeTestJSON-1284762742 tempest-AZAdminNegativeTestJSON-1284762742-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'ae0d17c5a2ea4095b173eb9f58d1cafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5e4628b2a542778d9ba2b0b49068a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b486a6b6-5e0c-4c62-89be-b752dee7fe5c tempest-AZAdminNegativeTestJSON-1284762742 tempest-AZAdminNegativeTestJSON-1284762742-project] Request method failure captured: Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKAhlWmLOfyyqthi0HZqLJh9Hp-nc-dC_QBbVd9FokccsFa71GEj6RCiMTMhiq4vfDBOgpW3Zi_9d2k8yFckNptg4bnpp_gOWzNwVx2vgg7WFQR38T3D3QQ2YIeYa3FSUv0FvQg9oljRkhi0yHXGmGgD7dbQgbcD6aouyp4p_2YOLm0 Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: fc5e4628b2a542778d9ba2b0b49068a8 Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1284762742 Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:05:41.532992 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:05:41.534417 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc5e4628b2a542778d9ba2b0b49068a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fc5e4628b2a542778d9ba2b0b49068a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fc5e4628b2a542778d9ba2b0b49068a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc5e4628b2a542778d9ba2b0b49068a8"}]}] Oct 04 21:05:41.534417 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AZAdminNegativeTestJSON-1284762742 Oct 04 21:05:41.534417 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: fc5e4628b2a542778d9ba2b0b49068a8 Oct 04 21:05:41.534417 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1284762742 Oct 04 21:05:41.534417 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AZAdminNegativeTestJSON-1284762742-project Oct 04 21:05:41.534417 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:05:41.534417 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:05:41.534417 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: ae0d17c5a2ea4095b173eb9f58d1cafe Oct 04 21:05:41.534417 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AZAdminNegativeTestJSON-1284762742-project Oct 04 21:05:41.534417 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:05:41.534417 n-d-860282-1 devstack@n-api.service[122758]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 21:05:41.534417 n-d-860282-1 devstack@n-api.service[122758]: action_args: {} Oct 04 21:05:41.535261 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:41.535261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:41.535261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:41.535261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:41.535261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:41.535261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:41.535261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:41.535261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:41.535261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 04 21:05:41.535261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 04 21:05:41.535261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:05:41.535261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:05:41.535261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:05:41.535261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:05:41.535261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:05:41.535261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:05:41.535261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:05:41.535261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:05:41.535261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:05:41.536471 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:05:41.536471 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:05:41.536471 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:05:41.536471 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:05:41.536471 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:05:41.536471 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 21:05:41.536471 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:41.536471 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:41.536471 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:41.536471 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:41.536471 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:41.536471 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:41.536471 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:05:41.536471 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:05:41.536471 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 21:05:41.536471 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:41.537857 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.aggregate [None req-0c7ca976-c3d7-4369-abcd-ab7359bba958 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Generated uuid c9df532e-81f7-438e-9ebe-16b194f72ee8 for aggregate {{(pid=122757) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:05:41.541247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b486a6b6-5e0c-4c62-89be-b752dee7fe5c tempest-AZAdminNegativeTestJSON-1284762742 tempest-AZAdminNegativeTestJSON-1284762742-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:41.542536 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b486a6b6-5e0c-4c62-89be-b752dee7fe5c tempest-AZAdminNegativeTestJSON-1284762742 tempest-AZAdminNegativeTestJSON-1284762742-project] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.186091 Oct 04 21:05:41.543700 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3/6] 10.222.0.30 () {58 vars in 1185 bytes} [Tue Oct 4 21:05:41 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 188 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:05:41.708314 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0c7ca976-c3d7-4369-abcd-ab7359bba958 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.209563 Oct 04 21:05:41.708932 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4/7] 10.222.0.30 () {60 vars in 1165 bytes} [Tue Oct 4 21:05:41 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:41.720445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b332b8b4-3cc2-4dd9-afce-7bb8c0e6bbfd tempest-FlavorsAccessTestJSON-1954615998 tempest-FlavorsAccessTestJSON-1954615998-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "977ec6532adc446aab95585193efd2ef"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:41.963961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-87b5adbc-2bce-4c64-906c-c90f0cb4ae94 tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Calling method '.version_select at 0x7f5791b4b310>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:41.971121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-87b5adbc-2bce-4c64-906c-c90f0cb4ae94 tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '76ddfd63dd004ca9bcbf20e8131af95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe8a1fca0c948e6a609e46d3e0ce7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-87b5adbc-2bce-4c64-906c-c90f0cb4ae94 tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Request method failure captured: Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKAgspKR6oG-5mqBOB1OvMvJVeOriHE-YLdSUHqDzu9zAdXiZfcaHAK-udj1Lk1FZIy4kO_4nqu_ZtNBQAvFjIymdKRwbGLLv34WfNe63pO0AQFqfohm0FHEVXL2tmXsJ5kFcfroIOIbqOBLDCqhmmUDTu1xkDre4T3meXNMmbJJXB8 Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: fbe8a1fca0c948e6a609e46d3e0ce7b2 Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1430533500 Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:05:41.976306 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:05:41.977740 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}] Oct 04 21:05:41.977740 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1430533500 Oct 04 21:05:41.977740 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: fbe8a1fca0c948e6a609e46d3e0ce7b2 Oct 04 21:05:41.977740 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1430533500 Oct 04 21:05:41.977740 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-HostsAdminNegativeTestJSON-1430533500-project Oct 04 21:05:41.977740 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:05:41.977740 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:05:41.977740 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 76ddfd63dd004ca9bcbf20e8131af95a Oct 04 21:05:41.977740 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1430533500-project Oct 04 21:05:41.977740 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:05:41.977740 n-d-860282-1 devstack@n-api.service[122758]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 21:05:41.977740 n-d-860282-1 devstack@n-api.service[122758]: action_args: {} Oct 04 21:05:41.977740 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:41.978653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:41.978653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:41.978653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:41.978653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:41.978653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:41.978653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:05:41.978653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:05:41.978653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:05:41.978653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:05:41.978653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:41.978653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:41.978653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 04 21:05:41.978653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 04 21:05:41.978653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:05:41.978653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:05:41.978653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:05:41.978653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:05:41.978653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:05:41.978653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:05:41.979932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:05:41.979932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:05:41.979932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:05:41.979932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:05:41.979932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:05:41.979932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:05:41.979932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:05:41.979932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:05:41.979932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 21:05:41.979932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:41.979932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:41.979932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:41.979932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:41.979932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:41.979932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:41.979932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:05:41.979932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:05:41.979932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 21:05:41.979932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:41.987023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-87b5adbc-2bce-4c64-906c-c90f0cb4ae94 tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:41.991000 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-87b5adbc-2bce-4c64-906c-c90f0cb4ae94 tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.443171 Oct 04 21:05:41.995094 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1128 bytes} [Tue Oct 4 21:05:41 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 450 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:05:42.008697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cae457ba-2b6c-4b45-beb5-bb242227924f tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:42.193698 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cae457ba-2b6c-4b45-beb5-bb242227924f tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1589211073/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.194821 Oct 04 21:05:42.201654 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 5/9] 10.222.0.30 () {60 vars in 1224 bytes} [Tue Oct 4 21:05:41 2022] POST /compute/v2.1/flavors/1589211073/os-extra_specs => generated 66 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:05:42.206690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-30e154e4-add6-41b2-8096-2b9059274424 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:42.220503 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-30e154e4-add6-41b2-8096-2b9059274424 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.017541 Oct 04 21:05:42.221608 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 6/10] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Oct 4 21:05:42 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:42.226364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b396df83-bbe5-4276-b355-3389179a163b tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Calling method '.version_select at 0x7f5791b049d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:42.228607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b396df83-bbe5-4276-b355-3389179a163b tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '76ddfd63dd004ca9bcbf20e8131af95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe8a1fca0c948e6a609e46d3e0ce7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b396df83-bbe5-4276-b355-3389179a163b tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Request method failure captured: Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-hosts/n-d-860282-1/reboot HTTP/1.1 Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKAgspKR6oG-5mqBOB1OvMvJVeOriHE-YLdSUHqDzu9zAdXiZfcaHAK-udj1Lk1FZIy4kO_4nqu_ZtNBQAvFjIymdKRwbGLLv34WfNe63pO0AQFqfohm0FHEVXL2tmXsJ5kFcfroIOIbqOBLDCqhmmUDTu1xkDre4T3meXNMmbJJXB8 Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: fbe8a1fca0c948e6a609e46d3e0ce7b2 Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1430533500 Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:05:42.231404 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:05:42.232774 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}] Oct 04 21:05:42.232774 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1430533500 Oct 04 21:05:42.232774 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: fbe8a1fca0c948e6a609e46d3e0ce7b2 Oct 04 21:05:42.232774 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1430533500 Oct 04 21:05:42.232774 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-HostsAdminNegativeTestJSON-1430533500-project Oct 04 21:05:42.232774 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:05:42.232774 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:05:42.232774 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 76ddfd63dd004ca9bcbf20e8131af95a Oct 04 21:05:42.232774 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1430533500-project Oct 04 21:05:42.232774 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:05:42.232774 n-d-860282-1 devstack@n-api.service[122758]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 21:05:42.232774 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'n-d-860282-1'} Oct 04 21:05:42.232774 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:42.233616 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:42.233616 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:42.233616 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:42.233616 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:42.233616 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:42.233616 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:05:42.233616 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:05:42.233616 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:42.233616 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:42.233616 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 04 21:05:42.233616 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 04 21:05:42.233616 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:05:42.233616 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:05:42.233616 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:05:42.233616 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:05:42.233616 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:05:42.233616 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:05:42.233616 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:05:42.233616 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:05:42.234546 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:05:42.234546 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:05:42.234546 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:05:42.234546 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:05:42.234546 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:05:42.234546 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:05:42.234546 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 21:05:42.234546 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:42.234546 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:42.234546 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:42.234546 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:42.234546 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:42.234546 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:42.234546 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:05:42.234546 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:05:42.234546 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 21:05:42.234546 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:42.237687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b396df83-bbe5-4276-b355-3389179a163b tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:42.239003 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b396df83-bbe5-4276-b355-3389179a163b tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/n-d-860282-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.016297 Oct 04 21:05:42.239648 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 7/11] 10.222.0.30 () {58 vars in 1188 bytes} [Tue Oct 4 21:05:42 2022] GET /compute/v2.1/os-hosts/n-d-860282-1/reboot => generated 111 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:05:42.448697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-592f9c5d-ecaf-483c-93ea-ccb4c1caf723 tempest-FlavorsExtraSpecsTestJSON-730566428 tempest-FlavorsExtraSpecsTestJSON-730566428-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:42.482498 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-592f9c5d-ecaf-483c-93ea-ccb4c1caf723 tempest-FlavorsExtraSpecsTestJSON-730566428 tempest-FlavorsExtraSpecsTestJSON-730566428-project] 10.222.0.30 "GET /compute/v2.1/flavors/1589211073/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.229424 Oct 04 21:05:42.482498 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 8/12] 10.222.0.30 () {58 vars in 1203 bytes} [Tue Oct 4 21:05:42 2022] GET /compute/v2.1/flavors/1589211073/os-extra_specs => generated 66 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:05:42.482806 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b332b8b4-3cc2-4dd9-afce-7bb8c0e6bbfd tempest-FlavorsAccessTestJSON-1954615998 tempest-FlavorsAccessTestJSON-1954615998-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1156302279/action" status: 200 len: 97 microversion: 2.1 time: 0.765101 Oct 04 21:05:42.482901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-25020764-9f5c-4c8f-bd01-b39c4db2764c tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860282-1"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:42.482995 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 5/13] 10.222.0.30 () {60 vars in 1200 bytes} [Tue Oct 4 21:05:41 2022] POST /compute/v2.1/flavors/1156302279/action => generated 97 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:05:42.485702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dce9db37-7401-48a2-affb-927ecb481c4f tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Calling method '.version_select at 0x7f5791ace1f0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:42.516741 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-dce9db37-7401-48a2-affb-927ecb481c4f tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:42.523638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25020764-9f5c-4c8f-bd01-b39c4db2764c tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:42.524137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25020764-9f5c-4c8f-bd01-b39c4db2764c tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:42.524574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25020764-9f5c-4c8f-bd01-b39c4db2764c tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dce9db37-7401-48a2-affb-927ecb481c4f tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Request method failure captured: Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKAj_rdd6BeTGb7u0dP6YGdGNDhp4OMEPKiI31D1iXl76-jsW_gqojBwv2K6P4ObJ8UPmHWJsImBG3RYdgSl7meqK6bXJ9j4zvoszsAXyjd39XY2AhwxkmoycFhFpP0o-JFhBsaMgV_MGOo2nb10cT-oAnwI2cN3zu3idGSIAn3hR0U Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: cd3f6b59c20c46deb7c2c99b4625c88f Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:05:42.524968 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:05:42.526501 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd3f6b59c20c46deb7c2c99b4625c88f"}]}] Oct 04 21:05:42.526501 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:42.526501 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: cd3f6b59c20c46deb7c2c99b4625c88f Oct 04 21:05:42.526501 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:42.526501 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-HostsAdminNegativeTestJSON-2008808556-project-admin Oct 04 21:05:42.526501 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:05:42.526501 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:05:42.526501 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c1c92dc5a9b04f8e9efe2e265ed9e250 Oct 04 21:05:42.526501 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2008808556-project-admin Oct 04 21:05:42.526501 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:05:42.526501 n-d-860282-1 devstack@n-api.service[122757]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:42.526501 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'nonexistent_hostname'} Oct 04 21:05:42.526501 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:42.527852 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:42.527852 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 21:05:42.527852 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 21:05:42.527852 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:05:42.527852 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:05:42.527852 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:05:42.527852 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:05:42.527852 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:05:42.527852 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:05:42.527852 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:05:42.527852 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:05:42.527852 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 21:05:42.527852 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 21:05:42.527852 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:05:42.527852 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:05:42.527852 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 21:05:42.527852 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 21:05:42.527852 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:05:42.527852 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:05:42.529666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 21:05:42.529666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 21:05:42.529666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:42.529666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:05:42.529666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:42.529666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:05:42.529666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:42.529666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:42.529666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:42.529666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:42.529666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:42.529666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:05:42.529666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:05:42.529666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:42.529666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:42.529666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 04 21:05:42.529666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 04 21:05:42.529666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 21:05:42.529666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:05:42.531366 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:42.531366 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:05:42.531366 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:42.531366 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:05:42.531366 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:42.531366 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:42.531366 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:42.531366 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:05:42.531366 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:05:42.531366 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:42.531366 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:05:42.531366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dce9db37-7401-48a2-affb-927ecb481c4f tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:42.531366 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dce9db37-7401-48a2-affb-927ecb481c4f tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.048775 Oct 04 21:05:42.532618 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 6/14] 10.222.0.30 () {58 vars in 1212 bytes} [Tue Oct 4 21:05:42 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:05:42.549804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c1d915c2-2cb9-40b6-9dbf-f66d68c9ee89 tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:42.596944 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c1d915c2-2cb9-40b6-9dbf-f66d68c9ee89 tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1589211073/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.064206 Oct 04 21:05:42.604723 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 7/15] 10.222.0.30 () {60 vars in 1224 bytes} [Tue Oct 4 21:05:42 2022] POST /compute/v2.1/flavors/1589211073/os-extra_specs => generated 66 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:05:43.062018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f7a5ec85-aa30-4bb8-900e-4646664bb248 tempest-FlavorsAccessTestJSON-908773925 tempest-FlavorsAccessTestJSON-908773925-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:43.116631 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f7a5ec85-aa30-4bb8-900e-4646664bb248 tempest-FlavorsAccessTestJSON-908773925 tempest-FlavorsAccessTestJSON-908773925-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.509291 Oct 04 21:05:43.125493 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 8/16] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:42 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:43.131444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c6f2e6ba-6d0c-460e-b477-4cee8a3e22cd tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Calling method '.version_select at 0x7f5791c42ca0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:43.135296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c6f2e6ba-6d0c-460e-b477-4cee8a3e22cd tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '76ddfd63dd004ca9bcbf20e8131af95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe8a1fca0c948e6a609e46d3e0ce7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c6f2e6ba-6d0c-460e-b477-4cee8a3e22cd tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Request method failure captured: Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-hosts/n-d-860282-1 HTTP/1.1 Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKAgspKR6oG-5mqBOB1OvMvJVeOriHE-YLdSUHqDzu9zAdXiZfcaHAK-udj1Lk1FZIy4kO_4nqu_ZtNBQAvFjIymdKRwbGLLv34WfNe63pO0AQFqfohm0FHEVXL2tmXsJ5kFcfroIOIbqOBLDCqhmmUDTu1xkDre4T3meXNMmbJJXB8 Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fbe8a1fca0c948e6a609e46d3e0ce7b2 Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1430533500 Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:05:43.143363 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:05:43.145374 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}] Oct 04 21:05:43.145374 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1430533500 Oct 04 21:05:43.145374 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fbe8a1fca0c948e6a609e46d3e0ce7b2 Oct 04 21:05:43.145374 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1430533500 Oct 04 21:05:43.145374 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-HostsAdminNegativeTestJSON-1430533500-project Oct 04 21:05:43.145374 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:05:43.145374 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:05:43.145374 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 76ddfd63dd004ca9bcbf20e8131af95a Oct 04 21:05:43.145374 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1430533500-project Oct 04 21:05:43.145374 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:05:43.145374 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 21:05:43.145374 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'n-d-860282-1'} Oct 04 21:05:43.145374 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:43.146184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:43.146184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:43.146184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:43.146184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:43.146184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:43.146184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:05:43.146184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:05:43.146184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:43.146184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:43.146184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 04 21:05:43.146184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 04 21:05:43.146184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:05:43.146184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:05:43.146184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:05:43.146184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:05:43.146184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:05:43.146184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:05:43.146184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:05:43.146184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:05:43.147372 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:05:43.147372 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:05:43.147372 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:05:43.147372 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:05:43.147372 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:05:43.147372 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:05:43.147372 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 21:05:43.147372 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:05:43.147372 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:43.147372 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:05:43.147372 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:43.147372 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:43.147372 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:43.147372 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:05:43.147372 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:05:43.147372 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 21:05:43.147372 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:05:43.148426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c6f2e6ba-6d0c-460e-b477-4cee8a3e22cd tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:43.148426 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c6f2e6ba-6d0c-460e-b477-4cee8a3e22cd tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/n-d-860282-1" status: 403 len: 109 microversion: 2.1 time: 0.026312 Oct 04 21:05:43.153609 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 9/17] 10.222.0.30 () {58 vars in 1167 bytes} [Tue Oct 4 21:05:43 2022] GET /compute/v2.1/os-hosts/n-d-860282-1 => generated 109 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:05:43.158866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-38be6c16-e076-4939-a4b0-6fc9d1f42232 tempest-FlavorsExtraSpecsTestJSON-730566428 tempest-FlavorsExtraSpecsTestJSON-730566428-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:43.179584 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-38be6c16-e076-4939-a4b0-6fc9d1f42232 tempest-FlavorsExtraSpecsTestJSON-730566428 tempest-FlavorsExtraSpecsTestJSON-730566428-project] 10.222.0.30 "GET /compute/v2.1/flavors/1589211073/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.024427 Oct 04 21:05:43.180906 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 10/18] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:05:43 2022] GET /compute/v2.1/flavors/1589211073/os-extra_specs/hw:numa_nodes => generated 22 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:05:43.189773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9df96a31-0d85-4477-bf04-9bffdc63133b tempest-FlavorsAccessTestJSON-1954615998 tempest-FlavorsAccessTestJSON-1954615998-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "977ec6532adc446aab95585193efd2ef"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:43.613673 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-25020764-9f5c-4c8f-bd01-b39c4db2764c tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.1 time: 1.140785 Oct 04 21:05:43.616442 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 9/19] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Oct 4 21:05:42 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:43.621932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c6825a61-1c16-4493-ba3f-fa8b55454c68 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Calling method '.version_select at 0x7f5791b4b3a0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:43.637914 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-c6825a61-1c16-4493-ba3f-fa8b55454c68 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:43.644117 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9df96a31-0d85-4477-bf04-9bffdc63133b tempest-FlavorsAccessTestJSON-1954615998 tempest-FlavorsAccessTestJSON-1954615998-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1156302279/action" status: 200 len: 21 microversion: 2.1 time: 0.461921 Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c6825a61-1c16-4493-ba3f-fa8b55454c68 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Request method failure captured: Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKAj_rdd6BeTGb7u0dP6YGdGNDhp4OMEPKiI31D1iXl76-jsW_gqojBwv2K6P4ObJ8UPmHWJsImBG3RYdgSl7meqK6bXJ9j4zvoszsAXyjd39XY2AhwxkmoycFhFpP0o-JFhBsaMgV_MGOo2nb10cT-oAnwI2cN3zu3idGSIAn3hR0U Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: cd3f6b59c20c46deb7c2c99b4625c88f Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:05:43.645758 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:05:43.647175 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd3f6b59c20c46deb7c2c99b4625c88f"}]}] Oct 04 21:05:43.647175 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:43.647175 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: cd3f6b59c20c46deb7c2c99b4625c88f Oct 04 21:05:43.647175 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:43.647175 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-HostsAdminNegativeTestJSON-2008808556-project-admin Oct 04 21:05:43.647175 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:05:43.647175 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:05:43.647175 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c1c92dc5a9b04f8e9efe2e265ed9e250 Oct 04 21:05:43.647175 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2008808556-project-admin Oct 04 21:05:43.647175 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:05:43.647175 n-d-860282-1 devstack@n-api.service[122758]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:43.647175 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'nonexistent_hostname'} Oct 04 21:05:43.647175 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:43.648009 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:43.648009 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 04 21:05:43.648009 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 21:05:43.648009 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:05:43.648009 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:05:43.648009 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 21:05:43.648009 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 21:05:43.648009 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:05:43.648009 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:05:43.648009 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 21:05:43.648009 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 21:05:43.648009 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:43.648009 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:43.648009 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:43.648009 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:43.648009 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:43.648009 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:43.648009 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:43.648009 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:43.649246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:43.649246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:05:43.649246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:05:43.649246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:43.649246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:43.649246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 04 21:05:43.649246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:05:43.649246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:43.649246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:43.649246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:43.649246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:43.649246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:43.649246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:43.649246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:43.649246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:05:43.649246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:05:43.649246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:43.649246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:43.650244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c6825a61-1c16-4493-ba3f-fa8b55454c68 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:43.650244 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c6825a61-1c16-4493-ba3f-fa8b55454c68 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.031667 Oct 04 21:05:43.650244 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 10/20] 10.222.0.30 () {58 vars in 1191 bytes} [Tue Oct 4 21:05:43 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:05:43.661744 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 11/21] 10.222.0.30 () {60 vars in 1200 bytes} [Tue Oct 4 21:05:43 2022] POST /compute/v2.1/flavors/1156302279/action => generated 21 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:05:43.668146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-41d7cd92-7edc-43a2-8dd4-2f59f28152c3 tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:43.676534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-00964ac7-364a-4dbd-860c-cc05659b653e tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Calling method '.version_select at 0x7f57911f5af0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:43.690970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-00964ac7-364a-4dbd-860c-cc05659b653e tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '76ddfd63dd004ca9bcbf20e8131af95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe8a1fca0c948e6a609e46d3e0ce7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-00964ac7-364a-4dbd-860c-cc05659b653e tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Request method failure captured: Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-hosts/n-d-860282-1/shutdown HTTP/1.1 Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKAgspKR6oG-5mqBOB1OvMvJVeOriHE-YLdSUHqDzu9zAdXiZfcaHAK-udj1Lk1FZIy4kO_4nqu_ZtNBQAvFjIymdKRwbGLLv34WfNe63pO0AQFqfohm0FHEVXL2tmXsJ5kFcfroIOIbqOBLDCqhmmUDTu1xkDre4T3meXNMmbJJXB8 Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fbe8a1fca0c948e6a609e46d3e0ce7b2 Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1430533500 Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:05:43.693358 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:05:43.694732 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}] Oct 04 21:05:43.694732 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1430533500 Oct 04 21:05:43.694732 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fbe8a1fca0c948e6a609e46d3e0ce7b2 Oct 04 21:05:43.694732 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1430533500 Oct 04 21:05:43.694732 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-HostsAdminNegativeTestJSON-1430533500-project Oct 04 21:05:43.694732 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:05:43.694732 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:05:43.694732 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 76ddfd63dd004ca9bcbf20e8131af95a Oct 04 21:05:43.694732 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1430533500-project Oct 04 21:05:43.694732 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:05:43.694732 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 21:05:43.694732 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'n-d-860282-1'} Oct 04 21:05:43.694732 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:43.695535 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:43.695535 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:43.695535 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:43.695535 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:43.695535 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:43.695535 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:05:43.695535 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:05:43.695535 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:43.695535 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:43.695535 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 04 21:05:43.695535 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 04 21:05:43.695535 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:05:43.695535 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:05:43.695535 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:05:43.695535 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:05:43.695535 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:05:43.695535 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:05:43.695535 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:05:43.695535 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:05:43.696697 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:05:43.696697 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:05:43.696697 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:05:43.696697 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:05:43.696697 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:05:43.696697 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:05:43.696697 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 21:05:43.696697 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:05:43.696697 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:43.696697 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:05:43.696697 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:43.696697 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:43.696697 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:43.696697 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:05:43.696697 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:05:43.696697 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 21:05:43.696697 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:05:43.698374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-00964ac7-364a-4dbd-860c-cc05659b653e tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:43.701975 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-00964ac7-364a-4dbd-860c-cc05659b653e tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/n-d-860282-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.032026 Oct 04 21:05:43.703284 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 12/22] 10.222.0.30 () {58 vars in 1194 bytes} [Tue Oct 4 21:05:43 2022] GET /compute/v2.1/os-hosts/n-d-860282-1/shutdown => generated 113 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:05:43.721527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-40b3d5a1-77c1-4db7-b81b-46f22a37404f tempest-FlavorsAccessTestJSON-908773925 tempest-FlavorsAccessTestJSON-908773925-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:43.737884 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-41d7cd92-7edc-43a2-8dd4-2f59f28152c3 tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1589211073/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.084448 Oct 04 21:05:43.746638 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 11/23] 10.222.0.30 () {60 vars in 1224 bytes} [Tue Oct 4 21:05:43 2022] POST /compute/v2.1/flavors/1589211073/os-extra_specs => generated 66 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:05:43.753221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-43bd611e-01cf-4c51-a7a2-69f2003a7646 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Calling method '.version_select at 0x7f579119ab80>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:43.761761 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-40b3d5a1-77c1-4db7-b81b-46f22a37404f tempest-FlavorsAccessTestJSON-908773925 tempest-FlavorsAccessTestJSON-908773925-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.056906 Oct 04 21:05:43.778271 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 13/24] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:43 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:43.784763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9d79cfe5-dd02-43d5-8c76-afb8af459ecd tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:43.789101 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-43bd611e-01cf-4c51-a7a2-69f2003a7646 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:43.794181 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9d79cfe5-dd02-43d5-8c76-afb8af459ecd tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1589211073/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014193 Oct 04 21:05:43.795355 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 14/25] 10.222.0.30 () {58 vars in 1203 bytes} [Tue Oct 4 21:05:43 2022] GET /compute/v2.1/flavors/1589211073/os-extra_specs => generated 66 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-43bd611e-01cf-4c51-a7a2-69f2003a7646 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Request method failure captured: Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKAj_rdd6BeTGb7u0dP6YGdGNDhp4OMEPKiI31D1iXl76-jsW_gqojBwv2K6P4ObJ8UPmHWJsImBG3RYdgSl7meqK6bXJ9j4zvoszsAXyjd39XY2AhwxkmoycFhFpP0o-JFhBsaMgV_MGOo2nb10cT-oAnwI2cN3zu3idGSIAn3hR0U Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: cd3f6b59c20c46deb7c2c99b4625c88f Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:05:43.796505 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:05:43.797772 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd3f6b59c20c46deb7c2c99b4625c88f"}]}] Oct 04 21:05:43.797772 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:43.797772 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: cd3f6b59c20c46deb7c2c99b4625c88f Oct 04 21:05:43.797772 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:43.797772 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-HostsAdminNegativeTestJSON-2008808556-project-admin Oct 04 21:05:43.797772 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:05:43.797772 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:05:43.797772 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c1c92dc5a9b04f8e9efe2e265ed9e250 Oct 04 21:05:43.797772 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2008808556-project-admin Oct 04 21:05:43.797772 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:05:43.797772 n-d-860282-1 devstack@n-api.service[122758]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:43.797772 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'nonexistent_hostname'} Oct 04 21:05:43.797772 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:43.798448 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:43.798448 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 21:05:43.798448 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 21:05:43.798448 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:05:43.798448 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:05:43.798448 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:05:43.798448 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:05:43.798448 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:05:43.798448 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:05:43.798448 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:05:43.798448 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:05:43.798448 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 21:05:43.798448 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 21:05:43.798448 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:05:43.798448 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:05:43.798448 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 21:05:43.798448 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 21:05:43.798448 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:05:43.798448 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:05:43.799917 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 21:05:43.799917 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 21:05:43.799917 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:43.799917 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:43.799917 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:43.799917 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:43.799917 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:43.799917 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:43.799917 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:43.799917 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:43.799917 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:43.799917 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:05:43.799917 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:05:43.799917 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:43.799917 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:43.799917 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 04 21:05:43.799917 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 04 21:05:43.799917 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 21:05:43.799917 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:05:43.801322 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:43.801322 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:43.801322 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:43.801322 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:43.801322 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:43.801322 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:43.801322 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:43.801322 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:05:43.801322 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:05:43.801322 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:43.801322 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:43.801322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-43bd611e-01cf-4c51-a7a2-69f2003a7646 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:43.801322 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-43bd611e-01cf-4c51-a7a2-69f2003a7646 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.050903 Oct 04 21:05:43.801322 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 12/26] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Oct 4 21:05:43 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:05:43.805773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6be2cec9-f5c9-4238-8e10-2efc15be75c3 tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:43.809099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d22dc50f-cb3f-45d7-aec8-fccb4d695dc2 tempest-FlavorsAccessTestJSON-1954615998 tempest-FlavorsAccessTestJSON-1954615998-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:43.954334 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d22dc50f-cb3f-45d7-aec8-fccb4d695dc2 tempest-FlavorsAccessTestJSON-1954615998 tempest-FlavorsAccessTestJSON-1954615998-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1156302279" status: 202 len: 0 microversion: 2.1 time: 0.157638 Oct 04 21:05:43.954914 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 15/27] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Oct 4 21:05:43 2022] DELETE /compute/v2.1/flavors/1156302279 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:05:43.965570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-17d7ece7-f22c-444b-97b7-9733d4311e53 tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Calling method '.version_select at 0x7f57911bb820>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:43.985274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-17d7ece7-f22c-444b-97b7-9733d4311e53 tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '76ddfd63dd004ca9bcbf20e8131af95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe8a1fca0c948e6a609e46d3e0ce7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-17d7ece7-f22c-444b-97b7-9733d4311e53 tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Request method failure captured: Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-hosts/n-d-860282-1/startup HTTP/1.1 Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKAgspKR6oG-5mqBOB1OvMvJVeOriHE-YLdSUHqDzu9zAdXiZfcaHAK-udj1Lk1FZIy4kO_4nqu_ZtNBQAvFjIymdKRwbGLLv34WfNe63pO0AQFqfohm0FHEVXL2tmXsJ5kFcfroIOIbqOBLDCqhmmUDTu1xkDre4T3meXNMmbJJXB8 Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fbe8a1fca0c948e6a609e46d3e0ce7b2 Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1430533500 Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:05:43.987270 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:05:43.988659 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}] Oct 04 21:05:43.988659 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1430533500 Oct 04 21:05:43.988659 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fbe8a1fca0c948e6a609e46d3e0ce7b2 Oct 04 21:05:43.988659 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1430533500 Oct 04 21:05:43.988659 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-HostsAdminNegativeTestJSON-1430533500-project Oct 04 21:05:43.988659 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:05:43.988659 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:05:43.988659 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 76ddfd63dd004ca9bcbf20e8131af95a Oct 04 21:05:43.988659 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1430533500-project Oct 04 21:05:43.988659 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:05:43.988659 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 21:05:43.988659 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'n-d-860282-1'} Oct 04 21:05:43.988659 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:43.989335 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:43.989335 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:43.989335 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:43.989335 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:43.989335 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:43.989335 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:05:43.989335 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:05:43.989335 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:43.989335 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:43.989335 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 04 21:05:43.989335 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 04 21:05:43.989335 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:05:43.989335 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:05:43.989335 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:05:43.989335 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:05:43.989335 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:05:43.989335 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:05:43.989335 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:05:43.989335 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:05:43.990346 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:05:43.990346 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:05:43.990346 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:05:43.990346 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:05:43.990346 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:05:43.990346 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:05:43.990346 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 21:05:43.990346 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:05:43.990346 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:43.990346 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:05:43.990346 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:43.990346 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:43.990346 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:43.990346 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:05:43.990346 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:05:43.990346 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 21:05:43.990346 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:05:43.994531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-17d7ece7-f22c-444b-97b7-9733d4311e53 tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:43.998752 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-17d7ece7-f22c-444b-97b7-9733d4311e53 tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/n-d-860282-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.042583 Oct 04 21:05:44.005542 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 16/28] 10.222.0.30 () {58 vars in 1191 bytes} [Tue Oct 4 21:05:43 2022] GET /compute/v2.1/os-hosts/n-d-860282-1/startup => generated 110 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:05:44.012743 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6be2cec9-f5c9-4238-8e10-2efc15be75c3 tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1589211073/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.209383 Oct 04 21:05:44.013706 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 13/29] 10.222.0.30 () {60 vars in 1265 bytes} [Tue Oct 4 21:05:43 2022] PUT /compute/v2.1/flavors/1589211073/os-extra_specs/hw:numa_nodes => generated 22 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:05:44.023683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-14a7772e-8815-4638-ae7a-4145ba7eaaa8 tempest-FlavorsAccessTestJSON-1954615998 tempest-FlavorsAccessTestJSON-1954615998-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:44.075223 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-14a7772e-8815-4638-ae7a-4145ba7eaaa8 tempest-FlavorsAccessTestJSON-1954615998 tempest-FlavorsAccessTestJSON-1954615998-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.058506 Oct 04 21:05:44.078496 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 14/30] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:44 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:44.084805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa2affc0-f563-46e8-8086-92e6d13cd3e9 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Calling method '.version_select at 0x7f579119a9d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:44.096480 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-aa2affc0-f563-46e8-8086-92e6d13cd3e9 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa2affc0-f563-46e8-8086-92e6d13cd3e9 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Request method failure captured: Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKAj_rdd6BeTGb7u0dP6YGdGNDhp4OMEPKiI31D1iXl76-jsW_gqojBwv2K6P4ObJ8UPmHWJsImBG3RYdgSl7meqK6bXJ9j4zvoszsAXyjd39XY2AhwxkmoycFhFpP0o-JFhBsaMgV_MGOo2nb10cT-oAnwI2cN3zu3idGSIAn3hR0U Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: cd3f6b59c20c46deb7c2c99b4625c88f Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:05:44.098723 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:05:44.099879 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd3f6b59c20c46deb7c2c99b4625c88f"}]}] Oct 04 21:05:44.099879 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:44.099879 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: cd3f6b59c20c46deb7c2c99b4625c88f Oct 04 21:05:44.099879 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:44.099879 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-HostsAdminNegativeTestJSON-2008808556-project-admin Oct 04 21:05:44.099879 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:05:44.099879 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:05:44.099879 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c1c92dc5a9b04f8e9efe2e265ed9e250 Oct 04 21:05:44.099879 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2008808556-project-admin Oct 04 21:05:44.099879 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:05:44.099879 n-d-860282-1 devstack@n-api.service[122758]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:44.099879 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'nonexistent_hostname'} Oct 04 21:05:44.099879 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:44.100676 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:44.100676 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 21:05:44.100676 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 21:05:44.100676 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:05:44.100676 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:05:44.100676 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:05:44.100676 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:05:44.100676 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:05:44.100676 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:05:44.100676 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:05:44.100676 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:05:44.100676 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 21:05:44.100676 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 21:05:44.100676 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:05:44.100676 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:05:44.100676 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 21:05:44.100676 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 21:05:44.100676 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:05:44.100676 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:05:44.106878 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 21:05:44.106878 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 21:05:44.106878 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:44.106878 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:44.106878 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:44.106878 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:44.106878 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:44.106878 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:44.106878 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:44.106878 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:44.106878 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:44.106878 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:05:44.106878 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:05:44.106878 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:44.106878 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:44.106878 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 04 21:05:44.106878 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 04 21:05:44.106878 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 21:05:44.106878 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:05:44.107868 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:44.107868 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:44.107868 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:44.107868 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:44.107868 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:44.107868 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:44.107868 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:44.107868 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:05:44.107868 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:05:44.107868 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:44.107868 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:44.107868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa2affc0-f563-46e8-8086-92e6d13cd3e9 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:44.107868 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aa2affc0-f563-46e8-8086-92e6d13cd3e9 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.020534 Oct 04 21:05:44.107868 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 15/31] 10.222.0.30 () {58 vars in 1215 bytes} [Tue Oct 4 21:05:44 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:05:44.110018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-be18ddcc-d81c-42e1-9b03-4797abe5100d tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:44.124022 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-be18ddcc-d81c-42e1-9b03-4797abe5100d tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1589211073/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.021337 Oct 04 21:05:44.130418 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 16/32] 10.222.0.30 () {58 vars in 1203 bytes} [Tue Oct 4 21:05:44 2022] GET /compute/v2.1/flavors/1589211073/os-extra_specs => generated 66 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:05:44.141001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8dce299f-35f5-4f6b-abff-857cfd063f85 tempest-FlavorsAccessTestJSON-1954615998 tempest-FlavorsAccessTestJSON-1954615998-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-681690239", "id": 589751394, "os-flavor-access:is_public": "False"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:44.304452 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8dce299f-35f5-4f6b-abff-857cfd063f85 tempest-FlavorsAccessTestJSON-1954615998 tempest-FlavorsAccessTestJSON-1954615998-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.172901 Oct 04 21:05:44.312924 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 17/33] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:44 2022] POST /compute/v2.1/flavors => generated 427 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:44.318710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fd13619d-77ea-4952-98b0-52313efe59f5 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Action: 'update', calling method: .version_select at 0x7f5791b4b3a0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fd13619d-77ea-4952-98b0-52313efe59f5 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Request method failure captured: Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: request: PUT /compute/v2.1/os-hosts/n-d-860282-1 HTTP/1.1 Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 51 Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKAj_rdd6BeTGb7u0dP6YGdGNDhp4OMEPKiI31D1iXl76-jsW_gqojBwv2K6P4ObJ8UPmHWJsImBG3RYdgSl7meqK6bXJ9j4zvoszsAXyjd39XY2AhwxkmoycFhFpP0o-JFhBsaMgV_MGOo2nb10cT-oAnwI2cN3zu3idGSIAn3hR0U Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: cd3f6b59c20c46deb7c2c99b4625c88f Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:05:44.326621 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:05:44.327834 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd3f6b59c20c46deb7c2c99b4625c88f"}]}] Oct 04 21:05:44.327834 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:44.327834 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: cd3f6b59c20c46deb7c2c99b4625c88f Oct 04 21:05:44.327834 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:44.327834 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-HostsAdminNegativeTestJSON-2008808556-project-admin Oct 04 21:05:44.327834 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:05:44.327834 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:05:44.327834 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c1c92dc5a9b04f8e9efe2e265ed9e250 Oct 04 21:05:44.327834 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2008808556-project-admin Oct 04 21:05:44.327834 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:05:44.327834 n-d-860282-1 devstack@n-api.service[122758]: {"status": "enable", "maintenance_mode": "invalid"} Oct 04 21:05:44.327834 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:05:44.327834 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'n-d-860282-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance: Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:44.328545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:44.330672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:44.330672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:44.330672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:44.330672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:05:44.330672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:05:44.330672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:44.330672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:44.330672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:05:44.330672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:05:44.330672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:05:44.330672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:05:44.330672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:05:44.330672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:05:44.330672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 21:05:44.330672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:44.330672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:44.330672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:44.330672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:44.330672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:44.332335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:44.332335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:05:44.332335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:05:44.332335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 21:05:44.332335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:44.332335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fd13619d-77ea-4952-98b0-52313efe59f5 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:44.332335 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fd13619d-77ea-4952-98b0-52313efe59f5 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/n-d-860282-1" status: 400 len: 199 microversion: 2.1 time: 0.022068 Oct 04 21:05:44.332335 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 18/34] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Oct 4 21:05:44 2022] PUT /compute/v2.1/os-hosts/n-d-860282-1 => generated 199 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:05:44.338435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-03cc0984-9e77-4734-abd3-609ebb6ec594 tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:44.446099 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-03cc0984-9e77-4734-abd3-609ebb6ec594 tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1589211073/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.111276 Oct 04 21:05:44.447105 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 19/35] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Oct 4 21:05:44 2022] DELETE /compute/v2.1/flavors/1589211073/os-extra_specs/hw:numa_nodes => generated 0 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:05:44.450996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-2000908682", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "availability_zone": "tempest-test_az-1418620599"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:44.466623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:44.467306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:44.467753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:44.468535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:44.469984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:44.475185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:44.528405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fbd77d71-3a05-40eb-af6c-71dcffc27eb9 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1464878370", "id": 927400784, "os-flavor-access:is_public": "True"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:44.686620 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fbd77d71-3a05-40eb-af6c-71dcffc27eb9 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.238227 Oct 04 21:05:44.696636 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 20/36] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:44 2022] POST /compute/v2.1/flavors => generated 427 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:44.702622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-546e4128-ac3b-4b19-b215-fcfee3448c54 tempest-FlavorsAccessTestJSON-1954615998 tempest-FlavorsAccessTestJSON-1954615998-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:44.722009 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-546e4128-ac3b-4b19-b215-fcfee3448c54 tempest-FlavorsAccessTestJSON-1954615998 tempest-FlavorsAccessTestJSON-1954615998-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/589751394/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.023918 Oct 04 21:05:44.723081 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 21/37] 10.222.0.30 () {58 vars in 1206 bytes} [Tue Oct 4 21:05:44 2022] GET /compute/v2.1/flavors/589751394/os-flavor-access => generated 21 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:05:44.730772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fbd3ed60-efd5-4e97-87e8-f50a01105def tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Action: 'update', calling method: .version_select at 0x7f5791a73e50>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fbd3ed60-efd5-4e97-87e8-f50a01105def tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Request method failure captured: Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: request: PUT /compute/v2.1/os-hosts/n-d-860282-1 HTTP/1.1 Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 51 Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKAj_rdd6BeTGb7u0dP6YGdGNDhp4OMEPKiI31D1iXl76-jsW_gqojBwv2K6P4ObJ8UPmHWJsImBG3RYdgSl7meqK6bXJ9j4zvoszsAXyjd39XY2AhwxkmoycFhFpP0o-JFhBsaMgV_MGOo2nb10cT-oAnwI2cN3zu3idGSIAn3hR0U Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: cd3f6b59c20c46deb7c2c99b4625c88f Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:05:44.733957 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:05:44.735063 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd3f6b59c20c46deb7c2c99b4625c88f"}]}] Oct 04 21:05:44.735063 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:44.735063 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: cd3f6b59c20c46deb7c2c99b4625c88f Oct 04 21:05:44.735063 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:44.735063 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-HostsAdminNegativeTestJSON-2008808556-project-admin Oct 04 21:05:44.735063 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:05:44.735063 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:05:44.735063 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c1c92dc5a9b04f8e9efe2e265ed9e250 Oct 04 21:05:44.735063 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2008808556-project-admin Oct 04 21:05:44.735063 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:05:44.735063 n-d-860282-1 devstack@n-api.service[122758]: {"status": "invalid", "maintenance_mode": "enable"} Oct 04 21:05:44.735063 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:05:44.735063 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'n-d-860282-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance: Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:44.735736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:44.736972 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:44.736972 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:44.736972 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:44.736972 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:05:44.736972 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:05:44.736972 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:44.736972 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:44.736972 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:05:44.736972 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:05:44.736972 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:05:44.736972 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:05:44.736972 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:05:44.736972 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:05:44.736972 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 21:05:44.736972 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:44.736972 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:44.736972 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:44.736972 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:44.736972 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:44.737967 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:44.737967 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:05:44.737967 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:05:44.737967 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 21:05:44.737967 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:44.739732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fbd3ed60-efd5-4e97-87e8-f50a01105def tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:44.740799 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fbd3ed60-efd5-4e97-87e8-f50a01105def tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/n-d-860282-1" status: 400 len: 189 microversion: 2.1 time: 0.016453 Oct 04 21:05:44.741592 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 22/38] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Oct 4 21:05:44 2022] PUT /compute/v2.1/os-hosts/n-d-860282-1 => generated 189 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:05:44.746491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8627fad5-8756-47c9-971b-3018772b7e57 tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:44.838230 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8627fad5-8756-47c9-971b-3018772b7e57 tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1589211073/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.095366 Oct 04 21:05:44.840127 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 23/39] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Oct 4 21:05:44 2022] DELETE /compute/v2.1/flavors/1589211073/os-extra_specs/hw:cpu_policy => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:05:44.850826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9b742a91-2db5-4d6c-beb4-79f53f89de9f tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:44.873179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=76,nova_api:SAVEPOINT=7,nova_api:INSERT=5,nova_api:RELEASE=7,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:44.983508 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9b742a91-2db5-4d6c-beb4-79f53f89de9f tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/927400784" status: 202 len: 0 microversion: 2.1 time: 0.141965 Oct 04 21:05:44.984105 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 24/40] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Oct 4 21:05:44 2022] DELETE /compute/v2.1/flavors/927400784 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:05:44.990389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f81ec555-356f-41fa-9786-b697c9eda5bd tempest-FlavorsAccessTestJSON-1954615998 tempest-FlavorsAccessTestJSON-1954615998-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:45.093481 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f81ec555-356f-41fa-9786-b697c9eda5bd tempest-FlavorsAccessTestJSON-1954615998 tempest-FlavorsAccessTestJSON-1954615998-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/589751394" status: 202 len: 0 microversion: 2.1 time: 0.107444 Oct 04 21:05:45.096011 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 25/41] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Oct 4 21:05:44 2022] DELETE /compute/v2.1/flavors/589751394 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:05:45.108010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a607d4d2-4447-450a-a4e0-b0ca81501a07 tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Action: 'update', calling method: .version_select at 0x7f579119ae50>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:45.109816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] validate_networks() for None {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:05:45.114681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a607d4d2-4447-450a-a4e0-b0ca81501a07 tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '76ddfd63dd004ca9bcbf20e8131af95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe8a1fca0c948e6a609e46d3e0ce7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a607d4d2-4447-450a-a4e0-b0ca81501a07 tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Request method failure captured: Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: request: PUT /compute/v2.1/os-hosts/n-d-860282-1 HTTP/1.1 Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 50 Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKAgspKR6oG-5mqBOB1OvMvJVeOriHE-YLdSUHqDzu9zAdXiZfcaHAK-udj1Lk1FZIy4kO_4nqu_ZtNBQAvFjIymdKRwbGLLv34WfNe63pO0AQFqfohm0FHEVXL2tmXsJ5kFcfroIOIbqOBLDCqhmmUDTu1xkDre4T3meXNMmbJJXB8 Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: fbe8a1fca0c948e6a609e46d3e0ce7b2 Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1430533500 Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:05:45.116946 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:05:45.122399 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbe8a1fca0c948e6a609e46d3e0ce7b2"}]}] Oct 04 21:05:45.122399 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1430533500 Oct 04 21:05:45.122399 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: fbe8a1fca0c948e6a609e46d3e0ce7b2 Oct 04 21:05:45.122399 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1430533500 Oct 04 21:05:45.122399 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-HostsAdminNegativeTestJSON-1430533500-project Oct 04 21:05:45.122399 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:05:45.122399 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:05:45.122399 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 76ddfd63dd004ca9bcbf20e8131af95a Oct 04 21:05:45.122399 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1430533500-project Oct 04 21:05:45.122399 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:05:45.122399 n-d-860282-1 devstack@n-api.service[122758]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 21:05:45.122399 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:05:45.122399 n-d-860282-1 devstack@n-api.service[122758]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 21:05:45.122399 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'n-d-860282-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:05:45.123320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:05:45.124528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:05:45.124528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:05:45.124528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:05:45.124528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:05:45.124528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:05:45.124528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:05:45.124528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:05:45.124528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:05:45.124528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 21:05:45.124528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:45.124528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:45.124528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:45.124528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:45.124528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:45.124528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:45.124528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:05:45.124528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:05:45.124528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 21:05:45.124528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:45.127522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a607d4d2-4447-450a-a4e0-b0ca81501a07 tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:45.127522 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a607d4d2-4447-450a-a4e0-b0ca81501a07 tempest-HostsAdminNegativeTestJSON-1430533500 tempest-HostsAdminNegativeTestJSON-1430533500-project] 10.222.0.30 "PUT /compute/v2.1/os-hosts/n-d-860282-1" status: 403 len: 111 microversion: 2.1 time: 0.022960 Oct 04 21:05:45.127522 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 26/42] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Oct 4 21:05:45 2022] PUT /compute/v2.1/os-hosts/n-d-860282-1 => generated 111 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:05:45.131602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1854874c-834b-44db-834f-81151a4a7a0b tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:45.144674 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1854874c-834b-44db-834f-81151a4a7a0b tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1589211073/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024555 Oct 04 21:05:45.146000 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 27/43] 10.222.0.30 () {58 vars in 1203 bytes} [Tue Oct 4 21:05:45 2022] GET /compute/v2.1/flavors/1589211073/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:05:45.152010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7bb82639-6ebb-474e-8d18-620c9df8f236 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:45.183721 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7bb82639-6ebb-474e-8d18-620c9df8f236 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.035431 Oct 04 21:05:45.184677 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 28/44] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:45 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:45.202888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3f195299-85ae-4c12-b3e8-4b623be1e1db tempest-FlavorsAccessTestJSON-1954615998 tempest-FlavorsAccessTestJSON-1954615998-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:45.229293 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3f195299-85ae-4c12-b3e8-4b623be1e1db tempest-FlavorsAccessTestJSON-1954615998 tempest-FlavorsAccessTestJSON-1954615998-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.042273 Oct 04 21:05:45.230731 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 29/45] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:45 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:45.236796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-384b3eaf-b2e2-4638-9d2e-d5c60a6bef00 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Action: 'update', calling method: .version_select at 0x7f57910edaf0>, body: {"status": null, "maintenance_mode": null} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-384b3eaf-b2e2-4638-9d2e-d5c60a6bef00 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Request method failure captured: Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: request: PUT /compute/v2.1/os-hosts/n-d-860282-1 HTTP/1.1 Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 42 Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKAj_rdd6BeTGb7u0dP6YGdGNDhp4OMEPKiI31D1iXl76-jsW_gqojBwv2K6P4ObJ8UPmHWJsImBG3RYdgSl7meqK6bXJ9j4zvoszsAXyjd39XY2AhwxkmoycFhFpP0o-JFhBsaMgV_MGOo2nb10cT-oAnwI2cN3zu3idGSIAn3hR0U Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: cd3f6b59c20c46deb7c2c99b4625c88f Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:05:45.242176 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:05:45.243408 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd3f6b59c20c46deb7c2c99b4625c88f"}]}] Oct 04 21:05:45.243408 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:45.243408 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: cd3f6b59c20c46deb7c2c99b4625c88f Oct 04 21:05:45.243408 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:45.243408 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-HostsAdminNegativeTestJSON-2008808556-project-admin Oct 04 21:05:45.243408 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:05:45.243408 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:05:45.243408 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c1c92dc5a9b04f8e9efe2e265ed9e250 Oct 04 21:05:45.243408 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2008808556-project-admin Oct 04 21:05:45.243408 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:05:45.243408 n-d-860282-1 devstack@n-api.service[122758]: {"status": null, "maintenance_mode": null} Oct 04 21:05:45.243408 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:05:45.243408 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 21:05:45.243408 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'n-d-860282-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance: Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi None Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:45.244510 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:45.253194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:45.253194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:45.253194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:05:45.253194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:05:45.253194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:45.253194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:45.253194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:05:45.253194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:05:45.253194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:05:45.253194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:05:45.253194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:05:45.253194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:05:45.253194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 21:05:45.253194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:45.253194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:45.253194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:45.253194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:45.253194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:45.253194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:45.254438 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:05:45.254438 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:05:45.254438 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 21:05:45.254438 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:45.254438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-384b3eaf-b2e2-4638-9d2e-d5c60a6bef00 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:45.254438 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-384b3eaf-b2e2-4638-9d2e-d5c60a6bef00 tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/n-d-860282-1" status: 400 len: 127 microversion: 2.1 time: 0.015549 Oct 04 21:05:45.254438 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 30/46] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Oct 4 21:05:45 2022] PUT /compute/v2.1/os-hosts/n-d-860282-1 => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:05:45.270411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-93ac6f55-50be-461e-ad08-1c01ce5b1e27 tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:45.369995 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-93ac6f55-50be-461e-ad08-1c01ce5b1e27 tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1589211073" status: 202 len: 0 microversion: 2.1 time: 0.120742 Oct 04 21:05:45.370911 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 31/47] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Oct 4 21:05:45 2022] DELETE /compute/v2.1/flavors/1589211073 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:05:45.377018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8367cd5f-4efc-4f9f-add0-5bbbc3e5714f tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-766818072", "id": 2139997708, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:45.489852 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8367cd5f-4efc-4f9f-add0-5bbbc3e5714f tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.117034 Oct 04 21:05:45.491613 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 32/48] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:45 2022] POST /compute/v2.1/flavors => generated 416 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:45.497444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ce87258d-bcd9-4693-bb33-52bf30f9365a tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Action: 'update', calling method: .version_select at 0x7f57910ed3a0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:45.503448 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.hosts [None req-ce87258d-bcd9-4693-bb33-52bf30f9365a tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Enabling host nonexistent_hostname. Oct 04 21:05:45.512607 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-ce87258d-bcd9-4693-bb33-52bf30f9365a tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ce87258d-bcd9-4693-bb33-52bf30f9365a tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Request method failure captured: Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 50 Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKAj_rdd6BeTGb7u0dP6YGdGNDhp4OMEPKiI31D1iXl76-jsW_gqojBwv2K6P4ObJ8UPmHWJsImBG3RYdgSl7meqK6bXJ9j4zvoszsAXyjd39XY2AhwxkmoycFhFpP0o-JFhBsaMgV_MGOo2nb10cT-oAnwI2cN3zu3idGSIAn3hR0U Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: cd3f6b59c20c46deb7c2c99b4625c88f Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:05:45.514848 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:05:45.515972 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cd3f6b59c20c46deb7c2c99b4625c88f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd3f6b59c20c46deb7c2c99b4625c88f"}]}] Oct 04 21:05:45.515972 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:45.515972 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: cd3f6b59c20c46deb7c2c99b4625c88f Oct 04 21:05:45.515972 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2008808556 Oct 04 21:05:45.515972 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-HostsAdminNegativeTestJSON-2008808556-project-admin Oct 04 21:05:45.515972 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:05:45.515972 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:05:45.515972 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c1c92dc5a9b04f8e9efe2e265ed9e250 Oct 04 21:05:45.515972 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2008808556-project-admin Oct 04 21:05:45.515972 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:05:45.515972 n-d-860282-1 devstack@n-api.service[122758]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 21:05:45.515972 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:05:45.515972 n-d-860282-1 devstack@n-api.service[122758]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:45.515972 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 21:05:45.516741 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:45.516741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:45.516741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 04 21:05:45.516741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 04 21:05:45.516741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:05:45.516741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:05:45.516741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:05:45.516741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:05:45.516741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:05:45.516741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:05:45.516741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:05:45.516741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:05:45.516741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 21:05:45.516741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 21:05:45.516741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:05:45.516741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:05:45.516741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 21:05:45.516741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:05:45.517826 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 04 21:05:45.518867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 04 21:05:45.518867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 04 21:05:45.518867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:05:45.518867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:45.518867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:45.518867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:45.518867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:45.518867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:45.518867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:45.518867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:45.518867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:05:45.518867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:05:45.518867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 21:05:45.518867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:45.528335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ce87258d-bcd9-4693-bb33-52bf30f9365a tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:45.536398 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ce87258d-bcd9-4693-bb33-52bf30f9365a tempest-HostsAdminNegativeTestJSON-2008808556 tempest-HostsAdminNegativeTestJSON-2008808556-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.036356 Oct 04 21:05:45.536398 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 33/49] 10.222.0.30 () {60 vars in 1211 bytes} [Tue Oct 4 21:05:45 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:05:45.536398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cbaf502d-ca80-424b-9ffa-0ae031977466 tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:45.571947 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cbaf502d-ca80-424b-9ffa-0ae031977466 tempest-FlavorsExtraSpecsTestJSON-640875074 tempest-FlavorsExtraSpecsTestJSON-640875074-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.040600 Oct 04 21:05:45.573080 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 34/50] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:45 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:45.578740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-94336828-8754-470b-8ea2-d9f8641f5567 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:45.608080 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-94336828-8754-470b-8ea2-d9f8641f5567 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.033492 Oct 04 21:05:45.609032 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 35/51] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:45 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:45.630369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d6a0b35f-4cda-4d2f-a606-2ecde2c3f71f tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:45.641273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:05:45.641880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:05:45.642403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:05:45.642930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:05:45.643237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:05:45.667989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:45.668680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:45.669316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:45.670124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:45.670594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:45.671059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:45.703443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Getting quotas for project 9419b86a729649c0aba5c047b5665f4c. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:05:45.709751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Getting quotas for user 5b79e298c90a46938431774ea19b61b8 and project 9419b86a729649c0aba5c047b5665f4c. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:05:45.714647 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d6a0b35f-4cda-4d2f-a606-2ecde2c3f71f tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/2139997708" status: 202 len: 0 microversion: 2.1 time: 0.089317 Oct 04 21:05:45.715232 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 36/52] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Oct 4 21:05:45 2022] DELETE /compute/v2.1/flavors/2139997708 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:05:45.738748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e4008bf6-d341-4654-9b2e-d45276a19b79 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:45.753096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:05:45.759581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:05:45.802265 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e4008bf6-d341-4654-9b2e-d45276a19b79 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.078937 Oct 04 21:05:45.805908 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 37/53] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:45.827503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-06c7f95c-e8e3-41a5-a13a-cef7072b4a3e tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-630737853", "id": 580280904, "os-flavor-access:is_public": "True"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:45.924095 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-06c7f95c-e8e3-41a5-a13a-cef7072b4a3e tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.102387 Oct 04 21:05:45.924885 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 38/54] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:45 2022] POST /compute/v2.1/flavors => generated 425 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:05:45.940502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-976c5341-83fc-4de3-868d-3d2293f3457a tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:45.945821 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c085ed11-38e1-4016-bbd8-11d6bcc6c6e6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.938459 Oct 04 21:05:45.948306 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 17/55] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:05:45.968379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7a354074-ac7b-47a3-8957-f129e62aeb3e tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:45.969523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7a354074-ac7b-47a3-8957-f129e62aeb3e tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:46.075761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7a354074-ac7b-47a3-8957-f129e62aeb3e tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:46.096936 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7a354074-ac7b-47a3-8957-f129e62aeb3e tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1243 microversion: 2.1 time: 0.135049 Oct 04 21:05:46.097522 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 18/56] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:45 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1243 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:46.109051 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-976c5341-83fc-4de3-868d-3d2293f3457a tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/580280904" status: 202 len: 0 microversion: 2.1 time: 0.175768 Oct 04 21:05:46.110114 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 39/57] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Oct 4 21:05:45 2022] DELETE /compute/v2.1/flavors/580280904 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:05:46.118944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f04d760f-be8f-4172-8f83-7acfa710f018 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:46.146961 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f04d760f-be8f-4172-8f83-7acfa710f018 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031923 Oct 04 21:05:46.158822 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 19/58] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:46.168021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-16ca8b63-ebe3-41bd-ab7a-db786c7fd8f8 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1860326292", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:46.269859 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-16ca8b63-ebe3-41bd-ab7a-db786c7fd8f8 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.105808 Oct 04 21:05:46.277696 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 40/59] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:46 2022] POST /compute/v2.1/flavors => generated 507 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:46.282980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-551a5dca-6f54-46d0-ba07-069206e2b389 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:46.388322 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-551a5dca-6f54-46d0-ba07-069206e2b389 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/b1d462b1-aa5a-48d3-bb63-4ae555ff2363" status: 202 len: 0 microversion: 2.1 time: 0.108279 Oct 04 21:05:46.389052 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 20/60] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:05:46 2022] DELETE /compute/v2.1/flavors/b1d462b1-aa5a-48d3-bb63-4ae555ff2363 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:05:46.404351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-65fc45bb-2068-4ac2-a0c2-88b8ac7eac18 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:46.431132 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-65fc45bb-2068-4ac2-a0c2-88b8ac7eac18 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033490 Oct 04 21:05:46.431707 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 41/61] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:46.451170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bca16d27-f4d8-4d4b-8e55-85f4db13e147 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1797315138", "id": "60912c1a-eb83-449c-a94b-6ca8aa47b8fd", "os-flavor-access:is_public": "True"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:46.547092 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bca16d27-f4d8-4d4b-8e55-85f4db13e147 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.099828 Oct 04 21:05:46.551338 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 21/62] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:46 2022] POST /compute/v2.1/flavors => generated 507 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:46.564801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-df223380-1e7f-4262-8f9c-e24889920839 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:46.674587 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-df223380-1e7f-4262-8f9c-e24889920839 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/60912c1a-eb83-449c-a94b-6ca8aa47b8fd" status: 202 len: 0 microversion: 2.1 time: 0.113990 Oct 04 21:05:46.675373 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 42/63] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:05:46 2022] DELETE /compute/v2.1/flavors/60912c1a-eb83-449c-a94b-6ca8aa47b8fd => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:05:46.684251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c6e5d079-f666-447b-9305-c2565a57bbb2 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:46.691016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=7 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:46.705143 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c6e5d079-f666-447b-9305-c2565a57bbb2 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025239 Oct 04 21:05:46.706393 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 22/64] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:46.736094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6348c88a-33bd-435c-b9e4-d8a673175566 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2032999561", "id": 1051042391, "os-flavor-access:is_public": "True"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:46.853387 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6348c88a-33bd-435c-b9e4-d8a673175566 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.121209 Oct 04 21:05:46.862353 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 43/65] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:46 2022] POST /compute/v2.1/flavors => generated 414 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:46.868490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d1e9a6b2-6853-4371-a799-0b2ca543753c tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:46.878108 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d1e9a6b2-6853-4371-a799-0b2ca543753c tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1051042391" status: 200 len: 414 microversion: 2.1 time: 0.013597 Oct 04 21:05:46.878688 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 23/66] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Oct 4 21:05:46 2022] GET /compute/v2.1/flavors/1051042391 => generated 414 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:47.124294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e5233ae5-1534-4280-9c20-ce2de665f07e tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:47.124948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e5233ae5-1534-4280-9c20-ce2de665f07e tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:47.329243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e5233ae5-1534-4280-9c20-ce2de665f07e tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:47.329600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bc3508a6-8359-4bdc-9860-65a9cd15c25b tempest-FlavorsAdminTestJSON-481422259 tempest-FlavorsAdminTestJSON-481422259-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:47.329680 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e5233ae5-1534-4280-9c20-ce2de665f07e tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1243 microversion: 2.1 time: 0.207170 Oct 04 21:05:47.329680 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 24/67] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:47 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1243 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:05:47.363478 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bc3508a6-8359-4bdc-9860-65a9cd15c25b tempest-FlavorsAdminTestJSON-481422259 tempest-FlavorsAdminTestJSON-481422259-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.475611 Oct 04 21:05:47.365260 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 44/68] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:46 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:05:47.388954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4e79e0e9-85af-4e54-9020-5ab34f4f8409 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:47.491761 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4e79e0e9-85af-4e54-9020-5ab34f4f8409 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1051042391" status: 202 len: 0 microversion: 2.1 time: 0.109368 Oct 04 21:05:47.492914 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 25/69] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Oct 4 21:05:47 2022] DELETE /compute/v2.1/flavors/1051042391 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:05:47.502764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7f8e37f2-41fa-4bf5-8023-cdf3e4880dbe tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:47.526118 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7f8e37f2-41fa-4bf5-8023-cdf3e4880dbe tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028250 Oct 04 21:05:47.527323 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 45/70] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:47.556459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-be89e084-f87a-477d-ab6b-781be0982ea9 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2025103725", "id": 2146646526, "os-flavor-access:is_public": "False"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:47.715483 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-be89e084-f87a-477d-ab6b-781be0982ea9 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.162562 Oct 04 21:05:47.718780 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 26/71] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:47 2022] POST /compute/v2.1/flavors => generated 430 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:47.731853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3c5ef70c-e4b0-415c-bec6-5037650dd5a7 tempest-FlavorsAdminTestJSON-481422259 tempest-FlavorsAdminTestJSON-481422259-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "2146646526"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:47.744588 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-3c5ef70c-e4b0-415c-bec6-5037650dd5a7 tempest-FlavorsAdminTestJSON-481422259 tempest-FlavorsAdminTestJSON-481422259-project] HTTP exception thrown: Flavor 2146646526 could not be found. Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3c5ef70c-e4b0-415c-bec6-5037650dd5a7 tempest-FlavorsAdminTestJSON-481422259 tempest-FlavorsAdminTestJSON-481422259-project] Request method failure captured: Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 107 Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKAmY_11ilsLOJwDuUf95JtBZsOiY61AmyzloPo17b89JQ25lgjPRmIa1yf-aX-OihfTZkzLrHn4-awyeTkenD0GWjQGRi9mPJBc6lAK9IUm9YKPMa7v-5_l3m3-rPyKUvmqt3_Vk9437TNaXX4q9oZusGVU4MCvCADmyP6-7DRlgEQ Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: d5ccc1a628124492ad47fdaabe59d74d Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-FlavorsAdminTestJSON-481422259 Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:05:47.749794 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:05:47.751639 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d5ccc1a628124492ad47fdaabe59d74d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d5ccc1a628124492ad47fdaabe59d74d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d5ccc1a628124492ad47fdaabe59d74d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d5ccc1a628124492ad47fdaabe59d74d"}]}] Oct 04 21:05:47.751639 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-FlavorsAdminTestJSON-481422259 Oct 04 21:05:47.751639 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: d5ccc1a628124492ad47fdaabe59d74d Oct 04 21:05:47.751639 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-481422259 Oct 04 21:05:47.751639 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-FlavorsAdminTestJSON-481422259-project Oct 04 21:05:47.751639 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:05:47.751639 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:05:47.751639 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 9a57a889a0fb415c87d0ce13a40a9167 Oct 04 21:05:47.751639 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-FlavorsAdminTestJSON-481422259-project Oct 04 21:05:47.751639 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:05:47.751639 n-d-860282-1 devstack@n-api.service[122758]: {"server": {"name": "test", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "2146646526"}} Oct 04 21:05:47.751639 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:05:47.751639 n-d-860282-1 devstack@n-api.service[122758]: exception: Flavor 2146646526 could not be found. Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '2146646526'}}} Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2146646526 could not be found. Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:47.752624 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2146646526 could not be found. Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:47.754018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:47.755430 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:47.755430 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:05:47.755430 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:05:47.755430 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2146646526 could not be found. Oct 04 21:05:47.755430 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:05:47.756099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3c5ef70c-e4b0-415c-bec6-5037650dd5a7 tempest-FlavorsAdminTestJSON-481422259 tempest-FlavorsAdminTestJSON-481422259-project] Returning 400 to user: Flavor 2146646526 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:47.757259 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3c5ef70c-e4b0-415c-bec6-5037650dd5a7 tempest-FlavorsAdminTestJSON-481422259 tempest-FlavorsAdminTestJSON-481422259-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.029932 Oct 04 21:05:47.758062 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 46/72] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:47 2022] POST /compute/v2.1/servers => generated 81 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 21:05:47.766767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0157b00f-280e-479e-b48b-e96e23601474 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:47.906434 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0157b00f-280e-479e-b48b-e96e23601474 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/2146646526" status: 202 len: 0 microversion: 2.1 time: 0.142421 Oct 04 21:05:47.907352 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 27/73] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Oct 4 21:05:47 2022] DELETE /compute/v2.1/flavors/2146646526 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:05:47.922241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5ac0527d-a4ec-4c73-ad93-9734b781344b tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:47.978397 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5ac0527d-a4ec-4c73-ad93-9734b781344b tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064752 Oct 04 21:05:47.979846 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 47/74] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:47.999727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bb72f4c8-8264-4d46-9871-8ce624420123 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1424711055", "id": 1132183603, "os-flavor-access:is_public": "False"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:48.131011 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bb72f4c8-8264-4d46-9871-8ce624420123 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.135984 Oct 04 21:05:48.131720 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 28/75] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:47 2022] POST /compute/v2.1/flavors => generated 415 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:48.147201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c95f983f-cb52-4705-8fd4-8412a47c8acf tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-199510179", "id": 2059834403, "os-flavor-access:is_public": "True"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:48.277177 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c95f983f-cb52-4705-8fd4-8412a47c8acf tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.132458 Oct 04 21:05:48.278366 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 48/76] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:48 2022] POST /compute/v2.1/flavors => generated 413 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:48.289974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-81f510a2-49aa-4bf8-a00f-8d4153088f10 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:48.332363 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-81f510a2-49aa-4bf8-a00f-8d4153088f10 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.046272 Oct 04 21:05:48.335742 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 29/77] 10.222.0.30 () {58 vars in 1169 bytes} [Tue Oct 4 21:05:48 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:48.349576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-757bb2b0-a650-44af-951a-f66a1c6c1379 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:48.350282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5880b4c0-526d-485f-83c6-40c13e3cf488 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:48.351064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5880b4c0-526d-485f-83c6-40c13e3cf488 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:48.367372 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-757bb2b0-a650-44af-951a-f66a1c6c1379 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.021422 Oct 04 21:05:48.367963 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 49/78] 10.222.0.30 () {58 vars in 1177 bytes} [Tue Oct 4 21:05:48 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:48.380833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fda5002b-2429-45eb-8c75-9bcb4af7643f tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:48.391326 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fda5002b-2429-45eb-8c75-9bcb4af7643f tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.014065 Oct 04 21:05:48.391907 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 50/79] 10.222.0.30 () {58 vars in 1171 bytes} [Tue Oct 4 21:05:48 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:05:48.406118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f524d44b-f977-4633-8ea6-3b8f8ed4c976 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:48.416503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5880b4c0-526d-485f-83c6-40c13e3cf488 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:48.421034 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f524d44b-f977-4633-8ea6-3b8f8ed4c976 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.020144 Oct 04 21:05:48.422143 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 51/80] 10.222.0.30 () {58 vars in 1169 bytes} [Tue Oct 4 21:05:48 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:05:48.425292 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5880b4c0-526d-485f-83c6-40c13e3cf488 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1243 microversion: 2.1 time: 0.079325 Oct 04 21:05:48.425979 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 30/81] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:48 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1243 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:48.434828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-97d78274-e55f-43df-84f1-ec06cf4be66d tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:48.483433 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-97d78274-e55f-43df-84f1-ec06cf4be66d tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.052469 Oct 04 21:05:48.484413 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 52/82] 10.222.0.30 () {58 vars in 1169 bytes} [Tue Oct 4 21:05:48 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:05:48.505022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d1d8ed7e-5331-4361-89d2-40e9be4c6405 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:48.534849 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d1d8ed7e-5331-4361-89d2-40e9be4c6405 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.031627 Oct 04 21:05:48.536142 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 31/83] 10.222.0.30 () {58 vars in 1175 bytes} [Tue Oct 4 21:05:48 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:48.554560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-23deebf5-5c8d-44bf-a041-bc8d22ad9f12 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:48.580564 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-23deebf5-5c8d-44bf-a041-bc8d22ad9f12 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.030187 Oct 04 21:05:48.581880 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 53/84] 10.222.0.30 () {58 vars in 1173 bytes} [Tue Oct 4 21:05:48 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:48.602849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6fe2addd-b869-423e-8609-59796e1d236b tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:48.631109 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6fe2addd-b869-423e-8609-59796e1d236b tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.031929 Oct 04 21:05:48.631945 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 32/85] 10.222.0.30 () {58 vars in 1169 bytes} [Tue Oct 4 21:05:48 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:48.659729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c1a946c6-5a9a-4341-a591-44eb9d11128e tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:48.815407 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c1a946c6-5a9a-4341-a591-44eb9d11128e tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/2059834403" status: 202 len: 0 microversion: 2.1 time: 0.166417 Oct 04 21:05:48.817354 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 54/86] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Oct 4 21:05:48 2022] DELETE /compute/v2.1/flavors/2059834403 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:05:48.824979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-564a4329-8335-44ae-9353-d120982732eb tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:48.857063 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-564a4329-8335-44ae-9353-d120982732eb tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036641 Oct 04 21:05:48.866505 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 33/87] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:48.884729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-35b1448d-5a0c-46af-9b39-5b443fbd398d tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:48.891230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=19,nova_api:INSERT=5 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:49.083451 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-35b1448d-5a0c-46af-9b39-5b443fbd398d tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1132183603" status: 202 len: 0 microversion: 2.1 time: 0.202691 Oct 04 21:05:49.084237 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 55/88] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Oct 4 21:05:48 2022] DELETE /compute/v2.1/flavors/1132183603 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:05:49.093651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8f258ec4-ab16-488f-ac0c-401f632a218e tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:49.114268 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8f258ec4-ab16-488f-ac0c-401f632a218e tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025160 Oct 04 21:05:49.114868 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 34/89] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:49.135426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5619eaaf-0cd6-4147-82ba-24c0c60a6288 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1472732940", "id": 1477851064, "os-flavor-access:is_public": "False"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:49.240361 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5619eaaf-0cd6-4147-82ba-24c0c60a6288 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.103392 Oct 04 21:05:49.240361 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 56/90] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:49 2022] POST /compute/v2.1/flavors => generated 415 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:49.248971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f32658c8-a0a5-473e-81a5-0c33ae1b757b tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:49.271856 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f32658c8-a0a5-473e-81a5-0c33ae1b757b tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027441 Oct 04 21:05:49.272873 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 35/91] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:49.298906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2f828b00-fc0f-46cb-aadc-2918e6e9f35e tempest-FlavorsAdminTestJSON-481422259 tempest-FlavorsAdminTestJSON-481422259-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:49.322651 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2f828b00-fc0f-46cb-aadc-2918e6e9f35e tempest-FlavorsAdminTestJSON-481422259 tempest-FlavorsAdminTestJSON-481422259-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027146 Oct 04 21:05:49.335209 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 57/92] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:49.350877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a83e8092-a815-4239-800b-f7891dd00316 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:49.458154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ea73f59c-e466-4dbe-a589-aa6dc05f3d3e tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:49.459340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ea73f59c-e466-4dbe-a589-aa6dc05f3d3e tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:49.471422 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a83e8092-a815-4239-800b-f7891dd00316 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1477851064" status: 202 len: 0 microversion: 2.1 time: 0.124869 Oct 04 21:05:49.473605 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 36/93] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Oct 4 21:05:49 2022] DELETE /compute/v2.1/flavors/1477851064 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:05:49.491278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-21c5970c-0a90-42a1-9be2-9362fe940bf1 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:49.522521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea73f59c-e466-4dbe-a589-aa6dc05f3d3e tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:49.523293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea73f59c-e466-4dbe-a589-aa6dc05f3d3e tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:49.523532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea73f59c-e466-4dbe-a589-aa6dc05f3d3e tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:49.524256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea73f59c-e466-4dbe-a589-aa6dc05f3d3e tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:49.534141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea73f59c-e466-4dbe-a589-aa6dc05f3d3e tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:49.534902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea73f59c-e466-4dbe-a589-aa6dc05f3d3e tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:49.561850 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-21c5970c-0a90-42a1-9be2-9362fe940bf1 tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067682 Oct 04 21:05:49.562504 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 37/94] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:49.584187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-decc2c8d-78b3-4a06-96a1-74a1042e5d7d tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-563894948", "id": 681020699, "os-flavor-access:is_public": "True"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:49.704293 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-decc2c8d-78b3-4a06-96a1-74a1042e5d7d tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.124926 Oct 04 21:05:49.705101 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 38/95] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:49 2022] POST /compute/v2.1/flavors => generated 410 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:49.718492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1e8edddc-9dc8-4b99-a29d-8319ba1bee3c tempest-FlavorsAdminTestJSON-481422259 tempest-FlavorsAdminTestJSON-481422259-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:49.762576 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1e8edddc-9dc8-4b99-a29d-8319ba1bee3c tempest-FlavorsAdminTestJSON-481422259 tempest-FlavorsAdminTestJSON-481422259-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.043718 Oct 04 21:05:49.763850 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 39/96] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:49 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:49.785413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5d3d5f6e-c623-44e8-9fa3-8892e3dc7dcc tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:49.957890 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5d3d5f6e-c623-44e8-9fa3-8892e3dc7dcc tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/681020699" status: 202 len: 0 microversion: 2.1 time: 0.176199 Oct 04 21:05:49.959266 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 40/97] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Oct 4 21:05:49 2022] DELETE /compute/v2.1/flavors/681020699 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:05:49.976187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0e885a6d-c122-4842-9612-0a8d36368a0a tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:50.059804 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0e885a6d-c122-4842-9612-0a8d36368a0a tempest-FlavorsAdminTestJSON-290640578 tempest-FlavorsAdminTestJSON-290640578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.096813 Oct 04 21:05:50.070999 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 41/98] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:05:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:05:50.972179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:51.276286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ea73f59c-e466-4dbe-a589-aa6dc05f3d3e tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:51.324596 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ea73f59c-e466-4dbe-a589-aa6dc05f3d3e tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1243 microversion: 2.1 time: 1.878709 Oct 04 21:05:51.340722 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 58/99] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:49 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1243 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:05:52.367825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c83d89d3-b405-4228-bcf4-a67d2248a539 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:52.369101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c83d89d3-b405-4228-bcf4-a67d2248a539 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:52.380762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c83d89d3-b405-4228-bcf4-a67d2248a539 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:52.381298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c83d89d3-b405-4228-bcf4-a67d2248a539 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:52.381744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c83d89d3-b405-4228-bcf4-a67d2248a539 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:52.388580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c83d89d3-b405-4228-bcf4-a67d2248a539 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:52.388580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c83d89d3-b405-4228-bcf4-a67d2248a539 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:52.388580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c83d89d3-b405-4228-bcf4-a67d2248a539 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:52.687499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c83d89d3-b405-4228-bcf4-a67d2248a539 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:52.719533 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c83d89d3-b405-4228-bcf4-a67d2248a539 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1297 microversion: 2.1 time: 0.356527 Oct 04 21:05:52.722141 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 42/100] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:52 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1297 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:52.876018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-84bbffe8-46ce-434a-be67-216e800b9bee tempest-FlavorsV261TestJSON-1345227855 tempest-FlavorsV261TestJSON-1345227855-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1758595858", "id": 127009004, "os-flavor-access:is_public": "True"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:53.034977 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-84bbffe8-46ce-434a-be67-216e800b9bee tempest-FlavorsV261TestJSON-1345227855 tempest-FlavorsV261TestJSON-1345227855-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.530499 Oct 04 21:05:53.038445 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 59/101] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Oct 4 21:05:52 2022] POST /compute/v2.1/flavors => generated 465 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:05:53.750344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b2de39e8-890e-40e5-bbea-59b77b374172 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:53.751541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b2de39e8-890e-40e5-bbea-59b77b374172 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:53.765447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b2de39e8-890e-40e5-bbea-59b77b374172 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:53.766906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b2de39e8-890e-40e5-bbea-59b77b374172 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:53.768617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b2de39e8-890e-40e5-bbea-59b77b374172 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:53.769687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b2de39e8-890e-40e5-bbea-59b77b374172 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:53.774121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b2de39e8-890e-40e5-bbea-59b77b374172 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:53.774121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b2de39e8-890e-40e5-bbea-59b77b374172 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:53.864777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0beda225-a344-4fb4-8459-13a517b0fb21 tempest-FlavorsV261TestJSON-1624531691 tempest-FlavorsV261TestJSON-1624531691-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:53.924110 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0beda225-a344-4fb4-8459-13a517b0fb21 tempest-FlavorsV261TestJSON-1624531691 tempest-FlavorsV261TestJSON-1624531691-project] 10.222.0.30 "GET /compute/v2.1/flavors/127009004" status: 200 len: 465 microversion: 2.61 time: 0.873153 Oct 04 21:05:53.932238 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 43/102] 10.222.0.30 () {60 vars in 1196 bytes} [Tue Oct 4 21:05:53 2022] GET /compute/v2.1/flavors/127009004 => generated 465 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:05:53.950915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-07933e31-7f98-4dfa-a79a-8d5854872c59 tempest-FlavorsV261TestJSON-1345227855 tempest-FlavorsV261TestJSON-1345227855-project-admin] Action: 'update', calling method: .version_select at 0x7f57920c0670>, body: {"flavor": {"description": "new"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:54.104166 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-07933e31-7f98-4dfa-a79a-8d5854872c59 tempest-FlavorsV261TestJSON-1345227855 tempest-FlavorsV261TestJSON-1345227855-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/127009004" status: 200 len: 466 microversion: 2.61 time: 0.161201 Oct 04 21:05:54.107123 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 44/103] 10.222.0.30 () {62 vars in 1216 bytes} [Tue Oct 4 21:05:53 2022] PUT /compute/v2.1/flavors/127009004 => generated 466 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:05:54.122614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-74c8daa0-8200-4156-9c9a-a430bb64ddc7 tempest-FlavorsV261TestJSON-1624531691 tempest-FlavorsV261TestJSON-1624531691-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:54.158035 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-74c8daa0-8200-4156-9c9a-a430bb64ddc7 tempest-FlavorsV261TestJSON-1624531691 tempest-FlavorsV261TestJSON-1624531691-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.040531 Oct 04 21:05:54.158681 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 45/104] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Oct 4 21:05:54 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:54.216257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab8b01d4-ae61-4960-b94b-cf4e419a7222 tempest-FlavorsV261TestJSON-1624531691 tempest-FlavorsV261TestJSON-1624531691-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:54.281461 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ab8b01d4-ae61-4960-b94b-cf4e419a7222 tempest-FlavorsV261TestJSON-1624531691 tempest-FlavorsV261TestJSON-1624531691-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.075927 Oct 04 21:05:54.285507 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 46/105] 10.222.0.30 () {60 vars in 1166 bytes} [Tue Oct 4 21:05:54 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:54.311063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2f2b5368-b9c4-4f87-9ddf-887d72b9d62a tempest-FlavorsV261TestJSON-1345227855 tempest-FlavorsV261TestJSON-1345227855-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:54.607608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b2de39e8-890e-40e5-bbea-59b77b374172 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:54.616627 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b2de39e8-890e-40e5-bbea-59b77b374172 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1339 microversion: 2.1 time: 0.872633 Oct 04 21:05:54.617222 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 60/106] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:53 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1339 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:05:54.781617 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2f2b5368-b9c4-4f87-9ddf-887d72b9d62a tempest-FlavorsV261TestJSON-1345227855 tempest-FlavorsV261TestJSON-1345227855-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/127009004" status: 202 len: 0 microversion: 2.61 time: 0.476965 Oct 04 21:05:54.784309 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 47/107] 10.222.0.30 () {60 vars in 1199 bytes} [Tue Oct 4 21:05:54 2022] DELETE /compute/v2.1/flavors/127009004 => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:05:54.820121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8d7e7d23-9230-4942-9f71-def2e467377e tempest-FlavorsV261TestJSON-1345227855 tempest-FlavorsV261TestJSON-1345227855-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:54.909221 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8d7e7d23-9230-4942-9f71-def2e467377e tempest-FlavorsV261TestJSON-1345227855 tempest-FlavorsV261TestJSON-1345227855-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.105316 Oct 04 21:05:54.919539 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 61/108] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Oct 4 21:05:54 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:55.646567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fe76cc82-7431-4917-aef9-5ce6c3af7806 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:55.647194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fe76cc82-7431-4917-aef9-5ce6c3af7806 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:55.679903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe76cc82-7431-4917-aef9-5ce6c3af7806 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:55.679903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe76cc82-7431-4917-aef9-5ce6c3af7806 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:55.679903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe76cc82-7431-4917-aef9-5ce6c3af7806 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:55.679903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe76cc82-7431-4917-aef9-5ce6c3af7806 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:55.681000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe76cc82-7431-4917-aef9-5ce6c3af7806 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:55.681626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe76cc82-7431-4917-aef9-5ce6c3af7806 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:55.769405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:56.218357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fe76cc82-7431-4917-aef9-5ce6c3af7806 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:56.226761 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fe76cc82-7431-4917-aef9-5ce6c3af7806 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1339 microversion: 2.1 time: 0.588295 Oct 04 21:05:56.255775 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 48/109] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:55 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1339 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:57.260809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5e8f8e75-3dd7-417e-8cc3-0abccc0e0b82 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:57.262104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5e8f8e75-3dd7-417e-8cc3-0abccc0e0b82 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:57.271772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e8f8e75-3dd7-417e-8cc3-0abccc0e0b82 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:57.276645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e8f8e75-3dd7-417e-8cc3-0abccc0e0b82 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:57.278108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e8f8e75-3dd7-417e-8cc3-0abccc0e0b82 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:57.285944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e8f8e75-3dd7-417e-8cc3-0abccc0e0b82 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:57.289669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e8f8e75-3dd7-417e-8cc3-0abccc0e0b82 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:57.289669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e8f8e75-3dd7-417e-8cc3-0abccc0e0b82 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:57.815959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5e8f8e75-3dd7-417e-8cc3-0abccc0e0b82 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:57.833077 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5e8f8e75-3dd7-417e-8cc3-0abccc0e0b82 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1339 microversion: 2.1 time: 0.577386 Oct 04 21:05:57.837363 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 62/110] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:57 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1339 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:58.858353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-31e3ad44-9645-4ffd-9896-3f70e5d265f6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:58.859080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-31e3ad44-9645-4ffd-9896-3f70e5d265f6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:58.869201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=12 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:58.874213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31e3ad44-9645-4ffd-9896-3f70e5d265f6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:58.877114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31e3ad44-9645-4ffd-9896-3f70e5d265f6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:58.877114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31e3ad44-9645-4ffd-9896-3f70e5d265f6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:58.877114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31e3ad44-9645-4ffd-9896-3f70e5d265f6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:58.877114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31e3ad44-9645-4ffd-9896-3f70e5d265f6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:58.882004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31e3ad44-9645-4ffd-9896-3f70e5d265f6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:59.434981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5e8f8e75-3dd7-417e-8cc3-0abccc0e0b82 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:59.437545 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5e8f8e75-3dd7-417e-8cc3-0abccc0e0b82 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003331 Oct 04 21:05:59.452459 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 63/111] 10.222.0.30 () {56 vars in 886 bytes} [Tue Oct 4 21:05:59 2022] GET /compute/ => generated 377 bytes in 20 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 04 21:05:59.997367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-31e3ad44-9645-4ffd-9896-3f70e5d265f6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:00.006651 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-31e3ad44-9645-4ffd-9896-3f70e5d265f6 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1339 microversion: 2.1 time: 1.152872 Oct 04 21:06:00.009219 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 49/112] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:58 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1339 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:00.948883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5f8ffabc-275c-4db7-913f-61d2ddebf122 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:00.977458 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5f8ffabc-275c-4db7-913f-61d2ddebf122 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 1.345554 Oct 04 21:06:00.978373 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 64/113] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:05:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:01.516382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a47e3930-cdea-4080-9b36-1765f75ff232 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1493046507", "ram": 512, "vcpus": 1, "disk": 10, "id": 1286980636, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:01.697867 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a47e3930-cdea-4080-9b36-1765f75ff232 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.842182 Oct 04 21:06:01.699098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ce490f47-fc54-471e-a752-00259dfbb5e3 tempest-ServersWithSpecificFlavorTestJSON-699011552 tempest-ServersWithSpecificFlavorTestJSON-699011552-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1704385894", "id": 78680178, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:01.707249 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 50/114] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:06:00 2022] POST /compute/v2.1/flavors => generated 416 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:01.713405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-764fa987-78cb-4f02-95e4-56b5a6831969 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:01.714596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-764fa987-78cb-4f02-95e4-56b5a6831969 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:01.721783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=15,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:01.723839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-764fa987-78cb-4f02-95e4-56b5a6831969 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:01.724753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-764fa987-78cb-4f02-95e4-56b5a6831969 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:01.725515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-764fa987-78cb-4f02-95e4-56b5a6831969 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:01.726882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-764fa987-78cb-4f02-95e4-56b5a6831969 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:01.728099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-764fa987-78cb-4f02-95e4-56b5a6831969 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:01.728891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-764fa987-78cb-4f02-95e4-56b5a6831969 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:01.804607 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ce490f47-fc54-471e-a752-00259dfbb5e3 tempest-ServersWithSpecificFlavorTestJSON-699011552 tempest-ServersWithSpecificFlavorTestJSON-699011552-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 419 microversion: 2.1 time: 0.810193 Oct 04 21:06:01.805543 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 65/115] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:06:00 2022] POST /compute/v2.1/flavors => generated 419 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:01.987612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-764fa987-78cb-4f02-95e4-56b5a6831969 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:01.998779 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-764fa987-78cb-4f02-95e4-56b5a6831969 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1339 microversion: 2.1 time: 0.290157 Oct 04 21:06:02.000789 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 51/116] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:01 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1339 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:02.311168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-2870ed46-4ee6-45ba-840d-6db9d2d7ecfb req-a365b7fe-d053-4d8e-997f-60d49a6a5ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfe6aa09-8e1e-41d7-a431-c8bae79920b6", "tag": "446eb630-3699-4714-a25a-51c8dbda8c2a"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:02.346264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2870ed46-4ee6-45ba-840d-6db9d2d7ecfb req-a365b7fe-d053-4d8e-997f-60d49a6a5ff3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:02.348736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2870ed46-4ee6-45ba-840d-6db9d2d7ecfb req-a365b7fe-d053-4d8e-997f-60d49a6a5ff3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:02.349339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2870ed46-4ee6-45ba-840d-6db9d2d7ecfb req-a365b7fe-d053-4d8e-997f-60d49a6a5ff3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:02.386970 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-2870ed46-4ee6-45ba-840d-6db9d2d7ecfb req-a365b7fe-d053-4d8e-997f-60d49a6a5ff3 service nova] Creating event network-changed:446eb630-3699-4714-a25a-51c8dbda8c2a for instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 on n-h1-860282-1 Oct 04 21:06:02.387759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2870ed46-4ee6-45ba-840d-6db9d2d7ecfb req-a365b7fe-d053-4d8e-997f-60d49a6a5ff3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122757) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:06:02.388302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2870ed46-4ee6-45ba-840d-6db9d2d7ecfb req-a365b7fe-d053-4d8e-997f-60d49a6a5ff3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122757) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:06:02.389593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a04aad5-854f-4a78-9868-d0f5de1fea6a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:02.390207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a04aad5-854f-4a78-9868-d0f5de1fea6a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:02.391281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a04aad5-854f-4a78-9868-d0f5de1fea6a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:02.392184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a04aad5-854f-4a78-9868-d0f5de1fea6a None None] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:02.392789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a04aad5-854f-4a78-9868-d0f5de1fea6a None None] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:02.394698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a04aad5-854f-4a78-9868-d0f5de1fea6a None None] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:02.399175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5a22d1d1-249b-43e5-8d71-b82fee037feb tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] Action: 'create', calling method: .version_select at 0x7f57910079d0>, body: {"keypair": {"name": "tempest-keypair-12281060", "type": "ssh", "user_id": "764fd07321a14d8a8013fcb0be55a5ba", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlKJSQBFKA1ny6+JnBjHQlZDLFrshqeMsrHRkGxQUGXpGEjmqRdXlxvHimLyhTk05JBvdM9j9Vcu2rpiGu0l+fZGpZhNGLDvqeVCBWz4SAz0gJQiEaC1X9/zo9NjmRsOQ=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:02.412934 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.compute.rpcapi [None req-5a04aad5-854f-4a78-9868-d0f5de1fea6a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 21:06:02.413907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a04aad5-854f-4a78-9868-d0f5de1fea6a None None] Releasing lock "compute-rpcapi-router" {{(pid=122757) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:06:02.446071 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5a04aad5-854f-4a78-9868-d0f5de1fea6a None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.443466 Oct 04 21:06:02.446711 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 52/117] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:02.473052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-5a22d1d1-249b-43e5-8d71-b82fee037feb tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] Getting quotas for project 8f185b9b490c4d598cfc30c3f07456b8. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:06:02.489224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-5a22d1d1-249b-43e5-8d71-b82fee037feb tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] Getting quotas for user fde7be017cb0445faa8ffa1049210179 and project 8f185b9b490c4d598cfc30c3f07456b8. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:06:02.604454 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5a22d1d1-249b-43e5-8d71-b82fee037feb tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.10 time: 0.796914 Oct 04 21:06:02.607056 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 66/118] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Oct 4 21:06:01 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 801 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:06:02.614137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e154d4ff-03e8-4b7e-8779-290cd896742d tempest-ServersWithSpecificFlavorTestJSON-699011552 tempest-ServersWithSpecificFlavorTestJSON-699011552-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:02.638771 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e154d4ff-03e8-4b7e-8779-290cd896742d tempest-ServersWithSpecificFlavorTestJSON-699011552 tempest-ServersWithSpecificFlavorTestJSON-699011552-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.030527 Oct 04 21:06:02.639621 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 67/119] 10.222.0.30 () {58 vars in 1182 bytes} [Tue Oct 4 21:06:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:06:02.652893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c4b8f067-d8d5-49c7-b80f-f6e09d5ebd75 tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] Action: 'create', calling method: .version_select at 0x7f5790ee9160>, body: {"keypair": {"name": "tempest-keypair-2096099710", "type": "ssh", "user_id": "764fd07321a14d8a8013fcb0be55a5ba", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgGmESK70uePx+PNsUbEsd04jAAJM9+OsG94b560yGDAuo8VLhqLOH6ooe/gavT4cq2Cefdd2pvKwA3hMi8fcK3+jBtjCimyMZrBpw/2HR/j6coFYPx+D0qJpY5wZi90A=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:02.701558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-c4b8f067-d8d5-49c7-b80f-f6e09d5ebd75 tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] Getting quotas for project 8f185b9b490c4d598cfc30c3f07456b8. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:06:02.708381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-c4b8f067-d8d5-49c7-b80f-f6e09d5ebd75 tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] Getting quotas for user fde7be017cb0445faa8ffa1049210179 and project 8f185b9b490c4d598cfc30c3f07456b8. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:06:02.833753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-603a5db6-af48-42a6-a603-6c658da84b76 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:02.857753 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-603a5db6-af48-42a6-a603-6c658da84b76 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] HTTP exception thrown: Flavor 1286980636 has no extra specs with key hw:cpu_thread_policy. Oct 04 21:06:02.864166 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c4b8f067-d8d5-49c7-b80f-f6e09d5ebd75 tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.219903 Oct 04 21:06:02.865630 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 68/120] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Oct 4 21:06:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 225 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-603a5db6-af48-42a6-a603-6c658da84b76 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] Request method failure captured: Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/flavors/1286980636/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKAzhc5VkUbtC1OSNJh_ZgB5LyzUiqcmslMAf5sQk8LmlVn-KfCWEohLSdTgRrRlIQuFBW94cdPgfcUVWsKABHPww9AwS6z9q43Slw9y5GCDDiHpgT60cqywYIu5HSLqSZSgoborgNp8M13uQ7txeOwftJAuUi1mTXqdL61dgfiMFHM Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fed1c558dcaa4254a61085f7b28818d1 Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:06:02.868824 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:06:02.871142 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fed1c558dcaa4254a61085f7b28818d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fed1c558dcaa4254a61085f7b28818d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fed1c558dcaa4254a61085f7b28818d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fed1c558dcaa4254a61085f7b28818d1"}]}] Oct 04 21:06:02.871142 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 Oct 04 21:06:02.871142 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fed1c558dcaa4254a61085f7b28818d1 Oct 04 21:06:02.871142 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 Oct 04 21:06:02.871142 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project Oct 04 21:06:02.871142 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:02.871142 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:02.871142 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 21b420b920c24e63855801363bb8310f Oct 04 21:06:02.871142 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project Oct 04 21:06:02.871142 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:06:02.871142 n-d-860282-1 devstack@n-api.service[122757]: exception: Flavor 1286980636 has no extra specs with key hw:cpu_thread_policy. Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'flavor_id': '1286980636', 'id': 'hw:cpu_thread_policy'} Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1286980636 has no extra specs with key hw:cpu_thread_policy. Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:02.871794 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:02.873076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:02.873076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:02.873076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:02.873076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:02.873076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:02.873076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1286980636 has no extra specs with key hw:cpu_thread_policy. Oct 04 21:06:02.873076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:02.873076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-603a5db6-af48-42a6-a603-6c658da84b76 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] Returning 404 to user: Flavor 1286980636 has no extra specs with key hw:cpu_thread_policy. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:02.873585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9300fea5-0ca6-4efa-8453-464302091189 tempest-ServersWithSpecificFlavorTestJSON-699011552 tempest-ServersWithSpecificFlavorTestJSON-699011552-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-46646802", "id": 1301334420, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:02.873687 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-603a5db6-af48-42a6-a603-6c658da84b76 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] 10.222.0.30 "GET /compute/v2.1/flavors/1286980636/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.422631 Oct 04 21:06:02.883182 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 53/121] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Oct 4 21:06:02 2022] GET /compute/v2.1/flavors/1286980636/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:06:02.915851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e37e8298-7543-4480-aa79-b924c4efc055 tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] Calling method '.version_select at 0x7f5790f144c0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:02.963301 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e37e8298-7543-4480-aa79-b924c4efc055 tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-12281060?user_id=764fd07321a14d8a8013fcb0be55a5ba" status: 200 len: 510 microversion: 2.10 time: 0.078860 Oct 04 21:06:02.971689 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 54/122] 10.222.0.30 () {60 vars in 1334 bytes} [Tue Oct 4 21:06:02 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-12281060?user_id=764fd07321a14d8a8013fcb0be55a5ba => generated 510 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:06:02.996072 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9300fea5-0ca6-4efa-8453-464302091189 tempest-ServersWithSpecificFlavorTestJSON-699011552 tempest-ServersWithSpecificFlavorTestJSON-699011552-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.124613 Oct 04 21:06:02.998122 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 69/123] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:06:02 2022] POST /compute/v2.1/flavors => generated 423 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:03.002889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eb3fe9d9-68d2-4564-bb15-2c5483f93bfe tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:03.014134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eb3fe9d9-68d2-4564-bb15-2c5483f93bfe tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '21b420b920c24e63855801363bb8310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1c558dcaa4254a61085f7b28818d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:03.014425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1886a80a-c689-4e28-8c9d-d68564ced9a2 tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] Action: 'create', calling method: .version_select at 0x7f5790ee9820>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1033844995", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4EGbwWe1HcO2AefLOSB9URePVNV+J2/7BUMHlelFVZCoKKCMnaa0styW08V/6k2om6HH27m1I4nsZphrLcGk5WD+rYpClvH5HPlDiRe6MxJcOq9ngaujUNtIguLD7fbA=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eb3fe9d9-68d2-4564-bb15-2c5483f93bfe tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] Request method failure captured: Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/flavors/1286980636/os-extra_specs HTTP/1.1 Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 66 Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKAzhc5VkUbtC1OSNJh_ZgB5LyzUiqcmslMAf5sQk8LmlVn-KfCWEohLSdTgRrRlIQuFBW94cdPgfcUVWsKABHPww9AwS6z9q43Slw9y5GCDDiHpgT60cqywYIu5HSLqSZSgoborgNp8M13uQ7txeOwftJAuUi1mTXqdL61dgfiMFHM Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fed1c558dcaa4254a61085f7b28818d1 Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:06:03.019439 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:06:03.020892 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fed1c558dcaa4254a61085f7b28818d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fed1c558dcaa4254a61085f7b28818d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fed1c558dcaa4254a61085f7b28818d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fed1c558dcaa4254a61085f7b28818d1"}]}] Oct 04 21:06:03.020892 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 Oct 04 21:06:03.020892 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fed1c558dcaa4254a61085f7b28818d1 Oct 04 21:06:03.020892 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 Oct 04 21:06:03.020892 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project Oct 04 21:06:03.020892 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:03.020892 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:03.020892 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 21b420b920c24e63855801363bb8310f Oct 04 21:06:03.020892 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project Oct 04 21:06:03.020892 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:06:03.020892 n-d-860282-1 devstack@n-api.service[122757]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 04 21:06:03.020892 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:06:03.021792 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 21:06:03.021792 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'flavor_id': '1286980636', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 04 21:06:03.021792 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:03.021792 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:03.021792 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:03.021792 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:03.021792 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:03.021792 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:03.021792 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:03.021792 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:03.021792 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:03.021792 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:03.021792 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 04 21:06:03.021792 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 04 21:06:03.021792 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:06:03.021792 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:06:03.021792 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:06:03.021792 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:06:03.021792 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 21:06:03.023100 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.028068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eb3fe9d9-68d2-4564-bb15-2c5483f93bfe tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:03.030514 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eb3fe9d9-68d2-4564-bb15-2c5483f93bfe tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] 10.222.0.30 "POST /compute/v2.1/flavors/1286980636/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.056071 Oct 04 21:06:03.033270 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 55/124] 10.222.0.30 () {60 vars in 1224 bytes} [Tue Oct 4 21:06:02 2022] POST /compute/v2.1/flavors/1286980636/os-extra_specs => generated 124 bytes in 60 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:06:03.052227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-733da70f-e913-4854-b5e6-b9dcd2fbdae3 tempest-ServersWithSpecificFlavorTestJSON-699011552 tempest-ServersWithSpecificFlavorTestJSON-699011552-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:03.060917 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-733da70f-e913-4854-b5e6-b9dcd2fbdae3 tempest-ServersWithSpecificFlavorTestJSON-699011552 tempest-ServersWithSpecificFlavorTestJSON-699011552-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014240 Oct 04 21:06:03.061516 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 56/125] 10.222.0.30 () {58 vars in 1182 bytes} [Tue Oct 4 21:06:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:06:03.067637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a76c3335-34de-4308-888f-16755e3853af tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:03.068563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a76c3335-34de-4308-888f-16755e3853af tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:03.082120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a76c3335-34de-4308-888f-16755e3853af tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:03.082672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a76c3335-34de-4308-888f-16755e3853af tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:03.083130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a76c3335-34de-4308-888f-16755e3853af tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:03.084028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a76c3335-34de-4308-888f-16755e3853af tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:03.084667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a76c3335-34de-4308-888f-16755e3853af tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:03.085269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a76c3335-34de-4308-888f-16755e3853af tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:03.099072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-1886a80a-c689-4e28-8c9d-d68564ced9a2 tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] Getting quotas for project 8f185b9b490c4d598cfc30c3f07456b8. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:06:03.126126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-1886a80a-c689-4e28-8c9d-d68564ced9a2 tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] Getting quotas for user fde7be017cb0445faa8ffa1049210179 and project 8f185b9b490c4d598cfc30c3f07456b8. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:06:03.275822 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1886a80a-c689-4e28-8c9d-d68564ced9a2 tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.276262 Oct 04 21:06:03.277642 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 70/126] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Oct 4 21:06:02 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 279 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:06:03.287012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4c73a5bb-73d3-45ac-b06d-8559906a7d52 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:03.367255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a76c3335-34de-4308-888f-16755e3853af tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:03.384439 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a76c3335-34de-4308-888f-16755e3853af tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1339 microversion: 2.1 time: 0.320608 Oct 04 21:06:03.385860 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 57/127] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:03 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1339 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:03.397397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-256fa363-5c57-485c-95bb-d548f48a62d7 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Action: 'create', calling method: .version_select at 0x7f5791001790>, body: {"keypair": {"name": "tempest-keypair-1534777327", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpsuxRRH/UdhR8yMVoREQbWQe8YBtpG/wnlnVglcnomoUgonv7hRSQgzIzjQW/n6ybtGOKOVoN1DB1559fmLO7OwnSK7woLwEXakMm+ENaGJqNtvJ4u30Kum5GsU4snew=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:03.422361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-256fa363-5c57-485c-95bb-d548f48a62d7 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Getting quotas for project c8d13d1c426145c4824dda4e6aa59040. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:06:03.435500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-256fa363-5c57-485c-95bb-d548f48a62d7 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Getting quotas for user ed473156169a4fd793d86dc9e9289dc1 and project c8d13d1c426145c4824dda4e6aa59040. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:06:03.470005 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4c73a5bb-73d3-45ac-b06d-8559906a7d52 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1286980636/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.190637 Oct 04 21:06:03.471579 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 71/128] 10.222.0.30 () {60 vars in 1224 bytes} [Tue Oct 4 21:06:03 2022] POST /compute/v2.1/flavors/1286980636/os-extra_specs => generated 66 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:06:03.476718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dd7c2e1f-2c44-49ab-8ae1-bd753ce7b450 tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] Calling method '.version_select at 0x7f5790eecee0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:03.481783 n-d-860282-1 devstack@n-api.service[122758]: WARNING oslo_db.sqlalchemy.utils [None req-dd7c2e1f-2c44-49ab-8ae1-bd753ce7b450 tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 21:06:03.491361 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dd7c2e1f-2c44-49ab-8ae1-bd753ce7b450 tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] 10.222.0.30 "GET /compute/v2.1/os-keypairs?user_id=764fd07321a14d8a8013fcb0be55a5ba" status: 200 len: 724 microversion: 2.10 time: 0.018525 Oct 04 21:06:03.500943 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 72/129] 10.222.0.30 () {60 vars in 1259 bytes} [Tue Oct 4 21:06:03 2022] GET /compute/v2.1/os-keypairs?user_id=764fd07321a14d8a8013fcb0be55a5ba => generated 724 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:06:03.506895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4f6ba487-c2f3-4c3c-a501-22317a328e36 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:03.509381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4f6ba487-c2f3-4c3c-a501-22317a328e36 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '21b420b920c24e63855801363bb8310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1c558dcaa4254a61085f7b28818d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4f6ba487-c2f3-4c3c-a501-22317a328e36 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] Request method failure captured: Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/flavors/1286980636/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKAzhc5VkUbtC1OSNJh_ZgB5LyzUiqcmslMAf5sQk8LmlVn-KfCWEohLSdTgRrRlIQuFBW94cdPgfcUVWsKABHPww9AwS6z9q43Slw9y5GCDDiHpgT60cqywYIu5HSLqSZSgoborgNp8M13uQ7txeOwftJAuUi1mTXqdL61dgfiMFHM Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: fed1c558dcaa4254a61085f7b28818d1 Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:06:03.516409 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:06:03.519138 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fed1c558dcaa4254a61085f7b28818d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fed1c558dcaa4254a61085f7b28818d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fed1c558dcaa4254a61085f7b28818d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fed1c558dcaa4254a61085f7b28818d1"}]}] Oct 04 21:06:03.519138 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 Oct 04 21:06:03.519138 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: fed1c558dcaa4254a61085f7b28818d1 Oct 04 21:06:03.519138 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 Oct 04 21:06:03.519138 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project Oct 04 21:06:03.519138 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:06:03.519138 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:06:03.519138 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 21b420b920c24e63855801363bb8310f Oct 04 21:06:03.519138 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project Oct 04 21:06:03.519138 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:06:03.519138 n-d-860282-1 devstack@n-api.service[122758]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'flavor_id': '1286980636', 'id': 'hw:numa_nodes'} Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:06:03.519983 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:06:03.521308 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:06:03.521308 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:06:03.521308 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:06:03.521308 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:06:03.521308 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:06:03.521308 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 21:06:03.521308 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.521308 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:03.521308 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.521308 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:03.521308 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:03.521308 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:03.521308 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:06:03.521308 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:06:03.521308 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 21:06:03.521308 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.521308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4f6ba487-c2f3-4c3c-a501-22317a328e36 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:03.523234 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4f6ba487-c2f3-4c3c-a501-22317a328e36 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] 10.222.0.30 "DELETE /compute/v2.1/flavors/1286980636/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.012167 Oct 04 21:06:03.523234 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 73/130] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Oct 4 21:06:03 2022] DELETE /compute/v2.1/flavors/1286980636/os-extra_specs/hw:numa_nodes => generated 124 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:06:03.529198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2283f270-1d7c-4b2f-b559-59dcf119531c tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] Calling method '.version_select at 0x7f57910a1a60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:03.537871 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-256fa363-5c57-485c-95bb-d548f48a62d7 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.150450 Oct 04 21:06:03.538744 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 58/131] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:06:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:03.558767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2cc78b3b-d9f3-4320-9af1-f4ab8d76caf2 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:03.612026 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2cc78b3b-d9f3-4320-9af1-f4ab8d76caf2 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1286980636/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.071866 Oct 04 21:06:03.612932 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 59/132] 10.222.0.30 () {60 vars in 1224 bytes} [Tue Oct 4 21:06:03 2022] POST /compute/v2.1/flavors/1286980636/os-extra_specs => generated 66 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:06:03.632008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4d1217b3-b90b-4154-91ac-baec26c4fcc5 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:03.643728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4d1217b3-b90b-4154-91ac-baec26c4fcc5 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '21b420b920c24e63855801363bb8310f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1c558dcaa4254a61085f7b28818d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4d1217b3-b90b-4154-91ac-baec26c4fcc5 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] Request method failure captured: Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: request: PUT /compute/v2.1/flavors/1286980636/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 22 Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKAzhc5VkUbtC1OSNJh_ZgB5LyzUiqcmslMAf5sQk8LmlVn-KfCWEohLSdTgRrRlIQuFBW94cdPgfcUVWsKABHPww9AwS6z9q43Slw9y5GCDDiHpgT60cqywYIu5HSLqSZSgoborgNp8M13uQ7txeOwftJAuUi1mTXqdL61dgfiMFHM Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fed1c558dcaa4254a61085f7b28818d1 Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:06:03.655359 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:06:03.656730 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fed1c558dcaa4254a61085f7b28818d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fed1c558dcaa4254a61085f7b28818d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fed1c558dcaa4254a61085f7b28818d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fed1c558dcaa4254a61085f7b28818d1"}]}] Oct 04 21:06:03.656730 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 Oct 04 21:06:03.656730 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fed1c558dcaa4254a61085f7b28818d1 Oct 04 21:06:03.656730 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 Oct 04 21:06:03.656730 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project Oct 04 21:06:03.656730 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:03.656730 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:03.656730 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 21b420b920c24e63855801363bb8310f Oct 04 21:06:03.656730 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project Oct 04 21:06:03.656730 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:06:03.656730 n-d-860282-1 devstack@n-api.service[122757]: {"hw:numa_nodes": "1"} Oct 04 21:06:03.656730 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:06:03.656730 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 21:06:03.665635 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'flavor_id': '1286980636', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 04 21:06:03.665635 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:03.665635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:03.665635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:03.665635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:03.665635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:03.665635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:03.665635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:03.665635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:03.665635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:03.665635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:03.665635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 04 21:06:03.665635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 04 21:06:03.665635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:06:03.665635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:06:03.665635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:06:03.665635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:06:03.665635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:06:03.665635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:06:03.666946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:06:03.666946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:06:03.666946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:06:03.666946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:06:03.666946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:06:03.666946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:06:03.666946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:06:03.666946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:06:03.666946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 21:06:03.666946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.666946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:03.666946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.666946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:03.666946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:03.666946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:03.666946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:06:03.666946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:06:03.666946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 21:06:03.666946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.668133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4d1217b3-b90b-4154-91ac-baec26c4fcc5 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:03.668133 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4d1217b3-b90b-4154-91ac-baec26c4fcc5 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344 tempest-FlavorsExtraSpecsNegativeTestJSON-461042344-project] 10.222.0.30 "PUT /compute/v2.1/flavors/1286980636/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.035120 Oct 04 21:06:03.668282 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2283f270-1d7c-4b2f-b559-59dcf119531c tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1033844995" status: 204 len: 0 microversion: 2.10 time: 0.133110 Oct 04 21:06:03.668282 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 74/134] 10.222.0.30 () {60 vars in 1325 bytes} [Tue Oct 4 21:06:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1033844995 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:06:03.668447 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 60/134] 10.222.0.30 () {60 vars in 1265 bytes} [Tue Oct 4 21:06:03 2022] PUT /compute/v2.1/flavors/1286980636/os-extra_specs/hw:numa_nodes => generated 124 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:06:03.673396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fc957566-c632-4ba6-a154-01b2c8765ee6 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:03.678062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-14bf7cf6-1bf7-4629-8435-e5a34df906bc tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] Calling method '.version_select at 0x7f5790ef1ca0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:03.690032 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-fc957566-c632-4ba6-a154-01b2c8765ee6 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] HTTP exception thrown: Flavor 1286980636 has no extra specs with key hw:cpu_thread_policy. Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fc957566-c632-4ba6-a154-01b2c8765ee6 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] Request method failure captured: Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/flavors/1286980636/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKA4hqkJ_noMjpk5qoDFeVxmyeiw10mTEa_zn5gbzLFOvEdv7ynTlyfTN7V7jx9RpFvd2tEtbSz4I5iPgk6E3M50gJqNSCLBN2ZZpJNJtjt2Qj5YdpibTZeCekXM6a0goL9tXlXo5JVdtuYtIF-GT73Ya1_KL5rSUZwDkp6xB345Zss Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: c208a32640e64315925ee11eb95fe90b Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:06:03.700769 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:06:03.708793 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c208a32640e64315925ee11eb95fe90b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c208a32640e64315925ee11eb95fe90b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c208a32640e64315925ee11eb95fe90b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c208a32640e64315925ee11eb95fe90b"}]}] Oct 04 21:06:03.708793 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 Oct 04 21:06:03.708793 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: c208a32640e64315925ee11eb95fe90b Oct 04 21:06:03.708793 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 Oct 04 21:06:03.708793 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin Oct 04 21:06:03.708793 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:06:03.708793 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:06:03.708793 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: f8e3632d651148888ce9582363b64b61 Oct 04 21:06:03.708793 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin Oct 04 21:06:03.708793 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:06:03.708793 n-d-860282-1 devstack@n-api.service[122758]: exception: Flavor 1286980636 has no extra specs with key hw:cpu_thread_policy. Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'flavor_id': '1286980636', 'id': 'hw:cpu_thread_policy'} Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1286980636 has no extra specs with key hw:cpu_thread_policy. Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:03.709569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.711096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:03.711096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:03.711096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:03.711096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:03.711096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:03.711096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1286980636 has no extra specs with key hw:cpu_thread_policy. Oct 04 21:06:03.711096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.711096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fc957566-c632-4ba6-a154-01b2c8765ee6 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] Returning 404 to user: Flavor 1286980636 has no extra specs with key hw:cpu_thread_policy. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:03.711096 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fc957566-c632-4ba6-a154-01b2c8765ee6 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1286980636/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.034288 Oct 04 21:06:03.711974 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 75/135] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Oct 4 21:06:03 2022] DELETE /compute/v2.1/flavors/1286980636/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:06:03.726191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8823cbc8-3304-4ca1-a00e-ce36d45bb866 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:03.739621 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-8823cbc8-3304-4ca1-a00e-ce36d45bb866 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8823cbc8-3304-4ca1-a00e-ce36d45bb866 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] Request method failure captured: Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: request: PUT /compute/v2.1/flavors/1286980636/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 27 Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKA4hqkJ_noMjpk5qoDFeVxmyeiw10mTEa_zn5gbzLFOvEdv7ynTlyfTN7V7jx9RpFvd2tEtbSz4I5iPgk6E3M50gJqNSCLBN2ZZpJNJtjt2Qj5YdpibTZeCekXM6a0goL9tXlXo5JVdtuYtIF-GT73Ya1_KL5rSUZwDkp6xB345Zss Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: c208a32640e64315925ee11eb95fe90b Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:06:03.744087 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:06:03.746040 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c208a32640e64315925ee11eb95fe90b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c208a32640e64315925ee11eb95fe90b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c208a32640e64315925ee11eb95fe90b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c208a32640e64315925ee11eb95fe90b"}]}] Oct 04 21:06:03.746040 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 Oct 04 21:06:03.746040 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: c208a32640e64315925ee11eb95fe90b Oct 04 21:06:03.746040 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 Oct 04 21:06:03.746040 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin Oct 04 21:06:03.746040 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:06:03.746040 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:06:03.746040 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: f8e3632d651148888ce9582363b64b61 Oct 04 21:06:03.746040 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin Oct 04 21:06:03.746040 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:06:03.746040 n-d-860282-1 devstack@n-api.service[122758]: {"hw:cpu_policy": "shared"} Oct 04 21:06:03.746040 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:06:03.746040 n-d-860282-1 devstack@n-api.service[122758]: exception: Request body and URI mismatch Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'flavor_id': '1286980636', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:03.746766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:03.747952 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:03.747952 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:03.747952 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 04 21:06:03.747952 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.753515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8823cbc8-3304-4ca1-a00e-ce36d45bb866 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:03.755266 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8823cbc8-3304-4ca1-a00e-ce36d45bb866 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1286980636/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.040478 Oct 04 21:06:03.757949 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 76/136] 10.222.0.30 () {60 vars in 1265 bytes} [Tue Oct 4 21:06:03 2022] PUT /compute/v2.1/flavors/1286980636/os-extra_specs/hw:numa_nodes => generated 73 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:06:03.776673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0374e6d1-9d9d-4cd1-ab5f-4858b315b912 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0374e6d1-9d9d-4cd1-ab5f-4858b315b912 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] Request method failure captured: Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: request: PUT /compute/v2.1/flavors/1286980636/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 49 Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKA4hqkJ_noMjpk5qoDFeVxmyeiw10mTEa_zn5gbzLFOvEdv7ynTlyfTN7V7jx9RpFvd2tEtbSz4I5iPgk6E3M50gJqNSCLBN2ZZpJNJtjt2Qj5YdpibTZeCekXM6a0goL9tXlXo5JVdtuYtIF-GT73Ya1_KL5rSUZwDkp6xB345Zss Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: c208a32640e64315925ee11eb95fe90b Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:06:03.785813 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:06:03.787197 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c208a32640e64315925ee11eb95fe90b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c208a32640e64315925ee11eb95fe90b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c208a32640e64315925ee11eb95fe90b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c208a32640e64315925ee11eb95fe90b"}]}] Oct 04 21:06:03.787197 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 Oct 04 21:06:03.787197 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: c208a32640e64315925ee11eb95fe90b Oct 04 21:06:03.787197 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 Oct 04 21:06:03.787197 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin Oct 04 21:06:03.787197 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:06:03.787197 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:06:03.787197 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: f8e3632d651148888ce9582363b64b61 Oct 04 21:06:03.787197 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin Oct 04 21:06:03.787197 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:06:03.787197 n-d-860282-1 devstack@n-api.service[122758]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 04 21:06:03.787197 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'flavor_id': '1286980636', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance: Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 04 21:06:03.787856 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.789082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:03.793160 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:03.793160 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:03.793160 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:06:03.793160 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:06:03.793160 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 21:06:03.793160 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:03.796267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0374e6d1-9d9d-4cd1-ab5f-4858b315b912 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:03.798580 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0374e6d1-9d9d-4cd1-ab5f-4858b315b912 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1286980636/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.031545 Oct 04 21:06:03.799733 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 77/137] 10.222.0.30 () {60 vars in 1265 bytes} [Tue Oct 4 21:06:03 2022] PUT /compute/v2.1/flavors/1286980636/os-extra_specs/hw:numa_nodes => generated 117 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:06:03.814699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-87464364-3a02-4a86-a663-a4116816287a tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:03.860865 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-14bf7cf6-1bf7-4629-8435-e5a34df906bc tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096099710?user_id=764fd07321a14d8a8013fcb0be55a5ba" status: 204 len: 0 microversion: 2.10 time: 0.178108 Oct 04 21:06:03.860865 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 61/138] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Oct 4 21:06:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096099710?user_id=764fd07321a14d8a8013fcb0be55a5ba => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:06:03.869629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4f403ea1-57e4-414f-9e09-5ef54fef57f5 tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] Calling method '.version_select at 0x7f5791001700>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:04.386294 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-87464364-3a02-4a86-a663-a4116816287a tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1286980636" status: 202 len: 0 microversion: 2.1 time: 0.581050 Oct 04 21:06:04.388225 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 78/139] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Oct 4 21:06:03 2022] DELETE /compute/v2.1/flavors/1286980636 => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:06:04.388909 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4f403ea1-57e4-414f-9e09-5ef54fef57f5 tempest-KeyPairsV210TestJSON-1563862898 tempest-KeyPairsV210TestJSON-1563862898-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-12281060?user_id=764fd07321a14d8a8013fcb0be55a5ba" status: 204 len: 0 microversion: 2.10 time: 0.523600 Oct 04 21:06:04.390174 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 62/140] 10.222.0.30 () {60 vars in 1337 bytes} [Tue Oct 4 21:06:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-12281060?user_id=764fd07321a14d8a8013fcb0be55a5ba => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:06:04.395783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-924452b3-a81d-44b4-aa11-d4dd40438644 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:04.403452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=7,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:04.411401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8f361549-d047-43e9-ab51-af06df93a537 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:04.413912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8f361549-d047-43e9-ab51-af06df93a537 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:04.419995 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-924452b3-a81d-44b4-aa11-d4dd40438644 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198 tempest-FlavorsExtraSpecsNegativeTestJSON-1432624198-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.027794 Oct 04 21:06:04.437406 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 79/141] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:06:04 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:04.438446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f361549-d047-43e9-ab51-af06df93a537 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:04.438446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f361549-d047-43e9-ab51-af06df93a537 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:04.438446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f361549-d047-43e9-ab51-af06df93a537 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:04.438446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f361549-d047-43e9-ab51-af06df93a537 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:04.438960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f361549-d047-43e9-ab51-af06df93a537 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:04.438960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f361549-d047-43e9-ab51-af06df93a537 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:04.567902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8f361549-d047-43e9-ab51-af06df93a537 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:04.576561 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8f361549-d047-43e9-ab51-af06df93a537 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1339 microversion: 2.1 time: 0.168999 Oct 04 21:06:04.577131 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 63/142] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:04 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1339 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:05.599882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f6467d09-2bbc-4646-8f73-1e55afc0c35f tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:05.600517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f6467d09-2bbc-4646-8f73-1e55afc0c35f tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:05.608179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6467d09-2bbc-4646-8f73-1e55afc0c35f tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:05.608679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6467d09-2bbc-4646-8f73-1e55afc0c35f tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:05.609117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6467d09-2bbc-4646-8f73-1e55afc0c35f tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:05.610268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6467d09-2bbc-4646-8f73-1e55afc0c35f tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:05.610784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6467d09-2bbc-4646-8f73-1e55afc0c35f tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:05.613064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6467d09-2bbc-4646-8f73-1e55afc0c35f tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:05.871929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f6467d09-2bbc-4646-8f73-1e55afc0c35f tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:05.879966 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f6467d09-2bbc-4646-8f73-1e55afc0c35f tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1339 microversion: 2.1 time: 0.283329 Oct 04 21:06:05.880762 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 64/143] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:05 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1339 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:06.052717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9ba77f45-f427-44e7-b6c3-8d2b8937048a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Calling method '.version_select at 0x7f5790eecf70>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:06.055418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ba77f45-f427-44e7-b6c3-8d2b8937048a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.056017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ba77f45-f427-44e7-b6c3-8d2b8937048a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.056561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ba77f45-f427-44e7-b6c3-8d2b8937048a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.078031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ba77f45-f427-44e7-b6c3-8d2b8937048a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.078655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ba77f45-f427-44e7-b6c3-8d2b8937048a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.079220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ba77f45-f427-44e7-b6c3-8d2b8937048a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.094879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ba77f45-f427-44e7-b6c3-8d2b8937048a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.095692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ba77f45-f427-44e7-b6c3-8d2b8937048a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.096504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ba77f45-f427-44e7-b6c3-8d2b8937048a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.103784 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9ba77f45-f427-44e7-b6c3-8d2b8937048a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.512511 Oct 04 21:06:06.104787 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 80/144] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:06:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:06.117883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-df868afc-ba02-4b2e-a1c4-33c0d09b643f tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Calling method '.version_select at 0x7f5790f144c0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:06.120415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df868afc-ba02-4b2e-a1c4-33c0d09b643f tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.121824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df868afc-ba02-4b2e-a1c4-33c0d09b643f tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.125509 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df868afc-ba02-4b2e-a1c4-33c0d09b643f tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.142632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df868afc-ba02-4b2e-a1c4-33c0d09b643f tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.143461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df868afc-ba02-4b2e-a1c4-33c0d09b643f tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.144065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df868afc-ba02-4b2e-a1c4-33c0d09b643f tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.155097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df868afc-ba02-4b2e-a1c4-33c0d09b643f tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.155587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df868afc-ba02-4b2e-a1c4-33c0d09b643f tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.156028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df868afc-ba02-4b2e-a1c4-33c0d09b643f tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.162106 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-df868afc-ba02-4b2e-a1c4-33c0d09b643f tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.049659 Oct 04 21:06:06.162722 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 65/145] 10.222.0.30 () {58 vars in 1167 bytes} [Tue Oct 4 21:06:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:06.179430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6d3f7f72-fa66-4138-85a3-81d37244d149 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Calling method '.version_select at 0x7f5790eec0d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:06.181218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d3f7f72-fa66-4138-85a3-81d37244d149 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.181734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d3f7f72-fa66-4138-85a3-81d37244d149 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.182178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d3f7f72-fa66-4138-85a3-81d37244d149 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.196412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d3f7f72-fa66-4138-85a3-81d37244d149 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.196960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d3f7f72-fa66-4138-85a3-81d37244d149 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.197396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d3f7f72-fa66-4138-85a3-81d37244d149 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.207968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d3f7f72-fa66-4138-85a3-81d37244d149 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.208701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d3f7f72-fa66-4138-85a3-81d37244d149 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.209144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d3f7f72-fa66-4138-85a3-81d37244d149 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.215829 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6d3f7f72-fa66-4138-85a3-81d37244d149 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.039895 Oct 04 21:06:06.216440 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 81/146] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:06:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:06.226773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-71c50737-4888-409b-b67f-9d2b50bf8f25 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Calling method '.version_select at 0x7f5790fc98b0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:06.228670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71c50737-4888-409b-b67f-9d2b50bf8f25 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.229321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71c50737-4888-409b-b67f-9d2b50bf8f25 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.229956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71c50737-4888-409b-b67f-9d2b50bf8f25 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.253196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71c50737-4888-409b-b67f-9d2b50bf8f25 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.253708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71c50737-4888-409b-b67f-9d2b50bf8f25 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.254342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71c50737-4888-409b-b67f-9d2b50bf8f25 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.262301 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-71c50737-4888-409b-b67f-9d2b50bf8f25 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.038398 Oct 04 21:06:06.263164 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 66/147] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:06:06 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:06.283034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-178c486b-9f8b-414f-8b40-357e3ce4c094 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Calling method '.version_select at 0x7f5790ef88b0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:06.288689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-178c486b-9f8b-414f-8b40-357e3ce4c094 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.289181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-178c486b-9f8b-414f-8b40-357e3ce4c094 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.312264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-178c486b-9f8b-414f-8b40-357e3ce4c094 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.329549 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-178c486b-9f8b-414f-8b40-357e3ce4c094 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.052574 Oct 04 21:06:06.341688 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 82/148] 10.222.0.30 () {58 vars in 1179 bytes} [Tue Oct 4 21:06:06 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:06.347404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4cdba71a-82a7-40d8-b134-7d60cbf109e3 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Calling method '.version_select at 0x7f57911b1280>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:06.349627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cdba71a-82a7-40d8-b134-7d60cbf109e3 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.350289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cdba71a-82a7-40d8-b134-7d60cbf109e3 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.351334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cdba71a-82a7-40d8-b134-7d60cbf109e3 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.369788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cdba71a-82a7-40d8-b134-7d60cbf109e3 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.371023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cdba71a-82a7-40d8-b134-7d60cbf109e3 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.372143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cdba71a-82a7-40d8-b134-7d60cbf109e3 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.387637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cdba71a-82a7-40d8-b134-7d60cbf109e3 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.388390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cdba71a-82a7-40d8-b134-7d60cbf109e3 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.389276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cdba71a-82a7-40d8-b134-7d60cbf109e3 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.397607 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4cdba71a-82a7-40d8-b134-7d60cbf109e3 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.055322 Oct 04 21:06:06.405547 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 67/149] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:06:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:06.410575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-28b82421-c974-4f89-8da7-3152cb8c3681 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Calling method '.version_select at 0x7f5790ef8040>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:06.412483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28b82421-c974-4f89-8da7-3152cb8c3681 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.413046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28b82421-c974-4f89-8da7-3152cb8c3681 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.413593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28b82421-c974-4f89-8da7-3152cb8c3681 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.437250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28b82421-c974-4f89-8da7-3152cb8c3681 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.437809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28b82421-c974-4f89-8da7-3152cb8c3681 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.438353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28b82421-c974-4f89-8da7-3152cb8c3681 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.445648 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-28b82421-c974-4f89-8da7-3152cb8c3681 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.038399 Oct 04 21:06:06.454476 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 83/150] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:06:06 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:06.463571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c2c54c43-39c2-4c1a-8dff-299f9aa83938 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Calling method '.version_select at 0x7f5790f149d0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:06.465520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2c54c43-39c2-4c1a-8dff-299f9aa83938 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.466014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2c54c43-39c2-4c1a-8dff-299f9aa83938 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.466454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2c54c43-39c2-4c1a-8dff-299f9aa83938 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.487271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2c54c43-39c2-4c1a-8dff-299f9aa83938 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.487844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2c54c43-39c2-4c1a-8dff-299f9aa83938 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.488423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2c54c43-39c2-4c1a-8dff-299f9aa83938 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.499271 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c2c54c43-39c2-4c1a-8dff-299f9aa83938 tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.041073 Oct 04 21:06:06.499271 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 68/151] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:06:06 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:06.524571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-afb4f4c5-a9ac-4d0e-b0f9-b0eafa21be5a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Calling method '.version_select at 0x7f5790eeca60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:06.527764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afb4f4c5-a9ac-4d0e-b0f9-b0eafa21be5a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.528388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afb4f4c5-a9ac-4d0e-b0f9-b0eafa21be5a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.529463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afb4f4c5-a9ac-4d0e-b0f9-b0eafa21be5a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.551991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afb4f4c5-a9ac-4d0e-b0f9-b0eafa21be5a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.552555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afb4f4c5-a9ac-4d0e-b0f9-b0eafa21be5a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.553071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afb4f4c5-a9ac-4d0e-b0f9-b0eafa21be5a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.567914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afb4f4c5-a9ac-4d0e-b0f9-b0eafa21be5a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.576999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afb4f4c5-a9ac-4d0e-b0f9-b0eafa21be5a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.576999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afb4f4c5-a9ac-4d0e-b0f9-b0eafa21be5a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.578566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afb4f4c5-a9ac-4d0e-b0f9-b0eafa21be5a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:06:06.578976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afb4f4c5-a9ac-4d0e-b0f9-b0eafa21be5a tempest-HypervisorAdminTestJSON-1080718540 tempest-HypervisorAdminTestJSON-1080718540-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:06:06.580077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c865d7d3-97b3-4aa7-91f6-787f10a9604b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.580545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c865d7d3-97b3-4aa7-91f6-787f10a9604b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.580980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c865d7d3-97b3-4aa7-91f6-787f10a9604b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.581734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c865d7d3-97b3-4aa7-91f6-787f10a9604b None None] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.582407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c865d7d3-97b3-4aa7-91f6-787f10a9604b None None] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.582603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c865d7d3-97b3-4aa7-91f6-787f10a9604b None None] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.594671 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.compute.rpcapi [None req-c865d7d3-97b3-4aa7-91f6-787f10a9604b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 21:06:06.598562 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c865d7d3-97b3-4aa7-91f6-787f10a9604b None None] Releasing lock "compute-rpcapi-router" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:06:06.635042 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c865d7d3-97b3-4aa7-91f6-787f10a9604b None None] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.124480 Oct 04 21:06:06.637158 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 84/152] 10.222.0.30 () {58 vars in 1173 bytes} [Tue Oct 4 21:06:06 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:06.904064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-829d93ab-8f47-471c-9e70-8c5d24cc5061 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:06.904702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-829d93ab-8f47-471c-9e70-8c5d24cc5061 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:06.912248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-829d93ab-8f47-471c-9e70-8c5d24cc5061 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.912752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-829d93ab-8f47-471c-9e70-8c5d24cc5061 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.916029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-829d93ab-8f47-471c-9e70-8c5d24cc5061 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.916029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-829d93ab-8f47-471c-9e70-8c5d24cc5061 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.916029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-829d93ab-8f47-471c-9e70-8c5d24cc5061 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.916029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-829d93ab-8f47-471c-9e70-8c5d24cc5061 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:07.177191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-829d93ab-8f47-471c-9e70-8c5d24cc5061 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:07.185670 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-829d93ab-8f47-471c-9e70-8c5d24cc5061 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1339 microversion: 2.1 time: 0.285938 Oct 04 21:06:07.186322 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 69/153] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:06 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1339 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:07.758668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b97b8fcb-f906-49e1-af28-2e1d23c826ff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-61860980", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "1301334420", "adminPass": "***", "networks": [{"uuid": "0c64d317-ef71-4c6a-8b35-d4574c9e9de5"}], "security_groups": [{"name": "tempest-securitygroup--119652470"}], "key_name": "tempest-keypair-1534777327", "user_data": "}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:07.903715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-b97b8fcb-f906-49e1-af28-2e1d23c826ff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] validate_networks() for [('0c64d317-ef71-4c6a-8b35-d4574c9e9de5', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:06:08.211135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2cfea214-d3d2-4527-a146-3c0440bd6e07 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:08.212346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2cfea214-d3d2-4527-a146-3c0440bd6e07 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:08.224867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2cfea214-d3d2-4527-a146-3c0440bd6e07 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:08.225531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2cfea214-d3d2-4527-a146-3c0440bd6e07 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:08.225912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2cfea214-d3d2-4527-a146-3c0440bd6e07 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:08.226634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2cfea214-d3d2-4527-a146-3c0440bd6e07 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:08.227089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2cfea214-d3d2-4527-a146-3c0440bd6e07 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:08.241232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2cfea214-d3d2-4527-a146-3c0440bd6e07 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:08.513000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2cfea214-d3d2-4527-a146-3c0440bd6e07 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:08.525350 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2cfea214-d3d2-4527-a146-3c0440bd6e07 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1339 microversion: 2.1 time: 0.319642 Oct 04 21:06:08.530844 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 70/154] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:08 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1339 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:09.157545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-51a754a7-6e6a-4d74-904d-8143fce17248 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Calling method '.version_select at 0x7f5790f09940>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:09.157545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51a754a7-6e6a-4d74-904d-8143fce17248 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.157545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51a754a7-6e6a-4d74-904d-8143fce17248 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.157545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51a754a7-6e6a-4d74-904d-8143fce17248 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.158152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-b97b8fcb-f906-49e1-af28-2e1d23c826ff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:06:09.158152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-b97b8fcb-f906-49e1-af28-2e1d23c826ff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:06:09.158152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-b97b8fcb-f906-49e1-af28-2e1d23c826ff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:06:09.158152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-b97b8fcb-f906-49e1-af28-2e1d23c826ff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:06:09.158152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-b97b8fcb-f906-49e1-af28-2e1d23c826ff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:06:09.158963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51a754a7-6e6a-4d74-904d-8143fce17248 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.158963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51a754a7-6e6a-4d74-904d-8143fce17248 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.158963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51a754a7-6e6a-4d74-904d-8143fce17248 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.164865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51a754a7-6e6a-4d74-904d-8143fce17248 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.165357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51a754a7-6e6a-4d74-904d-8143fce17248 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.165987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51a754a7-6e6a-4d74-904d-8143fce17248 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.172393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b97b8fcb-f906-49e1-af28-2e1d23c826ff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.172902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b97b8fcb-f906-49e1-af28-2e1d23c826ff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.174036 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-51a754a7-6e6a-4d74-904d-8143fce17248 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.391515 Oct 04 21:06:09.174843 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 71/155] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:06:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:09.181665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b97b8fcb-f906-49e1-af28-2e1d23c826ff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.182685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b97b8fcb-f906-49e1-af28-2e1d23c826ff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.183186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b97b8fcb-f906-49e1-af28-2e1d23c826ff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.184175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b97b8fcb-f906-49e1-af28-2e1d23c826ff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.186768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cd38f504-ff20-4a1b-92a8-8f23f8eaa0a8 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Calling method '.version_select at 0x7f5790f09820>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:09.188599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd38f504-ff20-4a1b-92a8-8f23f8eaa0a8 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.189081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd38f504-ff20-4a1b-92a8-8f23f8eaa0a8 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.189564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd38f504-ff20-4a1b-92a8-8f23f8eaa0a8 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.208774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-b97b8fcb-f906-49e1-af28-2e1d23c826ff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Getting quotas for project c8d13d1c426145c4824dda4e6aa59040. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:06:09.213361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd38f504-ff20-4a1b-92a8-8f23f8eaa0a8 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.213868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-b97b8fcb-f906-49e1-af28-2e1d23c826ff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Getting quotas for user ed473156169a4fd793d86dc9e9289dc1 and project c8d13d1c426145c4824dda4e6aa59040. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:06:09.213982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd38f504-ff20-4a1b-92a8-8f23f8eaa0a8 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.214406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd38f504-ff20-4a1b-92a8-8f23f8eaa0a8 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.226189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b97b8fcb-f906-49e1-af28-2e1d23c826ff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:06:09.228996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b97b8fcb-f906-49e1-af28-2e1d23c826ff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:06:09.247064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:09.258993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd38f504-ff20-4a1b-92a8-8f23f8eaa0a8 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.259488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd38f504-ff20-4a1b-92a8-8f23f8eaa0a8 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.259933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd38f504-ff20-4a1b-92a8-8f23f8eaa0a8 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.266676 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cd38f504-ff20-4a1b-92a8-8f23f8eaa0a8 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/n-h1-860282-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.085050 Oct 04 21:06:09.267462 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 72/156] 10.222.0.30 () {58 vars in 1212 bytes} [Tue Oct 4 21:06:09 2022] GET /compute/v2.1/os-hypervisors/n-h1-860282-1/servers => generated 196 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:09.279644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-25b82874-8521-47e6-9194-b9a76e171660 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Calling method '.version_select at 0x7f5790f090d0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:09.281455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25b82874-8521-47e6-9194-b9a76e171660 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.281933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25b82874-8521-47e6-9194-b9a76e171660 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.282365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25b82874-8521-47e6-9194-b9a76e171660 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.296042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25b82874-8521-47e6-9194-b9a76e171660 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.296514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25b82874-8521-47e6-9194-b9a76e171660 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.296948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25b82874-8521-47e6-9194-b9a76e171660 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.308107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25b82874-8521-47e6-9194-b9a76e171660 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.308738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25b82874-8521-47e6-9194-b9a76e171660 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.310006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25b82874-8521-47e6-9194-b9a76e171660 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.315730 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-25b82874-8521-47e6-9194-b9a76e171660 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.040040 Oct 04 21:06:09.316319 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 73/157] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:06:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:09.326017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-95615174-3dd8-4608-9491-5b6cf767f470 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Calling method '.version_select at 0x7f57910015e0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:09.327714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95615174-3dd8-4608-9491-5b6cf767f470 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.328177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95615174-3dd8-4608-9491-5b6cf767f470 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.328606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95615174-3dd8-4608-9491-5b6cf767f470 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.339828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95615174-3dd8-4608-9491-5b6cf767f470 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.340299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95615174-3dd8-4608-9491-5b6cf767f470 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.340732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95615174-3dd8-4608-9491-5b6cf767f470 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.346303 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-95615174-3dd8-4608-9491-5b6cf767f470 tempest-HypervisorAdminUnderV252Test-351609434 tempest-HypervisorAdminUnderV252Test-351609434-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/n-h1-860282-1/search" status: 200 len: 104 microversion: 2.1 time: 0.023675 Oct 04 21:06:09.346854 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 74/158] 10.222.0.30 () {58 vars in 1209 bytes} [Tue Oct 4 21:06:09 2022] GET /compute/v2.1/os-hypervisors/n-h1-860282-1/search => generated 104 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:09.548481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9a6d7d68-73f5-4bd0-b6a4-ba9ed1d399f4 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:09.549111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9a6d7d68-73f5-4bd0-b6a4-ba9ed1d399f4 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:09.554964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a6d7d68-73f5-4bd0-b6a4-ba9ed1d399f4 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.555445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a6d7d68-73f5-4bd0-b6a4-ba9ed1d399f4 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.555875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a6d7d68-73f5-4bd0-b6a4-ba9ed1d399f4 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.556562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a6d7d68-73f5-4bd0-b6a4-ba9ed1d399f4 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.557012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a6d7d68-73f5-4bd0-b6a4-ba9ed1d399f4 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.557465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a6d7d68-73f5-4bd0-b6a4-ba9ed1d399f4 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.723736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9a6d7d68-73f5-4bd0-b6a4-ba9ed1d399f4 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:09.723736 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9a6d7d68-73f5-4bd0-b6a4-ba9ed1d399f4 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1339 microversion: 2.1 time: 0.159020 Oct 04 21:06:09.723736 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 75/159] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:09 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1339 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:10.085744 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b97b8fcb-f906-49e1-af28-2e1d23c826ff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.333151 Oct 04 21:06:10.086703 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 85/160] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:06:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 2335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:06:10.099017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1fb37e63-2a87-4322-aecc-b0e13c26dafc tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:10.099654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1fb37e63-2a87-4322-aecc-b0e13c26dafc tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:10.175648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1fb37e63-2a87-4322-aecc-b0e13c26dafc tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:10.189034 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1fb37e63-2a87-4322-aecc-b0e13c26dafc tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 200 len: 1263 microversion: 2.1 time: 0.094097 Oct 04 21:06:10.190034 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 76/161] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:10 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 1263 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:10.727422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-de19d672-8914-446d-9985-af0d83d44d7c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:10.728195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-de19d672-8914-446d-9985-af0d83d44d7c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:10.735138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de19d672-8914-446d-9985-af0d83d44d7c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:10.735670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de19d672-8914-446d-9985-af0d83d44d7c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:10.736316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de19d672-8914-446d-9985-af0d83d44d7c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:10.737018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de19d672-8914-446d-9985-af0d83d44d7c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:10.737534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de19d672-8914-446d-9985-af0d83d44d7c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:10.737996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de19d672-8914-446d-9985-af0d83d44d7c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:10.742738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=59 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:10.915964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-de19d672-8914-446d-9985-af0d83d44d7c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:10.934072 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-de19d672-8914-446d-9985-af0d83d44d7c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1339 microversion: 2.1 time: 0.209113 Oct 04 21:06:10.945965 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 86/162] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:10 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1339 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:11.409190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-22a700e2-3460-43b7-bd7e-eaf41bd97e0c req-297b9014-d9a7-4e46-8109-af62ff742c7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfe6aa09-8e1e-41d7-a431-c8bae79920b6", "name": "network-vif-plugged", "status": "completed", "tag": "446eb630-3699-4714-a25a-51c8dbda8c2a"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:11.423535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-22a700e2-3460-43b7-bd7e-eaf41bd97e0c req-297b9014-d9a7-4e46-8109-af62ff742c7a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:11.424354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-22a700e2-3460-43b7-bd7e-eaf41bd97e0c req-297b9014-d9a7-4e46-8109-af62ff742c7a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:11.425008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-22a700e2-3460-43b7-bd7e-eaf41bd97e0c req-297b9014-d9a7-4e46-8109-af62ff742c7a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:11.438148 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-22a700e2-3460-43b7-bd7e-eaf41bd97e0c req-297b9014-d9a7-4e46-8109-af62ff742c7a service nova] Creating event network-vif-plugged:446eb630-3699-4714-a25a-51c8dbda8c2a for instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 on n-h1-860282-1 Oct 04 21:06:11.443845 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-22a700e2-3460-43b7-bd7e-eaf41bd97e0c req-297b9014-d9a7-4e46-8109-af62ff742c7a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.378073 Oct 04 21:06:11.444838 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 77/163] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:11.452213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f6b0a101-bd8c-46d9-bd40-c01dd1efaf56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:11.453301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f6b0a101-bd8c-46d9-bd40-c01dd1efaf56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:11.552672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f6b0a101-bd8c-46d9-bd40-c01dd1efaf56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:11.559687 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f6b0a101-bd8c-46d9-bd40-c01dd1efaf56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 200 len: 1263 microversion: 2.1 time: 0.113416 Oct 04 21:06:11.561361 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 78/164] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:11 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 1263 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:11.581188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c8f7e5d8-4b44-4524-b9f0-1466992a5086 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Calling method '.version_select at 0x7f5790ef80d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:11.583690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8f7e5d8-4b44-4524-b9f0-1466992a5086 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:11.583690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8f7e5d8-4b44-4524-b9f0-1466992a5086 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:11.583886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8f7e5d8-4b44-4524-b9f0-1466992a5086 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:11.604692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8f7e5d8-4b44-4524-b9f0-1466992a5086 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:11.605396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8f7e5d8-4b44-4524-b9f0-1466992a5086 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:11.606046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8f7e5d8-4b44-4524-b9f0-1466992a5086 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:11.618163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8f7e5d8-4b44-4524-b9f0-1466992a5086 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:11.618953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8f7e5d8-4b44-4524-b9f0-1466992a5086 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:11.619579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8f7e5d8-4b44-4524-b9f0-1466992a5086 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:11.627891 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c8f7e5d8-4b44-4524-b9f0-1466992a5086 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.442865 Oct 04 21:06:11.629047 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 87/165] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:06:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:11.973991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa46898b-90fa-49e7-b039-581d6f139610 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:11.975848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aa46898b-90fa-49e7-b039-581d6f139610 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:11.984619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa46898b-90fa-49e7-b039-581d6f139610 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:11.985325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa46898b-90fa-49e7-b039-581d6f139610 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:11.985955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa46898b-90fa-49e7-b039-581d6f139610 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:11.986845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa46898b-90fa-49e7-b039-581d6f139610 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:11.987311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa46898b-90fa-49e7-b039-581d6f139610 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:11.987748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa46898b-90fa-49e7-b039-581d6f139610 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:12.113496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-16dce6c4-abf4-42f0-8a02-f2d7edf947f9 tempest-HypervisorAdminNegativeUnderV252Test-1663061253 tempest-HypervisorAdminNegativeUnderV252Test-1663061253-project] Calling method '.version_select at 0x7f5790fa70d0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:12.115586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-16dce6c4-abf4-42f0-8a02-f2d7edf947f9 tempest-HypervisorAdminNegativeUnderV252Test-1663061253 tempest-HypervisorAdminNegativeUnderV252Test-1663061253-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '2ed23cf20b7a4d458bd3f643d9c6f8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53283bc045742e7aa7b4b823974acc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-16dce6c4-abf4-42f0-8a02-f2d7edf947f9 tempest-HypervisorAdminNegativeUnderV252Test-1663061253 tempest-HypervisorAdminNegativeUnderV252Test-1663061253-project] Request method failure captured: Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-hypervisors/n-h1-860282-1/search HTTP/1.1 Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKA_iUnL4ZGVHQ5R6eIKmgnAF9_7pS3j4MhmV7WHi09FR51iL6v_K0ELWzhiPBEl4oowXPk9s9Cr2Ln9M3dClfqzRjBynkecwJzPMJCHE2RL6hUarsqkRvT4rVnnKRBUdJB_DT31BbqwMaEaYxLA1P8kMei-GHoJe8Jcth_R97KKWes Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: d53283bc045742e7aa7b4b823974acc9 Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1663061253 Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:06:12.117740 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:06:12.119230 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d53283bc045742e7aa7b4b823974acc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d53283bc045742e7aa7b4b823974acc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d53283bc045742e7aa7b4b823974acc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d53283bc045742e7aa7b4b823974acc9"}]}] Oct 04 21:06:12.119230 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1663061253 Oct 04 21:06:12.119230 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: d53283bc045742e7aa7b4b823974acc9 Oct 04 21:06:12.119230 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1663061253 Oct 04 21:06:12.119230 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1663061253-project Oct 04 21:06:12.119230 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:12.119230 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:12.119230 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 2ed23cf20b7a4d458bd3f643d9c6f8f2 Oct 04 21:06:12.119230 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1663061253-project Oct 04 21:06:12.119230 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:06:12.119230 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 21:06:12.119230 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'n-h1-860282-1'} Oct 04 21:06:12.119953 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:12.119953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:12.119953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:12.119953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:12.119953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:12.119953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:12.119953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:06:12.119953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:06:12.119953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:12.119953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:12.119953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 04 21:06:12.119953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 04 21:06:12.119953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:06:12.119953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:06:12.119953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:06:12.119953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:06:12.119953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:06:12.119953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:06:12.119953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:06:12.121110 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:06:12.121110 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:06:12.121110 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:06:12.121110 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:06:12.121110 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:06:12.121110 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:06:12.121110 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:06:12.121110 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 21:06:12.121110 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:12.121110 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:12.121110 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:12.121110 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:12.121110 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:12.121110 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:12.121110 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:06:12.121110 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:06:12.121110 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 21:06:12.121110 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:12.122221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-16dce6c4-abf4-42f0-8a02-f2d7edf947f9 tempest-HypervisorAdminNegativeUnderV252Test-1663061253 tempest-HypervisorAdminNegativeUnderV252Test-1663061253-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:12.122221 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-16dce6c4-abf4-42f0-8a02-f2d7edf947f9 tempest-HypervisorAdminNegativeUnderV252Test-1663061253 tempest-HypervisorAdminNegativeUnderV252Test-1663061253-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/n-h1-860282-1/search" status: 403 len: 117 microversion: 2.1 time: 0.484732 Oct 04 21:06:12.126435 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 79/166] 10.222.0.30 () {58 vars in 1209 bytes} [Tue Oct 4 21:06:11 2022] GET /compute/v2.1/os-hypervisors/n-h1-860282-1/search => generated 117 bytes in 491 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:06:12.131896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-42f5e90a-40c0-439e-bdb4-2ac034aae876 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Calling method '.version_select at 0x7f5790e8de50>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:12.133608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42f5e90a-40c0-439e-bdb4-2ac034aae876 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:12.134085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42f5e90a-40c0-439e-bdb4-2ac034aae876 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:12.134705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42f5e90a-40c0-439e-bdb4-2ac034aae876 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:12.142211 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-42f5e90a-40c0-439e-bdb4-2ac034aae876 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-42f5e90a-40c0-439e-bdb4-2ac034aae876 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Request method failure captured: Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKBDIGPu-A8X3vW-YidJBcXqrkti8AfvoHaPDxfhkEJmFazMhhtwsvTtPJlmxQqVhe5s17adKTnPwoq-X-rUOPxODU-pPMRK47rW014zwERD_g4PgxstayyiRN95mVe75NqNSs21Mw8OcP92zww64YwQIhxw8aVR71yv5AACLoiwqvg Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 8e89d34f2e86473099e2df83aa11fae4 Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1163501396 Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:06:12.148150 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:06:12.149412 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e89d34f2e86473099e2df83aa11fae4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8e89d34f2e86473099e2df83aa11fae4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8e89d34f2e86473099e2df83aa11fae4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e89d34f2e86473099e2df83aa11fae4"}]}] Oct 04 21:06:12.149412 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1163501396 Oct 04 21:06:12.149412 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 8e89d34f2e86473099e2df83aa11fae4 Oct 04 21:06:12.149412 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1163501396 Oct 04 21:06:12.149412 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin Oct 04 21:06:12.149412 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:12.149412 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:12.149412 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b685c84cf5344347a247db08aba29c8e Oct 04 21:06:12.149412 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin Oct 04 21:06:12.149412 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:06:12.149412 n-d-860282-1 devstack@n-api.service[122757]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 21:06:12.149412 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:12.150156 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:12.151232 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:12.151232 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:12.151232 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:12.151232 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 21:06:12.151232 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:12.151232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-42f5e90a-40c0-439e-bdb4-2ac034aae876 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:12.151232 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-42f5e90a-40c0-439e-bdb4-2ac034aae876 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.017495 Oct 04 21:06:12.151232 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 80/167] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Oct 4 21:06:12 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:06:12.151789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aa46898b-90fa-49e7-b039-581d6f139610 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:12.163368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6d826291-b396-4054-80cb-dc8b8342e44f tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Calling method '.version_select at 0x7f5790f14940>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:12.164730 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aa46898b-90fa-49e7-b039-581d6f139610 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1339 microversion: 2.1 time: 0.195270 Oct 04 21:06:12.165143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d826291-b396-4054-80cb-dc8b8342e44f tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:12.165656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d826291-b396-4054-80cb-dc8b8342e44f tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:12.166401 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 88/168] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:11 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1339 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:12.177874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d826291-b396-4054-80cb-dc8b8342e44f tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:12.192695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d826291-b396-4054-80cb-dc8b8342e44f tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:12.193191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d826291-b396-4054-80cb-dc8b8342e44f tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:12.193661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d826291-b396-4054-80cb-dc8b8342e44f tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:12.204404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d826291-b396-4054-80cb-dc8b8342e44f tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:12.204883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d826291-b396-4054-80cb-dc8b8342e44f tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:12.205325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d826291-b396-4054-80cb-dc8b8342e44f tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:12.211282 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6d826291-b396-4054-80cb-dc8b8342e44f tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.052341 Oct 04 21:06:12.211879 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 81/169] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:06:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:12.224059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b60d6b75-a410-485f-8265-a786f3de337f tempest-HypervisorAdminNegativeUnderV252Test-1663061253 tempest-HypervisorAdminNegativeUnderV252Test-1663061253-project] Calling method '.version_select at 0x7f5790ef8af0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:12.225930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b60d6b75-a410-485f-8265-a786f3de337f tempest-HypervisorAdminNegativeUnderV252Test-1663061253 tempest-HypervisorAdminNegativeUnderV252Test-1663061253-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '2ed23cf20b7a4d458bd3f643d9c6f8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53283bc045742e7aa7b4b823974acc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b60d6b75-a410-485f-8265-a786f3de337f tempest-HypervisorAdminNegativeUnderV252Test-1663061253 tempest-HypervisorAdminNegativeUnderV252Test-1663061253-project] Request method failure captured: Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKA_iUnL4ZGVHQ5R6eIKmgnAF9_7pS3j4MhmV7WHi09FR51iL6v_K0ELWzhiPBEl4oowXPk9s9Cr2Ln9M3dClfqzRjBynkecwJzPMJCHE2RL6hUarsqkRvT4rVnnKRBUdJB_DT31BbqwMaEaYxLA1P8kMei-GHoJe8Jcth_R97KKWes Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: d53283bc045742e7aa7b4b823974acc9 Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1663061253 Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:06:12.228014 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:06:12.229621 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d53283bc045742e7aa7b4b823974acc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d53283bc045742e7aa7b4b823974acc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d53283bc045742e7aa7b4b823974acc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d53283bc045742e7aa7b4b823974acc9"}]}] Oct 04 21:06:12.229621 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1663061253 Oct 04 21:06:12.229621 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: d53283bc045742e7aa7b4b823974acc9 Oct 04 21:06:12.229621 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1663061253 Oct 04 21:06:12.229621 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1663061253-project Oct 04 21:06:12.229621 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:06:12.229621 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:06:12.229621 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 2ed23cf20b7a4d458bd3f643d9c6f8f2 Oct 04 21:06:12.229621 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1663061253-project Oct 04 21:06:12.229621 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:06:12.229621 n-d-860282-1 devstack@n-api.service[122758]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 21:06:12.229621 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '1'} Oct 04 21:06:12.230404 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:12.230404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:12.230404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:12.230404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:12.230404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:12.230404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:12.230404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:06:12.230404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:06:12.230404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:12.230404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:12.230404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 04 21:06:12.230404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 04 21:06:12.230404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:06:12.230404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:06:12.230404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:06:12.230404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:06:12.230404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:06:12.230404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:06:12.230404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:06:12.231505 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:06:12.231505 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:06:12.231505 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:06:12.231505 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:06:12.231505 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:06:12.231505 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:06:12.231505 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:06:12.231505 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 21:06:12.231505 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:12.231505 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:12.231505 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:12.231505 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:12.231505 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:12.231505 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:12.231505 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:06:12.231505 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:06:12.231505 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 21:06:12.231505 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:12.232598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b60d6b75-a410-485f-8265-a786f3de337f tempest-HypervisorAdminNegativeUnderV252Test-1663061253 tempest-HypervisorAdminNegativeUnderV252Test-1663061253-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:12.232598 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b60d6b75-a410-485f-8265-a786f3de337f tempest-HypervisorAdminNegativeUnderV252Test-1663061253 tempest-HypervisorAdminNegativeUnderV252Test-1663061253-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.009145 Oct 04 21:06:12.234297 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 89/170] 10.222.0.30 () {58 vars in 1176 bytes} [Tue Oct 4 21:06:12 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:06:12.239214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d255f8e5-b284-402c-8c5f-c9c82e1b4788 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Calling method '.version_select at 0x7f5790f141f0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:12.240939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d255f8e5-b284-402c-8c5f-c9c82e1b4788 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:12.241444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d255f8e5-b284-402c-8c5f-c9c82e1b4788 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:12.241890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d255f8e5-b284-402c-8c5f-c9c82e1b4788 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:12.249119 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-d255f8e5-b284-402c-8c5f-c9c82e1b4788 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] HTTP exception thrown: No hypervisor matching 'f9d54e7b-c744-43ef-93d8-069aaf637f39' could be found. Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d255f8e5-b284-402c-8c5f-c9c82e1b4788 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Request method failure captured: Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-hypervisors/f9d54e7b-c744-43ef-93d8-069aaf637f39/servers HTTP/1.1 Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKBDIGPu-A8X3vW-YidJBcXqrkti8AfvoHaPDxfhkEJmFazMhhtwsvTtPJlmxQqVhe5s17adKTnPwoq-X-rUOPxODU-pPMRK47rW014zwERD_g4PgxstayyiRN95mVe75NqNSs21Mw8OcP92zww64YwQIhxw8aVR71yv5AACLoiwqvg Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 8e89d34f2e86473099e2df83aa11fae4 Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1163501396 Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:06:12.250350 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:06:12.252321 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e89d34f2e86473099e2df83aa11fae4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8e89d34f2e86473099e2df83aa11fae4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8e89d34f2e86473099e2df83aa11fae4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e89d34f2e86473099e2df83aa11fae4"}]}] Oct 04 21:06:12.252321 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1163501396 Oct 04 21:06:12.252321 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 8e89d34f2e86473099e2df83aa11fae4 Oct 04 21:06:12.252321 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1163501396 Oct 04 21:06:12.252321 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin Oct 04 21:06:12.252321 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:12.252321 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:12.252321 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b685c84cf5344347a247db08aba29c8e Oct 04 21:06:12.252321 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin Oct 04 21:06:12.252321 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:06:12.252321 n-d-860282-1 devstack@n-api.service[122757]: exception: No hypervisor matching 'f9d54e7b-c744-43ef-93d8-069aaf637f39' could be found. Oct 04 21:06:12.252321 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'f9d54e7b-c744-43ef-93d8-069aaf637f39'} Oct 04 21:06:12.254153 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:12.254153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:12.254153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:12.254153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:12.254153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:12.254153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:12.254153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:06:12.254153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:06:12.254153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:12.254153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:12.254153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 04 21:06:12.254153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 21:06:12.254153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 21:06:12.254153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:06:12.254153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'f9d54e7b-c744-43ef-93d8-069aaf637f39' could be found. Oct 04 21:06:12.254153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:12.254153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:12.254153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:12.254153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:12.255233 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:12.255233 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:12.255233 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:12.255233 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:12.255233 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'f9d54e7b-c744-43ef-93d8-069aaf637f39' could be found. Oct 04 21:06:12.255233 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:12.255233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d255f8e5-b284-402c-8c5f-c9c82e1b4788 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] Returning 404 to user: No hypervisor matching 'f9d54e7b-c744-43ef-93d8-069aaf637f39' could be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:12.255233 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d255f8e5-b284-402c-8c5f-c9c82e1b4788 tempest-HypervisorAdminNegativeUnderV252Test-1163501396 tempest-HypervisorAdminNegativeUnderV252Test-1163501396-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/f9d54e7b-c744-43ef-93d8-069aaf637f39/servers" status: 404 len: 123 microversion: 2.1 time: 0.015741 Oct 04 21:06:12.255233 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 82/171] 10.222.0.30 () {58 vars in 1281 bytes} [Tue Oct 4 21:06:12 2022] GET /compute/v2.1/os-hypervisors/f9d54e7b-c744-43ef-93d8-069aaf637f39/servers => generated 123 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:06:12.584221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-542a8d62-77ad-4ee7-bc41-c60bba10d0de tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:12.584850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-542a8d62-77ad-4ee7-bc41-c60bba10d0de tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:12.592307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-542a8d62-77ad-4ee7-bc41-c60bba10d0de tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:12.592800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-542a8d62-77ad-4ee7-bc41-c60bba10d0de tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:12.593298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-542a8d62-77ad-4ee7-bc41-c60bba10d0de tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:12.594012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-542a8d62-77ad-4ee7-bc41-c60bba10d0de tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:12.594494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-542a8d62-77ad-4ee7-bc41-c60bba10d0de tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:12.594917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-542a8d62-77ad-4ee7-bc41-c60bba10d0de tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:12.657235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-542a8d62-77ad-4ee7-bc41-c60bba10d0de tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:12.666157 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-542a8d62-77ad-4ee7-bc41-c60bba10d0de tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 200 len: 1315 microversion: 2.1 time: 0.085880 Oct 04 21:06:12.666727 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 90/172] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:12 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 1315 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:13.193773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fd3d2a2c-fe93-4422-a7f9-410a27ea5e78 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:13.194409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fd3d2a2c-fe93-4422-a7f9-410a27ea5e78 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:13.207343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:13.211382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd3d2a2c-fe93-4422-a7f9-410a27ea5e78 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:13.212133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd3d2a2c-fe93-4422-a7f9-410a27ea5e78 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:13.216527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd3d2a2c-fe93-4422-a7f9-410a27ea5e78 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:13.216527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd3d2a2c-fe93-4422-a7f9-410a27ea5e78 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:13.216527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd3d2a2c-fe93-4422-a7f9-410a27ea5e78 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:13.216527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd3d2a2c-fe93-4422-a7f9-410a27ea5e78 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:13.436371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fd3d2a2c-fe93-4422-a7f9-410a27ea5e78 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:13.444221 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fd3d2a2c-fe93-4422-a7f9-410a27ea5e78 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1339 microversion: 2.1 time: 0.257603 Oct 04 21:06:13.447172 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 83/173] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:13 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1339 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:13.691598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ea17fbd6-1997-419d-b969-9f99a8c5b34d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:13.693211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ea17fbd6-1997-419d-b969-9f99a8c5b34d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:13.705873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea17fbd6-1997-419d-b969-9f99a8c5b34d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:13.706608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea17fbd6-1997-419d-b969-9f99a8c5b34d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:13.707373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea17fbd6-1997-419d-b969-9f99a8c5b34d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:13.708477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea17fbd6-1997-419d-b969-9f99a8c5b34d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:13.709133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea17fbd6-1997-419d-b969-9f99a8c5b34d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:13.709852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea17fbd6-1997-419d-b969-9f99a8c5b34d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:13.791680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ea17fbd6-1997-419d-b969-9f99a8c5b34d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:13.801165 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ea17fbd6-1997-419d-b969-9f99a8c5b34d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 200 len: 1333 microversion: 2.1 time: 0.112403 Oct 04 21:06:13.820187 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 91/174] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:13 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 1333 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:14.476431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a20249da-4c51-496a-a8c3-00609471c6db tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:14.477311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a20249da-4c51-496a-a8c3-00609471c6db tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:14.493639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a20249da-4c51-496a-a8c3-00609471c6db tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:14.494452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a20249da-4c51-496a-a8c3-00609471c6db tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:14.495235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a20249da-4c51-496a-a8c3-00609471c6db tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:14.496553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a20249da-4c51-496a-a8c3-00609471c6db tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:14.497215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a20249da-4c51-496a-a8c3-00609471c6db tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:14.498498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a20249da-4c51-496a-a8c3-00609471c6db tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:14.848079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a20249da-4c51-496a-a8c3-00609471c6db tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:14.853066 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a20249da-4c51-496a-a8c3-00609471c6db tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1489 microversion: 2.1 time: 0.384220 Oct 04 21:06:14.859717 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 84/175] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:14 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1489 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:14.864659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8007b25a-3e74-40b9-9150-cf14c83d298b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:14.871221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8007b25a-3e74-40b9-9150-cf14c83d298b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:14.880867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8007b25a-3e74-40b9-9150-cf14c83d298b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:14.881473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8007b25a-3e74-40b9-9150-cf14c83d298b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:14.881830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8007b25a-3e74-40b9-9150-cf14c83d298b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:14.882539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8007b25a-3e74-40b9-9150-cf14c83d298b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:14.883005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8007b25a-3e74-40b9-9150-cf14c83d298b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:14.883436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8007b25a-3e74-40b9-9150-cf14c83d298b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:14.991398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8007b25a-3e74-40b9-9150-cf14c83d298b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:15.001828 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8007b25a-3e74-40b9-9150-cf14c83d298b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 200 len: 1321 microversion: 2.1 time: 0.140723 Oct 04 21:06:15.003302 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 85/176] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:14 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 1321 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:15.017704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-abaae771-f8a4-436e-8c8a-b99f089595f7 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:15.019405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-abaae771-f8a4-436e-8c8a-b99f089595f7 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:15.032896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abaae771-f8a4-436e-8c8a-b99f089595f7 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:15.036753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abaae771-f8a4-436e-8c8a-b99f089595f7 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:15.037918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abaae771-f8a4-436e-8c8a-b99f089595f7 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:15.038898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abaae771-f8a4-436e-8c8a-b99f089595f7 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:15.041255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abaae771-f8a4-436e-8c8a-b99f089595f7 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:15.043629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abaae771-f8a4-436e-8c8a-b99f089595f7 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:15.179455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-219823ad-4c48-4383-8bf6-9ca24cc45f53 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Calling method '.version_select at 0x7f5790de3280>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:15.183885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-219823ad-4c48-4383-8bf6-9ca24cc45f53 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:15.188668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-219823ad-4c48-4383-8bf6-9ca24cc45f53 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:15.188668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-219823ad-4c48-4383-8bf6-9ca24cc45f53 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:15.188668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-219823ad-4c48-4383-8bf6-9ca24cc45f53 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:15.188668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-219823ad-4c48-4383-8bf6-9ca24cc45f53 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:15.189155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-219823ad-4c48-4383-8bf6-9ca24cc45f53 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:15.225165 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-219823ad-4c48-4383-8bf6-9ca24cc45f53 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.682231 Oct 04 21:06:15.226445 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 92/177] 10.222.0.30 () {58 vars in 1128 bytes} [Tue Oct 4 21:06:14 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:15.248430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-82c8e8cf-9394-488c-960b-0a9bfa9f8018 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Calling method '.version_select at 0x7f5790ed5f70>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:15.252428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82c8e8cf-9394-488c-960b-0a9bfa9f8018 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:15.253336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82c8e8cf-9394-488c-960b-0a9bfa9f8018 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:15.254316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82c8e8cf-9394-488c-960b-0a9bfa9f8018 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:15.255571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82c8e8cf-9394-488c-960b-0a9bfa9f8018 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:15.256294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82c8e8cf-9394-488c-960b-0a9bfa9f8018 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:15.256907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82c8e8cf-9394-488c-960b-0a9bfa9f8018 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:15.295902 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-82c8e8cf-9394-488c-960b-0a9bfa9f8018 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.060684 Oct 04 21:06:15.296972 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 93/178] 10.222.0.30 () {58 vars in 1139 bytes} [Tue Oct 4 21:06:15 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:15.311839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-35678241-837a-4d86-aac8-dd636906a4dc tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Calling method '.version_select at 0x7f5790ed5e50>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:15.316308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35678241-837a-4d86-aac8-dd636906a4dc tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:15.317290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35678241-837a-4d86-aac8-dd636906a4dc tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:15.317992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35678241-837a-4d86-aac8-dd636906a4dc tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:15.319160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35678241-837a-4d86-aac8-dd636906a4dc tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:15.319835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35678241-837a-4d86-aac8-dd636906a4dc tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:15.320269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35678241-837a-4d86-aac8-dd636906a4dc tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:15.360771 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-35678241-837a-4d86-aac8-dd636906a4dc tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.056347 Oct 04 21:06:15.361608 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 94/179] 10.222.0.30 () {58 vars in 1145 bytes} [Tue Oct 4 21:06:15 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:06:15.750823 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-abaae771-f8a4-436e-8c8a-b99f089595f7 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1640 microversion: 2.1 time: 0.745132 Oct 04 21:06:15.752354 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 86/180] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:15 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1640 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:15.780093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-92099678-65b5-4d39-aadc-e29eee3e3f8d tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:15.780609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-92099678-65b5-4d39-aadc-e29eee3e3f8d tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:15.796145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92099678-65b5-4d39-aadc-e29eee3e3f8d tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:15.796640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92099678-65b5-4d39-aadc-e29eee3e3f8d tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:15.797080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92099678-65b5-4d39-aadc-e29eee3e3f8d tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:15.797815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92099678-65b5-4d39-aadc-e29eee3e3f8d tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:15.798427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92099678-65b5-4d39-aadc-e29eee3e3f8d tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:15.803523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92099678-65b5-4d39-aadc-e29eee3e3f8d tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:15.830995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-92099678-65b5-4d39-aadc-e29eee3e3f8d tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:06:16.025850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4c32b394-b87e-4f35-b712-f22a3f91ce56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:16.026776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4c32b394-b87e-4f35-b712-f22a3f91ce56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:16.031545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:16.038415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c32b394-b87e-4f35-b712-f22a3f91ce56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:16.043128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c32b394-b87e-4f35-b712-f22a3f91ce56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:16.043456 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c32b394-b87e-4f35-b712-f22a3f91ce56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:16.044421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c32b394-b87e-4f35-b712-f22a3f91ce56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:16.045697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c32b394-b87e-4f35-b712-f22a3f91ce56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:16.048406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c32b394-b87e-4f35-b712-f22a3f91ce56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:16.288718 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-92099678-65b5-4d39-aadc-e29eee3e3f8d tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 204 len: 0 microversion: 2.1 time: 0.516947 Oct 04 21:06:16.289743 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 95/181] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:06:15 2022] DELETE /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:06:16.300437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1596b959-8024-43e7-87d0-2b6a2adde958 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:16.301399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1596b959-8024-43e7-87d0-2b6a2adde958 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:16.323549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1596b959-8024-43e7-87d0-2b6a2adde958 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:16.325208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1596b959-8024-43e7-87d0-2b6a2adde958 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:16.327644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1596b959-8024-43e7-87d0-2b6a2adde958 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:16.330193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1596b959-8024-43e7-87d0-2b6a2adde958 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:16.330976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1596b959-8024-43e7-87d0-2b6a2adde958 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:16.332739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1596b959-8024-43e7-87d0-2b6a2adde958 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:16.380593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4c32b394-b87e-4f35-b712-f22a3f91ce56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:16.392544 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4c32b394-b87e-4f35-b712-f22a3f91ce56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 200 len: 1388 microversion: 2.1 time: 0.370092 Oct 04 21:06:16.394700 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 87/182] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:16 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 1388 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:16.619681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1596b959-8024-43e7-87d0-2b6a2adde958 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:16.631619 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1596b959-8024-43e7-87d0-2b6a2adde958 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1495 microversion: 2.1 time: 0.336675 Oct 04 21:06:16.649682 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 96/183] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:16 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1495 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:17.299058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e00db596-4f48-4479-b212-7eb1d1786e59 tempest-NetworksTest-1569759936 tempest-NetworksTest-1569759936-project-admin] Calling method '.version_select at 0x7f5790e8d040>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:17.417074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-58e6c692-d1d9-4639-805d-40ed026ddfbd tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:17.419035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-58e6c692-d1d9-4639-805d-40ed026ddfbd tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:17.445469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58e6c692-d1d9-4639-805d-40ed026ddfbd tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:17.445469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58e6c692-d1d9-4639-805d-40ed026ddfbd tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:17.445469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58e6c692-d1d9-4639-805d-40ed026ddfbd tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:17.448966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58e6c692-d1d9-4639-805d-40ed026ddfbd tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:17.450060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58e6c692-d1d9-4639-805d-40ed026ddfbd tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:17.451120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58e6c692-d1d9-4639-805d-40ed026ddfbd tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:17.510588 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e00db596-4f48-4479-b212-7eb1d1786e59 tempest-NetworksTest-1569759936 tempest-NetworksTest-1569759936-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks" status: 200 len: 4700 microversion: 2.1 time: 0.645386 Oct 04 21:06:17.510588 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 88/184] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:06:16 2022] GET /compute/v2.1/os-networks => generated 4700 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:17.522819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-94f401eb-8586-48fa-b8f0-a4b56797825c tempest-NetworksTest-1569759936 tempest-NetworksTest-1569759936-project-admin] Calling method '.version_select at 0x7f5790e8ddc0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:18.073351 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-94f401eb-8586-48fa-b8f0-a4b56797825c tempest-NetworksTest-1569759936 tempest-NetworksTest-1569759936-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks/ebedf1d9-7fee-45d5-b9f8-18ec236ab757" status: 200 len: 652 microversion: 2.1 time: 0.557125 Oct 04 21:06:18.074048 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 89/185] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Oct 4 21:06:17 2022] GET /compute/v2.1/os-networks/ebedf1d9-7fee-45d5-b9f8-18ec236ab757 => generated 652 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:18.085331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ac22560b-2eca-4515-9916-b4d5537fda8c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:18.087023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ac22560b-2eca-4515-9916-b4d5537fda8c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:18.096471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac22560b-2eca-4515-9916-b4d5537fda8c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:18.097224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac22560b-2eca-4515-9916-b4d5537fda8c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:18.097915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac22560b-2eca-4515-9916-b4d5537fda8c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:18.099044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac22560b-2eca-4515-9916-b4d5537fda8c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:18.102657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac22560b-2eca-4515-9916-b4d5537fda8c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:18.104120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac22560b-2eca-4515-9916-b4d5537fda8c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:18.143354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-58e6c692-d1d9-4639-805d-40ed026ddfbd tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:18.155690 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-58e6c692-d1d9-4639-805d-40ed026ddfbd tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 200 len: 1388 microversion: 2.1 time: 0.743340 Oct 04 21:06:18.174772 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 97/186] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:17 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 1388 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:18.195090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9aa35843-5e23-48f0-bdd9-1a31a7a6f505 tempest-NetworksTest-1569759936 tempest-NetworksTest-1569759936-project-admin] Calling method '.version_select at 0x7f5791a73dc0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:18.934684 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9aa35843-5e23-48f0-bdd9-1a31a7a6f505 tempest-NetworksTest-1569759936 tempest-NetworksTest-1569759936-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks" status: 200 len: 4700 microversion: 2.1 time: 0.758683 Oct 04 21:06:18.936213 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 98/187] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:06:18 2022] GET /compute/v2.1/os-networks => generated 4700 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:19.015893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ac22560b-2eca-4515-9916-b4d5537fda8c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:19.035879 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ac22560b-2eca-4515-9916-b4d5537fda8c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1495 microversion: 2.1 time: 0.956672 Oct 04 21:06:19.041841 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 90/188] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:18 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1495 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:19.183889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-72347462-2e9f-42c8-8cf1-69b03386e3a0 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:19.184779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-72347462-2e9f-42c8-8cf1-69b03386e3a0 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:19.196545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-72347462-2e9f-42c8-8cf1-69b03386e3a0 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:19.196545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-72347462-2e9f-42c8-8cf1-69b03386e3a0 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:19.196545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-72347462-2e9f-42c8-8cf1-69b03386e3a0 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:19.199321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-72347462-2e9f-42c8-8cf1-69b03386e3a0 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:19.203308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-72347462-2e9f-42c8-8cf1-69b03386e3a0 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:19.203996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-72347462-2e9f-42c8-8cf1-69b03386e3a0 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:19.240406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=18 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:19.760407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-72347462-2e9f-42c8-8cf1-69b03386e3a0 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:19.786665 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-72347462-2e9f-42c8-8cf1-69b03386e3a0 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 200 len: 1388 microversion: 2.1 time: 0.607172 Oct 04 21:06:19.790401 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 99/189] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:19 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 1388 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:19.938736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-3d34f260-421b-4c69-866b-4b90fa1fe55c req-42d431c1-b4b6-4de6-9035-c1c9786bdc9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfe6aa09-8e1e-41d7-a431-c8bae79920b6", "name": "network-vif-deleted", "tag": "446eb630-3699-4714-a25a-51c8dbda8c2a"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:19.959241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3d34f260-421b-4c69-866b-4b90fa1fe55c req-42d431c1-b4b6-4de6-9035-c1c9786bdc9c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:19.960900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3d34f260-421b-4c69-866b-4b90fa1fe55c req-42d431c1-b4b6-4de6-9035-c1c9786bdc9c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:19.961882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3d34f260-421b-4c69-866b-4b90fa1fe55c req-42d431c1-b4b6-4de6-9035-c1c9786bdc9c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:19.998658 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-3d34f260-421b-4c69-866b-4b90fa1fe55c req-42d431c1-b4b6-4de6-9035-c1c9786bdc9c service nova] Creating event network-vif-deleted:446eb630-3699-4714-a25a-51c8dbda8c2a for instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 on n-h1-860282-1 Oct 04 21:06:20.014671 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-3d34f260-421b-4c69-866b-4b90fa1fe55c req-42d431c1-b4b6-4de6-9035-c1c9786bdc9c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080057 Oct 04 21:06:20.017196 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 91/190] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:20.064668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4b52f4b5-7501-417a-bb89-f4671c31934c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:20.066147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4b52f4b5-7501-417a-bb89-f4671c31934c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:20.083651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b52f4b5-7501-417a-bb89-f4671c31934c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:20.091165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b52f4b5-7501-417a-bb89-f4671c31934c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:20.091165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b52f4b5-7501-417a-bb89-f4671c31934c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:20.091165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b52f4b5-7501-417a-bb89-f4671c31934c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:20.091165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b52f4b5-7501-417a-bb89-f4671c31934c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:20.092166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b52f4b5-7501-417a-bb89-f4671c31934c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:20.265564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4b52f4b5-7501-417a-bb89-f4671c31934c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b79e298c90a46938431774ea19b61b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9419b86a729649c0aba5c047b5665f4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:20.276951 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4b52f4b5-7501-417a-bb89-f4671c31934c tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 200 len: 1324 microversion: 2.1 time: 0.217984 Oct 04 21:06:20.277999 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 100/191] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:20 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 1324 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:20.686919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d07ce902-3820-46ed-990c-f1d891013ebb tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1748167247", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:20.774958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-d07ce902-3820-46ed-990c-f1d891013ebb tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] validate_networks() for None {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:06:20.823768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-102a440f-cbb9-4ba1-9071-6b613e407317 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:20.828602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-102a440f-cbb9-4ba1-9071-6b613e407317 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:20.835228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-102a440f-cbb9-4ba1-9071-6b613e407317 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:20.836360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-102a440f-cbb9-4ba1-9071-6b613e407317 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:20.836677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-102a440f-cbb9-4ba1-9071-6b613e407317 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:20.838129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-102a440f-cbb9-4ba1-9071-6b613e407317 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:20.839415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-102a440f-cbb9-4ba1-9071-6b613e407317 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:20.840001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-102a440f-cbb9-4ba1-9071-6b613e407317 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:21.557789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:21.627488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-102a440f-cbb9-4ba1-9071-6b613e407317 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:21.635416 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-102a440f-cbb9-4ba1-9071-6b613e407317 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 200 len: 1388 microversion: 2.1 time: 0.817821 Oct 04 21:06:21.636005 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 101/192] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:20 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 1388 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:21.654536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d0203dde-507e-42de-8c50-5f51374b3feb tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:21.655417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d0203dde-507e-42de-8c50-5f51374b3feb tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:21.661373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0203dde-507e-42de-8c50-5f51374b3feb tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:21.661908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0203dde-507e-42de-8c50-5f51374b3feb tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:21.662348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0203dde-507e-42de-8c50-5f51374b3feb tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:21.663056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0203dde-507e-42de-8c50-5f51374b3feb tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:21.663518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0203dde-507e-42de-8c50-5f51374b3feb tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:21.663941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0203dde-507e-42de-8c50-5f51374b3feb tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:21.691428 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-d0203dde-507e-42de-8c50-5f51374b3feb tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] HTTP exception thrown: Instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 could not be found. Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d0203dde-507e-42de-8c50-5f51374b3feb tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Request method failure captured: Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 HTTP/1.1 Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKAf7ZnzIlzgbjMCt8QK5jC6ZP6rGbofjZ9Gq53xD31sZUVSksZDiHU1VYf2fnuo0iDKj0vT0nrSUBEEAEyNQns4LBTe-BDsd_93PSovBcLvNLRJZuc6X-KBYl7daDhK0w_jMp7Okp5AlncrQ-srk5gmPgkDLftl3T_ni2KcaWwFf8k Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 9419b86a729649c0aba5c047b5665f4c Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AggregatesAdminTestJSON-231602032 Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:06:21.693446 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:06:21.694903 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9419b86a729649c0aba5c047b5665f4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9419b86a729649c0aba5c047b5665f4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9419b86a729649c0aba5c047b5665f4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9419b86a729649c0aba5c047b5665f4c"}]}] Oct 04 21:06:21.694903 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AggregatesAdminTestJSON-231602032 Oct 04 21:06:21.694903 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 9419b86a729649c0aba5c047b5665f4c Oct 04 21:06:21.694903 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-231602032 Oct 04 21:06:21.694903 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AggregatesAdminTestJSON-231602032-project Oct 04 21:06:21.694903 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:06:21.694903 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:06:21.694903 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 5b79e298c90a46938431774ea19b61b8 Oct 04 21:06:21.694903 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AggregatesAdminTestJSON-231602032-project Oct 04 21:06:21.694903 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:06:21.694903 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 could not be found. Oct 04 21:06:21.694903 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'cfe6aa09-8e1e-41d7-a431-c8bae79920b6'} Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 could not be found. Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:21.695757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:21.697080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:21.697080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:06:21.697080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:06:21.697080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:06:21.697080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:06:21.697080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:06:21.697080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:06:21.697080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 could not be found. Oct 04 21:06:21.697080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:21.697080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:21.697080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:21.697080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:21.697080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:21.697080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:21.697080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:21.697080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:21.697080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 could not be found. Oct 04 21:06:21.697080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:21.698987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d0203dde-507e-42de-8c50-5f51374b3feb tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Returning 404 to user: Instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:21.700013 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d0203dde-507e-42de-8c50-5f51374b3feb tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 404 len: 111 microversion: 2.1 time: 0.049425 Oct 04 21:06:21.700778 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 102/193] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:21 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:06:21.714395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b348a50b-3bfd-4777-8ec7-59cab9d9d9e2 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860282-1"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:21.726781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b348a50b-3bfd-4777-8ec7-59cab9d9d9e2 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:21.727279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b348a50b-3bfd-4777-8ec7-59cab9d9d9e2 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:21.727721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b348a50b-3bfd-4777-8ec7-59cab9d9d9e2 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:21.793888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-d07ce902-3820-46ed-990c-f1d891013ebb tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:06:21.795599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-d07ce902-3820-46ed-990c-f1d891013ebb tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:06:21.796514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-d07ce902-3820-46ed-990c-f1d891013ebb tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:06:21.797868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-d07ce902-3820-46ed-990c-f1d891013ebb tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:06:21.798759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-d07ce902-3820-46ed-990c-f1d891013ebb tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:06:21.860374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d07ce902-3820-46ed-990c-f1d891013ebb tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:21.860939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d07ce902-3820-46ed-990c-f1d891013ebb tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:21.861490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d07ce902-3820-46ed-990c-f1d891013ebb tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:21.862294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d07ce902-3820-46ed-990c-f1d891013ebb tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:21.862806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d07ce902-3820-46ed-990c-f1d891013ebb tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:21.863301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d07ce902-3820-46ed-990c-f1d891013ebb tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:21.931492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-d07ce902-3820-46ed-990c-f1d891013ebb tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Getting quotas for project 6d56154e7fa646268a5c726e278c010e. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:06:21.947195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-d07ce902-3820-46ed-990c-f1d891013ebb tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Getting quotas for user 4454733cee334f368ee2048c3a32d7f0 and project 6d56154e7fa646268a5c726e278c010e. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:06:21.981519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d07ce902-3820-46ed-990c-f1d891013ebb tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:06:21.987110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d07ce902-3820-46ed-990c-f1d891013ebb tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:06:22.048880 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b348a50b-3bfd-4777-8ec7-59cab9d9d9e2 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.1 time: 0.338072 Oct 04 21:06:22.057884 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 103/194] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Oct 4 21:06:21 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:22.164852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-5f818467-104a-4f7a-9c11-c6069267d824 req-f39ef98d-6ea0-4617-893e-44647661a36b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7555a913-21ac-440f-8323-ca961a6d08d7", "tag": "ca0fba7b-2727-4db4-adba-b3f7120588e6"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:22.204161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5f818467-104a-4f7a-9c11-c6069267d824 req-f39ef98d-6ea0-4617-893e-44647661a36b service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:22.207390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5f818467-104a-4f7a-9c11-c6069267d824 req-f39ef98d-6ea0-4617-893e-44647661a36b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:22.207879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5f818467-104a-4f7a-9c11-c6069267d824 req-f39ef98d-6ea0-4617-893e-44647661a36b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:22.218771 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d07ce902-3820-46ed-990c-f1d891013ebb tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.755083 Oct 04 21:06:22.228984 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 92/195] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:06:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:06:22.244133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e51c1c91-4097-4af4-872c-e99f98691c4b tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:22.287893 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-5f818467-104a-4f7a-9c11-c6069267d824 req-f39ef98d-6ea0-4617-893e-44647661a36b service nova] Creating event network-changed:ca0fba7b-2727-4db4-adba-b3f7120588e6 for instance 7555a913-21ac-440f-8323-ca961a6d08d7 on n-h2-860282-1 Oct 04 21:06:22.314438 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-5f818467-104a-4f7a-9c11-c6069267d824 req-f39ef98d-6ea0-4617-893e-44647661a36b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256471 Oct 04 21:06:22.317716 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 104/196] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:22.329446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5dd222b4-7d53-427e-b8ba-075c63b914f9 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:22.331360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5dd222b4-7d53-427e-b8ba-075c63b914f9 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:22.380417 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e51c1c91-4097-4af4-872c-e99f98691c4b tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.149107 Oct 04 21:06:22.388358 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 93/197] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:06:22 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:06:22.401238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8365be34-9e6d-4ae0-87c9-4fdcf20b5059 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1749519610"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:22.412113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.aggregate [None req-8365be34-9e6d-4ae0-87c9-4fdcf20b5059 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Generated uuid fa214c3e-4f44-453d-80b8-4e3353bbdf4c for aggregate {{(pid=122757) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:06:22.536106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5dd222b4-7d53-427e-b8ba-075c63b914f9 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:22.554434 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8365be34-9e6d-4ae0-87c9-4fdcf20b5059 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.158951 Oct 04 21:06:22.555410 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 94/198] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Oct 4 21:06:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:22.563876 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5dd222b4-7d53-427e-b8ba-075c63b914f9 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 200 len: 1219 microversion: 2.1 time: 0.238082 Oct 04 21:06:22.577454 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 105/199] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:22 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 1219 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:22.578551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9593ed5f-cef2-4ff0-bbce-1f57152ae115 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860282-1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:22.601714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9593ed5f-cef2-4ff0-bbce-1f57152ae115 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:22.601714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9593ed5f-cef2-4ff0-bbce-1f57152ae115 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:22.601714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9593ed5f-cef2-4ff0-bbce-1f57152ae115 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:22.661403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e6f67998-fbb1-43b2-9288-0631b5efcdff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:22.662176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e6f67998-fbb1-43b2-9288-0631b5efcdff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:22.675508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6f67998-fbb1-43b2-9288-0631b5efcdff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:22.676307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6f67998-fbb1-43b2-9288-0631b5efcdff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:22.676812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6f67998-fbb1-43b2-9288-0631b5efcdff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:22.678905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6f67998-fbb1-43b2-9288-0631b5efcdff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:22.678905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6f67998-fbb1-43b2-9288-0631b5efcdff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:22.678905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6f67998-fbb1-43b2-9288-0631b5efcdff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:23.095985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e6f67998-fbb1-43b2-9288-0631b5efcdff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:23.105749 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e6f67998-fbb1-43b2-9288-0631b5efcdff tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 200 len: 1388 microversion: 2.1 time: 0.448248 Oct 04 21:06:23.106791 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 106/200] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:22 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 1388 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:23.573743 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9593ed5f-cef2-4ff0-bbce-1f57152ae115 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 1.008632 Oct 04 21:06:23.574344 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 95/201] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Oct 4 21:06:22 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:23.588283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7169af2c-f6b6-4871-baa9-e0d290085bf8 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:23.593750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9630f9d7-2a58-4d54-ac81-98206531c525 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:23.594446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9630f9d7-2a58-4d54-ac81-98206531c525 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:23.611886 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7169af2c-f6b6-4871-baa9-e0d290085bf8 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.027038 Oct 04 21:06:23.617047 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 107/202] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Oct 4 21:06:23 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:23.628011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9fe8f664-5a4f-4363-9d37-a79c0ce8d0d3 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860282-1"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:23.651695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9fe8f664-5a4f-4363-9d37-a79c0ce8d0d3 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:23.652342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9fe8f664-5a4f-4363-9d37-a79c0ce8d0d3 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:23.657749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9fe8f664-5a4f-4363-9d37-a79c0ce8d0d3 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:23.685396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:23.809624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9630f9d7-2a58-4d54-ac81-98206531c525 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:23.824697 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9630f9d7-2a58-4d54-ac81-98206531c525 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 200 len: 1219 microversion: 2.1 time: 0.235506 Oct 04 21:06:23.826090 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 96/203] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:23 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 1219 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:23.990633 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9fe8f664-5a4f-4363-9d37-a79c0ce8d0d3 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.369937 Oct 04 21:06:23.997137 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 108/204] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Oct 4 21:06:23 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:24.010189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9857e3a0-6da6-49df-acae-0f82a516f6da tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:24.131896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-02a98814-8303-422c-a1f0-179128e85417 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:24.132519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-02a98814-8303-422c-a1f0-179128e85417 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:24.145523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02a98814-8303-422c-a1f0-179128e85417 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.145523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02a98814-8303-422c-a1f0-179128e85417 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.145523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02a98814-8303-422c-a1f0-179128e85417 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.145523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02a98814-8303-422c-a1f0-179128e85417 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.146525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02a98814-8303-422c-a1f0-179128e85417 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.146525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02a98814-8303-422c-a1f0-179128e85417 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.149372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:24.229643 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9857e3a0-6da6-49df-acae-0f82a516f6da tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.229314 Oct 04 21:06:24.240729 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 97/205] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:06:23 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:06:24.275977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2a04e937-4a2f-45f8-a6dd-d972ef3bc559 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Calling method '.version_select at 0x7f5790f1b820>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:24.281382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a04e937-4a2f-45f8-a6dd-d972ef3bc559 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.281996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a04e937-4a2f-45f8-a6dd-d972ef3bc559 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.282454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a04e937-4a2f-45f8-a6dd-d972ef3bc559 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.283208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a04e937-4a2f-45f8-a6dd-d972ef3bc559 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.283670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a04e937-4a2f-45f8-a6dd-d972ef3bc559 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.284099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a04e937-4a2f-45f8-a6dd-d972ef3bc559 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.318771 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2a04e937-4a2f-45f8-a6dd-d972ef3bc559 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.076496 Oct 04 21:06:24.319376 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 98/206] 10.222.0.30 () {58 vars in 1128 bytes} [Tue Oct 4 21:06:24 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:24.336865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e55defa6-f987-47b0-baef-0247419de4c9 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Calling method '.version_select at 0x7f5790f14c10>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:24.339037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e55defa6-f987-47b0-baef-0247419de4c9 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.342726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e55defa6-f987-47b0-baef-0247419de4c9 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.343250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e55defa6-f987-47b0-baef-0247419de4c9 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.344934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e55defa6-f987-47b0-baef-0247419de4c9 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.345399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e55defa6-f987-47b0-baef-0247419de4c9 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.345860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e55defa6-f987-47b0-baef-0247419de4c9 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.374496 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e55defa6-f987-47b0-baef-0247419de4c9 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.043673 Oct 04 21:06:24.375405 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 99/207] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Oct 4 21:06:24 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:24.387918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4c3c6c14-244f-45ef-b3cc-41fc713a69a5 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Calling method '.version_select at 0x7f5790e8d8b0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:24.417212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c3c6c14-244f-45ef-b3cc-41fc713a69a5 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.424537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c3c6c14-244f-45ef-b3cc-41fc713a69a5 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.426042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c3c6c14-244f-45ef-b3cc-41fc713a69a5 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.429315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c3c6c14-244f-45ef-b3cc-41fc713a69a5 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.430192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c3c6c14-244f-45ef-b3cc-41fc713a69a5 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.430741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c3c6c14-244f-45ef-b3cc-41fc713a69a5 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.474170 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4c3c6c14-244f-45ef-b3cc-41fc713a69a5 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.090025 Oct 04 21:06:24.481079 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 100/208] 10.222.0.30 () {58 vars in 1128 bytes} [Tue Oct 4 21:06:24 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:24.488118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-52791681-b4f5-4b13-a226-735de4eb58b4 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1850462543"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:24.491735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.aggregate [None req-52791681-b4f5-4b13-a226-735de4eb58b4 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Generated uuid f7d95ca8-70fd-4b51-87f4-bdee7eb5755b for aggregate {{(pid=122757) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:06:24.588503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-02a98814-8303-422c-a1f0-179128e85417 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:24.615251 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-02a98814-8303-422c-a1f0-179128e85417 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 200 len: 1388 microversion: 2.1 time: 0.487157 Oct 04 21:06:24.617099 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 109/209] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:24 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 1388 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:24.626829 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-52791681-b4f5-4b13-a226-735de4eb58b4 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.147531 Oct 04 21:06:24.628239 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 101/210] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Oct 4 21:06:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:24.649488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fa908a45-cb45-47a2-99bf-207308956748 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860282-1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:24.658554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-65dad300-95aa-4000-889a-3b88a1d289f7 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Calling method '.version_select at 0x7f5790de30d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:24.689529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa908a45-cb45-47a2-99bf-207308956748 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.690426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65dad300-95aa-4000-889a-3b88a1d289f7 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.690948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65dad300-95aa-4000-889a-3b88a1d289f7 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.691398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65dad300-95aa-4000-889a-3b88a1d289f7 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.691624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa908a45-cb45-47a2-99bf-207308956748 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.692318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa908a45-cb45-47a2-99bf-207308956748 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.721040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65dad300-95aa-4000-889a-3b88a1d289f7 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.721591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65dad300-95aa-4000-889a-3b88a1d289f7 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.722039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65dad300-95aa-4000-889a-3b88a1d289f7 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.757868 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-65dad300-95aa-4000-889a-3b88a1d289f7 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/n-h1-860282-1" status: 200 len: 332 microversion: 2.1 time: 0.139127 Oct 04 21:06:24.758835 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 110/211] 10.222.0.30 () {58 vars in 1170 bytes} [Tue Oct 4 21:06:24 2022] GET /compute/v2.1/os-hosts/n-h1-860282-1 => generated 332 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:24.771633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-57dbb807-876f-442b-8085-80e8f4b3aca0 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Calling method '.version_select at 0x7f5790ddc550>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:24.797246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57dbb807-876f-442b-8085-80e8f4b3aca0 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.801931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57dbb807-876f-442b-8085-80e8f4b3aca0 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.801931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57dbb807-876f-442b-8085-80e8f4b3aca0 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.822308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57dbb807-876f-442b-8085-80e8f4b3aca0 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.823278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57dbb807-876f-442b-8085-80e8f4b3aca0 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.823929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57dbb807-876f-442b-8085-80e8f4b3aca0 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.854776 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-57dbb807-876f-442b-8085-80e8f4b3aca0 tempest-HostsAdminTestJSON-850108093 tempest-HostsAdminTestJSON-850108093-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/n-h2-860282-1" status: 200 len: 467 microversion: 2.1 time: 0.088686 Oct 04 21:06:24.857835 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 111/212] 10.222.0.30 () {58 vars in 1170 bytes} [Tue Oct 4 21:06:24 2022] GET /compute/v2.1/os-hosts/n-h2-860282-1 => generated 467 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:24.867450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a534b651-ed51-49b4-a196-62ac41d96d84 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:24.868463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a534b651-ed51-49b4-a196-62ac41d96d84 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:24.909358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a534b651-ed51-49b4-a196-62ac41d96d84 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.916826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a534b651-ed51-49b4-a196-62ac41d96d84 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.920216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a534b651-ed51-49b4-a196-62ac41d96d84 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.921252 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a534b651-ed51-49b4-a196-62ac41d96d84 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.921777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a534b651-ed51-49b4-a196-62ac41d96d84 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.928146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a534b651-ed51-49b4-a196-62ac41d96d84 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:25.236775 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fa908a45-cb45-47a2-99bf-207308956748 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.595191 Oct 04 21:06:25.238043 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 102/213] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Oct 4 21:06:24 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:25.259909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7574d4ee-2345-4c21-983a-9ad08defc68a tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:25.270997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a534b651-ed51-49b4-a196-62ac41d96d84 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:25.277292 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7574d4ee-2345-4c21-983a-9ad08defc68a tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.026997 Oct 04 21:06:25.280868 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 103/214] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Oct 4 21:06:25 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:25.281875 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a534b651-ed51-49b4-a196-62ac41d96d84 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 200 len: 1271 microversion: 2.1 time: 0.419261 Oct 04 21:06:25.282462 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 112/215] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:24 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 1271 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:25.297212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab0b5568-0281-45e2-a468-488ff1357d50 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860282-1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:25.310936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab0b5568-0281-45e2-a468-488ff1357d50 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:25.311673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab0b5568-0281-45e2-a468-488ff1357d50 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:25.312266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab0b5568-0281-45e2-a468-488ff1357d50 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:25.634397 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ab0b5568-0281-45e2-a468-488ff1357d50 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.345015 Oct 04 21:06:25.635815 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 104/216] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Oct 4 21:06:25 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:25.647101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f0301e6d-344e-4b1b-b81b-2d68fd00fe4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:25.647727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f0301e6d-344e-4b1b-b81b-2d68fd00fe4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:25.662364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-20b8a2a2-a015-4694-bfe5-594ee3e21fe5 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:25.670320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=10 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:25.670320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f0301e6d-344e-4b1b-b81b-2d68fd00fe4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:25.670320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f0301e6d-344e-4b1b-b81b-2d68fd00fe4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:25.670320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f0301e6d-344e-4b1b-b81b-2d68fd00fe4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:25.673606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f0301e6d-344e-4b1b-b81b-2d68fd00fe4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:25.674309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f0301e6d-344e-4b1b-b81b-2d68fd00fe4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:25.675572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f0301e6d-344e-4b1b-b81b-2d68fd00fe4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:25.786673 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-20b8a2a2-a015-4694-bfe5-594ee3e21fe5 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.135773 Oct 04 21:06:25.787770 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 105/217] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:06:25 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:06:25.801733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-85445479-e22a-4c66-b21c-258d486f1fb0 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-849250746"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:25.805292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.aggregate [None req-85445479-e22a-4c66-b21c-258d486f1fb0 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Generated uuid 9193f5f5-4eb9-4ad2-96a6-4d5485b6525c for aggregate {{(pid=122757) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:06:25.958899 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-85445479-e22a-4c66-b21c-258d486f1fb0 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.163970 Oct 04 21:06:25.959572 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 106/218] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Oct 4 21:06:25 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:25.973148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3014ba92-fe21-4bc7-903e-81d910b59978 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860282-1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:26.002864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3014ba92-fe21-4bc7-903e-81d910b59978 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:26.005797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3014ba92-fe21-4bc7-903e-81d910b59978 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:26.006353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3014ba92-fe21-4bc7-903e-81d910b59978 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:26.480224 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3014ba92-fe21-4bc7-903e-81d910b59978 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.512086 Oct 04 21:06:26.481017 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 107/219] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Oct 4 21:06:25 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:26.492605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f7fcb910-635a-4c8a-ba41-f912408f6088 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:26.493217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f7fcb910-635a-4c8a-ba41-f912408f6088 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:26.513953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7fcb910-635a-4c8a-ba41-f912408f6088 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:26.514460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7fcb910-635a-4c8a-ba41-f912408f6088 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:26.515369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7fcb910-635a-4c8a-ba41-f912408f6088 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:26.516094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7fcb910-635a-4c8a-ba41-f912408f6088 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:26.516554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7fcb910-635a-4c8a-ba41-f912408f6088 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:26.516977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7fcb910-635a-4c8a-ba41-f912408f6088 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:26.550287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f0301e6d-344e-4b1b-b81b-2d68fd00fe4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:26.561602 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f0301e6d-344e-4b1b-b81b-2d68fd00fe4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 200 len: 1388 microversion: 2.1 time: 0.918937 Oct 04 21:06:26.567984 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 113/220] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:25 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 1388 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:26.578424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7be8e08c-bff2-4522-ade9-de1ba62ff1fd tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860282-1"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:26.614309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7be8e08c-bff2-4522-ade9-de1ba62ff1fd tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:26.625645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7be8e08c-bff2-4522-ade9-de1ba62ff1fd tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:26.626142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7be8e08c-bff2-4522-ade9-de1ba62ff1fd tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:27.040082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f7fcb910-635a-4c8a-ba41-f912408f6088 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:27.049849 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f7fcb910-635a-4c8a-ba41-f912408f6088 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 200 len: 1277 microversion: 2.1 time: 0.560894 Oct 04 21:06:27.051100 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 108/221] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:26 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 1277 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:27.360598 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7be8e08c-bff2-4522-ade9-de1ba62ff1fd tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.791283 Oct 04 21:06:27.365988 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 114/222] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Oct 4 21:06:26 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:27.372918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6a6de360-426e-4558-8929-aa1b25cf243c tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:27.389414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9,nova_api:DELETE=7 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:27.495858 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6a6de360-426e-4558-8929-aa1b25cf243c tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.126718 Oct 04 21:06:27.498411 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 109/223] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:06:27 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:06:27.510890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1e8df818-eaaa-4c80-a6e0-66807f0cfff5 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1976761707"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:27.515558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-59a0aae3-538f-484e-b4e3-2b5c72a9ffeb tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1376415486"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:27.516878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.aggregate [None req-1e8df818-eaaa-4c80-a6e0-66807f0cfff5 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Generated uuid f5aaca29-1226-4d79-b0fb-5677bdc46aac for aggregate {{(pid=122758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:06:27.529552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.aggregate [None req-59a0aae3-538f-484e-b4e3-2b5c72a9ffeb tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Generated uuid 926e65cf-6b85-4dad-9cc2-711ded5a2850 for aggregate {{(pid=122757) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:06:27.602630 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1e8df818-eaaa-4c80-a6e0-66807f0cfff5 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.098969 Oct 04 21:06:27.605952 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 115/224] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Oct 4 21:06:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:27.614876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-570d15aa-55b2-4657-a103-894cf93ce0d1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:27.615729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-570d15aa-55b2-4657-a103-894cf93ce0d1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:27.628797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-570d15aa-55b2-4657-a103-894cf93ce0d1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:27.634435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-570d15aa-55b2-4657-a103-894cf93ce0d1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:27.635606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-570d15aa-55b2-4657-a103-894cf93ce0d1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:27.652282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-570d15aa-55b2-4657-a103-894cf93ce0d1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:27.652282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-570d15aa-55b2-4657-a103-894cf93ce0d1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:27.652282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-570d15aa-55b2-4657-a103-894cf93ce0d1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:27.652583 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-59a0aae3-538f-484e-b4e3-2b5c72a9ffeb tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.129441 Oct 04 21:06:27.652583 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 110/225] 10.222.0.30 () {62 vars in 1205 bytes} [Tue Oct 4 21:06:27 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:06:27.652583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3d5cc1e7-8ab5-489b-9d6d-01e519890f8a tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:27.746491 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3d5cc1e7-8ab5-489b-9d6d-01e519890f8a tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.103885 Oct 04 21:06:27.749966 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 111/226] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:06:27 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:06:27.764645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-38984229-d607-4b47-a941-dcd5a4b5004c tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-392501761"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:27.981669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-570d15aa-55b2-4657-a103-894cf93ce0d1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:27.993261 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-570d15aa-55b2-4657-a103-894cf93ce0d1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 200 len: 1388 microversion: 2.1 time: 0.388505 Oct 04 21:06:27.997142 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 116/227] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:27 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 1388 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:28.017920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fae64ddb-3f80-471b-8222-ed3ec8273d4b tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:28.030868 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-fae64ddb-3f80-471b-8222-ed3ec8273d4b tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fae64ddb-3f80-471b-8222-ed3ec8273d4b tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Request method failure captured: Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKAjudcwvOLAmcJlwYrtXv2NKUZ87WvAr0fc6np2avTB1kj2LEGGsiKNJzr1ARxsaFJ1Wl-NbaezoogXhHCA5qxEtVoh9IUZvk2yCShSJXfIFCDuGlDCiGy24X_xlf9bTvQiyldmaNfmmK_7iPrddxRETcW6IaDhxKX3VMS7CJeWqAo Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 796cd8687aaf49df8305e12c632d682e Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AggregatesAdminTestJSON-945291682 Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:06:28.039040 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:06:28.040313 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/796cd8687aaf49df8305e12c632d682e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_796cd8687aaf49df8305e12c632d682e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/796cd8687aaf49df8305e12c632d682e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/796cd8687aaf49df8305e12c632d682e"}]}] Oct 04 21:06:28.040313 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AggregatesAdminTestJSON-945291682 Oct 04 21:06:28.040313 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 796cd8687aaf49df8305e12c632d682e Oct 04 21:06:28.040313 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-945291682 Oct 04 21:06:28.040313 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AggregatesAdminTestJSON-945291682-project-admin Oct 04 21:06:28.040313 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:06:28.040313 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:06:28.040313 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: b22f595bb7bf42aebc2d0c11a59c436d Oct 04 21:06:28.040313 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AggregatesAdminTestJSON-945291682-project-admin Oct 04 21:06:28.040313 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:06:28.040313 n-d-860282-1 devstack@n-api.service[122758]: exception: Aggregate 5 could not be found. Oct 04 21:06:28.040313 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '5'} Oct 04 21:06:28.040313 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:28.041050 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:28.041050 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 21:06:28.041050 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 21:06:28.041050 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 21:06:28.041050 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 21:06:28.041050 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:06:28.041050 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:06:28.041050 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 21:06:28.041050 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 21:06:28.041050 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:06:28.041050 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:06:28.041050 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 21:06:28.041050 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 21:06:28.041050 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 04 21:06:28.041050 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:28.041050 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:28.041050 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:28.041050 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:28.041050 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:28.042351 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:28.042351 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:28.042351 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:28.042351 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:28.042351 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:28.042351 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 21:06:28.042351 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:06:28.042351 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 04 21:06:28.042351 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:28.042351 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:28.042351 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:28.042351 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:28.042351 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:28.042351 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:28.042351 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:28.042351 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:28.042351 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 04 21:06:28.042351 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:28.042351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fae64ddb-3f80-471b-8222-ed3ec8273d4b tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:28.043598 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fae64ddb-3f80-471b-8222-ed3ec8273d4b tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.035926 Oct 04 21:06:28.043598 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 117/228] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Oct 4 21:06:27 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:06:28.096073 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-38984229-d607-4b47-a941-dcd5a4b5004c tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.344562 Oct 04 21:06:28.097386 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 112/229] 10.222.0.30 () {62 vars in 1210 bytes} [Tue Oct 4 21:06:27 2022] PUT /compute/v2.1/os-aggregates/6 => generated 298 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:06:28.102273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2774a636-8afa-4a27-a361-0e91d41af904 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:28.114285 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-2774a636-8afa-4a27-a361-0e91d41af904 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2774a636-8afa-4a27-a361-0e91d41af904 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Request method failure captured: Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKAjudcwvOLAmcJlwYrtXv2NKUZ87WvAr0fc6np2avTB1kj2LEGGsiKNJzr1ARxsaFJ1Wl-NbaezoogXhHCA5qxEtVoh9IUZvk2yCShSJXfIFCDuGlDCiGy24X_xlf9bTvQiyldmaNfmmK_7iPrddxRETcW6IaDhxKX3VMS7CJeWqAo Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 796cd8687aaf49df8305e12c632d682e Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AggregatesAdminTestJSON-945291682 Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:06:28.116957 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:06:28.123141 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/796cd8687aaf49df8305e12c632d682e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_796cd8687aaf49df8305e12c632d682e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/796cd8687aaf49df8305e12c632d682e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/796cd8687aaf49df8305e12c632d682e"}]}] Oct 04 21:06:28.123141 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AggregatesAdminTestJSON-945291682 Oct 04 21:06:28.123141 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 796cd8687aaf49df8305e12c632d682e Oct 04 21:06:28.123141 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-945291682 Oct 04 21:06:28.123141 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AggregatesAdminTestJSON-945291682-project-admin Oct 04 21:06:28.123141 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:28.123141 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:28.123141 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b22f595bb7bf42aebc2d0c11a59c436d Oct 04 21:06:28.123141 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AggregatesAdminTestJSON-945291682-project-admin Oct 04 21:06:28.123141 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:06:28.123141 n-d-860282-1 devstack@n-api.service[122757]: exception: Aggregate 5 could not be found. Oct 04 21:06:28.123141 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '5'} Oct 04 21:06:28.123141 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:28.123889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:28.123889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 21:06:28.123889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 21:06:28.123889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:06:28.123889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:06:28.123889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:06:28.123889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:06:28.123889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:06:28.123889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:06:28.123889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:06:28.123889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:06:28.123889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 21:06:28.123889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 21:06:28.123889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:06:28.123889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:06:28.123889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 21:06:28.123889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 21:06:28.123889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:06:28.123889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:28.124922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:28.126153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:28.126153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:28.126153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:28.126153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 04 21:06:28.126153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:28.126153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2774a636-8afa-4a27-a361-0e91d41af904 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:28.126153 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2774a636-8afa-4a27-a361-0e91d41af904 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.020733 Oct 04 21:06:28.126153 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 113/230] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:06:28 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:06:28.129119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d8904a0b-b4ac-4cf9-841d-993d0e2064ec tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:28.130035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d8904a0b-b4ac-4cf9-841d-993d0e2064ec tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:28.143183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8904a0b-b4ac-4cf9-841d-993d0e2064ec tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:28.143687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8904a0b-b4ac-4cf9-841d-993d0e2064ec tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:28.144132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8904a0b-b4ac-4cf9-841d-993d0e2064ec tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:28.145337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8904a0b-b4ac-4cf9-841d-993d0e2064ec tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:28.145337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8904a0b-b4ac-4cf9-841d-993d0e2064ec tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:28.145749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8904a0b-b4ac-4cf9-841d-993d0e2064ec tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:28.180814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:28.246294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d8904a0b-b4ac-4cf9-841d-993d0e2064ec tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:28.255989 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d8904a0b-b4ac-4cf9-841d-993d0e2064ec tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 200 len: 1277 microversion: 2.1 time: 0.135185 Oct 04 21:06:28.256818 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 114/231] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:28 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 1277 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:28.280906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-59d83bdb-0bfe-49d8-b499-39b04c1d52cf tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:28.289902 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-59d83bdb-0bfe-49d8-b499-39b04c1d52cf tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.018451 Oct 04 21:06:28.290997 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 115/232] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Oct 4 21:06:28 2022] GET /compute/v2.1/os-aggregates/6 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:06:28.296575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6ec5a113-4a9f-482f-b092-a1fce4107df3 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1705181657", "name": "tempest-test_aggregate-1918587286"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:28.300941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.aggregate [None req-6ec5a113-4a9f-482f-b092-a1fce4107df3 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Generated uuid e2a9ae55-69ae-4801-b524-9f6ef3dffa7c for aggregate {{(pid=122757) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:06:28.432675 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6ec5a113-4a9f-482f-b092-a1fce4107df3 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.140325 Oct 04 21:06:28.435907 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 116/233] 10.222.0.30 () {60 vars in 1165 bytes} [Tue Oct 4 21:06:28 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:28.448467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-64195db0-e868-4719-8ad8-f11f75e68738 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860282-1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:28.468825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64195db0-e868-4719-8ad8-f11f75e68738 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:28.469765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64195db0-e868-4719-8ad8-f11f75e68738 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:28.470570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64195db0-e868-4719-8ad8-f11f75e68738 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:28.908826 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-64195db0-e868-4719-8ad8-f11f75e68738 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 313 microversion: 2.41 time: 0.468170 Oct 04 21:06:28.908826 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 117/234] 10.222.0.30 () {62 vars in 1232 bytes} [Tue Oct 4 21:06:28 2022] POST /compute/v2.1/os-aggregates/6/action => generated 313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:06:28.911320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-84ac3282-10e2-467a-9671-2ffe64c45f9a tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:29.044109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ec257e2a-320a-4673-8348-68c11ace304e tempest-QuotaClassesAdminTestJSON-69612693 tempest-QuotaClassesAdminTestJSON-69612693-project-admin] Calling method '.version_select at 0x7f5790d30f70>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:29.077216 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ec257e2a-320a-4673-8348-68c11ace304e tempest-QuotaClassesAdminTestJSON-69612693 tempest-QuotaClassesAdminTestJSON-69612693-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 1.038958 Oct 04 21:06:29.081481 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 118/235] 10.222.0.30 () {58 vars in 1185 bytes} [Tue Oct 4 21:06:28 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:29.094871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ab862ace-7977-4d4a-98c4-e3bbf7f6a245 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860282-1"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:29.100223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab862ace-7977-4d4a-98c4-e3bbf7f6a245 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:29.100725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab862ace-7977-4d4a-98c4-e3bbf7f6a245 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:29.101375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab862ace-7977-4d4a-98c4-e3bbf7f6a245 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:29.127643 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-84ac3282-10e2-467a-9671-2ffe64c45f9a tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.219944 Oct 04 21:06:29.128269 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 118/236] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:06:28 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:06:29.139389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ea371ce9-a56b-4276-8520-4fafb138c305 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:29.140137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ea371ce9-a56b-4276-8520-4fafb138c305 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:29.152001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea371ce9-a56b-4276-8520-4fafb138c305 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:29.152205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea371ce9-a56b-4276-8520-4fafb138c305 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:29.152505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea371ce9-a56b-4276-8520-4fafb138c305 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:29.153230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea371ce9-a56b-4276-8520-4fafb138c305 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:29.153723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea371ce9-a56b-4276-8520-4fafb138c305 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:29.154207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea371ce9-a56b-4276-8520-4fafb138c305 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:29.447632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ea371ce9-a56b-4276-8520-4fafb138c305 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:29.458539 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ab862ace-7977-4d4a-98c4-e3bbf7f6a245 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 298 microversion: 2.41 time: 0.376020 Oct 04 21:06:29.460304 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ea371ce9-a56b-4276-8520-4fafb138c305 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 200 len: 1388 microversion: 2.1 time: 0.330999 Oct 04 21:06:29.460430 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 119/237] 10.222.0.30 () {62 vars in 1232 bytes} [Tue Oct 4 21:06:29 2022] POST /compute/v2.1/os-aggregates/6/action => generated 298 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:06:29.461294 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 119/238] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:29 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 1388 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:29.470326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3f840bcf-201a-49e4-84be-8147a169ec16 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:29.470529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a7f6e4f4-15e6-41b9-bf0e-b368b09f2e5a tempest-QuotaClassesAdminTestJSON-69612693 tempest-QuotaClassesAdminTestJSON-69612693-project-admin] Action: 'update', calling method: .version_select at 0x7f5790de3a60>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:29.497125 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-3f840bcf-201a-49e4-84be-8147a169ec16 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3f840bcf-201a-49e4-84be-8147a169ec16 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Request method failure captured: Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKAjudcwvOLAmcJlwYrtXv2NKUZ87WvAr0fc6np2avTB1kj2LEGGsiKNJzr1ARxsaFJ1Wl-NbaezoogXhHCA5qxEtVoh9IUZvk2yCShSJXfIFCDuGlDCiGy24X_xlf9bTvQiyldmaNfmmK_7iPrddxRETcW6IaDhxKX3VMS7CJeWqAo Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 796cd8687aaf49df8305e12c632d682e Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AggregatesAdminTestJSON-945291682 Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:06:29.503428 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:06:29.504787 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/796cd8687aaf49df8305e12c632d682e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_796cd8687aaf49df8305e12c632d682e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/796cd8687aaf49df8305e12c632d682e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/796cd8687aaf49df8305e12c632d682e"}]}] Oct 04 21:06:29.504787 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AggregatesAdminTestJSON-945291682 Oct 04 21:06:29.504787 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 796cd8687aaf49df8305e12c632d682e Oct 04 21:06:29.504787 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-945291682 Oct 04 21:06:29.504787 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AggregatesAdminTestJSON-945291682-project-admin Oct 04 21:06:29.504787 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:29.504787 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:29.504787 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b22f595bb7bf42aebc2d0c11a59c436d Oct 04 21:06:29.504787 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AggregatesAdminTestJSON-945291682-project-admin Oct 04 21:06:29.504787 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:06:29.504787 n-d-860282-1 devstack@n-api.service[122757]: exception: Aggregate 7 could not be found. Oct 04 21:06:29.504787 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '7'} Oct 04 21:06:29.504787 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:29.506088 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:29.506088 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 21:06:29.506088 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 21:06:29.506088 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 21:06:29.506088 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 21:06:29.506088 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:06:29.506088 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:06:29.506088 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 21:06:29.506088 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 21:06:29.506088 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:06:29.506088 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:06:29.506088 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 21:06:29.506088 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 21:06:29.506088 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 04 21:06:29.506088 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:29.506088 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:29.506088 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:29.506088 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:29.506088 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:29.507192 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:29.507192 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:29.507192 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:29.507192 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:29.507192 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:29.507192 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 21:06:29.507192 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:06:29.507192 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 04 21:06:29.507192 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:29.507192 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:29.507192 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:29.507192 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:29.507192 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:29.507192 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:29.507192 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:29.507192 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:29.507192 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 04 21:06:29.507192 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:29.510189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3f840bcf-201a-49e4-84be-8147a169ec16 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:29.514187 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3f840bcf-201a-49e4-84be-8147a169ec16 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.051507 Oct 04 21:06:29.516566 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 120/239] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Oct 4 21:06:29 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:06:29.526183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e831e334-51c4-43b8-804c-347b07232127 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:29.542707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e831e334-51c4-43b8-804c-347b07232127 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:29.554299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e831e334-51c4-43b8-804c-347b07232127 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:29.554999 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e831e334-51c4-43b8-804c-347b07232127 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:29.555697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e831e334-51c4-43b8-804c-347b07232127 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:29.557164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e831e334-51c4-43b8-804c-347b07232127 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:29.558165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e831e334-51c4-43b8-804c-347b07232127 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:29.558984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e831e334-51c4-43b8-804c-347b07232127 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:29.923996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e831e334-51c4-43b8-804c-347b07232127 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:29.932845 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e831e334-51c4-43b8-804c-347b07232127 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 200 len: 1319 microversion: 2.1 time: 0.413771 Oct 04 21:06:29.933444 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 121/240] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:29 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:29.971046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-50cf7a11-0dc6-4d24-af34-e1e3e55bcf99 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:30.121093 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-50cf7a11-0dc6-4d24-af34-e1e3e55bcf99 tempest-AggregatesAdminTestV241-823635527 tempest-AggregatesAdminTestV241-823635527-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.157060 Oct 04 21:06:30.121805 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 122/241] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Oct 4 21:06:29 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:30.139151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a3c9dd55-6ec4-48d4-92ed-b725562cdf2c tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:30.157121 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-a3c9dd55-6ec4-48d4-92ed-b725562cdf2c tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a3c9dd55-6ec4-48d4-92ed-b725562cdf2c tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Request method failure captured: Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKAjudcwvOLAmcJlwYrtXv2NKUZ87WvAr0fc6np2avTB1kj2LEGGsiKNJzr1ARxsaFJ1Wl-NbaezoogXhHCA5qxEtVoh9IUZvk2yCShSJXfIFCDuGlDCiGy24X_xlf9bTvQiyldmaNfmmK_7iPrddxRETcW6IaDhxKX3VMS7CJeWqAo Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 796cd8687aaf49df8305e12c632d682e Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AggregatesAdminTestJSON-945291682 Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:06:30.158971 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:06:30.161645 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/796cd8687aaf49df8305e12c632d682e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_796cd8687aaf49df8305e12c632d682e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/796cd8687aaf49df8305e12c632d682e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/796cd8687aaf49df8305e12c632d682e"}]}] Oct 04 21:06:30.161645 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AggregatesAdminTestJSON-945291682 Oct 04 21:06:30.161645 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 796cd8687aaf49df8305e12c632d682e Oct 04 21:06:30.161645 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-945291682 Oct 04 21:06:30.161645 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AggregatesAdminTestJSON-945291682-project-admin Oct 04 21:06:30.161645 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:30.161645 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:30.161645 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b22f595bb7bf42aebc2d0c11a59c436d Oct 04 21:06:30.161645 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AggregatesAdminTestJSON-945291682-project-admin Oct 04 21:06:30.161645 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:06:30.161645 n-d-860282-1 devstack@n-api.service[122757]: exception: Aggregate 7 could not be found. Oct 04 21:06:30.161645 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '7'} Oct 04 21:06:30.161645 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:30.162593 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:30.162593 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 21:06:30.162593 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 21:06:30.162593 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:06:30.162593 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:06:30.162593 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:06:30.162593 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:06:30.162593 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:06:30.162593 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:06:30.162593 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:06:30.162593 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:06:30.162593 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 21:06:30.162593 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 21:06:30.162593 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:06:30.162593 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:06:30.162593 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 21:06:30.162593 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 21:06:30.162593 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:06:30.162593 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:30.166032 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:30.167762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:30.167762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:30.167762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:30.167762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 04 21:06:30.167762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:30.167762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a3c9dd55-6ec4-48d4-92ed-b725562cdf2c tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:30.167762 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a3c9dd55-6ec4-48d4-92ed-b725562cdf2c tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.033839 Oct 04 21:06:30.169618 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 123/242] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:06:30 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:06:30.176382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-76bc071a-66f6-460c-95af-94fd6a5ddd81 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1483336615"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:30.186039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.aggregate [None req-76bc071a-66f6-460c-95af-94fd6a5ddd81 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Generated uuid f5bb8cc8-3755-4431-aefc-dd9a8bec302c for aggregate {{(pid=122757) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:06:30.462131 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-76bc071a-66f6-460c-95af-94fd6a5ddd81 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.290821 Oct 04 21:06:30.463957 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 124/243] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Oct 4 21:06:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:30.502417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-2726e85f-6033-4acf-b5b5-f3f46710a6d7 req-b0d642d2-efdd-44ec-9a82-498f19aecf04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d4e9977-7ff4-4009-914b-6ea126ce63e8", "tag": "401354df-34a1-44ec-bcc3-145679d84557"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:30.535913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2726e85f-6033-4acf-b5b5-f3f46710a6d7 req-b0d642d2-efdd-44ec-9a82-498f19aecf04 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:30.537938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2726e85f-6033-4acf-b5b5-f3f46710a6d7 req-b0d642d2-efdd-44ec-9a82-498f19aecf04 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:30.538533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2726e85f-6033-4acf-b5b5-f3f46710a6d7 req-b0d642d2-efdd-44ec-9a82-498f19aecf04 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:30.580703 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-2726e85f-6033-4acf-b5b5-f3f46710a6d7 req-b0d642d2-efdd-44ec-9a82-498f19aecf04 service nova] Creating event network-changed:401354df-34a1-44ec-bcc3-145679d84557 for instance 3d4e9977-7ff4-4009-914b-6ea126ce63e8 on n-h1-860282-1 Oct 04 21:06:30.602464 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-2726e85f-6033-4acf-b5b5-f3f46710a6d7 req-b0d642d2-efdd-44ec-9a82-498f19aecf04 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137109 Oct 04 21:06:30.603728 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 125/244] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:30.611781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-45944112-521e-4ee1-a542-5a32bd738118 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:30.620985 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-45944112-521e-4ee1-a542-5a32bd738118 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.015877 Oct 04 21:06:30.621967 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 126/245] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Oct 4 21:06:30 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:30.633027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ddd9952b-df97-4b2e-bf1d-cf89b6506677 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:30.634106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ddd9952b-df97-4b2e-bf1d-cf89b6506677 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:30.640891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ddd9952b-df97-4b2e-bf1d-cf89b6506677 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:30.641635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ddd9952b-df97-4b2e-bf1d-cf89b6506677 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:30.642267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ddd9952b-df97-4b2e-bf1d-cf89b6506677 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:30.643130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ddd9952b-df97-4b2e-bf1d-cf89b6506677 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:30.643739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ddd9952b-df97-4b2e-bf1d-cf89b6506677 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:30.644330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ddd9952b-df97-4b2e-bf1d-cf89b6506677 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:31.186392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=3,nova_api:INSERT=12,nova_api:UPDATE=12 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:31.297163 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a7f6e4f4-15e6-41b9-bf0e-b368b09f2e5a tempest-QuotaClassesAdminTestJSON-69612693 tempest-QuotaClassesAdminTestJSON-69612693-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.835663 Oct 04 21:06:31.298054 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 120/246] 10.222.0.30 () {60 vars in 1206 bytes} [Tue Oct 4 21:06:29 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:31.304290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ac158ece-d1f2-4c7c-bc22-20ba2e1e9a31 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:31.511238 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ac158ece-d1f2-4c7c-bc22-20ba2e1e9a31 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.211878 Oct 04 21:06:31.512192 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 121/247] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Oct 4 21:06:31 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:31.518249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ddd9952b-df97-4b2e-bf1d-cf89b6506677 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:31.521166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-1451a54a-4ae6-4683-b722-02c50825f3da req-492e4af3-0a76-44d1-b3a5-34d4f31f5adf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7555a913-21ac-440f-8323-ca961a6d08d7", "name": "network-vif-plugged", "status": "completed", "tag": "ca0fba7b-2727-4db4-adba-b3f7120588e6"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:31.549965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1451a54a-4ae6-4683-b722-02c50825f3da req-492e4af3-0a76-44d1-b3a5-34d4f31f5adf service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:31.555708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1451a54a-4ae6-4683-b722-02c50825f3da req-492e4af3-0a76-44d1-b3a5-34d4f31f5adf service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:31.557692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1451a54a-4ae6-4683-b722-02c50825f3da req-492e4af3-0a76-44d1-b3a5-34d4f31f5adf service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:31.576681 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ddd9952b-df97-4b2e-bf1d-cf89b6506677 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 200 len: 1388 microversion: 2.1 time: 0.952606 Oct 04 21:06:31.582788 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 127/248] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:30 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 1388 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:31.598258 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-1451a54a-4ae6-4683-b722-02c50825f3da req-492e4af3-0a76-44d1-b3a5-34d4f31f5adf service nova] Creating event network-vif-plugged:ca0fba7b-2727-4db4-adba-b3f7120588e6 for instance 7555a913-21ac-440f-8323-ca961a6d08d7 on n-h2-860282-1 Oct 04 21:06:31.600150 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-1451a54a-4ae6-4683-b722-02c50825f3da req-492e4af3-0a76-44d1-b3a5-34d4f31f5adf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086428 Oct 04 21:06:31.601337 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 122/249] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:31.610769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-987bf9f0-d7c2-4fc2-b669-c17ac932cbc0 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:31.611770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-987bf9f0-d7c2-4fc2-b669-c17ac932cbc0 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:31.630003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-32cf6b93-de2d-4e09-8c20-ea8c6c78f7bf tempest-QuotaClassesAdminTestJSON-69612693 tempest-QuotaClassesAdminTestJSON-69612693-project-admin] Calling method '.version_select at 0x7f57923a8a60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:31.643293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-987bf9f0-d7c2-4fc2-b669-c17ac932cbc0 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:31.644136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-987bf9f0-d7c2-4fc2-b669-c17ac932cbc0 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:31.648561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-987bf9f0-d7c2-4fc2-b669-c17ac932cbc0 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:31.649577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-987bf9f0-d7c2-4fc2-b669-c17ac932cbc0 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:31.650526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-987bf9f0-d7c2-4fc2-b669-c17ac932cbc0 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:31.652082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-987bf9f0-d7c2-4fc2-b669-c17ac932cbc0 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:31.681944 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-32cf6b93-de2d-4e09-8c20-ea8c6c78f7bf tempest-QuotaClassesAdminTestJSON-69612693 tempest-QuotaClassesAdminTestJSON-69612693-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.076380 Oct 04 21:06:31.685953 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 123/250] 10.222.0.30 () {58 vars in 1185 bytes} [Tue Oct 4 21:06:31 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:31.696103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-27f53284-7498-4476-8343-5167e203fa77 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:31.718733 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-27f53284-7498-4476-8343-5167e203fa77 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.031071 Oct 04 21:06:31.719777 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 124/251] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Oct 4 21:06:31 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:31.728411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a08df72-430a-4017-9aa1-d8ab51a8f40f tempest-QuotaClassesAdminTestJSON-69612693 tempest-QuotaClassesAdminTestJSON-69612693-project-admin] Action: 'update', calling method: .version_select at 0x7f5790cb1f70>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:31.920658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-987bf9f0-d7c2-4fc2-b669-c17ac932cbc0 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:31.934377 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-987bf9f0-d7c2-4fc2-b669-c17ac932cbc0 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 200 len: 1319 microversion: 2.1 time: 0.350468 Oct 04 21:06:31.936471 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 128/252] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:31 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:31.941799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3354a557-995e-4f47-b133-dd6ba539588b tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:32.026971 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3354a557-995e-4f47-b133-dd6ba539588b tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.089107 Oct 04 21:06:32.027559 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 129/253] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:06:31 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:06:32.038688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0b3a3a52-ff29-48f8-84da-cbb5c0ecd84d tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-106484621", "availability_zone": "tempest-test_az-462920120"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:32.042658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.aggregate [None req-0b3a3a52-ff29-48f8-84da-cbb5c0ecd84d tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Generated uuid 8be22b6c-7900-410b-8ff9-c3efcd8107e8 for aggregate {{(pid=122757) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:06:32.145819 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0b3a3a52-ff29-48f8-84da-cbb5c0ecd84d tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.110972 Oct 04 21:06:32.147605 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 130/254] 10.222.0.30 () {60 vars in 1165 bytes} [Tue Oct 4 21:06:32 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:32.161184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-32ffb5ce-82f3-478d-833a-5c80c14d43bd tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-106484621_new", "availability_zone": "tempest-test_az-462920120_new"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:32.384873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32ffb5ce-82f3-478d-833a-5c80c14d43bd tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:32.385682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32ffb5ce-82f3-478d-833a-5c80c14d43bd tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:32.387768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32ffb5ce-82f3-478d-833a-5c80c14d43bd tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:32.527290 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-32ffb5ce-82f3-478d-833a-5c80c14d43bd tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 333 microversion: 2.1 time: 0.372058 Oct 04 21:06:32.535637 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 131/255] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Oct 4 21:06:32 2022] PUT /compute/v2.1/os-aggregates/9 => generated 333 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:32.540937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fa404734-8f24-447e-bef0-d6f72de99242 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:32.550499 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fa404734-8f24-447e-bef0-d6f72de99242 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 336 microversion: 2.1 time: 0.013395 Oct 04 21:06:32.569609 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 132/256] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Oct 4 21:06:32 2022] GET /compute/v2.1/os-aggregates => generated 336 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:32.579275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-552dcd47-51fb-4deb-9e1d-9358277014ec tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:32.592384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=10,nova_api:INSERT=7,nova_api:UPDATE=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:32.704456 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-552dcd47-51fb-4deb-9e1d-9358277014ec tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.132915 Oct 04 21:06:32.709586 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 133/257] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:06:32 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:06:32.719057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-61f02036-72d9-4115-ae16-05a160907721 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:32.721225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-61f02036-72d9-4115-ae16-05a160907721 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:32.741222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61f02036-72d9-4115-ae16-05a160907721 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:32.743896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61f02036-72d9-4115-ae16-05a160907721 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:32.743896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61f02036-72d9-4115-ae16-05a160907721 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:32.745021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61f02036-72d9-4115-ae16-05a160907721 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:32.745655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61f02036-72d9-4115-ae16-05a160907721 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:32.746198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61f02036-72d9-4115-ae16-05a160907721 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:33.080547 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7a08df72-430a-4017-9aa1-d8ab51a8f40f tempest-QuotaClassesAdminTestJSON-69612693 tempest-QuotaClassesAdminTestJSON-69612693-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.359277 Oct 04 21:06:33.081152 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 125/258] 10.222.0.30 () {60 vars in 1206 bytes} [Tue Oct 4 21:06:31 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:33.085909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-398d9cf3-8369-4c83-a036-9f71f866246d tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2021801877"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:33.095828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.aggregate [None req-398d9cf3-8369-4c83-a036-9f71f866246d tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Generated uuid 23ca8b67-2c65-4160-94ef-0819556f6801 for aggregate {{(pid=122758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:06:33.250928 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-398d9cf3-8369-4c83-a036-9f71f866246d tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.168528 Oct 04 21:06:33.258253 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 126/259] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Oct 4 21:06:33 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:33.261550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-81ecb024-e58b-43da-8027-b99d83c94fca tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:33.262301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-81ecb024-e58b-43da-8027-b99d83c94fca tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:33.283055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81ecb024-e58b-43da-8027-b99d83c94fca tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:33.283499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81ecb024-e58b-43da-8027-b99d83c94fca tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:33.283934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81ecb024-e58b-43da-8027-b99d83c94fca tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:33.286988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81ecb024-e58b-43da-8027-b99d83c94fca tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:33.293925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81ecb024-e58b-43da-8027-b99d83c94fca tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:33.295100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81ecb024-e58b-43da-8027-b99d83c94fca tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:33.355332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-61f02036-72d9-4115-ae16-05a160907721 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:33.366885 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-61f02036-72d9-4115-ae16-05a160907721 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 200 len: 1388 microversion: 2.1 time: 0.655652 Oct 04 21:06:33.378237 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 134/260] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:32 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 1388 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:33.393207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-37d86676-34b9-4ecb-bd06-3d27f4e33db9 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:33.409617 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-37d86676-34b9-4ecb-bd06-3d27f4e33db9 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.030071 Oct 04 21:06:33.410771 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 135/261] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Oct 4 21:06:33 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:33.422687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-61372e85-a056-492d-aed5-f35b1eab07e3 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:33.556634 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-61372e85-a056-492d-aed5-f35b1eab07e3 tempest-AggregatesAdminTestJSON-945291682 tempest-AggregatesAdminTestJSON-945291682-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.138062 Oct 04 21:06:33.559020 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 136/262] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Oct 4 21:06:33 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 21:06:33.570944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-073e5d97-3b3c-416a-ac1f-0566e35f1c04 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:33.572070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-073e5d97-3b3c-416a-ac1f-0566e35f1c04 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:33.582452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-073e5d97-3b3c-416a-ac1f-0566e35f1c04 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:33.584342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-073e5d97-3b3c-416a-ac1f-0566e35f1c04 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:33.585670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-073e5d97-3b3c-416a-ac1f-0566e35f1c04 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:33.587204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-073e5d97-3b3c-416a-ac1f-0566e35f1c04 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:33.587916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-073e5d97-3b3c-416a-ac1f-0566e35f1c04 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:33.588567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-073e5d97-3b3c-416a-ac1f-0566e35f1c04 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:33.612050 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-073e5d97-3b3c-416a-ac1f-0566e35f1c04 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] HTTP exception thrown: Instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 could not be found. Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-073e5d97-3b3c-416a-ac1f-0566e35f1c04 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Request method failure captured: Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 HTTP/1.1 Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKAf7ZnzIlzgbjMCt8QK5jC6ZP6rGbofjZ9Gq53xD31sZUVSksZDiHU1VYf2fnuo0iDKj0vT0nrSUBEEAEyNQns4LBTe-BDsd_93PSovBcLvNLRJZuc6X-KBYl7daDhK0w_jMp7Okp5AlncrQ-srk5gmPgkDLftl3T_ni2KcaWwFf8k Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 9419b86a729649c0aba5c047b5665f4c Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AggregatesAdminTestJSON-231602032 Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:06:33.615428 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:06:33.616695 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9419b86a729649c0aba5c047b5665f4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9419b86a729649c0aba5c047b5665f4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9419b86a729649c0aba5c047b5665f4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9419b86a729649c0aba5c047b5665f4c"}]}] Oct 04 21:06:33.616695 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AggregatesAdminTestJSON-231602032 Oct 04 21:06:33.616695 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 9419b86a729649c0aba5c047b5665f4c Oct 04 21:06:33.616695 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-231602032 Oct 04 21:06:33.616695 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AggregatesAdminTestJSON-231602032-project Oct 04 21:06:33.616695 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:33.616695 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:33.616695 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 5b79e298c90a46938431774ea19b61b8 Oct 04 21:06:33.616695 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AggregatesAdminTestJSON-231602032-project Oct 04 21:06:33.616695 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:06:33.616695 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 could not be found. Oct 04 21:06:33.616695 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'cfe6aa09-8e1e-41d7-a431-c8bae79920b6'} Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 could not be found. Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:33.617396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 could not be found. Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 could not be found. Oct 04 21:06:33.618594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:33.621436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-073e5d97-3b3c-416a-ac1f-0566e35f1c04 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Returning 404 to user: Instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:33.622586 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-073e5d97-3b3c-416a-ac1f-0566e35f1c04 tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 404 len: 111 microversion: 2.1 time: 0.058699 Oct 04 21:06:33.624337 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 137/263] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:06:33 2022] DELETE /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:06:33.632333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-43ddab45-9676-4c0a-bc35-e4efdc55aabc tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:33.633143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-43ddab45-9676-4c0a-bc35-e4efdc55aabc tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] [instance: cfe6aa09-8e1e-41d7-a431-c8bae79920b6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:33.640366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43ddab45-9676-4c0a-bc35-e4efdc55aabc tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:33.641408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43ddab45-9676-4c0a-bc35-e4efdc55aabc tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:33.643588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43ddab45-9676-4c0a-bc35-e4efdc55aabc tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:33.644731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43ddab45-9676-4c0a-bc35-e4efdc55aabc tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:33.645461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43ddab45-9676-4c0a-bc35-e4efdc55aabc tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:33.646157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43ddab45-9676-4c0a-bc35-e4efdc55aabc tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:33.671061 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-43ddab45-9676-4c0a-bc35-e4efdc55aabc tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] HTTP exception thrown: Instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 could not be found. Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-43ddab45-9676-4c0a-bc35-e4efdc55aabc tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Request method failure captured: Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 HTTP/1.1 Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKAf7ZnzIlzgbjMCt8QK5jC6ZP6rGbofjZ9Gq53xD31sZUVSksZDiHU1VYf2fnuo0iDKj0vT0nrSUBEEAEyNQns4LBTe-BDsd_93PSovBcLvNLRJZuc6X-KBYl7daDhK0w_jMp7Okp5AlncrQ-srk5gmPgkDLftl3T_ni2KcaWwFf8k Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 9419b86a729649c0aba5c047b5665f4c Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AggregatesAdminTestJSON-231602032 Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:06:33.673039 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:06:33.674333 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9419b86a729649c0aba5c047b5665f4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9419b86a729649c0aba5c047b5665f4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9419b86a729649c0aba5c047b5665f4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9419b86a729649c0aba5c047b5665f4c"}]}] Oct 04 21:06:33.674333 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AggregatesAdminTestJSON-231602032 Oct 04 21:06:33.674333 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 9419b86a729649c0aba5c047b5665f4c Oct 04 21:06:33.674333 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-231602032 Oct 04 21:06:33.674333 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AggregatesAdminTestJSON-231602032-project Oct 04 21:06:33.674333 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:33.674333 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:33.674333 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 5b79e298c90a46938431774ea19b61b8 Oct 04 21:06:33.674333 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AggregatesAdminTestJSON-231602032-project Oct 04 21:06:33.674333 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:06:33.674333 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 could not be found. Oct 04 21:06:33.674333 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'cfe6aa09-8e1e-41d7-a431-c8bae79920b6'} Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 could not be found. Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:33.674998 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:33.676086 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:33.676086 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:06:33.676086 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:06:33.676086 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:06:33.676086 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:06:33.676086 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:06:33.676086 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:06:33.676086 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 could not be found. Oct 04 21:06:33.676086 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:33.676086 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:33.676086 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:33.676086 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:33.676086 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:33.676086 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:33.676086 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:33.676086 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:33.676086 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 could not be found. Oct 04 21:06:33.676086 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:33.678788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-43ddab45-9676-4c0a-bc35-e4efdc55aabc tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] Returning 404 to user: Instance cfe6aa09-8e1e-41d7-a431-c8bae79920b6 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:33.679965 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-43ddab45-9676-4c0a-bc35-e4efdc55aabc tempest-AggregatesAdminTestJSON-231602032 tempest-AggregatesAdminTestJSON-231602032-project] 10.222.0.30 "GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6" status: 404 len: 111 microversion: 2.1 time: 0.051712 Oct 04 21:06:33.684011 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 138/264] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:33 2022] GET /compute/v2.1/servers/cfe6aa09-8e1e-41d7-a431-c8bae79920b6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:06:33.741911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-81ecb024-e58b-43da-8027-b99d83c94fca tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:33.751057 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-81ecb024-e58b-43da-8027-b99d83c94fca tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 200 len: 1319 microversion: 2.1 time: 0.498472 Oct 04 21:06:33.756716 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 127/265] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:33 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 1319 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:34.403360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-adf7d1e6-04a5-4bf0-8791-6866c7d58c8d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:34.404881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-adf7d1e6-04a5-4bf0-8791-6866c7d58c8d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:34.411025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:34.413399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-adf7d1e6-04a5-4bf0-8791-6866c7d58c8d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:34.414385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-adf7d1e6-04a5-4bf0-8791-6866c7d58c8d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:34.415108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-adf7d1e6-04a5-4bf0-8791-6866c7d58c8d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:34.416063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-adf7d1e6-04a5-4bf0-8791-6866c7d58c8d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:34.416909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-adf7d1e6-04a5-4bf0-8791-6866c7d58c8d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:34.417614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-adf7d1e6-04a5-4bf0-8791-6866c7d58c8d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:34.449165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:34.787251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-77249875-fb58-4229-b424-1b7c6db1d3db tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:34.787928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-77249875-fb58-4229-b424-1b7c6db1d3db tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:34.797894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77249875-fb58-4229-b424-1b7c6db1d3db tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:34.799192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77249875-fb58-4229-b424-1b7c6db1d3db tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:34.800615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77249875-fb58-4229-b424-1b7c6db1d3db tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:34.803534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77249875-fb58-4229-b424-1b7c6db1d3db tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:34.804221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77249875-fb58-4229-b424-1b7c6db1d3db tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:34.804805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77249875-fb58-4229-b424-1b7c6db1d3db tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:34.832308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-adf7d1e6-04a5-4bf0-8791-6866c7d58c8d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:34.843911 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-adf7d1e6-04a5-4bf0-8791-6866c7d58c8d tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 200 len: 1388 microversion: 2.1 time: 0.444481 Oct 04 21:06:34.845647 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 139/266] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:34 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 1388 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:35.090338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-77249875-fb58-4229-b424-1b7c6db1d3db tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:35.101264 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-77249875-fb58-4229-b424-1b7c6db1d3db tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 200 len: 1319 microversion: 2.1 time: 0.320889 Oct 04 21:06:35.102506 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 128/267] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:34 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:35.868702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5865a0ca-99c1-460a-bef9-9de119066a29 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:35.869228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5865a0ca-99c1-460a-bef9-9de119066a29 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:35.894471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5865a0ca-99c1-460a-bef9-9de119066a29 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:35.894973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5865a0ca-99c1-460a-bef9-9de119066a29 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:35.895413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5865a0ca-99c1-460a-bef9-9de119066a29 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:35.901649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5865a0ca-99c1-460a-bef9-9de119066a29 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:35.902142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5865a0ca-99c1-460a-bef9-9de119066a29 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:35.906150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5865a0ca-99c1-460a-bef9-9de119066a29 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:36.126724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5ac4f67e-79eb-40ed-9643-5678a2eda639 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:36.126724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5ac4f67e-79eb-40ed-9643-5678a2eda639 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:36.153633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ac4f67e-79eb-40ed-9643-5678a2eda639 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:36.155960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ac4f67e-79eb-40ed-9643-5678a2eda639 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:36.159448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ac4f67e-79eb-40ed-9643-5678a2eda639 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:36.161046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ac4f67e-79eb-40ed-9643-5678a2eda639 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:36.162606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ac4f67e-79eb-40ed-9643-5678a2eda639 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:36.170544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ac4f67e-79eb-40ed-9643-5678a2eda639 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:36.284233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5865a0ca-99c1-460a-bef9-9de119066a29 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:36.301405 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5865a0ca-99c1-460a-bef9-9de119066a29 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 200 len: 1586 microversion: 2.1 time: 0.432969 Oct 04 21:06:36.316931 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 140/268] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:35 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 1586 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:36.337616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b5250a2b-de9b-47a6-bc60-2463c9b9d15a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:36.339573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b5250a2b-de9b-47a6-bc60-2463c9b9d15a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:36.352555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5250a2b-de9b-47a6-bc60-2463c9b9d15a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:36.355442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5250a2b-de9b-47a6-bc60-2463c9b9d15a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:36.356087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5250a2b-de9b-47a6-bc60-2463c9b9d15a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:36.357617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5250a2b-de9b-47a6-bc60-2463c9b9d15a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:36.360704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5250a2b-de9b-47a6-bc60-2463c9b9d15a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:36.366410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5250a2b-de9b-47a6-bc60-2463c9b9d15a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:36.494387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5ac4f67e-79eb-40ed-9643-5678a2eda639 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:36.506401 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5ac4f67e-79eb-40ed-9643-5678a2eda639 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 200 len: 1319 microversion: 2.1 time: 0.385343 Oct 04 21:06:36.551928 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 129/269] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:36 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 1319 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:36.661216 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b5250a2b-de9b-47a6-bc60-2463c9b9d15a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.329056 Oct 04 21:06:36.662380 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 141/270] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:06:36 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7/os-interface => generated 284 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:37.543411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-688c2fe1-51f4-4ac6-9ed0-4ed67307fff3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:37.544034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-688c2fe1-51f4-4ac6-9ed0-4ed67307fff3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:37.573600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-688c2fe1-51f4-4ac6-9ed0-4ed67307fff3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:37.574102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-688c2fe1-51f4-4ac6-9ed0-4ed67307fff3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:37.575261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-688c2fe1-51f4-4ac6-9ed0-4ed67307fff3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:37.586161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-688c2fe1-51f4-4ac6-9ed0-4ed67307fff3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:37.586927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-688c2fe1-51f4-4ac6-9ed0-4ed67307fff3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:37.587551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-688c2fe1-51f4-4ac6-9ed0-4ed67307fff3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:38.143965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-688c2fe1-51f4-4ac6-9ed0-4ed67307fff3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:38.152370 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-688c2fe1-51f4-4ac6-9ed0-4ed67307fff3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 200 len: 1319 microversion: 2.1 time: 0.614235 Oct 04 21:06:38.158501 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 130/271] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:37 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 1319 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:39.196214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-34d5c64b-f1dd-4750-b0bd-accd9a2a33b7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:39.197665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-34d5c64b-f1dd-4750-b0bd-accd9a2a33b7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:39.205509 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34d5c64b-f1dd-4750-b0bd-accd9a2a33b7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:39.206197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34d5c64b-f1dd-4750-b0bd-accd9a2a33b7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:39.206796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34d5c64b-f1dd-4750-b0bd-accd9a2a33b7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:39.207957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34d5c64b-f1dd-4750-b0bd-accd9a2a33b7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:39.208614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34d5c64b-f1dd-4750-b0bd-accd9a2a33b7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:39.210539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34d5c64b-f1dd-4750-b0bd-accd9a2a33b7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:39.775354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-34d5c64b-f1dd-4750-b0bd-accd9a2a33b7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:39.783943 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-34d5c64b-f1dd-4750-b0bd-accd9a2a33b7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 200 len: 1319 microversion: 2.1 time: 0.600834 Oct 04 21:06:39.789497 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 142/272] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:39 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 1319 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:39.809227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a13d6359-3e6c-479f-b7bc-9c1ef9452d56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:39.809733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a13d6359-3e6c-479f-b7bc-9c1ef9452d56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:39.818559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-32370e09-1c5e-4613-81a9-482ead01b7c9 req-e10f47bf-8059-4ce5-9242-ce5787b666a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7555a913-21ac-440f-8323-ca961a6d08d7", "tag": "ca0fba7b-2727-4db4-adba-b3f7120588e6"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:39.838768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a13d6359-3e6c-479f-b7bc-9c1ef9452d56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:39.845720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a13d6359-3e6c-479f-b7bc-9c1ef9452d56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:39.846413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a13d6359-3e6c-479f-b7bc-9c1ef9452d56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:39.848224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-32370e09-1c5e-4613-81a9-482ead01b7c9 req-e10f47bf-8059-4ce5-9242-ce5787b666a8 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:39.849370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a13d6359-3e6c-479f-b7bc-9c1ef9452d56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:39.851594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-32370e09-1c5e-4613-81a9-482ead01b7c9 req-e10f47bf-8059-4ce5-9242-ce5787b666a8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:39.852287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a13d6359-3e6c-479f-b7bc-9c1ef9452d56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:39.852932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-32370e09-1c5e-4613-81a9-482ead01b7c9 req-e10f47bf-8059-4ce5-9242-ce5787b666a8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:39.853692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a13d6359-3e6c-479f-b7bc-9c1ef9452d56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:39.903484 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-32370e09-1c5e-4613-81a9-482ead01b7c9 req-e10f47bf-8059-4ce5-9242-ce5787b666a8 service nova] Creating event network-changed:ca0fba7b-2727-4db4-adba-b3f7120588e6 for instance 7555a913-21ac-440f-8323-ca961a6d08d7 on n-h2-860282-1 Oct 04 21:06:39.915124 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-32370e09-1c5e-4613-81a9-482ead01b7c9 req-e10f47bf-8059-4ce5-9242-ce5787b666a8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101267 Oct 04 21:06:39.920236 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 143/273] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:40.125564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a13d6359-3e6c-479f-b7bc-9c1ef9452d56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:40.137258 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a13d6359-3e6c-479f-b7bc-9c1ef9452d56 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 200 len: 1586 microversion: 2.1 time: 0.332099 Oct 04 21:06:40.139080 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 131/274] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:39 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 1586 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:40.675843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-ee7acaef-4d19-4ada-93c9-bfc10e1ce66a req-c428e1e8-dd2b-4085-a7a6-a1f96ab2ad1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4e9977-7ff4-4009-914b-6ea126ce63e8", "name": "network-vif-plugged", "status": "completed", "tag": "401354df-34a1-44ec-bcc3-145679d84557"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:40.708640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ee7acaef-4d19-4ada-93c9-bfc10e1ce66a req-c428e1e8-dd2b-4085-a7a6-a1f96ab2ad1b service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:40.712448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ee7acaef-4d19-4ada-93c9-bfc10e1ce66a req-c428e1e8-dd2b-4085-a7a6-a1f96ab2ad1b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:40.714438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ee7acaef-4d19-4ada-93c9-bfc10e1ce66a req-c428e1e8-dd2b-4085-a7a6-a1f96ab2ad1b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:40.747362 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-ee7acaef-4d19-4ada-93c9-bfc10e1ce66a req-c428e1e8-dd2b-4085-a7a6-a1f96ab2ad1b service nova] Creating event network-vif-plugged:401354df-34a1-44ec-bcc3-145679d84557 for instance 3d4e9977-7ff4-4009-914b-6ea126ce63e8 on n-h1-860282-1 Oct 04 21:06:40.761218 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-ee7acaef-4d19-4ada-93c9-bfc10e1ce66a req-c428e1e8-dd2b-4085-a7a6-a1f96ab2ad1b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092704 Oct 04 21:06:40.766709 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 144/275] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:40.818660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-50a46172-27c1-4e5d-aed2-5f582fff61fa tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:40.819542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-50a46172-27c1-4e5d-aed2-5f582fff61fa tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:40.833499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50a46172-27c1-4e5d-aed2-5f582fff61fa tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:40.841250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50a46172-27c1-4e5d-aed2-5f582fff61fa tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:40.842820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50a46172-27c1-4e5d-aed2-5f582fff61fa tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:40.846358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50a46172-27c1-4e5d-aed2-5f582fff61fa tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:40.850082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50a46172-27c1-4e5d-aed2-5f582fff61fa tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:40.855199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50a46172-27c1-4e5d-aed2-5f582fff61fa tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:41.411168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-50a46172-27c1-4e5d-aed2-5f582fff61fa tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:41.430793 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-50a46172-27c1-4e5d-aed2-5f582fff61fa tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 200 len: 1319 microversion: 2.1 time: 0.615785 Oct 04 21:06:41.430793 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 145/276] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:40 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 1319 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:41.444109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4be7d2f9-33e1-4145-865b-4cd64ec737a7 tempest-AZAdminV2TestJSON-381536434 tempest-AZAdminV2TestJSON-381536434-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:41.446584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4be7d2f9-33e1-4145-865b-4cd64ec737a7 tempest-AZAdminV2TestJSON-381536434 tempest-AZAdminV2TestJSON-381536434-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:41.447364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4be7d2f9-33e1-4145-865b-4cd64ec737a7 tempest-AZAdminV2TestJSON-381536434 tempest-AZAdminV2TestJSON-381536434-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:41.447945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4be7d2f9-33e1-4145-865b-4cd64ec737a7 tempest-AZAdminV2TestJSON-381536434 tempest-AZAdminV2TestJSON-381536434-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:41.448845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4be7d2f9-33e1-4145-865b-4cd64ec737a7 tempest-AZAdminV2TestJSON-381536434 tempest-AZAdminV2TestJSON-381536434-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:41.449308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4be7d2f9-33e1-4145-865b-4cd64ec737a7 tempest-AZAdminV2TestJSON-381536434 tempest-AZAdminV2TestJSON-381536434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:41.449749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4be7d2f9-33e1-4145-865b-4cd64ec737a7 tempest-AZAdminV2TestJSON-381536434 tempest-AZAdminV2TestJSON-381536434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:41.566787 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4be7d2f9-33e1-4145-865b-4cd64ec737a7 tempest-AZAdminV2TestJSON-381536434 tempest-AZAdminV2TestJSON-381536434-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.783772 Oct 04 21:06:41.577983 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 132/277] 10.222.0.30 () {58 vars in 1164 bytes} [Tue Oct 4 21:06:40 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:06:41.587402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f368a632-696f-4195-bd70-d8e404e32b87 tempest-AZAdminV2TestJSON-381536434 tempest-AZAdminV2TestJSON-381536434-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:41.589815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f368a632-696f-4195-bd70-d8e404e32b87 tempest-AZAdminV2TestJSON-381536434 tempest-AZAdminV2TestJSON-381536434-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:41.590682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f368a632-696f-4195-bd70-d8e404e32b87 tempest-AZAdminV2TestJSON-381536434 tempest-AZAdminV2TestJSON-381536434-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:41.591459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f368a632-696f-4195-bd70-d8e404e32b87 tempest-AZAdminV2TestJSON-381536434 tempest-AZAdminV2TestJSON-381536434-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:41.592679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f368a632-696f-4195-bd70-d8e404e32b87 tempest-AZAdminV2TestJSON-381536434 tempest-AZAdminV2TestJSON-381536434-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:41.596381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f368a632-696f-4195-bd70-d8e404e32b87 tempest-AZAdminV2TestJSON-381536434 tempest-AZAdminV2TestJSON-381536434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:41.597131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f368a632-696f-4195-bd70-d8e404e32b87 tempest-AZAdminV2TestJSON-381536434 tempest-AZAdminV2TestJSON-381536434-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:41.673268 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f368a632-696f-4195-bd70-d8e404e32b87 tempest-AZAdminV2TestJSON-381536434 tempest-AZAdminV2TestJSON-381536434-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.089581 Oct 04 21:06:41.676742 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 146/278] 10.222.0.30 () {58 vars in 1185 bytes} [Tue Oct 4 21:06:41 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:42.456745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3c35869e-8cc7-4d96-9dee-d1daaa906c07 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:42.459435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3c35869e-8cc7-4d96-9dee-d1daaa906c07 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:42.464638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c35869e-8cc7-4d96-9dee-d1daaa906c07 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:42.476310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c35869e-8cc7-4d96-9dee-d1daaa906c07 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:42.478934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c35869e-8cc7-4d96-9dee-d1daaa906c07 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:42.481375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c35869e-8cc7-4d96-9dee-d1daaa906c07 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:42.482239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c35869e-8cc7-4d96-9dee-d1daaa906c07 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:42.491743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c35869e-8cc7-4d96-9dee-d1daaa906c07 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:43.070318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=46,nova_cell0:UPDATE=12 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:43.117247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3c35869e-8cc7-4d96-9dee-d1daaa906c07 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:43.127462 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3c35869e-8cc7-4d96-9dee-d1daaa906c07 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 200 len: 1319 microversion: 2.1 time: 0.674358 Oct 04 21:06:43.152681 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 133/279] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:42 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 1319 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:43.707788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-258ec4ee-a568-40cb-96a8-eeeed5e9e8ea tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:43.715589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-258ec4ee-a568-40cb-96a8-eeeed5e9e8ea tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:43.717653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-258ec4ee-a568-40cb-96a8-eeeed5e9e8ea tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:43.718277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-258ec4ee-a568-40cb-96a8-eeeed5e9e8ea tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:43.720126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-258ec4ee-a568-40cb-96a8-eeeed5e9e8ea tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:43.721805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-258ec4ee-a568-40cb-96a8-eeeed5e9e8ea tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:43.722475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-258ec4ee-a568-40cb-96a8-eeeed5e9e8ea tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:43.801507 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-258ec4ee-a568-40cb-96a8-eeeed5e9e8ea tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.714179 Oct 04 21:06:43.802435 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 147/280] 10.222.0.30 () {58 vars in 1176 bytes} [Tue Oct 4 21:06:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:43.816102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7286e991-f4d3-490c-b640-e28f34c4454e tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1293475092"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:43.820696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.aggregate [None req-7286e991-f4d3-490c-b640-e28f34c4454e tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Generated uuid 4da6a363-c7c0-4f01-8c36-782aeefd8783 for aggregate {{(pid=122758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:06:43.954081 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7286e991-f4d3-490c-b640-e28f34c4454e tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.140673 Oct 04 21:06:43.957192 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 134/281] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Oct 4 21:06:43 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:43.976909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a61b2b04-a22a-44bd-9a66-e39ac2a8c823 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860282-1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:44.007833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a61b2b04-a22a-44bd-9a66-e39ac2a8c823 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:44.015102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a61b2b04-a22a-44bd-9a66-e39ac2a8c823 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:44.018567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a61b2b04-a22a-44bd-9a66-e39ac2a8c823 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:44.156136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1ffe04eb-345f-4d7a-b0d2-893ac6ee0e2b tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:44.157043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1ffe04eb-345f-4d7a-b0d2-893ac6ee0e2b tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:44.176973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ffe04eb-345f-4d7a-b0d2-893ac6ee0e2b tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:44.198248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ffe04eb-345f-4d7a-b0d2-893ac6ee0e2b tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:44.202004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ffe04eb-345f-4d7a-b0d2-893ac6ee0e2b tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:44.204619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ffe04eb-345f-4d7a-b0d2-893ac6ee0e2b tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:44.208780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ffe04eb-345f-4d7a-b0d2-893ac6ee0e2b tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:44.212114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ffe04eb-345f-4d7a-b0d2-893ac6ee0e2b tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:44.567648 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a61b2b04-a22a-44bd-9a66-e39ac2a8c823 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.601538 Oct 04 21:06:44.567918 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 148/282] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Oct 4 21:06:43 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:44.579226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1af2d5d7-78d7-4e8b-8d6f-3534ce5c817a tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860282-1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:44.600378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1af2d5d7-78d7-4e8b-8d6f-3534ce5c817a tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:44.602579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1af2d5d7-78d7-4e8b-8d6f-3534ce5c817a tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:44.609823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1af2d5d7-78d7-4e8b-8d6f-3534ce5c817a tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:44.714862 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-1af2d5d7-78d7-4e8b-8d6f-3534ce5c817a tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h1-860282-1. Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1af2d5d7-78d7-4e8b-8d6f-3534ce5c817a tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Request method failure captured: Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 39 Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKBiQDs0mPOhfura_Lc_GGkfj4bEWsSGalFU46gDL1kK_eOKbR3o1mLnYj9KzFuo5uj5xZKPqLCOonxgwc0taAz4p-dWklL4WWWwJe3pE3zzXyFYxomUd3I3WKonxfeENeCJVCmf50N5HvdkrCuvfPUTwY-UYNE5RXtDGI9NwJHsJXE Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f2abe170f2ea4be8abc0f3b4d99b7f20 Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:06:44.738240 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:06:44.739574 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}] Oct 04 21:06:44.739574 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:44.739574 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f2abe170f2ea4be8abc0f3b4d99b7f20 Oct 04 21:06:44.739574 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:44.739574 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin Oct 04 21:06:44.739574 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:44.739574 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:44.739574 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b34c76bf13bb4363b9486f897cd3774b Oct 04 21:06:44.739574 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin Oct 04 21:06:44.739574 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:06:44.739574 n-d-860282-1 devstack@n-api.service[122757]: {"add_host": {"host": "n-h1-860282-1"}} Oct 04 21:06:44.739574 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:06:44.739574 n-d-860282-1 devstack@n-api.service[122757]: exception: Aggregate 11 already has host n-h1-860282-1. Oct 04 21:06:44.740406 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h1-860282-1'}}} Oct 04 21:06:44.740406 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:44.740406 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:44.740406 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 21:06:44.740406 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 21:06:44.740406 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 21:06:44.740406 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 21:06:44.740406 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 21:06:44.740406 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 21:06:44.740406 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 21:06:44.740406 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 21:06:44.740406 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 21:06:44.740406 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 21:06:44.740406 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 21:06:44.740406 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result.read() Oct 04 21:06:44.740406 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 21:06:44.740406 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 21:06:44.740406 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 21:06:44.740406 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 21:06:44.741487 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 21:06:44.741487 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 21:06:44.741487 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 21:06:44.741487 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 21:06:44.741487 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-860282-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 21:06:44.741487 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:44.741487 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 21:06:44.741487 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:44.741487 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:44.741487 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 04 21:06:44.741487 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 04 21:06:44.741487 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 21:06:44.741487 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 21:06:44.741487 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 21:06:44.741487 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 21:06:44.741487 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 21:06:44.741487 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 21:06:44.741487 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 21:06:44.741487 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 21:06:44.743914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 21:06:44.743914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception Oct 04 21:06:44.743914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 21:06:44.743914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 21:06:44.743914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 21:06:44.743914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 21:06:44.743914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 21:06:44.743914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 21:06:44.743914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 21:06:44.743914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 21:06:44.743914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 21:06:44.743914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 21:06:44.743914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 21:06:44.743914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 21:06:44.743914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 21:06:44.743914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 21:06:44.743914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 21:06:44.743914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 21:06:44.745668 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 21:06:44.745668 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 21:06:44.745668 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 21:06:44.745668 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 21:06:44.745668 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 21:06:44.745668 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception Oct 04 21:06:44.745668 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 21:06:44.745668 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 21:06:44.745668 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 21:06:44.745668 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 21:06:44.745668 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 21:06:44.745668 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 21:06:44.745668 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 21:06:44.745668 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 21:06:44.745668 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 21:06:44.745668 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 21:06:44.745668 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 21:06:44.745668 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result.read() Oct 04 21:06:44.750145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 21:06:44.750145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 21:06:44.750145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 21:06:44.750145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 21:06:44.750145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 21:06:44.750145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 21:06:44.750145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 21:06:44.750145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 21:06:44.750145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-860282-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 21:06:44.750145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 04 21:06:44.750145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 21, 6, 44, 668885), 'updated_at': None, 'host': 'n-h1-860282-1', 'aggregate_id': 11}] Oct 04 21:06:44.750145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 21:06:44.750145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:44.750145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:44.750145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:44.750145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:44.750145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h1-860282-1. Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:44.751464 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h1-860282-1. Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:44.752574 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:44.753791 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h1-860282-1. Oct 04 21:06:44.753791 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:44.762383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1af2d5d7-78d7-4e8b-8d6f-3534ce5c817a tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Returning 409 to user: Aggregate 11 already has host n-h1-860282-1. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:44.765207 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1af2d5d7-78d7-4e8b-8d6f-3534ce5c817a tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.189400 Oct 04 21:06:44.772087 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 149/283] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Oct 4 21:06:44 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 197 msecs (HTTP/1.1 409) 9 headers in 377 bytes (2 switches on core 0) Oct 04 21:06:44.787994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f8f4cca7-8f7c-4a84-9520-63574bcd5a6c tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860282-1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:44.859305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8f4cca7-8f7c-4a84-9520-63574bcd5a6c tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:44.859944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8f4cca7-8f7c-4a84-9520-63574bcd5a6c tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:44.860390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8f4cca7-8f7c-4a84-9520-63574bcd5a6c tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:44.909220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1ffe04eb-345f-4d7a-b0d2-893ac6ee0e2b tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:44.922246 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1ffe04eb-345f-4d7a-b0d2-893ac6ee0e2b tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 200 len: 1469 microversion: 2.1 time: 0.771394 Oct 04 21:06:44.922847 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 135/284] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:44 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 1469 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:45.404814 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f8f4cca7-8f7c-4a84-9520-63574bcd5a6c tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.630910 Oct 04 21:06:45.406206 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 150/285] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Oct 4 21:06:44 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:45.418123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0fca7f7c-51cb-47a6-992b-4765d0ab7d10 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:45.521010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-430f1598-a8fb-43ac-af27-c9931ec3549a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1678117831", "block_migration": true, "disk_over_commit": false}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:45.523575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-430f1598-a8fb-43ac-af27-c9931ec3549a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:45.539439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-430f1598-a8fb-43ac-af27-c9931ec3549a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:45.539947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-430f1598-a8fb-43ac-af27-c9931ec3549a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:45.540387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-430f1598-a8fb-43ac-af27-c9931ec3549a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:45.541112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-430f1598-a8fb-43ac-af27-c9931ec3549a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:45.547158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-430f1598-a8fb-43ac-af27-c9931ec3549a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:45.547721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-430f1598-a8fb-43ac-af27-c9931ec3549a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:45.558198 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0fca7f7c-51cb-47a6-992b-4765d0ab7d10 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.143575 Oct 04 21:06:45.567775 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 151/286] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Oct 4 21:06:45 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 21:06:45.571085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bf23434f-e2a6-4c6f-93cb-0aaf2789815e tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2007037264"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:45.579737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.aggregate [None req-bf23434f-e2a6-4c6f-93cb-0aaf2789815e tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Generated uuid f87be3ee-a494-43de-affb-b1dca7e4db0e for aggregate {{(pid=122757) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:06:45.712569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-430f1598-a8fb-43ac-af27-c9931ec3549a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lazy-loading 'flavor' on Instance uuid 3d4e9977-7ff4-4009-914b-6ea126ce63e8 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:06:45.718393 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bf23434f-e2a6-4c6f-93cb-0aaf2789815e tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.148356 Oct 04 21:06:45.720097 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 152/287] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Oct 4 21:06:45 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:45.866787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-430f1598-a8fb-43ac-af27-c9931ec3549a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Going to try to live migrate instance to tempest-host-1678117831 {{(pid=122758) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:06:45.894409 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-430f1598-a8fb-43ac-af27-c9931ec3549a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] HTTP exception thrown: Compute host tempest-host-1678117831 could not be found. Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-430f1598-a8fb-43ac-af27-c9931ec3549a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Request method failure captured: Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8/action HTTP/1.1 Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 107 Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKBMPanXScbqpsedhLAz5ePty687aRzX9e17BeGZM-2IFey_hi8wFzy5Wd8SG8kEq6XHS1rinHw7IeTZiEFuRxm-SBV5irexDN1ytUdD5ulODnQWStRGcU7qjLxietVhdGyswfFs0EWBfhoGyzVgZXcyYPmF1bHwMkpLFDRjPLMRVHw Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 8881fd605941459b81b793da22776eae Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-LiveMigrationNegativeTest-749560113 Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:06:45.918031 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:06:45.925001 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8881fd605941459b81b793da22776eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8881fd605941459b81b793da22776eae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8881fd605941459b81b793da22776eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8881fd605941459b81b793da22776eae"}]}] Oct 04 21:06:45.925001 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-LiveMigrationNegativeTest-749560113 Oct 04 21:06:45.925001 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 8881fd605941459b81b793da22776eae Oct 04 21:06:45.925001 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-749560113 Oct 04 21:06:45.925001 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-LiveMigrationNegativeTest-749560113-project-admin Oct 04 21:06:45.925001 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:06:45.925001 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:06:45.925001 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 978a1bd456954313871887a783a3a16b Oct 04 21:06:45.925001 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-LiveMigrationNegativeTest-749560113-project-admin Oct 04 21:06:45.925001 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:06:45.925001 n-d-860282-1 devstack@n-api.service[122758]: {"os-migrateLive": {"host": "tempest-host-1678117831", "block_migration": true, "disk_over_commit": false}} Oct 04 21:06:45.925001 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:06:45.926002 n-d-860282-1 devstack@n-api.service[122758]: exception: Compute host tempest-host-1678117831 could not be found. Oct 04 21:06:45.926002 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '3d4e9977-7ff4-4009-914b-6ea126ce63e8', 'body': {'os-migrateLive': {'host': 'tempest-host-1678117831', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 21:06:45.926002 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:45.926002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:45.926002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 21:06:45.926002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 21:06:45.926002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 21:06:45.926002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:06:45.926002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 21:06:45.926002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:06:45.926002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 21:06:45.926002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:06:45.926002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 21:06:45.926002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:06:45.926002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 21:06:45.926002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:06:45.926002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 21:06:45.926002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:06:45.926002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:06:45.928852 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:06:45.928852 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 21:06:45.928852 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:06:45.928852 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 04 21:06:45.928852 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 04 21:06:45.928852 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:06:45.928852 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:06:45.928852 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 04 21:06:45.928852 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 04 21:06:45.928852 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 04 21:06:45.928852 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:45.928852 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 04 21:06:45.928852 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 04 21:06:45.928852 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 04 21:06:45.928852 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 04 21:06:45.928852 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 04 21:06:45.928852 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 04 21:06:45.928852 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1678117831 could not be found. Oct 04 21:06:45.928852 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1678117831 could not be found. Oct 04 21:06:45.931735 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:45.934587 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:45.934587 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:45.934587 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:45.934587 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:45.934587 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:45.934587 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:45.934587 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:45.934587 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1678117831 could not be found. Oct 04 21:06:45.934587 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:45.934587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-430f1598-a8fb-43ac-af27-c9931ec3549a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Returning 400 to user: Compute host tempest-host-1678117831 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:45.934587 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-430f1598-a8fb-43ac-af27-c9931ec3549a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8/action" status: 400 len: 100 microversion: 2.1 time: 0.976753 Oct 04 21:06:45.934587 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 136/288] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Oct 4 21:06:44 2022] POST /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8/action => generated 100 bytes in 990 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:06:45.946091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-abd6875c-e8d1-431c-be95-983a4f483a77 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:45.946091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-abd6875c-e8d1-431c-be95-983a4f483a77 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:45.951767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abd6875c-e8d1-431c-be95-983a4f483a77 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:45.952258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abd6875c-e8d1-431c-be95-983a4f483a77 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:45.952703 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abd6875c-e8d1-431c-be95-983a4f483a77 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:45.953409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abd6875c-e8d1-431c-be95-983a4f483a77 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:45.958125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abd6875c-e8d1-431c-be95-983a4f483a77 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:45.958737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abd6875c-e8d1-431c-be95-983a4f483a77 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:46.677577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bc8dc241-bfeb-4f8d-9029-d964f582354b tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860282-1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:46.694838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bc8dc241-bfeb-4f8d-9029-d964f582354b tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '290cee2d2eb5478587c44a9cf354d716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c9c702154b4b80941138506d8fe735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bc8dc241-bfeb-4f8d-9029-d964f582354b tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Request method failure captured: Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 39 Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKBg8k6l3htp2S4r-5eKKw92B_9XEh-nmLuLAq14omCwESSAZcfz4Hs9m9rGZ5Hn9OoOAupsWbrJSulB_4urgofJzabX7orM5VSb04QcccJ-IQHNR5omPFM3FycQMoiAkwCR2-PZHcJOIWCFMDcZ1mpAabWEBPskqEqclMTSZKO-gz4 Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 54c9c702154b4b80941138506d8fe735 Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1737750006 Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:06:46.702157 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:06:46.703451 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/54c9c702154b4b80941138506d8fe735"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_54c9c702154b4b80941138506d8fe735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/54c9c702154b4b80941138506d8fe735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/54c9c702154b4b80941138506d8fe735"}]}] Oct 04 21:06:46.703451 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1737750006 Oct 04 21:06:46.703451 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 54c9c702154b4b80941138506d8fe735 Oct 04 21:06:46.703451 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1737750006 Oct 04 21:06:46.703451 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AggregatesAdminNegativeTestJSON-1737750006-project Oct 04 21:06:46.703451 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:46.703451 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:46.703451 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 290cee2d2eb5478587c44a9cf354d716 Oct 04 21:06:46.703451 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1737750006-project Oct 04 21:06:46.703451 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:06:46.703451 n-d-860282-1 devstack@n-api.service[122757]: {"add_host": {"host": "n-h1-860282-1"}} Oct 04 21:06:46.703451 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:06:46.703451 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 21:06:46.704316 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-860282-1'}}} Oct 04 21:06:46.704316 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:46.704316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:46.704316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:46.704316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:46.704316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:46.704316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:46.704316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:46.704316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:46.704316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:46.704316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:46.704316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 04 21:06:46.704316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 04 21:06:46.704316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:06:46.704316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:06:46.704316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:06:46.704316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:06:46.704316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:06:46.704316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:06:46.705330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:06:46.705330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:06:46.705330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:06:46.705330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:06:46.705330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:06:46.705330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:06:46.705330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:06:46.705330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:06:46.705330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 21:06:46.705330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:46.705330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:46.705330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:46.705330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:46.705330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:46.705330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:46.705330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:06:46.705330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:06:46.705330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 21:06:46.705330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:46.717003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bc8dc241-bfeb-4f8d-9029-d964f582354b tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:46.719134 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bc8dc241-bfeb-4f8d-9029-d964f582354b tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.991274 Oct 04 21:06:46.720075 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 153/289] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Oct 4 21:06:45 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 993 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:06:46.822657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1e349e77-b68f-420f-b46b-58654f2ceb16 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Calling method '.version_select at 0x7f5790e8d4c0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:47.027054 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1e349e77-b68f-420f-b46b-58654f2ceb16 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/f2e89238dc764fe1abd95332e0ac5be0" status: 200 len: 371 microversion: 2.1 time: 0.305239 Oct 04 21:06:47.027650 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 154/290] 10.222.0.30 () {58 vars in 1242 bytes} [Tue Oct 4 21:06:46 2022] GET /compute/v2.1/os-quota-sets/f2e89238dc764fe1abd95332e0ac5be0 => generated 371 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:47.042119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a5591d3d-1bc4-471c-90bc-fdd9e64c6734 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:47.195435 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a5591d3d-1bc4-471c-90bc-fdd9e64c6734 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.155693 Oct 04 21:06:47.206462 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 155/291] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Oct 4 21:06:47 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:06:47.240770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-571aa362-c85e-4ce0-8eb8-544f8a85c704 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Action: 'update', calling method: .version_select at 0x7f5790add550>, body: {"quota_set": {"ram": "5120"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:47.328186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-571aa362-c85e-4ce0-8eb8-544f8a85c704 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:47.330969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-571aa362-c85e-4ce0-8eb8-544f8a85c704 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:47.332008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-571aa362-c85e-4ce0-8eb8-544f8a85c704 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:47.333539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-571aa362-c85e-4ce0-8eb8-544f8a85c704 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:47.334233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-571aa362-c85e-4ce0-8eb8-544f8a85c704 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:47.335073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-571aa362-c85e-4ce0-8eb8-544f8a85c704 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:47.474933 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-571aa362-c85e-4ce0-8eb8-544f8a85c704 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/f2e89238dc764fe1abd95332e0ac5be0" status: 200 len: 328 microversion: 2.1 time: 0.264675 Oct 04 21:06:47.488135 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 156/292] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Oct 4 21:06:47 2022] PUT /compute/v2.1/os-quota-sets/f2e89238dc764fe1abd95332e0ac5be0 => generated 328 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:47.498938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-abd6875c-e8d1-431c-be95-983a4f483a77 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:47.507457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:47.514737 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-abd6875c-e8d1-431c-be95-983a4f483a77 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 200 len: 1469 microversion: 2.1 time: 1.578388 Oct 04 21:06:47.515443 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 137/293] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:45 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 1469 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:47.540551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ea9778ed-dd4c-453a-8087-73e3b062749e tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1455532331"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:47.554457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.aggregate [None req-ea9778ed-dd4c-453a-8087-73e3b062749e tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Generated uuid 040267ce-73a5-4af0-a514-1221534ed60f for aggregate {{(pid=122758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:06:47.619121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3d0b7108-87a4-4ab7-9560-24cbd4f1deb4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-725804309", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "324f5d32-9535-4c31-8532-24f98392bc42"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:47.666931 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ea9778ed-dd4c-453a-8087-73e3b062749e tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.149336 Oct 04 21:06:47.668391 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 138/294] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Oct 4 21:06:47 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:47.675644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ead98249-5ba6-4771-880b-3aa01c45cbde tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:47.787199 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ead98249-5ba6-4771-880b-3aa01c45cbde tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-quota-sets/f2e89238dc764fe1abd95332e0ac5be0" status: 202 len: 0 microversion: 2.1 time: 0.117481 Oct 04 21:06:47.787978 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 139/295] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:06:47 2022] DELETE /compute/v2.1/os-quota-sets/f2e89238dc764fe1abd95332e0ac5be0 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:06:47.793280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e554f6ee-1fef-4de2-8d2a-c98eb25ccbfd tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-251958704"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:47.796248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-3d0b7108-87a4-4ab7-9560-24cbd4f1deb4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] validate_networks() for [('324f5d32-9535-4c31-8532-24f98392bc42', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:06:47.811546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e554f6ee-1fef-4de2-8d2a-c98eb25ccbfd tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:47.812298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e554f6ee-1fef-4de2-8d2a-c98eb25ccbfd tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:47.812910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e554f6ee-1fef-4de2-8d2a-c98eb25ccbfd tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:47.823213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e554f6ee-1fef-4de2-8d2a-c98eb25ccbfd tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:47.823956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e554f6ee-1fef-4de2-8d2a-c98eb25ccbfd tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:47.824727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e554f6ee-1fef-4de2-8d2a-c98eb25ccbfd tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:47.839599 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-e554f6ee-1fef-4de2-8d2a-c98eb25ccbfd tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-251958704 could not be found. Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e554f6ee-1fef-4de2-8d2a-c98eb25ccbfd tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Request method failure captured: Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 57 Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKBiQDs0mPOhfura_Lc_GGkfj4bEWsSGalFU46gDL1kK_eOKbR3o1mLnYj9KzFuo5uj5xZKPqLCOonxgwc0taAz4p-dWklL4WWWwJe3pE3zzXyFYxomUd3I3WKonxfeENeCJVCmf50N5HvdkrCuvfPUTwY-UYNE5RXtDGI9NwJHsJXE Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f2abe170f2ea4be8abc0f3b4d99b7f20 Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:06:47.842736 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:06:47.844279 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}] Oct 04 21:06:47.844279 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:47.844279 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f2abe170f2ea4be8abc0f3b4d99b7f20 Oct 04 21:06:47.844279 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:47.844279 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin Oct 04 21:06:47.844279 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:06:47.844279 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:06:47.844279 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: b34c76bf13bb4363b9486f897cd3774b Oct 04 21:06:47.844279 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin Oct 04 21:06:47.844279 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:06:47.844279 n-d-860282-1 devstack@n-api.service[122758]: {"add_host": {"host": "tempest-nonexist_host-251958704"}} Oct 04 21:06:47.844279 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:06:47.844279 n-d-860282-1 devstack@n-api.service[122758]: exception: Compute host tempest-nonexist_host-251958704 could not be found. Oct 04 21:06:47.845198 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-251958704'}}} Oct 04 21:06:47.845198 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:47.845198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:47.845198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 21:06:47.845198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 21:06:47.845198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:06:47.845198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:06:47.845198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 21:06:47.845198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 21:06:47.845198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:06:47.845198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:06:47.845198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 21:06:47.845198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 21:06:47.845198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-251958704' is not mapped to any cell Oct 04 21:06:47.845198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:47.845198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:47.845198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:47.845198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:47.845198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 04 21:06:47.853769 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-251958704 could not be found. Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-251958704 could not be found. Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:47.855268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:47.856808 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:47.856808 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:47.856808 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:47.856808 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:47.856808 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:47.856808 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-251958704 could not be found. Oct 04 21:06:47.856808 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:47.856808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e554f6ee-1fef-4de2-8d2a-c98eb25ccbfd tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-251958704 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:47.856808 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e554f6ee-1fef-4de2-8d2a-c98eb25ccbfd tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.063159 Oct 04 21:06:47.858048 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 140/296] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Oct 4 21:06:47 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:06:47.867191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ca7ab660-d79c-4e14-940c-ecfcbd62fb81 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2005146110", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:48.014458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-ca7ab660-d79c-4e14-940c-ecfcbd62fb81 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:06:48.836333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ca7ab660-d79c-4e14-940c-ecfcbd62fb81 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:06:48.836901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ca7ab660-d79c-4e14-940c-ecfcbd62fb81 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:06:48.837464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ca7ab660-d79c-4e14-940c-ecfcbd62fb81 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:06:48.837980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ca7ab660-d79c-4e14-940c-ecfcbd62fb81 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:06:48.838557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ca7ab660-d79c-4e14-940c-ecfcbd62fb81 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:06:48.863849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca7ab660-d79c-4e14-940c-ecfcbd62fb81 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:48.864420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca7ab660-d79c-4e14-940c-ecfcbd62fb81 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:48.869180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca7ab660-d79c-4e14-940c-ecfcbd62fb81 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:48.869180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca7ab660-d79c-4e14-940c-ecfcbd62fb81 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:48.869180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca7ab660-d79c-4e14-940c-ecfcbd62fb81 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:48.869180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca7ab660-d79c-4e14-940c-ecfcbd62fb81 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:48.907065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ca7ab660-d79c-4e14-940c-ecfcbd62fb81 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Getting quotas for project 6d56154e7fa646268a5c726e278c010e. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:06:48.908529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ca7ab660-d79c-4e14-940c-ecfcbd62fb81 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Getting quotas for user 4454733cee334f368ee2048c3a32d7f0 and project 6d56154e7fa646268a5c726e278c010e. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:06:48.926268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ca7ab660-d79c-4e14-940c-ecfcbd62fb81 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:06:48.931397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ca7ab660-d79c-4e14-940c-ecfcbd62fb81 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:06:49.101933 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ca7ab660-d79c-4e14-940c-ecfcbd62fb81 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.237038 Oct 04 21:06:49.102782 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 141/297] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:06:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:06:49.115086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-60d628e1-8f25-4bce-bfbe-5f39e34a80d3 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Calling method '.version_select at 0x7f5790c9cb80>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:49.412150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-3d0b7108-87a4-4ab7-9560-24cbd4f1deb4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:06:49.413142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-3d0b7108-87a4-4ab7-9560-24cbd4f1deb4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:06:49.414242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-3d0b7108-87a4-4ab7-9560-24cbd4f1deb4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:06:49.415825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-3d0b7108-87a4-4ab7-9560-24cbd4f1deb4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:06:49.416576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-3d0b7108-87a4-4ab7-9560-24cbd4f1deb4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:06:49.463467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d0b7108-87a4-4ab7-9560-24cbd4f1deb4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:49.474261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d0b7108-87a4-4ab7-9560-24cbd4f1deb4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:49.475109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d0b7108-87a4-4ab7-9560-24cbd4f1deb4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:49.476544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d0b7108-87a4-4ab7-9560-24cbd4f1deb4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:49.477328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d0b7108-87a4-4ab7-9560-24cbd4f1deb4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:49.502657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d0b7108-87a4-4ab7-9560-24cbd4f1deb4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:49.605575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-3d0b7108-87a4-4ab7-9560-24cbd4f1deb4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Getting quotas for project 7e9215d1ae0947ce84469bed21fc05ac. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:06:49.628219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-3d0b7108-87a4-4ab7-9560-24cbd4f1deb4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Getting quotas for user 8bfa449eb3144332afa616cc85d9643f and project 7e9215d1ae0947ce84469bed21fc05ac. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:06:49.640479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:DELETE=9,nova_api:SELECT=87,nova_api:INSERT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:49.686737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3d0b7108-87a4-4ab7-9560-24cbd4f1deb4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:06:49.695942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3d0b7108-87a4-4ab7-9560-24cbd4f1deb4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:06:49.897143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=8,nova_api:UPDATE=12,nova_api:DELETE=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:49.926155 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-60d628e1-8f25-4bce-bfbe-5f39e34a80d3 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/f2e89238dc764fe1abd95332e0ac5be0" status: 200 len: 371 microversion: 2.1 time: 0.822063 Oct 04 21:06:49.934355 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 142/298] 10.222.0.30 () {58 vars in 1242 bytes} [Tue Oct 4 21:06:49 2022] GET /compute/v2.1/os-quota-sets/f2e89238dc764fe1abd95332e0ac5be0 => generated 371 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:49.942154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-df7b6e34-94d2-4f20-8fc9-f830150207d0 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:49.955368 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3d0b7108-87a4-4ab7-9560-24cbd4f1deb4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.462409 Oct 04 21:06:49.956653 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 157/299] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:06:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:06:49.987112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c67c0b74-0a46-4164-8b4d-d25863001cc5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:50.000637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c67c0b74-0a46-4164-8b4d-d25863001cc5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:50.098182 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-df7b6e34-94d2-4f20-8fc9-f830150207d0 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.166636 Oct 04 21:06:50.099308 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 143/300] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Oct 4 21:06:49 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:06:50.110637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2cfb18b7-7ca0-494d-ac4d-c467f21da840 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:50.120441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2cfb18b7-7ca0-494d-ac4d-c467f21da840 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:50.377162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c67c0b74-0a46-4164-8b4d-d25863001cc5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:50.390217 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c67c0b74-0a46-4164-8b4d-d25863001cc5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1219 microversion: 2.1 time: 0.432213 Oct 04 21:06:50.406898 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 158/301] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:49 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1219 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:50.407028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2cfb18b7-7ca0-494d-ac4d-c467f21da840 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:50.413088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f753b736-6827-4c9e-a629-45f3473e09c8 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:50.416853 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2cfb18b7-7ca0-494d-ac4d-c467f21da840 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1210 microversion: 2.1 time: 0.316408 Oct 04 21:06:50.424696 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 144/302] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:50 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1210 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f753b736-6827-4c9e-a629-45f3473e09c8 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Request method failure captured: Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 283 Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKBiQDs0mPOhfura_Lc_GGkfj4bEWsSGalFU46gDL1kK_eOKbR3o1mLnYj9KzFuo5uj5xZKPqLCOonxgwc0taAz4p-dWklL4WWWwJe3pE3zzXyFYxomUd3I3WKonxfeENeCJVCmf50N5HvdkrCuvfPUTwY-UYNE5RXtDGI9NwJHsJXE Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f2abe170f2ea4be8abc0f3b4d99b7f20 Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:06:50.459887 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:06:50.461320 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}] Oct 04 21:06:50.461320 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:50.461320 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f2abe170f2ea4be8abc0f3b4d99b7f20 Oct 04 21:06:50.461320 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:50.461320 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin Oct 04 21:06:50.461320 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:50.461320 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:50.461320 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b34c76bf13bb4363b9486f897cd3774b Oct 04 21:06:50.461320 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin Oct 04 21:06:50.461320 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:06:50.462105 n-d-860282-1 devstack@n-api.service[122757]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 21:06:50.462105 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:06:50.462105 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:06:50.462105 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 21:06:50.462105 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:50.462105 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:50.462105 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:06:50.462105 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:06:50.462105 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:06:50.462105 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:06:50.462864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:06:50.462864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.462864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 21:06:50.462864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 21:06:50.462864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.462864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 21:06:50.462864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 21:06:50.462864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.462864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:50.462864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.462864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:50.462864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:50.462864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:50.462864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:50.462864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:50.462864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:50.462864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:50.464005 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:50.464005 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:50.464005 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:06:50.464005 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:06:50.464005 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:06:50.464005 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:06:50.464005 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:06:50.464005 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:06:50.464005 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:06:50.464005 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.464005 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:50.464005 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.464005 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:50.464005 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:50.464005 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:50.465023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:06:50.465023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:06:50.465023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:06:50.465023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.465023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f753b736-6827-4c9e-a629-45f3473e09c8 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:50.465402 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f753b736-6827-4c9e-a629-45f3473e09c8 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.066489 Oct 04 21:06:50.475914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8a9f0cb8-8810-423d-9a60-1465d7d2d63d tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8a9f0cb8-8810-423d-9a60-1465d7d2d63d tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Request method failure captured: Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 27 Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKBiQDs0mPOhfura_Lc_GGkfj4bEWsSGalFU46gDL1kK_eOKbR3o1mLnYj9KzFuo5uj5xZKPqLCOonxgwc0taAz4p-dWklL4WWWwJe3pE3zzXyFYxomUd3I3WKonxfeENeCJVCmf50N5HvdkrCuvfPUTwY-UYNE5RXtDGI9NwJHsJXE Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f2abe170f2ea4be8abc0f3b4d99b7f20 Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:06:50.487129 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:06:50.488737 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}] Oct 04 21:06:50.488737 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:50.488737 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f2abe170f2ea4be8abc0f3b4d99b7f20 Oct 04 21:06:50.488737 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:50.488737 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin Oct 04 21:06:50.488737 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:06:50.488737 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:06:50.488737 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: b34c76bf13bb4363b9486f897cd3774b Oct 04 21:06:50.488737 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin Oct 04 21:06:50.488737 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:06:50.488737 n-d-860282-1 devstack@n-api.service[122758]: {"aggregate": {"name": ""}} Oct 04 21:06:50.488737 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:06:50.488737 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi '' Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:50.489685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:06:50.491469 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.492795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8a9f0cb8-8810-423d-9a60-1465d7d2d63d tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:50.492887 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 159/303] 10.222.0.30 () {60 vars in 1165 bytes} [Tue Oct 4 21:06:50 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:06:50.496633 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8a9f0cb8-8810-423d-9a60-1465d7d2d63d tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.025576 Oct 04 21:06:50.507626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-29848d23-0150-4430-a074-400caa62ae2a tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1052035769"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:50.513997 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 145/304] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Oct 4 21:06:50 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-29848d23-0150-4430-a074-400caa62ae2a tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '290cee2d2eb5478587c44a9cf354d716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c9c702154b4b80941138506d8fe735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-29848d23-0150-4430-a074-400caa62ae2a tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Request method failure captured: Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 60 Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKBg8k6l3htp2S4r-5eKKw92B_9XEh-nmLuLAq14omCwESSAZcfz4Hs9m9rGZ5Hn9OoOAupsWbrJSulB_4urgofJzabX7orM5VSb04QcccJ-IQHNR5omPFM3FycQMoiAkwCR2-PZHcJOIWCFMDcZ1mpAabWEBPskqEqclMTSZKO-gz4 Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 54c9c702154b4b80941138506d8fe735 Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1737750006 Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:06:50.514307 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:06:50.515815 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/54c9c702154b4b80941138506d8fe735"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_54c9c702154b4b80941138506d8fe735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/54c9c702154b4b80941138506d8fe735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/54c9c702154b4b80941138506d8fe735"}]}] Oct 04 21:06:50.515815 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1737750006 Oct 04 21:06:50.515815 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 54c9c702154b4b80941138506d8fe735 Oct 04 21:06:50.515815 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1737750006 Oct 04 21:06:50.515815 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AggregatesAdminNegativeTestJSON-1737750006-project Oct 04 21:06:50.515815 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:50.515815 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:50.515815 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 290cee2d2eb5478587c44a9cf354d716 Oct 04 21:06:50.515815 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1737750006-project Oct 04 21:06:50.515815 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:06:50.515815 n-d-860282-1 devstack@n-api.service[122757]: {"aggregate": {"name": "tempest-test_aggregate-1052035769"}} Oct 04 21:06:50.515815 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:06:50.515815 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 21:06:50.516702 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1052035769'}}} Oct 04 21:06:50.516702 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:50.516702 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:50.516702 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:50.516702 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:50.516702 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:50.516702 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:50.516702 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:50.516702 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:50.516702 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:50.516702 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:50.516702 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:50.516702 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:50.516702 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 04 21:06:50.516702 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 04 21:06:50.516702 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:06:50.516702 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:06:50.516702 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:06:50.516702 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:06:50.518037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 21:06:50.519315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.519315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-29848d23-0150-4430-a074-400caa62ae2a tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:50.526736 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-29848d23-0150-4430-a074-400caa62ae2a tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.014573 Oct 04 21:06:50.533231 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 160/305] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Oct 4 21:06:50 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:06:50.539630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b6633029-7a9a-4b3f-b2cf-1d61a2cf237c tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1749568445"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:50.543664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.aggregate [None req-b6633029-7a9a-4b3f-b2cf-1d61a2cf237c tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Generated uuid 2363769f-31e1-4de7-a0b8-091b4c9837d1 for aggregate {{(pid=122758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:06:50.657940 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b6633029-7a9a-4b3f-b2cf-1d61a2cf237c tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.122509 Oct 04 21:06:50.659265 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 146/306] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Oct 4 21:06:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:50.671287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a57ad925-fd7c-4d19-b170-3bcb7be35436 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1749568445"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:50.682112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.aggregate [None req-a57ad925-fd7c-4d19-b170-3bcb7be35436 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Generated uuid 4078c64a-7267-4baf-bc0c-e9e8df7eb204 for aggregate {{(pid=122757) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:06:50.695170 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-a57ad925-fd7c-4d19-b170-3bcb7be35436 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1749568445 already exists. Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a57ad925-fd7c-4d19-b170-3bcb7be35436 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Request method failure captured: Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 60 Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKBiQDs0mPOhfura_Lc_GGkfj4bEWsSGalFU46gDL1kK_eOKbR3o1mLnYj9KzFuo5uj5xZKPqLCOonxgwc0taAz4p-dWklL4WWWwJe3pE3zzXyFYxomUd3I3WKonxfeENeCJVCmf50N5HvdkrCuvfPUTwY-UYNE5RXtDGI9NwJHsJXE Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f2abe170f2ea4be8abc0f3b4d99b7f20 Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:06:50.696920 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:06:50.698376 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}] Oct 04 21:06:50.698376 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:50.698376 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f2abe170f2ea4be8abc0f3b4d99b7f20 Oct 04 21:06:50.698376 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:50.698376 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin Oct 04 21:06:50.698376 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:50.698376 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:50.698376 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b34c76bf13bb4363b9486f897cd3774b Oct 04 21:06:50.698376 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin Oct 04 21:06:50.698376 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:06:50.698376 n-d-860282-1 devstack@n-api.service[122757]: {"aggregate": {"name": "tempest-test_aggregate-1749568445"}} Oct 04 21:06:50.698376 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:06:50.698376 n-d-860282-1 devstack@n-api.service[122757]: exception: Aggregate tempest-test_aggregate-1749568445 already exists. Oct 04 21:06:50.699291 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1749568445'}}} Oct 04 21:06:50.699291 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:50.699291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:50.699291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 04 21:06:50.699291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 04 21:06:50.699291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:06:50.699291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:06:50.699291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:06:50.699291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:06:50.699291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:06:50.699291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:06:50.699291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:06:50.699291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:06:50.699291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 04 21:06:50.699291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 04 21:06:50.699291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 21:06:50.699291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 21:06:50.699291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 04 21:06:50.699291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1749568445 already exists. Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:50.701108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 04 21:06:50.702570 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 21:06:50.702570 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1749568445 already exists. Oct 04 21:06:50.702570 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.702570 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:50.702570 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.702570 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:50.702570 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:50.702570 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:50.702570 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:50.702570 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:50.702570 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1749568445 already exists. Oct 04 21:06:50.702570 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:50.702570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a57ad925-fd7c-4d19-b170-3bcb7be35436 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1749568445 already exists. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:50.702570 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a57ad925-fd7c-4d19-b170-3bcb7be35436 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.031832 Oct 04 21:06:50.703511 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 161/307] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Oct 4 21:06:50 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 35 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:06:50.707634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-299bfc23-bb82-4749-800a-041b225ec62b tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:50.733747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-87b5fbcd-2c11-44ea-9da2-a54e817e9c6e tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Calling method '.version_select at 0x7f5790aec5e0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:50.819713 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-299bfc23-bb82-4749-800a-041b225ec62b tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.115938 Oct 04 21:06:50.821293 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 147/308] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Oct 4 21:06:50 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:06:50.832540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3928512f-180e-4b7c-bc39-8f56d640b616 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-681279750"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:50.840498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.aggregate [None req-3928512f-180e-4b7c-bc39-8f56d640b616 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Generated uuid b0a35588-a4f5-4c9e-bda9-1624542eaeec for aggregate {{(pid=122758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:06:51.000232 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3928512f-180e-4b7c-bc39-8f56d640b616 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.173203 Oct 04 21:06:51.002517 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 148/309] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Oct 4 21:06:50 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:51.019707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8668225f-05d6-48b2-b38b-50790706c6b9 tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:51.025139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8668225f-05d6-48b2-b38b-50790706c6b9 tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '290cee2d2eb5478587c44a9cf354d716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c9c702154b4b80941138506d8fe735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8668225f-05d6-48b2-b38b-50790706c6b9 tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Request method failure captured: Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKBg8k6l3htp2S4r-5eKKw92B_9XEh-nmLuLAq14omCwESSAZcfz4Hs9m9rGZ5Hn9OoOAupsWbrJSulB_4urgofJzabX7orM5VSb04QcccJ-IQHNR5omPFM3FycQMoiAkwCR2-PZHcJOIWCFMDcZ1mpAabWEBPskqEqclMTSZKO-gz4 Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 54c9c702154b4b80941138506d8fe735 Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1737750006 Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:06:51.031535 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:06:51.033091 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/54c9c702154b4b80941138506d8fe735"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_54c9c702154b4b80941138506d8fe735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/54c9c702154b4b80941138506d8fe735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/54c9c702154b4b80941138506d8fe735"}]}] Oct 04 21:06:51.033091 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1737750006 Oct 04 21:06:51.033091 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 54c9c702154b4b80941138506d8fe735 Oct 04 21:06:51.033091 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1737750006 Oct 04 21:06:51.033091 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AggregatesAdminNegativeTestJSON-1737750006-project Oct 04 21:06:51.033091 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:06:51.033091 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:06:51.033091 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 290cee2d2eb5478587c44a9cf354d716 Oct 04 21:06:51.033091 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1737750006-project Oct 04 21:06:51.033091 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:06:51.033091 n-d-860282-1 devstack@n-api.service[122758]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 21:06:51.033091 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '15'} Oct 04 21:06:51.033956 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:51.033956 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:51.033956 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:51.033956 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:51.033956 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:51.033956 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:51.033956 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:51.033956 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:51.033956 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 04 21:06:51.033956 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 04 21:06:51.033956 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:06:51.033956 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:06:51.033956 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:06:51.033956 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:06:51.033956 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:06:51.033956 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:06:51.033956 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:06:51.033956 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:06:51.033956 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:06:51.035719 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:06:51.035719 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:06:51.035719 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:06:51.035719 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:06:51.035719 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:06:51.035719 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 21:06:51.035719 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:51.035719 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:51.035719 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:51.035719 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:51.035719 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:51.035719 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:51.035719 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:06:51.035719 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:06:51.035719 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 21:06:51.035719 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:51.045678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8668225f-05d6-48b2-b38b-50790706c6b9 tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:51.052207 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8668225f-05d6-48b2-b38b-50790706c6b9 tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.036752 Oct 04 21:06:51.052207 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 149/310] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Oct 4 21:06:51 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:06:51.106817 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-748979eb-4b5d-45cf-97ae-04474bb08c4f tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:51.242592 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-87b5fbcd-2c11-44ea-9da2-a54e817e9c6e tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/5a5278d4fa3740bda2baf45e8fff3772/defaults" status: 200 len: 371 microversion: 2.1 time: 0.516314 Oct 04 21:06:51.243170 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 162/311] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Oct 4 21:06:50 2022] GET /compute/v2.1/os-quota-sets/5a5278d4fa3740bda2baf45e8fff3772/defaults => generated 371 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:51.333500 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-748979eb-4b5d-45cf-97ae-04474bb08c4f tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.242580 Oct 04 21:06:51.337054 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 150/312] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Oct 4 21:06:51 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:06:51.346911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-84ec62c5-836c-4c7d-8889-cceec1b83f39 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:51.374025 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-84ec62c5-836c-4c7d-8889-cceec1b83f39 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-84ec62c5-836c-4c7d-8889-cceec1b83f39 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Request method failure captured: Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKBiQDs0mPOhfura_Lc_GGkfj4bEWsSGalFU46gDL1kK_eOKbR3o1mLnYj9KzFuo5uj5xZKPqLCOonxgwc0taAz4p-dWklL4WWWwJe3pE3zzXyFYxomUd3I3WKonxfeENeCJVCmf50N5HvdkrCuvfPUTwY-UYNE5RXtDGI9NwJHsJXE Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f2abe170f2ea4be8abc0f3b4d99b7f20 Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:06:51.386756 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:06:51.389767 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}] Oct 04 21:06:51.389767 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:51.389767 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f2abe170f2ea4be8abc0f3b4d99b7f20 Oct 04 21:06:51.389767 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:51.389767 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin Oct 04 21:06:51.389767 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:51.389767 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:51.389767 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b34c76bf13bb4363b9486f897cd3774b Oct 04 21:06:51.389767 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin Oct 04 21:06:51.389767 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:06:51.389767 n-d-860282-1 devstack@n-api.service[122757]: exception: Aggregate -1 could not be found. Oct 04 21:06:51.389767 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '-1'} Oct 04 21:06:51.390594 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:51.390594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:51.390594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 21:06:51.390594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 21:06:51.390594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:06:51.390594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:06:51.390594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:06:51.390594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:06:51.390594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:06:51.390594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:06:51.390594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:06:51.390594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:06:51.390594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 21:06:51.390594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 21:06:51.390594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:06:51.390594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:06:51.390594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 21:06:51.390594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 21:06:51.390594 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:51.391853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:51.393247 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:51.393247 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:51.393247 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:51.393247 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:51.393247 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 21:06:51.393247 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:51.394295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-84ec62c5-836c-4c7d-8889-cceec1b83f39 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:51.398782 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-84ec62c5-836c-4c7d-8889-cceec1b83f39 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.057913 Oct 04 21:06:51.399851 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 163/313] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Oct 4 21:06:51 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:06:51.412426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-09685fc5-29f7-4b11-8a93-0f6c453cee31 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1610377761"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:51.421839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.aggregate [None req-09685fc5-29f7-4b11-8a93-0f6c453cee31 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Generated uuid 0c0bce4c-01e2-4e9f-a978-d4d88952cc7d for aggregate {{(pid=122758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:06:51.425269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-00b0fecd-a9ef-4029-875e-2ee154197df1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:51.433639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-00b0fecd-a9ef-4029-875e-2ee154197df1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:51.455819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00b0fecd-a9ef-4029-875e-2ee154197df1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:51.456335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00b0fecd-a9ef-4029-875e-2ee154197df1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:51.456784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00b0fecd-a9ef-4029-875e-2ee154197df1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:51.464151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00b0fecd-a9ef-4029-875e-2ee154197df1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:51.464652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00b0fecd-a9ef-4029-875e-2ee154197df1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:51.465103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00b0fecd-a9ef-4029-875e-2ee154197df1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:51.534856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:51.612212 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-09685fc5-29f7-4b11-8a93-0f6c453cee31 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.204142 Oct 04 21:06:51.613916 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 151/314] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Oct 4 21:06:51 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:51.621778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-56b77399-402d-47f0-b0c7-e075186ddd43 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:51.622924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-56b77399-402d-47f0-b0c7-e075186ddd43 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:51.628087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-00b0fecd-a9ef-4029-875e-2ee154197df1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:51.642270 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-00b0fecd-a9ef-4029-875e-2ee154197df1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1223 microversion: 2.1 time: 0.224983 Oct 04 21:06:51.651246 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 164/315] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:51 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1223 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:51.670598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3b13659a-05ee-453f-80bb-aba139585c73 tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:51.674167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3b13659a-05ee-453f-80bb-aba139585c73 tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '290cee2d2eb5478587c44a9cf354d716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c9c702154b4b80941138506d8fe735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3b13659a-05ee-453f-80bb-aba139585c73 tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Request method failure captured: Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKBg8k6l3htp2S4r-5eKKw92B_9XEh-nmLuLAq14omCwESSAZcfz4Hs9m9rGZ5Hn9OoOAupsWbrJSulB_4urgofJzabX7orM5VSb04QcccJ-IQHNR5omPFM3FycQMoiAkwCR2-PZHcJOIWCFMDcZ1mpAabWEBPskqEqclMTSZKO-gz4 Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 54c9c702154b4b80941138506d8fe735 Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1737750006 Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:06:51.679975 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:06:51.681614 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/54c9c702154b4b80941138506d8fe735"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_54c9c702154b4b80941138506d8fe735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/54c9c702154b4b80941138506d8fe735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/54c9c702154b4b80941138506d8fe735"}]}] Oct 04 21:06:51.681614 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1737750006 Oct 04 21:06:51.681614 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 54c9c702154b4b80941138506d8fe735 Oct 04 21:06:51.681614 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1737750006 Oct 04 21:06:51.681614 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AggregatesAdminNegativeTestJSON-1737750006-project Oct 04 21:06:51.681614 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:51.681614 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:51.681614 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 290cee2d2eb5478587c44a9cf354d716 Oct 04 21:06:51.681614 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1737750006-project Oct 04 21:06:51.681614 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:06:51.681614 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 21:06:51.681614 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '16'} Oct 04 21:06:51.682638 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:51.682638 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:51.682638 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:51.682638 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:51.682638 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:51.682638 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:51.682638 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:51.682638 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:51.682638 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 04 21:06:51.682638 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 04 21:06:51.682638 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:06:51.682638 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:06:51.682638 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:06:51.682638 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:06:51.682638 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:06:51.682638 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:06:51.682638 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:06:51.682638 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:06:51.682638 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:06:51.683799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:06:51.683799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:06:51.683799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:06:51.683799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:06:51.683799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:06:51.683799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 21:06:51.683799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:51.683799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:51.683799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:51.683799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:51.683799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:51.683799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:51.683799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:06:51.683799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:06:51.683799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 21:06:51.683799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:51.689173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3b13659a-05ee-453f-80bb-aba139585c73 tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:51.698432 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3b13659a-05ee-453f-80bb-aba139585c73 tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] 10.222.0.30 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.042157 Oct 04 21:06:51.699220 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 165/316] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:06:51 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:06:51.715784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eb0a2710-2732-4bc0-92b3-aca55f53b64d tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:51.789014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-56b77399-402d-47f0-b0c7-e075186ddd43 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:51.798158 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-56b77399-402d-47f0-b0c7-e075186ddd43 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1210 microversion: 2.1 time: 0.182090 Oct 04 21:06:51.799068 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 152/317] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:51 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1210 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:51.846360 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eb0a2710-2732-4bc0-92b3-aca55f53b64d tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.139383 Oct 04 21:06:51.854810 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 166/318] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Oct 4 21:06:51 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:06:51.863000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f5a448bc-7a10-4b9a-8307-08bd81a7d769 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:51.876056 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-f5a448bc-7a10-4b9a-8307-08bd81a7d769 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f5a448bc-7a10-4b9a-8307-08bd81a7d769 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Request method failure captured: Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKBiQDs0mPOhfura_Lc_GGkfj4bEWsSGalFU46gDL1kK_eOKbR3o1mLnYj9KzFuo5uj5xZKPqLCOonxgwc0taAz4p-dWklL4WWWwJe3pE3zzXyFYxomUd3I3WKonxfeENeCJVCmf50N5HvdkrCuvfPUTwY-UYNE5RXtDGI9NwJHsJXE Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f2abe170f2ea4be8abc0f3b4d99b7f20 Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:06:51.879675 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:06:51.890789 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}] Oct 04 21:06:51.890789 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:51.890789 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f2abe170f2ea4be8abc0f3b4d99b7f20 Oct 04 21:06:51.890789 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:51.890789 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin Oct 04 21:06:51.890789 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:06:51.890789 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:06:51.890789 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: b34c76bf13bb4363b9486f897cd3774b Oct 04 21:06:51.890789 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin Oct 04 21:06:51.890789 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:06:51.890789 n-d-860282-1 devstack@n-api.service[122758]: exception: Aggregate -1 could not be found. Oct 04 21:06:51.890789 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '-1'} Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:51.892357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:51.893873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:51.893873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:51.893873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:51.893873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:51.893873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:51.893873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 21:06:51.893873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:06:51.893873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 21:06:51.893873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:51.893873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:51.893873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:51.893873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:51.893873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:51.893873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:51.893873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:51.893873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:51.893873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 21:06:51.893873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:51.895051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f5a448bc-7a10-4b9a-8307-08bd81a7d769 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:51.895051 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f5a448bc-7a10-4b9a-8307-08bd81a7d769 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.025022 Oct 04 21:06:51.895051 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 153/319] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:06:51 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:06:51.895374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-384f4447-1e3a-4ac0-bbf4-eebd3277fb52 tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:51.897302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-384f4447-1e3a-4ac0-bbf4-eebd3277fb52 tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '290cee2d2eb5478587c44a9cf354d716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c9c702154b4b80941138506d8fe735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-384f4447-1e3a-4ac0-bbf4-eebd3277fb52 tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Request method failure captured: Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKBg8k6l3htp2S4r-5eKKw92B_9XEh-nmLuLAq14omCwESSAZcfz4Hs9m9rGZ5Hn9OoOAupsWbrJSulB_4urgofJzabX7orM5VSb04QcccJ-IQHNR5omPFM3FycQMoiAkwCR2-PZHcJOIWCFMDcZ1mpAabWEBPskqEqclMTSZKO-gz4 Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 54c9c702154b4b80941138506d8fe735 Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1737750006 Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:06:51.898088 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:06:51.899448 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/54c9c702154b4b80941138506d8fe735"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_54c9c702154b4b80941138506d8fe735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/54c9c702154b4b80941138506d8fe735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/54c9c702154b4b80941138506d8fe735"}]}] Oct 04 21:06:51.899448 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1737750006 Oct 04 21:06:51.899448 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 54c9c702154b4b80941138506d8fe735 Oct 04 21:06:51.899448 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1737750006 Oct 04 21:06:51.899448 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AggregatesAdminNegativeTestJSON-1737750006-project Oct 04 21:06:51.899448 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:51.899448 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:51.899448 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 290cee2d2eb5478587c44a9cf354d716 Oct 04 21:06:51.899448 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1737750006-project Oct 04 21:06:51.899448 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:06:51.899448 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 21:06:51.899448 n-d-860282-1 devstack@n-api.service[122757]: action_args: {} Oct 04 21:06:51.905307 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:51.905307 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:51.905307 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:51.905307 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:51.905307 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:51.905307 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:51.905307 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:51.905307 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:51.905307 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 04 21:06:51.905307 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 04 21:06:51.905307 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:06:51.905307 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:06:51.905307 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:06:51.905307 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:06:51.905307 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:06:51.905307 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:06:51.905307 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:06:51.905307 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:06:51.905307 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:06:51.906584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:06:51.906584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:06:51.906584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:06:51.906584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:06:51.906584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:06:51.906584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 21:06:51.906584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:51.906584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:51.906584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:51.906584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:51.906584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:51.906584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:51.906584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:06:51.906584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:06:51.906584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 21:06:51.906584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:51.906584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-384f4447-1e3a-4ac0-bbf4-eebd3277fb52 tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:51.907750 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-384f4447-1e3a-4ac0-bbf4-eebd3277fb52 tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.008552 Oct 04 21:06:51.907750 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 167/320] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Oct 4 21:06:51 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:06:51.910648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d6924872-afe5-4f5e-9b65-f46068f9cc51 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1143602835"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:51.917515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.aggregate [None req-d6924872-afe5-4f5e-9b65-f46068f9cc51 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Generated uuid 5fc37df3-015e-46fd-aa3e-ac28a0e8eaaf for aggregate {{(pid=122758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:06:52.047931 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d6924872-afe5-4f5e-9b65-f46068f9cc51 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.141360 Oct 04 21:06:52.049598 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 154/321] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Oct 4 21:06:51 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:52.069372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-66416f00-c716-4175-a0a6-c9acfee8a5f7 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860282-1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:52.117256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66416f00-c716-4175-a0a6-c9acfee8a5f7 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:52.120184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66416f00-c716-4175-a0a6-c9acfee8a5f7 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:52.122826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66416f00-c716-4175-a0a6-c9acfee8a5f7 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:52.288749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1e63acf1-41b2-40e5-bd90-5e7cbf6c709a tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Action: 'update', calling method: .version_select at 0x7f5790b64af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:52.586036 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-66416f00-c716-4175-a0a6-c9acfee8a5f7 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.529341 Oct 04 21:06:52.587340 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 168/322] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Oct 4 21:06:52 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:52.605804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1fc92f2c-cfbc-4c1a-b08f-9b7af8d0bf4a tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860282-1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:52.613444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1fc92f2c-cfbc-4c1a-b08f-9b7af8d0bf4a tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '290cee2d2eb5478587c44a9cf354d716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c9c702154b4b80941138506d8fe735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1fc92f2c-cfbc-4c1a-b08f-9b7af8d0bf4a tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Request method failure captured: Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 42 Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKBg8k6l3htp2S4r-5eKKw92B_9XEh-nmLuLAq14omCwESSAZcfz4Hs9m9rGZ5Hn9OoOAupsWbrJSulB_4urgofJzabX7orM5VSb04QcccJ-IQHNR5omPFM3FycQMoiAkwCR2-PZHcJOIWCFMDcZ1mpAabWEBPskqEqclMTSZKO-gz4 Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 54c9c702154b4b80941138506d8fe735 Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1737750006 Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:06:52.619831 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:06:52.621235 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/54c9c702154b4b80941138506d8fe735"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_54c9c702154b4b80941138506d8fe735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/54c9c702154b4b80941138506d8fe735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/54c9c702154b4b80941138506d8fe735"}]}] Oct 04 21:06:52.621235 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1737750006 Oct 04 21:06:52.621235 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 54c9c702154b4b80941138506d8fe735 Oct 04 21:06:52.621235 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1737750006 Oct 04 21:06:52.621235 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AggregatesAdminNegativeTestJSON-1737750006-project Oct 04 21:06:52.621235 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:06:52.621235 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:06:52.621235 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 290cee2d2eb5478587c44a9cf354d716 Oct 04 21:06:52.621235 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1737750006-project Oct 04 21:06:52.621235 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:06:52.621235 n-d-860282-1 devstack@n-api.service[122757]: {"remove_host": {"host": "n-h1-860282-1"}} Oct 04 21:06:52.621235 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:06:52.621235 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 21:06:52.622291 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-860282-1'}}} Oct 04 21:06:52.622291 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:52.622291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:52.622291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:52.622291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:52.622291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:52.622291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:52.622291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:52.622291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:52.622291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:52.622291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:52.622291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 04 21:06:52.622291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 04 21:06:52.622291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:06:52.622291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:06:52.622291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:06:52.622291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:06:52.622291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:06:52.622291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:06:52.624084 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:06:52.624084 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:06:52.624084 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:06:52.624084 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:06:52.624084 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:06:52.624084 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:06:52.624084 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:06:52.624084 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:06:52.624084 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 21:06:52.624084 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:52.624084 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:52.624084 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:52.624084 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:52.624084 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:52.624084 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:52.624084 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:06:52.624084 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:06:52.624084 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 21:06:52.624084 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:06:52.625351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1fc92f2c-cfbc-4c1a-b08f-9b7af8d0bf4a tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:52.626661 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1fc92f2c-cfbc-4c1a-b08f-9b7af8d0bf4a tempest-AggregatesAdminNegativeTestJSON-1737750006 tempest-AggregatesAdminNegativeTestJSON-1737750006-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.029512 Oct 04 21:06:52.627825 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 169/323] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Oct 4 21:06:52 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:06:52.656263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1e6e529d-e85d-4d06-905f-ef48a583c66e tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860282-1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:52.684669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e6e529d-e85d-4d06-905f-ef48a583c66e tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:52.686160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e6e529d-e85d-4d06-905f-ef48a583c66e tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:52.686703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e6e529d-e85d-4d06-905f-ef48a583c66e tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:52.797818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e63acf1-41b2-40e5-bd90-5e7cbf6c709a tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:52.798326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e63acf1-41b2-40e5-bd90-5e7cbf6c709a tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:52.801136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e63acf1-41b2-40e5-bd90-5e7cbf6c709a tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:52.807552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e63acf1-41b2-40e5-bd90-5e7cbf6c709a tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:52.809376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e63acf1-41b2-40e5-bd90-5e7cbf6c709a tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:52.811122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e63acf1-41b2-40e5-bd90-5e7cbf6c709a tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.072918 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1e63acf1-41b2-40e5-bd90-5e7cbf6c709a tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/b6bb2003ea0e47c88a0e8a8ec77c8602" status: 200 len: 328 microversion: 2.1 time: 0.790760 Oct 04 21:06:53.086009 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 155/324] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Oct 4 21:06:52 2022] PUT /compute/v2.1/os-quota-sets/b6bb2003ea0e47c88a0e8a8ec77c8602 => generated 328 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:53.135945 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1e6e529d-e85d-4d06-905f-ef48a583c66e tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.500541 Oct 04 21:06:53.137349 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 170/325] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Oct 4 21:06:52 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:53.155188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-454225e6-2a79-48c7-96e5-66d5c0e44cb7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:53.155823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-454225e6-2a79-48c7-96e5-66d5c0e44cb7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:53.176140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454225e6-2a79-48c7-96e5-66d5c0e44cb7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:53.183634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454225e6-2a79-48c7-96e5-66d5c0e44cb7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:53.183634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454225e6-2a79-48c7-96e5-66d5c0e44cb7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.183634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454225e6-2a79-48c7-96e5-66d5c0e44cb7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:53.183634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454225e6-2a79-48c7-96e5-66d5c0e44cb7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:53.184090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454225e6-2a79-48c7-96e5-66d5c0e44cb7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.391853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1d0a14d8-94dc-4aa7-9469-0f3f794e431f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Calling method '.version_select at 0x7f5790bbf700>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:53.393442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-454225e6-2a79-48c7-96e5-66d5c0e44cb7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:53.396038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d0a14d8-94dc-4aa7-9469-0f3f794e431f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:53.401534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d0a14d8-94dc-4aa7-9469-0f3f794e431f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:53.401534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d0a14d8-94dc-4aa7-9469-0f3f794e431f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.403663 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-454225e6-2a79-48c7-96e5-66d5c0e44cb7 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1279 microversion: 2.1 time: 0.265085 Oct 04 21:06:53.404461 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 171/326] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:53 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1279 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:53.418091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1eec334c-3a0a-4ad9-8c21-e7a2ff1b3c2f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:53.425570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1eec334c-3a0a-4ad9-8c21-e7a2ff1b3c2f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:53.437664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1eec334c-3a0a-4ad9-8c21-e7a2ff1b3c2f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:53.443747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1eec334c-3a0a-4ad9-8c21-e7a2ff1b3c2f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:53.444442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1eec334c-3a0a-4ad9-8c21-e7a2ff1b3c2f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.447832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1eec334c-3a0a-4ad9-8c21-e7a2ff1b3c2f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:53.470974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d0a14d8-94dc-4aa7-9469-0f3f794e431f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:53.476864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1eec334c-3a0a-4ad9-8c21-e7a2ff1b3c2f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:53.477411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1eec334c-3a0a-4ad9-8c21-e7a2ff1b3c2f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.477766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d0a14d8-94dc-4aa7-9469-0f3f794e431f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:53.478416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d0a14d8-94dc-4aa7-9469-0f3f794e431f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.539877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d0a14d8-94dc-4aa7-9469-0f3f794e431f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:53.540420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d0a14d8-94dc-4aa7-9469-0f3f794e431f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:53.543060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d0a14d8-94dc-4aa7-9469-0f3f794e431f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.572735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d0a14d8-94dc-4aa7-9469-0f3f794e431f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:53.575339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d0a14d8-94dc-4aa7-9469-0f3f794e431f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:53.578788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d0a14d8-94dc-4aa7-9469-0f3f794e431f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.654593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d0a14d8-94dc-4aa7-9469-0f3f794e431f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:53.654593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d0a14d8-94dc-4aa7-9469-0f3f794e431f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:53.654593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d0a14d8-94dc-4aa7-9469-0f3f794e431f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.683829 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1d0a14d8-94dc-4aa7-9469-0f3f794e431f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1915 microversion: 2.53 time: 0.596499 Oct 04 21:06:53.689691 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 156/327] 10.222.0.30 () {60 vars in 1243 bytes} [Tue Oct 4 21:06:53 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1915 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:06:53.698683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-71be49f5-713c-4a44-ac11-a76010b22c78 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Calling method '.version_select at 0x7f5790c9cb80>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:53.708187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1eec334c-3a0a-4ad9-8c21-e7a2ff1b3c2f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:53.727771 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1eec334c-3a0a-4ad9-8c21-e7a2ff1b3c2f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1262 microversion: 2.1 time: 0.316367 Oct 04 21:06:53.735972 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 172/328] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:53 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1262 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:53.745160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a7dc084f-9772-4820-9c5e-47bbb39dc232 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:53.880782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71be49f5-713c-4a44-ac11-a76010b22c78 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:53.896114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71be49f5-713c-4a44-ac11-a76010b22c78 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:53.902705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71be49f5-713c-4a44-ac11-a76010b22c78 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.904776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71be49f5-713c-4a44-ac11-a76010b22c78 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:53.909629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71be49f5-713c-4a44-ac11-a76010b22c78 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:53.911366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71be49f5-713c-4a44-ac11-a76010b22c78 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.925683 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a7dc084f-9772-4820-9c5e-47bbb39dc232 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.186194 Oct 04 21:06:53.926275 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 173/329] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Oct 4 21:06:53 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:06:53.937040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-de5d5efa-fd1e-4d56-bf86-68e2a0d91896 tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Calling method '.version_select at 0x7f5790aec0d0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:53.948382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de5d5efa-fd1e-4d56-bf86-68e2a0d91896 tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:53.954629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de5d5efa-fd1e-4d56-bf86-68e2a0d91896 tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:53.957031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de5d5efa-fd1e-4d56-bf86-68e2a0d91896 tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:54.003424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de5d5efa-fd1e-4d56-bf86-68e2a0d91896 tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:54.004433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de5d5efa-fd1e-4d56-bf86-68e2a0d91896 tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:54.007317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de5d5efa-fd1e-4d56-bf86-68e2a0d91896 tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:54.037522 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-71be49f5-713c-4a44-ac11-a76010b22c78 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/b6bb2003ea0e47c88a0e8a8ec77c8602/detail" status: 200 len: 916 microversion: 2.1 time: 0.337004 Oct 04 21:06:54.038768 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 157/330] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Oct 4 21:06:53 2022] GET /compute/v2.1/os-quota-sets/b6bb2003ea0e47c88a0e8a8ec77c8602/detail => generated 916 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:54.044372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2a09e5e9-c97e-44bc-b525-c27b574571ea tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-788605898"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:54.080914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de5d5efa-fd1e-4d56-bf86-68e2a0d91896 tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:54.081836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de5d5efa-fd1e-4d56-bf86-68e2a0d91896 tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:54.082674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de5d5efa-fd1e-4d56-bf86-68e2a0d91896 tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:54.082916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.aggregate [None req-2a09e5e9-c97e-44bc-b525-c27b574571ea tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Generated uuid 631480b0-fc73-484a-819c-b7facd71936b for aggregate {{(pid=122758) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:06:54.121458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de5d5efa-fd1e-4d56-bf86-68e2a0d91896 tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:54.122005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de5d5efa-fd1e-4d56-bf86-68e2a0d91896 tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:54.122559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de5d5efa-fd1e-4d56-bf86-68e2a0d91896 tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:54.210262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de5d5efa-fd1e-4d56-bf86-68e2a0d91896 tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:54.211043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de5d5efa-fd1e-4d56-bf86-68e2a0d91896 tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:54.212160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de5d5efa-fd1e-4d56-bf86-68e2a0d91896 tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:54.231470 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-de5d5efa-fd1e-4d56-bf86-68e2a0d91896 tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 607 microversion: 2.53 time: 0.303559 Oct 04 21:06:54.234346 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2a09e5e9-c97e-44bc-b525-c27b574571ea tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.194135 Oct 04 21:06:54.235283 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 158/331] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Oct 4 21:06:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:54.244103 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 174/332] 10.222.0.30 () {60 vars in 1222 bytes} [Tue Oct 4 21:06:53 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 607 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:06:54.248929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bcea7350-59df-44ad-a512-fff05334910f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Calling method '.version_select at 0x7f5790aec670>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:54.249091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a0977be7-dc72-4c6d-989b-3b97145a1dda tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:54.257197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bcea7350-59df-44ad-a512-fff05334910f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:54.262444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bcea7350-59df-44ad-a512-fff05334910f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:54.263781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bcea7350-59df-44ad-a512-fff05334910f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:54.294995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a0977be7-dc72-4c6d-989b-3b97145a1dda tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:54.295825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a0977be7-dc72-4c6d-989b-3b97145a1dda tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:54.296498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a0977be7-dc72-4c6d-989b-3b97145a1dda tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:54.308275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bcea7350-59df-44ad-a512-fff05334910f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:54.311633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bcea7350-59df-44ad-a512-fff05334910f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:54.313272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bcea7350-59df-44ad-a512-fff05334910f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:54.320471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a0977be7-dc72-4c6d-989b-3b97145a1dda tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:54.320971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a0977be7-dc72-4c6d-989b-3b97145a1dda tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:54.321414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a0977be7-dc72-4c6d-989b-3b97145a1dda tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:54.336908 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bcea7350-59df-44ad-a512-fff05334910f tempest-HypervisorAdminV253TestBase-745070950 tempest-HypervisorAdminV253TestBase-745070950-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/d36fa3a8-ac11-4b1d-925b-7cd70e390713" status: 200 len: 792 microversion: 2.53 time: 0.092322 Oct 04 21:06:54.343592 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 175/333] 10.222.0.30 () {60 vars in 1298 bytes} [Tue Oct 4 21:06:54 2022] GET /compute/v2.1/os-hypervisors/d36fa3a8-ac11-4b1d-925b-7cd70e390713 => generated 792 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:06:54.350055 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.compute.aggregates [None req-a0977be7-dc72-4c6d-989b-3b97145a1dda tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 21:06:54.350591 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-a0977be7-dc72-4c6d-989b-3b97145a1dda tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a0977be7-dc72-4c6d-989b-3b97145a1dda tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Request method failure captured: Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 42 Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKBiQDs0mPOhfura_Lc_GGkfj4bEWsSGalFU46gDL1kK_eOKbR3o1mLnYj9KzFuo5uj5xZKPqLCOonxgwc0taAz4p-dWklL4WWWwJe3pE3zzXyFYxomUd3I3WKonxfeENeCJVCmf50N5HvdkrCuvfPUTwY-UYNE5RXtDGI9NwJHsJXE Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f2abe170f2ea4be8abc0f3b4d99b7f20 Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:06:54.352525 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:06:54.354123 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2abe170f2ea4be8abc0f3b4d99b7f20"}]}] Oct 04 21:06:54.354123 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:54.354123 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f2abe170f2ea4be8abc0f3b4d99b7f20 Oct 04 21:06:54.354123 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-501244335 Oct 04 21:06:54.354123 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin Oct 04 21:06:54.354123 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:06:54.354123 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:06:54.354123 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: b34c76bf13bb4363b9486f897cd3774b Oct 04 21:06:54.354123 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin Oct 04 21:06:54.354123 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:06:54.354123 n-d-860282-1 devstack@n-api.service[122758]: {"remove_host": {"host": "nonexist_host"}} Oct 04 21:06:54.354123 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:06:54.354123 n-d-860282-1 devstack@n-api.service[122758]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 21:06:54.354906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 04 21:06:54.356027 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:54.357715 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:54.359403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:54.359403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:54.359403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:54.359403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:54.359403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 04 21:06:54.359403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:06:54.368955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a0977be7-dc72-4c6d-989b-3b97145a1dda tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:54.381790 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a0977be7-dc72-4c6d-989b-3b97145a1dda tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.126485 Oct 04 21:06:54.385566 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 159/334] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Oct 4 21:06:54 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:06:54.391338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f3f9da27-f539-4d5a-9f39-3bd4ae1260a7 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:54.430865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f80d27ac-6e84-491c-a1c5-a290571b9837 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:54.431914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f80d27ac-6e84-491c-a1c5-a290571b9837 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:54.440994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f80d27ac-6e84-491c-a1c5-a290571b9837 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:54.445043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f80d27ac-6e84-491c-a1c5-a290571b9837 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:54.445811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f80d27ac-6e84-491c-a1c5-a290571b9837 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:54.447726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f80d27ac-6e84-491c-a1c5-a290571b9837 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:54.449181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f80d27ac-6e84-491c-a1c5-a290571b9837 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:54.452302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f80d27ac-6e84-491c-a1c5-a290571b9837 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:54.506342 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f3f9da27-f539-4d5a-9f39-3bd4ae1260a7 tempest-AggregatesAdminNegativeTestJSON-501244335 tempest-AggregatesAdminNegativeTestJSON-501244335-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.119303 Oct 04 21:06:54.506999 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 176/335] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Oct 4 21:06:54 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:06:54.568944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8b506c96-7dde-4246-9d9b-b904b6b64971 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Action: 'update', calling method: .version_select at 0x7f5790b4c820>, body: {"quota_set": {"ram": "2048"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:54.805782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f80d27ac-6e84-491c-a1c5-a290571b9837 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:54.815528 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f80d27ac-6e84-491c-a1c5-a290571b9837 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1277 microversion: 2.1 time: 0.388854 Oct 04 21:06:54.822558 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 160/336] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:54 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1277 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:54.828632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d6543cf1-d767-4d10-8c70-95fa287fa836 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:54.831503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d6543cf1-d767-4d10-8c70-95fa287fa836 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:54.846118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6543cf1-d767-4d10-8c70-95fa287fa836 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:54.849323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6543cf1-d767-4d10-8c70-95fa287fa836 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:54.849915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6543cf1-d767-4d10-8c70-95fa287fa836 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:54.852176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6543cf1-d767-4d10-8c70-95fa287fa836 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:54.852759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6543cf1-d767-4d10-8c70-95fa287fa836 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:54.854105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6543cf1-d767-4d10-8c70-95fa287fa836 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:55.027782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d6543cf1-d767-4d10-8c70-95fa287fa836 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:55.046817 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d6543cf1-d767-4d10-8c70-95fa287fa836 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1268 microversion: 2.1 time: 0.220183 Oct 04 21:06:55.047439 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 161/337] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:54 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1268 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:55.528128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b506c96-7dde-4246-9d9b-b904b6b64971 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:55.529776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b506c96-7dde-4246-9d9b-b904b6b64971 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:55.530741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b506c96-7dde-4246-9d9b-b904b6b64971 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:55.532044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b506c96-7dde-4246-9d9b-b904b6b64971 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:55.536462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b506c96-7dde-4246-9d9b-b904b6b64971 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:55.537128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b506c96-7dde-4246-9d9b-b904b6b64971 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:55.636825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b506c96-7dde-4246-9d9b-b904b6b64971 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:55.637343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b506c96-7dde-4246-9d9b-b904b6b64971 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:55.640643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b506c96-7dde-4246-9d9b-b904b6b64971 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:55.642581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b506c96-7dde-4246-9d9b-b904b6b64971 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:55.643294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b506c96-7dde-4246-9d9b-b904b6b64971 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:55.643884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b506c96-7dde-4246-9d9b-b904b6b64971 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:55.848272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d8d84c1b-021f-4882-a9bd-c9bcb3abde14 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:55.848968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d8d84c1b-021f-4882-a9bd-c9bcb3abde14 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:55.859415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8d84c1b-021f-4882-a9bd-c9bcb3abde14 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:55.860095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8d84c1b-021f-4882-a9bd-c9bcb3abde14 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:55.861053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8d84c1b-021f-4882-a9bd-c9bcb3abde14 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:55.862006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8d84c1b-021f-4882-a9bd-c9bcb3abde14 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:55.863263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8d84c1b-021f-4882-a9bd-c9bcb3abde14 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:55.865094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8d84c1b-021f-4882-a9bd-c9bcb3abde14 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:55.866039 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8b506c96-7dde-4246-9d9b-b904b6b64971 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/b6bb2003ea0e47c88a0e8a8ec77c8602?user_id=625da13183144283873e1058bc5103fc" status: 200 len: 328 microversion: 2.1 time: 1.305858 Oct 04 21:06:55.869037 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 177/338] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Oct 4 21:06:54 2022] PUT /compute/v2.1/os-quota-sets/b6bb2003ea0e47c88a0e8a8ec77c8602?user_id=625da13183144283873e1058bc5103fc => generated 328 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:55.882082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4a9fd822-f932-4299-96af-5bdf42b2b38b tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Calling method '.version_select at 0x7f5790aec3a0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:56.072331 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4a9fd822-f932-4299-96af-5bdf42b2b38b tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/b6bb2003ea0e47c88a0e8a8ec77c8602?user_id=625da13183144283873e1058bc5103fc" status: 200 len: 370 microversion: 2.1 time: 0.190787 Oct 04 21:06:56.072331 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 178/339] 10.222.0.30 () {58 vars in 1323 bytes} [Tue Oct 4 21:06:55 2022] GET /compute/v2.1/os-quota-sets/b6bb2003ea0e47c88a0e8a8ec77c8602?user_id=625da13183144283873e1058bc5103fc => generated 370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:56.083837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-269c6833-e51f-48f2-be81-315466348a5c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:56.092355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-269c6833-e51f-48f2-be81-315466348a5c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:56.098876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-269c6833-e51f-48f2-be81-315466348a5c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:56.102066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-269c6833-e51f-48f2-be81-315466348a5c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:56.105908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-269c6833-e51f-48f2-be81-315466348a5c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:56.107130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-269c6833-e51f-48f2-be81-315466348a5c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:56.107882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-269c6833-e51f-48f2-be81-315466348a5c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:56.112506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-269c6833-e51f-48f2-be81-315466348a5c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:56.386365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-269c6833-e51f-48f2-be81-315466348a5c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:56.402767 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-269c6833-e51f-48f2-be81-315466348a5c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1268 microversion: 2.1 time: 0.330189 Oct 04 21:06:56.403611 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 179/340] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:56 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1268 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:56.979549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d8d84c1b-021f-4882-a9bd-c9bcb3abde14 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:56.993650 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d8d84c1b-021f-4882-a9bd-c9bcb3abde14 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1319 microversion: 2.1 time: 1.153823 Oct 04 21:06:57.001526 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 162/341] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:55 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1319 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:57.182068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8ffdeca4-227f-44dc-a932-8dcf165d657d tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Calling method '.version_select at 0x7f5790e8d4c0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:57.431207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e60707c0-3139-4412-9104-309684ff9485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:57.431826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e60707c0-3139-4412-9104-309684ff9485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:57.441570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e60707c0-3139-4412-9104-309684ff9485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:57.446997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e60707c0-3139-4412-9104-309684ff9485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:57.446997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e60707c0-3139-4412-9104-309684ff9485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:57.446997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e60707c0-3139-4412-9104-309684ff9485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:57.446997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e60707c0-3139-4412-9104-309684ff9485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:57.447373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e60707c0-3139-4412-9104-309684ff9485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:57.636298 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8ffdeca4-227f-44dc-a932-8dcf165d657d tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/5a5278d4fa3740bda2baf45e8fff3772/defaults" status: 200 len: 371 microversion: 2.1 time: 0.458481 Oct 04 21:06:57.637186 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 180/342] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Oct 4 21:06:57 2022] GET /compute/v2.1/os-quota-sets/5a5278d4fa3740bda2baf45e8fff3772/defaults => generated 371 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:57.654566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c7278c83-d3d4-42f9-9519-024edc50218f tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Action: 'update', calling method: .version_select at 0x7f5790aec1f0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:57.799043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7278c83-d3d4-42f9-9519-024edc50218f tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:57.799375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7278c83-d3d4-42f9-9519-024edc50218f tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:57.801050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7278c83-d3d4-42f9-9519-024edc50218f tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:57.804381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7278c83-d3d4-42f9-9519-024edc50218f tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:57.805020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7278c83-d3d4-42f9-9519-024edc50218f tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:57.805901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7278c83-d3d4-42f9-9519-024edc50218f tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:57.837916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=7 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:58.148116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e60707c0-3139-4412-9104-309684ff9485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:58.187523 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e60707c0-3139-4412-9104-309684ff9485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1310 microversion: 2.1 time: 0.758238 Oct 04 21:06:58.188924 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 163/343] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:57 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1310 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:58.197088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a0a8f095-a91e-4727-b644-429993f15418 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:58.198204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a0a8f095-a91e-4727-b644-429993f15418 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:58.209090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a0a8f095-a91e-4727-b644-429993f15418 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:58.209983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a0a8f095-a91e-4727-b644-429993f15418 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:58.210534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a0a8f095-a91e-4727-b644-429993f15418 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:58.211460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a0a8f095-a91e-4727-b644-429993f15418 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:58.212041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a0a8f095-a91e-4727-b644-429993f15418 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:58.212578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a0a8f095-a91e-4727-b644-429993f15418 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:58.769556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a0a8f095-a91e-4727-b644-429993f15418 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:58.777259 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a0a8f095-a91e-4727-b644-429993f15418 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1319 microversion: 2.1 time: 0.587041 Oct 04 21:06:58.785371 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 164/344] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:58 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1319 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:59.116475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-f23bfdf3-9eed-4f37-80ff-d3db08caaf7a req-8250eaaa-be4e-40c0-b68c-804109129975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbd5aea7-1ee4-4b65-8113-f35d01190b7b", "tag": "05977ab0-dafe-4113-9224-f929f82028cc"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:59.140310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f23bfdf3-9eed-4f37-80ff-d3db08caaf7a req-8250eaaa-be4e-40c0-b68c-804109129975 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:59.143026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f23bfdf3-9eed-4f37-80ff-d3db08caaf7a req-8250eaaa-be4e-40c0-b68c-804109129975 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:59.146574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f23bfdf3-9eed-4f37-80ff-d3db08caaf7a req-8250eaaa-be4e-40c0-b68c-804109129975 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:59.167771 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-f23bfdf3-9eed-4f37-80ff-d3db08caaf7a req-8250eaaa-be4e-40c0-b68c-804109129975 service nova] Creating event network-changed:05977ab0-dafe-4113-9224-f929f82028cc for instance cbd5aea7-1ee4-4b65-8113-f35d01190b7b on n-h1-860282-1 Oct 04 21:06:59.181583 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-f23bfdf3-9eed-4f37-80ff-d3db08caaf7a req-8250eaaa-be4e-40c0-b68c-804109129975 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078315 Oct 04 21:06:59.184910 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 165/345] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:59.237277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-16fac5c6-246b-4cbc-9d04-457a910f6340 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:59.238913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-16fac5c6-246b-4cbc-9d04-457a910f6340 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:59.252309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16fac5c6-246b-4cbc-9d04-457a910f6340 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:59.255375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16fac5c6-246b-4cbc-9d04-457a910f6340 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:59.255375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16fac5c6-246b-4cbc-9d04-457a910f6340 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:59.255375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16fac5c6-246b-4cbc-9d04-457a910f6340 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:59.256046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16fac5c6-246b-4cbc-9d04-457a910f6340 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:59.272732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16fac5c6-246b-4cbc-9d04-457a910f6340 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:59.384208 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c7278c83-d3d4-42f9-9519-024edc50218f tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/5a5278d4fa3740bda2baf45e8fff3772" status: 200 len: 329 microversion: 2.1 time: 1.736977 Oct 04 21:06:59.389888 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 181/346] 10.222.0.30 () {60 vars in 1263 bytes} [Tue Oct 4 21:06:57 2022] PUT /compute/v2.1/os-quota-sets/5a5278d4fa3740bda2baf45e8fff3772 => generated 329 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:59.398596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a6d344dc-33b7-44f5-b02f-94862785bae9 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Action: 'update', calling method: .version_select at 0x7f5790a64700>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:59.786638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6d344dc-33b7-44f5-b02f-94862785bae9 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:59.787196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6d344dc-33b7-44f5-b02f-94862785bae9 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:59.787718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6d344dc-33b7-44f5-b02f-94862785bae9 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:59.788774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6d344dc-33b7-44f5-b02f-94862785bae9 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:59.789410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6d344dc-33b7-44f5-b02f-94862785bae9 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:59.790019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6d344dc-33b7-44f5-b02f-94862785bae9 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:00.132645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-16fac5c6-246b-4cbc-9d04-457a910f6340 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:00.142604 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-16fac5c6-246b-4cbc-9d04-457a910f6340 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1310 microversion: 2.1 time: 0.931715 Oct 04 21:07:00.147174 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 166/347] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:59 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1310 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:00.158227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-90ec0b04-781a-4615-bdb4-5fa8ebdf31d1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:00.162920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-90ec0b04-781a-4615-bdb4-5fa8ebdf31d1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:00.175744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90ec0b04-781a-4615-bdb4-5fa8ebdf31d1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:00.178995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90ec0b04-781a-4615-bdb4-5fa8ebdf31d1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:00.179606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90ec0b04-781a-4615-bdb4-5fa8ebdf31d1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:00.182917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90ec0b04-781a-4615-bdb4-5fa8ebdf31d1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:00.182917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90ec0b04-781a-4615-bdb4-5fa8ebdf31d1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:00.182917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90ec0b04-781a-4615-bdb4-5fa8ebdf31d1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:00.737022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-90ec0b04-781a-4615-bdb4-5fa8ebdf31d1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:00.751565 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-90ec0b04-781a-4615-bdb4-5fa8ebdf31d1 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1319 microversion: 2.1 time: 0.602933 Oct 04 21:07:00.752173 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 167/348] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:00 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1319 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:00.782142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-e0a5b4fb-f7bd-47c8-b655-dbf427733ed0 req-0356a78c-bda0-43a7-8a7f-d82c071d695d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee48d230-2152-48c0-b95f-29a55787f7a4", "tag": "a4684f8a-e6a9-4608-b21b-3aaef38405be"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:00.791332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:00.808029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e0a5b4fb-f7bd-47c8-b655-dbf427733ed0 req-0356a78c-bda0-43a7-8a7f-d82c071d695d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:00.809029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e0a5b4fb-f7bd-47c8-b655-dbf427733ed0 req-0356a78c-bda0-43a7-8a7f-d82c071d695d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:00.809861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e0a5b4fb-f7bd-47c8-b655-dbf427733ed0 req-0356a78c-bda0-43a7-8a7f-d82c071d695d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:00.848665 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-e0a5b4fb-f7bd-47c8-b655-dbf427733ed0 req-0356a78c-bda0-43a7-8a7f-d82c071d695d service nova] Creating event network-changed:a4684f8a-e6a9-4608-b21b-3aaef38405be for instance ee48d230-2152-48c0-b95f-29a55787f7a4 on n-h1-860282-1 Oct 04 21:07:00.855605 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-e0a5b4fb-f7bd-47c8-b655-dbf427733ed0 req-0356a78c-bda0-43a7-8a7f-d82c071d695d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084751 Oct 04 21:07:00.858634 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 168/349] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:01.174687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9e212235-08b3-4711-b9fe-ca7e3e80eda8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:01.175781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9e212235-08b3-4711-b9fe-ca7e3e80eda8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:01.204508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e212235-08b3-4711-b9fe-ca7e3e80eda8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:01.205244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e212235-08b3-4711-b9fe-ca7e3e80eda8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:01.205906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e212235-08b3-4711-b9fe-ca7e3e80eda8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:01.206876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e212235-08b3-4711-b9fe-ca7e3e80eda8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:01.207827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e212235-08b3-4711-b9fe-ca7e3e80eda8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:01.208544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e212235-08b3-4711-b9fe-ca7e3e80eda8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:01.756562 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9e212235-08b3-4711-b9fe-ca7e3e80eda8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:01.766465 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9e212235-08b3-4711-b9fe-ca7e3e80eda8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1310 microversion: 2.1 time: 0.598902 Oct 04 21:07:01.780751 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 169/350] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:01 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1310 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:01.799459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1c6f51ad-f6aa-4379-8844-a87558e707bd tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:01.801815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1c6f51ad-f6aa-4379-8844-a87558e707bd tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:01.818022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6f51ad-f6aa-4379-8844-a87558e707bd tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:01.818771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6f51ad-f6aa-4379-8844-a87558e707bd tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:01.819367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6f51ad-f6aa-4379-8844-a87558e707bd tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:01.820237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6f51ad-f6aa-4379-8844-a87558e707bd tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:01.820853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6f51ad-f6aa-4379-8844-a87558e707bd tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:01.821495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6f51ad-f6aa-4379-8844-a87558e707bd tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:02.269544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1c6f51ad-f6aa-4379-8844-a87558e707bd tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:02.280480 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1c6f51ad-f6aa-4379-8844-a87558e707bd tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1319 microversion: 2.1 time: 0.497394 Oct 04 21:07:02.281638 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 170/351] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:01 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1319 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:02.290501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:02.452232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=28,nova_api:UPDATE=14 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:02.500715 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a6d344dc-33b7-44f5-b02f-94862785bae9 tempest-QuotasAdminTestJSON-1236227214 tempest-QuotasAdminTestJSON-1236227214-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/5a5278d4fa3740bda2baf45e8fff3772" status: 200 len: 329 microversion: 2.1 time: 3.107396 Oct 04 21:07:02.510451 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 182/352] 10.222.0.30 () {60 vars in 1263 bytes} [Tue Oct 4 21:06:59 2022] PUT /compute/v2.1/os-quota-sets/5a5278d4fa3740bda2baf45e8fff3772 => generated 329 bytes in 3117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:07:02.805121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1c255b8b-e7f5-4885-9252-e19de7e91ccf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:02.807148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1c255b8b-e7f5-4885-9252-e19de7e91ccf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:02.816760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c255b8b-e7f5-4885-9252-e19de7e91ccf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:02.821654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c255b8b-e7f5-4885-9252-e19de7e91ccf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:02.823811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c255b8b-e7f5-4885-9252-e19de7e91ccf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:02.824796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c255b8b-e7f5-4885-9252-e19de7e91ccf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:02.830347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c255b8b-e7f5-4885-9252-e19de7e91ccf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:02.831097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c255b8b-e7f5-4885-9252-e19de7e91ccf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:03.278267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1c255b8b-e7f5-4885-9252-e19de7e91ccf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:03.287388 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1c255b8b-e7f5-4885-9252-e19de7e91ccf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1310 microversion: 2.1 time: 0.486834 Oct 04 21:07:03.295600 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 171/353] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:02 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1310 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:03.315168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ae753d88-204b-4df4-888c-a916738dc7c2 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:03.315871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ae753d88-204b-4df4-888c-a916738dc7c2 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:03.333848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae753d88-204b-4df4-888c-a916738dc7c2 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:03.338947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae753d88-204b-4df4-888c-a916738dc7c2 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:03.339193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae753d88-204b-4df4-888c-a916738dc7c2 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:03.340162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae753d88-204b-4df4-888c-a916738dc7c2 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:03.342166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae753d88-204b-4df4-888c-a916738dc7c2 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:03.342780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae753d88-204b-4df4-888c-a916738dc7c2 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:03.727383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ae753d88-204b-4df4-888c-a916738dc7c2 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:03.738319 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ae753d88-204b-4df4-888c-a916738dc7c2 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1319 microversion: 2.1 time: 0.429609 Oct 04 21:07:03.743400 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 183/354] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:03 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:04.316474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3ae79fb0-13ce-4fe9-b4e6-be7b6a551614 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:04.317397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3ae79fb0-13ce-4fe9-b4e6-be7b6a551614 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:04.320328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=22 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:04.321488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=12 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:04.337766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ae79fb0-13ce-4fe9-b4e6-be7b6a551614 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:04.338273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ae79fb0-13ce-4fe9-b4e6-be7b6a551614 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:04.338720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ae79fb0-13ce-4fe9-b4e6-be7b6a551614 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:04.339444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ae79fb0-13ce-4fe9-b4e6-be7b6a551614 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:04.347437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ae79fb0-13ce-4fe9-b4e6-be7b6a551614 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:04.347884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ae79fb0-13ce-4fe9-b4e6-be7b6a551614 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:04.769137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0cdc4fcd-6f04-4754-9d8a-ca80b0cbbca8 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:04.770851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0cdc4fcd-6f04-4754-9d8a-ca80b0cbbca8 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:04.786290 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cdc4fcd-6f04-4754-9d8a-ca80b0cbbca8 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:04.787026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cdc4fcd-6f04-4754-9d8a-ca80b0cbbca8 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:04.787874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cdc4fcd-6f04-4754-9d8a-ca80b0cbbca8 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:04.788738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cdc4fcd-6f04-4754-9d8a-ca80b0cbbca8 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:04.789341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cdc4fcd-6f04-4754-9d8a-ca80b0cbbca8 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:04.789935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cdc4fcd-6f04-4754-9d8a-ca80b0cbbca8 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:05.004248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3ae79fb0-13ce-4fe9-b4e6-be7b6a551614 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:05.014276 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3ae79fb0-13ce-4fe9-b4e6-be7b6a551614 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1310 microversion: 2.1 time: 0.700984 Oct 04 21:07:05.030441 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 172/355] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:04 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1310 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:05.118984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0cdc4fcd-6f04-4754-9d8a-ca80b0cbbca8 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:05.145936 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0cdc4fcd-6f04-4754-9d8a-ca80b0cbbca8 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1319 microversion: 2.1 time: 0.370431 Oct 04 21:07:05.147618 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 184/356] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:04 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:05.210349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-af0ad3ff-ffb3-4036-9461-e36ec4884c6b tempest-InstanceUsageAuditLogNegativeTestJSON-572031368 tempest-InstanceUsageAuditLogNegativeTestJSON-572031368-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:05.222016 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-af0ad3ff-ffb3-4036-9461-e36ec4884c6b tempest-InstanceUsageAuditLogNegativeTestJSON-572031368 tempest-InstanceUsageAuditLogNegativeTestJSON-572031368-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-af0ad3ff-ffb3-4036-9461-e36ec4884c6b tempest-InstanceUsageAuditLogNegativeTestJSON-572031368 tempest-InstanceUsageAuditLogNegativeTestJSON-572031368-project-admin] Request method failure captured: Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKB4jofG1pkUbATNE6t7ecv14TQBhe9w8PQ-B9PXohg-FpcGI7o4iHD212uUA0OBvG8tSqWGwpuDSKhJtTbUwVE5SzSqUmbSX9IMZ72ze7g-TU1LHk9phLASP-E9YfFQrnYxaoVQIk68_d0KxRxepqFM1W0kvOOGekDYDlis6vJomA8 Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 2cc402e33d9d451088a65f1b21187e38 Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-572031368 Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:07:05.223031 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:07:05.224593 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2cc402e33d9d451088a65f1b21187e38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2cc402e33d9d451088a65f1b21187e38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2cc402e33d9d451088a65f1b21187e38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2cc402e33d9d451088a65f1b21187e38"}]}] Oct 04 21:07:05.224593 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-572031368 Oct 04 21:07:05.224593 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 2cc402e33d9d451088a65f1b21187e38 Oct 04 21:07:05.224593 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-572031368 Oct 04 21:07:05.224593 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-572031368-project-admin Oct 04 21:07:05.224593 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:07:05.224593 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:07:05.224593 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: a3805ef3004d4291bb40341bc2e717f6 Oct 04 21:07:05.224593 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-572031368-project-admin Oct 04 21:07:05.224593 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:07:05.224593 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid timestamp for date invalid_time Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'invalid_time'} Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:05.225593 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:05.226861 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 04 21:07:05.226861 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 04 21:07:05.226861 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 04 21:07:05.226861 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:05.226861 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:05.226861 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:05.226861 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:05.226861 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:05.226861 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:05.226861 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:05.226861 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:05.226861 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 04 21:07:05.226861 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:05.226861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-af0ad3ff-ffb3-4036-9461-e36ec4884c6b tempest-InstanceUsageAuditLogNegativeTestJSON-572031368 tempest-InstanceUsageAuditLogNegativeTestJSON-572031368-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:05.226861 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-af0ad3ff-ffb3-4036-9461-e36ec4884c6b tempest-InstanceUsageAuditLogNegativeTestJSON-572031368 tempest-InstanceUsageAuditLogNegativeTestJSON-572031368-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.208074 Oct 04 21:07:05.227762 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 173/357] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 21:07:05 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 209 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:07:05.287273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1f8e102a-b005-4864-b637-2f7231d48431 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-272365882", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:05.355190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dfdb2790-252b-4594-ba0f-122ff83b3629 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1623842377", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "d8cfe5e7-54b8-4178-9c64-fdf6c3f1a916"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:05.421807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-1f8e102a-b005-4864-b637-2f7231d48431 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] validate_networks() for None {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:07:05.427582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-dfdb2790-252b-4594-ba0f-122ff83b3629 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] validate_networks() for [('d8cfe5e7-54b8-4178-9c64-fdf6c3f1a916', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:07:05.780773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-1f8e102a-b005-4864-b637-2f7231d48431 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:07:05.781266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-1f8e102a-b005-4864-b637-2f7231d48431 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:07:05.781763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-1f8e102a-b005-4864-b637-2f7231d48431 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:07:05.782190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-1f8e102a-b005-4864-b637-2f7231d48431 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:07:05.782598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-1f8e102a-b005-4864-b637-2f7231d48431 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:07:05.800878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f8e102a-b005-4864-b637-2f7231d48431 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:05.801379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f8e102a-b005-4864-b637-2f7231d48431 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:05.801903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f8e102a-b005-4864-b637-2f7231d48431 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:05.802575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f8e102a-b005-4864-b637-2f7231d48431 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:05.811367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f8e102a-b005-4864-b637-2f7231d48431 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:05.812071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f8e102a-b005-4864-b637-2f7231d48431 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:05.857476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-1f8e102a-b005-4864-b637-2f7231d48431 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Getting quotas for project 4cfef30006e947d18bf514bdadff52ec. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:05.865349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-1f8e102a-b005-4864-b637-2f7231d48431 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Getting quotas for user 27554053d0174aa497fc09e07a859fba and project 4cfef30006e947d18bf514bdadff52ec. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:05.903686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1f8e102a-b005-4864-b637-2f7231d48431 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:07:05.914899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1f8e102a-b005-4864-b637-2f7231d48431 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:07:06.118921 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1f8e102a-b005-4864-b637-2f7231d48431 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.971225 Oct 04 21:07:06.126463 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 185/358] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:07:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:07:06.158726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-dfdb2790-252b-4594-ba0f-122ff83b3629 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:07:06.159394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-dfdb2790-252b-4594-ba0f-122ff83b3629 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:07:06.159880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-dfdb2790-252b-4594-ba0f-122ff83b3629 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:07:06.160536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-dfdb2790-252b-4594-ba0f-122ff83b3629 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:07:06.160716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-dfdb2790-252b-4594-ba0f-122ff83b3629 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:07:06.183092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfdb2790-252b-4594-ba0f-122ff83b3629 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:06.183590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfdb2790-252b-4594-ba0f-122ff83b3629 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:06.184038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfdb2790-252b-4594-ba0f-122ff83b3629 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:06.186280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfdb2790-252b-4594-ba0f-122ff83b3629 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:06.186753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfdb2790-252b-4594-ba0f-122ff83b3629 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:06.188067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfdb2790-252b-4594-ba0f-122ff83b3629 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:06.228096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-dfdb2790-252b-4594-ba0f-122ff83b3629 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Getting quotas for project d06810bbad6e4914aa53b43ef390f52e. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:06.240601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-dfdb2790-252b-4594-ba0f-122ff83b3629 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Getting quotas for user 95f0cc0f93b244cea8818c7bbdcfb90a and project d06810bbad6e4914aa53b43ef390f52e. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:06.262015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dfdb2790-252b-4594-ba0f-122ff83b3629 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:07:06.262157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dfdb2790-252b-4594-ba0f-122ff83b3629 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:07:06.479308 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dfdb2790-252b-4594-ba0f-122ff83b3629 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.244687 Oct 04 21:07:06.480214 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 174/359] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Oct 4 21:07:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1255 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:07:06.486709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-666d7c18-a523-4f4d-83fa-23eb60502dfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:06.487674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-666d7c18-a523-4f4d-83fa-23eb60502dfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:06.495101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-666d7c18-a523-4f4d-83fa-23eb60502dfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:06.495643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-666d7c18-a523-4f4d-83fa-23eb60502dfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:06.496081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-666d7c18-a523-4f4d-83fa-23eb60502dfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:06.496836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-666d7c18-a523-4f4d-83fa-23eb60502dfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:06.497381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-666d7c18-a523-4f4d-83fa-23eb60502dfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:06.498743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-666d7c18-a523-4f4d-83fa-23eb60502dfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:06.528095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:06.584575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5b66b203-6824-4444-97f0-8387abc297b5 tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357 tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:06.586798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5b66b203-6824-4444-97f0-8387abc297b5 tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357 tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'df95b41bec4d4ff89e74248d23184bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee8be9875248d99eeabf3a61beeba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5b66b203-6824-4444-97f0-8387abc297b5 tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357 tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357-project] Request method failure captured: Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKB20jcnYfF1IyiSmYCYAvh3Zfc_WIvVFEAClHR8MC69Y9wtOSpgCETwWTEwSY8hqKVnCk-5GlK7mV2HUODayGql1W2KimI1Er-t7YHQvCT6actk7M9EjfbBvOJeU7Sw3R8Axw3qy7C_kbsGUbT7iWR6QESWI3UnhyiA7CJiXzuxGJY Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 12ee8be9875248d99eeabf3a61beeba0 Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357 Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:07:06.589121 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:07:06.590708 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/12ee8be9875248d99eeabf3a61beeba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_12ee8be9875248d99eeabf3a61beeba0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/12ee8be9875248d99eeabf3a61beeba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/12ee8be9875248d99eeabf3a61beeba0"}]}] Oct 04 21:07:06.590708 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357 Oct 04 21:07:06.590708 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 12ee8be9875248d99eeabf3a61beeba0 Oct 04 21:07:06.590708 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357 Oct 04 21:07:06.590708 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357-project Oct 04 21:07:06.590708 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:07:06.590708 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:07:06.590708 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: df95b41bec4d4ff89e74248d23184bbb Oct 04 21:07:06.590708 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357-project Oct 04 21:07:06.590708 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: action_args: {} Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:07:06.592068 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:07:06.593598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:07:06.593598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:07:06.593598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:07:06.593598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:07:06.593598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:07:06.593598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:07:06.593598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 21:07:06.593598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:06.593598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:06.593598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:06.593598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:06.593598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:06.593598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:06.593598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:07:06.593598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:07:06.593598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 21:07:06.593598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:06.595902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5b66b203-6824-4444-97f0-8387abc297b5 tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357 tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:06.596915 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5b66b203-6824-4444-97f0-8387abc297b5 tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357 tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357-project] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.474698 Oct 04 21:07:06.597804 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 186/360] 10.222.0.30 () {58 vars in 1185 bytes} [Tue Oct 4 21:07:06 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 477 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:07:06.609808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-036054e3-c393-4594-a236-3e50ba0d457f tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:06.610477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-036054e3-c393-4594-a236-3e50ba0d457f tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:06.699366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-036054e3-c393-4594-a236-3e50ba0d457f tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:06.713774 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-036054e3-c393-4594-a236-3e50ba0d457f tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805" status: 200 len: 1219 microversion: 2.1 time: 0.114201 Oct 04 21:07:06.714730 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 187/361] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:06 2022] GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:06.737458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cb67694d-e25b-480c-87f0-7bcd0a6e1c66 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:06.737458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cb67694d-e25b-480c-87f0-7bcd0a6e1c66 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:06.748832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb67694d-e25b-480c-87f0-7bcd0a6e1c66 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:06.749335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb67694d-e25b-480c-87f0-7bcd0a6e1c66 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:06.749809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb67694d-e25b-480c-87f0-7bcd0a6e1c66 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:06.750528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb67694d-e25b-480c-87f0-7bcd0a6e1c66 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:06.750989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb67694d-e25b-480c-87f0-7bcd0a6e1c66 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:06.751425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb67694d-e25b-480c-87f0-7bcd0a6e1c66 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:06.896793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-666d7c18-a523-4f4d-83fa-23eb60502dfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:06.905180 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-666d7c18-a523-4f4d-83fa-23eb60502dfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1310 microversion: 2.1 time: 0.423886 Oct 04 21:07:06.909869 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 175/362] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:06 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1310 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:06.914827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f4dc05bd-dab3-4da3-a9e5-4953f9bda118 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:06.919976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f4dc05bd-dab3-4da3-a9e5-4953f9bda118 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:07.038177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f4dc05bd-dab3-4da3-a9e5-4953f9bda118 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:07.048146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f4dc05bd-dab3-4da3-a9e5-4953f9bda118 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:07.051714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f4dc05bd-dab3-4da3-a9e5-4953f9bda118 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:07.054107 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f4dc05bd-dab3-4da3-a9e5-4953f9bda118 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1262 microversion: 2.25 time: 0.142993 Oct 04 21:07:07.068324 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 176/363] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:06 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1262 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:07.083892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2cfd1dcd-bfee-4c15-bb00-49a61f5402ad tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357 tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:07.084193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cb67694d-e25b-480c-87f0-7bcd0a6e1c66 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:07.087460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2cfd1dcd-bfee-4c15-bb00-49a61f5402ad tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357 tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'df95b41bec4d4ff89e74248d23184bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee8be9875248d99eeabf3a61beeba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2cfd1dcd-bfee-4c15-bb00-49a61f5402ad tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357 tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357-project] Request method failure captured: Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2021:07:06 HTTP/1.1 Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKB20jcnYfF1IyiSmYCYAvh3Zfc_WIvVFEAClHR8MC69Y9wtOSpgCETwWTEwSY8hqKVnCk-5GlK7mV2HUODayGql1W2KimI1Er-t7YHQvCT6actk7M9EjfbBvOJeU7Sw3R8Axw3qy7C_kbsGUbT7iWR6QESWI3UnhyiA7CJiXzuxGJY Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 12ee8be9875248d99eeabf3a61beeba0 Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357 Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:07:07.089601 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:07:07.090885 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/12ee8be9875248d99eeabf3a61beeba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_12ee8be9875248d99eeabf3a61beeba0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/12ee8be9875248d99eeabf3a61beeba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/12ee8be9875248d99eeabf3a61beeba0"}]}] Oct 04 21:07:07.090885 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357 Oct 04 21:07:07.090885 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 12ee8be9875248d99eeabf3a61beeba0 Oct 04 21:07:07.090885 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357 Oct 04 21:07:07.090885 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357-project Oct 04 21:07:07.090885 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:07:07.090885 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:07:07.090885 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: df95b41bec4d4ff89e74248d23184bbb Oct 04 21:07:07.090885 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357-project Oct 04 21:07:07.090885 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '2022-10-04 21:07:06'} Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:07:07.091559 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:07:07.092725 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:07:07.092725 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:07:07.092725 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:07:07.092725 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:07:07.092725 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:07:07.092725 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:07:07.092725 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 21:07:07.092725 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:07.092725 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:07.092725 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:07.092725 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:07.092725 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:07.092725 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:07.092725 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:07:07.092725 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:07:07.092725 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 21:07:07.092725 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:07.101453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2cfd1dcd-bfee-4c15-bb00-49a61f5402ad tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357 tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:07.101453 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2cfd1dcd-bfee-4c15-bb00-49a61f5402ad tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357 tempest-InstanceUsageAuditLogNegativeTestJSON-1583331357-project] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 21:07:06" status: 403 len: 128 microversion: 2.1 time: 0.021580 Oct 04 21:07:07.101453 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 177/364] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Oct 4 21:07:07 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2021%3A07%3A06 => generated 128 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:07:07.101799 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cb67694d-e25b-480c-87f0-7bcd0a6e1c66 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1319 microversion: 2.1 time: 0.380939 Oct 04 21:07:07.102353 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 188/365] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:06 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:07.742563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fe3776d7-d5ea-449c-8912-9ac8c0e6564b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:07.745833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fe3776d7-d5ea-449c-8912-9ac8c0e6564b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:07.787091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe3776d7-d5ea-449c-8912-9ac8c0e6564b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:07.787596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe3776d7-d5ea-449c-8912-9ac8c0e6564b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:07.788040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe3776d7-d5ea-449c-8912-9ac8c0e6564b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:07.790799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe3776d7-d5ea-449c-8912-9ac8c0e6564b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:07.795482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe3776d7-d5ea-449c-8912-9ac8c0e6564b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:07.796853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe3776d7-d5ea-449c-8912-9ac8c0e6564b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:07.896359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fe3776d7-d5ea-449c-8912-9ac8c0e6564b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:07.906381 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fe3776d7-d5ea-449c-8912-9ac8c0e6564b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805" status: 200 len: 1223 microversion: 2.1 time: 0.172574 Oct 04 21:07:07.914029 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 178/366] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:07 2022] GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 => generated 1223 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:07.932936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dd6fc6b5-5453-4f5a-b0ce-6151d2cec1b2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:07.933812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dd6fc6b5-5453-4f5a-b0ce-6151d2cec1b2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:07.942563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd6fc6b5-5453-4f5a-b0ce-6151d2cec1b2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:07.943077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd6fc6b5-5453-4f5a-b0ce-6151d2cec1b2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:07.943553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd6fc6b5-5453-4f5a-b0ce-6151d2cec1b2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:07.944292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd6fc6b5-5453-4f5a-b0ce-6151d2cec1b2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:07.944923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd6fc6b5-5453-4f5a-b0ce-6151d2cec1b2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:07.946414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd6fc6b5-5453-4f5a-b0ce-6151d2cec1b2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:08.085400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7e70fa6c-6fee-419e-a46d-daa51a71ddcc tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:08.086588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7e70fa6c-6fee-419e-a46d-daa51a71ddcc tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:08.228212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7e70fa6c-6fee-419e-a46d-daa51a71ddcc tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:08.247091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dd6fc6b5-5453-4f5a-b0ce-6151d2cec1b2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:08.256975 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dd6fc6b5-5453-4f5a-b0ce-6151d2cec1b2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1310 microversion: 2.1 time: 0.328514 Oct 04 21:07:08.257624 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 189/367] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:07 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1310 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:08.262290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7e70fa6c-6fee-419e-a46d-daa51a71ddcc tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:08.263668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7e70fa6c-6fee-419e-a46d-daa51a71ddcc tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:08.264808 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7e70fa6c-6fee-419e-a46d-daa51a71ddcc tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1262 microversion: 2.25 time: 0.183341 Oct 04 21:07:08.283167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eefdd34d-d305-4d6f-b4e6-83149e153992 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:08.284266 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 179/368] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:08 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1262 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:07:08.286447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eefdd34d-d305-4d6f-b4e6-83149e153992 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:08.302752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eefdd34d-d305-4d6f-b4e6-83149e153992 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:08.303353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eefdd34d-d305-4d6f-b4e6-83149e153992 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:08.304074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eefdd34d-d305-4d6f-b4e6-83149e153992 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:08.305375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eefdd34d-d305-4d6f-b4e6-83149e153992 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:08.306225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eefdd34d-d305-4d6f-b4e6-83149e153992 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:08.307407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eefdd34d-d305-4d6f-b4e6-83149e153992 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:08.546083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eefdd34d-d305-4d6f-b4e6-83149e153992 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:08.554550 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eefdd34d-d305-4d6f-b4e6-83149e153992 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1319 microversion: 2.1 time: 0.295733 Oct 04 21:07:08.555469 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 190/369] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:08 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:08.930040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-13bc154c-7d8e-43e9-9285-d068c2446fe2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:08.930738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-13bc154c-7d8e-43e9-9285-d068c2446fe2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:08.938988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13bc154c-7d8e-43e9-9285-d068c2446fe2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:08.939705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13bc154c-7d8e-43e9-9285-d068c2446fe2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:08.940422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13bc154c-7d8e-43e9-9285-d068c2446fe2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:08.941389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13bc154c-7d8e-43e9-9285-d068c2446fe2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:08.942080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13bc154c-7d8e-43e9-9285-d068c2446fe2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:08.942566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13bc154c-7d8e-43e9-9285-d068c2446fe2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:09.033902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-13bc154c-7d8e-43e9-9285-d068c2446fe2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:09.045519 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-13bc154c-7d8e-43e9-9285-d068c2446fe2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805" status: 200 len: 1271 microversion: 2.1 time: 0.119001 Oct 04 21:07:09.051786 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 180/370] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:08 2022] GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:09.281068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-90a4a58d-e887-455a-aa12-8307b08f35b4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:09.282279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-90a4a58d-e887-455a-aa12-8307b08f35b4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:09.291733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90a4a58d-e887-455a-aa12-8307b08f35b4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:09.296254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-788ea7a3-73f4-429c-9a38-a67e869849bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:09.297004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-788ea7a3-73f4-429c-9a38-a67e869849bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:09.305072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90a4a58d-e887-455a-aa12-8307b08f35b4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:09.305072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90a4a58d-e887-455a-aa12-8307b08f35b4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:09.305072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90a4a58d-e887-455a-aa12-8307b08f35b4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:09.309184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90a4a58d-e887-455a-aa12-8307b08f35b4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:09.309849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90a4a58d-e887-455a-aa12-8307b08f35b4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:09.321186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-788ea7a3-73f4-429c-9a38-a67e869849bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:09.325254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-788ea7a3-73f4-429c-9a38-a67e869849bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:09.326027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-788ea7a3-73f4-429c-9a38-a67e869849bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:09.330508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-788ea7a3-73f4-429c-9a38-a67e869849bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:09.332347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-788ea7a3-73f4-429c-9a38-a67e869849bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:09.333054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-788ea7a3-73f4-429c-9a38-a67e869849bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:09.473904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-788ea7a3-73f4-429c-9a38-a67e869849bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:09.484268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-788ea7a3-73f4-429c-9a38-a67e869849bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:09.487113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-788ea7a3-73f4-429c-9a38-a67e869849bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:09.493967 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-788ea7a3-73f4-429c-9a38-a67e869849bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1314 microversion: 2.25 time: 0.205991 Oct 04 21:07:09.495045 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 181/371] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:09 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:07:09.582674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b526b6b0-f99f-480b-b243-e17f971c8e61 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:09.583294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b526b6b0-f99f-480b-b243-e17f971c8e61 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:09.594451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b526b6b0-f99f-480b-b243-e17f971c8e61 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:09.594899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b526b6b0-f99f-480b-b243-e17f971c8e61 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:09.595338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b526b6b0-f99f-480b-b243-e17f971c8e61 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:09.596047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b526b6b0-f99f-480b-b243-e17f971c8e61 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:09.596505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b526b6b0-f99f-480b-b243-e17f971c8e61 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:09.596934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b526b6b0-f99f-480b-b243-e17f971c8e61 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:09.659248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-90a4a58d-e887-455a-aa12-8307b08f35b4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:09.667932 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-90a4a58d-e887-455a-aa12-8307b08f35b4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1310 microversion: 2.1 time: 0.392149 Oct 04 21:07:09.671311 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 191/372] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:09 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1310 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:09.819910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b526b6b0-f99f-480b-b243-e17f971c8e61 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:09.832746 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b526b6b0-f99f-480b-b243-e17f971c8e61 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1319 microversion: 2.1 time: 0.254423 Oct 04 21:07:09.835635 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 182/373] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:09 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:10.069710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3a5f0bb2-144c-411a-b8a3-59653484b80c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:10.071558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3a5f0bb2-144c-411a-b8a3-59653484b80c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:10.080089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a5f0bb2-144c-411a-b8a3-59653484b80c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:10.082540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a5f0bb2-144c-411a-b8a3-59653484b80c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:10.083188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a5f0bb2-144c-411a-b8a3-59653484b80c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:10.084412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a5f0bb2-144c-411a-b8a3-59653484b80c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:10.085112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a5f0bb2-144c-411a-b8a3-59653484b80c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:10.086833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a5f0bb2-144c-411a-b8a3-59653484b80c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:10.208182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3a5f0bb2-144c-411a-b8a3-59653484b80c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:10.217020 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3a5f0bb2-144c-411a-b8a3-59653484b80c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805" status: 200 len: 1277 microversion: 2.1 time: 0.151075 Oct 04 21:07:10.217624 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 192/374] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:10 2022] GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:10.481815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-b3a57663-e5bc-4f54-bfe5-257313944a0b req-d18690d9-809b-415b-86bf-d7158193a0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee48d230-2152-48c0-b95f-29a55787f7a4", "name": "network-vif-plugged", "status": "completed", "tag": "a4684f8a-e6a9-4608-b21b-3aaef38405be"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:10.499875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b3a57663-e5bc-4f54-bfe5-257313944a0b req-d18690d9-809b-415b-86bf-d7158193a0e7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:10.504375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b3a57663-e5bc-4f54-bfe5-257313944a0b req-d18690d9-809b-415b-86bf-d7158193a0e7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:10.505052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b3a57663-e5bc-4f54-bfe5-257313944a0b req-d18690d9-809b-415b-86bf-d7158193a0e7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:10.520309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e329b79e-1149-4a3e-adf6-e3c4eaa6c6a4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:10.520917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e329b79e-1149-4a3e-adf6-e3c4eaa6c6a4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:10.530506 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-b3a57663-e5bc-4f54-bfe5-257313944a0b req-d18690d9-809b-415b-86bf-d7158193a0e7 service nova] Creating event network-vif-plugged:a4684f8a-e6a9-4608-b21b-3aaef38405be for instance ee48d230-2152-48c0-b95f-29a55787f7a4 on n-h1-860282-1 Oct 04 21:07:10.535185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e329b79e-1149-4a3e-adf6-e3c4eaa6c6a4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:10.539948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e329b79e-1149-4a3e-adf6-e3c4eaa6c6a4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:10.541017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e329b79e-1149-4a3e-adf6-e3c4eaa6c6a4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:10.541872 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-b3a57663-e5bc-4f54-bfe5-257313944a0b req-d18690d9-809b-415b-86bf-d7158193a0e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063505 Oct 04 21:07:10.542842 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 183/375] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:10.545277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e329b79e-1149-4a3e-adf6-e3c4eaa6c6a4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:10.545834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e329b79e-1149-4a3e-adf6-e3c4eaa6c6a4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:10.550532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e329b79e-1149-4a3e-adf6-e3c4eaa6c6a4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:10.573051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:10.682610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e329b79e-1149-4a3e-adf6-e3c4eaa6c6a4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:10.694523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d68a68ed-ccd2-4176-9069-ba0d7a8cf755 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:10.695923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d68a68ed-ccd2-4176-9069-ba0d7a8cf755 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:10.698727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e329b79e-1149-4a3e-adf6-e3c4eaa6c6a4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:10.700487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e329b79e-1149-4a3e-adf6-e3c4eaa6c6a4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:10.703525 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e329b79e-1149-4a3e-adf6-e3c4eaa6c6a4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1322 microversion: 2.25 time: 0.186244 Oct 04 21:07:10.711371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d68a68ed-ccd2-4176-9069-ba0d7a8cf755 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:10.711870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d68a68ed-ccd2-4176-9069-ba0d7a8cf755 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:10.712310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d68a68ed-ccd2-4176-9069-ba0d7a8cf755 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:10.713017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d68a68ed-ccd2-4176-9069-ba0d7a8cf755 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:10.724650 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 193/376] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:10 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:07:10.727495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d68a68ed-ccd2-4176-9069-ba0d7a8cf755 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:10.728408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d68a68ed-ccd2-4176-9069-ba0d7a8cf755 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:10.869900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b4e0934f-215e-4483-8f58-e41a5020a699 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:10.870596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b4e0934f-215e-4483-8f58-e41a5020a699 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:10.890850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b4e0934f-215e-4483-8f58-e41a5020a699 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:10.891345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b4e0934f-215e-4483-8f58-e41a5020a699 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:10.891832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b4e0934f-215e-4483-8f58-e41a5020a699 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:10.892761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b4e0934f-215e-4483-8f58-e41a5020a699 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:10.893229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b4e0934f-215e-4483-8f58-e41a5020a699 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:10.893686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b4e0934f-215e-4483-8f58-e41a5020a699 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:11.071208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d68a68ed-ccd2-4176-9069-ba0d7a8cf755 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:11.079559 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d68a68ed-ccd2-4176-9069-ba0d7a8cf755 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1310 microversion: 2.1 time: 0.390483 Oct 04 21:07:11.083506 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 184/377] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:10 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1310 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:11.153118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b4e0934f-215e-4483-8f58-e41a5020a699 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:11.166801 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b4e0934f-215e-4483-8f58-e41a5020a699 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1319 microversion: 2.1 time: 0.311644 Oct 04 21:07:11.167710 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 194/378] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:10 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:11.240273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7c9bc630-d572-43d6-b707-61e3c7bf9762 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:11.240926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7c9bc630-d572-43d6-b707-61e3c7bf9762 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:11.252006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c9bc630-d572-43d6-b707-61e3c7bf9762 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:11.254708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c9bc630-d572-43d6-b707-61e3c7bf9762 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:11.255150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c9bc630-d572-43d6-b707-61e3c7bf9762 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:11.255873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c9bc630-d572-43d6-b707-61e3c7bf9762 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:11.256342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c9bc630-d572-43d6-b707-61e3c7bf9762 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:11.256773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c9bc630-d572-43d6-b707-61e3c7bf9762 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:11.527784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7c9bc630-d572-43d6-b707-61e3c7bf9762 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:11.540204 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7c9bc630-d572-43d6-b707-61e3c7bf9762 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805" status: 200 len: 1319 microversion: 2.1 time: 0.303740 Oct 04 21:07:11.546358 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 195/379] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:11 2022] GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:11.668716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6516dcf0-9876-4b0c-b0ae-3c0fc4b11d96 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Calling method '.version_select at 0x7f5790b6d940>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:11.732279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-000ae6e6-2d7a-46af-99e4-954266142858 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:11.742381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-000ae6e6-2d7a-46af-99e4-954266142858 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:11.772974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-000ae6e6-2d7a-46af-99e4-954266142858 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:11.774865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-000ae6e6-2d7a-46af-99e4-954266142858 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:11.778121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-000ae6e6-2d7a-46af-99e4-954266142858 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:11.780289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-000ae6e6-2d7a-46af-99e4-954266142858 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:11.783282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-000ae6e6-2d7a-46af-99e4-954266142858 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:11.785588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-000ae6e6-2d7a-46af-99e4-954266142858 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:11.914506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-000ae6e6-2d7a-46af-99e4-954266142858 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:11.924411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-000ae6e6-2d7a-46af-99e4-954266142858 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:11.928352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-000ae6e6-2d7a-46af-99e4-954266142858 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:11.930328 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-000ae6e6-2d7a-46af-99e4-954266142858 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1320 microversion: 2.25 time: 0.202531 Oct 04 21:07:11.931506 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 196/380] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:11 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1320 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:12.104832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d2b94c92-25c9-4341-a1ec-14b1f38fd91d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:12.105465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d2b94c92-25c9-4341-a1ec-14b1f38fd91d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:12.126611 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6516dcf0-9876-4b0c-b0ae-3c0fc4b11d96 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675" status: 200 len: 371 microversion: 2.1 time: 0.996052 Oct 04 21:07:12.126853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2b94c92-25c9-4341-a1ec-14b1f38fd91d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:12.127505 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 185/381] 10.222.0.30 () {58 vars in 1242 bytes} [Tue Oct 4 21:07:11 2022] GET /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675 => generated 371 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:07:12.136758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2b94c92-25c9-4341-a1ec-14b1f38fd91d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:12.137582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2b94c92-25c9-4341-a1ec-14b1f38fd91d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:12.139596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2b94c92-25c9-4341-a1ec-14b1f38fd91d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:12.140174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2b94c92-25c9-4341-a1ec-14b1f38fd91d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:12.140844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-35af5c3e-5fd7-4743-ab7c-a4bf92e2fc9d tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Action: 'update', calling method: .version_select at 0x7f5790b3ddc0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:12.141328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2b94c92-25c9-4341-a1ec-14b1f38fd91d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:12.370787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d2b94c92-25c9-4341-a1ec-14b1f38fd91d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:12.382448 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d2b94c92-25c9-4341-a1ec-14b1f38fd91d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1310 microversion: 2.1 time: 0.281030 Oct 04 21:07:12.383577 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 197/382] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:12 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1310 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:12.390396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f1fb3fbb-68e2-4370-bd99-fca2123fd9e5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:12.391636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f1fb3fbb-68e2-4370-bd99-fca2123fd9e5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:12.400480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1fb3fbb-68e2-4370-bd99-fca2123fd9e5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:12.401153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1fb3fbb-68e2-4370-bd99-fca2123fd9e5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:12.401803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1fb3fbb-68e2-4370-bd99-fca2123fd9e5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:12.402952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1fb3fbb-68e2-4370-bd99-fca2123fd9e5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:12.404642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1fb3fbb-68e2-4370-bd99-fca2123fd9e5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:12.406009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1fb3fbb-68e2-4370-bd99-fca2123fd9e5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:12.535540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35af5c3e-5fd7-4743-ab7c-a4bf92e2fc9d tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:12.538932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35af5c3e-5fd7-4743-ab7c-a4bf92e2fc9d tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:12.542623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35af5c3e-5fd7-4743-ab7c-a4bf92e2fc9d tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:12.543628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35af5c3e-5fd7-4743-ab7c-a4bf92e2fc9d tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:12.544782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35af5c3e-5fd7-4743-ab7c-a4bf92e2fc9d tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:12.545377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35af5c3e-5fd7-4743-ab7c-a4bf92e2fc9d tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:12.609975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f1fb3fbb-68e2-4370-bd99-fca2123fd9e5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:12.644083 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f1fb3fbb-68e2-4370-bd99-fca2123fd9e5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1319 microversion: 2.1 time: 0.254684 Oct 04 21:07:12.644310 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 198/383] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:12 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:12.651605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eabffc93-1faf-4864-b1c2-bc44a4c7be7d tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:12.652948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eabffc93-1faf-4864-b1c2-bc44a4c7be7d tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:12.661184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eabffc93-1faf-4864-b1c2-bc44a4c7be7d tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:12.662419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eabffc93-1faf-4864-b1c2-bc44a4c7be7d tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:12.663097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eabffc93-1faf-4864-b1c2-bc44a4c7be7d tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:12.664560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eabffc93-1faf-4864-b1c2-bc44a4c7be7d tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:12.665243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eabffc93-1faf-4864-b1c2-bc44a4c7be7d tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:12.665915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eabffc93-1faf-4864-b1c2-bc44a4c7be7d tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:12.738641 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-35af5c3e-5fd7-4743-ab7c-a4bf92e2fc9d tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675" status: 200 len: 328 microversion: 2.1 time: 0.602597 Oct 04 21:07:12.748365 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 186/384] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Oct 4 21:07:12 2022] PUT /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675 => generated 328 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:12.759234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-c7f58f70-a068-4151-a8f2-cc213160456f req-93bb79f8-b35e-456e-8bdc-6c6cd92af323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd5aea7-1ee4-4b65-8113-f35d01190b7b", "name": "network-vif-plugged", "status": "completed", "tag": "05977ab0-dafe-4113-9224-f929f82028cc"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:12.786847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c7f58f70-a068-4151-a8f2-cc213160456f req-93bb79f8-b35e-456e-8bdc-6c6cd92af323 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:12.787358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c7f58f70-a068-4151-a8f2-cc213160456f req-93bb79f8-b35e-456e-8bdc-6c6cd92af323 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:12.798402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c7f58f70-a068-4151-a8f2-cc213160456f req-93bb79f8-b35e-456e-8bdc-6c6cd92af323 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:12.822007 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-c7f58f70-a068-4151-a8f2-cc213160456f req-93bb79f8-b35e-456e-8bdc-6c6cd92af323 service nova] Creating event network-vif-plugged:05977ab0-dafe-4113-9224-f929f82028cc for instance cbd5aea7-1ee4-4b65-8113-f35d01190b7b on n-h1-860282-1 Oct 04 21:07:12.836739 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-c7f58f70-a068-4151-a8f2-cc213160456f req-93bb79f8-b35e-456e-8bdc-6c6cd92af323 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086154 Oct 04 21:07:12.842260 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 187/385] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:12.891998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eabffc93-1faf-4864-b1c2-bc44a4c7be7d tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:12.910138 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eabffc93-1faf-4864-b1c2-bc44a4c7be7d tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805" status: 200 len: 1319 microversion: 2.1 time: 0.259453 Oct 04 21:07:12.911258 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 199/386] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:12 2022] GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:12.959883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8e76ba03-9dae-4fd2-86a1-351f1cc78af1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:12.964256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8e76ba03-9dae-4fd2-86a1-351f1cc78af1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:12.968179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e76ba03-9dae-4fd2-86a1-351f1cc78af1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:12.968680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e76ba03-9dae-4fd2-86a1-351f1cc78af1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:12.969120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e76ba03-9dae-4fd2-86a1-351f1cc78af1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:12.970082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e76ba03-9dae-4fd2-86a1-351f1cc78af1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:12.970788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e76ba03-9dae-4fd2-86a1-351f1cc78af1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:12.971216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e76ba03-9dae-4fd2-86a1-351f1cc78af1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:13.121226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8e76ba03-9dae-4fd2-86a1-351f1cc78af1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:13.130291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8e76ba03-9dae-4fd2-86a1-351f1cc78af1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:13.131734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8e76ba03-9dae-4fd2-86a1-351f1cc78af1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:13.133040 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8e76ba03-9dae-4fd2-86a1-351f1cc78af1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1362 microversion: 2.25 time: 0.178746 Oct 04 21:07:13.134185 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 200/387] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:12 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:07:13.299072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-145323875", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:13.379455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:07:13.414975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f6daa202-f350-460e-8588-b4c92de7bb97 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:13.415991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f6daa202-f350-460e-8588-b4c92de7bb97 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:13.427487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6daa202-f350-460e-8588-b4c92de7bb97 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:13.428960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6daa202-f350-460e-8588-b4c92de7bb97 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:13.429644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6daa202-f350-460e-8588-b4c92de7bb97 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:13.430815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6daa202-f350-460e-8588-b4c92de7bb97 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:13.431945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6daa202-f350-460e-8588-b4c92de7bb97 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:13.433470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6daa202-f350-460e-8588-b4c92de7bb97 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:13.661875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f6daa202-f350-460e-8588-b4c92de7bb97 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:13.661875 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f6daa202-f350-460e-8588-b4c92de7bb97 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1492 microversion: 2.1 time: 0.256148 Oct 04 21:07:13.661875 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 201/388] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:13 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1492 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:13.700195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:07:13.701271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:07:13.701985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:07:13.702606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:07:13.703203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:07:13.713356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:13.714145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:13.714754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:13.717921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:13.717921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:13.717921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:13.735869 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Getting quotas for project e18b8ecf521340f29e9f5ec7480fa675. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:13.745007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Getting quotas for user 1333edebb75244b3a3e6052524dac48d and project e18b8ecf521340f29e9f5ec7480fa675. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:13.779205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.utils [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] cores quota exceeded for e18b8ecf521340f29e9f5ec7480fa675, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122758) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 21:07:13.780227 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Request method failure captured: Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 144 Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKB9AxYM-aly-Rx10Rdisada58LMQZYVVfeq5BkN1qwFC9irCU_1xVlkyYCYEVuJM__mT3ZHK3Q7ltQNsaaLLq075x1BEAxXpPBWDkcgePXduqF8GEu0yW0Ym4PPzUX2Gd3NuT3etXEM1ulg0-Hn8ClE-t4ReZL7mAB0HAOzbT3n1kg Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: e18b8ecf521340f29e9f5ec7480fa675 Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-QuotasAdminNegativeTest-428506377 Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:07:13.783908 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:07:13.785220 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e18b8ecf521340f29e9f5ec7480fa675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e18b8ecf521340f29e9f5ec7480fa675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e18b8ecf521340f29e9f5ec7480fa675"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e18b8ecf521340f29e9f5ec7480fa675"}]}] Oct 04 21:07:13.785220 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-QuotasAdminNegativeTest-428506377 Oct 04 21:07:13.785220 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: e18b8ecf521340f29e9f5ec7480fa675 Oct 04 21:07:13.785220 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-428506377 Oct 04 21:07:13.785220 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-QuotasAdminNegativeTest-428506377-project Oct 04 21:07:13.785220 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:07:13.785220 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:07:13.785220 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 1333edebb75244b3a3e6052524dac48d Oct 04 21:07:13.785220 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-QuotasAdminNegativeTest-428506377-project Oct 04 21:07:13.785220 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:07:13.785220 n-d-860282-1 devstack@n-api.service[122758]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-145323875", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} Oct 04 21:07:13.785220 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:07:13.786008 n-d-860282-1 devstack@n-api.service[122758]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 21:07:13.786008 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-145323875', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452'}}} Oct 04 21:07:13.786008 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:13.786008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:13.786008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 21:07:13.786008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 21:07:13.786008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:07:13.786008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:07:13.786008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 21:07:13.786008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc Oct 04 21:07:13.786008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 21:07:13.786008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 21:07:13.786008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:07:13.786008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:07:13.786008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 21:07:13.786008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 21:07:13.786008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 21:07:13.786008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:13.787108 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:13.788490 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:13.789796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:13.789796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:13.789796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:13.789796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:13.789796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 21:07:13.789796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:13.789796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:13.789796 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a598e64b-6c2c-4bc9-a202-964d979d5372 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.834475 Oct 04 21:07:13.790729 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 188/389] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:07:12 2022] POST /compute/v2.1/servers => generated 111 bytes in 842 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:07:13.795716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-ca61c4e7-61a5-4e01-8916-7ae29328fc5e req-5d9486b6-9ecd-414d-a15a-b6df2e7af728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f93b80a9-1170-47c7-b177-93f1ea350805", "tag": "706e6fc5-a191-4fdf-854b-f0f15e85b501"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:13.806987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ca61c4e7-61a5-4e01-8916-7ae29328fc5e req-5d9486b6-9ecd-414d-a15a-b6df2e7af728 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:13.807476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ca61c4e7-61a5-4e01-8916-7ae29328fc5e req-5d9486b6-9ecd-414d-a15a-b6df2e7af728 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:13.807911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ca61c4e7-61a5-4e01-8916-7ae29328fc5e req-5d9486b6-9ecd-414d-a15a-b6df2e7af728 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:13.820790 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-ca61c4e7-61a5-4e01-8916-7ae29328fc5e req-5d9486b6-9ecd-414d-a15a-b6df2e7af728 service nova] Creating event network-changed:706e6fc5-a191-4fdf-854b-f0f15e85b501 for instance f93b80a9-1170-47c7-b177-93f1ea350805 on n-h2-860282-1 Oct 04 21:07:13.827229 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-ca61c4e7-61a5-4e01-8916-7ae29328fc5e req-5d9486b6-9ecd-414d-a15a-b6df2e7af728 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035049 Oct 04 21:07:13.827823 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 189/390] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:13.833896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e893936e-c886-4728-985b-6fcdfd5bb7f3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:13.834595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e893936e-c886-4728-985b-6fcdfd5bb7f3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:13.840837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e893936e-c886-4728-985b-6fcdfd5bb7f3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:13.841548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e893936e-c886-4728-985b-6fcdfd5bb7f3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:13.844052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e893936e-c886-4728-985b-6fcdfd5bb7f3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:13.844052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e893936e-c886-4728-985b-6fcdfd5bb7f3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:13.844052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e893936e-c886-4728-985b-6fcdfd5bb7f3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:13.844052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e893936e-c886-4728-985b-6fcdfd5bb7f3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:13.917061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1ade4dfd-46f2-4721-a2ab-fe012acc446f tempest-QuotaClassesAdmin257Test-1496048447 tempest-QuotaClassesAdmin257Test-1496048447-project-admin] Calling method '.version_select at 0x7f5790a441f0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:13.942995 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1ade4dfd-46f2-4721-a2ab-fe012acc446f tempest-QuotaClassesAdmin257Test-1496048447 tempest-QuotaClassesAdmin257Test-1496048447-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.278560 Oct 04 21:07:13.962524 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 202/391] 10.222.0.30 () {60 vars in 1226 bytes} [Tue Oct 4 21:07:13 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:07:14.010961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e893936e-c886-4728-985b-6fcdfd5bb7f3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:14.024486 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e893936e-c886-4728-985b-6fcdfd5bb7f3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1319 microversion: 2.1 time: 0.194551 Oct 04 21:07:14.035206 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 190/392] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:13 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:14.042039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-93307bca-d611-43f3-a4e3-0859629dd039 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Action: 'update', calling method: .version_select at 0x7f5790a9eca0>, body: {"quota_set": {"cores": 20}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:14.113880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-415afed9-4027-4d5f-adb2-c4c18b5f22aa tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:14.114510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-415afed9-4027-4d5f-adb2-c4c18b5f22aa tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:14.125782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-415afed9-4027-4d5f-adb2-c4c18b5f22aa tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:14.126289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-415afed9-4027-4d5f-adb2-c4c18b5f22aa tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:14.126779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-415afed9-4027-4d5f-adb2-c4c18b5f22aa tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:14.127498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-415afed9-4027-4d5f-adb2-c4c18b5f22aa tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:14.128113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-415afed9-4027-4d5f-adb2-c4c18b5f22aa tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:14.133926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-415afed9-4027-4d5f-adb2-c4c18b5f22aa tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:14.417802 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-415afed9-4027-4d5f-adb2-c4c18b5f22aa tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1643 microversion: 2.1 time: 0.453250 Oct 04 21:07:14.424322 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 203/393] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:13 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1643 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:14.429859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93307bca-d611-43f3-a4e3-0859629dd039 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:14.430459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93307bca-d611-43f3-a4e3-0859629dd039 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:14.430924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93307bca-d611-43f3-a4e3-0859629dd039 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:14.432245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93307bca-d611-43f3-a4e3-0859629dd039 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:14.432716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93307bca-d611-43f3-a4e3-0859629dd039 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:14.433870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93307bca-d611-43f3-a4e3-0859629dd039 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:14.450876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9efac21b-5f83-42b6-aab9-d56d79b80294 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:14.451872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9efac21b-5f83-42b6-aab9-d56d79b80294 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:14.467598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9efac21b-5f83-42b6-aab9-d56d79b80294 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:14.469846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9efac21b-5f83-42b6-aab9-d56d79b80294 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:14.472230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9efac21b-5f83-42b6-aab9-d56d79b80294 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:14.473157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9efac21b-5f83-42b6-aab9-d56d79b80294 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:14.475273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9efac21b-5f83-42b6-aab9-d56d79b80294 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:14.477017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9efac21b-5f83-42b6-aab9-d56d79b80294 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:14.628937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9efac21b-5f83-42b6-aab9-d56d79b80294 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:14.638948 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9efac21b-5f83-42b6-aab9-d56d79b80294 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805" status: 200 len: 1319 microversion: 2.1 time: 0.213018 Oct 04 21:07:14.639551 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 204/394] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:14 2022] GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:14.644541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-da5bdd2c-bb7a-4165-b2d9-57db92a46d5b tempest-QuotaClassesAdmin257Test-1496048447 tempest-QuotaClassesAdmin257Test-1496048447-project-admin] Action: 'update', calling method: .version_select at 0x7f5790d07a60>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:14.661298 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-93307bca-d611-43f3-a4e3-0859629dd039 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675" status: 200 len: 329 microversion: 2.1 time: 0.624673 Oct 04 21:07:14.664153 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 191/395] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Oct 4 21:07:14 2022] PUT /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675 => generated 329 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:14.666710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6b800e78-2977-4263-bc1e-d1320f169c16 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:14.667323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6b800e78-2977-4263-bc1e-d1320f169c16 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:14.670202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:14.675021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b800e78-2977-4263-bc1e-d1320f169c16 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:14.675518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b800e78-2977-4263-bc1e-d1320f169c16 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:14.675962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b800e78-2977-4263-bc1e-d1320f169c16 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:14.676666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b800e78-2977-4263-bc1e-d1320f169c16 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:14.677125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b800e78-2977-4263-bc1e-d1320f169c16 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:14.677597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b800e78-2977-4263-bc1e-d1320f169c16 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:14.814320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6b800e78-2977-4263-bc1e-d1320f169c16 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:14.822567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6b800e78-2977-4263-bc1e-d1320f169c16 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:14.824015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6b800e78-2977-4263-bc1e-d1320f169c16 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:14.825226 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6b800e78-2977-4263-bc1e-d1320f169c16 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1362 microversion: 2.25 time: 0.162255 Oct 04 21:07:14.825966 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 192/396] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:14 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:14.830374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9e408ef8-5731-450a-88dd-809be680ab17 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:14.830978 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9e408ef8-5731-450a-88dd-809be680ab17 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:14.836706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e408ef8-5731-450a-88dd-809be680ab17 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:14.837198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e408ef8-5731-450a-88dd-809be680ab17 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:14.837694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e408ef8-5731-450a-88dd-809be680ab17 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:14.838421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e408ef8-5731-450a-88dd-809be680ab17 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:14.838880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e408ef8-5731-450a-88dd-809be680ab17 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:14.839303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e408ef8-5731-450a-88dd-809be680ab17 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:15.006262 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9e408ef8-5731-450a-88dd-809be680ab17 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1643 microversion: 2.1 time: 0.178794 Oct 04 21:07:15.006830 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 193/397] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:14 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1643 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:15.015251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f895c3b1-29e8-468e-9948-67afd035822a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:15.015251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f895c3b1-29e8-468e-9948-67afd035822a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:15.017949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f895c3b1-29e8-468e-9948-67afd035822a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:15.018435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f895c3b1-29e8-468e-9948-67afd035822a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:15.018868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f895c3b1-29e8-468e-9948-67afd035822a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:15.019565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f895c3b1-29e8-468e-9948-67afd035822a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:15.020111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f895c3b1-29e8-468e-9948-67afd035822a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:15.020716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f895c3b1-29e8-468e-9948-67afd035822a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:15.047207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f895c3b1-29e8-468e-9948-67afd035822a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:07:15.334125 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-da5bdd2c-bb7a-4165-b2d9-57db92a46d5b tempest-QuotaClassesAdmin257Test-1496048447 tempest-QuotaClassesAdmin257Test-1496048447-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.693205 Oct 04 21:07:15.334750 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 205/398] 10.222.0.30 () {62 vars in 1247 bytes} [Tue Oct 4 21:07:14 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:07:15.388179 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f895c3b1-29e8-468e-9948-67afd035822a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 204 len: 0 microversion: 2.1 time: 0.379977 Oct 04 21:07:15.388977 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 194/399] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:07:15 2022] DELETE /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:07:15.393764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dbcf4dfa-f864-4ca7-95c5-88fc791e6ac5 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Calling method '.version_select at 0x7f5790b4be50>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:15.448282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3acf5ee2-3ae8-46f6-9c7b-22de2d8e11ef tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:15.456048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3acf5ee2-3ae8-46f6-9c7b-22de2d8e11ef tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:15.456603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3acf5ee2-3ae8-46f6-9c7b-22de2d8e11ef tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:15.457032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3acf5ee2-3ae8-46f6-9c7b-22de2d8e11ef tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:15.460756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3acf5ee2-3ae8-46f6-9c7b-22de2d8e11ef tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:15.460756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3acf5ee2-3ae8-46f6-9c7b-22de2d8e11ef tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:15.460756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3acf5ee2-3ae8-46f6-9c7b-22de2d8e11ef tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:15.464076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=20 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:15.483771 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3acf5ee2-3ae8-46f6-9c7b-22de2d8e11ef tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.147916 Oct 04 21:07:15.492798 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 206/400] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:07:15 2022] GET /compute/v2.1/os-services => generated 944 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:15.492798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b3999e2d-5930-4920-84af-7677ce5290f4 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:15.496540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3999e2d-5930-4920-84af-7677ce5290f4 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:15.497045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3999e2d-5930-4920-84af-7677ce5290f4 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:15.498251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3999e2d-5930-4920-84af-7677ce5290f4 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:15.499394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3999e2d-5930-4920-84af-7677ce5290f4 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:15.499648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3999e2d-5930-4920-84af-7677ce5290f4 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:15.500183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3999e2d-5930-4920-84af-7677ce5290f4 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:15.530103 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b3999e2d-5930-4920-84af-7677ce5290f4 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.041035 Oct 04 21:07:15.530103 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 207/401] 10.222.0.30 () {58 vars in 1176 bytes} [Tue Oct 4 21:07:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:15.532405 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dbcf4dfa-f864-4ca7-95c5-88fc791e6ac5 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675" status: 200 len: 374 microversion: 2.1 time: 0.136461 Oct 04 21:07:15.532994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4b22b8b4-dd0c-4b96-9aeb-3561c1867337 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:15.533476 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 195/402] 10.222.0.30 () {58 vars in 1242 bytes} [Tue Oct 4 21:07:15 2022] GET /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675 => generated 374 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:15.533650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4b22b8b4-dd0c-4b96-9aeb-3561c1867337 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:15.539631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fb5048dc-8ecb-4cdc-950e-56110c56b32e tempest-QuotaClassesAdmin257Test-1496048447 tempest-QuotaClassesAdmin257Test-1496048447-project-admin] Calling method '.version_select at 0x7f5790a731f0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:15.550287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b22b8b4-dd0c-4b96-9aeb-3561c1867337 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:15.550784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b22b8b4-dd0c-4b96-9aeb-3561c1867337 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:15.551603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b22b8b4-dd0c-4b96-9aeb-3561c1867337 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:15.551933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b22b8b4-dd0c-4b96-9aeb-3561c1867337 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:15.552394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b22b8b4-dd0c-4b96-9aeb-3561c1867337 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:15.552828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b22b8b4-dd0c-4b96-9aeb-3561c1867337 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:15.558128 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fb5048dc-8ecb-4cdc-950e-56110c56b32e tempest-QuotaClassesAdmin257Test-1496048447 tempest-QuotaClassesAdmin257Test-1496048447-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.021838 Oct 04 21:07:15.558545 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 196/403] 10.222.0.30 () {60 vars in 1226 bytes} [Tue Oct 4 21:07:15 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:07:15.563510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5f3297c5-f49f-4f3a-a9fa-693ea894a16c tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:15.567143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f3297c5-f49f-4f3a-a9fa-693ea894a16c tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:15.567701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f3297c5-f49f-4f3a-a9fa-693ea894a16c tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:15.568214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f3297c5-f49f-4f3a-a9fa-693ea894a16c tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:15.569021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f3297c5-f49f-4f3a-a9fa-693ea894a16c tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:15.569601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f3297c5-f49f-4f3a-a9fa-693ea894a16c tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:15.570111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f3297c5-f49f-4f3a-a9fa-693ea894a16c tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:15.594634 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5f3297c5-f49f-4f3a-a9fa-693ea894a16c tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.034973 Oct 04 21:07:15.597758 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 197/404] 10.222.0.30 () {58 vars in 1170 bytes} [Tue Oct 4 21:07:15 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:15.607923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-79d0a37a-2039-4198-af10-68997b341b80 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-85169362", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "78680178", "adminPass": "***", "networks": [{"uuid": "0c64d317-ef71-4c6a-8b35-d4574c9e9de5"}], "security_groups": [{"name": "tempest-securitygroup--119652470"}], "key_name": "tempest-keypair-1534777327", "user_data": "}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:15.704343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4b22b8b4-dd0c-4b96-9aeb-3561c1867337 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:15.712092 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4b22b8b4-dd0c-4b96-9aeb-3561c1867337 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1469 microversion: 2.1 time: 0.183034 Oct 04 21:07:15.712668 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 208/405] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:15 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1469 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:15.717850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d1aece02-6ade-455f-ade9-b1ce8877c67a tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860282-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:15.720328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d1aece02-6ade-455f-ade9-b1ce8877c67a tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:15.726166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1aece02-6ade-455f-ade9-b1ce8877c67a tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:15.726649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1aece02-6ade-455f-ade9-b1ce8877c67a tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:15.727082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1aece02-6ade-455f-ade9-b1ce8877c67a tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:15.727771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1aece02-6ade-455f-ade9-b1ce8877c67a tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:15.728217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1aece02-6ade-455f-ade9-b1ce8877c67a tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:15.728797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1aece02-6ade-455f-ade9-b1ce8877c67a tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:15.735109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-79d0a37a-2039-4198-af10-68997b341b80 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] validate_networks() for [('0c64d317-ef71-4c6a-8b35-d4574c9e9de5', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:07:15.807102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-d1aece02-6ade-455f-ade9-b1ce8877c67a tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lazy-loading 'flavor' on Instance uuid ee48d230-2152-48c0-b95f-29a55787f7a4 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:07:15.856305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d1aece02-6ade-455f-ade9-b1ce8877c67a tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Going to try to live migrate instance to n-h2-860282-1 {{(pid=122757) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:07:16.120206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-79d0a37a-2039-4198-af10-68997b341b80 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:07:16.120686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-79d0a37a-2039-4198-af10-68997b341b80 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:07:16.121198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-79d0a37a-2039-4198-af10-68997b341b80 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:07:16.121640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-79d0a37a-2039-4198-af10-68997b341b80 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:07:16.122056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-79d0a37a-2039-4198-af10-68997b341b80 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:07:16.132622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79d0a37a-2039-4198-af10-68997b341b80 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:16.133210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79d0a37a-2039-4198-af10-68997b341b80 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:16.133697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79d0a37a-2039-4198-af10-68997b341b80 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:16.134453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79d0a37a-2039-4198-af10-68997b341b80 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:16.134907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79d0a37a-2039-4198-af10-68997b341b80 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:16.135534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79d0a37a-2039-4198-af10-68997b341b80 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:16.153153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-79d0a37a-2039-4198-af10-68997b341b80 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Getting quotas for project c8d13d1c426145c4824dda4e6aa59040. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:16.158883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-79d0a37a-2039-4198-af10-68997b341b80 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Getting quotas for user ed473156169a4fd793d86dc9e9289dc1 and project c8d13d1c426145c4824dda4e6aa59040. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:16.171294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-79d0a37a-2039-4198-af10-68997b341b80 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:07:16.173916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-79d0a37a-2039-4198-af10-68997b341b80 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:07:16.549402 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-79d0a37a-2039-4198-af10-68997b341b80 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.948584 Oct 04 21:07:16.550240 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 198/406] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:07:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:07:16.554355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c68465e4-0085-4cc8-967a-bf8684075e80 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Action: 'update', calling method: .version_select at 0x7f5790a9e940>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:16.619703 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c68465e4-0085-4cc8-967a-bf8684075e80 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:16.620180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c68465e4-0085-4cc8-967a-bf8684075e80 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:16.620617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c68465e4-0085-4cc8-967a-bf8684075e80 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:16.621331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c68465e4-0085-4cc8-967a-bf8684075e80 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:16.621806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c68465e4-0085-4cc8-967a-bf8684075e80 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:16.622228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c68465e4-0085-4cc8-967a-bf8684075e80 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:16.745160 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c68465e4-0085-4cc8-967a-bf8684075e80 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675" status: 200 len: 330 microversion: 2.1 time: 0.193815 Oct 04 21:07:16.746145 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 199/407] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Oct 4 21:07:16 2022] PUT /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675 => generated 330 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:16.752704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ca733f38-efb6-402f-b033-715de1bfc49c tempest-QuotaClassesAdmin257Test-1496048447 tempest-QuotaClassesAdmin257Test-1496048447-project-admin] Action: 'update', calling method: .version_select at 0x7f5790b649d0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:17.463237 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ca733f38-efb6-402f-b033-715de1bfc49c tempest-QuotaClassesAdmin257Test-1496048447 tempest-QuotaClassesAdmin257Test-1496048447-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.715687 Oct 04 21:07:17.471443 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 200/408] 10.222.0.30 () {62 vars in 1247 bytes} [Tue Oct 4 21:07:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:07:17.483343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-54b3aa58-007c-4003-8d5f-82cfcfb9fc1f tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:17.487467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54b3aa58-007c-4003-8d5f-82cfcfb9fc1f tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:17.488183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54b3aa58-007c-4003-8d5f-82cfcfb9fc1f tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:17.488815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54b3aa58-007c-4003-8d5f-82cfcfb9fc1f tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:17.490309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54b3aa58-007c-4003-8d5f-82cfcfb9fc1f tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:17.491276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54b3aa58-007c-4003-8d5f-82cfcfb9fc1f tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:17.491939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54b3aa58-007c-4003-8d5f-82cfcfb9fc1f tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:17.525228 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-54b3aa58-007c-4003-8d5f-82cfcfb9fc1f tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.045866 Oct 04 21:07:17.527699 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 201/409] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:07:17 2022] GET /compute/v2.1/os-services => generated 944 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:17.533093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-79178b36-67ea-49cb-9ade-c3718c07e0e8 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:17.536592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-79178b36-67ea-49cb-9ade-c3718c07e0e8 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:17.544101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79178b36-67ea-49cb-9ade-c3718c07e0e8 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:17.544815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79178b36-67ea-49cb-9ade-c3718c07e0e8 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:17.545634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79178b36-67ea-49cb-9ade-c3718c07e0e8 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:17.546538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79178b36-67ea-49cb-9ade-c3718c07e0e8 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:17.547197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79178b36-67ea-49cb-9ade-c3718c07e0e8 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:17.547812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79178b36-67ea-49cb-9ade-c3718c07e0e8 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:18.085961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-79178b36-67ea-49cb-9ade-c3718c07e0e8 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:18.094195 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-79178b36-67ea-49cb-9ade-c3718c07e0e8 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805" status: 200 len: 1319 microversion: 2.1 time: 0.565219 Oct 04 21:07:18.095171 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 202/410] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:17 2022] GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 => generated 1319 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:18.099772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f415ef89-bb6a-44a7-8c6e-a2ae42cf4cec tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:18.100489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f415ef89-bb6a-44a7-8c6e-a2ae42cf4cec tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:18.107008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f415ef89-bb6a-44a7-8c6e-a2ae42cf4cec tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:18.107496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f415ef89-bb6a-44a7-8c6e-a2ae42cf4cec tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:18.107937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f415ef89-bb6a-44a7-8c6e-a2ae42cf4cec tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:18.108627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f415ef89-bb6a-44a7-8c6e-a2ae42cf4cec tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:18.109078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f415ef89-bb6a-44a7-8c6e-a2ae42cf4cec tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:18.109787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f415ef89-bb6a-44a7-8c6e-a2ae42cf4cec tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:18.175860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-f415ef89-bb6a-44a7-8c6e-a2ae42cf4cec tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lazy-loading 'flavor' on Instance uuid cbd5aea7-1ee4-4b65-8113-f35d01190b7b {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:07:18.197796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:18.546469 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f415ef89-bb6a-44a7-8c6e-a2ae42cf4cec tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b/action" status: 202 len: 0 microversion: 2.1 time: 0.446766 Oct 04 21:07:18.551600 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 203/411] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:07:18 2022] POST /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:07:18.572122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-96429966-fd55-4b67-9e24-3ed08f628f3a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:18.573776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-96429966-fd55-4b67-9e24-3ed08f628f3a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:18.590422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96429966-fd55-4b67-9e24-3ed08f628f3a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:18.590914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96429966-fd55-4b67-9e24-3ed08f628f3a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:18.591507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96429966-fd55-4b67-9e24-3ed08f628f3a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:18.596425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96429966-fd55-4b67-9e24-3ed08f628f3a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:18.599291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96429966-fd55-4b67-9e24-3ed08f628f3a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:18.599291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96429966-fd55-4b67-9e24-3ed08f628f3a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:18.864364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-96429966-fd55-4b67-9e24-3ed08f628f3a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:18.873528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-96429966-fd55-4b67-9e24-3ed08f628f3a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:18.878111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-96429966-fd55-4b67-9e24-3ed08f628f3a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:18.879720 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-96429966-fd55-4b67-9e24-3ed08f628f3a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1362 microversion: 2.25 time: 0.326629 Oct 04 21:07:18.880778 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 204/412] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:18 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:18.885711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-4ea5f553-a1f7-4544-925a-96a21245f00a req-7e03ecaa-5abe-474f-8078-07a9bf9447ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "392b3ca2-cc0a-44ae-b791-b8d6043f54e8", "tag": "a1c5c085-0f1e-46fd-868c-bc3dc886b2fa"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:18.898171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4ea5f553-a1f7-4544-925a-96a21245f00a req-7e03ecaa-5abe-474f-8078-07a9bf9447ab service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:18.898881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4ea5f553-a1f7-4544-925a-96a21245f00a req-7e03ecaa-5abe-474f-8078-07a9bf9447ab service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:18.899501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4ea5f553-a1f7-4544-925a-96a21245f00a req-7e03ecaa-5abe-474f-8078-07a9bf9447ab service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:18.912186 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-4ea5f553-a1f7-4544-925a-96a21245f00a req-7e03ecaa-5abe-474f-8078-07a9bf9447ab service nova] Creating event network-changed:a1c5c085-0f1e-46fd-868c-bc3dc886b2fa for instance 392b3ca2-cc0a-44ae-b791-b8d6043f54e8 on n-h2-860282-1 Oct 04 21:07:18.932287 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-4ea5f553-a1f7-4544-925a-96a21245f00a req-7e03ecaa-5abe-474f-8078-07a9bf9447ab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048126 Oct 04 21:07:18.934769 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 205/413] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:18.944091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1faa994f-c551-4ac3-99d0-65aaf0a4eb6b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:18.944812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1faa994f-c551-4ac3-99d0-65aaf0a4eb6b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:18.994166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1faa994f-c551-4ac3-99d0-65aaf0a4eb6b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:18.994675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1faa994f-c551-4ac3-99d0-65aaf0a4eb6b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:18.995111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1faa994f-c551-4ac3-99d0-65aaf0a4eb6b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:18.995839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1faa994f-c551-4ac3-99d0-65aaf0a4eb6b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:18.996319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1faa994f-c551-4ac3-99d0-65aaf0a4eb6b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:18.996787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1faa994f-c551-4ac3-99d0-65aaf0a4eb6b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:19.255105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1faa994f-c551-4ac3-99d0-65aaf0a4eb6b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:19.264103 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1faa994f-c551-4ac3-99d0-65aaf0a4eb6b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93" status: 200 len: 1311 microversion: 2.1 time: 0.325663 Oct 04 21:07:19.264679 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 206/414] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:18 2022] GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 => generated 1311 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:19.283285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-553385996", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:19.383031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:07:20.110815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:07:20.116786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:07:20.116786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:07:20.116786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:07:20.116786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:07:20.132922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:20.139097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:20.139830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:20.149632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:20.151612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:20.152078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:20.196227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Getting quotas for project e18b8ecf521340f29e9f5ec7480fa675. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:20.210591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Getting quotas for user 1333edebb75244b3a3e6052524dac48d and project e18b8ecf521340f29e9f5ec7480fa675. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:20.229338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.utils [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] instances quota exceeded for e18b8ecf521340f29e9f5ec7480fa675, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122758) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 21:07:20.229845 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Request method failure captured: Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 144 Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKB9AxYM-aly-Rx10Rdisada58LMQZYVVfeq5BkN1qwFC9irCU_1xVlkyYCYEVuJM__mT3ZHK3Q7ltQNsaaLLq075x1BEAxXpPBWDkcgePXduqF8GEu0yW0Ym4PPzUX2Gd3NuT3etXEM1ulg0-Hn8ClE-t4ReZL7mAB0HAOzbT3n1kg Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: e18b8ecf521340f29e9f5ec7480fa675 Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-QuotasAdminNegativeTest-428506377 Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:07:20.237924 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:07:20.239744 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e18b8ecf521340f29e9f5ec7480fa675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e18b8ecf521340f29e9f5ec7480fa675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e18b8ecf521340f29e9f5ec7480fa675"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e18b8ecf521340f29e9f5ec7480fa675"}]}] Oct 04 21:07:20.239744 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-QuotasAdminNegativeTest-428506377 Oct 04 21:07:20.239744 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: e18b8ecf521340f29e9f5ec7480fa675 Oct 04 21:07:20.239744 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-428506377 Oct 04 21:07:20.239744 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-QuotasAdminNegativeTest-428506377-project Oct 04 21:07:20.239744 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:07:20.239744 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:07:20.239744 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 1333edebb75244b3a3e6052524dac48d Oct 04 21:07:20.239744 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-QuotasAdminNegativeTest-428506377-project Oct 04 21:07:20.239744 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:07:20.239744 n-d-860282-1 devstack@n-api.service[122758]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-553385996", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} Oct 04 21:07:20.239744 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:07:20.240879 n-d-860282-1 devstack@n-api.service[122758]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 21:07:20.240879 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-553385996', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452'}}} Oct 04 21:07:20.240879 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:20.240879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:20.240879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 21:07:20.240879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 21:07:20.240879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:07:20.240879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:07:20.240879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 21:07:20.240879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc Oct 04 21:07:20.240879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 21:07:20.240879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 21:07:20.240879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:07:20.240879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:07:20.240879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 21:07:20.240879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 21:07:20.240879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 21:07:20.240879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:20.242089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:20.243340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:20.244607 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:20.244607 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:20.244607 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:20.244607 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:20.244607 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 21:07:20.244607 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:20.247055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:20.253212 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-215bee26-75f0-46eb-8809-e11adb5b25f0 tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.984205 Oct 04 21:07:20.253212 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 207/415] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:07:19 2022] POST /compute/v2.1/servers => generated 119 bytes in 985 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:07:20.261308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-769c03e8-8455-4110-b5e2-8ce6a8b8cd98 tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:20.286830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-769c03e8-8455-4110-b5e2-8ce6a8b8cd98 tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:20.287353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-769c03e8-8455-4110-b5e2-8ce6a8b8cd98 tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:20.287803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-769c03e8-8455-4110-b5e2-8ce6a8b8cd98 tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:20.289694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-769c03e8-8455-4110-b5e2-8ce6a8b8cd98 tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:20.290582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-769c03e8-8455-4110-b5e2-8ce6a8b8cd98 tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:20.293181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-769c03e8-8455-4110-b5e2-8ce6a8b8cd98 tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:20.335943 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-769c03e8-8455-4110-b5e2-8ce6a8b8cd98 tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=n-d-860282-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.084310 Oct 04 21:07:20.337380 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 208/416] 10.222.0.30 () {58 vars in 1194 bytes} [Tue Oct 4 21:07:20 2022] GET /compute/v2.1/os-services?host=n-d-860282-1&binary=xxx => generated 16 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:07:20.346713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cbab25cb-cb56-4eb5-baeb-261ea0abfd1c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:20.347905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cbab25cb-cb56-4eb5-baeb-261ea0abfd1c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:20.370951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=8,nova_api:INSERT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:20.376262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cbab25cb-cb56-4eb5-baeb-261ea0abfd1c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:20.379588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cbab25cb-cb56-4eb5-baeb-261ea0abfd1c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:20.379588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cbab25cb-cb56-4eb5-baeb-261ea0abfd1c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:20.379588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cbab25cb-cb56-4eb5-baeb-261ea0abfd1c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:20.380447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cbab25cb-cb56-4eb5-baeb-261ea0abfd1c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:20.381140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cbab25cb-cb56-4eb5-baeb-261ea0abfd1c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:20.740516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cbab25cb-cb56-4eb5-baeb-261ea0abfd1c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:20.750925 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cbab25cb-cb56-4eb5-baeb-261ea0abfd1c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1460 microversion: 2.1 time: 0.411977 Oct 04 21:07:20.752102 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 209/417] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:20 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1460 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:20.756844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-06d906e6-73b4-4dfa-a5c0-a2817b55921f req-a0a0b6aa-60d9-43d5-a755-7750306fc430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7555a913-21ac-440f-8323-ca961a6d08d7", "name": "network-vif-deleted", "tag": "ca0fba7b-2727-4db4-adba-b3f7120588e6"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:20.786085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-06d906e6-73b4-4dfa-a5c0-a2817b55921f req-a0a0b6aa-60d9-43d5-a755-7750306fc430 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:20.787125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-06d906e6-73b4-4dfa-a5c0-a2817b55921f req-a0a0b6aa-60d9-43d5-a755-7750306fc430 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:20.787820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-06d906e6-73b4-4dfa-a5c0-a2817b55921f req-a0a0b6aa-60d9-43d5-a755-7750306fc430 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:20.805399 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-06d906e6-73b4-4dfa-a5c0-a2817b55921f req-a0a0b6aa-60d9-43d5-a755-7750306fc430 service nova] Creating event network-vif-deleted:ca0fba7b-2727-4db4-adba-b3f7120588e6 for instance 7555a913-21ac-440f-8323-ca961a6d08d7 on n-h2-860282-1 Oct 04 21:07:20.811692 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-06d906e6-73b4-4dfa-a5c0-a2817b55921f req-a0a0b6aa-60d9-43d5-a755-7750306fc430 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057973 Oct 04 21:07:20.812544 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 210/418] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:20.818482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-549cde19-6f75-4936-9f03-1f7eb254e4bc req-59d23ffb-311e-45ec-b09d-13e7db8d2f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f93b80a9-1170-47c7-b177-93f1ea350805", "name": "network-vif-plugged", "status": "completed", "tag": "706e6fc5-a191-4fdf-854b-f0f15e85b501"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:20.829305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-549cde19-6f75-4936-9f03-1f7eb254e4bc req-59d23ffb-311e-45ec-b09d-13e7db8d2f0c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:20.837090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-549cde19-6f75-4936-9f03-1f7eb254e4bc req-59d23ffb-311e-45ec-b09d-13e7db8d2f0c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:20.837090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-549cde19-6f75-4936-9f03-1f7eb254e4bc req-59d23ffb-311e-45ec-b09d-13e7db8d2f0c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:20.841926 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-549cde19-6f75-4936-9f03-1f7eb254e4bc req-59d23ffb-311e-45ec-b09d-13e7db8d2f0c service nova] Creating event network-vif-plugged:706e6fc5-a191-4fdf-854b-f0f15e85b501 for instance f93b80a9-1170-47c7-b177-93f1ea350805 on n-h2-860282-1 Oct 04 21:07:20.847230 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-549cde19-6f75-4936-9f03-1f7eb254e4bc req-59d23ffb-311e-45ec-b09d-13e7db8d2f0c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033018 Oct 04 21:07:20.847828 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 211/419] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:20.854266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8d1c6dd8-d6b1-402f-827e-2a55223db960 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:20.855250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8d1c6dd8-d6b1-402f-827e-2a55223db960 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:20.863095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d1c6dd8-d6b1-402f-827e-2a55223db960 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:20.863095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d1c6dd8-d6b1-402f-827e-2a55223db960 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:20.863095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d1c6dd8-d6b1-402f-827e-2a55223db960 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:20.869331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d1c6dd8-d6b1-402f-827e-2a55223db960 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:20.870059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d1c6dd8-d6b1-402f-827e-2a55223db960 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:20.870661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d1c6dd8-d6b1-402f-827e-2a55223db960 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.161159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8d1c6dd8-d6b1-402f-827e-2a55223db960 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:21.170275 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8d1c6dd8-d6b1-402f-827e-2a55223db960 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805" status: 200 len: 1319 microversion: 2.1 time: 0.320735 Oct 04 21:07:21.171157 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 212/420] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:20 2022] GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:21.194729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4dea3ecc-4e93-48d7-bc73-c424b71d0a0c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:21.210768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4dea3ecc-4e93-48d7-bc73-c424b71d0a0c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:21.225852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4dea3ecc-4e93-48d7-bc73-c424b71d0a0c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.229848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4dea3ecc-4e93-48d7-bc73-c424b71d0a0c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.229848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4dea3ecc-4e93-48d7-bc73-c424b71d0a0c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.229848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4dea3ecc-4e93-48d7-bc73-c424b71d0a0c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.229848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4dea3ecc-4e93-48d7-bc73-c424b71d0a0c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.230303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4dea3ecc-4e93-48d7-bc73-c424b71d0a0c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.432815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4dea3ecc-4e93-48d7-bc73-c424b71d0a0c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:21.442970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4dea3ecc-4e93-48d7-bc73-c424b71d0a0c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:21.445223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4dea3ecc-4e93-48d7-bc73-c424b71d0a0c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:21.446627 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4dea3ecc-4e93-48d7-bc73-c424b71d0a0c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1362 microversion: 2.25 time: 0.269655 Oct 04 21:07:21.447291 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 213/421] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:21 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:21.451919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3d20762d-ab16-47b6-9d8b-5e23343fb31d tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Action: 'update', calling method: .version_select at 0x7f57909f3a60>, body: {"quota_set": {"instances": 110}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:21.713223 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d1aece02-6ade-455f-ade9-b1ce8877c67a tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4/action" status: 202 len: 0 microversion: 2.1 time: 5.999475 Oct 04 21:07:21.713864 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 209/422] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:07:15 2022] POST /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4/action => generated 0 bytes in 6001 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:07:21.722706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3decff4b-47ce-40d6-b671-ce0b387a2060 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:21.723317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3decff4b-47ce-40d6-b671-ce0b387a2060 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:21.729119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d20762d-ab16-47b6-9d8b-5e23343fb31d tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.729632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d20762d-ab16-47b6-9d8b-5e23343fb31d tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.730071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d20762d-ab16-47b6-9d8b-5e23343fb31d tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.730799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d20762d-ab16-47b6-9d8b-5e23343fb31d tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.731251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d20762d-ab16-47b6-9d8b-5e23343fb31d tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.731490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3decff4b-47ce-40d6-b671-ce0b387a2060 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.731779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d20762d-ab16-47b6-9d8b-5e23343fb31d tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.732106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3decff4b-47ce-40d6-b671-ce0b387a2060 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.732548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3decff4b-47ce-40d6-b671-ce0b387a2060 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.733236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3decff4b-47ce-40d6-b671-ce0b387a2060 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.733719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3decff4b-47ce-40d6-b671-ce0b387a2060 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.734147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3decff4b-47ce-40d6-b671-ce0b387a2060 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.890730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3decff4b-47ce-40d6-b671-ce0b387a2060 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:21.899323 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3decff4b-47ce-40d6-b671-ce0b387a2060 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93" status: 200 len: 1384 microversion: 2.1 time: 0.180435 Oct 04 21:07:21.900389 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 210/423] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:21 2022] GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 => generated 1384 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:21.906050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-93248cb0-9975-490b-89b4-236aafbb002f tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:21.909559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93248cb0-9975-490b-89b4-236aafbb002f tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.910048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93248cb0-9975-490b-89b4-236aafbb002f tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.910485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93248cb0-9975-490b-89b4-236aafbb002f tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.911461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93248cb0-9975-490b-89b4-236aafbb002f tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.912187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93248cb0-9975-490b-89b4-236aafbb002f tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.912578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93248cb0-9975-490b-89b4-236aafbb002f tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.920724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:21.928022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:UPDATE=7 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:21.943290 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-93248cb0-9975-490b-89b4-236aafbb002f tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.041500 Oct 04 21:07:21.945266 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 211/424] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:07:21 2022] GET /compute/v2.1/os-services => generated 944 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:21.947258 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3d20762d-ab16-47b6-9d8b-5e23343fb31d tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675" status: 200 len: 330 microversion: 2.1 time: 0.498446 Oct 04 21:07:21.955238 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 214/425] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Oct 4 21:07:21 2022] PUT /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675 => generated 330 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:21.955439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-311c2def-c985-46d1-877f-f78c813433d7 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:21.956114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-311c2def-c985-46d1-877f-f78c813433d7 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:21.962975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-311c2def-c985-46d1-877f-f78c813433d7 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.963511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-311c2def-c985-46d1-877f-f78c813433d7 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.964140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-311c2def-c985-46d1-877f-f78c813433d7 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.964840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-311c2def-c985-46d1-877f-f78c813433d7 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.965507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-311c2def-c985-46d1-877f-f78c813433d7 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.966634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-311c2def-c985-46d1-877f-f78c813433d7 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.972287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8f1a391e-6e15-46df-a8b2-25b87d4be7c7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:21.973087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8f1a391e-6e15-46df-a8b2-25b87d4be7c7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:21.982854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f1a391e-6e15-46df-a8b2-25b87d4be7c7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.983344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f1a391e-6e15-46df-a8b2-25b87d4be7c7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.983775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f1a391e-6e15-46df-a8b2-25b87d4be7c7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.984477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f1a391e-6e15-46df-a8b2-25b87d4be7c7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.984988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f1a391e-6e15-46df-a8b2-25b87d4be7c7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.985443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f1a391e-6e15-46df-a8b2-25b87d4be7c7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:22.232845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8f1a391e-6e15-46df-a8b2-25b87d4be7c7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:22.250521 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8f1a391e-6e15-46df-a8b2-25b87d4be7c7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1502 microversion: 2.1 time: 0.282672 Oct 04 21:07:22.251115 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 215/426] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:21 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1502 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:22.264701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-00021fa7-f6fd-4a38-a630-50b68628dd98 tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:22.268744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00021fa7-f6fd-4a38-a630-50b68628dd98 tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:22.269529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00021fa7-f6fd-4a38-a630-50b68628dd98 tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:22.270207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00021fa7-f6fd-4a38-a630-50b68628dd98 tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:22.271060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00021fa7-f6fd-4a38-a630-50b68628dd98 tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:22.271602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00021fa7-f6fd-4a38-a630-50b68628dd98 tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:22.272035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00021fa7-f6fd-4a38-a630-50b68628dd98 tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:22.302711 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-00021fa7-f6fd-4a38-a630-50b68628dd98 tempest-ServicesAdminNegativeTestJSON-1854099635 tempest-ServicesAdminNegativeTestJSON-1854099635-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.050534 Oct 04 21:07:22.303309 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 216/427] 10.222.0.30 () {58 vars in 1198 bytes} [Tue Oct 4 21:07:22 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:07:22.307814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-98c4692a-462a-4ba8-9fe9-73b13fdd26c5 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Calling method '.version_select at 0x7f57909a2790>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:22.449129 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-311c2def-c985-46d1-877f-f78c813433d7 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1611 microversion: 2.1 time: 0.502210 Oct 04 21:07:22.454894 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 212/428] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:21 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1611 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:22.469574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-75907e38-164c-4e64-94dc-4a5c3add0aba tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:22.474404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-75907e38-164c-4e64-94dc-4a5c3add0aba tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:22.482424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75907e38-164c-4e64-94dc-4a5c3add0aba tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:22.484697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75907e38-164c-4e64-94dc-4a5c3add0aba tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:22.486027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75907e38-164c-4e64-94dc-4a5c3add0aba tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:22.487403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75907e38-164c-4e64-94dc-4a5c3add0aba tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:22.488161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75907e38-164c-4e64-94dc-4a5c3add0aba tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:22.488848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75907e38-164c-4e64-94dc-4a5c3add0aba tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:22.662199 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-98c4692a-462a-4ba8-9fe9-73b13fdd26c5 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675" status: 200 len: 372 microversion: 2.1 time: 0.357630 Oct 04 21:07:22.667464 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 217/429] 10.222.0.30 () {58 vars in 1242 bytes} [Tue Oct 4 21:07:22 2022] GET /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675 => generated 372 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:22.670568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-566327f8-a885-42ce-9517-96dcffbbe285 req-0ad0a347-5606-419d-acef-4c8f07e56c7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcffd52e-afbb-4711-a9fb-acdaf64b9a93", "tag": "c75969cc-4db7-457e-8f38-1307a890a3f2"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:22.681028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-566327f8-a885-42ce-9517-96dcffbbe285 req-0ad0a347-5606-419d-acef-4c8f07e56c7f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:22.681690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-566327f8-a885-42ce-9517-96dcffbbe285 req-0ad0a347-5606-419d-acef-4c8f07e56c7f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:22.682336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-566327f8-a885-42ce-9517-96dcffbbe285 req-0ad0a347-5606-419d-acef-4c8f07e56c7f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:22.695464 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-566327f8-a885-42ce-9517-96dcffbbe285 req-0ad0a347-5606-419d-acef-4c8f07e56c7f service nova] Creating event network-changed:c75969cc-4db7-457e-8f38-1307a890a3f2 for instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 on n-h1-860282-1 Oct 04 21:07:22.701320 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-566327f8-a885-42ce-9517-96dcffbbe285 req-0ad0a347-5606-419d-acef-4c8f07e56c7f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036321 Oct 04 21:07:22.702153 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 218/430] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:22.788470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-75907e38-164c-4e64-94dc-4a5c3add0aba tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:22.799624 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-75907e38-164c-4e64-94dc-4a5c3add0aba tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805" status: 200 len: 1319 microversion: 2.1 time: 0.343541 Oct 04 21:07:22.800649 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 213/431] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:22 2022] GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:22.808184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-90edc691-3756-48ec-9eec-1f76782529a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:22.809629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-90edc691-3756-48ec-9eec-1f76782529a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:22.823748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90edc691-3756-48ec-9eec-1f76782529a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:22.828085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90edc691-3756-48ec-9eec-1f76782529a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:22.831642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90edc691-3756-48ec-9eec-1f76782529a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:22.833828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90edc691-3756-48ec-9eec-1f76782529a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:22.833828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90edc691-3756-48ec-9eec-1f76782529a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:22.834056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90edc691-3756-48ec-9eec-1f76782529a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:22.904802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-03285654-9479-43a2-a2e1-eaa02756fb5d tempest-ServicesAdminNegativeTestJSON-1005936080 tempest-ServicesAdminNegativeTestJSON-1005936080-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:22.909862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-03285654-9479-43a2-a2e1-eaa02756fb5d tempest-ServicesAdminNegativeTestJSON-1005936080 tempest-ServicesAdminNegativeTestJSON-1005936080-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '2672a210fd0b4c4089f8d9cbf671c2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745fa4fb22d42bc8bea771f013e417a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-03285654-9479-43a2-a2e1-eaa02756fb5d tempest-ServicesAdminNegativeTestJSON-1005936080 tempest-ServicesAdminNegativeTestJSON-1005936080-project] Request method failure captured: Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKCBvzEYYa2wV49jLv013uEnBsX8JUvzvMK88bWcCa8AsdMFkOowYB3vM6KkHjZnkHcRhH2Ns2UiO_ttZ-1tju_tHOEFmnXbuU8vRb00mXkbrXxEBI8RxHlxCvcD9od60wDA0MWIs13YrsCeW7gnwACdtogGCWn60zm5szOtPpxtFCg Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f745fa4fb22d42bc8bea771f013e417a Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1005936080 Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:07:22.913167 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:07:22.915244 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f745fa4fb22d42bc8bea771f013e417a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f745fa4fb22d42bc8bea771f013e417a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f745fa4fb22d42bc8bea771f013e417a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f745fa4fb22d42bc8bea771f013e417a"}]}] Oct 04 21:07:22.915244 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1005936080 Oct 04 21:07:22.915244 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f745fa4fb22d42bc8bea771f013e417a Oct 04 21:07:22.915244 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1005936080 Oct 04 21:07:22.915244 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServicesAdminNegativeTestJSON-1005936080-project Oct 04 21:07:22.915244 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:07:22.915244 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:07:22.915244 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 2672a210fd0b4c4089f8d9cbf671c2d7 Oct 04 21:07:22.915244 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1005936080-project Oct 04 21:07:22.915244 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:07:22.915244 n-d-860282-1 devstack@n-api.service[122758]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 21:07:22.915244 n-d-860282-1 devstack@n-api.service[122758]: action_args: {} Oct 04 21:07:22.916066 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:22.916066 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:22.916066 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:22.916066 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:22.916066 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:22.916066 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:22.916066 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:07:22.916066 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:22.916066 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:07:22.916066 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:22.916066 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:22.916066 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:22.916066 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 21:07:22.916066 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 21:07:22.916066 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:07:22.916066 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:07:22.916066 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:07:22.916066 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:07:22.916066 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 21:07:22.917397 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:22.921463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-03285654-9479-43a2-a2e1-eaa02756fb5d tempest-ServicesAdminNegativeTestJSON-1005936080 tempest-ServicesAdminNegativeTestJSON-1005936080-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:22.922758 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-03285654-9479-43a2-a2e1-eaa02756fb5d tempest-ServicesAdminNegativeTestJSON-1005936080 tempest-ServicesAdminNegativeTestJSON-1005936080-project] 10.222.0.30 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.219126 Oct 04 21:07:22.924177 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 219/432] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:07:22 2022] GET /compute/v2.1/os-services => generated 112 bytes in 221 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:07:22.929975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-21d4773d-3bc4-40df-9542-40e7783aa97a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:22.933642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21d4773d-3bc4-40df-9542-40e7783aa97a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:22.934878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21d4773d-3bc4-40df-9542-40e7783aa97a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:22.936077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21d4773d-3bc4-40df-9542-40e7783aa97a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:22.936892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21d4773d-3bc4-40df-9542-40e7783aa97a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:22.937413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21d4773d-3bc4-40df-9542-40e7783aa97a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:22.937868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21d4773d-3bc4-40df-9542-40e7783aa97a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:22.962379 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-21d4773d-3bc4-40df-9542-40e7783aa97a tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036775 Oct 04 21:07:22.970741 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 220/433] 10.222.0.30 () {58 vars in 1176 bytes} [Tue Oct 4 21:07:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:22.976108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e0c54aff-40c1-4afd-9e75-6af50fa08286 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Action: 'update', calling method: .version_select at 0x7f57909f35e0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:23.091683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-90edc691-3756-48ec-9eec-1f76782529a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:23.100491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-90edc691-3756-48ec-9eec-1f76782529a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:23.101990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-90edc691-3756-48ec-9eec-1f76782529a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:23.106414 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-90edc691-3756-48ec-9eec-1f76782529a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1362 microversion: 2.25 time: 0.303288 Oct 04 21:07:23.108356 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 214/434] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:22 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1362 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:23.113546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-bcd2162f-2982-43ba-81bb-fe07f2e7e96c req-5817478c-4189-4449-9085-638dd1a8d136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392b3ca2-cc0a-44ae-b791-b8d6043f54e8", "name": "network-vif-plugged", "status": "completed", "tag": "a1c5c085-0f1e-46fd-868c-bc3dc886b2fa"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:23.123349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bcd2162f-2982-43ba-81bb-fe07f2e7e96c req-5817478c-4189-4449-9085-638dd1a8d136 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:23.124153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bcd2162f-2982-43ba-81bb-fe07f2e7e96c req-5817478c-4189-4449-9085-638dd1a8d136 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:23.124760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bcd2162f-2982-43ba-81bb-fe07f2e7e96c req-5817478c-4189-4449-9085-638dd1a8d136 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:23.137092 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-bcd2162f-2982-43ba-81bb-fe07f2e7e96c req-5817478c-4189-4449-9085-638dd1a8d136 service nova] Creating event network-vif-plugged:a1c5c085-0f1e-46fd-868c-bc3dc886b2fa for instance 392b3ca2-cc0a-44ae-b791-b8d6043f54e8 on n-h2-860282-1 Oct 04 21:07:23.142600 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-bcd2162f-2982-43ba-81bb-fe07f2e7e96c req-5817478c-4189-4449-9085-638dd1a8d136 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032750 Oct 04 21:07:23.143558 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 215/435] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:23.152898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4716b001-4db2-4285-a0ad-a8cc5f099001 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:23.154487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4716b001-4db2-4285-a0ad-a8cc5f099001 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:23.161120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4716b001-4db2-4285-a0ad-a8cc5f099001 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:23.162220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4716b001-4db2-4285-a0ad-a8cc5f099001 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:23.162861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4716b001-4db2-4285-a0ad-a8cc5f099001 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:23.163573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4716b001-4db2-4285-a0ad-a8cc5f099001 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:23.164679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4716b001-4db2-4285-a0ad-a8cc5f099001 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:23.165281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4716b001-4db2-4285-a0ad-a8cc5f099001 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:23.246492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0c54aff-40c1-4afd-9e75-6af50fa08286 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:23.248310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0c54aff-40c1-4afd-9e75-6af50fa08286 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:23.248866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0c54aff-40c1-4afd-9e75-6af50fa08286 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:23.250772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0c54aff-40c1-4afd-9e75-6af50fa08286 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:23.262165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0c54aff-40c1-4afd-9e75-6af50fa08286 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:23.262165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0c54aff-40c1-4afd-9e75-6af50fa08286 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:23.334749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4716b001-4db2-4285-a0ad-a8cc5f099001 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:23.344037 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4716b001-4db2-4285-a0ad-a8cc5f099001 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93" status: 200 len: 1384 microversion: 2.1 time: 0.196018 Oct 04 21:07:23.344945 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 216/436] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:23 2022] GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 => generated 1384 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:23.349847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-12a61473-f3be-40ee-9ff4-b7d596258157 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860282-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:23.352742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-12a61473-f3be-40ee-9ff4-b7d596258157 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:23.362183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12a61473-f3be-40ee-9ff4-b7d596258157 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:23.362673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12a61473-f3be-40ee-9ff4-b7d596258157 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:23.363103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12a61473-f3be-40ee-9ff4-b7d596258157 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:23.363813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12a61473-f3be-40ee-9ff4-b7d596258157 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:23.364274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12a61473-f3be-40ee-9ff4-b7d596258157 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:23.364703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12a61473-f3be-40ee-9ff4-b7d596258157 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:23.392824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-12a61473-f3be-40ee-9ff4-b7d596258157 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Lazy-loading 'flavor' on Instance uuid cbd5aea7-1ee4-4b65-8113-f35d01190b7b {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:07:23.399692 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e0c54aff-40c1-4afd-9e75-6af50fa08286 tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675" status: 200 len: 326 microversion: 2.1 time: 0.426537 Oct 04 21:07:23.400785 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 221/437] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Oct 4 21:07:22 2022] PUT /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675 => generated 326 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:23.416017 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-12a61473-f3be-40ee-9ff4-b7d596258157 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance cbd5aea7-1ee4-4b65-8113-f35d01190b7b while it is in vm_state suspended Oct 04 21:07:23.417043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7bf6bf65-3f8c-4e89-b43b-8285cc354c3d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:23.417977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7bf6bf65-3f8c-4e89-b43b-8285cc354c3d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-12a61473-f3be-40ee-9ff4-b7d596258157 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Request method failure captured: Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b/action HTTP/1.1 Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 97 Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKBMPanXScbqpsedhLAz5ePty687aRzX9e17BeGZM-2IFey_hi8wFzy5Wd8SG8kEq6XHS1rinHw7IeTZiEFuRxm-SBV5irexDN1ytUdD5ulODnQWStRGcU7qjLxietVhdGyswfFs0EWBfhoGyzVgZXcyYPmF1bHwMkpLFDRjPLMRVHw Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 8881fd605941459b81b793da22776eae Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-LiveMigrationNegativeTest-749560113 Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:07:23.418347 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:07:23.420786 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8881fd605941459b81b793da22776eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8881fd605941459b81b793da22776eae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8881fd605941459b81b793da22776eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8881fd605941459b81b793da22776eae"}]}] Oct 04 21:07:23.420786 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-LiveMigrationNegativeTest-749560113 Oct 04 21:07:23.420786 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 8881fd605941459b81b793da22776eae Oct 04 21:07:23.420786 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-749560113 Oct 04 21:07:23.420786 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-LiveMigrationNegativeTest-749560113-project-admin Oct 04 21:07:23.420786 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:07:23.420786 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:07:23.420786 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 978a1bd456954313871887a783a3a16b Oct 04 21:07:23.420786 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-LiveMigrationNegativeTest-749560113-project-admin Oct 04 21:07:23.420786 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:07:23.420786 n-d-860282-1 devstack@n-api.service[122757]: {"os-migrateLive": {"host": "n-h2-860282-1", "block_migration": true, "disk_over_commit": false}} Oct 04 21:07:23.420786 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:07:23.421723 n-d-860282-1 devstack@n-api.service[122757]: exception: Cannot 'os-migrateLive' instance cbd5aea7-1ee4-4b65-8113-f35d01190b7b while it is in vm_state suspended Oct 04 21:07:23.421723 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'cbd5aea7-1ee4-4b65-8113-f35d01190b7b', 'body': {'os-migrateLive': {'host': 'n-h2-860282-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 21:07:23.421723 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:23.421723 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:23.421723 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 21:07:23.421723 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 21:07:23.421723 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 21:07:23.421723 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:07:23.421723 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 21:07:23.421723 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:07:23.421723 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 21:07:23.421723 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:07:23.421723 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 21:07:23.421723 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:07:23.421723 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 21:07:23.421723 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:07:23.421723 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 21:07:23.421723 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cbd5aea7-1ee4-4b65-8113-f35d01190b7b in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:23.423112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:23.424788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:23.424788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 21:07:23.424788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 04 21:07:23.424788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:07:23.424788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:07:23.424788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:07:23.424788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance cbd5aea7-1ee4-4b65-8113-f35d01190b7b while it is in vm_state suspended Oct 04 21:07:23.424788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:23.424788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:23.424788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:23.424788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:23.424788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:23.424788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:23.424788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:23.424788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:23.424788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance cbd5aea7-1ee4-4b65-8113-f35d01190b7b while it is in vm_state suspended Oct 04 21:07:23.424788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:23.426385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-12a61473-f3be-40ee-9ff4-b7d596258157 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance cbd5aea7-1ee4-4b65-8113-f35d01190b7b while it is in vm_state suspended {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:23.426385 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-12a61473-f3be-40ee-9ff4-b7d596258157 tempest-LiveMigrationNegativeTest-749560113 tempest-LiveMigrationNegativeTest-749560113-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b/action" status: 409 len: 155 microversion: 2.1 time: 0.073875 Oct 04 21:07:23.426385 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 217/438] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:07:23 2022] POST /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b/action => generated 155 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:07:23.432294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f7712f50-62ab-44d0-b7e4-769024218a34 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:23.432594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bf6bf65-3f8c-4e89-b43b-8285cc354c3d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:23.432799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f7712f50-62ab-44d0-b7e4-769024218a34 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:23.433094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bf6bf65-3f8c-4e89-b43b-8285cc354c3d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:23.433580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bf6bf65-3f8c-4e89-b43b-8285cc354c3d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:23.434816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bf6bf65-3f8c-4e89-b43b-8285cc354c3d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:23.435837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bf6bf65-3f8c-4e89-b43b-8285cc354c3d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:23.436264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bf6bf65-3f8c-4e89-b43b-8285cc354c3d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:23.440743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7712f50-62ab-44d0-b7e4-769024218a34 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:23.441322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7712f50-62ab-44d0-b7e4-769024218a34 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:23.441937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7712f50-62ab-44d0-b7e4-769024218a34 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:23.442736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7712f50-62ab-44d0-b7e4-769024218a34 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:23.443275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7712f50-62ab-44d0-b7e4-769024218a34 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:23.443776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7712f50-62ab-44d0-b7e4-769024218a34 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:23.471870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f7712f50-62ab-44d0-b7e4-769024218a34 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:07:23.608997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7bf6bf65-3f8c-4e89-b43b-8285cc354c3d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:23.619218 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7bf6bf65-3f8c-4e89-b43b-8285cc354c3d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1502 microversion: 2.1 time: 0.217309 Oct 04 21:07:23.619796 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 222/439] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:23 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1502 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:23.655315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-208916161", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:23.722983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:07:23.811682 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f7712f50-62ab-44d0-b7e4-769024218a34 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 204 len: 0 microversion: 2.1 time: 0.383597 Oct 04 21:07:23.814006 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 218/440] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:07:23 2022] DELETE /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:07:23.823603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-65cb6bb7-90b7-496d-bc22-37f1b51bd7df tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:23.824754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-65cb6bb7-90b7-496d-bc22-37f1b51bd7df tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:23.834109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65cb6bb7-90b7-496d-bc22-37f1b51bd7df tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:23.834812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65cb6bb7-90b7-496d-bc22-37f1b51bd7df tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:23.835422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65cb6bb7-90b7-496d-bc22-37f1b51bd7df tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:23.843371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65cb6bb7-90b7-496d-bc22-37f1b51bd7df tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:23.843371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65cb6bb7-90b7-496d-bc22-37f1b51bd7df tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:23.843371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65cb6bb7-90b7-496d-bc22-37f1b51bd7df tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:24.022823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:07:24.023147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:07:24.023637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:07:24.024057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:07:24.024555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:07:24.034924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:24.035475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:24.035989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:24.036822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:24.037315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:24.037797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:24.051200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-65cb6bb7-90b7-496d-bc22-37f1b51bd7df tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:24.057244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Getting quotas for project e18b8ecf521340f29e9f5ec7480fa675. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:24.060381 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-65cb6bb7-90b7-496d-bc22-37f1b51bd7df tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1466 microversion: 2.1 time: 0.242475 Oct 04 21:07:24.062761 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 219/441] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:23 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1466 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:24.067473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-79fe931e-a83f-43de-b971-2b7ad26c4565 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:24.068117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-79fe931e-a83f-43de-b971-2b7ad26c4565 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:24.075711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79fe931e-a83f-43de-b971-2b7ad26c4565 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:24.076305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79fe931e-a83f-43de-b971-2b7ad26c4565 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:24.076744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79fe931e-a83f-43de-b971-2b7ad26c4565 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:24.077464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79fe931e-a83f-43de-b971-2b7ad26c4565 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:24.078047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Getting quotas for user 1333edebb75244b3a3e6052524dac48d and project e18b8ecf521340f29e9f5ec7480fa675. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:24.078284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79fe931e-a83f-43de-b971-2b7ad26c4565 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:24.078853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79fe931e-a83f-43de-b971-2b7ad26c4565 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:24.097245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.utils [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] ram quota exceeded for e18b8ecf521340f29e9f5ec7480fa675, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122758) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 21:07:24.098340 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Request method failure captured: Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 144 Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKB9AxYM-aly-Rx10Rdisada58LMQZYVVfeq5BkN1qwFC9irCU_1xVlkyYCYEVuJM__mT3ZHK3Q7ltQNsaaLLq075x1BEAxXpPBWDkcgePXduqF8GEu0yW0Ym4PPzUX2Gd3NuT3etXEM1ulg0-Hn8ClE-t4ReZL7mAB0HAOzbT3n1kg Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: e18b8ecf521340f29e9f5ec7480fa675 Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-QuotasAdminNegativeTest-428506377 Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:07:24.109225 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:07:24.114781 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e18b8ecf521340f29e9f5ec7480fa675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e18b8ecf521340f29e9f5ec7480fa675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e18b8ecf521340f29e9f5ec7480fa675"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e18b8ecf521340f29e9f5ec7480fa675"}]}] Oct 04 21:07:24.114781 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-QuotasAdminNegativeTest-428506377 Oct 04 21:07:24.114781 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: e18b8ecf521340f29e9f5ec7480fa675 Oct 04 21:07:24.114781 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-428506377 Oct 04 21:07:24.114781 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-QuotasAdminNegativeTest-428506377-project Oct 04 21:07:24.114781 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:07:24.114781 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:07:24.114781 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 1333edebb75244b3a3e6052524dac48d Oct 04 21:07:24.114781 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-QuotasAdminNegativeTest-428506377-project Oct 04 21:07:24.114781 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:07:24.114781 n-d-860282-1 devstack@n-api.service[122758]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-208916161", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} Oct 04 21:07:24.114781 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:07:24.115806 n-d-860282-1 devstack@n-api.service[122758]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 21:07:24.115806 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-208916161', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452'}}} Oct 04 21:07:24.115806 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:24.115806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:24.115806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 21:07:24.115806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 21:07:24.115806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:07:24.115806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:07:24.115806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 21:07:24.115806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc Oct 04 21:07:24.115806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 21:07:24.115806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 21:07:24.115806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:07:24.115806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:07:24.115806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 21:07:24.115806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 21:07:24.115806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 21:07:24.115806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:24.117162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:24.119497 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:24.120935 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:24.120935 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:24.120935 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:24.120935 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:24.120935 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 21:07:24.120935 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:24.120935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:24.120935 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-53197927-bfaf-4b31-980c-03841d85115d tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.464564 Oct 04 21:07:24.123497 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 223/442] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:07:23 2022] POST /compute/v2.1/servers => generated 110 bytes in 475 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:07:24.129749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f2118973-15c2-486a-96fd-23e6b9579bef tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Action: 'update', calling method: .version_select at 0x7f5790a9e5e0>, body: {"quota_set": {"ram": 51200}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:24.239824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-79fe931e-a83f-43de-b971-2b7ad26c4565 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:24.248394 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-79fe931e-a83f-43de-b971-2b7ad26c4565 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805" status: 200 len: 1469 microversion: 2.1 time: 0.184536 Oct 04 21:07:24.249290 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 220/443] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:24 2022] GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:24.253970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b7b9c979-7127-4f93-936d-1b93bd9088f1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:24.254569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b7b9c979-7127-4f93-936d-1b93bd9088f1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:24.260639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7b9c979-7127-4f93-936d-1b93bd9088f1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:24.261346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7b9c979-7127-4f93-936d-1b93bd9088f1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:24.261995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7b9c979-7127-4f93-936d-1b93bd9088f1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:24.262766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7b9c979-7127-4f93-936d-1b93bd9088f1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:24.263407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7b9c979-7127-4f93-936d-1b93bd9088f1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:24.264028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7b9c979-7127-4f93-936d-1b93bd9088f1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:24.398160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2118973-15c2-486a-96fd-23e6b9579bef tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:24.399184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2118973-15c2-486a-96fd-23e6b9579bef tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:24.399786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2118973-15c2-486a-96fd-23e6b9579bef tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:24.400685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2118973-15c2-486a-96fd-23e6b9579bef tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:24.401305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2118973-15c2-486a-96fd-23e6b9579bef tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:24.401936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2118973-15c2-486a-96fd-23e6b9579bef tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:24.446570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b7b9c979-7127-4f93-936d-1b93bd9088f1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:24.457016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b7b9c979-7127-4f93-936d-1b93bd9088f1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:24.458886 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b7b9c979-7127-4f93-936d-1b93bd9088f1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:24.460020 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b7b9c979-7127-4f93-936d-1b93bd9088f1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1362 microversion: 2.25 time: 0.209742 Oct 04 21:07:24.465509 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 221/444] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:24 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:24.553004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2b0f82af-140b-4e10-b144-2d39727ecbc6 tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Action: 'update', calling method: .version_select at 0x7f57908eaa60>, body: {"quota_set": {"ram": "5120"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:24.591007 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f2118973-15c2-486a-96fd-23e6b9579bef tempest-QuotasAdminNegativeTest-131250531 tempest-QuotasAdminNegativeTest-131250531-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675" status: 200 len: 330 microversion: 2.1 time: 0.466240 Oct 04 21:07:24.593724 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 224/445] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Oct 4 21:07:24 2022] PUT /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675 => generated 330 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:24.639593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b0f82af-140b-4e10-b144-2d39727ecbc6 tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:24.640263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b0f82af-140b-4e10-b144-2d39727ecbc6 tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:24.640785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b0f82af-140b-4e10-b144-2d39727ecbc6 tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:24.641992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b0f82af-140b-4e10-b144-2d39727ecbc6 tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:24.642562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b0f82af-140b-4e10-b144-2d39727ecbc6 tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:24.644649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b0f82af-140b-4e10-b144-2d39727ecbc6 tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:24.738136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ca81e7e8-8898-4a35-a269-655b959fc517 tempest-DeleteServersAdminTestJSON-615978898 tempest-DeleteServersAdminTestJSON-615978898-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:24.738639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ca81e7e8-8898-4a35-a269-655b959fc517 tempest-DeleteServersAdminTestJSON-615978898 tempest-DeleteServersAdminTestJSON-615978898-project-admin] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:24.745337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca81e7e8-8898-4a35-a269-655b959fc517 tempest-DeleteServersAdminTestJSON-615978898 tempest-DeleteServersAdminTestJSON-615978898-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:24.745880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca81e7e8-8898-4a35-a269-655b959fc517 tempest-DeleteServersAdminTestJSON-615978898 tempest-DeleteServersAdminTestJSON-615978898-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:24.746322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca81e7e8-8898-4a35-a269-655b959fc517 tempest-DeleteServersAdminTestJSON-615978898 tempest-DeleteServersAdminTestJSON-615978898-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:24.747020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca81e7e8-8898-4a35-a269-655b959fc517 tempest-DeleteServersAdminTestJSON-615978898 tempest-DeleteServersAdminTestJSON-615978898-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:24.748087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca81e7e8-8898-4a35-a269-655b959fc517 tempest-DeleteServersAdminTestJSON-615978898 tempest-DeleteServersAdminTestJSON-615978898-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:24.748529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca81e7e8-8898-4a35-a269-655b959fc517 tempest-DeleteServersAdminTestJSON-615978898 tempest-DeleteServersAdminTestJSON-615978898-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:24.770960 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2b0f82af-140b-4e10-b144-2d39727ecbc6 tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/7a6e02b86041413b9e8526d108c3b39a" status: 200 len: 240 microversion: 2.36 time: 0.308690 Oct 04 21:07:24.772340 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 222/446] 10.222.0.30 () {62 vars in 1303 bytes} [Tue Oct 4 21:07:24 2022] PUT /compute/v2.1/os-quota-sets/7a6e02b86041413b9e8526d108c3b39a => generated 240 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:07:24.774133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ca81e7e8-8898-4a35-a269-655b959fc517 tempest-DeleteServersAdminTestJSON-615978898 tempest-DeleteServersAdminTestJSON-615978898-project-admin] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:07:24.777746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-31ec7cc4-b890-4ea7-ad2d-d0b2a2299096 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:24.780216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-31ec7cc4-b890-4ea7-ad2d-d0b2a2299096 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:24.788111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31ec7cc4-b890-4ea7-ad2d-d0b2a2299096 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:24.788791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31ec7cc4-b890-4ea7-ad2d-d0b2a2299096 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:24.789356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31ec7cc4-b890-4ea7-ad2d-d0b2a2299096 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:24.790184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31ec7cc4-b890-4ea7-ad2d-d0b2a2299096 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:24.790734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31ec7cc4-b890-4ea7-ad2d-d0b2a2299096 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:24.791257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31ec7cc4-b890-4ea7-ad2d-d0b2a2299096 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:24.946565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-31ec7cc4-b890-4ea7-ad2d-d0b2a2299096 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:24.954985 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-31ec7cc4-b890-4ea7-ad2d-d0b2a2299096 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93" status: 200 len: 1384 microversion: 2.1 time: 0.181425 Oct 04 21:07:24.955558 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 223/447] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:24 2022] GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 => generated 1384 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:24.960018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f311bf49-ae5e-4e55-9fdb-0ecc79d0f24c tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Action: 'update', calling method: .version_select at 0x7f57908f0c10>, body: {"quota_set": {"ram": 0}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:24.965670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f311bf49-ae5e-4e55-9fdb-0ecc79d0f24c tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '1333edebb75244b3a3e6052524dac48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18b8ecf521340f29e9f5ec7480fa675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f311bf49-ae5e-4e55-9fdb-0ecc79d0f24c tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Request method failure captured: Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: request: PUT /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675 HTTP/1.1 Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 25 Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKB9AxYM-aly-Rx10Rdisada58LMQZYVVfeq5BkN1qwFC9irCU_1xVlkyYCYEVuJM__mT3ZHK3Q7ltQNsaaLLq075x1BEAxXpPBWDkcgePXduqF8GEu0yW0Ym4PPzUX2Gd3NuT3etXEM1ulg0-Hn8ClE-t4ReZL7mAB0HAOzbT3n1kg Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: e18b8ecf521340f29e9f5ec7480fa675 Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-QuotasAdminNegativeTest-428506377 Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:07:24.967593 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:07:24.968904 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e18b8ecf521340f29e9f5ec7480fa675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e18b8ecf521340f29e9f5ec7480fa675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e18b8ecf521340f29e9f5ec7480fa675"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e18b8ecf521340f29e9f5ec7480fa675"}]}] Oct 04 21:07:24.968904 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-QuotasAdminNegativeTest-428506377 Oct 04 21:07:24.968904 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: e18b8ecf521340f29e9f5ec7480fa675 Oct 04 21:07:24.968904 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-428506377 Oct 04 21:07:24.968904 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-QuotasAdminNegativeTest-428506377-project Oct 04 21:07:24.968904 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:07:24.968904 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:07:24.968904 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 1333edebb75244b3a3e6052524dac48d Oct 04 21:07:24.968904 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-QuotasAdminNegativeTest-428506377-project Oct 04 21:07:24.968904 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:07:24.968904 n-d-860282-1 devstack@n-api.service[122757]: {"quota_set": {"ram": 0}} Oct 04 21:07:24.968904 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:07:24.968904 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 21:07:24.968904 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'e18b8ecf521340f29e9f5ec7480fa675', 'body': {'quota_set': {'ram': 0}}} Oct 04 21:07:24.970835 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:24.970835 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:24.970835 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:24.970835 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:24.970835 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:24.970835 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:24.970835 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:07:24.970835 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:07:24.970835 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:24.970835 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:24.970835 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:24.970835 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:24.970835 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 04 21:07:24.970835 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 04 21:07:24.970835 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:07:24.970835 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:24.970835 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:07:24.970835 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:24.970835 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:24.972279 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:24.973488 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:24.973488 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:24.973488 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:07:24.973488 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:07:24.973488 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 21:07:24.973488 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:24.973488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f311bf49-ae5e-4e55-9fdb-0ecc79d0f24c tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:24.973488 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f311bf49-ae5e-4e55-9fdb-0ecc79d0f24c tempest-QuotasAdminNegativeTest-428506377 tempest-QuotasAdminNegativeTest-428506377-project] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675" status: 403 len: 116 microversion: 2.1 time: 0.012495 Oct 04 21:07:24.973488 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 224/448] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Oct 4 21:07:24 2022] PUT /compute/v2.1/os-quota-sets/e18b8ecf521340f29e9f5ec7480fa675 => generated 116 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:07:24.979590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5b4f1bff-7351-437d-a23f-95d61b88a8e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:24.980208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5b4f1bff-7351-437d-a23f-95d61b88a8e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:25.004670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b4f1bff-7351-437d-a23f-95d61b88a8e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:25.005182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b4f1bff-7351-437d-a23f-95d61b88a8e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:25.005661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b4f1bff-7351-437d-a23f-95d61b88a8e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:25.006380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b4f1bff-7351-437d-a23f-95d61b88a8e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:25.006844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b4f1bff-7351-437d-a23f-95d61b88a8e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:25.007279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b4f1bff-7351-437d-a23f-95d61b88a8e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:25.097802 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ca81e7e8-8898-4a35-a269-655b959fc517 tempest-DeleteServersAdminTestJSON-615978898 tempest-DeleteServersAdminTestJSON-615978898-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805" status: 204 len: 0 microversion: 2.1 time: 0.501351 Oct 04 21:07:25.099147 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 225/449] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:07:24 2022] DELETE /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:07:25.109715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-1951e55f-d14e-41c8-abf4-257edf6f3a75 req-383cad8f-7e7d-4bf5-93a5-746b47d3de88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee48d230-2152-48c0-b95f-29a55787f7a4", "name": "network-vif-unplugged", "status": "completed", "tag": "a4684f8a-e6a9-4608-b21b-3aaef38405be"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:25.121249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1951e55f-d14e-41c8-abf4-257edf6f3a75 req-383cad8f-7e7d-4bf5-93a5-746b47d3de88 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:25.126378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1951e55f-d14e-41c8-abf4-257edf6f3a75 req-383cad8f-7e7d-4bf5-93a5-746b47d3de88 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:25.126378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1951e55f-d14e-41c8-abf4-257edf6f3a75 req-383cad8f-7e7d-4bf5-93a5-746b47d3de88 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:25.136183 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-1951e55f-d14e-41c8-abf4-257edf6f3a75 req-383cad8f-7e7d-4bf5-93a5-746b47d3de88 service nova] Creating event network-vif-unplugged:a4684f8a-e6a9-4608-b21b-3aaef38405be for instance ee48d230-2152-48c0-b95f-29a55787f7a4 on n-h1-860282-1 Oct 04 21:07:25.141591 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-1951e55f-d14e-41c8-abf4-257edf6f3a75 req-383cad8f-7e7d-4bf5-93a5-746b47d3de88 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037230 Oct 04 21:07:25.142190 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 226/450] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:25.147268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ca02726d-545b-40a4-9920-8c30a38de92e tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Calling method '.version_select at 0x7f57909a24c0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:25.159267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5b4f1bff-7351-437d-a23f-95d61b88a8e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:25.167307 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5b4f1bff-7351-437d-a23f-95d61b88a8e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1502 microversion: 2.1 time: 0.191586 Oct 04 21:07:25.167864 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 225/451] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:24 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1502 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:25.173067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4ce69050-6285-4f36-bba2-b4a05ac0c1d5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:25.173696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4ce69050-6285-4f36-bba2-b4a05ac0c1d5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:25.179763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ce69050-6285-4f36-bba2-b4a05ac0c1d5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:25.180253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ce69050-6285-4f36-bba2-b4a05ac0c1d5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:25.180693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ce69050-6285-4f36-bba2-b4a05ac0c1d5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:25.183089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ce69050-6285-4f36-bba2-b4a05ac0c1d5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:25.183089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ce69050-6285-4f36-bba2-b4a05ac0c1d5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:25.183089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ce69050-6285-4f36-bba2-b4a05ac0c1d5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:25.335256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4ce69050-6285-4f36-bba2-b4a05ac0c1d5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:25.343848 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4ce69050-6285-4f36-bba2-b4a05ac0c1d5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1466 microversion: 2.1 time: 0.174988 Oct 04 21:07:25.344408 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 226/452] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:25 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1466 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:25.349494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b5f7c259-2cf1-414a-ae72-73987d3beb64 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:25.349494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b5f7c259-2cf1-414a-ae72-73987d3beb64 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:25.355380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5f7c259-2cf1-414a-ae72-73987d3beb64 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:25.355859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5f7c259-2cf1-414a-ae72-73987d3beb64 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:25.356299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5f7c259-2cf1-414a-ae72-73987d3beb64 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:25.357597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5f7c259-2cf1-414a-ae72-73987d3beb64 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:25.358148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5f7c259-2cf1-414a-ae72-73987d3beb64 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:25.358574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5f7c259-2cf1-414a-ae72-73987d3beb64 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:25.464167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca02726d-545b-40a4-9920-8c30a38de92e tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:25.464735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca02726d-545b-40a4-9920-8c30a38de92e tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:25.465057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca02726d-545b-40a4-9920-8c30a38de92e tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:25.466469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca02726d-545b-40a4-9920-8c30a38de92e tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:25.467011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca02726d-545b-40a4-9920-8c30a38de92e tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:25.471496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca02726d-545b-40a4-9920-8c30a38de92e tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:25.496041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:25.502865 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ca02726d-545b-40a4-9920-8c30a38de92e tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/7a6e02b86041413b9e8526d108c3b39a/detail" status: 200 len: 672 microversion: 2.36 time: 0.359406 Oct 04 21:07:25.503490 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 227/453] 10.222.0.30 () {60 vars in 1304 bytes} [Tue Oct 4 21:07:25 2022] GET /compute/v2.1/os-quota-sets/7a6e02b86041413b9e8526d108c3b39a/detail => generated 672 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:07:25.509193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b0090b51-abdc-4632-9227-44ce2dda4694 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:25.510512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b0090b51-abdc-4632-9227-44ce2dda4694 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:25.518963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0090b51-abdc-4632-9227-44ce2dda4694 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:25.519695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0090b51-abdc-4632-9227-44ce2dda4694 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:25.520288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0090b51-abdc-4632-9227-44ce2dda4694 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:25.521654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0090b51-abdc-4632-9227-44ce2dda4694 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:25.523138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0090b51-abdc-4632-9227-44ce2dda4694 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:25.523745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0090b51-abdc-4632-9227-44ce2dda4694 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:25.575723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b5f7c259-2cf1-414a-ae72-73987d3beb64 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:25.585177 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b5f7c259-2cf1-414a-ae72-73987d3beb64 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805" status: 200 len: 1475 microversion: 2.1 time: 0.239739 Oct 04 21:07:25.586974 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 227/454] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:25 2022] GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 => generated 1475 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:25.758577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b0090b51-abdc-4632-9227-44ce2dda4694 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:25.760764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:25.776205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b0090b51-abdc-4632-9227-44ce2dda4694 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:25.777723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b0090b51-abdc-4632-9227-44ce2dda4694 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:25.793560 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b0090b51-abdc-4632-9227-44ce2dda4694 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1559 microversion: 2.25 time: 0.274741 Oct 04 21:07:25.793560 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 228/455] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:25 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1559 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:25.820690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b0c16027-44e7-4d24-89a5-ffc8b6f2d97f tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Action: 'update', calling method: .version_select at 0x7f5790a73940>, body: {"quota_set": {"ram": "2048"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:25.961021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0c16027-44e7-4d24-89a5-ffc8b6f2d97f tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:25.961743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0c16027-44e7-4d24-89a5-ffc8b6f2d97f tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:25.962340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0c16027-44e7-4d24-89a5-ffc8b6f2d97f tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:25.963282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0c16027-44e7-4d24-89a5-ffc8b6f2d97f tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:25.963921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0c16027-44e7-4d24-89a5-ffc8b6f2d97f tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:25.964498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0c16027-44e7-4d24-89a5-ffc8b6f2d97f tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:26.005363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:26.008730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0c16027-44e7-4d24-89a5-ffc8b6f2d97f tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:26.009232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0c16027-44e7-4d24-89a5-ffc8b6f2d97f tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:26.009719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0c16027-44e7-4d24-89a5-ffc8b6f2d97f tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:26.013626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0c16027-44e7-4d24-89a5-ffc8b6f2d97f tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:26.013626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0c16027-44e7-4d24-89a5-ffc8b6f2d97f tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:26.013626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0c16027-44e7-4d24-89a5-ffc8b6f2d97f tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:26.030510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8b7b1f9b-2852-4cc1-9eb0-91216d38cb01 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:26.031125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8b7b1f9b-2852-4cc1-9eb0-91216d38cb01 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:26.037879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b7b1f9b-2852-4cc1-9eb0-91216d38cb01 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:26.038789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b7b1f9b-2852-4cc1-9eb0-91216d38cb01 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:26.042166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b7b1f9b-2852-4cc1-9eb0-91216d38cb01 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:26.042166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b7b1f9b-2852-4cc1-9eb0-91216d38cb01 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:26.042166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b7b1f9b-2852-4cc1-9eb0-91216d38cb01 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:26.042166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b7b1f9b-2852-4cc1-9eb0-91216d38cb01 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:26.172441 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b0c16027-44e7-4d24-89a5-ffc8b6f2d97f tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/7a6e02b86041413b9e8526d108c3b39a?user_id=b979b5bda6a34f7589ba85ef85df60d2" status: 200 len: 240 microversion: 2.36 time: 0.354843 Oct 04 21:07:26.173367 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 229/456] 10.222.0.30 () {62 vars in 1384 bytes} [Tue Oct 4 21:07:25 2022] PUT /compute/v2.1/os-quota-sets/7a6e02b86041413b9e8526d108c3b39a?user_id=b979b5bda6a34f7589ba85ef85df60d2 => generated 240 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:07:26.178837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e4e39d3d-2fbb-47f3-9d37-01c35fc8ba4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:26.179622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e4e39d3d-2fbb-47f3-9d37-01c35fc8ba4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:26.187964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4e39d3d-2fbb-47f3-9d37-01c35fc8ba4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:26.190128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4e39d3d-2fbb-47f3-9d37-01c35fc8ba4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:26.190574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4e39d3d-2fbb-47f3-9d37-01c35fc8ba4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:26.191468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4e39d3d-2fbb-47f3-9d37-01c35fc8ba4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:26.192290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4e39d3d-2fbb-47f3-9d37-01c35fc8ba4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:26.192904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4e39d3d-2fbb-47f3-9d37-01c35fc8ba4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:26.219962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-8b7b1f9b-2852-4cc1-9eb0-91216d38cb01 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lazy-loading 'services' on Instance uuid 392b3ca2-cc0a-44ae-b791-b8d6043f54e8 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:07:26.264813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:26.289289 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8b7b1f9b-2852-4cc1-9eb0-91216d38cb01 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 2052 microversion: 2.25 time: 0.479005 Oct 04 21:07:26.290454 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 228/457] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:25 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 2052 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:26.295484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7eb77876-ca15-49a7-9fca-fe8dde1a1df6 tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] Calling method '.version_select at 0x7f57908bdaf0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:26.561878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e4e39d3d-2fbb-47f3-9d37-01c35fc8ba4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:26.582134 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e4e39d3d-2fbb-47f3-9d37-01c35fc8ba4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93" status: 200 len: 1384 microversion: 2.1 time: 0.407476 Oct 04 21:07:26.588573 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 230/458] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:26 2022] GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 => generated 1384 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:26.599158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c8639c9e-534a-4e3b-b69d-a887f253b744 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:26.600209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c8639c9e-534a-4e3b-b69d-a887f253b744 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:26.616716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8639c9e-534a-4e3b-b69d-a887f253b744 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:26.617284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8639c9e-534a-4e3b-b69d-a887f253b744 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:26.617758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8639c9e-534a-4e3b-b69d-a887f253b744 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:26.618638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8639c9e-534a-4e3b-b69d-a887f253b744 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:26.619285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8639c9e-534a-4e3b-b69d-a887f253b744 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:26.620904 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7eb77876-ca15-49a7-9fca-fe8dde1a1df6 tempest-QuotasAdminTestV236-1830189379 tempest-QuotasAdminTestV236-1830189379-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/7a6e02b86041413b9e8526d108c3b39a?user_id=b979b5bda6a34f7589ba85ef85df60d2" status: 200 len: 282 microversion: 2.36 time: 0.329212 Oct 04 21:07:26.626135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8639c9e-534a-4e3b-b69d-a887f253b744 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:26.626707 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 229/459] 10.222.0.30 () {60 vars in 1364 bytes} [Tue Oct 4 21:07:26 2022] GET /compute/v2.1/os-quota-sets/7a6e02b86041413b9e8526d108c3b39a?user_id=b979b5bda6a34f7589ba85ef85df60d2 => generated 282 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:07:26.635634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f2f47716-7cef-4253-a643-9c28347bed46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:26.635634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f2f47716-7cef-4253-a643-9c28347bed46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:26.657511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2f47716-7cef-4253-a643-9c28347bed46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:26.658138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2f47716-7cef-4253-a643-9c28347bed46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:26.658682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2f47716-7cef-4253-a643-9c28347bed46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:26.659501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2f47716-7cef-4253-a643-9c28347bed46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:26.660067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2f47716-7cef-4253-a643-9c28347bed46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:26.660600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2f47716-7cef-4253-a643-9c28347bed46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:27.342761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-f2f47716-7cef-4253-a643-9c28347bed46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lazy-loading 'services' on Instance uuid 392b3ca2-cc0a-44ae-b791-b8d6043f54e8 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:07:27.361756 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f2f47716-7cef-4253-a643-9c28347bed46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 2052 microversion: 2.25 time: 0.733598 Oct 04 21:07:27.362351 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 230/460] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:26 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 2052 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:27.370252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b2737aaa-a6fa-4d18-b869-4e5895060c5f tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:27.376087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b2737aaa-a6fa-4d18-b869-4e5895060c5f tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:27.390281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2737aaa-a6fa-4d18-b869-4e5895060c5f tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:27.393448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2737aaa-a6fa-4d18-b869-4e5895060c5f tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:27.393448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2737aaa-a6fa-4d18-b869-4e5895060c5f tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:27.393448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2737aaa-a6fa-4d18-b869-4e5895060c5f tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:27.393448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2737aaa-a6fa-4d18-b869-4e5895060c5f tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:27.395273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2737aaa-a6fa-4d18-b869-4e5895060c5f tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:27.397218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c8639c9e-534a-4e3b-b69d-a887f253b744 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:27.405929 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c8639c9e-534a-4e3b-b69d-a887f253b744 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1502 microversion: 2.1 time: 0.815821 Oct 04 21:07:27.410014 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 231/461] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:26 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1502 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:27.414860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-78b6a100-cc83-43cf-8b09-68373b2b48bd tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:27.415473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-78b6a100-cc83-43cf-8b09-68373b2b48bd tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:27.426282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78b6a100-cc83-43cf-8b09-68373b2b48bd tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:27.426777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78b6a100-cc83-43cf-8b09-68373b2b48bd tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:27.427283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78b6a100-cc83-43cf-8b09-68373b2b48bd tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:27.439381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78b6a100-cc83-43cf-8b09-68373b2b48bd tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:27.439381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78b6a100-cc83-43cf-8b09-68373b2b48bd tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:27.439381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78b6a100-cc83-43cf-8b09-68373b2b48bd tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:27.556677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-78b6a100-cc83-43cf-8b09-68373b2b48bd tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:27.590322 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-78b6a100-cc83-43cf-8b09-68373b2b48bd tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805" status: 200 len: 1433 microversion: 2.1 time: 0.177330 Oct 04 21:07:27.592211 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 232/462] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:27 2022] GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 => generated 1433 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:27.611194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-481fbbfc-fd20-4373-9251-b46933dc3928 req-39179c08-2ed3-45fa-928a-52498e18c831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee48d230-2152-48c0-b95f-29a55787f7a4", "tag": "a4684f8a-e6a9-4608-b21b-3aaef38405be"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:27.649592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-481fbbfc-fd20-4373-9251-b46933dc3928 req-39179c08-2ed3-45fa-928a-52498e18c831 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:27.649592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-481fbbfc-fd20-4373-9251-b46933dc3928 req-39179c08-2ed3-45fa-928a-52498e18c831 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:27.650720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-481fbbfc-fd20-4373-9251-b46933dc3928 req-39179c08-2ed3-45fa-928a-52498e18c831 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:27.694163 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-481fbbfc-fd20-4373-9251-b46933dc3928 req-39179c08-2ed3-45fa-928a-52498e18c831 service nova] Creating event network-changed:a4684f8a-e6a9-4608-b21b-3aaef38405be for instance ee48d230-2152-48c0-b95f-29a55787f7a4 on n-h1-860282-1 Oct 04 21:07:27.710375 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-481fbbfc-fd20-4373-9251-b46933dc3928 req-39179c08-2ed3-45fa-928a-52498e18c831 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113349 Oct 04 21:07:27.712249 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 233/463] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:27.727523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b857d051-2672-496f-bd5a-4b674cf31fec tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:27.740445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b857d051-2672-496f-bd5a-4b674cf31fec tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:27.741318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b857d051-2672-496f-bd5a-4b674cf31fec tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:27.747070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b857d051-2672-496f-bd5a-4b674cf31fec tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:27.747070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b857d051-2672-496f-bd5a-4b674cf31fec tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:27.747070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b857d051-2672-496f-bd5a-4b674cf31fec tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:27.747070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b857d051-2672-496f-bd5a-4b674cf31fec tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:27.821143 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b857d051-2672-496f-bd5a-4b674cf31fec tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.104679 Oct 04 21:07:27.822619 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 234/464] 10.222.0.30 () {60 vars in 1217 bytes} [Tue Oct 4 21:07:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:07:27.825188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b2737aaa-a6fa-4d18-b869-4e5895060c5f tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:27.828796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-88548721-3b6b-4e68-98de-55f6a66731c3 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:27.829756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-88548721-3b6b-4e68-98de-55f6a66731c3 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:27.836248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88548721-3b6b-4e68-98de-55f6a66731c3 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:27.837549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88548721-3b6b-4e68-98de-55f6a66731c3 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:27.838151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88548721-3b6b-4e68-98de-55f6a66731c3 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:27.839567 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b2737aaa-a6fa-4d18-b869-4e5895060c5f tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1466 microversion: 2.1 time: 0.473481 Oct 04 21:07:27.839761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88548721-3b6b-4e68-98de-55f6a66731c3 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:27.840739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88548721-3b6b-4e68-98de-55f6a66731c3 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:27.841907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88548721-3b6b-4e68-98de-55f6a66731c3 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:27.849726 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 231/465] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:27 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1466 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:27.872341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-7e053d20-39f3-4cbe-8a59-ca46baaf0712 req-29702dca-68fb-42c2-b304-3e07839828d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd5aea7-1ee4-4b65-8113-f35d01190b7b", "name": "network-vif-deleted", "tag": "05977ab0-dafe-4113-9224-f929f82028cc"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:27.902742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7e053d20-39f3-4cbe-8a59-ca46baaf0712 req-29702dca-68fb-42c2-b304-3e07839828d6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:27.903236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7e053d20-39f3-4cbe-8a59-ca46baaf0712 req-29702dca-68fb-42c2-b304-3e07839828d6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:27.918366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7e053d20-39f3-4cbe-8a59-ca46baaf0712 req-29702dca-68fb-42c2-b304-3e07839828d6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:27.967101 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-7e053d20-39f3-4cbe-8a59-ca46baaf0712 req-29702dca-68fb-42c2-b304-3e07839828d6 service nova] Creating event network-vif-deleted:05977ab0-dafe-4113-9224-f929f82028cc for instance cbd5aea7-1ee4-4b65-8113-f35d01190b7b on n-h1-860282-1 Oct 04 21:07:27.983424 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-7e053d20-39f3-4cbe-8a59-ca46baaf0712 req-29702dca-68fb-42c2-b304-3e07839828d6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130569 Oct 04 21:07:28.003374 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 232/466] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:28.019584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6b1bee5e-67b4-408b-b4ba-033936f9f224 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860282-1", "block_migration": "auto"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:28.020023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6b1bee5e-67b4-408b-b4ba-033936f9f224 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:28.045533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b1bee5e-67b4-408b-b4ba-033936f9f224 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:28.046168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b1bee5e-67b4-408b-b4ba-033936f9f224 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:28.048152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b1bee5e-67b4-408b-b4ba-033936f9f224 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:28.048152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b1bee5e-67b4-408b-b4ba-033936f9f224 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:28.048152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b1bee5e-67b4-408b-b4ba-033936f9f224 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:28.048530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b1bee5e-67b4-408b-b4ba-033936f9f224 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:28.048995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-88548721-3b6b-4e68-98de-55f6a66731c3 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:28.061372 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-88548721-3b6b-4e68-98de-55f6a66731c3 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93" status: 200 len: 1384 microversion: 2.1 time: 0.237052 Oct 04 21:07:28.062444 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 235/467] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:27 2022] GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 => generated 1384 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:28.088886 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-6b1bee5e-67b4-408b-b4ba-033936f9f224 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lazy-loading 'flavor' on Instance uuid 392b3ca2-cc0a-44ae-b791-b8d6043f54e8 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:07:28.104714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6b1bee5e-67b4-408b-b4ba-033936f9f224 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Going to try to live migrate instance to n-h1-860282-1 {{(pid=122757) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:07:28.435308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2768eb79-3073-4253-8f1a-a5a210f407f4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:28.436031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2768eb79-3073-4253-8f1a-a5a210f407f4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:28.450992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2768eb79-3073-4253-8f1a-a5a210f407f4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:28.453882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2768eb79-3073-4253-8f1a-a5a210f407f4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:28.454329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2768eb79-3073-4253-8f1a-a5a210f407f4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:28.455081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2768eb79-3073-4253-8f1a-a5a210f407f4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:28.455543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2768eb79-3073-4253-8f1a-a5a210f407f4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:28.455967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2768eb79-3073-4253-8f1a-a5a210f407f4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:28.694369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2768eb79-3073-4253-8f1a-a5a210f407f4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:28.705308 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2768eb79-3073-4253-8f1a-a5a210f407f4 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1502 microversion: 2.1 time: 0.275451 Oct 04 21:07:28.707216 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 236/468] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:28 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1502 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:28.726558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-1f5ea796-b75d-4af1-b2d7-7c8b108b54d0 req-37c4e2e3-9046-4786-b48b-4478fad5e0ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcffd52e-afbb-4711-a9fb-acdaf64b9a93", "name": "network-vif-plugged", "status": "completed", "tag": "c75969cc-4db7-457e-8f38-1307a890a3f2"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:28.743359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1f5ea796-b75d-4af1-b2d7-7c8b108b54d0 req-37c4e2e3-9046-4786-b48b-4478fad5e0ca service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:28.744104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1f5ea796-b75d-4af1-b2d7-7c8b108b54d0 req-37c4e2e3-9046-4786-b48b-4478fad5e0ca service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:28.744695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1f5ea796-b75d-4af1-b2d7-7c8b108b54d0 req-37c4e2e3-9046-4786-b48b-4478fad5e0ca service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:28.757455 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-1f5ea796-b75d-4af1-b2d7-7c8b108b54d0 req-37c4e2e3-9046-4786-b48b-4478fad5e0ca service nova] Creating event network-vif-plugged:c75969cc-4db7-457e-8f38-1307a890a3f2 for instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 on n-h1-860282-1 Oct 04 21:07:28.765361 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-1f5ea796-b75d-4af1-b2d7-7c8b108b54d0 req-37c4e2e3-9046-4786-b48b-4478fad5e0ca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051675 Oct 04 21:07:28.765361 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 237/469] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:28.772083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-763150de-60bf-4dd9-9590-2b3f728167a2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:28.773807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-763150de-60bf-4dd9-9590-2b3f728167a2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:28.780302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-763150de-60bf-4dd9-9590-2b3f728167a2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:28.780978 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-763150de-60bf-4dd9-9590-2b3f728167a2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:28.781634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-763150de-60bf-4dd9-9590-2b3f728167a2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:28.782524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-763150de-60bf-4dd9-9590-2b3f728167a2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:28.783227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-763150de-60bf-4dd9-9590-2b3f728167a2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:28.783651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-763150de-60bf-4dd9-9590-2b3f728167a2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:28.842369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-763150de-60bf-4dd9-9590-2b3f728167a2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:28.842876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-763150de-60bf-4dd9-9590-2b3f728167a2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:28.844560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-763150de-60bf-4dd9-9590-2b3f728167a2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:28.846438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-763150de-60bf-4dd9-9590-2b3f728167a2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lazy-loading 'fault' on Instance uuid f93b80a9-1170-47c7-b177-93f1ea350805 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:07:28.923941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-763150de-60bf-4dd9-9590-2b3f728167a2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:28.931206 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-763150de-60bf-4dd9-9590-2b3f728167a2 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805" status: 200 len: 1309 microversion: 2.1 time: 0.164022 Oct 04 21:07:28.931997 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 238/470] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:28 2022] GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 => generated 1309 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:28.939236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8bd2ec4d-e989-4e94-b651-4e9f9f30283c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:28.940073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8bd2ec4d-e989-4e94-b651-4e9f9f30283c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:28.949089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8bd2ec4d-e989-4e94-b651-4e9f9f30283c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:28.950096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8bd2ec4d-e989-4e94-b651-4e9f9f30283c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:28.950843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8bd2ec4d-e989-4e94-b651-4e9f9f30283c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:28.952019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8bd2ec4d-e989-4e94-b651-4e9f9f30283c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:28.952493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8bd2ec4d-e989-4e94-b651-4e9f9f30283c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:28.953521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8bd2ec4d-e989-4e94-b651-4e9f9f30283c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:28.997199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8bd2ec4d-e989-4e94-b651-4e9f9f30283c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:28.998321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8bd2ec4d-e989-4e94-b651-4e9f9f30283c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:28.999344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8bd2ec4d-e989-4e94-b651-4e9f9f30283c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:29.000348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-8bd2ec4d-e989-4e94-b651-4e9f9f30283c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lazy-loading 'fault' on Instance uuid cbd5aea7-1ee4-4b65-8113-f35d01190b7b {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:07:29.112331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8bd2ec4d-e989-4e94-b651-4e9f9f30283c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:29.125756 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8bd2ec4d-e989-4e94-b651-4e9f9f30283c tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 200 len: 1309 microversion: 2.1 time: 0.192252 Oct 04 21:07:29.126880 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 239/471] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:28 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 1309 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:29.149381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b000651c-5ad1-46b9-9dd4-aa1d3967dc86 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:29.150039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b000651c-5ad1-46b9-9dd4-aa1d3967dc86 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:29.156830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b000651c-5ad1-46b9-9dd4-aa1d3967dc86 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:29.157328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b000651c-5ad1-46b9-9dd4-aa1d3967dc86 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:29.157803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b000651c-5ad1-46b9-9dd4-aa1d3967dc86 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:29.158682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b000651c-5ad1-46b9-9dd4-aa1d3967dc86 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:29.159147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b000651c-5ad1-46b9-9dd4-aa1d3967dc86 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:29.161277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b000651c-5ad1-46b9-9dd4-aa1d3967dc86 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:29.496892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b000651c-5ad1-46b9-9dd4-aa1d3967dc86 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:29.508218 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b000651c-5ad1-46b9-9dd4-aa1d3967dc86 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93" status: 200 len: 1384 microversion: 2.1 time: 0.368694 Oct 04 21:07:29.509863 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 240/472] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:29 2022] GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 => generated 1384 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:29.730536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-838f457f-1bda-44fd-bb94-bb45f99e24cf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:29.736202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-838f457f-1bda-44fd-bb94-bb45f99e24cf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:29.737783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-838f457f-1bda-44fd-bb94-bb45f99e24cf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:29.738447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-838f457f-1bda-44fd-bb94-bb45f99e24cf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:29.739031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-838f457f-1bda-44fd-bb94-bb45f99e24cf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:29.740329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-838f457f-1bda-44fd-bb94-bb45f99e24cf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:29.740947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-838f457f-1bda-44fd-bb94-bb45f99e24cf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:29.741554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-838f457f-1bda-44fd-bb94-bb45f99e24cf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:30.029903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-838f457f-1bda-44fd-bb94-bb45f99e24cf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:30.038463 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-838f457f-1bda-44fd-bb94-bb45f99e24cf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1502 microversion: 2.1 time: 0.312243 Oct 04 21:07:30.039198 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 241/473] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:29 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1502 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:30.043797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-1324eecb-10b5-4da5-bed2-9ff524baf134 req-26c6b113-13e1-41e0-974b-0cfdbe811083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f93b80a9-1170-47c7-b177-93f1ea350805", "name": "network-vif-deleted", "tag": "706e6fc5-a191-4fdf-854b-f0f15e85b501"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:30.053359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1324eecb-10b5-4da5-bed2-9ff524baf134 req-26c6b113-13e1-41e0-974b-0cfdbe811083 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:30.053883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1324eecb-10b5-4da5-bed2-9ff524baf134 req-26c6b113-13e1-41e0-974b-0cfdbe811083 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:30.054313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1324eecb-10b5-4da5-bed2-9ff524baf134 req-26c6b113-13e1-41e0-974b-0cfdbe811083 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:30.077093 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-1324eecb-10b5-4da5-bed2-9ff524baf134 req-26c6b113-13e1-41e0-974b-0cfdbe811083 service nova] Creating event network-vif-deleted:706e6fc5-a191-4fdf-854b-f0f15e85b501 for instance f93b80a9-1170-47c7-b177-93f1ea350805 on n-h2-860282-1 Oct 04 21:07:30.087792 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-1324eecb-10b5-4da5-bed2-9ff524baf134 req-26c6b113-13e1-41e0-974b-0cfdbe811083 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047176 Oct 04 21:07:30.089030 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 242/474] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:30.098531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-20a0fcbd-6960-43c5-96f4-929db4664512 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:30.099435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-20a0fcbd-6960-43c5-96f4-929db4664512 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:30.106296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20a0fcbd-6960-43c5-96f4-929db4664512 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:30.107088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20a0fcbd-6960-43c5-96f4-929db4664512 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:30.107678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20a0fcbd-6960-43c5-96f4-929db4664512 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:30.108583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20a0fcbd-6960-43c5-96f4-929db4664512 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:30.109191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20a0fcbd-6960-43c5-96f4-929db4664512 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:30.109814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20a0fcbd-6960-43c5-96f4-929db4664512 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:30.132261 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-20a0fcbd-6960-43c5-96f4-929db4664512 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] HTTP exception thrown: Instance f93b80a9-1170-47c7-b177-93f1ea350805 could not be found. Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-20a0fcbd-6960-43c5-96f4-929db4664512 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Request method failure captured: Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 HTTP/1.1 Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKB2gp6fJBasMsFvCZe2B7jdkCLOEYv82xbxBYFtdaXeHV6iPTdW-jNcJ-Eh0dKsmNTfNkgNfW9HyMMMPw3_Ua576zW9GAvB7emDSNSEc0cLLPHOGa8-Fv8KydRx4NUWVAoJTe6iF41zumgu2yvq0GcxRG7VLI04Evm_d3p6_J8EsxQ Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 4cfef30006e947d18bf514bdadff52ec Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-DeleteServersAdminTestJSON-819880978 Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:07:30.133956 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:07:30.135558 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4cfef30006e947d18bf514bdadff52ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4cfef30006e947d18bf514bdadff52ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4cfef30006e947d18bf514bdadff52ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4cfef30006e947d18bf514bdadff52ec"}]}] Oct 04 21:07:30.135558 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-DeleteServersAdminTestJSON-819880978 Oct 04 21:07:30.135558 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 4cfef30006e947d18bf514bdadff52ec Oct 04 21:07:30.135558 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-819880978 Oct 04 21:07:30.135558 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-DeleteServersAdminTestJSON-819880978-project Oct 04 21:07:30.135558 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:07:30.135558 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:07:30.135558 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 27554053d0174aa497fc09e07a859fba Oct 04 21:07:30.135558 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-DeleteServersAdminTestJSON-819880978-project Oct 04 21:07:30.135558 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:07:30.135558 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance f93b80a9-1170-47c7-b177-93f1ea350805 could not be found. Oct 04 21:07:30.135558 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'f93b80a9-1170-47c7-b177-93f1ea350805'} Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f93b80a9-1170-47c7-b177-93f1ea350805 could not be found. Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:30.136445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:30.137832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:30.137832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:07:30.137832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:07:30.137832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:07:30.137832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:07:30.137832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:07:30.137832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:07:30.137832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f93b80a9-1170-47c7-b177-93f1ea350805 could not be found. Oct 04 21:07:30.137832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:30.137832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:30.137832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:30.137832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:30.137832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:30.137832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:30.137832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:30.137832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:30.137832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f93b80a9-1170-47c7-b177-93f1ea350805 could not be found. Oct 04 21:07:30.137832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:30.139575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-20a0fcbd-6960-43c5-96f4-929db4664512 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Returning 404 to user: Instance f93b80a9-1170-47c7-b177-93f1ea350805 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:30.139575 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-20a0fcbd-6960-43c5-96f4-929db4664512 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805" status: 404 len: 111 microversion: 2.1 time: 0.044425 Oct 04 21:07:30.139575 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 243/475] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:30 2022] GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:07:30.156232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-65bf4a19-a3ab-4f37-bf55-76459ff407c5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:30.156957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-65bf4a19-a3ab-4f37-bf55-76459ff407c5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: cbd5aea7-1ee4-4b65-8113-f35d01190b7b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:30.162934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65bf4a19-a3ab-4f37-bf55-76459ff407c5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:30.163517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65bf4a19-a3ab-4f37-bf55-76459ff407c5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:30.164026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65bf4a19-a3ab-4f37-bf55-76459ff407c5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:30.164834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65bf4a19-a3ab-4f37-bf55-76459ff407c5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:30.165392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65bf4a19-a3ab-4f37-bf55-76459ff407c5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:30.165956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65bf4a19-a3ab-4f37-bf55-76459ff407c5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:30.180425 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-65bf4a19-a3ab-4f37-bf55-76459ff407c5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] HTTP exception thrown: Instance cbd5aea7-1ee4-4b65-8113-f35d01190b7b could not be found. Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-65bf4a19-a3ab-4f37-bf55-76459ff407c5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Request method failure captured: Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b HTTP/1.1 Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKBKPAxAwTSoLx071-6XfVoULWRiSFPC5HCbsCisDLOBiT7khyIoXci7vU7hmM8xYX1Uz_sSRAP-qVzR5tTOPejy5oi6yCpw1Z-6eHSo0rzG_9l5-oxauRtBYFqZ_n-jv_xVnB10H2oZZxUFnD4i8ycVWy2zQGtGy6A9zASxxpk64_o Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 6d56154e7fa646268a5c726e278c010e Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-LiveMigrationNegativeTest-14017868 Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:07:30.182096 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:07:30.183634 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6d56154e7fa646268a5c726e278c010e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6d56154e7fa646268a5c726e278c010e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6d56154e7fa646268a5c726e278c010e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6d56154e7fa646268a5c726e278c010e"}]}] Oct 04 21:07:30.183634 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-LiveMigrationNegativeTest-14017868 Oct 04 21:07:30.183634 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 6d56154e7fa646268a5c726e278c010e Oct 04 21:07:30.183634 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-14017868 Oct 04 21:07:30.183634 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-LiveMigrationNegativeTest-14017868-project Oct 04 21:07:30.183634 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:07:30.183634 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:07:30.183634 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 4454733cee334f368ee2048c3a32d7f0 Oct 04 21:07:30.183634 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-LiveMigrationNegativeTest-14017868-project Oct 04 21:07:30.183634 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:07:30.183634 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance cbd5aea7-1ee4-4b65-8113-f35d01190b7b could not be found. Oct 04 21:07:30.183634 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'cbd5aea7-1ee4-4b65-8113-f35d01190b7b'} Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbd5aea7-1ee4-4b65-8113-f35d01190b7b could not be found. Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:30.184528 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:30.186654 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:30.186654 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:07:30.186654 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:07:30.186654 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:07:30.186654 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:07:30.186654 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:07:30.186654 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:07:30.186654 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbd5aea7-1ee4-4b65-8113-f35d01190b7b could not be found. Oct 04 21:07:30.186654 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:30.186654 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:30.186654 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:30.186654 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:30.186654 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:30.186654 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:30.186654 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:30.186654 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:30.186654 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbd5aea7-1ee4-4b65-8113-f35d01190b7b could not be found. Oct 04 21:07:30.186654 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:30.187892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-65bf4a19-a3ab-4f37-bf55-76459ff407c5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Returning 404 to user: Instance cbd5aea7-1ee4-4b65-8113-f35d01190b7b could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:30.188400 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-65bf4a19-a3ab-4f37-bf55-76459ff407c5 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b" status: 404 len: 111 microversion: 2.1 time: 0.036211 Oct 04 21:07:30.189048 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 244/476] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:30 2022] GET /compute/v2.1/servers/cbd5aea7-1ee4-4b65-8113-f35d01190b7b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:07:30.197959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f3cb0222-252c-4917-9e2a-755dc4393ebc tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:30.198800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f3cb0222-252c-4917-9e2a-755dc4393ebc tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:30.206184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3cb0222-252c-4917-9e2a-755dc4393ebc tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:30.218817 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3cb0222-252c-4917-9e2a-755dc4393ebc tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:30.218817 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3cb0222-252c-4917-9e2a-755dc4393ebc tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:30.218817 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3cb0222-252c-4917-9e2a-755dc4393ebc tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:30.218817 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3cb0222-252c-4917-9e2a-755dc4393ebc tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:30.219207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3cb0222-252c-4917-9e2a-755dc4393ebc tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:30.238496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f3cb0222-252c-4917-9e2a-755dc4393ebc tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:07:30.660331 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f3cb0222-252c-4917-9e2a-755dc4393ebc tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 204 len: 0 microversion: 2.1 time: 0.466527 Oct 04 21:07:30.664649 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 245/477] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:07:30 2022] DELETE /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:07:30.671906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7024d528-ea86-4169-90c4-59d0ba347c70 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-856172303", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:30.731062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-7024d528-ea86-4169-90c4-59d0ba347c70 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:07:31.040541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7024d528-ea86-4169-90c4-59d0ba347c70 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:07:31.041281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7024d528-ea86-4169-90c4-59d0ba347c70 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:07:31.041794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7024d528-ea86-4169-90c4-59d0ba347c70 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:07:31.042208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7024d528-ea86-4169-90c4-59d0ba347c70 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:07:31.042623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7024d528-ea86-4169-90c4-59d0ba347c70 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:07:31.053256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7024d528-ea86-4169-90c4-59d0ba347c70 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:31.054001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7024d528-ea86-4169-90c4-59d0ba347c70 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:31.054732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7024d528-ea86-4169-90c4-59d0ba347c70 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:31.062737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7024d528-ea86-4169-90c4-59d0ba347c70 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:31.064444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7024d528-ea86-4169-90c4-59d0ba347c70 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:31.066161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7024d528-ea86-4169-90c4-59d0ba347c70 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:31.110962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7024d528-ea86-4169-90c4-59d0ba347c70 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Getting quotas for project 4cfef30006e947d18bf514bdadff52ec. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:31.126726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7024d528-ea86-4169-90c4-59d0ba347c70 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Getting quotas for user 27554053d0174aa497fc09e07a859fba and project 4cfef30006e947d18bf514bdadff52ec. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:31.155816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7024d528-ea86-4169-90c4-59d0ba347c70 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:07:31.166416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7024d528-ea86-4169-90c4-59d0ba347c70 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:07:31.368277 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7024d528-ea86-4169-90c4-59d0ba347c70 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702038 Oct 04 21:07:31.369080 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 246/478] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:07:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:07:31.377472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e56cf0ce-0f1c-49c6-8e88-40ec84149309 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:31.378543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e56cf0ce-0f1c-49c6-8e88-40ec84149309 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:31.386576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e56cf0ce-0f1c-49c6-8e88-40ec84149309 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:31.387461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e56cf0ce-0f1c-49c6-8e88-40ec84149309 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:31.388215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e56cf0ce-0f1c-49c6-8e88-40ec84149309 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:31.389144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e56cf0ce-0f1c-49c6-8e88-40ec84149309 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:31.389941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e56cf0ce-0f1c-49c6-8e88-40ec84149309 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:31.390704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e56cf0ce-0f1c-49c6-8e88-40ec84149309 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:31.604645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e56cf0ce-0f1c-49c6-8e88-40ec84149309 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:31.609270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:31.614646 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e56cf0ce-0f1c-49c6-8e88-40ec84149309 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93" status: 200 len: 1583 microversion: 2.1 time: 0.244170 Oct 04 21:07:31.633230 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 247/479] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:31 2022] GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 => generated 1583 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:31.639181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-18e5dde2-862a-421f-8207-cbbbd38b20a3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:31.639851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-18e5dde2-862a-421f-8207-cbbbd38b20a3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:31.652320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18e5dde2-862a-421f-8207-cbbbd38b20a3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:31.652865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18e5dde2-862a-421f-8207-cbbbd38b20a3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:31.653322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18e5dde2-862a-421f-8207-cbbbd38b20a3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:31.655069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18e5dde2-862a-421f-8207-cbbbd38b20a3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:31.655977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18e5dde2-862a-421f-8207-cbbbd38b20a3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:31.663329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18e5dde2-862a-421f-8207-cbbbd38b20a3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:31.829585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-18e5dde2-862a-421f-8207-cbbbd38b20a3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:31.837996 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-18e5dde2-862a-421f-8207-cbbbd38b20a3 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 200 len: 1475 microversion: 2.1 time: 0.203593 Oct 04 21:07:31.838577 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 248/480] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:31 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 1475 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:31.843819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5a41e846-d137-461e-8cd1-2c0db9ba70ec tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:31.844429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5a41e846-d137-461e-8cd1-2c0db9ba70ec tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:31.850514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a41e846-d137-461e-8cd1-2c0db9ba70ec tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:31.855960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a41e846-d137-461e-8cd1-2c0db9ba70ec tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:31.855960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a41e846-d137-461e-8cd1-2c0db9ba70ec tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:31.855960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a41e846-d137-461e-8cd1-2c0db9ba70ec tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:31.855960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a41e846-d137-461e-8cd1-2c0db9ba70ec tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:31.856309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a41e846-d137-461e-8cd1-2c0db9ba70ec tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:32.165614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5a41e846-d137-461e-8cd1-2c0db9ba70ec tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:32.193150 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5a41e846-d137-461e-8cd1-2c0db9ba70ec tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1502 microversion: 2.1 time: 0.351264 Oct 04 21:07:32.193150 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 249/481] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:31 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1502 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:32.215328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fd3b9bd3-3b0c-4647-a3e6-b31f51d59fd4 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:32.217642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fd3b9bd3-3b0c-4647-a3e6-b31f51d59fd4 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:32.336928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fd3b9bd3-3b0c-4647-a3e6-b31f51d59fd4 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:32.349354 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fd3b9bd3-3b0c-4647-a3e6-b31f51d59fd4 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 200 len: 1219 microversion: 2.1 time: 0.138009 Oct 04 21:07:32.351989 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 250/482] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:32 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:32.679157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1f523382-f330-415f-9fa9-e8f159f7a65d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1439110258", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:32.829514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-1f523382-f330-415f-9fa9-e8f159f7a65d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:07:33.251687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-1f523382-f330-415f-9fa9-e8f159f7a65d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:07:33.252908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-1f523382-f330-415f-9fa9-e8f159f7a65d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:07:33.253402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-1f523382-f330-415f-9fa9-e8f159f7a65d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:07:33.253835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-1f523382-f330-415f-9fa9-e8f159f7a65d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:07:33.254438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-1f523382-f330-415f-9fa9-e8f159f7a65d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:07:33.266084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:33.284518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f523382-f330-415f-9fa9-e8f159f7a65d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:33.285002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f523382-f330-415f-9fa9-e8f159f7a65d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:33.285645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f523382-f330-415f-9fa9-e8f159f7a65d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:33.286557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f523382-f330-415f-9fa9-e8f159f7a65d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:33.287159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f523382-f330-415f-9fa9-e8f159f7a65d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:33.287757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f523382-f330-415f-9fa9-e8f159f7a65d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:33.314064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-1f523382-f330-415f-9fa9-e8f159f7a65d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:33.320223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-1f523382-f330-415f-9fa9-e8f159f7a65d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for user 0f0ac29dc4e440e785408fa1dfedce5e and project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:33.333531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1f523382-f330-415f-9fa9-e8f159f7a65d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:07:33.335756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1f523382-f330-415f-9fa9-e8f159f7a65d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:07:33.499899 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6b1bee5e-67b4-408b-b4ba-033936f9f224 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8/action" status: 202 len: 0 microversion: 2.25 time: 5.489533 Oct 04 21:07:33.503672 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 233/483] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Oct 4 21:07:28 2022] POST /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8/action => generated 0 bytes in 5497 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:07:33.514976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-31cb1a2c-ffed-4599-905a-e5487c4f7ecb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:33.520369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-31cb1a2c-ffed-4599-905a-e5487c4f7ecb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:33.535847 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1f523382-f330-415f-9fa9-e8f159f7a65d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.181894 Oct 04 21:07:33.548767 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 251/484] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:07:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:07:33.552840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31cb1a2c-ffed-4599-905a-e5487c4f7ecb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:33.560742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31cb1a2c-ffed-4599-905a-e5487c4f7ecb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:33.564003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31cb1a2c-ffed-4599-905a-e5487c4f7ecb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:33.564936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31cb1a2c-ffed-4599-905a-e5487c4f7ecb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:33.569990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31cb1a2c-ffed-4599-905a-e5487c4f7ecb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:33.571549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31cb1a2c-ffed-4599-905a-e5487c4f7ecb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:33.573497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6b58bbcc-2a03-4507-beb7-bc4bcc25c97d tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:33.575139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6b58bbcc-2a03-4507-beb7-bc4bcc25c97d tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:33.614966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b58bbcc-2a03-4507-beb7-bc4bcc25c97d tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:33.615485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b58bbcc-2a03-4507-beb7-bc4bcc25c97d tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:33.615929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b58bbcc-2a03-4507-beb7-bc4bcc25c97d tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:33.616660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b58bbcc-2a03-4507-beb7-bc4bcc25c97d tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:33.617117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b58bbcc-2a03-4507-beb7-bc4bcc25c97d tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:33.621818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b58bbcc-2a03-4507-beb7-bc4bcc25c97d tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:33.839231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6b58bbcc-2a03-4507-beb7-bc4bcc25c97d tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:33.849259 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-31cb1a2c-ffed-4599-905a-e5487c4f7ecb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.345540 Oct 04 21:07:33.850054 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 234/485] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:07:33 2022] GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93/os-interface => generated 285 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:33.855209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a2a083af-ba0e-486b-b31b-f346190b5596 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:33.856764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a2a083af-ba0e-486b-b31b-f346190b5596 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:33.867927 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6b58bbcc-2a03-4507-beb7-bc4bcc25c97d tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 200 len: 1433 microversion: 2.1 time: 0.313648 Oct 04 21:07:33.883725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2a083af-ba0e-486b-b31b-f346190b5596 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:33.884231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2a083af-ba0e-486b-b31b-f346190b5596 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:33.884680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2a083af-ba0e-486b-b31b-f346190b5596 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:33.885384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2a083af-ba0e-486b-b31b-f346190b5596 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:33.885872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2a083af-ba0e-486b-b31b-f346190b5596 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:33.886299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2a083af-ba0e-486b-b31b-f346190b5596 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:33.894934 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 252/486] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:33 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 1433 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:33.916002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5ca39cdb-19e5-4d45-b08c-af077a0988c9 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:33.918383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5ca39cdb-19e5-4d45-b08c-af077a0988c9 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:33.936023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ca39cdb-19e5-4d45-b08c-af077a0988c9 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:33.939017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ca39cdb-19e5-4d45-b08c-af077a0988c9 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:33.939672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ca39cdb-19e5-4d45-b08c-af077a0988c9 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:33.941558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ca39cdb-19e5-4d45-b08c-af077a0988c9 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:33.944209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ca39cdb-19e5-4d45-b08c-af077a0988c9 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:33.946783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ca39cdb-19e5-4d45-b08c-af077a0988c9 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:34.241134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5ca39cdb-19e5-4d45-b08c-af077a0988c9 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:34.250015 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5ca39cdb-19e5-4d45-b08c-af077a0988c9 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 200 len: 1271 microversion: 2.1 time: 0.350377 Oct 04 21:07:34.257627 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 253/487] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:33 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 1271 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:34.263821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2709dc2c-0c48-4bae-898e-b1e87fdc7c04 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:34.267457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2709dc2c-0c48-4bae-898e-b1e87fdc7c04 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:34.280348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2709dc2c-0c48-4bae-898e-b1e87fdc7c04 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:34.281041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2709dc2c-0c48-4bae-898e-b1e87fdc7c04 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:34.281696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2709dc2c-0c48-4bae-898e-b1e87fdc7c04 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:34.282593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2709dc2c-0c48-4bae-898e-b1e87fdc7c04 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:34.283369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2709dc2c-0c48-4bae-898e-b1e87fdc7c04 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:34.284166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2709dc2c-0c48-4bae-898e-b1e87fdc7c04 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:34.540442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a2a083af-ba0e-486b-b31b-f346190b5596 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:34.549372 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a2a083af-ba0e-486b-b31b-f346190b5596 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1502 microversion: 2.1 time: 0.698265 Oct 04 21:07:34.558511 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 235/488] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:33 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1502 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:34.563907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bf925a0e-4a71-4610-9538-cf05d7921d9e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:34.566181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bf925a0e-4a71-4610-9538-cf05d7921d9e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:34.636257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2709dc2c-0c48-4bae-898e-b1e87fdc7c04 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:34.647696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2709dc2c-0c48-4bae-898e-b1e87fdc7c04 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:34.652312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2709dc2c-0c48-4bae-898e-b1e87fdc7c04 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:34.659288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=7 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:34.660526 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2709dc2c-0c48-4bae-898e-b1e87fdc7c04 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1569 microversion: 2.25 time: 0.394474 Oct 04 21:07:34.661391 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 254/489] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:34 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1569 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:34.677291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-b17a4aa8-5207-4384-a400-277b654d6756 req-49bdbb37-ef2d-4911-be52-4dab757ab037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4e9977-7ff4-4009-914b-6ea126ce63e8", "name": "network-vif-deleted", "tag": "401354df-34a1-44ec-bcc3-145679d84557"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:34.689667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b17a4aa8-5207-4384-a400-277b654d6756 req-49bdbb37-ef2d-4911-be52-4dab757ab037 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:34.694459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b17a4aa8-5207-4384-a400-277b654d6756 req-49bdbb37-ef2d-4911-be52-4dab757ab037 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:34.695105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b17a4aa8-5207-4384-a400-277b654d6756 req-49bdbb37-ef2d-4911-be52-4dab757ab037 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:34.713458 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-b17a4aa8-5207-4384-a400-277b654d6756 req-49bdbb37-ef2d-4911-be52-4dab757ab037 service nova] Creating event network-vif-deleted:401354df-34a1-44ec-bcc3-145679d84557 for instance 3d4e9977-7ff4-4009-914b-6ea126ce63e8 on n-h1-860282-1 Oct 04 21:07:34.725392 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-b17a4aa8-5207-4384-a400-277b654d6756 req-49bdbb37-ef2d-4911-be52-4dab757ab037 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057112 Oct 04 21:07:34.725392 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 255/490] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:34.759653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bf925a0e-4a71-4610-9538-cf05d7921d9e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:34.760573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=33,nova_cell0:UPDATE=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:34.769544 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bf925a0e-4a71-4610-9538-cf05d7921d9e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 200 len: 1217 microversion: 2.1 time: 0.209412 Oct 04 21:07:34.770045 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 236/491] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:34 2022] GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 1217 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:34.899369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6a2e2a7c-4e44-47fe-b9d7-de177ed23b04 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:34.900278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6a2e2a7c-4e44-47fe-b9d7-de177ed23b04 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:34.909197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a2e2a7c-4e44-47fe-b9d7-de177ed23b04 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:34.910359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a2e2a7c-4e44-47fe-b9d7-de177ed23b04 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:34.911195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a2e2a7c-4e44-47fe-b9d7-de177ed23b04 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:34.914148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a2e2a7c-4e44-47fe-b9d7-de177ed23b04 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:34.914148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a2e2a7c-4e44-47fe-b9d7-de177ed23b04 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:34.914148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a2e2a7c-4e44-47fe-b9d7-de177ed23b04 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:34.950222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a2e2a7c-4e44-47fe-b9d7-de177ed23b04 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:34.951149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a2e2a7c-4e44-47fe-b9d7-de177ed23b04 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:34.951740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a2e2a7c-4e44-47fe-b9d7-de177ed23b04 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:34.952347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-6a2e2a7c-4e44-47fe-b9d7-de177ed23b04 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lazy-loading 'fault' on Instance uuid 3d4e9977-7ff4-4009-914b-6ea126ce63e8 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:07:35.049562 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6a2e2a7c-4e44-47fe-b9d7-de177ed23b04 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4454733cee334f368ee2048c3a32d7f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d56154e7fa646268a5c726e278c010e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:35.057248 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6a2e2a7c-4e44-47fe-b9d7-de177ed23b04 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 200 len: 1309 microversion: 2.1 time: 0.162619 Oct 04 21:07:35.057878 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 256/492] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:34 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 1309 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:35.255205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-31b89d32-8678-4c44-9afd-abdaf91a6d71 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-233897952", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": "none"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:35.280928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a378a707-16db-47a4-b0d2-5f3556a38831 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:35.281475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a378a707-16db-47a4-b0d2-5f3556a38831 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:35.290386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a378a707-16db-47a4-b0d2-5f3556a38831 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:35.291035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a378a707-16db-47a4-b0d2-5f3556a38831 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:35.291639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a378a707-16db-47a4-b0d2-5f3556a38831 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:35.292500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a378a707-16db-47a4-b0d2-5f3556a38831 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:35.293132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a378a707-16db-47a4-b0d2-5f3556a38831 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:35.293751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a378a707-16db-47a4-b0d2-5f3556a38831 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:35.335088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-31b89d32-8678-4c44-9afd-abdaf91a6d71 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:07:35.335735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-31b89d32-8678-4c44-9afd-abdaf91a6d71 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:07:35.336393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-31b89d32-8678-4c44-9afd-abdaf91a6d71 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:07:35.336988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-31b89d32-8678-4c44-9afd-abdaf91a6d71 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:07:35.337402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-31b89d32-8678-4c44-9afd-abdaf91a6d71 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:07:35.348394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31b89d32-8678-4c44-9afd-abdaf91a6d71 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:35.349124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31b89d32-8678-4c44-9afd-abdaf91a6d71 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:35.349774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31b89d32-8678-4c44-9afd-abdaf91a6d71 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:35.350673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31b89d32-8678-4c44-9afd-abdaf91a6d71 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:35.351306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31b89d32-8678-4c44-9afd-abdaf91a6d71 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:35.351897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31b89d32-8678-4c44-9afd-abdaf91a6d71 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:35.371095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-31b89d32-8678-4c44-9afd-abdaf91a6d71 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Getting quotas for project 022b5442755646a0bd3d814ee61fad3f. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:35.376963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-31b89d32-8678-4c44-9afd-abdaf91a6d71 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Getting quotas for user 37e346ff2098411480433b65e79aec71 and project 022b5442755646a0bd3d814ee61fad3f. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:35.390922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-31b89d32-8678-4c44-9afd-abdaf91a6d71 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:07:35.393582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-31b89d32-8678-4c44-9afd-abdaf91a6d71 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:07:35.632232 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-31b89d32-8678-4c44-9afd-abdaf91a6d71 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.510436 Oct 04 21:07:35.634377 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 237/493] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Oct 4 21:07:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:07:35.657119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f6cd7056-3888-4bbe-b115-917f35911a40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:35.658086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f6cd7056-3888-4bbe-b115-917f35911a40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:35.671633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6cd7056-3888-4bbe-b115-917f35911a40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:35.671633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6cd7056-3888-4bbe-b115-917f35911a40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:35.672021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6cd7056-3888-4bbe-b115-917f35911a40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:35.672993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6cd7056-3888-4bbe-b115-917f35911a40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:35.673483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6cd7056-3888-4bbe-b115-917f35911a40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:35.674070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6cd7056-3888-4bbe-b115-917f35911a40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:35.735524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a378a707-16db-47a4-b0d2-5f3556a38831 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:35.759316 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a378a707-16db-47a4-b0d2-5f3556a38831 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 200 len: 1279 microversion: 2.1 time: 0.482720 Oct 04 21:07:35.762556 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 257/494] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:35 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 1279 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:35.771344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-825422a9-1334-440e-8398-f09e9fba51a0 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:35.777726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-825422a9-1334-440e-8398-f09e9fba51a0 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:35.957486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-825422a9-1334-440e-8398-f09e9fba51a0 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:35.968729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-825422a9-1334-440e-8398-f09e9fba51a0 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:35.970773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-825422a9-1334-440e-8398-f09e9fba51a0 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:35.982019 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-825422a9-1334-440e-8398-f09e9fba51a0 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "PUT /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1358 microversion: 2.75 time: 0.214734 Oct 04 21:07:35.992034 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 258/495] 10.222.0.30 () {62 vars in 1297 bytes} [Tue Oct 4 21:07:35 2022] PUT /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:35.999603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c69b175c-1971-4132-9ba1-a081a389291a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:36.000122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c69b175c-1971-4132-9ba1-a081a389291a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:36.016207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c69b175c-1971-4132-9ba1-a081a389291a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:36.016700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c69b175c-1971-4132-9ba1-a081a389291a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:36.028071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c69b175c-1971-4132-9ba1-a081a389291a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:36.029013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c69b175c-1971-4132-9ba1-a081a389291a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:36.029527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c69b175c-1971-4132-9ba1-a081a389291a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:36.030140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c69b175c-1971-4132-9ba1-a081a389291a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:36.107879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f6cd7056-3888-4bbe-b115-917f35911a40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:36.119938 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f6cd7056-3888-4bbe-b115-917f35911a40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1502 microversion: 2.1 time: 0.470672 Oct 04 21:07:36.126714 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 238/496] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:35 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1502 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:36.155643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-801534d9-b9ea-4e15-a4f4-69cc3381a3e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:36.158900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-801534d9-b9ea-4e15-a4f4-69cc3381a3e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:36.176799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-801534d9-b9ea-4e15-a4f4-69cc3381a3e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:36.178327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-801534d9-b9ea-4e15-a4f4-69cc3381a3e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:36.178943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-801534d9-b9ea-4e15-a4f4-69cc3381a3e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:36.179964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-801534d9-b9ea-4e15-a4f4-69cc3381a3e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:36.180736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-801534d9-b9ea-4e15-a4f4-69cc3381a3e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:36.182777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-801534d9-b9ea-4e15-a4f4-69cc3381a3e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:36.312043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-801534d9-b9ea-4e15-a4f4-69cc3381a3e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:36.336881 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-801534d9-b9ea-4e15-a4f4-69cc3381a3e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 200 len: 1213 microversion: 2.1 time: 0.192779 Oct 04 21:07:36.341554 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 239/497] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:36 2022] GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 1213 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:36.353006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5b1189ab-8e9b-4c50-bec4-9a0649d3b033 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:36.354052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5b1189ab-8e9b-4c50-bec4-9a0649d3b033 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:36.371596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:36.511244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5b1189ab-8e9b-4c50-bec4-9a0649d3b033 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:36.522189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5b1189ab-8e9b-4c50-bec4-9a0649d3b033 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:36.523791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5b1189ab-8e9b-4c50-bec4-9a0649d3b033 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:36.534200 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5b1189ab-8e9b-4c50-bec4-9a0649d3b033 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1358 microversion: 2.75 time: 0.191318 Oct 04 21:07:36.538986 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 240/498] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:36 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:36.546556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-25594f7a-18e2-45d6-9ca1-77c201464044 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:36.547192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-25594f7a-18e2-45d6-9ca1-77c201464044 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] [instance: 3d4e9977-7ff4-4009-914b-6ea126ce63e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:36.567820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25594f7a-18e2-45d6-9ca1-77c201464044 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:36.570340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25594f7a-18e2-45d6-9ca1-77c201464044 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:36.571196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25594f7a-18e2-45d6-9ca1-77c201464044 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:36.573040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25594f7a-18e2-45d6-9ca1-77c201464044 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:36.573924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25594f7a-18e2-45d6-9ca1-77c201464044 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:36.576861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25594f7a-18e2-45d6-9ca1-77c201464044 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:36.599514 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-25594f7a-18e2-45d6-9ca1-77c201464044 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] HTTP exception thrown: Instance 3d4e9977-7ff4-4009-914b-6ea126ce63e8 could not be found. Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-25594f7a-18e2-45d6-9ca1-77c201464044 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Request method failure captured: Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 HTTP/1.1 Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKBKPAxAwTSoLx071-6XfVoULWRiSFPC5HCbsCisDLOBiT7khyIoXci7vU7hmM8xYX1Uz_sSRAP-qVzR5tTOPejy5oi6yCpw1Z-6eHSo0rzG_9l5-oxauRtBYFqZ_n-jv_xVnB10H2oZZxUFnD4i8ycVWy2zQGtGy6A9zASxxpk64_o Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 6d56154e7fa646268a5c726e278c010e Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-LiveMigrationNegativeTest-14017868 Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:07:36.601199 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:07:36.602568 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6d56154e7fa646268a5c726e278c010e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6d56154e7fa646268a5c726e278c010e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6d56154e7fa646268a5c726e278c010e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6d56154e7fa646268a5c726e278c010e"}]}] Oct 04 21:07:36.602568 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-LiveMigrationNegativeTest-14017868 Oct 04 21:07:36.602568 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 6d56154e7fa646268a5c726e278c010e Oct 04 21:07:36.602568 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-14017868 Oct 04 21:07:36.602568 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-LiveMigrationNegativeTest-14017868-project Oct 04 21:07:36.602568 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:07:36.602568 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:07:36.602568 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 4454733cee334f368ee2048c3a32d7f0 Oct 04 21:07:36.602568 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-LiveMigrationNegativeTest-14017868-project Oct 04 21:07:36.602568 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:07:36.602568 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 3d4e9977-7ff4-4009-914b-6ea126ce63e8 could not be found. Oct 04 21:07:36.602568 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '3d4e9977-7ff4-4009-914b-6ea126ce63e8'} Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d4e9977-7ff4-4009-914b-6ea126ce63e8 could not be found. Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:36.603595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:36.604811 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:36.604811 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:07:36.604811 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:07:36.604811 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:07:36.604811 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:07:36.604811 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:07:36.604811 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:07:36.604811 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d4e9977-7ff4-4009-914b-6ea126ce63e8 could not be found. Oct 04 21:07:36.604811 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:36.604811 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:36.604811 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:36.604811 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:36.604811 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:36.604811 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:36.604811 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:36.604811 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:36.604811 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d4e9977-7ff4-4009-914b-6ea126ce63e8 could not be found. Oct 04 21:07:36.604811 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:36.607587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-25594f7a-18e2-45d6-9ca1-77c201464044 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] Returning 404 to user: Instance 3d4e9977-7ff4-4009-914b-6ea126ce63e8 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:36.607587 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-25594f7a-18e2-45d6-9ca1-77c201464044 tempest-LiveMigrationNegativeTest-14017868 tempest-LiveMigrationNegativeTest-14017868-project] 10.222.0.30 "GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8" status: 404 len: 111 microversion: 2.1 time: 0.061133 Oct 04 21:07:36.607587 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 241/499] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:36 2022] GET /compute/v2.1/servers/3d4e9977-7ff4-4009-914b-6ea126ce63e8 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:07:36.681579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c69b175c-1971-4132-9ba1-a081a389291a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:36.691721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c69b175c-1971-4132-9ba1-a081a389291a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:36.693168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c69b175c-1971-4132-9ba1-a081a389291a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:36.699522 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c69b175c-1971-4132-9ba1-a081a389291a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1569 microversion: 2.25 time: 0.706276 Oct 04 21:07:36.700144 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 259/500] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:35 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1569 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:36.786388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-61172c88-82e7-483c-945b-117ea5d79958 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:36.787841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-61172c88-82e7-483c-945b-117ea5d79958 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:36.800305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61172c88-82e7-483c-945b-117ea5d79958 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:36.801162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61172c88-82e7-483c-945b-117ea5d79958 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:36.801796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61172c88-82e7-483c-945b-117ea5d79958 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:36.803791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61172c88-82e7-483c-945b-117ea5d79958 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:36.804410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61172c88-82e7-483c-945b-117ea5d79958 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:36.808287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61172c88-82e7-483c-945b-117ea5d79958 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:36.984905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-61172c88-82e7-483c-945b-117ea5d79958 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:36.998139 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-61172c88-82e7-483c-945b-117ea5d79958 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 200 len: 1277 microversion: 2.1 time: 0.214527 Oct 04 21:07:36.999637 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 242/501] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:36 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 1277 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:37.153340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5136435b-e583-4c39-ba66-3d7c0b6f0bdd tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:37.154018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5136435b-e583-4c39-ba66-3d7c0b6f0bdd tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:37.162152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5136435b-e583-4c39-ba66-3d7c0b6f0bdd tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:37.168623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5136435b-e583-4c39-ba66-3d7c0b6f0bdd tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:37.169704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5136435b-e583-4c39-ba66-3d7c0b6f0bdd tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:37.170587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5136435b-e583-4c39-ba66-3d7c0b6f0bdd tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:37.171065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5136435b-e583-4c39-ba66-3d7c0b6f0bdd tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:37.171676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5136435b-e583-4c39-ba66-3d7c0b6f0bdd tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:37.214138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-677915ec-00a7-4784-8d0c-6503d1edd0ba tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:37.214757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-677915ec-00a7-4784-8d0c-6503d1edd0ba tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:37.226097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-677915ec-00a7-4784-8d0c-6503d1edd0ba tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:37.234323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-677915ec-00a7-4784-8d0c-6503d1edd0ba tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:37.235079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-677915ec-00a7-4784-8d0c-6503d1edd0ba tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:37.236000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-677915ec-00a7-4784-8d0c-6503d1edd0ba tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:37.244418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-677915ec-00a7-4784-8d0c-6503d1edd0ba tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:37.245102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-677915ec-00a7-4784-8d0c-6503d1edd0ba tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:37.627093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-677915ec-00a7-4784-8d0c-6503d1edd0ba tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:37.640904 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-677915ec-00a7-4784-8d0c-6503d1edd0ba tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93" status: 200 len: 1583 microversion: 2.1 time: 0.430838 Oct 04 21:07:37.641512 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 243/502] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:37 2022] GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 => generated 1583 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:37.661734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b6bc7148-71d7-4d9a-872e-ebf313f78e72 req-91b91ead-0ebf-4724-8af8-48cac611d2fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcffd52e-afbb-4711-a9fb-acdaf64b9a93", "tag": "c75969cc-4db7-457e-8f38-1307a890a3f2"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:37.683663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b6bc7148-71d7-4d9a-872e-ebf313f78e72 req-91b91ead-0ebf-4724-8af8-48cac611d2fa service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:37.684147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b6bc7148-71d7-4d9a-872e-ebf313f78e72 req-91b91ead-0ebf-4724-8af8-48cac611d2fa service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:37.684585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b6bc7148-71d7-4d9a-872e-ebf313f78e72 req-91b91ead-0ebf-4724-8af8-48cac611d2fa service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:37.707397 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b6bc7148-71d7-4d9a-872e-ebf313f78e72 req-91b91ead-0ebf-4724-8af8-48cac611d2fa service nova] Creating event network-changed:c75969cc-4db7-457e-8f38-1307a890a3f2 for instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 on n-h1-860282-1 Oct 04 21:07:37.714922 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b6bc7148-71d7-4d9a-872e-ebf313f78e72 req-91b91ead-0ebf-4724-8af8-48cac611d2fa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072195 Oct 04 21:07:37.721306 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 244/503] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:37.732736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4cb5d0ab-48b5-4805-9343-84787f45caa4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:37.733865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4cb5d0ab-48b5-4805-9343-84787f45caa4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:37.749170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cb5d0ab-48b5-4805-9343-84787f45caa4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:37.749942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cb5d0ab-48b5-4805-9343-84787f45caa4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:37.750546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cb5d0ab-48b5-4805-9343-84787f45caa4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:37.751573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cb5d0ab-48b5-4805-9343-84787f45caa4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:37.752194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cb5d0ab-48b5-4805-9343-84787f45caa4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:37.752809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cb5d0ab-48b5-4805-9343-84787f45caa4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:37.818158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5136435b-e583-4c39-ba66-3d7c0b6f0bdd tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:37.834212 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5136435b-e583-4c39-ba66-3d7c0b6f0bdd tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1502 microversion: 2.1 time: 0.677604 Oct 04 21:07:37.834861 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 260/504] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:37 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1502 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:37.849337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-0a8d92f3-6cb8-46d2-8563-94e011054d4c req-56511439-826c-4d4c-9831-b23f4d70dc47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392b3ca2-cc0a-44ae-b791-b8d6043f54e8", "name": "network-vif-unplugged", "status": "completed", "tag": "a1c5c085-0f1e-46fd-868c-bc3dc886b2fa"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:37.863801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0a8d92f3-6cb8-46d2-8563-94e011054d4c req-56511439-826c-4d4c-9831-b23f4d70dc47 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:37.870229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0a8d92f3-6cb8-46d2-8563-94e011054d4c req-56511439-826c-4d4c-9831-b23f4d70dc47 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:37.870758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0a8d92f3-6cb8-46d2-8563-94e011054d4c req-56511439-826c-4d4c-9831-b23f4d70dc47 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:37.890607 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-0a8d92f3-6cb8-46d2-8563-94e011054d4c req-56511439-826c-4d4c-9831-b23f4d70dc47 service nova] Creating event network-vif-unplugged:a1c5c085-0f1e-46fd-868c-bc3dc886b2fa for instance 392b3ca2-cc0a-44ae-b791-b8d6043f54e8 on n-h2-860282-1 Oct 04 21:07:37.896914 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-0a8d92f3-6cb8-46d2-8563-94e011054d4c req-56511439-826c-4d4c-9831-b23f4d70dc47 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060602 Oct 04 21:07:37.897063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4cb5d0ab-48b5-4805-9343-84787f45caa4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:37.898045 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 261/505] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:37.904947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-38f1330c-664f-4123-b5f8-5259b1312dea tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:37.905837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-38f1330c-664f-4123-b5f8-5259b1312dea tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:37.911092 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4cb5d0ab-48b5-4805-9343-84787f45caa4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 200 len: 1287 microversion: 2.1 time: 0.185216 Oct 04 21:07:37.916431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38f1330c-664f-4123-b5f8-5259b1312dea tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:37.916997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38f1330c-664f-4123-b5f8-5259b1312dea tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:37.917465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38f1330c-664f-4123-b5f8-5259b1312dea tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:37.918218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38f1330c-664f-4123-b5f8-5259b1312dea tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:37.923569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38f1330c-664f-4123-b5f8-5259b1312dea tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:37.923569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38f1330c-664f-4123-b5f8-5259b1312dea tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:37.937791 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 245/506] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:37 2022] GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 1287 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:37.944354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d2dcef7f-da1f-458e-8933-0c1f770a3dfa tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:37.946569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d2dcef7f-da1f-458e-8933-0c1f770a3dfa tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:37.990993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2dcef7f-da1f-458e-8933-0c1f770a3dfa tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:37.994750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2dcef7f-da1f-458e-8933-0c1f770a3dfa tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:37.995302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2dcef7f-da1f-458e-8933-0c1f770a3dfa tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:37.997805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2dcef7f-da1f-458e-8933-0c1f770a3dfa tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:38.004547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2dcef7f-da1f-458e-8933-0c1f770a3dfa tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:38.005589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2dcef7f-da1f-458e-8933-0c1f770a3dfa tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:38.238231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-38f1330c-664f-4123-b5f8-5259b1312dea tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:38.258357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-38f1330c-664f-4123-b5f8-5259b1312dea tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:38.267222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-38f1330c-664f-4123-b5f8-5259b1312dea tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:38.273854 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-38f1330c-664f-4123-b5f8-5259b1312dea tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1354 microversion: 2.75 time: 0.374247 Oct 04 21:07:38.290231 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 262/507] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:37 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1354 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:38.302579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1721645e-b786-4f8d-8f3e-234cb5d61c95 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:38.303489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1721645e-b786-4f8d-8f3e-234cb5d61c95 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:38.311819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1721645e-b786-4f8d-8f3e-234cb5d61c95 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:38.312576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1721645e-b786-4f8d-8f3e-234cb5d61c95 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:38.318358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1721645e-b786-4f8d-8f3e-234cb5d61c95 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:38.318358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1721645e-b786-4f8d-8f3e-234cb5d61c95 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:38.318358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1721645e-b786-4f8d-8f3e-234cb5d61c95 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:38.318358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1721645e-b786-4f8d-8f3e-234cb5d61c95 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:38.952453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1721645e-b786-4f8d-8f3e-234cb5d61c95 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:38.964013 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1721645e-b786-4f8d-8f3e-234cb5d61c95 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 200 len: 1319 microversion: 2.1 time: 0.671847 Oct 04 21:07:38.985614 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 263/508] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:38 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 1319 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:38.994004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a31d2576-4853-459c-b11f-12527028d920 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:38.996019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a31d2576-4853-459c-b11f-12527028d920 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:39.004201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a31d2576-4853-459c-b11f-12527028d920 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:39.005988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a31d2576-4853-459c-b11f-12527028d920 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:39.006657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a31d2576-4853-459c-b11f-12527028d920 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:39.007800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a31d2576-4853-459c-b11f-12527028d920 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:39.008864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a31d2576-4853-459c-b11f-12527028d920 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:39.009509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a31d2576-4853-459c-b11f-12527028d920 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:39.106814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d2dcef7f-da1f-458e-8933-0c1f770a3dfa tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:39.126282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d2dcef7f-da1f-458e-8933-0c1f770a3dfa tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:39.145580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d2dcef7f-da1f-458e-8933-0c1f770a3dfa tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:39.151298 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d2dcef7f-da1f-458e-8933-0c1f770a3dfa tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1569 microversion: 2.25 time: 1.211970 Oct 04 21:07:39.152886 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 246/509] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:37 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1569 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:39.171173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b7d70e50-6e85-486b-987c-bdad27af0e06 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:39.173124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b7d70e50-6e85-486b-987c-bdad27af0e06 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:39.201326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7d70e50-6e85-486b-987c-bdad27af0e06 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:39.203044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7d70e50-6e85-486b-987c-bdad27af0e06 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:39.210303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7d70e50-6e85-486b-987c-bdad27af0e06 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:39.210303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7d70e50-6e85-486b-987c-bdad27af0e06 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:39.210303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7d70e50-6e85-486b-987c-bdad27af0e06 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:39.210303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7d70e50-6e85-486b-987c-bdad27af0e06 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:39.707948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b7d70e50-6e85-486b-987c-bdad27af0e06 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:39.718028 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b7d70e50-6e85-486b-987c-bdad27af0e06 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 200 len: 1275 microversion: 2.1 time: 0.563395 Oct 04 21:07:39.763338 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 247/510] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:39 2022] GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 1275 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:39.783059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab396639-f8bf-4206-8b80-ca500c3030a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:39.783059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ab396639-f8bf-4206-8b80-ca500c3030a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:39.793257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab396639-f8bf-4206-8b80-ca500c3030a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:39.795061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab396639-f8bf-4206-8b80-ca500c3030a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:39.795757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab396639-f8bf-4206-8b80-ca500c3030a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:39.797449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab396639-f8bf-4206-8b80-ca500c3030a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:39.798129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab396639-f8bf-4206-8b80-ca500c3030a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:39.799454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab396639-f8bf-4206-8b80-ca500c3030a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:39.844854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a31d2576-4853-459c-b11f-12527028d920 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:39.854314 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a31d2576-4853-459c-b11f-12527028d920 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1492 microversion: 2.1 time: 0.867129 Oct 04 21:07:39.854891 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 264/511] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:38 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1492 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:39.884332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d42bcb4e-6e98-431b-885c-f17db1858739 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '.version_select at 0x7f57908eb5e0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:39.891940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d42bcb4e-6e98-431b-885c-f17db1858739 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:39.893495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d42bcb4e-6e98-431b-885c-f17db1858739 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:39.894283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d42bcb4e-6e98-431b-885c-f17db1858739 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:39.945802 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d42bcb4e-6e98-431b-885c-f17db1858739 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 780 microversion: 2.1 time: 0.066611 Oct 04 21:07:39.948278 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 265/512] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Oct 4 21:07:39 2022] GET /compute/v2.1/os-migrations => generated 780 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:39.962271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-2b81804d-15d5-4764-8edc-2149cef2248a req-518a7169-230c-48ef-a42c-446e2f637b92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "392b3ca2-cc0a-44ae-b791-b8d6043f54e8", "tag": "a1c5c085-0f1e-46fd-868c-bc3dc886b2fa"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:40.015828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2b81804d-15d5-4764-8edc-2149cef2248a req-518a7169-230c-48ef-a42c-446e2f637b92 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:40.016418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2b81804d-15d5-4764-8edc-2149cef2248a req-518a7169-230c-48ef-a42c-446e2f637b92 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:40.017042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2b81804d-15d5-4764-8edc-2149cef2248a req-518a7169-230c-48ef-a42c-446e2f637b92 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:40.043692 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-2b81804d-15d5-4764-8edc-2149cef2248a req-518a7169-230c-48ef-a42c-446e2f637b92 service nova] Creating event network-changed:a1c5c085-0f1e-46fd-868c-bc3dc886b2fa for instance 392b3ca2-cc0a-44ae-b791-b8d6043f54e8 on n-h2-860282-1 Oct 04 21:07:40.051347 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-2b81804d-15d5-4764-8edc-2149cef2248a req-518a7169-230c-48ef-a42c-446e2f637b92 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099345 Oct 04 21:07:40.052538 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 266/513] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:40.058967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c8d27a76-ab79-4f0b-a289-3f01003faa4c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:40.060946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c8d27a76-ab79-4f0b-a289-3f01003faa4c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:40.069747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8d27a76-ab79-4f0b-a289-3f01003faa4c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:40.072215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8d27a76-ab79-4f0b-a289-3f01003faa4c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:40.072215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8d27a76-ab79-4f0b-a289-3f01003faa4c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:40.072649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8d27a76-ab79-4f0b-a289-3f01003faa4c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:40.073267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8d27a76-ab79-4f0b-a289-3f01003faa4c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:40.074604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8d27a76-ab79-4f0b-a289-3f01003faa4c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:40.096704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ab396639-f8bf-4206-8b80-ca500c3030a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:40.116835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ab396639-f8bf-4206-8b80-ca500c3030a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:40.119240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ab396639-f8bf-4206-8b80-ca500c3030a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:40.130198 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ab396639-f8bf-4206-8b80-ca500c3030a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1428 microversion: 2.75 time: 0.365168 Oct 04 21:07:40.134593 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 248/514] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:39 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1428 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:40.150138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fa8768a3-fe71-43e5-a1ed-0ad3b6189a29 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:40.151064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fa8768a3-fe71-43e5-a1ed-0ad3b6189a29 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:40.165017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa8768a3-fe71-43e5-a1ed-0ad3b6189a29 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:40.165850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa8768a3-fe71-43e5-a1ed-0ad3b6189a29 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:40.166927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa8768a3-fe71-43e5-a1ed-0ad3b6189a29 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:40.169229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa8768a3-fe71-43e5-a1ed-0ad3b6189a29 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:40.170979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa8768a3-fe71-43e5-a1ed-0ad3b6189a29 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:40.171579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa8768a3-fe71-43e5-a1ed-0ad3b6189a29 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:40.207989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:40.906092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fa8768a3-fe71-43e5-a1ed-0ad3b6189a29 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:40.924273 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fa8768a3-fe71-43e5-a1ed-0ad3b6189a29 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 200 len: 1319 microversion: 2.1 time: 0.788295 Oct 04 21:07:40.924874 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 249/515] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:40 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 1319 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:40.940014 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c8d27a76-ab79-4f0b-a289-3f01003faa4c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1643 microversion: 2.1 time: 0.885979 Oct 04 21:07:40.942009 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 267/516] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:40 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1643 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:40.952547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-299d1ade-91a8-4bf7-9c97-697ba2eac443 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:40.957120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-60d5e2c9-4203-4461-b4e3-0d92d359d94d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:40.957765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-60d5e2c9-4203-4461-b4e3-0d92d359d94d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:40.958154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-299d1ade-91a8-4bf7-9c97-697ba2eac443 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:40.970813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60d5e2c9-4203-4461-b4e3-0d92d359d94d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:40.971325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60d5e2c9-4203-4461-b4e3-0d92d359d94d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:40.974085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-299d1ade-91a8-4bf7-9c97-697ba2eac443 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:40.974085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-299d1ade-91a8-4bf7-9c97-697ba2eac443 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:40.974085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-299d1ade-91a8-4bf7-9c97-697ba2eac443 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:40.975063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60d5e2c9-4203-4461-b4e3-0d92d359d94d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:40.976769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-299d1ade-91a8-4bf7-9c97-697ba2eac443 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:40.977009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60d5e2c9-4203-4461-b4e3-0d92d359d94d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:40.977662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60d5e2c9-4203-4461-b4e3-0d92d359d94d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:40.978768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60d5e2c9-4203-4461-b4e3-0d92d359d94d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:40.979149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-299d1ade-91a8-4bf7-9c97-697ba2eac443 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:40.980321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-299d1ade-91a8-4bf7-9c97-697ba2eac443 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:41.452589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-299d1ade-91a8-4bf7-9c97-697ba2eac443 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:41.471067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-60d5e2c9-4203-4461-b4e3-0d92d359d94d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:41.479230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-299d1ade-91a8-4bf7-9c97-697ba2eac443 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:41.483696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-299d1ade-91a8-4bf7-9c97-697ba2eac443 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:41.486749 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-299d1ade-91a8-4bf7-9c97-697ba2eac443 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1569 microversion: 2.25 time: 0.545208 Oct 04 21:07:41.490254 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-60d5e2c9-4203-4461-b4e3-0d92d359d94d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 200 len: 1317 microversion: 2.1 time: 0.544130 Oct 04 21:07:41.491230 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 268/517] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:40 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1569 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:41.514806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-43be4c97-06c7-45a3-b247-26354cfb9d49 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:41.517207 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 250/518] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:40 2022] GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 1317 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:41.538391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-43be4c97-06c7-45a3-b247-26354cfb9d49 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:41.538667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ffb2c91d-3ebf-408c-9347-3483a8a47701 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-614807896", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "324f5d32-9535-4c31-8532-24f98392bc42"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:41.555863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43be4c97-06c7-45a3-b247-26354cfb9d49 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:41.556366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43be4c97-06c7-45a3-b247-26354cfb9d49 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:41.556930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43be4c97-06c7-45a3-b247-26354cfb9d49 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:41.559365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43be4c97-06c7-45a3-b247-26354cfb9d49 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:41.564312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43be4c97-06c7-45a3-b247-26354cfb9d49 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:41.565000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43be4c97-06c7-45a3-b247-26354cfb9d49 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:41.621499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:41.674949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-ffb2c91d-3ebf-408c-9347-3483a8a47701 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] validate_networks() for [('324f5d32-9535-4c31-8532-24f98392bc42', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:07:41.751227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-43be4c97-06c7-45a3-b247-26354cfb9d49 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:41.767680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-43be4c97-06c7-45a3-b247-26354cfb9d49 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:41.770995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-43be4c97-06c7-45a3-b247-26354cfb9d49 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:41.779576 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-43be4c97-06c7-45a3-b247-26354cfb9d49 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1416 microversion: 2.75 time: 0.285956 Oct 04 21:07:41.784870 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 269/519] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:41 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1416 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:41.954313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-81080f3a-c149-4b99-b284-dd2c9c383301 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:41.954313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-81080f3a-c149-4b99-b284-dd2c9c383301 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:41.969250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81080f3a-c149-4b99-b284-dd2c9c383301 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:41.969921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81080f3a-c149-4b99-b284-dd2c9c383301 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:41.970342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81080f3a-c149-4b99-b284-dd2c9c383301 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:41.971274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81080f3a-c149-4b99-b284-dd2c9c383301 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:41.971730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81080f3a-c149-4b99-b284-dd2c9c383301 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:41.972346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81080f3a-c149-4b99-b284-dd2c9c383301 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:42.282110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-81080f3a-c149-4b99-b284-dd2c9c383301 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:42.321827 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-81080f3a-c149-4b99-b284-dd2c9c383301 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 200 len: 1319 microversion: 2.1 time: 0.374503 Oct 04 21:07:42.325362 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 270/520] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:41 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:42.338638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-2276e0a5-8c3c-4f52-a55b-0a1ef544a165 req-584f00cb-a559-48f9-aa17-cb84fa00a60d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3626e794-7b5c-40a7-b2af-07101d77ce62", "tag": "cfa799aa-808a-473d-b542-399f3d0868b2"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:42.373669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2276e0a5-8c3c-4f52-a55b-0a1ef544a165 req-584f00cb-a559-48f9-aa17-cb84fa00a60d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:42.375159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2276e0a5-8c3c-4f52-a55b-0a1ef544a165 req-584f00cb-a559-48f9-aa17-cb84fa00a60d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:42.376979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2276e0a5-8c3c-4f52-a55b-0a1ef544a165 req-584f00cb-a559-48f9-aa17-cb84fa00a60d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:42.409498 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-2276e0a5-8c3c-4f52-a55b-0a1ef544a165 req-584f00cb-a559-48f9-aa17-cb84fa00a60d service nova] Creating event network-changed:cfa799aa-808a-473d-b542-399f3d0868b2 for instance 3626e794-7b5c-40a7-b2af-07101d77ce62 on n-h2-860282-1 Oct 04 21:07:42.438408 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-2276e0a5-8c3c-4f52-a55b-0a1ef544a165 req-584f00cb-a559-48f9-aa17-cb84fa00a60d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103675 Oct 04 21:07:42.440046 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 271/521] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:42.460756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ffb2c91d-3ebf-408c-9347-3483a8a47701 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:07:42.461759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ffb2c91d-3ebf-408c-9347-3483a8a47701 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:07:42.462326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ffb2c91d-3ebf-408c-9347-3483a8a47701 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:07:42.462745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ffb2c91d-3ebf-408c-9347-3483a8a47701 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:07:42.463377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ffb2c91d-3ebf-408c-9347-3483a8a47701 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:07:42.481522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ffb2c91d-3ebf-408c-9347-3483a8a47701 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:42.483425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ffb2c91d-3ebf-408c-9347-3483a8a47701 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:42.484192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ffb2c91d-3ebf-408c-9347-3483a8a47701 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:42.485526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ffb2c91d-3ebf-408c-9347-3483a8a47701 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:42.486151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ffb2c91d-3ebf-408c-9347-3483a8a47701 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:42.486853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ffb2c91d-3ebf-408c-9347-3483a8a47701 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:42.548113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-ffb2c91d-3ebf-408c-9347-3483a8a47701 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Getting quotas for project 7e9215d1ae0947ce84469bed21fc05ac. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:42.558360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-ffb2c91d-3ebf-408c-9347-3483a8a47701 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Getting quotas for user 8bfa449eb3144332afa616cc85d9643f and project 7e9215d1ae0947ce84469bed21fc05ac. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:42.599205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ffb2c91d-3ebf-408c-9347-3483a8a47701 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:07:42.601599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ffb2c91d-3ebf-408c-9347-3483a8a47701 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:07:42.704337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa7bdce4-6ca4-456c-b2e8-1596024885af tempest-FloatingIPDetailsNegativeTestJSON-1265937188 tempest-FloatingIPDetailsNegativeTestJSON-1265937188-project] Calling method '.version_select at 0x7f579086e820>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:42.777071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG neutronclient.v2_0.client [None req-aa7bdce4-6ca4-456c-b2e8-1596024885af tempest-FloatingIPDetailsNegativeTestJSON-1265937188 tempest-FloatingIPDetailsNegativeTestJSON-1265937188-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0f0f3a4c-8e4d-4282-8b39-a1e4459b0e26 could not be found", "detail": ""}} {{(pid=122758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:07:42.777860 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-aa7bdce4-6ca4-456c-b2e8-1596024885af tempest-FloatingIPDetailsNegativeTestJSON-1265937188 tempest-FloatingIPDetailsNegativeTestJSON-1265937188-project] HTTP exception thrown: Floating IP not found for ID 0f0f3a4c-8e4d-4282-8b39-a1e4459b0e26 Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa7bdce4-6ca4-456c-b2e8-1596024885af tempest-FloatingIPDetailsNegativeTestJSON-1265937188 tempest-FloatingIPDetailsNegativeTestJSON-1265937188-project] Request method failure captured: Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-floating-ips/0f0f3a4c-8e4d-4282-8b39-a1e4459b0e26 HTTP/1.1 Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKCeIDToWACNLrHtCIRJlhqe_BbNxZrsZA8qtshaxtTtMKKCKag1_qgWlohmEJGmLvgJymRe-dQdUtHxmwcfnl85PhHm8kJDmf44sFLWMC65dCU4bvHldfiT4r6pltwzRILiDdcWxOztMDrBbYbCkVL7Z7Opx59em0Wj9YdrmRK49f8 Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 78e77d9486c04a22bb353f18b6b68f5b Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1265937188 Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:07:42.792193 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:07:42.793597 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/78e77d9486c04a22bb353f18b6b68f5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_78e77d9486c04a22bb353f18b6b68f5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/78e77d9486c04a22bb353f18b6b68f5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/78e77d9486c04a22bb353f18b6b68f5b"}]}] Oct 04 21:07:42.793597 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1265937188 Oct 04 21:07:42.793597 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 78e77d9486c04a22bb353f18b6b68f5b Oct 04 21:07:42.793597 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1265937188 Oct 04 21:07:42.793597 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1265937188-project Oct 04 21:07:42.793597 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:07:42.793597 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:07:42.793597 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: b76ecfe9f2744fd78ec7c4e332956df4 Oct 04 21:07:42.793597 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1265937188-project Oct 04 21:07:42.793597 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:07:42.793597 n-d-860282-1 devstack@n-api.service[122758]: exception: Floating IP not found for ID 0f0f3a4c-8e4d-4282-8b39-a1e4459b0e26 Oct 04 21:07:42.793597 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '0f0f3a4c-8e4d-4282-8b39-a1e4459b0e26'} Oct 04 21:07:42.795977 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:42.795977 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:42.795977 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 21:07:42.795977 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 21:07:42.795977 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:07:42.795977 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:07:42.795977 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 21:07:42.795977 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 21:07:42.795977 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:07:42.795977 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:07:42.795977 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:07:42.795977 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:07:42.795977 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:07:42.795977 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:07:42.795977 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:07:42.795977 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:07:42.795977 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:07:42.795977 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:07:42.795977 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:07:42.797330 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:07:42.797330 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:07:42.797330 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:07:42.797330 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:07:42.797330 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:07:42.797330 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:07:42.797330 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:07:42.797330 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0f0f3a4c-8e4d-4282-8b39-a1e4459b0e26 could not be found Oct 04 21:07:42.797330 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87ef3842-4285-4f98-9c45-cc8207e111ed'] Oct 04 21:07:42.797330 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:42.797330 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:42.797330 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:42.797330 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:42.797330 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 21:07:42.797330 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 21:07:42.797330 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 21:07:42.797330 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 21:07:42.797330 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0f0f3a4c-8e4d-4282-8b39-a1e4459b0e26. Oct 04 21:07:42.797330 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0f0f3a4c-8e4d-4282-8b39-a1e4459b0e26 Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:42.798750 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:42.800198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:42.800198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0f0f3a4c-8e4d-4282-8b39-a1e4459b0e26 Oct 04 21:07:42.800198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:42.802172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa7bdce4-6ca4-456c-b2e8-1596024885af tempest-FloatingIPDetailsNegativeTestJSON-1265937188 tempest-FloatingIPDetailsNegativeTestJSON-1265937188-project] Returning 404 to user: Floating IP not found for ID 0f0f3a4c-8e4d-4282-8b39-a1e4459b0e26 {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:42.803270 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aa7bdce4-6ca4-456c-b2e8-1596024885af tempest-FloatingIPDetailsNegativeTestJSON-1265937188 tempest-FloatingIPDetailsNegativeTestJSON-1265937188-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/0f0f3a4c-8e4d-4282-8b39-a1e4459b0e26" status: 404 len: 111 microversion: 2.1 time: 0.361138 Oct 04 21:07:42.811809 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 272/522] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Oct 4 21:07:42 2022] GET /compute/v2.1/os-floating-ips/0f0f3a4c-8e4d-4282-8b39-a1e4459b0e26 => generated 111 bytes in 365 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:07:42.817951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9868be87-6380-445d-be77-6b3fb681cb20 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:42.821630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9868be87-6380-445d-be77-6b3fb681cb20 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:42.828302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9868be87-6380-445d-be77-6b3fb681cb20 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:42.829070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9868be87-6380-445d-be77-6b3fb681cb20 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:42.829752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9868be87-6380-445d-be77-6b3fb681cb20 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:42.830673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9868be87-6380-445d-be77-6b3fb681cb20 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:42.831292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9868be87-6380-445d-be77-6b3fb681cb20 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:42.831889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9868be87-6380-445d-be77-6b3fb681cb20 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:42.864725 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ffb2c91d-3ebf-408c-9347-3483a8a47701 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.343889 Oct 04 21:07:42.866099 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 251/523] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:07:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:07:42.883139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-79f863dc-200f-447c-894b-07aa7458cc57 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:42.883783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-79f863dc-200f-447c-894b-07aa7458cc57 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:42.906806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79f863dc-200f-447c-894b-07aa7458cc57 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:42.907944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79f863dc-200f-447c-894b-07aa7458cc57 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:42.909076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79f863dc-200f-447c-894b-07aa7458cc57 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:42.909696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79f863dc-200f-447c-894b-07aa7458cc57 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:42.909906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79f863dc-200f-447c-894b-07aa7458cc57 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:42.910337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79f863dc-200f-447c-894b-07aa7458cc57 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:43.156826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9868be87-6380-445d-be77-6b3fb681cb20 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:43.175438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9868be87-6380-445d-be77-6b3fb681cb20 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:43.176443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9868be87-6380-445d-be77-6b3fb681cb20 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:43.184858 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9868be87-6380-445d-be77-6b3fb681cb20 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1569 microversion: 2.25 time: 0.371121 Oct 04 21:07:43.197930 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 273/524] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:42 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1569 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:43.219384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b1f2fee9-aa5d-47c5-bbc9-8aa77015bdc6 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:43.221080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b1f2fee9-aa5d-47c5-bbc9-8aa77015bdc6 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:43.230898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-79f863dc-200f-447c-894b-07aa7458cc57 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:43.243609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1f2fee9-aa5d-47c5-bbc9-8aa77015bdc6 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:43.243987 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-79f863dc-200f-447c-894b-07aa7458cc57 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 200 len: 1317 microversion: 2.1 time: 0.374255 Oct 04 21:07:43.244721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1f2fee9-aa5d-47c5-bbc9-8aa77015bdc6 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:43.245821 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 252/525] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:42 2022] GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:43.246456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1f2fee9-aa5d-47c5-bbc9-8aa77015bdc6 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:43.252108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1f2fee9-aa5d-47c5-bbc9-8aa77015bdc6 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:43.254107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1f2fee9-aa5d-47c5-bbc9-8aa77015bdc6 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:43.255542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1f2fee9-aa5d-47c5-bbc9-8aa77015bdc6 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:43.262407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-376befe0-5204-4250-b7f3-c037e910f9ff tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:43.265035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-376befe0-5204-4250-b7f3-c037e910f9ff tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:43.299773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=45 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:43.339303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-376befe0-5204-4250-b7f3-c037e910f9ff tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:43.347692 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-376befe0-5204-4250-b7f3-c037e910f9ff tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1210 microversion: 2.1 time: 0.098217 Oct 04 21:07:43.348671 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 253/526] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:43 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:43.353378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-35dca632-3d52-41f2-b7dc-57c6b1a6c30b req-26848819-b1a9-4826-9472-c080c7358f33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f201296c-ba54-4f1e-984a-461dfe55d267", "tag": "1a0e3523-2e2d-43b0-a14b-d80fa3c131ff"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:43.364767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-35dca632-3d52-41f2-b7dc-57c6b1a6c30b req-26848819-b1a9-4826-9472-c080c7358f33 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:43.366610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-35dca632-3d52-41f2-b7dc-57c6b1a6c30b req-26848819-b1a9-4826-9472-c080c7358f33 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:43.371413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-35dca632-3d52-41f2-b7dc-57c6b1a6c30b req-26848819-b1a9-4826-9472-c080c7358f33 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:43.380451 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-35dca632-3d52-41f2-b7dc-57c6b1a6c30b req-26848819-b1a9-4826-9472-c080c7358f33 service nova] Creating event network-changed:1a0e3523-2e2d-43b0-a14b-d80fa3c131ff for instance f201296c-ba54-4f1e-984a-461dfe55d267 on n-h2-860282-1 Oct 04 21:07:43.394217 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-35dca632-3d52-41f2-b7dc-57c6b1a6c30b req-26848819-b1a9-4826-9472-c080c7358f33 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043982 Oct 04 21:07:43.396704 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 254/527] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:43.396925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b1f2fee9-aa5d-47c5-bbc9-8aa77015bdc6 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:43.411920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6a59f449-6adc-4ad9-9262-fce60464a501 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:43.412149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6a59f449-6adc-4ad9-9262-fce60464a501 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:43.416445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b1f2fee9-aa5d-47c5-bbc9-8aa77015bdc6 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:43.418589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a59f449-6adc-4ad9-9262-fce60464a501 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:43.419319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a59f449-6adc-4ad9-9262-fce60464a501 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:43.419969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a59f449-6adc-4ad9-9262-fce60464a501 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:43.420838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a59f449-6adc-4ad9-9262-fce60464a501 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:43.421535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a59f449-6adc-4ad9-9262-fce60464a501 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:43.422115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a59f449-6adc-4ad9-9262-fce60464a501 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:43.427556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b1f2fee9-aa5d-47c5-bbc9-8aa77015bdc6 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:43.435527 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b1f2fee9-aa5d-47c5-bbc9-8aa77015bdc6 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1437 microversion: 2.75 time: 0.231671 Oct 04 21:07:43.439231 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 274/528] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:43 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1437 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:43.464157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:43.469651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:43.476911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:43.477955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:43.478554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:43.479320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:43.479923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:43.480657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:43.597351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:07:43.597711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:07:43.598183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:07:43.599198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:07:43.599198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:07:43.701195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6a59f449-6adc-4ad9-9262-fce60464a501 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:43.709670 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6a59f449-6adc-4ad9-9262-fce60464a501 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 200 len: 1319 microversion: 2.1 time: 0.311698 Oct 04 21:07:43.711083 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 255/529] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:43 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:43.944644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:43.951865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:43.952400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:43.953019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:43.954026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:43.954492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:43.955261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:44.040947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:44.053121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:44.055350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:44.064795 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c5f982d2-0a05-4f92-8d18-c590bee56326 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "POST /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206/action" status: 202 len: 1494 microversion: 2.75 time: 0.603880 Oct 04 21:07:44.068560 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 275/530] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Oct 4 21:07:43 2022] POST /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206/action => generated 1494 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 04 21:07:44.095278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-20b860e2-449b-47c1-9539-74408af6ab17 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:44.096902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-20b860e2-449b-47c1-9539-74408af6ab17 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:44.104438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20b860e2-449b-47c1-9539-74408af6ab17 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:44.105316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20b860e2-449b-47c1-9539-74408af6ab17 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:44.105885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20b860e2-449b-47c1-9539-74408af6ab17 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:44.106846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20b860e2-449b-47c1-9539-74408af6ab17 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:44.107631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20b860e2-449b-47c1-9539-74408af6ab17 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:44.108081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20b860e2-449b-47c1-9539-74408af6ab17 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:44.212223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-367bb8c6-1827-4c00-97db-1758754f52d7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:44.212861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-367bb8c6-1827-4c00-97db-1758754f52d7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:44.247069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-367bb8c6-1827-4c00-97db-1758754f52d7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:44.258834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-367bb8c6-1827-4c00-97db-1758754f52d7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:44.259455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-367bb8c6-1827-4c00-97db-1758754f52d7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:44.260235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-367bb8c6-1827-4c00-97db-1758754f52d7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:44.260722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-367bb8c6-1827-4c00-97db-1758754f52d7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:44.261161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-367bb8c6-1827-4c00-97db-1758754f52d7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:44.286727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-20b860e2-449b-47c1-9539-74408af6ab17 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:44.318612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-20b860e2-449b-47c1-9539-74408af6ab17 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:44.320643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-20b860e2-449b-47c1-9539-74408af6ab17 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:44.342384 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-20b860e2-449b-47c1-9539-74408af6ab17 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.248413 Oct 04 21:07:44.347020 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 256/531] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:44 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:44.382010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-66f54f56-5c4f-46d2-8805-8703d35ea26d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:44.382010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-66f54f56-5c4f-46d2-8805-8703d35ea26d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:44.404642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66f54f56-5c4f-46d2-8805-8703d35ea26d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:44.407625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66f54f56-5c4f-46d2-8805-8703d35ea26d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:44.408768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66f54f56-5c4f-46d2-8805-8703d35ea26d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:44.409743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66f54f56-5c4f-46d2-8805-8703d35ea26d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:44.410386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66f54f56-5c4f-46d2-8805-8703d35ea26d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:44.411730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66f54f56-5c4f-46d2-8805-8703d35ea26d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:44.636693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-367bb8c6-1827-4c00-97db-1758754f52d7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:44.664293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-367bb8c6-1827-4c00-97db-1758754f52d7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:44.669991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-367bb8c6-1827-4c00-97db-1758754f52d7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:44.674594 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-367bb8c6-1827-4c00-97db-1758754f52d7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1569 microversion: 2.25 time: 0.466201 Oct 04 21:07:44.693774 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 276/532] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:44 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1569 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:44.712349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-94067473-9170-46b9-b6f5-f184f417c69a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:44.712989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-94067473-9170-46b9-b6f5-f184f417c69a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:44.725120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94067473-9170-46b9-b6f5-f184f417c69a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:44.725722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94067473-9170-46b9-b6f5-f184f417c69a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:44.726207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94067473-9170-46b9-b6f5-f184f417c69a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:44.728597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94067473-9170-46b9-b6f5-f184f417c69a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:44.729223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94067473-9170-46b9-b6f5-f184f417c69a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:44.730772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94067473-9170-46b9-b6f5-f184f417c69a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:44.784272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-66f54f56-5c4f-46d2-8805-8703d35ea26d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:44.807060 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-66f54f56-5c4f-46d2-8805-8703d35ea26d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 200 len: 1317 microversion: 2.1 time: 0.450981 Oct 04 21:07:44.817687 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 257/533] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:44 2022] GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 1317 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:44.824950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dbac87e2-564b-4e18-bce1-3ba51ed8f3db tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:44.825922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dbac87e2-564b-4e18-bce1-3ba51ed8f3db tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:44.846972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbac87e2-564b-4e18-bce1-3ba51ed8f3db tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:44.850801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbac87e2-564b-4e18-bce1-3ba51ed8f3db tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:44.854174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbac87e2-564b-4e18-bce1-3ba51ed8f3db tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:44.855038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbac87e2-564b-4e18-bce1-3ba51ed8f3db tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:44.855533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbac87e2-564b-4e18-bce1-3ba51ed8f3db tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:44.857342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbac87e2-564b-4e18-bce1-3ba51ed8f3db tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:44.928722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-94067473-9170-46b9-b6f5-f184f417c69a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:44.957011 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-94067473-9170-46b9-b6f5-f184f417c69a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1206 microversion: 2.1 time: 0.258579 Oct 04 21:07:44.958420 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 277/534] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:44 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1206 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:45.329135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dbac87e2-564b-4e18-bce1-3ba51ed8f3db tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:45.349639 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dbac87e2-564b-4e18-bce1-3ba51ed8f3db tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 200 len: 1319 microversion: 2.1 time: 0.530397 Oct 04 21:07:45.355755 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 258/535] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:44 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 1319 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:45.381057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2af55d76-04ba-4f02-aaec-ed9352b7f4e5 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:45.382033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2af55d76-04ba-4f02-aaec-ed9352b7f4e5 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:45.393295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2af55d76-04ba-4f02-aaec-ed9352b7f4e5 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:45.394150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2af55d76-04ba-4f02-aaec-ed9352b7f4e5 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:45.394833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2af55d76-04ba-4f02-aaec-ed9352b7f4e5 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:45.395824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2af55d76-04ba-4f02-aaec-ed9352b7f4e5 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:45.396502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2af55d76-04ba-4f02-aaec-ed9352b7f4e5 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:45.397372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2af55d76-04ba-4f02-aaec-ed9352b7f4e5 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:45.479128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4eb337a5-7051-469c-8905-b6f41ff43dfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-276020586", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:45.507383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2af55d76-04ba-4f02-aaec-ed9352b7f4e5 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:45.524911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2af55d76-04ba-4f02-aaec-ed9352b7f4e5 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:45.527121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2af55d76-04ba-4f02-aaec-ed9352b7f4e5 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:45.536498 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2af55d76-04ba-4f02-aaec-ed9352b7f4e5 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.164007 Oct 04 21:07:45.537592 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 259/536] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:45 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:07:45.589404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-4eb337a5-7051-469c-8905-b6f41ff43dfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:07:45.708588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c5f78d27-50ed-4b48-a125-ab5b8dec3379 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:45.709593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c5f78d27-50ed-4b48-a125-ab5b8dec3379 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:45.718709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5f78d27-50ed-4b48-a125-ab5b8dec3379 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:45.719841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5f78d27-50ed-4b48-a125-ab5b8dec3379 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:45.720442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5f78d27-50ed-4b48-a125-ab5b8dec3379 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:45.721165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5f78d27-50ed-4b48-a125-ab5b8dec3379 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:45.721648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5f78d27-50ed-4b48-a125-ab5b8dec3379 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:45.722078 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5f78d27-50ed-4b48-a125-ab5b8dec3379 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:45.840495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-4eb337a5-7051-469c-8905-b6f41ff43dfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:07:45.841177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-4eb337a5-7051-469c-8905-b6f41ff43dfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:07:45.841850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-4eb337a5-7051-469c-8905-b6f41ff43dfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:07:45.842593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-4eb337a5-7051-469c-8905-b6f41ff43dfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:07:45.843610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-4eb337a5-7051-469c-8905-b6f41ff43dfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:07:45.854998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4eb337a5-7051-469c-8905-b6f41ff43dfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:45.855895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4eb337a5-7051-469c-8905-b6f41ff43dfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:45.856576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4eb337a5-7051-469c-8905-b6f41ff43dfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:45.857559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4eb337a5-7051-469c-8905-b6f41ff43dfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:45.858202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4eb337a5-7051-469c-8905-b6f41ff43dfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:45.858866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4eb337a5-7051-469c-8905-b6f41ff43dfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:45.888796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-4eb337a5-7051-469c-8905-b6f41ff43dfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Getting quotas for project e11e3d4d14b240a3b934701459ada871. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:45.897742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-4eb337a5-7051-469c-8905-b6f41ff43dfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Getting quotas for user 150625a9472d43e0b0509ef044c58d34 and project e11e3d4d14b240a3b934701459ada871. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:45.926341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4eb337a5-7051-469c-8905-b6f41ff43dfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:07:45.929449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4eb337a5-7051-469c-8905-b6f41ff43dfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:07:45.949256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c5f78d27-50ed-4b48-a125-ab5b8dec3379 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:45.962638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c5f78d27-50ed-4b48-a125-ab5b8dec3379 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:45.964478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c5f78d27-50ed-4b48-a125-ab5b8dec3379 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:45.977085 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c5f78d27-50ed-4b48-a125-ab5b8dec3379 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1569 microversion: 2.25 time: 0.262723 Oct 04 21:07:45.977085 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 260/537] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:45 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1569 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:07:45.977085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1ebaa3bc-61b5-4b50-b548-6e9c9c06a5f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:45.977085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1ebaa3bc-61b5-4b50-b548-6e9c9c06a5f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:45.988334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ebaa3bc-61b5-4b50-b548-6e9c9c06a5f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:45.988836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ebaa3bc-61b5-4b50-b548-6e9c9c06a5f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:45.989278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ebaa3bc-61b5-4b50-b548-6e9c9c06a5f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:45.990013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ebaa3bc-61b5-4b50-b548-6e9c9c06a5f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:45.990476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ebaa3bc-61b5-4b50-b548-6e9c9c06a5f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:45.990905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ebaa3bc-61b5-4b50-b548-6e9c9c06a5f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:46.135496 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4eb337a5-7051-469c-8905-b6f41ff43dfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.828893 Oct 04 21:07:46.143531 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 278/538] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:07:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:07:46.150239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e6c6d38d-e13a-4c5a-a1c6-e34e2d2fda01 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:46.153200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e6c6d38d-e13a-4c5a-a1c6-e34e2d2fda01 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:46.159488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:46.161639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6c6d38d-e13a-4c5a-a1c6-e34e2d2fda01 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:46.162371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6c6d38d-e13a-4c5a-a1c6-e34e2d2fda01 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:46.163555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6c6d38d-e13a-4c5a-a1c6-e34e2d2fda01 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:46.164637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6c6d38d-e13a-4c5a-a1c6-e34e2d2fda01 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:46.165363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6c6d38d-e13a-4c5a-a1c6-e34e2d2fda01 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:46.166022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6c6d38d-e13a-4c5a-a1c6-e34e2d2fda01 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:46.210759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1ebaa3bc-61b5-4b50-b548-6e9c9c06a5f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:46.219656 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1ebaa3bc-61b5-4b50-b548-6e9c9c06a5f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 200 len: 1317 microversion: 2.1 time: 0.247991 Oct 04 21:07:46.220577 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 261/539] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:45 2022] GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:46.236241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-63f387ec-e025-4619-ad62-502f86be1116 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:46.241067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-63f387ec-e025-4619-ad62-502f86be1116 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:46.278276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e6c6d38d-e13a-4c5a-a1c6-e34e2d2fda01 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:46.288411 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e6c6d38d-e13a-4c5a-a1c6-e34e2d2fda01 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1270 microversion: 2.1 time: 0.143256 Oct 04 21:07:46.316446 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 279/540] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:46 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:46.401220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c29b0e1f-ea3c-4647-a844-3a99bfb2a021 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:46.401889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c29b0e1f-ea3c-4647-a844-3a99bfb2a021 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:46.425585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c29b0e1f-ea3c-4647-a844-3a99bfb2a021 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:46.426083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c29b0e1f-ea3c-4647-a844-3a99bfb2a021 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:46.426525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c29b0e1f-ea3c-4647-a844-3a99bfb2a021 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:46.427245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c29b0e1f-ea3c-4647-a844-3a99bfb2a021 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:46.427702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c29b0e1f-ea3c-4647-a844-3a99bfb2a021 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:46.446778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c29b0e1f-ea3c-4647-a844-3a99bfb2a021 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:46.676832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-63f387ec-e025-4619-ad62-502f86be1116 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:46.685907 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-63f387ec-e025-4619-ad62-502f86be1116 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1212 microversion: 2.1 time: 0.463674 Oct 04 21:07:46.707451 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 262/541] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:46 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1212 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:46.713023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9be4e1be-2a82-4d6c-b5dc-cb3e793c6ffe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:46.721923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9be4e1be-2a82-4d6c-b5dc-cb3e793c6ffe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:46.731393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9be4e1be-2a82-4d6c-b5dc-cb3e793c6ffe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:46.732860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9be4e1be-2a82-4d6c-b5dc-cb3e793c6ffe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:46.736498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9be4e1be-2a82-4d6c-b5dc-cb3e793c6ffe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:46.737550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9be4e1be-2a82-4d6c-b5dc-cb3e793c6ffe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:46.743463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9be4e1be-2a82-4d6c-b5dc-cb3e793c6ffe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:46.744199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9be4e1be-2a82-4d6c-b5dc-cb3e793c6ffe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:46.949018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9be4e1be-2a82-4d6c-b5dc-cb3e793c6ffe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:46.961829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9be4e1be-2a82-4d6c-b5dc-cb3e793c6ffe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:46.970192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9be4e1be-2a82-4d6c-b5dc-cb3e793c6ffe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:46.989616 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9be4e1be-2a82-4d6c-b5dc-cb3e793c6ffe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.268341 Oct 04 21:07:46.990511 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 263/542] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:46 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:47.005736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-13484b41-a614-4d24-9b09-2c44f630d9e3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:47.006671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-13484b41-a614-4d24-9b09-2c44f630d9e3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:47.014383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13484b41-a614-4d24-9b09-2c44f630d9e3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:47.015190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13484b41-a614-4d24-9b09-2c44f630d9e3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:47.015818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13484b41-a614-4d24-9b09-2c44f630d9e3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:47.016759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13484b41-a614-4d24-9b09-2c44f630d9e3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:47.017608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13484b41-a614-4d24-9b09-2c44f630d9e3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:47.018251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13484b41-a614-4d24-9b09-2c44f630d9e3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:47.285791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c29b0e1f-ea3c-4647-a844-3a99bfb2a021 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:47.294559 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c29b0e1f-ea3c-4647-a844-3a99bfb2a021 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 200 len: 1319 microversion: 2.1 time: 0.917485 Oct 04 21:07:47.295683 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 280/543] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:46 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 1319 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:47.319065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1d51f6e8-fd7b-4bdf-8b28-f4eb012638bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:47.320022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1d51f6e8-fd7b-4bdf-8b28-f4eb012638bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:47.331478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d51f6e8-fd7b-4bdf-8b28-f4eb012638bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:47.332747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d51f6e8-fd7b-4bdf-8b28-f4eb012638bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:47.335410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d51f6e8-fd7b-4bdf-8b28-f4eb012638bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:47.335410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d51f6e8-fd7b-4bdf-8b28-f4eb012638bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:47.335410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d51f6e8-fd7b-4bdf-8b28-f4eb012638bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:47.335914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d51f6e8-fd7b-4bdf-8b28-f4eb012638bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:47.429494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-13484b41-a614-4d24-9b09-2c44f630d9e3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:47.439865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-13484b41-a614-4d24-9b09-2c44f630d9e3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:47.442099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-13484b41-a614-4d24-9b09-2c44f630d9e3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:47.444083 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-13484b41-a614-4d24-9b09-2c44f630d9e3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1569 microversion: 2.25 time: 0.452197 Oct 04 21:07:47.463061 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 264/544] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:46 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1569 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:47.477170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e49e50ef-7f39-45a2-9400-a5777791b2f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:47.478198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e49e50ef-7f39-45a2-9400-a5777791b2f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:47.491869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e49e50ef-7f39-45a2-9400-a5777791b2f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:47.492789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e49e50ef-7f39-45a2-9400-a5777791b2f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:47.493521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e49e50ef-7f39-45a2-9400-a5777791b2f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:47.494474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e49e50ef-7f39-45a2-9400-a5777791b2f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:47.498344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e49e50ef-7f39-45a2-9400-a5777791b2f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:47.499099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e49e50ef-7f39-45a2-9400-a5777791b2f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:47.966580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e49e50ef-7f39-45a2-9400-a5777791b2f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:47.979862 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e49e50ef-7f39-45a2-9400-a5777791b2f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1268 microversion: 2.1 time: 0.518636 Oct 04 21:07:47.980681 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 265/545] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:47 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1268 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:47.985446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4c305d8e-9701-49e4-9e3a-00487b4bc727 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:47.986299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4c305d8e-9701-49e4-9e3a-00487b4bc727 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:47.995372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c305d8e-9701-49e4-9e3a-00487b4bc727 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:47.995372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c305d8e-9701-49e4-9e3a-00487b4bc727 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:47.995372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c305d8e-9701-49e4-9e3a-00487b4bc727 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:47.995372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c305d8e-9701-49e4-9e3a-00487b4bc727 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:47.996084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c305d8e-9701-49e4-9e3a-00487b4bc727 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:47.996712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c305d8e-9701-49e4-9e3a-00487b4bc727 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:48.066408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1d51f6e8-fd7b-4bdf-8b28-f4eb012638bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:48.076723 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1d51f6e8-fd7b-4bdf-8b28-f4eb012638bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 200 len: 1317 microversion: 2.1 time: 0.761504 Oct 04 21:07:48.078014 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 281/546] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:47 2022] GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 1317 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:48.090224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e5db057c-c558-4f65-892e-1df1fe610129 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:48.091182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e5db057c-c558-4f65-892e-1df1fe610129 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:48.098350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5db057c-c558-4f65-892e-1df1fe610129 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:48.098846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5db057c-c558-4f65-892e-1df1fe610129 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:48.099418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5db057c-c558-4f65-892e-1df1fe610129 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:48.100324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5db057c-c558-4f65-892e-1df1fe610129 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:48.100789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5db057c-c558-4f65-892e-1df1fe610129 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:48.101258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5db057c-c558-4f65-892e-1df1fe610129 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:48.146229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4c305d8e-9701-49e4-9e3a-00487b4bc727 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:48.164732 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4c305d8e-9701-49e4-9e3a-00487b4bc727 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1216 microversion: 2.1 time: 0.172958 Oct 04 21:07:48.168328 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 266/547] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:47 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1216 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:48.234030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e5db057c-c558-4f65-892e-1df1fe610129 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:48.242500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e5db057c-c558-4f65-892e-1df1fe610129 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:48.244095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e5db057c-c558-4f65-892e-1df1fe610129 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:48.250340 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e5db057c-c558-4f65-892e-1df1fe610129 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.171047 Oct 04 21:07:48.250917 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 282/548] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:48 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:48.321882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-635fa776-8cb5-4d57-9fa1-91a60eef0be6 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:48.322504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-635fa776-8cb5-4d57-9fa1-91a60eef0be6 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:48.329544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-635fa776-8cb5-4d57-9fa1-91a60eef0be6 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:48.330043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-635fa776-8cb5-4d57-9fa1-91a60eef0be6 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:48.330491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-635fa776-8cb5-4d57-9fa1-91a60eef0be6 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:48.331193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-635fa776-8cb5-4d57-9fa1-91a60eef0be6 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:48.331655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-635fa776-8cb5-4d57-9fa1-91a60eef0be6 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:48.332085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-635fa776-8cb5-4d57-9fa1-91a60eef0be6 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:48.473126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d886e442-bfbc-4ff2-8db3-8285ca98fa4e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:48.475087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d886e442-bfbc-4ff2-8db3-8285ca98fa4e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:48.487109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d886e442-bfbc-4ff2-8db3-8285ca98fa4e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:48.487921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d886e442-bfbc-4ff2-8db3-8285ca98fa4e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:48.492346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d886e442-bfbc-4ff2-8db3-8285ca98fa4e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:48.496311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d886e442-bfbc-4ff2-8db3-8285ca98fa4e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:48.496311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d886e442-bfbc-4ff2-8db3-8285ca98fa4e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:48.497121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d886e442-bfbc-4ff2-8db3-8285ca98fa4e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:48.765493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-635fa776-8cb5-4d57-9fa1-91a60eef0be6 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:48.775719 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-635fa776-8cb5-4d57-9fa1-91a60eef0be6 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 200 len: 1319 microversion: 2.1 time: 0.457863 Oct 04 21:07:48.776950 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 267/549] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:48 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:48.832259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d886e442-bfbc-4ff2-8db3-8285ca98fa4e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:48.842405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d886e442-bfbc-4ff2-8db3-8285ca98fa4e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:48.846563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d886e442-bfbc-4ff2-8db3-8285ca98fa4e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:48.848995 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d886e442-bfbc-4ff2-8db3-8285ca98fa4e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1569 microversion: 2.25 time: 0.381258 Oct 04 21:07:48.866723 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 283/550] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:48 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1569 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:48.895156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-9e18e410-ae20-4101-8fbd-10fbc5a4a491 req-506e62ba-3923-4e4f-af56-f9e4eaf8c4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3626e794-7b5c-40a7-b2af-07101d77ce62", "name": "network-vif-plugged", "status": "completed", "tag": "cfa799aa-808a-473d-b542-399f3d0868b2"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:48.906275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9e18e410-ae20-4101-8fbd-10fbc5a4a491 req-506e62ba-3923-4e4f-af56-f9e4eaf8c4a4 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:48.907046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9e18e410-ae20-4101-8fbd-10fbc5a4a491 req-506e62ba-3923-4e4f-af56-f9e4eaf8c4a4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:48.907961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9e18e410-ae20-4101-8fbd-10fbc5a4a491 req-506e62ba-3923-4e4f-af56-f9e4eaf8c4a4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:48.926971 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-9e18e410-ae20-4101-8fbd-10fbc5a4a491 req-506e62ba-3923-4e4f-af56-f9e4eaf8c4a4 service nova] Creating event network-vif-plugged:cfa799aa-808a-473d-b542-399f3d0868b2 for instance 3626e794-7b5c-40a7-b2af-07101d77ce62 on n-h2-860282-1 Oct 04 21:07:48.935567 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-9e18e410-ae20-4101-8fbd-10fbc5a4a491 req-506e62ba-3923-4e4f-af56-f9e4eaf8c4a4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041430 Oct 04 21:07:48.935567 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 268/551] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:49.005701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-294bd533-ce3a-4c13-a08b-2e34d07dd8f2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:49.006738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-294bd533-ce3a-4c13-a08b-2e34d07dd8f2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:49.023362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-294bd533-ce3a-4c13-a08b-2e34d07dd8f2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:49.024084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-294bd533-ce3a-4c13-a08b-2e34d07dd8f2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:49.024704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-294bd533-ce3a-4c13-a08b-2e34d07dd8f2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:49.025667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-294bd533-ce3a-4c13-a08b-2e34d07dd8f2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:49.026287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-294bd533-ce3a-4c13-a08b-2e34d07dd8f2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:49.026894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-294bd533-ce3a-4c13-a08b-2e34d07dd8f2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:49.104316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1e4d81c1-9098-4227-81ad-af0021dee618 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:49.106040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1e4d81c1-9098-4227-81ad-af0021dee618 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:49.199809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e4d81c1-9098-4227-81ad-af0021dee618 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:49.201742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e4d81c1-9098-4227-81ad-af0021dee618 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:49.202302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e4d81c1-9098-4227-81ad-af0021dee618 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:49.203163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e4d81c1-9098-4227-81ad-af0021dee618 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:49.203684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e4d81c1-9098-4227-81ad-af0021dee618 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:49.204296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e4d81c1-9098-4227-81ad-af0021dee618 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:49.398564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-294bd533-ce3a-4c13-a08b-2e34d07dd8f2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:49.425890 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-294bd533-ce3a-4c13-a08b-2e34d07dd8f2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1310 microversion: 2.1 time: 0.425490 Oct 04 21:07:49.429388 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 284/552] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:48 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1310 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:49.446113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b58c6de8-85d1-407d-be37-30118ad67a2e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:49.450989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b58c6de8-85d1-407d-be37-30118ad67a2e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:49.462334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b58c6de8-85d1-407d-be37-30118ad67a2e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:49.463769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b58c6de8-85d1-407d-be37-30118ad67a2e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:49.463769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b58c6de8-85d1-407d-be37-30118ad67a2e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:49.464450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b58c6de8-85d1-407d-be37-30118ad67a2e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:49.465034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b58c6de8-85d1-407d-be37-30118ad67a2e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:49.465622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b58c6de8-85d1-407d-be37-30118ad67a2e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:49.474067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1e4d81c1-9098-4227-81ad-af0021dee618 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:49.476828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:49.488845 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1e4d81c1-9098-4227-81ad-af0021dee618 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 200 len: 1317 microversion: 2.1 time: 0.392802 Oct 04 21:07:49.502538 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 269/553] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:49 2022] GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:49.521250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-174465fb-879c-48bf-8962-ccb6bfca7acc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:49.524690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-174465fb-879c-48bf-8962-ccb6bfca7acc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:49.539016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-174465fb-879c-48bf-8962-ccb6bfca7acc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:49.540041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-174465fb-879c-48bf-8962-ccb6bfca7acc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:49.540699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-174465fb-879c-48bf-8962-ccb6bfca7acc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:49.541750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-174465fb-879c-48bf-8962-ccb6bfca7acc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:49.542522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-174465fb-879c-48bf-8962-ccb6bfca7acc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:49.543326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-174465fb-879c-48bf-8962-ccb6bfca7acc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:49.589290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b58c6de8-85d1-407d-be37-30118ad67a2e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:49.609636 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b58c6de8-85d1-407d-be37-30118ad67a2e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1264 microversion: 2.1 time: 0.173092 Oct 04 21:07:49.612037 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 285/554] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:49 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:49.692815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-174465fb-879c-48bf-8962-ccb6bfca7acc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:49.707397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-174465fb-879c-48bf-8962-ccb6bfca7acc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:49.708861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-174465fb-879c-48bf-8962-ccb6bfca7acc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:49.721020 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-174465fb-879c-48bf-8962-ccb6bfca7acc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.216940 Oct 04 21:07:49.721972 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 270/555] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:49 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:49.802854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-44babf25-35dd-441e-8f20-e6b3ea686c30 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:49.803724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-44babf25-35dd-441e-8f20-e6b3ea686c30 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:49.810910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44babf25-35dd-441e-8f20-e6b3ea686c30 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:49.811431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44babf25-35dd-441e-8f20-e6b3ea686c30 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:49.811868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44babf25-35dd-441e-8f20-e6b3ea686c30 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:49.812574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44babf25-35dd-441e-8f20-e6b3ea686c30 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:49.813028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44babf25-35dd-441e-8f20-e6b3ea686c30 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:49.813479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44babf25-35dd-441e-8f20-e6b3ea686c30 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:49.817736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:49.873468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f5be6f5c-56f2-4671-8064-28b507e95441 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:49.874087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f5be6f5c-56f2-4671-8064-28b507e95441 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:49.880059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5be6f5c-56f2-4671-8064-28b507e95441 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:49.880548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5be6f5c-56f2-4671-8064-28b507e95441 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:49.880992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5be6f5c-56f2-4671-8064-28b507e95441 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:49.881738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5be6f5c-56f2-4671-8064-28b507e95441 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:49.882198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5be6f5c-56f2-4671-8064-28b507e95441 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:49.882816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5be6f5c-56f2-4671-8064-28b507e95441 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:50.255444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-44babf25-35dd-441e-8f20-e6b3ea686c30 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:50.284959 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-44babf25-35dd-441e-8f20-e6b3ea686c30 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 200 len: 1319 microversion: 2.1 time: 0.486617 Oct 04 21:07:50.290189 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 286/556] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:49 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 1319 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:50.298229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f5be6f5c-56f2-4671-8064-28b507e95441 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:50.311001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f5be6f5c-56f2-4671-8064-28b507e95441 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:50.312865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f5be6f5c-56f2-4671-8064-28b507e95441 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:50.314321 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f5be6f5c-56f2-4671-8064-28b507e95441 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1559 microversion: 2.25 time: 0.444803 Oct 04 21:07:50.315539 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 271/557] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:49 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1559 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:50.349282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-35f8ef08-e376-4d9f-a665-127c27c5386d tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '.version_select at 0x7f57908ab0d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:50.353149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35f8ef08-e376-4d9f-a665-127c27c5386d tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:50.353900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35f8ef08-e376-4d9f-a665-127c27c5386d tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:50.354654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35f8ef08-e376-4d9f-a665-127c27c5386d tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:50.364112 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-35f8ef08-e376-4d9f-a665-127c27c5386d tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1100 microversion: 2.25 time: 0.018505 Oct 04 21:07:50.364981 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 287/558] 10.222.0.30 () {60 vars in 1184 bytes} [Tue Oct 4 21:07:50 2022] GET /compute/v2.1/os-migrations => generated 1100 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:50.387033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-20d8829b-f8a6-48e8-a5f0-6595dfe9f063 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:50.387906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-20d8829b-f8a6-48e8-a5f0-6595dfe9f063 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:50.404589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20d8829b-f8a6-48e8-a5f0-6595dfe9f063 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:50.405577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20d8829b-f8a6-48e8-a5f0-6595dfe9f063 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:50.406238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20d8829b-f8a6-48e8-a5f0-6595dfe9f063 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:50.407840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20d8829b-f8a6-48e8-a5f0-6595dfe9f063 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:50.408469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20d8829b-f8a6-48e8-a5f0-6595dfe9f063 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:50.409754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20d8829b-f8a6-48e8-a5f0-6595dfe9f063 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:50.452805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ff3a17c5-a5ab-4dd4-b4e4-786db3aef01c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:50.453772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ff3a17c5-a5ab-4dd4-b4e4-786db3aef01c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:50.461023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff3a17c5-a5ab-4dd4-b4e4-786db3aef01c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:50.467422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff3a17c5-a5ab-4dd4-b4e4-786db3aef01c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:50.467986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff3a17c5-a5ab-4dd4-b4e4-786db3aef01c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:50.468792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff3a17c5-a5ab-4dd4-b4e4-786db3aef01c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:50.469788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff3a17c5-a5ab-4dd4-b4e4-786db3aef01c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:50.470432 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff3a17c5-a5ab-4dd4-b4e4-786db3aef01c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:50.724043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ff3a17c5-a5ab-4dd4-b4e4-786db3aef01c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:50.736788 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ff3a17c5-a5ab-4dd4-b4e4-786db3aef01c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1310 microversion: 2.1 time: 0.284812 Oct 04 21:07:50.736788 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 288/559] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:50 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1310 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:50.740951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f2d88f8e-38c7-4a53-ab4f-749488416866 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:50.742489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f2d88f8e-38c7-4a53-ab4f-749488416866 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:50.751458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2d88f8e-38c7-4a53-ab4f-749488416866 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:50.752362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2d88f8e-38c7-4a53-ab4f-749488416866 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:50.753028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2d88f8e-38c7-4a53-ab4f-749488416866 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:50.753883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2d88f8e-38c7-4a53-ab4f-749488416866 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:50.754868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2d88f8e-38c7-4a53-ab4f-749488416866 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:50.755780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2d88f8e-38c7-4a53-ab4f-749488416866 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:50.797335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-20d8829b-f8a6-48e8-a5f0-6595dfe9f063 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lazy-loading 'services' on Instance uuid 392b3ca2-cc0a-44ae-b791-b8d6043f54e8 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:07:50.816964 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-20d8829b-f8a6-48e8-a5f0-6595dfe9f063 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 2052 microversion: 2.25 time: 0.431072 Oct 04 21:07:50.816964 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 272/560] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:50 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 2052 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:50.817538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-add652d3-9377-4a8f-b12b-8ee1ff98bee9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:50.818145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-add652d3-9377-4a8f-b12b-8ee1ff98bee9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:50.824166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-add652d3-9377-4a8f-b12b-8ee1ff98bee9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:50.824827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-add652d3-9377-4a8f-b12b-8ee1ff98bee9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:50.825503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-add652d3-9377-4a8f-b12b-8ee1ff98bee9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:50.826423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-add652d3-9377-4a8f-b12b-8ee1ff98bee9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:50.827027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-add652d3-9377-4a8f-b12b-8ee1ff98bee9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:50.827603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-add652d3-9377-4a8f-b12b-8ee1ff98bee9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:50.936897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-add652d3-9377-4a8f-b12b-8ee1ff98bee9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:50.954227 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-add652d3-9377-4a8f-b12b-8ee1ff98bee9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1270 microversion: 2.1 time: 0.140122 Oct 04 21:07:50.955043 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 273/561] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:50 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1270 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:50.959790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0d076b02-c49e-4efd-8e41-eefbee684f8e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:50.960389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0d076b02-c49e-4efd-8e41-eefbee684f8e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:50.974428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d076b02-c49e-4efd-8e41-eefbee684f8e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:50.974957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d076b02-c49e-4efd-8e41-eefbee684f8e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:50.975581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d076b02-c49e-4efd-8e41-eefbee684f8e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:50.976312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d076b02-c49e-4efd-8e41-eefbee684f8e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:50.976771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d076b02-c49e-4efd-8e41-eefbee684f8e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:50.977196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d076b02-c49e-4efd-8e41-eefbee684f8e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:51.089395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f2d88f8e-38c7-4a53-ab4f-749488416866 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:51.090008 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f2d88f8e-38c7-4a53-ab4f-749488416866 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 200 len: 1317 microversion: 2.1 time: 0.354846 Oct 04 21:07:51.096594 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 289/562] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:50 2022] GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:51.101571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-1be286aa-3b37-43f0-84fd-b80d2cb06b7d req-036e13a1-4fb1-4598-b26e-82d86ab5f037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e14e448-c2c9-4904-823a-4febd5b537b2", "tag": "fd07f72b-4442-4b44-b1f2-27824c689273"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:51.105226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0d076b02-c49e-4efd-8e41-eefbee684f8e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:51.129311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1be286aa-3b37-43f0-84fd-b80d2cb06b7d req-036e13a1-4fb1-4598-b26e-82d86ab5f037 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:51.129817 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1be286aa-3b37-43f0-84fd-b80d2cb06b7d req-036e13a1-4fb1-4598-b26e-82d86ab5f037 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:51.130249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1be286aa-3b37-43f0-84fd-b80d2cb06b7d req-036e13a1-4fb1-4598-b26e-82d86ab5f037 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:51.132920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0d076b02-c49e-4efd-8e41-eefbee684f8e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:51.134720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0d076b02-c49e-4efd-8e41-eefbee684f8e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:51.141008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:51.143127 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0d076b02-c49e-4efd-8e41-eefbee684f8e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.186896 Oct 04 21:07:51.149896 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-1be286aa-3b37-43f0-84fd-b80d2cb06b7d req-036e13a1-4fb1-4598-b26e-82d86ab5f037 service nova] Creating event network-changed:fd07f72b-4442-4b44-b1f2-27824c689273 for instance 6e14e448-c2c9-4904-823a-4febd5b537b2 on n-h1-860282-1 Oct 04 21:07:51.155256 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 274/563] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:50 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:51.158345 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-1be286aa-3b37-43f0-84fd-b80d2cb06b7d req-036e13a1-4fb1-4598-b26e-82d86ab5f037 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058836 Oct 04 21:07:51.159365 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 290/564] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:51.170050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-422a2573-1f8e-4fe3-95f5-d9f2caaee495 req-2e000670-8cca-4667-a8a4-8d47e97bd521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f201296c-ba54-4f1e-984a-461dfe55d267", "name": "network-vif-plugged", "status": "completed", "tag": "1a0e3523-2e2d-43b0-a14b-d80fa3c131ff"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:51.175308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bcd260db-8ddd-458d-90de-f67fc94e77b7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1775510611", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "d8cfe5e7-54b8-4178-9c64-fdf6c3f1a916"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:51.181116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-422a2573-1f8e-4fe3-95f5-d9f2caaee495 req-2e000670-8cca-4667-a8a4-8d47e97bd521 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:51.183851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-422a2573-1f8e-4fe3-95f5-d9f2caaee495 req-2e000670-8cca-4667-a8a4-8d47e97bd521 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:51.183851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-422a2573-1f8e-4fe3-95f5-d9f2caaee495 req-2e000670-8cca-4667-a8a4-8d47e97bd521 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:51.245307 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-422a2573-1f8e-4fe3-95f5-d9f2caaee495 req-2e000670-8cca-4667-a8a4-8d47e97bd521 service nova] Creating event network-vif-plugged:1a0e3523-2e2d-43b0-a14b-d80fa3c131ff for instance f201296c-ba54-4f1e-984a-461dfe55d267 on n-h2-860282-1 Oct 04 21:07:51.253334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-bcd260db-8ddd-458d-90de-f67fc94e77b7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] validate_networks() for [('d8cfe5e7-54b8-4178-9c64-fdf6c3f1a916', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:07:51.256618 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-422a2573-1f8e-4fe3-95f5-d9f2caaee495 req-2e000670-8cca-4667-a8a4-8d47e97bd521 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090419 Oct 04 21:07:51.257229 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 275/565] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:51.320888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-13dd3898-69ca-4e3b-96e7-b97090c57b58 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:51.321921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-13dd3898-69ca-4e3b-96e7-b97090c57b58 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:51.333254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13dd3898-69ca-4e3b-96e7-b97090c57b58 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:51.334038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13dd3898-69ca-4e3b-96e7-b97090c57b58 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:51.334487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13dd3898-69ca-4e3b-96e7-b97090c57b58 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:51.335205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13dd3898-69ca-4e3b-96e7-b97090c57b58 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:51.335837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13dd3898-69ca-4e3b-96e7-b97090c57b58 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:51.336272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13dd3898-69ca-4e3b-96e7-b97090c57b58 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:51.660684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-13dd3898-69ca-4e3b-96e7-b97090c57b58 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:51.669808 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-13dd3898-69ca-4e3b-96e7-b97090c57b58 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 200 len: 1469 microversion: 2.1 time: 0.356793 Oct 04 21:07:51.670414 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 276/566] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:51 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 1469 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:51.710696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f381d707-2240-4363-9a28-b884d14d5d25 tempest-DeleteServersAdminTestJSON-615978898 tempest-DeleteServersAdminTestJSON-615978898-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:51.713112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f381d707-2240-4363-9a28-b884d14d5d25 tempest-DeleteServersAdminTestJSON-615978898 tempest-DeleteServersAdminTestJSON-615978898-project-admin] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:51.727449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f381d707-2240-4363-9a28-b884d14d5d25 tempest-DeleteServersAdminTestJSON-615978898 tempest-DeleteServersAdminTestJSON-615978898-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:51.728170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f381d707-2240-4363-9a28-b884d14d5d25 tempest-DeleteServersAdminTestJSON-615978898 tempest-DeleteServersAdminTestJSON-615978898-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:51.728796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f381d707-2240-4363-9a28-b884d14d5d25 tempest-DeleteServersAdminTestJSON-615978898 tempest-DeleteServersAdminTestJSON-615978898-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:51.729565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f381d707-2240-4363-9a28-b884d14d5d25 tempest-DeleteServersAdminTestJSON-615978898 tempest-DeleteServersAdminTestJSON-615978898-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:51.730031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f381d707-2240-4363-9a28-b884d14d5d25 tempest-DeleteServersAdminTestJSON-615978898 tempest-DeleteServersAdminTestJSON-615978898-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:51.730461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f381d707-2240-4363-9a28-b884d14d5d25 tempest-DeleteServersAdminTestJSON-615978898 tempest-DeleteServersAdminTestJSON-615978898-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.078490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-bcd260db-8ddd-458d-90de-f67fc94e77b7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:07:52.078950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-bcd260db-8ddd-458d-90de-f67fc94e77b7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:07:52.079700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-bcd260db-8ddd-458d-90de-f67fc94e77b7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:07:52.080163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-bcd260db-8ddd-458d-90de-f67fc94e77b7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:07:52.080551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-bcd260db-8ddd-458d-90de-f67fc94e77b7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:07:52.090839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bcd260db-8ddd-458d-90de-f67fc94e77b7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:52.091947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bcd260db-8ddd-458d-90de-f67fc94e77b7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:52.092393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bcd260db-8ddd-458d-90de-f67fc94e77b7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.093127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bcd260db-8ddd-458d-90de-f67fc94e77b7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:52.093674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bcd260db-8ddd-458d-90de-f67fc94e77b7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:52.094226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bcd260db-8ddd-458d-90de-f67fc94e77b7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.110982 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f381d707-2240-4363-9a28-b884d14d5d25 tempest-DeleteServersAdminTestJSON-615978898 tempest-DeleteServersAdminTestJSON-615978898-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62/action" status: 202 len: 0 microversion: 2.1 time: 0.409012 Oct 04 21:07:52.111754 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 277/567] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:07:51 2022] POST /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:07:52.115742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-bcd260db-8ddd-458d-90de-f67fc94e77b7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Getting quotas for project d06810bbad6e4914aa53b43ef390f52e. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:52.121964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c2125f93-9529-41c8-99a0-92e99efa6897 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:52.121964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c2125f93-9529-41c8-99a0-92e99efa6897 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:52.128138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2125f93-9529-41c8-99a0-92e99efa6897 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:52.128859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2125f93-9529-41c8-99a0-92e99efa6897 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:52.129854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2125f93-9529-41c8-99a0-92e99efa6897 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.130770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2125f93-9529-41c8-99a0-92e99efa6897 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:52.131385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2125f93-9529-41c8-99a0-92e99efa6897 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:52.131989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-bcd260db-8ddd-458d-90de-f67fc94e77b7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Getting quotas for user 95f0cc0f93b244cea8818c7bbdcfb90a and project d06810bbad6e4914aa53b43ef390f52e. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:52.132110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2125f93-9529-41c8-99a0-92e99efa6897 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.149905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bcd260db-8ddd-458d-90de-f67fc94e77b7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:07:52.152750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bcd260db-8ddd-458d-90de-f67fc94e77b7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:07:52.270159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c2125f93-9529-41c8-99a0-92e99efa6897 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:52.280360 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c2125f93-9529-41c8-99a0-92e99efa6897 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1310 microversion: 2.1 time: 0.166993 Oct 04 21:07:52.280942 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 278/568] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:52 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1310 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:52.288857 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c37c80f4-01ba-4071-ad17-ce515d334fe3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:52.289609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c37c80f4-01ba-4071-ad17-ce515d334fe3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:52.296062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c37c80f4-01ba-4071-ad17-ce515d334fe3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:52.296808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c37c80f4-01ba-4071-ad17-ce515d334fe3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:52.297865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c37c80f4-01ba-4071-ad17-ce515d334fe3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.308829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c37c80f4-01ba-4071-ad17-ce515d334fe3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:52.310602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c37c80f4-01ba-4071-ad17-ce515d334fe3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:52.312225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c37c80f4-01ba-4071-ad17-ce515d334fe3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.430145 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bcd260db-8ddd-458d-90de-f67fc94e77b7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.266144 Oct 04 21:07:52.431520 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 291/569] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Oct 4 21:07:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:07:52.437037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7c49ff8f-1b9b-46f6-ae4c-45069715a237 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:52.437761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7c49ff8f-1b9b-46f6-ae4c-45069715a237 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:52.444889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c49ff8f-1b9b-46f6-ae4c-45069715a237 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:52.445568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c49ff8f-1b9b-46f6-ae4c-45069715a237 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:52.446045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c49ff8f-1b9b-46f6-ae4c-45069715a237 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.446926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c49ff8f-1b9b-46f6-ae4c-45069715a237 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:52.447388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c49ff8f-1b9b-46f6-ae4c-45069715a237 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:52.447811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c49ff8f-1b9b-46f6-ae4c-45069715a237 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.458512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c37c80f4-01ba-4071-ad17-ce515d334fe3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:52.466605 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c37c80f4-01ba-4071-ad17-ce515d334fe3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1312 microversion: 2.1 time: 0.184202 Oct 04 21:07:52.467056 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 279/570] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:52 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1312 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:52.472907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-55975d43-66b1-4732-989c-d5c709ebb765 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:52.473615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-55975d43-66b1-4732-989c-d5c709ebb765 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:52.480374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55975d43-66b1-4732-989c-d5c709ebb765 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:52.480866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55975d43-66b1-4732-989c-d5c709ebb765 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:52.481305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55975d43-66b1-4732-989c-d5c709ebb765 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.483145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55975d43-66b1-4732-989c-d5c709ebb765 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:52.483612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55975d43-66b1-4732-989c-d5c709ebb765 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:52.484042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55975d43-66b1-4732-989c-d5c709ebb765 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.522890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:52.534290 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55975d43-66b1-4732-989c-d5c709ebb765 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:52.534890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55975d43-66b1-4732-989c-d5c709ebb765 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:52.535339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55975d43-66b1-4732-989c-d5c709ebb765 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.535788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-55975d43-66b1-4732-989c-d5c709ebb765 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lazy-loading 'fault' on Instance uuid 3626e794-7b5c-40a7-b2af-07101d77ce62 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:07:52.696419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7c49ff8f-1b9b-46f6-ae4c-45069715a237 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:52.704399 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7c49ff8f-1b9b-46f6-ae4c-45069715a237 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 200 len: 1317 microversion: 2.1 time: 0.271942 Oct 04 21:07:52.705250 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 292/571] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:52 2022] GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:52.725070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2cdd0f95-3a38-4248-ac81-1edb06f6d2e0 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:52.729648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2cdd0f95-3a38-4248-ac81-1edb06f6d2e0 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:52.740490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2cdd0f95-3a38-4248-ac81-1edb06f6d2e0 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:52.740976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2cdd0f95-3a38-4248-ac81-1edb06f6d2e0 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:52.741666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2cdd0f95-3a38-4248-ac81-1edb06f6d2e0 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.742594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2cdd0f95-3a38-4248-ac81-1edb06f6d2e0 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:52.743236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2cdd0f95-3a38-4248-ac81-1edb06f6d2e0 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:52.743942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2cdd0f95-3a38-4248-ac81-1edb06f6d2e0 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.763948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-55975d43-66b1-4732-989c-d5c709ebb765 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:52.771866 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-55975d43-66b1-4732-989c-d5c709ebb765 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 200 len: 1452 microversion: 2.1 time: 0.302700 Oct 04 21:07:52.772613 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 280/572] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:52 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 1452 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:52.805143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-afea4016-fb25-47a5-8ed5-e98067d15478 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:52.812019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-afea4016-fb25-47a5-8ed5-e98067d15478 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:52.837356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2cdd0f95-3a38-4248-ac81-1edb06f6d2e0 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:52.846348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2cdd0f95-3a38-4248-ac81-1edb06f6d2e0 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:52.853570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2cdd0f95-3a38-4248-ac81-1edb06f6d2e0 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:52.863658 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2cdd0f95-3a38-4248-ac81-1edb06f6d2e0 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.157135 Oct 04 21:07:52.864251 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 293/573] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:52 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:52.870026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f2472744-8767-4612-a63f-e806eb1a39a7 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:52.870525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f2472744-8767-4612-a63f-e806eb1a39a7 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:52.893726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2472744-8767-4612-a63f-e806eb1a39a7 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:52.893726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2472744-8767-4612-a63f-e806eb1a39a7 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:52.893726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2472744-8767-4612-a63f-e806eb1a39a7 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.893726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2472744-8767-4612-a63f-e806eb1a39a7 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:52.894239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2472744-8767-4612-a63f-e806eb1a39a7 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:52.894334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-afea4016-fb25-47a5-8ed5-e98067d15478 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:52.894446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2472744-8767-4612-a63f-e806eb1a39a7 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.901957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-afea4016-fb25-47a5-8ed5-e98067d15478 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:52.904403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-afea4016-fb25-47a5-8ed5-e98067d15478 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:52.906107 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-afea4016-fb25-47a5-8ed5-e98067d15478 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1262 microversion: 2.25 time: 0.121061 Oct 04 21:07:52.907168 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 281/574] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:52 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1262 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:52.921258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f2472744-8767-4612-a63f-e806eb1a39a7 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:07:53.155017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-80497b2a-5806-4f76-a344-174c49533f8e req-782ed132-7f82-4a2c-84ce-f6cc855ad421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41063621-009d-455a-a56d-9ffbae52f46c", "tag": "165120d0-97d6-48bd-b2b4-6ab812848c0b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:53.171752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-80497b2a-5806-4f76-a344-174c49533f8e req-782ed132-7f82-4a2c-84ce-f6cc855ad421 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:53.172447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-80497b2a-5806-4f76-a344-174c49533f8e req-782ed132-7f82-4a2c-84ce-f6cc855ad421 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:53.173065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-80497b2a-5806-4f76-a344-174c49533f8e req-782ed132-7f82-4a2c-84ce-f6cc855ad421 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:53.187201 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-80497b2a-5806-4f76-a344-174c49533f8e req-782ed132-7f82-4a2c-84ce-f6cc855ad421 service nova] Creating event network-changed:165120d0-97d6-48bd-b2b4-6ab812848c0b for instance 41063621-009d-455a-a56d-9ffbae52f46c on n-h1-860282-1 Oct 04 21:07:53.192485 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-80497b2a-5806-4f76-a344-174c49533f8e req-782ed132-7f82-4a2c-84ce-f6cc855ad421 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048250 Oct 04 21:07:53.193291 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 282/575] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:53.305141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-19144803-f219-4f69-9e28-8fea8e099f44 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:53.306345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-19144803-f219-4f69-9e28-8fea8e099f44 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:53.314827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19144803-f219-4f69-9e28-8fea8e099f44 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:53.315572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19144803-f219-4f69-9e28-8fea8e099f44 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:53.316355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19144803-f219-4f69-9e28-8fea8e099f44 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:53.317235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19144803-f219-4f69-9e28-8fea8e099f44 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:53.317942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19144803-f219-4f69-9e28-8fea8e099f44 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:53.318548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19144803-f219-4f69-9e28-8fea8e099f44 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:53.508730 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f2472744-8767-4612-a63f-e806eb1a39a7 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 204 len: 0 microversion: 2.1 time: 0.641970 Oct 04 21:07:53.511012 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 294/576] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:07:52 2022] DELETE /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:07:53.518522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a71c453c-1ecd-4549-8cc1-35415cc1d140 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:53.519241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a71c453c-1ecd-4549-8cc1-35415cc1d140 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:53.525565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a71c453c-1ecd-4549-8cc1-35415cc1d140 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:53.526059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a71c453c-1ecd-4549-8cc1-35415cc1d140 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:53.526502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a71c453c-1ecd-4549-8cc1-35415cc1d140 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:53.527206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a71c453c-1ecd-4549-8cc1-35415cc1d140 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:53.527660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a71c453c-1ecd-4549-8cc1-35415cc1d140 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:53.528378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a71c453c-1ecd-4549-8cc1-35415cc1d140 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:53.550693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-19144803-f219-4f69-9e28-8fea8e099f44 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:53.559101 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-19144803-f219-4f69-9e28-8fea8e099f44 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1310 microversion: 2.1 time: 0.258202 Oct 04 21:07:53.564741 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 283/577] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:53 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1310 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:53.574040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9c803abc-5b5b-44f9-b835-31a0faa7f025 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:53.574754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9c803abc-5b5b-44f9-b835-31a0faa7f025 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:53.581755 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c803abc-5b5b-44f9-b835-31a0faa7f025 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:53.582366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c803abc-5b5b-44f9-b835-31a0faa7f025 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:53.582815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c803abc-5b5b-44f9-b835-31a0faa7f025 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:53.583514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c803abc-5b5b-44f9-b835-31a0faa7f025 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:53.584021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c803abc-5b5b-44f9-b835-31a0faa7f025 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:53.584450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c803abc-5b5b-44f9-b835-31a0faa7f025 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:53.652215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c803abc-5b5b-44f9-b835-31a0faa7f025 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:53.652985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c803abc-5b5b-44f9-b835-31a0faa7f025 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:53.654467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c803abc-5b5b-44f9-b835-31a0faa7f025 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:53.655796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-9c803abc-5b5b-44f9-b835-31a0faa7f025 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lazy-loading 'fault' on Instance uuid 3626e794-7b5c-40a7-b2af-07101d77ce62 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:07:54.152503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9c803abc-5b5b-44f9-b835-31a0faa7f025 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:54.155993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a71c453c-1ecd-4549-8cc1-35415cc1d140 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:54.161974 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9c803abc-5b5b-44f9-b835-31a0faa7f025 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 200 len: 1458 microversion: 2.1 time: 0.596149 Oct 04 21:07:54.162846 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 284/578] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:53 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 1458 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:54.175793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e7070f00-120e-4d36-a770-9b59df998740 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:54.176069 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a71c453c-1ecd-4549-8cc1-35415cc1d140 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1312 microversion: 2.1 time: 0.660724 Oct 04 21:07:54.176821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e7070f00-120e-4d36-a770-9b59df998740 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:54.180346 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 295/579] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:53 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1312 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:54.184488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7070f00-120e-4d36-a770-9b59df998740 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:54.185471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7070f00-120e-4d36-a770-9b59df998740 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:54.186072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7070f00-120e-4d36-a770-9b59df998740 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:54.186960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7070f00-120e-4d36-a770-9b59df998740 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:54.187573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7070f00-120e-4d36-a770-9b59df998740 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:54.188165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7070f00-120e-4d36-a770-9b59df998740 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:54.306220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9b52f855-5c20-48c5-ab6e-a0f37416f64a tempest-ListImagesTestJSON-118341510 tempest-ListImagesTestJSON-118341510-project] Calling method '.version_select at 0x7f57907be9d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:54.350995 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9b52f855-5c20-48c5-ab6e-a0f37416f64a tempest-ListImagesTestJSON-118341510 tempest-ListImagesTestJSON-118341510-project] 10.222.0.30 "GET /compute/v2.1/images/d55fbb2c-685c-4db7-a38c-ac6cf5459ad1" status: 200 len: 784 microversion: 2.1 time: 0.169496 Oct 04 21:07:54.351678 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 296/580] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:07:54 2022] GET /compute/v2.1/images/d55fbb2c-685c-4db7-a38c-ac6cf5459ad1 => generated 784 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:54.356221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-23578346-d236-4a16-b233-2854f0fb1421 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:54.356891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-23578346-d236-4a16-b233-2854f0fb1421 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:54.369526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23578346-d236-4a16-b233-2854f0fb1421 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:54.369526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23578346-d236-4a16-b233-2854f0fb1421 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:54.369526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23578346-d236-4a16-b233-2854f0fb1421 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:54.369526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23578346-d236-4a16-b233-2854f0fb1421 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:54.369907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23578346-d236-4a16-b233-2854f0fb1421 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:54.369907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23578346-d236-4a16-b233-2854f0fb1421 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:54.401992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e7070f00-120e-4d36-a770-9b59df998740 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:54.410733 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e7070f00-120e-4d36-a770-9b59df998740 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 200 len: 1466 microversion: 2.1 time: 0.246741 Oct 04 21:07:54.411523 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 285/581] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:54 2022] GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 1466 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:54.426974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d10e4412-1ca8-4e27-ba4c-e95b8cdf1cb1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:54.427697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d10e4412-1ca8-4e27-ba4c-e95b8cdf1cb1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:54.434295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d10e4412-1ca8-4e27-ba4c-e95b8cdf1cb1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:54.444142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d10e4412-1ca8-4e27-ba4c-e95b8cdf1cb1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:54.444142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d10e4412-1ca8-4e27-ba4c-e95b8cdf1cb1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:54.444142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d10e4412-1ca8-4e27-ba4c-e95b8cdf1cb1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:54.444142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d10e4412-1ca8-4e27-ba4c-e95b8cdf1cb1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:54.444558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d10e4412-1ca8-4e27-ba4c-e95b8cdf1cb1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:54.444558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:54.448320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-23578346-d236-4a16-b233-2854f0fb1421 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:54.457513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-23578346-d236-4a16-b233-2854f0fb1421 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:54.459014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-23578346-d236-4a16-b233-2854f0fb1421 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:54.464439 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-23578346-d236-4a16-b233-2854f0fb1421 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.111707 Oct 04 21:07:54.465881 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 297/582] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:54 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:54.471033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-070da321-6214-4abc-8a5a-af52665a3ec5 tempest-ListImagesTestJSON-118341510 tempest-ListImagesTestJSON-118341510-project] Calling method '.version_select at 0x7f57907be820>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:54.506552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d10e4412-1ca8-4e27-ba4c-e95b8cdf1cb1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:54.515464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d10e4412-1ca8-4e27-ba4c-e95b8cdf1cb1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:54.516963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d10e4412-1ca8-4e27-ba4c-e95b8cdf1cb1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:54.519696 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d10e4412-1ca8-4e27-ba4c-e95b8cdf1cb1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1266 microversion: 2.25 time: 0.096978 Oct 04 21:07:54.520420 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 286/583] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:54 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:54.557011 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-070da321-6214-4abc-8a5a-af52665a3ec5 tempest-ListImagesTestJSON-118341510 tempest-ListImagesTestJSON-118341510-project] 10.222.0.30 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.089951 Oct 04 21:07:54.557643 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 298/584] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 21:07:54 2022] GET /compute/v2.1/images => generated 445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:54.570450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0e90c119-2740-4ab3-8760-1c9b73cd54bb tempest-ListImagesTestJSON-118341510 tempest-ListImagesTestJSON-118341510-project] Calling method '.version_select at 0x7f579086eee0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:54.619155 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0e90c119-2740-4ab3-8760-1c9b73cd54bb tempest-ListImagesTestJSON-118341510 tempest-ListImagesTestJSON-118341510-project] 10.222.0.30 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.052275 Oct 04 21:07:54.619804 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 299/585] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Oct 4 21:07:54 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:07:54.624846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d090dfdd-232d-4c26-85da-ffb7414c6b65 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:54.625484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d090dfdd-232d-4c26-85da-ffb7414c6b65 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:54.631584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d090dfdd-232d-4c26-85da-ffb7414c6b65 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:54.632271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d090dfdd-232d-4c26-85da-ffb7414c6b65 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:54.633147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d090dfdd-232d-4c26-85da-ffb7414c6b65 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:54.633605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d090dfdd-232d-4c26-85da-ffb7414c6b65 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:54.634065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d090dfdd-232d-4c26-85da-ffb7414c6b65 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:54.634497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d090dfdd-232d-4c26-85da-ffb7414c6b65 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:54.662672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-966f4193-2b04-42fb-9ced-0e91bb88cd21 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:54.663295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-966f4193-2b04-42fb-9ced-0e91bb88cd21 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:54.669201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-966f4193-2b04-42fb-9ced-0e91bb88cd21 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:54.669726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-966f4193-2b04-42fb-9ced-0e91bb88cd21 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:54.670203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-966f4193-2b04-42fb-9ced-0e91bb88cd21 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:54.670912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-966f4193-2b04-42fb-9ced-0e91bb88cd21 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:54.671365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-966f4193-2b04-42fb-9ced-0e91bb88cd21 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:54.671788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-966f4193-2b04-42fb-9ced-0e91bb88cd21 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:54.844991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d090dfdd-232d-4c26-85da-ffb7414c6b65 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:54.852723 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d090dfdd-232d-4c26-85da-ffb7414c6b65 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1310 microversion: 2.1 time: 0.231782 Oct 04 21:07:54.853293 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 300/586] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:54 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1310 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:55.120207 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-966f4193-2b04-42fb-9ced-0e91bb88cd21 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 200 len: 1617 microversion: 2.1 time: 0.598628 Oct 04 21:07:55.121024 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 287/587] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:54 2022] GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 1617 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:55.144501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b15b223e-cbbc-41cc-a729-7bc9e8205862 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Action: 'create', calling method: .version_select at 0x7f579085c790>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1043100493", "policies": ["affinity"]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:55.162589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-b15b223e-cbbc-41cc-a729-7bc9e8205862 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_groups'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:55.167896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-b15b223e-cbbc-41cc-a729-7bc9e8205862 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for user 0f0ac29dc4e440e785408fa1dfedce5e and project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_groups'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:55.198447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9a247020-b7c0-4ac0-bd2d-80851835315c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:55.199149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9a247020-b7c0-4ac0-bd2d-80851835315c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:55.205325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a247020-b7c0-4ac0-bd2d-80851835315c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:55.207656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a247020-b7c0-4ac0-bd2d-80851835315c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:55.207656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a247020-b7c0-4ac0-bd2d-80851835315c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:55.207656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a247020-b7c0-4ac0-bd2d-80851835315c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:55.207656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a247020-b7c0-4ac0-bd2d-80851835315c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:55.208035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a247020-b7c0-4ac0-bd2d-80851835315c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:55.238836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a247020-b7c0-4ac0-bd2d-80851835315c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:55.239320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a247020-b7c0-4ac0-bd2d-80851835315c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:55.239760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a247020-b7c0-4ac0-bd2d-80851835315c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:55.240210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-9a247020-b7c0-4ac0-bd2d-80851835315c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lazy-loading 'fault' on Instance uuid 3626e794-7b5c-40a7-b2af-07101d77ce62 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:07:55.371875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9a247020-b7c0-4ac0-bd2d-80851835315c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:55.379571 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9a247020-b7c0-4ac0-bd2d-80851835315c tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 200 len: 1458 microversion: 2.1 time: 0.185000 Oct 04 21:07:55.380402 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 288/588] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:55 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 1458 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:55.385092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d50063ad-4068-42db-bf23-fabae1248891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:55.395793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d50063ad-4068-42db-bf23-fabae1248891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:55.395793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d50063ad-4068-42db-bf23-fabae1248891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:55.395793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d50063ad-4068-42db-bf23-fabae1248891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:55.395793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d50063ad-4068-42db-bf23-fabae1248891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:55.396165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d50063ad-4068-42db-bf23-fabae1248891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:55.396165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d50063ad-4068-42db-bf23-fabae1248891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:55.396165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d50063ad-4068-42db-bf23-fabae1248891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:55.410654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-b15b223e-cbbc-41cc-a729-7bc9e8205862 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_groups'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:55.421707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-b15b223e-cbbc-41cc-a729-7bc9e8205862 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for user 0f0ac29dc4e440e785408fa1dfedce5e and project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_groups'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:55.438624 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b15b223e-cbbc-41cc-a729-7bc9e8205862 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.298037 Oct 04 21:07:55.439359 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 301/589] 10.222.0.30 () {60 vars in 1174 bytes} [Tue Oct 4 21:07:55 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:55.494926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0db2fb69-c767-450d-8fac-cd34b99ba0a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:55.495686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0db2fb69-c767-450d-8fac-cd34b99ba0a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:55.504806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0db2fb69-c767-450d-8fac-cd34b99ba0a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:55.504806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0db2fb69-c767-450d-8fac-cd34b99ba0a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:55.504806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0db2fb69-c767-450d-8fac-cd34b99ba0a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:55.505202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0db2fb69-c767-450d-8fac-cd34b99ba0a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:55.505299 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0db2fb69-c767-450d-8fac-cd34b99ba0a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:55.505811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0db2fb69-c767-450d-8fac-cd34b99ba0a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:55.561244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d50063ad-4068-42db-bf23-fabae1248891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:55.572210 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d50063ad-4068-42db-bf23-fabae1248891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1312 microversion: 2.1 time: 0.190591 Oct 04 21:07:55.578465 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 289/590] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:55 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:55.584177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-26d958de-dad2-4811-a42b-57b5edf15a0f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:55.584789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-26d958de-dad2-4811-a42b-57b5edf15a0f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:55.596975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26d958de-dad2-4811-a42b-57b5edf15a0f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:55.598021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26d958de-dad2-4811-a42b-57b5edf15a0f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:55.598828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26d958de-dad2-4811-a42b-57b5edf15a0f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:55.609394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26d958de-dad2-4811-a42b-57b5edf15a0f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:55.610670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26d958de-dad2-4811-a42b-57b5edf15a0f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:55.612711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26d958de-dad2-4811-a42b-57b5edf15a0f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:55.641703 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0db2fb69-c767-450d-8fac-cd34b99ba0a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:55.652034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0db2fb69-c767-450d-8fac-cd34b99ba0a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:55.656335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0db2fb69-c767-450d-8fac-cd34b99ba0a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:55.666051 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0db2fb69-c767-450d-8fac-cd34b99ba0a7 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.174510 Oct 04 21:07:55.668060 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 302/591] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:55 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:07:55.676357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-436940532", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "dc9974f1-f005-4f05-aaf9-1081ec35916b"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:55.716520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-26d958de-dad2-4811-a42b-57b5edf15a0f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:55.728663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-26d958de-dad2-4811-a42b-57b5edf15a0f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:55.731183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-26d958de-dad2-4811-a42b-57b5edf15a0f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:55.733161 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-26d958de-dad2-4811-a42b-57b5edf15a0f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1314 microversion: 2.25 time: 0.152709 Oct 04 21:07:55.734581 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 290/592] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:55 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:55.750467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-9571a996-593b-4e7c-8b9b-f95b112941b0 req-a845e36a-ade2-4c5c-a425-4c0d8644458e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3626e794-7b5c-40a7-b2af-07101d77ce62", "name": "network-vif-deleted", "tag": "cfa799aa-808a-473d-b542-399f3d0868b2"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:55.758675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:07:55.764139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9571a996-593b-4e7c-8b9b-f95b112941b0 req-a845e36a-ade2-4c5c-a425-4c0d8644458e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:55.764638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9571a996-593b-4e7c-8b9b-f95b112941b0 req-a845e36a-ade2-4c5c-a425-4c0d8644458e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:55.765074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9571a996-593b-4e7c-8b9b-f95b112941b0 req-a845e36a-ade2-4c5c-a425-4c0d8644458e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:55.777190 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-9571a996-593b-4e7c-8b9b-f95b112941b0 req-a845e36a-ade2-4c5c-a425-4c0d8644458e service nova] Creating event network-vif-deleted:cfa799aa-808a-473d-b542-399f3d0868b2 for instance 3626e794-7b5c-40a7-b2af-07101d77ce62 on n-h2-860282-1 Oct 04 21:07:55.785039 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-9571a996-593b-4e7c-8b9b-f95b112941b0 req-a845e36a-ade2-4c5c-a425-4c0d8644458e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048978 Oct 04 21:07:55.785746 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 291/593] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:55.875777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e0fea1cf-9894-4a14-b7c9-48b53959f704 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:55.876831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e0fea1cf-9894-4a14-b7c9-48b53959f704 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:55.883608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0fea1cf-9894-4a14-b7c9-48b53959f704 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:55.884174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0fea1cf-9894-4a14-b7c9-48b53959f704 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:55.884695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0fea1cf-9894-4a14-b7c9-48b53959f704 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:55.889519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0fea1cf-9894-4a14-b7c9-48b53959f704 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:55.889519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0fea1cf-9894-4a14-b7c9-48b53959f704 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:55.889519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0fea1cf-9894-4a14-b7c9-48b53959f704 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:56.129634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:07:56.129897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:07:56.130380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:07:56.130844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:07:56.131198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:07:56.132020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e0fea1cf-9894-4a14-b7c9-48b53959f704 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:56.140415 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e0fea1cf-9894-4a14-b7c9-48b53959f704 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1310 microversion: 2.1 time: 0.268875 Oct 04 21:07:56.141232 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 292/594] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:55 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1310 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:56.160576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:56.161208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:56.161693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:56.162429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:56.162885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:56.163313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:56.180012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:56.182268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:56.186173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for user 0f0ac29dc4e440e785408fa1dfedce5e and project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:56.198466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Going to run 2 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:07:56.201042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 06d4ebc0-b7ec-4481-ae12-df4530909f2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:07:56.405646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-263b55a5-49c7-49f4-b08f-47fa2c995c57 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:56.407221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-263b55a5-49c7-49f4-b08f-47fa2c995c57 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:56.414254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-263b55a5-49c7-49f4-b08f-47fa2c995c57 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:56.414965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-263b55a5-49c7-49f4-b08f-47fa2c995c57 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:56.415551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-263b55a5-49c7-49f4-b08f-47fa2c995c57 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:56.416400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-263b55a5-49c7-49f4-b08f-47fa2c995c57 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:56.417396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-263b55a5-49c7-49f4-b08f-47fa2c995c57 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:56.418066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-263b55a5-49c7-49f4-b08f-47fa2c995c57 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:56.443721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122758) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 04 21:07:56.453403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-263b55a5-49c7-49f4-b08f-47fa2c995c57 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:56.453965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-263b55a5-49c7-49f4-b08f-47fa2c995c57 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:56.454403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-263b55a5-49c7-49f4-b08f-47fa2c995c57 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:56.454829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-263b55a5-49c7-49f4-b08f-47fa2c995c57 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lazy-loading 'fault' on Instance uuid 3626e794-7b5c-40a7-b2af-07101d77ce62 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:07:56.463046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_group_members'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:56.468372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for user 0f0ac29dc4e440e785408fa1dfedce5e and project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_group_members'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:56.495347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-263b55a5-49c7-49f4-b08f-47fa2c995c57 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:56.504131 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-263b55a5-49c7-49f4-b08f-47fa2c995c57 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 200 len: 1309 microversion: 2.1 time: 0.104167 Oct 04 21:07:56.504730 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 293/595] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:56 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:56.600925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0d51d391-5b02-4e68-99d2-e8665fff73b8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:56.601725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0d51d391-5b02-4e68-99d2-e8665fff73b8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:56.611320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d51d391-5b02-4e68-99d2-e8665fff73b8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:56.612485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d51d391-5b02-4e68-99d2-e8665fff73b8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:56.613092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d51d391-5b02-4e68-99d2-e8665fff73b8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:56.614510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d51d391-5b02-4e68-99d2-e8665fff73b8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:56.615405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d51d391-5b02-4e68-99d2-e8665fff73b8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:56.616583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d51d391-5b02-4e68-99d2-e8665fff73b8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:56.620390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_group_members'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:56.630730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for user 0f0ac29dc4e440e785408fa1dfedce5e and project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_group_members'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:56.640609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=55 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:56.648658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=06d4ebc0-b7ec-4481-ae12-df4530909f2d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:07:56.800648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_group_members'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:56.806687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for user 0f0ac29dc4e440e785408fa1dfedce5e and project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_group_members'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:56.834712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0d51d391-5b02-4e68-99d2-e8665fff73b8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:56.843453 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0d51d391-5b02-4e68-99d2-e8665fff73b8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1312 microversion: 2.1 time: 0.248461 Oct 04 21:07:56.859070 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 294/596] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:56 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1312 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:56.867137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d36c40e5-f7dd-48ec-a0a6-f5b3a466e67c tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:56.867846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d36c40e5-f7dd-48ec-a0a6-f5b3a466e67c tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:56.876005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d36c40e5-f7dd-48ec-a0a6-f5b3a466e67c tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:56.876574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d36c40e5-f7dd-48ec-a0a6-f5b3a466e67c tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:56.877085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d36c40e5-f7dd-48ec-a0a6-f5b3a466e67c tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:56.877910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d36c40e5-f7dd-48ec-a0a6-f5b3a466e67c tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:56.878763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d36c40e5-f7dd-48ec-a0a6-f5b3a466e67c tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:56.879667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d36c40e5-f7dd-48ec-a0a6-f5b3a466e67c tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:56.967485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d36c40e5-f7dd-48ec-a0a6-f5b3a466e67c tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:56.975966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d36c40e5-f7dd-48ec-a0a6-f5b3a466e67c tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:56.977707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d36c40e5-f7dd-48ec-a0a6-f5b3a466e67c tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:56.983512 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d36c40e5-f7dd-48ec-a0a6-f5b3a466e67c tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.122173 Oct 04 21:07:56.984224 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 295/597] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:56 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:56.988720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-669d1d21-5b20-4f1f-898b-b3bef6db5f3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:56.989333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-669d1d21-5b20-4f1f-898b-b3bef6db5f3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:56.995016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-669d1d21-5b20-4f1f-898b-b3bef6db5f3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:56.995511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-669d1d21-5b20-4f1f-898b-b3bef6db5f3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:56.995952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-669d1d21-5b20-4f1f-898b-b3bef6db5f3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:56.996653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-669d1d21-5b20-4f1f-898b-b3bef6db5f3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:56.997113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-669d1d21-5b20-4f1f-898b-b3bef6db5f3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:56.997577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-669d1d21-5b20-4f1f-898b-b3bef6db5f3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:57.036533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_group_members'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:57.044726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for user 0f0ac29dc4e440e785408fa1dfedce5e and project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_group_members'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:57.061227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-669d1d21-5b20-4f1f-898b-b3bef6db5f3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:57.069364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-669d1d21-5b20-4f1f-898b-b3bef6db5f3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:57.070826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-669d1d21-5b20-4f1f-898b-b3bef6db5f3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:57.080679 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-669d1d21-5b20-4f1f-898b-b3bef6db5f3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1322 microversion: 2.25 time: 0.086786 Oct 04 21:07:57.080679 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 296/598] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:56 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1322 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:57.085257 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-eaa042db-d5a9-496b-9cb3-6253e529bb81 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.415641 Oct 04 21:07:57.086105 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 303/599] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:07:55 2022] POST /compute/v2.1/servers => generated 32 bytes in 1417 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 21:07:57.095660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2ebe0015-b3d7-4d87-a3a6-15e6bbbb2815 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:57.100578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2ebe0015-b3d7-4d87-a3a6-15e6bbbb2815 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:57.101352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2ebe0015-b3d7-4d87-a3a6-15e6bbbb2815 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Searching by: {'deleted': False, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:07:57.119211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ebe0015-b3d7-4d87-a3a6-15e6bbbb2815 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:57.119698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ebe0015-b3d7-4d87-a3a6-15e6bbbb2815 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:57.120197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ebe0015-b3d7-4d87-a3a6-15e6bbbb2815 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:57.120888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ebe0015-b3d7-4d87-a3a6-15e6bbbb2815 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:57.121351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ebe0015-b3d7-4d87-a3a6-15e6bbbb2815 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:57.121815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ebe0015-b3d7-4d87-a3a6-15e6bbbb2815 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:57.165630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6a4fd21b-2afa-4087-b4b0-083b33841510 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:57.166616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6a4fd21b-2afa-4087-b4b0-083b33841510 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:57.174052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a4fd21b-2afa-4087-b4b0-083b33841510 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:57.174748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a4fd21b-2afa-4087-b4b0-083b33841510 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:57.175060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a4fd21b-2afa-4087-b4b0-083b33841510 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:57.175667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a4fd21b-2afa-4087-b4b0-083b33841510 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:57.200941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a4fd21b-2afa-4087-b4b0-083b33841510 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:57.202210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a4fd21b-2afa-4087-b4b0-083b33841510 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:57.273848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-2ebe0015-b3d7-4d87-a3a6-15e6bbbb2815 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:07:57.408753 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2ebe0015-b3d7-4d87-a3a6-15e6bbbb2815 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.317736 Oct 04 21:07:57.420292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6a4fd21b-2afa-4087-b4b0-083b33841510 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:57.421587 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 297/600] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Oct 4 21:07:57 2022] GET /compute/v2.1/servers => generated 1002 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:57.429533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dc7f443d-b3ac-4f80-824e-5dd711047684 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:57.430625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dc7f443d-b3ac-4f80-824e-5dd711047684 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:57.438654 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6a4fd21b-2afa-4087-b4b0-083b33841510 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1310 microversion: 2.1 time: 0.276654 Oct 04 21:07:57.454518 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 304/601] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:57 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1310 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:57.535577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dc7f443d-b3ac-4f80-824e-5dd711047684 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:57.543591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c0e25adf-725d-494d-9d22-86133cd480c5 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:57.543591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c0e25adf-725d-494d-9d22-86133cd480c5 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:57.547420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0e25adf-725d-494d-9d22-86133cd480c5 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:57.547947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0e25adf-725d-494d-9d22-86133cd480c5 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:57.548396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0e25adf-725d-494d-9d22-86133cd480c5 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:57.548666 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dc7f443d-b3ac-4f80-824e-5dd711047684 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d" status: 200 len: 1218 microversion: 2.1 time: 0.125213 Oct 04 21:07:57.549113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0e25adf-725d-494d-9d22-86133cd480c5 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:57.549607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0e25adf-725d-494d-9d22-86133cd480c5 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:57.550046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0e25adf-725d-494d-9d22-86133cd480c5 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:57.562364 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 298/602] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:57 2022] GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:57.599552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0e25adf-725d-494d-9d22-86133cd480c5 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:57.600038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0e25adf-725d-494d-9d22-86133cd480c5 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:57.600473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0e25adf-725d-494d-9d22-86133cd480c5 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:57.600920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-c0e25adf-725d-494d-9d22-86133cd480c5 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lazy-loading 'fault' on Instance uuid 3626e794-7b5c-40a7-b2af-07101d77ce62 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:07:57.647055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c0e25adf-725d-494d-9d22-86133cd480c5 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27554053d0174aa497fc09e07a859fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfef30006e947d18bf514bdadff52ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:57.655065 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c0e25adf-725d-494d-9d22-86133cd480c5 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 200 len: 1309 microversion: 2.1 time: 0.130689 Oct 04 21:07:57.655694 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 305/603] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:57 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 1309 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:57.871639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7568649e-37ee-43c9-9da2-f74c8e100df5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:57.872477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7568649e-37ee-43c9-9da2-f74c8e100df5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:57.880511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7568649e-37ee-43c9-9da2-f74c8e100df5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:57.881409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7568649e-37ee-43c9-9da2-f74c8e100df5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:57.882040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7568649e-37ee-43c9-9da2-f74c8e100df5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:57.895020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7568649e-37ee-43c9-9da2-f74c8e100df5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:57.895020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7568649e-37ee-43c9-9da2-f74c8e100df5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:57.895020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7568649e-37ee-43c9-9da2-f74c8e100df5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:57.991201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9f418c92-838b-4544-b625-4552ca14c48e tempest-AbsoluteLimitsNegativeTestJSON-180090659 tempest-AbsoluteLimitsNegativeTestJSON-180090659-project] Calling method '.version_select at 0x7f579072eaf0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:58.011109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f418c92-838b-4544-b625-4552ca14c48e tempest-AbsoluteLimitsNegativeTestJSON-180090659 tempest-AbsoluteLimitsNegativeTestJSON-180090659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.011910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f418c92-838b-4544-b625-4552ca14c48e tempest-AbsoluteLimitsNegativeTestJSON-180090659 tempest-AbsoluteLimitsNegativeTestJSON-180090659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.012576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f418c92-838b-4544-b625-4552ca14c48e tempest-AbsoluteLimitsNegativeTestJSON-180090659 tempest-AbsoluteLimitsNegativeTestJSON-180090659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.013544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f418c92-838b-4544-b625-4552ca14c48e tempest-AbsoluteLimitsNegativeTestJSON-180090659 tempest-AbsoluteLimitsNegativeTestJSON-180090659-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.017653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f418c92-838b-4544-b625-4552ca14c48e tempest-AbsoluteLimitsNegativeTestJSON-180090659 tempest-AbsoluteLimitsNegativeTestJSON-180090659-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.019157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f418c92-838b-4544-b625-4552ca14c48e tempest-AbsoluteLimitsNegativeTestJSON-180090659 tempest-AbsoluteLimitsNegativeTestJSON-180090659-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.039396 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9f418c92-838b-4544-b625-4552ca14c48e tempest-AbsoluteLimitsNegativeTestJSON-180090659 tempest-AbsoluteLimitsNegativeTestJSON-180090659-project] 10.222.0.30 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.200088 Oct 04 21:07:58.040102 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 299/604] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 21:07:57 2022] GET /compute/v2.1/limits => generated 511 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:58.045530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-480ed91f-2e43-4997-ad16-e8e603091f23 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:58.050731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-480ed91f-2e43-4997-ad16-e8e603091f23 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:58.052853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480ed91f-2e43-4997-ad16-e8e603091f23 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.053578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480ed91f-2e43-4997-ad16-e8e603091f23 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.054179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480ed91f-2e43-4997-ad16-e8e603091f23 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.055147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480ed91f-2e43-4997-ad16-e8e603091f23 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.058405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480ed91f-2e43-4997-ad16-e8e603091f23 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.058657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480ed91f-2e43-4997-ad16-e8e603091f23 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.090453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7568649e-37ee-43c9-9da2-f74c8e100df5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:58.111196 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7568649e-37ee-43c9-9da2-f74c8e100df5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1312 microversion: 2.1 time: 0.236778 Oct 04 21:07:58.111196 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 306/605] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:57 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1312 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:58.115444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9ad507d8-d537-40dc-95cf-4d7530cf34b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:58.116073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9ad507d8-d537-40dc-95cf-4d7530cf34b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:58.127787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ad507d8-d537-40dc-95cf-4d7530cf34b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.128361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ad507d8-d537-40dc-95cf-4d7530cf34b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.129018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ad507d8-d537-40dc-95cf-4d7530cf34b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.129814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ad507d8-d537-40dc-95cf-4d7530cf34b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.130274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ad507d8-d537-40dc-95cf-4d7530cf34b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.130699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ad507d8-d537-40dc-95cf-4d7530cf34b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.140529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-480ed91f-2e43-4997-ad16-e8e603091f23 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:58.150431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-480ed91f-2e43-4997-ad16-e8e603091f23 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:58.151264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:58.152802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-480ed91f-2e43-4997-ad16-e8e603091f23 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:58.159380 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-480ed91f-2e43-4997-ad16-e8e603091f23 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.117728 Oct 04 21:07:58.160089 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 300/606] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:58 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:58.165133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b9cb0136-e71a-460a-88e1-15d814a72c78 tempest-AbsoluteLimitsNegativeTestJSON-180090659 tempest-AbsoluteLimitsNegativeTestJSON-180090659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1517585686", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:58.240262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-b9cb0136-e71a-460a-88e1-15d814a72c78 tempest-AbsoluteLimitsNegativeTestJSON-180090659 tempest-AbsoluteLimitsNegativeTestJSON-180090659-project] validate_networks() for None {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:07:58.367990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9ad507d8-d537-40dc-95cf-4d7530cf34b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:58.377077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9ad507d8-d537-40dc-95cf-4d7530cf34b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:58.378867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9ad507d8-d537-40dc-95cf-4d7530cf34b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:58.380008 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9ad507d8-d537-40dc-95cf-4d7530cf34b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1362 microversion: 2.25 time: 0.269358 Oct 04 21:07:58.382270 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 307/607] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:58 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:58.464247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-66ebde43-2635-4840-94b3-8c31dfb89a5d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:58.464876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-66ebde43-2635-4840-94b3-8c31dfb89a5d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:58.471703 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66ebde43-2635-4840-94b3-8c31dfb89a5d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.472415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66ebde43-2635-4840-94b3-8c31dfb89a5d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.472852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66ebde43-2635-4840-94b3-8c31dfb89a5d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.473957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66ebde43-2635-4840-94b3-8c31dfb89a5d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.474614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66ebde43-2635-4840-94b3-8c31dfb89a5d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.475204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66ebde43-2635-4840-94b3-8c31dfb89a5d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.500306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-b9cb0136-e71a-460a-88e1-15d814a72c78 tempest-AbsoluteLimitsNegativeTestJSON-180090659 tempest-AbsoluteLimitsNegativeTestJSON-180090659-project] Getting quotas for project 26e4be6d5bf34515a62314dff5a80117. Resources: dict_keys(['metadata_items']) {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:58.507668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-b9cb0136-e71a-460a-88e1-15d814a72c78 tempest-AbsoluteLimitsNegativeTestJSON-180090659 tempest-AbsoluteLimitsNegativeTestJSON-180090659-project] Getting quotas for user 0752af3d84bf41a282251d4ead30385e and project 26e4be6d5bf34515a62314dff5a80117. Resources: dict_keys(['metadata_items']) {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:58.523745 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-b9cb0136-e71a-460a-88e1-15d814a72c78 tempest-AbsoluteLimitsNegativeTestJSON-180090659 tempest-AbsoluteLimitsNegativeTestJSON-180090659-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b9cb0136-e71a-460a-88e1-15d814a72c78 tempest-AbsoluteLimitsNegativeTestJSON-180090659 tempest-AbsoluteLimitsNegativeTestJSON-180090659-project] Request method failure captured: Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 1752 Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKCtYQvRufkqRNu1PivpKJDdM9tV2ERqLvTZH4JFsKQHesiyXcWJz8sXpMRGGbn_N5xfnxal5-FNVVqH1BpyJqf_Y6IX_-tVqftk-qG8Rh20pLcMDjIQx4kkC6ouCArSf7nrg1b4TO-3cXMmesej-FFAvZ2-oNwGmKAsoH9k-NCbek8 Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 26e4be6d5bf34515a62314dff5a80117 Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-180090659 Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/26e4be6d5bf34515a62314dff5a80117"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_26e4be6d5bf34515a62314dff5a80117"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/26e4be6d5bf34515a62314dff5a80117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/26e4be6d5bf34515a62314dff5a80117"}]}] Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-180090659 Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 26e4be6d5bf34515a62314dff5a80117 Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-180090659 Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-180090659-project Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 0752af3d84bf41a282251d4ead30385e Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-180090659-project Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1517585686", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:07:58.527997 n-d-860282-1 devstack@n-api.service[122757]: exception: Maximum number of metadata items exceeds 128 Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1517585686', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:58.530698 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:58.540471 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:58.540471 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:07:58.540471 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 21:07:58.540471 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 21:07:58.540471 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 04 21:07:58.540471 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.540471 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:58.540471 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.540471 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:58.540471 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:58.540471 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:58.540471 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:58.540471 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:58.540471 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 04 21:07:58.540471 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.540471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b9cb0136-e71a-460a-88e1-15d814a72c78 tempest-AbsoluteLimitsNegativeTestJSON-180090659 tempest-AbsoluteLimitsNegativeTestJSON-180090659-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:58.540471 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b9cb0136-e71a-460a-88e1-15d814a72c78 tempest-AbsoluteLimitsNegativeTestJSON-180090659 tempest-AbsoluteLimitsNegativeTestJSON-180090659-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.376070 Oct 04 21:07:58.540471 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 301/608] 10.222.0.30 () {60 vars in 1148 bytes} [Tue Oct 4 21:07:58 2022] POST /compute/v2.1/servers => generated 87 bytes in 377 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:07:58.574871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2e01fbdd-7412-434d-b12a-63c38c3cb14f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:58.578066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2e01fbdd-7412-434d-b12a-63c38c3cb14f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:58.718669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2e01fbdd-7412-434d-b12a-63c38c3cb14f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:58.727331 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2e01fbdd-7412-434d-b12a-63c38c3cb14f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d" status: 200 len: 1218 microversion: 2.1 time: 0.158513 Oct 04 21:07:58.730076 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 302/609] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:58 2022] GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d => generated 1218 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:58.740668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-89feb0f9-feff-4d49-b1d5-d602dcb7f000 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:58.741248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-89feb0f9-feff-4d49-b1d5-d602dcb7f000 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:58.749370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89feb0f9-feff-4d49-b1d5-d602dcb7f000 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.758533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89feb0f9-feff-4d49-b1d5-d602dcb7f000 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.761736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89feb0f9-feff-4d49-b1d5-d602dcb7f000 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.763139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-66ebde43-2635-4840-94b3-8c31dfb89a5d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:58.763660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89feb0f9-feff-4d49-b1d5-d602dcb7f000 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.764581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89feb0f9-feff-4d49-b1d5-d602dcb7f000 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.765033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89feb0f9-feff-4d49-b1d5-d602dcb7f000 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.775372 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-66ebde43-2635-4840-94b3-8c31dfb89a5d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1310 microversion: 2.1 time: 0.315253 Oct 04 21:07:58.776263 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 308/610] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:58 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1310 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:58.781685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-2b42020a-3520-4433-becf-66b506467a20 req-b649cd0d-cbd0-4ddf-95bf-bc5419f0bd16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e14e448-c2c9-4904-823a-4febd5b537b2", "name": "network-vif-plugged", "status": "completed", "tag": "fd07f72b-4442-4b44-b1f2-27824c689273"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:58.783729 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-89feb0f9-feff-4d49-b1d5-d602dcb7f000 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] HTTP exception thrown: Instance 3626e794-7b5c-40a7-b2af-07101d77ce62 could not be found. Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-89feb0f9-feff-4d49-b1d5-d602dcb7f000 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Request method failure captured: Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 HTTP/1.1 Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKB2gp6fJBasMsFvCZe2B7jdkCLOEYv82xbxBYFtdaXeHV6iPTdW-jNcJ-Eh0dKsmNTfNkgNfW9HyMMMPw3_Ua576zW9GAvB7emDSNSEc0cLLPHOGa8-Fv8KydRx4NUWVAoJTe6iF41zumgu2yvq0GcxRG7VLI04Evm_d3p6_J8EsxQ Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 4cfef30006e947d18bf514bdadff52ec Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-DeleteServersAdminTestJSON-819880978 Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4cfef30006e947d18bf514bdadff52ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4cfef30006e947d18bf514bdadff52ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4cfef30006e947d18bf514bdadff52ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4cfef30006e947d18bf514bdadff52ec"}]}] Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-DeleteServersAdminTestJSON-819880978 Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 4cfef30006e947d18bf514bdadff52ec Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-819880978 Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-DeleteServersAdminTestJSON-819880978-project Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 27554053d0174aa497fc09e07a859fba Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-DeleteServersAdminTestJSON-819880978-project Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 3626e794-7b5c-40a7-b2af-07101d77ce62 could not be found. Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '3626e794-7b5c-40a7-b2af-07101d77ce62'} Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3626e794-7b5c-40a7-b2af-07101d77ce62 could not be found. Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3626e794-7b5c-40a7-b2af-07101d77ce62 could not be found. Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:58.785643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.790369 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:58.790369 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:58.790369 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:58.790369 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:58.790369 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:58.790369 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3626e794-7b5c-40a7-b2af-07101d77ce62 could not be found. Oct 04 21:07:58.790369 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.790369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-89feb0f9-feff-4d49-b1d5-d602dcb7f000 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Returning 404 to user: Instance 3626e794-7b5c-40a7-b2af-07101d77ce62 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:58.790369 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-89feb0f9-feff-4d49-b1d5-d602dcb7f000 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 404 len: 111 microversion: 2.1 time: 0.055151 Oct 04 21:07:58.795563 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 303/611] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:58 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:07:58.798583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2b42020a-3520-4433-becf-66b506467a20 req-b649cd0d-cbd0-4ddf-95bf-bc5419f0bd16 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.799055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2b42020a-3520-4433-becf-66b506467a20 req-b649cd0d-cbd0-4ddf-95bf-bc5419f0bd16 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.799830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2b42020a-3520-4433-becf-66b506467a20 req-b649cd0d-cbd0-4ddf-95bf-bc5419f0bd16 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.800622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-97ec826e-69c3-471f-b36c-b2862b9800ea tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:58.801206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-97ec826e-69c3-471f-b36c-b2862b9800ea tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:58.809011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97ec826e-69c3-471f-b36c-b2862b9800ea tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.815216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97ec826e-69c3-471f-b36c-b2862b9800ea tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.815216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97ec826e-69c3-471f-b36c-b2862b9800ea tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.815216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97ec826e-69c3-471f-b36c-b2862b9800ea tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.815216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97ec826e-69c3-471f-b36c-b2862b9800ea tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.815216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97ec826e-69c3-471f-b36c-b2862b9800ea tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.816691 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-2b42020a-3520-4433-becf-66b506467a20 req-b649cd0d-cbd0-4ddf-95bf-bc5419f0bd16 service nova] Creating event network-vif-plugged:fd07f72b-4442-4b44-b1f2-27824c689273 for instance 6e14e448-c2c9-4904-823a-4febd5b537b2 on n-h1-860282-1 Oct 04 21:07:58.821853 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-2b42020a-3520-4433-becf-66b506467a20 req-b649cd0d-cbd0-4ddf-95bf-bc5419f0bd16 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044223 Oct 04 21:07:58.823025 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 309/612] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:58.831462 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-97ec826e-69c3-471f-b36c-b2862b9800ea tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] HTTP exception thrown: Instance 3626e794-7b5c-40a7-b2af-07101d77ce62 could not be found. Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-97ec826e-69c3-471f-b36c-b2862b9800ea tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Request method failure captured: Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 HTTP/1.1 Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKB2gp6fJBasMsFvCZe2B7jdkCLOEYv82xbxBYFtdaXeHV6iPTdW-jNcJ-Eh0dKsmNTfNkgNfW9HyMMMPw3_Ua576zW9GAvB7emDSNSEc0cLLPHOGa8-Fv8KydRx4NUWVAoJTe6iF41zumgu2yvq0GcxRG7VLI04Evm_d3p6_J8EsxQ Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 4cfef30006e947d18bf514bdadff52ec Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-DeleteServersAdminTestJSON-819880978 Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4cfef30006e947d18bf514bdadff52ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4cfef30006e947d18bf514bdadff52ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4cfef30006e947d18bf514bdadff52ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4cfef30006e947d18bf514bdadff52ec"}]}] Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-DeleteServersAdminTestJSON-819880978 Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 4cfef30006e947d18bf514bdadff52ec Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-819880978 Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-DeleteServersAdminTestJSON-819880978-project Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 27554053d0174aa497fc09e07a859fba Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-DeleteServersAdminTestJSON-819880978-project Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 3626e794-7b5c-40a7-b2af-07101d77ce62 could not be found. Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '3626e794-7b5c-40a7-b2af-07101d77ce62'} Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3626e794-7b5c-40a7-b2af-07101d77ce62 could not be found. Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:07:58.833131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:07:58.837482 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3626e794-7b5c-40a7-b2af-07101d77ce62 could not be found. Oct 04 21:07:58.837482 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.837482 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:58.837482 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.837482 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:58.837482 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:58.837482 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:58.837482 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:58.837482 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:58.837482 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3626e794-7b5c-40a7-b2af-07101d77ce62 could not be found. Oct 04 21:07:58.837482 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.837482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-97ec826e-69c3-471f-b36c-b2862b9800ea tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Returning 404 to user: Instance 3626e794-7b5c-40a7-b2af-07101d77ce62 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:58.837482 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-97ec826e-69c3-471f-b36c-b2862b9800ea tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 404 len: 111 microversion: 2.1 time: 0.038643 Oct 04 21:07:58.842688 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 304/613] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:07:58 2022] DELETE /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:07:58.851166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fea5d4c4-ac53-432f-abbe-5643dd0ebc1b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:58.851907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fea5d4c4-ac53-432f-abbe-5643dd0ebc1b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: 3626e794-7b5c-40a7-b2af-07101d77ce62] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:58.860721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fea5d4c4-ac53-432f-abbe-5643dd0ebc1b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.861515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fea5d4c4-ac53-432f-abbe-5643dd0ebc1b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.862099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fea5d4c4-ac53-432f-abbe-5643dd0ebc1b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.863201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fea5d4c4-ac53-432f-abbe-5643dd0ebc1b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.863910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fea5d4c4-ac53-432f-abbe-5643dd0ebc1b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.864745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fea5d4c4-ac53-432f-abbe-5643dd0ebc1b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.879791 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-fea5d4c4-ac53-432f-abbe-5643dd0ebc1b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] HTTP exception thrown: Instance 3626e794-7b5c-40a7-b2af-07101d77ce62 could not be found. Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fea5d4c4-ac53-432f-abbe-5643dd0ebc1b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Request method failure captured: Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 HTTP/1.1 Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKB2gp6fJBasMsFvCZe2B7jdkCLOEYv82xbxBYFtdaXeHV6iPTdW-jNcJ-Eh0dKsmNTfNkgNfW9HyMMMPw3_Ua576zW9GAvB7emDSNSEc0cLLPHOGa8-Fv8KydRx4NUWVAoJTe6iF41zumgu2yvq0GcxRG7VLI04Evm_d3p6_J8EsxQ Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 4cfef30006e947d18bf514bdadff52ec Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-DeleteServersAdminTestJSON-819880978 Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4cfef30006e947d18bf514bdadff52ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4cfef30006e947d18bf514bdadff52ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4cfef30006e947d18bf514bdadff52ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4cfef30006e947d18bf514bdadff52ec"}]}] Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-DeleteServersAdminTestJSON-819880978 Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 4cfef30006e947d18bf514bdadff52ec Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-819880978 Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-DeleteServersAdminTestJSON-819880978-project Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 27554053d0174aa497fc09e07a859fba Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-DeleteServersAdminTestJSON-819880978-project Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 3626e794-7b5c-40a7-b2af-07101d77ce62 could not be found. Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '3626e794-7b5c-40a7-b2af-07101d77ce62'} Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3626e794-7b5c-40a7-b2af-07101d77ce62 could not be found. Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3626e794-7b5c-40a7-b2af-07101d77ce62 could not be found. Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:58.881650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.886249 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:58.886249 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:58.886249 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:58.886249 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:58.886249 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:58.886249 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3626e794-7b5c-40a7-b2af-07101d77ce62 could not be found. Oct 04 21:07:58.886249 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.886249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fea5d4c4-ac53-432f-abbe-5643dd0ebc1b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Returning 404 to user: Instance 3626e794-7b5c-40a7-b2af-07101d77ce62 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:58.886249 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fea5d4c4-ac53-432f-abbe-5643dd0ebc1b tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62" status: 404 len: 111 microversion: 2.1 time: 0.038954 Oct 04 21:07:58.887369 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 310/614] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:58 2022] GET /compute/v2.1/servers/3626e794-7b5c-40a7-b2af-07101d77ce62 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:07:58.901312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d8b57b9e-00ff-49f9-bd20-e2c427ab0f63 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:58.901848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d8b57b9e-00ff-49f9-bd20-e2c427ab0f63 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:58.915459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8b57b9e-00ff-49f9-bd20-e2c427ab0f63 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.915992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8b57b9e-00ff-49f9-bd20-e2c427ab0f63 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.916469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8b57b9e-00ff-49f9-bd20-e2c427ab0f63 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.917873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8b57b9e-00ff-49f9-bd20-e2c427ab0f63 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.918340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8b57b9e-00ff-49f9-bd20-e2c427ab0f63 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.918775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8b57b9e-00ff-49f9-bd20-e2c427ab0f63 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.935772 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-d8b57b9e-00ff-49f9-bd20-e2c427ab0f63 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] HTTP exception thrown: Instance f93b80a9-1170-47c7-b177-93f1ea350805 could not be found. Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d8b57b9e-00ff-49f9-bd20-e2c427ab0f63 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Request method failure captured: Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 HTTP/1.1 Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKB2gp6fJBasMsFvCZe2B7jdkCLOEYv82xbxBYFtdaXeHV6iPTdW-jNcJ-Eh0dKsmNTfNkgNfW9HyMMMPw3_Ua576zW9GAvB7emDSNSEc0cLLPHOGa8-Fv8KydRx4NUWVAoJTe6iF41zumgu2yvq0GcxRG7VLI04Evm_d3p6_J8EsxQ Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 4cfef30006e947d18bf514bdadff52ec Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-DeleteServersAdminTestJSON-819880978 Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4cfef30006e947d18bf514bdadff52ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4cfef30006e947d18bf514bdadff52ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4cfef30006e947d18bf514bdadff52ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4cfef30006e947d18bf514bdadff52ec"}]}] Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-DeleteServersAdminTestJSON-819880978 Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 4cfef30006e947d18bf514bdadff52ec Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-819880978 Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-DeleteServersAdminTestJSON-819880978-project Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 27554053d0174aa497fc09e07a859fba Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-DeleteServersAdminTestJSON-819880978-project Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance f93b80a9-1170-47c7-b177-93f1ea350805 could not be found. Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'f93b80a9-1170-47c7-b177-93f1ea350805'} Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f93b80a9-1170-47c7-b177-93f1ea350805 could not be found. Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:07:58.937627 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:07:58.942333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f93b80a9-1170-47c7-b177-93f1ea350805 could not be found. Oct 04 21:07:58.942333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.942333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:58.942333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.942333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:58.942333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:58.942333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:58.942333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:58.942333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:58.942333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f93b80a9-1170-47c7-b177-93f1ea350805 could not be found. Oct 04 21:07:58.942333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.942333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d8b57b9e-00ff-49f9-bd20-e2c427ab0f63 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Returning 404 to user: Instance f93b80a9-1170-47c7-b177-93f1ea350805 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:58.942333 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d8b57b9e-00ff-49f9-bd20-e2c427ab0f63 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805" status: 404 len: 111 microversion: 2.1 time: 0.047376 Oct 04 21:07:58.942333 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 305/615] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:07:58 2022] DELETE /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:07:58.948302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8da987fe-3bd1-4735-acb3-fc5fbdd8be16 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:58.948921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8da987fe-3bd1-4735-acb3-fc5fbdd8be16 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] [instance: f93b80a9-1170-47c7-b177-93f1ea350805] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:58.956266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8da987fe-3bd1-4735-acb3-fc5fbdd8be16 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.956802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8da987fe-3bd1-4735-acb3-fc5fbdd8be16 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.957244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8da987fe-3bd1-4735-acb3-fc5fbdd8be16 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.958049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8da987fe-3bd1-4735-acb3-fc5fbdd8be16 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.958870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8da987fe-3bd1-4735-acb3-fc5fbdd8be16 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.959460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8da987fe-3bd1-4735-acb3-fc5fbdd8be16 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.980852 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-8da987fe-3bd1-4735-acb3-fc5fbdd8be16 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] HTTP exception thrown: Instance f93b80a9-1170-47c7-b177-93f1ea350805 could not be found. Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8da987fe-3bd1-4735-acb3-fc5fbdd8be16 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Request method failure captured: Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 HTTP/1.1 Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKB2gp6fJBasMsFvCZe2B7jdkCLOEYv82xbxBYFtdaXeHV6iPTdW-jNcJ-Eh0dKsmNTfNkgNfW9HyMMMPw3_Ua576zW9GAvB7emDSNSEc0cLLPHOGa8-Fv8KydRx4NUWVAoJTe6iF41zumgu2yvq0GcxRG7VLI04Evm_d3p6_J8EsxQ Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 4cfef30006e947d18bf514bdadff52ec Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-DeleteServersAdminTestJSON-819880978 Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4cfef30006e947d18bf514bdadff52ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4cfef30006e947d18bf514bdadff52ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4cfef30006e947d18bf514bdadff52ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4cfef30006e947d18bf514bdadff52ec"}]}] Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-DeleteServersAdminTestJSON-819880978 Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 4cfef30006e947d18bf514bdadff52ec Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-819880978 Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-DeleteServersAdminTestJSON-819880978-project Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 27554053d0174aa497fc09e07a859fba Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-DeleteServersAdminTestJSON-819880978-project Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance f93b80a9-1170-47c7-b177-93f1ea350805 could not be found. Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'f93b80a9-1170-47c7-b177-93f1ea350805'} Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f93b80a9-1170-47c7-b177-93f1ea350805 could not be found. Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f93b80a9-1170-47c7-b177-93f1ea350805 could not be found. Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:58.982483 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.987468 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:58.987468 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:58.987468 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:58.987468 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:58.987468 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:58.987468 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f93b80a9-1170-47c7-b177-93f1ea350805 could not be found. Oct 04 21:07:58.987468 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:07:58.987468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8da987fe-3bd1-4735-acb3-fc5fbdd8be16 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] Returning 404 to user: Instance f93b80a9-1170-47c7-b177-93f1ea350805 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:58.987468 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8da987fe-3bd1-4735-acb3-fc5fbdd8be16 tempest-DeleteServersAdminTestJSON-819880978 tempest-DeleteServersAdminTestJSON-819880978-project] 10.222.0.30 "GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805" status: 404 len: 111 microversion: 2.1 time: 0.040201 Oct 04 21:07:58.989125 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 311/616] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:58 2022] GET /compute/v2.1/servers/f93b80a9-1170-47c7-b177-93f1ea350805 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:07:59.054604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-e7638f6d-0ce5-4158-bbc0-641253bd5c4f req-bce55094-8f9d-424e-a49d-b24f66e2c3f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6aaef31-56eb-458f-a142-992790ebe523", "tag": "894b83eb-5706-418c-bd1d-c3b0a4308370"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:59.064651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e7638f6d-0ce5-4158-bbc0-641253bd5c4f req-bce55094-8f9d-424e-a49d-b24f66e2c3f1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:59.065336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e7638f6d-0ce5-4158-bbc0-641253bd5c4f req-bce55094-8f9d-424e-a49d-b24f66e2c3f1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:59.065817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e7638f6d-0ce5-4158-bbc0-641253bd5c4f req-bce55094-8f9d-424e-a49d-b24f66e2c3f1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.077535 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-e7638f6d-0ce5-4158-bbc0-641253bd5c4f req-bce55094-8f9d-424e-a49d-b24f66e2c3f1 service nova] Creating event network-changed:894b83eb-5706-418c-bd1d-c3b0a4308370 for instance b6aaef31-56eb-458f-a142-992790ebe523 on n-h2-860282-1 Oct 04 21:07:59.083020 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-e7638f6d-0ce5-4158-bbc0-641253bd5c4f req-bce55094-8f9d-424e-a49d-b24f66e2c3f1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032879 Oct 04 21:07:59.083717 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 306/617] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:59.130388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e50c522a-11d8-41bc-a9c1-e502ca739504 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:59.130916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e50c522a-11d8-41bc-a9c1-e502ca739504 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:59.136670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e50c522a-11d8-41bc-a9c1-e502ca739504 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:59.137148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e50c522a-11d8-41bc-a9c1-e502ca739504 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:59.137612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e50c522a-11d8-41bc-a9c1-e502ca739504 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.138299 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e50c522a-11d8-41bc-a9c1-e502ca739504 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:59.139287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e50c522a-11d8-41bc-a9c1-e502ca739504 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:59.140100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e50c522a-11d8-41bc-a9c1-e502ca739504 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.189875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-69a7155b-554c-408c-9735-f05b70fc2728 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:59.190911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-69a7155b-554c-408c-9735-f05b70fc2728 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:59.202874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69a7155b-554c-408c-9735-f05b70fc2728 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:59.203517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69a7155b-554c-408c-9735-f05b70fc2728 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:59.204635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69a7155b-554c-408c-9735-f05b70fc2728 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.205481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69a7155b-554c-408c-9735-f05b70fc2728 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:59.206183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69a7155b-554c-408c-9735-f05b70fc2728 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:59.206845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69a7155b-554c-408c-9735-f05b70fc2728 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.298608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-69a7155b-554c-408c-9735-f05b70fc2728 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:59.311585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-69a7155b-554c-408c-9735-f05b70fc2728 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:59.313457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-69a7155b-554c-408c-9735-f05b70fc2728 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:59.320528 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-69a7155b-554c-408c-9735-f05b70fc2728 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.136130 Oct 04 21:07:59.324055 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 307/618] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:59 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:07:59.324394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e50c522a-11d8-41bc-a9c1-e502ca739504 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:59.340939 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e50c522a-11d8-41bc-a9c1-e502ca739504 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1312 microversion: 2.1 time: 0.214483 Oct 04 21:07:59.349671 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 312/619] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:59 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1312 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:59.413815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-265e128c-9942-44ef-ab49-2245f1473e5c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:59.414426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-265e128c-9942-44ef-ab49-2245f1473e5c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:59.419816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:59.422026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-265e128c-9942-44ef-ab49-2245f1473e5c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:59.422571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-265e128c-9942-44ef-ab49-2245f1473e5c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:59.423006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-265e128c-9942-44ef-ab49-2245f1473e5c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.423703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-265e128c-9942-44ef-ab49-2245f1473e5c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:59.424214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-265e128c-9942-44ef-ab49-2245f1473e5c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:59.424636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-265e128c-9942-44ef-ab49-2245f1473e5c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.636695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-265e128c-9942-44ef-ab49-2245f1473e5c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:59.642175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:59.649160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-265e128c-9942-44ef-ab49-2245f1473e5c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:59.650645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-265e128c-9942-44ef-ab49-2245f1473e5c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:59.658073 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-265e128c-9942-44ef-ab49-2245f1473e5c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1362 microversion: 2.25 time: 0.244142 Oct 04 21:07:59.660734 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 308/620] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:59 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:59.758398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ffd930a0-7bc5-4d48-ab6f-eb386276a1a2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:59.759231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ffd930a0-7bc5-4d48-ab6f-eb386276a1a2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:59.767997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffd930a0-7bc5-4d48-ab6f-eb386276a1a2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:59.769415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffd930a0-7bc5-4d48-ab6f-eb386276a1a2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:59.770759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffd930a0-7bc5-4d48-ab6f-eb386276a1a2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.771675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffd930a0-7bc5-4d48-ab6f-eb386276a1a2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:59.772731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffd930a0-7bc5-4d48-ab6f-eb386276a1a2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:59.773334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffd930a0-7bc5-4d48-ab6f-eb386276a1a2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.800282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-df2b9fe5-60d7-4b2b-8e07-c736276cf802 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:59.800896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-df2b9fe5-60d7-4b2b-8e07-c736276cf802 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:59.817770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df2b9fe5-60d7-4b2b-8e07-c736276cf802 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:59.818115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df2b9fe5-60d7-4b2b-8e07-c736276cf802 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:59.818560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df2b9fe5-60d7-4b2b-8e07-c736276cf802 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.819461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df2b9fe5-60d7-4b2b-8e07-c736276cf802 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:59.820082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df2b9fe5-60d7-4b2b-8e07-c736276cf802 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:59.820521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df2b9fe5-60d7-4b2b-8e07-c736276cf802 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.858602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ffd930a0-7bc5-4d48-ab6f-eb386276a1a2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:59.868619 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ffd930a0-7bc5-4d48-ab6f-eb386276a1a2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d" status: 200 len: 1222 microversion: 2.1 time: 0.115467 Oct 04 21:07:59.874018 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 313/621] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:59 2022] GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d => generated 1222 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:59.987177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-df2b9fe5-60d7-4b2b-8e07-c736276cf802 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:59.994886 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-df2b9fe5-60d7-4b2b-8e07-c736276cf802 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1310 microversion: 2.1 time: 0.198787 Oct 04 21:08:00.018799 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 309/622] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:59 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1310 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:00.353310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6beb6014-c24f-4c8c-8889-952d6d9a6f05 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:00.354005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6beb6014-c24f-4c8c-8889-952d6d9a6f05 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:00.360855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6beb6014-c24f-4c8c-8889-952d6d9a6f05 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:00.361357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6beb6014-c24f-4c8c-8889-952d6d9a6f05 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:00.361831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6beb6014-c24f-4c8c-8889-952d6d9a6f05 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:00.362527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6beb6014-c24f-4c8c-8889-952d6d9a6f05 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:00.363616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6beb6014-c24f-4c8c-8889-952d6d9a6f05 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:00.364214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6beb6014-c24f-4c8c-8889-952d6d9a6f05 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:00.366545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6a0aabad-9cac-493a-8674-c8a2273a7981 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:00.367490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6a0aabad-9cac-493a-8674-c8a2273a7981 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:00.374844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a0aabad-9cac-493a-8674-c8a2273a7981 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:00.375882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a0aabad-9cac-493a-8674-c8a2273a7981 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:00.379927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a0aabad-9cac-493a-8674-c8a2273a7981 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:00.380838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a0aabad-9cac-493a-8674-c8a2273a7981 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:00.381381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a0aabad-9cac-493a-8674-c8a2273a7981 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:00.381904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a0aabad-9cac-493a-8674-c8a2273a7981 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:00.439105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6beb6014-c24f-4c8c-8889-952d6d9a6f05 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:00.452195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6beb6014-c24f-4c8c-8889-952d6d9a6f05 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:00.454927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6beb6014-c24f-4c8c-8889-952d6d9a6f05 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:00.468268 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6beb6014-c24f-4c8c-8889-952d6d9a6f05 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.118733 Oct 04 21:08:00.469818 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 314/623] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:00 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:00.581362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6a0aabad-9cac-493a-8674-c8a2273a7981 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:00.589443 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6a0aabad-9cac-493a-8674-c8a2273a7981 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1312 microversion: 2.1 time: 0.227429 Oct 04 21:08:00.590027 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 310/624] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:00 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1312 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:00.684193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8d08e530-583b-4c3d-bbee-552e105fc5ed tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:00.691591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8d08e530-583b-4c3d-bbee-552e105fc5ed tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:00.693825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d08e530-583b-4c3d-bbee-552e105fc5ed tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:00.694349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d08e530-583b-4c3d-bbee-552e105fc5ed tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:00.694739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d08e530-583b-4c3d-bbee-552e105fc5ed tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:00.695600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d08e530-583b-4c3d-bbee-552e105fc5ed tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:00.696053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d08e530-583b-4c3d-bbee-552e105fc5ed tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:00.696468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d08e530-583b-4c3d-bbee-552e105fc5ed tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:00.836869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-7ba98217-0c7f-47fd-b711-0f7513159ad8 req-f26c68cd-cafc-4a4f-b766-08897f802b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41063621-009d-455a-a56d-9ffbae52f46c", "name": "network-vif-plugged", "status": "completed", "tag": "165120d0-97d6-48bd-b2b4-6ab812848c0b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:00.843334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8d08e530-583b-4c3d-bbee-552e105fc5ed tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:00.854861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8d08e530-583b-4c3d-bbee-552e105fc5ed tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:00.860218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8d08e530-583b-4c3d-bbee-552e105fc5ed tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:00.860218 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8d08e530-583b-4c3d-bbee-552e105fc5ed tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1362 microversion: 2.25 time: 0.177364 Oct 04 21:08:00.860218 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 315/625] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:00 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:00.860473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7ba98217-0c7f-47fd-b711-0f7513159ad8 req-f26c68cd-cafc-4a4f-b766-08897f802b20 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:00.860473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7ba98217-0c7f-47fd-b711-0f7513159ad8 req-f26c68cd-cafc-4a4f-b766-08897f802b20 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:00.860736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7ba98217-0c7f-47fd-b711-0f7513159ad8 req-f26c68cd-cafc-4a4f-b766-08897f802b20 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:00.872423 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-7ba98217-0c7f-47fd-b711-0f7513159ad8 req-f26c68cd-cafc-4a4f-b766-08897f802b20 service nova] Creating event network-vif-plugged:165120d0-97d6-48bd-b2b4-6ab812848c0b for instance 41063621-009d-455a-a56d-9ffbae52f46c on n-h1-860282-1 Oct 04 21:08:00.879018 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-7ba98217-0c7f-47fd-b711-0f7513159ad8 req-f26c68cd-cafc-4a4f-b766-08897f802b20 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045721 Oct 04 21:08:00.879791 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 311/626] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:08:00.892245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7cdb71d9-648f-47a3-8431-bf2f389f5d21 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:00.892848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7cdb71d9-648f-47a3-8431-bf2f389f5d21 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:00.899800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cdb71d9-648f-47a3-8431-bf2f389f5d21 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:00.900380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cdb71d9-648f-47a3-8431-bf2f389f5d21 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:00.900927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cdb71d9-648f-47a3-8431-bf2f389f5d21 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:00.901745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cdb71d9-648f-47a3-8431-bf2f389f5d21 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:00.902272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cdb71d9-648f-47a3-8431-bf2f389f5d21 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:00.902779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cdb71d9-648f-47a3-8431-bf2f389f5d21 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:00.998464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7cdb71d9-648f-47a3-8431-bf2f389f5d21 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:01.006499 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7cdb71d9-648f-47a3-8431-bf2f389f5d21 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d" status: 200 len: 1214 microversion: 2.1 time: 0.118076 Oct 04 21:08:01.007095 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 316/627] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:00 2022] GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:01.027082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-54bb2b09-7b68-4e26-a410-f91b26d1252f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:01.027783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-54bb2b09-7b68-4e26-a410-f91b26d1252f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:01.035011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54bb2b09-7b68-4e26-a410-f91b26d1252f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:01.035592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54bb2b09-7b68-4e26-a410-f91b26d1252f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:01.036031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54bb2b09-7b68-4e26-a410-f91b26d1252f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:01.036723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54bb2b09-7b68-4e26-a410-f91b26d1252f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:01.037179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54bb2b09-7b68-4e26-a410-f91b26d1252f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:01.037649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54bb2b09-7b68-4e26-a410-f91b26d1252f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:01.171775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-54bb2b09-7b68-4e26-a410-f91b26d1252f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:01.179850 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-54bb2b09-7b68-4e26-a410-f91b26d1252f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1492 microversion: 2.1 time: 0.156839 Oct 04 21:08:01.180673 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 312/628] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:01 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1492 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:01.202989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-972babaf-94d8-483d-9d3f-0a3cc1e4e7f5 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:01.203794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-972babaf-94d8-483d-9d3f-0a3cc1e4e7f5 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:01.209550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-972babaf-94d8-483d-9d3f-0a3cc1e4e7f5 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:01.210045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-972babaf-94d8-483d-9d3f-0a3cc1e4e7f5 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:01.210484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-972babaf-94d8-483d-9d3f-0a3cc1e4e7f5 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:01.211185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-972babaf-94d8-483d-9d3f-0a3cc1e4e7f5 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:01.211645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-972babaf-94d8-483d-9d3f-0a3cc1e4e7f5 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:01.212073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-972babaf-94d8-483d-9d3f-0a3cc1e4e7f5 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:01.376137 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-972babaf-94d8-483d-9d3f-0a3cc1e4e7f5 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1643 microversion: 2.1 time: 0.177391 Oct 04 21:08:01.376719 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 317/629] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:01 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1643 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:01.405897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f84ef7b6-f228-4f65-96e1-20b269c086f8 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:01.406517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f84ef7b6-f228-4f65-96e1-20b269c086f8 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:01.413104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f84ef7b6-f228-4f65-96e1-20b269c086f8 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:01.413645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f84ef7b6-f228-4f65-96e1-20b269c086f8 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:01.414081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f84ef7b6-f228-4f65-96e1-20b269c086f8 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:01.414929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f84ef7b6-f228-4f65-96e1-20b269c086f8 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:01.415389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f84ef7b6-f228-4f65-96e1-20b269c086f8 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:01.415990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f84ef7b6-f228-4f65-96e1-20b269c086f8 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:01.500565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0a3cb8a8-ce90-485c-9082-5c5987939efe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:01.505892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0a3cb8a8-ce90-485c-9082-5c5987939efe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:01.524911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a3cb8a8-ce90-485c-9082-5c5987939efe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:01.525557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a3cb8a8-ce90-485c-9082-5c5987939efe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:01.526240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a3cb8a8-ce90-485c-9082-5c5987939efe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:01.540414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a3cb8a8-ce90-485c-9082-5c5987939efe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:01.540987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a3cb8a8-ce90-485c-9082-5c5987939efe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:01.541468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a3cb8a8-ce90-485c-9082-5c5987939efe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:01.624534 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f84ef7b6-f228-4f65-96e1-20b269c086f8 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1643 microversion: 2.1 time: 0.223683 Oct 04 21:08:01.630496 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 313/630] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:01 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1643 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:01.639605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7fe5398c-0961-4c14-ace7-44a63d50e9df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:01.645356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7fe5398c-0961-4c14-ace7-44a63d50e9df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:01.656147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0a3cb8a8-ce90-485c-9082-5c5987939efe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:01.660315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fe5398c-0961-4c14-ace7-44a63d50e9df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:01.662654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fe5398c-0961-4c14-ace7-44a63d50e9df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:01.662654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fe5398c-0961-4c14-ace7-44a63d50e9df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:01.662654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fe5398c-0961-4c14-ace7-44a63d50e9df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:01.662654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fe5398c-0961-4c14-ace7-44a63d50e9df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:01.663467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fe5398c-0961-4c14-ace7-44a63d50e9df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:01.665288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0a3cb8a8-ce90-485c-9082-5c5987939efe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:01.666811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0a3cb8a8-ce90-485c-9082-5c5987939efe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:01.672550 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0a3cb8a8-ce90-485c-9082-5c5987939efe tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.180181 Oct 04 21:08:01.673130 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 318/631] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:01 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:01.688813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0141a159-e6f0-4280-815d-834fecac4003 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:01.693385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0141a159-e6f0-4280-815d-834fecac4003 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:01.694244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0141a159-e6f0-4280-815d-834fecac4003 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:01.695545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0141a159-e6f0-4280-815d-834fecac4003 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:01.696887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0141a159-e6f0-4280-815d-834fecac4003 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:01.697474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0141a159-e6f0-4280-815d-834fecac4003 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:01.698071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0141a159-e6f0-4280-815d-834fecac4003 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:01.710515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:01.724613 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0141a159-e6f0-4280-815d-834fecac4003 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.041401 Oct 04 21:08:01.725471 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 319/632] 10.222.0.30 () {58 vars in 1176 bytes} [Tue Oct 4 21:08:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:01.737148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e091b4d8-82ec-42f5-8ac4-fcfc3b9fc05b tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:01.737658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e091b4d8-82ec-42f5-8ac4-fcfc3b9fc05b tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:01.743614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e091b4d8-82ec-42f5-8ac4-fcfc3b9fc05b tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:01.747151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e091b4d8-82ec-42f5-8ac4-fcfc3b9fc05b tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:01.747151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e091b4d8-82ec-42f5-8ac4-fcfc3b9fc05b tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:01.747151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e091b4d8-82ec-42f5-8ac4-fcfc3b9fc05b tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:01.747151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e091b4d8-82ec-42f5-8ac4-fcfc3b9fc05b tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:01.747151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e091b4d8-82ec-42f5-8ac4-fcfc3b9fc05b tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:01.867736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7fe5398c-0961-4c14-ace7-44a63d50e9df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:01.867736 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7fe5398c-0961-4c14-ace7-44a63d50e9df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1312 microversion: 2.1 time: 0.231838 Oct 04 21:08:01.867736 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 314/633] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:01 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1312 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:01.894193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3c5843c1-21c7-47fb-9bb1-0b0e567e713b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:01.894828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3c5843c1-21c7-47fb-9bb1-0b0e567e713b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:01.917577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c5843c1-21c7-47fb-9bb1-0b0e567e713b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:01.918268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c5843c1-21c7-47fb-9bb1-0b0e567e713b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:01.918901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c5843c1-21c7-47fb-9bb1-0b0e567e713b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:01.920822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c5843c1-21c7-47fb-9bb1-0b0e567e713b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:01.921973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c5843c1-21c7-47fb-9bb1-0b0e567e713b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:01.922587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c5843c1-21c7-47fb-9bb1-0b0e567e713b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:02.085144 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e091b4d8-82ec-42f5-8ac4-fcfc3b9fc05b tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2/action" status: 202 len: 0 microversion: 2.1 time: 0.350504 Oct 04 21:08:02.090756 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 320/634] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:08:01 2022] POST /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:08:02.098663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-de10c337-290f-4259-a134-a5b64bfde355 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:02.099820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-de10c337-290f-4259-a134-a5b64bfde355 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:02.106973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de10c337-290f-4259-a134-a5b64bfde355 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:02.107813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de10c337-290f-4259-a134-a5b64bfde355 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:02.108254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de10c337-290f-4259-a134-a5b64bfde355 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:02.109120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de10c337-290f-4259-a134-a5b64bfde355 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:02.109810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de10c337-290f-4259-a134-a5b64bfde355 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:02.117002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de10c337-290f-4259-a134-a5b64bfde355 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:02.140750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3c5843c1-21c7-47fb-9bb1-0b0e567e713b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:02.149216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3c5843c1-21c7-47fb-9bb1-0b0e567e713b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:02.151259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3c5843c1-21c7-47fb-9bb1-0b0e567e713b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:02.151830 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3c5843c1-21c7-47fb-9bb1-0b0e567e713b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1362 microversion: 2.25 time: 0.272737 Oct 04 21:08:02.152386 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 315/635] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:01 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:02.157684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1744869d-5d83-4da3-8fbc-119cde55f3f0 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:02.158540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1744869d-5d83-4da3-8fbc-119cde55f3f0 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:02.164707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1744869d-5d83-4da3-8fbc-119cde55f3f0 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:02.165194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1744869d-5d83-4da3-8fbc-119cde55f3f0 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:02.165688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1744869d-5d83-4da3-8fbc-119cde55f3f0 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:02.166565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1744869d-5d83-4da3-8fbc-119cde55f3f0 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:02.167022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1744869d-5d83-4da3-8fbc-119cde55f3f0 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:02.167445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1744869d-5d83-4da3-8fbc-119cde55f3f0 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:02.186367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-de10c337-290f-4259-a134-a5b64bfde355 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:02.194968 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-de10c337-290f-4259-a134-a5b64bfde355 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d" status: 200 len: 1270 microversion: 2.1 time: 0.102729 Oct 04 21:08:02.195557 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 321/636] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:02 2022] GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:02.323826 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1744869d-5d83-4da3-8fbc-119cde55f3f0 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1648 microversion: 2.1 time: 0.162713 Oct 04 21:08:02.323826 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 316/637] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:02 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1648 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:02.703306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-998ffbf4-a0c5-4058-8242-4363717ec42a tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:02.703955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-998ffbf4-a0c5-4058-8242-4363717ec42a tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:02.723658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998ffbf4-a0c5-4058-8242-4363717ec42a tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:02.729464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998ffbf4-a0c5-4058-8242-4363717ec42a tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:02.730153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998ffbf4-a0c5-4058-8242-4363717ec42a tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:02.731076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998ffbf4-a0c5-4058-8242-4363717ec42a tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:02.731721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998ffbf4-a0c5-4058-8242-4363717ec42a tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:02.732154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998ffbf4-a0c5-4058-8242-4363717ec42a tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:02.806909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-998ffbf4-a0c5-4058-8242-4363717ec42a tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:02.830186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-998ffbf4-a0c5-4058-8242-4363717ec42a tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:02.831997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-998ffbf4-a0c5-4058-8242-4363717ec42a tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:02.837833 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-998ffbf4-a0c5-4058-8242-4363717ec42a tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.139630 Oct 04 21:08:02.838679 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 322/638] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:02 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:02.892247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b9095f4c-a2b4-4aa7-9642-a82d738596f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:02.893136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b9095f4c-a2b4-4aa7-9642-a82d738596f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:02.907570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9095f4c-a2b4-4aa7-9642-a82d738596f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:02.908279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9095f4c-a2b4-4aa7-9642-a82d738596f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:02.908803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9095f4c-a2b4-4aa7-9642-a82d738596f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:02.911697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9095f4c-a2b4-4aa7-9642-a82d738596f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:02.912257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9095f4c-a2b4-4aa7-9642-a82d738596f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:02.912875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9095f4c-a2b4-4aa7-9642-a82d738596f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:03.177205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f770651e-e0e5-4143-be6b-014f79c29ef2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:03.177889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f770651e-e0e5-4143-be6b-014f79c29ef2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:03.186148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f770651e-e0e5-4143-be6b-014f79c29ef2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:03.191306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f770651e-e0e5-4143-be6b-014f79c29ef2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:03.191306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f770651e-e0e5-4143-be6b-014f79c29ef2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:03.191306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f770651e-e0e5-4143-be6b-014f79c29ef2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:03.191306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f770651e-e0e5-4143-be6b-014f79c29ef2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:03.191306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f770651e-e0e5-4143-be6b-014f79c29ef2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:03.204092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b9095f4c-a2b4-4aa7-9642-a82d738596f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:03.214665 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b9095f4c-a2b4-4aa7-9642-a82d738596f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1462 microversion: 2.1 time: 0.326229 Oct 04 21:08:03.230870 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 317/639] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:02 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1462 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:03.244257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f4e08e81-1ab9-4419-88f0-40e9fd0db32d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:03.245405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f4e08e81-1ab9-4419-88f0-40e9fd0db32d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:03.253255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4e08e81-1ab9-4419-88f0-40e9fd0db32d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:03.254395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4e08e81-1ab9-4419-88f0-40e9fd0db32d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:03.255186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4e08e81-1ab9-4419-88f0-40e9fd0db32d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:03.256164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4e08e81-1ab9-4419-88f0-40e9fd0db32d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:03.256860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4e08e81-1ab9-4419-88f0-40e9fd0db32d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:03.257597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4e08e81-1ab9-4419-88f0-40e9fd0db32d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:03.492307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f4e08e81-1ab9-4419-88f0-40e9fd0db32d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:03.503661 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f4e08e81-1ab9-4419-88f0-40e9fd0db32d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d" status: 200 len: 1278 microversion: 2.1 time: 0.270966 Oct 04 21:08:03.505846 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 318/640] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:03 2022] GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d => generated 1278 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:03.632809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f770651e-e0e5-4143-be6b-014f79c29ef2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:03.644725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f770651e-e0e5-4143-be6b-014f79c29ef2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:03.656355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f770651e-e0e5-4143-be6b-014f79c29ef2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:03.659683 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f770651e-e0e5-4143-be6b-014f79c29ef2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1362 microversion: 2.25 time: 0.486646 Oct 04 21:08:03.660785 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 323/641] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:03 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1362 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:03.665682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-144d5f2e-507a-41a1-a71f-b4808ca430c0 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:03.666657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-144d5f2e-507a-41a1-a71f-b4808ca430c0 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:03.674271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-144d5f2e-507a-41a1-a71f-b4808ca430c0 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:03.675207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-144d5f2e-507a-41a1-a71f-b4808ca430c0 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:03.675797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-144d5f2e-507a-41a1-a71f-b4808ca430c0 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:03.677009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-144d5f2e-507a-41a1-a71f-b4808ca430c0 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:03.678059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-144d5f2e-507a-41a1-a71f-b4808ca430c0 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:03.678640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-144d5f2e-507a-41a1-a71f-b4808ca430c0 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:03.753948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4f33f3ce-ac9d-4cd7-b34f-b30560277865 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:03.754586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4f33f3ce-ac9d-4cd7-b34f-b30560277865 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:03.765191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f33f3ce-ac9d-4cd7-b34f-b30560277865 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:03.765644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f33f3ce-ac9d-4cd7-b34f-b30560277865 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:03.766091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f33f3ce-ac9d-4cd7-b34f-b30560277865 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:03.766805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f33f3ce-ac9d-4cd7-b34f-b30560277865 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:03.767266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f33f3ce-ac9d-4cd7-b34f-b30560277865 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:03.767700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f33f3ce-ac9d-4cd7-b34f-b30560277865 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:03.950011 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-144d5f2e-507a-41a1-a71f-b4808ca430c0 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1628 microversion: 2.1 time: 0.287828 Oct 04 21:08:03.950767 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 324/642] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:03 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1628 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:03.964386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-82c21165-96f2-4411-b9ce-9ce15e7fca4e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:03.965312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-82c21165-96f2-4411-b9ce-9ce15e7fca4e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:03.975256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82c21165-96f2-4411-b9ce-9ce15e7fca4e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:03.975881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82c21165-96f2-4411-b9ce-9ce15e7fca4e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:03.976811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82c21165-96f2-4411-b9ce-9ce15e7fca4e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:03.977626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82c21165-96f2-4411-b9ce-9ce15e7fca4e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:03.978148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82c21165-96f2-4411-b9ce-9ce15e7fca4e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:03.978797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82c21165-96f2-4411-b9ce-9ce15e7fca4e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:04.075608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-82c21165-96f2-4411-b9ce-9ce15e7fca4e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:04.081354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:04.088263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-82c21165-96f2-4411-b9ce-9ce15e7fca4e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:04.090450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-82c21165-96f2-4411-b9ce-9ce15e7fca4e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:04.103613 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-82c21165-96f2-4411-b9ce-9ce15e7fca4e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.144868 Oct 04 21:08:04.104830 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 325/643] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:03 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:04.113780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e2fdc56c-6645-4b36-a41d-e8fcd47df4ad tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860282-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:04.117768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e2fdc56c-6645-4b36-a41d-e8fcd47df4ad tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:04.124776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2fdc56c-6645-4b36-a41d-e8fcd47df4ad tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:04.125820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2fdc56c-6645-4b36-a41d-e8fcd47df4ad tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:04.126621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2fdc56c-6645-4b36-a41d-e8fcd47df4ad tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:04.127593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2fdc56c-6645-4b36-a41d-e8fcd47df4ad tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:04.128763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2fdc56c-6645-4b36-a41d-e8fcd47df4ad tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:04.129692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2fdc56c-6645-4b36-a41d-e8fcd47df4ad tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:04.168557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-e2fdc56c-6645-4b36-a41d-e8fcd47df4ad tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lazy-loading 'flavor' on Instance uuid 6e14e448-c2c9-4904-823a-4febd5b537b2 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:04.185564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e2fdc56c-6645-4b36-a41d-e8fcd47df4ad tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Going to try to live migrate instance to n-h2-860282-1 {{(pid=122758) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:08:04.368825 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4f33f3ce-ac9d-4cd7-b34f-b30560277865 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1613 microversion: 2.1 time: 0.861427 Oct 04 21:08:04.369606 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 319/644] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:03 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1613 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:04.393067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-596bf390-036f-4f17-935b-80db4df4d466 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:04.393681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-596bf390-036f-4f17-935b-80db4df4d466 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:04.400835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-596bf390-036f-4f17-935b-80db4df4d466 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:04.401325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-596bf390-036f-4f17-935b-80db4df4d466 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:04.401823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-596bf390-036f-4f17-935b-80db4df4d466 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:04.402521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-596bf390-036f-4f17-935b-80db4df4d466 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:04.402974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-596bf390-036f-4f17-935b-80db4df4d466 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:04.403397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-596bf390-036f-4f17-935b-80db4df4d466 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:04.489652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-596bf390-036f-4f17-935b-80db4df4d466 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '46403f4804524b49b6e6a819eacf9316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f1585595be4d9a8ac10069615004c1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:04.490536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-596bf390-036f-4f17-935b-80db4df4d466 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] flavor_id is None. Assuming migration. {{(pid=122757) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 21:08:04.491759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-596bf390-036f-4f17-935b-80db4df4d466 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122757) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:08:04.991896 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-596bf390-036f-4f17-935b-80db4df4d466 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c/action" status: 202 len: 0 microversion: 2.1 time: 0.596729 Oct 04 21:08:04.994942 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 320/645] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:08:04 2022] POST /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:08:05.018167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-50675368-e9f8-4452-9849-4b0bce59f96a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:05.019457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-50675368-e9f8-4452-9849-4b0bce59f96a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:05.049934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50675368-e9f8-4452-9849-4b0bce59f96a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:05.055628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50675368-e9f8-4452-9849-4b0bce59f96a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:05.056651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50675368-e9f8-4452-9849-4b0bce59f96a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:05.058189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50675368-e9f8-4452-9849-4b0bce59f96a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:05.059073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50675368-e9f8-4452-9849-4b0bce59f96a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:05.059838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50675368-e9f8-4452-9849-4b0bce59f96a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:05.450628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-50675368-e9f8-4452-9849-4b0bce59f96a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:05.460892 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-50675368-e9f8-4452-9849-4b0bce59f96a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d" status: 200 len: 1318 microversion: 2.1 time: 0.463567 Oct 04 21:08:05.478050 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 321/646] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:04 2022] GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:05.478964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f1af04de-175e-43b0-8e6b-6e0df5f48187 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:05.479838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f1af04de-175e-43b0-8e6b-6e0df5f48187 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:05.487423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1af04de-175e-43b0-8e6b-6e0df5f48187 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:05.488167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1af04de-175e-43b0-8e6b-6e0df5f48187 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:05.488874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1af04de-175e-43b0-8e6b-6e0df5f48187 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:05.489908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1af04de-175e-43b0-8e6b-6e0df5f48187 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:05.490529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1af04de-175e-43b0-8e6b-6e0df5f48187 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:05.491075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1af04de-175e-43b0-8e6b-6e0df5f48187 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:06.084056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f1af04de-175e-43b0-8e6b-6e0df5f48187 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:06.111298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f1af04de-175e-43b0-8e6b-6e0df5f48187 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:06.116106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f1af04de-175e-43b0-8e6b-6e0df5f48187 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:06.121565 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f1af04de-175e-43b0-8e6b-6e0df5f48187 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1362 microversion: 2.25 time: 0.649965 Oct 04 21:08:06.124968 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 322/647] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:05 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1362 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:06.134134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-95d45f5c-87a8-42a1-9d45-0548458be783 req-94914f0c-feb1-45ab-b72d-17c39653a129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d4ebc0-b7ec-4481-ae12-df4530909f2d", "tag": "59e997dc-877a-4edb-8588-607e62851bd1"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:06.153986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-95d45f5c-87a8-42a1-9d45-0548458be783 req-94914f0c-feb1-45ab-b72d-17c39653a129 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:06.156654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-95d45f5c-87a8-42a1-9d45-0548458be783 req-94914f0c-feb1-45ab-b72d-17c39653a129 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:06.156654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-95d45f5c-87a8-42a1-9d45-0548458be783 req-94914f0c-feb1-45ab-b72d-17c39653a129 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:06.177826 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-95d45f5c-87a8-42a1-9d45-0548458be783 req-94914f0c-feb1-45ab-b72d-17c39653a129 service nova] Creating event network-changed:59e997dc-877a-4edb-8588-607e62851bd1 for instance 06d4ebc0-b7ec-4481-ae12-df4530909f2d on n-h2-860282-1 Oct 04 21:08:06.184032 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-95d45f5c-87a8-42a1-9d45-0548458be783 req-94914f0c-feb1-45ab-b72d-17c39653a129 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056062 Oct 04 21:08:06.185384 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 323/648] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:06.192320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bd02e4ca-357a-4a39-93f6-c3ab91214967 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:06.195537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bd02e4ca-357a-4a39-93f6-c3ab91214967 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:06.205538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd02e4ca-357a-4a39-93f6-c3ab91214967 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:06.206033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd02e4ca-357a-4a39-93f6-c3ab91214967 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:06.212231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd02e4ca-357a-4a39-93f6-c3ab91214967 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:06.212985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd02e4ca-357a-4a39-93f6-c3ab91214967 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:06.213481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd02e4ca-357a-4a39-93f6-c3ab91214967 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:06.213922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd02e4ca-357a-4a39-93f6-c3ab91214967 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:06.487713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bd02e4ca-357a-4a39-93f6-c3ab91214967 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:06.500381 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bd02e4ca-357a-4a39-93f6-c3ab91214967 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1471 microversion: 2.1 time: 0.310940 Oct 04 21:08:06.500381 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 324/649] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:06 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1471 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:06.503423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e3b8349e-40fc-4e4f-b6d5-79a82e35dc70 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:06.504241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e3b8349e-40fc-4e4f-b6d5-79a82e35dc70 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:06.510810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3b8349e-40fc-4e4f-b6d5-79a82e35dc70 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:06.511559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3b8349e-40fc-4e4f-b6d5-79a82e35dc70 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:06.512251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3b8349e-40fc-4e4f-b6d5-79a82e35dc70 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:06.513184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3b8349e-40fc-4e4f-b6d5-79a82e35dc70 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:06.514461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3b8349e-40fc-4e4f-b6d5-79a82e35dc70 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:06.515096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3b8349e-40fc-4e4f-b6d5-79a82e35dc70 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:06.520066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:06.822146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e3b8349e-40fc-4e4f-b6d5-79a82e35dc70 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:06.832029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e3b8349e-40fc-4e4f-b6d5-79a82e35dc70 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:06.833643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e3b8349e-40fc-4e4f-b6d5-79a82e35dc70 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:06.840847 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e3b8349e-40fc-4e4f-b6d5-79a82e35dc70 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.341174 Oct 04 21:08:06.841551 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 325/650] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:06 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:06.911690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e2ddde29-7706-46eb-b70c-a969f2675ee0 tempest-FlavorMetadataValidation-1022513459 tempest-FlavorMetadataValidation-1022513459-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-775257148", "id": 588084519, "os-flavor-access:is_public": "True"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:07.010458 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e2ddde29-7706-46eb-b70c-a969f2675ee0 tempest-FlavorMetadataValidation-1022513459 tempest-FlavorMetadataValidation-1022513459-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.167061 Oct 04 21:08:07.011099 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 326/651] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Oct 4 21:08:06 2022] POST /compute/v2.1/flavors => generated 467 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:08:07.016373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-bd780527-d19e-4fe8-9dfb-852fb61a2770 req-916a5133-d0ba-4200-ba0f-e6d0468b00ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6aaef31-56eb-458f-a142-992790ebe523", "name": "network-vif-plugged", "status": "completed", "tag": "894b83eb-5706-418c-bd1d-c3b0a4308370"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:07.026691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bd780527-d19e-4fe8-9dfb-852fb61a2770 req-916a5133-d0ba-4200-ba0f-e6d0468b00ae service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:07.029688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bd780527-d19e-4fe8-9dfb-852fb61a2770 req-916a5133-d0ba-4200-ba0f-e6d0468b00ae service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:07.029688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bd780527-d19e-4fe8-9dfb-852fb61a2770 req-916a5133-d0ba-4200-ba0f-e6d0468b00ae service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:07.040090 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-bd780527-d19e-4fe8-9dfb-852fb61a2770 req-916a5133-d0ba-4200-ba0f-e6d0468b00ae service nova] Creating event network-vif-plugged:894b83eb-5706-418c-bd1d-c3b0a4308370 for instance b6aaef31-56eb-458f-a142-992790ebe523 on n-h2-860282-1 Oct 04 21:08:07.045335 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-bd780527-d19e-4fe8-9dfb-852fb61a2770 req-916a5133-d0ba-4200-ba0f-e6d0468b00ae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032912 Oct 04 21:08:07.046124 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 327/652] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:07.051448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-84de2189-9f4c-4015-8543-f75e2ebf7c3d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:07.052143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-84de2189-9f4c-4015-8543-f75e2ebf7c3d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:07.071763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84de2189-9f4c-4015-8543-f75e2ebf7c3d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:07.072311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84de2189-9f4c-4015-8543-f75e2ebf7c3d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:07.072757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84de2189-9f4c-4015-8543-f75e2ebf7c3d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:07.073508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84de2189-9f4c-4015-8543-f75e2ebf7c3d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:07.073993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84de2189-9f4c-4015-8543-f75e2ebf7c3d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:07.074705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84de2189-9f4c-4015-8543-f75e2ebf7c3d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:07.382541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-84de2189-9f4c-4015-8543-f75e2ebf7c3d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:07.399081 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-84de2189-9f4c-4015-8543-f75e2ebf7c3d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d" status: 200 len: 1318 microversion: 2.1 time: 0.351345 Oct 04 21:08:07.399691 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 328/653] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:07 2022] GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:07.421013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-54673bc0-3fe5-4e23-a0cd-dd4ed57eef40 tempest-FlavorMetadataValidation-1022513459 tempest-FlavorMetadataValidation-1022513459-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:07.790688 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-54673bc0-3fe5-4e23-a0cd-dd4ed57eef40 tempest-FlavorMetadataValidation-1022513459 tempest-FlavorMetadataValidation-1022513459-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/588084519/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.374434 Oct 04 21:08:07.798340 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 329/654] 10.222.0.30 () {62 vars in 1262 bytes} [Tue Oct 4 21:08:07 2022] POST /compute/v2.1/flavors/588084519/os-extra_specs => generated 62 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:07.804712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-67bbe9cc-3196-4b90-b1c7-60f2e3b9249b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:07.805586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-67bbe9cc-3196-4b90-b1c7-60f2e3b9249b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:07.814714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67bbe9cc-3196-4b90-b1c7-60f2e3b9249b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:07.815515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67bbe9cc-3196-4b90-b1c7-60f2e3b9249b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:07.815964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67bbe9cc-3196-4b90-b1c7-60f2e3b9249b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:07.816746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67bbe9cc-3196-4b90-b1c7-60f2e3b9249b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:07.817210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67bbe9cc-3196-4b90-b1c7-60f2e3b9249b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:07.817685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67bbe9cc-3196-4b90-b1c7-60f2e3b9249b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:07.952142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=9 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:08.027898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:08.114030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-67bbe9cc-3196-4b90-b1c7-60f2e3b9249b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:08.122388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-67bbe9cc-3196-4b90-b1c7-60f2e3b9249b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:08.124676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-67bbe9cc-3196-4b90-b1c7-60f2e3b9249b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:08.126041 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-67bbe9cc-3196-4b90-b1c7-60f2e3b9249b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1362 microversion: 2.25 time: 0.325972 Oct 04 21:08:08.126602 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 330/655] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:07 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:08.138816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab953469-32fb-468a-a10d-7cc8695278f7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:08.142875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ab953469-32fb-468a-a10d-7cc8695278f7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:08.145885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab953469-32fb-468a-a10d-7cc8695278f7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:08.146381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab953469-32fb-468a-a10d-7cc8695278f7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:08.146824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab953469-32fb-468a-a10d-7cc8695278f7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:08.147522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab953469-32fb-468a-a10d-7cc8695278f7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:08.147977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab953469-32fb-468a-a10d-7cc8695278f7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:08.148402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab953469-32fb-468a-a10d-7cc8695278f7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:08.441674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ab953469-32fb-468a-a10d-7cc8695278f7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:08.462244 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ab953469-32fb-468a-a10d-7cc8695278f7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1471 microversion: 2.1 time: 0.324601 Oct 04 21:08:08.465665 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 331/656] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:08 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1471 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:08.473222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4302c8df-20f8-42d8-9a90-b66bd4cb6406 tempest-FlavorMetadataValidation-1022513459 tempest-FlavorMetadataValidation-1022513459-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:08.633841 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4302c8df-20f8-42d8-9a90-b66bd4cb6406 tempest-FlavorMetadataValidation-1022513459 tempest-FlavorMetadataValidation-1022513459-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/588084519" status: 202 len: 0 microversion: 2.86 time: 0.166936 Oct 04 21:08:08.634445 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 332/657] 10.222.0.30 () {60 vars in 1199 bytes} [Tue Oct 4 21:08:08 2022] DELETE /compute/v2.1/flavors/588084519 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:08:08.640845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-21ba4b2f-bd76-4070-bc3e-b8c0a8a4af52 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:08.641496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-21ba4b2f-bd76-4070-bc3e-b8c0a8a4af52 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:08.656414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21ba4b2f-bd76-4070-bc3e-b8c0a8a4af52 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:08.657385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21ba4b2f-bd76-4070-bc3e-b8c0a8a4af52 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:08.666679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21ba4b2f-bd76-4070-bc3e-b8c0a8a4af52 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:08.667447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21ba4b2f-bd76-4070-bc3e-b8c0a8a4af52 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:08.668147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21ba4b2f-bd76-4070-bc3e-b8c0a8a4af52 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:08.668966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21ba4b2f-bd76-4070-bc3e-b8c0a8a4af52 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:08.724457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=31 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:08.772465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-21ba4b2f-bd76-4070-bc3e-b8c0a8a4af52 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:08.784696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-21ba4b2f-bd76-4070-bc3e-b8c0a8a4af52 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:08.786580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-21ba4b2f-bd76-4070-bc3e-b8c0a8a4af52 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:08.794132 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-21ba4b2f-bd76-4070-bc3e-b8c0a8a4af52 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.157108 Oct 04 21:08:08.794929 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 333/658] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:08 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:08.803820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-147f3624-2c88-4c5b-bcca-c1cb7ecd3619 req-eaadd618-4227-4f06-b950-22bbc16d622c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60fb0e75-0b0d-4f33-8494-c0fdc2be222d", "tag": "14864892-4e40-4a93-81ac-834038e82ec4"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:08.821125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-147f3624-2c88-4c5b-bcca-c1cb7ecd3619 req-eaadd618-4227-4f06-b950-22bbc16d622c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:08.821713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-147f3624-2c88-4c5b-bcca-c1cb7ecd3619 req-eaadd618-4227-4f06-b950-22bbc16d622c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:08.823230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-147f3624-2c88-4c5b-bcca-c1cb7ecd3619 req-eaadd618-4227-4f06-b950-22bbc16d622c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:08.837449 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-147f3624-2c88-4c5b-bcca-c1cb7ecd3619 req-eaadd618-4227-4f06-b950-22bbc16d622c service nova] Creating event network-changed:14864892-4e40-4a93-81ac-834038e82ec4 for instance 60fb0e75-0b0d-4f33-8494-c0fdc2be222d on n-h2-860282-1 Oct 04 21:08:08.843605 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-147f3624-2c88-4c5b-bcca-c1cb7ecd3619 req-eaadd618-4227-4f06-b950-22bbc16d622c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047120 Oct 04 21:08:08.844868 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 334/659] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:08.851284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0d182f30-8c59-454a-ad5f-9de8843b0291 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:08.852104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0d182f30-8c59-454a-ad5f-9de8843b0291 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:08.859491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d182f30-8c59-454a-ad5f-9de8843b0291 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:08.860206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d182f30-8c59-454a-ad5f-9de8843b0291 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:08.861298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d182f30-8c59-454a-ad5f-9de8843b0291 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:08.861899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d182f30-8c59-454a-ad5f-9de8843b0291 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:08.862429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d182f30-8c59-454a-ad5f-9de8843b0291 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:08.862927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d182f30-8c59-454a-ad5f-9de8843b0291 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:09.033396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0d182f30-8c59-454a-ad5f-9de8843b0291 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:09.042981 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0d182f30-8c59-454a-ad5f-9de8843b0291 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d" status: 200 len: 1318 microversion: 2.1 time: 0.196473 Oct 04 21:08:09.045494 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 335/660] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:08 2022] GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:09.051591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-87eb89c1-1199-425e-87bd-dea0c57539c7 tempest-FlavorMetadataValidation-1022513459 tempest-FlavorMetadataValidation-1022513459-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:09.082278 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-87eb89c1-1199-425e-87bd-dea0c57539c7 tempest-FlavorMetadataValidation-1022513459 tempest-FlavorMetadataValidation-1022513459-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6677 microversion: 2.86 time: 0.037327 Oct 04 21:08:09.083994 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 336/661] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Oct 4 21:08:09 2022] GET /compute/v2.1/flavors/detail => generated 6677 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:09.099824 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e2fdc56c-6645-4b36-a41d-e8fcd47df4ad tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2/action" status: 202 len: 0 microversion: 2.1 time: 4.992817 Oct 04 21:08:09.100431 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 326/662] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:08:04 2022] POST /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2/action => generated 0 bytes in 4995 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:08:09.112303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f2b4e3ae-1b94-491c-bdd1-86f44fd38485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:09.112821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f2b4e3ae-1b94-491c-bdd1-86f44fd38485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:09.119869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2b4e3ae-1b94-491c-bdd1-86f44fd38485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.120369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2b4e3ae-1b94-491c-bdd1-86f44fd38485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.120814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2b4e3ae-1b94-491c-bdd1-86f44fd38485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:09.121786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2b4e3ae-1b94-491c-bdd1-86f44fd38485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.122263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2b4e3ae-1b94-491c-bdd1-86f44fd38485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.122694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2b4e3ae-1b94-491c-bdd1-86f44fd38485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:09.157921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b9bd3668-b248-4841-acbe-5b2fbe42f7fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:09.158854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b9bd3668-b248-4841-acbe-5b2fbe42f7fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:09.171371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9bd3668-b248-4841-acbe-5b2fbe42f7fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.172302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9bd3668-b248-4841-acbe-5b2fbe42f7fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.173145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9bd3668-b248-4841-acbe-5b2fbe42f7fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:09.176425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9bd3668-b248-4841-acbe-5b2fbe42f7fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.177352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9bd3668-b248-4841-acbe-5b2fbe42f7fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.178009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9bd3668-b248-4841-acbe-5b2fbe42f7fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:09.401249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b9bd3668-b248-4841-acbe-5b2fbe42f7fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:09.402504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f2b4e3ae-1b94-491c-bdd1-86f44fd38485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:09.428222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b9bd3668-b248-4841-acbe-5b2fbe42f7fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:09.429585 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f2b4e3ae-1b94-491c-bdd1-86f44fd38485 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1502 microversion: 2.1 time: 0.322699 Oct 04 21:08:09.431045 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 337/663] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:09 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1502 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:09.431473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b9bd3668-b248-4841-acbe-5b2fbe42f7fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:09.432913 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b9bd3668-b248-4841-acbe-5b2fbe42f7fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1558 microversion: 2.25 time: 0.284403 Oct 04 21:08:09.446925 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 327/664] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:09 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1558 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:09.461308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7718850e-3f47-42ce-b998-2a61d688af91 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:09.461956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7718850e-3f47-42ce-b998-2a61d688af91 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:09.468955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7718850e-3f47-42ce-b998-2a61d688af91 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.469474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7718850e-3f47-42ce-b998-2a61d688af91 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.470110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7718850e-3f47-42ce-b998-2a61d688af91 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:09.470965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7718850e-3f47-42ce-b998-2a61d688af91 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.471427 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7718850e-3f47-42ce-b998-2a61d688af91 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.471869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7718850e-3f47-42ce-b998-2a61d688af91 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:09.488345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a604fe1b-10e3-4c18-9167-1f55bcad928a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:09.488345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a604fe1b-10e3-4c18-9167-1f55bcad928a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:09.498848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a604fe1b-10e3-4c18-9167-1f55bcad928a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.499876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a604fe1b-10e3-4c18-9167-1f55bcad928a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.500657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a604fe1b-10e3-4c18-9167-1f55bcad928a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:09.501802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a604fe1b-10e3-4c18-9167-1f55bcad928a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.502360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a604fe1b-10e3-4c18-9167-1f55bcad928a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.503028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a604fe1b-10e3-4c18-9167-1f55bcad928a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:09.708036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-7718850e-3f47-42ce-b998-2a61d688af91 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lazy-loading 'services' on Instance uuid b6aaef31-56eb-458f-a142-992790ebe523 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:09.729690 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7718850e-3f47-42ce-b998-2a61d688af91 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 2051 microversion: 2.25 time: 0.272046 Oct 04 21:08:09.730973 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 338/665] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:09 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 2051 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:09.780359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-77ad7b26-e67e-4bf1-bf48-b57ba55769c9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:09.780359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-77ad7b26-e67e-4bf1-bf48-b57ba55769c9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:09.783677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77ad7b26-e67e-4bf1-bf48-b57ba55769c9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.784967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77ad7b26-e67e-4bf1-bf48-b57ba55769c9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.785438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77ad7b26-e67e-4bf1-bf48-b57ba55769c9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:09.786405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77ad7b26-e67e-4bf1-bf48-b57ba55769c9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.786778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77ad7b26-e67e-4bf1-bf48-b57ba55769c9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.787284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77ad7b26-e67e-4bf1-bf48-b57ba55769c9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:09.885111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a604fe1b-10e3-4c18-9167-1f55bcad928a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:09.902266 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a604fe1b-10e3-4c18-9167-1f55bcad928a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1471 microversion: 2.1 time: 0.419899 Oct 04 21:08:09.913690 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 328/666] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:09 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1471 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:09.913690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9b3acaa7-792e-4e1f-9384-b9861e90db94 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:09.913690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9b3acaa7-792e-4e1f-9384-b9861e90db94 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:09.921132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b3acaa7-792e-4e1f-9384-b9861e90db94 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.923307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b3acaa7-792e-4e1f-9384-b9861e90db94 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.923906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b3acaa7-792e-4e1f-9384-b9861e90db94 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:09.924797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b3acaa7-792e-4e1f-9384-b9861e90db94 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.925400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b3acaa7-792e-4e1f-9384-b9861e90db94 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.935054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b3acaa7-792e-4e1f-9384-b9861e90db94 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:10.050471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9b3acaa7-792e-4e1f-9384-b9861e90db94 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:10.065007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9b3acaa7-792e-4e1f-9384-b9861e90db94 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:10.066570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9b3acaa7-792e-4e1f-9384-b9861e90db94 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:10.078650 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9b3acaa7-792e-4e1f-9384-b9861e90db94 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.172757 Oct 04 21:08:10.079805 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 329/667] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:09 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:10.097040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5290944a-3061-4791-88a7-7cad623d7baa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:10.099684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5290944a-3061-4791-88a7-7cad623d7baa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:10.111524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5290944a-3061-4791-88a7-7cad623d7baa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:10.112068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5290944a-3061-4791-88a7-7cad623d7baa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:10.112507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5290944a-3061-4791-88a7-7cad623d7baa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:10.113224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5290944a-3061-4791-88a7-7cad623d7baa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:10.113747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5290944a-3061-4791-88a7-7cad623d7baa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:10.114180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5290944a-3061-4791-88a7-7cad623d7baa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:10.215037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-77ad7b26-e67e-4bf1-bf48-b57ba55769c9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lazy-loading 'services' on Instance uuid b6aaef31-56eb-458f-a142-992790ebe523 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:10.244360 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-77ad7b26-e67e-4bf1-bf48-b57ba55769c9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 2051 microversion: 2.25 time: 0.490081 Oct 04 21:08:10.244967 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 339/668] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:09 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 2051 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:10.278351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0c319b9e-7744-4480-8847-eddd264207df tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:10.285042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c319b9e-7744-4480-8847-eddd264207df tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:10.285815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c319b9e-7744-4480-8847-eddd264207df tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:10.286464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c319b9e-7744-4480-8847-eddd264207df tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:10.287386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c319b9e-7744-4480-8847-eddd264207df tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:10.288013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c319b9e-7744-4480-8847-eddd264207df tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:10.288623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c319b9e-7744-4480-8847-eddd264207df tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:10.331007 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0c319b9e-7744-4480-8847-eddd264207df tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.058676 Oct 04 21:08:10.340733 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 340/669] 10.222.0.30 () {60 vars in 1217 bytes} [Tue Oct 4 21:08:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:08:10.347690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c701fcdf-5a60-4906-b7c3-4c6e2f349196 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:10.348429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c701fcdf-5a60-4906-b7c3-4c6e2f349196 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:10.355805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c701fcdf-5a60-4906-b7c3-4c6e2f349196 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:10.356230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c701fcdf-5a60-4906-b7c3-4c6e2f349196 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:10.356690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c701fcdf-5a60-4906-b7c3-4c6e2f349196 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:10.357451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c701fcdf-5a60-4906-b7c3-4c6e2f349196 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:10.358258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c701fcdf-5a60-4906-b7c3-4c6e2f349196 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:10.358703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c701fcdf-5a60-4906-b7c3-4c6e2f349196 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:10.408484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5290944a-3061-4791-88a7-7cad623d7baa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:10.416983 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5290944a-3061-4791-88a7-7cad623d7baa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d" status: 200 len: 1318 microversion: 2.1 time: 0.334467 Oct 04 21:08:10.419715 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 330/670] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:10 2022] GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:10.458346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-eb40cfb5-1c8e-4686-95c3-08e5b1c0a4db tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:10.458974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-eb40cfb5-1c8e-4686-95c3-08e5b1c0a4db tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:10.470181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eb40cfb5-1c8e-4686-95c3-08e5b1c0a4db tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:10.470753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eb40cfb5-1c8e-4686-95c3-08e5b1c0a4db tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:10.471376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eb40cfb5-1c8e-4686-95c3-08e5b1c0a4db tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:10.472394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eb40cfb5-1c8e-4686-95c3-08e5b1c0a4db tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:10.473068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eb40cfb5-1c8e-4686-95c3-08e5b1c0a4db tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:10.473767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eb40cfb5-1c8e-4686-95c3-08e5b1c0a4db tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:10.732078 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c701fcdf-5a60-4906-b7c3-4c6e2f349196 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523/action" status: 202 len: 0 microversion: 2.25 time: 0.388378 Oct 04 21:08:10.732892 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 341/671] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Oct 4 21:08:10 2022] POST /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:08:10.742258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a1b6b506-ff5e-4c3e-9fca-b646b9de35fd tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:10.743293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a1b6b506-ff5e-4c3e-9fca-b646b9de35fd tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:10.762011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1b6b506-ff5e-4c3e-9fca-b646b9de35fd tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:10.762825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1b6b506-ff5e-4c3e-9fca-b646b9de35fd tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:10.763438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1b6b506-ff5e-4c3e-9fca-b646b9de35fd tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:10.765079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1b6b506-ff5e-4c3e-9fca-b646b9de35fd tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:10.766307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1b6b506-ff5e-4c3e-9fca-b646b9de35fd tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:10.769826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1b6b506-ff5e-4c3e-9fca-b646b9de35fd tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:11.123765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-eb40cfb5-1c8e-4686-95c3-08e5b1c0a4db tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:11.138153 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-eb40cfb5-1c8e-4686-95c3-08e5b1c0a4db tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1502 microversion: 2.1 time: 0.684364 Oct 04 21:08:11.138845 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 331/672] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:10 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1502 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:11.145022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e0e5faeb-3fe1-4ddb-b383-57536923d334 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:11.151428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e0e5faeb-3fe1-4ddb-b383-57536923d334 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:11.170840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0e5faeb-3fe1-4ddb-b383-57536923d334 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:11.171424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0e5faeb-3fe1-4ddb-b383-57536923d334 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:11.171884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0e5faeb-3fe1-4ddb-b383-57536923d334 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:11.172613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0e5faeb-3fe1-4ddb-b383-57536923d334 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:11.173079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0e5faeb-3fe1-4ddb-b383-57536923d334 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:11.173539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0e5faeb-3fe1-4ddb-b383-57536923d334 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:11.539183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-a1b6b506-ff5e-4c3e-9fca-b646b9de35fd tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lazy-loading 'services' on Instance uuid b6aaef31-56eb-458f-a142-992790ebe523 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:11.563983 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a1b6b506-ff5e-4c3e-9fca-b646b9de35fd tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 2056 microversion: 2.25 time: 0.825834 Oct 04 21:08:11.564939 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 342/673] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:10 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 2056 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:11.569749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2cf7ef17-1478-4e2d-9e2a-48af8ee9a690 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:11.570431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2cf7ef17-1478-4e2d-9e2a-48af8ee9a690 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:11.585066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2cf7ef17-1478-4e2d-9e2a-48af8ee9a690 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:11.585653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2cf7ef17-1478-4e2d-9e2a-48af8ee9a690 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:11.586155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2cf7ef17-1478-4e2d-9e2a-48af8ee9a690 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:11.586895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2cf7ef17-1478-4e2d-9e2a-48af8ee9a690 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:11.587356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2cf7ef17-1478-4e2d-9e2a-48af8ee9a690 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:11.588470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2cf7ef17-1478-4e2d-9e2a-48af8ee9a690 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:11.704838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:11.736414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e0e5faeb-3fe1-4ddb-b383-57536923d334 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:11.744908 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e0e5faeb-3fe1-4ddb-b383-57536923d334 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1471 microversion: 2.1 time: 0.604616 Oct 04 21:08:11.747008 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 332/674] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:11 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1471 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:11.767796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-bb471608-2d2b-4dde-9626-ca8d4905ad68 req-92ada01a-0166-4dbd-872d-e981def48e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d4ebc0-b7ec-4481-ae12-df4530909f2d", "name": "network-vif-plugged", "status": "completed", "tag": "59e997dc-877a-4edb-8588-607e62851bd1"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:11.778131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-bb471608-2d2b-4dde-9626-ca8d4905ad68 req-92ada01a-0166-4dbd-872d-e981def48e26 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:11.778935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-bb471608-2d2b-4dde-9626-ca8d4905ad68 req-92ada01a-0166-4dbd-872d-e981def48e26 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:11.780149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-bb471608-2d2b-4dde-9626-ca8d4905ad68 req-92ada01a-0166-4dbd-872d-e981def48e26 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:11.811218 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-bb471608-2d2b-4dde-9626-ca8d4905ad68 req-92ada01a-0166-4dbd-872d-e981def48e26 service nova] Creating event network-vif-plugged:59e997dc-877a-4edb-8588-607e62851bd1 for instance 06d4ebc0-b7ec-4481-ae12-df4530909f2d on n-h2-860282-1 Oct 04 21:08:11.817610 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-bb471608-2d2b-4dde-9626-ca8d4905ad68 req-92ada01a-0166-4dbd-872d-e981def48e26 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068710 Oct 04 21:08:11.818741 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 333/675] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:11.830949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-debeed64-3777-4a38-95a6-e335e0142ead tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:11.833040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-debeed64-3777-4a38-95a6-e335e0142ead tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:11.842688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-debeed64-3777-4a38-95a6-e335e0142ead tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:11.848963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-debeed64-3777-4a38-95a6-e335e0142ead tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:11.849704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-debeed64-3777-4a38-95a6-e335e0142ead tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:11.854781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-debeed64-3777-4a38-95a6-e335e0142ead tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:11.855565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-debeed64-3777-4a38-95a6-e335e0142ead tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:11.856341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-debeed64-3777-4a38-95a6-e335e0142ead tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:11.895268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2cf7ef17-1478-4e2d-9e2a-48af8ee9a690 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:11.910389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2cf7ef17-1478-4e2d-9e2a-48af8ee9a690 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:11.917290 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2cf7ef17-1478-4e2d-9e2a-48af8ee9a690 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:11.930526 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2cf7ef17-1478-4e2d-9e2a-48af8ee9a690 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.364381 Oct 04 21:08:11.933100 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 343/676] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:11 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:12.166810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a99295e6-4193-4fbd-949e-a5e26265b30b tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:12.167864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a99295e6-4193-4fbd-949e-a5e26265b30b tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:12.174901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:12.191051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a99295e6-4193-4fbd-949e-a5e26265b30b tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:12.191650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a99295e6-4193-4fbd-949e-a5e26265b30b tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:12.192270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a99295e6-4193-4fbd-949e-a5e26265b30b tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:12.193038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a99295e6-4193-4fbd-949e-a5e26265b30b tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:12.193525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a99295e6-4193-4fbd-949e-a5e26265b30b tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:12.194030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a99295e6-4193-4fbd-949e-a5e26265b30b tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:12.364451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-debeed64-3777-4a38-95a6-e335e0142ead tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:12.378221 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-debeed64-3777-4a38-95a6-e335e0142ead tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d" status: 200 len: 1318 microversion: 2.1 time: 0.555710 Oct 04 21:08:12.380988 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 334/677] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:11 2022] GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d => generated 1318 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:12.393158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-f2d6d170-e168-4cd0-a337-28431681eb6b req-68cea933-591d-441a-9206-d23bb4d864d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e14e448-c2c9-4904-823a-4febd5b537b2", "name": "network-vif-unplugged", "status": "completed", "tag": "fd07f72b-4442-4b44-b1f2-27824c689273"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:12.408035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f2d6d170-e168-4cd0-a337-28431681eb6b req-68cea933-591d-441a-9206-d23bb4d864d4 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:12.408714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f2d6d170-e168-4cd0-a337-28431681eb6b req-68cea933-591d-441a-9206-d23bb4d864d4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:12.409561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f2d6d170-e168-4cd0-a337-28431681eb6b req-68cea933-591d-441a-9206-d23bb4d864d4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:12.424412 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-f2d6d170-e168-4cd0-a337-28431681eb6b req-68cea933-591d-441a-9206-d23bb4d864d4 service nova] Creating event network-vif-unplugged:fd07f72b-4442-4b44-b1f2-27824c689273 for instance 6e14e448-c2c9-4904-823a-4febd5b537b2 on n-h1-860282-1 Oct 04 21:08:12.431053 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-f2d6d170-e168-4cd0-a337-28431681eb6b req-68cea933-591d-441a-9206-d23bb4d864d4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047491 Oct 04 21:08:12.432953 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 335/678] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:12.553247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a99295e6-4193-4fbd-949e-a5e26265b30b tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:12.565717 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a99295e6-4193-4fbd-949e-a5e26265b30b tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1502 microversion: 2.1 time: 0.403732 Oct 04 21:08:12.588567 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 344/679] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:12 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1502 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:12.593495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8da0876e-e8fe-459c-a427-a47dc9272811 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:12.594391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8da0876e-e8fe-459c-a427-a47dc9272811 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:12.602300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8da0876e-e8fe-459c-a427-a47dc9272811 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:12.603035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8da0876e-e8fe-459c-a427-a47dc9272811 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:12.603707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8da0876e-e8fe-459c-a427-a47dc9272811 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:12.604635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8da0876e-e8fe-459c-a427-a47dc9272811 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:12.605309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8da0876e-e8fe-459c-a427-a47dc9272811 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:12.605848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8da0876e-e8fe-459c-a427-a47dc9272811 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:12.634394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-03b662f8-5e0e-4d39-adb5-a7a9f2b89800 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Action: 'create', calling method: .version_select at 0x7f57908ab040>, body: {"keypair": {"name": "tempest-keypair-513931149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhO3wNxePN6gAVFN4YmgKTy0oOV/JLIGIw7ilz5nW41uQOkCCcjrZTTboJ5LbObldhVTtBdutyoXjAsyFxnuQNFoHN+0z7/b/2za+gfqajSD3yJRyb72lsxkhLzCGMlOQ=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:12.655633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-03b662f8-5e0e-4d39-adb5-a7a9f2b89800 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Getting quotas for project 2b5ab646aa83404ea0006a5cdc439417. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:08:12.662381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-03b662f8-5e0e-4d39-adb5-a7a9f2b89800 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Getting quotas for user fc5cc145484d4444b7e93cec0d14d062 and project 2b5ab646aa83404ea0006a5cdc439417. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:08:12.780271 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-03b662f8-5e0e-4d39-adb5-a7a9f2b89800 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.345695 Oct 04 21:08:12.781631 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 336/680] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:08:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:12.786432 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-405b7d73-ac36-4d65-ad69-d4083903bff7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:12.789463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-405b7d73-ac36-4d65-ad69-d4083903bff7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:12.794480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-405b7d73-ac36-4d65-ad69-d4083903bff7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:12.795576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-405b7d73-ac36-4d65-ad69-d4083903bff7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:12.796040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-405b7d73-ac36-4d65-ad69-d4083903bff7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:12.796911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-405b7d73-ac36-4d65-ad69-d4083903bff7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:12.797292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-405b7d73-ac36-4d65-ad69-d4083903bff7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:12.797741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-405b7d73-ac36-4d65-ad69-d4083903bff7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:12.836919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:12.843188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-8da0876e-e8fe-459c-a427-a47dc9272811 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lazy-loading 'services' on Instance uuid b6aaef31-56eb-458f-a142-992790ebe523 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:12.864258 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8da0876e-e8fe-459c-a427-a47dc9272811 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 2036 microversion: 2.25 time: 0.274455 Oct 04 21:08:12.864943 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 345/681] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:12 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 2036 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:12.892579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eceb3edf-d8f5-433b-8300-1218949e7c12 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860282-1", "block_migration": "auto"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:12.895530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eceb3edf-d8f5-433b-8300-1218949e7c12 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:12.902894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eceb3edf-d8f5-433b-8300-1218949e7c12 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:12.918183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eceb3edf-d8f5-433b-8300-1218949e7c12 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:12.921463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eceb3edf-d8f5-433b-8300-1218949e7c12 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:12.922459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eceb3edf-d8f5-433b-8300-1218949e7c12 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:12.923976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eceb3edf-d8f5-433b-8300-1218949e7c12 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:12.924399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eceb3edf-d8f5-433b-8300-1218949e7c12 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:12.957201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-eceb3edf-d8f5-433b-8300-1218949e7c12 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lazy-loading 'flavor' on Instance uuid b6aaef31-56eb-458f-a142-992790ebe523 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:12.976982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eceb3edf-d8f5-433b-8300-1218949e7c12 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Going to try to live migrate instance to n-h1-860282-1 {{(pid=122757) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:08:12.998984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-405b7d73-ac36-4d65-ad69-d4083903bff7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:13.010562 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-405b7d73-ac36-4d65-ad69-d4083903bff7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1471 microversion: 2.1 time: 0.226804 Oct 04 21:08:13.011382 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 337/682] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:12 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1471 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:13.024762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2259032c-0ec8-4d39-87ec-195b63fb82ff tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:13.024762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2259032c-0ec8-4d39-87ec-195b63fb82ff tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:13.034185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2259032c-0ec8-4d39-87ec-195b63fb82ff tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:13.034688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2259032c-0ec8-4d39-87ec-195b63fb82ff tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:13.035127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2259032c-0ec8-4d39-87ec-195b63fb82ff tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:13.035836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2259032c-0ec8-4d39-87ec-195b63fb82ff tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:13.036344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2259032c-0ec8-4d39-87ec-195b63fb82ff tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:13.036775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2259032c-0ec8-4d39-87ec-195b63fb82ff tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:13.130065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2259032c-0ec8-4d39-87ec-195b63fb82ff tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:13.145993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2259032c-0ec8-4d39-87ec-195b63fb82ff tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:13.148166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2259032c-0ec8-4d39-87ec-195b63fb82ff tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:13.156836 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2259032c-0ec8-4d39-87ec-195b63fb82ff tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.144603 Oct 04 21:08:13.157667 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 338/683] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:13 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:13.167231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d85112ff-46a1-470b-bdae-c2edae10f6d7 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:13.167942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d85112ff-46a1-470b-bdae-c2edae10f6d7 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:13.175265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d85112ff-46a1-470b-bdae-c2edae10f6d7 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:13.176175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d85112ff-46a1-470b-bdae-c2edae10f6d7 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:13.176825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d85112ff-46a1-470b-bdae-c2edae10f6d7 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:13.177778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d85112ff-46a1-470b-bdae-c2edae10f6d7 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:13.178385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d85112ff-46a1-470b-bdae-c2edae10f6d7 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:13.179136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d85112ff-46a1-470b-bdae-c2edae10f6d7 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:13.210579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d85112ff-46a1-470b-bdae-c2edae10f6d7 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:08:13.723097 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d85112ff-46a1-470b-bdae-c2edae10f6d7 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93" status: 204 len: 0 microversion: 2.1 time: 0.563523 Oct 04 21:08:13.727153 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 339/684] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:08:13 2022] DELETE /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:08:13.739137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-03c98d83-a65f-457c-8456-0b4d18510c4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:13.740088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-03c98d83-a65f-457c-8456-0b4d18510c4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:13.760229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03c98d83-a65f-457c-8456-0b4d18510c4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:13.766046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03c98d83-a65f-457c-8456-0b4d18510c4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:13.766858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03c98d83-a65f-457c-8456-0b4d18510c4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:13.768363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03c98d83-a65f-457c-8456-0b4d18510c4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:13.769074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03c98d83-a65f-457c-8456-0b4d18510c4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:13.769970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03c98d83-a65f-457c-8456-0b4d18510c4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:13.930001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-03c98d83-a65f-457c-8456-0b4d18510c4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:13.939465 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-03c98d83-a65f-457c-8456-0b4d18510c4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d" status: 200 len: 1318 microversion: 2.1 time: 0.211004 Oct 04 21:08:13.940339 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 340/685] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:13 2022] GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:13.945032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9ebe827d-3c1a-4178-9d57-dd7169bd31c2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:13.945856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9ebe827d-3c1a-4178-9d57-dd7169bd31c2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:13.952194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ebe827d-3c1a-4178-9d57-dd7169bd31c2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:13.953749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ebe827d-3c1a-4178-9d57-dd7169bd31c2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:13.959339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ebe827d-3c1a-4178-9d57-dd7169bd31c2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:13.959339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ebe827d-3c1a-4178-9d57-dd7169bd31c2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:13.959339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ebe827d-3c1a-4178-9d57-dd7169bd31c2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:13.959339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ebe827d-3c1a-4178-9d57-dd7169bd31c2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:13.960814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:14.130973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9ebe827d-3c1a-4178-9d57-dd7169bd31c2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:14.144425 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9ebe827d-3c1a-4178-9d57-dd7169bd31c2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1502 microversion: 2.1 time: 0.202515 Oct 04 21:08:14.144558 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 341/686] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:13 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1502 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:14.158357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e722347d-7dfa-4a70-9741-397fc78bda6a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:14.161632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e722347d-7dfa-4a70-9741-397fc78bda6a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:14.168405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e722347d-7dfa-4a70-9741-397fc78bda6a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:14.168902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e722347d-7dfa-4a70-9741-397fc78bda6a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:14.169340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e722347d-7dfa-4a70-9741-397fc78bda6a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:14.170707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e722347d-7dfa-4a70-9741-397fc78bda6a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:14.171240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e722347d-7dfa-4a70-9741-397fc78bda6a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:14.171633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e722347d-7dfa-4a70-9741-397fc78bda6a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:14.335934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e722347d-7dfa-4a70-9741-397fc78bda6a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:14.354659 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e722347d-7dfa-4a70-9741-397fc78bda6a tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93" status: 200 len: 1707 microversion: 2.1 time: 0.199111 Oct 04 21:08:14.366231 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 342/687] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:14 2022] GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 => generated 1707 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:14.377350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-19b654f7-a241-4734-8eb2-f525c2503dea req-3163d784-993c-448f-ad46-217ff99f2fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fb0e75-0b0d-4f33-8494-c0fdc2be222d", "name": "network-vif-plugged", "status": "completed", "tag": "14864892-4e40-4a93-81ac-834038e82ec4"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:14.395920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-19b654f7-a241-4734-8eb2-f525c2503dea req-3163d784-993c-448f-ad46-217ff99f2fb5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:14.399094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-19b654f7-a241-4734-8eb2-f525c2503dea req-3163d784-993c-448f-ad46-217ff99f2fb5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:14.399778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-19b654f7-a241-4734-8eb2-f525c2503dea req-3163d784-993c-448f-ad46-217ff99f2fb5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:14.422757 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-19b654f7-a241-4734-8eb2-f525c2503dea req-3163d784-993c-448f-ad46-217ff99f2fb5 service nova] Creating event network-vif-plugged:14864892-4e40-4a93-81ac-834038e82ec4 for instance 60fb0e75-0b0d-4f33-8494-c0fdc2be222d on n-h2-860282-1 Oct 04 21:08:14.429796 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-19b654f7-a241-4734-8eb2-f525c2503dea req-3163d784-993c-448f-ad46-217ff99f2fb5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061865 Oct 04 21:08:14.431595 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 343/688] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:14.445482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-96915ce9-a310-4c1d-8a94-943ed2fbd7eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:14.445482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-96915ce9-a310-4c1d-8a94-943ed2fbd7eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:14.452022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96915ce9-a310-4c1d-8a94-943ed2fbd7eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:14.452771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96915ce9-a310-4c1d-8a94-943ed2fbd7eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:14.453215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96915ce9-a310-4c1d-8a94-943ed2fbd7eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:14.453956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96915ce9-a310-4c1d-8a94-943ed2fbd7eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:14.455304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96915ce9-a310-4c1d-8a94-943ed2fbd7eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:14.455797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96915ce9-a310-4c1d-8a94-943ed2fbd7eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:14.641795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-96915ce9-a310-4c1d-8a94-943ed2fbd7eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:14.650100 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-96915ce9-a310-4c1d-8a94-943ed2fbd7eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1476 microversion: 2.1 time: 0.216945 Oct 04 21:08:14.650750 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 344/689] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:14 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1476 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:14.667524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa30584d-5c89-464c-8db5-75f05b2f113d tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:14.668291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aa30584d-5c89-464c-8db5-75f05b2f113d tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:14.681741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa30584d-5c89-464c-8db5-75f05b2f113d tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:14.681741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa30584d-5c89-464c-8db5-75f05b2f113d tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:14.682239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa30584d-5c89-464c-8db5-75f05b2f113d tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:14.683037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa30584d-5c89-464c-8db5-75f05b2f113d tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:14.689666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa30584d-5c89-464c-8db5-75f05b2f113d tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:14.690307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa30584d-5c89-464c-8db5-75f05b2f113d tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:14.757639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aa30584d-5c89-464c-8db5-75f05b2f113d tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:14.766660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aa30584d-5c89-464c-8db5-75f05b2f113d tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:14.768208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aa30584d-5c89-464c-8db5-75f05b2f113d tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:14.775696 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aa30584d-5c89-464c-8db5-75f05b2f113d tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.123702 Oct 04 21:08:14.776138 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 345/690] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:14 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:14.781519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-60c3e78b-ec30-4a3a-adfb-aaf0b9511757 req-d3db1417-e2d7-4453-8532-f47db101bf82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e14e448-c2c9-4904-823a-4febd5b537b2", "tag": "fd07f72b-4442-4b44-b1f2-27824c689273"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:14.802864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-60c3e78b-ec30-4a3a-adfb-aaf0b9511757 req-d3db1417-e2d7-4453-8532-f47db101bf82 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:14.803417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-60c3e78b-ec30-4a3a-adfb-aaf0b9511757 req-d3db1417-e2d7-4453-8532-f47db101bf82 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:14.803847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-60c3e78b-ec30-4a3a-adfb-aaf0b9511757 req-d3db1417-e2d7-4453-8532-f47db101bf82 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:14.831424 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-60c3e78b-ec30-4a3a-adfb-aaf0b9511757 req-d3db1417-e2d7-4453-8532-f47db101bf82 service nova] Creating event network-changed:fd07f72b-4442-4b44-b1f2-27824c689273 for instance 6e14e448-c2c9-4904-823a-4febd5b537b2 on n-h1-860282-1 Oct 04 21:08:14.837013 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-60c3e78b-ec30-4a3a-adfb-aaf0b9511757 req-d3db1417-e2d7-4453-8532-f47db101bf82 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059748 Oct 04 21:08:14.837903 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 346/691] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:14.963747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-38ac2c10-5ff3-416b-8d7f-a771ff5c619c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:14.964577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-38ac2c10-5ff3-416b-8d7f-a771ff5c619c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:14.972148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38ac2c10-5ff3-416b-8d7f-a771ff5c619c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:14.972636 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38ac2c10-5ff3-416b-8d7f-a771ff5c619c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:14.973072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38ac2c10-5ff3-416b-8d7f-a771ff5c619c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:14.973836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38ac2c10-5ff3-416b-8d7f-a771ff5c619c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:14.974380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38ac2c10-5ff3-416b-8d7f-a771ff5c619c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:14.974805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38ac2c10-5ff3-416b-8d7f-a771ff5c619c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:15.194290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-38ac2c10-5ff3-416b-8d7f-a771ff5c619c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:15.202948 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-38ac2c10-5ff3-416b-8d7f-a771ff5c619c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d" status: 200 len: 1318 microversion: 2.1 time: 0.243501 Oct 04 21:08:15.219234 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 347/692] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:14 2022] GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:15.224632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-94aa3f64-37a0-4bcd-98b5-25e500a24504 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:15.225320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-94aa3f64-37a0-4bcd-98b5-25e500a24504 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:15.231618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94aa3f64-37a0-4bcd-98b5-25e500a24504 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:15.231900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94aa3f64-37a0-4bcd-98b5-25e500a24504 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:15.232384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94aa3f64-37a0-4bcd-98b5-25e500a24504 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:15.233219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94aa3f64-37a0-4bcd-98b5-25e500a24504 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:15.233723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94aa3f64-37a0-4bcd-98b5-25e500a24504 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:15.234127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94aa3f64-37a0-4bcd-98b5-25e500a24504 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:15.525992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-94aa3f64-37a0-4bcd-98b5-25e500a24504 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:15.538399 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-94aa3f64-37a0-4bcd-98b5-25e500a24504 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1502 microversion: 2.1 time: 0.317922 Oct 04 21:08:15.541374 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 348/693] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:15 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1502 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:15.552186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-958cdc11-2160-4f65-bed0-f6088bc39a12 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:15.554137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-958cdc11-2160-4f65-bed0-f6088bc39a12 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:15.565576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-958cdc11-2160-4f65-bed0-f6088bc39a12 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:15.566007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-958cdc11-2160-4f65-bed0-f6088bc39a12 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:15.566454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-958cdc11-2160-4f65-bed0-f6088bc39a12 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:15.567174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-958cdc11-2160-4f65-bed0-f6088bc39a12 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:15.567706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-958cdc11-2160-4f65-bed0-f6088bc39a12 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:15.573640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-958cdc11-2160-4f65-bed0-f6088bc39a12 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:15.824192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-958cdc11-2160-4f65-bed0-f6088bc39a12 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:15.832950 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-958cdc11-2160-4f65-bed0-f6088bc39a12 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93" status: 200 len: 1707 microversion: 2.1 time: 0.290559 Oct 04 21:08:15.839400 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 349/694] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:15 2022] GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 => generated 1707 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:15.854388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-68c55af2-221f-4e4c-940a-e6699ea4f971 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:15.855284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-68c55af2-221f-4e4c-940a-e6699ea4f971 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:15.862675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68c55af2-221f-4e4c-940a-e6699ea4f971 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:15.863265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68c55af2-221f-4e4c-940a-e6699ea4f971 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:15.863771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68c55af2-221f-4e4c-940a-e6699ea4f971 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:15.865100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68c55af2-221f-4e4c-940a-e6699ea4f971 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:15.865629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68c55af2-221f-4e4c-940a-e6699ea4f971 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:15.866220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68c55af2-221f-4e4c-940a-e6699ea4f971 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:16.080797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-68c55af2-221f-4e4c-940a-e6699ea4f971 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:16.094554 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-68c55af2-221f-4e4c-940a-e6699ea4f971 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1476 microversion: 2.1 time: 0.253755 Oct 04 21:08:16.095173 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 350/695] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:15 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1476 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:16.125515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bb90ad80-47fc-4098-ad54-711adf068fc9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:16.126566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bb90ad80-47fc-4098-ad54-711adf068fc9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:16.138951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb90ad80-47fc-4098-ad54-711adf068fc9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:16.144161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb90ad80-47fc-4098-ad54-711adf068fc9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:16.144712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb90ad80-47fc-4098-ad54-711adf068fc9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:16.145533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb90ad80-47fc-4098-ad54-711adf068fc9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:16.145967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb90ad80-47fc-4098-ad54-711adf068fc9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:16.147001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb90ad80-47fc-4098-ad54-711adf068fc9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:16.256909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bb90ad80-47fc-4098-ad54-711adf068fc9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:16.270442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bb90ad80-47fc-4098-ad54-711adf068fc9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:16.272735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bb90ad80-47fc-4098-ad54-711adf068fc9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:16.281087 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bb90ad80-47fc-4098-ad54-711adf068fc9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1446 microversion: 2.75 time: 0.184705 Oct 04 21:08:16.282233 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 351/696] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:16 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1446 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:16.291306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-11936272-abf7-4495-b7a9-d29ab9725058 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:16.291967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-11936272-abf7-4495-b7a9-d29ab9725058 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:16.309635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11936272-abf7-4495-b7a9-d29ab9725058 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:16.314605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11936272-abf7-4495-b7a9-d29ab9725058 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:16.315117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11936272-abf7-4495-b7a9-d29ab9725058 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:16.315859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11936272-abf7-4495-b7a9-d29ab9725058 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:16.316328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11936272-abf7-4495-b7a9-d29ab9725058 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:16.317091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11936272-abf7-4495-b7a9-d29ab9725058 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:16.491883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-11936272-abf7-4495-b7a9-d29ab9725058 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:16.500822 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-11936272-abf7-4495-b7a9-d29ab9725058 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d" status: 200 len: 1468 microversion: 2.1 time: 0.217356 Oct 04 21:08:16.501685 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 352/697] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:16 2022] GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d => generated 1468 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:16.693706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-31904cfa-f84f-4194-8999-3082c86b325f tempest-HypervisorAdminV228Test-231831604 tempest-HypervisorAdminV228Test-231831604-project-admin] Calling method '.version_select at 0x7f57906c4d30>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:16.698143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31904cfa-f84f-4194-8999-3082c86b325f tempest-HypervisorAdminV228Test-231831604 tempest-HypervisorAdminV228Test-231831604-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:16.699375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31904cfa-f84f-4194-8999-3082c86b325f tempest-HypervisorAdminV228Test-231831604 tempest-HypervisorAdminV228Test-231831604-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:16.700047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31904cfa-f84f-4194-8999-3082c86b325f tempest-HypervisorAdminV228Test-231831604 tempest-HypervisorAdminV228Test-231831604-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:16.722747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:16.729360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31904cfa-f84f-4194-8999-3082c86b325f tempest-HypervisorAdminV228Test-231831604 tempest-HypervisorAdminV228Test-231831604-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:16.729882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31904cfa-f84f-4194-8999-3082c86b325f tempest-HypervisorAdminV228Test-231831604 tempest-HypervisorAdminV228Test-231831604-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:16.730325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31904cfa-f84f-4194-8999-3082c86b325f tempest-HypervisorAdminV228Test-231831604 tempest-HypervisorAdminV228Test-231831604-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:16.749414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31904cfa-f84f-4194-8999-3082c86b325f tempest-HypervisorAdminV228Test-231831604 tempest-HypervisorAdminV228Test-231831604-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:16.749414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31904cfa-f84f-4194-8999-3082c86b325f tempest-HypervisorAdminV228Test-231831604 tempest-HypervisorAdminV228Test-231831604-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:16.749414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31904cfa-f84f-4194-8999-3082c86b325f tempest-HypervisorAdminV228Test-231831604 tempest-HypervisorAdminV228Test-231831604-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:16.752786 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-31904cfa-f84f-4194-8999-3082c86b325f tempest-HypervisorAdminV228Test-231831604 tempest-HypervisorAdminV228Test-231831604-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.249721 Oct 04 21:08:16.753372 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 353/698] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Oct 4 21:08:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:08:16.758044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-096674c3-969c-4dfd-984d-852846029b14 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:16.758646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-096674c3-969c-4dfd-984d-852846029b14 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 06d4ebc0-b7ec-4481-ae12-df4530909f2d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:16.764593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-096674c3-969c-4dfd-984d-852846029b14 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:16.765084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-096674c3-969c-4dfd-984d-852846029b14 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:16.765541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-096674c3-969c-4dfd-984d-852846029b14 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:16.766247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-096674c3-969c-4dfd-984d-852846029b14 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:16.766702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-096674c3-969c-4dfd-984d-852846029b14 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:16.767127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-096674c3-969c-4dfd-984d-852846029b14 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:16.918857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-096674c3-969c-4dfd-984d-852846029b14 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:16.928456 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-096674c3-969c-4dfd-984d-852846029b14 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/06d4ebc0-b7ec-4481-ae12-df4530909f2d" status: 200 len: 1468 microversion: 2.1 time: 0.173689 Oct 04 21:08:16.933520 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 354/699] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:16 2022] GET /compute/v2.1/servers/06d4ebc0-b7ec-4481-ae12-df4530909f2d => generated 1468 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:16.935663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dba6f0b9-bcd7-47ae-a935-ea0bd3cf1d57 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:16.936328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dba6f0b9-bcd7-47ae-a935-ea0bd3cf1d57 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:16.953794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dba6f0b9-bcd7-47ae-a935-ea0bd3cf1d57 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:16.954810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dba6f0b9-bcd7-47ae-a935-ea0bd3cf1d57 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:16.955634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dba6f0b9-bcd7-47ae-a935-ea0bd3cf1d57 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:16.956416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dba6f0b9-bcd7-47ae-a935-ea0bd3cf1d57 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:16.956923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dba6f0b9-bcd7-47ae-a935-ea0bd3cf1d57 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:16.957354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dba6f0b9-bcd7-47ae-a935-ea0bd3cf1d57 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:17.247656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dba6f0b9-bcd7-47ae-a935-ea0bd3cf1d57 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:17.257237 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dba6f0b9-bcd7-47ae-a935-ea0bd3cf1d57 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1502 microversion: 2.1 time: 0.325695 Oct 04 21:08:17.257860 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 355/700] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:16 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1502 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:17.273850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-03b886ad-fe62-43b6-bbd8-08f090eced7b tempest-HypervisorAdminV228Test-231831604 tempest-HypervisorAdminV228Test-231831604-project-admin] Calling method '.version_select at 0x7f5790699430>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:17.275645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03b886ad-fe62-43b6-bbd8-08f090eced7b tempest-HypervisorAdminV228Test-231831604 tempest-HypervisorAdminV228Test-231831604-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:17.276650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03b886ad-fe62-43b6-bbd8-08f090eced7b tempest-HypervisorAdminV228Test-231831604 tempest-HypervisorAdminV228Test-231831604-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:17.277152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03b886ad-fe62-43b6-bbd8-08f090eced7b tempest-HypervisorAdminV228Test-231831604 tempest-HypervisorAdminV228Test-231831604-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:17.292625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03b886ad-fe62-43b6-bbd8-08f090eced7b tempest-HypervisorAdminV228Test-231831604 tempest-HypervisorAdminV228Test-231831604-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:17.293207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03b886ad-fe62-43b6-bbd8-08f090eced7b tempest-HypervisorAdminV228Test-231831604 tempest-HypervisorAdminV228Test-231831604-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:17.293590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03b886ad-fe62-43b6-bbd8-08f090eced7b tempest-HypervisorAdminV228Test-231831604 tempest-HypervisorAdminV228Test-231831604-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:17.326713 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-03b886ad-fe62-43b6-bbd8-08f090eced7b tempest-HypervisorAdminV228Test-231831604 tempest-HypervisorAdminV228Test-231831604-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.067209 Oct 04 21:08:17.327575 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 356/701] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Oct 4 21:08:17 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:08:17.334954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5a2c7726-25dd-455d-b1b6-aed985f66d9f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:17.334954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5a2c7726-25dd-455d-b1b6-aed985f66d9f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:17.351594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a2c7726-25dd-455d-b1b6-aed985f66d9f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:17.354928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a2c7726-25dd-455d-b1b6-aed985f66d9f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:17.355429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a2c7726-25dd-455d-b1b6-aed985f66d9f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:17.356182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a2c7726-25dd-455d-b1b6-aed985f66d9f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:17.356658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a2c7726-25dd-455d-b1b6-aed985f66d9f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:17.357089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a2c7726-25dd-455d-b1b6-aed985f66d9f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:17.587727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5a2c7726-25dd-455d-b1b6-aed985f66d9f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:17.605757 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5a2c7726-25dd-455d-b1b6-aed985f66d9f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93" status: 200 len: 1640 microversion: 2.1 time: 0.273902 Oct 04 21:08:17.627554 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 357/702] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:17 2022] GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 => generated 1640 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:17.632929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ff0f1c48-2861-44b1-be42-5eed20157457 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:17.639610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ff0f1c48-2861-44b1-be42-5eed20157457 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:17.640716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ff0f1c48-2861-44b1-be42-5eed20157457 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Searching by: {'reservation_id': 'r-6x2ss7ca', 'deleted': False, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:08:17.656751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff0f1c48-2861-44b1-be42-5eed20157457 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:17.657404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff0f1c48-2861-44b1-be42-5eed20157457 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:17.658011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff0f1c48-2861-44b1-be42-5eed20157457 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:17.660938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff0f1c48-2861-44b1-be42-5eed20157457 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:17.660938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff0f1c48-2861-44b1-be42-5eed20157457 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:17.660938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff0f1c48-2861-44b1-be42-5eed20157457 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:17.872086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.multi_cell_list [None req-ff0f1c48-2861-44b1-be42-5eed20157457 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:08:18.158686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ff0f1c48-2861-44b1-be42-5eed20157457 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:18.165241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff0f1c48-2861-44b1-be42-5eed20157457 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:18.165968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff0f1c48-2861-44b1-be42-5eed20157457 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:18.176544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff0f1c48-2861-44b1-be42-5eed20157457 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:18.176544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:18.388137 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ff0f1c48-2861-44b1-be42-5eed20157457 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?reservation_id=r-6x2ss7ca" status: 200 len: 2929 microversion: 2.1 time: 0.749971 Oct 04 21:08:18.388137 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 358/703] 10.222.0.30 () {58 vars in 1197 bytes} [Tue Oct 4 21:08:17 2022] GET /compute/v2.1/servers/detail?reservation_id=r-6x2ss7ca => generated 2929 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:18.388137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ffbcf0f1-fffb-49f2-8240-3c937cb0d77a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:18.388137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ffbcf0f1-fffb-49f2-8240-3c937cb0d77a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:18.391969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffbcf0f1-fffb-49f2-8240-3c937cb0d77a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:18.392566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffbcf0f1-fffb-49f2-8240-3c937cb0d77a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:18.393103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffbcf0f1-fffb-49f2-8240-3c937cb0d77a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:18.393923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffbcf0f1-fffb-49f2-8240-3c937cb0d77a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:18.402830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffbcf0f1-fffb-49f2-8240-3c937cb0d77a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:18.404364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffbcf0f1-fffb-49f2-8240-3c937cb0d77a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:18.593609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ffbcf0f1-fffb-49f2-8240-3c937cb0d77a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:18.609321 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ffbcf0f1-fffb-49f2-8240-3c937cb0d77a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1476 microversion: 2.1 time: 0.228602 Oct 04 21:08:18.627038 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eceb3edf-d8f5-433b-8300-1218949e7c12 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523/action" status: 202 len: 0 microversion: 2.25 time: 5.733342 Oct 04 21:08:18.627038 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 346/704] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Oct 4 21:08:12 2022] POST /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523/action => generated 0 bytes in 5735 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:08:18.627038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e4f30f52-bca5-4b90-9cf7-c1187a41b1cf tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:18.628004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e4f30f52-bca5-4b90-9cf7-c1187a41b1cf tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:18.639798 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 359/705] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:18 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1476 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:18.645656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4f30f52-bca5-4b90-9cf7-c1187a41b1cf tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:18.646158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4f30f52-bca5-4b90-9cf7-c1187a41b1cf tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:18.646600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4f30f52-bca5-4b90-9cf7-c1187a41b1cf tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:18.647323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4f30f52-bca5-4b90-9cf7-c1187a41b1cf tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:18.647783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4f30f52-bca5-4b90-9cf7-c1187a41b1cf tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:18.648215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4f30f52-bca5-4b90-9cf7-c1187a41b1cf tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:18.655282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-417999ed-1179-4430-a054-733811a1fb7a req-46dcabce-815b-4e1e-a700-58d0414ede3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcffd52e-afbb-4711-a9fb-acdaf64b9a93", "name": "network-vif-deleted", "tag": "c75969cc-4db7-457e-8f38-1307a890a3f2"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:18.682751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-417999ed-1179-4430-a054-733811a1fb7a req-46dcabce-815b-4e1e-a700-58d0414ede3e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:18.683468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-417999ed-1179-4430-a054-733811a1fb7a req-46dcabce-815b-4e1e-a700-58d0414ede3e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:18.684128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-417999ed-1179-4430-a054-733811a1fb7a req-46dcabce-815b-4e1e-a700-58d0414ede3e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:18.699893 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-417999ed-1179-4430-a054-733811a1fb7a req-46dcabce-815b-4e1e-a700-58d0414ede3e service nova] Creating event network-vif-deleted:c75969cc-4db7-457e-8f38-1307a890a3f2 for instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 on n-h1-860282-1 Oct 04 21:08:18.706510 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-417999ed-1179-4430-a054-733811a1fb7a req-46dcabce-815b-4e1e-a700-58d0414ede3e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065172 Oct 04 21:08:18.709446 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 360/706] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:18.717816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d38772e2-6340-44bf-b2dc-bcdbc2b398c5 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:18.718766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d38772e2-6340-44bf-b2dc-bcdbc2b398c5 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:18.725372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d38772e2-6340-44bf-b2dc-bcdbc2b398c5 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:18.725970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d38772e2-6340-44bf-b2dc-bcdbc2b398c5 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:18.726572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d38772e2-6340-44bf-b2dc-bcdbc2b398c5 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:18.727281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d38772e2-6340-44bf-b2dc-bcdbc2b398c5 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:18.727766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d38772e2-6340-44bf-b2dc-bcdbc2b398c5 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:18.728201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d38772e2-6340-44bf-b2dc-bcdbc2b398c5 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:18.746997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e4f30f52-bca5-4b90-9cf7-c1187a41b1cf tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:18.760542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e4f30f52-bca5-4b90-9cf7-c1187a41b1cf tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:18.769018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e4f30f52-bca5-4b90-9cf7-c1187a41b1cf tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:18.769731 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e4f30f52-bca5-4b90-9cf7-c1187a41b1cf tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1452 microversion: 2.75 time: 0.147955 Oct 04 21:08:18.770830 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 347/707] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:18 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:18.776096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a663f995-eb51-40de-97a5-05930f18639a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:18.815352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.compute.server_groups [None req-a663f995-eb51-40de-97a5-05930f18639a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Querying cell 016bade6-ba85-4482-99c1-a6ee7c8937c1(cell1) for 2 instances {{(pid=122757) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 21:08:18.816225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a663f995-eb51-40de-97a5-05930f18639a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:18.816841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a663f995-eb51-40de-97a5-05930f18639a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:18.817351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a663f995-eb51-40de-97a5-05930f18639a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:18.860611 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a663f995-eb51-40de-97a5-05930f18639a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/dc9974f1-f005-4f05-aaf9-1081ec35916b" status: 200 len: 266 microversion: 2.1 time: 0.088479 Oct 04 21:08:18.861368 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 348/708] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Oct 4 21:08:18 2022] GET /compute/v2.1/os-server-groups/dc9974f1-f005-4f05-aaf9-1081ec35916b => generated 266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:18.884212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-27cd4a5a-7fb9-4494-993c-d3ea56286fa2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:18.890683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-27cd4a5a-7fb9-4494-993c-d3ea56286fa2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:18.908903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27cd4a5a-7fb9-4494-993c-d3ea56286fa2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:18.909467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27cd4a5a-7fb9-4494-993c-d3ea56286fa2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:18.914242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27cd4a5a-7fb9-4494-993c-d3ea56286fa2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:18.915760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27cd4a5a-7fb9-4494-993c-d3ea56286fa2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:18.916219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27cd4a5a-7fb9-4494-993c-d3ea56286fa2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:18.916661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27cd4a5a-7fb9-4494-993c-d3ea56286fa2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:18.954037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d38772e2-6340-44bf-b2dc-bcdbc2b398c5 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:18.966725 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d38772e2-6340-44bf-b2dc-bcdbc2b398c5 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1502 microversion: 2.1 time: 0.255502 Oct 04 21:08:18.968646 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 361/709] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:18 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1502 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:18.984262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f449c965-90cd-4604-8ebf-3e08ceabde46 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:18.986018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f449c965-90cd-4604-8ebf-3e08ceabde46 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:18.999966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f449c965-90cd-4604-8ebf-3e08ceabde46 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:19.000483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f449c965-90cd-4604-8ebf-3e08ceabde46 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:19.000986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f449c965-90cd-4604-8ebf-3e08ceabde46 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:19.003236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f449c965-90cd-4604-8ebf-3e08ceabde46 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:19.003906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f449c965-90cd-4604-8ebf-3e08ceabde46 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:19.004349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f449c965-90cd-4604-8ebf-3e08ceabde46 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:19.100068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f449c965-90cd-4604-8ebf-3e08ceabde46 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:19.117108 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f449c965-90cd-4604-8ebf-3e08ceabde46 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93" status: 200 len: 1344 microversion: 2.1 time: 0.147190 Oct 04 21:08:19.117811 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 362/710] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:18 2022] GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 => generated 1344 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:19.122839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cb63a514-0fd1-482b-b199-64a430296a4e tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:19.124236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cb63a514-0fd1-482b-b199-64a430296a4e tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] [instance: 06d4ebc0-b7ec-4481-ae12-df4530909f2d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:19.130395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb63a514-0fd1-482b-b199-64a430296a4e tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:19.130946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb63a514-0fd1-482b-b199-64a430296a4e tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:19.131645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb63a514-0fd1-482b-b199-64a430296a4e tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:19.132473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb63a514-0fd1-482b-b199-64a430296a4e tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:19.132999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb63a514-0fd1-482b-b199-64a430296a4e tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:19.133534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb63a514-0fd1-482b-b199-64a430296a4e tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:19.228612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-27cd4a5a-7fb9-4494-993c-d3ea56286fa2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:19.238531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-27cd4a5a-7fb9-4494-993c-d3ea56286fa2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:19.249250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-27cd4a5a-7fb9-4494-993c-d3ea56286fa2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:19.253674 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-27cd4a5a-7fb9-4494-993c-d3ea56286fa2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1568 microversion: 2.25 time: 0.375249 Oct 04 21:08:19.254518 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 349/711] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:18 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1568 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:19.342539 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cb63a514-0fd1-482b-b199-64a430296a4e tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/06d4ebc0-b7ec-4481-ae12-df4530909f2d" status: 200 len: 1619 microversion: 2.1 time: 0.223590 Oct 04 21:08:19.343136 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 363/712] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:19 2022] GET /compute/v2.1/servers/06d4ebc0-b7ec-4481-ae12-df4530909f2d => generated 1619 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:19.370870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-74edf62c-3399-4a6a-97c3-cd69166688a8 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:19.371614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-74edf62c-3399-4a6a-97c3-cd69166688a8 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:19.378962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74edf62c-3399-4a6a-97c3-cd69166688a8 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:19.379513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74edf62c-3399-4a6a-97c3-cd69166688a8 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:19.379963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74edf62c-3399-4a6a-97c3-cd69166688a8 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:19.380724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74edf62c-3399-4a6a-97c3-cd69166688a8 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:19.382102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74edf62c-3399-4a6a-97c3-cd69166688a8 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:19.383824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74edf62c-3399-4a6a-97c3-cd69166688a8 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:19.582989 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-74edf62c-3399-4a6a-97c3-cd69166688a8 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d" status: 200 len: 1619 microversion: 2.1 time: 0.215930 Oct 04 21:08:19.583670 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 350/713] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:19 2022] GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d => generated 1619 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:19.610380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7e0b0441-0bdc-4319-86a2-b5c967389438 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Action: 'create', calling method: .version_select at 0x7f57906993a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1587615763", "policies": ["anti-affinity"]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:19.627249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7e0b0441-0bdc-4319-86a2-b5c967389438 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_groups'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:08:19.634035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0d5b84b7-fa81-4608-9727-b2a38f012878 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:19.635385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0d5b84b7-fa81-4608-9727-b2a38f012878 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:19.653891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d5b84b7-fa81-4608-9727-b2a38f012878 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:19.656333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d5b84b7-fa81-4608-9727-b2a38f012878 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:19.656947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d5b84b7-fa81-4608-9727-b2a38f012878 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:19.657731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d5b84b7-fa81-4608-9727-b2a38f012878 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:19.658215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d5b84b7-fa81-4608-9727-b2a38f012878 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:19.658655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d5b84b7-fa81-4608-9727-b2a38f012878 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:19.675618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7e0b0441-0bdc-4319-86a2-b5c967389438 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for user 0f0ac29dc4e440e785408fa1dfedce5e and project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_groups'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:08:19.863470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7e0b0441-0bdc-4319-86a2-b5c967389438 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_groups'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:08:19.873130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7e0b0441-0bdc-4319-86a2-b5c967389438 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for user 0f0ac29dc4e440e785408fa1dfedce5e and project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_groups'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:08:19.887508 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7e0b0441-0bdc-4319-86a2-b5c967389438 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.283742 Oct 04 21:08:19.899450 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 364/714] 10.222.0.30 () {60 vars in 1174 bytes} [Tue Oct 4 21:08:19 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:19.900894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-861b63d8-604b-46d2-a18c-1f648f46562e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:19.901906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-861b63d8-604b-46d2-a18c-1f648f46562e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:19.911289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-861b63d8-604b-46d2-a18c-1f648f46562e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:19.911894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-861b63d8-604b-46d2-a18c-1f648f46562e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:19.912430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-861b63d8-604b-46d2-a18c-1f648f46562e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:19.914312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-861b63d8-604b-46d2-a18c-1f648f46562e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:19.914906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-861b63d8-604b-46d2-a18c-1f648f46562e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:19.915787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-861b63d8-604b-46d2-a18c-1f648f46562e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:19.967406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0d5b84b7-fa81-4608-9727-b2a38f012878 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:19.976846 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0d5b84b7-fa81-4608-9727-b2a38f012878 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1476 microversion: 2.1 time: 0.346581 Oct 04 21:08:19.980561 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 351/715] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:19 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1476 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:19.994212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2d503068-e133-4e3a-a221-4a2abb30d078 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:19.995026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2d503068-e133-4e3a-a221-4a2abb30d078 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:20.005955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d503068-e133-4e3a-a221-4a2abb30d078 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:20.011167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d503068-e133-4e3a-a221-4a2abb30d078 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:20.011772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d503068-e133-4e3a-a221-4a2abb30d078 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:20.012821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d503068-e133-4e3a-a221-4a2abb30d078 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:20.013476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d503068-e133-4e3a-a221-4a2abb30d078 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:20.014642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d503068-e133-4e3a-a221-4a2abb30d078 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:20.056774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-861b63d8-604b-46d2-a18c-1f648f46562e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:20.066505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-861b63d8-604b-46d2-a18c-1f648f46562e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:20.071717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-861b63d8-604b-46d2-a18c-1f648f46562e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:20.081942 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-861b63d8-604b-46d2-a18c-1f648f46562e tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1452 microversion: 2.75 time: 0.186028 Oct 04 21:08:20.083202 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 365/716] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:19 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1452 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:20.096137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-777256568", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "71bca548-1b20-4669-a31b-2cddaf629123"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:20.182905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:08:20.296048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:20.356786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2d503068-e133-4e3a-a221-4a2abb30d078 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:20.367698 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2d503068-e133-4e3a-a221-4a2abb30d078 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1502 microversion: 2.1 time: 0.378159 Oct 04 21:08:20.368795 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 352/717] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:19 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1502 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:20.378701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6a9115b5-1768-4d0a-b704-6e89e03cdb4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:20.379610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6a9115b5-1768-4d0a-b704-6e89e03cdb4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:20.393673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a9115b5-1768-4d0a-b704-6e89e03cdb4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:20.393673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a9115b5-1768-4d0a-b704-6e89e03cdb4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:20.393673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a9115b5-1768-4d0a-b704-6e89e03cdb4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:20.394415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a9115b5-1768-4d0a-b704-6e89e03cdb4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:20.395184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a9115b5-1768-4d0a-b704-6e89e03cdb4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:20.395975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a9115b5-1768-4d0a-b704-6e89e03cdb4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:20.465616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a9115b5-1768-4d0a-b704-6e89e03cdb4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:20.466480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a9115b5-1768-4d0a-b704-6e89e03cdb4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:20.467882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a9115b5-1768-4d0a-b704-6e89e03cdb4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:20.469153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-6a9115b5-1768-4d0a-b704-6e89e03cdb4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lazy-loading 'fault' on Instance uuid fcffd52e-afbb-4711-a9fb-acdaf64b9a93 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:20.847542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6a9115b5-1768-4d0a-b704-6e89e03cdb4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed473156169a4fd793d86dc9e9289dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d13d1c426145c4824dda4e6aa59040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:20.855669 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6a9115b5-1768-4d0a-b704-6e89e03cdb4f tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93" status: 200 len: 1349 microversion: 2.1 time: 0.485423 Oct 04 21:08:20.869820 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 353/718] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:20 2022] GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 => generated 1349 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:20.880916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bfa27885-5a3a-450d-a1b6-e2666a09fb4b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:20.880916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bfa27885-5a3a-450d-a1b6-e2666a09fb4b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:20.884206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfa27885-5a3a-450d-a1b6-e2666a09fb4b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:20.884705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfa27885-5a3a-450d-a1b6-e2666a09fb4b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:20.885144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfa27885-5a3a-450d-a1b6-e2666a09fb4b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:20.885997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfa27885-5a3a-450d-a1b6-e2666a09fb4b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:20.886328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfa27885-5a3a-450d-a1b6-e2666a09fb4b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:20.886754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfa27885-5a3a-450d-a1b6-e2666a09fb4b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:21.089906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:08:21.090477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:08:21.091223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:08:21.092233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:08:21.092859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:08:21.107966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:21.110245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:21.110948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:21.112704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:21.113344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:21.114022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:21.134758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:08:21.141155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for user 0f0ac29dc4e440e785408fa1dfedce5e and project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:08:21.155378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Going to run 2 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:08:21.160536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bfa27885-5a3a-450d-a1b6-e2666a09fb4b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:21.162133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 28198b9c-ff65-40f0-869f-117104e764ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:08:21.170559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bfa27885-5a3a-450d-a1b6-e2666a09fb4b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:21.172348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bfa27885-5a3a-450d-a1b6-e2666a09fb4b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:21.176769 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bfa27885-5a3a-450d-a1b6-e2666a09fb4b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1568 microversion: 2.25 time: 0.305606 Oct 04 21:08:21.177364 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 354/719] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:20 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:21.184399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8a059efa-84ff-4d86-9e0b-49e22a4b90ce tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:21.200402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8a059efa-84ff-4d86-9e0b-49e22a4b90ce tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:21.200402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a059efa-84ff-4d86-9e0b-49e22a4b90ce tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:21.200402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a059efa-84ff-4d86-9e0b-49e22a4b90ce tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:21.200402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a059efa-84ff-4d86-9e0b-49e22a4b90ce tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:21.200402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a059efa-84ff-4d86-9e0b-49e22a4b90ce tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:21.200402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a059efa-84ff-4d86-9e0b-49e22a4b90ce tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:21.200402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a059efa-84ff-4d86-9e0b-49e22a4b90ce tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:21.340528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8a059efa-84ff-4d86-9e0b-49e22a4b90ce tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:21.348672 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8a059efa-84ff-4d86-9e0b-49e22a4b90ce tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1476 microversion: 2.1 time: 0.169990 Oct 04 21:08:21.349486 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 355/720] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:21 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1476 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:21.354693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-57af80df-89d5-48e8-8634-0c09a4682cd9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:21.355464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-57af80df-89d5-48e8-8634-0c09a4682cd9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:21.362947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57af80df-89d5-48e8-8634-0c09a4682cd9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:21.363654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57af80df-89d5-48e8-8634-0c09a4682cd9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:21.364253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57af80df-89d5-48e8-8634-0c09a4682cd9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:21.365100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57af80df-89d5-48e8-8634-0c09a4682cd9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:21.365561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_group_members'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:08:21.365921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57af80df-89d5-48e8-8634-0c09a4682cd9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:21.366353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57af80df-89d5-48e8-8634-0c09a4682cd9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:21.372302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for user 0f0ac29dc4e440e785408fa1dfedce5e and project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_group_members'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:08:21.438944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-57af80df-89d5-48e8-8634-0c09a4682cd9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:21.449913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-57af80df-89d5-48e8-8634-0c09a4682cd9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:21.451733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-57af80df-89d5-48e8-8634-0c09a4682cd9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:21.466241 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-57af80df-89d5-48e8-8634-0c09a4682cd9 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1437 microversion: 2.75 time: 0.110657 Oct 04 21:08:21.466241 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 356/721] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:21 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1437 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:21.479072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c4eefe2f-f497-4ac0-bbb4-512013b54f9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:21.479721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c4eefe2f-f497-4ac0-bbb4-512013b54f9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:21.487686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4eefe2f-f497-4ac0-bbb4-512013b54f9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:21.488438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4eefe2f-f497-4ac0-bbb4-512013b54f9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:21.489178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4eefe2f-f497-4ac0-bbb4-512013b54f9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:21.490232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4eefe2f-f497-4ac0-bbb4-512013b54f9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:21.490880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4eefe2f-f497-4ac0-bbb4-512013b54f9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:21.491483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4eefe2f-f497-4ac0-bbb4-512013b54f9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:21.567015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_group_members'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:08:21.580160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for user 0f0ac29dc4e440e785408fa1dfedce5e and project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_group_members'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:08:21.606608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=28198b9c-ff65-40f0-869f-117104e764ef,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:08:21.672338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:21.745849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_group_members'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:08:21.755842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for user 0f0ac29dc4e440e785408fa1dfedce5e and project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_group_members'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:08:21.776071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c4eefe2f-f497-4ac0-bbb4-512013b54f9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:21.786580 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c4eefe2f-f497-4ac0-bbb4-512013b54f9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1477 microversion: 2.1 time: 0.322098 Oct 04 21:08:21.788117 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 357/722] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:21 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1477 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:21.866572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_group_members'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:08:21.874639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for user 0f0ac29dc4e440e785408fa1dfedce5e and project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'server_group_members'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:08:21.933994 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ddd736e1-9715-4050-aa2f-6eb64087cb0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.849497 Oct 04 21:08:21.939299 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 366/723] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:08:20 2022] POST /compute/v2.1/servers => generated 32 bytes in 1855 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 21:08:21.949336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a77efcc8-d13f-47b0-a7bf-371936848b10 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '.version_select at 0x7f57908ab550>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:21.958442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a77efcc8-d13f-47b0-a7bf-371936848b10 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:21.959759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a77efcc8-d13f-47b0-a7bf-371936848b10 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:21.961187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a77efcc8-d13f-47b0-a7bf-371936848b10 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:21.978431 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a77efcc8-d13f-47b0-a7bf-371936848b10 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1943 microversion: 2.1 time: 0.037720 Oct 04 21:08:21.982738 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 367/724] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Oct 4 21:08:21 2022] GET /compute/v2.1/os-migrations => generated 1943 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:21.989558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa27b966-fb79-44e5-b702-9f17f327e98e tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:21.990434 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aa27b966-fb79-44e5-b702-9f17f327e98e tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:21.997387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa27b966-fb79-44e5-b702-9f17f327e98e tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:22.016754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa27b966-fb79-44e5-b702-9f17f327e98e tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:22.016754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa27b966-fb79-44e5-b702-9f17f327e98e tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:22.016754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa27b966-fb79-44e5-b702-9f17f327e98e tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:22.016754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa27b966-fb79-44e5-b702-9f17f327e98e tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:22.016754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa27b966-fb79-44e5-b702-9f17f327e98e tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:22.075860 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-aa27b966-fb79-44e5-b702-9f17f327e98e tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] HTTP exception thrown: Instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 could not be found. Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa27b966-fb79-44e5-b702-9f17f327e98e tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Request method failure captured: Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 HTTP/1.1 Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKAoI-KUR9fZc13V8-1uehgLz1H3DzvRXpY90VVpBJtd90d6sZdH11E2A0xNrteQi_nq9w0G_z5zYgPwsh0iNgvurNxHfj4geZf5Q3z8y-sHRcKf0ltqlghTzVK1XXYhKmScVhaVdB44hV0HBa6WZl5lUO580bVKSDXDoWjcx4U4xLw Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: c8d13d1c426145c4824dda4e6aa59040 Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c8d13d1c426145c4824dda4e6aa59040"}]}] Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: c8d13d1c426145c4824dda4e6aa59040 Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersWithSpecificFlavorTestJSON-109304057-project Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: ed473156169a4fd793d86dc9e9289dc1 Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057-project Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 could not be found. Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'fcffd52e-afbb-4711-a9fb-acdaf64b9a93'} Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 could not be found. Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 could not be found. Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:22.078170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:22.089504 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:22.089504 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:22.089504 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:22.089504 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:22.089504 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:08:22.089504 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:08:22.089504 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 could not be found. Oct 04 21:08:22.089504 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:22.089504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa27b966-fb79-44e5-b702-9f17f327e98e tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Returning 404 to user: Instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:08:22.089504 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aa27b966-fb79-44e5-b702-9f17f327e98e tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93" status: 404 len: 111 microversion: 2.1 time: 0.096190 Oct 04 21:08:22.089504 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 368/725] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:21 2022] GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:08:22.091742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c5ebd9d7-388c-4b99-b25d-e6c8483a2d1b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:22.101227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c5ebd9d7-388c-4b99-b25d-e6c8483a2d1b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:22.106370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c5ebd9d7-388c-4b99-b25d-e6c8483a2d1b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Searching by: {'deleted': False, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:08:22.122684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:22.126881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:22.138675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5ebd9d7-388c-4b99-b25d-e6c8483a2d1b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:22.139216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5ebd9d7-388c-4b99-b25d-e6c8483a2d1b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:22.142797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5ebd9d7-388c-4b99-b25d-e6c8483a2d1b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:22.142797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5ebd9d7-388c-4b99-b25d-e6c8483a2d1b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:22.143218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5ebd9d7-388c-4b99-b25d-e6c8483a2d1b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:22.144716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:22.145546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:22.146548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5ebd9d7-388c-4b99-b25d-e6c8483a2d1b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:22.146986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:22.147968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:22.148994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:22.151053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:22.278248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.multi_cell_list [None req-c5ebd9d7-388c-4b99-b25d-e6c8483a2d1b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:08:22.335107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:08:22.335542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:08:22.336036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:08:22.336464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:08:22.339756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:08:22.353513 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c5ebd9d7-388c-4b99-b25d-e6c8483a2d1b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.267893 Oct 04 21:08:22.354709 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 369/726] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Oct 4 21:08:22 2022] GET /compute/v2.1/servers => generated 1662 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:22.359687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4d9042dd-7e1e-4917-b004-c50e3a158a09 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:22.360311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4d9042dd-7e1e-4917-b004-c50e3a158a09 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:22.381959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d9042dd-7e1e-4917-b004-c50e3a158a09 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:22.383080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d9042dd-7e1e-4917-b004-c50e3a158a09 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:22.383529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d9042dd-7e1e-4917-b004-c50e3a158a09 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:22.384250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d9042dd-7e1e-4917-b004-c50e3a158a09 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:22.384916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d9042dd-7e1e-4917-b004-c50e3a158a09 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:22.385353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d9042dd-7e1e-4917-b004-c50e3a158a09 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:22.527215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:22.636062 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4d9042dd-7e1e-4917-b004-c50e3a158a09 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1628 microversion: 2.1 time: 0.279369 Oct 04 21:08:22.645453 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 370/727] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:22 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1628 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:22.645453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0c0c057b-4fee-4ba6-86cc-ba5cb811e440 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:22.645453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0c0c057b-4fee-4ba6-86cc-ba5cb811e440 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:22.647610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:22.676044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:22.676886 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:22.677081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:22.682022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c0c057b-4fee-4ba6-86cc-ba5cb811e440 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:22.683457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:22.683457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:22.683701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:22.687046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c0c057b-4fee-4ba6-86cc-ba5cb811e440 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:22.691447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c0c057b-4fee-4ba6-86cc-ba5cb811e440 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:22.691447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c0c057b-4fee-4ba6-86cc-ba5cb811e440 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:22.691447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c0c057b-4fee-4ba6-86cc-ba5cb811e440 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:22.692341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c0c057b-4fee-4ba6-86cc-ba5cb811e440 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:22.734413 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-0c0c057b-4fee-4ba6-86cc-ba5cb811e440 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] HTTP exception thrown: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0c0c057b-4fee-4ba6-86cc-ba5cb811e440 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Request method failure captured: Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 HTTP/1.1 Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKAoI-KUR9fZc13V8-1uehgLz1H3DzvRXpY90VVpBJtd90d6sZdH11E2A0xNrteQi_nq9w0G_z5zYgPwsh0iNgvurNxHfj4geZf5Q3z8y-sHRcKf0ltqlghTzVK1XXYhKmScVhaVdB44hV0HBa6WZl5lUO580bVKSDXDoWjcx4U4xLw Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: c8d13d1c426145c4824dda4e6aa59040 Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c8d13d1c426145c4824dda4e6aa59040"}]}] Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: c8d13d1c426145c4824dda4e6aa59040 Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersWithSpecificFlavorTestJSON-109304057-project Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: ed473156169a4fd793d86dc9e9289dc1 Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057-project Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '7555a913-21ac-440f-8323-ca961a6d08d7'} Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:08:22.736002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:08:22.740617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:22.740617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:22.740617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:22.740617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:22.740617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:22.740617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:22.740617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:22.740617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:08:22.740617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:08:22.740617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:22.740617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:22.740617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0c0c057b-4fee-4ba6-86cc-ba5cb811e440 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Returning 404 to user: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:08:22.740617 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0c0c057b-4fee-4ba6-86cc-ba5cb811e440 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 404 len: 111 microversion: 2.1 time: 0.099355 Oct 04 21:08:22.750994 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 371/728] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:08:22 2022] DELETE /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:08:22.756476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-413fcb1d-3f6c-49b0-b122-512969fd955a req-d78554f2-5412-4f55-97ae-40a60c9115cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6aaef31-56eb-458f-a142-992790ebe523", "name": "network-vif-unplugged", "status": "completed", "tag": "894b83eb-5706-418c-bd1d-c3b0a4308370"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:22.767561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-413fcb1d-3f6c-49b0-b122-512969fd955a req-d78554f2-5412-4f55-97ae-40a60c9115cf service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:22.768045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-413fcb1d-3f6c-49b0-b122-512969fd955a req-d78554f2-5412-4f55-97ae-40a60c9115cf service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:22.768480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-413fcb1d-3f6c-49b0-b122-512969fd955a req-d78554f2-5412-4f55-97ae-40a60c9115cf service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:22.783199 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-413fcb1d-3f6c-49b0-b122-512969fd955a req-d78554f2-5412-4f55-97ae-40a60c9115cf service nova] Creating event network-vif-unplugged:894b83eb-5706-418c-bd1d-c3b0a4308370 for instance b6aaef31-56eb-458f-a142-992790ebe523 on n-h2-860282-1 Oct 04 21:08:22.791758 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-413fcb1d-3f6c-49b0-b122-512969fd955a req-d78554f2-5412-4f55-97ae-40a60c9115cf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036489 Oct 04 21:08:22.795481 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 372/729] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:22.805111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5ab23eed-fe24-48ef-99f8-7e1aab286de7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:22.806289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5ab23eed-fe24-48ef-99f8-7e1aab286de7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:22.815020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ab23eed-fe24-48ef-99f8-7e1aab286de7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:22.815801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ab23eed-fe24-48ef-99f8-7e1aab286de7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:22.816254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ab23eed-fe24-48ef-99f8-7e1aab286de7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:22.817024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ab23eed-fe24-48ef-99f8-7e1aab286de7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:22.817793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ab23eed-fe24-48ef-99f8-7e1aab286de7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:22.818231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ab23eed-fe24-48ef-99f8-7e1aab286de7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:22.955834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:22.975311 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e7359ed2-f017-42bc-b257-0dccf5e08dbc tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206/action" status: 202 len: 1940 microversion: 2.75 time: 1.177250 Oct 04 21:08:22.976230 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 358/730] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Oct 4 21:08:21 2022] POST /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206/action => generated 1940 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 21:08:22.982870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-94c7d50e-5729-4ecd-931d-31516bf672bb tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:22.984113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-94c7d50e-5729-4ecd-931d-31516bf672bb tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:23.100818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-94c7d50e-5729-4ecd-931d-31516bf672bb tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:23.114880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5ab23eed-fe24-48ef-99f8-7e1aab286de7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:23.126821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5ab23eed-fe24-48ef-99f8-7e1aab286de7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:23.129137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5ab23eed-fe24-48ef-99f8-7e1aab286de7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:23.130892 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5ab23eed-fe24-48ef-99f8-7e1aab286de7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1568 microversion: 2.25 time: 0.330558 Oct 04 21:08:23.131622 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 373/731] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:22 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1568 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:23.133279 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-94c7d50e-5729-4ecd-931d-31516bf672bb tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 200 len: 1218 microversion: 2.1 time: 0.148185 Oct 04 21:08:23.136448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b3f3dabc-d467-4a00-91c5-291d72168e36 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:23.137143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b3f3dabc-d467-4a00-91c5-291d72168e36 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:23.138025 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 359/732] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:22 2022] GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:23.159447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8fe8351f-08bf-4505-a228-804cffdbf3b2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Action: 'create', calling method: .version_select at 0x7f57905b4af0>, body: {"keypair": {"name": "tempest-keypair-1792744913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnk1zw2W1YbAynzdIZ9SqRVGLx4S78v7NKqpU1FpC1OMOfwPBqC4GgTLzDiwnxmS5i0mnRpy3skJPgZhNZ2+yPgvj7EIPvKAZunORVuYoJAjSwLWHtkSWOl7v9eBm20xg=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:23.161894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3f3dabc-d467-4a00-91c5-291d72168e36 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:23.162647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3f3dabc-d467-4a00-91c5-291d72168e36 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:23.165963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3f3dabc-d467-4a00-91c5-291d72168e36 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:23.166913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3f3dabc-d467-4a00-91c5-291d72168e36 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:23.167279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3f3dabc-d467-4a00-91c5-291d72168e36 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:23.167706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3f3dabc-d467-4a00-91c5-291d72168e36 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:23.254559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-8fe8351f-08bf-4505-a228-804cffdbf3b2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Getting quotas for project 7e9215d1ae0947ce84469bed21fc05ac. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:08:23.260897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-8fe8351f-08bf-4505-a228-804cffdbf3b2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Getting quotas for user 8bfa449eb3144332afa616cc85d9643f and project 7e9215d1ae0947ce84469bed21fc05ac. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:08:23.347622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b3f3dabc-d467-4a00-91c5-291d72168e36 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:23.356090 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b3f3dabc-d467-4a00-91c5-291d72168e36 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1476 microversion: 2.1 time: 0.223542 Oct 04 21:08:23.356857 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 374/733] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:23 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1476 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:23.361666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-42f76c62-b807-4445-bef6-63cdd913e935 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:23.362335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-42f76c62-b807-4445-bef6-63cdd913e935 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:23.368017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42f76c62-b807-4445-bef6-63cdd913e935 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:23.368494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42f76c62-b807-4445-bef6-63cdd913e935 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:23.368946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42f76c62-b807-4445-bef6-63cdd913e935 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:23.369658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42f76c62-b807-4445-bef6-63cdd913e935 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:23.370113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42f76c62-b807-4445-bef6-63cdd913e935 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:23.370540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42f76c62-b807-4445-bef6-63cdd913e935 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:23.387476 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-42f76c62-b807-4445-bef6-63cdd913e935 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] HTTP exception thrown: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-42f76c62-b807-4445-bef6-63cdd913e935 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Request method failure captured: Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 HTTP/1.1 Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKAoI-KUR9fZc13V8-1uehgLz1H3DzvRXpY90VVpBJtd90d6sZdH11E2A0xNrteQi_nq9w0G_z5zYgPwsh0iNgvurNxHfj4geZf5Q3z8y-sHRcKf0ltqlghTzVK1XXYhKmScVhaVdB44hV0HBa6WZl5lUO580bVKSDXDoWjcx4U4xLw Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: c8d13d1c426145c4824dda4e6aa59040 Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c8d13d1c426145c4824dda4e6aa59040"}]}] Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: c8d13d1c426145c4824dda4e6aa59040 Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersWithSpecificFlavorTestJSON-109304057-project Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: ed473156169a4fd793d86dc9e9289dc1 Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057-project Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '7555a913-21ac-440f-8323-ca961a6d08d7'} Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:23.389875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:23.393823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:23.393823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:23.393823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:23.393823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:23.393823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:08:23.393823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:08:23.393823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:23.393823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:23.393823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-42f76c62-b807-4445-bef6-63cdd913e935 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Returning 404 to user: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:08:23.393823 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-42f76c62-b807-4445-bef6-63cdd913e935 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 404 len: 111 microversion: 2.1 time: 0.033648 Oct 04 21:08:23.393823 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 375/734] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:23 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:08:23.402048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9a88dd75-aeb9-46ab-8be2-78f5a79cbca1 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:23.402906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9a88dd75-aeb9-46ab-8be2-78f5a79cbca1 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:23.412228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a88dd75-aeb9-46ab-8be2-78f5a79cbca1 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:23.412228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a88dd75-aeb9-46ab-8be2-78f5a79cbca1 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:23.412228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a88dd75-aeb9-46ab-8be2-78f5a79cbca1 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:23.412228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a88dd75-aeb9-46ab-8be2-78f5a79cbca1 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:23.412228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a88dd75-aeb9-46ab-8be2-78f5a79cbca1 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:23.412228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a88dd75-aeb9-46ab-8be2-78f5a79cbca1 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:23.441632 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8fe8351f-08bf-4505-a228-804cffdbf3b2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.301787 Oct 04 21:08:23.442706 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 360/735] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:08:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:23.460212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cdb091cb-39f9-4b7d-a627-4f26437810ed tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '.version_select at 0x7f57909de9d0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:23.571721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-9a88dd75-aeb9-46ab-8be2-78f5a79cbca1 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:23.643893 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9a88dd75-aeb9-46ab-8be2-78f5a79cbca1 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.250718 Oct 04 21:08:23.646150 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 376/736] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:23 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:23.783425 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cdb091cb-39f9-4b7d-a627-4f26437810ed tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534777327" status: 202 len: 0 microversion: 2.1 time: 0.339332 Oct 04 21:08:23.784014 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 361/737] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Oct 4 21:08:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534777327 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:08:24.157326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2e11c2e4-0384-43de-9740-3e778fbf651b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:24.157911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2e11c2e4-0384-43de-9740-3e778fbf651b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:24.164483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d08c4acf-f519-454f-96bc-56e89d170c64 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:24.168613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d08c4acf-f519-454f-96bc-56e89d170c64 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:24.168954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e11c2e4-0384-43de-9740-3e778fbf651b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:24.168954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e11c2e4-0384-43de-9740-3e778fbf651b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:24.168954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e11c2e4-0384-43de-9740-3e778fbf651b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:24.168954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e11c2e4-0384-43de-9740-3e778fbf651b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:24.168954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e11c2e4-0384-43de-9740-3e778fbf651b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:24.168954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e11c2e4-0384-43de-9740-3e778fbf651b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:24.352280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d08c4acf-f519-454f-96bc-56e89d170c64 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:24.352280 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d08c4acf-f519-454f-96bc-56e89d170c64 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 200 len: 1218 microversion: 2.1 time: 0.165660 Oct 04 21:08:24.352280 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 362/738] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:24 2022] GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 1218 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:24.385984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e0969257-297f-4b9c-bdfa-3859b560052b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:24.387003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e0969257-297f-4b9c-bdfa-3859b560052b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:24.402998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0969257-297f-4b9c-bdfa-3859b560052b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:24.402998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0969257-297f-4b9c-bdfa-3859b560052b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:24.402998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0969257-297f-4b9c-bdfa-3859b560052b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:24.402998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0969257-297f-4b9c-bdfa-3859b560052b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:24.402998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0969257-297f-4b9c-bdfa-3859b560052b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:24.402998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0969257-297f-4b9c-bdfa-3859b560052b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:24.507104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2e11c2e4-0384-43de-9740-3e778fbf651b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:24.522839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2e11c2e4-0384-43de-9740-3e778fbf651b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:24.525918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2e11c2e4-0384-43de-9740-3e778fbf651b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:24.528235 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2e11c2e4-0384-43de-9740-3e778fbf651b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1568 microversion: 2.25 time: 0.375857 Oct 04 21:08:24.530698 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 377/739] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:24 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1568 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:24.605179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e0969257-297f-4b9c-bdfa-3859b560052b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:24.619878 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e0969257-297f-4b9c-bdfa-3859b560052b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1476 microversion: 2.1 time: 0.242321 Oct 04 21:08:24.623017 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 363/740] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:24 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1476 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:24.681080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aa54d9da-9038-4244-954d-3136512a6374 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:24.685735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-aa54d9da-9038-4244-954d-3136512a6374 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:24.695735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa54d9da-9038-4244-954d-3136512a6374 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:24.696837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa54d9da-9038-4244-954d-3136512a6374 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:24.697735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa54d9da-9038-4244-954d-3136512a6374 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:24.699150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa54d9da-9038-4244-954d-3136512a6374 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:24.699687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa54d9da-9038-4244-954d-3136512a6374 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:24.700194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa54d9da-9038-4244-954d-3136512a6374 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:24.726796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a8f73f22-2144-46b8-b49d-d51c2d7b4b3c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-2120197262", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": "none"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:24.811629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a8f73f22-2144-46b8-b49d-d51c2d7b4b3c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:08:24.815962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a8f73f22-2144-46b8-b49d-d51c2d7b4b3c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:08:24.815962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a8f73f22-2144-46b8-b49d-d51c2d7b4b3c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:08:24.815962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a8f73f22-2144-46b8-b49d-d51c2d7b4b3c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:08:24.815962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a8f73f22-2144-46b8-b49d-d51c2d7b4b3c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:08:24.828722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a8f73f22-2144-46b8-b49d-d51c2d7b4b3c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:24.829746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a8f73f22-2144-46b8-b49d-d51c2d7b4b3c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:24.830548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a8f73f22-2144-46b8-b49d-d51c2d7b4b3c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:24.831493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a8f73f22-2144-46b8-b49d-d51c2d7b4b3c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:24.831949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a8f73f22-2144-46b8-b49d-d51c2d7b4b3c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:24.832380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a8f73f22-2144-46b8-b49d-d51c2d7b4b3c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:24.839097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-aa54d9da-9038-4244-954d-3136512a6374 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:24.852238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-a8f73f22-2144-46b8-b49d-d51c2d7b4b3c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Getting quotas for project b79808dd205e4a8c87a0a32c9e38da30. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:08:24.861377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-a8f73f22-2144-46b8-b49d-d51c2d7b4b3c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Getting quotas for user a07e879a204d4cf48e68655838e27e98 and project b79808dd205e4a8c87a0a32c9e38da30. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:08:24.865814 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-aa54d9da-9038-4244-954d-3136512a6374 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.192627 Oct 04 21:08:24.865814 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 364/741] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:24 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:24.868744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-a8873c83-caae-4fa2-8f9a-966d1c4ed093 req-9c4e47fe-84eb-4386-bedc-bc2802fb2293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6aaef31-56eb-458f-a142-992790ebe523", "tag": "894b83eb-5706-418c-bd1d-c3b0a4308370"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:24.879159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a8f73f22-2144-46b8-b49d-d51c2d7b4b3c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:08:24.880677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a8873c83-caae-4fa2-8f9a-966d1c4ed093 req-9c4e47fe-84eb-4386-bedc-bc2802fb2293 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:24.881328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a8873c83-caae-4fa2-8f9a-966d1c4ed093 req-9c4e47fe-84eb-4386-bedc-bc2802fb2293 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:24.881560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a8f73f22-2144-46b8-b49d-d51c2d7b4b3c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:08:24.882370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a8873c83-caae-4fa2-8f9a-966d1c4ed093 req-9c4e47fe-84eb-4386-bedc-bc2802fb2293 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:24.897937 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-a8873c83-caae-4fa2-8f9a-966d1c4ed093 req-9c4e47fe-84eb-4386-bedc-bc2802fb2293 service nova] Creating event network-changed:894b83eb-5706-418c-bd1d-c3b0a4308370 for instance b6aaef31-56eb-458f-a142-992790ebe523 on n-h2-860282-1 Oct 04 21:08:24.904033 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-a8873c83-caae-4fa2-8f9a-966d1c4ed093 req-9c4e47fe-84eb-4386-bedc-bc2802fb2293 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039342 Oct 04 21:08:24.905069 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 365/742] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:25.116034 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a8f73f22-2144-46b8-b49d-d51c2d7b4b3c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.554776 Oct 04 21:08:25.125473 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 378/743] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Oct 4 21:08:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 21:08:25.136952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d16dfdab-a9a3-4435-844d-88fffabced69 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:25.137757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d16dfdab-a9a3-4435-844d-88fffabced69 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:25.231281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d16dfdab-a9a3-4435-844d-88fffabced69 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:25.241314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d16dfdab-a9a3-4435-844d-88fffabced69 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:25.243106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d16dfdab-a9a3-4435-844d-88fffabced69 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:25.249344 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d16dfdab-a9a3-4435-844d-88fffabced69 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1454 microversion: 2.91 time: 0.121902 Oct 04 21:08:25.259680 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 366/744] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:25 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:25.356854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cfe4e92e-dc53-4c24-bf24-175caeeb7ed1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:25.358426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cfe4e92e-dc53-4c24-bf24-175caeeb7ed1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:25.367740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfe4e92e-dc53-4c24-bf24-175caeeb7ed1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:25.368778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfe4e92e-dc53-4c24-bf24-175caeeb7ed1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:25.370430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfe4e92e-dc53-4c24-bf24-175caeeb7ed1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:25.371384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfe4e92e-dc53-4c24-bf24-175caeeb7ed1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:25.372013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfe4e92e-dc53-4c24-bf24-175caeeb7ed1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:25.372608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfe4e92e-dc53-4c24-bf24-175caeeb7ed1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:25.384496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ae1d57e2-ea13-4c29-95ce-03d075ffe1a4 tempest-ServersWithSpecificFlavorTestJSON-699011552 tempest-ServersWithSpecificFlavorTestJSON-699011552-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:25.454091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cfe4e92e-dc53-4c24-bf24-175caeeb7ed1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:25.463218 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cfe4e92e-dc53-4c24-bf24-175caeeb7ed1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 200 len: 1222 microversion: 2.1 time: 0.112556 Oct 04 21:08:25.464033 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 379/745] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:25 2022] GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 1222 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:25.489101 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ae1d57e2-ea13-4c29-95ce-03d075ffe1a4 tempest-ServersWithSpecificFlavorTestJSON-699011552 tempest-ServersWithSpecificFlavorTestJSON-699011552-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1301334420" status: 202 len: 0 microversion: 2.1 time: 0.107938 Oct 04 21:08:25.490047 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 367/746] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Oct 4 21:08:25 2022] DELETE /compute/v2.1/flavors/1301334420 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:08:25.501756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2ce3b34c-cced-4947-8677-74fcc77666d2 tempest-ServersWithSpecificFlavorTestJSON-699011552 tempest-ServersWithSpecificFlavorTestJSON-699011552-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:25.532827 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2ce3b34c-cced-4947-8677-74fcc77666d2 tempest-ServersWithSpecificFlavorTestJSON-699011552 tempest-ServersWithSpecificFlavorTestJSON-699011552-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5400 microversion: 2.1 time: 0.036409 Oct 04 21:08:25.534667 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 380/747] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:08:25 2022] GET /compute/v2.1/flavors/detail => generated 5400 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:25.555062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c4a0d4fa-3529-40dd-a934-fc6be04836e5 tempest-ServersWithSpecificFlavorTestJSON-699011552 tempest-ServersWithSpecificFlavorTestJSON-699011552-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:25.556777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4cfee9c3-8c68-4428-abc4-4d7a7089b730 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:25.557461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4cfee9c3-8c68-4428-abc4-4d7a7089b730 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:25.569461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cfee9c3-8c68-4428-abc4-4d7a7089b730 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:25.569963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cfee9c3-8c68-4428-abc4-4d7a7089b730 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:25.570401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cfee9c3-8c68-4428-abc4-4d7a7089b730 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:25.576880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cfee9c3-8c68-4428-abc4-4d7a7089b730 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:25.577370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cfee9c3-8c68-4428-abc4-4d7a7089b730 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:25.578093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cfee9c3-8c68-4428-abc4-4d7a7089b730 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:25.679382 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c4a0d4fa-3529-40dd-a934-fc6be04836e5 tempest-ServersWithSpecificFlavorTestJSON-699011552 tempest-ServersWithSpecificFlavorTestJSON-699011552-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/78680178" status: 202 len: 0 microversion: 2.1 time: 0.129861 Oct 04 21:08:25.680241 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 368/748] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Oct 4 21:08:25 2022] DELETE /compute/v2.1/flavors/78680178 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:08:25.687849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d6713927-3ab7-44b5-ab4b-465b04603884 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:25.688837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d6713927-3ab7-44b5-ab4b-465b04603884 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:25.705012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6713927-3ab7-44b5-ab4b-465b04603884 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:25.713567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6713927-3ab7-44b5-ab4b-465b04603884 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:25.713567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6713927-3ab7-44b5-ab4b-465b04603884 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:25.713567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6713927-3ab7-44b5-ab4b-465b04603884 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:25.713567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6713927-3ab7-44b5-ab4b-465b04603884 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:25.713567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6713927-3ab7-44b5-ab4b-465b04603884 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:25.843208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4cfee9c3-8c68-4428-abc4-4d7a7089b730 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:25.869897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4cfee9c3-8c68-4428-abc4-4d7a7089b730 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:25.882048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4cfee9c3-8c68-4428-abc4-4d7a7089b730 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:25.883719 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4cfee9c3-8c68-4428-abc4-4d7a7089b730 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1568 microversion: 2.25 time: 0.331247 Oct 04 21:08:25.885984 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 381/749] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:25 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1568 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:25.896312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-67876125-c9cc-42e6-ab1f-2e1a3de10e97 tempest-ServersWithSpecificFlavorTestJSON-699011552 tempest-ServersWithSpecificFlavorTestJSON-699011552-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:25.922904 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-67876125-c9cc-42e6-ab1f-2e1a3de10e97 tempest-ServersWithSpecificFlavorTestJSON-699011552 tempest-ServersWithSpecificFlavorTestJSON-699011552-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035783 Oct 04 21:08:25.934820 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 382/750] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:08:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:25.941364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d6713927-3ab7-44b5-ab4b-465b04603884 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:25.943168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2bdd39d6-dab4-446b-b5b9-65cfa7fe7dab tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:25.945705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2bdd39d6-dab4-446b-b5b9-65cfa7fe7dab tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:25.950659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bdd39d6-dab4-446b-b5b9-65cfa7fe7dab tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:25.951191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bdd39d6-dab4-446b-b5b9-65cfa7fe7dab tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:25.951636 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bdd39d6-dab4-446b-b5b9-65cfa7fe7dab tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:25.952535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bdd39d6-dab4-446b-b5b9-65cfa7fe7dab tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:25.953079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bdd39d6-dab4-446b-b5b9-65cfa7fe7dab tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:25.953545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bdd39d6-dab4-446b-b5b9-65cfa7fe7dab tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:25.955492 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d6713927-3ab7-44b5-ab4b-465b04603884 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1476 microversion: 2.1 time: 0.273730 Oct 04 21:08:25.960863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:25.966022 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 369/751] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:25 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1476 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:25.972443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-48162f96-456c-488c-b2e7-9ac2f9769fe1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:25.974663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-48162f96-456c-488c-b2e7-9ac2f9769fe1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:25.981407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:DELETE=7 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:25.985965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48162f96-456c-488c-b2e7-9ac2f9769fe1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:25.986815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48162f96-456c-488c-b2e7-9ac2f9769fe1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:25.987792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48162f96-456c-488c-b2e7-9ac2f9769fe1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:25.988807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48162f96-456c-488c-b2e7-9ac2f9769fe1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:25.989518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48162f96-456c-488c-b2e7-9ac2f9769fe1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:25.990863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48162f96-456c-488c-b2e7-9ac2f9769fe1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:26.016423 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-48162f96-456c-488c-b2e7-9ac2f9769fe1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] HTTP exception thrown: Instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 could not be found. Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-48162f96-456c-488c-b2e7-9ac2f9769fe1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Request method failure captured: Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 HTTP/1.1 Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKAoI-KUR9fZc13V8-1uehgLz1H3DzvRXpY90VVpBJtd90d6sZdH11E2A0xNrteQi_nq9w0G_z5zYgPwsh0iNgvurNxHfj4geZf5Q3z8y-sHRcKf0ltqlghTzVK1XXYhKmScVhaVdB44hV0HBa6WZl5lUO580bVKSDXDoWjcx4U4xLw Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: c8d13d1c426145c4824dda4e6aa59040 Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c8d13d1c426145c4824dda4e6aa59040"}]}] Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: c8d13d1c426145c4824dda4e6aa59040 Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersWithSpecificFlavorTestJSON-109304057-project Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: ed473156169a4fd793d86dc9e9289dc1 Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057-project Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 could not be found. Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'fcffd52e-afbb-4711-a9fb-acdaf64b9a93'} Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 could not be found. Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:08:26.019060 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:08:26.023304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 could not be found. Oct 04 21:08:26.023304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.023304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:26.023304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.023304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:26.023304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:26.023304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:26.023304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:08:26.023304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:08:26.023304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 could not be found. Oct 04 21:08:26.023304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.026378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-48162f96-456c-488c-b2e7-9ac2f9769fe1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Returning 404 to user: Instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:08:26.028941 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-48162f96-456c-488c-b2e7-9ac2f9769fe1 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93" status: 404 len: 111 microversion: 2.1 time: 0.059657 Oct 04 21:08:26.031065 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 370/752] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:08:25 2022] DELETE /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:08:26.037910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-2bdd39d6-dab4-446b-b5b9-65cfa7fe7dab tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:26.046053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cfdf6f1d-efba-4138-8716-d767e6be29bb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:26.049835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cfdf6f1d-efba-4138-8716-d767e6be29bb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: fcffd52e-afbb-4711-a9fb-acdaf64b9a93] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:26.057217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cfdf6f1d-efba-4138-8716-d767e6be29bb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:26.057217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cfdf6f1d-efba-4138-8716-d767e6be29bb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:26.064561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cfdf6f1d-efba-4138-8716-d767e6be29bb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:26.069005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cfdf6f1d-efba-4138-8716-d767e6be29bb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:26.070348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cfdf6f1d-efba-4138-8716-d767e6be29bb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:26.071533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cfdf6f1d-efba-4138-8716-d767e6be29bb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:26.074822 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2bdd39d6-dab4-446b-b5b9-65cfa7fe7dab tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.136756 Oct 04 21:08:26.089461 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 383/753] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:25 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-cfdf6f1d-efba-4138-8716-d767e6be29bb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] HTTP exception thrown: Instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 could not be found. Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cfdf6f1d-efba-4138-8716-d767e6be29bb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Request method failure captured: Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 HTTP/1.1 Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKAoI-KUR9fZc13V8-1uehgLz1H3DzvRXpY90VVpBJtd90d6sZdH11E2A0xNrteQi_nq9w0G_z5zYgPwsh0iNgvurNxHfj4geZf5Q3z8y-sHRcKf0ltqlghTzVK1XXYhKmScVhaVdB44hV0HBa6WZl5lUO580bVKSDXDoWjcx4U4xLw Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: c8d13d1c426145c4824dda4e6aa59040 Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c8d13d1c426145c4824dda4e6aa59040"}]}] Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: c8d13d1c426145c4824dda4e6aa59040 Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersWithSpecificFlavorTestJSON-109304057-project Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: ed473156169a4fd793d86dc9e9289dc1 Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057-project Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 could not be found. Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'fcffd52e-afbb-4711-a9fb-acdaf64b9a93'} Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 could not be found. Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:08:26.095528 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:08:26.099682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:08:26.099682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 could not be found. Oct 04 21:08:26.099682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.099682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:26.099682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.099682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:26.099682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:26.099682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:26.099682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:08:26.099682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:08:26.099682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 could not be found. Oct 04 21:08:26.099682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.099682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cfdf6f1d-efba-4138-8716-d767e6be29bb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Returning 404 to user: Instance fcffd52e-afbb-4711-a9fb-acdaf64b9a93 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:08:26.099682 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cfdf6f1d-efba-4138-8716-d767e6be29bb tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93" status: 404 len: 111 microversion: 2.1 time: 0.058426 Oct 04 21:08:26.099682 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 371/754] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:26 2022] GET /compute/v2.1/servers/fcffd52e-afbb-4711-a9fb-acdaf64b9a93 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:08:26.108246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c15dcd82-ccc5-4c3e-8152-745b66d74d2b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:26.108522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c15dcd82-ccc5-4c3e-8152-745b66d74d2b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:26.115732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c15dcd82-ccc5-4c3e-8152-745b66d74d2b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:26.116321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c15dcd82-ccc5-4c3e-8152-745b66d74d2b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:26.116884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c15dcd82-ccc5-4c3e-8152-745b66d74d2b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:26.121678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c15dcd82-ccc5-4c3e-8152-745b66d74d2b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:26.121678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c15dcd82-ccc5-4c3e-8152-745b66d74d2b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:26.121678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c15dcd82-ccc5-4c3e-8152-745b66d74d2b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-c15dcd82-ccc5-4c3e-8152-745b66d74d2b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] HTTP exception thrown: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c15dcd82-ccc5-4c3e-8152-745b66d74d2b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Request method failure captured: Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 HTTP/1.1 Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKAoI-KUR9fZc13V8-1uehgLz1H3DzvRXpY90VVpBJtd90d6sZdH11E2A0xNrteQi_nq9w0G_z5zYgPwsh0iNgvurNxHfj4geZf5Q3z8y-sHRcKf0ltqlghTzVK1XXYhKmScVhaVdB44hV0HBa6WZl5lUO580bVKSDXDoWjcx4U4xLw Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: c8d13d1c426145c4824dda4e6aa59040 Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c8d13d1c426145c4824dda4e6aa59040"}]}] Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: c8d13d1c426145c4824dda4e6aa59040 Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersWithSpecificFlavorTestJSON-109304057-project Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: ed473156169a4fd793d86dc9e9289dc1 Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057-project Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '7555a913-21ac-440f-8323-ca961a6d08d7'} Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:08:26.158800 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:08:26.164936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:08:26.164936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:08:26.164936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:08:26.164936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:26.164936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.164936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:26.164936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.164936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:26.164936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:26.164936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:26.164936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:08:26.164936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:08:26.164936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:26.164936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.164936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c15dcd82-ccc5-4c3e-8152-745b66d74d2b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Returning 404 to user: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:08:26.164936 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c15dcd82-ccc5-4c3e-8152-745b66d74d2b tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 404 len: 111 microversion: 2.1 time: 0.054698 Oct 04 21:08:26.174787 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 384/755] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:08:26 2022] DELETE /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:08:26.190003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aca39f05-a61a-40c7-a7a7-6619e5ceb429 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:26.191916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-aca39f05-a61a-40c7-a7a7-6619e5ceb429 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] [instance: 7555a913-21ac-440f-8323-ca961a6d08d7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:26.212010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aca39f05-a61a-40c7-a7a7-6619e5ceb429 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:26.215512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aca39f05-a61a-40c7-a7a7-6619e5ceb429 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:26.219485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aca39f05-a61a-40c7-a7a7-6619e5ceb429 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:26.220721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aca39f05-a61a-40c7-a7a7-6619e5ceb429 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:26.223461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aca39f05-a61a-40c7-a7a7-6619e5ceb429 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:26.223917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aca39f05-a61a-40c7-a7a7-6619e5ceb429 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:26.262501 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-aca39f05-a61a-40c7-a7a7-6619e5ceb429 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] HTTP exception thrown: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aca39f05-a61a-40c7-a7a7-6619e5ceb429 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Request method failure captured: Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 HTTP/1.1 Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKAoI-KUR9fZc13V8-1uehgLz1H3DzvRXpY90VVpBJtd90d6sZdH11E2A0xNrteQi_nq9w0G_z5zYgPwsh0iNgvurNxHfj4geZf5Q3z8y-sHRcKf0ltqlghTzVK1XXYhKmScVhaVdB44hV0HBa6WZl5lUO580bVKSDXDoWjcx4U4xLw Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: c8d13d1c426145c4824dda4e6aa59040 Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c8d13d1c426145c4824dda4e6aa59040"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c8d13d1c426145c4824dda4e6aa59040"}]}] Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: c8d13d1c426145c4824dda4e6aa59040 Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057 Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersWithSpecificFlavorTestJSON-109304057-project Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: ed473156169a4fd793d86dc9e9289dc1 Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-109304057-project Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '7555a913-21ac-440f-8323-ca961a6d08d7'} Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.267717 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:26.272289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.272289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:26.272289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:26.272289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:26.272289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:08:26.272289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:08:26.272289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. Oct 04 21:08:26.272289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:26.272289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aca39f05-a61a-40c7-a7a7-6619e5ceb429 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] Returning 404 to user: Instance 7555a913-21ac-440f-8323-ca961a6d08d7 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:08:26.272289 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-aca39f05-a61a-40c7-a7a7-6619e5ceb429 tempest-ServersWithSpecificFlavorTestJSON-109304057 tempest-ServersWithSpecificFlavorTestJSON-109304057-project] 10.222.0.30 "GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7" status: 404 len: 111 microversion: 2.1 time: 0.093617 Oct 04 21:08:26.272289 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 372/756] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:26 2022] GET /compute/v2.1/servers/7555a913-21ac-440f-8323-ca961a6d08d7 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:08:26.284519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1d72421f-cd39-47f7-8076-789ddfe8609c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:26.285127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1d72421f-cd39-47f7-8076-789ddfe8609c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:26.373088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1d72421f-cd39-47f7-8076-789ddfe8609c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:26.383944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1d72421f-cd39-47f7-8076-789ddfe8609c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:26.386567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1d72421f-cd39-47f7-8076-789ddfe8609c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:26.409354 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1d72421f-cd39-47f7-8076-789ddfe8609c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1454 microversion: 2.91 time: 0.133060 Oct 04 21:08:26.426324 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 385/757] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:26 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:26.493571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7e8f2416-bf31-4fb9-8482-4298934f159b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:26.499317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7e8f2416-bf31-4fb9-8482-4298934f159b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:26.511778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e8f2416-bf31-4fb9-8482-4298934f159b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:26.514340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e8f2416-bf31-4fb9-8482-4298934f159b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:26.515004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e8f2416-bf31-4fb9-8482-4298934f159b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:26.517994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e8f2416-bf31-4fb9-8482-4298934f159b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:26.518892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e8f2416-bf31-4fb9-8482-4298934f159b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:26.521135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e8f2416-bf31-4fb9-8482-4298934f159b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:26.661832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7e8f2416-bf31-4fb9-8482-4298934f159b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:26.665651 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7e8f2416-bf31-4fb9-8482-4298934f159b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 200 len: 1270 microversion: 2.1 time: 0.181478 Oct 04 21:08:26.666228 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 373/758] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:26 2022] GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 1270 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:26.917724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cf97eac0-b993-4f57-9e4c-6e4c42f5a971 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:26.918540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cf97eac0-b993-4f57-9e4c-6e4c42f5a971 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:26.931415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf97eac0-b993-4f57-9e4c-6e4c42f5a971 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:26.933375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf97eac0-b993-4f57-9e4c-6e4c42f5a971 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:26.934357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf97eac0-b993-4f57-9e4c-6e4c42f5a971 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:26.935665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf97eac0-b993-4f57-9e4c-6e4c42f5a971 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:26.936439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf97eac0-b993-4f57-9e4c-6e4c42f5a971 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:26.937098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf97eac0-b993-4f57-9e4c-6e4c42f5a971 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:26.988235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dc7d2bc4-9a6a-46c8-8198-167d4c69815b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:26.989268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dc7d2bc4-9a6a-46c8-8198-167d4c69815b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:27.001844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc7d2bc4-9a6a-46c8-8198-167d4c69815b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:27.002490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc7d2bc4-9a6a-46c8-8198-167d4c69815b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:27.003263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc7d2bc4-9a6a-46c8-8198-167d4c69815b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:27.004096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc7d2bc4-9a6a-46c8-8198-167d4c69815b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:27.004817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc7d2bc4-9a6a-46c8-8198-167d4c69815b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:27.005538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc7d2bc4-9a6a-46c8-8198-167d4c69815b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:27.848193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cf97eac0-b993-4f57-9e4c-6e4c42f5a971 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:27.858987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cf97eac0-b993-4f57-9e4c-6e4c42f5a971 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:27.860680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cf97eac0-b993-4f57-9e4c-6e4c42f5a971 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:27.861903 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cf97eac0-b993-4f57-9e4c-6e4c42f5a971 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1568 microversion: 2.25 time: 0.951999 Oct 04 21:08:27.862645 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 386/759] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:26 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1568 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:27.884804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-748cfc20-260e-4380-ace5-f28ce09f2e11 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:27.885385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-748cfc20-260e-4380-ace5-f28ce09f2e11 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:27.892042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-748cfc20-260e-4380-ace5-f28ce09f2e11 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:27.892264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-748cfc20-260e-4380-ace5-f28ce09f2e11 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:27.892755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-748cfc20-260e-4380-ace5-f28ce09f2e11 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:27.893487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-748cfc20-260e-4380-ace5-f28ce09f2e11 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:27.893948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-748cfc20-260e-4380-ace5-f28ce09f2e11 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:27.894375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-748cfc20-260e-4380-ace5-f28ce09f2e11 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:27.921327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dc7d2bc4-9a6a-46c8-8198-167d4c69815b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:27.931651 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dc7d2bc4-9a6a-46c8-8198-167d4c69815b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1476 microversion: 2.1 time: 0.949366 Oct 04 21:08:27.932251 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 374/760] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:26 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1476 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:27.963954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7986de41-ffc6-4e25-b0d8-25b9abf21513 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:27.963954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7986de41-ffc6-4e25-b0d8-25b9abf21513 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:27.987915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7986de41-ffc6-4e25-b0d8-25b9abf21513 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:27.988426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7986de41-ffc6-4e25-b0d8-25b9abf21513 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:27.990208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7986de41-ffc6-4e25-b0d8-25b9abf21513 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:27.992058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7986de41-ffc6-4e25-b0d8-25b9abf21513 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:27.994278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7986de41-ffc6-4e25-b0d8-25b9abf21513 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:27.997411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7986de41-ffc6-4e25-b0d8-25b9abf21513 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:28.161261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-748cfc20-260e-4380-ace5-f28ce09f2e11 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:28.180600 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-748cfc20-260e-4380-ace5-f28ce09f2e11 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.301640 Oct 04 21:08:28.181304 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 387/761] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:27 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:28.196075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d0a9748a-ce73-49f2-bb3f-b53b4507740e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:28.196788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d0a9748a-ce73-49f2-bb3f-b53b4507740e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:28.203654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0a9748a-ce73-49f2-bb3f-b53b4507740e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:28.204216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0a9748a-ce73-49f2-bb3f-b53b4507740e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:28.204745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0a9748a-ce73-49f2-bb3f-b53b4507740e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:28.206235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0a9748a-ce73-49f2-bb3f-b53b4507740e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:28.206708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0a9748a-ce73-49f2-bb3f-b53b4507740e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:28.207141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0a9748a-ce73-49f2-bb3f-b53b4507740e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:28.230451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7986de41-ffc6-4e25-b0d8-25b9abf21513 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:28.238728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7986de41-ffc6-4e25-b0d8-25b9abf21513 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:28.240647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7986de41-ffc6-4e25-b0d8-25b9abf21513 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:28.259882 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7986de41-ffc6-4e25-b0d8-25b9abf21513 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1506 microversion: 2.91 time: 0.309453 Oct 04 21:08:28.262892 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 375/762] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:27 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:28.410921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d0a9748a-ce73-49f2-bb3f-b53b4507740e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:28.419373 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d0a9748a-ce73-49f2-bb3f-b53b4507740e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 200 len: 1276 microversion: 2.1 time: 0.230869 Oct 04 21:08:28.421928 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 388/763] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:28 2022] GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 1276 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:28.891512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-67f04369-b424-4c3f-bc29-f2720b5926a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:28.892444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-67f04369-b424-4c3f-bc29-f2720b5926a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:28.902018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67f04369-b424-4c3f-bc29-f2720b5926a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:28.903204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67f04369-b424-4c3f-bc29-f2720b5926a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:28.903903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67f04369-b424-4c3f-bc29-f2720b5926a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:28.906025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67f04369-b424-4c3f-bc29-f2720b5926a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:28.906737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67f04369-b424-4c3f-bc29-f2720b5926a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:28.907675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67f04369-b424-4c3f-bc29-f2720b5926a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:28.961890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-441c05f3-fa01-4833-9992-8491216d7741 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:28.966619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-441c05f3-fa01-4833-9992-8491216d7741 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:28.970580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-441c05f3-fa01-4833-9992-8491216d7741 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:28.971349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-441c05f3-fa01-4833-9992-8491216d7741 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:28.972064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-441c05f3-fa01-4833-9992-8491216d7741 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:28.973212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-441c05f3-fa01-4833-9992-8491216d7741 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:28.973986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-441c05f3-fa01-4833-9992-8491216d7741 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:28.974748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-441c05f3-fa01-4833-9992-8491216d7741 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:29.481912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-67f04369-b424-4c3f-bc29-f2720b5926a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:29.493170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-67f04369-b424-4c3f-bc29-f2720b5926a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:29.495192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-67f04369-b424-4c3f-bc29-f2720b5926a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:29.496374 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-67f04369-b424-4c3f-bc29-f2720b5926a2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1568 microversion: 2.25 time: 0.610801 Oct 04 21:08:29.497459 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 376/764] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:28 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1568 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:29.517671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-29adce65-40fa-48ac-b343-bc848f967d8e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:29.518299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-29adce65-40fa-48ac-b343-bc848f967d8e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:29.526645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29adce65-40fa-48ac-b343-bc848f967d8e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:29.527579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29adce65-40fa-48ac-b343-bc848f967d8e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:29.528199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29adce65-40fa-48ac-b343-bc848f967d8e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:29.529090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29adce65-40fa-48ac-b343-bc848f967d8e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:29.529744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29adce65-40fa-48ac-b343-bc848f967d8e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:29.530182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29adce65-40fa-48ac-b343-bc848f967d8e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:29.547574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-441c05f3-fa01-4833-9992-8491216d7741 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:29.558657 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-441c05f3-fa01-4833-9992-8491216d7741 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1476 microversion: 2.1 time: 0.600931 Oct 04 21:08:29.559889 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 389/765] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:28 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1476 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:29.579993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b85bc182-f458-4d65-8d6e-b538759598fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:29.581461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b85bc182-f458-4d65-8d6e-b538759598fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:29.588133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b85bc182-f458-4d65-8d6e-b538759598fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:29.588644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b85bc182-f458-4d65-8d6e-b538759598fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:29.589087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b85bc182-f458-4d65-8d6e-b538759598fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:29.589822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b85bc182-f458-4d65-8d6e-b538759598fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:29.590391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b85bc182-f458-4d65-8d6e-b538759598fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:29.590843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b85bc182-f458-4d65-8d6e-b538759598fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:29.628893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-29adce65-40fa-48ac-b343-bc848f967d8e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:29.648278 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-29adce65-40fa-48ac-b343-bc848f967d8e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.137796 Oct 04 21:08:29.648879 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 377/766] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:29 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:29.657076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1d36d1ff-9539-41e1-9bbe-33b6ec343031 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:29.657728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1d36d1ff-9539-41e1-9bbe-33b6ec343031 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:29.663757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d36d1ff-9539-41e1-9bbe-33b6ec343031 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:29.664622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d36d1ff-9539-41e1-9bbe-33b6ec343031 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:29.665233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d36d1ff-9539-41e1-9bbe-33b6ec343031 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:29.666128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d36d1ff-9539-41e1-9bbe-33b6ec343031 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:29.666511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b85bc182-f458-4d65-8d6e-b538759598fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:29.666933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d36d1ff-9539-41e1-9bbe-33b6ec343031 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:29.667507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d36d1ff-9539-41e1-9bbe-33b6ec343031 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:29.681048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b85bc182-f458-4d65-8d6e-b538759598fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:29.682546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b85bc182-f458-4d65-8d6e-b538759598fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:29.691073 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b85bc182-f458-4d65-8d6e-b538759598fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1512 microversion: 2.91 time: 0.119668 Oct 04 21:08:29.691660 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 390/767] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:29 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1512 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:29.891172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1d36d1ff-9539-41e1-9bbe-33b6ec343031 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:29.943673 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1d36d1ff-9539-41e1-9bbe-33b6ec343031 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 200 len: 1276 microversion: 2.1 time: 0.248297 Oct 04 21:08:29.943673 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 378/768] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:29 2022] GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 1276 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:30.386728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-01e7fdcb-699b-4e60-8513-2618f0a2e34e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-275362", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "324f5d32-9535-4c31-8532-24f98392bc42"}], "security_groups": [{"name": "tempest-securitygroup--1264023219"}], "key_name": "tempest-keypair-1792744913", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:30.403592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:30.524580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-005d0d2d-e684-4909-bf5e-e3a5cc8ce803 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:30.525360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-005d0d2d-e684-4909-bf5e-e3a5cc8ce803 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:30.533155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-005d0d2d-e684-4909-bf5e-e3a5cc8ce803 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:30.533853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-005d0d2d-e684-4909-bf5e-e3a5cc8ce803 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:30.534593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-005d0d2d-e684-4909-bf5e-e3a5cc8ce803 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:30.537581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-005d0d2d-e684-4909-bf5e-e3a5cc8ce803 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:30.538155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-005d0d2d-e684-4909-bf5e-e3a5cc8ce803 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:30.538650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-005d0d2d-e684-4909-bf5e-e3a5cc8ce803 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:30.697902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-01e7fdcb-699b-4e60-8513-2618f0a2e34e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] validate_networks() for [('324f5d32-9535-4c31-8532-24f98392bc42', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:08:31.383515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-005d0d2d-e684-4909-bf5e-e3a5cc8ce803 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:31.394143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-005d0d2d-e684-4909-bf5e-e3a5cc8ce803 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:31.395772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-005d0d2d-e684-4909-bf5e-e3a5cc8ce803 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:31.396967 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-005d0d2d-e684-4909-bf5e-e3a5cc8ce803 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1543 microversion: 2.25 time: 0.877959 Oct 04 21:08:31.418012 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 379/769] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:30 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1543 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:31.424432 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-877f919d-db0a-4cde-8b62-5d464169ec27 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:31.433166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-877f919d-db0a-4cde-8b62-5d464169ec27 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:31.433166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-877f919d-db0a-4cde-8b62-5d464169ec27 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:31.433819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-877f919d-db0a-4cde-8b62-5d464169ec27 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:31.434475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-877f919d-db0a-4cde-8b62-5d464169ec27 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:31.436050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-877f919d-db0a-4cde-8b62-5d464169ec27 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:31.436531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-877f919d-db0a-4cde-8b62-5d464169ec27 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:31.436969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-877f919d-db0a-4cde-8b62-5d464169ec27 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:32.109024 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-877f919d-db0a-4cde-8b62-5d464169ec27 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:32.121523 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-877f919d-db0a-4cde-8b62-5d464169ec27 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1476 microversion: 2.1 time: 0.702277 Oct 04 21:08:32.127790 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 380/770] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:31 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1476 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:32.146379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ce7914db-4df5-42f5-8908-5e41fafdc206 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:32.148210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ce7914db-4df5-42f5-8908-5e41fafdc206 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:32.158841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce7914db-4df5-42f5-8908-5e41fafdc206 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:32.159582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce7914db-4df5-42f5-8908-5e41fafdc206 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:32.160258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce7914db-4df5-42f5-8908-5e41fafdc206 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:32.160980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce7914db-4df5-42f5-8908-5e41fafdc206 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:32.161706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce7914db-4df5-42f5-8908-5e41fafdc206 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:32.162370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce7914db-4df5-42f5-8908-5e41fafdc206 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:32.304487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-ce7914db-4df5-42f5-8908-5e41fafdc206 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:32.368307 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ce7914db-4df5-42f5-8908-5e41fafdc206 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.238972 Oct 04 21:08:32.376562 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 381/771] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:32 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:32.385191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-abda4337-7ceb-4170-9634-77f9d9c4f8b5 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:32.386120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-abda4337-7ceb-4170-9634-77f9d9c4f8b5 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:32.419486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abda4337-7ceb-4170-9634-77f9d9c4f8b5 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:32.420091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abda4337-7ceb-4170-9634-77f9d9c4f8b5 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:32.420537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abda4337-7ceb-4170-9634-77f9d9c4f8b5 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:32.421257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abda4337-7ceb-4170-9634-77f9d9c4f8b5 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:32.421744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abda4337-7ceb-4170-9634-77f9d9c4f8b5 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:32.422178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abda4337-7ceb-4170-9634-77f9d9c4f8b5 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:32.573598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-01e7fdcb-699b-4e60-8513-2618f0a2e34e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:08:32.574849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-01e7fdcb-699b-4e60-8513-2618f0a2e34e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:08:32.575518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-01e7fdcb-699b-4e60-8513-2618f0a2e34e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:08:32.577047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-01e7fdcb-699b-4e60-8513-2618f0a2e34e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:08:32.577737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-01e7fdcb-699b-4e60-8513-2618f0a2e34e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:08:32.597585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-abda4337-7ceb-4170-9634-77f9d9c4f8b5 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:32.602739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01e7fdcb-699b-4e60-8513-2618f0a2e34e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:32.603241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01e7fdcb-699b-4e60-8513-2618f0a2e34e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:32.603687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01e7fdcb-699b-4e60-8513-2618f0a2e34e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:32.604429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01e7fdcb-699b-4e60-8513-2618f0a2e34e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:32.604893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01e7fdcb-699b-4e60-8513-2618f0a2e34e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:32.605328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01e7fdcb-699b-4e60-8513-2618f0a2e34e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:32.609181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:32.617964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-abda4337-7ceb-4170-9634-77f9d9c4f8b5 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:32.626762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-abda4337-7ceb-4170-9634-77f9d9c4f8b5 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:32.638683 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-abda4337-7ceb-4170-9634-77f9d9c4f8b5 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1533 microversion: 2.91 time: 0.258619 Oct 04 21:08:32.640084 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 382/772] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:32 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1533 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:32.644351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-01e7fdcb-699b-4e60-8513-2618f0a2e34e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Getting quotas for project 7e9215d1ae0947ce84469bed21fc05ac. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:08:32.651472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-55cc8b9e-8d52-4301-ba5c-d3cc6dfaba66 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:32.652300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-01e7fdcb-699b-4e60-8513-2618f0a2e34e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Getting quotas for user 8bfa449eb3144332afa616cc85d9643f and project 7e9215d1ae0947ce84469bed21fc05ac. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:08:32.653098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-55cc8b9e-8d52-4301-ba5c-d3cc6dfaba66 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:32.671564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55cc8b9e-8d52-4301-ba5c-d3cc6dfaba66 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:32.672138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55cc8b9e-8d52-4301-ba5c-d3cc6dfaba66 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:32.678331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55cc8b9e-8d52-4301-ba5c-d3cc6dfaba66 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:32.679340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55cc8b9e-8d52-4301-ba5c-d3cc6dfaba66 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:32.680242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55cc8b9e-8d52-4301-ba5c-d3cc6dfaba66 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:32.680823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55cc8b9e-8d52-4301-ba5c-d3cc6dfaba66 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:32.694007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-01e7fdcb-699b-4e60-8513-2618f0a2e34e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:08:32.697036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-01e7fdcb-699b-4e60-8513-2618f0a2e34e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:08:32.843230 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-01e7fdcb-699b-4e60-8513-2618f0a2e34e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.460189 Oct 04 21:08:32.846463 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 391/773] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:08:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 2466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:08:32.857787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-11716f87-7005-42a7-a29f-7f99394f772b tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '.version_select at 0x7f5790ee9790>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:32.868456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11716f87-7005-42a7-a29f-7f99394f772b tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:32.871574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11716f87-7005-42a7-a29f-7f99394f772b tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:32.872207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11716f87-7005-42a7-a29f-7f99394f772b tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:32.910098 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-11716f87-7005-42a7-a29f-7f99394f772b tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 2364 microversion: 2.25 time: 0.059480 Oct 04 21:08:32.911111 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 392/774] 10.222.0.30 () {60 vars in 1184 bytes} [Tue Oct 4 21:08:32 2022] GET /compute/v2.1/os-migrations => generated 2364 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:33.036948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7b53574f-89f0-4ec0-a62e-ede5e6616214 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:33.037701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7b53574f-89f0-4ec0-a62e-ede5e6616214 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:33.050937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b53574f-89f0-4ec0-a62e-ede5e6616214 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:33.071620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b53574f-89f0-4ec0-a62e-ede5e6616214 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:33.071620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b53574f-89f0-4ec0-a62e-ede5e6616214 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:33.071620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b53574f-89f0-4ec0-a62e-ede5e6616214 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:33.071620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b53574f-89f0-4ec0-a62e-ede5e6616214 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:33.071620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b53574f-89f0-4ec0-a62e-ede5e6616214 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:33.265398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-7b53574f-89f0-4ec0-a62e-ede5e6616214 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lazy-loading 'services' on Instance uuid 6a60b592-6e55-4259-aff7-b06203ef2d1e {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:33.304783 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7b53574f-89f0-4ec0-a62e-ede5e6616214 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1938 microversion: 2.91 time: 0.392188 Oct 04 21:08:33.305807 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 393/775] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:32 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1938 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:33.312832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b16947ef-3c3f-4f3d-a88a-36aa95e9c491 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:33.313836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b16947ef-3c3f-4f3d-a88a-36aa95e9c491 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:33.367082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-55cc8b9e-8d52-4301-ba5c-d3cc6dfaba66 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:33.377799 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-55cc8b9e-8d52-4301-ba5c-d3cc6dfaba66 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 200 len: 1318 microversion: 2.1 time: 0.735728 Oct 04 21:08:33.379017 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 383/776] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:32 2022] GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 1318 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:33.389707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-642469d6-67d0-4ed5-8f58-24bc970c9cb9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:33.390952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-642469d6-67d0-4ed5-8f58-24bc970c9cb9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:33.391861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b16947ef-3c3f-4f3d-a88a-36aa95e9c491 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:33.398755 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-642469d6-67d0-4ed5-8f58-24bc970c9cb9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:33.401234 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b16947ef-3c3f-4f3d-a88a-36aa95e9c491 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1231 microversion: 2.1 time: 0.092958 Oct 04 21:08:33.402172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-642469d6-67d0-4ed5-8f58-24bc970c9cb9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:33.402893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-642469d6-67d0-4ed5-8f58-24bc970c9cb9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:33.404398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-642469d6-67d0-4ed5-8f58-24bc970c9cb9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:33.405102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-642469d6-67d0-4ed5-8f58-24bc970c9cb9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:33.405899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-642469d6-67d0-4ed5-8f58-24bc970c9cb9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:33.414423 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 394/777] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:33 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:33.441338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2a893114-d78a-45ab-9148-678d54471a70 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:33.444421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2a893114-d78a-45ab-9148-678d54471a70 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:33.460990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a893114-d78a-45ab-9148-678d54471a70 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:33.463981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a893114-d78a-45ab-9148-678d54471a70 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:33.466163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a893114-d78a-45ab-9148-678d54471a70 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:33.481558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a893114-d78a-45ab-9148-678d54471a70 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:33.484871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a893114-d78a-45ab-9148-678d54471a70 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:33.489166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a893114-d78a-45ab-9148-678d54471a70 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:33.976623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-642469d6-67d0-4ed5-8f58-24bc970c9cb9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lazy-loading 'services' on Instance uuid b6aaef31-56eb-458f-a142-992790ebe523 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:33.996898 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-642469d6-67d0-4ed5-8f58-24bc970c9cb9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 2036 microversion: 2.25 time: 0.616228 Oct 04 21:08:33.998609 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 384/778] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:33 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 2036 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:34.006885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d8d2b621-7ecd-4912-b99d-7e2857d78b2d tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:34.007875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d8d2b621-7ecd-4912-b99d-7e2857d78b2d tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:34.025676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8d2b621-7ecd-4912-b99d-7e2857d78b2d tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:34.027265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8d2b621-7ecd-4912-b99d-7e2857d78b2d tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:34.027947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8d2b621-7ecd-4912-b99d-7e2857d78b2d tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:34.028937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8d2b621-7ecd-4912-b99d-7e2857d78b2d tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:34.029679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8d2b621-7ecd-4912-b99d-7e2857d78b2d tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:34.030406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8d2b621-7ecd-4912-b99d-7e2857d78b2d tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:34.044503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2a893114-d78a-45ab-9148-678d54471a70 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:34.057393 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2a893114-d78a-45ab-9148-678d54471a70 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1476 microversion: 2.1 time: 0.641511 Oct 04 21:08:34.057956 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 395/779] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:33 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1476 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:34.065692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-36dadc31-c427-4b0c-bc36-816fb959691d tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:34.069544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-36dadc31-c427-4b0c-bc36-816fb959691d tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:34.080755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36dadc31-c427-4b0c-bc36-816fb959691d tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:34.081588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36dadc31-c427-4b0c-bc36-816fb959691d tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:34.082184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36dadc31-c427-4b0c-bc36-816fb959691d tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:34.085681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36dadc31-c427-4b0c-bc36-816fb959691d tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:34.086308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36dadc31-c427-4b0c-bc36-816fb959691d tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:34.086895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36dadc31-c427-4b0c-bc36-816fb959691d tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:34.156911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-d8d2b621-7ecd-4912-b99d-7e2857d78b2d tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lazy-loading 'services' on Instance uuid 6a60b592-6e55-4259-aff7-b06203ef2d1e {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:34.214796 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d8d2b621-7ecd-4912-b99d-7e2857d78b2d tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1938 microversion: 2.91 time: 0.214681 Oct 04 21:08:34.220658 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 385/780] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:33 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1938 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:34.238004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6918282a-1619-4250-a9fb-8477aa4f5620 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Action: 'create', calling method: .version_select at 0x7f5790a44a60>, body: {"keypair": {"name": "tempest-keypair-1793215724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH90axVxUoyJUY14xNfmIyLBlTl6CvWiCV8xQ7tLtzKHs1HR/DAqHlDqnXe9W8I/wRsu/sQaycH/CKOIXOSGDlyr5at1ghIVwjOTkPrBIG38Ha9Ucj/0+iKKm52UvvHSLA=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:34.261509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-36dadc31-c427-4b0c-bc36-816fb959691d tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:34.261674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-6918282a-1619-4250-a9fb-8477aa4f5620 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Getting quotas for project d06810bbad6e4914aa53b43ef390f52e. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:08:34.267062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-6918282a-1619-4250-a9fb-8477aa4f5620 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Getting quotas for user 95f0cc0f93b244cea8818c7bbdcfb90a and project d06810bbad6e4914aa53b43ef390f52e. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:08:34.309529 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-36dadc31-c427-4b0c-bc36-816fb959691d tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.242868 Oct 04 21:08:34.309529 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 396/781] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:34 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:34.324921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6a0905e3-2855-446c-ad01-2474240d76dd tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:34.330573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a0905e3-2855-446c-ad01-2474240d76dd tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:34.331342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a0905e3-2855-446c-ad01-2474240d76dd tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:34.331998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a0905e3-2855-446c-ad01-2474240d76dd tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:34.333707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a0905e3-2855-446c-ad01-2474240d76dd tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:34.345606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a0905e3-2855-446c-ad01-2474240d76dd tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:34.345606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a0905e3-2855-446c-ad01-2474240d76dd tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:34.392250 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6a0905e3-2855-446c-ad01-2474240d76dd tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.085392 Oct 04 21:08:34.392872 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 397/782] 10.222.0.30 () {60 vars in 1217 bytes} [Tue Oct 4 21:08:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:08:34.397767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-9ad1b2a4-f1d9-4a54-8f83-f61200021fce req-8a833e9c-61e4-47fc-b1d7-73b9abb9f53d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28198b9c-ff65-40f0-869f-117104e764ef", "tag": "39719aa6-16e6-4454-bc46-5da1d39dc83a"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:34.409732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9ad1b2a4-f1d9-4a54-8f83-f61200021fce req-8a833e9c-61e4-47fc-b1d7-73b9abb9f53d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:34.410429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9ad1b2a4-f1d9-4a54-8f83-f61200021fce req-8a833e9c-61e4-47fc-b1d7-73b9abb9f53d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:34.411226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9ad1b2a4-f1d9-4a54-8f83-f61200021fce req-8a833e9c-61e4-47fc-b1d7-73b9abb9f53d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:34.425213 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-9ad1b2a4-f1d9-4a54-8f83-f61200021fce req-8a833e9c-61e4-47fc-b1d7-73b9abb9f53d service nova] Creating event network-changed:39719aa6-16e6-4454-bc46-5da1d39dc83a for instance 28198b9c-ff65-40f0-869f-117104e764ef on n-h1-860282-1 Oct 04 21:08:34.433774 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6918282a-1619-4250-a9fb-8477aa4f5620 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.211741 Oct 04 21:08:34.434769 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 386/783] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Oct 4 21:08:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 213 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:08:34.440665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-31dd7e8b-ed5e-432f-ba26-ee75bf4fff3c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:34.444726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-31dd7e8b-ed5e-432f-ba26-ee75bf4fff3c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:34.445161 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-9ad1b2a4-f1d9-4a54-8f83-f61200021fce req-8a833e9c-61e4-47fc-b1d7-73b9abb9f53d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050298 Oct 04 21:08:34.448883 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 398/784] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:34.461281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-154e25b6-7e2e-405c-9dcf-cdbf63b83e98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:34.462539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31dd7e8b-ed5e-432f-ba26-ee75bf4fff3c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:34.463109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31dd7e8b-ed5e-432f-ba26-ee75bf4fff3c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:34.463861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31dd7e8b-ed5e-432f-ba26-ee75bf4fff3c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:34.464466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-154e25b6-7e2e-405c-9dcf-cdbf63b83e98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:34.466165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31dd7e8b-ed5e-432f-ba26-ee75bf4fff3c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:34.467378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31dd7e8b-ed5e-432f-ba26-ee75bf4fff3c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:34.467822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31dd7e8b-ed5e-432f-ba26-ee75bf4fff3c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:34.480380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-154e25b6-7e2e-405c-9dcf-cdbf63b83e98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:34.484535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-154e25b6-7e2e-405c-9dcf-cdbf63b83e98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:34.509775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-154e25b6-7e2e-405c-9dcf-cdbf63b83e98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:34.510570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-154e25b6-7e2e-405c-9dcf-cdbf63b83e98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:34.514655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-154e25b6-7e2e-405c-9dcf-cdbf63b83e98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:34.517724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-154e25b6-7e2e-405c-9dcf-cdbf63b83e98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:34.601784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-154e25b6-7e2e-405c-9dcf-cdbf63b83e98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lazy-loading 'flavor' on Instance uuid 6a60b592-6e55-4259-aff7-b06203ef2d1e {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:34.937981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-31dd7e8b-ed5e-432f-ba26-ee75bf4fff3c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:34.947565 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-31dd7e8b-ed5e-432f-ba26-ee75bf4fff3c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 200 len: 1318 microversion: 2.1 time: 0.510645 Oct 04 21:08:34.948844 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 387/785] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:34 2022] GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:34.954565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a240b005-d98e-4682-80a7-667acceaa9ce tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:34.955311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a240b005-d98e-4682-80a7-667acceaa9ce tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:34.961325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a240b005-d98e-4682-80a7-667acceaa9ce tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:34.962136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a240b005-d98e-4682-80a7-667acceaa9ce tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:34.962793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a240b005-d98e-4682-80a7-667acceaa9ce tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:34.964018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a240b005-d98e-4682-80a7-667acceaa9ce tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:34.964689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a240b005-d98e-4682-80a7-667acceaa9ce tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:34.965326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a240b005-d98e-4682-80a7-667acceaa9ce tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:35.119703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a240b005-d98e-4682-80a7-667acceaa9ce tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:35.128804 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a240b005-d98e-4682-80a7-667acceaa9ce tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1235 microversion: 2.1 time: 0.178588 Oct 04 21:08:35.129788 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 388/786] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:34 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1235 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:35.134860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d6e2cb99-63e4-4281-b129-f8acbc7ec7ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:35.135473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d6e2cb99-63e4-4281-b129-f8acbc7ec7ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:35.144193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6e2cb99-63e4-4281-b129-f8acbc7ec7ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:35.145017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6e2cb99-63e4-4281-b129-f8acbc7ec7ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:35.171601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6e2cb99-63e4-4281-b129-f8acbc7ec7ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:35.172887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6e2cb99-63e4-4281-b129-f8acbc7ec7ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:35.175502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6e2cb99-63e4-4281-b129-f8acbc7ec7ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:35.180065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6e2cb99-63e4-4281-b129-f8acbc7ec7ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:35.419214 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-154e25b6-7e2e-405c-9dcf-cdbf63b83e98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "POST /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e/action" status: 202 len: 0 microversion: 2.91 time: 0.968239 Oct 04 21:08:35.420549 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 399/787] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Oct 4 21:08:34 2022] POST /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e/action => generated 0 bytes in 971 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:08:35.454445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f224f3a6-b9f9-4618-85f1-505c8b863f6e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:35.458893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f224f3a6-b9f9-4618-85f1-505c8b863f6e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:35.469260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f224f3a6-b9f9-4618-85f1-505c8b863f6e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:35.470352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f224f3a6-b9f9-4618-85f1-505c8b863f6e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:35.470956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f224f3a6-b9f9-4618-85f1-505c8b863f6e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:35.472127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f224f3a6-b9f9-4618-85f1-505c8b863f6e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:35.472764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f224f3a6-b9f9-4618-85f1-505c8b863f6e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:35.473346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f224f3a6-b9f9-4618-85f1-505c8b863f6e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:36.335602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-f224f3a6-b9f9-4618-85f1-505c8b863f6e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:36.371255 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f224f3a6-b9f9-4618-85f1-505c8b863f6e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.923398 Oct 04 21:08:36.371858 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 400/788] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:35 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:36.390074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-929bfe0c-e0f3-4cd1-94ee-f24575c36088 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:36.390692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-929bfe0c-e0f3-4cd1-94ee-f24575c36088 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:36.397215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-929bfe0c-e0f3-4cd1-94ee-f24575c36088 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:36.397714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-929bfe0c-e0f3-4cd1-94ee-f24575c36088 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:36.408495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-929bfe0c-e0f3-4cd1-94ee-f24575c36088 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:36.409608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-929bfe0c-e0f3-4cd1-94ee-f24575c36088 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:36.410246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-929bfe0c-e0f3-4cd1-94ee-f24575c36088 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:36.410836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-929bfe0c-e0f3-4cd1-94ee-f24575c36088 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:36.487959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:36.513050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d6e2cb99-63e4-4281-b129-f8acbc7ec7ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:36.524964 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d6e2cb99-63e4-4281-b129-f8acbc7ec7ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1476 microversion: 2.1 time: 1.393948 Oct 04 21:08:36.542695 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 389/789] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:35 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1476 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:36.552817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-608a0f85-3b98-4c8c-b35a-1911c03f0035 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:36.554065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-608a0f85-3b98-4c8c-b35a-1911c03f0035 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:36.561552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-608a0f85-3b98-4c8c-b35a-1911c03f0035 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:36.562388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-608a0f85-3b98-4c8c-b35a-1911c03f0035 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:36.563194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-608a0f85-3b98-4c8c-b35a-1911c03f0035 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:36.564124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-608a0f85-3b98-4c8c-b35a-1911c03f0035 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:36.565012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-608a0f85-3b98-4c8c-b35a-1911c03f0035 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:36.565532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-608a0f85-3b98-4c8c-b35a-1911c03f0035 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:36.688849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-929bfe0c-e0f3-4cd1-94ee-f24575c36088 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:36.697385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-929bfe0c-e0f3-4cd1-94ee-f24575c36088 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:36.707364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-929bfe0c-e0f3-4cd1-94ee-f24575c36088 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:36.714302 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-929bfe0c-e0f3-4cd1-94ee-f24575c36088 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.341339 Oct 04 21:08:36.729632 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 401/790] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:36 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:36.740143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5cba439b-b63d-4241-ad7c-b10717f19265 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:36.741053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5cba439b-b63d-4241-ad7c-b10717f19265 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:36.756164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5cba439b-b63d-4241-ad7c-b10717f19265 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:36.757843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5cba439b-b63d-4241-ad7c-b10717f19265 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:36.767042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5cba439b-b63d-4241-ad7c-b10717f19265 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:36.768367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5cba439b-b63d-4241-ad7c-b10717f19265 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:36.769341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5cba439b-b63d-4241-ad7c-b10717f19265 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:36.769974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5cba439b-b63d-4241-ad7c-b10717f19265 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:37.035921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5cba439b-b63d-4241-ad7c-b10717f19265 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:37.057887 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5cba439b-b63d-4241-ad7c-b10717f19265 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1291 microversion: 2.1 time: 0.324561 Oct 04 21:08:37.073444 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 402/791] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:36 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1291 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:37.073444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-e0c79dca-3ae4-4011-8dd7-fc6897033b4b req-23704d8d-b8e6-4282-9338-ecb59ff4f2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79e74286-835f-42b6-9d83-304b333a786f", "tag": "35e8d1d0-7fba-4543-9d29-aea7260b9810"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:37.077591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e0c79dca-3ae4-4011-8dd7-fc6897033b4b req-23704d8d-b8e6-4282-9338-ecb59ff4f2d3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:37.078350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e0c79dca-3ae4-4011-8dd7-fc6897033b4b req-23704d8d-b8e6-4282-9338-ecb59ff4f2d3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:37.079019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e0c79dca-3ae4-4011-8dd7-fc6897033b4b req-23704d8d-b8e6-4282-9338-ecb59ff4f2d3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:37.092520 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-e0c79dca-3ae4-4011-8dd7-fc6897033b4b req-23704d8d-b8e6-4282-9338-ecb59ff4f2d3 service nova] Creating event network-changed:35e8d1d0-7fba-4543-9d29-aea7260b9810 for instance 79e74286-835f-42b6-9d83-304b333a786f on n-h2-860282-1 Oct 04 21:08:37.097899 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-e0c79dca-3ae4-4011-8dd7-fc6897033b4b req-23704d8d-b8e6-4282-9338-ecb59ff4f2d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034850 Oct 04 21:08:37.098986 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 403/792] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:37.226061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-608a0f85-3b98-4c8c-b35a-1911c03f0035 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:37.248631 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-608a0f85-3b98-4c8c-b35a-1911c03f0035 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 200 len: 1318 microversion: 2.1 time: 0.703782 Oct 04 21:08:37.263178 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 390/793] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:36 2022] GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 1318 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:37.399651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3c5b56c9-9415-4ae4-826a-07cd1783de02 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:37.400455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3c5b56c9-9415-4ae4-826a-07cd1783de02 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:37.408379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c5b56c9-9415-4ae4-826a-07cd1783de02 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:37.409073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c5b56c9-9415-4ae4-826a-07cd1783de02 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:37.409611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c5b56c9-9415-4ae4-826a-07cd1783de02 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:37.410395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c5b56c9-9415-4ae4-826a-07cd1783de02 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:37.410917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c5b56c9-9415-4ae4-826a-07cd1783de02 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:37.411426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c5b56c9-9415-4ae4-826a-07cd1783de02 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:37.516498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-3c5b56c9-9415-4ae4-826a-07cd1783de02 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:37.538114 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3c5b56c9-9415-4ae4-826a-07cd1783de02 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.142616 Oct 04 21:08:37.539299 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 404/794] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:37 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:37.556765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-956df0cb-89f5-4553-821d-408e6a793b03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:37.557380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-956df0cb-89f5-4553-821d-408e6a793b03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:37.564711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-956df0cb-89f5-4553-821d-408e6a793b03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:37.566132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-956df0cb-89f5-4553-821d-408e6a793b03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:37.566728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-956df0cb-89f5-4553-821d-408e6a793b03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:37.567793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-956df0cb-89f5-4553-821d-408e6a793b03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:37.568336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-956df0cb-89f5-4553-821d-408e6a793b03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:37.568890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-956df0cb-89f5-4553-821d-408e6a793b03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:37.667524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-7e4599ed-5a0c-460b-976f-c0078ff2ec18 req-d19e496e-4c11-486c-a0e2-bb09d8d5e98e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41063621-009d-455a-a56d-9ffbae52f46c", "name": "network-vif-unplugged", "status": "completed", "tag": "165120d0-97d6-48bd-b2b4-6ab812848c0b"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:37.678363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-7e4599ed-5a0c-460b-976f-c0078ff2ec18 req-d19e496e-4c11-486c-a0e2-bb09d8d5e98e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:37.679109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-7e4599ed-5a0c-460b-976f-c0078ff2ec18 req-d19e496e-4c11-486c-a0e2-bb09d8d5e98e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:37.679757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-7e4599ed-5a0c-460b-976f-c0078ff2ec18 req-d19e496e-4c11-486c-a0e2-bb09d8d5e98e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:37.694017 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-7e4599ed-5a0c-460b-976f-c0078ff2ec18 req-d19e496e-4c11-486c-a0e2-bb09d8d5e98e service nova] Creating event network-vif-unplugged:165120d0-97d6-48bd-b2b4-6ab812848c0b for instance 41063621-009d-455a-a56d-9ffbae52f46c on n-h2-860282-1 Oct 04 21:08:37.704767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-7e4599ed-5a0c-460b-976f-c0078ff2ec18 req-d19e496e-4c11-486c-a0e2-bb09d8d5e98e service nova] Instance 41063621-009d-455a-a56d-9ffbae52f46c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:08:37.716645 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-7e4599ed-5a0c-460b-976f-c0078ff2ec18 req-d19e496e-4c11-486c-a0e2-bb09d8d5e98e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053646 Oct 04 21:08:37.717902 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 405/795] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:08:37.743788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-14fb8e80-b3d9-4545-8810-514e0617d8ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:37.745792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-14fb8e80-b3d9-4545-8810-514e0617d8ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:37.754404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14fb8e80-b3d9-4545-8810-514e0617d8ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:37.755578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14fb8e80-b3d9-4545-8810-514e0617d8ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:37.756025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14fb8e80-b3d9-4545-8810-514e0617d8ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:37.756739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14fb8e80-b3d9-4545-8810-514e0617d8ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:37.757536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14fb8e80-b3d9-4545-8810-514e0617d8ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:37.758220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14fb8e80-b3d9-4545-8810-514e0617d8ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:37.879533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-14fb8e80-b3d9-4545-8810-514e0617d8ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:37.880990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-956df0cb-89f5-4553-821d-408e6a793b03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:37.889763 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-956df0cb-89f5-4553-821d-408e6a793b03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1475 microversion: 2.1 time: 0.336752 Oct 04 21:08:37.891105 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 391/796] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:37 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1475 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:37.901402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-14fb8e80-b3d9-4545-8810-514e0617d8ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:37.903581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-14fb8e80-b3d9-4545-8810-514e0617d8ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:37.911047 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-14fb8e80-b3d9-4545-8810-514e0617d8ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.172004 Oct 04 21:08:37.912971 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 406/797] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:37 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:38.093702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-efaf6897-44bc-4162-ac43-d2804483788a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:38.093702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-efaf6897-44bc-4162-ac43-d2804483788a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:38.107724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efaf6897-44bc-4162-ac43-d2804483788a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:38.109233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efaf6897-44bc-4162-ac43-d2804483788a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:38.110022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efaf6897-44bc-4162-ac43-d2804483788a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:38.111324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efaf6897-44bc-4162-ac43-d2804483788a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:38.111796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efaf6897-44bc-4162-ac43-d2804483788a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:38.112692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efaf6897-44bc-4162-ac43-d2804483788a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:38.243384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-efaf6897-44bc-4162-ac43-d2804483788a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:38.252694 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-efaf6897-44bc-4162-ac43-d2804483788a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1289 microversion: 2.1 time: 0.170050 Oct 04 21:08:38.254094 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 392/798] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:38 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1289 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:38.277256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0c0603e4-6262-4001-8500-34644283dd3f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:38.278173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0c0603e4-6262-4001-8500-34644283dd3f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:38.288779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c0603e4-6262-4001-8500-34644283dd3f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:38.289581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c0603e4-6262-4001-8500-34644283dd3f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:38.290266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c0603e4-6262-4001-8500-34644283dd3f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:38.291385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c0603e4-6262-4001-8500-34644283dd3f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:38.292006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c0603e4-6262-4001-8500-34644283dd3f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:38.292534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c0603e4-6262-4001-8500-34644283dd3f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:38.573054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cf9541f3-222a-448a-bb90-33fe920cf9f9 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:38.591157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cf9541f3-222a-448a-bb90-33fe920cf9f9 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:38.591157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf9541f3-222a-448a-bb90-33fe920cf9f9 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:38.591157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf9541f3-222a-448a-bb90-33fe920cf9f9 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:38.591157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf9541f3-222a-448a-bb90-33fe920cf9f9 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:38.591157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf9541f3-222a-448a-bb90-33fe920cf9f9 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:38.591157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf9541f3-222a-448a-bb90-33fe920cf9f9 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:38.591157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf9541f3-222a-448a-bb90-33fe920cf9f9 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:38.624017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0c0603e4-6262-4001-8500-34644283dd3f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:38.631875 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0c0603e4-6262-4001-8500-34644283dd3f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 200 len: 1318 microversion: 2.1 time: 0.361053 Oct 04 21:08:38.632465 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 407/799] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:38 2022] GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:38.677572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-cf9541f3-222a-448a-bb90-33fe920cf9f9 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:38.696920 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cf9541f3-222a-448a-bb90-33fe920cf9f9 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.128382 Oct 04 21:08:38.701608 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 393/800] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:38 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:38.919099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8521eb89-c0cb-4e1e-a33e-e677b4a2463e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:38.920457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8521eb89-c0cb-4e1e-a33e-e677b4a2463e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:38.928359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8521eb89-c0cb-4e1e-a33e-e677b4a2463e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:38.928860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8521eb89-c0cb-4e1e-a33e-e677b4a2463e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:38.929301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8521eb89-c0cb-4e1e-a33e-e677b4a2463e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:38.930040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8521eb89-c0cb-4e1e-a33e-e677b4a2463e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:38.930498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8521eb89-c0cb-4e1e-a33e-e677b4a2463e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:38.931228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8521eb89-c0cb-4e1e-a33e-e677b4a2463e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:38.946126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3879755a-33c2-4e07-868f-10f1eb1c2a90 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:38.946825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3879755a-33c2-4e07-868f-10f1eb1c2a90 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:38.955121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3879755a-33c2-4e07-868f-10f1eb1c2a90 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:38.955840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3879755a-33c2-4e07-868f-10f1eb1c2a90 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:38.956283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3879755a-33c2-4e07-868f-10f1eb1c2a90 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:38.957271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3879755a-33c2-4e07-868f-10f1eb1c2a90 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:38.957926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3879755a-33c2-4e07-868f-10f1eb1c2a90 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:38.958556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3879755a-33c2-4e07-868f-10f1eb1c2a90 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:39.079224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3879755a-33c2-4e07-868f-10f1eb1c2a90 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:39.092891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3879755a-33c2-4e07-868f-10f1eb1c2a90 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:39.094869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3879755a-33c2-4e07-868f-10f1eb1c2a90 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:39.102064 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3879755a-33c2-4e07-868f-10f1eb1c2a90 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.159876 Oct 04 21:08:39.103416 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 394/801] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:38 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:39.184494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8521eb89-c0cb-4e1e-a33e-e677b4a2463e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:39.193558 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8521eb89-c0cb-4e1e-a33e-e677b4a2463e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1475 microversion: 2.1 time: 0.280744 Oct 04 21:08:39.194148 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 408/802] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:38 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1475 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:39.277867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fc27978a-ed08-420f-9be1-8190aa51adb7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:39.278653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fc27978a-ed08-420f-9be1-8190aa51adb7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:39.286288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc27978a-ed08-420f-9be1-8190aa51adb7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:39.286783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc27978a-ed08-420f-9be1-8190aa51adb7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:39.287282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc27978a-ed08-420f-9be1-8190aa51adb7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:39.288063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc27978a-ed08-420f-9be1-8190aa51adb7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:39.288535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc27978a-ed08-420f-9be1-8190aa51adb7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:39.288983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc27978a-ed08-420f-9be1-8190aa51adb7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:39.359856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fc27978a-ed08-420f-9be1-8190aa51adb7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:39.367994 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fc27978a-ed08-420f-9be1-8190aa51adb7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1289 microversion: 2.1 time: 0.094287 Oct 04 21:08:39.368594 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 395/803] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:39 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1289 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:39.666991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f2ddc619-301e-4a10-9c03-7eae77beadad tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:39.668323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f2ddc619-301e-4a10-9c03-7eae77beadad tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:39.676282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2ddc619-301e-4a10-9c03-7eae77beadad tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:39.677024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2ddc619-301e-4a10-9c03-7eae77beadad tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:39.677645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2ddc619-301e-4a10-9c03-7eae77beadad tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:39.678505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2ddc619-301e-4a10-9c03-7eae77beadad tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:39.681034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2ddc619-301e-4a10-9c03-7eae77beadad tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:39.681775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2ddc619-301e-4a10-9c03-7eae77beadad tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:39.727170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-93013d0a-e2d3-4cff-8277-19c297650a1e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:39.728141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-93013d0a-e2d3-4cff-8277-19c297650a1e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:39.756786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93013d0a-e2d3-4cff-8277-19c297650a1e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:39.757822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93013d0a-e2d3-4cff-8277-19c297650a1e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:39.758651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93013d0a-e2d3-4cff-8277-19c297650a1e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:39.762352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93013d0a-e2d3-4cff-8277-19c297650a1e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:39.763427 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93013d0a-e2d3-4cff-8277-19c297650a1e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:39.769351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93013d0a-e2d3-4cff-8277-19c297650a1e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:39.931237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-93013d0a-e2d3-4cff-8277-19c297650a1e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:39.956542 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-93013d0a-e2d3-4cff-8277-19c297650a1e tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.235618 Oct 04 21:08:39.957261 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 396/804] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:39 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:39.962822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-cf939d3c-759e-4117-92ad-09101d2ca0f5 req-e24a4cf3-a7de-4d2e-80c0-f2f742fc20d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41063621-009d-455a-a56d-9ffbae52f46c", "tag": "165120d0-97d6-48bd-b2b4-6ab812848c0b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:39.975339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cf939d3c-759e-4117-92ad-09101d2ca0f5 req-e24a4cf3-a7de-4d2e-80c0-f2f742fc20d6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:39.976088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cf939d3c-759e-4117-92ad-09101d2ca0f5 req-e24a4cf3-a7de-4d2e-80c0-f2f742fc20d6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:39.976680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cf939d3c-759e-4117-92ad-09101d2ca0f5 req-e24a4cf3-a7de-4d2e-80c0-f2f742fc20d6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:40.025074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f2ddc619-301e-4a10-9c03-7eae77beadad tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:40.027705 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-cf939d3c-759e-4117-92ad-09101d2ca0f5 req-e24a4cf3-a7de-4d2e-80c0-f2f742fc20d6 service nova] Creating event network-changed:165120d0-97d6-48bd-b2b4-6ab812848c0b for instance 41063621-009d-455a-a56d-9ffbae52f46c on n-h2-860282-1 Oct 04 21:08:40.038712 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f2ddc619-301e-4a10-9c03-7eae77beadad tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 200 len: 1318 microversion: 2.1 time: 0.383016 Oct 04 21:08:40.039779 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 409/805] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:39 2022] GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:40.079122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [req-cf939d3c-759e-4117-92ad-09101d2ca0f5 req-e24a4cf3-a7de-4d2e-80c0-f2f742fc20d6 service nova] Instance 41063621-009d-455a-a56d-9ffbae52f46c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122757) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:08:40.116134 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-cf939d3c-759e-4117-92ad-09101d2ca0f5 req-e24a4cf3-a7de-4d2e-80c0-f2f742fc20d6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153501 Oct 04 21:08:40.117056 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 397/806] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:40.139560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-94b7cd22-fc41-4aa8-a1c0-29d91bd0debc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:40.140313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-94b7cd22-fc41-4aa8-a1c0-29d91bd0debc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:40.153602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94b7cd22-fc41-4aa8-a1c0-29d91bd0debc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:40.154147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94b7cd22-fc41-4aa8-a1c0-29d91bd0debc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:40.155103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94b7cd22-fc41-4aa8-a1c0-29d91bd0debc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:40.156119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94b7cd22-fc41-4aa8-a1c0-29d91bd0debc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:40.156592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94b7cd22-fc41-4aa8-a1c0-29d91bd0debc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:40.157025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94b7cd22-fc41-4aa8-a1c0-29d91bd0debc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:40.219304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-39e3c1ea-6e6b-4c19-bde2-079b1ec89a40 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:40.220020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-39e3c1ea-6e6b-4c19-bde2-079b1ec89a40 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:40.230279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39e3c1ea-6e6b-4c19-bde2-079b1ec89a40 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:40.230773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39e3c1ea-6e6b-4c19-bde2-079b1ec89a40 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:40.231209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39e3c1ea-6e6b-4c19-bde2-079b1ec89a40 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:40.231925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39e3c1ea-6e6b-4c19-bde2-079b1ec89a40 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:40.233167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39e3c1ea-6e6b-4c19-bde2-079b1ec89a40 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:40.233737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39e3c1ea-6e6b-4c19-bde2-079b1ec89a40 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:40.643629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-94b7cd22-fc41-4aa8-a1c0-29d91bd0debc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:40.658623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-94b7cd22-fc41-4aa8-a1c0-29d91bd0debc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:40.664560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-94b7cd22-fc41-4aa8-a1c0-29d91bd0debc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:40.685720 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-94b7cd22-fc41-4aa8-a1c0-29d91bd0debc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.541033 Oct 04 21:08:40.686736 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 410/807] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:40 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:40.697812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8dbdb3f0-2bf9-45b5-a1cc-d94f54d8a305 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:40.704230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8dbdb3f0-2bf9-45b5-a1cc-d94f54d8a305 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:40.717662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-39e3c1ea-6e6b-4c19-bde2-079b1ec89a40 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:40.717910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dbdb3f0-2bf9-45b5-a1cc-d94f54d8a305 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:40.718242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dbdb3f0-2bf9-45b5-a1cc-d94f54d8a305 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:40.720789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dbdb3f0-2bf9-45b5-a1cc-d94f54d8a305 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:40.723912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dbdb3f0-2bf9-45b5-a1cc-d94f54d8a305 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:40.724398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dbdb3f0-2bf9-45b5-a1cc-d94f54d8a305 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:40.726941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dbdb3f0-2bf9-45b5-a1cc-d94f54d8a305 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:40.731127 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-39e3c1ea-6e6b-4c19-bde2-079b1ec89a40 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1475 microversion: 2.1 time: 0.513193 Oct 04 21:08:40.733006 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 398/808] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:40 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1475 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:40.992795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-56482274-c5b8-4aef-adce-7324f506fc43 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:40.993755 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-56482274-c5b8-4aef-adce-7324f506fc43 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:41.006330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56482274-c5b8-4aef-adce-7324f506fc43 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:41.007237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56482274-c5b8-4aef-adce-7324f506fc43 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:41.008902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56482274-c5b8-4aef-adce-7324f506fc43 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:41.013122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56482274-c5b8-4aef-adce-7324f506fc43 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:41.013976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56482274-c5b8-4aef-adce-7324f506fc43 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:41.014822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56482274-c5b8-4aef-adce-7324f506fc43 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:41.090715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:41.297123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-56482274-c5b8-4aef-adce-7324f506fc43 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:41.340349 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-56482274-c5b8-4aef-adce-7324f506fc43 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.351811 Oct 04 21:08:41.341185 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 399/809] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:40 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:41.348978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3012a1f5-fb59-47f5-9609-eb0916ca790c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:41.357507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3012a1f5-fb59-47f5-9609-eb0916ca790c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:41.365210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3012a1f5-fb59-47f5-9609-eb0916ca790c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:41.371611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3012a1f5-fb59-47f5-9609-eb0916ca790c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:41.371611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3012a1f5-fb59-47f5-9609-eb0916ca790c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:41.371611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3012a1f5-fb59-47f5-9609-eb0916ca790c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:41.371611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3012a1f5-fb59-47f5-9609-eb0916ca790c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:41.371611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3012a1f5-fb59-47f5-9609-eb0916ca790c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:41.377029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8dbdb3f0-2bf9-45b5-a1cc-d94f54d8a305 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:41.385020 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8dbdb3f0-2bf9-45b5-a1cc-d94f54d8a305 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1357 microversion: 2.1 time: 0.696928 Oct 04 21:08:41.399181 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 411/810] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:40 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1357 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:41.410594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a3e44e07-4432-4105-bb4e-6e71cfe619bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2054538592", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "d8cfe5e7-54b8-4178-9c64-fdf6c3f1a916"}], "security_groups": [{"name": "tempest-securitygroup--499042856"}], "key_name": "tempest-keypair-1793215724", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:41.811330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-a3e44e07-4432-4105-bb4e-6e71cfe619bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] validate_networks() for [('d8cfe5e7-54b8-4178-9c64-fdf6c3f1a916', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:08:41.940846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3012a1f5-fb59-47f5-9609-eb0916ca790c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:41.948717 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3012a1f5-fb59-47f5-9609-eb0916ca790c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 200 len: 1318 microversion: 2.1 time: 0.605151 Oct 04 21:08:41.962711 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 400/811] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:41 2022] GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 1318 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:41.969710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5c2d6e99-19e5-49f6-9454-889dc5d296d0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:41.970561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5c2d6e99-19e5-49f6-9454-889dc5d296d0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:41.989260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c2d6e99-19e5-49f6-9454-889dc5d296d0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:41.990029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c2d6e99-19e5-49f6-9454-889dc5d296d0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:41.990692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c2d6e99-19e5-49f6-9454-889dc5d296d0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:41.991596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c2d6e99-19e5-49f6-9454-889dc5d296d0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:41.992234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c2d6e99-19e5-49f6-9454-889dc5d296d0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:41.992820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c2d6e99-19e5-49f6-9454-889dc5d296d0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:42.189820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5c2d6e99-19e5-49f6-9454-889dc5d296d0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:42.200750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5c2d6e99-19e5-49f6-9454-889dc5d296d0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:42.204786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5c2d6e99-19e5-49f6-9454-889dc5d296d0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:42.208442 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5c2d6e99-19e5-49f6-9454-889dc5d296d0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.244224 Oct 04 21:08:42.209031 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 401/812] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:41 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:42.214437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f0261f6f-adb2-44a3-92b2-40b3bf3896be tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:42.215049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f0261f6f-adb2-44a3-92b2-40b3bf3896be tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:42.222099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0261f6f-adb2-44a3-92b2-40b3bf3896be tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:42.222584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0261f6f-adb2-44a3-92b2-40b3bf3896be tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:42.223218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0261f6f-adb2-44a3-92b2-40b3bf3896be tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:42.224159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0261f6f-adb2-44a3-92b2-40b3bf3896be tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:42.224760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0261f6f-adb2-44a3-92b2-40b3bf3896be tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:42.225341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0261f6f-adb2-44a3-92b2-40b3bf3896be tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:42.542452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f0261f6f-adb2-44a3-92b2-40b3bf3896be tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:42.552022 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f0261f6f-adb2-44a3-92b2-40b3bf3896be tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1473 microversion: 2.1 time: 0.340666 Oct 04 21:08:42.568861 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 402/813] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:42 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1473 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:42.575410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-71ebf682-45e5-4bf3-80a4-d3dc64476976 req-1d0ec2aa-c873-4dbb-957e-71a569550e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf618d0-9d79-435c-ac4f-636ac63dbbda", "tag": "dd232c2f-36a6-4a3c-93d1-396a660ea091"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:42.587765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-71ebf682-45e5-4bf3-80a4-d3dc64476976 req-1d0ec2aa-c873-4dbb-957e-71a569550e10 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:42.587765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-71ebf682-45e5-4bf3-80a4-d3dc64476976 req-1d0ec2aa-c873-4dbb-957e-71a569550e10 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:42.587765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-71ebf682-45e5-4bf3-80a4-d3dc64476976 req-1d0ec2aa-c873-4dbb-957e-71a569550e10 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:42.601770 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-71ebf682-45e5-4bf3-80a4-d3dc64476976 req-1d0ec2aa-c873-4dbb-957e-71a569550e10 service nova] Creating event network-changed:dd232c2f-36a6-4a3c-93d1-396a660ea091 for instance fcf618d0-9d79-435c-ac4f-636ac63dbbda on n-h2-860282-1 Oct 04 21:08:42.609545 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-71ebf682-45e5-4bf3-80a4-d3dc64476976 req-1d0ec2aa-c873-4dbb-957e-71a569550e10 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035935 Oct 04 21:08:42.610684 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 403/814] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:42.616214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-931302e0-3d06-4298-af08-adccb231862f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:42.617044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-931302e0-3d06-4298-af08-adccb231862f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:42.624097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-931302e0-3d06-4298-af08-adccb231862f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:42.624831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-931302e0-3d06-4298-af08-adccb231862f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:42.627625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-931302e0-3d06-4298-af08-adccb231862f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:42.627625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-931302e0-3d06-4298-af08-adccb231862f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:42.627625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-931302e0-3d06-4298-af08-adccb231862f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:42.627625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-931302e0-3d06-4298-af08-adccb231862f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:42.768884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-931302e0-3d06-4298-af08-adccb231862f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:42.813848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:42.816622 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-931302e0-3d06-4298-af08-adccb231862f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.204475 Oct 04 21:08:42.817802 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 404/815] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:42 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:42.826984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dccdcf0a-f7b0-4fa2-8ef0-763ceb430be6 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:42.827851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dccdcf0a-f7b0-4fa2-8ef0-763ceb430be6 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:42.836026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dccdcf0a-f7b0-4fa2-8ef0-763ceb430be6 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:42.837053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dccdcf0a-f7b0-4fa2-8ef0-763ceb430be6 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:42.837808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dccdcf0a-f7b0-4fa2-8ef0-763ceb430be6 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:42.838657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dccdcf0a-f7b0-4fa2-8ef0-763ceb430be6 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:42.839386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dccdcf0a-f7b0-4fa2-8ef0-763ceb430be6 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:42.840005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dccdcf0a-f7b0-4fa2-8ef0-763ceb430be6 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:42.974654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a3e44e07-4432-4105-bb4e-6e71cfe619bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:08:42.975915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a3e44e07-4432-4105-bb4e-6e71cfe619bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:08:42.976403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a3e44e07-4432-4105-bb4e-6e71cfe619bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:08:42.976824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a3e44e07-4432-4105-bb4e-6e71cfe619bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:08:42.977281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a3e44e07-4432-4105-bb4e-6e71cfe619bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:08:42.990447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=53 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:42.990447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3e44e07-4432-4105-bb4e-6e71cfe619bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:42.990447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3e44e07-4432-4105-bb4e-6e71cfe619bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:42.990447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3e44e07-4432-4105-bb4e-6e71cfe619bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:42.992860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3e44e07-4432-4105-bb4e-6e71cfe619bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:42.992860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3e44e07-4432-4105-bb4e-6e71cfe619bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:42.992860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3e44e07-4432-4105-bb4e-6e71cfe619bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:43.004758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=13 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:43.018495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-a3e44e07-4432-4105-bb4e-6e71cfe619bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Getting quotas for project d06810bbad6e4914aa53b43ef390f52e. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:08:43.026302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-a3e44e07-4432-4105-bb4e-6e71cfe619bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Getting quotas for user 95f0cc0f93b244cea8818c7bbdcfb90a and project d06810bbad6e4914aa53b43ef390f52e. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:08:43.058179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a3e44e07-4432-4105-bb4e-6e71cfe619bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:08:43.062459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a3e44e07-4432-4105-bb4e-6e71cfe619bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:08:43.116966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dccdcf0a-f7b0-4fa2-8ef0-763ceb430be6 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:43.125632 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dccdcf0a-f7b0-4fa2-8ef0-763ceb430be6 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1357 microversion: 2.1 time: 0.306162 Oct 04 21:08:43.127047 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 405/816] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:42 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1357 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:43.136651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b22476d5-28a1-451f-802a-28dc4defd73d req-16671461-077c-4650-bdfe-239af1a20679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28198b9c-ff65-40f0-869f-117104e764ef", "name": "network-vif-plugged", "status": "completed", "tag": "39719aa6-16e6-4454-bc46-5da1d39dc83a"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:43.149491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b22476d5-28a1-451f-802a-28dc4defd73d req-16671461-077c-4650-bdfe-239af1a20679 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:43.149964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b22476d5-28a1-451f-802a-28dc4defd73d req-16671461-077c-4650-bdfe-239af1a20679 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:43.150734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b22476d5-28a1-451f-802a-28dc4defd73d req-16671461-077c-4650-bdfe-239af1a20679 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:43.166991 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b22476d5-28a1-451f-802a-28dc4defd73d req-16671461-077c-4650-bdfe-239af1a20679 service nova] Creating event network-vif-plugged:39719aa6-16e6-4454-bc46-5da1d39dc83a for instance 28198b9c-ff65-40f0-869f-117104e764ef on n-h1-860282-1 Oct 04 21:08:43.173701 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b22476d5-28a1-451f-802a-28dc4defd73d req-16671461-077c-4650-bdfe-239af1a20679 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041708 Oct 04 21:08:43.174919 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 406/817] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:43.180247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-31102d80-d486-455b-9a16-1cfbd978d584 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:43.181110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-31102d80-d486-455b-9a16-1cfbd978d584 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:43.214273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31102d80-d486-455b-9a16-1cfbd978d584 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:43.216120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31102d80-d486-455b-9a16-1cfbd978d584 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:43.218049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31102d80-d486-455b-9a16-1cfbd978d584 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:43.219170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31102d80-d486-455b-9a16-1cfbd978d584 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:43.220057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31102d80-d486-455b-9a16-1cfbd978d584 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:43.220715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31102d80-d486-455b-9a16-1cfbd978d584 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:43.221098 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a3e44e07-4432-4105-bb4e-6e71cfe619bf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.820121 Oct 04 21:08:43.221812 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 412/818] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Oct 4 21:08:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1822 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:08:43.254097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d8fe0b7d-3fc0-4955-8ff8-8843b7ee010a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:43.271585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d8fe0b7d-3fc0-4955-8ff8-8843b7ee010a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:43.499013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d8fe0b7d-3fc0-4955-8ff8-8843b7ee010a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:43.510675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d8fe0b7d-3fc0-4955-8ff8-8843b7ee010a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:43.512185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d8fe0b7d-3fc0-4955-8ff8-8843b7ee010a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:43.513972 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d8fe0b7d-3fc0-4955-8ff8-8843b7ee010a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1286 microversion: 2.25 time: 0.272470 Oct 04 21:08:43.514554 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 413/819] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:43 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1286 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:43.546727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-098e478c-52f0-40ed-bd60-904d9139e9f7 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:43.546727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-098e478c-52f0-40ed-bd60-904d9139e9f7 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:43.565312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-098e478c-52f0-40ed-bd60-904d9139e9f7 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:43.565902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-098e478c-52f0-40ed-bd60-904d9139e9f7 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:43.566452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-098e478c-52f0-40ed-bd60-904d9139e9f7 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:43.567138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-098e478c-52f0-40ed-bd60-904d9139e9f7 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:43.567672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-098e478c-52f0-40ed-bd60-904d9139e9f7 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:43.568071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-098e478c-52f0-40ed-bd60-904d9139e9f7 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:43.730666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-098e478c-52f0-40ed-bd60-904d9139e9f7 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:43.743985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-098e478c-52f0-40ed-bd60-904d9139e9f7 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:43.746333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-098e478c-52f0-40ed-bd60-904d9139e9f7 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:43.753596 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-098e478c-52f0-40ed-bd60-904d9139e9f7 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.228554 Oct 04 21:08:43.771446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-31102d80-d486-455b-9a16-1cfbd978d584 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:43.778403 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 414/820] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:43 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:43.796299 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-31102d80-d486-455b-9a16-1cfbd978d584 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 200 len: 1318 microversion: 2.1 time: 0.603003 Oct 04 21:08:43.796299 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 407/821] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:43 2022] GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 1318 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:43.796747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0e65b52f-5b44-4bbb-9e82-f6c877280b2c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:43.796747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0e65b52f-5b44-4bbb-9e82-f6c877280b2c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:43.796747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:43.796747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e65b52f-5b44-4bbb-9e82-f6c877280b2c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:43.796747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e65b52f-5b44-4bbb-9e82-f6c877280b2c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:43.796747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e65b52f-5b44-4bbb-9e82-f6c877280b2c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:43.796747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e65b52f-5b44-4bbb-9e82-f6c877280b2c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:43.796747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e65b52f-5b44-4bbb-9e82-f6c877280b2c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:43.796747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e65b52f-5b44-4bbb-9e82-f6c877280b2c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:43.847373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d7246fe7-0251-4ef5-9c5b-b574195b6982 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:43.847754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d7246fe7-0251-4ef5-9c5b-b574195b6982 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:43.858514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7246fe7-0251-4ef5-9c5b-b574195b6982 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:43.859015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7246fe7-0251-4ef5-9c5b-b574195b6982 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:43.859452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7246fe7-0251-4ef5-9c5b-b574195b6982 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:43.860162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7246fe7-0251-4ef5-9c5b-b574195b6982 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:43.860616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7246fe7-0251-4ef5-9c5b-b574195b6982 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:43.861041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7246fe7-0251-4ef5-9c5b-b574195b6982 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:43.980651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-d7246fe7-0251-4ef5-9c5b-b574195b6982 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:44.020769 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d7246fe7-0251-4ef5-9c5b-b574195b6982 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.177222 Oct 04 21:08:44.030440 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 408/822] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:43 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:44.148914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-94dfdf5d-05bf-4c8a-9edc-e077278e7138 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:44.158242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0e65b52f-5b44-4bbb-9e82-f6c877280b2c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:44.162550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-94dfdf5d-05bf-4c8a-9edc-e077278e7138 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:44.178976 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0e65b52f-5b44-4bbb-9e82-f6c877280b2c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1473 microversion: 2.1 time: 0.398717 Oct 04 21:08:44.181398 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 415/823] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:43 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1473 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:44.187921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94dfdf5d-05bf-4c8a-9edc-e077278e7138 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:44.196966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94dfdf5d-05bf-4c8a-9edc-e077278e7138 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:44.198038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94dfdf5d-05bf-4c8a-9edc-e077278e7138 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:44.201979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94dfdf5d-05bf-4c8a-9edc-e077278e7138 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:44.205234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94dfdf5d-05bf-4c8a-9edc-e077278e7138 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:44.205961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94dfdf5d-05bf-4c8a-9edc-e077278e7138 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:44.291484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=14 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:44.550292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b802316e-9c29-4e1e-a3a5-589ade138307 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:44.550876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b802316e-9c29-4e1e-a3a5-589ade138307 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:44.833120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b802316e-9c29-4e1e-a3a5-589ade138307 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:44.852268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b802316e-9c29-4e1e-a3a5-589ade138307 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:44.853832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b802316e-9c29-4e1e-a3a5-589ade138307 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:44.854981 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b802316e-9c29-4e1e-a3a5-589ade138307 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1286 microversion: 2.25 time: 0.315169 Oct 04 21:08:44.873671 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 416/824] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:44 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1286 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:44.873671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5591e7f1-faa5-4920-a002-d56a02a262cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:44.873671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5591e7f1-faa5-4920-a002-d56a02a262cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:44.894214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5591e7f1-faa5-4920-a002-d56a02a262cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:44.894908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5591e7f1-faa5-4920-a002-d56a02a262cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:44.896495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5591e7f1-faa5-4920-a002-d56a02a262cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:44.899108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5591e7f1-faa5-4920-a002-d56a02a262cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:44.899712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5591e7f1-faa5-4920-a002-d56a02a262cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:44.900474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5591e7f1-faa5-4920-a002-d56a02a262cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:45.018330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5591e7f1-faa5-4920-a002-d56a02a262cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:45.034960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5591e7f1-faa5-4920-a002-d56a02a262cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:45.040572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5591e7f1-faa5-4920-a002-d56a02a262cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:45.050504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-94dfdf5d-05bf-4c8a-9edc-e077278e7138 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:45.059768 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5591e7f1-faa5-4920-a002-d56a02a262cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.199414 Oct 04 21:08:45.062973 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 417/825] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:44 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:45.076176 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-94dfdf5d-05bf-4c8a-9edc-e077278e7138 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1357 microversion: 2.1 time: 0.931140 Oct 04 21:08:45.076563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cdc8ca58-ea67-48c1-a84f-4485369f04af tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:45.077507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cdc8ca58-ea67-48c1-a84f-4485369f04af tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:45.090064 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 409/826] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:44 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1357 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:45.094059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cdc8ca58-ea67-48c1-a84f-4485369f04af tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:45.096020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cdc8ca58-ea67-48c1-a84f-4485369f04af tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:45.096717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cdc8ca58-ea67-48c1-a84f-4485369f04af tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:45.097866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cdc8ca58-ea67-48c1-a84f-4485369f04af tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:45.098344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cdc8ca58-ea67-48c1-a84f-4485369f04af tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:45.104485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cdc8ca58-ea67-48c1-a84f-4485369f04af tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:45.104646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8a4e8146-dfbb-4688-8e9e-d0d7a0969e49 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:45.104646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8a4e8146-dfbb-4688-8e9e-d0d7a0969e49 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:45.118485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a4e8146-dfbb-4688-8e9e-d0d7a0969e49 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:45.118988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a4e8146-dfbb-4688-8e9e-d0d7a0969e49 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:45.119430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a4e8146-dfbb-4688-8e9e-d0d7a0969e49 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:45.120147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a4e8146-dfbb-4688-8e9e-d0d7a0969e49 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:45.120601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a4e8146-dfbb-4688-8e9e-d0d7a0969e49 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:45.121028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a4e8146-dfbb-4688-8e9e-d0d7a0969e49 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:45.275662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-8a4e8146-dfbb-4688-8e9e-d0d7a0969e49 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:45.309604 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8a4e8146-dfbb-4688-8e9e-d0d7a0969e49 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.218212 Oct 04 21:08:45.310984 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 410/827] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:45 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:45.341410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-00e981c2-0cc6-41a4-8802-7c76d51a6366 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:45.342254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-00e981c2-0cc6-41a4-8802-7c76d51a6366 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:45.362962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00e981c2-0cc6-41a4-8802-7c76d51a6366 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:45.363472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00e981c2-0cc6-41a4-8802-7c76d51a6366 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:45.363915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00e981c2-0cc6-41a4-8802-7c76d51a6366 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:45.365487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00e981c2-0cc6-41a4-8802-7c76d51a6366 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:45.366119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00e981c2-0cc6-41a4-8802-7c76d51a6366 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:45.366711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00e981c2-0cc6-41a4-8802-7c76d51a6366 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:45.387587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cdc8ca58-ea67-48c1-a84f-4485369f04af tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:45.399481 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cdc8ca58-ea67-48c1-a84f-4485369f04af tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 200 len: 1318 microversion: 2.1 time: 0.334841 Oct 04 21:08:45.407220 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 418/828] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:45 2022] GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:45.412768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-e83d01e2-5fec-4aaf-acc0-94e5e0c462f1 req-d988d18a-4005-4f63-a7c4-0b52e823b82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e74286-835f-42b6-9d83-304b333a786f", "name": "network-vif-plugged", "status": "completed", "tag": "35e8d1d0-7fba-4543-9d29-aea7260b9810"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:45.437735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e83d01e2-5fec-4aaf-acc0-94e5e0c462f1 req-d988d18a-4005-4f63-a7c4-0b52e823b82d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:45.438270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e83d01e2-5fec-4aaf-acc0-94e5e0c462f1 req-d988d18a-4005-4f63-a7c4-0b52e823b82d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:45.438757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e83d01e2-5fec-4aaf-acc0-94e5e0c462f1 req-d988d18a-4005-4f63-a7c4-0b52e823b82d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:45.461554 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-e83d01e2-5fec-4aaf-acc0-94e5e0c462f1 req-d988d18a-4005-4f63-a7c4-0b52e823b82d service nova] Creating event network-vif-plugged:35e8d1d0-7fba-4543-9d29-aea7260b9810 for instance 79e74286-835f-42b6-9d83-304b333a786f on n-h2-860282-1 Oct 04 21:08:45.475154 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-e83d01e2-5fec-4aaf-acc0-94e5e0c462f1 req-d988d18a-4005-4f63-a7c4-0b52e823b82d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066299 Oct 04 21:08:45.476582 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 419/829] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:45.550099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-00e981c2-0cc6-41a4-8802-7c76d51a6366 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:45.559115 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-00e981c2-0cc6-41a4-8802-7c76d51a6366 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1470 microversion: 2.1 time: 0.224317 Oct 04 21:08:45.561727 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 411/830] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:45 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1470 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:45.583935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-619284f0-95c1-45dc-9650-1de869bebf5b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:45.584677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-619284f0-95c1-45dc-9650-1de869bebf5b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:45.591539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-619284f0-95c1-45dc-9650-1de869bebf5b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:45.592453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-619284f0-95c1-45dc-9650-1de869bebf5b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:45.593005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-619284f0-95c1-45dc-9650-1de869bebf5b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:45.593892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-619284f0-95c1-45dc-9650-1de869bebf5b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:45.594926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-619284f0-95c1-45dc-9650-1de869bebf5b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:45.594926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-619284f0-95c1-45dc-9650-1de869bebf5b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:45.790964 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-619284f0-95c1-45dc-9650-1de869bebf5b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "POST /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c/action" status: 204 len: 0 microversion: 2.1 time: 0.211626 Oct 04 21:08:45.791850 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 420/831] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:08:45 2022] POST /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c/action => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:08:45.802792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-09f39273-dfcd-4c15-b2fd-e0d4c2ee93ad tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:45.803483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-09f39273-dfcd-4c15-b2fd-e0d4c2ee93ad tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:45.815697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09f39273-dfcd-4c15-b2fd-e0d4c2ee93ad tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:45.815947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09f39273-dfcd-4c15-b2fd-e0d4c2ee93ad tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:45.818966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09f39273-dfcd-4c15-b2fd-e0d4c2ee93ad tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:45.819784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09f39273-dfcd-4c15-b2fd-e0d4c2ee93ad tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:45.821487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09f39273-dfcd-4c15-b2fd-e0d4c2ee93ad tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:45.822006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09f39273-dfcd-4c15-b2fd-e0d4c2ee93ad tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:45.890659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d7142b01-1c8a-47e4-a094-a76825d62a47 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:45.891577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d7142b01-1c8a-47e4-a094-a76825d62a47 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:45.906777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7142b01-1c8a-47e4-a094-a76825d62a47 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:45.907503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7142b01-1c8a-47e4-a094-a76825d62a47 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:45.908058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7142b01-1c8a-47e4-a094-a76825d62a47 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:45.908993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7142b01-1c8a-47e4-a094-a76825d62a47 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:45.909618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7142b01-1c8a-47e4-a094-a76825d62a47 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:45.911280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7142b01-1c8a-47e4-a094-a76825d62a47 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:45.918855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:46.035108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d7142b01-1c8a-47e4-a094-a76825d62a47 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:46.047750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d7142b01-1c8a-47e4-a094-a76825d62a47 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:46.049943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d7142b01-1c8a-47e4-a094-a76825d62a47 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:46.051277 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d7142b01-1c8a-47e4-a094-a76825d62a47 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1338 microversion: 2.25 time: 0.165882 Oct 04 21:08:46.052354 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 421/832] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:45 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1338 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:46.096810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e919de74-ce7b-4408-a005-bdcdb91889bf tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:46.097494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e919de74-ce7b-4408-a005-bdcdb91889bf tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:46.108620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e919de74-ce7b-4408-a005-bdcdb91889bf tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:46.109123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e919de74-ce7b-4408-a005-bdcdb91889bf tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:46.109595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e919de74-ce7b-4408-a005-bdcdb91889bf tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:46.110325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e919de74-ce7b-4408-a005-bdcdb91889bf tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:46.110782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e919de74-ce7b-4408-a005-bdcdb91889bf tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:46.111209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e919de74-ce7b-4408-a005-bdcdb91889bf tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:46.182590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-09f39273-dfcd-4c15-b2fd-e0d4c2ee93ad tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:46.193408 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-09f39273-dfcd-4c15-b2fd-e0d4c2ee93ad tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1470 microversion: 2.1 time: 0.393136 Oct 04 21:08:46.194990 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 412/833] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:45 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1470 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:46.213401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-42b7d9eb-84d6-41a7-ada8-d2abaa23b32c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:46.216483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-42b7d9eb-84d6-41a7-ada8-d2abaa23b32c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:46.221243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42b7d9eb-84d6-41a7-ada8-d2abaa23b32c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:46.221750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42b7d9eb-84d6-41a7-ada8-d2abaa23b32c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:46.223579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42b7d9eb-84d6-41a7-ada8-d2abaa23b32c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:46.224497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42b7d9eb-84d6-41a7-ada8-d2abaa23b32c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:46.227484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42b7d9eb-84d6-41a7-ada8-d2abaa23b32c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:46.232414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42b7d9eb-84d6-41a7-ada8-d2abaa23b32c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:46.315738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e919de74-ce7b-4408-a005-bdcdb91889bf tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:46.337804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e919de74-ce7b-4408-a005-bdcdb91889bf tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:46.340507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e919de74-ce7b-4408-a005-bdcdb91889bf tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:46.347474 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e919de74-ce7b-4408-a005-bdcdb91889bf tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.257436 Oct 04 21:08:46.348941 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 422/834] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:46 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:46.355368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-35c951ed-c4ae-4afa-b42e-f481ad96c989 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:46.356621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-35c951ed-c4ae-4afa-b42e-f481ad96c989 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:46.365910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35c951ed-c4ae-4afa-b42e-f481ad96c989 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:46.366402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35c951ed-c4ae-4afa-b42e-f481ad96c989 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:46.367056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35c951ed-c4ae-4afa-b42e-f481ad96c989 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:46.367757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35c951ed-c4ae-4afa-b42e-f481ad96c989 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:46.368428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35c951ed-c4ae-4afa-b42e-f481ad96c989 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:46.368984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35c951ed-c4ae-4afa-b42e-f481ad96c989 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:46.483324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-35c951ed-c4ae-4afa-b42e-f481ad96c989 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:46.527487 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-35c951ed-c4ae-4afa-b42e-f481ad96c989 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.175130 Oct 04 21:08:46.528139 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 423/835] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:46 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:46.544515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d0f288a9-9950-4d38-8173-0a733ec828db tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:46.547622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d0f288a9-9950-4d38-8173-0a733ec828db tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:46.562300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0f288a9-9950-4d38-8173-0a733ec828db tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:46.565864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0f288a9-9950-4d38-8173-0a733ec828db tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:46.566649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0f288a9-9950-4d38-8173-0a733ec828db tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:46.569921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0f288a9-9950-4d38-8173-0a733ec828db tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:46.570728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0f288a9-9950-4d38-8173-0a733ec828db tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:46.571666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0f288a9-9950-4d38-8173-0a733ec828db tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:46.595205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-42b7d9eb-84d6-41a7-ada8-d2abaa23b32c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:46.603429 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-42b7d9eb-84d6-41a7-ada8-d2abaa23b32c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1357 microversion: 2.1 time: 0.406784 Oct 04 21:08:46.608451 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 413/836] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:46 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1357 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:46.836095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d0f288a9-9950-4d38-8173-0a733ec828db tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:46.849626 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d0f288a9-9950-4d38-8173-0a733ec828db tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 200 len: 1318 microversion: 2.1 time: 0.318581 Oct 04 21:08:46.851061 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 424/837] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:46 2022] GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:47.081998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8971a2a1-e0b8-41e4-8d3b-4f7c4b475278 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:47.082946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8971a2a1-e0b8-41e4-8d3b-4f7c4b475278 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:47.091411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8971a2a1-e0b8-41e4-8d3b-4f7c4b475278 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.091549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8971a2a1-e0b8-41e4-8d3b-4f7c4b475278 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.091992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8971a2a1-e0b8-41e4-8d3b-4f7c4b475278 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.092716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8971a2a1-e0b8-41e4-8d3b-4f7c4b475278 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.093184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8971a2a1-e0b8-41e4-8d3b-4f7c4b475278 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.093786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8971a2a1-e0b8-41e4-8d3b-4f7c4b475278 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.230555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8971a2a1-e0b8-41e4-8d3b-4f7c4b475278 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:47.234782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8785c6d6-a24d-47a0-b135-72429db308a5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:47.236939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8785c6d6-a24d-47a0-b135-72429db308a5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:47.240725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8971a2a1-e0b8-41e4-8d3b-4f7c4b475278 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:47.242472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8971a2a1-e0b8-41e4-8d3b-4f7c4b475278 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:47.244309 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8971a2a1-e0b8-41e4-8d3b-4f7c4b475278 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1338 microversion: 2.25 time: 0.167246 Oct 04 21:08:47.261088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8785c6d6-a24d-47a0-b135-72429db308a5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.261088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8785c6d6-a24d-47a0-b135-72429db308a5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.261088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8785c6d6-a24d-47a0-b135-72429db308a5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.261088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8785c6d6-a24d-47a0-b135-72429db308a5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.261088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8785c6d6-a24d-47a0-b135-72429db308a5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.261088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8785c6d6-a24d-47a0-b135-72429db308a5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.261784 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 414/838] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:47 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1338 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:47.381221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-68e965c1-ca87-4c0c-8e96-f88a3279de50 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:47.381871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-68e965c1-ca87-4c0c-8e96-f88a3279de50 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:47.388208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68e965c1-ca87-4c0c-8e96-f88a3279de50 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.393232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68e965c1-ca87-4c0c-8e96-f88a3279de50 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.393232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68e965c1-ca87-4c0c-8e96-f88a3279de50 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.393232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68e965c1-ca87-4c0c-8e96-f88a3279de50 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.393232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68e965c1-ca87-4c0c-8e96-f88a3279de50 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.393232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68e965c1-ca87-4c0c-8e96-f88a3279de50 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.473918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-68e965c1-ca87-4c0c-8e96-f88a3279de50 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:47.495400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-68e965c1-ca87-4c0c-8e96-f88a3279de50 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:47.496865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-68e965c1-ca87-4c0c-8e96-f88a3279de50 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:47.508350 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-68e965c1-ca87-4c0c-8e96-f88a3279de50 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.125706 Oct 04 21:08:47.509602 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 415/839] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:47 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:47.558133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b80ae11c-8439-4182-8e5e-d5e85a9acd12 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:47.558790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b80ae11c-8439-4182-8e5e-d5e85a9acd12 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:47.588272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b80ae11c-8439-4182-8e5e-d5e85a9acd12 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.588272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b80ae11c-8439-4182-8e5e-d5e85a9acd12 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.588272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b80ae11c-8439-4182-8e5e-d5e85a9acd12 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.588272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b80ae11c-8439-4182-8e5e-d5e85a9acd12 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.588272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b80ae11c-8439-4182-8e5e-d5e85a9acd12 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.588931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8785c6d6-a24d-47a0-b135-72429db308a5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:47.589717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b80ae11c-8439-4182-8e5e-d5e85a9acd12 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.593248 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8785c6d6-a24d-47a0-b135-72429db308a5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1470 microversion: 2.1 time: 0.374183 Oct 04 21:08:47.593871 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 425/840] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:47 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1470 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:47.598462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:47.615289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-a12a34ca-57db-428c-a707-69f3099a510b req-682e6149-f9b3-4ada-a333-0f3046396392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41063621-009d-455a-a56d-9ffbae52f46c", "name": "network-vif-plugged", "status": "completed", "tag": "165120d0-97d6-48bd-b2b4-6ab812848c0b"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:47.625453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a12a34ca-57db-428c-a707-69f3099a510b req-682e6149-f9b3-4ada-a333-0f3046396392 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.626505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a12a34ca-57db-428c-a707-69f3099a510b req-682e6149-f9b3-4ada-a333-0f3046396392 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.627753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a12a34ca-57db-428c-a707-69f3099a510b req-682e6149-f9b3-4ada-a333-0f3046396392 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.650800 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-a12a34ca-57db-428c-a707-69f3099a510b req-682e6149-f9b3-4ada-a333-0f3046396392 service nova] Creating event network-vif-plugged:165120d0-97d6-48bd-b2b4-6ab812848c0b for instance 41063621-009d-455a-a56d-9ffbae52f46c on n-h2-860282-1 Oct 04 21:08:47.660242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-a12a34ca-57db-428c-a707-69f3099a510b req-682e6149-f9b3-4ada-a333-0f3046396392 service nova] Instance 41063621-009d-455a-a56d-9ffbae52f46c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:08:47.674886 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-a12a34ca-57db-428c-a707-69f3099a510b req-682e6149-f9b3-4ada-a333-0f3046396392 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064285 Oct 04 21:08:47.675966 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 426/841] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:08:47.682515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f8125e4f-1575-45fb-84d8-3925f6f1a4c8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:47.683658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f8125e4f-1575-45fb-84d8-3925f6f1a4c8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:47.698102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-b80ae11c-8439-4182-8e5e-d5e85a9acd12 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:47.699428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8125e4f-1575-45fb-84d8-3925f6f1a4c8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.700297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8125e4f-1575-45fb-84d8-3925f6f1a4c8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.701508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8125e4f-1575-45fb-84d8-3925f6f1a4c8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.702426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8125e4f-1575-45fb-84d8-3925f6f1a4c8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.703047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8125e4f-1575-45fb-84d8-3925f6f1a4c8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.703693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8125e4f-1575-45fb-84d8-3925f6f1a4c8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.736371 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b80ae11c-8439-4182-8e5e-d5e85a9acd12 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.181903 Oct 04 21:08:47.736963 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 416/842] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:47 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:47.858991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f8125e4f-1575-45fb-84d8-3925f6f1a4c8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:47.872361 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f8125e4f-1575-45fb-84d8-3925f6f1a4c8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1357 microversion: 2.1 time: 0.190819 Oct 04 21:08:47.875743 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 427/843] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:47 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:47.879050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9435aed9-9a1a-4a00-a023-e57776114bea tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:47.879710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9435aed9-9a1a-4a00-a023-e57776114bea tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:47.889721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9435aed9-9a1a-4a00-a023-e57776114bea tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.890224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9435aed9-9a1a-4a00-a023-e57776114bea tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.890766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9435aed9-9a1a-4a00-a023-e57776114bea tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.891530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9435aed9-9a1a-4a00-a023-e57776114bea tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.891988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9435aed9-9a1a-4a00-a023-e57776114bea tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.892465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9435aed9-9a1a-4a00-a023-e57776114bea tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:48.096486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9435aed9-9a1a-4a00-a023-e57776114bea tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:48.102952 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9435aed9-9a1a-4a00-a023-e57776114bea tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 200 len: 1318 microversion: 2.1 time: 0.230393 Oct 04 21:08:48.103546 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 417/844] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:47 2022] GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:48.272335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-63ac7849-9bcd-46d6-8bb3-a16cf323bcd8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:48.272956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-63ac7849-9bcd-46d6-8bb3-a16cf323bcd8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:48.279985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63ac7849-9bcd-46d6-8bb3-a16cf323bcd8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:48.280475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63ac7849-9bcd-46d6-8bb3-a16cf323bcd8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:48.280927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63ac7849-9bcd-46d6-8bb3-a16cf323bcd8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:48.281753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63ac7849-9bcd-46d6-8bb3-a16cf323bcd8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:48.282228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63ac7849-9bcd-46d6-8bb3-a16cf323bcd8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:48.282661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63ac7849-9bcd-46d6-8bb3-a16cf323bcd8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:48.356549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-63ac7849-9bcd-46d6-8bb3-a16cf323bcd8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:48.367816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-63ac7849-9bcd-46d6-8bb3-a16cf323bcd8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:48.369281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-63ac7849-9bcd-46d6-8bb3-a16cf323bcd8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:48.370446 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-63ac7849-9bcd-46d6-8bb3-a16cf323bcd8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1346 microversion: 2.25 time: 0.102349 Oct 04 21:08:48.376639 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 428/845] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:48 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:48.536794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-39c8df40-bd2d-4899-897c-784ee4a3ceb9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:48.537444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-39c8df40-bd2d-4899-897c-784ee4a3ceb9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:48.545283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c8df40-bd2d-4899-897c-784ee4a3ceb9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:48.546047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c8df40-bd2d-4899-897c-784ee4a3ceb9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:48.546689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c8df40-bd2d-4899-897c-784ee4a3ceb9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:48.547408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c8df40-bd2d-4899-897c-784ee4a3ceb9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:48.547890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c8df40-bd2d-4899-897c-784ee4a3ceb9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:48.548309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c8df40-bd2d-4899-897c-784ee4a3ceb9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:48.615644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-39c8df40-bd2d-4899-897c-784ee4a3ceb9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:48.620028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-080f4146-bcbb-479e-98ef-987378c00c76 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:48.620923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-080f4146-bcbb-479e-98ef-987378c00c76 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:48.626014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-39c8df40-bd2d-4899-897c-784ee4a3ceb9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:48.627671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-39c8df40-bd2d-4899-897c-784ee4a3ceb9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:48.628651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-080f4146-bcbb-479e-98ef-987378c00c76 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:48.629252 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-080f4146-bcbb-479e-98ef-987378c00c76 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:48.629821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-080f4146-bcbb-479e-98ef-987378c00c76 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:48.630780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-080f4146-bcbb-479e-98ef-987378c00c76 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:48.631659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-080f4146-bcbb-479e-98ef-987378c00c76 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:48.631877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-080f4146-bcbb-479e-98ef-987378c00c76 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:48.633371 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-39c8df40-bd2d-4899-897c-784ee4a3ceb9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.101122 Oct 04 21:08:48.634177 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 418/846] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:48 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:48.769620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-caad4fb3-b768-4e0f-a523-1bc18fc55867 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:48.770352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-caad4fb3-b768-4e0f-a523-1bc18fc55867 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:48.777397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-caad4fb3-b768-4e0f-a523-1bc18fc55867 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:48.778056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-caad4fb3-b768-4e0f-a523-1bc18fc55867 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:48.779800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-caad4fb3-b768-4e0f-a523-1bc18fc55867 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:48.779800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-caad4fb3-b768-4e0f-a523-1bc18fc55867 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:48.780435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-caad4fb3-b768-4e0f-a523-1bc18fc55867 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:48.780986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-caad4fb3-b768-4e0f-a523-1bc18fc55867 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:48.803664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-080f4146-bcbb-479e-98ef-987378c00c76 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:48.813647 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-080f4146-bcbb-479e-98ef-987378c00c76 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1470 microversion: 2.1 time: 0.197574 Oct 04 21:08:48.814163 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 429/847] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:48 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1470 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:48.891441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-caad4fb3-b768-4e0f-a523-1bc18fc55867 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:48.907771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c6bfeb5e-1e63-4636-a26f-311ba9d2c5c1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:48.908555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c6bfeb5e-1e63-4636-a26f-311ba9d2c5c1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:48.912405 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-caad4fb3-b768-4e0f-a523-1bc18fc55867 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.150451 Oct 04 21:08:48.912405 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 419/848] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:48 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:48.921344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6bfeb5e-1e63-4636-a26f-311ba9d2c5c1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:48.921868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6bfeb5e-1e63-4636-a26f-311ba9d2c5c1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:48.922364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6bfeb5e-1e63-4636-a26f-311ba9d2c5c1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:48.923070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6bfeb5e-1e63-4636-a26f-311ba9d2c5c1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:48.923525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6bfeb5e-1e63-4636-a26f-311ba9d2c5c1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:48.923950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6bfeb5e-1e63-4636-a26f-311ba9d2c5c1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:49.096501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c6bfeb5e-1e63-4636-a26f-311ba9d2c5c1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:49.106367 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c6bfeb5e-1e63-4636-a26f-311ba9d2c5c1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1357 microversion: 2.1 time: 0.203871 Oct 04 21:08:49.109280 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 430/849] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:48 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:49.126967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c7d20b62-a2d2-4224-a755-d817ead78db0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:49.127586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c7d20b62-a2d2-4224-a755-d817ead78db0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:49.134266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7d20b62-a2d2-4224-a755-d817ead78db0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:49.135055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7d20b62-a2d2-4224-a755-d817ead78db0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:49.135506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7d20b62-a2d2-4224-a755-d817ead78db0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:49.136194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7d20b62-a2d2-4224-a755-d817ead78db0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:49.136808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7d20b62-a2d2-4224-a755-d817ead78db0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:49.137387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7d20b62-a2d2-4224-a755-d817ead78db0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:49.323466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c7d20b62-a2d2-4224-a755-d817ead78db0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:49.334632 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c7d20b62-a2d2-4224-a755-d817ead78db0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 200 len: 1468 microversion: 2.1 time: 0.212164 Oct 04 21:08:49.336609 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 420/850] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:49 2022] GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 1468 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:49.360822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-705d11d3-1151-47c1-a7f4-d25933a908a7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:49.360822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-705d11d3-1151-47c1-a7f4-d25933a908a7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 28198b9c-ff65-40f0-869f-117104e764ef] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:49.370600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-705d11d3-1151-47c1-a7f4-d25933a908a7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:49.371359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-705d11d3-1151-47c1-a7f4-d25933a908a7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:49.371991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-705d11d3-1151-47c1-a7f4-d25933a908a7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:49.373628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-705d11d3-1151-47c1-a7f4-d25933a908a7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:49.374510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-705d11d3-1151-47c1-a7f4-d25933a908a7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:49.375137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-705d11d3-1151-47c1-a7f4-d25933a908a7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:49.399655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-faefee62-64dc-4aae-a6e9-e5c6bac335d3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:49.401518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-faefee62-64dc-4aae-a6e9-e5c6bac335d3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:49.414511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-faefee62-64dc-4aae-a6e9-e5c6bac335d3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:49.415430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-faefee62-64dc-4aae-a6e9-e5c6bac335d3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:49.415897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-faefee62-64dc-4aae-a6e9-e5c6bac335d3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:49.416650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-faefee62-64dc-4aae-a6e9-e5c6bac335d3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:49.417117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-faefee62-64dc-4aae-a6e9-e5c6bac335d3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:49.417578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-faefee62-64dc-4aae-a6e9-e5c6bac335d3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:49.614614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-705d11d3-1151-47c1-a7f4-d25933a908a7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:49.643429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-faefee62-64dc-4aae-a6e9-e5c6bac335d3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:49.647957 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-705d11d3-1151-47c1-a7f4-d25933a908a7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/28198b9c-ff65-40f0-869f-117104e764ef" status: 200 len: 1468 microversion: 2.1 time: 0.292663 Oct 04 21:08:49.648541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-faefee62-64dc-4aae-a6e9-e5c6bac335d3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:49.649575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-faefee62-64dc-4aae-a6e9-e5c6bac335d3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:49.665052 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-faefee62-64dc-4aae-a6e9-e5c6bac335d3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1411 microversion: 2.25 time: 0.254979 Oct 04 21:08:49.666302 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 431/852] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:49 2022] GET /compute/v2.1/servers/28198b9c-ff65-40f0-869f-117104e764ef => generated 1468 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:49.666431 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 421/852] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:49 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1411 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:49.675210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d4aafd1b-4303-44b5-bb50-98070cf347f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:49.680371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f912cf4d-40ec-4ef5-bd05-31f4fbdb66cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:49.681066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d4aafd1b-4303-44b5-bb50-98070cf347f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:49.681705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f912cf4d-40ec-4ef5-bd05-31f4fbdb66cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:49.682551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d4aafd1b-4303-44b5-bb50-98070cf347f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Searching by: {'reservation_id': 'r-1jv93uyh', 'deleted': False, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:08:49.691034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4aafd1b-4303-44b5-bb50-98070cf347f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:49.691806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4aafd1b-4303-44b5-bb50-98070cf347f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:49.692401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4aafd1b-4303-44b5-bb50-98070cf347f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:49.693003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f912cf4d-40ec-4ef5-bd05-31f4fbdb66cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:49.693522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4aafd1b-4303-44b5-bb50-98070cf347f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:49.693661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f912cf4d-40ec-4ef5-bd05-31f4fbdb66cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:49.693982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f912cf4d-40ec-4ef5-bd05-31f4fbdb66cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:49.694418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4aafd1b-4303-44b5-bb50-98070cf347f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:49.694822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f912cf4d-40ec-4ef5-bd05-31f4fbdb66cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:49.695174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4aafd1b-4303-44b5-bb50-98070cf347f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:49.695293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f912cf4d-40ec-4ef5-bd05-31f4fbdb66cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:49.695714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f912cf4d-40ec-4ef5-bd05-31f4fbdb66cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:49.793984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f912cf4d-40ec-4ef5-bd05-31f4fbdb66cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:49.807021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f912cf4d-40ec-4ef5-bd05-31f4fbdb66cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:49.808685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f912cf4d-40ec-4ef5-bd05-31f4fbdb66cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:49.816475 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f912cf4d-40ec-4ef5-bd05-31f4fbdb66cd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.146393 Oct 04 21:08:49.817289 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 422/853] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:49 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:49.822578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.multi_cell_list [None req-d4aafd1b-4303-44b5-bb50-98070cf347f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:08:49.844630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-36d7b3bf-3800-4f6c-8ef0-9dd756c7bf6d req-5d43bd81-a82a-474e-afdc-f1dfb341515b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf618d0-9d79-435c-ac4f-636ac63dbbda", "name": "network-vif-plugged", "status": "completed", "tag": "dd232c2f-36a6-4a3c-93d1-396a660ea091"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:49.856723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-36d7b3bf-3800-4f6c-8ef0-9dd756c7bf6d req-5d43bd81-a82a-474e-afdc-f1dfb341515b service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:49.857873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-36d7b3bf-3800-4f6c-8ef0-9dd756c7bf6d req-5d43bd81-a82a-474e-afdc-f1dfb341515b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:49.858351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-36d7b3bf-3800-4f6c-8ef0-9dd756c7bf6d req-5d43bd81-a82a-474e-afdc-f1dfb341515b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:49.872968 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-36d7b3bf-3800-4f6c-8ef0-9dd756c7bf6d req-5d43bd81-a82a-474e-afdc-f1dfb341515b service nova] Creating event network-vif-plugged:dd232c2f-36a6-4a3c-93d1-396a660ea091 for instance fcf618d0-9d79-435c-ac4f-636ac63dbbda on n-h2-860282-1 Oct 04 21:08:49.879524 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-36d7b3bf-3800-4f6c-8ef0-9dd756c7bf6d req-5d43bd81-a82a-474e-afdc-f1dfb341515b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047452 Oct 04 21:08:49.880530 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 423/854] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:49.886059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c5e9dcf0-2ecf-4c6e-9a3a-d99707d95ce3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:49.887430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c5e9dcf0-2ecf-4c6e-9a3a-d99707d95ce3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:49.910551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d4aafd1b-4303-44b5-bb50-98070cf347f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:49.912021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5e9dcf0-2ecf-4c6e-9a3a-d99707d95ce3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:49.912622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5e9dcf0-2ecf-4c6e-9a3a-d99707d95ce3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:49.913075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5e9dcf0-2ecf-4c6e-9a3a-d99707d95ce3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:49.913849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5e9dcf0-2ecf-4c6e-9a3a-d99707d95ce3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:49.914316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5e9dcf0-2ecf-4c6e-9a3a-d99707d95ce3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:49.914492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4aafd1b-4303-44b5-bb50-98070cf347f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:49.914749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5e9dcf0-2ecf-4c6e-9a3a-d99707d95ce3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:49.915280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4aafd1b-4303-44b5-bb50-98070cf347f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:49.915890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4aafd1b-4303-44b5-bb50-98070cf347f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:50.126220 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d4aafd1b-4303-44b5-bb50-98070cf347f7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?reservation_id=r-1jv93uyh" status: 200 len: 2929 microversion: 2.1 time: 0.454643 Oct 04 21:08:50.127486 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 432/855] 10.222.0.30 () {58 vars in 1197 bytes} [Tue Oct 4 21:08:49 2022] GET /compute/v2.1/servers/detail?reservation_id=r-1jv93uyh => generated 2929 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:50.136016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c5e9dcf0-2ecf-4c6e-9a3a-d99707d95ce3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:50.146805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-faa576e2-172b-4f8c-b3ca-d161a82ae071 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:50.147441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-faa576e2-172b-4f8c-b3ca-d161a82ae071 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:50.153232 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c5e9dcf0-2ecf-4c6e-9a3a-d99707d95ce3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1462 microversion: 2.1 time: 0.271134 Oct 04 21:08:50.153873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-faa576e2-172b-4f8c-b3ca-d161a82ae071 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:50.165526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-faa576e2-172b-4f8c-b3ca-d161a82ae071 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:50.165727 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 424/856] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:49 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1462 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:50.165842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-faa576e2-172b-4f8c-b3ca-d161a82ae071 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:50.165842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-faa576e2-172b-4f8c-b3ca-d161a82ae071 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:50.165842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-faa576e2-172b-4f8c-b3ca-d161a82ae071 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:50.165842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-faa576e2-172b-4f8c-b3ca-d161a82ae071 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:50.166185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-76bd9c75-1037-4fb2-b4e6-9064f5561e78 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:50.166185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-76bd9c75-1037-4fb2-b4e6-9064f5561e78 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:50.168704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76bd9c75-1037-4fb2-b4e6-9064f5561e78 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:50.170444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76bd9c75-1037-4fb2-b4e6-9064f5561e78 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:50.171307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76bd9c75-1037-4fb2-b4e6-9064f5561e78 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:50.172303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76bd9c75-1037-4fb2-b4e6-9064f5561e78 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:50.174174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76bd9c75-1037-4fb2-b4e6-9064f5561e78 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:50.175092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76bd9c75-1037-4fb2-b4e6-9064f5561e78 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:50.249766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-faa576e2-172b-4f8c-b3ca-d161a82ae071 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:50.273836 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-faa576e2-172b-4f8c-b3ca-d161a82ae071 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.144168 Oct 04 21:08:50.274871 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 433/857] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:50 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:50.281873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2b415a48-3971-4265-8806-fc13cccac707 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:50.314878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.compute.server_groups [None req-2b415a48-3971-4265-8806-fc13cccac707 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Querying cell 016bade6-ba85-4482-99c1-a6ee7c8937c1(cell1) for 2 instances {{(pid=122758) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 21:08:50.315836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b415a48-3971-4265-8806-fc13cccac707 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:50.316483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b415a48-3971-4265-8806-fc13cccac707 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:50.317080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b415a48-3971-4265-8806-fc13cccac707 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:50.356418 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2b415a48-3971-4265-8806-fc13cccac707 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/71bca548-1b20-4669-a31b-2cddaf629123" status: 200 len: 271 microversion: 2.1 time: 0.080380 Oct 04 21:08:50.358607 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 434/858] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Oct 4 21:08:50 2022] GET /compute/v2.1/os-server-groups/71bca548-1b20-4669-a31b-2cddaf629123 => generated 271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:50.370792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fee57d76-ea6f-4802-b681-102ad40556c4 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:50.370792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fee57d76-ea6f-4802-b681-102ad40556c4 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:50.371234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-76bd9c75-1037-4fb2-b4e6-9064f5561e78 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:50.376856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fee57d76-ea6f-4802-b681-102ad40556c4 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:50.377359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fee57d76-ea6f-4802-b681-102ad40556c4 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:50.377830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fee57d76-ea6f-4802-b681-102ad40556c4 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:50.379145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fee57d76-ea6f-4802-b681-102ad40556c4 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:50.379613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fee57d76-ea6f-4802-b681-102ad40556c4 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:50.380044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fee57d76-ea6f-4802-b681-102ad40556c4 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:50.380767 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-76bd9c75-1037-4fb2-b4e6-9064f5561e78 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1357 microversion: 2.1 time: 0.224829 Oct 04 21:08:50.385790 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 425/859] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:50 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1357 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:50.395874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-923fed06-9119-4ab8-af97-820c29bd0ff7 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:50.397093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-923fed06-9119-4ab8-af97-820c29bd0ff7 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] [instance: 28198b9c-ff65-40f0-869f-117104e764ef] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:50.403701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-923fed06-9119-4ab8-af97-820c29bd0ff7 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:50.411735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-923fed06-9119-4ab8-af97-820c29bd0ff7 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:50.411735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-923fed06-9119-4ab8-af97-820c29bd0ff7 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:50.411735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-923fed06-9119-4ab8-af97-820c29bd0ff7 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:50.411735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-923fed06-9119-4ab8-af97-820c29bd0ff7 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:50.411735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-923fed06-9119-4ab8-af97-820c29bd0ff7 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:50.580459 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-923fed06-9119-4ab8-af97-820c29bd0ff7 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/28198b9c-ff65-40f0-869f-117104e764ef" status: 200 len: 1619 microversion: 2.1 time: 0.189556 Oct 04 21:08:50.581252 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fee57d76-ea6f-4802-b681-102ad40556c4 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1613 microversion: 2.1 time: 0.220763 Oct 04 21:08:50.581379 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 426/860] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:50 2022] GET /compute/v2.1/servers/28198b9c-ff65-40f0-869f-117104e764ef => generated 1619 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:50.582079 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 435/861] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:50 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1613 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:50.609871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-538b0cf5-26e6-40dd-aa07-eb65b6db4094 req-fed14146-f988-428f-ac99-00284cb8015e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "191d63c3-2de0-4d3a-85f1-c4be3d2f5432", "tag": "816da828-8532-4f45-bd81-2b2098519c9f"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:50.624334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-538b0cf5-26e6-40dd-aa07-eb65b6db4094 req-fed14146-f988-428f-ac99-00284cb8015e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:50.624334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-538b0cf5-26e6-40dd-aa07-eb65b6db4094 req-fed14146-f988-428f-ac99-00284cb8015e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:50.624334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-538b0cf5-26e6-40dd-aa07-eb65b6db4094 req-fed14146-f988-428f-ac99-00284cb8015e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:50.624576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d19e57b9-249e-4921-89a1-2764d23b90ff tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Calling method '.version_select at 0x7f5790987940>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:50.628880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d19e57b9-249e-4921-89a1-2764d23b90ff tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:50.629385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d19e57b9-249e-4921-89a1-2764d23b90ff tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:50.630372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d19e57b9-249e-4921-89a1-2764d23b90ff tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:50.636870 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-538b0cf5-26e6-40dd-aa07-eb65b6db4094 req-fed14146-f988-428f-ac99-00284cb8015e service nova] Creating event network-changed:816da828-8532-4f45-bd81-2b2098519c9f for instance 191d63c3-2de0-4d3a-85f1-c4be3d2f5432 on n-h2-860282-1 Oct 04 21:08:50.641308 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d19e57b9-249e-4921-89a1-2764d23b90ff tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.1 time: 0.022176 Oct 04 21:08:50.642333 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 436/862] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Oct 4 21:08:50 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:50.642997 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-538b0cf5-26e6-40dd-aa07-eb65b6db4094 req-fed14146-f988-428f-ac99-00284cb8015e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044886 Oct 04 21:08:50.643714 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 427/863] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:50.647086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8f9f2d21-d96d-4dcc-9828-c5feaf8f057d tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:50.647749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8f9f2d21-d96d-4dcc-9828-c5feaf8f057d tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:50.662363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f9f2d21-d96d-4dcc-9828-c5feaf8f057d tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:50.662919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f9f2d21-d96d-4dcc-9828-c5feaf8f057d tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:50.663597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f9f2d21-d96d-4dcc-9828-c5feaf8f057d tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:50.665105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f9f2d21-d96d-4dcc-9828-c5feaf8f057d tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:50.665245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f9f2d21-d96d-4dcc-9828-c5feaf8f057d tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:50.665626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f9f2d21-d96d-4dcc-9828-c5feaf8f057d tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:50.689442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-40a062ae-55df-455f-8837-e110aa4b9215 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:50.690171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-40a062ae-55df-455f-8837-e110aa4b9215 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:50.698739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40a062ae-55df-455f-8837-e110aa4b9215 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:50.699825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40a062ae-55df-455f-8837-e110aa4b9215 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:50.701692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40a062ae-55df-455f-8837-e110aa4b9215 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:50.702532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40a062ae-55df-455f-8837-e110aa4b9215 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:50.703184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40a062ae-55df-455f-8837-e110aa4b9215 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:50.703813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40a062ae-55df-455f-8837-e110aa4b9215 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:50.857104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:50.863362 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8f9f2d21-d96d-4dcc-9828-c5feaf8f057d tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 200 len: 1619 microversion: 2.1 time: 0.219963 Oct 04 21:08:50.864188 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 437/864] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:50 2022] GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 1619 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:50.885791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f1a10dcc-0f20-431f-bf63-45ff1259a232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1455909817", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:50.895555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-40a062ae-55df-455f-8837-e110aa4b9215 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:50.912239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-40a062ae-55df-455f-8837-e110aa4b9215 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:50.914851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-40a062ae-55df-455f-8837-e110aa4b9215 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:50.916170 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-40a062ae-55df-455f-8837-e110aa4b9215 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1411 microversion: 2.25 time: 0.233472 Oct 04 21:08:50.917406 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 428/865] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:50 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1411 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:50.924336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-266e0b64-fb5d-427f-ab4e-2d2c86f21b9e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:50.925038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-266e0b64-fb5d-427f-ab4e-2d2c86f21b9e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:50.934580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-266e0b64-fb5d-427f-ab4e-2d2c86f21b9e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:50.936522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-266e0b64-fb5d-427f-ab4e-2d2c86f21b9e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:50.937054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-266e0b64-fb5d-427f-ab4e-2d2c86f21b9e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:50.938077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-266e0b64-fb5d-427f-ab4e-2d2c86f21b9e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:50.938678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-266e0b64-fb5d-427f-ab4e-2d2c86f21b9e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:50.939317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-266e0b64-fb5d-427f-ab4e-2d2c86f21b9e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:50.945306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-f1a10dcc-0f20-431f-bf63-45ff1259a232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:08:51.043563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-266e0b64-fb5d-427f-ab4e-2d2c86f21b9e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:51.053051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-266e0b64-fb5d-427f-ab4e-2d2c86f21b9e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:51.054562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-266e0b64-fb5d-427f-ab4e-2d2c86f21b9e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:51.060015 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-266e0b64-fb5d-427f-ab4e-2d2c86f21b9e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.141138 Oct 04 21:08:51.061554 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 429/866] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:50 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:51.086621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6d1904ff-b2da-40cd-b47e-159cefc0e086 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-402448332", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "f201296c-ba54-4f1e-984a-461dfe55d267"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:51.158324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-6d1904ff-b2da-40cd-b47e-159cefc0e086 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] validate_networks() for None {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:08:51.298495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f1a10dcc-0f20-431f-bf63-45ff1259a232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:08:51.298923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f1a10dcc-0f20-431f-bf63-45ff1259a232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:08:51.299404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f1a10dcc-0f20-431f-bf63-45ff1259a232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:08:51.299814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f1a10dcc-0f20-431f-bf63-45ff1259a232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:08:51.301699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f1a10dcc-0f20-431f-bf63-45ff1259a232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:08:51.309247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1a10dcc-0f20-431f-bf63-45ff1259a232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:51.309763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1a10dcc-0f20-431f-bf63-45ff1259a232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:51.310608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1a10dcc-0f20-431f-bf63-45ff1259a232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:51.311465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1a10dcc-0f20-431f-bf63-45ff1259a232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:51.311920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1a10dcc-0f20-431f-bf63-45ff1259a232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:51.312356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1a10dcc-0f20-431f-bf63-45ff1259a232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:51.335808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-f1a10dcc-0f20-431f-bf63-45ff1259a232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Getting quotas for project e11e3d4d14b240a3b934701459ada871. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:08:51.342254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-f1a10dcc-0f20-431f-bf63-45ff1259a232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Getting quotas for user 150625a9472d43e0b0509ef044c58d34 and project e11e3d4d14b240a3b934701459ada871. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:08:51.358450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f1a10dcc-0f20-431f-bf63-45ff1259a232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:08:51.364099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f1a10dcc-0f20-431f-bf63-45ff1259a232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:08:51.436688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-6d1904ff-b2da-40cd-b47e-159cefc0e086 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:08:51.437238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-6d1904ff-b2da-40cd-b47e-159cefc0e086 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:08:51.437791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-6d1904ff-b2da-40cd-b47e-159cefc0e086 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:08:51.438231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-6d1904ff-b2da-40cd-b47e-159cefc0e086 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:08:51.438642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-6d1904ff-b2da-40cd-b47e-159cefc0e086 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:08:51.447515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d1904ff-b2da-40cd-b47e-159cefc0e086 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:51.448004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d1904ff-b2da-40cd-b47e-159cefc0e086 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:51.448442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d1904ff-b2da-40cd-b47e-159cefc0e086 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:51.449163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d1904ff-b2da-40cd-b47e-159cefc0e086 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:51.449647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d1904ff-b2da-40cd-b47e-159cefc0e086 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:51.450083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d1904ff-b2da-40cd-b47e-159cefc0e086 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:51.469990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-6d1904ff-b2da-40cd-b47e-159cefc0e086 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:08:51.475908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-6d1904ff-b2da-40cd-b47e-159cefc0e086 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for user 0f0ac29dc4e440e785408fa1dfedce5e and project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:08:51.497612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6d1904ff-b2da-40cd-b47e-159cefc0e086 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:08:51.497612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6d1904ff-b2da-40cd-b47e-159cefc0e086 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:08:51.553030 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f1a10dcc-0f20-431f-bf63-45ff1259a232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674092 Oct 04 21:08:51.554078 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 438/867] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:08:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:08:51.558671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-84d1e536-0186-4706-91a3-0ccf86b42f89 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:51.559287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-84d1e536-0186-4706-91a3-0ccf86b42f89 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:51.567022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84d1e536-0186-4706-91a3-0ccf86b42f89 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:51.567659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84d1e536-0186-4706-91a3-0ccf86b42f89 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:51.568081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84d1e536-0186-4706-91a3-0ccf86b42f89 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:51.568786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84d1e536-0186-4706-91a3-0ccf86b42f89 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:51.569245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84d1e536-0186-4706-91a3-0ccf86b42f89 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:51.569698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84d1e536-0186-4706-91a3-0ccf86b42f89 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:51.669221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-84d1e536-0186-4706-91a3-0ccf86b42f89 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:51.696188 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-84d1e536-0186-4706-91a3-0ccf86b42f89 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.140595 Oct 04 21:08:51.698030 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 439/868] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:51 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:51.710512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1de481d2-4363-4cf1-ae4a-d85c7b97ff67 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:51.716260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1de481d2-4363-4cf1-ae4a-d85c7b97ff67 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:51.730227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1de481d2-4363-4cf1-ae4a-d85c7b97ff67 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:51.730625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1de481d2-4363-4cf1-ae4a-d85c7b97ff67 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:51.731123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1de481d2-4363-4cf1-ae4a-d85c7b97ff67 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:51.731802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1de481d2-4363-4cf1-ae4a-d85c7b97ff67 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:51.732597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1de481d2-4363-4cf1-ae4a-d85c7b97ff67 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:51.733243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1de481d2-4363-4cf1-ae4a-d85c7b97ff67 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:51.740537 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6d1904ff-b2da-40cd-b47e-159cefc0e086 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665371 Oct 04 21:08:51.741211 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 430/869] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:08:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:08:51.747564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cd8e18e0-2efa-467b-9ca6-01ad4f35f182 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:51.748901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cd8e18e0-2efa-467b-9ca6-01ad4f35f182 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:51.858954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cd8e18e0-2efa-467b-9ca6-01ad4f35f182 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:51.897703 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cd8e18e0-2efa-467b-9ca6-01ad4f35f182 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1213 microversion: 2.1 time: 0.127174 Oct 04 21:08:51.897703 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 431/870] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:51 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:51.897703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e1d22374-ea2e-4099-b69a-84bf7db421da tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:51.897703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e1d22374-ea2e-4099-b69a-84bf7db421da tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:51.939090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1de481d2-4363-4cf1-ae4a-d85c7b97ff67 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:51.948905 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1de481d2-4363-4cf1-ae4a-d85c7b97ff67 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1357 microversion: 2.1 time: 0.249517 Oct 04 21:08:51.949514 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 440/871] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:51 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:51.954094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4fc41b35-a992-445f-9786-0bbb83526133 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:51.962917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4fc41b35-a992-445f-9786-0bbb83526133 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:51.978726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fc41b35-a992-445f-9786-0bbb83526133 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:51.979572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fc41b35-a992-445f-9786-0bbb83526133 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:51.980018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fc41b35-a992-445f-9786-0bbb83526133 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:51.985238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e1d22374-ea2e-4099-b69a-84bf7db421da tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:51.989347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fc41b35-a992-445f-9786-0bbb83526133 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:51.989870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fc41b35-a992-445f-9786-0bbb83526133 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:51.993575 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e1d22374-ea2e-4099-b69a-84bf7db421da tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 200 len: 1216 microversion: 2.1 time: 0.121391 Oct 04 21:08:51.994535 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 432/872] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:51 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 1216 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:52.009818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fc41b35-a992-445f-9786-0bbb83526133 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:52.095976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1118148e-0b59-4aba-b7b5-daea897e540e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:52.097086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1118148e-0b59-4aba-b7b5-daea897e540e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:52.104290 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1118148e-0b59-4aba-b7b5-daea897e540e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:52.105708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1118148e-0b59-4aba-b7b5-daea897e540e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:52.106323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1118148e-0b59-4aba-b7b5-daea897e540e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:52.108423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1118148e-0b59-4aba-b7b5-daea897e540e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:52.109071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1118148e-0b59-4aba-b7b5-daea897e540e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:52.109706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1118148e-0b59-4aba-b7b5-daea897e540e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:52.195770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1118148e-0b59-4aba-b7b5-daea897e540e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:52.205358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1118148e-0b59-4aba-b7b5-daea897e540e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:52.206996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1118148e-0b59-4aba-b7b5-daea897e540e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:52.212377 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1118148e-0b59-4aba-b7b5-daea897e540e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.123942 Oct 04 21:08:52.213044 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 433/873] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:52 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:52.218344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4fc41b35-a992-445f-9786-0bbb83526133 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:52.227215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4fc41b35-a992-445f-9786-0bbb83526133 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:52.228906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4fc41b35-a992-445f-9786-0bbb83526133 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:52.230406 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4fc41b35-a992-445f-9786-0bbb83526133 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1411 microversion: 2.25 time: 0.279909 Oct 04 21:08:52.233509 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 441/874] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:51 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1411 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:52.728350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5c76efd9-a258-41a5-9219-c9c768a8da0b tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:52.728977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5c76efd9-a258-41a5-9219-c9c768a8da0b tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:52.738672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c76efd9-a258-41a5-9219-c9c768a8da0b tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:52.740788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c76efd9-a258-41a5-9219-c9c768a8da0b tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:52.740788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c76efd9-a258-41a5-9219-c9c768a8da0b tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:52.740788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c76efd9-a258-41a5-9219-c9c768a8da0b tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:52.740788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c76efd9-a258-41a5-9219-c9c768a8da0b tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:52.741665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c76efd9-a258-41a5-9219-c9c768a8da0b tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:52.816713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-5c76efd9-a258-41a5-9219-c9c768a8da0b tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:52.833484 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5c76efd9-a258-41a5-9219-c9c768a8da0b tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.108722 Oct 04 21:08:52.834106 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 434/875] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:52 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:52.903413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6660df8e-10d9-4bbb-b59b-13f1d0303388 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:52.904741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6660df8e-10d9-4bbb-b59b-13f1d0303388 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:52.960668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6660df8e-10d9-4bbb-b59b-13f1d0303388 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:52.968015 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6660df8e-10d9-4bbb-b59b-13f1d0303388 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1213 microversion: 2.1 time: 0.068349 Oct 04 21:08:52.968706 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 442/876] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:52 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:52.998578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5b3740ed-f0c5-4ebf-a53b-12590e49fca0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:52.998578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5b3740ed-f0c5-4ebf-a53b-12590e49fca0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:52.998578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:52.998578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b3740ed-f0c5-4ebf-a53b-12590e49fca0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:52.998578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b3740ed-f0c5-4ebf-a53b-12590e49fca0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:52.998578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b3740ed-f0c5-4ebf-a53b-12590e49fca0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:52.998578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b3740ed-f0c5-4ebf-a53b-12590e49fca0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:52.998578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b3740ed-f0c5-4ebf-a53b-12590e49fca0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:52.998578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b3740ed-f0c5-4ebf-a53b-12590e49fca0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:53.022592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a9d33220-17f2-467e-b18f-f82e8773ba75 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:53.023206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a9d33220-17f2-467e-b18f-f82e8773ba75 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:53.095740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a9d33220-17f2-467e-b18f-f82e8773ba75 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:53.102942 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a9d33220-17f2-467e-b18f-f82e8773ba75 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 200 len: 1216 microversion: 2.1 time: 0.084465 Oct 04 21:08:53.103918 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 443/877] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:53 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:53.157343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5b3740ed-f0c5-4ebf-a53b-12590e49fca0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:53.160889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:53.166822 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5b3740ed-f0c5-4ebf-a53b-12590e49fca0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1540 microversion: 2.1 time: 0.195198 Oct 04 21:08:53.167417 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 435/878] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:52 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1540 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:53.195776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9a830a22-96c8-450c-8257-83f50ab9f910 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:53.196542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9a830a22-96c8-450c-8257-83f50ab9f910 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:53.202786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a830a22-96c8-450c-8257-83f50ab9f910 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:53.211350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a830a22-96c8-450c-8257-83f50ab9f910 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:53.211350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a830a22-96c8-450c-8257-83f50ab9f910 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:53.211350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a830a22-96c8-450c-8257-83f50ab9f910 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:53.211350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a830a22-96c8-450c-8257-83f50ab9f910 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:53.211350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a830a22-96c8-450c-8257-83f50ab9f910 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:53.261588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3ae833e3-057c-492d-a234-343d43d6c682 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:53.262559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3ae833e3-057c-492d-a234-343d43d6c682 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:53.272363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ae833e3-057c-492d-a234-343d43d6c682 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:53.272852 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ae833e3-057c-492d-a234-343d43d6c682 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:53.273295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ae833e3-057c-492d-a234-343d43d6c682 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:53.288334 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9a830a22-96c8-450c-8257-83f50ab9f910 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096557 Oct 04 21:08:53.288632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ae833e3-057c-492d-a234-343d43d6c682 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:53.289099 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 444/879] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:08:53 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:53.289237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ae833e3-057c-492d-a234-343d43d6c682 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:53.289710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ae833e3-057c-492d-a234-343d43d6c682 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:53.302326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b3267df9-b163-487d-94e8-4e3bff4a79b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:53.303188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b3267df9-b163-487d-94e8-4e3bff4a79b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:53.312242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3267df9-b163-487d-94e8-4e3bff4a79b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:53.312855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3267df9-b163-487d-94e8-4e3bff4a79b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:53.313570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3267df9-b163-487d-94e8-4e3bff4a79b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:53.326199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3267df9-b163-487d-94e8-4e3bff4a79b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:53.326199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3267df9-b163-487d-94e8-4e3bff4a79b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:53.326199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3267df9-b163-487d-94e8-4e3bff4a79b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:53.396809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3ae833e3-057c-492d-a234-343d43d6c682 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:53.406544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3ae833e3-057c-492d-a234-343d43d6c682 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:53.408091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3ae833e3-057c-492d-a234-343d43d6c682 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:53.418666 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3ae833e3-057c-492d-a234-343d43d6c682 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.179451 Oct 04 21:08:53.420215 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 436/880] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:53 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:53.617471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5c864f18-9c52-4754-a5b2-0974f3a6cd09 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1202091578", "id": 2021176263, "os-flavor-access:is_public": "False"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:53.618177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b3267df9-b163-487d-94e8-4e3bff4a79b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:53.627704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b3267df9-b163-487d-94e8-4e3bff4a79b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:53.629152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b3267df9-b163-487d-94e8-4e3bff4a79b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:53.630492 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b3267df9-b163-487d-94e8-4e3bff4a79b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1411 microversion: 2.25 time: 0.340341 Oct 04 21:08:53.631056 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 445/881] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:53 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1411 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:53.790821 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5c864f18-9c52-4754-a5b2-0974f3a6cd09 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.369040 Oct 04 21:08:53.791431 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 437/882] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:08:53 2022] POST /compute/v2.1/flavors => generated 439 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:53.805326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-701ff2d7-2a7c-47e0-8cd8-25261e590c48 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "10d69e8c4cc5453197a75fca840ad4e4"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:53.881639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7ddd8d6a-83af-4667-b91d-33e72cd497e8 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:53.882269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7ddd8d6a-83af-4667-b91d-33e72cd497e8 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:53.890648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ddd8d6a-83af-4667-b91d-33e72cd497e8 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:53.891376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ddd8d6a-83af-4667-b91d-33e72cd497e8 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:53.892021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ddd8d6a-83af-4667-b91d-33e72cd497e8 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:53.892895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ddd8d6a-83af-4667-b91d-33e72cd497e8 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:53.893643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ddd8d6a-83af-4667-b91d-33e72cd497e8 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:53.894426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ddd8d6a-83af-4667-b91d-33e72cd497e8 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:53.969646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-7ddd8d6a-83af-4667-b91d-33e72cd497e8 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:53.979923 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-701ff2d7-2a7c-47e0-8cd8-25261e590c48 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/2021176263/action" status: 200 len: 97 microversion: 2.1 time: 0.178316 Oct 04 21:08:53.981756 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 446/883] 10.222.0.30 () {60 vars in 1200 bytes} [Tue Oct 4 21:08:53 2022] POST /compute/v2.1/flavors/2021176263/action => generated 97 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:08:53.986519 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7ddd8d6a-83af-4667-b91d-33e72cd497e8 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.121044 Oct 04 21:08:53.987107 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 438/884] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:53 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:53.991560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-73c947df-a707-472d-a4e6-4b9cfb0e4876 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "10d69e8c4cc5453197a75fca840ad4e4"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:53.991742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fae5c4b4-d5d7-42cd-b475-9ccfa8a68d29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:53.992171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fae5c4b4-d5d7-42cd-b475-9ccfa8a68d29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:53.998377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fae5c4b4-d5d7-42cd-b475-9ccfa8a68d29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:53.998865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fae5c4b4-d5d7-42cd-b475-9ccfa8a68d29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:53.999344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fae5c4b4-d5d7-42cd-b475-9ccfa8a68d29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:54.000076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fae5c4b4-d5d7-42cd-b475-9ccfa8a68d29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:54.001617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fae5c4b4-d5d7-42cd-b475-9ccfa8a68d29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:54.002166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fae5c4b4-d5d7-42cd-b475-9ccfa8a68d29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:54.057032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:54.083402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fae5c4b4-d5d7-42cd-b475-9ccfa8a68d29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:54.091021 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fae5c4b4-d5d7-42cd-b475-9ccfa8a68d29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1265 microversion: 2.1 time: 0.102934 Oct 04 21:08:54.091796 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 439/885] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:53 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:54.116573 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-73c947df-a707-472d-a4e6-4b9cfb0e4876 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] HTTP exception thrown: Flavor access already exists for flavor 34 and project 10d69e8c4cc5453197a75fca840ad4e4 combination. Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-73c947df-a707-472d-a4e6-4b9cfb0e4876 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Request method failure captured: Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/flavors/2021176263/action HTTP/1.1 Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 67 Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKDk8yzp9S4hEnUg_xXFk9YHJLIKIQm91viRnYQX1Ba0nUiIvQGll7H0WbGSbl271gVBkFCVHDEW5FaJPFvBJzH4t2zQzV_5VKz7usJ2En6gBUrYNkcnlxVHbVgW-9G4RSw1YE92tnAHb5Ee-Jf34-mrIEuU6RSS8jKmouDmOIW2lE0 Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: fbb7fb438b674ea4bfafa7f2ef7c0a50 Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1348214912 Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb7fb438b674ea4bfafa7f2ef7c0a50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbb7fb438b674ea4bfafa7f2ef7c0a50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbb7fb438b674ea4bfafa7f2ef7c0a50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb7fb438b674ea4bfafa7f2ef7c0a50"}]}] Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1348214912 Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: fbb7fb438b674ea4bfafa7f2ef7c0a50 Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1348214912 Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 01ef70f7cec847d998e9fe0d212a5db9 Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: {"addTenantAccess": {"tenant": "10d69e8c4cc5453197a75fca840ad4e4"}} Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: exception: Flavor access already exists for flavor 34 and project 10d69e8c4cc5453197a75fca840ad4e4 combination. Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '2021176263', 'body': {'addTenantAccess': {'tenant': '10d69e8c4cc5453197a75fca840ad4e4'}}} Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result.read() Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '34-10d69e8c4cc5453197a75fca840ad4e4' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:54.128182 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result.read() Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 21:08:54.134992 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '34-10d69e8c4cc5453197a75fca840ad4e4' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 21, 8, 54, 58035), 'updated_at': None, 'flavor_id': 34, 'project_id': '10d69e8c4cc5453197a75fca840ad4e4'}] Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 34 and project 10d69e8c4cc5453197a75fca840ad4e4 combination. Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 34 and project 10d69e8c4cc5453197a75fca840ad4e4 combination. Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 34 and project 10d69e8c4cc5453197a75fca840ad4e4 combination. Oct 04 21:08:54.140760 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:08:54.147379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-09471101-4f6a-425f-acb3-8adb860e7f6e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:54.147718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-73c947df-a707-472d-a4e6-4b9cfb0e4876 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Returning 409 to user: Flavor access already exists for flavor 34 and project 10d69e8c4cc5453197a75fca840ad4e4 combination. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:08:54.147920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-09471101-4f6a-425f-acb3-8adb860e7f6e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:54.148087 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-73c947df-a707-472d-a4e6-4b9cfb0e4876 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/2021176263/action" status: 409 len: 152 microversion: 2.1 time: 0.142256 Oct 04 21:08:54.148087 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 447/886] 10.222.0.30 () {60 vars in 1200 bytes} [Tue Oct 4 21:08:53 2022] POST /compute/v2.1/flavors/2021176263/action => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:08:54.148087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4c8f15c6-cd64-443b-b746-bd4ab34d8a3f tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "10d69e8c4cc5453197a75fca840ad4e4"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:54.148712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09471101-4f6a-425f-acb3-8adb860e7f6e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:54.148712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09471101-4f6a-425f-acb3-8adb860e7f6e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:54.148712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09471101-4f6a-425f-acb3-8adb860e7f6e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:54.148712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09471101-4f6a-425f-acb3-8adb860e7f6e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:54.148712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09471101-4f6a-425f-acb3-8adb860e7f6e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:54.148712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09471101-4f6a-425f-acb3-8adb860e7f6e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:54.224008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-09471101-4f6a-425f-acb3-8adb860e7f6e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:54.231858 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-09471101-4f6a-425f-acb3-8adb860e7f6e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 200 len: 1212 microversion: 2.1 time: 0.107868 Oct 04 21:08:54.232483 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 440/887] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:54 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 1212 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:54.324573 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4c8f15c6-cd64-443b-b746-bd4ab34d8a3f tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/2021176263/action" status: 200 len: 21 microversion: 2.1 time: 0.188293 Oct 04 21:08:54.325262 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 448/888] 10.222.0.30 () {60 vars in 1200 bytes} [Tue Oct 4 21:08:54 2022] POST /compute/v2.1/flavors/2021176263/action => generated 21 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:08:54.338501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-43ae16ab-5dff-4994-847e-c66d5aed7a1f tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:54.448679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9f604577-6215-4bc0-a286-144e2e5d0e9f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:54.449616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9f604577-6215-4bc0-a286-144e2e5d0e9f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:54.456769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f604577-6215-4bc0-a286-144e2e5d0e9f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:54.460728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f604577-6215-4bc0-a286-144e2e5d0e9f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:54.460728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f604577-6215-4bc0-a286-144e2e5d0e9f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:54.460728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f604577-6215-4bc0-a286-144e2e5d0e9f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:54.460728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f604577-6215-4bc0-a286-144e2e5d0e9f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:54.460728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f604577-6215-4bc0-a286-144e2e5d0e9f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:54.772261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9f604577-6215-4bc0-a286-144e2e5d0e9f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:54.780631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9f604577-6215-4bc0-a286-144e2e5d0e9f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:54.782254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9f604577-6215-4bc0-a286-144e2e5d0e9f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:54.788960 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9f604577-6215-4bc0-a286-144e2e5d0e9f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.344733 Oct 04 21:08:54.789844 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 449/889] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:54 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:54.794254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-282938fa-aecd-4046-b3df-6bae9823c5bd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:54.794892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-282938fa-aecd-4046-b3df-6bae9823c5bd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:54.801178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-282938fa-aecd-4046-b3df-6bae9823c5bd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:54.801760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-282938fa-aecd-4046-b3df-6bae9823c5bd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:54.802602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-282938fa-aecd-4046-b3df-6bae9823c5bd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:54.802941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-282938fa-aecd-4046-b3df-6bae9823c5bd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:54.803411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-282938fa-aecd-4046-b3df-6bae9823c5bd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:54.804040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-282938fa-aecd-4046-b3df-6bae9823c5bd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:54.865052 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-43ae16ab-5dff-4994-847e-c66d5aed7a1f tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/2021176263" status: 202 len: 0 microversion: 2.1 time: 0.533038 Oct 04 21:08:54.873251 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 441/890] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Oct 4 21:08:54 2022] DELETE /compute/v2.1/flavors/2021176263 => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:08:54.873251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-0c497ee8-ff9a-420a-bc9b-c99f94972c3b req-bfc26824-910e-4c84-a3ac-0d7f0efd8526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf618d0-9d79-435c-ac4f-636ac63dbbda", "tag": "dd232c2f-36a6-4a3c-93d1-396a660ea091"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:54.883199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0c497ee8-ff9a-420a-bc9b-c99f94972c3b req-bfc26824-910e-4c84-a3ac-0d7f0efd8526 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:54.883684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0c497ee8-ff9a-420a-bc9b-c99f94972c3b req-bfc26824-910e-4c84-a3ac-0d7f0efd8526 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:54.884115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0c497ee8-ff9a-420a-bc9b-c99f94972c3b req-bfc26824-910e-4c84-a3ac-0d7f0efd8526 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:54.899256 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-0c497ee8-ff9a-420a-bc9b-c99f94972c3b req-bfc26824-910e-4c84-a3ac-0d7f0efd8526 service nova] Creating event network-changed:dd232c2f-36a6-4a3c-93d1-396a660ea091 for instance fcf618d0-9d79-435c-ac4f-636ac63dbbda on n-h2-860282-1 Oct 04 21:08:54.904729 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-0c497ee8-ff9a-420a-bc9b-c99f94972c3b req-bfc26824-910e-4c84-a3ac-0d7f0efd8526 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037376 Oct 04 21:08:54.905924 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 442/891] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:54.910966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9ae4f596-34fb-4f66-9646-2fb3980762d7 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:54.943106 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9ae4f596-34fb-4f66-9646-2fb3980762d7 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035980 Oct 04 21:08:54.943657 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 443/892] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:08:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:54.958475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-282938fa-aecd-4046-b3df-6bae9823c5bd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:54.965761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fa41a1d6-5301-4dff-b979-9ccb65672237 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-957416355", "id": 1574152231, "os-flavor-access:is_public": "True"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:54.970965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-282938fa-aecd-4046-b3df-6bae9823c5bd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:54.972459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-282938fa-aecd-4046-b3df-6bae9823c5bd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:54.973888 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-282938fa-aecd-4046-b3df-6bae9823c5bd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1411 microversion: 2.25 time: 0.182976 Oct 04 21:08:54.974468 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 450/893] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:54 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1411 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:55.015795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9014e0b9-3c3a-4dba-9dc3-ab653ebc9c41 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:55.016497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9014e0b9-3c3a-4dba-9dc3-ab653ebc9c41 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:55.022680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9014e0b9-3c3a-4dba-9dc3-ab653ebc9c41 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:55.023009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9014e0b9-3c3a-4dba-9dc3-ab653ebc9c41 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:55.023453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9014e0b9-3c3a-4dba-9dc3-ab653ebc9c41 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:55.024159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9014e0b9-3c3a-4dba-9dc3-ab653ebc9c41 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:55.024611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9014e0b9-3c3a-4dba-9dc3-ab653ebc9c41 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:55.025219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9014e0b9-3c3a-4dba-9dc3-ab653ebc9c41 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:55.078133 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fa41a1d6-5301-4dff-b979-9ccb65672237 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.116015 Oct 04 21:08:55.087074 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 444/894] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:08:54 2022] POST /compute/v2.1/flavors => generated 437 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:08:55.100781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d058a242-1550-4728-947b-e66b587943e3 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:55.109815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-9014e0b9-3c3a-4dba-9dc3-ab653ebc9c41 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:55.114956 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-d058a242-1550-4728-947b-e66b587943e3 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d058a242-1550-4728-947b-e66b587943e3 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Request method failure captured: Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/flavors/1574152231/os-flavor-access HTTP/1.1 Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKDk8yzp9S4hEnUg_xXFk9YHJLIKIQm91viRnYQX1Ba0nUiIvQGll7H0WbGSbl271gVBkFCVHDEW5FaJPFvBJzH4t2zQzV_5VKz7usJ2En6gBUrYNkcnlxVHbVgW-9G4RSw1YE92tnAHb5Ee-Jf34-mrIEuU6RSS8jKmouDmOIW2lE0 Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fbb7fb438b674ea4bfafa7f2ef7c0a50 Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1348214912 Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb7fb438b674ea4bfafa7f2ef7c0a50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbb7fb438b674ea4bfafa7f2ef7c0a50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbb7fb438b674ea4bfafa7f2ef7c0a50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb7fb438b674ea4bfafa7f2ef7c0a50"}]}] Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1348214912 Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fbb7fb438b674ea4bfafa7f2ef7c0a50 Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1348214912 Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 01ef70f7cec847d998e9fe0d212a5db9 Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: exception: Access list not available for public flavors. Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'flavor_id': '1574152231'} Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 04 21:08:55.116706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:55.127340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d058a242-1550-4728-947b-e66b587943e3 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:08:55.127340 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d058a242-1550-4728-947b-e66b587943e3 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1574152231/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.027845 Oct 04 21:08:55.127340 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 445/895] 10.222.0.30 () {58 vars in 1209 bytes} [Tue Oct 4 21:08:55 2022] GET /compute/v2.1/flavors/1574152231/os-flavor-access => generated 91 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:08:55.138014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d0ab9a58-8e47-432c-8d42-a5c42be6cbde tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:55.140332 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9014e0b9-3c3a-4dba-9dc3-ab653ebc9c41 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1927 microversion: 2.75 time: 0.129085 Oct 04 21:08:55.144351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d0ab9a58-8e47-432c-8d42-a5c42be6cbde tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:55.152401 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 451/896] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:55 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1927 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:55.166290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b11933b8-880d-42fb-9263-01c90b22b95e tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:55.166445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0ab9a58-8e47-432c-8d42-a5c42be6cbde tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:55.166995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0ab9a58-8e47-432c-8d42-a5c42be6cbde tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:55.167439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0ab9a58-8e47-432c-8d42-a5c42be6cbde tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:55.168158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0ab9a58-8e47-432c-8d42-a5c42be6cbde tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:55.170041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0ab9a58-8e47-432c-8d42-a5c42be6cbde tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:55.172734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0ab9a58-8e47-432c-8d42-a5c42be6cbde tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:55.250095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d0ab9a58-8e47-432c-8d42-a5c42be6cbde tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:55.263103 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d0ab9a58-8e47-432c-8d42-a5c42be6cbde tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1265 microversion: 2.1 time: 0.138680 Oct 04 21:08:55.264914 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 446/897] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:55 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:55.269877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-33d4f421-03ac-4cd4-b177-e1b78e2b5e09 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:55.270527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-33d4f421-03ac-4cd4-b177-e1b78e2b5e09 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:55.281727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33d4f421-03ac-4cd4-b177-e1b78e2b5e09 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:55.286671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33d4f421-03ac-4cd4-b177-e1b78e2b5e09 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:55.287203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33d4f421-03ac-4cd4-b177-e1b78e2b5e09 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:55.288020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33d4f421-03ac-4cd4-b177-e1b78e2b5e09 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:55.288565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33d4f421-03ac-4cd4-b177-e1b78e2b5e09 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:55.289069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33d4f421-03ac-4cd4-b177-e1b78e2b5e09 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:55.316713 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b11933b8-880d-42fb-9263-01c90b22b95e tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1574152231" status: 202 len: 0 microversion: 2.1 time: 0.157781 Oct 04 21:08:55.316713 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 452/898] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Oct 4 21:08:55 2022] DELETE /compute/v2.1/flavors/1574152231 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:08:55.324292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c500d83c-9709-427f-a8f1-6bd1978d01f8 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:55.384711 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c500d83c-9709-427f-a8f1-6bd1978d01f8 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064380 Oct 04 21:08:55.384988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-33d4f421-03ac-4cd4-b177-e1b78e2b5e09 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:55.393588 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-33d4f421-03ac-4cd4-b177-e1b78e2b5e09 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 200 len: 1212 microversion: 2.1 time: 0.127340 Oct 04 21:08:55.400397 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 453/899] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:08:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:55.406487 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 447/900] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:55 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 1212 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:55.411905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3dedffa1-1c62-408a-b6d4-0b203a5ada0b tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1387933782", "id": 767778599, "os-flavor-access:is_public": "False"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:55.549194 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3dedffa1-1c62-408a-b6d4-0b203a5ada0b tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.141769 Oct 04 21:08:55.550213 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 454/901] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:08:55 2022] POST /compute/v2.1/flavors => generated 436 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:08:55.687631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ac0d5853-e25f-4114-a509-d9af99ec029a tempest-FlavorsAccessNegativeTestJSON-689335970 tempest-FlavorsAccessNegativeTestJSON-689335970-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "10d69e8c4cc5453197a75fca840ad4e4"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:55.693029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ac0d5853-e25f-4114-a509-d9af99ec029a tempest-FlavorsAccessNegativeTestJSON-689335970 tempest-FlavorsAccessNegativeTestJSON-689335970-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '916731d4cfbc4dfeabff54a0944956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d69e8c4cc5453197a75fca840ad4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ac0d5853-e25f-4114-a509-d9af99ec029a tempest-FlavorsAccessNegativeTestJSON-689335970 tempest-FlavorsAccessNegativeTestJSON-689335970-project] Request method failure captured: Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/flavors/767778599/action HTTP/1.1 Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 67 Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKDiGtS6Ql1VdhGrJrOYhiVzevJkHuIHS7SdxSPd-8GviBzYu-A01p-JBTrdTRolQEZczX3AGoZ-br1Bk3u8PVDR2e6tA6EGkPARqBK8-DNGPBCWREDTgi5CnE2I3-oLVdjyK--HSlTC35lCmJtA939IJnbILuHnKDEuYikuPJR09ic Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 10d69e8c4cc5453197a75fca840ad4e4 Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-689335970 Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10d69e8c4cc5453197a75fca840ad4e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10d69e8c4cc5453197a75fca840ad4e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10d69e8c4cc5453197a75fca840ad4e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10d69e8c4cc5453197a75fca840ad4e4"}]}] Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-689335970 Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 10d69e8c4cc5453197a75fca840ad4e4 Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-689335970 Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-FlavorsAccessNegativeTestJSON-689335970-project Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 916731d4cfbc4dfeabff54a0944956b5 Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-689335970-project Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: {"addTenantAccess": {"tenant": "10d69e8c4cc5453197a75fca840ad4e4"}} Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '767778599', 'body': {'addTenantAccess': {'tenant': '10d69e8c4cc5453197a75fca840ad4e4'}}} Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:08:55.694738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 21:08:55.699724 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:55.699724 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:55.699724 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:55.699724 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:55.699724 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:55.699724 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:55.699724 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:08:55.699724 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:08:55.699724 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 21:08:55.699724 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:55.699724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ac0d5853-e25f-4114-a509-d9af99ec029a tempest-FlavorsAccessNegativeTestJSON-689335970 tempest-FlavorsAccessNegativeTestJSON-689335970-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:08:55.699724 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ac0d5853-e25f-4114-a509-d9af99ec029a tempest-FlavorsAccessNegativeTestJSON-689335970 tempest-FlavorsAccessNegativeTestJSON-689335970-project] 10.222.0.30 "POST /compute/v2.1/flavors/767778599/action" status: 403 len: 130 microversion: 2.1 time: 0.137508 Oct 04 21:08:55.702393 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 448/902] 10.222.0.30 () {60 vars in 1197 bytes} [Tue Oct 4 21:08:55 2022] POST /compute/v2.1/flavors/767778599/action => generated 130 bytes in 144 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:08:55.707809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5c846012-7f57-4751-853d-0f9d29ea88f8 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:55.821766 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5c846012-7f57-4751-853d-0f9d29ea88f8 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/767778599" status: 202 len: 0 microversion: 2.1 time: 0.117677 Oct 04 21:08:55.822345 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 455/903] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Oct 4 21:08:55 2022] DELETE /compute/v2.1/flavors/767778599 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:08:55.822547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-88740376-5b5f-4752-8543-89ff1ad87104 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:55.823369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-88740376-5b5f-4752-8543-89ff1ad87104 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:55.831422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5dc2103a-c448-47a9-b5d5-5fd24ce517b9 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:55.842912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88740376-5b5f-4752-8543-89ff1ad87104 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:55.843658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88740376-5b5f-4752-8543-89ff1ad87104 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:55.844292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88740376-5b5f-4752-8543-89ff1ad87104 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:55.845222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88740376-5b5f-4752-8543-89ff1ad87104 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:55.846051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88740376-5b5f-4752-8543-89ff1ad87104 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:55.846496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88740376-5b5f-4752-8543-89ff1ad87104 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:55.855178 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5dc2103a-c448-47a9-b5d5-5fd24ce517b9 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026322 Oct 04 21:08:55.855178 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 456/904] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:08:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:55.876906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f5ba4fcc-fc27-4201-897a-0a2ffb560963 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-144263234", "id": 319854031, "os-flavor-access:is_public": "False"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:55.931365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-88740376-5b5f-4752-8543-89ff1ad87104 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:55.940597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-88740376-5b5f-4752-8543-89ff1ad87104 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:55.942167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-88740376-5b5f-4752-8543-89ff1ad87104 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:55.947247 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-88740376-5b5f-4752-8543-89ff1ad87104 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.129529 Oct 04 21:08:55.947818 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 449/905] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:55 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:56.018261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-79ce32dc-4df1-4598-ad2e-ea346289b166 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:56.018261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-79ce32dc-4df1-4598-ad2e-ea346289b166 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:56.018261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79ce32dc-4df1-4598-ad2e-ea346289b166 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:56.018261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79ce32dc-4df1-4598-ad2e-ea346289b166 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:56.018261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79ce32dc-4df1-4598-ad2e-ea346289b166 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:56.018261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79ce32dc-4df1-4598-ad2e-ea346289b166 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:56.018261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79ce32dc-4df1-4598-ad2e-ea346289b166 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:56.018261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79ce32dc-4df1-4598-ad2e-ea346289b166 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:56.114037 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f5ba4fcc-fc27-4201-897a-0a2ffb560963 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.241305 Oct 04 21:08:56.115703 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 457/906] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:08:55 2022] POST /compute/v2.1/flavors => generated 435 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:56.129789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa8a011f-b615-4326-987f-556a77d5f53d tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "10d69e8c4cc5453197a75fca840ad4e4"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:56.259891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-79ce32dc-4df1-4598-ad2e-ea346289b166 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:56.268907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-79ce32dc-4df1-4598-ad2e-ea346289b166 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:56.270725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-79ce32dc-4df1-4598-ad2e-ea346289b166 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:56.275279 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-79ce32dc-4df1-4598-ad2e-ea346289b166 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1411 microversion: 2.25 time: 0.274830 Oct 04 21:08:56.275279 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 450/907] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:55 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1411 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:56.276764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a5907b2e-9941-4536-aacd-b3d74eecebee tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:56.277607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a5907b2e-9941-4536-aacd-b3d74eecebee tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:56.288433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5907b2e-9941-4536-aacd-b3d74eecebee tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:56.288972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5907b2e-9941-4536-aacd-b3d74eecebee tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:56.289433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5907b2e-9941-4536-aacd-b3d74eecebee tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:56.290175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5907b2e-9941-4536-aacd-b3d74eecebee tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:56.290650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5907b2e-9941-4536-aacd-b3d74eecebee tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:56.291074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5907b2e-9941-4536-aacd-b3d74eecebee tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:56.381039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-a5907b2e-9941-4536-aacd-b3d74eecebee tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:56.388057 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aa8a011f-b615-4326-987f-556a77d5f53d tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/319854031/action" status: 200 len: 96 microversion: 2.1 time: 0.256010 Oct 04 21:08:56.388057 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 458/908] 10.222.0.30 () {60 vars in 1197 bytes} [Tue Oct 4 21:08:56 2022] POST /compute/v2.1/flavors/319854031/action => generated 96 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:08:56.388057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7710399e-3557-4f9b-bf96-293891dc5d1f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:56.388057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7710399e-3557-4f9b-bf96-293891dc5d1f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:56.393647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7710399e-3557-4f9b-bf96-293891dc5d1f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:56.394144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7710399e-3557-4f9b-bf96-293891dc5d1f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:56.394589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7710399e-3557-4f9b-bf96-293891dc5d1f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:56.395291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7710399e-3557-4f9b-bf96-293891dc5d1f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:56.395749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7710399e-3557-4f9b-bf96-293891dc5d1f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:56.396226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7710399e-3557-4f9b-bf96-293891dc5d1f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:56.399599 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a5907b2e-9941-4536-aacd-b3d74eecebee tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1933 microversion: 2.75 time: 0.126192 Oct 04 21:08:56.400182 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 451/909] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:56 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1933 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:56.405384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c7301954-ce51-4d72-a0c1-8f66e9f2f8dd tempest-FlavorsAccessNegativeTestJSON-689335970 tempest-FlavorsAccessNegativeTestJSON-689335970-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "10d69e8c4cc5453197a75fca840ad4e4"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:56.408671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c7301954-ce51-4d72-a0c1-8f66e9f2f8dd tempest-FlavorsAccessNegativeTestJSON-689335970 tempest-FlavorsAccessNegativeTestJSON-689335970-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '916731d4cfbc4dfeabff54a0944956b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d69e8c4cc5453197a75fca840ad4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c7301954-ce51-4d72-a0c1-8f66e9f2f8dd tempest-FlavorsAccessNegativeTestJSON-689335970 tempest-FlavorsAccessNegativeTestJSON-689335970-project] Request method failure captured: Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/flavors/319854031/action HTTP/1.1 Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 70 Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKDiGtS6Ql1VdhGrJrOYhiVzevJkHuIHS7SdxSPd-8GviBzYu-A01p-JBTrdTRolQEZczX3AGoZ-br1Bk3u8PVDR2e6tA6EGkPARqBK8-DNGPBCWREDTgi5CnE2I3-oLVdjyK--HSlTC35lCmJtA939IJnbILuHnKDEuYikuPJR09ic Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 10d69e8c4cc5453197a75fca840ad4e4 Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-689335970 Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10d69e8c4cc5453197a75fca840ad4e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10d69e8c4cc5453197a75fca840ad4e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10d69e8c4cc5453197a75fca840ad4e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10d69e8c4cc5453197a75fca840ad4e4"}]}] Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-689335970 Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 10d69e8c4cc5453197a75fca840ad4e4 Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-689335970 Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-FlavorsAccessNegativeTestJSON-689335970-project Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 916731d4cfbc4dfeabff54a0944956b5 Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-689335970-project Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: {"removeTenantAccess": {"tenant": "10d69e8c4cc5453197a75fca840ad4e4"}} Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '319854031', 'body': {'removeTenantAccess': {'tenant': '10d69e8c4cc5453197a75fca840ad4e4'}}} Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can( Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 21:08:56.411127 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:56.418991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:56.418991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:56.418991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:56.418991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:56.418991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:56.418991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:08:56.418991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:08:56.418991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 21:08:56.418991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:56.418991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c7301954-ce51-4d72-a0c1-8f66e9f2f8dd tempest-FlavorsAccessNegativeTestJSON-689335970 tempest-FlavorsAccessNegativeTestJSON-689335970-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:08:56.418991 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c7301954-ce51-4d72-a0c1-8f66e9f2f8dd tempest-FlavorsAccessNegativeTestJSON-689335970 tempest-FlavorsAccessNegativeTestJSON-689335970-project] 10.222.0.30 "POST /compute/v2.1/flavors/319854031/action" status: 403 len: 133 microversion: 2.1 time: 0.011606 Oct 04 21:08:56.418991 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 452/910] 10.222.0.30 () {60 vars in 1197 bytes} [Tue Oct 4 21:08:56 2022] POST /compute/v2.1/flavors/319854031/action => generated 133 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:08:56.422759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ef7e1c7f-3225-4e1e-948e-09fbdd726336 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:56.423373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ef7e1c7f-3225-4e1e-948e-09fbdd726336 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:56.430151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef7e1c7f-3225-4e1e-948e-09fbdd726336 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:56.430664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef7e1c7f-3225-4e1e-948e-09fbdd726336 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:56.431296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef7e1c7f-3225-4e1e-948e-09fbdd726336 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:56.431994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef7e1c7f-3225-4e1e-948e-09fbdd726336 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:56.432448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef7e1c7f-3225-4e1e-948e-09fbdd726336 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:56.432905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef7e1c7f-3225-4e1e-948e-09fbdd726336 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:56.469630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7710399e-3557-4f9b-bf96-293891dc5d1f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:56.478562 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7710399e-3557-4f9b-bf96-293891dc5d1f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1273 microversion: 2.1 time: 0.095330 Oct 04 21:08:56.479418 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 459/911] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:56 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:56.485072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-39f3cc00-fff9-438d-8872-b6188fdf0089 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "10d69e8c4cc5453197a75fca840ad4e4"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:56.514563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ef7e1c7f-3225-4e1e-948e-09fbdd726336 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:56.526249 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ef7e1c7f-3225-4e1e-948e-09fbdd726336 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 200 len: 1268 microversion: 2.1 time: 0.107738 Oct 04 21:08:56.526843 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 453/912] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:56 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 1268 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:56.690435 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-39f3cc00-fff9-438d-8872-b6188fdf0089 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/319854031/action" status: 200 len: 21 microversion: 2.1 time: 0.209385 Oct 04 21:08:56.691074 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 460/913] 10.222.0.30 () {60 vars in 1197 bytes} [Tue Oct 4 21:08:56 2022] POST /compute/v2.1/flavors/319854031/action => generated 21 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:08:56.700906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bbb1d8eb-a9e3-4fe0-bcde-7cd729b28e92 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:56.804601 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bbb1d8eb-a9e3-4fe0-bcde-7cd729b28e92 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/319854031" status: 202 len: 0 microversion: 2.1 time: 0.107369 Oct 04 21:08:56.805188 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 454/914] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Oct 4 21:08:56 2022] DELETE /compute/v2.1/flavors/319854031 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:08:56.814843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-be03a187-05bf-4a55-a8c2-cc59ce0ffdd7 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:56.835082 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-be03a187-05bf-4a55-a8c2-cc59ce0ffdd7 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024674 Oct 04 21:08:56.842075 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 461/915] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:08:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:56.860164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9e90d052-5cf6-4667-ab40-69c74049f2b8 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1278568252", "id": 1181348480, "os-flavor-access:is_public": "False"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:56.974934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-352fc228-829d-46c6-81a4-574fc2ec8925 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:56.975474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-352fc228-829d-46c6-81a4-574fc2ec8925 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:56.979263 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9e90d052-5cf6-4667-ab40-69c74049f2b8 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.123508 Oct 04 21:08:56.979941 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 455/916] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:08:56 2022] POST /compute/v2.1/flavors => generated 439 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:56.984265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-352fc228-829d-46c6-81a4-574fc2ec8925 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:56.984824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-352fc228-829d-46c6-81a4-574fc2ec8925 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:56.985532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-352fc228-829d-46c6-81a4-574fc2ec8925 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:56.993617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-352fc228-829d-46c6-81a4-574fc2ec8925 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:56.993617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-352fc228-829d-46c6-81a4-574fc2ec8925 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:56.993617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-352fc228-829d-46c6-81a4-574fc2ec8925 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:56.994086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-da4a3977-04ea-4ee5-8130-d13a736d2510 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3fb7608457594b99aa892a51fdd28008"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:57.053376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-352fc228-829d-46c6-81a4-574fc2ec8925 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:57.059838 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-da4a3977-04ea-4ee5-8130-d13a736d2510 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] HTTP exception thrown: Flavor access not found for 38 / 3fb7608457594b99aa892a51fdd28008 combination. Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-da4a3977-04ea-4ee5-8130-d13a736d2510 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Request method failure captured: Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/flavors/1181348480/action HTTP/1.1 Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 70 Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKDk8yzp9S4hEnUg_xXFk9YHJLIKIQm91viRnYQX1Ba0nUiIvQGll7H0WbGSbl271gVBkFCVHDEW5FaJPFvBJzH4t2zQzV_5VKz7usJ2En6gBUrYNkcnlxVHbVgW-9G4RSw1YE92tnAHb5Ee-Jf34-mrIEuU6RSS8jKmouDmOIW2lE0 Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fbb7fb438b674ea4bfafa7f2ef7c0a50 Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1348214912 Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb7fb438b674ea4bfafa7f2ef7c0a50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbb7fb438b674ea4bfafa7f2ef7c0a50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbb7fb438b674ea4bfafa7f2ef7c0a50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb7fb438b674ea4bfafa7f2ef7c0a50"}]}] Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1348214912 Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fbb7fb438b674ea4bfafa7f2ef7c0a50 Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1348214912 Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 01ef70f7cec847d998e9fe0d212a5db9 Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: {"removeTenantAccess": {"tenant": "3fb7608457594b99aa892a51fdd28008"}} Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: exception: Flavor access not found for 38 / 3fb7608457594b99aa892a51fdd28008 combination. Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '1181348480', 'body': {'removeTenantAccess': {'tenant': '3fb7608457594b99aa892a51fdd28008'}}} Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 38 / 3fb7608457594b99aa892a51fdd28008 combination. Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:08:57.062626 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:08:57.070801 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:08:57.070801 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:08:57.070801 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 04 21:08:57.070801 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:08:57.070801 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 38 / 3fb7608457594b99aa892a51fdd28008 combination. Oct 04 21:08:57.070801 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:57.070801 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:57.070801 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:57.070801 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:57.070801 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:57.070801 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:57.070801 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:08:57.070801 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:08:57.070801 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 38 / 3fb7608457594b99aa892a51fdd28008 combination. Oct 04 21:08:57.070801 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:08:57.072063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-352fc228-829d-46c6-81a4-574fc2ec8925 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:57.072197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-da4a3977-04ea-4ee5-8130-d13a736d2510 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Returning 404 to user: Flavor access not found for 38 / 3fb7608457594b99aa892a51fdd28008 combination. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:08:57.072197 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-da4a3977-04ea-4ee5-8130-d13a736d2510 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1181348480/action" status: 404 len: 124 microversion: 2.1 time: 0.074987 Oct 04 21:08:57.072388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-352fc228-829d-46c6-81a4-574fc2ec8925 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:57.072496 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 456/917] 10.222.0.30 () {60 vars in 1200 bytes} [Tue Oct 4 21:08:56 2022] POST /compute/v2.1/flavors/1181348480/action => generated 124 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:08:57.072589 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-352fc228-829d-46c6-81a4-574fc2ec8925 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.098572 Oct 04 21:08:57.072589 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 462/918] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:56 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:57.073017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-784a33fb-5484-48df-8cbc-cc8618ac4661 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:57.235750 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-784a33fb-5484-48df-8cbc-cc8618ac4661 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1181348480" status: 202 len: 0 microversion: 2.1 time: 0.165423 Oct 04 21:08:57.237463 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 457/919] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Oct 4 21:08:57 2022] DELETE /compute/v2.1/flavors/1181348480 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:08:57.244427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ddc4b968-23b4-4371-9f0e-97ba8bade2b3 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:57.266216 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ddc4b968-23b4-4371-9f0e-97ba8bade2b3 tempest-FlavorsAccessNegativeTestJSON-1348214912 tempest-FlavorsAccessNegativeTestJSON-1348214912-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025199 Oct 04 21:08:57.266817 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 463/920] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:08:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:57.301305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-32738dff-3441-4f0c-b07c-bbe65ce23427 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:57.302433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-32738dff-3441-4f0c-b07c-bbe65ce23427 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:57.316392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32738dff-3441-4f0c-b07c-bbe65ce23427 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:57.316392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32738dff-3441-4f0c-b07c-bbe65ce23427 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:57.317357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32738dff-3441-4f0c-b07c-bbe65ce23427 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:57.318099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32738dff-3441-4f0c-b07c-bbe65ce23427 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:57.318747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32738dff-3441-4f0c-b07c-bbe65ce23427 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:57.319405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32738dff-3441-4f0c-b07c-bbe65ce23427 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:57.429833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0f97ca97-18dd-4a7f-889e-16f59c8e3d65 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:57.430446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0f97ca97-18dd-4a7f-889e-16f59c8e3d65 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:57.437729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f97ca97-18dd-4a7f-889e-16f59c8e3d65 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:57.438534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f97ca97-18dd-4a7f-889e-16f59c8e3d65 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:57.438972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f97ca97-18dd-4a7f-889e-16f59c8e3d65 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:57.439668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f97ca97-18dd-4a7f-889e-16f59c8e3d65 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:57.440286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f97ca97-18dd-4a7f-889e-16f59c8e3d65 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:57.440722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f97ca97-18dd-4a7f-889e-16f59c8e3d65 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:57.548971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-0f97ca97-18dd-4a7f-889e-16f59c8e3d65 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:57.558110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-32738dff-3441-4f0c-b07c-bbe65ce23427 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:57.568315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-32738dff-3441-4f0c-b07c-bbe65ce23427 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:57.570216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-32738dff-3441-4f0c-b07c-bbe65ce23427 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:57.572721 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-32738dff-3441-4f0c-b07c-bbe65ce23427 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1411 microversion: 2.25 time: 0.277105 Oct 04 21:08:57.573613 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0f97ca97-18dd-4a7f-889e-16f59c8e3d65 tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1933 microversion: 2.75 time: 0.148015 Oct 04 21:08:57.574439 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 464/921] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:57 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1933 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:57.583610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3ba496c7-59c0-4fce-899f-88afecc28458 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:57.598695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3ba496c7-59c0-4fce-899f-88afecc28458 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:57.598695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ba496c7-59c0-4fce-899f-88afecc28458 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:57.599126 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 458/922] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:57 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1411 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:57.599239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ba496c7-59c0-4fce-899f-88afecc28458 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:57.599239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ba496c7-59c0-4fce-899f-88afecc28458 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:57.599239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ba496c7-59c0-4fce-899f-88afecc28458 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:57.599239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ba496c7-59c0-4fce-899f-88afecc28458 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:57.599239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ba496c7-59c0-4fce-899f-88afecc28458 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:57.604691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-21ef2115-795e-4c1b-ad0b-e92dd9950e0b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:57.606455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-21ef2115-795e-4c1b-ad0b-e92dd9950e0b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:57.615518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21ef2115-795e-4c1b-ad0b-e92dd9950e0b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:57.616360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21ef2115-795e-4c1b-ad0b-e92dd9950e0b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:57.617032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21ef2115-795e-4c1b-ad0b-e92dd9950e0b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:57.618118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21ef2115-795e-4c1b-ad0b-e92dd9950e0b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:57.618793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21ef2115-795e-4c1b-ad0b-e92dd9950e0b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:57.619847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21ef2115-795e-4c1b-ad0b-e92dd9950e0b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:57.681934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3ba496c7-59c0-4fce-899f-88afecc28458 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:57.691416 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3ba496c7-59c0-4fce-899f-88afecc28458 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1283 microversion: 2.1 time: 0.115479 Oct 04 21:08:57.692302 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 465/923] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:57 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1283 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:57.720744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-21ef2115-795e-4c1b-ad0b-e92dd9950e0b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:57.729821 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-21ef2115-795e-4c1b-ad0b-e92dd9950e0b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 200 len: 1268 microversion: 2.1 time: 0.134432 Oct 04 21:08:57.730415 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 459/924] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:57 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 1268 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:58.006599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-c698061c-f854-4719-b1c8-aa8b4ae732cd req-3d467d5b-bd97-4a01-bc59-788bd259bc6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "191d63c3-2de0-4d3a-85f1-c4be3d2f5432", "name": "network-vif-plugged", "status": "completed", "tag": "816da828-8532-4f45-bd81-2b2098519c9f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:58.017085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c698061c-f854-4719-b1c8-aa8b4ae732cd req-3d467d5b-bd97-4a01-bc59-788bd259bc6a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:58.017383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c698061c-f854-4719-b1c8-aa8b4ae732cd req-3d467d5b-bd97-4a01-bc59-788bd259bc6a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:58.017833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c698061c-f854-4719-b1c8-aa8b4ae732cd req-3d467d5b-bd97-4a01-bc59-788bd259bc6a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:58.032391 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-c698061c-f854-4719-b1c8-aa8b4ae732cd req-3d467d5b-bd97-4a01-bc59-788bd259bc6a service nova] Creating event network-vif-plugged:816da828-8532-4f45-bd81-2b2098519c9f for instance 191d63c3-2de0-4d3a-85f1-c4be3d2f5432 on n-h2-860282-1 Oct 04 21:08:58.037616 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-c698061c-f854-4719-b1c8-aa8b4ae732cd req-3d467d5b-bd97-4a01-bc59-788bd259bc6a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034844 Oct 04 21:08:58.038234 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 466/925] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:58.096979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e41bc25d-4b93-49c7-bdc1-f5afce79747e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:58.097576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e41bc25d-4b93-49c7-bdc1-f5afce79747e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:58.105193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e41bc25d-4b93-49c7-bdc1-f5afce79747e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:58.105949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e41bc25d-4b93-49c7-bdc1-f5afce79747e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:58.106688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e41bc25d-4b93-49c7-bdc1-f5afce79747e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:58.109045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e41bc25d-4b93-49c7-bdc1-f5afce79747e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:58.109864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e41bc25d-4b93-49c7-bdc1-f5afce79747e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:58.110535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e41bc25d-4b93-49c7-bdc1-f5afce79747e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:58.247792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e41bc25d-4b93-49c7-bdc1-f5afce79747e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:58.274140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e41bc25d-4b93-49c7-bdc1-f5afce79747e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:58.280123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e41bc25d-4b93-49c7-bdc1-f5afce79747e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:58.292481 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e41bc25d-4b93-49c7-bdc1-f5afce79747e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.199527 Oct 04 21:08:58.293465 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 460/926] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:58 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:58.603366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-de2b138e-7ad9-4225-b6ff-226d9977e6df tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:58.604403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-de2b138e-7ad9-4225-b6ff-226d9977e6df tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:58.611603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de2b138e-7ad9-4225-b6ff-226d9977e6df tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:58.612217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de2b138e-7ad9-4225-b6ff-226d9977e6df tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:58.612521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de2b138e-7ad9-4225-b6ff-226d9977e6df tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:58.613441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de2b138e-7ad9-4225-b6ff-226d9977e6df tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:58.614278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de2b138e-7ad9-4225-b6ff-226d9977e6df tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:58.614898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de2b138e-7ad9-4225-b6ff-226d9977e6df tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:58.634818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d3695c3b-9993-4385-8778-b88e5e046b4f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:58.637065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d3695c3b-9993-4385-8778-b88e5e046b4f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:58.645162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3695c3b-9993-4385-8778-b88e5e046b4f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:58.646023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3695c3b-9993-4385-8778-b88e5e046b4f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:58.646637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3695c3b-9993-4385-8778-b88e5e046b4f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:58.648474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3695c3b-9993-4385-8778-b88e5e046b4f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:58.649136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3695c3b-9993-4385-8778-b88e5e046b4f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:58.649763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3695c3b-9993-4385-8778-b88e5e046b4f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:58.804652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-d3695c3b-9993-4385-8778-b88e5e046b4f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:58.833315 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d3695c3b-9993-4385-8778-b88e5e046b4f tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1933 microversion: 2.75 time: 0.211635 Oct 04 21:08:58.834765 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 461/927] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:58 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1933 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:58.839715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dd558df9-2f45-4f18-8a9c-18251ce439eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:58.840638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dd558df9-2f45-4f18-8a9c-18251ce439eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:58.855344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd558df9-2f45-4f18-8a9c-18251ce439eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:58.855817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd558df9-2f45-4f18-8a9c-18251ce439eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:58.856293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd558df9-2f45-4f18-8a9c-18251ce439eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:58.859445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd558df9-2f45-4f18-8a9c-18251ce439eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:58.860920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd558df9-2f45-4f18-8a9c-18251ce439eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:58.863623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd558df9-2f45-4f18-8a9c-18251ce439eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:59.055783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-de2b138e-7ad9-4225-b6ff-226d9977e6df tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:59.064475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-de2b138e-7ad9-4225-b6ff-226d9977e6df tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:59.066066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-de2b138e-7ad9-4225-b6ff-226d9977e6df tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:59.067275 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-de2b138e-7ad9-4225-b6ff-226d9977e6df tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1411 microversion: 2.25 time: 0.469173 Oct 04 21:08:59.086452 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 467/928] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:58 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1411 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:59.086452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1951fb74-a030-40bd-8cc5-5058e063150f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:59.086452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1951fb74-a030-40bd-8cc5-5058e063150f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:59.107633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1951fb74-a030-40bd-8cc5-5058e063150f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:59.109723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1951fb74-a030-40bd-8cc5-5058e063150f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:59.110518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1951fb74-a030-40bd-8cc5-5058e063150f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:59.111387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1951fb74-a030-40bd-8cc5-5058e063150f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:59.112299 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1951fb74-a030-40bd-8cc5-5058e063150f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:59.113211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1951fb74-a030-40bd-8cc5-5058e063150f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:59.127251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dd558df9-2f45-4f18-8a9c-18251ce439eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:59.156773 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dd558df9-2f45-4f18-8a9c-18251ce439eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1313 microversion: 2.1 time: 0.320354 Oct 04 21:08:59.166368 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 462/929] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:58 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:59.226320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1951fb74-a030-40bd-8cc5-5058e063150f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:59.237251 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1951fb74-a030-40bd-8cc5-5058e063150f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 200 len: 1286 microversion: 2.1 time: 0.160850 Oct 04 21:08:59.238114 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 468/930] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:59 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 1286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:59.320131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eca4ece2-42b6-4b24-8fb1-3b050426d46e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:59.320740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eca4ece2-42b6-4b24-8fb1-3b050426d46e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:59.327329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eca4ece2-42b6-4b24-8fb1-3b050426d46e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:59.327855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eca4ece2-42b6-4b24-8fb1-3b050426d46e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:59.328292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eca4ece2-42b6-4b24-8fb1-3b050426d46e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:59.328986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eca4ece2-42b6-4b24-8fb1-3b050426d46e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:59.329457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eca4ece2-42b6-4b24-8fb1-3b050426d46e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:59.335146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eca4ece2-42b6-4b24-8fb1-3b050426d46e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:59.335381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:59.397820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eca4ece2-42b6-4b24-8fb1-3b050426d46e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:59.408406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eca4ece2-42b6-4b24-8fb1-3b050426d46e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:59.410114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eca4ece2-42b6-4b24-8fb1-3b050426d46e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:59.415787 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eca4ece2-42b6-4b24-8fb1-3b050426d46e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.099557 Oct 04 21:08:59.416431 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 463/931] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:59 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:59.862357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-b57671fc-c1ef-4c64-968a-a85ed37ed229 req-2dd48428-c905-4d77-ac04-1f468a62868d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d10b511-a8bd-46cc-bf96-0879899ac60b", "tag": "cc7eeb3c-7c42-43b5-b169-cbc14e6a3436"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:59.869558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dbafbcea-cf58-4696-bdac-dc36e950069c tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:59.870447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dbafbcea-cf58-4696-bdac-dc36e950069c tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:59.881928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b57671fc-c1ef-4c64-968a-a85ed37ed229 req-2dd48428-c905-4d77-ac04-1f468a62868d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:59.882737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbafbcea-cf58-4696-bdac-dc36e950069c tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:59.883431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbafbcea-cf58-4696-bdac-dc36e950069c tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:59.883946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b57671fc-c1ef-4c64-968a-a85ed37ed229 req-2dd48428-c905-4d77-ac04-1f468a62868d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:59.884243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbafbcea-cf58-4696-bdac-dc36e950069c tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:59.884799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b57671fc-c1ef-4c64-968a-a85ed37ed229 req-2dd48428-c905-4d77-ac04-1f468a62868d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:59.885910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbafbcea-cf58-4696-bdac-dc36e950069c tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:59.886993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbafbcea-cf58-4696-bdac-dc36e950069c tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:59.888021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbafbcea-cf58-4696-bdac-dc36e950069c tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:59.907392 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-b57671fc-c1ef-4c64-968a-a85ed37ed229 req-2dd48428-c905-4d77-ac04-1f468a62868d service nova] Creating event network-changed:cc7eeb3c-7c42-43b5-b169-cbc14e6a3436 for instance 4d10b511-a8bd-46cc-bf96-0879899ac60b on n-h1-860282-1 Oct 04 21:08:59.912442 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-b57671fc-c1ef-4c64-968a-a85ed37ed229 req-2dd48428-c905-4d77-ac04-1f468a62868d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055594 Oct 04 21:08:59.918935 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 469/932] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:00.031374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-dbafbcea-cf58-4696-bdac-dc36e950069c tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] Lazy-loading 'services' on Instance uuid b6ce8338-829f-43ad-8fc7-52a2716fb206 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:09:00.082161 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dbafbcea-cf58-4696-bdac-dc36e950069c tempest-ServersAdmin275Test-547233421 tempest-ServersAdmin275Test-547233421-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1918 microversion: 2.75 time: 0.217512 Oct 04 21:09:00.089761 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 464/933] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:59 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1918 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:09:00.119847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d72e1483-303d-4c89-a2ce-701df163a03b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:00.121079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d72e1483-303d-4c89-a2ce-701df163a03b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:00.129140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-586f97f1-5b84-461e-a99e-24146df39cdc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:00.129697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-586f97f1-5b84-461e-a99e-24146df39cdc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:00.145273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d72e1483-303d-4c89-a2ce-701df163a03b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:00.145791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d72e1483-303d-4c89-a2ce-701df163a03b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:00.146393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d72e1483-303d-4c89-a2ce-701df163a03b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:00.146973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d72e1483-303d-4c89-a2ce-701df163a03b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:00.158224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-586f97f1-5b84-461e-a99e-24146df39cdc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:00.158716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-586f97f1-5b84-461e-a99e-24146df39cdc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:00.159157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-586f97f1-5b84-461e-a99e-24146df39cdc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:00.159879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-586f97f1-5b84-461e-a99e-24146df39cdc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:00.160333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-586f97f1-5b84-461e-a99e-24146df39cdc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:00.160758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-586f97f1-5b84-461e-a99e-24146df39cdc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:00.178041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d72e1483-303d-4c89-a2ce-701df163a03b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:00.178798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d72e1483-303d-4c89-a2ce-701df163a03b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:00.217671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-586f97f1-5b84-461e-a99e-24146df39cdc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:09:00.520505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d72e1483-303d-4c89-a2ce-701df163a03b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:00.524241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:00.526321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:DELETE=10,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:00.543762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d72e1483-303d-4c89-a2ce-701df163a03b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:00.550784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d72e1483-303d-4c89-a2ce-701df163a03b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:00.552248 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d72e1483-303d-4c89-a2ce-701df163a03b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1608 microversion: 2.25 time: 0.437988 Oct 04 21:09:00.552854 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 470/934] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:00 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1608 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:00.563740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6e3a9ee0-c0b1-42cd-a77e-fdafd87472f1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:00.564629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6e3a9ee0-c0b1-42cd-a77e-fdafd87472f1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:00.595604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e3a9ee0-c0b1-42cd-a77e-fdafd87472f1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:00.600646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e3a9ee0-c0b1-42cd-a77e-fdafd87472f1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:00.601264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e3a9ee0-c0b1-42cd-a77e-fdafd87472f1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:00.604971 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-586f97f1-5b84-461e-a99e-24146df39cdc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 204 len: 0 microversion: 2.75 time: 0.480568 Oct 04 21:09:00.609316 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 465/935] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:09:00 2022] DELETE /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:09:00.609508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e3a9ee0-c0b1-42cd-a77e-fdafd87472f1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:00.609508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e3a9ee0-c0b1-42cd-a77e-fdafd87472f1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:00.609508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e3a9ee0-c0b1-42cd-a77e-fdafd87472f1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:00.615831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-410af345-7891-4084-b665-6f3d130116c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:00.615831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-410af345-7891-4084-b665-6f3d130116c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:00.627861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-410af345-7891-4084-b665-6f3d130116c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:00.628360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-410af345-7891-4084-b665-6f3d130116c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:00.628840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-410af345-7891-4084-b665-6f3d130116c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:00.629598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-410af345-7891-4084-b665-6f3d130116c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:00.630215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-410af345-7891-4084-b665-6f3d130116c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:00.638834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-410af345-7891-4084-b665-6f3d130116c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:00.901351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6e3a9ee0-c0b1-42cd-a77e-fdafd87472f1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:00.912266 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6e3a9ee0-c0b1-42cd-a77e-fdafd87472f1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1313 microversion: 2.1 time: 0.353362 Oct 04 21:09:00.912980 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 471/936] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:00 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:00.927143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-43cda36c-e9a1-4af4-bfdd-f57085eed88d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:00.928188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-43cda36c-e9a1-4af4-bfdd-f57085eed88d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:00.946418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43cda36c-e9a1-4af4-bfdd-f57085eed88d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:00.947376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43cda36c-e9a1-4af4-bfdd-f57085eed88d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:00.948001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43cda36c-e9a1-4af4-bfdd-f57085eed88d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:00.948882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43cda36c-e9a1-4af4-bfdd-f57085eed88d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:00.949336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43cda36c-e9a1-4af4-bfdd-f57085eed88d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:00.949806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43cda36c-e9a1-4af4-bfdd-f57085eed88d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:00.966083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-410af345-7891-4084-b665-6f3d130116c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:00.976568 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-410af345-7891-4084-b665-6f3d130116c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 200 len: 1316 microversion: 2.1 time: 0.368042 Oct 04 21:09:00.988394 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 466/937] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:00 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:01.005103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3a65c607-affd-4de0-a0a7-17e9566a1537 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:01.009124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3a65c607-affd-4de0-a0a7-17e9566a1537 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:01.014875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a65c607-affd-4de0-a0a7-17e9566a1537 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:01.015674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a65c607-affd-4de0-a0a7-17e9566a1537 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:01.016366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a65c607-affd-4de0-a0a7-17e9566a1537 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:01.017289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a65c607-affd-4de0-a0a7-17e9566a1537 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:01.017950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a65c607-affd-4de0-a0a7-17e9566a1537 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:01.018544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a65c607-affd-4de0-a0a7-17e9566a1537 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:01.032865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-43cda36c-e9a1-4af4-bfdd-f57085eed88d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:01.045237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-43cda36c-e9a1-4af4-bfdd-f57085eed88d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:01.046795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-43cda36c-e9a1-4af4-bfdd-f57085eed88d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:01.055827 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-43cda36c-e9a1-4af4-bfdd-f57085eed88d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.137403 Oct 04 21:09:01.057098 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 472/938] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:00 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:01.063143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ed13ae87-ab52-45b0-885b-500af10c70cc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:01.066527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ed13ae87-ab52-45b0-885b-500af10c70cc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:01.073517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed13ae87-ab52-45b0-885b-500af10c70cc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:01.074221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed13ae87-ab52-45b0-885b-500af10c70cc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:01.074844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed13ae87-ab52-45b0-885b-500af10c70cc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:01.075747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed13ae87-ab52-45b0-885b-500af10c70cc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:01.076687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed13ae87-ab52-45b0-885b-500af10c70cc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:01.077360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed13ae87-ab52-45b0-885b-500af10c70cc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:01.127827 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3a65c607-affd-4de0-a0a7-17e9566a1537 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.138110 Oct 04 21:09:01.128607 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 467/939] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Oct 4 21:09:00 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:09:01.221090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ed13ae87-ab52-45b0-885b-500af10c70cc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:01.227883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ed13ae87-ab52-45b0-885b-500af10c70cc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:01.229774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ed13ae87-ab52-45b0-885b-500af10c70cc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:01.236442 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ed13ae87-ab52-45b0-885b-500af10c70cc tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1443 microversion: 2.75 time: 0.177999 Oct 04 21:09:01.237627 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 473/940] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:01 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1443 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:01.938050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:01.943438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-67046e92-647b-41e1-8ddb-cb37abb82b05 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:01.944060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-67046e92-647b-41e1-8ddb-cb37abb82b05 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:01.955312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-c8492e14-06a6-4db7-9ecc-ceabfef25a7f req-7c9ab729-9443-471c-9314-d01bd0a02aed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be194fa-5a4b-435d-9f06-ac053d4c403e", "tag": "e54fa548-306d-41bb-aa9a-bc50b6a52b0f"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:01.959070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=5 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:01.968407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67046e92-647b-41e1-8ddb-cb37abb82b05 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:01.968904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67046e92-647b-41e1-8ddb-cb37abb82b05 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:01.969342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67046e92-647b-41e1-8ddb-cb37abb82b05 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:01.970555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67046e92-647b-41e1-8ddb-cb37abb82b05 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:01.970555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67046e92-647b-41e1-8ddb-cb37abb82b05 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:01.981202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c8492e14-06a6-4db7-9ecc-ceabfef25a7f req-7c9ab729-9443-471c-9314-d01bd0a02aed service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:01.986670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67046e92-647b-41e1-8ddb-cb37abb82b05 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:01.997549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c8492e14-06a6-4db7-9ecc-ceabfef25a7f req-7c9ab729-9443-471c-9314-d01bd0a02aed service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:01.998374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c8492e14-06a6-4db7-9ecc-ceabfef25a7f req-7c9ab729-9443-471c-9314-d01bd0a02aed service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:02.024895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=10 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:02.027995 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-c8492e14-06a6-4db7-9ecc-ceabfef25a7f req-7c9ab729-9443-471c-9314-d01bd0a02aed service nova] Creating event network-changed:e54fa548-306d-41bb-aa9a-bc50b6a52b0f for instance 4be194fa-5a4b-435d-9f06-ac053d4c403e on n-h1-860282-1 Oct 04 21:09:02.037076 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-c8492e14-06a6-4db7-9ecc-ceabfef25a7f req-7c9ab729-9443-471c-9314-d01bd0a02aed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100938 Oct 04 21:09:02.037076 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 468/941] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:02.050988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-35188d85-9f50-4dbc-87dd-915454fc019d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:02.051944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-35188d85-9f50-4dbc-87dd-915454fc019d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:02.058952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35188d85-9f50-4dbc-87dd-915454fc019d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:02.059450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35188d85-9f50-4dbc-87dd-915454fc019d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:02.060882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35188d85-9f50-4dbc-87dd-915454fc019d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:02.061758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35188d85-9f50-4dbc-87dd-915454fc019d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:02.062227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35188d85-9f50-4dbc-87dd-915454fc019d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:02.062656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35188d85-9f50-4dbc-87dd-915454fc019d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:02.722492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67046e92-647b-41e1-8ddb-cb37abb82b05 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:02.731125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-35188d85-9f50-4dbc-87dd-915454fc019d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:02.731303 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-67046e92-647b-41e1-8ddb-cb37abb82b05 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1313 microversion: 2.1 time: 0.795904 Oct 04 21:09:02.731814 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 474/942] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:01 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1313 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:02.741351 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-35188d85-9f50-4dbc-87dd-915454fc019d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 200 len: 1316 microversion: 2.1 time: 0.705327 Oct 04 21:09:02.742411 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 469/943] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:02 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 1316 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:02.752185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-118edef8-1499-4587-8072-fe3554eaf808 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:02.752185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-118edef8-1499-4587-8072-fe3554eaf808 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:02.755741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-118edef8-1499-4587-8072-fe3554eaf808 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:02.756302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-118edef8-1499-4587-8072-fe3554eaf808 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:02.756806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-118edef8-1499-4587-8072-fe3554eaf808 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:02.757716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-118edef8-1499-4587-8072-fe3554eaf808 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:02.758407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-118edef8-1499-4587-8072-fe3554eaf808 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:02.759175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-118edef8-1499-4587-8072-fe3554eaf808 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:02.762435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1835677694", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f683a344-afff-4dbc-af23-648d054ddf52"}], "security_groups": [{"name": "tempest-securitygroup--202811965"}], "key_name": "tempest-keypair-513931149", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "157d5cf6-822d-432a-9913-06b2227aaeec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:02.859097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-118edef8-1499-4587-8072-fe3554eaf808 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:02.867695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-118edef8-1499-4587-8072-fe3554eaf808 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:02.869281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-118edef8-1499-4587-8072-fe3554eaf808 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:02.874692 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-118edef8-1499-4587-8072-fe3554eaf808 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.130659 Oct 04 21:09:02.875351 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 470/944] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:02 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:02.879937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-021c74fd-75bf-4072-8fec-c12450127865 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:02.880681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-021c74fd-75bf-4072-8fec-c12450127865 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:02.887325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-021c74fd-75bf-4072-8fec-c12450127865 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:02.887944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-021c74fd-75bf-4072-8fec-c12450127865 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:02.889068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-021c74fd-75bf-4072-8fec-c12450127865 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:02.889874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-021c74fd-75bf-4072-8fec-c12450127865 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:02.890393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-021c74fd-75bf-4072-8fec-c12450127865 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:02.890892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-021c74fd-75bf-4072-8fec-c12450127865 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:03.009892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-021c74fd-75bf-4072-8fec-c12450127865 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:03.020151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] validate_networks() for [('f683a344-afff-4dbc-af23-648d054ddf52', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:09:03.039579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-021c74fd-75bf-4072-8fec-c12450127865 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:03.041048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-021c74fd-75bf-4072-8fec-c12450127865 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e346ff2098411480433b65e79aec71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b5442755646a0bd3d814ee61fad3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:03.046610 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-021c74fd-75bf-4072-8fec-c12450127865 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 200 len: 1443 microversion: 2.75 time: 0.170185 Oct 04 21:09:03.047612 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 471/945] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:02 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 1443 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:03.100732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=21 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:03.129269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-0572019b-a419-4f1f-95b1-ac690ea9a0de req-0c73ba37-cec5-4727-9fda-36e0381ac854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "191d63c3-2de0-4d3a-85f1-c4be3d2f5432", "tag": "816da828-8532-4f45-bd81-2b2098519c9f"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:03.145774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0572019b-a419-4f1f-95b1-ac690ea9a0de req-0c73ba37-cec5-4727-9fda-36e0381ac854 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:03.146446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0572019b-a419-4f1f-95b1-ac690ea9a0de req-0c73ba37-cec5-4727-9fda-36e0381ac854 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:03.147124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0572019b-a419-4f1f-95b1-ac690ea9a0de req-0c73ba37-cec5-4727-9fda-36e0381ac854 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:03.192410 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-0572019b-a419-4f1f-95b1-ac690ea9a0de req-0c73ba37-cec5-4727-9fda-36e0381ac854 service nova] Creating event network-changed:816da828-8532-4f45-bd81-2b2098519c9f for instance 191d63c3-2de0-4d3a-85f1-c4be3d2f5432 on n-h2-860282-1 Oct 04 21:09:03.198993 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-0572019b-a419-4f1f-95b1-ac690ea9a0de req-0c73ba37-cec5-4727-9fda-36e0381ac854 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073274 Oct 04 21:09:03.200421 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 472/946] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:03.768602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5c877a63-8f01-4b05-92ce-dbec5ff8fa77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:03.768865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5c877a63-8f01-4b05-92ce-dbec5ff8fa77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:03.779272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c877a63-8f01-4b05-92ce-dbec5ff8fa77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:03.785573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c877a63-8f01-4b05-92ce-dbec5ff8fa77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:03.786289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c877a63-8f01-4b05-92ce-dbec5ff8fa77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:03.787217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c877a63-8f01-4b05-92ce-dbec5ff8fa77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:03.788708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c877a63-8f01-4b05-92ce-dbec5ff8fa77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:03.792854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c877a63-8f01-4b05-92ce-dbec5ff8fa77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:03.858896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4,nova_api:DELETE=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:03.877512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Getting quotas for project 2b5ab646aa83404ea0006a5cdc439417. Resources: dict_keys(['metadata_items']) {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:09:03.905097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Getting quotas for user fc5cc145484d4444b7e93cec0d14d062 and project 2b5ab646aa83404ea0006a5cdc439417. Resources: dict_keys(['metadata_items']) {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:09:03.944014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:09:03.944713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:09:03.945355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:09:03.951377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:09:03.953336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:09:03.966722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:03.967775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:03.968720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:03.969883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:03.970734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:03.971595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:04.002385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Getting quotas for project 2b5ab646aa83404ea0006a5cdc439417. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:09:04.010614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Getting quotas for user fc5cc145484d4444b7e93cec0d14d062 and project 2b5ab646aa83404ea0006a5cdc439417. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:09:04.103990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:09:04.108853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='157d5cf6-822d-432a-9913-06b2227aaeec',volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:09:04.253677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5c877a63-8f01-4b05-92ce-dbec5ff8fa77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:04.262755 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5c877a63-8f01-4b05-92ce-dbec5ff8fa77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1313 microversion: 2.1 time: 0.504002 Oct 04 21:09:04.265470 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 473/947] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:03 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:04.268593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f98a2863-99e8-42cb-8269-61dc1119bdf0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:04.269218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f98a2863-99e8-42cb-8269-61dc1119bdf0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:04.285289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f98a2863-99e8-42cb-8269-61dc1119bdf0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:04.285289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f98a2863-99e8-42cb-8269-61dc1119bdf0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:04.286173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f98a2863-99e8-42cb-8269-61dc1119bdf0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:04.286918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f98a2863-99e8-42cb-8269-61dc1119bdf0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:04.287381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f98a2863-99e8-42cb-8269-61dc1119bdf0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:04.296297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f98a2863-99e8-42cb-8269-61dc1119bdf0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:04.502740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f98a2863-99e8-42cb-8269-61dc1119bdf0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:04.510836 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f98a2863-99e8-42cb-8269-61dc1119bdf0 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 200 len: 1316 microversion: 2.1 time: 0.245837 Oct 04 21:09:04.511417 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 474/948] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:04 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:04.516816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d18cd46e-2be5-4941-9888-8e9f3e7d8977 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:04.517938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d18cd46e-2be5-4941-9888-8e9f3e7d8977 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:04.526087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d18cd46e-2be5-4941-9888-8e9f3e7d8977 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:04.526585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d18cd46e-2be5-4941-9888-8e9f3e7d8977 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:04.527029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d18cd46e-2be5-4941-9888-8e9f3e7d8977 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:04.527739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d18cd46e-2be5-4941-9888-8e9f3e7d8977 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:04.528197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d18cd46e-2be5-4941-9888-8e9f3e7d8977 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:04.528620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d18cd46e-2be5-4941-9888-8e9f3e7d8977 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:04.609642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d18cd46e-2be5-4941-9888-8e9f3e7d8977 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:04.617055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d18cd46e-2be5-4941-9888-8e9f3e7d8977 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:04.618833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d18cd46e-2be5-4941-9888-8e9f3e7d8977 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:04.624279 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d18cd46e-2be5-4941-9888-8e9f3e7d8977 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.111885 Oct 04 21:09:04.624851 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 475/949] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:04 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:04.634463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4836464e-9450-4d85-9676-95bebc62c369 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:04.635406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4836464e-9450-4d85-9676-95bebc62c369 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] [instance: b6ce8338-829f-43ad-8fc7-52a2716fb206] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:04.642894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4836464e-9450-4d85-9676-95bebc62c369 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:04.643633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4836464e-9450-4d85-9676-95bebc62c369 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:04.644258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4836464e-9450-4d85-9676-95bebc62c369 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:04.645533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4836464e-9450-4d85-9676-95bebc62c369 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:04.646214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4836464e-9450-4d85-9676-95bebc62c369 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:04.646879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4836464e-9450-4d85-9676-95bebc62c369 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:04.667011 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-4836464e-9450-4d85-9676-95bebc62c369 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] HTTP exception thrown: Instance b6ce8338-829f-43ad-8fc7-52a2716fb206 could not be found. Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4836464e-9450-4d85-9676-95bebc62c369 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Request method failure captured: Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 HTTP/1.1 Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKCV3tdA-xlhqICPSk7nLqdWmnpYCyPXEtzkjeil37UGKtEmaF2-jHAuWbEzOrWmnKleYNzCC2aEUXUjYlUed1qJjOPmXiBgJVgbu8KD5TYQCHGMOWoB-zx0OzJbuOZvUBYeCS2MISOdk-_OsWFK1VxGWcSEEOlIfMjrOnMzOp3flr0 Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.75 Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 022b5442755646a0bd3d814ee61fad3f Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersAdmin275Test-788407938 Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/022b5442755646a0bd3d814ee61fad3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_022b5442755646a0bd3d814ee61fad3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/022b5442755646a0bd3d814ee61fad3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/022b5442755646a0bd3d814ee61fad3f"}]}] Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersAdmin275Test-788407938 Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 022b5442755646a0bd3d814ee61fad3f Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersAdmin275Test-788407938 Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersAdmin275Test-788407938-project Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 37e346ff2098411480433b65e79aec71 Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersAdmin275Test-788407938-project Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance b6ce8338-829f-43ad-8fc7-52a2716fb206 could not be found. Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'b6ce8338-829f-43ad-8fc7-52a2716fb206'} Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6ce8338-829f-43ad-8fc7-52a2716fb206 could not be found. Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6ce8338-829f-43ad-8fc7-52a2716fb206 could not be found. Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:04.668617 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:04.677341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:04.677341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:04.677341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:04.677341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:09:04.677341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:09:04.677341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6ce8338-829f-43ad-8fc7-52a2716fb206 could not be found. Oct 04 21:09:04.677341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:04.677341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4836464e-9450-4d85-9676-95bebc62c369 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] Returning 404 to user: Instance b6ce8338-829f-43ad-8fc7-52a2716fb206 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:09:04.677341 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4836464e-9450-4d85-9676-95bebc62c369 tempest-ServersAdmin275Test-788407938 tempest-ServersAdmin275Test-788407938-project] 10.222.0.30 "GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206" status: 404 len: 111 microversion: 2.75 time: 0.044626 Oct 04 21:09:04.677341 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 476/950] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:04 2022] GET /compute/v2.1/servers/b6ce8338-829f-43ad-8fc7-52a2716fb206 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:09:04.707584 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3dab46f2-7257-42b4-8d75-dc33bb95ac11 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.949522 Oct 04 21:09:04.708758 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 475/951] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:09:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:09:04.720935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-22bd7c79-4810-4367-b89a-aaee54620ee6 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:04.724670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-22bd7c79-4810-4367-b89a-aaee54620ee6 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:04.801395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-22bd7c79-4810-4367-b89a-aaee54620ee6 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:04.809066 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-22bd7c79-4810-4367-b89a-aaee54620ee6 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1121 microversion: 2.1 time: 0.093450 Oct 04 21:09:04.809677 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 477/952] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:04 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1121 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:05.296675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d5bc0a2b-20e2-48ed-b66a-59c55db0d911 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:05.297979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d5bc0a2b-20e2-48ed-b66a-59c55db0d911 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:05.308383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5bc0a2b-20e2-48ed-b66a-59c55db0d911 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:05.310528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5bc0a2b-20e2-48ed-b66a-59c55db0d911 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:05.311168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5bc0a2b-20e2-48ed-b66a-59c55db0d911 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:05.312047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5bc0a2b-20e2-48ed-b66a-59c55db0d911 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:05.312498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5bc0a2b-20e2-48ed-b66a-59c55db0d911 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:05.313391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5bc0a2b-20e2-48ed-b66a-59c55db0d911 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:05.539034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d5bc0a2b-20e2-48ed-b66a-59c55db0d911 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:05.540149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2447e36c-948f-4795-83b3-43fa4608d6d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:05.541031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2447e36c-948f-4795-83b3-43fa4608d6d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:05.552167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2447e36c-948f-4795-83b3-43fa4608d6d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:05.552689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2447e36c-948f-4795-83b3-43fa4608d6d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:05.553336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2447e36c-948f-4795-83b3-43fa4608d6d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:05.554078 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2447e36c-948f-4795-83b3-43fa4608d6d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:05.554542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2447e36c-948f-4795-83b3-43fa4608d6d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:05.554969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2447e36c-948f-4795-83b3-43fa4608d6d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:05.555915 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d5bc0a2b-20e2-48ed-b66a-59c55db0d911 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1313 microversion: 2.1 time: 0.263650 Oct 04 21:09:05.559584 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 476/953] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:05 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:05.652710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0bc133a4-419c-4d37-ba17-8e48222e26c6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:05.653333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0bc133a4-419c-4d37-ba17-8e48222e26c6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:05.660054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0bc133a4-419c-4d37-ba17-8e48222e26c6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:05.660781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0bc133a4-419c-4d37-ba17-8e48222e26c6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:05.661216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0bc133a4-419c-4d37-ba17-8e48222e26c6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:05.661968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0bc133a4-419c-4d37-ba17-8e48222e26c6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:05.662430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0bc133a4-419c-4d37-ba17-8e48222e26c6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:05.662856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0bc133a4-419c-4d37-ba17-8e48222e26c6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:05.777690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0bc133a4-419c-4d37-ba17-8e48222e26c6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:05.790967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2447e36c-948f-4795-83b3-43fa4608d6d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:05.798222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0bc133a4-419c-4d37-ba17-8e48222e26c6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:05.803027 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2447e36c-948f-4795-83b3-43fa4608d6d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 200 len: 1316 microversion: 2.1 time: 0.267142 Oct 04 21:09:05.805528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0bc133a4-419c-4d37-ba17-8e48222e26c6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:05.807516 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 478/954] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:05 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:05.812278 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0bc133a4-419c-4d37-ba17-8e48222e26c6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.164055 Oct 04 21:09:05.813095 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 477/955] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:05 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:05.832200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-334ca6aa-13bc-4357-8ef0-164bfbe71919 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:05.833202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-334ca6aa-13bc-4357-8ef0-164bfbe71919 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:05.890149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-334ca6aa-13bc-4357-8ef0-164bfbe71919 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:05.897623 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-334ca6aa-13bc-4357-8ef0-164bfbe71919 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1121 microversion: 2.1 time: 0.069266 Oct 04 21:09:05.898475 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 479/956] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:05 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1121 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:06.057178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a4fa4eb9-0415-486c-a387-3f9a68e48d43 tempest-FlavorsV255TestJSON-543858023 tempest-FlavorsV255TestJSON-543858023-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1821215171", "id": 1900088280, "os-flavor-access:is_public": "True"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:06.153115 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a4fa4eb9-0415-486c-a387-3f9a68e48d43 tempest-FlavorsV255TestJSON-543858023 tempest-FlavorsV255TestJSON-543858023-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.250483 Oct 04 21:09:06.153753 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 478/957] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Oct 4 21:09:05 2022] POST /compute/v2.1/flavors => generated 449 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:09:06.327882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ec1f897c-bceb-484b-98b0-2f8779194e7a tempest-FlavorsV255TestJSON-811487327 tempest-FlavorsV255TestJSON-811487327-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:06.336434 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ec1f897c-bceb-484b-98b0-2f8779194e7a tempest-FlavorsV255TestJSON-811487327 tempest-FlavorsV255TestJSON-811487327-project] 10.222.0.30 "GET /compute/v2.1/flavors/1900088280" status: 200 len: 449 microversion: 2.55 time: 0.173317 Oct 04 21:09:06.337353 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 480/958] 10.222.0.30 () {60 vars in 1199 bytes} [Tue Oct 4 21:09:06 2022] GET /compute/v2.1/flavors/1900088280 => generated 449 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:09:06.350272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9cd1571e-3e50-4db3-8771-1b61cc798ff6 tempest-FlavorsV255TestJSON-543858023 tempest-FlavorsV255TestJSON-543858023-project-admin] Action: 'update', calling method: .version_select at 0x7f57920c0670>, body: {"flavor": {"description": "new"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:06.466838 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9cd1571e-3e50-4db3-8771-1b61cc798ff6 tempest-FlavorsV255TestJSON-543858023 tempest-FlavorsV255TestJSON-543858023-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1900088280" status: 200 len: 450 microversion: 2.55 time: 0.119881 Oct 04 21:09:06.467186 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 479/959] 10.222.0.30 () {62 vars in 1219 bytes} [Tue Oct 4 21:09:06 2022] PUT /compute/v2.1/flavors/1900088280 => generated 450 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:09:06.480221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f7d6dbb2-9441-4bed-9270-89cad0b7d0b6 tempest-FlavorsV255TestJSON-811487327 tempest-FlavorsV255TestJSON-811487327-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:06.503798 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f7d6dbb2-9441-4bed-9270-89cad0b7d0b6 tempest-FlavorsV255TestJSON-811487327 tempest-FlavorsV255TestJSON-811487327-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.027429 Oct 04 21:09:06.504378 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 481/960] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Oct 4 21:09:06 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:06.524937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e1af455d-5117-487c-9469-38f07e03f2b5 tempest-FlavorsV255TestJSON-811487327 tempest-FlavorsV255TestJSON-811487327-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:06.547878 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e1af455d-5117-487c-9469-38f07e03f2b5 tempest-FlavorsV255TestJSON-811487327 tempest-FlavorsV255TestJSON-811487327-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.027107 Oct 04 21:09:06.548464 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 480/961] 10.222.0.30 () {60 vars in 1166 bytes} [Tue Oct 4 21:09:06 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:06.564798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e24b5708-df9d-4501-bb05-b1e68533a74f tempest-FlavorsV255TestJSON-543858023 tempest-FlavorsV255TestJSON-543858023-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:06.583347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-86748ebe-e880-43e6-b69e-db2bf959c8a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:06.584009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-86748ebe-e880-43e6-b69e-db2bf959c8a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:06.589861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86748ebe-e880-43e6-b69e-db2bf959c8a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:06.590344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86748ebe-e880-43e6-b69e-db2bf959c8a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:06.590781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86748ebe-e880-43e6-b69e-db2bf959c8a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:06.592067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86748ebe-e880-43e6-b69e-db2bf959c8a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:06.592605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86748ebe-e880-43e6-b69e-db2bf959c8a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:06.593041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86748ebe-e880-43e6-b69e-db2bf959c8a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:06.658874 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e24b5708-df9d-4501-bb05-b1e68533a74f tempest-FlavorsV255TestJSON-543858023 tempest-FlavorsV255TestJSON-543858023-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1900088280" status: 202 len: 0 microversion: 2.55 time: 0.097663 Oct 04 21:09:06.659470 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 482/962] 10.222.0.30 () {60 vars in 1202 bytes} [Tue Oct 4 21:09:06 2022] DELETE /compute/v2.1/flavors/1900088280 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:09:06.668194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3f534644-b877-43bd-97f0-56a6dbce190a tempest-FlavorsV255TestJSON-543858023 tempest-FlavorsV255TestJSON-543858023-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:06.693021 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3f534644-b877-43bd-97f0-56a6dbce190a tempest-FlavorsV255TestJSON-543858023 tempest-FlavorsV255TestJSON-543858023-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.028096 Oct 04 21:09:06.694278 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 483/963] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Oct 4 21:09:06 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:09:06.747016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-86748ebe-e880-43e6-b69e-db2bf959c8a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:06.771943 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-86748ebe-e880-43e6-b69e-db2bf959c8a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1313 microversion: 2.1 time: 0.192233 Oct 04 21:09:06.772553 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 481/964] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:06 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:06.828544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a5603827-8cee-49db-9703-3788650a1a8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:06.828544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a5603827-8cee-49db-9703-3788650a1a8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:06.835120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5603827-8cee-49db-9703-3788650a1a8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:06.835744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5603827-8cee-49db-9703-3788650a1a8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:06.836292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5603827-8cee-49db-9703-3788650a1a8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:06.837251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5603827-8cee-49db-9703-3788650a1a8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:06.838360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5603827-8cee-49db-9703-3788650a1a8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:06.838360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5603827-8cee-49db-9703-3788650a1a8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:06.846532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-57ea2e43-ca86-4243-bb2e-1b10ab81cb2f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:06.847145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-57ea2e43-ca86-4243-bb2e-1b10ab81cb2f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:06.853127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57ea2e43-ca86-4243-bb2e-1b10ab81cb2f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:06.853711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57ea2e43-ca86-4243-bb2e-1b10ab81cb2f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:06.854165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57ea2e43-ca86-4243-bb2e-1b10ab81cb2f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:06.855322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57ea2e43-ca86-4243-bb2e-1b10ab81cb2f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:06.856034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57ea2e43-ca86-4243-bb2e-1b10ab81cb2f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:06.856718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57ea2e43-ca86-4243-bb2e-1b10ab81cb2f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:06.974306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-57ea2e43-ca86-4243-bb2e-1b10ab81cb2f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:06.991198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-57ea2e43-ca86-4243-bb2e-1b10ab81cb2f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:06.994575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-57ea2e43-ca86-4243-bb2e-1b10ab81cb2f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:07.018027 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-57ea2e43-ca86-4243-bb2e-1b10ab81cb2f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1560 microversion: 2.91 time: 0.174392 Oct 04 21:09:07.026015 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 482/965] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:06 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:09:07.032537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e3b75ed4-aba2-44f4-954e-be63fd245cdd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:07.034133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e3b75ed4-aba2-44f4-954e-be63fd245cdd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:07.042128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3b75ed4-aba2-44f4-954e-be63fd245cdd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:07.042468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a5603827-8cee-49db-9703-3788650a1a8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:07.043115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3b75ed4-aba2-44f4-954e-be63fd245cdd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:07.043800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3b75ed4-aba2-44f4-954e-be63fd245cdd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:07.045202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3b75ed4-aba2-44f4-954e-be63fd245cdd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:07.046220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3b75ed4-aba2-44f4-954e-be63fd245cdd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:07.047091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3b75ed4-aba2-44f4-954e-be63fd245cdd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:07.054194 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a5603827-8cee-49db-9703-3788650a1a8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 200 len: 1316 microversion: 2.1 time: 0.230345 Oct 04 21:09:07.056991 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 484/966] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:06 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 1316 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:07.098426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b47a0f45-c63e-4c65-8b15-65b7c09aad2c req-2a81de7f-073d-4c52-bc1b-324bc5b68d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d10b511-a8bd-46cc-bf96-0879899ac60b", "name": "network-vif-plugged", "status": "completed", "tag": "cc7eeb3c-7c42-43b5-b169-cbc14e6a3436"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:07.117396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b47a0f45-c63e-4c65-8b15-65b7c09aad2c req-2a81de7f-073d-4c52-bc1b-324bc5b68d3e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:07.117995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b47a0f45-c63e-4c65-8b15-65b7c09aad2c req-2a81de7f-073d-4c52-bc1b-324bc5b68d3e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:07.118521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b47a0f45-c63e-4c65-8b15-65b7c09aad2c req-2a81de7f-073d-4c52-bc1b-324bc5b68d3e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:07.131838 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b47a0f45-c63e-4c65-8b15-65b7c09aad2c req-2a81de7f-073d-4c52-bc1b-324bc5b68d3e service nova] Creating event network-vif-plugged:cc7eeb3c-7c42-43b5-b169-cbc14e6a3436 for instance 4d10b511-a8bd-46cc-bf96-0879899ac60b on n-h1-860282-1 Oct 04 21:09:07.137442 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b47a0f45-c63e-4c65-8b15-65b7c09aad2c req-2a81de7f-073d-4c52-bc1b-324bc5b68d3e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078835 Oct 04 21:09:07.138702 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 485/967] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:07.156120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e3b75ed4-aba2-44f4-954e-be63fd245cdd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:07.170504 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e3b75ed4-aba2-44f4-954e-be63fd245cdd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1219 microversion: 2.1 time: 0.146479 Oct 04 21:09:07.172020 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 483/968] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:07 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:07.798027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3e239e2f-83f8-47a2-a78a-b70576db88a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:07.803129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3e239e2f-83f8-47a2-a78a-b70576db88a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:07.805137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e239e2f-83f8-47a2-a78a-b70576db88a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:07.805668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e239e2f-83f8-47a2-a78a-b70576db88a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:07.806117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e239e2f-83f8-47a2-a78a-b70576db88a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:07.806819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e239e2f-83f8-47a2-a78a-b70576db88a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:07.807288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e239e2f-83f8-47a2-a78a-b70576db88a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:07.807765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e239e2f-83f8-47a2-a78a-b70576db88a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:08.025265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3e239e2f-83f8-47a2-a78a-b70576db88a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:08.032032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:08.037980 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3e239e2f-83f8-47a2-a78a-b70576db88a9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1313 microversion: 2.1 time: 0.244751 Oct 04 21:09:08.042927 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 486/969] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:07 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:08.066080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-685b6ca2-7661-4b10-b95b-1bf2a4bcfd58 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:08.072858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-685b6ca2-7661-4b10-b95b-1bf2a4bcfd58 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:08.086694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cc25e722-35d6-46bc-a884-5084e15df2e8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:08.087563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cc25e722-35d6-46bc-a884-5084e15df2e8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:08.099083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc25e722-35d6-46bc-a884-5084e15df2e8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:08.109243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc25e722-35d6-46bc-a884-5084e15df2e8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:08.112175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc25e722-35d6-46bc-a884-5084e15df2e8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:08.113282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc25e722-35d6-46bc-a884-5084e15df2e8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:08.115032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc25e722-35d6-46bc-a884-5084e15df2e8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:08.119314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc25e722-35d6-46bc-a884-5084e15df2e8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:08.119497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-685b6ca2-7661-4b10-b95b-1bf2a4bcfd58 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:08.119497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-685b6ca2-7661-4b10-b95b-1bf2a4bcfd58 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:08.119696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-685b6ca2-7661-4b10-b95b-1bf2a4bcfd58 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:08.124123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-685b6ca2-7661-4b10-b95b-1bf2a4bcfd58 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:08.125252 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-685b6ca2-7661-4b10-b95b-1bf2a4bcfd58 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:08.126108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-685b6ca2-7661-4b10-b95b-1bf2a4bcfd58 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:08.224422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-685b6ca2-7661-4b10-b95b-1bf2a4bcfd58 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:08.232968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-685b6ca2-7661-4b10-b95b-1bf2a4bcfd58 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:08.234798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-685b6ca2-7661-4b10-b95b-1bf2a4bcfd58 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:08.240163 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-685b6ca2-7661-4b10-b95b-1bf2a4bcfd58 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1560 microversion: 2.91 time: 0.188461 Oct 04 21:09:08.240701 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 484/970] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:08 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:08.245544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c2d76e14-dcba-4ae4-b28e-f423fbfe94d7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:08.246162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c2d76e14-dcba-4ae4-b28e-f423fbfe94d7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:08.252596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2d76e14-dcba-4ae4-b28e-f423fbfe94d7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:08.253298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2d76e14-dcba-4ae4-b28e-f423fbfe94d7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:08.253913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2d76e14-dcba-4ae4-b28e-f423fbfe94d7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:08.254799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2d76e14-dcba-4ae4-b28e-f423fbfe94d7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:08.255254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2d76e14-dcba-4ae4-b28e-f423fbfe94d7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:08.255839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2d76e14-dcba-4ae4-b28e-f423fbfe94d7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:08.345172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cc25e722-35d6-46bc-a884-5084e15df2e8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:08.347327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c2d76e14-dcba-4ae4-b28e-f423fbfe94d7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:08.356222 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cc25e722-35d6-46bc-a884-5084e15df2e8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 200 len: 1316 microversion: 2.1 time: 0.271835 Oct 04 21:09:08.360417 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 487/971] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:08 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:08.367672 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c2d76e14-dcba-4ae4-b28e-f423fbfe94d7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1237 microversion: 2.1 time: 0.125724 Oct 04 21:09:08.370018 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 485/972] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:08 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1237 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:09.067682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7fb1a21d-3d04-42b8-b39d-d2848475cee6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:09.068315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7fb1a21d-3d04-42b8-b39d-d2848475cee6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:09.097493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fb1a21d-3d04-42b8-b39d-d2848475cee6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:09.102146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fb1a21d-3d04-42b8-b39d-d2848475cee6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:09.102814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fb1a21d-3d04-42b8-b39d-d2848475cee6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:09.104354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fb1a21d-3d04-42b8-b39d-d2848475cee6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:09.104851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fb1a21d-3d04-42b8-b39d-d2848475cee6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:09.105296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fb1a21d-3d04-42b8-b39d-d2848475cee6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:09.167888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-4f56a095-b0d5-4459-bad6-781f37ae6197 req-455fc947-8708-497e-a958-e781462c9a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be194fa-5a4b-435d-9f06-ac053d4c403e", "name": "network-vif-plugged", "status": "completed", "tag": "e54fa548-306d-41bb-aa9a-bc50b6a52b0f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:09.195291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4f56a095-b0d5-4459-bad6-781f37ae6197 req-455fc947-8708-497e-a958-e781462c9a63 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:09.195767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4f56a095-b0d5-4459-bad6-781f37ae6197 req-455fc947-8708-497e-a958-e781462c9a63 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:09.196509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4f56a095-b0d5-4459-bad6-781f37ae6197 req-455fc947-8708-497e-a958-e781462c9a63 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:09.217256 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-4f56a095-b0d5-4459-bad6-781f37ae6197 req-455fc947-8708-497e-a958-e781462c9a63 service nova] Creating event network-vif-plugged:e54fa548-306d-41bb-aa9a-bc50b6a52b0f for instance 4be194fa-5a4b-435d-9f06-ac053d4c403e on n-h1-860282-1 Oct 04 21:09:09.224990 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-4f56a095-b0d5-4459-bad6-781f37ae6197 req-455fc947-8708-497e-a958-e781462c9a63 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062141 Oct 04 21:09:09.226046 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 486/973] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:09.270399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ad579e3d-d1cd-457d-b604-22791d1f878f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:09.278457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ad579e3d-d1cd-457d-b604-22791d1f878f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:09.297320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad579e3d-d1cd-457d-b604-22791d1f878f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:09.297852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad579e3d-d1cd-457d-b604-22791d1f878f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:09.298297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad579e3d-d1cd-457d-b604-22791d1f878f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:09.299048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad579e3d-d1cd-457d-b604-22791d1f878f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:09.299510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad579e3d-d1cd-457d-b604-22791d1f878f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:09.299943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad579e3d-d1cd-457d-b604-22791d1f878f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:09.624255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ad579e3d-d1cd-457d-b604-22791d1f878f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:09.633915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ad579e3d-d1cd-457d-b604-22791d1f878f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:09.635431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ad579e3d-d1cd-457d-b604-22791d1f878f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:09.640901 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ad579e3d-d1cd-457d-b604-22791d1f878f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.375320 Oct 04 21:09:09.641812 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 487/974] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:09 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:09.646310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b15ff9f7-7de0-47b7-b1be-5e9784d3e0d4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:09.647110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b15ff9f7-7de0-47b7-b1be-5e9784d3e0d4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:09.662782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b15ff9f7-7de0-47b7-b1be-5e9784d3e0d4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:09.663281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b15ff9f7-7de0-47b7-b1be-5e9784d3e0d4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:09.663722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b15ff9f7-7de0-47b7-b1be-5e9784d3e0d4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:09.664433 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b15ff9f7-7de0-47b7-b1be-5e9784d3e0d4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:09.664888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b15ff9f7-7de0-47b7-b1be-5e9784d3e0d4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:09.665716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b15ff9f7-7de0-47b7-b1be-5e9784d3e0d4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:09.686505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7fb1a21d-3d04-42b8-b39d-d2848475cee6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:09.697267 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7fb1a21d-3d04-42b8-b39d-d2848475cee6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1462 microversion: 2.1 time: 0.636240 Oct 04 21:09:09.698254 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 488/975] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:09 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1462 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:09.738942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-33132e91-3003-470e-a6ee-365a99827bfc tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:09.739602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-33132e91-3003-470e-a6ee-365a99827bfc tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:09.756573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33132e91-3003-470e-a6ee-365a99827bfc tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:09.758267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33132e91-3003-470e-a6ee-365a99827bfc tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:09.760133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33132e91-3003-470e-a6ee-365a99827bfc tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:09.760133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33132e91-3003-470e-a6ee-365a99827bfc tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:09.762152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33132e91-3003-470e-a6ee-365a99827bfc tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:09.763897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33132e91-3003-470e-a6ee-365a99827bfc tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:10.004235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b15ff9f7-7de0-47b7-b1be-5e9784d3e0d4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:10.019732 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b15ff9f7-7de0-47b7-b1be-5e9784d3e0d4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 200 len: 1316 microversion: 2.1 time: 0.371918 Oct 04 21:09:10.019732 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 488/976] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:09 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 1316 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:10.031244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3879fe69-4d7b-4678-b786-d402e1028994 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:10.038301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3879fe69-4d7b-4678-b786-d402e1028994 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:10.052723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3879fe69-4d7b-4678-b786-d402e1028994 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:10.053649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3879fe69-4d7b-4678-b786-d402e1028994 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:10.059278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3879fe69-4d7b-4678-b786-d402e1028994 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:10.060866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3879fe69-4d7b-4678-b786-d402e1028994 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:10.061520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3879fe69-4d7b-4678-b786-d402e1028994 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:10.062026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3879fe69-4d7b-4678-b786-d402e1028994 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:10.086196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-33132e91-3003-470e-a6ee-365a99827bfc tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:10.112827 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-33132e91-3003-470e-a6ee-365a99827bfc tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1304 microversion: 2.1 time: 0.393049 Oct 04 21:09:10.113693 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 489/977] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:09 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1304 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:10.208230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3879fe69-4d7b-4678-b786-d402e1028994 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:10.221752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3879fe69-4d7b-4678-b786-d402e1028994 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Old instance type m1.heat2, new instance type m1.heat {{(pid=122758) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:09:10.232315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3879fe69-4d7b-4678-b786-d402e1028994 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:09:10.233022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3879fe69-4d7b-4678-b786-d402e1028994 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:09:10.233682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3879fe69-4d7b-4678-b786-d402e1028994 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:09:10.234413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3879fe69-4d7b-4678-b786-d402e1028994 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:09:10.234984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3879fe69-4d7b-4678-b786-d402e1028994 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:09:10.398528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-a35bee14-b5c9-4366-bdb9-40d006c43f37 req-a8cbfb09-0ebc-40ee-8f18-a81d42299d28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff9a9f7b-0c44-4de4-9171-a14d2c39e096", "tag": "cac1c9b0-2f6f-49d5-bf55-ff55af059f63"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:10.438891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a35bee14-b5c9-4366-bdb9-40d006c43f37 req-a8cbfb09-0ebc-40ee-8f18-a81d42299d28 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:10.440689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a35bee14-b5c9-4366-bdb9-40d006c43f37 req-a8cbfb09-0ebc-40ee-8f18-a81d42299d28 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:10.441369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a35bee14-b5c9-4366-bdb9-40d006c43f37 req-a8cbfb09-0ebc-40ee-8f18-a81d42299d28 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:10.474889 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-a35bee14-b5c9-4366-bdb9-40d006c43f37 req-a8cbfb09-0ebc-40ee-8f18-a81d42299d28 service nova] Creating event network-changed:cac1c9b0-2f6f-49d5-bf55-ff55af059f63 for instance ff9a9f7b-0c44-4de4-9171-a14d2c39e096 on n-h2-860282-1 Oct 04 21:09:10.479012 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-a35bee14-b5c9-4366-bdb9-40d006c43f37 req-a8cbfb09-0ebc-40ee-8f18-a81d42299d28 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086164 Oct 04 21:09:10.479627 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 490/978] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:09:10.576415 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3879fe69-4d7b-4678-b786-d402e1028994 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "POST /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b/action" status: 202 len: 0 microversion: 2.1 time: 0.555248 Oct 04 21:09:10.578504 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 489/979] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:09:10 2022] POST /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:09:10.587166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9bcd4a9d-b2a4-4181-9efa-89f02a0e3add tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:10.587875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9bcd4a9d-b2a4-4181-9efa-89f02a0e3add tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:10.599678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9bcd4a9d-b2a4-4181-9efa-89f02a0e3add tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:10.611209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9bcd4a9d-b2a4-4181-9efa-89f02a0e3add tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:10.612871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9bcd4a9d-b2a4-4181-9efa-89f02a0e3add tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:10.615465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9bcd4a9d-b2a4-4181-9efa-89f02a0e3add tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:10.620574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9bcd4a9d-b2a4-4181-9efa-89f02a0e3add tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:10.621310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9bcd4a9d-b2a4-4181-9efa-89f02a0e3add tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:10.672208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4ca703fe-23a2-40c4-8d84-4844b375ce23 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:10.673111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4ca703fe-23a2-40c4-8d84-4844b375ce23 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:10.680674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ca703fe-23a2-40c4-8d84-4844b375ce23 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:10.681615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ca703fe-23a2-40c4-8d84-4844b375ce23 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:10.682225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ca703fe-23a2-40c4-8d84-4844b375ce23 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:10.689415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ca703fe-23a2-40c4-8d84-4844b375ce23 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:10.689415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ca703fe-23a2-40c4-8d84-4844b375ce23 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:10.689415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ca703fe-23a2-40c4-8d84-4844b375ce23 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:10.711195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:10.851190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4ca703fe-23a2-40c4-8d84-4844b375ce23 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:10.875029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4ca703fe-23a2-40c4-8d84-4844b375ce23 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:10.876812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4ca703fe-23a2-40c4-8d84-4844b375ce23 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:10.896380 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4ca703fe-23a2-40c4-8d84-4844b375ce23 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.229115 Oct 04 21:09:10.916526 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 490/980] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:10 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:11.030594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9bcd4a9d-b2a4-4181-9efa-89f02a0e3add tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:11.042617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-efc32cc8-8072-46d2-a6c1-5cb8d1e4d25a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:11.043499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-efc32cc8-8072-46d2-a6c1-5cb8d1e4d25a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:11.046307 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9bcd4a9d-b2a4-4181-9efa-89f02a0e3add tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1471 microversion: 2.1 time: 0.460792 Oct 04 21:09:11.049805 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 491/981] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:10 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1471 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:11.058133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efc32cc8-8072-46d2-a6c1-5cb8d1e4d25a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:11.061823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efc32cc8-8072-46d2-a6c1-5cb8d1e4d25a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:11.062835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efc32cc8-8072-46d2-a6c1-5cb8d1e4d25a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:11.065045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efc32cc8-8072-46d2-a6c1-5cb8d1e4d25a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:11.065575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efc32cc8-8072-46d2-a6c1-5cb8d1e4d25a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:11.066010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efc32cc8-8072-46d2-a6c1-5cb8d1e4d25a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:11.428394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-efc32cc8-8072-46d2-a6c1-5cb8d1e4d25a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:11.438564 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-efc32cc8-8072-46d2-a6c1-5cb8d1e4d25a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 200 len: 1316 microversion: 2.1 time: 0.400752 Oct 04 21:09:11.439407 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 491/982] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:11 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:11.452095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-67e6130a-95cc-4a7b-8203-e7d9eb282795 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:11.456810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-67e6130a-95cc-4a7b-8203-e7d9eb282795 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:11.480583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67e6130a-95cc-4a7b-8203-e7d9eb282795 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:11.485514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67e6130a-95cc-4a7b-8203-e7d9eb282795 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:11.492473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67e6130a-95cc-4a7b-8203-e7d9eb282795 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:11.493555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67e6130a-95cc-4a7b-8203-e7d9eb282795 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:11.494304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67e6130a-95cc-4a7b-8203-e7d9eb282795 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:11.494964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67e6130a-95cc-4a7b-8203-e7d9eb282795 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:11.775671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-61c82a0e-d8bd-47b1-a86f-b7ea46804398 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-475021868", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:11.832388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67e6130a-95cc-4a7b-8203-e7d9eb282795 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:11.840629 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-67e6130a-95cc-4a7b-8203-e7d9eb282795 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1304 microversion: 2.1 time: 0.400016 Oct 04 21:09:11.843082 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 492/983] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:11 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1304 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:11.890560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-61c82a0e-d8bd-47b1-a86f-b7ea46804398 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] validate_networks() for None {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:09:11.936006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-07aa192f-4fd9-46c4-8594-e0c2e97a10c1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:11.936616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-07aa192f-4fd9-46c4-8594-e0c2e97a10c1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:11.965741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07aa192f-4fd9-46c4-8594-e0c2e97a10c1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:11.966910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07aa192f-4fd9-46c4-8594-e0c2e97a10c1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:11.967470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07aa192f-4fd9-46c4-8594-e0c2e97a10c1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:11.968250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07aa192f-4fd9-46c4-8594-e0c2e97a10c1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:11.968706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07aa192f-4fd9-46c4-8594-e0c2e97a10c1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:11.973761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07aa192f-4fd9-46c4-8594-e0c2e97a10c1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:12.136969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-07aa192f-4fd9-46c4-8594-e0c2e97a10c1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:12.150727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-07aa192f-4fd9-46c4-8594-e0c2e97a10c1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:12.152750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-07aa192f-4fd9-46c4-8594-e0c2e97a10c1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:12.162544 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-07aa192f-4fd9-46c4-8594-e0c2e97a10c1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.233209 Oct 04 21:09:12.162544 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 493/984] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:11 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:12.180832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d54cce80-42fb-4d4d-92e6-143468732ae4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:12.182551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d54cce80-42fb-4d4d-92e6-143468732ae4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:12.190039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d54cce80-42fb-4d4d-92e6-143468732ae4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:12.190846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d54cce80-42fb-4d4d-92e6-143468732ae4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:12.191466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d54cce80-42fb-4d4d-92e6-143468732ae4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:12.192484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d54cce80-42fb-4d4d-92e6-143468732ae4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:12.193091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d54cce80-42fb-4d4d-92e6-143468732ae4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:12.193761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d54cce80-42fb-4d4d-92e6-143468732ae4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:12.338224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-61c82a0e-d8bd-47b1-a86f-b7ea46804398 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:09:12.338927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-61c82a0e-d8bd-47b1-a86f-b7ea46804398 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:09:12.339538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-61c82a0e-d8bd-47b1-a86f-b7ea46804398 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:09:12.339891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-61c82a0e-d8bd-47b1-a86f-b7ea46804398 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:09:12.340307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-61c82a0e-d8bd-47b1-a86f-b7ea46804398 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:09:12.375682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61c82a0e-d8bd-47b1-a86f-b7ea46804398 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:12.376356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61c82a0e-d8bd-47b1-a86f-b7ea46804398 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:12.377109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61c82a0e-d8bd-47b1-a86f-b7ea46804398 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:12.378175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61c82a0e-d8bd-47b1-a86f-b7ea46804398 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:12.378792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61c82a0e-d8bd-47b1-a86f-b7ea46804398 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:12.379837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61c82a0e-d8bd-47b1-a86f-b7ea46804398 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:12.402899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-61c82a0e-d8bd-47b1-a86f-b7ea46804398 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Getting quotas for project aa2f4ca02ad74730963245d9e018a386. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:09:12.411339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-61c82a0e-d8bd-47b1-a86f-b7ea46804398 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Getting quotas for user 5320f1606bbc49d693ae96f7b7ac516a and project aa2f4ca02ad74730963245d9e018a386. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:09:12.427471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-61c82a0e-d8bd-47b1-a86f-b7ea46804398 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:09:12.430409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-61c82a0e-d8bd-47b1-a86f-b7ea46804398 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:09:12.529004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d54cce80-42fb-4d4d-92e6-143468732ae4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:12.545561 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d54cce80-42fb-4d4d-92e6-143468732ae4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1471 microversion: 2.1 time: 0.382494 Oct 04 21:09:12.546606 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 494/985] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:12 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1471 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:12.555573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-07c01549-aa5c-4db1-adc4-30375290050e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:12.555573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-07c01549-aa5c-4db1-adc4-30375290050e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:12.559053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07c01549-aa5c-4db1-adc4-30375290050e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:12.559809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07c01549-aa5c-4db1-adc4-30375290050e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:12.561733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07c01549-aa5c-4db1-adc4-30375290050e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:12.562706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07c01549-aa5c-4db1-adc4-30375290050e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:12.563386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07c01549-aa5c-4db1-adc4-30375290050e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:12.564053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07c01549-aa5c-4db1-adc4-30375290050e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:12.631538 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-61c82a0e-d8bd-47b1-a86f-b7ea46804398 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.550452 Oct 04 21:09:12.632193 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 492/986] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:09:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:09:12.838028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-07c01549-aa5c-4db1-adc4-30375290050e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:12.855268 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-07c01549-aa5c-4db1-adc4-30375290050e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 200 len: 1465 microversion: 2.1 time: 0.307420 Oct 04 21:09:12.856300 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 495/987] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:12 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 1465 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:12.866703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8d986b9e-443f-4945-aa44-07762774246a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:12.867318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8d986b9e-443f-4945-aa44-07762774246a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:12.879742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3bb1dd33-2063-49c2-b52e-e0e1ff2c237c tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:12.880608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3bb1dd33-2063-49c2-b52e-e0e1ff2c237c tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:12.880934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d986b9e-443f-4945-aa44-07762774246a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:12.881470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d986b9e-443f-4945-aa44-07762774246a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:12.885631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d986b9e-443f-4945-aa44-07762774246a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:12.886384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d986b9e-443f-4945-aa44-07762774246a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:12.886857 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d986b9e-443f-4945-aa44-07762774246a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:12.889275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d986b9e-443f-4945-aa44-07762774246a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:12.895345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bb1dd33-2063-49c2-b52e-e0e1ff2c237c tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:12.896021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bb1dd33-2063-49c2-b52e-e0e1ff2c237c tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:12.896621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bb1dd33-2063-49c2-b52e-e0e1ff2c237c tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:12.897517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bb1dd33-2063-49c2-b52e-e0e1ff2c237c tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:12.898124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bb1dd33-2063-49c2-b52e-e0e1ff2c237c tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:12.898699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bb1dd33-2063-49c2-b52e-e0e1ff2c237c tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:13.235798 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3bb1dd33-2063-49c2-b52e-e0e1ff2c237c tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 200 len: 1616 microversion: 2.1 time: 0.359589 Oct 04 21:09:13.239023 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 496/988] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:12 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 1616 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:13.247308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-793c4b3f-2a83-4cbd-9f1b-9d5de5a3291e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1630600151", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:13.353230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8d986b9e-443f-4945-aa44-07762774246a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:13.366977 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8d986b9e-443f-4945-aa44-07762774246a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1304 microversion: 2.1 time: 0.504918 Oct 04 21:09:13.370542 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 493/989] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:12 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1304 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:13.417111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-793c4b3f-2a83-4cbd-9f1b-9d5de5a3291e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:09:13.668607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ad3eb7d9-b35e-4922-9b6c-83c03d199a1e tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Calling method '.version_select at 0x7f5790494a60>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:13.681755 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ad3eb7d9-b35e-4922-9b6c-83c03d199a1e tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '434fc3dc294a4198b4f4881d2da3d844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80784aaf41c544ecb8df588c80f1e526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ad3eb7d9-b35e-4922-9b6c-83c03d199a1e tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Request method failure captured: Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKD34FbFIjfnEvv1lctt93F7T_0v4GleTRcwFz30UJN68DU9qksZuw2UBaR2RkVSpkmok0FXddjxNCVw-HPjux6JFqLbrgoIktNqKVwUN2I1kePowo8kS7Kr4gBNmr3dsFewk-9G3VXHlQG5KjZDZh1NJ5_2LRYZ5-a_Ao5NYd25ywY Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 80784aaf41c544ecb8df588c80f1e526 Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-467704213 Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/80784aaf41c544ecb8df588c80f1e526"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_80784aaf41c544ecb8df588c80f1e526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/80784aaf41c544ecb8df588c80f1e526"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/80784aaf41c544ecb8df588c80f1e526"}]}] Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-467704213 Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 80784aaf41c544ecb8df588c80f1e526 Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-467704213 Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-HypervisorAdminNegativeTestJSON-467704213-project Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 434fc3dc294a4198b4f4881d2da3d844 Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-467704213-project Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: action_args: {} Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 21:09:13.687916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:13.696113 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:13.696113 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:13.696113 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:13.696113 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:13.696113 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:13.696113 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:09:13.696113 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:09:13.696113 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 21:09:13.696113 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:13.696113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ad3eb7d9-b35e-4922-9b6c-83c03d199a1e tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:09:13.696113 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ad3eb7d9-b35e-4922-9b6c-83c03d199a1e tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.318097 Oct 04 21:09:13.703323 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 494/990] 10.222.0.30 () {58 vars in 1167 bytes} [Tue Oct 4 21:09:13 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 332 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:09:13.714692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2679b3be-8f64-427b-9027-e39201982d16 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:13.715544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2679b3be-8f64-427b-9027-e39201982d16 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:13.724623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-793c4b3f-2a83-4cbd-9f1b-9d5de5a3291e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:09:13.725727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-793c4b3f-2a83-4cbd-9f1b-9d5de5a3291e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:09:13.726370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-793c4b3f-2a83-4cbd-9f1b-9d5de5a3291e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:09:13.727011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-793c4b3f-2a83-4cbd-9f1b-9d5de5a3291e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:09:13.727590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-793c4b3f-2a83-4cbd-9f1b-9d5de5a3291e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:09:13.730652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2679b3be-8f64-427b-9027-e39201982d16 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:13.734141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2679b3be-8f64-427b-9027-e39201982d16 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:13.734730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2679b3be-8f64-427b-9027-e39201982d16 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:13.735760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2679b3be-8f64-427b-9027-e39201982d16 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:13.736235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2679b3be-8f64-427b-9027-e39201982d16 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:13.737004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2679b3be-8f64-427b-9027-e39201982d16 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:13.742143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-793c4b3f-2a83-4cbd-9f1b-9d5de5a3291e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:13.742646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-793c4b3f-2a83-4cbd-9f1b-9d5de5a3291e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:13.743147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-793c4b3f-2a83-4cbd-9f1b-9d5de5a3291e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:13.745385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-793c4b3f-2a83-4cbd-9f1b-9d5de5a3291e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:13.745385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-793c4b3f-2a83-4cbd-9f1b-9d5de5a3291e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:13.745385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-793c4b3f-2a83-4cbd-9f1b-9d5de5a3291e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:13.772080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-793c4b3f-2a83-4cbd-9f1b-9d5de5a3291e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Getting quotas for project aa2f4ca02ad74730963245d9e018a386. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:09:13.808143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-793c4b3f-2a83-4cbd-9f1b-9d5de5a3291e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Getting quotas for user 5320f1606bbc49d693ae96f7b7ac516a and project aa2f4ca02ad74730963245d9e018a386. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:09:13.834913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-793c4b3f-2a83-4cbd-9f1b-9d5de5a3291e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:09:13.847802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2679b3be-8f64-427b-9027-e39201982d16 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:13.851683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-793c4b3f-2a83-4cbd-9f1b-9d5de5a3291e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:09:13.869621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2679b3be-8f64-427b-9027-e39201982d16 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:13.872084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2679b3be-8f64-427b-9027-e39201982d16 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:13.890137 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2679b3be-8f64-427b-9027-e39201982d16 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.183928 Oct 04 21:09:13.897595 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 495/991] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:13 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:13.901698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7f034111-12e5-47a1-8382-2db4b5fac2be tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1778352083", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["f201296c-ba54-4f1e-984a-461dfe55d267"]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:13.925275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:14.000828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-7f034111-12e5-47a1-8382-2db4b5fac2be tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] validate_networks() for None {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:09:14.058847 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-793c4b3f-2a83-4cbd-9f1b-9d5de5a3291e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.818458 Oct 04 21:09:14.060527 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 497/992] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:09:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:09:14.084846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6789b0f3-b7a3-426f-9963-b83ba6d494c4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:14.089077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6789b0f3-b7a3-426f-9963-b83ba6d494c4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:14.118482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6789b0f3-b7a3-426f-9963-b83ba6d494c4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:14.120685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6789b0f3-b7a3-426f-9963-b83ba6d494c4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:14.121714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6789b0f3-b7a3-426f-9963-b83ba6d494c4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:14.124484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6789b0f3-b7a3-426f-9963-b83ba6d494c4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:14.125271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6789b0f3-b7a3-426f-9963-b83ba6d494c4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:14.125973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6789b0f3-b7a3-426f-9963-b83ba6d494c4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:14.518856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7f034111-12e5-47a1-8382-2db4b5fac2be tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:09:14.519412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7f034111-12e5-47a1-8382-2db4b5fac2be tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:09:14.520132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7f034111-12e5-47a1-8382-2db4b5fac2be tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:09:14.520719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7f034111-12e5-47a1-8382-2db4b5fac2be tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:09:14.521634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7f034111-12e5-47a1-8382-2db4b5fac2be tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:09:14.533043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6789b0f3-b7a3-426f-9963-b83ba6d494c4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:14.545113 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6789b0f3-b7a3-426f-9963-b83ba6d494c4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1471 microversion: 2.1 time: 0.479345 Oct 04 21:09:14.545845 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 498/993] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:14 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1471 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:14.547129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f034111-12e5-47a1-8382-2db4b5fac2be tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:14.547634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f034111-12e5-47a1-8382-2db4b5fac2be tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:14.548076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f034111-12e5-47a1-8382-2db4b5fac2be tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:14.548884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f034111-12e5-47a1-8382-2db4b5fac2be tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:14.549353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f034111-12e5-47a1-8382-2db4b5fac2be tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:14.549821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f034111-12e5-47a1-8382-2db4b5fac2be tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:14.550495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8ea14e8b-b202-4a21-8eb4-6fc5169b7a5e tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Calling method '.version_select at 0x7f57900b59d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:14.552293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8ea14e8b-b202-4a21-8eb4-6fc5169b7a5e tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '434fc3dc294a4198b4f4881d2da3d844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80784aaf41c544ecb8df588c80f1e526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8ea14e8b-b202-4a21-8eb4-6fc5169b7a5e tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Request method failure captured: Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKD34FbFIjfnEvv1lctt93F7T_0v4GleTRcwFz30UJN68DU9qksZuw2UBaR2RkVSpkmok0FXddjxNCVw-HPjux6JFqLbrgoIktNqKVwUN2I1kePowo8kS7Kr4gBNmr3dsFewk-9G3VXHlQG5KjZDZh1NJ5_2LRYZ5-a_Ao5NYd25ywY Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 80784aaf41c544ecb8df588c80f1e526 Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-467704213 Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/80784aaf41c544ecb8df588c80f1e526"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_80784aaf41c544ecb8df588c80f1e526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/80784aaf41c544ecb8df588c80f1e526"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/80784aaf41c544ecb8df588c80f1e526"}]}] Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-467704213 Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 80784aaf41c544ecb8df588c80f1e526 Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-467704213 Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-HypervisorAdminNegativeTestJSON-467704213-project Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 434fc3dc294a4198b4f4881d2da3d844 Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-467704213-project Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: action_args: {} Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 21:09:14.554067 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:09:14.557947 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:14.557947 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:09:14.557947 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:14.557947 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:14.557947 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:14.557947 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:09:14.557947 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:09:14.557947 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 21:09:14.557947 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:09:14.557947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8ea14e8b-b202-4a21-8eb4-6fc5169b7a5e tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:09:14.557947 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8ea14e8b-b202-4a21-8eb4-6fc5169b7a5e tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.008633 Oct 04 21:09:14.557947 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 499/994] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:09:14 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:09:14.572798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7d48c716-8224-4879-bd40-f475c063dd89 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:14.572798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7d48c716-8224-4879-bd40-f475c063dd89 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:14.582368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-7f034111-12e5-47a1-8382-2db4b5fac2be tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:09:14.588704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-7f034111-12e5-47a1-8382-2db4b5fac2be tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for user 0f0ac29dc4e440e785408fa1dfedce5e and project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:09:14.591786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:14.603906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7f034111-12e5-47a1-8382-2db4b5fac2be tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:09:14.608278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7f034111-12e5-47a1-8382-2db4b5fac2be tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:09:14.649250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7d48c716-8224-4879-bd40-f475c063dd89 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:14.657693 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7d48c716-8224-4879-bd40-f475c063dd89 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1214 microversion: 2.1 time: 0.100767 Oct 04 21:09:14.661140 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 500/995] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:14 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:14.669939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-94166f89-b9ce-4fea-86be-eb4891b163ba tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:14.671184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-94166f89-b9ce-4fea-86be-eb4891b163ba tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:14.687709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94166f89-b9ce-4fea-86be-eb4891b163ba tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:14.687709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94166f89-b9ce-4fea-86be-eb4891b163ba tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:14.688749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94166f89-b9ce-4fea-86be-eb4891b163ba tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:14.690148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94166f89-b9ce-4fea-86be-eb4891b163ba tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:14.690914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94166f89-b9ce-4fea-86be-eb4891b163ba tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:14.692046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94166f89-b9ce-4fea-86be-eb4891b163ba tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:14.792741 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7f034111-12e5-47a1-8382-2db4b5fac2be tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.900862 Oct 04 21:09:14.795850 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 496/996] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:09:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:09:14.811010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-45767b7c-8100-4842-9156-ebbe9551b788 tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Calling method '.version_select at 0x7f57904944c0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:14.813322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-45767b7c-8100-4842-9156-ebbe9551b788 tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '434fc3dc294a4198b4f4881d2da3d844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80784aaf41c544ecb8df588c80f1e526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-45767b7c-8100-4842-9156-ebbe9551b788 tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Request method failure captured: Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKD34FbFIjfnEvv1lctt93F7T_0v4GleTRcwFz30UJN68DU9qksZuw2UBaR2RkVSpkmok0FXddjxNCVw-HPjux6JFqLbrgoIktNqKVwUN2I1kePowo8kS7Kr4gBNmr3dsFewk-9G3VXHlQG5KjZDZh1NJ5_2LRYZ5-a_Ao5NYd25ywY Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 80784aaf41c544ecb8df588c80f1e526 Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-467704213 Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/80784aaf41c544ecb8df588c80f1e526"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_80784aaf41c544ecb8df588c80f1e526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/80784aaf41c544ecb8df588c80f1e526"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/80784aaf41c544ecb8df588c80f1e526"}]}] Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-467704213 Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 80784aaf41c544ecb8df588c80f1e526 Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-467704213 Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-HypervisorAdminNegativeTestJSON-467704213-project Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 434fc3dc294a4198b4f4881d2da3d844 Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-467704213-project Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: action_args: {} Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:14.815227 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:14.819988 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:14.819988 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:14.819988 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:09:14.819988 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:09:14.819988 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 21:09:14.819988 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:14.819988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-45767b7c-8100-4842-9156-ebbe9551b788 tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:09:14.819988 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-45767b7c-8100-4842-9156-ebbe9551b788 tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.019009 Oct 04 21:09:14.819988 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 497/997] 10.222.0.30 () {58 vars in 1179 bytes} [Tue Oct 4 21:09:14 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:09:14.840747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-99288d7b-2804-4e03-95a5-03f90c04fd6a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:14.841466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-99288d7b-2804-4e03-95a5-03f90c04fd6a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:14.983451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-99288d7b-2804-4e03-95a5-03f90c04fd6a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:14.993231 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-99288d7b-2804-4e03-95a5-03f90c04fd6a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1217 microversion: 2.1 time: 0.172404 Oct 04 21:09:14.994094 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 498/998] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:14 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1217 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:15.135867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-64499885-e9c3-4d96-8e92-ad02d8c3cbc3 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Calling method '.version_select at 0x7f5790318d30>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:15.138281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64499885-e9c3-4d96-8e92-ad02d8c3cbc3 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:15.139042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64499885-e9c3-4d96-8e92-ad02d8c3cbc3 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:15.139343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64499885-e9c3-4d96-8e92-ad02d8c3cbc3 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:15.173246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-94166f89-b9ce-4fea-86be-eb4891b163ba tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:15.174209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64499885-e9c3-4d96-8e92-ad02d8c3cbc3 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:15.174717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64499885-e9c3-4d96-8e92-ad02d8c3cbc3 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:15.175162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64499885-e9c3-4d96-8e92-ad02d8c3cbc3 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:15.188360 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-94166f89-b9ce-4fea-86be-eb4891b163ba tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1304 microversion: 2.1 time: 0.525066 Oct 04 21:09:15.204124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64499885-e9c3-4d96-8e92-ad02d8c3cbc3 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:15.204124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64499885-e9c3-4d96-8e92-ad02d8c3cbc3 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:15.204124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64499885-e9c3-4d96-8e92-ad02d8c3cbc3 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:15.209855 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 501/999] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:14 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1304 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:15.210104 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-64499885-e9c3-4d96-8e92-ad02d8c3cbc3 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.202579 Oct 04 21:09:15.210711 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 499/1000] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:09:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:15.222036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-eff6e76f-42fe-4986-b8d9-df29b9b0ee0a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:15.229051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-eff6e76f-42fe-4986-b8d9-df29b9b0ee0a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:15.231314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c120a3fa-05ee-4901-a3dc-52b82768deee tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Calling method '.version_select at 0x7f579038c700>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:15.236808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c120a3fa-05ee-4901-a3dc-52b82768deee tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '434fc3dc294a4198b4f4881d2da3d844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80784aaf41c544ecb8df588c80f1e526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c120a3fa-05ee-4901-a3dc-52b82768deee tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Request method failure captured: Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKD34FbFIjfnEvv1lctt93F7T_0v4GleTRcwFz30UJN68DU9qksZuw2UBaR2RkVSpkmok0FXddjxNCVw-HPjux6JFqLbrgoIktNqKVwUN2I1kePowo8kS7Kr4gBNmr3dsFewk-9G3VXHlQG5KjZDZh1NJ5_2LRYZ5-a_Ao5NYd25ywY Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 80784aaf41c544ecb8df588c80f1e526 Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-467704213 Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/80784aaf41c544ecb8df588c80f1e526"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_80784aaf41c544ecb8df588c80f1e526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/80784aaf41c544ecb8df588c80f1e526"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/80784aaf41c544ecb8df588c80f1e526"}]}] Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-467704213 Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 80784aaf41c544ecb8df588c80f1e526 Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-467704213 Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-HypervisorAdminNegativeTestJSON-467704213-project Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 434fc3dc294a4198b4f4881d2da3d844 Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-467704213-project Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '1'} Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.240635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:15.253745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:15.253745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:15.253745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:09:15.253745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:09:15.253745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 21:09:15.253745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.253745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c120a3fa-05ee-4901-a3dc-52b82768deee tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:09:15.255072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eff6e76f-42fe-4986-b8d9-df29b9b0ee0a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:15.255219 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c120a3fa-05ee-4901-a3dc-52b82768deee tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.024219 Oct 04 21:09:15.255358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eff6e76f-42fe-4986-b8d9-df29b9b0ee0a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:15.255358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eff6e76f-42fe-4986-b8d9-df29b9b0ee0a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:15.255712 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 500/1001] 10.222.0.30 () {58 vars in 1173 bytes} [Tue Oct 4 21:09:15 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:09:15.255849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eff6e76f-42fe-4986-b8d9-df29b9b0ee0a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:15.255849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eff6e76f-42fe-4986-b8d9-df29b9b0ee0a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:15.255849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eff6e76f-42fe-4986-b8d9-df29b9b0ee0a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:15.260861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fab3777a-64b1-43e0-acdb-c0f1844924cd tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Calling method '.version_select at 0x7f579031e940>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:15.262579 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-fab3777a-64b1-43e0-acdb-c0f1844924cd tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] HTTP exception thrown: Hypervisor with ID 'c1ac6578-3175-4809-af8d-0835a46d2384' could not be found. Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fab3777a-64b1-43e0-acdb-c0f1844924cd tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Request method failure captured: Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-hypervisors/c1ac6578-3175-4809-af8d-0835a46d2384/uptime HTTP/1.1 Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKD4t9wUTaSbn7qq25GVWXoG7a2GkjIgKaCsMJc3OBN9Hx9A9hZLMbZqcxgmwSLIC7hwDCREh7Lo3TKLB2NWP7WzkxD7_nkEEXWQnvWjhqrcuF14rP1Fr4L2sHELCMDD5kcBdYiQFw6CJATz3WWPAEKnY5199b7xoz0aHd64bkrFdIg Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f0f4fa3df07641bab4a79717aaef8c56 Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1270541161 Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f0f4fa3df07641bab4a79717aaef8c56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f0f4fa3df07641bab4a79717aaef8c56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f0f4fa3df07641bab4a79717aaef8c56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f0f4fa3df07641bab4a79717aaef8c56"}]}] Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1270541161 Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f0f4fa3df07641bab4a79717aaef8c56 Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1270541161 Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 53e9a9a7de9747e88230f87541d6d835 Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: exception: Hypervisor with ID 'c1ac6578-3175-4809-af8d-0835a46d2384' could not be found. Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'c1ac6578-3175-4809-af8d-0835a46d2384'} Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'c1ac6578-3175-4809-af8d-0835a46d2384' Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:09:15.274377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'c1ac6578-3175-4809-af8d-0835a46d2384' could not be found. Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'c1ac6578-3175-4809-af8d-0835a46d2384' could not be found. Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fab3777a-64b1-43e0-acdb-c0f1844924cd tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Returning 404 to user: Hypervisor with ID 'c1ac6578-3175-4809-af8d-0835a46d2384' could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fab3777a-64b1-43e0-acdb-c0f1844924cd tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/c1ac6578-3175-4809-af8d-0835a46d2384/uptime" status: 404 len: 123 microversion: 2.1 time: 0.023436 Oct 04 21:09:15.285749 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 501/1002] 10.222.0.30 () {58 vars in 1278 bytes} [Tue Oct 4 21:09:15 2022] GET /compute/v2.1/os-hypervisors/c1ac6578-3175-4809-af8d-0835a46d2384/uptime => generated 123 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:09:15.290834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2b21acb3-450f-406c-a3e2-e3e334aeb0e1 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Calling method '.version_select at 0x7f579111bc10>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:15.293811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b21acb3-450f-406c-a3e2-e3e334aeb0e1 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:15.296455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b21acb3-450f-406c-a3e2-e3e334aeb0e1 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:15.297036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b21acb3-450f-406c-a3e2-e3e334aeb0e1 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:15.317920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b21acb3-450f-406c-a3e2-e3e334aeb0e1 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:15.318558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b21acb3-450f-406c-a3e2-e3e334aeb0e1 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:15.319236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b21acb3-450f-406c-a3e2-e3e334aeb0e1 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:15.333657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b21acb3-450f-406c-a3e2-e3e334aeb0e1 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:15.334563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b21acb3-450f-406c-a3e2-e3e334aeb0e1 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:15.335223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b21acb3-450f-406c-a3e2-e3e334aeb0e1 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:15.344552 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2b21acb3-450f-406c-a3e2-e3e334aeb0e1 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.060619 Oct 04 21:09:15.345874 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 502/1003] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:09:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:15.359086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ca6a16e7-ea87-487e-9bab-394df66fd9db tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Calling method '.version_select at 0x7f579038c700>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:15.363522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ca6a16e7-ea87-487e-9bab-394df66fd9db tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '434fc3dc294a4198b4f4881d2da3d844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80784aaf41c544ecb8df588c80f1e526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:15.367408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-eff6e76f-42fe-4986-b8d9-df29b9b0ee0a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ca6a16e7-ea87-487e-9bab-394df66fd9db tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Request method failure captured: Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKD34FbFIjfnEvv1lctt93F7T_0v4GleTRcwFz30UJN68DU9qksZuw2UBaR2RkVSpkmok0FXddjxNCVw-HPjux6JFqLbrgoIktNqKVwUN2I1kePowo8kS7Kr4gBNmr3dsFewk-9G3VXHlQG5KjZDZh1NJ5_2LRYZ5-a_Ao5NYd25ywY Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 80784aaf41c544ecb8df588c80f1e526 Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-467704213 Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/80784aaf41c544ecb8df588c80f1e526"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_80784aaf41c544ecb8df588c80f1e526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/80784aaf41c544ecb8df588c80f1e526"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/80784aaf41c544ecb8df588c80f1e526"}]}] Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-467704213 Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 80784aaf41c544ecb8df588c80f1e526 Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-467704213 Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-HypervisorAdminNegativeTestJSON-467704213-project Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 434fc3dc294a4198b4f4881d2da3d844 Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-467704213-project Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '1'} Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 21:09:15.368292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.374584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:15.374584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.374584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:15.374584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:15.374584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:15.374584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:09:15.374584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:09:15.374584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 21:09:15.374584 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.377317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ca6a16e7-ea87-487e-9bab-394df66fd9db tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:09:15.379504 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ca6a16e7-ea87-487e-9bab-394df66fd9db tempest-HypervisorAdminNegativeTestJSON-467704213 tempest-HypervisorAdminNegativeTestJSON-467704213-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.025810 Oct 04 21:09:15.380601 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 503/1004] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:09:15 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:09:15.384275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-eff6e76f-42fe-4986-b8d9-df29b9b0ee0a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:15.384594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-eff6e76f-42fe-4986-b8d9-df29b9b0ee0a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:15.405998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b33eeba9-9eef-4db8-bb15-95cb90f75617 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Calling method '.version_select at 0x7f579031e790>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:15.421010 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-b33eeba9-9eef-4db8-bb15-95cb90f75617 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] HTTP exception thrown: Hypervisor with ID '1091d139-ccba-4f46-8a01-989e4f62973c' could not be found. Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b33eeba9-9eef-4db8-bb15-95cb90f75617 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Request method failure captured: Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-hypervisors/1091d139-ccba-4f46-8a01-989e4f62973c HTTP/1.1 Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKD4t9wUTaSbn7qq25GVWXoG7a2GkjIgKaCsMJc3OBN9Hx9A9hZLMbZqcxgmwSLIC7hwDCREh7Lo3TKLB2NWP7WzkxD7_nkEEXWQnvWjhqrcuF14rP1Fr4L2sHELCMDD5kcBdYiQFw6CJATz3WWPAEKnY5199b7xoz0aHd64bkrFdIg Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f0f4fa3df07641bab4a79717aaef8c56 Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1270541161 Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f0f4fa3df07641bab4a79717aaef8c56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f0f4fa3df07641bab4a79717aaef8c56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f0f4fa3df07641bab4a79717aaef8c56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f0f4fa3df07641bab4a79717aaef8c56"}]}] Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1270541161 Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f0f4fa3df07641bab4a79717aaef8c56 Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1270541161 Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 53e9a9a7de9747e88230f87541d6d835 Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: exception: Hypervisor with ID '1091d139-ccba-4f46-8a01-989e4f62973c' could not be found. Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '1091d139-ccba-4f46-8a01-989e4f62973c'} Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '1091d139-ccba-4f46-8a01-989e4f62973c' Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:09:15.427891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '1091d139-ccba-4f46-8a01-989e4f62973c' could not be found. Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '1091d139-ccba-4f46-8a01-989e4f62973c' could not be found. Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b33eeba9-9eef-4db8-bb15-95cb90f75617 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] Returning 404 to user: Hypervisor with ID '1091d139-ccba-4f46-8a01-989e4f62973c' could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:09:15.440921 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b33eeba9-9eef-4db8-bb15-95cb90f75617 tempest-HypervisorAdminNegativeTestJSON-1270541161 tempest-HypervisorAdminNegativeTestJSON-1270541161-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1091d139-ccba-4f46-8a01-989e4f62973c" status: 404 len: 123 microversion: 2.1 time: 0.045397 Oct 04 21:09:15.445750 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-eff6e76f-42fe-4986-b8d9-df29b9b0ee0a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.214362 Oct 04 21:09:15.445905 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 504/1005] 10.222.0.30 () {58 vars in 1257 bytes} [Tue Oct 4 21:09:15 2022] GET /compute/v2.1/os-hypervisors/1091d139-ccba-4f46-8a01-989e4f62973c => generated 123 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:09:15.461888 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 502/1006] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:15 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:15.576260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eb01adb8-1a02-4879-b167-561d01cb8008 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:15.577166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eb01adb8-1a02-4879-b167-561d01cb8008 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:15.584026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb01adb8-1a02-4879-b167-561d01cb8008 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:15.584814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb01adb8-1a02-4879-b167-561d01cb8008 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:15.591676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb01adb8-1a02-4879-b167-561d01cb8008 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:15.591676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb01adb8-1a02-4879-b167-561d01cb8008 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:15.591676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb01adb8-1a02-4879-b167-561d01cb8008 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:15.591676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb01adb8-1a02-4879-b167-561d01cb8008 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:15.690824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5196cb81-cbc2-40a6-8274-d428f261a350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:15.691719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5196cb81-cbc2-40a6-8274-d428f261a350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:15.707620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5196cb81-cbc2-40a6-8274-d428f261a350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:15.722758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5196cb81-cbc2-40a6-8274-d428f261a350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:15.723689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5196cb81-cbc2-40a6-8274-d428f261a350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:15.730035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5196cb81-cbc2-40a6-8274-d428f261a350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:15.733624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5196cb81-cbc2-40a6-8274-d428f261a350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:15.735750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5196cb81-cbc2-40a6-8274-d428f261a350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:15.961771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5196cb81-cbc2-40a6-8274-d428f261a350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:15.974584 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5196cb81-cbc2-40a6-8274-d428f261a350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1218 microversion: 2.1 time: 0.289270 Oct 04 21:09:15.975452 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 503/1007] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:15 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1218 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:16.001037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eb01adb8-1a02-4879-b167-561d01cb8008 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:16.013402 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eb01adb8-1a02-4879-b167-561d01cb8008 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1471 microversion: 2.1 time: 0.441320 Oct 04 21:09:16.022736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-376866ab-8814-47be-ac15-b11289e26579 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:16.022736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-376866ab-8814-47be-ac15-b11289e26579 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:16.041715 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 505/1008] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:15 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1471 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:16.165956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-376866ab-8814-47be-ac15-b11289e26579 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:16.175528 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-376866ab-8814-47be-ac15-b11289e26579 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1217 microversion: 2.1 time: 0.159081 Oct 04 21:09:16.176976 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 504/1009] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:16 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:16.211652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-14a58ccd-69a1-44b6-95ed-a73a989ba0cd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:16.212272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-14a58ccd-69a1-44b6-95ed-a73a989ba0cd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:16.220998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14a58ccd-69a1-44b6-95ed-a73a989ba0cd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:16.221534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14a58ccd-69a1-44b6-95ed-a73a989ba0cd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:16.221993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14a58ccd-69a1-44b6-95ed-a73a989ba0cd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:16.222712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14a58ccd-69a1-44b6-95ed-a73a989ba0cd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:16.223197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14a58ccd-69a1-44b6-95ed-a73a989ba0cd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:16.232995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14a58ccd-69a1-44b6-95ed-a73a989ba0cd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:16.464123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f751d9bd-50dd-4a3e-886d-0821094e14de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:16.464744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f751d9bd-50dd-4a3e-886d-0821094e14de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:16.477963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f751d9bd-50dd-4a3e-886d-0821094e14de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:16.478483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f751d9bd-50dd-4a3e-886d-0821094e14de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:16.478916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f751d9bd-50dd-4a3e-886d-0821094e14de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:16.479628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f751d9bd-50dd-4a3e-886d-0821094e14de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:16.480086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f751d9bd-50dd-4a3e-886d-0821094e14de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:16.480507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f751d9bd-50dd-4a3e-886d-0821094e14de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:16.884972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f751d9bd-50dd-4a3e-886d-0821094e14de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:16.899661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f751d9bd-50dd-4a3e-886d-0821094e14de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:16.906137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f751d9bd-50dd-4a3e-886d-0821094e14de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:16.922720 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f751d9bd-50dd-4a3e-886d-0821094e14de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.462402 Oct 04 21:09:16.939854 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 505/1010] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:16 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:09:17.004980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8470ec70-3f81-4dbb-81da-32509288cc8c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:17.005701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8470ec70-3f81-4dbb-81da-32509288cc8c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:17.021034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8470ec70-3f81-4dbb-81da-32509288cc8c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:17.022131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8470ec70-3f81-4dbb-81da-32509288cc8c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:17.022591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8470ec70-3f81-4dbb-81da-32509288cc8c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:17.023423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8470ec70-3f81-4dbb-81da-32509288cc8c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:17.023895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8470ec70-3f81-4dbb-81da-32509288cc8c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:17.026485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8470ec70-3f81-4dbb-81da-32509288cc8c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:17.064406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-14a58ccd-69a1-44b6-95ed-a73a989ba0cd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:17.074874 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-14a58ccd-69a1-44b6-95ed-a73a989ba0cd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1304 microversion: 2.1 time: 0.866984 Oct 04 21:09:17.075540 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 506/1011] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:16 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1304 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:17.099412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab0c8ecd-c005-4422-8154-752edabf41e1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:17.100213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ab0c8ecd-c005-4422-8154-752edabf41e1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:17.126442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab0c8ecd-c005-4422-8154-752edabf41e1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:17.126442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab0c8ecd-c005-4422-8154-752edabf41e1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:17.126442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab0c8ecd-c005-4422-8154-752edabf41e1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:17.130903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab0c8ecd-c005-4422-8154-752edabf41e1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:17.131800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab0c8ecd-c005-4422-8154-752edabf41e1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:17.132500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab0c8ecd-c005-4422-8154-752edabf41e1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:17.139122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8470ec70-3f81-4dbb-81da-32509288cc8c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:17.157304 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8470ec70-3f81-4dbb-81da-32509288cc8c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1266 microversion: 2.1 time: 0.157423 Oct 04 21:09:17.163100 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 506/1012] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:16 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:17.200033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f62025e9-8186-4dca-85cc-4b7f64e9d43a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:17.200764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f62025e9-8186-4dca-85cc-4b7f64e9d43a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:17.213554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f62025e9-8186-4dca-85cc-4b7f64e9d43a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:17.214063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f62025e9-8186-4dca-85cc-4b7f64e9d43a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:17.218157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f62025e9-8186-4dca-85cc-4b7f64e9d43a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:17.218157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f62025e9-8186-4dca-85cc-4b7f64e9d43a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:17.218157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f62025e9-8186-4dca-85cc-4b7f64e9d43a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:17.218157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f62025e9-8186-4dca-85cc-4b7f64e9d43a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:17.374323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f62025e9-8186-4dca-85cc-4b7f64e9d43a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:17.391250 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f62025e9-8186-4dca-85cc-4b7f64e9d43a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1213 microversion: 2.1 time: 0.192496 Oct 04 21:09:17.391869 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 507/1013] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:17 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1213 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:17.410415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ab0c8ecd-c005-4422-8154-752edabf41e1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:17.420305 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ab0c8ecd-c005-4422-8154-752edabf41e1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1471 microversion: 2.1 time: 0.337201 Oct 04 21:09:17.421027 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 507/1014] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:17 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1471 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:17.973649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dc60dcea-997f-4077-8f31-1ec337f20ee9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:17.973649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dc60dcea-997f-4077-8f31-1ec337f20ee9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:17.973649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc60dcea-997f-4077-8f31-1ec337f20ee9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:17.973649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc60dcea-997f-4077-8f31-1ec337f20ee9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:17.973649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc60dcea-997f-4077-8f31-1ec337f20ee9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:17.973649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc60dcea-997f-4077-8f31-1ec337f20ee9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:17.973649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc60dcea-997f-4077-8f31-1ec337f20ee9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:17.973649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc60dcea-997f-4077-8f31-1ec337f20ee9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:18.030803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dc60dcea-997f-4077-8f31-1ec337f20ee9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:18.061365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dc60dcea-997f-4077-8f31-1ec337f20ee9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:18.062837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dc60dcea-997f-4077-8f31-1ec337f20ee9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:18.067803 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dc60dcea-997f-4077-8f31-1ec337f20ee9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.114839 Oct 04 21:09:18.068367 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 508/1015] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:17 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:18.106218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-abb2fd0a-55f7-4a2b-b5ac-d3b98417cb2e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:18.107379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-abb2fd0a-55f7-4a2b-b5ac-d3b98417cb2e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:18.113446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abb2fd0a-55f7-4a2b-b5ac-d3b98417cb2e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:18.114213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abb2fd0a-55f7-4a2b-b5ac-d3b98417cb2e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:18.114903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abb2fd0a-55f7-4a2b-b5ac-d3b98417cb2e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:18.115618 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abb2fd0a-55f7-4a2b-b5ac-d3b98417cb2e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:18.116083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abb2fd0a-55f7-4a2b-b5ac-d3b98417cb2e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:18.116506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abb2fd0a-55f7-4a2b-b5ac-d3b98417cb2e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:18.193348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3f74d7b4-8f73-4b50-84d7-c9c0ff69134d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:18.193933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3f74d7b4-8f73-4b50-84d7-c9c0ff69134d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:18.200035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f74d7b4-8f73-4b50-84d7-c9c0ff69134d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:18.200575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f74d7b4-8f73-4b50-84d7-c9c0ff69134d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:18.201359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f74d7b4-8f73-4b50-84d7-c9c0ff69134d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:18.202210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f74d7b4-8f73-4b50-84d7-c9c0ff69134d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:18.202686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f74d7b4-8f73-4b50-84d7-c9c0ff69134d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:18.203119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f74d7b4-8f73-4b50-84d7-c9c0ff69134d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:18.291600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3f74d7b4-8f73-4b50-84d7-c9c0ff69134d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:18.307798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-abb2fd0a-55f7-4a2b-b5ac-d3b98417cb2e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:18.322327 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3f74d7b4-8f73-4b50-84d7-c9c0ff69134d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1266 microversion: 2.1 time: 0.125704 Oct 04 21:09:18.322327 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 509/1016] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:18 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:18.322571 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-abb2fd0a-55f7-4a2b-b5ac-d3b98417cb2e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1304 microversion: 2.1 time: 0.216200 Oct 04 21:09:18.322571 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 508/1017] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:18 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1304 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:18.416003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0c910b4f-99da-4769-976e-d977802c7782 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:18.416715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0c910b4f-99da-4769-976e-d977802c7782 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:18.429726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c910b4f-99da-4769-976e-d977802c7782 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:18.430239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c910b4f-99da-4769-976e-d977802c7782 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:18.431003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c910b4f-99da-4769-976e-d977802c7782 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:18.431751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c910b4f-99da-4769-976e-d977802c7782 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:18.433717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c910b4f-99da-4769-976e-d977802c7782 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:18.434215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c910b4f-99da-4769-976e-d977802c7782 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:18.448428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-00a31e1a-267e-4871-a96b-3dd9277bc0c8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:18.449047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-00a31e1a-267e-4871-a96b-3dd9277bc0c8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:18.466737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00a31e1a-267e-4871-a96b-3dd9277bc0c8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:18.467256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00a31e1a-267e-4871-a96b-3dd9277bc0c8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:18.467762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00a31e1a-267e-4871-a96b-3dd9277bc0c8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:18.468488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00a31e1a-267e-4871-a96b-3dd9277bc0c8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:18.468950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00a31e1a-267e-4871-a96b-3dd9277bc0c8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:18.469385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00a31e1a-267e-4871-a96b-3dd9277bc0c8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:18.757535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0c910b4f-99da-4769-976e-d977802c7782 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:18.764602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:18.768324 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0c910b4f-99da-4769-976e-d977802c7782 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1269 microversion: 2.1 time: 0.356309 Oct 04 21:09:18.769045 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 510/1018] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:18 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1269 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:18.870302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-00a31e1a-267e-4871-a96b-3dd9277bc0c8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:18.884022 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-00a31e1a-267e-4871-a96b-3dd9277bc0c8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.439544 Oct 04 21:09:18.899561 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 509/1019] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:18 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:19.096262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d32bcaa8-f89c-41fd-aa13-d71c90806e5c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:19.096988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d32bcaa8-f89c-41fd-aa13-d71c90806e5c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:19.103972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d32bcaa8-f89c-41fd-aa13-d71c90806e5c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:19.104590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d32bcaa8-f89c-41fd-aa13-d71c90806e5c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:19.105006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d32bcaa8-f89c-41fd-aa13-d71c90806e5c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:19.105738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d32bcaa8-f89c-41fd-aa13-d71c90806e5c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:19.106189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d32bcaa8-f89c-41fd-aa13-d71c90806e5c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:19.106664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d32bcaa8-f89c-41fd-aa13-d71c90806e5c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:19.201623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d32bcaa8-f89c-41fd-aa13-d71c90806e5c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:19.212645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d32bcaa8-f89c-41fd-aa13-d71c90806e5c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:19.215603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d32bcaa8-f89c-41fd-aa13-d71c90806e5c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:19.221573 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d32bcaa8-f89c-41fd-aa13-d71c90806e5c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.130350 Oct 04 21:09:19.245371 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 511/1020] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:19 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:19.359239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-57f43347-0ca6-412e-b116-28546056f44a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:19.360098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f4d51f9c-bb6d-4188-980d-6a13645a1e03 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:19.361137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-57f43347-0ca6-412e-b116-28546056f44a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:19.361766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f4d51f9c-bb6d-4188-980d-6a13645a1e03 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:19.385140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57f43347-0ca6-412e-b116-28546056f44a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:19.385678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57f43347-0ca6-412e-b116-28546056f44a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:19.387770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57f43347-0ca6-412e-b116-28546056f44a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:19.389855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57f43347-0ca6-412e-b116-28546056f44a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:19.390346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57f43347-0ca6-412e-b116-28546056f44a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:19.391779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4d51f9c-bb6d-4188-980d-6a13645a1e03 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:19.392308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4d51f9c-bb6d-4188-980d-6a13645a1e03 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:19.392762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4d51f9c-bb6d-4188-980d-6a13645a1e03 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:19.393555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4d51f9c-bb6d-4188-980d-6a13645a1e03 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:19.393975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4d51f9c-bb6d-4188-980d-6a13645a1e03 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:19.394407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4d51f9c-bb6d-4188-980d-6a13645a1e03 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:19.400192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57f43347-0ca6-412e-b116-28546056f44a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:19.695367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-57f43347-0ca6-412e-b116-28546056f44a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:19.707152 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-57f43347-0ca6-412e-b116-28546056f44a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1272 microversion: 2.1 time: 0.350293 Oct 04 21:09:19.717468 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 512/1021] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:19 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1272 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:19.795423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b1baac72-99a7-4a93-9012-01ea1e2875ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:19.796125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b1baac72-99a7-4a93-9012-01ea1e2875ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:19.803090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1baac72-99a7-4a93-9012-01ea1e2875ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:19.803581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1baac72-99a7-4a93-9012-01ea1e2875ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:19.804014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1baac72-99a7-4a93-9012-01ea1e2875ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:19.804987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1baac72-99a7-4a93-9012-01ea1e2875ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:19.805459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1baac72-99a7-4a93-9012-01ea1e2875ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:19.805965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1baac72-99a7-4a93-9012-01ea1e2875ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:19.853893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f4d51f9c-bb6d-4188-980d-6a13645a1e03 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:19.864883 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f4d51f9c-bb6d-4188-980d-6a13645a1e03 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1292 microversion: 2.1 time: 0.520645 Oct 04 21:09:19.868027 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 510/1022] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:19 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1292 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:19.918740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d07476f1-2057-4439-aca3-97bba15c1d7d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:19.919550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d07476f1-2057-4439-aca3-97bba15c1d7d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:19.928758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d07476f1-2057-4439-aca3-97bba15c1d7d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:19.929731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d07476f1-2057-4439-aca3-97bba15c1d7d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:19.933191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d07476f1-2057-4439-aca3-97bba15c1d7d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:19.934695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d07476f1-2057-4439-aca3-97bba15c1d7d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:19.935871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d07476f1-2057-4439-aca3-97bba15c1d7d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:19.940263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d07476f1-2057-4439-aca3-97bba15c1d7d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:19.953808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b1baac72-99a7-4a93-9012-01ea1e2875ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:19.966227 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b1baac72-99a7-4a93-9012-01ea1e2875ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1277 microversion: 2.1 time: 0.173175 Oct 04 21:09:19.970321 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 513/1023] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:19 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:20.250188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d07476f1-2057-4439-aca3-97bba15c1d7d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:20.254314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-317b0a7a-2d72-42e0-8152-800b4ef6afad tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:20.254833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-317b0a7a-2d72-42e0-8152-800b4ef6afad tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:20.259724 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d07476f1-2057-4439-aca3-97bba15c1d7d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.348541 Oct 04 21:09:20.260635 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 511/1024] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:19 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:20.264424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-317b0a7a-2d72-42e0-8152-800b4ef6afad tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:20.267429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-317b0a7a-2d72-42e0-8152-800b4ef6afad tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:20.267429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-317b0a7a-2d72-42e0-8152-800b4ef6afad tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:20.275359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-317b0a7a-2d72-42e0-8152-800b4ef6afad tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:20.275959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-317b0a7a-2d72-42e0-8152-800b4ef6afad tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:20.276596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-317b0a7a-2d72-42e0-8152-800b4ef6afad tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:20.438396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-317b0a7a-2d72-42e0-8152-800b4ef6afad tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:20.452773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-317b0a7a-2d72-42e0-8152-800b4ef6afad tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:20.454719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-317b0a7a-2d72-42e0-8152-800b4ef6afad tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:20.461764 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-317b0a7a-2d72-42e0-8152-800b4ef6afad tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.211453 Oct 04 21:09:20.478817 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 514/1025] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:20 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:09:20.733918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-01644be6-bd37-4076-88e0-b5f717ea9b0a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:20.736525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-01644be6-bd37-4076-88e0-b5f717ea9b0a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:20.753101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01644be6-bd37-4076-88e0-b5f717ea9b0a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:20.754251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01644be6-bd37-4076-88e0-b5f717ea9b0a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:20.754925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01644be6-bd37-4076-88e0-b5f717ea9b0a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:20.755898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01644be6-bd37-4076-88e0-b5f717ea9b0a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:20.761032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01644be6-bd37-4076-88e0-b5f717ea9b0a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:20.761032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01644be6-bd37-4076-88e0-b5f717ea9b0a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:20.788487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:20.896786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-13180afb-9416-4520-bf47-995eec23b106 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:20.897740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-13180afb-9416-4520-bf47-995eec23b106 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:20.908134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13180afb-9416-4520-bf47-995eec23b106 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:20.909747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13180afb-9416-4520-bf47-995eec23b106 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:20.910209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13180afb-9416-4520-bf47-995eec23b106 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:20.913158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13180afb-9416-4520-bf47-995eec23b106 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:20.915563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13180afb-9416-4520-bf47-995eec23b106 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:20.916292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13180afb-9416-4520-bf47-995eec23b106 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:21.087210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-01644be6-bd37-4076-88e0-b5f717ea9b0a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:21.101324 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-01644be6-bd37-4076-88e0-b5f717ea9b0a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1314 microversion: 2.1 time: 0.372751 Oct 04 21:09:21.103253 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 512/1026] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:20 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:21.111669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ff06e594-f066-4eee-809e-b388a61ce540 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:21.113398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ff06e594-f066-4eee-809e-b388a61ce540 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:21.129937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff06e594-f066-4eee-809e-b388a61ce540 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:21.132647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff06e594-f066-4eee-809e-b388a61ce540 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:21.134151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff06e594-f066-4eee-809e-b388a61ce540 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:21.135052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff06e594-f066-4eee-809e-b388a61ce540 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:21.138062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff06e594-f066-4eee-809e-b388a61ce540 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:21.139169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff06e594-f066-4eee-809e-b388a61ce540 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:21.266041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-13180afb-9416-4520-bf47-995eec23b106 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:21.286981 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-13180afb-9416-4520-bf47-995eec23b106 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1292 microversion: 2.1 time: 0.394271 Oct 04 21:09:21.287890 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 515/1027] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:20 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1292 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:21.292530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-090ab6ca-bf86-4d66-9693-ff37f3aaab20 req-0dd8ac63-10e6-4253-932b-723a61b5e82e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2480cf36-216a-4565-a5b3-2430424a7a6e", "tag": "91abea23-f356-47a5-8b1c-3915d0031ec2"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:21.301499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ff06e594-f066-4eee-809e-b388a61ce540 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:21.310478 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ff06e594-f066-4eee-809e-b388a61ce540 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1275 microversion: 2.1 time: 0.205231 Oct 04 21:09:21.315773 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 513/1028] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:21 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1275 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:21.318269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-090ab6ca-bf86-4d66-9693-ff37f3aaab20 req-0dd8ac63-10e6-4253-932b-723a61b5e82e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:21.318754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-090ab6ca-bf86-4d66-9693-ff37f3aaab20 req-0dd8ac63-10e6-4253-932b-723a61b5e82e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:21.319193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-090ab6ca-bf86-4d66-9693-ff37f3aaab20 req-0dd8ac63-10e6-4253-932b-723a61b5e82e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:21.333059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f415a580-ecf2-4c0e-9701-a0465e2a79df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:21.333889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f415a580-ecf2-4c0e-9701-a0465e2a79df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:21.345310 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-090ab6ca-bf86-4d66-9693-ff37f3aaab20 req-0dd8ac63-10e6-4253-932b-723a61b5e82e service nova] Creating event network-changed:91abea23-f356-47a5-8b1c-3915d0031ec2 for instance 2480cf36-216a-4565-a5b3-2430424a7a6e on n-h1-860282-1 Oct 04 21:09:21.347882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f415a580-ecf2-4c0e-9701-a0465e2a79df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:21.359054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f415a580-ecf2-4c0e-9701-a0465e2a79df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:21.359528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f415a580-ecf2-4c0e-9701-a0465e2a79df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:21.360137 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-090ab6ca-bf86-4d66-9693-ff37f3aaab20 req-0dd8ac63-10e6-4253-932b-723a61b5e82e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070463 Oct 04 21:09:21.360277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f415a580-ecf2-4c0e-9701-a0465e2a79df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:21.361290 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 516/1029] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:21.373412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f415a580-ecf2-4c0e-9701-a0465e2a79df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:21.373412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f415a580-ecf2-4c0e-9701-a0465e2a79df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:21.494035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6342caa3-500a-46df-a04d-8481aade1d83 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:21.494934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6342caa3-500a-46df-a04d-8481aade1d83 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:21.507912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6342caa3-500a-46df-a04d-8481aade1d83 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:21.508723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6342caa3-500a-46df-a04d-8481aade1d83 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:21.509187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6342caa3-500a-46df-a04d-8481aade1d83 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:21.509978 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6342caa3-500a-46df-a04d-8481aade1d83 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:21.510463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6342caa3-500a-46df-a04d-8481aade1d83 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:21.510912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6342caa3-500a-46df-a04d-8481aade1d83 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:21.729737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f415a580-ecf2-4c0e-9701-a0465e2a79df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:21.745530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6342caa3-500a-46df-a04d-8481aade1d83 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:21.751005 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f415a580-ecf2-4c0e-9701-a0465e2a79df tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.433738 Oct 04 21:09:21.753061 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 514/1030] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:21 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:21.755090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6342caa3-500a-46df-a04d-8481aade1d83 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:21.756542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6342caa3-500a-46df-a04d-8481aade1d83 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:21.762001 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6342caa3-500a-46df-a04d-8481aade1d83 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.273497 Oct 04 21:09:21.777873 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 517/1031] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:21 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:22.066540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-e842791c-3447-4ada-b6d7-a1cc0b0344a0 req-7be8d4db-bc33-4bfe-a239-d8ac01b6c2fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e8b58cf-bd44-497d-8bb6-01ffbf4b8429", "tag": "5d2cde1b-5598-46bc-b281-5449bd749072"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:22.080219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e842791c-3447-4ada-b6d7-a1cc0b0344a0 req-7be8d4db-bc33-4bfe-a239-d8ac01b6c2fc service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:22.080704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e842791c-3447-4ada-b6d7-a1cc0b0344a0 req-7be8d4db-bc33-4bfe-a239-d8ac01b6c2fc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:22.081137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e842791c-3447-4ada-b6d7-a1cc0b0344a0 req-7be8d4db-bc33-4bfe-a239-d8ac01b6c2fc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:22.116568 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-e842791c-3447-4ada-b6d7-a1cc0b0344a0 req-7be8d4db-bc33-4bfe-a239-d8ac01b6c2fc service nova] Creating event network-changed:5d2cde1b-5598-46bc-b281-5449bd749072 for instance 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 on n-h1-860282-1 Oct 04 21:09:22.131304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c31c2f74-11ec-4413-8ca6-22e22be7c45f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:22.131994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c31c2f74-11ec-4413-8ca6-22e22be7c45f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:22.143830 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-e842791c-3447-4ada-b6d7-a1cc0b0344a0 req-7be8d4db-bc33-4bfe-a239-d8ac01b6c2fc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081004 Oct 04 21:09:22.144666 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 515/1032] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:22.144790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c31c2f74-11ec-4413-8ca6-22e22be7c45f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:22.148673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c31c2f74-11ec-4413-8ca6-22e22be7c45f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:22.148673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c31c2f74-11ec-4413-8ca6-22e22be7c45f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:22.148673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c31c2f74-11ec-4413-8ca6-22e22be7c45f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:22.148673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c31c2f74-11ec-4413-8ca6-22e22be7c45f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:22.148673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c31c2f74-11ec-4413-8ca6-22e22be7c45f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:22.312532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-df9b67d8-3b1d-4f88-88b0-4ea5db77d7a4 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:22.313478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-df9b67d8-3b1d-4f88-88b0-4ea5db77d7a4 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:22.324727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df9b67d8-3b1d-4f88-88b0-4ea5db77d7a4 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:22.325233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df9b67d8-3b1d-4f88-88b0-4ea5db77d7a4 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:22.325830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df9b67d8-3b1d-4f88-88b0-4ea5db77d7a4 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:22.330915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df9b67d8-3b1d-4f88-88b0-4ea5db77d7a4 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:22.331510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df9b67d8-3b1d-4f88-88b0-4ea5db77d7a4 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:22.331971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df9b67d8-3b1d-4f88-88b0-4ea5db77d7a4 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:22.762062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-df9b67d8-3b1d-4f88-88b0-4ea5db77d7a4 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:22.786375 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-df9b67d8-3b1d-4f88-88b0-4ea5db77d7a4 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1292 microversion: 2.1 time: 0.477155 Oct 04 21:09:22.791455 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 516/1033] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:22 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1292 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:22.798991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c31c2f74-11ec-4413-8ca6-22e22be7c45f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:22.803743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-454d77a7-37e1-402a-bc27-bf9c5d064e51 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:22.808802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-454d77a7-37e1-402a-bc27-bf9c5d064e51 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:22.808956 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c31c2f74-11ec-4413-8ca6-22e22be7c45f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1314 microversion: 2.1 time: 0.682699 Oct 04 21:09:22.821597 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 518/1034] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:22 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:22.822028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454d77a7-37e1-402a-bc27-bf9c5d064e51 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:22.822028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454d77a7-37e1-402a-bc27-bf9c5d064e51 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:22.822028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454d77a7-37e1-402a-bc27-bf9c5d064e51 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:22.822028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454d77a7-37e1-402a-bc27-bf9c5d064e51 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:22.822028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454d77a7-37e1-402a-bc27-bf9c5d064e51 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:22.822028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454d77a7-37e1-402a-bc27-bf9c5d064e51 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:22.824242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a729a181-cfbe-479d-9543-f87136659dbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:22.824242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a729a181-cfbe-479d-9543-f87136659dbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:22.853921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a729a181-cfbe-479d-9543-f87136659dbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:22.854441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a729a181-cfbe-479d-9543-f87136659dbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:22.854890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a729a181-cfbe-479d-9543-f87136659dbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:22.855623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a729a181-cfbe-479d-9543-f87136659dbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:22.856091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a729a181-cfbe-479d-9543-f87136659dbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:22.856523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a729a181-cfbe-479d-9543-f87136659dbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:23.146814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a729a181-cfbe-479d-9543-f87136659dbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:23.150160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-454d77a7-37e1-402a-bc27-bf9c5d064e51 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:23.158963 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a729a181-cfbe-479d-9543-f87136659dbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.345061 Oct 04 21:09:23.160330 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-454d77a7-37e1-402a-bc27-bf9c5d064e51 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1317 microversion: 2.1 time: 0.366566 Oct 04 21:09:23.161355 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 517/1035] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:22 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:23.162013 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 519/1036] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:22 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:23.183692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2dbcf50b-3666-4d68-b92c-471baaf08515 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:23.184322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2dbcf50b-3666-4d68-b92c-471baaf08515 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:23.191349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2dbcf50b-3666-4d68-b92c-471baaf08515 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:23.191978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2dbcf50b-3666-4d68-b92c-471baaf08515 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:23.193364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2dbcf50b-3666-4d68-b92c-471baaf08515 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:23.195960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2dbcf50b-3666-4d68-b92c-471baaf08515 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:23.195960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2dbcf50b-3666-4d68-b92c-471baaf08515 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:23.195960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2dbcf50b-3666-4d68-b92c-471baaf08515 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:23.275372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2dbcf50b-3666-4d68-b92c-471baaf08515 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:23.293512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2dbcf50b-3666-4d68-b92c-471baaf08515 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:23.293512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2dbcf50b-3666-4d68-b92c-471baaf08515 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:23.293512 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2dbcf50b-3666-4d68-b92c-471baaf08515 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.129061 Oct 04 21:09:23.305212 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 518/1037] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:23 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:23.580118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aebb6fdf-8d0f-4486-b10d-a6b17fbcf991 tempest-InstanceUsageAuditLogTestJSON-636251339 tempest-InstanceUsageAuditLogTestJSON-636251339-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:23.601753 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aebb6fdf-8d0f-4486-b10d-a6b17fbcf991 tempest-InstanceUsageAuditLogTestJSON-636251339 tempest-InstanceUsageAuditLogTestJSON-636251339-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 21:09:23" status: 200 len: 318 microversion: 2.1 time: 0.176488 Oct 04 21:09:23.602561 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 520/1038] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Oct 4 21:09:23 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2021%3A09%3A23 => generated 318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:23.619073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5bc8747d-251e-42d5-88e5-fb8006afd18c tempest-InstanceUsageAuditLogTestJSON-636251339 tempest-InstanceUsageAuditLogTestJSON-636251339-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:23.639969 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5bc8747d-251e-42d5-88e5-fb8006afd18c tempest-InstanceUsageAuditLogTestJSON-636251339 tempest-InstanceUsageAuditLogTestJSON-636251339-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.024485 Oct 04 21:09:23.640569 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 519/1039] 10.222.0.30 () {58 vars in 1185 bytes} [Tue Oct 4 21:09:23 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:23.814643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1ddf0c93-62b0-4ca0-ab69-7da807aa94b0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:23.815931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1ddf0c93-62b0-4ca0-ab69-7da807aa94b0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:23.817986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:23.823544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ddf0c93-62b0-4ca0-ab69-7da807aa94b0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:23.824048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ddf0c93-62b0-4ca0-ab69-7da807aa94b0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:23.824533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ddf0c93-62b0-4ca0-ab69-7da807aa94b0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:23.825375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ddf0c93-62b0-4ca0-ab69-7da807aa94b0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:23.826337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ddf0c93-62b0-4ca0-ab69-7da807aa94b0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:23.828550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ddf0c93-62b0-4ca0-ab69-7da807aa94b0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:23.834213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0863a869-ea39-432a-b8b5-5197939d7128 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:23.834951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0863a869-ea39-432a-b8b5-5197939d7128 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:23.842958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0863a869-ea39-432a-b8b5-5197939d7128 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:23.844112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0863a869-ea39-432a-b8b5-5197939d7128 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:23.844660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0863a869-ea39-432a-b8b5-5197939d7128 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:23.845521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0863a869-ea39-432a-b8b5-5197939d7128 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:23.846093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0863a869-ea39-432a-b8b5-5197939d7128 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:23.846987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0863a869-ea39-432a-b8b5-5197939d7128 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:24.146736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1ddf0c93-62b0-4ca0-ab69-7da807aa94b0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:24.156020 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1ddf0c93-62b0-4ca0-ab69-7da807aa94b0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1292 microversion: 2.1 time: 0.345842 Oct 04 21:09:24.157568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0863a869-ea39-432a-b8b5-5197939d7128 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:24.176525 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 521/1040] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:23 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1292 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:24.185451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b8e193db-ddb4-44fd-8ba7-6e5390d54a3d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:24.186370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b8e193db-ddb4-44fd-8ba7-6e5390d54a3d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:24.187128 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0863a869-ea39-432a-b8b5-5197939d7128 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1314 microversion: 2.1 time: 0.357282 Oct 04 21:09:24.191639 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 520/1041] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:23 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:24.194742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8e193db-ddb4-44fd-8ba7-6e5390d54a3d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:24.195423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8e193db-ddb4-44fd-8ba7-6e5390d54a3d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:24.196658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5a7e220c-dfd2-4e0b-a052-ad57d839608b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:24.196805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8e193db-ddb4-44fd-8ba7-6e5390d54a3d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:24.197666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5a7e220c-dfd2-4e0b-a052-ad57d839608b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:24.198051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8e193db-ddb4-44fd-8ba7-6e5390d54a3d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:24.198596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8e193db-ddb4-44fd-8ba7-6e5390d54a3d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:24.199100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8e193db-ddb4-44fd-8ba7-6e5390d54a3d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:24.205601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a7e220c-dfd2-4e0b-a052-ad57d839608b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:24.214271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a7e220c-dfd2-4e0b-a052-ad57d839608b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:24.215065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a7e220c-dfd2-4e0b-a052-ad57d839608b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:24.215837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a7e220c-dfd2-4e0b-a052-ad57d839608b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:24.216895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a7e220c-dfd2-4e0b-a052-ad57d839608b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:24.217332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a7e220c-dfd2-4e0b-a052-ad57d839608b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:24.524969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b8e193db-ddb4-44fd-8ba7-6e5390d54a3d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:24.532688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5a7e220c-dfd2-4e0b-a052-ad57d839608b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:24.538075 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5a7e220c-dfd2-4e0b-a052-ad57d839608b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1317 microversion: 2.1 time: 0.348367 Oct 04 21:09:24.540294 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 521/1042] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:24 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:24.556084 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b8e193db-ddb4-44fd-8ba7-6e5390d54a3d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.375623 Oct 04 21:09:24.560587 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 522/1043] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:24 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:24.569135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-17f09b65-4a28-40bb-9486-159ad5b711ed tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:24.569913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-17f09b65-4a28-40bb-9486-159ad5b711ed tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:24.580637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:24.582834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f09b65-4a28-40bb-9486-159ad5b711ed tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:24.583530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f09b65-4a28-40bb-9486-159ad5b711ed tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:24.584054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f09b65-4a28-40bb-9486-159ad5b711ed tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:24.584891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f09b65-4a28-40bb-9486-159ad5b711ed tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:24.585449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f09b65-4a28-40bb-9486-159ad5b711ed tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:24.594537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f09b65-4a28-40bb-9486-159ad5b711ed tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:24.763637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-17f09b65-4a28-40bb-9486-159ad5b711ed tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:24.776301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-17f09b65-4a28-40bb-9486-159ad5b711ed tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:24.778134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-17f09b65-4a28-40bb-9486-159ad5b711ed tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:24.784321 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-17f09b65-4a28-40bb-9486-159ad5b711ed tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.225762 Oct 04 21:09:24.785289 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 522/1044] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:24 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:25.180484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-db5d8105-c1c6-4367-9a65-3aa6bf9f05c7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:25.181834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-db5d8105-c1c6-4367-9a65-3aa6bf9f05c7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:25.189779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db5d8105-c1c6-4367-9a65-3aa6bf9f05c7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:25.190359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db5d8105-c1c6-4367-9a65-3aa6bf9f05c7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:25.191023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db5d8105-c1c6-4367-9a65-3aa6bf9f05c7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:25.191798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db5d8105-c1c6-4367-9a65-3aa6bf9f05c7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:25.192446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db5d8105-c1c6-4367-9a65-3aa6bf9f05c7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:25.192885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db5d8105-c1c6-4367-9a65-3aa6bf9f05c7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:25.218903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0729e237-854d-4921-af52-144b19c2a63b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:25.219531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0729e237-854d-4921-af52-144b19c2a63b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:25.228756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0729e237-854d-4921-af52-144b19c2a63b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:25.229259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0729e237-854d-4921-af52-144b19c2a63b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:25.229751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0729e237-854d-4921-af52-144b19c2a63b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:25.230679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0729e237-854d-4921-af52-144b19c2a63b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:25.231144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0729e237-854d-4921-af52-144b19c2a63b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:25.232449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0729e237-854d-4921-af52-144b19c2a63b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:25.413262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-db5d8105-c1c6-4367-9a65-3aa6bf9f05c7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:25.425066 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-db5d8105-c1c6-4367-9a65-3aa6bf9f05c7 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1292 microversion: 2.1 time: 0.248939 Oct 04 21:09:25.427075 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 523/1045] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:25 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1292 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:25.431938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-f99ca580-278b-4f0f-843a-b542983821dc req-fb107f79-cdb3-4477-ba40-635d5b6099a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdefd528-2e7a-438e-b093-a98a4ec58e78", "tag": "2ce00f87-090e-47d0-917a-4baf600863f9"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:25.452367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f99ca580-278b-4f0f-843a-b542983821dc req-fb107f79-cdb3-4477-ba40-635d5b6099a9 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:25.452845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f99ca580-278b-4f0f-843a-b542983821dc req-fb107f79-cdb3-4477-ba40-635d5b6099a9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:25.453309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f99ca580-278b-4f0f-843a-b542983821dc req-fb107f79-cdb3-4477-ba40-635d5b6099a9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:25.464760 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-f99ca580-278b-4f0f-843a-b542983821dc req-fb107f79-cdb3-4477-ba40-635d5b6099a9 service nova] Creating event network-changed:2ce00f87-090e-47d0-917a-4baf600863f9 for instance bdefd528-2e7a-438e-b093-a98a4ec58e78 on n-h1-860282-1 Oct 04 21:09:25.472931 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-f99ca580-278b-4f0f-843a-b542983821dc req-fb107f79-cdb3-4477-ba40-635d5b6099a9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044509 Oct 04 21:09:25.474062 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 524/1046] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:25.492409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0729e237-854d-4921-af52-144b19c2a63b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:25.503618 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0729e237-854d-4921-af52-144b19c2a63b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1314 microversion: 2.1 time: 0.291286 Oct 04 21:09:25.504628 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 523/1047] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:25 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:25.568745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c2fc57a3-722b-4226-91fc-235e09689cc5 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:25.569587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c2fc57a3-722b-4226-91fc-235e09689cc5 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:25.581938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2fc57a3-722b-4226-91fc-235e09689cc5 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:25.582755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2fc57a3-722b-4226-91fc-235e09689cc5 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:25.583412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2fc57a3-722b-4226-91fc-235e09689cc5 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:25.583722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0c4f543c-a993-40a6-869b-950cd929f484 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:25.584403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0c4f543c-a993-40a6-869b-950cd929f484 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:25.584846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2fc57a3-722b-4226-91fc-235e09689cc5 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:25.585563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2fc57a3-722b-4226-91fc-235e09689cc5 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:25.602646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2fc57a3-722b-4226-91fc-235e09689cc5 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:25.602846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c4f543c-a993-40a6-869b-950cd929f484 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:25.602846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c4f543c-a993-40a6-869b-950cd929f484 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:25.602846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c4f543c-a993-40a6-869b-950cd929f484 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:25.602846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c4f543c-a993-40a6-869b-950cd929f484 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:25.602846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c4f543c-a993-40a6-869b-950cd929f484 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:25.602846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c4f543c-a993-40a6-869b-950cd929f484 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:25.817829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0c4f543c-a993-40a6-869b-950cd929f484 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:25.828279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c2fc57a3-722b-4226-91fc-235e09689cc5 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:25.828969 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0c4f543c-a993-40a6-869b-950cd929f484 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.249089 Oct 04 21:09:25.839368 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c2fc57a3-722b-4226-91fc-235e09689cc5 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1317 microversion: 2.1 time: 0.276389 Oct 04 21:09:25.849714 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 524/1048] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:25 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:25.849714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-40190386-a1c7-4afa-b780-586b108318ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:25.850041 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 525/1049] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:25 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:25.850157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-40190386-a1c7-4afa-b780-586b108318ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:25.865413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40190386-a1c7-4afa-b780-586b108318ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:25.865413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40190386-a1c7-4afa-b780-586b108318ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:25.870144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40190386-a1c7-4afa-b780-586b108318ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:25.870933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40190386-a1c7-4afa-b780-586b108318ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:25.871707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40190386-a1c7-4afa-b780-586b108318ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:25.871958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40190386-a1c7-4afa-b780-586b108318ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:25.951238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-40190386-a1c7-4afa-b780-586b108318ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:25.963486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-40190386-a1c7-4afa-b780-586b108318ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:25.967004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-40190386-a1c7-4afa-b780-586b108318ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:25.973561 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-40190386-a1c7-4afa-b780-586b108318ca tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.132050 Oct 04 21:09:25.974717 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 525/1050] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:25 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:26.451840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9d547583-a6bf-40f4-8040-f9741fa20439 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:26.453313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9d547583-a6bf-40f4-8040-f9741fa20439 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:26.466996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d547583-a6bf-40f4-8040-f9741fa20439 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:26.473964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d547583-a6bf-40f4-8040-f9741fa20439 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:26.473964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d547583-a6bf-40f4-8040-f9741fa20439 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:26.473964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d547583-a6bf-40f4-8040-f9741fa20439 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:26.473964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d547583-a6bf-40f4-8040-f9741fa20439 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:26.473964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d547583-a6bf-40f4-8040-f9741fa20439 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:26.530937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8072fbfb-4a2b-47a3-bff0-3e2153fa8cca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:26.532604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8072fbfb-4a2b-47a3-bff0-3e2153fa8cca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:26.544848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8072fbfb-4a2b-47a3-bff0-3e2153fa8cca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:26.545655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8072fbfb-4a2b-47a3-bff0-3e2153fa8cca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:26.546325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8072fbfb-4a2b-47a3-bff0-3e2153fa8cca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:26.547565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8072fbfb-4a2b-47a3-bff0-3e2153fa8cca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:26.549033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8072fbfb-4a2b-47a3-bff0-3e2153fa8cca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:26.550754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8072fbfb-4a2b-47a3-bff0-3e2153fa8cca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:26.810989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9d547583-a6bf-40f4-8040-f9741fa20439 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:26.822963 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9d547583-a6bf-40f4-8040-f9741fa20439 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1292 microversion: 2.1 time: 0.375867 Oct 04 21:09:26.823879 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 526/1051] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:26 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1292 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:26.853215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-47f6c92c-71d6-42b2-9bc2-dc7890ee1f0a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:26.854216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-47f6c92c-71d6-42b2-9bc2-dc7890ee1f0a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:26.863519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47f6c92c-71d6-42b2-9bc2-dc7890ee1f0a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:26.867410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47f6c92c-71d6-42b2-9bc2-dc7890ee1f0a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:26.868111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47f6c92c-71d6-42b2-9bc2-dc7890ee1f0a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:26.869023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47f6c92c-71d6-42b2-9bc2-dc7890ee1f0a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:26.870339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47f6c92c-71d6-42b2-9bc2-dc7890ee1f0a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:26.873086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47f6c92c-71d6-42b2-9bc2-dc7890ee1f0a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:26.907123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8072fbfb-4a2b-47a3-bff0-3e2153fa8cca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:26.920871 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8072fbfb-4a2b-47a3-bff0-3e2153fa8cca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1314 microversion: 2.1 time: 0.396605 Oct 04 21:09:26.922868 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 526/1052] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:26 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:26.941062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d266ae76-af2f-4a2f-9cad-a9eb90ce2a44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:26.947435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d266ae76-af2f-4a2f-9cad-a9eb90ce2a44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:26.960992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d266ae76-af2f-4a2f-9cad-a9eb90ce2a44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:26.961956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d266ae76-af2f-4a2f-9cad-a9eb90ce2a44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:26.963245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d266ae76-af2f-4a2f-9cad-a9eb90ce2a44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:26.964388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d266ae76-af2f-4a2f-9cad-a9eb90ce2a44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:26.965147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d266ae76-af2f-4a2f-9cad-a9eb90ce2a44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:26.966673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d266ae76-af2f-4a2f-9cad-a9eb90ce2a44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:27.202957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-47f6c92c-71d6-42b2-9bc2-dc7890ee1f0a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:27.261581 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-47f6c92c-71d6-42b2-9bc2-dc7890ee1f0a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.391714 Oct 04 21:09:27.261980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d266ae76-af2f-4a2f-9cad-a9eb90ce2a44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:27.262163 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 527/1053] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:26 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:27.262277 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d266ae76-af2f-4a2f-9cad-a9eb90ce2a44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1317 microversion: 2.1 time: 0.333605 Oct 04 21:09:27.268946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a64c07b4-cb17-4baa-b8fa-ebce60685302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:27.269880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a64c07b4-cb17-4baa-b8fa-ebce60685302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:27.271060 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 527/1054] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:26 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:27.280725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a64c07b4-cb17-4baa-b8fa-ebce60685302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:27.284263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a64c07b4-cb17-4baa-b8fa-ebce60685302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:27.284263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a64c07b4-cb17-4baa-b8fa-ebce60685302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:27.284263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a64c07b4-cb17-4baa-b8fa-ebce60685302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:27.284263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a64c07b4-cb17-4baa-b8fa-ebce60685302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:27.285033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a64c07b4-cb17-4baa-b8fa-ebce60685302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:27.377459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a64c07b4-cb17-4baa-b8fa-ebce60685302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:27.385747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a64c07b4-cb17-4baa-b8fa-ebce60685302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:27.387188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a64c07b4-cb17-4baa-b8fa-ebce60685302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:27.398062 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a64c07b4-cb17-4baa-b8fa-ebce60685302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.149197 Oct 04 21:09:27.398841 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 528/1055] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:27 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:27.850564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b436379a-de65-4152-be0a-a714a9a5b168 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:27.851186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b436379a-de65-4152-be0a-a714a9a5b168 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:27.858776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b436379a-de65-4152-be0a-a714a9a5b168 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:27.859272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b436379a-de65-4152-be0a-a714a9a5b168 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:27.859710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b436379a-de65-4152-be0a-a714a9a5b168 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:27.860429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b436379a-de65-4152-be0a-a714a9a5b168 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:27.860888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b436379a-de65-4152-be0a-a714a9a5b168 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:27.861321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b436379a-de65-4152-be0a-a714a9a5b168 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:27.954049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-05bc59dd-b1d9-41a8-8386-52b7a7870725 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:27.955541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-05bc59dd-b1d9-41a8-8386-52b7a7870725 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:27.962770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05bc59dd-b1d9-41a8-8386-52b7a7870725 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:27.967910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05bc59dd-b1d9-41a8-8386-52b7a7870725 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:27.967910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05bc59dd-b1d9-41a8-8386-52b7a7870725 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:27.967910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05bc59dd-b1d9-41a8-8386-52b7a7870725 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:27.967910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05bc59dd-b1d9-41a8-8386-52b7a7870725 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:27.967910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05bc59dd-b1d9-41a8-8386-52b7a7870725 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:28.063230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b436379a-de65-4152-be0a-a714a9a5b168 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:28.077823 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b436379a-de65-4152-be0a-a714a9a5b168 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1292 microversion: 2.1 time: 0.230873 Oct 04 21:09:28.101971 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 528/1056] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:27 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1292 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:28.150531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-05bc59dd-b1d9-41a8-8386-52b7a7870725 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:28.153080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:28.160790 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-05bc59dd-b1d9-41a8-8386-52b7a7870725 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1314 microversion: 2.1 time: 0.216291 Oct 04 21:09:28.161392 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 529/1057] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:27 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:28.275655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ea891b89-1f65-4e22-9e63-b1280e05b039 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:28.276224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ea891b89-1f65-4e22-9e63-b1280e05b039 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:28.282502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-889a578c-e82f-4822-8d66-c6d34d60a375 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:28.283060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-889a578c-e82f-4822-8d66-c6d34d60a375 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:28.287683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea891b89-1f65-4e22-9e63-b1280e05b039 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:28.288733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea891b89-1f65-4e22-9e63-b1280e05b039 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:28.289410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea891b89-1f65-4e22-9e63-b1280e05b039 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:28.290347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea891b89-1f65-4e22-9e63-b1280e05b039 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:28.290832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea891b89-1f65-4e22-9e63-b1280e05b039 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:28.291246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea891b89-1f65-4e22-9e63-b1280e05b039 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:28.292530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-889a578c-e82f-4822-8d66-c6d34d60a375 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:28.293028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-889a578c-e82f-4822-8d66-c6d34d60a375 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:28.293543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-889a578c-e82f-4822-8d66-c6d34d60a375 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:28.294245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-889a578c-e82f-4822-8d66-c6d34d60a375 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:28.294707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-889a578c-e82f-4822-8d66-c6d34d60a375 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:28.295118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-889a578c-e82f-4822-8d66-c6d34d60a375 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:28.490000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-889a578c-e82f-4822-8d66-c6d34d60a375 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:28.496634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ea891b89-1f65-4e22-9e63-b1280e05b039 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:28.505114 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-889a578c-e82f-4822-8d66-c6d34d60a375 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1317 microversion: 2.1 time: 0.226469 Oct 04 21:09:28.505858 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ea891b89-1f65-4e22-9e63-b1280e05b039 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.233775 Oct 04 21:09:28.506090 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 530/1058] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:28 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:28.510750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-415814c3-bc6b-4969-b5c8-9e78971edc4e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:28.511348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-415814c3-bc6b-4969-b5c8-9e78971edc4e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:28.517843 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 529/1059] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:28 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:28.519973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-415814c3-bc6b-4969-b5c8-9e78971edc4e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:28.520230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-415814c3-bc6b-4969-b5c8-9e78971edc4e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:28.520688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-415814c3-bc6b-4969-b5c8-9e78971edc4e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:28.521374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-415814c3-bc6b-4969-b5c8-9e78971edc4e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:28.521846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-415814c3-bc6b-4969-b5c8-9e78971edc4e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:28.522271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-415814c3-bc6b-4969-b5c8-9e78971edc4e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:28.606447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-415814c3-bc6b-4969-b5c8-9e78971edc4e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:28.615104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-415814c3-bc6b-4969-b5c8-9e78971edc4e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:28.616506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-415814c3-bc6b-4969-b5c8-9e78971edc4e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:28.621663 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-415814c3-bc6b-4969-b5c8-9e78971edc4e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.114463 Oct 04 21:09:28.622255 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 531/1060] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:28 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:29.104495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7b06eed5-9182-4824-ba10-42ed821c0427 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:29.105181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7b06eed5-9182-4824-ba10-42ed821c0427 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:29.124150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b06eed5-9182-4824-ba10-42ed821c0427 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:29.126151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b06eed5-9182-4824-ba10-42ed821c0427 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:29.127906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b06eed5-9182-4824-ba10-42ed821c0427 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:29.129029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b06eed5-9182-4824-ba10-42ed821c0427 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:29.129551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b06eed5-9182-4824-ba10-42ed821c0427 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:29.129991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b06eed5-9182-4824-ba10-42ed821c0427 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:29.183476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7c9d774f-3707-46ad-a7d3-cbb80b48068f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:29.184053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7c9d774f-3707-46ad-a7d3-cbb80b48068f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:29.204630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c9d774f-3707-46ad-a7d3-cbb80b48068f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:29.207850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c9d774f-3707-46ad-a7d3-cbb80b48068f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:29.207850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c9d774f-3707-46ad-a7d3-cbb80b48068f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:29.207850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c9d774f-3707-46ad-a7d3-cbb80b48068f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:29.207850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c9d774f-3707-46ad-a7d3-cbb80b48068f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:29.207850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c9d774f-3707-46ad-a7d3-cbb80b48068f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:29.693683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7c9d774f-3707-46ad-a7d3-cbb80b48068f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:29.695032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7b06eed5-9182-4824-ba10-42ed821c0427 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:29.698536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:29.709938 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7b06eed5-9182-4824-ba10-42ed821c0427 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1292 microversion: 2.1 time: 0.613148 Oct 04 21:09:29.710752 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 530/1061] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:29 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1292 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:29.716396 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7c9d774f-3707-46ad-a7d3-cbb80b48068f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1314 microversion: 2.1 time: 0.537062 Oct 04 21:09:29.717703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-98dc1b8e-0910-440d-a6b3-25e2d2123467 req-53bf6ff9-448c-46bc-b1ad-078fda77c7a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2480cf36-216a-4565-a5b3-2430424a7a6e", "name": "network-vif-plugged", "status": "completed", "tag": "91abea23-f356-47a5-8b1c-3915d0031ec2"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:29.717990 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 532/1062] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:29 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:29.736683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4b4b9982-982d-4203-be86-ee0d42f01dc6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:29.739134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-98dc1b8e-0910-440d-a6b3-25e2d2123467 req-53bf6ff9-448c-46bc-b1ad-078fda77c7a6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:29.739251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4b4b9982-982d-4203-be86-ee0d42f01dc6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:29.739851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-98dc1b8e-0910-440d-a6b3-25e2d2123467 req-53bf6ff9-448c-46bc-b1ad-078fda77c7a6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:29.740331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-98dc1b8e-0910-440d-a6b3-25e2d2123467 req-53bf6ff9-448c-46bc-b1ad-078fda77c7a6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:29.746381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b4b9982-982d-4203-be86-ee0d42f01dc6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:29.748849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b4b9982-982d-4203-be86-ee0d42f01dc6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:29.749410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b4b9982-982d-4203-be86-ee0d42f01dc6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:29.750556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b4b9982-982d-4203-be86-ee0d42f01dc6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:29.751493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b4b9982-982d-4203-be86-ee0d42f01dc6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:29.751767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b4b9982-982d-4203-be86-ee0d42f01dc6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:29.769542 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-98dc1b8e-0910-440d-a6b3-25e2d2123467 req-53bf6ff9-448c-46bc-b1ad-078fda77c7a6 service nova] Creating event network-vif-plugged:91abea23-f356-47a5-8b1c-3915d0031ec2 for instance 2480cf36-216a-4565-a5b3-2430424a7a6e on n-h1-860282-1 Oct 04 21:09:29.775434 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-98dc1b8e-0910-440d-a6b3-25e2d2123467 req-53bf6ff9-448c-46bc-b1ad-078fda77c7a6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063290 Oct 04 21:09:29.776032 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 531/1063] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:29.781185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-22b50c14-f148-4de5-8ae8-a570d757d00d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:29.781915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-22b50c14-f148-4de5-8ae8-a570d757d00d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:29.789123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22b50c14-f148-4de5-8ae8-a570d757d00d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:29.789687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22b50c14-f148-4de5-8ae8-a570d757d00d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:29.790113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22b50c14-f148-4de5-8ae8-a570d757d00d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:29.790927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22b50c14-f148-4de5-8ae8-a570d757d00d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:29.791383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22b50c14-f148-4de5-8ae8-a570d757d00d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:29.791814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22b50c14-f148-4de5-8ae8-a570d757d00d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:30.012632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4b4b9982-982d-4203-be86-ee0d42f01dc6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:30.025250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-22b50c14-f148-4de5-8ae8-a570d757d00d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:30.030240 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4b4b9982-982d-4203-be86-ee0d42f01dc6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1317 microversion: 2.1 time: 0.310134 Oct 04 21:09:30.033954 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 533/1064] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:29 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:30.039345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a41ab747-de9c-47ae-8688-dcd6f96c2387 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:30.039955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a41ab747-de9c-47ae-8688-dcd6f96c2387 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:30.041257 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-22b50c14-f148-4de5-8ae8-a570d757d00d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.264037 Oct 04 21:09:30.042286 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 532/1065] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:29 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:30.054485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a41ab747-de9c-47ae-8688-dcd6f96c2387 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:30.054968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a41ab747-de9c-47ae-8688-dcd6f96c2387 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:30.055406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a41ab747-de9c-47ae-8688-dcd6f96c2387 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:30.056121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a41ab747-de9c-47ae-8688-dcd6f96c2387 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:30.056579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a41ab747-de9c-47ae-8688-dcd6f96c2387 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:30.057010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a41ab747-de9c-47ae-8688-dcd6f96c2387 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:30.131446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a41ab747-de9c-47ae-8688-dcd6f96c2387 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:30.140341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a41ab747-de9c-47ae-8688-dcd6f96c2387 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:30.142126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a41ab747-de9c-47ae-8688-dcd6f96c2387 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:30.147282 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a41ab747-de9c-47ae-8688-dcd6f96c2387 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.112303 Oct 04 21:09:30.147873 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 534/1066] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:30 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:30.734190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e0a7a741-3b07-405b-b689-e46083294af1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:30.734927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e0a7a741-3b07-405b-b689-e46083294af1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:30.741764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0a7a741-3b07-405b-b689-e46083294af1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:30.742384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0a7a741-3b07-405b-b689-e46083294af1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:30.742945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0a7a741-3b07-405b-b689-e46083294af1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:30.743634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0a7a741-3b07-405b-b689-e46083294af1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:30.744165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0a7a741-3b07-405b-b689-e46083294af1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:30.744664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0a7a741-3b07-405b-b689-e46083294af1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:30.746251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-92702dbd-0263-41d5-83e7-62e5063bfe43 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:30.747216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-92702dbd-0263-41d5-83e7-62e5063bfe43 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:30.755538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92702dbd-0263-41d5-83e7-62e5063bfe43 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:30.756048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92702dbd-0263-41d5-83e7-62e5063bfe43 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:30.756479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92702dbd-0263-41d5-83e7-62e5063bfe43 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:30.757216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92702dbd-0263-41d5-83e7-62e5063bfe43 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:30.757879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92702dbd-0263-41d5-83e7-62e5063bfe43 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:30.761206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92702dbd-0263-41d5-83e7-62e5063bfe43 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:31.004338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e0a7a741-3b07-405b-b689-e46083294af1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:31.008589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-92702dbd-0263-41d5-83e7-62e5063bfe43 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:31.016761 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e0a7a741-3b07-405b-b689-e46083294af1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1292 microversion: 2.1 time: 0.283995 Oct 04 21:09:31.017234 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-92702dbd-0263-41d5-83e7-62e5063bfe43 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1314 microversion: 2.1 time: 0.277122 Oct 04 21:09:31.017713 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 533/1067] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:30 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1292 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:31.033508 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 535/1068] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:30 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:31.054031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6a919fc5-e57d-4592-995d-4da143981b84 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:31.054811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6a919fc5-e57d-4592-995d-4da143981b84 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:31.063083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a919fc5-e57d-4592-995d-4da143981b84 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:31.063661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a919fc5-e57d-4592-995d-4da143981b84 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:31.064700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a919fc5-e57d-4592-995d-4da143981b84 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:31.065447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a919fc5-e57d-4592-995d-4da143981b84 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:31.065935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a919fc5-e57d-4592-995d-4da143981b84 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:31.066520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a919fc5-e57d-4592-995d-4da143981b84 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:31.069372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b1300f6e-e932-45f9-8a17-95020ded55e6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:31.070429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b1300f6e-e932-45f9-8a17-95020ded55e6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:31.079060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1300f6e-e932-45f9-8a17-95020ded55e6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:31.079820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1300f6e-e932-45f9-8a17-95020ded55e6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:31.080572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1300f6e-e932-45f9-8a17-95020ded55e6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:31.082082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1300f6e-e932-45f9-8a17-95020ded55e6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:31.082710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1300f6e-e932-45f9-8a17-95020ded55e6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:31.083330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1300f6e-e932-45f9-8a17-95020ded55e6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:31.333256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6a919fc5-e57d-4592-995d-4da143981b84 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:31.341323 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6a919fc5-e57d-4592-995d-4da143981b84 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1317 microversion: 2.1 time: 0.291252 Oct 04 21:09:31.360785 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 534/1069] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:31 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:31.361193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b1300f6e-e932-45f9-8a17-95020ded55e6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:31.366402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-061eb1da-668f-482d-9c64-85032fe80349 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:31.366562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-061eb1da-668f-482d-9c64-85032fe80349 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:31.373707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-061eb1da-668f-482d-9c64-85032fe80349 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:31.374214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-061eb1da-668f-482d-9c64-85032fe80349 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:31.374661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-061eb1da-668f-482d-9c64-85032fe80349 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:31.375015 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b1300f6e-e932-45f9-8a17-95020ded55e6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.311585 Oct 04 21:09:31.375569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-061eb1da-668f-482d-9c64-85032fe80349 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:31.376306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-061eb1da-668f-482d-9c64-85032fe80349 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:31.376521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-061eb1da-668f-482d-9c64-85032fe80349 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:31.377335 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 536/1070] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:31 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:31.471775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-061eb1da-668f-482d-9c64-85032fe80349 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:31.479789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-061eb1da-668f-482d-9c64-85032fe80349 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:31.481240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-061eb1da-668f-482d-9c64-85032fe80349 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:31.486243 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-061eb1da-668f-482d-9c64-85032fe80349 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1537 microversion: 2.91 time: 0.124565 Oct 04 21:09:31.486999 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 535/1071] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:31 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1537 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:31.798315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-5670a751-76eb-4a47-9667-6ea880d244c7 req-fad7e26f-7be3-4fe7-bc7f-8cfb6db7200d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff9a9f7b-0c44-4de4-9171-a14d2c39e096", "name": "network-vif-plugged", "status": "completed", "tag": "cac1c9b0-2f6f-49d5-bf55-ff55af059f63"}, {"server_uuid": "6e8b58cf-bd44-497d-8bb6-01ffbf4b8429", "name": "network-vif-plugged", "status": "completed", "tag": "5d2cde1b-5598-46bc-b281-5449bd749072"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:31.810559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5670a751-76eb-4a47-9667-6ea880d244c7 req-fad7e26f-7be3-4fe7-bc7f-8cfb6db7200d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:31.810908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5670a751-76eb-4a47-9667-6ea880d244c7 req-fad7e26f-7be3-4fe7-bc7f-8cfb6db7200d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:31.811340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5670a751-76eb-4a47-9667-6ea880d244c7 req-fad7e26f-7be3-4fe7-bc7f-8cfb6db7200d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:31.824149 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-5670a751-76eb-4a47-9667-6ea880d244c7 req-fad7e26f-7be3-4fe7-bc7f-8cfb6db7200d service nova] Creating event network-vif-plugged:cac1c9b0-2f6f-49d5-bf55-ff55af059f63 for instance ff9a9f7b-0c44-4de4-9171-a14d2c39e096 on n-h2-860282-1 Oct 04 21:09:31.824661 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-5670a751-76eb-4a47-9667-6ea880d244c7 req-fad7e26f-7be3-4fe7-bc7f-8cfb6db7200d service nova] Creating event network-vif-plugged:5d2cde1b-5598-46bc-b281-5449bd749072 for instance 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 on n-h1-860282-1 Oct 04 21:09:31.833078 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-5670a751-76eb-4a47-9667-6ea880d244c7 req-fad7e26f-7be3-4fe7-bc7f-8cfb6db7200d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039263 Oct 04 21:09:31.833738 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 537/1072] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:32.039555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b6b3a578-7e27-4221-a788-12c82e04e5d1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:32.040560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b6b3a578-7e27-4221-a788-12c82e04e5d1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:32.047551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6b3a578-7e27-4221-a788-12c82e04e5d1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:32.048268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6b3a578-7e27-4221-a788-12c82e04e5d1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:32.048720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6b3a578-7e27-4221-a788-12c82e04e5d1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:32.049450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6b3a578-7e27-4221-a788-12c82e04e5d1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:32.049922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6b3a578-7e27-4221-a788-12c82e04e5d1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:32.050359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6b3a578-7e27-4221-a788-12c82e04e5d1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:32.059555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-04acf663-9493-4989-8383-8f54733f2095 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:32.060576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-04acf663-9493-4989-8383-8f54733f2095 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:32.063535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=99 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:32.067394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04acf663-9493-4989-8383-8f54733f2095 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:32.067883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04acf663-9493-4989-8383-8f54733f2095 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:32.068312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04acf663-9493-4989-8383-8f54733f2095 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:32.069220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04acf663-9493-4989-8383-8f54733f2095 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:32.069722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04acf663-9493-4989-8383-8f54733f2095 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:32.070181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04acf663-9493-4989-8383-8f54733f2095 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:32.268684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b6b3a578-7e27-4221-a788-12c82e04e5d1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:32.270518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-04acf663-9493-4989-8383-8f54733f2095 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:32.277799 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b6b3a578-7e27-4221-a788-12c82e04e5d1 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1292 microversion: 2.1 time: 0.241956 Oct 04 21:09:32.281479 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-04acf663-9493-4989-8383-8f54733f2095 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1314 microversion: 2.1 time: 0.223506 Oct 04 21:09:32.281662 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 536/1073] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:32 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1292 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:32.294831 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 538/1074] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:32 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:32.368188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5a3ccea6-5ef3-4a11-ab51-3fed62a653b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:32.368811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5a3ccea6-5ef3-4a11-ab51-3fed62a653b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:32.375512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a3ccea6-5ef3-4a11-ab51-3fed62a653b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:32.376002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a3ccea6-5ef3-4a11-ab51-3fed62a653b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:32.376440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a3ccea6-5ef3-4a11-ab51-3fed62a653b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:32.377135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a3ccea6-5ef3-4a11-ab51-3fed62a653b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:32.377647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a3ccea6-5ef3-4a11-ab51-3fed62a653b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:32.378034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a3ccea6-5ef3-4a11-ab51-3fed62a653b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:32.404213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4867f062-522e-46a4-8814-55483f2f1fdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:32.404832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4867f062-522e-46a4-8814-55483f2f1fdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:32.410827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4867f062-522e-46a4-8814-55483f2f1fdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:32.411358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4867f062-522e-46a4-8814-55483f2f1fdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:32.411820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4867f062-522e-46a4-8814-55483f2f1fdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:32.412714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4867f062-522e-46a4-8814-55483f2f1fdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:32.413202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4867f062-522e-46a4-8814-55483f2f1fdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:32.413659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4867f062-522e-46a4-8814-55483f2f1fdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:32.599967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5a3ccea6-5ef3-4a11-ab51-3fed62a653b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:32.607953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4867f062-522e-46a4-8814-55483f2f1fdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:32.608623 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5a3ccea6-5ef3-4a11-ab51-3fed62a653b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1317 microversion: 2.1 time: 0.244331 Oct 04 21:09:32.613476 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 537/1075] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:32 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:32.614232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-02d3f8ac-ef33-40f7-bc06-600db0a89207 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:32.614930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-02d3f8ac-ef33-40f7-bc06-600db0a89207 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:32.618536 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4867f062-522e-46a4-8814-55483f2f1fdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.218191 Oct 04 21:09:32.620630 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 539/1076] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:32 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:32.621064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02d3f8ac-ef33-40f7-bc06-600db0a89207 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:32.621586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02d3f8ac-ef33-40f7-bc06-600db0a89207 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:32.625574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02d3f8ac-ef33-40f7-bc06-600db0a89207 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:32.625574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02d3f8ac-ef33-40f7-bc06-600db0a89207 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:32.625574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02d3f8ac-ef33-40f7-bc06-600db0a89207 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:32.625574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02d3f8ac-ef33-40f7-bc06-600db0a89207 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:32.690377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-02d3f8ac-ef33-40f7-bc06-600db0a89207 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:32.699007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-02d3f8ac-ef33-40f7-bc06-600db0a89207 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:32.700558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-02d3f8ac-ef33-40f7-bc06-600db0a89207 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:32.705367 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-02d3f8ac-ef33-40f7-bc06-600db0a89207 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1537 microversion: 2.91 time: 0.094752 Oct 04 21:09:32.705992 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 538/1077] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:32 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1537 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:33.301906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4a11394c-dee6-4d60-ba72-8e71660cc3e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:33.303413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4a11394c-dee6-4d60-ba72-8e71660cc3e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:33.304186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b3fce6f0-b6ba-473e-8945-e6efaa2cfb3f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:33.304883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b3fce6f0-b6ba-473e-8945-e6efaa2cfb3f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:33.313138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3fce6f0-b6ba-473e-8945-e6efaa2cfb3f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:33.314437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3fce6f0-b6ba-473e-8945-e6efaa2cfb3f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:33.314781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a11394c-dee6-4d60-ba72-8e71660cc3e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:33.315202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3fce6f0-b6ba-473e-8945-e6efaa2cfb3f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:33.316098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3fce6f0-b6ba-473e-8945-e6efaa2cfb3f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:33.316621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3fce6f0-b6ba-473e-8945-e6efaa2cfb3f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:33.317010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a11394c-dee6-4d60-ba72-8e71660cc3e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:33.317125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3fce6f0-b6ba-473e-8945-e6efaa2cfb3f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:33.317485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a11394c-dee6-4d60-ba72-8e71660cc3e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:33.318212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a11394c-dee6-4d60-ba72-8e71660cc3e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:33.318671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a11394c-dee6-4d60-ba72-8e71660cc3e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:33.319550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a11394c-dee6-4d60-ba72-8e71660cc3e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:33.525026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b3fce6f0-b6ba-473e-8945-e6efaa2cfb3f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:33.528856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4a11394c-dee6-4d60-ba72-8e71660cc3e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:33.534775 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b3fce6f0-b6ba-473e-8945-e6efaa2cfb3f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1314 microversion: 2.1 time: 0.234858 Oct 04 21:09:33.545599 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 539/1078] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:33 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:33.546411 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4a11394c-dee6-4d60-ba72-8e71660cc3e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1292 microversion: 2.1 time: 0.241624 Oct 04 21:09:33.546411 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 540/1079] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:33 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1292 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:33.632202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-42ffff9e-1d01-4fb2-a43b-14b36e1e9e44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:33.632816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-42ffff9e-1d01-4fb2-a43b-14b36e1e9e44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:33.634777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=22 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:33.639718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42ffff9e-1d01-4fb2-a43b-14b36e1e9e44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:33.640204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42ffff9e-1d01-4fb2-a43b-14b36e1e9e44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:33.641471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42ffff9e-1d01-4fb2-a43b-14b36e1e9e44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:33.641471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42ffff9e-1d01-4fb2-a43b-14b36e1e9e44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:33.641871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42ffff9e-1d01-4fb2-a43b-14b36e1e9e44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:33.642374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42ffff9e-1d01-4fb2-a43b-14b36e1e9e44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:33.647129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-46cf5cf0-edaf-46ac-b7b4-d374df16cec8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:33.648097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-46cf5cf0-edaf-46ac-b7b4-d374df16cec8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:33.649937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=24 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:33.665682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46cf5cf0-edaf-46ac-b7b4-d374df16cec8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:33.665682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46cf5cf0-edaf-46ac-b7b4-d374df16cec8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:33.665682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46cf5cf0-edaf-46ac-b7b4-d374df16cec8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:33.665682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46cf5cf0-edaf-46ac-b7b4-d374df16cec8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:33.665682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46cf5cf0-edaf-46ac-b7b4-d374df16cec8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:33.665682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46cf5cf0-edaf-46ac-b7b4-d374df16cec8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:33.850400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-42ffff9e-1d01-4fb2-a43b-14b36e1e9e44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:33.858566 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-42ffff9e-1d01-4fb2-a43b-14b36e1e9e44 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1317 microversion: 2.1 time: 0.230259 Oct 04 21:09:33.859501 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 540/1080] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:33 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:33.863978 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-46cf5cf0-edaf-46ac-b7b4-d374df16cec8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:33.866391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-28bdf85b-fd8b-48cf-bcbe-193b7bdd6575 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:33.867157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-28bdf85b-fd8b-48cf-bcbe-193b7bdd6575 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:33.873638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:33.875211 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-46cf5cf0-edaf-46ac-b7b4-d374df16cec8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.231807 Oct 04 21:09:33.875741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28bdf85b-fd8b-48cf-bcbe-193b7bdd6575 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:33.876030 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 541/1081] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:33 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:33.876288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28bdf85b-fd8b-48cf-bcbe-193b7bdd6575 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:33.876999 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28bdf85b-fd8b-48cf-bcbe-193b7bdd6575 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:33.877923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28bdf85b-fd8b-48cf-bcbe-193b7bdd6575 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:33.878385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28bdf85b-fd8b-48cf-bcbe-193b7bdd6575 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:33.884473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28bdf85b-fd8b-48cf-bcbe-193b7bdd6575 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:33.884619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-67a8ac9d-5a42-4450-ad35-029e29f7f13a req-62ed1091-b334-49ab-bf9e-a2e61461b240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdefd528-2e7a-438e-b093-a98a4ec58e78", "name": "network-vif-plugged", "status": "completed", "tag": "2ce00f87-090e-47d0-917a-4baf600863f9"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:33.897458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-67a8ac9d-5a42-4450-ad35-029e29f7f13a req-62ed1091-b334-49ab-bf9e-a2e61461b240 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:33.897458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-67a8ac9d-5a42-4450-ad35-029e29f7f13a req-62ed1091-b334-49ab-bf9e-a2e61461b240 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:33.897458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-67a8ac9d-5a42-4450-ad35-029e29f7f13a req-62ed1091-b334-49ab-bf9e-a2e61461b240 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:33.903118 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-67a8ac9d-5a42-4450-ad35-029e29f7f13a req-62ed1091-b334-49ab-bf9e-a2e61461b240 service nova] Creating event network-vif-plugged:2ce00f87-090e-47d0-917a-4baf600863f9 for instance bdefd528-2e7a-438e-b093-a98a4ec58e78 on n-h1-860282-1 Oct 04 21:09:33.908727 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-67a8ac9d-5a42-4450-ad35-029e29f7f13a req-62ed1091-b334-49ab-bf9e-a2e61461b240 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031414 Oct 04 21:09:33.913568 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 542/1082] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:33.962541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-28bdf85b-fd8b-48cf-bcbe-193b7bdd6575 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:33.973578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-28bdf85b-fd8b-48cf-bcbe-193b7bdd6575 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:33.975040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-28bdf85b-fd8b-48cf-bcbe-193b7bdd6575 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:33.980283 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-28bdf85b-fd8b-48cf-bcbe-193b7bdd6575 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1540 microversion: 2.91 time: 0.119284 Oct 04 21:09:33.982029 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 541/1083] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:33 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1540 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:34.008349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-286767a1-7fe8-4f50-9b9b-eeb6a5921012 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-860282-1"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:34.010955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-286767a1-7fe8-4f50-9b9b-eeb6a5921012 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:34.018697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-286767a1-7fe8-4f50-9b9b-eeb6a5921012 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:34.021073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-286767a1-7fe8-4f50-9b9b-eeb6a5921012 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:34.021073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-286767a1-7fe8-4f50-9b9b-eeb6a5921012 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:34.021073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-286767a1-7fe8-4f50-9b9b-eeb6a5921012 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:34.021554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-286767a1-7fe8-4f50-9b9b-eeb6a5921012 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:34.022160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-286767a1-7fe8-4f50-9b9b-eeb6a5921012 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:34.093627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-286767a1-7fe8-4f50-9b9b-eeb6a5921012 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-860282-1". {{(pid=122758) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 21:09:34.349528 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-286767a1-7fe8-4f50-9b9b-eeb6a5921012 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e/action" status: 202 len: 0 microversion: 2.91 time: 0.345151 Oct 04 21:09:34.350594 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 543/1084] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Oct 4 21:09:34 2022] POST /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:09:34.358405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8252e65b-ef8b-418d-8651-22811f1dc39a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:34.359689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8252e65b-ef8b-418d-8651-22811f1dc39a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:34.370084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8252e65b-ef8b-418d-8651-22811f1dc39a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:34.370898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8252e65b-ef8b-418d-8651-22811f1dc39a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:34.371422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8252e65b-ef8b-418d-8651-22811f1dc39a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:34.373075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8252e65b-ef8b-418d-8651-22811f1dc39a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:34.373867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8252e65b-ef8b-418d-8651-22811f1dc39a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:34.374301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8252e65b-ef8b-418d-8651-22811f1dc39a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:34.443741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8252e65b-ef8b-418d-8651-22811f1dc39a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:34.451990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8252e65b-ef8b-418d-8651-22811f1dc39a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:34.453527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8252e65b-ef8b-418d-8651-22811f1dc39a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:34.468831 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8252e65b-ef8b-418d-8651-22811f1dc39a tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1548 microversion: 2.91 time: 0.110693 Oct 04 21:09:34.476662 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 542/1085] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:34 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1548 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:34.559304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dea149d1-4fd2-431f-8862-44793d624822 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:34.560476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dea149d1-4fd2-431f-8862-44793d624822 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:34.564203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a4da9487-7c91-4854-a6b2-c49778af55ae tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:34.565384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a4da9487-7c91-4854-a6b2-c49778af55ae tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:34.568341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dea149d1-4fd2-431f-8862-44793d624822 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:34.568970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dea149d1-4fd2-431f-8862-44793d624822 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:34.569564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dea149d1-4fd2-431f-8862-44793d624822 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:34.570595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dea149d1-4fd2-431f-8862-44793d624822 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:34.571157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dea149d1-4fd2-431f-8862-44793d624822 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:34.571730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dea149d1-4fd2-431f-8862-44793d624822 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:34.572418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a4da9487-7c91-4854-a6b2-c49778af55ae tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:34.572987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a4da9487-7c91-4854-a6b2-c49778af55ae tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:34.573478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a4da9487-7c91-4854-a6b2-c49778af55ae tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:34.574370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a4da9487-7c91-4854-a6b2-c49778af55ae tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:34.575089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a4da9487-7c91-4854-a6b2-c49778af55ae tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:34.576515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a4da9487-7c91-4854-a6b2-c49778af55ae tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:34.821571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dea149d1-4fd2-431f-8862-44793d624822 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:34.840617 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dea149d1-4fd2-431f-8862-44793d624822 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1314 microversion: 2.1 time: 0.285294 Oct 04 21:09:34.841952 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 544/1086] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:34 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:34.857942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a4da9487-7c91-4854-a6b2-c49778af55ae tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:34.868239 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a4da9487-7c91-4854-a6b2-c49778af55ae tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1482 microversion: 2.1 time: 0.308989 Oct 04 21:09:34.887628 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 543/1087] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:34 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1482 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:34.902825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aab63b21-35f2-44d3-8601-a4a9d930a7d2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:34.905491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-aab63b21-35f2-44d3-8601-a4a9d930a7d2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:34.913309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aab63b21-35f2-44d3-8601-a4a9d930a7d2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:34.914052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aab63b21-35f2-44d3-8601-a4a9d930a7d2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:34.914667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aab63b21-35f2-44d3-8601-a4a9d930a7d2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:34.916105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aab63b21-35f2-44d3-8601-a4a9d930a7d2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:34.916846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aab63b21-35f2-44d3-8601-a4a9d930a7d2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:34.917608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aab63b21-35f2-44d3-8601-a4a9d930a7d2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.027816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1d4b5459-5737-4b00-8f2e-ec04847e6aa5 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:35.034505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d4b5459-5737-4b00-8f2e-ec04847e6aa5 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.035217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d4b5459-5737-4b00-8f2e-ec04847e6aa5 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.036130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d4b5459-5737-4b00-8f2e-ec04847e6aa5 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.037169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d4b5459-5737-4b00-8f2e-ec04847e6aa5 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.037832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d4b5459-5737-4b00-8f2e-ec04847e6aa5 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.038709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d4b5459-5737-4b00-8f2e-ec04847e6aa5 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.094423 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1d4b5459-5737-4b00-8f2e-ec04847e6aa5 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.251248 Oct 04 21:09:35.096360 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 545/1088] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:09:34 2022] GET /compute/v2.1/os-services => generated 944 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:35.102225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-23892062-036c-485a-ab0a-5fb0c52254af tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:35.102911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-23892062-036c-485a-ab0a-5fb0c52254af tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:35.109487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-aab63b21-35f2-44d3-8601-a4a9d930a7d2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:35.119793 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-aab63b21-35f2-44d3-8601-a4a9d930a7d2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1317 microversion: 2.1 time: 0.220768 Oct 04 21:09:35.122581 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 544/1089] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:34 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:35.137567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23892062-036c-485a-ab0a-5fb0c52254af tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.137567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23892062-036c-485a-ab0a-5fb0c52254af tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.137567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23892062-036c-485a-ab0a-5fb0c52254af tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.137567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23892062-036c-485a-ab0a-5fb0c52254af tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.137567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23892062-036c-485a-ab0a-5fb0c52254af tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.137567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23892062-036c-485a-ab0a-5fb0c52254af tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.144444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-24b7d76c-9cb6-4749-b4fc-4a6d296ddc24 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:35.148459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-24b7d76c-9cb6-4749-b4fc-4a6d296ddc24 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:35.153691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24b7d76c-9cb6-4749-b4fc-4a6d296ddc24 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.154421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24b7d76c-9cb6-4749-b4fc-4a6d296ddc24 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.155066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24b7d76c-9cb6-4749-b4fc-4a6d296ddc24 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.155856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24b7d76c-9cb6-4749-b4fc-4a6d296ddc24 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.156392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24b7d76c-9cb6-4749-b4fc-4a6d296ddc24 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.156885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24b7d76c-9cb6-4749-b4fc-4a6d296ddc24 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.259416 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-23892062-036c-485a-ab0a-5fb0c52254af tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.161804 Oct 04 21:09:35.260208 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 546/1090] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:09:35 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:35.266481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-75d82fba-bc58-4da4-843d-25ec756bfb0c tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:35.274608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75d82fba-bc58-4da4-843d-25ec756bfb0c tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.276820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75d82fba-bc58-4da4-843d-25ec756bfb0c tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.277480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75d82fba-bc58-4da4-843d-25ec756bfb0c tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.280714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75d82fba-bc58-4da4-843d-25ec756bfb0c tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.282124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75d82fba-bc58-4da4-843d-25ec756bfb0c tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.286179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75d82fba-bc58-4da4-843d-25ec756bfb0c tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.328687 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-75d82fba-bc58-4da4-843d-25ec756bfb0c tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=n-d-860282-1" status: 200 len: 578 microversion: 2.1 time: 0.067131 Oct 04 21:09:35.329298 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 547/1091] 10.222.0.30 () {58 vars in 1172 bytes} [Tue Oct 4 21:09:35 2022] GET /compute/v2.1/os-services?host=n-d-860282-1 => generated 578 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:35.344476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f164bd1f-1e20-48c8-a407-890804381d47 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:35.348864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f164bd1f-1e20-48c8-a407-890804381d47 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.349661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f164bd1f-1e20-48c8-a407-890804381d47 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.350697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f164bd1f-1e20-48c8-a407-890804381d47 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.351661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f164bd1f-1e20-48c8-a407-890804381d47 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.352296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f164bd1f-1e20-48c8-a407-890804381d47 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.352878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f164bd1f-1e20-48c8-a407-890804381d47 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.364998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:35.383123 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f164bd1f-1e20-48c8-a407-890804381d47 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044302 Oct 04 21:09:35.384027 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 548/1092] 10.222.0.30 () {58 vars in 1176 bytes} [Tue Oct 4 21:09:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:09:35.397977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c5c9622b-de34-4c06-a869-aab4f5d495d6 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:35.401413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5c9622b-de34-4c06-a869-aab4f5d495d6 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.401930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5c9622b-de34-4c06-a869-aab4f5d495d6 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.402368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5c9622b-de34-4c06-a869-aab4f5d495d6 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.403097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5c9622b-de34-4c06-a869-aab4f5d495d6 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.403746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5c9622b-de34-4c06-a869-aab4f5d495d6 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.404181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5c9622b-de34-4c06-a869-aab4f5d495d6 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.430515 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c5c9622b-de34-4c06-a869-aab4f5d495d6 tempest-ServicesAdminTestJSON-833246302 tempest-ServicesAdminTestJSON-833246302-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.036222 Oct 04 21:09:35.437803 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 549/1093] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:09:35 2022] GET /compute/v2.1/os-services => generated 944 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:09:35.463923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-24b7d76c-9cb6-4749-b4fc-4a6d296ddc24 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:35.478646 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-24b7d76c-9cb6-4749-b4fc-4a6d296ddc24 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.354603 Oct 04 21:09:35.479891 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 545/1094] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:35 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:35.508751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ab41dc43-8179-4fb6-9ba2-80165292c89e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:35.510374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ab41dc43-8179-4fb6-9ba2-80165292c89e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:35.528596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab41dc43-8179-4fb6-9ba2-80165292c89e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.530926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab41dc43-8179-4fb6-9ba2-80165292c89e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.532571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab41dc43-8179-4fb6-9ba2-80165292c89e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.534285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab41dc43-8179-4fb6-9ba2-80165292c89e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.536426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab41dc43-8179-4fb6-9ba2-80165292c89e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.538694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab41dc43-8179-4fb6-9ba2-80165292c89e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.747005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ab41dc43-8179-4fb6-9ba2-80165292c89e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:35.759184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ab41dc43-8179-4fb6-9ba2-80165292c89e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:35.761007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ab41dc43-8179-4fb6-9ba2-80165292c89e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:35.768360 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ab41dc43-8179-4fb6-9ba2-80165292c89e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1548 microversion: 2.91 time: 0.273738 Oct 04 21:09:35.783710 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 550/1095] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:35 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1548 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:35.867429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-64a96fd7-548e-4aa0-9bae-db3c9b13e22f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:35.868524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-64a96fd7-548e-4aa0-9bae-db3c9b13e22f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:35.876054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64a96fd7-548e-4aa0-9bae-db3c9b13e22f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.876935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64a96fd7-548e-4aa0-9bae-db3c9b13e22f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.877741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64a96fd7-548e-4aa0-9bae-db3c9b13e22f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.878745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64a96fd7-548e-4aa0-9bae-db3c9b13e22f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.879470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64a96fd7-548e-4aa0-9bae-db3c9b13e22f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.880135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64a96fd7-548e-4aa0-9bae-db3c9b13e22f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:36.132968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-64a96fd7-548e-4aa0-9bae-db3c9b13e22f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:36.142887 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-64a96fd7-548e-4aa0-9bae-db3c9b13e22f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1463 microversion: 2.1 time: 0.279309 Oct 04 21:09:36.142887 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 546/1096] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:35 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1463 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:36.161298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4c842db3-9c06-4619-943b-00a7db46b56b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:36.161966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4c842db3-9c06-4619-943b-00a7db46b56b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:36.165441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1167a461-6c75-4490-acfa-da539626ea65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:36.166079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1167a461-6c75-4490-acfa-da539626ea65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:36.168521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c842db3-9c06-4619-943b-00a7db46b56b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:36.169744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c842db3-9c06-4619-943b-00a7db46b56b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:36.170354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c842db3-9c06-4619-943b-00a7db46b56b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:36.171403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c842db3-9c06-4619-943b-00a7db46b56b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:36.172021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c842db3-9c06-4619-943b-00a7db46b56b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:36.172842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c842db3-9c06-4619-943b-00a7db46b56b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:36.173410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1167a461-6c75-4490-acfa-da539626ea65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:36.173933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1167a461-6c75-4490-acfa-da539626ea65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:36.174380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1167a461-6c75-4490-acfa-da539626ea65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:36.175089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1167a461-6c75-4490-acfa-da539626ea65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:36.175555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1167a461-6c75-4490-acfa-da539626ea65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:36.175988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1167a461-6c75-4490-acfa-da539626ea65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:36.492612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4c842db3-9c06-4619-943b-00a7db46b56b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:36.503319 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4c842db3-9c06-4619-943b-00a7db46b56b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1466 microversion: 2.1 time: 0.346095 Oct 04 21:09:36.504241 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 551/1097] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:36 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1466 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:36.513389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a9145f02-21a6-4b5a-aa3e-df171bb5f3a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:36.514007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a9145f02-21a6-4b5a-aa3e-df171bb5f3a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:36.524378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a9145f02-21a6-4b5a-aa3e-df171bb5f3a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:36.524872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a9145f02-21a6-4b5a-aa3e-df171bb5f3a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:36.525704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a9145f02-21a6-4b5a-aa3e-df171bb5f3a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:36.526340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a9145f02-21a6-4b5a-aa3e-df171bb5f3a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:36.526797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a9145f02-21a6-4b5a-aa3e-df171bb5f3a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:36.532235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a9145f02-21a6-4b5a-aa3e-df171bb5f3a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:36.550025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1167a461-6c75-4490-acfa-da539626ea65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:36.563775 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1167a461-6c75-4490-acfa-da539626ea65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1463 microversion: 2.1 time: 0.402067 Oct 04 21:09:36.564657 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 547/1098] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:36 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1463 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:36.569877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8e3bda31-867a-4658-999d-06407da251dc tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:36.570693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8e3bda31-867a-4658-999d-06407da251dc tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:36.577604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e3bda31-867a-4658-999d-06407da251dc tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:36.578098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e3bda31-867a-4658-999d-06407da251dc tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:36.578672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e3bda31-867a-4658-999d-06407da251dc tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:36.579568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e3bda31-867a-4658-999d-06407da251dc tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:36.580187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e3bda31-867a-4658-999d-06407da251dc tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:36.580880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e3bda31-867a-4658-999d-06407da251dc tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:36.586062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:36.872885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a9145f02-21a6-4b5a-aa3e-df171bb5f3a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:36.883131 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a9145f02-21a6-4b5a-aa3e-df171bb5f3a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.375429 Oct 04 21:09:36.884183 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 552/1099] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:36 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:36.890721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-23bf469b-934b-464a-aadd-65ae9e026def tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-384226746", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "2480cf36-216a-4565-a5b3-2430424a7a6e"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:36.896247 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8e3bda31-867a-4658-999d-06407da251dc tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1617 microversion: 2.1 time: 0.330280 Oct 04 21:09:36.910263 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 548/1100] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:36 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1617 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:36.933528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-911d08e6-bfce-4010-8fb1-f4c1c73b884f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:36.934598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-911d08e6-bfce-4010-8fb1-f4c1c73b884f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:36.942956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-911d08e6-bfce-4010-8fb1-f4c1c73b884f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:36.943793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-911d08e6-bfce-4010-8fb1-f4c1c73b884f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:36.944668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-911d08e6-bfce-4010-8fb1-f4c1c73b884f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:36.946879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-911d08e6-bfce-4010-8fb1-f4c1c73b884f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:36.947940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-911d08e6-bfce-4010-8fb1-f4c1c73b884f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:36.949172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-911d08e6-bfce-4010-8fb1-f4c1c73b884f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:36.991712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-23bf469b-934b-464a-aadd-65ae9e026def tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:09:37.095431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-911d08e6-bfce-4010-8fb1-f4c1c73b884f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:37.103798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-911d08e6-bfce-4010-8fb1-f4c1c73b884f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:37.105285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-911d08e6-bfce-4010-8fb1-f4c1c73b884f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:37.111114 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-911d08e6-bfce-4010-8fb1-f4c1c73b884f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1490 microversion: 2.91 time: 0.198808 Oct 04 21:09:37.116322 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 549/1101] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:36 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1490 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:37.120014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7fa52846-962f-4ae5-a9b4-2a205749147f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-584947571", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "f201296c-ba54-4f1e-984a-461dfe55d267"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:37.188185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-7fa52846-962f-4ae5-a9b4-2a205749147f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] validate_networks() for None {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:09:37.428506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-23bf469b-934b-464a-aadd-65ae9e026def tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:09:37.429222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-23bf469b-934b-464a-aadd-65ae9e026def tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:09:37.429946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-23bf469b-934b-464a-aadd-65ae9e026def tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:09:37.430578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-23bf469b-934b-464a-aadd-65ae9e026def tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:09:37.431197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-23bf469b-934b-464a-aadd-65ae9e026def tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:09:37.441123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23bf469b-934b-464a-aadd-65ae9e026def tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:37.441804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23bf469b-934b-464a-aadd-65ae9e026def tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:37.446373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23bf469b-934b-464a-aadd-65ae9e026def tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:37.446373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23bf469b-934b-464a-aadd-65ae9e026def tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:37.446373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23bf469b-934b-464a-aadd-65ae9e026def tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:37.446373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23bf469b-934b-464a-aadd-65ae9e026def tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:37.463561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-23bf469b-934b-464a-aadd-65ae9e026def tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Getting quotas for project aa2f4ca02ad74730963245d9e018a386. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:09:37.469905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-23bf469b-934b-464a-aadd-65ae9e026def tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Getting quotas for user 5320f1606bbc49d693ae96f7b7ac516a and project aa2f4ca02ad74730963245d9e018a386. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:09:37.484942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-23bf469b-934b-464a-aadd-65ae9e026def tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:09:37.487776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-23bf469b-934b-464a-aadd-65ae9e026def tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:09:37.565536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7fa52846-962f-4ae5-a9b4-2a205749147f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:09:37.565968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7fa52846-962f-4ae5-a9b4-2a205749147f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:09:37.566441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7fa52846-962f-4ae5-a9b4-2a205749147f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:09:37.566860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7fa52846-962f-4ae5-a9b4-2a205749147f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:09:37.567457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7fa52846-962f-4ae5-a9b4-2a205749147f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:09:37.577936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fa52846-962f-4ae5-a9b4-2a205749147f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:37.578671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fa52846-962f-4ae5-a9b4-2a205749147f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:37.579451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fa52846-962f-4ae5-a9b4-2a205749147f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:37.580459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fa52846-962f-4ae5-a9b4-2a205749147f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:37.581075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fa52846-962f-4ae5-a9b4-2a205749147f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:37.581704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fa52846-962f-4ae5-a9b4-2a205749147f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:37.594289 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-23bf469b-934b-464a-aadd-65ae9e026def tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708368 Oct 04 21:09:37.595525 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 553/1102] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:09:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:09:37.601115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-57dc8b36-5842-42fb-a206-3f413a01b7e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:37.602263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-57dc8b36-5842-42fb-a206-3f413a01b7e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:37.609702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57dc8b36-5842-42fb-a206-3f413a01b7e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:37.612714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57dc8b36-5842-42fb-a206-3f413a01b7e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:37.612714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57dc8b36-5842-42fb-a206-3f413a01b7e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:37.613038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-7fa52846-962f-4ae5-a9b4-2a205749147f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:09:37.614129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57dc8b36-5842-42fb-a206-3f413a01b7e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:37.615108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57dc8b36-5842-42fb-a206-3f413a01b7e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:37.615758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57dc8b36-5842-42fb-a206-3f413a01b7e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:37.618754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-7fa52846-962f-4ae5-a9b4-2a205749147f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Getting quotas for user 0f0ac29dc4e440e785408fa1dfedce5e and project 801ce5c5897d4894a6a2ffc1b27191aa. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:09:37.632889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7fa52846-962f-4ae5-a9b4-2a205749147f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:09:37.635264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7fa52846-962f-4ae5-a9b4-2a205749147f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:09:37.801522 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7fa52846-962f-4ae5-a9b4-2a205749147f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688647 Oct 04 21:09:37.802183 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 550/1103] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:09:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:09:37.807196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-302b0394-e4cb-4df1-b508-45faa4b4d650 req-5a2a0e66-cfb4-465c-bf6e-99207aefa685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff9a9f7b-0c44-4de4-9171-a14d2c39e096", "tag": "cac1c9b0-2f6f-49d5-bf55-ff55af059f63"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:37.820878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-302b0394-e4cb-4df1-b508-45faa4b4d650 req-5a2a0e66-cfb4-465c-bf6e-99207aefa685 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:37.821731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-302b0394-e4cb-4df1-b508-45faa4b4d650 req-5a2a0e66-cfb4-465c-bf6e-99207aefa685 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:37.822547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-302b0394-e4cb-4df1-b508-45faa4b4d650 req-5a2a0e66-cfb4-465c-bf6e-99207aefa685 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:37.849480 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-302b0394-e4cb-4df1-b508-45faa4b4d650 req-5a2a0e66-cfb4-465c-bf6e-99207aefa685 service nova] Creating event network-changed:cac1c9b0-2f6f-49d5-bf55-ff55af059f63 for instance ff9a9f7b-0c44-4de4-9171-a14d2c39e096 on n-h2-860282-1 Oct 04 21:09:37.863706 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-302b0394-e4cb-4df1-b508-45faa4b4d650 req-5a2a0e66-cfb4-465c-bf6e-99207aefa685 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059704 Oct 04 21:09:37.864577 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 551/1104] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:37.870732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3fcbf8d1-21a4-4e0c-a49b-621312c8e9aa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:37.872448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3fcbf8d1-21a4-4e0c-a49b-621312c8e9aa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:38.010635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3fcbf8d1-21a4-4e0c-a49b-621312c8e9aa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:38.020309 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3fcbf8d1-21a4-4e0c-a49b-621312c8e9aa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1213 microversion: 2.1 time: 0.154243 Oct 04 21:09:38.021855 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 552/1105] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:37 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1213 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:38.033099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bbec891e-e7ce-4da9-a1fe-ac642138b51a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:38.034459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-57dc8b36-5842-42fb-a206-3f413a01b7e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:38.036669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bbec891e-e7ce-4da9-a1fe-ac642138b51a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:38.045604 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-57dc8b36-5842-42fb-a206-3f413a01b7e0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1482 microversion: 2.1 time: 0.447379 Oct 04 21:09:38.050127 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 554/1106] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:37 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1482 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:38.056086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-78eb24be-8f0f-49f2-9bd2-8d4863732115 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:38.056698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-78eb24be-8f0f-49f2-9bd2-8d4863732115 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:38.081944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78eb24be-8f0f-49f2-9bd2-8d4863732115 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:38.082603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78eb24be-8f0f-49f2-9bd2-8d4863732115 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:38.083122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78eb24be-8f0f-49f2-9bd2-8d4863732115 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:38.083983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78eb24be-8f0f-49f2-9bd2-8d4863732115 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:38.084571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78eb24be-8f0f-49f2-9bd2-8d4863732115 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:38.085075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78eb24be-8f0f-49f2-9bd2-8d4863732115 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:38.572359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bbec891e-e7ce-4da9-a1fe-ac642138b51a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:38.582700 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bbec891e-e7ce-4da9-a1fe-ac642138b51a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 200 len: 1216 microversion: 2.1 time: 0.559487 Oct 04 21:09:38.583283 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 553/1107] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:38 2022] GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 1216 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:38.599097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c6930b58-e60c-4cb1-b912-be19272b3d59 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:38.599916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c6930b58-e60c-4cb1-b912-be19272b3d59 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:38.614339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6930b58-e60c-4cb1-b912-be19272b3d59 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:38.614850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6930b58-e60c-4cb1-b912-be19272b3d59 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:38.615296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6930b58-e60c-4cb1-b912-be19272b3d59 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:38.616017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6930b58-e60c-4cb1-b912-be19272b3d59 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:38.616476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6930b58-e60c-4cb1-b912-be19272b3d59 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:38.618361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6930b58-e60c-4cb1-b912-be19272b3d59 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:38.815647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c6930b58-e60c-4cb1-b912-be19272b3d59 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:38.825103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c6930b58-e60c-4cb1-b912-be19272b3d59 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:38.829891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c6930b58-e60c-4cb1-b912-be19272b3d59 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:38.835006 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c6930b58-e60c-4cb1-b912-be19272b3d59 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.250309 Oct 04 21:09:38.835722 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 554/1108] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:38 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:38.856250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-78eb24be-8f0f-49f2-9bd2-8d4863732115 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:38.864586 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-78eb24be-8f0f-49f2-9bd2-8d4863732115 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.813177 Oct 04 21:09:38.865160 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 555/1109] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:38 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:39.045274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-61f09339-21bc-408e-8195-087b3e4480fa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:39.046459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-61f09339-21bc-408e-8195-087b3e4480fa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:39.054015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61f09339-21bc-408e-8195-087b3e4480fa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:39.054504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61f09339-21bc-408e-8195-087b3e4480fa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:39.054942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61f09339-21bc-408e-8195-087b3e4480fa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:39.055640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61f09339-21bc-408e-8195-087b3e4480fa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:39.056392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61f09339-21bc-408e-8195-087b3e4480fa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:39.056824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61f09339-21bc-408e-8195-087b3e4480fa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:39.110765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-344b52d9-88fa-491a-81a3-f2affc5cdd38 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:39.111377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-344b52d9-88fa-491a-81a3-f2affc5cdd38 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:39.117845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-344b52d9-88fa-491a-81a3-f2affc5cdd38 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:39.118333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-344b52d9-88fa-491a-81a3-f2affc5cdd38 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:39.118765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-344b52d9-88fa-491a-81a3-f2affc5cdd38 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:39.119458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-344b52d9-88fa-491a-81a3-f2affc5cdd38 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:39.120098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-344b52d9-88fa-491a-81a3-f2affc5cdd38 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:39.121216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-344b52d9-88fa-491a-81a3-f2affc5cdd38 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:39.125742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-61f09339-21bc-408e-8195-087b3e4480fa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:39.133758 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-61f09339-21bc-408e-8195-087b3e4480fa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1217 microversion: 2.1 time: 0.093933 Oct 04 21:09:39.134345 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 555/1110] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:39 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:39.269186 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-344b52d9-88fa-491a-81a3-f2affc5cdd38 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1809 microversion: 2.1 time: 0.162599 Oct 04 21:09:39.269910 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 556/1111] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:39 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:39.296776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab590d8b-96a1-4a99-9ea4-654d86d4896a tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:39.301034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab590d8b-96a1-4a99-9ea4-654d86d4896a tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:39.301757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab590d8b-96a1-4a99-9ea4-654d86d4896a tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:39.302203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab590d8b-96a1-4a99-9ea4-654d86d4896a tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:39.302982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab590d8b-96a1-4a99-9ea4-654d86d4896a tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:39.303445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab590d8b-96a1-4a99-9ea4-654d86d4896a tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:39.304075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab590d8b-96a1-4a99-9ea4-654d86d4896a tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:39.335930 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ab590d8b-96a1-4a99-9ea4-654d86d4896a tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044846 Oct 04 21:09:39.336567 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 556/1112] 10.222.0.30 () {58 vars in 1176 bytes} [Tue Oct 4 21:09:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:39.610479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-921607a6-4cf7-4434-a6bd-6a7fdbbf21a1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:39.611370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-921607a6-4cf7-4434-a6bd-6a7fdbbf21a1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:39.625562 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-921607a6-4cf7-4434-a6bd-6a7fdbbf21a1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:39.631363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-921607a6-4cf7-4434-a6bd-6a7fdbbf21a1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:39.631824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-921607a6-4cf7-4434-a6bd-6a7fdbbf21a1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:39.636691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-921607a6-4cf7-4434-a6bd-6a7fdbbf21a1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:39.636691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-921607a6-4cf7-4434-a6bd-6a7fdbbf21a1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:39.636691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-921607a6-4cf7-4434-a6bd-6a7fdbbf21a1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:39.814753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-921607a6-4cf7-4434-a6bd-6a7fdbbf21a1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:39.825412 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-921607a6-4cf7-4434-a6bd-6a7fdbbf21a1 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 200 len: 1212 microversion: 2.1 time: 0.219979 Oct 04 21:09:39.838030 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 557/1113] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:39 2022] GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 1212 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:39.873287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-53efc261-a940-4650-b496-a62f79a3aaff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:39.873287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-53efc261-a940-4650-b496-a62f79a3aaff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:39.884035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53efc261-a940-4650-b496-a62f79a3aaff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:39.884569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53efc261-a940-4650-b496-a62f79a3aaff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:39.885013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53efc261-a940-4650-b496-a62f79a3aaff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:39.885948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53efc261-a940-4650-b496-a62f79a3aaff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:39.886405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53efc261-a940-4650-b496-a62f79a3aaff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:39.886834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53efc261-a940-4650-b496-a62f79a3aaff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:39.902071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-caa97fba-bf6f-498d-b0cc-ed42d85ac8e2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:39.903454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-caa97fba-bf6f-498d-b0cc-ed42d85ac8e2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:39.909813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-caa97fba-bf6f-498d-b0cc-ed42d85ac8e2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:39.910511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-caa97fba-bf6f-498d-b0cc-ed42d85ac8e2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:39.911106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-caa97fba-bf6f-498d-b0cc-ed42d85ac8e2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:39.922235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-caa97fba-bf6f-498d-b0cc-ed42d85ac8e2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:39.923131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-caa97fba-bf6f-498d-b0cc-ed42d85ac8e2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:39.926334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-caa97fba-bf6f-498d-b0cc-ed42d85ac8e2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:40.008651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-53efc261-a940-4650-b496-a62f79a3aaff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:40.018759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-53efc261-a940-4650-b496-a62f79a3aaff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:40.019920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-53efc261-a940-4650-b496-a62f79a3aaff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:40.038390 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-53efc261-a940-4650-b496-a62f79a3aaff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.178214 Oct 04 21:09:40.039907 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 557/1114] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:39 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:40.160978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-002ab9e0-9d46-4c59-bccf-1e4682063e9c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:40.162399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-002ab9e0-9d46-4c59-bccf-1e4682063e9c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:40.178173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-002ab9e0-9d46-4c59-bccf-1e4682063e9c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:40.178843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-002ab9e0-9d46-4c59-bccf-1e4682063e9c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:40.179342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-002ab9e0-9d46-4c59-bccf-1e4682063e9c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:40.180094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-002ab9e0-9d46-4c59-bccf-1e4682063e9c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:40.180558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-002ab9e0-9d46-4c59-bccf-1e4682063e9c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:40.180983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-002ab9e0-9d46-4c59-bccf-1e4682063e9c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:40.196426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-caa97fba-bf6f-498d-b0cc-ed42d85ac8e2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:40.207145 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-caa97fba-bf6f-498d-b0cc-ed42d85ac8e2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.322509 Oct 04 21:09:40.207743 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 558/1115] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:39 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:40.366702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-002ab9e0-9d46-4c59-bccf-1e4682063e9c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:40.385576 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-002ab9e0-9d46-4c59-bccf-1e4682063e9c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1265 microversion: 2.1 time: 0.226277 Oct 04 21:09:40.385576 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 558/1116] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:40 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:40.673532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa94b408-84bf-45e4-bf44-239099da17f5 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:40.682359 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aa94b408-84bf-45e4-bf44-239099da17f5 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.253810 Oct 04 21:09:40.683024 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 559/1117] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:09:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:40.698975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a15abc63-b35c-4b81-b9ef-60a883871a91 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:40.721046 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a15abc63-b35c-4b81-b9ef-60a883871a91 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.026382 Oct 04 21:09:40.722751 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 559/1118] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Oct 4 21:09:40 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:40.742144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c5c174a0-966c-496d-ad7b-222d263c3468 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:40.753663 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c5c174a0-966c-496d-ad7b-222d263c3468 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016484 Oct 04 21:09:40.754540 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 560/1119] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:09:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:40.775459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1b73417c-6b61-400d-88c6-6c41bed1712e tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:40.776200 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1b73417c-6b61-400d-88c6-6c41bed1712e tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012937 Oct 04 21:09:40.776977 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 560/1120] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:09:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:40.790120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-10a6ef5e-629a-48bd-8f0e-62d836d0d4b4 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:40.819094 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-10a6ef5e-629a-48bd-8f0e-62d836d0d4b4 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.033305 Oct 04 21:09:40.838103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8a0c0e54-9109-44fa-a4d5-e987d32e6e08 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:40.842484 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 561/1121] 10.222.0.30 () {58 vars in 1165 bytes} [Tue Oct 4 21:09:40 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:40.847461 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8a0c0e54-9109-44fa-a4d5-e987d32e6e08 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013235 Oct 04 21:09:40.849151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-92d828b1-946b-4720-bb99-4a3600b6945a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:40.849774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-92d828b1-946b-4720-bb99-4a3600b6945a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:40.850583 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 561/1122] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:09:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:40.865022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-33e4fc25-eb47-4fdd-a9b6-a106d5292f42 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:40.866541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92d828b1-946b-4720-bb99-4a3600b6945a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:40.867037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92d828b1-946b-4720-bb99-4a3600b6945a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:40.867474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92d828b1-946b-4720-bb99-4a3600b6945a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:40.868176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92d828b1-946b-4720-bb99-4a3600b6945a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:40.868619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92d828b1-946b-4720-bb99-4a3600b6945a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:40.869232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92d828b1-946b-4720-bb99-4a3600b6945a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:40.928951 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-33e4fc25-eb47-4fdd-a9b6-a106d5292f42 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.068964 Oct 04 21:09:40.930905 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 562/1123] 10.222.0.30 () {58 vars in 1169 bytes} [Tue Oct 4 21:09:40 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:40.947967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a3ed8afa-81a0-4998-9f36-c051aa51cf96 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:40.961829 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a3ed8afa-81a0-4998-9f36-c051aa51cf96 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.017953 Oct 04 21:09:40.963045 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 563/1124] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Oct 4 21:09:40 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:40.977822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-edd2ae99-b061-4e93-a18a-4a20a6fdc7b9 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:40.994003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-92d828b1-946b-4720-bb99-4a3600b6945a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:41.003566 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-edd2ae99-b061-4e93-a18a-4a20a6fdc7b9 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027806 Oct 04 21:09:41.003566 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 564/1125] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:09:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:41.034892 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-92d828b1-946b-4720-bb99-4a3600b6945a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 200 len: 1268 microversion: 2.1 time: 0.169932 Oct 04 21:09:41.034892 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 562/1126] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:40 2022] GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:41.035190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3cafa1e8-f32a-4598-8035-801e1b4d7651 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:41.070385 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3cafa1e8-f32a-4598-8035-801e1b4d7651 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.058233 Oct 04 21:09:41.072874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4b5518bd-be7a-4cb0-87fc-5b3cc045b972 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:41.073983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4b5518bd-be7a-4cb0-87fc-5b3cc045b972 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:41.082932 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 565/1127] 10.222.0.30 () {58 vars in 1167 bytes} [Tue Oct 4 21:09:41 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:41.087425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b5518bd-be7a-4cb0-87fc-5b3cc045b972 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:41.087864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d978f808-e3da-424f-9157-af6553c49f78 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:41.096205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b5518bd-be7a-4cb0-87fc-5b3cc045b972 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:41.096758 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d978f808-e3da-424f-9157-af6553c49f78 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012684 Oct 04 21:09:41.097114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b5518bd-be7a-4cb0-87fc-5b3cc045b972 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:41.099634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b5518bd-be7a-4cb0-87fc-5b3cc045b972 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:41.100415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b5518bd-be7a-4cb0-87fc-5b3cc045b972 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:41.101237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b5518bd-be7a-4cb0-87fc-5b3cc045b972 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:41.104592 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 566/1128] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:09:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:41.110218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0b27cd1a-a63b-44be-88e8-70cf8a441bd7 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:41.143522 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0b27cd1a-a63b-44be-88e8-70cf8a441bd7 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] 10.222.0.30 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.037588 Oct 04 21:09:41.157781 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 567/1129] 10.222.0.30 () {58 vars in 1144 bytes} [Tue Oct 4 21:09:41 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:41.163088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4d300a3a-66fa-4948-b106-c2cf1d525c05 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:41.178129 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4d300a3a-66fa-4948-b106-c2cf1d525c05 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018549 Oct 04 21:09:41.188088 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 568/1130] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:09:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:41.193291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f3d90f86-3e19-4b2e-b4db-781d4429b1b3 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:41.219037 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f3d90f86-3e19-4b2e-b4db-781d4429b1b3 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] 10.222.0.30 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.028970 Oct 04 21:09:41.228729 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 569/1131] 10.222.0.30 () {58 vars in 1148 bytes} [Tue Oct 4 21:09:41 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:41.249632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3782da5b-aff8-401d-bf87-12cfd43b24ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:41.250294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3782da5b-aff8-401d-bf87-12cfd43b24ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:41.258002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4b5518bd-be7a-4cb0-87fc-5b3cc045b972 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:41.271706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3782da5b-aff8-401d-bf87-12cfd43b24ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:41.272276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3782da5b-aff8-401d-bf87-12cfd43b24ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:41.272731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3782da5b-aff8-401d-bf87-12cfd43b24ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:41.273493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3782da5b-aff8-401d-bf87-12cfd43b24ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:41.275870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3782da5b-aff8-401d-bf87-12cfd43b24ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:41.276390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3782da5b-aff8-401d-bf87-12cfd43b24ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:41.276977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4b5518bd-be7a-4cb0-87fc-5b3cc045b972 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:41.283856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4b5518bd-be7a-4cb0-87fc-5b3cc045b972 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:41.296535 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4b5518bd-be7a-4cb0-87fc-5b3cc045b972 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.224712 Oct 04 21:09:41.299621 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 563/1132] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:41 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:09:41.307975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0b9dd76e-5412-402d-a858-9a2afc892423 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:41.345097 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0b9dd76e-5412-402d-a858-9a2afc892423 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] 10.222.0.30 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.036096 Oct 04 21:09:41.345097 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 564/1133] 10.222.0.30 () {58 vars in 1140 bytes} [Tue Oct 4 21:09:41 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:41.359725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2923f3b7-207b-4c7c-aaa5-b286599a4d9d tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:41.376020 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2923f3b7-207b-4c7c-aaa5-b286599a4d9d tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028667 Oct 04 21:09:41.381517 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 565/1134] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:09:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:09:41.399402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c324f54e-144e-47d5-9b8a-2b6c6f3d300a tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:41.485168 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c324f54e-144e-47d5-9b8a-2b6c6f3d300a tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] 10.222.0.30 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.099643 Oct 04 21:09:41.488132 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 566/1135] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:09:41 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:41.494081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-22be60b3-bf0a-453f-80d2-3b954acd31cd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:41.504499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-22be60b3-bf0a-453f-80d2-3b954acd31cd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:41.517680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22be60b3-bf0a-453f-80d2-3b954acd31cd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:41.522751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22be60b3-bf0a-453f-80d2-3b954acd31cd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:41.524889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22be60b3-bf0a-453f-80d2-3b954acd31cd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:41.525769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22be60b3-bf0a-453f-80d2-3b954acd31cd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:41.530047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22be60b3-bf0a-453f-80d2-3b954acd31cd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:41.530576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22be60b3-bf0a-453f-80d2-3b954acd31cd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:41.635748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-22be60b3-bf0a-453f-80d2-3b954acd31cd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:41.648038 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-22be60b3-bf0a-453f-80d2-3b954acd31cd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1265 microversion: 2.1 time: 0.158566 Oct 04 21:09:41.652146 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 567/1136] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:41 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:41.665607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f5576556-3b98-48ce-aa81-0a0b0564abf2 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:41.695888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3782da5b-aff8-401d-bf87-12cfd43b24ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:41.716773 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3782da5b-aff8-401d-bf87-12cfd43b24ab tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.481750 Oct 04 21:09:41.717482 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 570/1137] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:41 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:41.969596 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f5576556-3b98-48ce-aa81-0a0b0564abf2 tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.314925 Oct 04 21:09:41.970681 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 568/1138] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:09:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:41.989834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-846666c4-397e-4fb2-b0cd-865908e5734d tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:42.000668 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-846666c4-397e-4fb2-b0cd-865908e5734d tempest-FlavorsV2TestJSON-588836107 tempest-FlavorsV2TestJSON-588836107-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015734 Oct 04 21:09:42.019010 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 571/1139] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:09:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:42.041469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cdc93a68-2441-401c-8612-33cc70a4b8ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:42.093597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cdc93a68-2441-401c-8612-33cc70a4b8ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:42.093597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cdc93a68-2441-401c-8612-33cc70a4b8ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:42.093597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cdc93a68-2441-401c-8612-33cc70a4b8ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:42.093597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cdc93a68-2441-401c-8612-33cc70a4b8ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:42.093597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cdc93a68-2441-401c-8612-33cc70a4b8ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:42.093597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cdc93a68-2441-401c-8612-33cc70a4b8ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:42.093597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cdc93a68-2441-401c-8612-33cc70a4b8ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:42.162820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cdc93a68-2441-401c-8612-33cc70a4b8ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:42.179766 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cdc93a68-2441-401c-8612-33cc70a4b8ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 200 len: 1286 microversion: 2.1 time: 0.142955 Oct 04 21:09:42.190107 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 569/1140] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:42 2022] GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 1286 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:42.333591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bafd371b-13a1-483a-8e92-aa6a33d90cd9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:42.335457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bafd371b-13a1-483a-8e92-aa6a33d90cd9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:42.343299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bafd371b-13a1-483a-8e92-aa6a33d90cd9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:42.343797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bafd371b-13a1-483a-8e92-aa6a33d90cd9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:42.344244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bafd371b-13a1-483a-8e92-aa6a33d90cd9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:42.344958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bafd371b-13a1-483a-8e92-aa6a33d90cd9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:42.345580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bafd371b-13a1-483a-8e92-aa6a33d90cd9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:42.346016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bafd371b-13a1-483a-8e92-aa6a33d90cd9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:42.432204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bafd371b-13a1-483a-8e92-aa6a33d90cd9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:42.442813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bafd371b-13a1-483a-8e92-aa6a33d90cd9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:42.444761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bafd371b-13a1-483a-8e92-aa6a33d90cd9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:42.451602 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bafd371b-13a1-483a-8e92-aa6a33d90cd9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.122503 Oct 04 21:09:42.458496 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 572/1141] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:42 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:42.683143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e032d0dd-83b2-4266-8dea-b71cb0108d70 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:42.684079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e032d0dd-83b2-4266-8dea-b71cb0108d70 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:42.701661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e032d0dd-83b2-4266-8dea-b71cb0108d70 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:42.701661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e032d0dd-83b2-4266-8dea-b71cb0108d70 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:42.701661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e032d0dd-83b2-4266-8dea-b71cb0108d70 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:42.701661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e032d0dd-83b2-4266-8dea-b71cb0108d70 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:42.701661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e032d0dd-83b2-4266-8dea-b71cb0108d70 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:42.705687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e032d0dd-83b2-4266-8dea-b71cb0108d70 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:42.746866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d95f066a-2e88-4800-b3cf-a5f624170646 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:42.748278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d95f066a-2e88-4800-b3cf-a5f624170646 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:42.757902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d95f066a-2e88-4800-b3cf-a5f624170646 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:42.758410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d95f066a-2e88-4800-b3cf-a5f624170646 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:42.758855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d95f066a-2e88-4800-b3cf-a5f624170646 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:42.762499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d95f066a-2e88-4800-b3cf-a5f624170646 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:42.765197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d95f066a-2e88-4800-b3cf-a5f624170646 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:42.770011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d95f066a-2e88-4800-b3cf-a5f624170646 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:42.861351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e032d0dd-83b2-4266-8dea-b71cb0108d70 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:42.870958 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e032d0dd-83b2-4266-8dea-b71cb0108d70 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1265 microversion: 2.1 time: 0.191625 Oct 04 21:09:42.875564 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 570/1142] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:42 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:42.880783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-158a06b3-f91a-4ce6-85dc-0268fc9b969f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc69a272-9755-4805-9b22-917f8e844aa5", "device": "/dev/xvdb"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:42.897911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-158a06b3-f91a-4ce6-85dc-0268fc9b969f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:42.919380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-158a06b3-f91a-4ce6-85dc-0268fc9b969f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:42.920149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-158a06b3-f91a-4ce6-85dc-0268fc9b969f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:42.920675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-158a06b3-f91a-4ce6-85dc-0268fc9b969f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:42.921498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-158a06b3-f91a-4ce6-85dc-0268fc9b969f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:42.922293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-158a06b3-f91a-4ce6-85dc-0268fc9b969f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:42.922975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-158a06b3-f91a-4ce6-85dc-0268fc9b969f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:43.089483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d95f066a-2e88-4800-b3cf-a5f624170646 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:43.101749 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d95f066a-2e88-4800-b3cf-a5f624170646 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.360151 Oct 04 21:09:43.107483 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 573/1143] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:42 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:43.213035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-90078835-dab7-4ab0-a3b2-53a9c73fd57a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:43.214679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-90078835-dab7-4ab0-a3b2-53a9c73fd57a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:43.221802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90078835-dab7-4ab0-a3b2-53a9c73fd57a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:43.222669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90078835-dab7-4ab0-a3b2-53a9c73fd57a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:43.223345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90078835-dab7-4ab0-a3b2-53a9c73fd57a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:43.224293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90078835-dab7-4ab0-a3b2-53a9c73fd57a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:43.224987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90078835-dab7-4ab0-a3b2-53a9c73fd57a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:43.225660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90078835-dab7-4ab0-a3b2-53a9c73fd57a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:43.320303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-90078835-dab7-4ab0-a3b2-53a9c73fd57a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:43.357667 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-90078835-dab7-4ab0-a3b2-53a9c73fd57a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 200 len: 1274 microversion: 2.1 time: 0.138204 Oct 04 21:09:43.357667 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 574/1144] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:43 2022] GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 1274 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:43.491354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a29ec8d2-1dc5-45ed-9254-5cc9a42d495f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:43.492855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a29ec8d2-1dc5-45ed-9254-5cc9a42d495f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:43.495864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:43.504291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a29ec8d2-1dc5-45ed-9254-5cc9a42d495f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:43.505363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a29ec8d2-1dc5-45ed-9254-5cc9a42d495f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:43.506257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a29ec8d2-1dc5-45ed-9254-5cc9a42d495f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:43.507612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a29ec8d2-1dc5-45ed-9254-5cc9a42d495f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:43.508801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a29ec8d2-1dc5-45ed-9254-5cc9a42d495f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:43.509517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a29ec8d2-1dc5-45ed-9254-5cc9a42d495f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:43.641317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a29ec8d2-1dc5-45ed-9254-5cc9a42d495f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:43.671594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a29ec8d2-1dc5-45ed-9254-5cc9a42d495f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:43.673872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a29ec8d2-1dc5-45ed-9254-5cc9a42d495f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:43.681708 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a29ec8d2-1dc5-45ed-9254-5cc9a42d495f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.196212 Oct 04 21:09:43.683904 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 575/1145] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:43 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:09:43.821270 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-158a06b3-f91a-4ce6-85dc-0268fc9b969f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "POST /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.943130 Oct 04 21:09:43.822597 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 571/1146] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 21:09:42 2022] POST /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments => generated 194 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:43.905169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-43cde03a-836a-4379-9cc0-f466f80e7a59 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:43.906064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-43cde03a-836a-4379-9cc0-f466f80e7a59 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:43.918500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43cde03a-836a-4379-9cc0-f466f80e7a59 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:43.923169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43cde03a-836a-4379-9cc0-f466f80e7a59 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:43.923169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43cde03a-836a-4379-9cc0-f466f80e7a59 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:43.929299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43cde03a-836a-4379-9cc0-f466f80e7a59 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:43.930071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43cde03a-836a-4379-9cc0-f466f80e7a59 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:43.932019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43cde03a-836a-4379-9cc0-f466f80e7a59 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:44.136849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-017ff67d-cc32-4f8c-8fe0-4974d7cfb6de tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:44.138124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-017ff67d-cc32-4f8c-8fe0-4974d7cfb6de tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:44.141912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:44.159247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-43cde03a-836a-4379-9cc0-f466f80e7a59 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:44.171421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-017ff67d-cc32-4f8c-8fe0-4974d7cfb6de tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:44.171997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-017ff67d-cc32-4f8c-8fe0-4974d7cfb6de tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:44.174413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-017ff67d-cc32-4f8c-8fe0-4974d7cfb6de tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:44.175338 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-43cde03a-836a-4379-9cc0-f466f80e7a59 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1273 microversion: 2.1 time: 0.274746 Oct 04 21:09:44.177128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-017ff67d-cc32-4f8c-8fe0-4974d7cfb6de tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:44.181774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-017ff67d-cc32-4f8c-8fe0-4974d7cfb6de tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:44.181875 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 576/1147] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:43 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1273 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:44.181971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-017ff67d-cc32-4f8c-8fe0-4974d7cfb6de tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:44.235320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:44.372777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-273b1c03-2fdd-41d5-b40d-97b756d982e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:44.377593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-273b1c03-2fdd-41d5-b40d-97b756d982e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:44.395689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-273b1c03-2fdd-41d5-b40d-97b756d982e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:44.395689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-273b1c03-2fdd-41d5-b40d-97b756d982e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:44.421939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-273b1c03-2fdd-41d5-b40d-97b756d982e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:44.429362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-273b1c03-2fdd-41d5-b40d-97b756d982e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:44.429362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-273b1c03-2fdd-41d5-b40d-97b756d982e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:44.429362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-273b1c03-2fdd-41d5-b40d-97b756d982e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:44.922429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-017ff67d-cc32-4f8c-8fe0-4974d7cfb6de tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:44.934511 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-017ff67d-cc32-4f8c-8fe0-4974d7cfb6de tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.802368 Oct 04 21:09:44.943102 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 572/1148] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:44 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:44.960182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-48db100b-1003-4ef8-83cc-ceaa12eb7a98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:44.963598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-48db100b-1003-4ef8-83cc-ceaa12eb7a98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:44.990990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48db100b-1003-4ef8-83cc-ceaa12eb7a98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:44.996079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48db100b-1003-4ef8-83cc-ceaa12eb7a98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:44.996736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48db100b-1003-4ef8-83cc-ceaa12eb7a98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:44.999761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48db100b-1003-4ef8-83cc-ceaa12eb7a98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:45.000420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48db100b-1003-4ef8-83cc-ceaa12eb7a98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:45.005876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48db100b-1003-4ef8-83cc-ceaa12eb7a98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:45.060989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-273b1c03-2fdd-41d5-b40d-97b756d982e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:45.072301 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-273b1c03-2fdd-41d5-b40d-97b756d982e2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 200 len: 1316 microversion: 2.1 time: 0.704012 Oct 04 21:09:45.072894 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 577/1149] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:44 2022] GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 1316 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:45.204431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-89d6c480-2b20-4d4f-ba1d-169cb207aac7 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:45.212444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-89d6c480-2b20-4d4f-ba1d-169cb207aac7 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:45.216899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89d6c480-2b20-4d4f-ba1d-169cb207aac7 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:45.217797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89d6c480-2b20-4d4f-ba1d-169cb207aac7 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:45.218517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89d6c480-2b20-4d4f-ba1d-169cb207aac7 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:45.223791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89d6c480-2b20-4d4f-ba1d-169cb207aac7 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:45.224631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89d6c480-2b20-4d4f-ba1d-169cb207aac7 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:45.225341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89d6c480-2b20-4d4f-ba1d-169cb207aac7 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:45.252003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-48db100b-1003-4ef8-83cc-ceaa12eb7a98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:45.297365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-48db100b-1003-4ef8-83cc-ceaa12eb7a98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:45.320401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-48db100b-1003-4ef8-83cc-ceaa12eb7a98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:45.339902 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-48db100b-1003-4ef8-83cc-ceaa12eb7a98 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.392040 Oct 04 21:09:45.349727 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 573/1150] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:44 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:45.469726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-89d6c480-2b20-4d4f-ba1d-169cb207aac7 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:45.481064 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-89d6c480-2b20-4d4f-ba1d-169cb207aac7 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1271 microversion: 2.1 time: 0.278988 Oct 04 21:09:45.499067 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 578/1151] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:45 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1271 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:45.925595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-fdce508a-368a-4b58-9407-7b3d9a07bc4a req-0de39b7c-c496-4ee2-aec8-0be80e2dbdfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "478b7921-99ee-4230-858f-4423735eea84", "tag": "6920b939-b234-490f-b6b7-a2cbf5a54616"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:45.950734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-fdce508a-368a-4b58-9407-7b3d9a07bc4a req-0de39b7c-c496-4ee2-aec8-0be80e2dbdfb service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:45.951846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-fdce508a-368a-4b58-9407-7b3d9a07bc4a req-0de39b7c-c496-4ee2-aec8-0be80e2dbdfb service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:45.952667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-fdce508a-368a-4b58-9407-7b3d9a07bc4a req-0de39b7c-c496-4ee2-aec8-0be80e2dbdfb service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:45.968072 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-fdce508a-368a-4b58-9407-7b3d9a07bc4a req-0de39b7c-c496-4ee2-aec8-0be80e2dbdfb service nova] Creating event network-changed:6920b939-b234-490f-b6b7-a2cbf5a54616 for instance 478b7921-99ee-4230-858f-4423735eea84 on n-h2-860282-1 Oct 04 21:09:45.997202 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-fdce508a-368a-4b58-9407-7b3d9a07bc4a req-0de39b7c-c496-4ee2-aec8-0be80e2dbdfb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080104 Oct 04 21:09:46.002287 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 579/1152] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:46.019500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-74cc7352-c6ca-4109-9a12-ffeccb90658b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:46.020377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-74cc7352-c6ca-4109-9a12-ffeccb90658b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:46.039306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74cc7352-c6ca-4109-9a12-ffeccb90658b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:46.042215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74cc7352-c6ca-4109-9a12-ffeccb90658b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:46.043052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74cc7352-c6ca-4109-9a12-ffeccb90658b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:46.045151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74cc7352-c6ca-4109-9a12-ffeccb90658b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:46.046314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74cc7352-c6ca-4109-9a12-ffeccb90658b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:46.047413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74cc7352-c6ca-4109-9a12-ffeccb90658b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:46.221167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-63c690da-9347-425d-b98b-247509eb2cb9 tempest-FlavorsV2NegativeTest-316185863 tempest-FlavorsV2NegativeTest-316185863-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:46.269409 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-63c690da-9347-425d-b98b-247509eb2cb9 tempest-FlavorsV2NegativeTest-316185863 tempest-FlavorsV2NegativeTest-316185863-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.399924 Oct 04 21:09:46.272150 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 574/1153] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:09:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:46.288959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c20db662-895f-423f-b998-0412650f0c29 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:46.289813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c20db662-895f-423f-b998-0412650f0c29 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:46.318658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c20db662-895f-423f-b998-0412650f0c29 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:46.321101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c20db662-895f-423f-b998-0412650f0c29 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:46.321705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c20db662-895f-423f-b998-0412650f0c29 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:46.327762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c20db662-895f-423f-b998-0412650f0c29 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:46.328380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c20db662-895f-423f-b998-0412650f0c29 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:46.328933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c20db662-895f-423f-b998-0412650f0c29 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:46.775195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c20db662-895f-423f-b998-0412650f0c29 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:46.797358 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c20db662-895f-423f-b998-0412650f0c29 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 200 len: 1316 microversion: 2.1 time: 0.523844 Oct 04 21:09:46.812363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-74cc7352-c6ca-4109-9a12-ffeccb90658b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:46.825643 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 575/1154] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:46 2022] GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 1316 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:46.830993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-63160af9-30bb-4803-a43a-ba0cdc960551 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:46.834295 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-74cc7352-c6ca-4109-9a12-ffeccb90658b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.828453 Oct 04 21:09:46.858272 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 580/1155] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:46 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:46.864236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-78b73d28-7492-4563-8a91-40ddb5b65b6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:46.865239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-78b73d28-7492-4563-8a91-40ddb5b65b6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:46.866286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-63160af9-30bb-4803-a43a-ba0cdc960551 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:46.900982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63160af9-30bb-4803-a43a-ba0cdc960551 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:46.906236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63160af9-30bb-4803-a43a-ba0cdc960551 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:46.906793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63160af9-30bb-4803-a43a-ba0cdc960551 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:46.907675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63160af9-30bb-4803-a43a-ba0cdc960551 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:46.912176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63160af9-30bb-4803-a43a-ba0cdc960551 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:46.916724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63160af9-30bb-4803-a43a-ba0cdc960551 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:46.921657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78b73d28-7492-4563-8a91-40ddb5b65b6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:46.927070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78b73d28-7492-4563-8a91-40ddb5b65b6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:46.930654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78b73d28-7492-4563-8a91-40ddb5b65b6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:46.931610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78b73d28-7492-4563-8a91-40ddb5b65b6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:46.932344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78b73d28-7492-4563-8a91-40ddb5b65b6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:46.937258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78b73d28-7492-4563-8a91-40ddb5b65b6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:47.016644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:47.102564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-63160af9-30bb-4803-a43a-ba0cdc960551 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:47.120693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-63160af9-30bb-4803-a43a-ba0cdc960551 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:47.124990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-63160af9-30bb-4803-a43a-ba0cdc960551 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:47.137204 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-63160af9-30bb-4803-a43a-ba0cdc960551 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.310192 Oct 04 21:09:47.138173 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 576/1156] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:46 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:47.463591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-78b73d28-7492-4563-8a91-40ddb5b65b6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:47.483703 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-78b73d28-7492-4563-8a91-40ddb5b65b6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1313 microversion: 2.1 time: 0.623883 Oct 04 21:09:47.484496 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 581/1157] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:46 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1313 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:47.814925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-73a56894-f7fa-4ee2-ad80-63776af3ef1d tempest-FlavorsV2NegativeTest-316185863 tempest-FlavorsV2NegativeTest-316185863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-900138168", "imageRef": "d49cb663-f85e-42fe-a8ab-265e6b17a361", "flavorRef": "452"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:47.830892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=10 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:47.846381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:47.848915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8d94c535-bd93-41fd-848d-f304f373ee07 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:47.850231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8d94c535-bd93-41fd-848d-f304f373ee07 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:47.861477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d94c535-bd93-41fd-848d-f304f373ee07 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:47.865572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d94c535-bd93-41fd-848d-f304f373ee07 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:47.865572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d94c535-bd93-41fd-848d-f304f373ee07 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:47.865572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d94c535-bd93-41fd-848d-f304f373ee07 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:47.866533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d94c535-bd93-41fd-848d-f304f373ee07 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:47.867067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d94c535-bd93-41fd-848d-f304f373ee07 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:47.954417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-73a56894-f7fa-4ee2-ad80-63776af3ef1d tempest-FlavorsV2NegativeTest-316185863 tempest-FlavorsV2NegativeTest-316185863-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:09:48.250712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8d94c535-bd93-41fd-848d-f304f373ee07 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:48.268636 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8d94c535-bd93-41fd-848d-f304f373ee07 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 200 len: 1316 microversion: 2.1 time: 0.423618 Oct 04 21:09:48.274448 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 582/1158] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:47 2022] GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 1316 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:48.296007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3b068b83-40e1-4ca9-b1fa-901f0bd0cde2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:48.299683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3b068b83-40e1-4ca9-b1fa-901f0bd0cde2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:48.336745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b068b83-40e1-4ca9-b1fa-901f0bd0cde2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:48.337575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b068b83-40e1-4ca9-b1fa-901f0bd0cde2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:48.338321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b068b83-40e1-4ca9-b1fa-901f0bd0cde2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:48.339121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b068b83-40e1-4ca9-b1fa-901f0bd0cde2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:48.339748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b068b83-40e1-4ca9-b1fa-901f0bd0cde2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:48.340528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b068b83-40e1-4ca9-b1fa-901f0bd0cde2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:48.576955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=10 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:48.703364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3b068b83-40e1-4ca9-b1fa-901f0bd0cde2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:48.722853 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3b068b83-40e1-4ca9-b1fa-901f0bd0cde2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.446811 Oct 04 21:09:48.727307 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 583/1159] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:48 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:48.747658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-22358b78-893a-4d77-bbba-4673d8e54302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:48.748680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-22358b78-893a-4d77-bbba-4673d8e54302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:48.756145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22358b78-893a-4d77-bbba-4673d8e54302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:48.756930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22358b78-893a-4d77-bbba-4673d8e54302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:48.757811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22358b78-893a-4d77-bbba-4673d8e54302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:48.758792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22358b78-893a-4d77-bbba-4673d8e54302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:48.759486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22358b78-893a-4d77-bbba-4673d8e54302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:48.760271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22358b78-893a-4d77-bbba-4673d8e54302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:48.783227 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-73a56894-f7fa-4ee2-ad80-63776af3ef1d tempest-FlavorsV2NegativeTest-316185863 tempest-FlavorsV2NegativeTest-316185863-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-73a56894-f7fa-4ee2-ad80-63776af3ef1d tempest-FlavorsV2NegativeTest-316185863 tempest-FlavorsV2NegativeTest-316185863-project] Request method failure captured: Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 142 Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKEZPRfkPjOgFtBQUmQdNvNiISq_iZWDueiE4i8nR1M2jK9kJ3UWQfwV2QSwOw1wpHIP-j2akMiO6pd7R82pl-u2f3jdKG_guQjpKG-uBGZS8uPSDEM2fpBfOmBn2dzwvBZSW2JqsQmism_J-QBecaeMj4vOLHFoBC8NJWLCMFn_pxY Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7264781263504915b6f96e48e214a293 Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-FlavorsV2NegativeTest-316185863 Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7264781263504915b6f96e48e214a293"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7264781263504915b6f96e48e214a293"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7264781263504915b6f96e48e214a293"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7264781263504915b6f96e48e214a293"}]}] Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-FlavorsV2NegativeTest-316185863 Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7264781263504915b6f96e48e214a293 Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-316185863 Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-FlavorsV2NegativeTest-316185863-project Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 9dab2c8b377946d5ad5e543ebac3319d Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-FlavorsV2NegativeTest-316185863-project Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-900138168", "imageRef": "d49cb663-f85e-42fe-a8ab-265e6b17a361", "flavorRef": "452"}} Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: exception: Flavor's memory is too small for requested image. Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-900138168', 'imageRef': 'd49cb663-f85e-42fe-a8ab-265e6b17a361', 'flavorRef': '452'}}} Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:09:48.785810 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:09:48.793411 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:09:48.793411 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:09:48.793411 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:09:48.793411 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 04 21:09:48.793411 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 21:09:48.793411 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 04 21:09:48.793411 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:09:48.793411 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:48.793411 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:09:48.793411 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:48.793411 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:48.793411 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:48.793411 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:09:48.793411 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:09:48.793411 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 04 21:09:48.793411 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:09:48.799791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-73a56894-f7fa-4ee2-ad80-63776af3ef1d tempest-FlavorsV2NegativeTest-316185863 tempest-FlavorsV2NegativeTest-316185863-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:09:48.801646 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-73a56894-f7fa-4ee2-ad80-63776af3ef1d tempest-FlavorsV2NegativeTest-316185863 tempest-FlavorsV2NegativeTest-316185863-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.004389 Oct 04 21:09:48.805996 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 577/1160] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:09:47 2022] POST /compute/v2.1/servers => generated 93 bytes in 1010 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:09:48.819623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c78afcd2-2ed3-48b9-93d7-344acfcd330d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:48.823488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c78afcd2-2ed3-48b9-93d7-344acfcd330d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:48.841962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c78afcd2-2ed3-48b9-93d7-344acfcd330d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:48.843750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c78afcd2-2ed3-48b9-93d7-344acfcd330d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:48.846641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c78afcd2-2ed3-48b9-93d7-344acfcd330d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:48.847855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c78afcd2-2ed3-48b9-93d7-344acfcd330d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:48.848780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c78afcd2-2ed3-48b9-93d7-344acfcd330d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:48.850618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c78afcd2-2ed3-48b9-93d7-344acfcd330d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:48.979571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-22358b78-893a-4d77-bbba-4673d8e54302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:48.998304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-22358b78-893a-4d77-bbba-4673d8e54302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:49.001815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-22358b78-893a-4d77-bbba-4673d8e54302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:49.029614 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-22358b78-893a-4d77-bbba-4673d8e54302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.286510 Oct 04 21:09:49.033757 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 584/1161] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:48 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:49.226518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c78afcd2-2ed3-48b9-93d7-344acfcd330d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:49.237448 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c78afcd2-2ed3-48b9-93d7-344acfcd330d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1313 microversion: 2.1 time: 0.429820 Oct 04 21:09:49.255525 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 578/1162] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:48 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1313 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:49.297607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ec92c5f9-2207-4d1e-92de-a0e16b7679ff tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:49.298238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ec92c5f9-2207-4d1e-92de-a0e16b7679ff tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:49.307359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec92c5f9-2207-4d1e-92de-a0e16b7679ff tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:49.308020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec92c5f9-2207-4d1e-92de-a0e16b7679ff tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:49.308653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec92c5f9-2207-4d1e-92de-a0e16b7679ff tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:49.313531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec92c5f9-2207-4d1e-92de-a0e16b7679ff tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:49.313531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec92c5f9-2207-4d1e-92de-a0e16b7679ff tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:49.313531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec92c5f9-2207-4d1e-92de-a0e16b7679ff tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:49.313531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:49.328036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-061c2683-44f7-46c0-b820-8ea3b0b3eee7 req-d2b51762-0908-4287-916e-320d487dc4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a255f2-7c48-4148-bdc8-6603ac47d2a3", "tag": "9d8db50d-d745-4054-ac10-dc90ebaf61be"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:49.339483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-061c2683-44f7-46c0-b820-8ea3b0b3eee7 req-d2b51762-0908-4287-916e-320d487dc4b3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:49.339483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-061c2683-44f7-46c0-b820-8ea3b0b3eee7 req-d2b51762-0908-4287-916e-320d487dc4b3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:49.347661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-061c2683-44f7-46c0-b820-8ea3b0b3eee7 req-d2b51762-0908-4287-916e-320d487dc4b3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:49.375472 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-061c2683-44f7-46c0-b820-8ea3b0b3eee7 req-d2b51762-0908-4287-916e-320d487dc4b3 service nova] Creating event network-changed:9d8db50d-d745-4054-ac10-dc90ebaf61be for instance a8a255f2-7c48-4148-bdc8-6603ac47d2a3 on n-h1-860282-1 Oct 04 21:09:49.387163 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-061c2683-44f7-46c0-b820-8ea3b0b3eee7 req-d2b51762-0908-4287-916e-320d487dc4b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063278 Oct 04 21:09:49.388106 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 579/1163] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:09:49.533073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ec92c5f9-2207-4d1e-92de-a0e16b7679ff tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:49.562189 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ec92c5f9-2207-4d1e-92de-a0e16b7679ff tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 200 len: 1316 microversion: 2.1 time: 0.267355 Oct 04 21:09:49.563524 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 585/1164] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:49 2022] GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:49.755322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9c16973e-c149-4296-96ef-eb37c3925155 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:49.756020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9c16973e-c149-4296-96ef-eb37c3925155 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:49.763740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c16973e-c149-4296-96ef-eb37c3925155 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:49.764480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c16973e-c149-4296-96ef-eb37c3925155 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:49.765073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c16973e-c149-4296-96ef-eb37c3925155 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:49.765982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c16973e-c149-4296-96ef-eb37c3925155 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:49.766617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c16973e-c149-4296-96ef-eb37c3925155 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:49.770149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c16973e-c149-4296-96ef-eb37c3925155 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:49.950630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5738962a-d19e-4155-adc6-8329600cf3cb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:49.950957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9c16973e-c149-4296-96ef-eb37c3925155 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:49.952258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5738962a-d19e-4155-adc6-8329600cf3cb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:49.962095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5738962a-d19e-4155-adc6-8329600cf3cb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:49.962605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5738962a-d19e-4155-adc6-8329600cf3cb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:49.963049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5738962a-d19e-4155-adc6-8329600cf3cb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:49.964169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5738962a-d19e-4155-adc6-8329600cf3cb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:49.964902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5738962a-d19e-4155-adc6-8329600cf3cb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:49.965341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5738962a-d19e-4155-adc6-8329600cf3cb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:49.969480 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9c16973e-c149-4296-96ef-eb37c3925155 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.218445 Oct 04 21:09:49.973055 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 580/1165] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:49 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:50.075741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-670990ef-2c5a-47a3-8cb0-665ad1a298cc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:50.076594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-670990ef-2c5a-47a3-8cb0-665ad1a298cc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:50.095102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-670990ef-2c5a-47a3-8cb0-665ad1a298cc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:50.095102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-670990ef-2c5a-47a3-8cb0-665ad1a298cc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:50.097614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-670990ef-2c5a-47a3-8cb0-665ad1a298cc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:50.099327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-670990ef-2c5a-47a3-8cb0-665ad1a298cc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:50.102750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-670990ef-2c5a-47a3-8cb0-665ad1a298cc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:50.103504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-670990ef-2c5a-47a3-8cb0-665ad1a298cc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:50.127875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-5738962a-d19e-4155-adc6-8329600cf3cb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lazy-loading 'services' on Instance uuid 191d63c3-2de0-4d3a-85f1-c4be3d2f5432 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:09:50.148533 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5738962a-d19e-4155-adc6-8329600cf3cb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 2346 microversion: 2.25 time: 0.203588 Oct 04 21:09:50.149225 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 586/1166] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:49 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 2346 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:09:50.174879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d1a2938e-1bb3-4345-a1e5-222569ad0079 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:50.178861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1a2938e-1bb3-4345-a1e5-222569ad0079 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:50.179905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1a2938e-1bb3-4345-a1e5-222569ad0079 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:50.180344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1a2938e-1bb3-4345-a1e5-222569ad0079 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:50.181276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1a2938e-1bb3-4345-a1e5-222569ad0079 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:50.181759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1a2938e-1bb3-4345-a1e5-222569ad0079 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:50.182179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1a2938e-1bb3-4345-a1e5-222569ad0079 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:50.211325 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d1a2938e-1bb3-4345-a1e5-222569ad0079 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.040143 Oct 04 21:09:50.212771 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 587/1167] 10.222.0.30 () {60 vars in 1217 bytes} [Tue Oct 4 21:09:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:09:50.214874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-670990ef-2c5a-47a3-8cb0-665ad1a298cc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:50.227769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-670990ef-2c5a-47a3-8cb0-665ad1a298cc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:50.239530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-670990ef-2c5a-47a3-8cb0-665ad1a298cc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:50.266050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1411f1d7-6a4a-45b9-a8b7-c108e9c33c65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:50.266954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1411f1d7-6a4a-45b9-a8b7-c108e9c33c65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:50.273572 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-670990ef-2c5a-47a3-8cb0-665ad1a298cc tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.189648 Oct 04 21:09:50.284285 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 581/1168] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:50 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:50.284708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1411f1d7-6a4a-45b9-a8b7-c108e9c33c65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:50.284708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1411f1d7-6a4a-45b9-a8b7-c108e9c33c65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:50.284708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1411f1d7-6a4a-45b9-a8b7-c108e9c33c65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:50.284708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1411f1d7-6a4a-45b9-a8b7-c108e9c33c65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:50.284708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1411f1d7-6a4a-45b9-a8b7-c108e9c33c65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:50.284708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1411f1d7-6a4a-45b9-a8b7-c108e9c33c65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:50.548950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1411f1d7-6a4a-45b9-a8b7-c108e9c33c65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:50.559163 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1411f1d7-6a4a-45b9-a8b7-c108e9c33c65 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1313 microversion: 2.1 time: 0.297821 Oct 04 21:09:50.561059 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 588/1169] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:50 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:50.587545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cb039be7-05f2-49e1-b556-54b6e20ce79a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:50.588385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cb039be7-05f2-49e1-b556-54b6e20ce79a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:50.599223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb039be7-05f2-49e1-b556-54b6e20ce79a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:50.599815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb039be7-05f2-49e1-b556-54b6e20ce79a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:50.600328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb039be7-05f2-49e1-b556-54b6e20ce79a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:50.601533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb039be7-05f2-49e1-b556-54b6e20ce79a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:50.604017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb039be7-05f2-49e1-b556-54b6e20ce79a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:50.604529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb039be7-05f2-49e1-b556-54b6e20ce79a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:50.869085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cb039be7-05f2-49e1-b556-54b6e20ce79a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:50.898311 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cb039be7-05f2-49e1-b556-54b6e20ce79a tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 200 len: 1316 microversion: 2.1 time: 0.314887 Oct 04 21:09:50.900059 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 582/1170] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:50 2022] GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:50.996113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eec82c53-c7c2-490a-beab-562d4f984497 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:50.996800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eec82c53-c7c2-490a-beab-562d4f984497 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:51.014302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eec82c53-c7c2-490a-beab-562d4f984497 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:51.014806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eec82c53-c7c2-490a-beab-562d4f984497 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:51.015262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eec82c53-c7c2-490a-beab-562d4f984497 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:51.015975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eec82c53-c7c2-490a-beab-562d4f984497 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:51.016489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eec82c53-c7c2-490a-beab-562d4f984497 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:51.016969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eec82c53-c7c2-490a-beab-562d4f984497 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:51.311777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8b4fb0bd-56c3-4988-b7e6-45aa0ca84594 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:51.320485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8b4fb0bd-56c3-4988-b7e6-45aa0ca84594 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:51.321636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eec82c53-c7c2-490a-beab-562d4f984497 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:51.330443 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eec82c53-c7c2-490a-beab-562d4f984497 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.338268 Oct 04 21:09:51.331626 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 589/1171] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:50 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:51.354251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b4fb0bd-56c3-4988-b7e6-45aa0ca84594 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:51.354756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b4fb0bd-56c3-4988-b7e6-45aa0ca84594 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:51.365698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b4fb0bd-56c3-4988-b7e6-45aa0ca84594 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:51.366583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b4fb0bd-56c3-4988-b7e6-45aa0ca84594 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:51.370418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b4fb0bd-56c3-4988-b7e6-45aa0ca84594 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:51.374249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b4fb0bd-56c3-4988-b7e6-45aa0ca84594 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:51.536209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8b4fb0bd-56c3-4988-b7e6-45aa0ca84594 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:51.548072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8b4fb0bd-56c3-4988-b7e6-45aa0ca84594 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:51.550780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8b4fb0bd-56c3-4988-b7e6-45aa0ca84594 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:51.558013 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8b4fb0bd-56c3-4988-b7e6-45aa0ca84594 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.252259 Oct 04 21:09:51.558683 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 583/1172] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:51 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:51.589627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8ea3f05d-685c-4bfb-b76d-0a42544e5604 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:51.590460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8ea3f05d-685c-4bfb-b76d-0a42544e5604 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:51.600012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ea3f05d-685c-4bfb-b76d-0a42544e5604 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:51.600720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ea3f05d-685c-4bfb-b76d-0a42544e5604 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:51.601270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ea3f05d-685c-4bfb-b76d-0a42544e5604 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:51.602260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ea3f05d-685c-4bfb-b76d-0a42544e5604 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:51.602965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ea3f05d-685c-4bfb-b76d-0a42544e5604 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:51.603611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ea3f05d-685c-4bfb-b76d-0a42544e5604 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:51.823953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8ea3f05d-685c-4bfb-b76d-0a42544e5604 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:51.832342 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8ea3f05d-685c-4bfb-b76d-0a42544e5604 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1313 microversion: 2.1 time: 0.249148 Oct 04 21:09:51.832919 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 590/1173] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:51 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:51.926371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d68ff00d-5715-4d1f-a2bb-2bf7f4099c91 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:51.927103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d68ff00d-5715-4d1f-a2bb-2bf7f4099c91 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:51.935442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d68ff00d-5715-4d1f-a2bb-2bf7f4099c91 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:51.944033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d68ff00d-5715-4d1f-a2bb-2bf7f4099c91 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:51.944033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d68ff00d-5715-4d1f-a2bb-2bf7f4099c91 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:51.944033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d68ff00d-5715-4d1f-a2bb-2bf7f4099c91 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:51.944033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d68ff00d-5715-4d1f-a2bb-2bf7f4099c91 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:51.944033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d68ff00d-5715-4d1f-a2bb-2bf7f4099c91 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:52.108197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d68ff00d-5715-4d1f-a2bb-2bf7f4099c91 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:52.118757 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d68ff00d-5715-4d1f-a2bb-2bf7f4099c91 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 200 len: 1316 microversion: 2.1 time: 0.196383 Oct 04 21:09:52.119680 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 584/1174] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:51 2022] GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 1316 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:52.355215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1942a18d-fb2e-4bec-9c15-3d688c526184 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:52.355791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1942a18d-fb2e-4bec-9c15-3d688c526184 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:52.365791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1942a18d-fb2e-4bec-9c15-3d688c526184 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:52.366680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1942a18d-fb2e-4bec-9c15-3d688c526184 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:52.368139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1942a18d-fb2e-4bec-9c15-3d688c526184 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:52.371854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1942a18d-fb2e-4bec-9c15-3d688c526184 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:52.373561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1942a18d-fb2e-4bec-9c15-3d688c526184 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:52.376641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1942a18d-fb2e-4bec-9c15-3d688c526184 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:52.559520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1942a18d-fb2e-4bec-9c15-3d688c526184 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:52.568588 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1942a18d-fb2e-4bec-9c15-3d688c526184 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.218824 Oct 04 21:09:52.569259 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 591/1175] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:52 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:52.596284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-30bb96c3-941e-4b11-86e7-75faabe8b12c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:52.596929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-30bb96c3-941e-4b11-86e7-75faabe8b12c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:52.602908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30bb96c3-941e-4b11-86e7-75faabe8b12c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:52.603426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30bb96c3-941e-4b11-86e7-75faabe8b12c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:52.603912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30bb96c3-941e-4b11-86e7-75faabe8b12c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:52.604605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30bb96c3-941e-4b11-86e7-75faabe8b12c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:52.605064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30bb96c3-941e-4b11-86e7-75faabe8b12c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:52.605515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30bb96c3-941e-4b11-86e7-75faabe8b12c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:52.670370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-30bb96c3-941e-4b11-86e7-75faabe8b12c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:52.678662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-30bb96c3-941e-4b11-86e7-75faabe8b12c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:52.680131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-30bb96c3-941e-4b11-86e7-75faabe8b12c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:52.685368 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-30bb96c3-941e-4b11-86e7-75faabe8b12c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.092795 Oct 04 21:09:52.685972 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 585/1176] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:52 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:09:52.855455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e5607eb1-0740-40fc-8280-8de63a6a3467 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:52.856099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e5607eb1-0740-40fc-8280-8de63a6a3467 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:52.862065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5607eb1-0740-40fc-8280-8de63a6a3467 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:52.862578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5607eb1-0740-40fc-8280-8de63a6a3467 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:52.863022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5607eb1-0740-40fc-8280-8de63a6a3467 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:52.863712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5607eb1-0740-40fc-8280-8de63a6a3467 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:52.864168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5607eb1-0740-40fc-8280-8de63a6a3467 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:52.864593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5607eb1-0740-40fc-8280-8de63a6a3467 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:53.010314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e5607eb1-0740-40fc-8280-8de63a6a3467 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:53.018752 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e5607eb1-0740-40fc-8280-8de63a6a3467 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1313 microversion: 2.1 time: 0.167201 Oct 04 21:09:53.019321 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 592/1177] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:52 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:53.123644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-72243ef5-050d-4e80-ab61-a9721ae95528 req-13c80703-59e9-4181-a9a2-8b95b0f1e740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478b7921-99ee-4230-858f-4423735eea84", "name": "network-vif-plugged", "status": "completed", "tag": "6920b939-b234-490f-b6b7-a2cbf5a54616"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:53.134652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-72243ef5-050d-4e80-ab61-a9721ae95528 req-13c80703-59e9-4181-a9a2-8b95b0f1e740 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:53.135208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-72243ef5-050d-4e80-ab61-a9721ae95528 req-13c80703-59e9-4181-a9a2-8b95b0f1e740 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:53.135641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-72243ef5-050d-4e80-ab61-a9721ae95528 req-13c80703-59e9-4181-a9a2-8b95b0f1e740 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:53.143760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-243fdb74-23b1-4dc0-850e-7b48694b5389 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:53.144473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-243fdb74-23b1-4dc0-850e-7b48694b5389 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:53.147921 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-72243ef5-050d-4e80-ab61-a9721ae95528 req-13c80703-59e9-4181-a9a2-8b95b0f1e740 service nova] Creating event network-vif-plugged:6920b939-b234-490f-b6b7-a2cbf5a54616 for instance 478b7921-99ee-4230-858f-4423735eea84 on n-h2-860282-1 Oct 04 21:09:53.151051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-243fdb74-23b1-4dc0-850e-7b48694b5389 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:53.151743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-243fdb74-23b1-4dc0-850e-7b48694b5389 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:53.152630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-243fdb74-23b1-4dc0-850e-7b48694b5389 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:53.153136 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-72243ef5-050d-4e80-ab61-a9721ae95528 req-13c80703-59e9-4181-a9a2-8b95b0f1e740 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034223 Oct 04 21:09:53.153600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-243fdb74-23b1-4dc0-850e-7b48694b5389 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:53.159459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-243fdb74-23b1-4dc0-850e-7b48694b5389 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:53.160593 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 586/1178] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:53.160698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-243fdb74-23b1-4dc0-850e-7b48694b5389 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:53.311530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-243fdb74-23b1-4dc0-850e-7b48694b5389 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:53.321336 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-243fdb74-23b1-4dc0-850e-7b48694b5389 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 200 len: 1316 microversion: 2.1 time: 0.181900 Oct 04 21:09:53.323001 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 593/1179] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:53 2022] GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:53.486477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-85b2368d-3e24-42f3-aba4-c78ad958af4a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bd72c14-55c5-4213-a451-85dd01487f4b", "device": "/dev/xvdb"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:53.489086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-85b2368d-3e24-42f3-aba4-c78ad958af4a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:53.495188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85b2368d-3e24-42f3-aba4-c78ad958af4a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:53.498987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85b2368d-3e24-42f3-aba4-c78ad958af4a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:53.498987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85b2368d-3e24-42f3-aba4-c78ad958af4a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:53.498987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85b2368d-3e24-42f3-aba4-c78ad958af4a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:53.498987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85b2368d-3e24-42f3-aba4-c78ad958af4a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:53.498987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85b2368d-3e24-42f3-aba4-c78ad958af4a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:53.592213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-22ef8a18-4b1c-42c8-8c03-e0469e4c807e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:53.592833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-22ef8a18-4b1c-42c8-8c03-e0469e4c807e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:53.599514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22ef8a18-4b1c-42c8-8c03-e0469e4c807e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:53.600007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22ef8a18-4b1c-42c8-8c03-e0469e4c807e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:53.600451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22ef8a18-4b1c-42c8-8c03-e0469e4c807e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:53.601210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22ef8a18-4b1c-42c8-8c03-e0469e4c807e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:53.601868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22ef8a18-4b1c-42c8-8c03-e0469e4c807e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:53.602290 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22ef8a18-4b1c-42c8-8c03-e0469e4c807e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:53.744547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-22ef8a18-4b1c-42c8-8c03-e0469e4c807e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:53.753452 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-22ef8a18-4b1c-42c8-8c03-e0469e4c807e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.165209 Oct 04 21:09:53.754048 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 594/1180] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:53 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:53.758708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ea557c95-0770-4510-b3a2-756f4969ea5f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:53.759310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ea557c95-0770-4510-b3a2-756f4969ea5f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:53.765756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea557c95-0770-4510-b3a2-756f4969ea5f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:53.766248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea557c95-0770-4510-b3a2-756f4969ea5f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:53.766688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea557c95-0770-4510-b3a2-756f4969ea5f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:53.767723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea557c95-0770-4510-b3a2-756f4969ea5f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:53.768179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea557c95-0770-4510-b3a2-756f4969ea5f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:53.768609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea557c95-0770-4510-b3a2-756f4969ea5f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:53.845652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ea557c95-0770-4510-b3a2-756f4969ea5f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:53.856100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ea557c95-0770-4510-b3a2-756f4969ea5f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:53.858448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ea557c95-0770-4510-b3a2-756f4969ea5f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:53.867702 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ea557c95-0770-4510-b3a2-756f4969ea5f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.110305 Oct 04 21:09:53.867702 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 595/1181] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:53 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:54.041565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-edfdb87c-7093-432b-9bc3-825a459f8417 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:54.042292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-edfdb87c-7093-432b-9bc3-825a459f8417 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:54.048907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-edfdb87c-7093-432b-9bc3-825a459f8417 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:54.049559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-edfdb87c-7093-432b-9bc3-825a459f8417 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:54.050115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-edfdb87c-7093-432b-9bc3-825a459f8417 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:54.050949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-edfdb87c-7093-432b-9bc3-825a459f8417 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:54.051405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-edfdb87c-7093-432b-9bc3-825a459f8417 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:54.051833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-edfdb87c-7093-432b-9bc3-825a459f8417 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:54.191542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-edfdb87c-7093-432b-9bc3-825a459f8417 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:54.199455 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-edfdb87c-7093-432b-9bc3-825a459f8417 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1313 microversion: 2.1 time: 0.161747 Oct 04 21:09:54.200952 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 596/1182] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:54 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:54.348341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0d8bcd95-c96a-4b66-93dd-76b1995bc366 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:54.348953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0d8bcd95-c96a-4b66-93dd-76b1995bc366 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:54.356574 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-85b2368d-3e24-42f3-aba4-c78ad958af4a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "POST /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.874985 Oct 04 21:09:54.357991 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 587/1183] 10.222.0.30 () {62 vars in 1364 bytes} [Tue Oct 4 21:09:53 2022] POST /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-volume_attachments => generated 194 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:09:54.365118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d8bcd95-c96a-4b66-93dd-76b1995bc366 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:54.365678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d8bcd95-c96a-4b66-93dd-76b1995bc366 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:54.366317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d8bcd95-c96a-4b66-93dd-76b1995bc366 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:54.367207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d8bcd95-c96a-4b66-93dd-76b1995bc366 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:54.367739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d8bcd95-c96a-4b66-93dd-76b1995bc366 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:54.368139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d8bcd95-c96a-4b66-93dd-76b1995bc366 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:54.517890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0d8bcd95-c96a-4b66-93dd-76b1995bc366 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:54.526698 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0d8bcd95-c96a-4b66-93dd-76b1995bc366 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 200 len: 1316 microversion: 2.1 time: 0.182476 Oct 04 21:09:54.537451 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 597/1184] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:54 2022] GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:54.776710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7f41be78-dcdb-4e5e-b2ab-82f9aa28ce6b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:54.777416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7f41be78-dcdb-4e5e-b2ab-82f9aa28ce6b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:54.787929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f41be78-dcdb-4e5e-b2ab-82f9aa28ce6b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:54.788659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f41be78-dcdb-4e5e-b2ab-82f9aa28ce6b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:54.789100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f41be78-dcdb-4e5e-b2ab-82f9aa28ce6b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:54.789992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f41be78-dcdb-4e5e-b2ab-82f9aa28ce6b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:54.790603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f41be78-dcdb-4e5e-b2ab-82f9aa28ce6b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:54.791185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f41be78-dcdb-4e5e-b2ab-82f9aa28ce6b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:54.893527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3d036fe9-c9de-4f4d-8782-d38665fb3662 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:54.894573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3d036fe9-c9de-4f4d-8782-d38665fb3662 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:54.902702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d036fe9-c9de-4f4d-8782-d38665fb3662 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:54.903498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d036fe9-c9de-4f4d-8782-d38665fb3662 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:54.903944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d036fe9-c9de-4f4d-8782-d38665fb3662 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:54.904662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d036fe9-c9de-4f4d-8782-d38665fb3662 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:54.905267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d036fe9-c9de-4f4d-8782-d38665fb3662 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:54.905904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d036fe9-c9de-4f4d-8782-d38665fb3662 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:54.928864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:54.985731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3d036fe9-c9de-4f4d-8782-d38665fb3662 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:55.002461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3d036fe9-c9de-4f4d-8782-d38665fb3662 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:55.002461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3d036fe9-c9de-4f4d-8782-d38665fb3662 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:55.016179 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3d036fe9-c9de-4f4d-8782-d38665fb3662 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.127681 Oct 04 21:09:55.017059 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 598/1185] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:54 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:55.068706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7f41be78-dcdb-4e5e-b2ab-82f9aa28ce6b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:55.081720 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7f41be78-dcdb-4e5e-b2ab-82f9aa28ce6b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1476 microversion: 2.1 time: 0.308999 Oct 04 21:09:55.083742 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 588/1186] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:54 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1476 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:55.226101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e646dcb9-e040-459e-a1ee-2d7f7e3a6f78 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:55.228512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e646dcb9-e040-459e-a1ee-2d7f7e3a6f78 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:55.238159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e646dcb9-e040-459e-a1ee-2d7f7e3a6f78 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:55.239665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e646dcb9-e040-459e-a1ee-2d7f7e3a6f78 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:55.240459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e646dcb9-e040-459e-a1ee-2d7f7e3a6f78 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:55.241637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e646dcb9-e040-459e-a1ee-2d7f7e3a6f78 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:55.242285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e646dcb9-e040-459e-a1ee-2d7f7e3a6f78 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:55.244020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e646dcb9-e040-459e-a1ee-2d7f7e3a6f78 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:55.507993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e646dcb9-e040-459e-a1ee-2d7f7e3a6f78 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:55.517292 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e646dcb9-e040-459e-a1ee-2d7f7e3a6f78 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1313 microversion: 2.1 time: 0.296810 Oct 04 21:09:55.530133 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 599/1187] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:55 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:55.552119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-81404e1f-ea20-4cab-8c52-4332421becac tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:55.552753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-81404e1f-ea20-4cab-8c52-4332421becac tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:55.567180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81404e1f-ea20-4cab-8c52-4332421becac tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:55.567696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81404e1f-ea20-4cab-8c52-4332421becac tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:55.568153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81404e1f-ea20-4cab-8c52-4332421becac tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:55.568881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81404e1f-ea20-4cab-8c52-4332421becac tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:55.569350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81404e1f-ea20-4cab-8c52-4332421becac tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:55.569826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81404e1f-ea20-4cab-8c52-4332421becac tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:55.866946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-81404e1f-ea20-4cab-8c52-4332421becac tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:55.879897 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-81404e1f-ea20-4cab-8c52-4332421becac tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 200 len: 1466 microversion: 2.1 time: 0.331592 Oct 04 21:09:55.881639 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 589/1188] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:55 2022] GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 1466 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:55.913483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3c35d526-023f-4940-950c-050eb579cbe1 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:55.914769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3c35d526-023f-4940-950c-050eb579cbe1 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:55.926139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c35d526-023f-4940-950c-050eb579cbe1 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:55.927319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c35d526-023f-4940-950c-050eb579cbe1 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:55.928159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c35d526-023f-4940-950c-050eb579cbe1 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:55.929800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c35d526-023f-4940-950c-050eb579cbe1 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:55.930466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c35d526-023f-4940-950c-050eb579cbe1 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:55.931051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c35d526-023f-4940-950c-050eb579cbe1 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:56.046801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f269c656-91e7-45e7-8673-0bd26efd6534 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:56.057315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f269c656-91e7-45e7-8673-0bd26efd6534 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:56.097952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f269c656-91e7-45e7-8673-0bd26efd6534 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:56.099070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f269c656-91e7-45e7-8673-0bd26efd6534 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:56.100016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f269c656-91e7-45e7-8673-0bd26efd6534 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:56.100854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f269c656-91e7-45e7-8673-0bd26efd6534 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:56.101325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f269c656-91e7-45e7-8673-0bd26efd6534 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:56.103072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f269c656-91e7-45e7-8673-0bd26efd6534 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:56.259955 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3c35d526-023f-4940-950c-050eb579cbe1 tempest-ServersOnMultiNodesTest-1566059297 tempest-ServersOnMultiNodesTest-1566059297-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 200 len: 1617 microversion: 2.1 time: 0.353642 Oct 04 21:09:56.265588 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 600/1189] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:55 2022] GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 1617 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:56.271141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f269c656-91e7-45e7-8673-0bd26efd6534 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:56.289207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f269c656-91e7-45e7-8673-0bd26efd6534 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:56.293363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-abc7e62d-ee6c-4a3d-8b15-129df0e15227 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:56.313009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f269c656-91e7-45e7-8673-0bd26efd6534 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:56.318110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-abc7e62d-ee6c-4a3d-8b15-129df0e15227 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:56.324410 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f269c656-91e7-45e7-8673-0bd26efd6534 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.283525 Oct 04 21:09:56.326042 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 590/1190] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:56 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:56.331383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-99bdce06-2ca0-47e8-8cce-63ac9d7b0a49 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:56.332139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-99bdce06-2ca0-47e8-8cce-63ac9d7b0a49 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:56.333469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abc7e62d-ee6c-4a3d-8b15-129df0e15227 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:56.335090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abc7e62d-ee6c-4a3d-8b15-129df0e15227 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:56.336678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abc7e62d-ee6c-4a3d-8b15-129df0e15227 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:56.338918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abc7e62d-ee6c-4a3d-8b15-129df0e15227 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:56.340882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abc7e62d-ee6c-4a3d-8b15-129df0e15227 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:56.341502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abc7e62d-ee6c-4a3d-8b15-129df0e15227 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:56.341754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99bdce06-2ca0-47e8-8cce-63ac9d7b0a49 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:56.342502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99bdce06-2ca0-47e8-8cce-63ac9d7b0a49 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:56.343148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99bdce06-2ca0-47e8-8cce-63ac9d7b0a49 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:56.344178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99bdce06-2ca0-47e8-8cce-63ac9d7b0a49 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:56.344900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99bdce06-2ca0-47e8-8cce-63ac9d7b0a49 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:56.345740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99bdce06-2ca0-47e8-8cce-63ac9d7b0a49 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:56.349774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:56.403686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-99bdce06-2ca0-47e8-8cce-63ac9d7b0a49 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:09:56.820580 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-99bdce06-2ca0-47e8-8cce-63ac9d7b0a49 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "DELETE /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 204 len: 0 microversion: 2.1 time: 0.492862 Oct 04 21:09:56.823191 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 591/1191] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:09:56 2022] DELETE /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:09:56.836324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-db597956-6ae0-4493-aed9-d65d8d257e38 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:56.837400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-db597956-6ae0-4493-aed9-d65d8d257e38 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:56.844221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db597956-6ae0-4493-aed9-d65d8d257e38 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:56.845106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db597956-6ae0-4493-aed9-d65d8d257e38 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:56.849939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db597956-6ae0-4493-aed9-d65d8d257e38 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:56.849939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db597956-6ae0-4493-aed9-d65d8d257e38 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:56.849939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db597956-6ae0-4493-aed9-d65d8d257e38 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:56.849939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db597956-6ae0-4493-aed9-d65d8d257e38 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:57.228013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-db597956-6ae0-4493-aed9-d65d8d257e38 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:57.245457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-abc7e62d-ee6c-4a3d-8b15-129df0e15227 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:57.255452 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-abc7e62d-ee6c-4a3d-8b15-129df0e15227 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1475 microversion: 2.1 time: 0.968938 Oct 04 21:09:57.258189 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-db597956-6ae0-4493-aed9-d65d8d257e38 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1313 microversion: 2.1 time: 0.428801 Oct 04 21:09:57.258966 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 592/1192] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:56 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1313 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:57.260635 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 601/1193] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:56 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1475 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:57.265237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1d204b83-2eb1-40f8-b45d-27b1de0b3c85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:57.270199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1d204b83-2eb1-40f8-b45d-27b1de0b3c85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:57.283187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d204b83-2eb1-40f8-b45d-27b1de0b3c85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:57.283187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d204b83-2eb1-40f8-b45d-27b1de0b3c85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:57.283187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d204b83-2eb1-40f8-b45d-27b1de0b3c85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:57.286801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d204b83-2eb1-40f8-b45d-27b1de0b3c85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:57.287235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d204b83-2eb1-40f8-b45d-27b1de0b3c85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:57.287844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d204b83-2eb1-40f8-b45d-27b1de0b3c85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:57.367218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-06ffe174-9848-4a16-8c0b-9b4ce1c2c906 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:57.367872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-06ffe174-9848-4a16-8c0b-9b4ce1c2c906 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:57.377880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06ffe174-9848-4a16-8c0b-9b4ce1c2c906 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:57.378936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06ffe174-9848-4a16-8c0b-9b4ce1c2c906 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:57.379379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06ffe174-9848-4a16-8c0b-9b4ce1c2c906 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:57.380094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06ffe174-9848-4a16-8c0b-9b4ce1c2c906 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:57.381615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06ffe174-9848-4a16-8c0b-9b4ce1c2c906 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:57.382360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06ffe174-9848-4a16-8c0b-9b4ce1c2c906 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:57.536710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1d204b83-2eb1-40f8-b45d-27b1de0b3c85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:57.538832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-06ffe174-9848-4a16-8c0b-9b4ce1c2c906 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:57.551137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-06ffe174-9848-4a16-8c0b-9b4ce1c2c906 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:57.553035 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1d204b83-2eb1-40f8-b45d-27b1de0b3c85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 200 len: 1472 microversion: 2.1 time: 0.292716 Oct 04 21:09:57.553608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-06ffe174-9848-4a16-8c0b-9b4ce1c2c906 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:57.566840 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-06ffe174-9848-4a16-8c0b-9b4ce1c2c906 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.204377 Oct 04 21:09:57.568182 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 602/1194] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:57 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:57.570640 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 593/1195] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:57 2022] GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 1472 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:58.291750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dfc641df-7354-469b-80fa-b52bd9dc5953 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:58.292953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dfc641df-7354-469b-80fa-b52bd9dc5953 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:58.303948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dfc641df-7354-469b-80fa-b52bd9dc5953 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:58.304679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dfc641df-7354-469b-80fa-b52bd9dc5953 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:58.305590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dfc641df-7354-469b-80fa-b52bd9dc5953 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:58.307277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dfc641df-7354-469b-80fa-b52bd9dc5953 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:58.308279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dfc641df-7354-469b-80fa-b52bd9dc5953 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:58.308882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dfc641df-7354-469b-80fa-b52bd9dc5953 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:58.315159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b395fc69-97d8-40a7-93b6-f29cdf6293a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:58.316422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b395fc69-97d8-40a7-93b6-f29cdf6293a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:58.329712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b395fc69-97d8-40a7-93b6-f29cdf6293a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:58.330241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b395fc69-97d8-40a7-93b6-f29cdf6293a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:58.330789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b395fc69-97d8-40a7-93b6-f29cdf6293a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:58.332622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b395fc69-97d8-40a7-93b6-f29cdf6293a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:58.333800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b395fc69-97d8-40a7-93b6-f29cdf6293a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:58.334650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b395fc69-97d8-40a7-93b6-f29cdf6293a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:58.807393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b395fc69-97d8-40a7-93b6-f29cdf6293a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:58.816238 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b395fc69-97d8-40a7-93b6-f29cdf6293a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1313 microversion: 2.1 time: 0.511127 Oct 04 21:09:58.822671 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 594/1196] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:58 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1313 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:58.828053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-3d36f103-81ef-4832-9fd7-74f2ed8fc147 req-9dbb5876-70cb-47ec-88c1-206b076e96c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d10b511-a8bd-46cc-bf96-0879899ac60b", "name": "network-vif-unplugged", "status": "completed", "tag": "cc7eeb3c-7c42-43b5-b169-cbc14e6a3436"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:58.861978 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3d36f103-81ef-4832-9fd7-74f2ed8fc147 req-9dbb5876-70cb-47ec-88c1-206b076e96c0 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:58.862652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3d36f103-81ef-4832-9fd7-74f2ed8fc147 req-9dbb5876-70cb-47ec-88c1-206b076e96c0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:58.864277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3d36f103-81ef-4832-9fd7-74f2ed8fc147 req-9dbb5876-70cb-47ec-88c1-206b076e96c0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:58.872440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dfc641df-7354-469b-80fa-b52bd9dc5953 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:58.881135 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dfc641df-7354-469b-80fa-b52bd9dc5953 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1475 microversion: 2.1 time: 0.593636 Oct 04 21:09:58.883381 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-3d36f103-81ef-4832-9fd7-74f2ed8fc147 req-9dbb5876-70cb-47ec-88c1-206b076e96c0 service nova] Creating event network-vif-unplugged:cc7eeb3c-7c42-43b5-b169-cbc14e6a3436 for instance 4d10b511-a8bd-46cc-bf96-0879899ac60b on n-h1-860282-1 Oct 04 21:09:58.884470 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 603/1197] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:58 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1475 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:58.892786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-20ba5b55-17d3-48f8-93c3-dcd10c7caa85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:58.896471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-20ba5b55-17d3-48f8-93c3-dcd10c7caa85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:58.910673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20ba5b55-17d3-48f8-93c3-dcd10c7caa85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:58.912251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20ba5b55-17d3-48f8-93c3-dcd10c7caa85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:58.912928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20ba5b55-17d3-48f8-93c3-dcd10c7caa85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:58.917096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20ba5b55-17d3-48f8-93c3-dcd10c7caa85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:58.921793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20ba5b55-17d3-48f8-93c3-dcd10c7caa85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:58.921976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-3d36f103-81ef-4832-9fd7-74f2ed8fc147 req-9dbb5876-70cb-47ec-88c1-206b076e96c0 service nova] Instance 4d10b511-a8bd-46cc-bf96-0879899ac60b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:09:58.922665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20ba5b55-17d3-48f8-93c3-dcd10c7caa85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:58.953717 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-3d36f103-81ef-4832-9fd7-74f2ed8fc147 req-9dbb5876-70cb-47ec-88c1-206b076e96c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129598 Oct 04 21:09:58.958253 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 595/1198] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:58.974435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-21167b69-f944-4d4d-860f-329a26cb5ce3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:58.974435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-21167b69-f944-4d4d-860f-329a26cb5ce3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:58.991166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21167b69-f944-4d4d-860f-329a26cb5ce3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:59.000110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21167b69-f944-4d4d-860f-329a26cb5ce3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:59.002458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21167b69-f944-4d4d-860f-329a26cb5ce3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:59.002458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21167b69-f944-4d4d-860f-329a26cb5ce3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:59.002458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21167b69-f944-4d4d-860f-329a26cb5ce3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:59.004452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21167b69-f944-4d4d-860f-329a26cb5ce3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:59.186394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-21167b69-f944-4d4d-860f-329a26cb5ce3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:59.230334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-21167b69-f944-4d4d-860f-329a26cb5ce3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:59.232555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-21167b69-f944-4d4d-860f-329a26cb5ce3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:59.247313 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-21167b69-f944-4d4d-860f-329a26cb5ce3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.286412 Oct 04 21:09:59.263066 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 596/1199] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:58 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:59.344830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-20ba5b55-17d3-48f8-93c3-dcd10c7caa85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:59.377545 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-20ba5b55-17d3-48f8-93c3-dcd10c7caa85 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 200 len: 1472 microversion: 2.1 time: 0.490126 Oct 04 21:09:59.378335 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 604/1200] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:58 2022] GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 1472 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:59.436186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-800bd420-b2a3-4cb2-957a-4ede01a6b8b2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:59.436930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-800bd420-b2a3-4cb2-957a-4ede01a6b8b2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:59.449648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-800bd420-b2a3-4cb2-957a-4ede01a6b8b2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:59.455612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-800bd420-b2a3-4cb2-957a-4ede01a6b8b2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:59.456150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-800bd420-b2a3-4cb2-957a-4ede01a6b8b2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:59.456924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-800bd420-b2a3-4cb2-957a-4ede01a6b8b2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:59.457555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-800bd420-b2a3-4cb2-957a-4ede01a6b8b2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:59.459811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-800bd420-b2a3-4cb2-957a-4ede01a6b8b2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:59.710080 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-800bd420-b2a3-4cb2-957a-4ede01a6b8b2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1855 microversion: 2.1 time: 0.278828 Oct 04 21:09:59.714394 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 597/1201] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:59 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1855 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:59.737156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-9111174c-4876-44f2-818b-f44cab042c13 req-a8de605d-85d0-449c-85df-00b3c695eb01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478b7921-99ee-4230-858f-4423735eea84", "name": "network-vif-deleted", "tag": "6920b939-b234-490f-b6b7-a2cbf5a54616"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:59.757574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c6f2949d-1ace-441c-bf69-a9124a607323 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860282-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:59.759659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9111174c-4876-44f2-818b-f44cab042c13 req-a8de605d-85d0-449c-85df-00b3c695eb01 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:59.760156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9111174c-4876-44f2-818b-f44cab042c13 req-a8de605d-85d0-449c-85df-00b3c695eb01 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:59.760590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9111174c-4876-44f2-818b-f44cab042c13 req-a8de605d-85d0-449c-85df-00b3c695eb01 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:59.763754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c6f2949d-1ace-441c-bf69-a9124a607323 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:59.778612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6f2949d-1ace-441c-bf69-a9124a607323 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:59.781969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6f2949d-1ace-441c-bf69-a9124a607323 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:59.783042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6f2949d-1ace-441c-bf69-a9124a607323 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:59.784020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6f2949d-1ace-441c-bf69-a9124a607323 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:59.789091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6f2949d-1ace-441c-bf69-a9124a607323 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:59.789994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6f2949d-1ace-441c-bf69-a9124a607323 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:59.800358 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-9111174c-4876-44f2-818b-f44cab042c13 req-a8de605d-85d0-449c-85df-00b3c695eb01 service nova] Creating event network-vif-deleted:6920b939-b234-490f-b6b7-a2cbf5a54616 for instance 478b7921-99ee-4230-858f-4423735eea84 on n-h2-860282-1 Oct 04 21:09:59.805248 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-9111174c-4876-44f2-818b-f44cab042c13 req-a8de605d-85d0-449c-85df-00b3c695eb01 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075879 Oct 04 21:09:59.806200 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 605/1202] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:59.833286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-c6f2949d-1ace-441c-bf69-a9124a607323 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lazy-loading 'flavor' on Instance uuid fcf618d0-9d79-435c-ac4f-636ac63dbbda {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:09:59.846973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ce7d624b-d0fb-4f30-9180-e38f2f2aabc1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:59.848000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ce7d624b-d0fb-4f30-9180-e38f2f2aabc1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:59.852106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c6f2949d-1ace-441c-bf69-a9124a607323 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Going to try to live migrate instance to n-h1-860282-1 {{(pid=122758) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:09:59.858819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce7d624b-d0fb-4f30-9180-e38f2f2aabc1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:59.860987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce7d624b-d0fb-4f30-9180-e38f2f2aabc1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:59.862874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce7d624b-d0fb-4f30-9180-e38f2f2aabc1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:59.863858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce7d624b-d0fb-4f30-9180-e38f2f2aabc1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:59.864494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce7d624b-d0fb-4f30-9180-e38f2f2aabc1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:59.867383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce7d624b-d0fb-4f30-9180-e38f2f2aabc1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:00.119467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ce7d624b-d0fb-4f30-9180-e38f2f2aabc1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:00.128451 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ce7d624b-d0fb-4f30-9180-e38f2f2aabc1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1313 microversion: 2.1 time: 0.285822 Oct 04 21:10:00.129032 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 606/1203] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:59 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:10:00.133662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0c2a43cc-730b-49c6-b284-43b7bd2f087e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:00.134436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0c2a43cc-730b-49c6-b284-43b7bd2f087e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:00.140676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c2a43cc-730b-49c6-b284-43b7bd2f087e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:00.141340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c2a43cc-730b-49c6-b284-43b7bd2f087e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:00.141955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c2a43cc-730b-49c6-b284-43b7bd2f087e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:00.142874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c2a43cc-730b-49c6-b284-43b7bd2f087e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:00.143481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c2a43cc-730b-49c6-b284-43b7bd2f087e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:00.144085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c2a43cc-730b-49c6-b284-43b7bd2f087e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:00.274782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:00.553336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0c2a43cc-730b-49c6-b284-43b7bd2f087e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:00.567656 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0c2a43cc-730b-49c6-b284-43b7bd2f087e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1473 microversion: 2.1 time: 0.437294 Oct 04 21:10:00.568263 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 607/1204] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:00 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1473 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:00.586199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-894fbe21-0325-4643-91f3-bc9b54f70672 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:00.586828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-894fbe21-0325-4643-91f3-bc9b54f70672 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:00.603046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-894fbe21-0325-4643-91f3-bc9b54f70672 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:00.603563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-894fbe21-0325-4643-91f3-bc9b54f70672 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:00.608104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-894fbe21-0325-4643-91f3-bc9b54f70672 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:00.609092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-894fbe21-0325-4643-91f3-bc9b54f70672 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:00.611630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-894fbe21-0325-4643-91f3-bc9b54f70672 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:00.612736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-894fbe21-0325-4643-91f3-bc9b54f70672 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:00.724252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-894fbe21-0325-4643-91f3-bc9b54f70672 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:00.735900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-894fbe21-0325-4643-91f3-bc9b54f70672 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:00.739503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-894fbe21-0325-4643-91f3-bc9b54f70672 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:00.745930 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-894fbe21-0325-4643-91f3-bc9b54f70672 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.174451 Oct 04 21:10:00.748951 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 608/1205] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:00 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:00.754016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3a439a7e-1803-4e46-9a6e-6cd97535ac8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:00.754811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3a439a7e-1803-4e46-9a6e-6cd97535ac8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:00.762060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a439a7e-1803-4e46-9a6e-6cd97535ac8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:00.775052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a439a7e-1803-4e46-9a6e-6cd97535ac8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:00.775052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a439a7e-1803-4e46-9a6e-6cd97535ac8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:00.775052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a439a7e-1803-4e46-9a6e-6cd97535ac8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:00.775052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a439a7e-1803-4e46-9a6e-6cd97535ac8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:00.775052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a439a7e-1803-4e46-9a6e-6cd97535ac8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:00.801767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a439a7e-1803-4e46-9a6e-6cd97535ac8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:00.802501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a439a7e-1803-4e46-9a6e-6cd97535ac8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:00.803196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a439a7e-1803-4e46-9a6e-6cd97535ac8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:00.803842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-3a439a7e-1803-4e46-9a6e-6cd97535ac8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lazy-loading 'fault' on Instance uuid 478b7921-99ee-4230-858f-4423735eea84 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:10:00.883968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3a439a7e-1803-4e46-9a6e-6cd97535ac8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:00.898868 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3a439a7e-1803-4e46-9a6e-6cd97535ac8c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 200 len: 1306 microversion: 2.1 time: 0.148444 Oct 04 21:10:00.899949 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 609/1206] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:00 2022] GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 1306 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:01.156626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-42764196-d1bf-4ab5-bc0a-06a9c68fc56f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:01.157549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-42764196-d1bf-4ab5-bc0a-06a9c68fc56f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:01.167993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42764196-d1bf-4ab5-bc0a-06a9c68fc56f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:01.169649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42764196-d1bf-4ab5-bc0a-06a9c68fc56f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:01.171844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42764196-d1bf-4ab5-bc0a-06a9c68fc56f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:01.172756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42764196-d1bf-4ab5-bc0a-06a9c68fc56f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:01.175144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42764196-d1bf-4ab5-bc0a-06a9c68fc56f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:01.175610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42764196-d1bf-4ab5-bc0a-06a9c68fc56f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:01.356973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-42764196-d1bf-4ab5-bc0a-06a9c68fc56f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:01.367573 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-42764196-d1bf-4ab5-bc0a-06a9c68fc56f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1313 microversion: 2.1 time: 0.215832 Oct 04 21:10:01.368431 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 610/1207] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:01 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:10:01.591597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-af85e347-5425-4203-b5da-b020d1dadbca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:01.592974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-af85e347-5425-4203-b5da-b020d1dadbca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:01.599969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af85e347-5425-4203-b5da-b020d1dadbca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:01.600834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af85e347-5425-4203-b5da-b020d1dadbca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:01.601607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af85e347-5425-4203-b5da-b020d1dadbca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:01.602598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af85e347-5425-4203-b5da-b020d1dadbca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:01.603239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af85e347-5425-4203-b5da-b020d1dadbca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:01.603887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af85e347-5425-4203-b5da-b020d1dadbca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:02.057837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-af85e347-5425-4203-b5da-b020d1dadbca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:02.073116 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-af85e347-5425-4203-b5da-b020d1dadbca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1473 microversion: 2.1 time: 0.483747 Oct 04 21:10:02.073799 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 611/1208] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:01 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1473 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:10:02.080456 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-76d3b431-a2b5-4dd9-bd58-573b139b5d89 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:02.081080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-76d3b431-a2b5-4dd9-bd58-573b139b5d89 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:02.087141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76d3b431-a2b5-4dd9-bd58-573b139b5d89 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:02.087665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76d3b431-a2b5-4dd9-bd58-573b139b5d89 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:02.088106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76d3b431-a2b5-4dd9-bd58-573b139b5d89 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:02.088803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76d3b431-a2b5-4dd9-bd58-573b139b5d89 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:02.089262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76d3b431-a2b5-4dd9-bd58-573b139b5d89 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:02.089715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76d3b431-a2b5-4dd9-bd58-573b139b5d89 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:02.245016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-76d3b431-a2b5-4dd9-bd58-573b139b5d89 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:02.255198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-76d3b431-a2b5-4dd9-bd58-573b139b5d89 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:02.258828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-76d3b431-a2b5-4dd9-bd58-573b139b5d89 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:02.269415 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-76d3b431-a2b5-4dd9-bd58-573b139b5d89 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1533 microversion: 2.91 time: 0.194495 Oct 04 21:10:02.271146 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 612/1209] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:02 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1533 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:02.280029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6cfd391f-2a41-4b66-b54b-864d433f6a0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:02.280029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6cfd391f-2a41-4b66-b54b-864d433f6a0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 478b7921-99ee-4230-858f-4423735eea84] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:02.285521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cfd391f-2a41-4b66-b54b-864d433f6a0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:02.287094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cfd391f-2a41-4b66-b54b-864d433f6a0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:02.287779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cfd391f-2a41-4b66-b54b-864d433f6a0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:02.292769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cfd391f-2a41-4b66-b54b-864d433f6a0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:02.294092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cfd391f-2a41-4b66-b54b-864d433f6a0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:02.295176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cfd391f-2a41-4b66-b54b-864d433f6a0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:02.310996 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-6cfd391f-2a41-4b66-b54b-864d433f6a0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] HTTP exception thrown: Instance 478b7921-99ee-4230-858f-4423735eea84 could not be found. Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6cfd391f-2a41-4b66-b54b-864d433f6a0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Request method failure captured: Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 HTTP/1.1 Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKCSppkDAXSjwCSQa1f69X7mZVl7uZCSLTAHkzCtM2WTMjjTMUCKpz98J5Gj1CKCaKAVO-07ppp3m5zpHBQBOvXrxv-C9cE1HJ_RUrNofezjxAPsUNqPHzklSFFJuiasvRr2uETo5d4QJvlemPPKWE4rz9k2ow6zF89U2q-GMS4a-Gw Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 801ce5c5897d4894a6a2ffc1b27191aa Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/801ce5c5897d4894a6a2ffc1b27191aa"}]}] Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 801ce5c5897d4894a6a2ffc1b27191aa Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersOnMultiNodesTest-2051543181-project Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 0f0ac29dc4e440e785408fa1dfedce5e Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersOnMultiNodesTest-2051543181-project Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 478b7921-99ee-4230-858f-4423735eea84 could not be found. Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '478b7921-99ee-4230-858f-4423735eea84'} Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478b7921-99ee-4230-858f-4423735eea84 could not be found. Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478b7921-99ee-4230-858f-4423735eea84 could not be found. Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:10:02.317224 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:02.322306 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:02.322306 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:10:02.322306 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:10:02.322306 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:10:02.322306 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:10:02.322306 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478b7921-99ee-4230-858f-4423735eea84 could not be found. Oct 04 21:10:02.322306 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:02.322306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6cfd391f-2a41-4b66-b54b-864d433f6a0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Returning 404 to user: Instance 478b7921-99ee-4230-858f-4423735eea84 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:10:02.322306 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6cfd391f-2a41-4b66-b54b-864d433f6a0d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84" status: 404 len: 111 microversion: 2.1 time: 0.046497 Oct 04 21:10:02.322985 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 613/1210] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:02 2022] GET /compute/v2.1/servers/478b7921-99ee-4230-858f-4423735eea84 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:10:02.327274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b3e51743-0bf0-4e93-8b8b-5ecf9afd9d07 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:02.328103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b3e51743-0bf0-4e93-8b8b-5ecf9afd9d07 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:02.337022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3e51743-0bf0-4e93-8b8b-5ecf9afd9d07 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:02.342938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3e51743-0bf0-4e93-8b8b-5ecf9afd9d07 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:02.342938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3e51743-0bf0-4e93-8b8b-5ecf9afd9d07 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:02.342938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3e51743-0bf0-4e93-8b8b-5ecf9afd9d07 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:02.342938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3e51743-0bf0-4e93-8b8b-5ecf9afd9d07 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:02.345588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3e51743-0bf0-4e93-8b8b-5ecf9afd9d07 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:02.512623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-b3e51743-0bf0-4e93-8b8b-5ecf9afd9d07 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lazy-loading 'services' on Instance uuid 6a60b592-6e55-4259-aff7-b06203ef2d1e {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:10:02.538514 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b3e51743-0bf0-4e93-8b8b-5ecf9afd9d07 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1938 microversion: 2.91 time: 0.214708 Oct 04 21:10:02.539639 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 614/1211] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:02 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1938 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:02.546277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fa0340db-fe16-4fb7-854a-e958006f05d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:02.546793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fa0340db-fe16-4fb7-854a-e958006f05d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:02.548767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:02.555851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa0340db-fe16-4fb7-854a-e958006f05d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:02.555851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa0340db-fe16-4fb7-854a-e958006f05d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:02.556390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa0340db-fe16-4fb7-854a-e958006f05d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:02.557114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa0340db-fe16-4fb7-854a-e958006f05d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:02.557637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa0340db-fe16-4fb7-854a-e958006f05d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:02.558268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa0340db-fe16-4fb7-854a-e958006f05d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:02.618067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fa0340db-fe16-4fb7-854a-e958006f05d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:10:02.622938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:03.032817 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fa0340db-fe16-4fb7-854a-e958006f05d7 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 204 len: 0 microversion: 2.1 time: 0.491628 Oct 04 21:10:03.033466 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 615/1212] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:10:02 2022] DELETE /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:10:03.039082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a57c1d01-49b0-4890-afee-335f70ac6525 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:03.039809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a57c1d01-49b0-4890-afee-335f70ac6525 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:03.046774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a57c1d01-49b0-4890-afee-335f70ac6525 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:03.047275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a57c1d01-49b0-4890-afee-335f70ac6525 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:03.047881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a57c1d01-49b0-4890-afee-335f70ac6525 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:03.048588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a57c1d01-49b0-4890-afee-335f70ac6525 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:03.049050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a57c1d01-49b0-4890-afee-335f70ac6525 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:03.049506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a57c1d01-49b0-4890-afee-335f70ac6525 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:03.156533 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c6f2949d-1ace-441c-bf69-a9124a607323 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/action" status: 202 len: 0 microversion: 2.1 time: 3.405170 Oct 04 21:10:03.158114 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 598/1213] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:09:59 2022] POST /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/action => generated 0 bytes in 3412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:10:03.196375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a57c1d01-49b0-4890-afee-335f70ac6525 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:03.205021 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a57c1d01-49b0-4890-afee-335f70ac6525 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1313 microversion: 2.1 time: 0.170226 Oct 04 21:10:03.205773 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 616/1214] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:03 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:03.210932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-24ea16db-d8f2-4fe7-9005-a6fb7a8ecfff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:03.211709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-24ea16db-d8f2-4fe7-9005-a6fb7a8ecfff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:03.217964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24ea16db-d8f2-4fe7-9005-a6fb7a8ecfff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:03.218744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24ea16db-d8f2-4fe7-9005-a6fb7a8ecfff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:03.219399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24ea16db-d8f2-4fe7-9005-a6fb7a8ecfff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:03.220327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24ea16db-d8f2-4fe7-9005-a6fb7a8ecfff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:03.220871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24ea16db-d8f2-4fe7-9005-a6fb7a8ecfff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:03.221544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24ea16db-d8f2-4fe7-9005-a6fb7a8ecfff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:03.249146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-24ea16db-d8f2-4fe7-9005-a6fb7a8ecfff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lazy-loading 'flavor' on Instance uuid 6a60b592-6e55-4259-aff7-b06203ef2d1e {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:10:03.332048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5348e6ac-b749-49f1-a5f5-1ca4bc7ae74d tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] Action: 'create', calling method: .version_select at 0x7f57900549d0>, body: {"pool": null} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:03.890202 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-24ea16db-d8f2-4fe7-9005-a6fb7a8ecfff tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "POST /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e/action" status: 202 len: 0 microversion: 2.91 time: 0.682147 Oct 04 21:10:03.890998 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 617/1215] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Oct 4 21:10:03 2022] POST /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e/action => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:10:03.900482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d4f89ba0-9e05-4bac-8058-923be7f505ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:03.900482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d4f89ba0-9e05-4bac-8058-923be7f505ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:03.907769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4f89ba0-9e05-4bac-8058-923be7f505ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:03.908957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4f89ba0-9e05-4bac-8058-923be7f505ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:03.908957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4f89ba0-9e05-4bac-8058-923be7f505ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:03.909382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4f89ba0-9e05-4bac-8058-923be7f505ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:03.909861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4f89ba0-9e05-4bac-8058-923be7f505ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:03.910293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4f89ba0-9e05-4bac-8058-923be7f505ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:04.096232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d4f89ba0-9e05-4bac-8058-923be7f505ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:04.108463 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d4f89ba0-9e05-4bac-8058-923be7f505ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1472 microversion: 2.1 time: 0.215954 Oct 04 21:10:04.111148 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 618/1216] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:03 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1472 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:04.135607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-01c7473c-2e12-4f67-8ea4-e6ac05be2a77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:04.136297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-01c7473c-2e12-4f67-8ea4-e6ac05be2a77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:04.147557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01c7473c-2e12-4f67-8ea4-e6ac05be2a77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:04.148234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01c7473c-2e12-4f67-8ea4-e6ac05be2a77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:04.148777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01c7473c-2e12-4f67-8ea4-e6ac05be2a77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:04.149651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01c7473c-2e12-4f67-8ea4-e6ac05be2a77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:04.150180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01c7473c-2e12-4f67-8ea4-e6ac05be2a77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:04.150683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01c7473c-2e12-4f67-8ea4-e6ac05be2a77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:04.423646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-01c7473c-2e12-4f67-8ea4-e6ac05be2a77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:04.440007 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-01c7473c-2e12-4f67-8ea4-e6ac05be2a77 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1470 microversion: 2.1 time: 0.329117 Oct 04 21:10:04.440514 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 619/1217] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:04 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1470 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:04.449206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-945f0b9a-71dc-4278-9d96-38d6f95fa221 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:04.450606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-945f0b9a-71dc-4278-9d96-38d6f95fa221 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:04.457936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-945f0b9a-71dc-4278-9d96-38d6f95fa221 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:04.458426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-945f0b9a-71dc-4278-9d96-38d6f95fa221 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:04.458939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-945f0b9a-71dc-4278-9d96-38d6f95fa221 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:04.459666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-945f0b9a-71dc-4278-9d96-38d6f95fa221 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:04.460724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-945f0b9a-71dc-4278-9d96-38d6f95fa221 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:04.460724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-945f0b9a-71dc-4278-9d96-38d6f95fa221 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:04.687010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-945f0b9a-71dc-4278-9d96-38d6f95fa221 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:04.696093 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-945f0b9a-71dc-4278-9d96-38d6f95fa221 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.254517 Oct 04 21:10:04.696808 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 620/1218] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:04 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:04.701856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1f8c3edf-46d7-4f1c-aa38-70ae26024d0b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:04.702618 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1f8c3edf-46d7-4f1c-aa38-70ae26024d0b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:04.708975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f8c3edf-46d7-4f1c-aa38-70ae26024d0b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:04.709484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f8c3edf-46d7-4f1c-aa38-70ae26024d0b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:04.710326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f8c3edf-46d7-4f1c-aa38-70ae26024d0b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:04.710913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f8c3edf-46d7-4f1c-aa38-70ae26024d0b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:04.711885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f8c3edf-46d7-4f1c-aa38-70ae26024d0b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:04.711885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f8c3edf-46d7-4f1c-aa38-70ae26024d0b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:05.207186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1f8c3edf-46d7-4f1c-aa38-70ae26024d0b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:05.218604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1f8c3edf-46d7-4f1c-aa38-70ae26024d0b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:05.223190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1f8c3edf-46d7-4f1c-aa38-70ae26024d0b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:05.240720 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1f8c3edf-46d7-4f1c-aa38-70ae26024d0b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.542992 Oct 04 21:10:05.241641 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 621/1219] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:04 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:05.246304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b16826b8-173b-436a-a4fa-0b81ebb23484 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:05.247140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b16826b8-173b-436a-a4fa-0b81ebb23484 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:05.266587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b16826b8-173b-436a-a4fa-0b81ebb23484 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:05.267051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b16826b8-173b-436a-a4fa-0b81ebb23484 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:05.267501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b16826b8-173b-436a-a4fa-0b81ebb23484 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:05.268225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b16826b8-173b-436a-a4fa-0b81ebb23484 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:05.268686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b16826b8-173b-436a-a4fa-0b81ebb23484 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:05.272875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b16826b8-173b-436a-a4fa-0b81ebb23484 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:05.710024 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b16826b8-173b-436a-a4fa-0b81ebb23484 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:05.720608 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b16826b8-173b-436a-a4fa-0b81ebb23484 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1313 microversion: 2.1 time: 0.477499 Oct 04 21:10:05.721636 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 622/1220] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:05 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:05.728404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-09eb239d-042a-40da-a74e-04493435103b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:05.729323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-09eb239d-042a-40da-a74e-04493435103b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:05.737779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09eb239d-042a-40da-a74e-04493435103b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:05.738661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09eb239d-042a-40da-a74e-04493435103b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:05.739186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09eb239d-042a-40da-a74e-04493435103b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:05.739977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09eb239d-042a-40da-a74e-04493435103b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:05.740503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09eb239d-042a-40da-a74e-04493435103b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:05.741135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09eb239d-042a-40da-a74e-04493435103b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:06.047749 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-09eb239d-042a-40da-a74e-04493435103b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "POST /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b/action" status: 204 len: 0 microversion: 2.1 time: 0.324576 Oct 04 21:10:06.048416 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 623/1221] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:10:05 2022] POST /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b/action => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:10:06.061843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-c1868112-6014-4c7d-ab82-b3195cf9813f req-fd495995-853e-49be-8383-b89665acf923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a255f2-7c48-4148-bdc8-6603ac47d2a3", "name": "network-vif-plugged", "status": "completed", "tag": "9d8db50d-d745-4054-ac10-dc90ebaf61be"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:06.078322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c1868112-6014-4c7d-ab82-b3195cf9813f req-fd495995-853e-49be-8383-b89665acf923 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:06.079261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c1868112-6014-4c7d-ab82-b3195cf9813f req-fd495995-853e-49be-8383-b89665acf923 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:06.079261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c1868112-6014-4c7d-ab82-b3195cf9813f req-fd495995-853e-49be-8383-b89665acf923 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:06.086339 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5348e6ac-b749-49f1-a5f5-1ca4bc7ae74d tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.927050 Oct 04 21:10:06.097053 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 599/1222] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Oct 4 21:10:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:06.098331 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-c1868112-6014-4c7d-ab82-b3195cf9813f req-fd495995-853e-49be-8383-b89665acf923 service nova] Creating event network-vif-plugged:9d8db50d-d745-4054-ac10-dc90ebaf61be for instance a8a255f2-7c48-4148-bdc8-6603ac47d2a3 on n-h1-860282-1 Oct 04 21:10:06.103307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9cecb965-068b-4642-a3ea-fb7e65c984fe tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:06.105506 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-c1868112-6014-4c7d-ab82-b3195cf9813f req-fd495995-853e-49be-8383-b89665acf923 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053737 Oct 04 21:10:06.105928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9cecb965-068b-4642-a3ea-fb7e65c984fe tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:06.111208 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 624/1223] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:06.129956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9cecb965-068b-4642-a3ea-fb7e65c984fe tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:06.132461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9cecb965-068b-4642-a3ea-fb7e65c984fe tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:06.133334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9cecb965-068b-4642-a3ea-fb7e65c984fe tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:06.139978 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9cecb965-068b-4642-a3ea-fb7e65c984fe tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:06.140711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9cecb965-068b-4642-a3ea-fb7e65c984fe tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:06.141361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9cecb965-068b-4642-a3ea-fb7e65c984fe tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:06.147121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e93d4c2f-3a15-42d9-a650-6c60ca46843d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:06.147763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e93d4c2f-3a15-42d9-a650-6c60ca46843d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:06.189160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e93d4c2f-3a15-42d9-a650-6c60ca46843d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:06.189977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e93d4c2f-3a15-42d9-a650-6c60ca46843d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:06.191201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e93d4c2f-3a15-42d9-a650-6c60ca46843d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:06.192124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e93d4c2f-3a15-42d9-a650-6c60ca46843d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:06.195472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e93d4c2f-3a15-42d9-a650-6c60ca46843d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:06.196092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e93d4c2f-3a15-42d9-a650-6c60ca46843d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:06.417370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9cecb965-068b-4642-a3ea-fb7e65c984fe tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:06.434559 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9cecb965-068b-4642-a3ea-fb7e65c984fe tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1430 microversion: 2.1 time: 0.335931 Oct 04 21:10:06.442135 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 600/1224] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:06 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1430 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:06.460084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7f910363-afda-42f1-95e0-72863ddb44d2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:06.463877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7f910363-afda-42f1-95e0-72863ddb44d2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:06.484928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f910363-afda-42f1-95e0-72863ddb44d2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:06.487631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f910363-afda-42f1-95e0-72863ddb44d2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:06.489168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f910363-afda-42f1-95e0-72863ddb44d2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:06.490377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f910363-afda-42f1-95e0-72863ddb44d2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:06.494419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f910363-afda-42f1-95e0-72863ddb44d2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:06.498858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f910363-afda-42f1-95e0-72863ddb44d2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:06.582809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e93d4c2f-3a15-42d9-a650-6c60ca46843d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:06.593282 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e93d4c2f-3a15-42d9-a650-6c60ca46843d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.461946 Oct 04 21:10:06.594316 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 625/1225] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:06 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:06.600013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-37f34971-1016-4adf-8508-e635d10daa1b tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] Action: 'create', calling method: .version_select at 0x7f57903a8550>, body: {"pool": null} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:06.915245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7f910363-afda-42f1-95e0-72863ddb44d2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:06.928856 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7f910363-afda-42f1-95e0-72863ddb44d2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1470 microversion: 2.1 time: 0.483890 Oct 04 21:10:06.929389 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 601/1226] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:06 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1470 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:06.942347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b873ea6c-5c2d-420b-953a-a527de1504da tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:06.942981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b873ea6c-5c2d-420b-953a-a527de1504da tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:06.957568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b873ea6c-5c2d-420b-953a-a527de1504da tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:06.958347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b873ea6c-5c2d-420b-953a-a527de1504da tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:06.958974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b873ea6c-5c2d-420b-953a-a527de1504da tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:06.959855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b873ea6c-5c2d-420b-953a-a527de1504da tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:06.961398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b873ea6c-5c2d-420b-953a-a527de1504da tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:06.962301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b873ea6c-5c2d-420b-953a-a527de1504da tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:07.082767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b873ea6c-5c2d-420b-953a-a527de1504da tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:07.096438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b873ea6c-5c2d-420b-953a-a527de1504da tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:07.100123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b873ea6c-5c2d-420b-953a-a527de1504da tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:07.114598 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b873ea6c-5c2d-420b-953a-a527de1504da tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.182072 Oct 04 21:10:07.115372 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 602/1227] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:06 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:07.129259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-0038f73e-2dc2-4c20-bfa3-ddc236028580 req-da4e72b6-12e3-4c2d-b1ba-931699286709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdefd528-2e7a-438e-b093-a98a4ec58e78", "name": "network-vif-deleted", "tag": "2ce00f87-090e-47d0-917a-4baf600863f9"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:07.151514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0038f73e-2dc2-4c20-bfa3-ddc236028580 req-da4e72b6-12e3-4c2d-b1ba-931699286709 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:07.154121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0038f73e-2dc2-4c20-bfa3-ddc236028580 req-da4e72b6-12e3-4c2d-b1ba-931699286709 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:07.154878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0038f73e-2dc2-4c20-bfa3-ddc236028580 req-da4e72b6-12e3-4c2d-b1ba-931699286709 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:07.180255 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-0038f73e-2dc2-4c20-bfa3-ddc236028580 req-da4e72b6-12e3-4c2d-b1ba-931699286709 service nova] Creating event network-vif-deleted:2ce00f87-090e-47d0-917a-4baf600863f9 for instance bdefd528-2e7a-438e-b093-a98a4ec58e78 on n-h1-860282-1 Oct 04 21:10:07.193287 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-0038f73e-2dc2-4c20-bfa3-ddc236028580 req-da4e72b6-12e3-4c2d-b1ba-931699286709 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075888 Oct 04 21:10:07.194294 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 603/1228] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:07.206688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ca78d538-0cb9-4e94-b040-4d42927bb765 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:07.213584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ca78d538-0cb9-4e94-b040-4d42927bb765 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:07.236985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca78d538-0cb9-4e94-b040-4d42927bb765 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:07.237739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca78d538-0cb9-4e94-b040-4d42927bb765 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:07.240899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca78d538-0cb9-4e94-b040-4d42927bb765 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:07.242277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca78d538-0cb9-4e94-b040-4d42927bb765 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:07.243374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca78d538-0cb9-4e94-b040-4d42927bb765 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:07.244311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca78d538-0cb9-4e94-b040-4d42927bb765 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:07.598251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ca78d538-0cb9-4e94-b040-4d42927bb765 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:07.612575 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ca78d538-0cb9-4e94-b040-4d42927bb765 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1313 microversion: 2.1 time: 0.413034 Oct 04 21:10:07.613167 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 604/1229] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:07 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:07.628234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-17c50d39-03bb-41ca-91ae-2a91f3f914f3 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:07.632402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-17c50d39-03bb-41ca-91ae-2a91f3f914f3 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:07.648045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17c50d39-03bb-41ca-91ae-2a91f3f914f3 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:07.649219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17c50d39-03bb-41ca-91ae-2a91f3f914f3 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:07.650102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17c50d39-03bb-41ca-91ae-2a91f3f914f3 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:07.653871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17c50d39-03bb-41ca-91ae-2a91f3f914f3 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:07.656887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17c50d39-03bb-41ca-91ae-2a91f3f914f3 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:07.656887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17c50d39-03bb-41ca-91ae-2a91f3f914f3 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:07.741692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17c50d39-03bb-41ca-91ae-2a91f3f914f3 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:07.742036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17c50d39-03bb-41ca-91ae-2a91f3f914f3 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:07.742925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17c50d39-03bb-41ca-91ae-2a91f3f914f3 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:07.743117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-17c50d39-03bb-41ca-91ae-2a91f3f914f3 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lazy-loading 'fault' on Instance uuid bdefd528-2e7a-438e-b093-a98a4ec58e78 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:10:07.796005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-17c50d39-03bb-41ca-91ae-2a91f3f914f3 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:07.797631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:07.804352 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-17c50d39-03bb-41ca-91ae-2a91f3f914f3 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1307 microversion: 2.1 time: 0.184568 Oct 04 21:10:07.804934 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 605/1230] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:07 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1307 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:07.810328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-87fc08a3-784d-4c12-9bf4-0dd5db9bce3a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:07.810942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-87fc08a3-784d-4c12-9bf4-0dd5db9bce3a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:07.817064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87fc08a3-784d-4c12-9bf4-0dd5db9bce3a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:07.817878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87fc08a3-784d-4c12-9bf4-0dd5db9bce3a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:07.818529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87fc08a3-784d-4c12-9bf4-0dd5db9bce3a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:07.819424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87fc08a3-784d-4c12-9bf4-0dd5db9bce3a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:07.820069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87fc08a3-784d-4c12-9bf4-0dd5db9bce3a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:07.820682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87fc08a3-784d-4c12-9bf4-0dd5db9bce3a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:08.025326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-87fc08a3-784d-4c12-9bf4-0dd5db9bce3a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:08.038422 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-87fc08a3-784d-4c12-9bf4-0dd5db9bce3a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.232123 Oct 04 21:10:08.039208 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 606/1231] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:07 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:08.043995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9aad8b5b-3f6a-4f29-8370-ae5af10abb0f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:08.044890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9aad8b5b-3f6a-4f29-8370-ae5af10abb0f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:08.051619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9aad8b5b-3f6a-4f29-8370-ae5af10abb0f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:08.052418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9aad8b5b-3f6a-4f29-8370-ae5af10abb0f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:08.053083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9aad8b5b-3f6a-4f29-8370-ae5af10abb0f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:08.054044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9aad8b5b-3f6a-4f29-8370-ae5af10abb0f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:08.054729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9aad8b5b-3f6a-4f29-8370-ae5af10abb0f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:08.055388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9aad8b5b-3f6a-4f29-8370-ae5af10abb0f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:08.282272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9aad8b5b-3f6a-4f29-8370-ae5af10abb0f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:08.290989 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9aad8b5b-3f6a-4f29-8370-ae5af10abb0f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1470 microversion: 2.1 time: 0.250541 Oct 04 21:10:08.306011 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 607/1232] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:08 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1470 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:08.314204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-7b890624-33c6-4d6a-9775-7a6fcaa25b30 req-fdd3be08-b49a-47a3-b1c4-1ae5e433a2fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d10b511-a8bd-46cc-bf96-0879899ac60b", "name": "network-vif-plugged", "status": "completed", "tag": "cc7eeb3c-7c42-43b5-b169-cbc14e6a3436"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:08.324549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-7b890624-33c6-4d6a-9775-7a6fcaa25b30 req-fdd3be08-b49a-47a3-b1c4-1ae5e433a2fe service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:08.325068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-7b890624-33c6-4d6a-9775-7a6fcaa25b30 req-fdd3be08-b49a-47a3-b1c4-1ae5e433a2fe service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:08.325733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-7b890624-33c6-4d6a-9775-7a6fcaa25b30 req-fdd3be08-b49a-47a3-b1c4-1ae5e433a2fe service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:08.342619 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-7b890624-33c6-4d6a-9775-7a6fcaa25b30 req-fdd3be08-b49a-47a3-b1c4-1ae5e433a2fe service nova] Creating event network-vif-plugged:cc7eeb3c-7c42-43b5-b169-cbc14e6a3436 for instance 4d10b511-a8bd-46cc-bf96-0879899ac60b on n-h1-860282-1 Oct 04 21:10:08.348889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-7b890624-33c6-4d6a-9775-7a6fcaa25b30 req-fdd3be08-b49a-47a3-b1c4-1ae5e433a2fe service nova] Instance 4d10b511-a8bd-46cc-bf96-0879899ac60b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:10:08.356996 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-7b890624-33c6-4d6a-9775-7a6fcaa25b30 req-fdd3be08-b49a-47a3-b1c4-1ae5e433a2fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048296 Oct 04 21:10:08.357624 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 608/1233] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:08.364758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-45a21d96-edf4-49bf-bc29-d2f03a4cc59e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:08.365406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-45a21d96-edf4-49bf-bc29-d2f03a4cc59e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:08.372647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45a21d96-edf4-49bf-bc29-d2f03a4cc59e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:08.373640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45a21d96-edf4-49bf-bc29-d2f03a4cc59e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:08.374560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45a21d96-edf4-49bf-bc29-d2f03a4cc59e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:08.375741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45a21d96-edf4-49bf-bc29-d2f03a4cc59e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:08.376154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45a21d96-edf4-49bf-bc29-d2f03a4cc59e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:08.376744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45a21d96-edf4-49bf-bc29-d2f03a4cc59e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:08.512017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-45a21d96-edf4-49bf-bc29-d2f03a4cc59e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:08.532942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-45a21d96-edf4-49bf-bc29-d2f03a4cc59e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:08.534749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-45a21d96-edf4-49bf-bc29-d2f03a4cc59e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:08.541242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:08.543990 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-45a21d96-edf4-49bf-bc29-d2f03a4cc59e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.184304 Oct 04 21:10:08.545363 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 609/1234] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:08 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:08.640076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c482e5ff-cceb-4b8c-8322-c00b69cb1e0e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:08.641487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c482e5ff-cceb-4b8c-8322-c00b69cb1e0e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:08.660637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c482e5ff-cceb-4b8c-8322-c00b69cb1e0e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:08.662531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c482e5ff-cceb-4b8c-8322-c00b69cb1e0e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:08.663665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c482e5ff-cceb-4b8c-8322-c00b69cb1e0e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:08.665333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c482e5ff-cceb-4b8c-8322-c00b69cb1e0e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:08.666749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c482e5ff-cceb-4b8c-8322-c00b69cb1e0e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:08.667300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c482e5ff-cceb-4b8c-8322-c00b69cb1e0e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:08.949850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c482e5ff-cceb-4b8c-8322-c00b69cb1e0e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:08.969337 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c482e5ff-cceb-4b8c-8322-c00b69cb1e0e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1313 microversion: 2.1 time: 0.333193 Oct 04 21:10:08.971907 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 610/1235] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:08 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:10:08.982062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e8829ba8-3f0d-4532-93ba-8ff73976439d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:08.988284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e8829ba8-3f0d-4532-93ba-8ff73976439d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:08.996713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8829ba8-3f0d-4532-93ba-8ff73976439d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:08.997304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8829ba8-3f0d-4532-93ba-8ff73976439d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:08.998208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8829ba8-3f0d-4532-93ba-8ff73976439d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:08.999177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8829ba8-3f0d-4532-93ba-8ff73976439d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:08.999917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8829ba8-3f0d-4532-93ba-8ff73976439d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:09.000563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8829ba8-3f0d-4532-93ba-8ff73976439d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:09.045745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8829ba8-3f0d-4532-93ba-8ff73976439d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:09.046225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8829ba8-3f0d-4532-93ba-8ff73976439d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:09.046666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8829ba8-3f0d-4532-93ba-8ff73976439d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:09.047307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-e8829ba8-3f0d-4532-93ba-8ff73976439d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lazy-loading 'fault' on Instance uuid bdefd528-2e7a-438e-b093-a98a4ec58e78 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:10:09.119745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e8829ba8-3f0d-4532-93ba-8ff73976439d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:09.128863 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e8829ba8-3f0d-4532-93ba-8ff73976439d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 200 len: 1307 microversion: 2.1 time: 0.155192 Oct 04 21:10:09.145366 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 611/1236] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:08 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 1307 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:09.145366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-953be092-1140-4f25-82ed-8e3d77f09ef9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:09.145366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-953be092-1140-4f25-82ed-8e3d77f09ef9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:09.145366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-953be092-1140-4f25-82ed-8e3d77f09ef9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:09.145366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-953be092-1140-4f25-82ed-8e3d77f09ef9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:09.145366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-953be092-1140-4f25-82ed-8e3d77f09ef9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:09.145366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-953be092-1140-4f25-82ed-8e3d77f09ef9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:09.145366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-953be092-1140-4f25-82ed-8e3d77f09ef9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:09.146307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-953be092-1140-4f25-82ed-8e3d77f09ef9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:09.329575 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-37f34971-1016-4adf-8508-e635d10daa1b tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.733912 Oct 04 21:10:09.338089 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 626/1237] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Oct 4 21:10:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:09.344859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1f498865-834e-4248-93b3-37a25e16a44f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:09.345505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1f498865-834e-4248-93b3-37a25e16a44f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:09.355197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f498865-834e-4248-93b3-37a25e16a44f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:09.355197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f498865-834e-4248-93b3-37a25e16a44f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:09.355197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f498865-834e-4248-93b3-37a25e16a44f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:09.355197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f498865-834e-4248-93b3-37a25e16a44f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:09.356045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f498865-834e-4248-93b3-37a25e16a44f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:09.356481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f498865-834e-4248-93b3-37a25e16a44f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:09.357447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-953be092-1140-4f25-82ed-8e3d77f09ef9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lazy-loading 'services' on Instance uuid 191d63c3-2de0-4d3a-85f1-c4be3d2f5432 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:10:09.373209 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-953be092-1140-4f25-82ed-8e3d77f09ef9 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 2424 microversion: 2.25 time: 0.242537 Oct 04 21:10:09.386503 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 612/1238] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:09 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 2424 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:09.398903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-61c5383f-a9a5-4722-8f16-14c4584dd232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:09.402506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-61c5383f-a9a5-4722-8f16-14c4584dd232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:09.406658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61c5383f-a9a5-4722-8f16-14c4584dd232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:09.407312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61c5383f-a9a5-4722-8f16-14c4584dd232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:09.407853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61c5383f-a9a5-4722-8f16-14c4584dd232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:09.409318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61c5383f-a9a5-4722-8f16-14c4584dd232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:09.409917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61c5383f-a9a5-4722-8f16-14c4584dd232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:09.410440 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61c5383f-a9a5-4722-8f16-14c4584dd232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:09.542709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1f498865-834e-4248-93b3-37a25e16a44f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:09.553863 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1f498865-834e-4248-93b3-37a25e16a44f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.213214 Oct 04 21:10:09.555021 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 627/1239] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:09 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:09.561185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3111ccf7-0237-40d1-9735-e31b29a57963 tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] Action: 'create', calling method: .version_select at 0x7f579025f430>, body: {"pool": null} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:09.593774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-61c5383f-a9a5-4722-8f16-14c4584dd232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:09.605281 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-61c5383f-a9a5-4722-8f16-14c4584dd232 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1470 microversion: 2.1 time: 0.216823 Oct 04 21:10:09.605281 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 613/1240] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:09 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1470 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:09.610178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-75d1c55f-695d-43d9-ba7c-31b46a19dd46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860282-1", "block_migration": "auto"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:09.612820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-75d1c55f-695d-43d9-ba7c-31b46a19dd46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:09.619392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75d1c55f-695d-43d9-ba7c-31b46a19dd46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:09.620115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75d1c55f-695d-43d9-ba7c-31b46a19dd46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:09.620679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75d1c55f-695d-43d9-ba7c-31b46a19dd46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:09.621501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75d1c55f-695d-43d9-ba7c-31b46a19dd46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:09.622646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75d1c55f-695d-43d9-ba7c-31b46a19dd46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:09.623201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75d1c55f-695d-43d9-ba7c-31b46a19dd46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:09.654865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-75d1c55f-695d-43d9-ba7c-31b46a19dd46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lazy-loading 'flavor' on Instance uuid 191d63c3-2de0-4d3a-85f1-c4be3d2f5432 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:10:09.670180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-75d1c55f-695d-43d9-ba7c-31b46a19dd46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Going to try to live migrate instance to n-h1-860282-1 {{(pid=122758) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:10:11.367422 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3111ccf7-0237-40d1-9735-e31b29a57963 tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.811131 Oct 04 21:10:11.368045 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 628/1241] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Oct 4 21:10:09 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:11.375817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1411871f-e089-4f4d-8c64-2b3cf7849ea9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:11.375817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1411871f-e089-4f4d-8c64-2b3cf7849ea9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:11.386855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1411871f-e089-4f4d-8c64-2b3cf7849ea9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:11.387976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1411871f-e089-4f4d-8c64-2b3cf7849ea9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:11.388574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1411871f-e089-4f4d-8c64-2b3cf7849ea9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:11.389570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1411871f-e089-4f4d-8c64-2b3cf7849ea9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:11.390040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1411871f-e089-4f4d-8c64-2b3cf7849ea9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:11.390500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1411871f-e089-4f4d-8c64-2b3cf7849ea9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:11.457465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1411871f-e089-4f4d-8c64-2b3cf7849ea9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:11.466680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1411871f-e089-4f4d-8c64-2b3cf7849ea9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:11.468209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1411871f-e089-4f4d-8c64-2b3cf7849ea9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:11.473598 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1411871f-e089-4f4d-8c64-2b3cf7849ea9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.104448 Oct 04 21:10:11.474184 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 629/1242] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:11 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:11.478680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b7ea97ba-cfc1-41e5-aab5-b1831e0365fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:11.479302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b7ea97ba-cfc1-41e5-aab5-b1831e0365fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:11.485067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7ea97ba-cfc1-41e5-aab5-b1831e0365fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:11.485597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7ea97ba-cfc1-41e5-aab5-b1831e0365fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:11.486256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7ea97ba-cfc1-41e5-aab5-b1831e0365fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:11.486961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7ea97ba-cfc1-41e5-aab5-b1831e0365fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:11.487520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7ea97ba-cfc1-41e5-aab5-b1831e0365fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:11.488124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7ea97ba-cfc1-41e5-aab5-b1831e0365fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:11.507002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:11.629058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b7ea97ba-cfc1-41e5-aab5-b1831e0365fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:11.637003 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b7ea97ba-cfc1-41e5-aab5-b1831e0365fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1463 microversion: 2.1 time: 0.161849 Oct 04 21:10:11.637770 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 630/1243] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:11 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1463 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:11.642482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-50d8e6ac-72ba-451a-96e2-e6fbddc1b71f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:11.643293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-50d8e6ac-72ba-451a-96e2-e6fbddc1b71f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: bdefd528-2e7a-438e-b093-a98a4ec58e78] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:11.649496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50d8e6ac-72ba-451a-96e2-e6fbddc1b71f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:11.650055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50d8e6ac-72ba-451a-96e2-e6fbddc1b71f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:11.650527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50d8e6ac-72ba-451a-96e2-e6fbddc1b71f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:11.651231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50d8e6ac-72ba-451a-96e2-e6fbddc1b71f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:11.652595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50d8e6ac-72ba-451a-96e2-e6fbddc1b71f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:11.652595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50d8e6ac-72ba-451a-96e2-e6fbddc1b71f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:11.667804 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-50d8e6ac-72ba-451a-96e2-e6fbddc1b71f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] HTTP exception thrown: Instance bdefd528-2e7a-438e-b093-a98a4ec58e78 could not be found. Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-50d8e6ac-72ba-451a-96e2-e6fbddc1b71f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Request method failure captured: Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 HTTP/1.1 Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKCSppkDAXSjwCSQa1f69X7mZVl7uZCSLTAHkzCtM2WTMjjTMUCKpz98J5Gj1CKCaKAVO-07ppp3m5zpHBQBOvXrxv-C9cE1HJ_RUrNofezjxAPsUNqPHzklSFFJuiasvRr2uETo5d4QJvlemPPKWE4rz9k2ow6zF89U2q-GMS4a-Gw Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 801ce5c5897d4894a6a2ffc1b27191aa Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/801ce5c5897d4894a6a2ffc1b27191aa"}]}] Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 801ce5c5897d4894a6a2ffc1b27191aa Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersOnMultiNodesTest-2051543181-project Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 0f0ac29dc4e440e785408fa1dfedce5e Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersOnMultiNodesTest-2051543181-project Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance bdefd528-2e7a-438e-b093-a98a4ec58e78 could not be found. Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'bdefd528-2e7a-438e-b093-a98a4ec58e78'} Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdefd528-2e7a-438e-b093-a98a4ec58e78 could not be found. Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdefd528-2e7a-438e-b093-a98a4ec58e78 could not be found. Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:10:11.670330 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:11.675317 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:11.675317 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:10:11.675317 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:10:11.675317 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:10:11.675317 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:10:11.675317 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdefd528-2e7a-438e-b093-a98a4ec58e78 could not be found. Oct 04 21:10:11.675317 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:11.675317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-50d8e6ac-72ba-451a-96e2-e6fbddc1b71f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Returning 404 to user: Instance bdefd528-2e7a-438e-b093-a98a4ec58e78 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:10:11.675317 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-50d8e6ac-72ba-451a-96e2-e6fbddc1b71f tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78" status: 404 len: 111 microversion: 2.1 time: 0.035555 Oct 04 21:10:11.675317 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 631/1244] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:11 2022] GET /compute/v2.1/servers/bdefd528-2e7a-438e-b093-a98a4ec58e78 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:10:11.681099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-17dd498f-2d2c-439b-a86d-2b515257766c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:11.681754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-17dd498f-2d2c-439b-a86d-2b515257766c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:11.688402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17dd498f-2d2c-439b-a86d-2b515257766c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:11.689021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17dd498f-2d2c-439b-a86d-2b515257766c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:11.689522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17dd498f-2d2c-439b-a86d-2b515257766c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:11.690428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17dd498f-2d2c-439b-a86d-2b515257766c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:11.690893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17dd498f-2d2c-439b-a86d-2b515257766c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:11.691369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17dd498f-2d2c-439b-a86d-2b515257766c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:11.934469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-17dd498f-2d2c-439b-a86d-2b515257766c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:11.943334 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-17dd498f-2d2c-439b-a86d-2b515257766c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.266272 Oct 04 21:10:11.943923 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 632/1245] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:11 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:11.949618 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dbb0dccb-39aa-4c36-9efe-70ec5cd4ea8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:11.950896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dbb0dccb-39aa-4c36-9efe-70ec5cd4ea8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:11.957737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbb0dccb-39aa-4c36-9efe-70ec5cd4ea8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:11.958235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbb0dccb-39aa-4c36-9efe-70ec5cd4ea8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:11.963040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbb0dccb-39aa-4c36-9efe-70ec5cd4ea8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:11.963040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbb0dccb-39aa-4c36-9efe-70ec5cd4ea8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:11.963040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbb0dccb-39aa-4c36-9efe-70ec5cd4ea8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:11.963040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbb0dccb-39aa-4c36-9efe-70ec5cd4ea8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:12.164653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dbb0dccb-39aa-4c36-9efe-70ec5cd4ea8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:12.172941 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dbb0dccb-39aa-4c36-9efe-70ec5cd4ea8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1462 microversion: 2.1 time: 0.227773 Oct 04 21:10:12.173570 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 633/1246] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:11 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1462 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:12.179217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6378d5fb-353b-4930-832a-2d8a08a9284f tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] Action: 'create', calling method: .version_select at 0x7f579025faf0>, body: {"pool": null} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:12.813472 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-75d1c55f-695d-43d9-ba7c-31b46a19dd46 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/action" status: 202 len: 0 microversion: 2.25 time: 3.207026 Oct 04 21:10:12.814216 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 614/1247] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Oct 4 21:10:09 2022] POST /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/action => generated 0 bytes in 3209 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:10:12.937329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9c723db1-5c61-4ccf-9b45-778436f394ef tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:12.942621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9c723db1-5c61-4ccf-9b45-778436f394ef tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Searching by: {'deleted': False, 'project_id': '962da150e861400196ba5c9b6bd75d8a'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:10:12.948624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c723db1-5c61-4ccf-9b45-778436f394ef tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:12.950367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c723db1-5c61-4ccf-9b45-778436f394ef tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:12.950367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c723db1-5c61-4ccf-9b45-778436f394ef tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:12.950367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c723db1-5c61-4ccf-9b45-778436f394ef tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:12.950749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c723db1-5c61-4ccf-9b45-778436f394ef tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:12.951177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c723db1-5c61-4ccf-9b45-778436f394ef tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:13.044939 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9c723db1-5c61-4ccf-9b45-778436f394ef tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.229641 Oct 04 21:10:13.045564 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 615/1248] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:10:12 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:13.049993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2131e265-fff6-459e-9691-64eefda184b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:13.050490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2131e265-fff6-459e-9691-64eefda184b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:13.055971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2131e265-fff6-459e-9691-64eefda184b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:13.056579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2131e265-fff6-459e-9691-64eefda184b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:13.057024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2131e265-fff6-459e-9691-64eefda184b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:13.057745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2131e265-fff6-459e-9691-64eefda184b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:13.058204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2131e265-fff6-459e-9691-64eefda184b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:13.058632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2131e265-fff6-459e-9691-64eefda184b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:13.087371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2131e265-fff6-459e-9691-64eefda184b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:10:13.569761 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2131e265-fff6-459e-9691-64eefda184b6 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 204 len: 0 microversion: 2.1 time: 0.522900 Oct 04 21:10:13.573471 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 616/1249] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:10:13 2022] DELETE /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:10:13.576150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-28f3632d-3ab6-44a1-92e9-1589c8e3dcfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:13.576846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-28f3632d-3ab6-44a1-92e9-1589c8e3dcfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:13.582779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28f3632d-3ab6-44a1-92e9-1589c8e3dcfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:13.583261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28f3632d-3ab6-44a1-92e9-1589c8e3dcfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:13.583695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28f3632d-3ab6-44a1-92e9-1589c8e3dcfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:13.584381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28f3632d-3ab6-44a1-92e9-1589c8e3dcfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:13.584873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28f3632d-3ab6-44a1-92e9-1589c8e3dcfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:13.585300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28f3632d-3ab6-44a1-92e9-1589c8e3dcfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:13.793124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-28f3632d-3ab6-44a1-92e9-1589c8e3dcfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:13.801552 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-28f3632d-3ab6-44a1-92e9-1589c8e3dcfa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1462 microversion: 2.1 time: 0.229870 Oct 04 21:10:13.802134 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 617/1250] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:13 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1462 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:13.806646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5c8041e5-fc9f-4ed8-b261-d7338a2c9e84 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:13.807337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5c8041e5-fc9f-4ed8-b261-d7338a2c9e84 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:13.814289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c8041e5-fc9f-4ed8-b261-d7338a2c9e84 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:13.818410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c8041e5-fc9f-4ed8-b261-d7338a2c9e84 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:13.818410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c8041e5-fc9f-4ed8-b261-d7338a2c9e84 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:13.818410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c8041e5-fc9f-4ed8-b261-d7338a2c9e84 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:13.818410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c8041e5-fc9f-4ed8-b261-d7338a2c9e84 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:13.818410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c8041e5-fc9f-4ed8-b261-d7338a2c9e84 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:13.885707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5c8041e5-fc9f-4ed8-b261-d7338a2c9e84 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:13.894082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5c8041e5-fc9f-4ed8-b261-d7338a2c9e84 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:13.895564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5c8041e5-fc9f-4ed8-b261-d7338a2c9e84 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:13.900632 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5c8041e5-fc9f-4ed8-b261-d7338a2c9e84 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.097474 Oct 04 21:10:13.901213 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 618/1251] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:13 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:13.906533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-76d053b0-ec12-4a28-bbe9-dd5d2278167f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:13.907074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-76d053b0-ec12-4a28-bbe9-dd5d2278167f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:13.913313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76d053b0-ec12-4a28-bbe9-dd5d2278167f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:13.913839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76d053b0-ec12-4a28-bbe9-dd5d2278167f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:13.914281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76d053b0-ec12-4a28-bbe9-dd5d2278167f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:13.914983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76d053b0-ec12-4a28-bbe9-dd5d2278167f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:13.915474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76d053b0-ec12-4a28-bbe9-dd5d2278167f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:13.915905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76d053b0-ec12-4a28-bbe9-dd5d2278167f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:13.918735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:14.130326 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6378d5fb-353b-4930-832a-2d8a08a9284f tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.949514 Oct 04 21:10:14.130326 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 634/1252] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Oct 4 21:10:12 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:14.130326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-51888acc-76ec-4695-a0a5-e61337cc8e36 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:14.130326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-51888acc-76ec-4695-a0a5-e61337cc8e36 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:14.132424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-76d053b0-ec12-4a28-bbe9-dd5d2278167f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:14.136855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51888acc-76ec-4695-a0a5-e61337cc8e36 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:14.137343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51888acc-76ec-4695-a0a5-e61337cc8e36 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:14.137820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51888acc-76ec-4695-a0a5-e61337cc8e36 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:14.138566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51888acc-76ec-4695-a0a5-e61337cc8e36 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:14.139628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51888acc-76ec-4695-a0a5-e61337cc8e36 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:14.140063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51888acc-76ec-4695-a0a5-e61337cc8e36 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:14.141266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-76d053b0-ec12-4a28-bbe9-dd5d2278167f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:14.142783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-76d053b0-ec12-4a28-bbe9-dd5d2278167f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:14.145361 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-76d053b0-ec12-4a28-bbe9-dd5d2278167f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.241805 Oct 04 21:10:14.145361 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 619/1253] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:13 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:14.149069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b627085e-449f-4b69-8234-59ae442ea5d9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:14.155921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b627085e-449f-4b69-8234-59ae442ea5d9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Searching by: {'deleted': False} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:10:14.161318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b627085e-449f-4b69-8234-59ae442ea5d9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:14.161795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b627085e-449f-4b69-8234-59ae442ea5d9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:14.162224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b627085e-449f-4b69-8234-59ae442ea5d9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:14.162979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b627085e-449f-4b69-8234-59ae442ea5d9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:14.163439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b627085e-449f-4b69-8234-59ae442ea5d9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:14.163892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b627085e-449f-4b69-8234-59ae442ea5d9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:14.274027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-51888acc-76ec-4695-a0a5-e61337cc8e36 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:14.283543 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-51888acc-76ec-4695-a0a5-e61337cc8e36 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.157657 Oct 04 21:10:14.284304 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 635/1254] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:14 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:14.289281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4d76e779-dcd6-49f0-9585-bed4e5b1cec8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:14.289929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4d76e779-dcd6-49f0-9585-bed4e5b1cec8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:14.291974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.multi_cell_list [None req-b627085e-449f-4b69-8234-59ae442ea5d9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Listed batch of 19 results from cell out of 1000 limit. Returned 19 total so far. {{(pid=122758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:10:14.297158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d76e779-dcd6-49f0-9585-bed4e5b1cec8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:14.297158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d76e779-dcd6-49f0-9585-bed4e5b1cec8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:14.297158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d76e779-dcd6-49f0-9585-bed4e5b1cec8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:14.297980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d76e779-dcd6-49f0-9585-bed4e5b1cec8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:14.298627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d76e779-dcd6-49f0-9585-bed4e5b1cec8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:14.299400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d76e779-dcd6-49f0-9585-bed4e5b1cec8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:14.380485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b627085e-449f-4b69-8234-59ae442ea5d9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:14.380980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b627085e-449f-4b69-8234-59ae442ea5d9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:14.381434 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b627085e-449f-4b69-8234-59ae442ea5d9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:14.437323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4d76e779-dcd6-49f0-9585-bed4e5b1cec8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:14.445609 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4d76e779-dcd6-49f0-9585-bed4e5b1cec8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 200 len: 1471 microversion: 2.1 time: 0.160035 Oct 04 21:10:14.446237 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 636/1255] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:14 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:14.450935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-69a0986e-d508-4d93-80da-ebdc2c519151 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Action: 'create', calling method: .version_select at 0x7f579025fdc0>, body: {"keypair": {"name": "tempest-keypair-872053037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPg6PIDNw1kKKjz/KI6ZplV1p2Y8J4n4ZVyM1G0WMDP7AdGfUD93lL0ynWnpQA0LBO6ZuQxFsi88o8jJ3UukgWw6QEKNTs5m5728fhlPoob8JNFboA3l2oxA+/KKsMxRRQ=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:14.468988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-69a0986e-d508-4d93-80da-ebdc2c519151 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Getting quotas for project e11e3d4d14b240a3b934701459ada871. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:10:14.473205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-69a0986e-d508-4d93-80da-ebdc2c519151 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Getting quotas for user 150625a9472d43e0b0509ef044c58d34 and project e11e3d4d14b240a3b934701459ada871. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:10:14.556539 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-69a0986e-d508-4d93-80da-ebdc2c519151 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.109224 Oct 04 21:10:14.557275 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 637/1256] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:10:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:14.568991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c2764684-41e6-4e61-ac45-ee94db6c08f0 tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] Calling method '.version_select at 0x7f579020b280>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:14.770171 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c2764684-41e6-4e61-ac45-ee94db6c08f0 tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/23a8f5e7-82ba-4fe8-a074-7aad2aefd532" status: 200 len: 141 microversion: 2.1 time: 0.209198 Oct 04 21:10:14.770171 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 638/1257] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Oct 4 21:10:14 2022] GET /compute/v2.1/os-floating-ips/23a8f5e7-82ba-4fe8-a074-7aad2aefd532 => generated 141 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:14.781170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-45504f16-d462-400c-8f75-e9e8c172be10 tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] Calling method '.version_select at 0x7f579020bdc0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:15.066961 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b627085e-449f-4b69-8234-59ae442ea5d9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 31175 microversion: 2.1 time: 0.920483 Oct 04 21:10:15.067834 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 620/1258] 10.222.0.30 () {58 vars in 1171 bytes} [Tue Oct 4 21:10:14 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 31175 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:10:15.072908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6c160b29-cc02-4f18-a20c-56ea35aaefd3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:15.073747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6c160b29-cc02-4f18-a20c-56ea35aaefd3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:15.080832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6c160b29-cc02-4f18-a20c-56ea35aaefd3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:15.081573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6c160b29-cc02-4f18-a20c-56ea35aaefd3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:15.082027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6c160b29-cc02-4f18-a20c-56ea35aaefd3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:15.082740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6c160b29-cc02-4f18-a20c-56ea35aaefd3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:15.083376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6c160b29-cc02-4f18-a20c-56ea35aaefd3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:15.083815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6c160b29-cc02-4f18-a20c-56ea35aaefd3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:15.169306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6c160b29-cc02-4f18-a20c-56ea35aaefd3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:15.177028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6c160b29-cc02-4f18-a20c-56ea35aaefd3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:15.178537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6c160b29-cc02-4f18-a20c-56ea35aaefd3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:15.183501 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6c160b29-cc02-4f18-a20c-56ea35aaefd3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.114475 Oct 04 21:10:15.184076 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 621/1259] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:15 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:15.188859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f885f862-16d5-4f8c-8984-081cfd6e4875 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:15.194873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f885f862-16d5-4f8c-8984-081cfd6e4875 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Searching by: {'deleted': False, 'project_id': '962da150e861400196ba5c9b6bd75d8a'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:10:15.200069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f885f862-16d5-4f8c-8984-081cfd6e4875 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:15.200555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f885f862-16d5-4f8c-8984-081cfd6e4875 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:15.201890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f885f862-16d5-4f8c-8984-081cfd6e4875 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:15.202314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f885f862-16d5-4f8c-8984-081cfd6e4875 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:15.202714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f885f862-16d5-4f8c-8984-081cfd6e4875 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:15.203142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f885f862-16d5-4f8c-8984-081cfd6e4875 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:15.232461 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f885f862-16d5-4f8c-8984-081cfd6e4875 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?tenant_id=aa2f4ca02ad74730963245d9e018a386" status: 200 len: 15 microversion: 2.1 time: 0.047302 Oct 04 21:10:15.233724 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 622/1260] 10.222.0.30 () {58 vars in 1231 bytes} [Tue Oct 4 21:10:15 2022] GET /compute/v2.1/servers/detail?tenant_id=aa2f4ca02ad74730963245d9e018a386 => generated 15 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:15.238665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0a910787-030b-4d1f-8a70-81f9e6172472 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:15.239517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0a910787-030b-4d1f-8a70-81f9e6172472 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:15.258769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a910787-030b-4d1f-8a70-81f9e6172472 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:15.259370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a910787-030b-4d1f-8a70-81f9e6172472 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:15.260019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a910787-030b-4d1f-8a70-81f9e6172472 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:15.261187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a910787-030b-4d1f-8a70-81f9e6172472 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:15.261557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a910787-030b-4d1f-8a70-81f9e6172472 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:15.262074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a910787-030b-4d1f-8a70-81f9e6172472 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:15.486577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0a910787-030b-4d1f-8a70-81f9e6172472 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:15.498828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0a910787-030b-4d1f-8a70-81f9e6172472 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:15.501139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0a910787-030b-4d1f-8a70-81f9e6172472 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:15.502605 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0a910787-030b-4d1f-8a70-81f9e6172472 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.267752 Oct 04 21:10:15.503184 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 623/1261] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:15 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:15.509401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4d2cc1f7-55e4-4ce7-9ad2-ccb04a71d7c5 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:15.517882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4d2cc1f7-55e4-4ce7-9ad2-ccb04a71d7c5 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Searching by: {'tenant_id': 'aa2f4ca02ad74730963245d9e018a386', 'deleted': False} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:10:15.523461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d2cc1f7-55e4-4ce7-9ad2-ccb04a71d7c5 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:15.524328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d2cc1f7-55e4-4ce7-9ad2-ccb04a71d7c5 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:15.524872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d2cc1f7-55e4-4ce7-9ad2-ccb04a71d7c5 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:15.525921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d2cc1f7-55e4-4ce7-9ad2-ccb04a71d7c5 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:15.526716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d2cc1f7-55e4-4ce7-9ad2-ccb04a71d7c5 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:15.533448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d2cc1f7-55e4-4ce7-9ad2-ccb04a71d7c5 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:15.565766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.multi_cell_list [None req-4d2cc1f7-55e4-4ce7-9ad2-ccb04a71d7c5 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:10:15.649093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d2cc1f7-55e4-4ce7-9ad2-ccb04a71d7c5 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:15.649630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d2cc1f7-55e4-4ce7-9ad2-ccb04a71d7c5 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:15.650070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d2cc1f7-55e4-4ce7-9ad2-ccb04a71d7c5 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:15.770952 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4d2cc1f7-55e4-4ce7-9ad2-ccb04a71d7c5 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=aa2f4ca02ad74730963245d9e018a386" status: 200 len: 4825 microversion: 2.1 time: 0.266016 Oct 04 21:10:15.771568 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 624/1262] 10.222.0.30 () {58 vars in 1257 bytes} [Tue Oct 4 21:10:15 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=aa2f4ca02ad74730963245d9e018a386 => generated 4825 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:15.776400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-22c0d967-a633-4de3-bfcd-ab5e5fb92bc8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:15.777018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-22c0d967-a633-4de3-bfcd-ab5e5fb92bc8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:15.783529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22c0d967-a633-4de3-bfcd-ab5e5fb92bc8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:15.784013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22c0d967-a633-4de3-bfcd-ab5e5fb92bc8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:15.784814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22c0d967-a633-4de3-bfcd-ab5e5fb92bc8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:15.785405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22c0d967-a633-4de3-bfcd-ab5e5fb92bc8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:15.785970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22c0d967-a633-4de3-bfcd-ab5e5fb92bc8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:15.786403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22c0d967-a633-4de3-bfcd-ab5e5fb92bc8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:15.949497 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-45504f16-d462-400c-8f75-e9e8c172be10 tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/23a8f5e7-82ba-4fe8-a074-7aad2aefd532" status: 202 len: 0 microversion: 2.1 time: 1.171905 Oct 04 21:10:15.950084 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 639/1263] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Oct 4 21:10:14 2022] DELETE /compute/v2.1/os-floating-ips/23a8f5e7-82ba-4fe8-a074-7aad2aefd532 => generated 0 bytes in 1173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:10:15.955911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dde71e97-920c-41fa-aa20-c2a28d196da2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:15.955911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dde71e97-920c-41fa-aa20-c2a28d196da2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:15.964927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dde71e97-920c-41fa-aa20-c2a28d196da2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:15.965560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dde71e97-920c-41fa-aa20-c2a28d196da2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:15.966047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dde71e97-920c-41fa-aa20-c2a28d196da2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:15.967141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dde71e97-920c-41fa-aa20-c2a28d196da2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:15.967719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dde71e97-920c-41fa-aa20-c2a28d196da2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:15.968197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dde71e97-920c-41fa-aa20-c2a28d196da2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:15.996514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-22c0d967-a633-4de3-bfcd-ab5e5fb92bc8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:16.005610 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-22c0d967-a633-4de3-bfcd-ab5e5fb92bc8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.233000 Oct 04 21:10:16.006196 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 625/1264] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:15 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:16.017292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-59a9925e-baa5-4868-b621-94e34a298193 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:16.023260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-59a9925e-baa5-4868-b621-94e34a298193 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Searching by: {'tenant_id': '962da150e861400196ba5c9b6bd75d8a', 'deleted': False} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:10:16.028254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59a9925e-baa5-4868-b621-94e34a298193 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:16.029206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59a9925e-baa5-4868-b621-94e34a298193 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:16.030049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59a9925e-baa5-4868-b621-94e34a298193 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:16.030796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59a9925e-baa5-4868-b621-94e34a298193 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:16.031446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59a9925e-baa5-4868-b621-94e34a298193 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:16.032439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59a9925e-baa5-4868-b621-94e34a298193 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:16.068497 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-59a9925e-baa5-4868-b621-94e34a298193 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=962da150e861400196ba5c9b6bd75d8a" status: 200 len: 15 microversion: 2.1 time: 0.059596 Oct 04 21:10:16.082016 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 626/1265] 10.222.0.30 () {58 vars in 1257 bytes} [Tue Oct 4 21:10:16 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=962da150e861400196ba5c9b6bd75d8a => generated 15 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:16.092811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-057347ee-cd83-447c-b76c-14f335052a9c tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] Calling method '.version_select at 0x7f579007e0d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:16.389673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dde71e97-920c-41fa-aa20-c2a28d196da2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:16.399395 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dde71e97-920c-41fa-aa20-c2a28d196da2 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 200 len: 1471 microversion: 2.1 time: 0.448271 Oct 04 21:10:16.419526 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-057347ee-cd83-447c-b76c-14f335052a9c tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.336238 Oct 04 21:10:16.421442 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 627/1267] 10.222.0.30 () {58 vars in 1164 bytes} [Tue Oct 4 21:10:16 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:16.424406 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 640/1267] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:15 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 1471 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:16.427064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4d7d36cb-3f57-46a5-b2d6-cd71cb6d18b9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:16.429338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-51bb8727-034e-475f-ab29-c08daf982f08 req-e1fe20c1-f041-4768-b3c8-8435248a4e37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be194fa-5a4b-435d-9f06-ac053d4c403e", "name": "network-vif-deleted", "tag": "e54fa548-306d-41bb-aa9a-bc50b6a52b0f"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:16.434178 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4d7d36cb-3f57-46a5-b2d6-cd71cb6d18b9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.011252 Oct 04 21:10:16.443105 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 628/1268] 10.222.0.30 () {58 vars in 1189 bytes} [Tue Oct 4 21:10:16 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:16.455761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-51bb8727-034e-475f-ab29-c08daf982f08 req-e1fe20c1-f041-4768-b3c8-8435248a4e37 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:16.456028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fd510865-c9e1-492c-92ef-e8335fc02095 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:16.456853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fd510865-c9e1-492c-92ef-e8335fc02095 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:16.457557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-51bb8727-034e-475f-ab29-c08daf982f08 req-e1fe20c1-f041-4768-b3c8-8435248a4e37 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:16.459407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-51bb8727-034e-475f-ab29-c08daf982f08 req-e1fe20c1-f041-4768-b3c8-8435248a4e37 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:16.475120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd510865-c9e1-492c-92ef-e8335fc02095 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:16.475915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd510865-c9e1-492c-92ef-e8335fc02095 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:16.476532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd510865-c9e1-492c-92ef-e8335fc02095 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:16.477752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd510865-c9e1-492c-92ef-e8335fc02095 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:16.478397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd510865-c9e1-492c-92ef-e8335fc02095 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:16.478997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd510865-c9e1-492c-92ef-e8335fc02095 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:16.486486 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-51bb8727-034e-475f-ab29-c08daf982f08 req-e1fe20c1-f041-4768-b3c8-8435248a4e37 service nova] Creating event network-vif-deleted:e54fa548-306d-41bb-aa9a-bc50b6a52b0f for instance 4be194fa-5a4b-435d-9f06-ac053d4c403e on n-h1-860282-1 Oct 04 21:10:16.505564 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-51bb8727-034e-475f-ab29-c08daf982f08 req-e1fe20c1-f041-4768-b3c8-8435248a4e37 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069706 Oct 04 21:10:16.512073 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 641/1269] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:16.513671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d21a3ee4-8450-4077-ab4e-a30302753b0f tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] Calling method '.version_select at 0x7f5790a0df70>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:16.665983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fd510865-c9e1-492c-92ef-e8335fc02095 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:16.676196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fd510865-c9e1-492c-92ef-e8335fc02095 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:16.679000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fd510865-c9e1-492c-92ef-e8335fc02095 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:16.685027 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fd510865-c9e1-492c-92ef-e8335fc02095 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.239098 Oct 04 21:10:16.686468 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 629/1270] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:16 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:16.691659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-147e644d-2cc9-4bd7-95b3-d27ff48bada7 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:16.694893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-147e644d-2cc9-4bd7-95b3-d27ff48bada7 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:16.701642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-147e644d-2cc9-4bd7-95b3-d27ff48bada7 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:16.702433 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-147e644d-2cc9-4bd7-95b3-d27ff48bada7 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:16.703180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-147e644d-2cc9-4bd7-95b3-d27ff48bada7 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:16.704321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-147e644d-2cc9-4bd7-95b3-d27ff48bada7 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:16.705209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-147e644d-2cc9-4bd7-95b3-d27ff48bada7 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:16.705835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-147e644d-2cc9-4bd7-95b3-d27ff48bada7 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:16.992447 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-147e644d-2cc9-4bd7-95b3-d27ff48bada7 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e/action" status: 202 len: 0 microversion: 2.1 time: 0.304389 Oct 04 21:10:16.993122 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 630/1271] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:10:16 2022] POST /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:10:16.999431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b0063335-1164-4363-9b76-a99f0cea1396 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:17.000049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b0063335-1164-4363-9b76-a99f0cea1396 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:17.008429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0063335-1164-4363-9b76-a99f0cea1396 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:17.008930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0063335-1164-4363-9b76-a99f0cea1396 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:17.009396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0063335-1164-4363-9b76-a99f0cea1396 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:17.010193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0063335-1164-4363-9b76-a99f0cea1396 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:17.010801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0063335-1164-4363-9b76-a99f0cea1396 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:17.011235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0063335-1164-4363-9b76-a99f0cea1396 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:17.225294 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d21a3ee4-8450-4077-ab4e-a30302753b0f tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.717268 Oct 04 21:10:17.226384 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 642/1272] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Oct 4 21:10:16 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:17.231172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9c837c12-955b-41c8-8131-0309ed1a0542 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:17.239261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9c837c12-955b-41c8-8131-0309ed1a0542 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:17.240085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9c837c12-955b-41c8-8131-0309ed1a0542 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'aa2f4ca02ad74730963245d9e018a386'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:10:17.248149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c837c12-955b-41c8-8131-0309ed1a0542 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:17.250320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c837c12-955b-41c8-8131-0309ed1a0542 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:17.250761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c837c12-955b-41c8-8131-0309ed1a0542 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:17.251500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c837c12-955b-41c8-8131-0309ed1a0542 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:17.251959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c837c12-955b-41c8-8131-0309ed1a0542 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:17.252385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c837c12-955b-41c8-8131-0309ed1a0542 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:17.313460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b0063335-1164-4363-9b76-a99f0cea1396 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:17.323314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b0063335-1164-4363-9b76-a99f0cea1396 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:17.324885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b0063335-1164-4363-9b76-a99f0cea1396 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:17.326176 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b0063335-1164-4363-9b76-a99f0cea1396 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.331620 Oct 04 21:10:17.326818 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 631/1273] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:16 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:17.331355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-43260f5f-f6d2-4e40-a1b8-84517eeb4359 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:17.332028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-43260f5f-f6d2-4e40-a1b8-84517eeb4359 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:17.338210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43260f5f-f6d2-4e40-a1b8-84517eeb4359 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:17.343492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43260f5f-f6d2-4e40-a1b8-84517eeb4359 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:17.343492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43260f5f-f6d2-4e40-a1b8-84517eeb4359 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:17.343492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43260f5f-f6d2-4e40-a1b8-84517eeb4359 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:17.343492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43260f5f-f6d2-4e40-a1b8-84517eeb4359 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:17.343492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43260f5f-f6d2-4e40-a1b8-84517eeb4359 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:17.344082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-9c837c12-955b-41c8-8131-0309ed1a0542 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:10:17.405444 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9c837c12-955b-41c8-8131-0309ed1a0542 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.177611 Oct 04 21:10:17.406046 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 643/1274] 10.222.0.30 () {58 vars in 1150 bytes} [Tue Oct 4 21:10:17 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:17.410554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-99f437be-b925-453f-bca1-11fe9a3253e4 tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] Calling method '.version_select at 0x7f579020b790>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:17.677269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-43260f5f-f6d2-4e40-a1b8-84517eeb4359 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:17.686709 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-43260f5f-f6d2-4e40-a1b8-84517eeb4359 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.358672 Oct 04 21:10:17.687529 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 632/1275] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:17 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:17.692066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-67d5eee9-d627-477b-b01c-51c834540b7c tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:17.694458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-67d5eee9-d627-477b-b01c-51c834540b7c tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:17.700497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d5eee9-d627-477b-b01c-51c834540b7c tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:17.701306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d5eee9-d627-477b-b01c-51c834540b7c tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:17.701774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d5eee9-d627-477b-b01c-51c834540b7c tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:17.702525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d5eee9-d627-477b-b01c-51c834540b7c tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:17.702987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d5eee9-d627-477b-b01c-51c834540b7c tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:17.703417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d5eee9-d627-477b-b01c-51c834540b7c tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:17.975501 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-67d5eee9-d627-477b-b01c-51c834540b7c tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e/action" status: 202 len: 0 microversion: 2.1 time: 0.287072 Oct 04 21:10:17.976241 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 633/1276] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:10:17 2022] POST /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:10:17.986467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9a84ec63-e310-4f36-af63-c4f718d614fa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:17.991205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9a84ec63-e310-4f36-af63-c4f718d614fa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 4be194fa-5a4b-435d-9f06-ac053d4c403e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:17.993719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a84ec63-e310-4f36-af63-c4f718d614fa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:17.994208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a84ec63-e310-4f36-af63-c4f718d614fa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:17.994642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a84ec63-e310-4f36-af63-c4f718d614fa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:17.995342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a84ec63-e310-4f36-af63-c4f718d614fa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:17.995850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a84ec63-e310-4f36-af63-c4f718d614fa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:17.996429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a84ec63-e310-4f36-af63-c4f718d614fa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:18.011506 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-9a84ec63-e310-4f36-af63-c4f718d614fa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] HTTP exception thrown: Instance 4be194fa-5a4b-435d-9f06-ac053d4c403e could not be found. Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9a84ec63-e310-4f36-af63-c4f718d614fa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Request method failure captured: Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e HTTP/1.1 Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKCSppkDAXSjwCSQa1f69X7mZVl7uZCSLTAHkzCtM2WTMjjTMUCKpz98J5Gj1CKCaKAVO-07ppp3m5zpHBQBOvXrxv-C9cE1HJ_RUrNofezjxAPsUNqPHzklSFFJuiasvRr2uETo5d4QJvlemPPKWE4rz9k2ow6zF89U2q-GMS4a-Gw Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 801ce5c5897d4894a6a2ffc1b27191aa Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/801ce5c5897d4894a6a2ffc1b27191aa"}]}] Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 801ce5c5897d4894a6a2ffc1b27191aa Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersOnMultiNodesTest-2051543181-project Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 0f0ac29dc4e440e785408fa1dfedce5e Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersOnMultiNodesTest-2051543181-project Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 4be194fa-5a4b-435d-9f06-ac053d4c403e could not be found. Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '4be194fa-5a4b-435d-9f06-ac053d4c403e'} Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be194fa-5a4b-435d-9f06-ac053d4c403e could not be found. Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be194fa-5a4b-435d-9f06-ac053d4c403e could not be found. Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:10:18.020147 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:18.025569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:18.025569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:10:18.025569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:10:18.025569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:10:18.025569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:10:18.025569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be194fa-5a4b-435d-9f06-ac053d4c403e could not be found. Oct 04 21:10:18.025569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:18.025569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9a84ec63-e310-4f36-af63-c4f718d614fa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Returning 404 to user: Instance 4be194fa-5a4b-435d-9f06-ac053d4c403e could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:10:18.025569 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9a84ec63-e310-4f36-af63-c4f718d614fa tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e" status: 404 len: 111 microversion: 2.1 time: 0.034248 Oct 04 21:10:18.025569 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 634/1277] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:17 2022] GET /compute/v2.1/servers/4be194fa-5a4b-435d-9f06-ac053d4c403e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:10:18.025569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ceec6c8f-d259-44c8-9adb-f3a4304e2d91 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:18.025569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ceec6c8f-d259-44c8-9adb-f3a4304e2d91 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:18.032046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ceec6c8f-d259-44c8-9adb-f3a4304e2d91 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:18.032545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ceec6c8f-d259-44c8-9adb-f3a4304e2d91 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:18.033041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ceec6c8f-d259-44c8-9adb-f3a4304e2d91 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:18.033954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ceec6c8f-d259-44c8-9adb-f3a4304e2d91 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:18.034350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ceec6c8f-d259-44c8-9adb-f3a4304e2d91 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:18.034792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ceec6c8f-d259-44c8-9adb-f3a4304e2d91 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:18.051571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:18.157176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ceec6c8f-d259-44c8-9adb-f3a4304e2d91 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:18.166350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ceec6c8f-d259-44c8-9adb-f3a4304e2d91 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:18.167258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ceec6c8f-d259-44c8-9adb-f3a4304e2d91 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:18.172984 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ceec6c8f-d259-44c8-9adb-f3a4304e2d91 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.156432 Oct 04 21:10:18.173598 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 635/1278] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:18 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:18.177946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a04ba5b1-30d3-4125-a523-3c65de6bb3fa tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:18.178561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a04ba5b1-30d3-4125-a523-3c65de6bb3fa tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:18.184205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a04ba5b1-30d3-4125-a523-3c65de6bb3fa tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:18.185613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a04ba5b1-30d3-4125-a523-3c65de6bb3fa tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:18.186201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a04ba5b1-30d3-4125-a523-3c65de6bb3fa tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:18.187106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a04ba5b1-30d3-4125-a523-3c65de6bb3fa tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:18.187611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a04ba5b1-30d3-4125-a523-3c65de6bb3fa tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:18.188014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a04ba5b1-30d3-4125-a523-3c65de6bb3fa tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:18.425731 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a04ba5b1-30d3-4125-a523-3c65de6bb3fa tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1614 microversion: 2.1 time: 0.251038 Oct 04 21:10:18.426298 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 636/1279] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:18 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1614 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:18.430852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-92a227b8-f6e7-43ab-8ec6-12cd08cf84f4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:18.431682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-92a227b8-f6e7-43ab-8ec6-12cd08cf84f4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 28198b9c-ff65-40f0-869f-117104e764ef] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:18.438766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92a227b8-f6e7-43ab-8ec6-12cd08cf84f4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:18.439441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92a227b8-f6e7-43ab-8ec6-12cd08cf84f4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:18.441891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92a227b8-f6e7-43ab-8ec6-12cd08cf84f4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:18.442782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92a227b8-f6e7-43ab-8ec6-12cd08cf84f4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:18.443427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92a227b8-f6e7-43ab-8ec6-12cd08cf84f4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:18.444195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92a227b8-f6e7-43ab-8ec6-12cd08cf84f4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:18.474216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-92a227b8-f6e7-43ab-8ec6-12cd08cf84f4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 28198b9c-ff65-40f0-869f-117104e764ef] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:10:18.700496 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-99f437be-b925-453f-bca1-11fe9a3253e4 tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/fae2e62b-15d5-474c-87ea-fb9e112582d0" status: 202 len: 0 microversion: 2.1 time: 1.293332 Oct 04 21:10:18.701081 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 644/1280] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Oct 4 21:10:17 2022] DELETE /compute/v2.1/os-floating-ips/fae2e62b-15d5-474c-87ea-fb9e112582d0 => generated 0 bytes in 1294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:10:18.706984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2211d666-2524-4f64-817a-96fbe20773d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:18.707839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2211d666-2524-4f64-817a-96fbe20773d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:18.714220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2211d666-2524-4f64-817a-96fbe20773d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:18.715710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2211d666-2524-4f64-817a-96fbe20773d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:18.715710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2211d666-2524-4f64-817a-96fbe20773d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:18.716049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2211d666-2524-4f64-817a-96fbe20773d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:18.716539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2211d666-2524-4f64-817a-96fbe20773d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:18.717026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2211d666-2524-4f64-817a-96fbe20773d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:18.850853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2211d666-2524-4f64-817a-96fbe20773d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:18.859952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2211d666-2524-4f64-817a-96fbe20773d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:18.861457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2211d666-2524-4f64-817a-96fbe20773d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:18.862601 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2211d666-2524-4f64-817a-96fbe20773d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.159424 Oct 04 21:10:18.863156 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 645/1281] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:18 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:18.867346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0a641aad-1ff6-4530-860d-5766549bf3d4 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:18.876500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0a641aad-1ff6-4530-860d-5766549bf3d4 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:18.876500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a641aad-1ff6-4530-860d-5766549bf3d4 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:18.876500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a641aad-1ff6-4530-860d-5766549bf3d4 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:18.876500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a641aad-1ff6-4530-860d-5766549bf3d4 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:18.876500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a641aad-1ff6-4530-860d-5766549bf3d4 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:18.876500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a641aad-1ff6-4530-860d-5766549bf3d4 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:18.876500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a641aad-1ff6-4530-860d-5766549bf3d4 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:18.903852 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-92a227b8-f6e7-43ab-8ec6-12cd08cf84f4 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "DELETE /compute/v2.1/servers/28198b9c-ff65-40f0-869f-117104e764ef" status: 204 len: 0 microversion: 2.1 time: 0.476296 Oct 04 21:10:18.904516 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 637/1282] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:10:18 2022] DELETE /compute/v2.1/servers/28198b9c-ff65-40f0-869f-117104e764ef => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:10:18.910123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1798b4a9-f38c-4bcb-9751-f404afcbafb8 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Calling method '.version_select at 0x7f5790103160>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:18.914946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1798b4a9-f38c-4bcb-9751-f404afcbafb8 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:18.915446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1798b4a9-f38c-4bcb-9751-f404afcbafb8 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:18.916609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1798b4a9-f38c-4bcb-9751-f404afcbafb8 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:18.929409 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1798b4a9-f38c-4bcb-9751-f404afcbafb8 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 3103 microversion: 2.1 time: 0.023723 Oct 04 21:10:18.930032 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 638/1283] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Oct 4 21:10:18 2022] GET /compute/v2.1/os-migrations => generated 3103 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:18.934431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6cdee4a5-5d1f-4808-a3ed-a06fefbad341 tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] Calling method '.version_select at 0x7f5790d30af0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:19.099632 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0a641aad-1ff6-4530-860d-5766549bf3d4 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1614 microversion: 2.1 time: 0.235362 Oct 04 21:10:19.100134 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 646/1284] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:18 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1614 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:19.104570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-77eabb18-4515-4f1f-89e2-0f620a504018 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:19.105175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-77eabb18-4515-4f1f-89e2-0f620a504018 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:19.113727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77eabb18-4515-4f1f-89e2-0f620a504018 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:19.114210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77eabb18-4515-4f1f-89e2-0f620a504018 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:19.114649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77eabb18-4515-4f1f-89e2-0f620a504018 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:19.117278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77eabb18-4515-4f1f-89e2-0f620a504018 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:19.117772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77eabb18-4515-4f1f-89e2-0f620a504018 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:19.118206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77eabb18-4515-4f1f-89e2-0f620a504018 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:19.376696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-77eabb18-4515-4f1f-89e2-0f620a504018 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:19.385089 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-77eabb18-4515-4f1f-89e2-0f620a504018 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.283939 Oct 04 21:10:19.385827 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 647/1285] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:19 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:19.390322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-796941c9-c2e7-4053-ad24-9b6adb5b5ce8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:19.390899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-796941c9-c2e7-4053-ad24-9b6adb5b5ce8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:19.407397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-796941c9-c2e7-4053-ad24-9b6adb5b5ce8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:19.407951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-796941c9-c2e7-4053-ad24-9b6adb5b5ce8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:19.408404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-796941c9-c2e7-4053-ad24-9b6adb5b5ce8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:19.409356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-796941c9-c2e7-4053-ad24-9b6adb5b5ce8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:19.409865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-796941c9-c2e7-4053-ad24-9b6adb5b5ce8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:19.416820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-796941c9-c2e7-4053-ad24-9b6adb5b5ce8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:19.436939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-796941c9-c2e7-4053-ad24-9b6adb5b5ce8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:10:19.746386 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-796941c9-c2e7-4053-ad24-9b6adb5b5ce8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "DELETE /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 204 len: 0 microversion: 2.1 time: 0.359212 Oct 04 21:10:19.747029 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 648/1286] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:10:19 2022] DELETE /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:10:19.752214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8c93474e-7231-4c58-851c-f98ead08b974 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:19.758885 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8c93474e-7231-4c58-851c-f98ead08b974 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.010730 Oct 04 21:10:19.759447 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 649/1287] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:10:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:19.764428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d1ee9684-13d7-4690-8b33-2e18d3e7786a tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:19.773701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d1ee9684-13d7-4690-8b33-2e18d3e7786a tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Searching by: {'host': 'n-h1-860282-1', 'deleted': False} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:10:19.784374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1ee9684-13d7-4690-8b33-2e18d3e7786a tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:19.784862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1ee9684-13d7-4690-8b33-2e18d3e7786a tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:19.785300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1ee9684-13d7-4690-8b33-2e18d3e7786a tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:19.786101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1ee9684-13d7-4690-8b33-2e18d3e7786a tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:19.786602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1ee9684-13d7-4690-8b33-2e18d3e7786a tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:19.787032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1ee9684-13d7-4690-8b33-2e18d3e7786a tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:19.884939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-d1ee9684-13d7-4690-8b33-2e18d3e7786a tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:10:19.917071 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6cdee4a5-5d1f-4808-a3ed-a06fefbad341 tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/063741b9-b55b-42de-8abd-ef23bc779f5c" status: 202 len: 0 microversion: 2.1 time: 0.985965 Oct 04 21:10:19.917756 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 639/1288] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Oct 4 21:10:18 2022] DELETE /compute/v2.1/os-floating-ips/063741b9-b55b-42de-8abd-ef23bc779f5c => generated 0 bytes in 987 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:10:19.922754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e60a7209-1fe4-4e8b-bd4a-53e4f8e5ab64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:19.923645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e60a7209-1fe4-4e8b-bd4a-53e4f8e5ab64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:19.930566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e60a7209-1fe4-4e8b-bd4a-53e4f8e5ab64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:19.931058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e60a7209-1fe4-4e8b-bd4a-53e4f8e5ab64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:19.931506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e60a7209-1fe4-4e8b-bd4a-53e4f8e5ab64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:19.932209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e60a7209-1fe4-4e8b-bd4a-53e4f8e5ab64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:19.932668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e60a7209-1fe4-4e8b-bd4a-53e4f8e5ab64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:19.933095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e60a7209-1fe4-4e8b-bd4a-53e4f8e5ab64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:19.945913 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d1ee9684-13d7-4690-8b33-2e18d3e7786a tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] 10.222.0.30 "GET /compute/v2.1/servers?host=n-h1-860282-1&all_tenants=1" status: 200 len: 2650 microversion: 2.1 time: 0.185397 Oct 04 21:10:19.946558 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 650/1289] 10.222.0.30 () {58 vars in 1190 bytes} [Tue Oct 4 21:10:19 2022] GET /compute/v2.1/servers?host=n-h1-860282-1&all_tenants=1 => generated 2650 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:19.951005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ae72a25c-c114-4692-b5e1-b6cf04ff931c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:19.954353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ae72a25c-c114-4692-b5e1-b6cf04ff931c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 28198b9c-ff65-40f0-869f-117104e764ef] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:19.963114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae72a25c-c114-4692-b5e1-b6cf04ff931c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:19.963600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae72a25c-c114-4692-b5e1-b6cf04ff931c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:19.971966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae72a25c-c114-4692-b5e1-b6cf04ff931c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:19.971966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae72a25c-c114-4692-b5e1-b6cf04ff931c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:19.971966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae72a25c-c114-4692-b5e1-b6cf04ff931c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:19.971966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae72a25c-c114-4692-b5e1-b6cf04ff931c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:20.011032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e60a7209-1fe4-4e8b-bd4a-53e4f8e5ab64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:20.020385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e60a7209-1fe4-4e8b-bd4a-53e4f8e5ab64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:20.021897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e60a7209-1fe4-4e8b-bd4a-53e4f8e5ab64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:20.027064 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e60a7209-1fe4-4e8b-bd4a-53e4f8e5ab64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.108312 Oct 04 21:10:20.027626 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 640/1290] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:19 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:20.031992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-85000eac-d136-4bdb-b1d2-5496dec6328c tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1144870918", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:20.108320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ae72a25c-c114-4692-b5e1-b6cf04ff931c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:20.109989 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-85000eac-d136-4bdb-b1d2-5496dec6328c tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.081272 Oct 04 21:10:20.111701 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 641/1291] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Oct 4 21:10:20 2022] POST /compute/v2.1/flavors => generated 499 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:20.115706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-058d16e6-3a4c-43fd-9350-9a5e11f5c544 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:20.116321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-058d16e6-3a4c-43fd-9350-9a5e11f5c544 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:20.118241 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ae72a25c-c114-4692-b5e1-b6cf04ff931c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/28198b9c-ff65-40f0-869f-117104e764ef" status: 200 len: 1474 microversion: 2.1 time: 0.170263 Oct 04 21:10:20.128317 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 651/1292] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:19 2022] GET /compute/v2.1/servers/28198b9c-ff65-40f0-869f-117104e764ef => generated 1474 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:20.128537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-058d16e6-3a4c-43fd-9350-9a5e11f5c544 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:20.128537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-058d16e6-3a4c-43fd-9350-9a5e11f5c544 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:20.128537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-058d16e6-3a4c-43fd-9350-9a5e11f5c544 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:20.128537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-058d16e6-3a4c-43fd-9350-9a5e11f5c544 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:20.128910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eeb498a0-fcb8-4a57-95d5-1b30be2ddaa6 tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] Calling method '.version_select at 0x7f57901e2dc0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:20.129019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-058d16e6-3a4c-43fd-9350-9a5e11f5c544 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:20.129019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-058d16e6-3a4c-43fd-9350-9a5e11f5c544 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:20.359029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-058d16e6-3a4c-43fd-9350-9a5e11f5c544 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:20.367999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-058d16e6-3a4c-43fd-9350-9a5e11f5c544 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:20.369486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-058d16e6-3a4c-43fd-9350-9a5e11f5c544 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:20.370675 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-058d16e6-3a4c-43fd-9350-9a5e11f5c544 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.258640 Oct 04 21:10:20.371434 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 642/1293] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:20 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:20.376350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-953e883a-9bab-4fba-9ec7-4bc7067908cc tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:20.382333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-953e883a-9bab-4fba-9ec7-4bc7067908cc tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:10:20.387209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-953e883a-9bab-4fba-9ec7-4bc7067908cc tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:20.387782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-953e883a-9bab-4fba-9ec7-4bc7067908cc tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:20.388132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-953e883a-9bab-4fba-9ec7-4bc7067908cc tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:20.392588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-953e883a-9bab-4fba-9ec7-4bc7067908cc tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:20.392588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-953e883a-9bab-4fba-9ec7-4bc7067908cc tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:20.392588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-953e883a-9bab-4fba-9ec7-4bc7067908cc tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:20.470461 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-953e883a-9bab-4fba-9ec7-4bc7067908cc tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] 10.222.0.30 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.098021 Oct 04 21:10:20.470919 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 643/1294] 10.222.0.30 () {58 vars in 1196 bytes} [Tue Oct 4 21:10:20 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:20.475228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-351feaa7-8b9c-445a-8522-24fc1e26ce00 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:20.478698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:20.484539 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-351feaa7-8b9c-445a-8522-24fc1e26ce00 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012619 Oct 04 21:10:20.485325 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 644/1295] 10.222.0.30 () {58 vars in 1182 bytes} [Tue Oct 4 21:10:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:20.489579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-74cc5223-5160-4598-be7c-7de6c601a0e2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:20.490195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-74cc5223-5160-4598-be7c-7de6c601a0e2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:20.499557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74cc5223-5160-4598-be7c-7de6c601a0e2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:20.499557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74cc5223-5160-4598-be7c-7de6c601a0e2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:20.499557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74cc5223-5160-4598-be7c-7de6c601a0e2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:20.499557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74cc5223-5160-4598-be7c-7de6c601a0e2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:20.499557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74cc5223-5160-4598-be7c-7de6c601a0e2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:20.499557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74cc5223-5160-4598-be7c-7de6c601a0e2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:20.741561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-74cc5223-5160-4598-be7c-7de6c601a0e2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:20.750628 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-74cc5223-5160-4598-be7c-7de6c601a0e2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.264505 Oct 04 21:10:20.751526 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 645/1296] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:20 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:20.755785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-783b6357-3f97-4964-8789-68ddfdfa8ad1 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:20.758000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-783b6357-3f97-4964-8789-68ddfdfa8ad1 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:20.765022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-783b6357-3f97-4964-8789-68ddfdfa8ad1 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:20.765654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-783b6357-3f97-4964-8789-68ddfdfa8ad1 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:20.766098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-783b6357-3f97-4964-8789-68ddfdfa8ad1 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:20.766810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-783b6357-3f97-4964-8789-68ddfdfa8ad1 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:20.767815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-783b6357-3f97-4964-8789-68ddfdfa8ad1 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:20.768242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-783b6357-3f97-4964-8789-68ddfdfa8ad1 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:21.117691 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-783b6357-3f97-4964-8789-68ddfdfa8ad1 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e/action" status: 202 len: 0 microversion: 2.1 time: 0.365204 Oct 04 21:10:21.118493 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 646/1297] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:10:20 2022] POST /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:10:21.123918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bf1cf440-c219-4f96-a2c0-fe7b251f66b5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-53859280", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "2cd11cb4-6333-43ab-a095-d4301a490bf8"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:21.134106 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eeb498a0-fcb8-4a57-95d5-1b30be2ddaa6 tempest-FloatingIPDetailsTestJSON-1911321184 tempest-FloatingIPDetailsTestJSON-1911321184-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/e74d9c9d-cb75-4731-a417-ed628725217f" status: 202 len: 0 microversion: 2.1 time: 1.013701 Oct 04 21:10:21.134791 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 652/1298] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Oct 4 21:10:20 2022] DELETE /compute/v2.1/os-floating-ips/e74d9c9d-cb75-4731-a417-ed628725217f => generated 0 bytes in 1015 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:10:21.141490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8d4f1ee0-b695-4610-ad2f-0a56efef2aef tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:21.142205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8d4f1ee0-b695-4610-ad2f-0a56efef2aef tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:21.150173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d4f1ee0-b695-4610-ad2f-0a56efef2aef tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:21.150662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d4f1ee0-b695-4610-ad2f-0a56efef2aef tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:21.151097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d4f1ee0-b695-4610-ad2f-0a56efef2aef tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:21.151994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d4f1ee0-b695-4610-ad2f-0a56efef2aef tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:21.152446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d4f1ee0-b695-4610-ad2f-0a56efef2aef tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:21.152872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d4f1ee0-b695-4610-ad2f-0a56efef2aef tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:21.183342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-bf1cf440-c219-4f96-a2c0-fe7b251f66b5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:10:21.255586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8d4f1ee0-b695-4610-ad2f-0a56efef2aef tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:21.264516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8d4f1ee0-b695-4610-ad2f-0a56efef2aef tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:21.266012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8d4f1ee0-b695-4610-ad2f-0a56efef2aef tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:21.271089 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8d4f1ee0-b695-4610-ad2f-0a56efef2aef tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.135331 Oct 04 21:10:21.271760 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 653/1299] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:21 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:21.276568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:21.279534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:21.288328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:21.288328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:21.288328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:21.288328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:21.288328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:21.288328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:21.292078 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:21.382146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:10:21.382945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:10:21.383612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:10:21.384204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:10:21.384783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:10:21.464872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-bf1cf440-c219-4f96-a2c0-fe7b251f66b5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:10:21.465406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-bf1cf440-c219-4f96-a2c0-fe7b251f66b5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:10:21.466119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-bf1cf440-c219-4f96-a2c0-fe7b251f66b5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:10:21.467387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-bf1cf440-c219-4f96-a2c0-fe7b251f66b5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:10:21.467811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-bf1cf440-c219-4f96-a2c0-fe7b251f66b5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:10:21.476823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bf1cf440-c219-4f96-a2c0-fe7b251f66b5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:21.477313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bf1cf440-c219-4f96-a2c0-fe7b251f66b5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:21.477780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bf1cf440-c219-4f96-a2c0-fe7b251f66b5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:21.478512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bf1cf440-c219-4f96-a2c0-fe7b251f66b5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:21.478972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bf1cf440-c219-4f96-a2c0-fe7b251f66b5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:21.479402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bf1cf440-c219-4f96-a2c0-fe7b251f66b5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:21.497400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-bf1cf440-c219-4f96-a2c0-fe7b251f66b5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Getting quotas for project e11e3d4d14b240a3b934701459ada871. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:10:21.502878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-bf1cf440-c219-4f96-a2c0-fe7b251f66b5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Getting quotas for user 150625a9472d43e0b0509ef044c58d34 and project e11e3d4d14b240a3b934701459ada871. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:10:21.516414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bf1cf440-c219-4f96-a2c0-fe7b251f66b5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:10:21.518749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bf1cf440-c219-4f96-a2c0-fe7b251f66b5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:10:21.619152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:21.625339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:21.625868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:21.626553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:21.627259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:21.627720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:21.628149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:21.656625 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a64a6a28-624d-4608-8c76-5172a094abae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "POST /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e/action" status: 202 len: 1067 microversion: 2.1 time: 0.383595 Oct 04 21:10:21.657528 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 654/1300] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:10:21 2022] POST /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e/action => generated 1067 bytes in 385 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 21:10:21.662136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-79de171e-3873-45db-b7e6-9d1513f6e7ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:21.662927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-79de171e-3873-45db-b7e6-9d1513f6e7ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 28198b9c-ff65-40f0-869f-117104e764ef] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:21.669662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79de171e-3873-45db-b7e6-9d1513f6e7ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:21.671000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79de171e-3873-45db-b7e6-9d1513f6e7ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:21.671612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79de171e-3873-45db-b7e6-9d1513f6e7ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:21.674427 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bf1cf440-c219-4f96-a2c0-fe7b251f66b5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554786 Oct 04 21:10:21.675075 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 647/1301] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:10:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:10:21.683261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-098d71f6-768b-42dd-bf11-8e7f7c48a15e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:21.683409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79de171e-3873-45db-b7e6-9d1513f6e7ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:21.683923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-098d71f6-768b-42dd-bf11-8e7f7c48a15e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:21.686665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79de171e-3873-45db-b7e6-9d1513f6e7ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:21.690224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79de171e-3873-45db-b7e6-9d1513f6e7ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:21.699478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-098d71f6-768b-42dd-bf11-8e7f7c48a15e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:21.699992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-098d71f6-768b-42dd-bf11-8e7f7c48a15e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:21.700435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-098d71f6-768b-42dd-bf11-8e7f7c48a15e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:21.701444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-098d71f6-768b-42dd-bf11-8e7f7c48a15e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:21.702148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-098d71f6-768b-42dd-bf11-8e7f7c48a15e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:21.702766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-098d71f6-768b-42dd-bf11-8e7f7c48a15e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:21.950134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-098d71f6-768b-42dd-bf11-8e7f7c48a15e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:21.959478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-098d71f6-768b-42dd-bf11-8e7f7c48a15e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:21.960914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-098d71f6-768b-42dd-bf11-8e7f7c48a15e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:21.962487 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-098d71f6-768b-42dd-bf11-8e7f7c48a15e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.285551 Oct 04 21:10:21.963052 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 648/1302] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:21 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:21.969048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-79de171e-3873-45db-b7e6-9d1513f6e7ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:21.969642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-acc181a7-58a2-419e-89f6-b0474bc681e3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:21.970661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-acc181a7-58a2-419e-89f6-b0474bc681e3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:21.978029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acc181a7-58a2-419e-89f6-b0474bc681e3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:21.978923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acc181a7-58a2-419e-89f6-b0474bc681e3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:21.979608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acc181a7-58a2-419e-89f6-b0474bc681e3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:21.979752 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-79de171e-3873-45db-b7e6-9d1513f6e7ec tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/28198b9c-ff65-40f0-869f-117104e764ef" status: 200 len: 1474 microversion: 2.1 time: 0.321152 Oct 04 21:10:21.984297 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 655/1303] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:21 2022] GET /compute/v2.1/servers/28198b9c-ff65-40f0-869f-117104e764ef => generated 1474 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:21.984971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acc181a7-58a2-419e-89f6-b0474bc681e3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:21.985927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acc181a7-58a2-419e-89f6-b0474bc681e3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:21.986518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acc181a7-58a2-419e-89f6-b0474bc681e3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:22.002115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-45de7f0c-3871-4567-9f5c-341fd4e59a3d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:22.002742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-45de7f0c-3871-4567-9f5c-341fd4e59a3d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:22.010748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:22.109173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-45de7f0c-3871-4567-9f5c-341fd4e59a3d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:22.126184 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-45de7f0c-3871-4567-9f5c-341fd4e59a3d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1277 microversion: 2.1 time: 0.143780 Oct 04 21:10:22.137061 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 656/1304] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:21 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1277 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:22.137061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4abc89b3-628b-4a19-aa07-ebbb9f830202 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:22.137061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4abc89b3-628b-4a19-aa07-ebbb9f830202 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:22.140996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4abc89b3-628b-4a19-aa07-ebbb9f830202 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:22.142704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4abc89b3-628b-4a19-aa07-ebbb9f830202 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:22.143321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4abc89b3-628b-4a19-aa07-ebbb9f830202 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:22.144215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4abc89b3-628b-4a19-aa07-ebbb9f830202 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:22.155211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4abc89b3-628b-4a19-aa07-ebbb9f830202 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:22.155211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4abc89b3-628b-4a19-aa07-ebbb9f830202 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:22.198782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-acc181a7-58a2-419e-89f6-b0474bc681e3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:22.212075 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-acc181a7-58a2-419e-89f6-b0474bc681e3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1471 microversion: 2.1 time: 0.245041 Oct 04 21:10:22.212075 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 649/1305] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:21 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:22.304394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3abc3edb-8463-46af-bd20-b7772058db6d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:22.305058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3abc3edb-8463-46af-bd20-b7772058db6d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:22.315074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3abc3edb-8463-46af-bd20-b7772058db6d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:22.317474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3abc3edb-8463-46af-bd20-b7772058db6d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:22.317992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3abc3edb-8463-46af-bd20-b7772058db6d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:22.319092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3abc3edb-8463-46af-bd20-b7772058db6d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:22.321200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3abc3edb-8463-46af-bd20-b7772058db6d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:22.321841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3abc3edb-8463-46af-bd20-b7772058db6d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:22.360010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4abc89b3-628b-4a19-aa07-ebbb9f830202 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:22.382888 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4abc89b3-628b-4a19-aa07-ebbb9f830202 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.253755 Oct 04 21:10:22.386754 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 657/1306] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:22 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:22.422802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3abc3edb-8463-46af-bd20-b7772058db6d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:22.431731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3abc3edb-8463-46af-bd20-b7772058db6d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:22.433324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3abc3edb-8463-46af-bd20-b7772058db6d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:22.443587 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3abc3edb-8463-46af-bd20-b7772058db6d tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.144523 Oct 04 21:10:22.444680 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 650/1307] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:22 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:10:22.535787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-cc463856-61a6-43f1-aa64-3328536c3ede req-934bdf43-6fd5-4854-88fe-6483f30ddd90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e74286-835f-42b6-9d83-304b333a786f", "name": "network-vif-deleted", "tag": "35e8d1d0-7fba-4543-9d29-aea7260b9810"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:22.554906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cc463856-61a6-43f1-aa64-3328536c3ede req-934bdf43-6fd5-4854-88fe-6483f30ddd90 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:22.555658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cc463856-61a6-43f1-aa64-3328536c3ede req-934bdf43-6fd5-4854-88fe-6483f30ddd90 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:22.556260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cc463856-61a6-43f1-aa64-3328536c3ede req-934bdf43-6fd5-4854-88fe-6483f30ddd90 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:22.568637 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-cc463856-61a6-43f1-aa64-3328536c3ede req-934bdf43-6fd5-4854-88fe-6483f30ddd90 service nova] Creating event network-vif-deleted:35e8d1d0-7fba-4543-9d29-aea7260b9810 for instance 79e74286-835f-42b6-9d83-304b333a786f on n-h2-860282-1 Oct 04 21:10:22.573815 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-cc463856-61a6-43f1-aa64-3328536c3ede req-934bdf43-6fd5-4854-88fe-6483f30ddd90 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041562 Oct 04 21:10:22.575007 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 658/1308] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:22.995453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9dc6fdc7-34c0-42dc-a799-81245ac011d9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:22.996079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9dc6fdc7-34c0-42dc-a799-81245ac011d9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:23.005570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-df37a038-1b9c-4dab-8f3f-8e480b468bef tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:23.006286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-df37a038-1b9c-4dab-8f3f-8e480b468bef tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 28198b9c-ff65-40f0-869f-117104e764ef] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:23.009008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dc6fdc7-34c0-42dc-a799-81245ac011d9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:23.010207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dc6fdc7-34c0-42dc-a799-81245ac011d9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:23.010919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dc6fdc7-34c0-42dc-a799-81245ac011d9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:23.011959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dc6fdc7-34c0-42dc-a799-81245ac011d9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:23.012649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df37a038-1b9c-4dab-8f3f-8e480b468bef tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:23.012794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dc6fdc7-34c0-42dc-a799-81245ac011d9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:23.013133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dc6fdc7-34c0-42dc-a799-81245ac011d9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:23.013246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df37a038-1b9c-4dab-8f3f-8e480b468bef tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:23.013632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df37a038-1b9c-4dab-8f3f-8e480b468bef tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:23.014347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df37a038-1b9c-4dab-8f3f-8e480b468bef tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:23.014804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df37a038-1b9c-4dab-8f3f-8e480b468bef tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:23.015231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df37a038-1b9c-4dab-8f3f-8e480b468bef tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:23.237784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-df37a038-1b9c-4dab-8f3f-8e480b468bef tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:23.241861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9dc6fdc7-34c0-42dc-a799-81245ac011d9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:23.254252 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-df37a038-1b9c-4dab-8f3f-8e480b468bef tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/28198b9c-ff65-40f0-869f-117104e764ef" status: 200 len: 1474 microversion: 2.1 time: 0.254145 Oct 04 21:10:23.255498 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 659/1309] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:22 2022] GET /compute/v2.1/servers/28198b9c-ff65-40f0-869f-117104e764ef => generated 1474 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:23.256655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9dc6fdc7-34c0-42dc-a799-81245ac011d9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:23.258747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9dc6fdc7-34c0-42dc-a799-81245ac011d9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:23.260670 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9dc6fdc7-34c0-42dc-a799-81245ac011d9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.269101 Oct 04 21:10:23.261766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b2047d17-8a41-4782-b5fa-50dd0855a009 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:23.262233 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 651/1310] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:22 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:23.262902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b2047d17-8a41-4782-b5fa-50dd0855a009 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:23.267862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fa4826ae-a465-42eb-9945-d5dd37089896 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:23.268479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fa4826ae-a465-42eb-9945-d5dd37089896 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:23.283989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa4826ae-a465-42eb-9945-d5dd37089896 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:23.284822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa4826ae-a465-42eb-9945-d5dd37089896 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:23.285691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2047d17-8a41-4782-b5fa-50dd0855a009 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:23.285840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa4826ae-a465-42eb-9945-d5dd37089896 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:23.286185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2047d17-8a41-4782-b5fa-50dd0855a009 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:23.286794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2047d17-8a41-4782-b5fa-50dd0855a009 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:23.286948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa4826ae-a465-42eb-9945-d5dd37089896 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:23.287325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa4826ae-a465-42eb-9945-d5dd37089896 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:23.287936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa4826ae-a465-42eb-9945-d5dd37089896 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:23.288300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2047d17-8a41-4782-b5fa-50dd0855a009 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:23.288919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2047d17-8a41-4782-b5fa-50dd0855a009 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:23.289523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2047d17-8a41-4782-b5fa-50dd0855a009 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:23.367253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b2047d17-8a41-4782-b5fa-50dd0855a009 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:23.377579 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b2047d17-8a41-4782-b5fa-50dd0855a009 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1281 microversion: 2.1 time: 0.120655 Oct 04 21:10:23.390000 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 660/1311] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:23 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1281 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:23.412145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-255ac3a5-fe8e-4167-abb7-0521d880fa23 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:23.412145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-255ac3a5-fe8e-4167-abb7-0521d880fa23 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:23.416546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-255ac3a5-fe8e-4167-abb7-0521d880fa23 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:23.417161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-255ac3a5-fe8e-4167-abb7-0521d880fa23 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:23.417733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-255ac3a5-fe8e-4167-abb7-0521d880fa23 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:23.418540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-255ac3a5-fe8e-4167-abb7-0521d880fa23 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:23.419266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-255ac3a5-fe8e-4167-abb7-0521d880fa23 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:23.421196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-255ac3a5-fe8e-4167-abb7-0521d880fa23 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:23.515744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fa4826ae-a465-42eb-9945-d5dd37089896 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:23.526056 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fa4826ae-a465-42eb-9945-d5dd37089896 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1471 microversion: 2.1 time: 0.262655 Oct 04 21:10:23.526740 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 652/1312] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:23 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1471 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:23.532098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c87858b6-a959-44db-9f83-71ea31710a53 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:23.532819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c87858b6-a959-44db-9f83-71ea31710a53 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:23.538821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c87858b6-a959-44db-9f83-71ea31710a53 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:23.539403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c87858b6-a959-44db-9f83-71ea31710a53 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:23.539918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c87858b6-a959-44db-9f83-71ea31710a53 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:23.540694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c87858b6-a959-44db-9f83-71ea31710a53 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:23.541230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c87858b6-a959-44db-9f83-71ea31710a53 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:23.541751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c87858b6-a959-44db-9f83-71ea31710a53 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:23.649246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-255ac3a5-fe8e-4167-abb7-0521d880fa23 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:23.659182 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-255ac3a5-fe8e-4167-abb7-0521d880fa23 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.255105 Oct 04 21:10:23.668070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c87858b6-a959-44db-9f83-71ea31710a53 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:23.678196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:23.678619 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 661/1313] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:23 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:23.680156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c87858b6-a959-44db-9f83-71ea31710a53 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:23.681872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c87858b6-a959-44db-9f83-71ea31710a53 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:23.688347 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c87858b6-a959-44db-9f83-71ea31710a53 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.159882 Oct 04 21:10:23.689731 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 653/1314] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:23 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:24.295818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e622cdef-86c2-40db-b8d7-5936416bc96c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:24.296449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e622cdef-86c2-40db-b8d7-5936416bc96c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:24.299422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6c746b6f-a0a1-49df-9c5b-936100ffefba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:24.300551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6c746b6f-a0a1-49df-9c5b-936100ffefba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 28198b9c-ff65-40f0-869f-117104e764ef] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:24.311333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c746b6f-a0a1-49df-9c5b-936100ffefba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.312210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c746b6f-a0a1-49df-9c5b-936100ffefba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.314109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c746b6f-a0a1-49df-9c5b-936100ffefba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:24.315085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c746b6f-a0a1-49df-9c5b-936100ffefba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.315876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c746b6f-a0a1-49df-9c5b-936100ffefba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.316455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c746b6f-a0a1-49df-9c5b-936100ffefba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:24.317278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e622cdef-86c2-40db-b8d7-5936416bc96c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.320332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e622cdef-86c2-40db-b8d7-5936416bc96c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.322304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e622cdef-86c2-40db-b8d7-5936416bc96c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:24.323385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e622cdef-86c2-40db-b8d7-5936416bc96c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.324097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e622cdef-86c2-40db-b8d7-5936416bc96c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.325744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e622cdef-86c2-40db-b8d7-5936416bc96c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:24.355029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c746b6f-a0a1-49df-9c5b-936100ffefba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.355516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c746b6f-a0a1-49df-9c5b-936100ffefba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.356099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c746b6f-a0a1-49df-9c5b-936100ffefba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:24.356562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-6c746b6f-a0a1-49df-9c5b-936100ffefba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lazy-loading 'fault' on Instance uuid 28198b9c-ff65-40f0-869f-117104e764ef {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:10:24.436065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6c746b6f-a0a1-49df-9c5b-936100ffefba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:24.461545 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6c746b6f-a0a1-49df-9c5b-936100ffefba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/28198b9c-ff65-40f0-869f-117104e764ef" status: 200 len: 1308 microversion: 2.1 time: 0.187142 Oct 04 21:10:24.477456 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 662/1315] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:24 2022] GET /compute/v2.1/servers/28198b9c-ff65-40f0-869f-117104e764ef => generated 1308 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:24.492897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3947b61b-dcf7-496c-a824-8cb7fc226b1c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:24.496317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3947b61b-dcf7-496c-a824-8cb7fc226b1c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:24.510521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3947b61b-dcf7-496c-a824-8cb7fc226b1c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.511102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3947b61b-dcf7-496c-a824-8cb7fc226b1c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.511542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3947b61b-dcf7-496c-a824-8cb7fc226b1c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:24.512260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3947b61b-dcf7-496c-a824-8cb7fc226b1c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.512743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3947b61b-dcf7-496c-a824-8cb7fc226b1c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.513169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3947b61b-dcf7-496c-a824-8cb7fc226b1c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:24.540907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e622cdef-86c2-40db-b8d7-5936416bc96c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:24.556924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e622cdef-86c2-40db-b8d7-5936416bc96c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:24.561574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e622cdef-86c2-40db-b8d7-5936416bc96c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:24.564500 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e622cdef-86c2-40db-b8d7-5936416bc96c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.279272 Oct 04 21:10:24.581114 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 654/1316] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:24 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:24.581114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0ea0519c-473d-497b-92fb-6d537521ceaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:24.581114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0ea0519c-473d-497b-92fb-6d537521ceaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:24.592545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0ea0519c-473d-497b-92fb-6d537521ceaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.597487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0ea0519c-473d-497b-92fb-6d537521ceaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.597487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0ea0519c-473d-497b-92fb-6d537521ceaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:24.597487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0ea0519c-473d-497b-92fb-6d537521ceaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.597487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0ea0519c-473d-497b-92fb-6d537521ceaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.597487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0ea0519c-473d-497b-92fb-6d537521ceaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:24.676513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3947b61b-dcf7-496c-a824-8cb7fc226b1c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:24.690157 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3947b61b-dcf7-496c-a824-8cb7fc226b1c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1329 microversion: 2.1 time: 0.219887 Oct 04 21:10:24.691320 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 663/1317] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:24 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1329 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:24.705588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-4fca01f2-b07f-457e-9f7d-75c1f43e56d7 req-78f90be9-fc6a-4de9-a0dd-d075f19238dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf618d0-9d79-435c-ac4f-636ac63dbbda", "name": "network-vif-unplugged", "status": "completed", "tag": "dd232c2f-36a6-4a3c-93d1-396a660ea091"}, {"server_uuid": "28198b9c-ff65-40f0-869f-117104e764ef", "name": "network-vif-deleted", "tag": "39719aa6-16e6-4454-bc46-5da1d39dc83a"}, {"name": "network-changed", "server_uuid": "fcf618d0-9d79-435c-ac4f-636ac63dbbda", "tag": "dd232c2f-36a6-4a3c-93d1-396a660ea091"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:24.724004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4fca01f2-b07f-457e-9f7d-75c1f43e56d7 req-78f90be9-fc6a-4de9-a0dd-d075f19238dd service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.730501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4fca01f2-b07f-457e-9f7d-75c1f43e56d7 req-78f90be9-fc6a-4de9-a0dd-d075f19238dd service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.730501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4fca01f2-b07f-457e-9f7d-75c1f43e56d7 req-78f90be9-fc6a-4de9-a0dd-d075f19238dd service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:24.742272 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-4fca01f2-b07f-457e-9f7d-75c1f43e56d7 req-78f90be9-fc6a-4de9-a0dd-d075f19238dd service nova] Creating event network-vif-unplugged:dd232c2f-36a6-4a3c-93d1-396a660ea091 for instance fcf618d0-9d79-435c-ac4f-636ac63dbbda on n-h2-860282-1 Oct 04 21:10:24.743067 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-4fca01f2-b07f-457e-9f7d-75c1f43e56d7 req-78f90be9-fc6a-4de9-a0dd-d075f19238dd service nova] Creating event network-vif-deleted:39719aa6-16e6-4454-bc46-5da1d39dc83a for instance 28198b9c-ff65-40f0-869f-117104e764ef on n-h1-860282-1 Oct 04 21:10:24.743755 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-4fca01f2-b07f-457e-9f7d-75c1f43e56d7 req-78f90be9-fc6a-4de9-a0dd-d075f19238dd service nova] Creating event network-changed:dd232c2f-36a6-4a3c-93d1-396a660ea091 for instance fcf618d0-9d79-435c-ac4f-636ac63dbbda on n-h2-860282-1 Oct 04 21:10:24.758279 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-4fca01f2-b07f-457e-9f7d-75c1f43e56d7 req-78f90be9-fc6a-4de9-a0dd-d075f19238dd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.063754 Oct 04 21:10:24.760597 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 664/1318] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:24.781824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7d4da683-d8c4-4799-8a56-f48e6b2d1ce8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:24.783241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7d4da683-d8c4-4799-8a56-f48e6b2d1ce8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:24.790230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d4da683-d8c4-4799-8a56-f48e6b2d1ce8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.790910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d4da683-d8c4-4799-8a56-f48e6b2d1ce8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.791504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d4da683-d8c4-4799-8a56-f48e6b2d1ce8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:24.799229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d4da683-d8c4-4799-8a56-f48e6b2d1ce8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.799229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d4da683-d8c4-4799-8a56-f48e6b2d1ce8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.799229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d4da683-d8c4-4799-8a56-f48e6b2d1ce8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:24.931666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0ea0519c-473d-497b-92fb-6d537521ceaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:24.945806 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0ea0519c-473d-497b-92fb-6d537521ceaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1471 microversion: 2.1 time: 0.372105 Oct 04 21:10:24.947211 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 655/1319] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:24 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1471 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:24.953010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-efa81e62-9e8a-4da2-8048-076765cd9554 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:24.956837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-efa81e62-9e8a-4da2-8048-076765cd9554 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:24.968875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efa81e62-9e8a-4da2-8048-076765cd9554 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.969705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efa81e62-9e8a-4da2-8048-076765cd9554 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.970387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efa81e62-9e8a-4da2-8048-076765cd9554 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:24.971310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efa81e62-9e8a-4da2-8048-076765cd9554 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.972012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efa81e62-9e8a-4da2-8048-076765cd9554 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.972460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efa81e62-9e8a-4da2-8048-076765cd9554 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:25.020820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7d4da683-d8c4-4799-8a56-f48e6b2d1ce8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:25.033958 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7d4da683-d8c4-4799-8a56-f48e6b2d1ce8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.270782 Oct 04 21:10:25.034814 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 665/1320] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:24 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:25.062524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-efa81e62-9e8a-4da2-8048-076765cd9554 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:25.075190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-efa81e62-9e8a-4da2-8048-076765cd9554 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:25.077338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-efa81e62-9e8a-4da2-8048-076765cd9554 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:25.083171 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-efa81e62-9e8a-4da2-8048-076765cd9554 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.134629 Oct 04 21:10:25.097661 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 656/1321] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:24 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:25.489651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-04645417-b343-476a-95ec-867abed72e5d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:25.490924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-04645417-b343-476a-95ec-867abed72e5d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 28198b9c-ff65-40f0-869f-117104e764ef] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:25.506213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04645417-b343-476a-95ec-867abed72e5d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:25.506704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04645417-b343-476a-95ec-867abed72e5d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:25.508694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04645417-b343-476a-95ec-867abed72e5d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:25.510919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04645417-b343-476a-95ec-867abed72e5d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:25.511761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04645417-b343-476a-95ec-867abed72e5d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:25.514427 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04645417-b343-476a-95ec-867abed72e5d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:25.560410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04645417-b343-476a-95ec-867abed72e5d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:25.561807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04645417-b343-476a-95ec-867abed72e5d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:25.562408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04645417-b343-476a-95ec-867abed72e5d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:25.562849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-04645417-b343-476a-95ec-867abed72e5d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lazy-loading 'fault' on Instance uuid 28198b9c-ff65-40f0-869f-117104e764ef {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:10:25.601718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f94e4970-e811-428f-9c11-865095164abc tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:25.602991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f94e4970-e811-428f-9c11-865095164abc tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:25.603764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-04645417-b343-476a-95ec-867abed72e5d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:25.611504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f94e4970-e811-428f-9c11-865095164abc tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:25.611990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f94e4970-e811-428f-9c11-865095164abc tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:25.612428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f94e4970-e811-428f-9c11-865095164abc tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:25.612720 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-04645417-b343-476a-95ec-867abed72e5d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/28198b9c-ff65-40f0-869f-117104e764ef" status: 200 len: 1308 microversion: 2.1 time: 0.126843 Oct 04 21:10:25.613270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f94e4970-e811-428f-9c11-865095164abc tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:25.619224 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 666/1322] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:25 2022] GET /compute/v2.1/servers/28198b9c-ff65-40f0-869f-117104e764ef => generated 1308 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:25.619363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f94e4970-e811-428f-9c11-865095164abc tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:25.619363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f94e4970-e811-428f-9c11-865095164abc tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:25.716143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-edf2af58-9a11-48de-83b0-fec8dd919ab9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:25.716984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-edf2af58-9a11-48de-83b0-fec8dd919ab9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:25.723816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-edf2af58-9a11-48de-83b0-fec8dd919ab9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:25.727011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-edf2af58-9a11-48de-83b0-fec8dd919ab9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:25.727011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-edf2af58-9a11-48de-83b0-fec8dd919ab9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:25.727011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-edf2af58-9a11-48de-83b0-fec8dd919ab9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:25.727011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-edf2af58-9a11-48de-83b0-fec8dd919ab9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:25.727011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-edf2af58-9a11-48de-83b0-fec8dd919ab9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:25.798533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f94e4970-e811-428f-9c11-865095164abc tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:25.810684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f94e4970-e811-428f-9c11-865095164abc tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:25.814206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f94e4970-e811-428f-9c11-865095164abc tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:25.817016 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f94e4970-e811-428f-9c11-865095164abc tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.219027 Oct 04 21:10:25.821615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-edf2af58-9a11-48de-83b0-fec8dd919ab9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:25.826049 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 657/1323] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:25 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:10:25.834607 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-edf2af58-9a11-48de-83b0-fec8dd919ab9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1337 microversion: 2.1 time: 0.122794 Oct 04 21:10:25.836132 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 667/1324] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:25 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1337 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:10:25.971405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e801c6ac-fbdc-4009-922e-04ad47ab0bba tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:25.972298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e801c6ac-fbdc-4009-922e-04ad47ab0bba tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:25.984495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e801c6ac-fbdc-4009-922e-04ad47ab0bba tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:25.988286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e801c6ac-fbdc-4009-922e-04ad47ab0bba tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:25.988286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e801c6ac-fbdc-4009-922e-04ad47ab0bba tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:25.988286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e801c6ac-fbdc-4009-922e-04ad47ab0bba tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:25.988286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e801c6ac-fbdc-4009-922e-04ad47ab0bba tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:25.988286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e801c6ac-fbdc-4009-922e-04ad47ab0bba tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:26.058581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5290a271-5676-4039-93d4-32cdf4135e60 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:26.059264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5290a271-5676-4039-93d4-32cdf4135e60 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:26.067340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5290a271-5676-4039-93d4-32cdf4135e60 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:26.067841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5290a271-5676-4039-93d4-32cdf4135e60 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:26.068824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5290a271-5676-4039-93d4-32cdf4135e60 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:26.068983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5290a271-5676-4039-93d4-32cdf4135e60 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:26.070614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5290a271-5676-4039-93d4-32cdf4135e60 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:26.070614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5290a271-5676-4039-93d4-32cdf4135e60 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:26.188145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e801c6ac-fbdc-4009-922e-04ad47ab0bba tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:26.198709 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e801c6ac-fbdc-4009-922e-04ad47ab0bba tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1471 microversion: 2.1 time: 0.232390 Oct 04 21:10:26.209940 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 658/1325] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:25 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1471 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:26.221629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5efad4cd-3137-4a50-afac-b993089d0190 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:26.222259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5efad4cd-3137-4a50-afac-b993089d0190 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:26.228616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5efad4cd-3137-4a50-afac-b993089d0190 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:26.229118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5efad4cd-3137-4a50-afac-b993089d0190 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:26.229591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5efad4cd-3137-4a50-afac-b993089d0190 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:26.230304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5efad4cd-3137-4a50-afac-b993089d0190 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:26.230762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5efad4cd-3137-4a50-afac-b993089d0190 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:26.231188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5efad4cd-3137-4a50-afac-b993089d0190 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:26.239076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5290a271-5676-4039-93d4-32cdf4135e60 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:26.249537 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5290a271-5676-4039-93d4-32cdf4135e60 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.195136 Oct 04 21:10:26.254319 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 668/1326] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:26 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:10:26.302039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5efad4cd-3137-4a50-afac-b993089d0190 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:26.315381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5efad4cd-3137-4a50-afac-b993089d0190 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:26.315381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5efad4cd-3137-4a50-afac-b993089d0190 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:26.319030 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5efad4cd-3137-4a50-afac-b993089d0190 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.107962 Oct 04 21:10:26.319627 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 659/1327] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:26 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:26.635700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0542319e-e7b9-4d7e-a1ba-1a2e307b6542 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:26.636317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0542319e-e7b9-4d7e-a1ba-1a2e307b6542 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 28198b9c-ff65-40f0-869f-117104e764ef] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:26.643602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0542319e-e7b9-4d7e-a1ba-1a2e307b6542 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:26.644096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0542319e-e7b9-4d7e-a1ba-1a2e307b6542 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:26.644996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0542319e-e7b9-4d7e-a1ba-1a2e307b6542 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:26.645997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0542319e-e7b9-4d7e-a1ba-1a2e307b6542 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:26.647195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0542319e-e7b9-4d7e-a1ba-1a2e307b6542 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:26.647625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0542319e-e7b9-4d7e-a1ba-1a2e307b6542 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:26.662532 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-0542319e-e7b9-4d7e-a1ba-1a2e307b6542 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] HTTP exception thrown: Instance 28198b9c-ff65-40f0-869f-117104e764ef could not be found. Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0542319e-e7b9-4d7e-a1ba-1a2e307b6542 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Request method failure captured: Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/28198b9c-ff65-40f0-869f-117104e764ef HTTP/1.1 Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKCSppkDAXSjwCSQa1f69X7mZVl7uZCSLTAHkzCtM2WTMjjTMUCKpz98J5Gj1CKCaKAVO-07ppp3m5zpHBQBOvXrxv-C9cE1HJ_RUrNofezjxAPsUNqPHzklSFFJuiasvRr2uETo5d4QJvlemPPKWE4rz9k2ow6zF89U2q-GMS4a-Gw Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 801ce5c5897d4894a6a2ffc1b27191aa Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/801ce5c5897d4894a6a2ffc1b27191aa"}]}] Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 801ce5c5897d4894a6a2ffc1b27191aa Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersOnMultiNodesTest-2051543181-project Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 0f0ac29dc4e440e785408fa1dfedce5e Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersOnMultiNodesTest-2051543181-project Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 28198b9c-ff65-40f0-869f-117104e764ef could not be found. Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '28198b9c-ff65-40f0-869f-117104e764ef'} Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28198b9c-ff65-40f0-869f-117104e764ef could not be found. Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28198b9c-ff65-40f0-869f-117104e764ef could not be found. Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:10:26.664678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:26.669641 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:26.669641 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:10:26.669641 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:10:26.669641 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:10:26.669641 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:10:26.669641 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28198b9c-ff65-40f0-869f-117104e764ef could not be found. Oct 04 21:10:26.669641 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:26.671065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0542319e-e7b9-4d7e-a1ba-1a2e307b6542 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Returning 404 to user: Instance 28198b9c-ff65-40f0-869f-117104e764ef could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:10:26.672111 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0542319e-e7b9-4d7e-a1ba-1a2e307b6542 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/28198b9c-ff65-40f0-869f-117104e764ef" status: 404 len: 111 microversion: 2.1 time: 0.040449 Oct 04 21:10:26.676220 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 669/1328] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:26 2022] GET /compute/v2.1/servers/28198b9c-ff65-40f0-869f-117104e764ef => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:10:26.687780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-73b788a9-09aa-4d44-bd10-e029c9f2127c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:26.688455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-73b788a9-09aa-4d44-bd10-e029c9f2127c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 79e74286-835f-42b6-9d83-304b333a786f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:26.720030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73b788a9-09aa-4d44-bd10-e029c9f2127c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:26.720709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73b788a9-09aa-4d44-bd10-e029c9f2127c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:26.721281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73b788a9-09aa-4d44-bd10-e029c9f2127c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:26.722147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73b788a9-09aa-4d44-bd10-e029c9f2127c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:26.722722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73b788a9-09aa-4d44-bd10-e029c9f2127c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:26.723259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73b788a9-09aa-4d44-bd10-e029c9f2127c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:26.753569 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-73b788a9-09aa-4d44-bd10-e029c9f2127c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] HTTP exception thrown: Instance 79e74286-835f-42b6-9d83-304b333a786f could not be found. Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-73b788a9-09aa-4d44-bd10-e029c9f2127c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Request method failure captured: Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f HTTP/1.1 Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKCSppkDAXSjwCSQa1f69X7mZVl7uZCSLTAHkzCtM2WTMjjTMUCKpz98J5Gj1CKCaKAVO-07ppp3m5zpHBQBOvXrxv-C9cE1HJ_RUrNofezjxAPsUNqPHzklSFFJuiasvRr2uETo5d4QJvlemPPKWE4rz9k2ow6zF89U2q-GMS4a-Gw Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 801ce5c5897d4894a6a2ffc1b27191aa Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/801ce5c5897d4894a6a2ffc1b27191aa"}]}] Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 801ce5c5897d4894a6a2ffc1b27191aa Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersOnMultiNodesTest-2051543181-project Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 0f0ac29dc4e440e785408fa1dfedce5e Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersOnMultiNodesTest-2051543181-project Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 79e74286-835f-42b6-9d83-304b333a786f could not be found. Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '79e74286-835f-42b6-9d83-304b333a786f'} Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79e74286-835f-42b6-9d83-304b333a786f could not be found. Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79e74286-835f-42b6-9d83-304b333a786f could not be found. Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:10:26.755421 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:26.760533 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:26.760533 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:10:26.760533 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:10:26.760533 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:10:26.760533 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:10:26.760533 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79e74286-835f-42b6-9d83-304b333a786f could not be found. Oct 04 21:10:26.760533 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:26.760533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-73b788a9-09aa-4d44-bd10-e029c9f2127c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Returning 404 to user: Instance 79e74286-835f-42b6-9d83-304b333a786f could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:10:26.761803 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-73b788a9-09aa-4d44-bd10-e029c9f2127c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f" status: 404 len: 111 microversion: 2.1 time: 0.084397 Oct 04 21:10:26.766489 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 660/1329] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:26 2022] GET /compute/v2.1/servers/79e74286-835f-42b6-9d83-304b333a786f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:10:26.771511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-02f99136-725c-4967-b11c-f744facde83d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:26.852320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f008d658-528b-47d4-8013-e5c3504fc711 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:26.854922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f008d658-528b-47d4-8013-e5c3504fc711 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:26.862281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f008d658-528b-47d4-8013-e5c3504fc711 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:26.863154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f008d658-528b-47d4-8013-e5c3504fc711 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:26.863991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f008d658-528b-47d4-8013-e5c3504fc711 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:26.865007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f008d658-528b-47d4-8013-e5c3504fc711 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:26.865727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f008d658-528b-47d4-8013-e5c3504fc711 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:26.868661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f008d658-528b-47d4-8013-e5c3504fc711 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:26.869696 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-02f99136-725c-4967-b11c-f744facde83d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/71bca548-1b20-4669-a31b-2cddaf629123" status: 204 len: 0 microversion: 2.1 time: 0.097253 Oct 04 21:10:26.874862 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 670/1330] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Oct 4 21:10:26 2022] DELETE /compute/v2.1/os-server-groups/71bca548-1b20-4669-a31b-2cddaf629123 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:10:26.880543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bfbe1cca-7aab-443c-bd58-38b39a9d947e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:26.881599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bfbe1cca-7aab-443c-bd58-38b39a9d947e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:26.890995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfbe1cca-7aab-443c-bd58-38b39a9d947e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:26.892550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfbe1cca-7aab-443c-bd58-38b39a9d947e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:26.893189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfbe1cca-7aab-443c-bd58-38b39a9d947e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:26.894125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfbe1cca-7aab-443c-bd58-38b39a9d947e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:26.894796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfbe1cca-7aab-443c-bd58-38b39a9d947e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:26.896106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfbe1cca-7aab-443c-bd58-38b39a9d947e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:27.035549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bfbe1cca-7aab-443c-bd58-38b39a9d947e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:27.049151 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bfbe1cca-7aab-443c-bd58-38b39a9d947e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1335 microversion: 2.1 time: 0.174373 Oct 04 21:10:27.051049 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 671/1331] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:26 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1335 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:27.058122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6c7ea833-7952-4dd6-9f8f-54ec9abd73c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:27.058730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6c7ea833-7952-4dd6-9f8f-54ec9abd73c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 06d4ebc0-b7ec-4481-ae12-df4530909f2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:27.067418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c7ea833-7952-4dd6-9f8f-54ec9abd73c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:27.067929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c7ea833-7952-4dd6-9f8f-54ec9abd73c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:27.068713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c7ea833-7952-4dd6-9f8f-54ec9abd73c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:27.069455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c7ea833-7952-4dd6-9f8f-54ec9abd73c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:27.070262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c7ea833-7952-4dd6-9f8f-54ec9abd73c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:27.071152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c7ea833-7952-4dd6-9f8f-54ec9abd73c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:27.079662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:27.110494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6c7ea833-7952-4dd6-9f8f-54ec9abd73c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 06d4ebc0-b7ec-4481-ae12-df4530909f2d] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:10:27.195646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f008d658-528b-47d4-8013-e5c3504fc711 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:27.211057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f008d658-528b-47d4-8013-e5c3504fc711 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:27.213627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f008d658-528b-47d4-8013-e5c3504fc711 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:27.215103 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f008d658-528b-47d4-8013-e5c3504fc711 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.366911 Oct 04 21:10:27.217872 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 661/1332] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:26 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:27.247758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-42d1ba4d-903b-42b1-a1a2-b6ec25772945 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:27.249235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-42d1ba4d-903b-42b1-a1a2-b6ec25772945 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:27.264936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42d1ba4d-903b-42b1-a1a2-b6ec25772945 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:27.265454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42d1ba4d-903b-42b1-a1a2-b6ec25772945 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:27.265904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42d1ba4d-903b-42b1-a1a2-b6ec25772945 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:27.266621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42d1ba4d-903b-42b1-a1a2-b6ec25772945 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:27.267085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42d1ba4d-903b-42b1-a1a2-b6ec25772945 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:27.267814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42d1ba4d-903b-42b1-a1a2-b6ec25772945 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:27.489630 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6c7ea833-7952-4dd6-9f8f-54ec9abd73c8 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "DELETE /compute/v2.1/servers/06d4ebc0-b7ec-4481-ae12-df4530909f2d" status: 204 len: 0 microversion: 2.1 time: 0.437157 Oct 04 21:10:27.490781 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 672/1333] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:10:27 2022] DELETE /compute/v2.1/servers/06d4ebc0-b7ec-4481-ae12-df4530909f2d => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:10:27.500041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d3d52852-daf3-4fc5-af81-fe841dc5fab0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:27.501059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d3d52852-daf3-4fc5-af81-fe841dc5fab0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:27.518530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3d52852-daf3-4fc5-af81-fe841dc5fab0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:27.519252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3d52852-daf3-4fc5-af81-fe841dc5fab0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:27.521007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3d52852-daf3-4fc5-af81-fe841dc5fab0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:27.521208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3d52852-daf3-4fc5-af81-fe841dc5fab0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:27.521909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3d52852-daf3-4fc5-af81-fe841dc5fab0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:27.522459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3d52852-daf3-4fc5-af81-fe841dc5fab0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:27.554763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-42d1ba4d-903b-42b1-a1a2-b6ec25772945 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:27.567590 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-42d1ba4d-903b-42b1-a1a2-b6ec25772945 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1471 microversion: 2.1 time: 0.344269 Oct 04 21:10:27.571520 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 662/1334] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:27 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1471 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:27.577343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d882b6b9-bf7f-41dd-9cca-6a3cf4241810 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:27.579488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d882b6b9-bf7f-41dd-9cca-6a3cf4241810 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:27.612018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d882b6b9-bf7f-41dd-9cca-6a3cf4241810 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:27.612643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d882b6b9-bf7f-41dd-9cca-6a3cf4241810 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:27.613201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d882b6b9-bf7f-41dd-9cca-6a3cf4241810 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:27.613968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d882b6b9-bf7f-41dd-9cca-6a3cf4241810 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:27.614426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d882b6b9-bf7f-41dd-9cca-6a3cf4241810 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:27.614851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d882b6b9-bf7f-41dd-9cca-6a3cf4241810 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:27.848057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d882b6b9-bf7f-41dd-9cca-6a3cf4241810 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:27.861250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d882b6b9-bf7f-41dd-9cca-6a3cf4241810 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:27.862733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d882b6b9-bf7f-41dd-9cca-6a3cf4241810 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:27.876045 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d882b6b9-bf7f-41dd-9cca-6a3cf4241810 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.302555 Oct 04 21:10:27.876969 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 663/1335] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:27 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:27.881917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d6255cd8-5526-4c68-b157-632f59dbac1d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:27.882389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d6255cd8-5526-4c68-b157-632f59dbac1d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:27.891100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6255cd8-5526-4c68-b157-632f59dbac1d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:27.892099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6255cd8-5526-4c68-b157-632f59dbac1d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:27.892805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6255cd8-5526-4c68-b157-632f59dbac1d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:27.893807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6255cd8-5526-4c68-b157-632f59dbac1d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:27.894499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6255cd8-5526-4c68-b157-632f59dbac1d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:27.895077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6255cd8-5526-4c68-b157-632f59dbac1d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:27.928176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d6255cd8-5526-4c68-b157-632f59dbac1d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:10:27.934905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d3d52852-daf3-4fc5-af81-fe841dc5fab0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:27.944686 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d3d52852-daf3-4fc5-af81-fe841dc5fab0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.452619 Oct 04 21:10:27.945415 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 673/1336] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:27 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:28.078158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-644f54c4-dca4-4d6a-87ac-34bc413af354 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:28.079050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-644f54c4-dca4-4d6a-87ac-34bc413af354 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:28.085550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-644f54c4-dca4-4d6a-87ac-34bc413af354 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:28.086107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-644f54c4-dca4-4d6a-87ac-34bc413af354 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:28.086541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-644f54c4-dca4-4d6a-87ac-34bc413af354 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:28.087292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-644f54c4-dca4-4d6a-87ac-34bc413af354 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:28.087751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-644f54c4-dca4-4d6a-87ac-34bc413af354 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:28.088214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-644f54c4-dca4-4d6a-87ac-34bc413af354 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:28.361837 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d6255cd8-5526-4c68-b157-632f59dbac1d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "DELETE /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d" status: 204 len: 0 microversion: 2.1 time: 0.483456 Oct 04 21:10:28.362591 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 664/1337] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:10:27 2022] DELETE /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:10:28.368711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7e4395fa-2ba4-4f8b-8692-425d6401b262 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:28.369739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7e4395fa-2ba4-4f8b-8692-425d6401b262 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:28.377415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e4395fa-2ba4-4f8b-8692-425d6401b262 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:28.378089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e4395fa-2ba4-4f8b-8692-425d6401b262 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:28.378639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e4395fa-2ba4-4f8b-8692-425d6401b262 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:28.379525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e4395fa-2ba4-4f8b-8692-425d6401b262 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:28.380086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e4395fa-2ba4-4f8b-8692-425d6401b262 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:28.380616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e4395fa-2ba4-4f8b-8692-425d6401b262 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:28.493033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-644f54c4-dca4-4d6a-87ac-34bc413af354 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:28.501692 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-644f54c4-dca4-4d6a-87ac-34bc413af354 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1377 microversion: 2.1 time: 0.428493 Oct 04 21:10:28.517540 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 674/1338] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:28 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1377 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:10:28.523004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3798751c-7c6f-457c-881e-4dae1090a207 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:28.523626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3798751c-7c6f-457c-881e-4dae1090a207 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 06d4ebc0-b7ec-4481-ae12-df4530909f2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:28.533955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3798751c-7c6f-457c-881e-4dae1090a207 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:28.534665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3798751c-7c6f-457c-881e-4dae1090a207 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:28.535601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3798751c-7c6f-457c-881e-4dae1090a207 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:28.536868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3798751c-7c6f-457c-881e-4dae1090a207 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:28.537610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3798751c-7c6f-457c-881e-4dae1090a207 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:28.538214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3798751c-7c6f-457c-881e-4dae1090a207 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:28.548362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7e4395fa-2ba4-4f8b-8692-425d6401b262 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:28.559921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7e4395fa-2ba4-4f8b-8692-425d6401b262 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:28.563050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7e4395fa-2ba4-4f8b-8692-425d6401b262 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:28.564506 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7e4395fa-2ba4-4f8b-8692-425d6401b262 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.200307 Oct 04 21:10:28.565559 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 665/1339] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:28 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:28.591104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-d63c81f8-0952-4abb-8d7f-eadba6368bef req-edb7616a-0804-4be6-ade1-7cf6d9d1a7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19a7d656-c2a8-46fa-88dc-6c6cb1919c3b", "tag": "0f85098b-592d-4f47-9950-f46b2b886584"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:28.602008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d63c81f8-0952-4abb-8d7f-eadba6368bef req-edb7616a-0804-4be6-ade1-7cf6d9d1a7e4 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:28.606468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d63c81f8-0952-4abb-8d7f-eadba6368bef req-edb7616a-0804-4be6-ade1-7cf6d9d1a7e4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:28.606468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d63c81f8-0952-4abb-8d7f-eadba6368bef req-edb7616a-0804-4be6-ade1-7cf6d9d1a7e4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:28.615019 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-d63c81f8-0952-4abb-8d7f-eadba6368bef req-edb7616a-0804-4be6-ade1-7cf6d9d1a7e4 service nova] Creating event network-changed:0f85098b-592d-4f47-9950-f46b2b886584 for instance 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b on n-h2-860282-1 Oct 04 21:10:28.619849 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-d63c81f8-0952-4abb-8d7f-eadba6368bef req-edb7616a-0804-4be6-ade1-7cf6d9d1a7e4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040615 Oct 04 21:10:28.620649 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 666/1340] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:28.627815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ece5aad5-2f8e-41a2-836a-58ad76fdbdc2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:28.628522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ece5aad5-2f8e-41a2-836a-58ad76fdbdc2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:28.634984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ece5aad5-2f8e-41a2-836a-58ad76fdbdc2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:28.635627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ece5aad5-2f8e-41a2-836a-58ad76fdbdc2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:28.635911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ece5aad5-2f8e-41a2-836a-58ad76fdbdc2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:28.636611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ece5aad5-2f8e-41a2-836a-58ad76fdbdc2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:28.637161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ece5aad5-2f8e-41a2-836a-58ad76fdbdc2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:28.637512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ece5aad5-2f8e-41a2-836a-58ad76fdbdc2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:28.727214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3798751c-7c6f-457c-881e-4dae1090a207 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:28.736117 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3798751c-7c6f-457c-881e-4dae1090a207 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/06d4ebc0-b7ec-4481-ae12-df4530909f2d" status: 200 len: 1474 microversion: 2.1 time: 0.217305 Oct 04 21:10:28.736702 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 675/1341] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:28 2022] GET /compute/v2.1/servers/06d4ebc0-b7ec-4481-ae12-df4530909f2d => generated 1474 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:28.819028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ece5aad5-2f8e-41a2-836a-58ad76fdbdc2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:28.827000 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ece5aad5-2f8e-41a2-836a-58ad76fdbdc2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1471 microversion: 2.1 time: 0.204254 Oct 04 21:10:28.827589 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 667/1342] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:28 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1471 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:28.903569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e63cccdf-57f6-48ef-b0dd-1ec68b848c06 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:28.904716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e63cccdf-57f6-48ef-b0dd-1ec68b848c06 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:28.911875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e63cccdf-57f6-48ef-b0dd-1ec68b848c06 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:28.912453 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e63cccdf-57f6-48ef-b0dd-1ec68b848c06 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:28.913072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e63cccdf-57f6-48ef-b0dd-1ec68b848c06 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:28.913955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e63cccdf-57f6-48ef-b0dd-1ec68b848c06 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:28.914424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e63cccdf-57f6-48ef-b0dd-1ec68b848c06 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:28.914862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e63cccdf-57f6-48ef-b0dd-1ec68b848c06 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:28.969141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-40c9b402-28bb-44f4-a8a4-d72625b54896 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:28.969917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-40c9b402-28bb-44f4-a8a4-d72625b54896 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:28.976033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40c9b402-28bb-44f4-a8a4-d72625b54896 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:28.976722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40c9b402-28bb-44f4-a8a4-d72625b54896 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:28.977158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40c9b402-28bb-44f4-a8a4-d72625b54896 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:28.978048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40c9b402-28bb-44f4-a8a4-d72625b54896 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:28.978664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40c9b402-28bb-44f4-a8a4-d72625b54896 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:28.979252 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40c9b402-28bb-44f4-a8a4-d72625b54896 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:28.984924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e63cccdf-57f6-48ef-b0dd-1ec68b848c06 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:28.993959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e63cccdf-57f6-48ef-b0dd-1ec68b848c06 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:28.995500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e63cccdf-57f6-48ef-b0dd-1ec68b848c06 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:29.001189 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e63cccdf-57f6-48ef-b0dd-1ec68b848c06 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.101562 Oct 04 21:10:29.001793 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 676/1343] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:28 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:29.128713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-40c9b402-28bb-44f4-a8a4-d72625b54896 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:29.134481 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-40c9b402-28bb-44f4-a8a4-d72625b54896 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.169815 Oct 04 21:10:29.135165 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 668/1344] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:28 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:29.524224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0de5cfde-d453-4780-bce4-b2b5d2696d7c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:29.524862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0de5cfde-d453-4780-bce4-b2b5d2696d7c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:29.531674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0de5cfde-d453-4780-bce4-b2b5d2696d7c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:29.532167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0de5cfde-d453-4780-bce4-b2b5d2696d7c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:29.532612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0de5cfde-d453-4780-bce4-b2b5d2696d7c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:29.533349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0de5cfde-d453-4780-bce4-b2b5d2696d7c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:29.533869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0de5cfde-d453-4780-bce4-b2b5d2696d7c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:29.534308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0de5cfde-d453-4780-bce4-b2b5d2696d7c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:29.596950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1e0d2842-69db-4c41-902c-97d4e2332fac tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:29.597738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1e0d2842-69db-4c41-902c-97d4e2332fac tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:29.603830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e0d2842-69db-4c41-902c-97d4e2332fac tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:29.604315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e0d2842-69db-4c41-902c-97d4e2332fac tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:29.604763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e0d2842-69db-4c41-902c-97d4e2332fac tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:29.605474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e0d2842-69db-4c41-902c-97d4e2332fac tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:29.605993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e0d2842-69db-4c41-902c-97d4e2332fac tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:29.606416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e0d2842-69db-4c41-902c-97d4e2332fac tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:29.713549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0de5cfde-d453-4780-bce4-b2b5d2696d7c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:29.722464 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0de5cfde-d453-4780-bce4-b2b5d2696d7c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1377 microversion: 2.1 time: 0.202260 Oct 04 21:10:29.723273 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 677/1345] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:29 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1377 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:29.766687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1e0d2842-69db-4c41-902c-97d4e2332fac tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:29.766892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8736b220-56c8-4e0c-92cc-12fd41383a0c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:29.767739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8736b220-56c8-4e0c-92cc-12fd41383a0c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 06d4ebc0-b7ec-4481-ae12-df4530909f2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:29.774273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8736b220-56c8-4e0c-92cc-12fd41383a0c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:29.776287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8736b220-56c8-4e0c-92cc-12fd41383a0c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:29.776287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8736b220-56c8-4e0c-92cc-12fd41383a0c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:29.776287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8736b220-56c8-4e0c-92cc-12fd41383a0c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:29.778169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8736b220-56c8-4e0c-92cc-12fd41383a0c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:29.778169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8736b220-56c8-4e0c-92cc-12fd41383a0c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:29.778346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1e0d2842-69db-4c41-902c-97d4e2332fac tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:29.779206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1e0d2842-69db-4c41-902c-97d4e2332fac tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:29.780513 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1e0d2842-69db-4c41-902c-97d4e2332fac tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.187656 Oct 04 21:10:29.781095 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 669/1346] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:29 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:10:29.812254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:29.850989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fb6a4791-44ea-429b-9154-90b0cf62311e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:29.851866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fb6a4791-44ea-429b-9154-90b0cf62311e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:29.858695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb6a4791-44ea-429b-9154-90b0cf62311e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:29.859351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb6a4791-44ea-429b-9154-90b0cf62311e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:29.859767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb6a4791-44ea-429b-9154-90b0cf62311e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:29.860544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb6a4791-44ea-429b-9154-90b0cf62311e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:29.861264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb6a4791-44ea-429b-9154-90b0cf62311e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:29.861718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb6a4791-44ea-429b-9154-90b0cf62311e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:29.867462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:29.954320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8736b220-56c8-4e0c-92cc-12fd41383a0c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:29.963513 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8736b220-56c8-4e0c-92cc-12fd41383a0c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/06d4ebc0-b7ec-4481-ae12-df4530909f2d" status: 200 len: 1474 microversion: 2.1 time: 0.201441 Oct 04 21:10:29.964558 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 678/1347] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:29 2022] GET /compute/v2.1/servers/06d4ebc0-b7ec-4481-ae12-df4530909f2d => generated 1474 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:10:30.019538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fb6a4791-44ea-429b-9154-90b0cf62311e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:30.027932 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fb6a4791-44ea-429b-9154-90b0cf62311e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1471 microversion: 2.1 time: 0.181289 Oct 04 21:10:30.028680 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 670/1348] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:29 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1471 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:10:30.030622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-812abfdf-d447-484b-bdb1-7c3c27f805dd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:30.031505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-812abfdf-d447-484b-bdb1-7c3c27f805dd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:30.039234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-812abfdf-d447-484b-bdb1-7c3c27f805dd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:30.039843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-812abfdf-d447-484b-bdb1-7c3c27f805dd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:30.040372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-812abfdf-d447-484b-bdb1-7c3c27f805dd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:30.041183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-812abfdf-d447-484b-bdb1-7c3c27f805dd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:30.041732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-812abfdf-d447-484b-bdb1-7c3c27f805dd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:30.042226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-812abfdf-d447-484b-bdb1-7c3c27f805dd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:30.113129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-812abfdf-d447-484b-bdb1-7c3c27f805dd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:30.122286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-812abfdf-d447-484b-bdb1-7c3c27f805dd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:30.124460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-812abfdf-d447-484b-bdb1-7c3c27f805dd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:30.129986 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-812abfdf-d447-484b-bdb1-7c3c27f805dd tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.104874 Oct 04 21:10:30.130753 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 679/1349] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:30 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:10:30.158060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1d76d228-3673-4b19-b274-3226ec65c20e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:30.158704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1d76d228-3673-4b19-b274-3226ec65c20e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:30.164694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d76d228-3673-4b19-b274-3226ec65c20e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:30.165175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d76d228-3673-4b19-b274-3226ec65c20e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:30.165650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d76d228-3673-4b19-b274-3226ec65c20e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:30.166386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d76d228-3673-4b19-b274-3226ec65c20e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:30.166839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d76d228-3673-4b19-b274-3226ec65c20e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:30.167266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d76d228-3673-4b19-b274-3226ec65c20e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:30.313059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1d76d228-3673-4b19-b274-3226ec65c20e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:30.321487 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1d76d228-3673-4b19-b274-3226ec65c20e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.167301 Oct 04 21:10:30.322051 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 671/1350] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:30 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:30.754004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-340c1b11-61c5-4a71-9cb5-98df05993892 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:30.754988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-340c1b11-61c5-4a71-9cb5-98df05993892 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:30.769002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-340c1b11-61c5-4a71-9cb5-98df05993892 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:30.769002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-340c1b11-61c5-4a71-9cb5-98df05993892 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:30.769002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-340c1b11-61c5-4a71-9cb5-98df05993892 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:30.769002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-340c1b11-61c5-4a71-9cb5-98df05993892 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:30.769002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-340c1b11-61c5-4a71-9cb5-98df05993892 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:30.769002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-340c1b11-61c5-4a71-9cb5-98df05993892 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:30.810344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fa89da06-2846-4ef7-ba7e-4b8c10d15e86 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:30.811988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fa89da06-2846-4ef7-ba7e-4b8c10d15e86 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:30.819605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa89da06-2846-4ef7-ba7e-4b8c10d15e86 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:30.822698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa89da06-2846-4ef7-ba7e-4b8c10d15e86 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:30.822698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa89da06-2846-4ef7-ba7e-4b8c10d15e86 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:30.822698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa89da06-2846-4ef7-ba7e-4b8c10d15e86 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:30.822698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa89da06-2846-4ef7-ba7e-4b8c10d15e86 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:30.822698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa89da06-2846-4ef7-ba7e-4b8c10d15e86 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:31.399870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-340c1b11-61c5-4a71-9cb5-98df05993892 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:31.408437 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-340c1b11-61c5-4a71-9cb5-98df05993892 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1377 microversion: 2.1 time: 0.664312 Oct 04 21:10:31.425103 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 680/1351] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:30 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1377 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:31.425968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fa89da06-2846-4ef7-ba7e-4b8c10d15e86 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:31.431066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6840c59a-a545-4c6b-99bd-9334457e083c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:31.431855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6840c59a-a545-4c6b-99bd-9334457e083c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 06d4ebc0-b7ec-4481-ae12-df4530909f2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:31.438533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6840c59a-a545-4c6b-99bd-9334457e083c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:31.439198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6840c59a-a545-4c6b-99bd-9334457e083c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:31.439787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6840c59a-a545-4c6b-99bd-9334457e083c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:31.440657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6840c59a-a545-4c6b-99bd-9334457e083c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:31.441263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6840c59a-a545-4c6b-99bd-9334457e083c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:31.441902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6840c59a-a545-4c6b-99bd-9334457e083c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:31.443036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fa89da06-2846-4ef7-ba7e-4b8c10d15e86 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:31.444762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fa89da06-2846-4ef7-ba7e-4b8c10d15e86 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:31.446622 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fa89da06-2846-4ef7-ba7e-4b8c10d15e86 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.639986 Oct 04 21:10:31.474275 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 672/1352] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:30 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:10:31.479561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9b873927-c46e-4a23-a160-162b7444243c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:31.480193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9b873927-c46e-4a23-a160-162b7444243c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:31.500436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=14 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:31.502057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b873927-c46e-4a23-a160-162b7444243c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:31.502776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b873927-c46e-4a23-a160-162b7444243c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:31.503382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b873927-c46e-4a23-a160-162b7444243c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:31.504260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b873927-c46e-4a23-a160-162b7444243c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:31.504729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b873927-c46e-4a23-a160-162b7444243c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:31.505160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b873927-c46e-4a23-a160-162b7444243c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:31.516402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=10 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:31.578034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6840c59a-a545-4c6b-99bd-9334457e083c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:31.589677 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6840c59a-a545-4c6b-99bd-9334457e083c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/06d4ebc0-b7ec-4481-ae12-df4530909f2d" status: 200 len: 1303 microversion: 2.1 time: 0.162289 Oct 04 21:10:31.604432 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 681/1353] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:31 2022] GET /compute/v2.1/servers/06d4ebc0-b7ec-4481-ae12-df4530909f2d => generated 1303 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:31.612674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6e7672c8-1520-482d-ad01-45ede1301b91 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Calling method '.version_select at 0x7f5790145700>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:31.673649 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6e7672c8-1520-482d-ad01-45ede1301b91 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] 10.222.0.30 "GET /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f" status: 200 len: 636 microversion: 2.1 time: 0.067289 Oct 04 21:10:31.677727 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 682/1354] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:10:31 2022] GET /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f => generated 636 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:31.684866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3fe0333d-a38a-433d-b6e1-109d294d9f25 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:31.685721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3fe0333d-a38a-433d-b6e1-109d294d9f25 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:31.692431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fe0333d-a38a-433d-b6e1-109d294d9f25 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:31.693335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fe0333d-a38a-433d-b6e1-109d294d9f25 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:31.693988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fe0333d-a38a-433d-b6e1-109d294d9f25 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:31.694871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fe0333d-a38a-433d-b6e1-109d294d9f25 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:31.695494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fe0333d-a38a-433d-b6e1-109d294d9f25 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:31.696094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fe0333d-a38a-433d-b6e1-109d294d9f25 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:31.767746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9b873927-c46e-4a23-a160-162b7444243c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:31.776673 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9b873927-c46e-4a23-a160-162b7444243c tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1471 microversion: 2.1 time: 0.300896 Oct 04 21:10:31.787540 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 673/1355] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:31 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1471 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:31.787540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-79d227f6-f9bf-4271-aec5-8c24255ed000 req-5c258a5b-10f5-41c3-bc2b-5b3eed9a6f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d4ebc0-b7ec-4481-ae12-df4530909f2d", "name": "network-vif-deleted", "tag": "59e997dc-877a-4edb-8588-607e62851bd1"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:31.788539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3fe0333d-a38a-433d-b6e1-109d294d9f25 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:31.793842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-79d227f6-f9bf-4271-aec5-8c24255ed000 req-5c258a5b-10f5-41c3-bc2b-5b3eed9a6f1b service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:31.794560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-79d227f6-f9bf-4271-aec5-8c24255ed000 req-5c258a5b-10f5-41c3-bc2b-5b3eed9a6f1b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:31.795353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-79d227f6-f9bf-4271-aec5-8c24255ed000 req-5c258a5b-10f5-41c3-bc2b-5b3eed9a6f1b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:31.797003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3fe0333d-a38a-433d-b6e1-109d294d9f25 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:31.798485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3fe0333d-a38a-433d-b6e1-109d294d9f25 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:31.804969 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3fe0333d-a38a-433d-b6e1-109d294d9f25 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.125443 Oct 04 21:10:31.806032 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 683/1356] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:31 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:31.808931 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-79d227f6-f9bf-4271-aec5-8c24255ed000 req-5c258a5b-10f5-41c3-bc2b-5b3eed9a6f1b service nova] Creating event network-vif-deleted:59e997dc-877a-4edb-8588-607e62851bd1 for instance 06d4ebc0-b7ec-4481-ae12-df4530909f2d on n-h2-860282-1 Oct 04 21:10:31.813242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-10e8f124-aa9e-4f21-b858-8bc45764bff2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:31.813916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-10e8f124-aa9e-4f21-b858-8bc45764bff2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:31.815563 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-79d227f6-f9bf-4271-aec5-8c24255ed000 req-5c258a5b-10f5-41c3-bc2b-5b3eed9a6f1b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036705 Oct 04 21:10:31.818476 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 674/1357] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:31.820110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10e8f124-aa9e-4f21-b858-8bc45764bff2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:31.820757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10e8f124-aa9e-4f21-b858-8bc45764bff2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:31.821162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10e8f124-aa9e-4f21-b858-8bc45764bff2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:31.821806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10e8f124-aa9e-4f21-b858-8bc45764bff2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:31.823306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10e8f124-aa9e-4f21-b858-8bc45764bff2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:31.824243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10e8f124-aa9e-4f21-b858-8bc45764bff2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:31.830347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-df51233c-176c-45ef-ab8d-27cc5e0cc95b req-e8207359-e4f5-4c24-a989-bef834bfd347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fb0e75-0b0d-4f33-8494-c0fdc2be222d", "name": "network-vif-deleted", "tag": "14864892-4e40-4a93-81ac-834038e82ec4"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:31.847205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-df51233c-176c-45ef-ab8d-27cc5e0cc95b req-e8207359-e4f5-4c24-a989-bef834bfd347 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:31.847205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-df51233c-176c-45ef-ab8d-27cc5e0cc95b req-e8207359-e4f5-4c24-a989-bef834bfd347 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:31.847205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-df51233c-176c-45ef-ab8d-27cc5e0cc95b req-e8207359-e4f5-4c24-a989-bef834bfd347 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:31.859892 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-df51233c-176c-45ef-ab8d-27cc5e0cc95b req-e8207359-e4f5-4c24-a989-bef834bfd347 service nova] Creating event network-vif-deleted:14864892-4e40-4a93-81ac-834038e82ec4 for instance 60fb0e75-0b0d-4f33-8494-c0fdc2be222d on n-h2-860282-1 Oct 04 21:10:31.866496 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-df51233c-176c-45ef-ab8d-27cc5e0cc95b req-e8207359-e4f5-4c24-a989-bef834bfd347 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042758 Oct 04 21:10:31.867451 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 675/1358] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:31.874245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-40cd17ec-45a9-410e-82d0-50acadd6a61c tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Action: 'update_all', calling method: .version_select at 0x7f57907429d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:31.936225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-40cd17ec-45a9-410e-82d0-50acadd6a61c tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Getting quotas for project 43cbb76e016e467b9997d2a50114ec20. Resources: dict_keys(['metadata_items']) {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:10:31.945753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-40cd17ec-45a9-410e-82d0-50acadd6a61c tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Getting quotas for user 77c49f9bb4224668a49e65d0ae0c4303 and project 43cbb76e016e467b9997d2a50114ec20. Resources: dict_keys(['metadata_items']) {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:10:31.965604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:31.992593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-10e8f124-aa9e-4f21-b858-8bc45764bff2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:32.002533 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-10e8f124-aa9e-4f21-b858-8bc45764bff2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.195453 Oct 04 21:10:32.003118 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 684/1359] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:31 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:32.352520 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-40cd17ec-45a9-410e-82d0-50acadd6a61c tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] 10.222.0.30 "PUT /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.483543 Oct 04 21:10:32.353195 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 676/1360] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:10:31 2022] PUT /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata => generated 61 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:32.363210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b8def1a9-ca6c-4d16-9c44-4eff2552983f tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Calling method '.version_select at 0x7f57900b80d0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:32.368933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:32.432175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cc402a33-3ec2-42f6-93c8-b12cfa57a8d3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:32.432912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cc402a33-3ec2-42f6-93c8-b12cfa57a8d3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:32.440704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc402a33-3ec2-42f6-93c8-b12cfa57a8d3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:32.441198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc402a33-3ec2-42f6-93c8-b12cfa57a8d3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:32.441687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc402a33-3ec2-42f6-93c8-b12cfa57a8d3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:32.442396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc402a33-3ec2-42f6-93c8-b12cfa57a8d3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:32.442885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc402a33-3ec2-42f6-93c8-b12cfa57a8d3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:32.444384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc402a33-3ec2-42f6-93c8-b12cfa57a8d3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:32.608555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cc402a33-3ec2-42f6-93c8-b12cfa57a8d3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:32.619287 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cc402a33-3ec2-42f6-93c8-b12cfa57a8d3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1377 microversion: 2.1 time: 0.190948 Oct 04 21:10:32.620002 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 677/1361] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:32 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1377 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:10:32.625824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0ffc0fd9-ddb1-43f9-a763-f0e69c0b18a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:32.626513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0ffc0fd9-ddb1-43f9-a763-f0e69c0b18a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:32.641094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0ffc0fd9-ddb1-43f9-a763-f0e69c0b18a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:32.641588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0ffc0fd9-ddb1-43f9-a763-f0e69c0b18a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:32.642024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0ffc0fd9-ddb1-43f9-a763-f0e69c0b18a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:32.642728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0ffc0fd9-ddb1-43f9-a763-f0e69c0b18a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:32.643181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0ffc0fd9-ddb1-43f9-a763-f0e69c0b18a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:32.643601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0ffc0fd9-ddb1-43f9-a763-f0e69c0b18a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:32.793811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0ffc0fd9-ddb1-43f9-a763-f0e69c0b18a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:32.806713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0ffc0fd9-ddb1-43f9-a763-f0e69c0b18a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:32.814137 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b8def1a9-ca6c-4d16-9c44-4eff2552983f tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] 10.222.0.30 "DELETE /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.454283 Oct 04 21:10:32.815047 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 685/1362] 10.222.0.30 () {58 vars in 1296 bytes} [Tue Oct 4 21:10:32 2022] DELETE /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata/os_version => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:10:32.816837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0ffc0fd9-ddb1-43f9-a763-f0e69c0b18a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:32.818356 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0ffc0fd9-ddb1-43f9-a763-f0e69c0b18a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.197256 Oct 04 21:10:32.820824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a5056940-b1bc-44c6-bd2e-b658b673191c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:32.822092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a5056940-b1bc-44c6-bd2e-b658b673191c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 06d4ebc0-b7ec-4481-ae12-df4530909f2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:32.829996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5056940-b1bc-44c6-bd2e-b658b673191c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:32.830816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5056940-b1bc-44c6-bd2e-b658b673191c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:32.831552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5056940-b1bc-44c6-bd2e-b658b673191c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:32.832349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5056940-b1bc-44c6-bd2e-b658b673191c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:32.833099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5056940-b1bc-44c6-bd2e-b658b673191c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:32.833682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5056940-b1bc-44c6-bd2e-b658b673191c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:32.843195 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 678/1363] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:32 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:32.848484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a4af4c34-9df7-4859-ad62-ba3591794726 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:32.849508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a4af4c34-9df7-4859-ad62-ba3591794726 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:32.859100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4af4c34-9df7-4859-ad62-ba3591794726 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:32.859829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4af4c34-9df7-4859-ad62-ba3591794726 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:32.860514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4af4c34-9df7-4859-ad62-ba3591794726 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:32.861639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4af4c34-9df7-4859-ad62-ba3591794726 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:32.862277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4af4c34-9df7-4859-ad62-ba3591794726 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:32.862711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4af4c34-9df7-4859-ad62-ba3591794726 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:32.927375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5056940-b1bc-44c6-bd2e-b658b673191c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:32.928224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5056940-b1bc-44c6-bd2e-b658b673191c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:32.928896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5056940-b1bc-44c6-bd2e-b658b673191c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:32.931773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-a5056940-b1bc-44c6-bd2e-b658b673191c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lazy-loading 'fault' on Instance uuid 06d4ebc0-b7ec-4481-ae12-df4530909f2d {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:10:33.018220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a5056940-b1bc-44c6-bd2e-b658b673191c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:33.047446 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a5056940-b1bc-44c6-bd2e-b658b673191c tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/06d4ebc0-b7ec-4481-ae12-df4530909f2d" status: 200 len: 1308 microversion: 2.1 time: 0.224459 Oct 04 21:10:33.048449 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 686/1364] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:32 2022] GET /compute/v2.1/servers/06d4ebc0-b7ec-4481-ae12-df4530909f2d => generated 1308 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:33.063536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d95c78a2-5b3b-4d0d-9bf9-3e692d359592 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Calling method '.version_select at 0x7f5790035c10>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:33.105354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a4af4c34-9df7-4859-ad62-ba3591794726 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:33.115439 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a4af4c34-9df7-4859-ad62-ba3591794726 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1471 microversion: 2.1 time: 0.270775 Oct 04 21:10:33.117206 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 679/1365] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:32 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1471 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:33.127389 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d95c78a2-5b3b-4d0d-9bf9-3e692d359592 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] 10.222.0.30 "GET /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata" status: 200 len: 37 microversion: 2.1 time: 0.071439 Oct 04 21:10:33.127494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-416f9c1d-7a70-486f-85fa-48dd126eb8f3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:33.127582 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 687/1366] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Oct 4 21:10:33 2022] GET /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata => generated 37 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:33.127664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-416f9c1d-7a70-486f-85fa-48dd126eb8f3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:33.129201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-49896b31-ba18-4203-a12e-31298349f68c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:33.130079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-49896b31-ba18-4203-a12e-31298349f68c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:33.131910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-416f9c1d-7a70-486f-85fa-48dd126eb8f3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:33.132573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-416f9c1d-7a70-486f-85fa-48dd126eb8f3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:33.133172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-416f9c1d-7a70-486f-85fa-48dd126eb8f3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:33.134090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-416f9c1d-7a70-486f-85fa-48dd126eb8f3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:33.134805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-416f9c1d-7a70-486f-85fa-48dd126eb8f3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:33.135409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-416f9c1d-7a70-486f-85fa-48dd126eb8f3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:33.139399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49896b31-ba18-4203-a12e-31298349f68c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:33.140035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49896b31-ba18-4203-a12e-31298349f68c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:33.140495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49896b31-ba18-4203-a12e-31298349f68c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:33.142929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49896b31-ba18-4203-a12e-31298349f68c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:33.144297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49896b31-ba18-4203-a12e-31298349f68c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:33.144765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49896b31-ba18-4203-a12e-31298349f68c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:33.256532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-416f9c1d-7a70-486f-85fa-48dd126eb8f3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:33.268238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-416f9c1d-7a70-486f-85fa-48dd126eb8f3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:33.270007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-416f9c1d-7a70-486f-85fa-48dd126eb8f3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:33.280134 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-416f9c1d-7a70-486f-85fa-48dd126eb8f3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.157179 Oct 04 21:10:33.280134 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 680/1367] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:33 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:33.281824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-89a99059-04be-4d3c-99c3-a09c42e7c416 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Action: 'update_all', calling method: .version_select at 0x7f57907424c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:33.339009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-89a99059-04be-4d3c-99c3-a09c42e7c416 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Getting quotas for project 43cbb76e016e467b9997d2a50114ec20. Resources: dict_keys(['metadata_items']) {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:10:33.339952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-49896b31-ba18-4203-a12e-31298349f68c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:33.345214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-89a99059-04be-4d3c-99c3-a09c42e7c416 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Getting quotas for user 77c49f9bb4224668a49e65d0ae0c4303 and project 43cbb76e016e467b9997d2a50114ec20. Resources: dict_keys(['metadata_items']) {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:10:33.351373 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-49896b31-ba18-4203-a12e-31298349f68c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.226726 Oct 04 21:10:33.352406 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 688/1368] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:33 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:33.644124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f7afca3d-5ea0-4d6d-9545-3e39caac45b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:33.644658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f7afca3d-5ea0-4d6d-9545-3e39caac45b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:33.650896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7afca3d-5ea0-4d6d-9545-3e39caac45b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:33.651394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7afca3d-5ea0-4d6d-9545-3e39caac45b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:33.651838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7afca3d-5ea0-4d6d-9545-3e39caac45b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:33.654804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7afca3d-5ea0-4d6d-9545-3e39caac45b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:33.654804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7afca3d-5ea0-4d6d-9545-3e39caac45b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:33.654804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7afca3d-5ea0-4d6d-9545-3e39caac45b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:33.702803 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-89a99059-04be-4d3c-99c3-a09c42e7c416 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] 10.222.0.30 "PUT /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.425239 Oct 04 21:10:33.703458 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 681/1369] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:10:33 2022] PUT /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata => generated 61 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:33.712763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-08ab5772-c1a6-4c7f-8584-9de1be75ed15 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Calling method '.version_select at 0x7f5790d30430>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:33.756023 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-08ab5772-c1a6-4c7f-8584-9de1be75ed15 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] 10.222.0.30 "GET /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.046985 Oct 04 21:10:33.756882 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 682/1370] 10.222.0.30 () {58 vars in 1290 bytes} [Tue Oct 4 21:10:33 2022] GET /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata/os_distro => generated 33 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:10:33.768590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-532dc8c0-bacf-4d5d-a7d1-3b45859f6fdf tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Action: 'update_all', calling method: .version_select at 0x7f57907429d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:33.825582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-532dc8c0-bacf-4d5d-a7d1-3b45859f6fdf tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Getting quotas for project 43cbb76e016e467b9997d2a50114ec20. Resources: dict_keys(['metadata_items']) {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:10:33.833557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-532dc8c0-bacf-4d5d-a7d1-3b45859f6fdf tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Getting quotas for user 77c49f9bb4224668a49e65d0ae0c4303 and project 43cbb76e016e467b9997d2a50114ec20. Resources: dict_keys(['metadata_items']) {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:10:33.904314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f7afca3d-5ea0-4d6d-9545-3e39caac45b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:33.904314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:33.911705 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f7afca3d-5ea0-4d6d-9545-3e39caac45b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1377 microversion: 2.1 time: 0.271705 Oct 04 21:10:33.922672 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 689/1371] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:33 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1377 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:33.922672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-98290367-8015-4210-af89-16a18c33a2b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:33.922672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-98290367-8015-4210-af89-16a18c33a2b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:33.929697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98290367-8015-4210-af89-16a18c33a2b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:33.930837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98290367-8015-4210-af89-16a18c33a2b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:33.931641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98290367-8015-4210-af89-16a18c33a2b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:33.932558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98290367-8015-4210-af89-16a18c33a2b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:33.933139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98290367-8015-4210-af89-16a18c33a2b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:33.933676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98290367-8015-4210-af89-16a18c33a2b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:34.027578 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-532dc8c0-bacf-4d5d-a7d1-3b45859f6fdf tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] 10.222.0.30 "PUT /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.263458 Oct 04 21:10:34.028156 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 683/1372] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:10:33 2022] PUT /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata => generated 61 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:34.039388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fe93825b-b131-450f-8387-4180903d2e34 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Calling method '.version_select at 0x7f57908ff820>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:34.096845 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fe93825b-b131-450f-8387-4180903d2e34 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] 10.222.0.30 "GET /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.060843 Oct 04 21:10:34.097958 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 684/1373] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Oct 4 21:10:34 2022] GET /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata => generated 61 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:10:34.103070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d1b415b1-05f1-4aa1-8bcd-2022f76cd12e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:34.104108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d1b415b1-05f1-4aa1-8bcd-2022f76cd12e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 06d4ebc0-b7ec-4481-ae12-df4530909f2d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:34.111580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1b415b1-05f1-4aa1-8bcd-2022f76cd12e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:34.112124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1b415b1-05f1-4aa1-8bcd-2022f76cd12e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:34.112592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1b415b1-05f1-4aa1-8bcd-2022f76cd12e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:34.113328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1b415b1-05f1-4aa1-8bcd-2022f76cd12e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:34.114922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1b415b1-05f1-4aa1-8bcd-2022f76cd12e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:34.115064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1b415b1-05f1-4aa1-8bcd-2022f76cd12e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:34.134446 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-d1b415b1-05f1-4aa1-8bcd-2022f76cd12e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] HTTP exception thrown: Instance 06d4ebc0-b7ec-4481-ae12-df4530909f2d could not be found. Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d1b415b1-05f1-4aa1-8bcd-2022f76cd12e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Request method failure captured: Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/06d4ebc0-b7ec-4481-ae12-df4530909f2d HTTP/1.1 Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKCSppkDAXSjwCSQa1f69X7mZVl7uZCSLTAHkzCtM2WTMjjTMUCKpz98J5Gj1CKCaKAVO-07ppp3m5zpHBQBOvXrxv-C9cE1HJ_RUrNofezjxAPsUNqPHzklSFFJuiasvRr2uETo5d4QJvlemPPKWE4rz9k2ow6zF89U2q-GMS4a-Gw Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 801ce5c5897d4894a6a2ffc1b27191aa Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/801ce5c5897d4894a6a2ffc1b27191aa"}]}] Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 801ce5c5897d4894a6a2ffc1b27191aa Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersOnMultiNodesTest-2051543181-project Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 0f0ac29dc4e440e785408fa1dfedce5e Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersOnMultiNodesTest-2051543181-project Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 06d4ebc0-b7ec-4481-ae12-df4530909f2d could not be found. Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '06d4ebc0-b7ec-4481-ae12-df4530909f2d'} Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d4ebc0-b7ec-4481-ae12-df4530909f2d could not be found. Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d4ebc0-b7ec-4481-ae12-df4530909f2d could not be found. Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:10:34.137037 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:34.147002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:34.147002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:10:34.147002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:10:34.147002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:10:34.147002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:10:34.147002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d4ebc0-b7ec-4481-ae12-df4530909f2d could not be found. Oct 04 21:10:34.147002 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:34.147002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d1b415b1-05f1-4aa1-8bcd-2022f76cd12e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Returning 404 to user: Instance 06d4ebc0-b7ec-4481-ae12-df4530909f2d could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:10:34.147002 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d1b415b1-05f1-4aa1-8bcd-2022f76cd12e tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/06d4ebc0-b7ec-4481-ae12-df4530909f2d" status: 404 len: 111 microversion: 2.1 time: 0.040874 Oct 04 21:10:34.147002 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 685/1374] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:34 2022] GET /compute/v2.1/servers/06d4ebc0-b7ec-4481-ae12-df4530909f2d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:10:34.147002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-000260f4-4dfd-4e49-a797-488800e558e3 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Action: 'update_all', calling method: .version_select at 0x7f579086e3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:34.194423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-98290367-8015-4210-af89-16a18c33a2b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:34.204570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-98290367-8015-4210-af89-16a18c33a2b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:34.206120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-98290367-8015-4210-af89-16a18c33a2b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:34.207289 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-98290367-8015-4210-af89-16a18c33a2b9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.293223 Oct 04 21:10:34.217771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-000260f4-4dfd-4e49-a797-488800e558e3 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Getting quotas for project 43cbb76e016e467b9997d2a50114ec20. Resources: dict_keys(['metadata_items']) {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:10:34.222143 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 690/1375] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:33 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:34.226881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-000260f4-4dfd-4e49-a797-488800e558e3 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Getting quotas for user 77c49f9bb4224668a49e65d0ae0c4303 and project 43cbb76e016e467b9997d2a50114ec20. Resources: dict_keys(['metadata_items']) {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:10:34.231044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-22aeac89-4b87-48bf-98dc-eca762b3aedf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:34.231676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-22aeac89-4b87-48bf-98dc-eca762b3aedf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:34.238389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22aeac89-4b87-48bf-98dc-eca762b3aedf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:34.238956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22aeac89-4b87-48bf-98dc-eca762b3aedf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:34.240884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22aeac89-4b87-48bf-98dc-eca762b3aedf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:34.240884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22aeac89-4b87-48bf-98dc-eca762b3aedf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:34.240884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22aeac89-4b87-48bf-98dc-eca762b3aedf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:34.241157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22aeac89-4b87-48bf-98dc-eca762b3aedf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:34.410277 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-000260f4-4dfd-4e49-a797-488800e558e3 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] 10.222.0.30 "PUT /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.267929 Oct 04 21:10:34.412065 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 686/1376] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:10:34 2022] PUT /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata => generated 61 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:34.417949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e6b99710-9fc9-4bc7-8bd6-c89ae207b9ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:34.418786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e6b99710-9fc9-4bc7-8bd6-c89ae207b9ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:34.425658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6b99710-9fc9-4bc7-8bd6-c89ae207b9ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:34.426344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6b99710-9fc9-4bc7-8bd6-c89ae207b9ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:34.426865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6b99710-9fc9-4bc7-8bd6-c89ae207b9ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:34.427657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6b99710-9fc9-4bc7-8bd6-c89ae207b9ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:34.428194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6b99710-9fc9-4bc7-8bd6-c89ae207b9ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:34.428687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6b99710-9fc9-4bc7-8bd6-c89ae207b9ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:34.453981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-22aeac89-4b87-48bf-98dc-eca762b3aedf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:34.461950 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-22aeac89-4b87-48bf-98dc-eca762b3aedf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1471 microversion: 2.1 time: 0.238605 Oct 04 21:10:34.462530 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 691/1377] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:34 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1471 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:34.465081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6b99710-9fc9-4bc7-8bd6-c89ae207b9ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:34.465602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6b99710-9fc9-4bc7-8bd6-c89ae207b9ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:34.466038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6b99710-9fc9-4bc7-8bd6-c89ae207b9ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:34.467086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-e6b99710-9fc9-4bc7-8bd6-c89ae207b9ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lazy-loading 'fault' on Instance uuid 60fb0e75-0b0d-4f33-8494-c0fdc2be222d {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:10:34.468427 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9ec45063-ba37-4959-9b4f-cb847119bca8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:34.469251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9ec45063-ba37-4959-9b4f-cb847119bca8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:34.475987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9ec45063-ba37-4959-9b4f-cb847119bca8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:34.476715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9ec45063-ba37-4959-9b4f-cb847119bca8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:34.477342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9ec45063-ba37-4959-9b4f-cb847119bca8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:34.478266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9ec45063-ba37-4959-9b4f-cb847119bca8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:34.478889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9ec45063-ba37-4959-9b4f-cb847119bca8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:34.479638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9ec45063-ba37-4959-9b4f-cb847119bca8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:34.518540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e6b99710-9fc9-4bc7-8bd6-c89ae207b9ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:34.530994 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e6b99710-9fc9-4bc7-8bd6-c89ae207b9ba tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d" status: 200 len: 1308 microversion: 2.1 time: 0.113942 Oct 04 21:10:34.552368 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 687/1378] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:34 2022] GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d => generated 1308 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:34.556463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-534e4e09-9ffe-4f5a-aab6-12adcbf03c9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:34.557844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-534e4e09-9ffe-4f5a-aab6-12adcbf03c9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:34.563236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9ec45063-ba37-4959-9b4f-cb847119bca8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:34.564648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-534e4e09-9ffe-4f5a-aab6-12adcbf03c9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:34.565151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-534e4e09-9ffe-4f5a-aab6-12adcbf03c9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:34.565637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-534e4e09-9ffe-4f5a-aab6-12adcbf03c9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:34.566328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-534e4e09-9ffe-4f5a-aab6-12adcbf03c9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:34.566849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-534e4e09-9ffe-4f5a-aab6-12adcbf03c9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:34.567655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-534e4e09-9ffe-4f5a-aab6-12adcbf03c9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:34.574316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9ec45063-ba37-4959-9b4f-cb847119bca8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:34.577355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9ec45063-ba37-4959-9b4f-cb847119bca8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:34.587610 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9ec45063-ba37-4959-9b4f-cb847119bca8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.121394 Oct 04 21:10:34.604169 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 692/1379] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:34 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:34.609360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cb61c873-930e-4787-95d3-2bba00e74747 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Action: 'update_all', calling method: .version_select at 0x7f5790035ca0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:34.666311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-cb61c873-930e-4787-95d3-2bba00e74747 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Getting quotas for project 43cbb76e016e467b9997d2a50114ec20. Resources: dict_keys(['metadata_items']) {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:10:34.671557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-cb61c873-930e-4787-95d3-2bba00e74747 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Getting quotas for user 77c49f9bb4224668a49e65d0ae0c4303 and project 43cbb76e016e467b9997d2a50114ec20. Resources: dict_keys(['metadata_items']) {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:10:34.686525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:35.081756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-534e4e09-9ffe-4f5a-aab6-12adcbf03c9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:35.095583 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-534e4e09-9ffe-4f5a-aab6-12adcbf03c9f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.543067 Oct 04 21:10:35.096412 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 688/1380] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:34 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:35.106783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-296008f5-63c0-4611-adcd-128a638a3397 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:35.108374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-296008f5-63c0-4611-adcd-128a638a3397 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:35.120558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-296008f5-63c0-4611-adcd-128a638a3397 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:35.123933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-296008f5-63c0-4611-adcd-128a638a3397 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:35.126415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-296008f5-63c0-4611-adcd-128a638a3397 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:35.127172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-296008f5-63c0-4611-adcd-128a638a3397 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:35.127657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-296008f5-63c0-4611-adcd-128a638a3397 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:35.128075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-296008f5-63c0-4611-adcd-128a638a3397 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:35.320420 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cb61c873-930e-4787-95d3-2bba00e74747 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] 10.222.0.30 "PUT /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata" status: 200 len: 64 microversion: 2.1 time: 0.715019 Oct 04 21:10:35.321332 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 693/1381] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:10:34 2022] PUT /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata => generated 64 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:35.331020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8fc1970a-bb2c-47eb-9975-11d304e1d84b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:35.336208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8fc1970a-bb2c-47eb-9975-11d304e1d84b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:35.338049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fc1970a-bb2c-47eb-9975-11d304e1d84b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:35.339075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fc1970a-bb2c-47eb-9975-11d304e1d84b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:35.339695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fc1970a-bb2c-47eb-9975-11d304e1d84b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:35.340766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fc1970a-bb2c-47eb-9975-11d304e1d84b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:35.341197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fc1970a-bb2c-47eb-9975-11d304e1d84b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:35.341438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-296008f5-63c0-4611-adcd-128a638a3397 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:35.342226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fc1970a-bb2c-47eb-9975-11d304e1d84b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:35.352159 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-296008f5-63c0-4611-adcd-128a638a3397 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1377 microversion: 2.1 time: 0.254245 Oct 04 21:10:35.353193 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 689/1382] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:35 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1377 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:35.358389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d7db6a43-16ae-415f-a7bb-56efddf3fe66 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Calling method '.version_select at 0x7f579011f1f0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:35.400620 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d7db6a43-16ae-415f-a7bb-56efddf3fe66 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] 10.222.0.30 "GET /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata" status: 200 len: 64 microversion: 2.1 time: 0.046173 Oct 04 21:10:35.401354 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 690/1383] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Oct 4 21:10:35 2022] GET /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata => generated 64 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:35.413361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ca3b042d-8b2a-452f-abd9-069cb2b9bd47 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Action: 'update_all', calling method: .version_select at 0x7f5790b3df70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:35.478156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ca3b042d-8b2a-452f-abd9-069cb2b9bd47 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Getting quotas for project 43cbb76e016e467b9997d2a50114ec20. Resources: dict_keys(['metadata_items']) {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:10:35.484933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ca3b042d-8b2a-452f-abd9-069cb2b9bd47 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Getting quotas for user 77c49f9bb4224668a49e65d0ae0c4303 and project 43cbb76e016e467b9997d2a50114ec20. Resources: dict_keys(['metadata_items']) {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:10:35.501531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8fc1970a-bb2c-47eb-9975-11d304e1d84b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:35.513030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8fc1970a-bb2c-47eb-9975-11d304e1d84b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:35.515542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8fc1970a-bb2c-47eb-9975-11d304e1d84b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:35.517933 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8fc1970a-bb2c-47eb-9975-11d304e1d84b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.190011 Oct 04 21:10:35.518068 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 694/1384] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:35 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:35.523616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9183d1bb-d8b1-479b-85ac-1fbc618a8f8e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:35.524590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9183d1bb-d8b1-479b-85ac-1fbc618a8f8e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:35.532095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9183d1bb-d8b1-479b-85ac-1fbc618a8f8e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:35.532948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9183d1bb-d8b1-479b-85ac-1fbc618a8f8e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:35.533652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9183d1bb-d8b1-479b-85ac-1fbc618a8f8e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:35.534606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9183d1bb-d8b1-479b-85ac-1fbc618a8f8e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:35.535166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9183d1bb-d8b1-479b-85ac-1fbc618a8f8e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:35.535885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9183d1bb-d8b1-479b-85ac-1fbc618a8f8e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:35.743349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9183d1bb-d8b1-479b-85ac-1fbc618a8f8e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:35.758732 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9183d1bb-d8b1-479b-85ac-1fbc618a8f8e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1471 microversion: 2.1 time: 0.239286 Oct 04 21:10:35.759343 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 695/1385] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:35 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1471 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:35.767371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-da35b795-592b-4d03-9690-e179897a67bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:35.767997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-da35b795-592b-4d03-9690-e179897a67bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: 60fb0e75-0b0d-4f33-8494-c0fdc2be222d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:35.784607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da35b795-592b-4d03-9690-e179897a67bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:35.785104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da35b795-592b-4d03-9690-e179897a67bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:35.788313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da35b795-592b-4d03-9690-e179897a67bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:35.790359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da35b795-592b-4d03-9690-e179897a67bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:35.792656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da35b795-592b-4d03-9690-e179897a67bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:35.798337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da35b795-592b-4d03-9690-e179897a67bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:35.811421 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-da35b795-592b-4d03-9690-e179897a67bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] HTTP exception thrown: Instance 60fb0e75-0b0d-4f33-8494-c0fdc2be222d could not be found. Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-da35b795-592b-4d03-9690-e179897a67bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Request method failure captured: Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d HTTP/1.1 Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKCSppkDAXSjwCSQa1f69X7mZVl7uZCSLTAHkzCtM2WTMjjTMUCKpz98J5Gj1CKCaKAVO-07ppp3m5zpHBQBOvXrxv-C9cE1HJ_RUrNofezjxAPsUNqPHzklSFFJuiasvRr2uETo5d4QJvlemPPKWE4rz9k2ow6zF89U2q-GMS4a-Gw Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 801ce5c5897d4894a6a2ffc1b27191aa Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/801ce5c5897d4894a6a2ffc1b27191aa"}]}] Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 801ce5c5897d4894a6a2ffc1b27191aa Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersOnMultiNodesTest-2051543181-project Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 0f0ac29dc4e440e785408fa1dfedce5e Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersOnMultiNodesTest-2051543181-project Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 60fb0e75-0b0d-4f33-8494-c0fdc2be222d could not be found. Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '60fb0e75-0b0d-4f33-8494-c0fdc2be222d'} Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60fb0e75-0b0d-4f33-8494-c0fdc2be222d could not be found. Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60fb0e75-0b0d-4f33-8494-c0fdc2be222d could not be found. Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:10:35.813612 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:35.825828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:35.825828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:10:35.825828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:10:35.825828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:10:35.825828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:10:35.825828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60fb0e75-0b0d-4f33-8494-c0fdc2be222d could not be found. Oct 04 21:10:35.825828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:10:35.825828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-da35b795-592b-4d03-9690-e179897a67bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Returning 404 to user: Instance 60fb0e75-0b0d-4f33-8494-c0fdc2be222d could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:10:35.825828 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-da35b795-592b-4d03-9690-e179897a67bc tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d" status: 404 len: 111 microversion: 2.1 time: 0.060186 Oct 04 21:10:35.825828 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 696/1386] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:35 2022] GET /compute/v2.1/servers/60fb0e75-0b0d-4f33-8494-c0fdc2be222d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:10:35.833759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f11d11b1-77c7-4d62-89c7-eeb4a14a92fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:35.834623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f11d11b1-77c7-4d62-89c7-eeb4a14a92fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:35.841398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f11d11b1-77c7-4d62-89c7-eeb4a14a92fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:35.842272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f11d11b1-77c7-4d62-89c7-eeb4a14a92fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:35.845742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f11d11b1-77c7-4d62-89c7-eeb4a14a92fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:35.846745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f11d11b1-77c7-4d62-89c7-eeb4a14a92fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:35.848097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f11d11b1-77c7-4d62-89c7-eeb4a14a92fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:35.848396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f11d11b1-77c7-4d62-89c7-eeb4a14a92fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:35.935925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f11d11b1-77c7-4d62-89c7-eeb4a14a92fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:35.950608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f11d11b1-77c7-4d62-89c7-eeb4a14a92fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:35.953949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f11d11b1-77c7-4d62-89c7-eeb4a14a92fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:35.959998 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f11d11b1-77c7-4d62-89c7-eeb4a14a92fb tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1560 microversion: 2.91 time: 0.131563 Oct 04 21:10:35.965945 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 697/1387] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:35 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1560 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:35.972307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-86f93b1a-0e9e-4368-84ec-5acf9036e2ac tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:35.997350 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ca3b042d-8b2a-452f-abd9-069cb2b9bd47 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] 10.222.0.30 "PUT /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.587950 Oct 04 21:10:35.999092 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 691/1388] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:10:35 2022] PUT /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata => generated 61 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:36.017824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c8bc3de9-0f90-4fcc-8d47-70ab9f6b4ad2 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Action: 'update', calling method: .version_select at 0x7f57908ff550>, body: {"meta": {"os_version": "alt"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:36.073726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-c8bc3de9-0f90-4fcc-8d47-70ab9f6b4ad2 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Getting quotas for project 43cbb76e016e467b9997d2a50114ec20. Resources: dict_keys(['metadata_items']) {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:10:36.079453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-c8bc3de9-0f90-4fcc-8d47-70ab9f6b4ad2 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Getting quotas for user 77c49f9bb4224668a49e65d0ae0c4303 and project 43cbb76e016e467b9997d2a50114ec20. Resources: dict_keys(['metadata_items']) {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:10:36.180651 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-86f93b1a-0e9e-4368-84ec-5acf9036e2ac tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/dc9974f1-f005-4f05-aaf9-1081ec35916b" status: 204 len: 0 microversion: 2.1 time: 0.213385 Oct 04 21:10:36.181336 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 698/1389] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Oct 4 21:10:35 2022] DELETE /compute/v2.1/os-server-groups/dc9974f1-f005-4f05-aaf9-1081ec35916b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:10:36.187294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e84d4724-1269-4194-9989-c98f7f011105 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:36.193786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e84d4724-1269-4194-9989-c98f7f011105 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:36.195260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e84d4724-1269-4194-9989-c98f7f011105 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:36.195971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e84d4724-1269-4194-9989-c98f7f011105 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:36.196637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e84d4724-1269-4194-9989-c98f7f011105 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:36.197600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e84d4724-1269-4194-9989-c98f7f011105 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:36.198270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e84d4724-1269-4194-9989-c98f7f011105 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:36.198905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e84d4724-1269-4194-9989-c98f7f011105 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:36.358609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e84d4724-1269-4194-9989-c98f7f011105 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:36.367400 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e84d4724-1269-4194-9989-c98f7f011105 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1714 microversion: 2.1 time: 0.185029 Oct 04 21:10:36.369561 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 699/1390] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:36 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1714 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:36.374419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-60438b69-2194-4e2c-aebe-7f3e0f494bee tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:36.375014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-60438b69-2194-4e2c-aebe-7f3e0f494bee tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:36.381208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60438b69-2194-4e2c-aebe-7f3e0f494bee tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:36.381797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60438b69-2194-4e2c-aebe-7f3e0f494bee tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:36.382336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60438b69-2194-4e2c-aebe-7f3e0f494bee tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:36.383217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60438b69-2194-4e2c-aebe-7f3e0f494bee tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:36.383843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60438b69-2194-4e2c-aebe-7f3e0f494bee tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:36.384281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60438b69-2194-4e2c-aebe-7f3e0f494bee tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:36.412393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-60438b69-2194-4e2c-aebe-7f3e0f494bee tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:10:36.467603 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c8bc3de9-0f90-4fcc-8d47-70ab9f6b4ad2 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] 10.222.0.30 "PUT /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.453360 Oct 04 21:10:36.468722 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 692/1391] 10.222.0.30 () {60 vars in 1313 bytes} [Tue Oct 4 21:10:36 2022] PUT /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata/os_version => generated 31 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:10:36.473522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8cb132e0-7405-410c-9ae2-c30d9198208c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:36.474396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8cb132e0-7405-410c-9ae2-c30d9198208c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:36.480558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cb132e0-7405-410c-9ae2-c30d9198208c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:36.481059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cb132e0-7405-410c-9ae2-c30d9198208c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:36.481532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cb132e0-7405-410c-9ae2-c30d9198208c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:36.482874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cb132e0-7405-410c-9ae2-c30d9198208c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:36.483417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cb132e0-7405-410c-9ae2-c30d9198208c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:36.483857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cb132e0-7405-410c-9ae2-c30d9198208c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:36.618398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8cb132e0-7405-410c-9ae2-c30d9198208c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:36.626989 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8cb132e0-7405-410c-9ae2-c30d9198208c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1377 microversion: 2.1 time: 0.156908 Oct 04 21:10:36.635530 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 693/1392] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:36 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1377 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:36.648203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-08b37dda-1bcf-4ff7-9ec8-00d17b80a0ce tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Calling method '.version_select at 0x7f57906c48b0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:36.695801 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-08b37dda-1bcf-4ff7-9ec8-00d17b80a0ce tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] 10.222.0.30 "GET /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata" status: 200 len: 58 microversion: 2.1 time: 0.058833 Oct 04 21:10:36.696376 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 694/1393] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Oct 4 21:10:36 2022] GET /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata => generated 58 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:36.702665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4416e125-60ca-4786-8a9b-f94dc28a6f3d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:36.703613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4416e125-60ca-4786-8a9b-f94dc28a6f3d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:36.709721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4416e125-60ca-4786-8a9b-f94dc28a6f3d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:36.710217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4416e125-60ca-4786-8a9b-f94dc28a6f3d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:36.710658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4416e125-60ca-4786-8a9b-f94dc28a6f3d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:36.711370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4416e125-60ca-4786-8a9b-f94dc28a6f3d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:36.711836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4416e125-60ca-4786-8a9b-f94dc28a6f3d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:36.712265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4416e125-60ca-4786-8a9b-f94dc28a6f3d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:36.728253 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-60438b69-2194-4e2c-aebe-7f3e0f494bee tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 204 len: 0 microversion: 2.1 time: 0.354317 Oct 04 21:10:36.728253 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 700/1394] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:10:36 2022] DELETE /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:10:36.731707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5f5c6dd1-618a-4048-9587-2a882eb6fd93 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Action: 'update_all', calling method: .version_select at 0x7f57900141f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:36.792349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5f5c6dd1-618a-4048-9587-2a882eb6fd93 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Getting quotas for project 43cbb76e016e467b9997d2a50114ec20. Resources: dict_keys(['metadata_items']) {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:10:36.798401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5f5c6dd1-618a-4048-9587-2a882eb6fd93 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Getting quotas for user 77c49f9bb4224668a49e65d0ae0c4303 and project 43cbb76e016e467b9997d2a50114ec20. Resources: dict_keys(['metadata_items']) {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:10:36.864381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4416e125-60ca-4786-8a9b-f94dc28a6f3d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:36.876612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4416e125-60ca-4786-8a9b-f94dc28a6f3d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:36.878405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4416e125-60ca-4786-8a9b-f94dc28a6f3d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:36.879860 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4416e125-60ca-4786-8a9b-f94dc28a6f3d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.181665 Oct 04 21:10:36.880570 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 695/1395] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:36 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:36.886870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3dbf00f1-3a77-493f-86b7-dde174574baf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:36.887484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3dbf00f1-3a77-493f-86b7-dde174574baf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:36.897999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3dbf00f1-3a77-493f-86b7-dde174574baf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:36.897999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3dbf00f1-3a77-493f-86b7-dde174574baf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:36.897999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3dbf00f1-3a77-493f-86b7-dde174574baf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:36.897999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3dbf00f1-3a77-493f-86b7-dde174574baf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:36.897999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3dbf00f1-3a77-493f-86b7-dde174574baf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:36.897999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3dbf00f1-3a77-493f-86b7-dde174574baf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:37.067609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3dbf00f1-3a77-493f-86b7-dde174574baf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:37.077878 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3dbf00f1-3a77-493f-86b7-dde174574baf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 200 len: 1472 microversion: 2.1 time: 0.195530 Oct 04 21:10:37.081736 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 696/1396] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:36 2022] GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 1472 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:37.085560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f45e0296-62c3-4578-b103-0e89a4a5d1f2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:37.086478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f45e0296-62c3-4578-b103-0e89a4a5d1f2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:37.096502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f45e0296-62c3-4578-b103-0e89a4a5d1f2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:37.096993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f45e0296-62c3-4578-b103-0e89a4a5d1f2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:37.097658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f45e0296-62c3-4578-b103-0e89a4a5d1f2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:37.098419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f45e0296-62c3-4578-b103-0e89a4a5d1f2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:37.099405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f45e0296-62c3-4578-b103-0e89a4a5d1f2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:37.099910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f45e0296-62c3-4578-b103-0e89a4a5d1f2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:37.180655 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5f5c6dd1-618a-4048-9587-2a882eb6fd93 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] 10.222.0.30 "PUT /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.454467 Oct 04 21:10:37.180840 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 701/1397] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:10:36 2022] PUT /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata => generated 61 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:37.186192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c6035588-11b6-4fa7-a3af-00b053e2b772 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:37.186961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c6035588-11b6-4fa7-a3af-00b053e2b772 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:37.193058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6035588-11b6-4fa7-a3af-00b053e2b772 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:37.193582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6035588-11b6-4fa7-a3af-00b053e2b772 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:37.194027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6035588-11b6-4fa7-a3af-00b053e2b772 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:37.194723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6035588-11b6-4fa7-a3af-00b053e2b772 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:37.195178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6035588-11b6-4fa7-a3af-00b053e2b772 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:37.195599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6035588-11b6-4fa7-a3af-00b053e2b772 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:37.273774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f45e0296-62c3-4578-b103-0e89a4a5d1f2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:37.275943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c6035588-11b6-4fa7-a3af-00b053e2b772 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:37.286750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c6035588-11b6-4fa7-a3af-00b053e2b772 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:37.288256 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f45e0296-62c3-4578-b103-0e89a4a5d1f2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1471 microversion: 2.1 time: 0.208349 Oct 04 21:10:37.288735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c6035588-11b6-4fa7-a3af-00b053e2b772 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:37.288864 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 697/1398] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:37 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1471 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:37.293962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-fb6231ee-8996-4e7d-a837-fb47767d2093 req-e688dee9-f002-4cd7-9e7a-e4840c15d69a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a7d656-c2a8-46fa-88dc-6c6cb1919c3b", "name": "network-vif-plugged", "status": "completed", "tag": "0f85098b-592d-4f47-9950-f46b2b886584"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:37.296368 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c6035588-11b6-4fa7-a3af-00b053e2b772 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1560 microversion: 2.91 time: 0.113171 Oct 04 21:10:37.305453 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 702/1399] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:37 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1560 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:37.305650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-fb6231ee-8996-4e7d-a837-fb47767d2093 req-e688dee9-f002-4cd7-9e7a-e4840c15d69a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:37.305746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a72be8d5-7d07-4eb0-a2fe-11dd1c49ee7c tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Action: 'create', calling method: .version_select at 0x7f5790014940>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:37.306140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-fb6231ee-8996-4e7d-a837-fb47767d2093 req-e688dee9-f002-4cd7-9e7a-e4840c15d69a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:37.306592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-fb6231ee-8996-4e7d-a837-fb47767d2093 req-e688dee9-f002-4cd7-9e7a-e4840c15d69a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:37.321891 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-fb6231ee-8996-4e7d-a837-fb47767d2093 req-e688dee9-f002-4cd7-9e7a-e4840c15d69a service nova] Creating event network-vif-plugged:0f85098b-592d-4f47-9950-f46b2b886584 for instance 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b on n-h2-860282-1 Oct 04 21:10:37.326628 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-fb6231ee-8996-4e7d-a837-fb47767d2093 req-e688dee9-f002-4cd7-9e7a-e4840c15d69a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036358 Oct 04 21:10:37.327481 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 698/1400] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:37.365977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-a72be8d5-7d07-4eb0-a2fe-11dd1c49ee7c tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Getting quotas for project 43cbb76e016e467b9997d2a50114ec20. Resources: dict_keys(['metadata_items']) {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:10:37.372498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-a72be8d5-7d07-4eb0-a2fe-11dd1c49ee7c tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Getting quotas for user 77c49f9bb4224668a49e65d0ae0c4303 and project 43cbb76e016e467b9997d2a50114ec20. Resources: dict_keys(['metadata_items']) {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:10:37.394689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2ce7f65e-0063-4d1d-a12a-911095cf1161 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:37.395392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2ce7f65e-0063-4d1d-a12a-911095cf1161 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:37.413849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ce7f65e-0063-4d1d-a12a-911095cf1161 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:37.414190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ce7f65e-0063-4d1d-a12a-911095cf1161 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:37.414619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ce7f65e-0063-4d1d-a12a-911095cf1161 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:37.415332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ce7f65e-0063-4d1d-a12a-911095cf1161 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:37.415784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ce7f65e-0063-4d1d-a12a-911095cf1161 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:37.416533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ce7f65e-0063-4d1d-a12a-911095cf1161 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:37.421571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:37.558071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2ce7f65e-0063-4d1d-a12a-911095cf1161 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:37.567253 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2ce7f65e-0063-4d1d-a12a-911095cf1161 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1704 microversion: 2.1 time: 0.177119 Oct 04 21:10:37.567967 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 699/1401] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:37 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1704 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:10:37.590686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b29ddf04-5fd7-4530-ab82-aea5a59886cb tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '.version_select at 0x7f5790136820>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:37.594920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b29ddf04-5fd7-4530-ab82-aea5a59886cb tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:37.595413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b29ddf04-5fd7-4530-ab82-aea5a59886cb tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:37.595850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b29ddf04-5fd7-4530-ab82-aea5a59886cb tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:37.612197 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b29ddf04-5fd7-4530-ab82-aea5a59886cb tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 3101 microversion: 2.1 time: 0.024989 Oct 04 21:10:37.612815 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 700/1402] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Oct 4 21:10:37 2022] GET /compute/v2.1/os-migrations => generated 3101 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:10:37.627968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-80c1fbaf-616f-4358-a432-43a72c49aa3c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:37.628589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-80c1fbaf-616f-4358-a432-43a72c49aa3c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:37.635247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80c1fbaf-616f-4358-a432-43a72c49aa3c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:37.635742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80c1fbaf-616f-4358-a432-43a72c49aa3c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:37.636185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80c1fbaf-616f-4358-a432-43a72c49aa3c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:37.636886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80c1fbaf-616f-4358-a432-43a72c49aa3c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:37.637345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80c1fbaf-616f-4358-a432-43a72c49aa3c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:37.637805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80c1fbaf-616f-4358-a432-43a72c49aa3c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:37.773674 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-80c1fbaf-616f-4358-a432-43a72c49aa3c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1855 microversion: 2.1 time: 0.149048 Oct 04 21:10:37.774407 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 701/1403] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:37 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1855 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:10:37.782915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9942dce5-6205-4b83-bd9a-f21375951aea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:37.783523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9942dce5-6205-4b83-bd9a-f21375951aea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:37.790666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9942dce5-6205-4b83-bd9a-f21375951aea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:37.791459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9942dce5-6205-4b83-bd9a-f21375951aea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:37.791707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9942dce5-6205-4b83-bd9a-f21375951aea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:37.792277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9942dce5-6205-4b83-bd9a-f21375951aea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:37.792732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9942dce5-6205-4b83-bd9a-f21375951aea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:37.793222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9942dce5-6205-4b83-bd9a-f21375951aea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:37.794862 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a72be8d5-7d07-4eb0-a2fe-11dd1c49ee7c tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] 10.222.0.30 "POST /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata" status: 200 len: 85 microversion: 2.1 time: 0.496242 Oct 04 21:10:37.795761 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 703/1404] 10.222.0.30 () {60 vars in 1281 bytes} [Tue Oct 4 21:10:37 2022] POST /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata => generated 85 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:37.800170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b1c8e05e-328e-48ef-9056-460266ebc926 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:37.800859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b1c8e05e-328e-48ef-9056-460266ebc926 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:37.807166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1c8e05e-328e-48ef-9056-460266ebc926 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:37.807727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1c8e05e-328e-48ef-9056-460266ebc926 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:37.808101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1c8e05e-328e-48ef-9056-460266ebc926 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:37.808807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1c8e05e-328e-48ef-9056-460266ebc926 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:37.809909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1c8e05e-328e-48ef-9056-460266ebc926 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:37.810035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1c8e05e-328e-48ef-9056-460266ebc926 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:37.994045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9942dce5-6205-4b83-bd9a-f21375951aea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:38.002508 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9942dce5-6205-4b83-bd9a-f21375951aea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1377 microversion: 2.1 time: 0.223995 Oct 04 21:10:38.003092 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 702/1405] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:37 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1377 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:38.004845 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b1c8e05e-328e-48ef-9056-460266ebc926 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1855 microversion: 2.1 time: 0.207996 Oct 04 21:10:38.005473 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 704/1406] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:37 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1855 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:38.007835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e5827e0f-8cbe-4d21-95fc-4e5e86d846e6 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] Calling method '.version_select at 0x7f57907be5e0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:38.010586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-02c2d9d1-a790-46fb-b51e-197d10c907b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:38.011341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-02c2d9d1-a790-46fb-b51e-197d10c907b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:38.020650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02c2d9d1-a790-46fb-b51e-197d10c907b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:38.021144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02c2d9d1-a790-46fb-b51e-197d10c907b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:38.021920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02c2d9d1-a790-46fb-b51e-197d10c907b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:38.022649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02c2d9d1-a790-46fb-b51e-197d10c907b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:38.023118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02c2d9d1-a790-46fb-b51e-197d10c907b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:38.023560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02c2d9d1-a790-46fb-b51e-197d10c907b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:38.066808 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e5827e0f-8cbe-4d21-95fc-4e5e86d846e6 tempest-ImagesMetadataTestJSON-1474853363 tempest-ImagesMetadataTestJSON-1474853363-project] 10.222.0.30 "GET /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata" status: 200 len: 85 microversion: 2.1 time: 0.061991 Oct 04 21:10:38.072902 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 703/1407] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Oct 4 21:10:38 2022] GET /compute/v2.1/images/d73a171f-c2e7-4a25-99f7-87d10f2a471f/metadata => generated 85 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:38.103171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5d6bbff7-55f9-4ddb-b620-130f01c5d8cf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:38.103972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5d6bbff7-55f9-4ddb-b620-130f01c5d8cf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:38.110814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d6bbff7-55f9-4ddb-b620-130f01c5d8cf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:38.111311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d6bbff7-55f9-4ddb-b620-130f01c5d8cf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:38.111811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d6bbff7-55f9-4ddb-b620-130f01c5d8cf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:38.112649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d6bbff7-55f9-4ddb-b620-130f01c5d8cf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:38.113119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d6bbff7-55f9-4ddb-b620-130f01c5d8cf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:38.113572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d6bbff7-55f9-4ddb-b620-130f01c5d8cf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:38.222473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-02c2d9d1-a790-46fb-b51e-197d10c907b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:38.234553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-02c2d9d1-a790-46fb-b51e-197d10c907b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:38.236198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-02c2d9d1-a790-46fb-b51e-197d10c907b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:38.237395 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-02c2d9d1-a790-46fb-b51e-197d10c907b4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.230849 Oct 04 21:10:38.238220 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 705/1408] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:38 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:38.250923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-647d896a-3727-4fec-8a18-dd0a1fa0dbcb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:38.257544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-647d896a-3727-4fec-8a18-dd0a1fa0dbcb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:38.272921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-647d896a-3727-4fec-8a18-dd0a1fa0dbcb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:38.273659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-647d896a-3727-4fec-8a18-dd0a1fa0dbcb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:38.274156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-647d896a-3727-4fec-8a18-dd0a1fa0dbcb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:38.274945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-647d896a-3727-4fec-8a18-dd0a1fa0dbcb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:38.275481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-647d896a-3727-4fec-8a18-dd0a1fa0dbcb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:38.276039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-647d896a-3727-4fec-8a18-dd0a1fa0dbcb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:38.322855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5d6bbff7-55f9-4ddb-b620-130f01c5d8cf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:38.342278 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5d6bbff7-55f9-4ddb-b620-130f01c5d8cf tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 200 len: 1472 microversion: 2.1 time: 0.242946 Oct 04 21:10:38.344022 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 704/1409] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:38 2022] GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 1472 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:38.348842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-30b55ab2-631d-49a3-a5cd-1f4a29bb47d3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:38.349480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-30b55ab2-631d-49a3-a5cd-1f4a29bb47d3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:38.356841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30b55ab2-631d-49a3-a5cd-1f4a29bb47d3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:38.358201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30b55ab2-631d-49a3-a5cd-1f4a29bb47d3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:38.358758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30b55ab2-631d-49a3-a5cd-1f4a29bb47d3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:38.359466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30b55ab2-631d-49a3-a5cd-1f4a29bb47d3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:38.359955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30b55ab2-631d-49a3-a5cd-1f4a29bb47d3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:38.360396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30b55ab2-631d-49a3-a5cd-1f4a29bb47d3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:38.448078 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-647d896a-3727-4fec-8a18-dd0a1fa0dbcb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lazy-loading 'services' on Instance uuid fcf618d0-9d79-435c-ac4f-636ac63dbbda {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:10:38.621324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-30b55ab2-631d-49a3-a5cd-1f4a29bb47d3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:38.629969 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-30b55ab2-631d-49a3-a5cd-1f4a29bb47d3 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1471 microversion: 2.1 time: 0.284986 Oct 04 21:10:38.630550 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 705/1410] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:38 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1471 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:38.635020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-332ef6b3-9df9-4045-a4d5-9dec15afb8fa tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:38.635625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-332ef6b3-9df9-4045-a4d5-9dec15afb8fa tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:38.642532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-332ef6b3-9df9-4045-a4d5-9dec15afb8fa tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:38.643024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-332ef6b3-9df9-4045-a4d5-9dec15afb8fa tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:38.643469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-332ef6b3-9df9-4045-a4d5-9dec15afb8fa tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:38.644225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-332ef6b3-9df9-4045-a4d5-9dec15afb8fa tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:38.644771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-332ef6b3-9df9-4045-a4d5-9dec15afb8fa tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:38.645530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-332ef6b3-9df9-4045-a4d5-9dec15afb8fa tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:38.714065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-332ef6b3-9df9-4045-a4d5-9dec15afb8fa tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:38.722331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-332ef6b3-9df9-4045-a4d5-9dec15afb8fa tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:38.723790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-332ef6b3-9df9-4045-a4d5-9dec15afb8fa tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:38.728489 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-332ef6b3-9df9-4045-a4d5-9dec15afb8fa tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1560 microversion: 2.91 time: 0.096984 Oct 04 21:10:38.729051 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 706/1411] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:38 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1560 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:38.827557 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-647d896a-3727-4fec-8a18-dd0a1fa0dbcb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments/cc69a272-9755-4805-9b22-917f8e844aa5" status: 202 len: 0 microversion: 2.1 time: 0.586588 Oct 04 21:10:38.828216 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 706/1412] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 21:10:38 2022] DELETE /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments/cc69a272-9755-4805-9b22-917f8e844aa5 => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:10:38.836794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3afbb9f3-2405-4f3b-bf52-1ab3bee812a6 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:38.839347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3afbb9f3-2405-4f3b-bf52-1ab3bee812a6 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:38.848895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3afbb9f3-2405-4f3b-bf52-1ab3bee812a6 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:38.849724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3afbb9f3-2405-4f3b-bf52-1ab3bee812a6 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:38.850355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3afbb9f3-2405-4f3b-bf52-1ab3bee812a6 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:38.851258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3afbb9f3-2405-4f3b-bf52-1ab3bee812a6 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:38.852125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3afbb9f3-2405-4f3b-bf52-1ab3bee812a6 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:38.852785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3afbb9f3-2405-4f3b-bf52-1ab3bee812a6 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:38.921142 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3afbb9f3-2405-4f3b-bf52-1ab3bee812a6 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088296 Oct 04 21:10:38.922393 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 707/1413] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:10:38 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:39.043416 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2c4a44fc-ecd6-4d81-b60e-fe93a3883908 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:39.048064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2c4a44fc-ecd6-4d81-b60e-fe93a3883908 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:39.056638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c4a44fc-ecd6-4d81-b60e-fe93a3883908 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:39.057682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c4a44fc-ecd6-4d81-b60e-fe93a3883908 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:39.058131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c4a44fc-ecd6-4d81-b60e-fe93a3883908 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:39.058840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c4a44fc-ecd6-4d81-b60e-fe93a3883908 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:39.059298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c4a44fc-ecd6-4d81-b60e-fe93a3883908 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:39.061363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c4a44fc-ecd6-4d81-b60e-fe93a3883908 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:39.263807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e82c61a9-10be-4a96-bfdd-2f368df42cb9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:39.264423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e82c61a9-10be-4a96-bfdd-2f368df42cb9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:39.271321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e82c61a9-10be-4a96-bfdd-2f368df42cb9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:39.271817 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e82c61a9-10be-4a96-bfdd-2f368df42cb9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:39.272358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e82c61a9-10be-4a96-bfdd-2f368df42cb9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:39.273063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e82c61a9-10be-4a96-bfdd-2f368df42cb9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:39.274051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e82c61a9-10be-4a96-bfdd-2f368df42cb9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:39.274596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e82c61a9-10be-4a96-bfdd-2f368df42cb9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:39.382400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2c4a44fc-ecd6-4d81-b60e-fe93a3883908 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:39.393569 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2c4a44fc-ecd6-4d81-b60e-fe93a3883908 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1377 microversion: 2.1 time: 0.356781 Oct 04 21:10:39.393569 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 707/1414] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:39 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1377 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:39.398641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2e6753e4-21da-4e5e-8808-ade8c3cca8f9 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:39.399263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2e6753e4-21da-4e5e-8808-ade8c3cca8f9 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:39.407495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e6753e4-21da-4e5e-8808-ade8c3cca8f9 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:39.411101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e6753e4-21da-4e5e-8808-ade8c3cca8f9 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:39.411101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e6753e4-21da-4e5e-8808-ade8c3cca8f9 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:39.412681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e6753e4-21da-4e5e-8808-ade8c3cca8f9 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:39.413343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e6753e4-21da-4e5e-8808-ade8c3cca8f9 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:39.413819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e6753e4-21da-4e5e-8808-ade8c3cca8f9 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:39.517087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e82c61a9-10be-4a96-bfdd-2f368df42cb9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:39.527707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e82c61a9-10be-4a96-bfdd-2f368df42cb9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:39.530260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e82c61a9-10be-4a96-bfdd-2f368df42cb9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:39.535830 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e82c61a9-10be-4a96-bfdd-2f368df42cb9 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.271981 Oct 04 21:10:39.535830 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 708/1415] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:39 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:10:39.590686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2e6753e4-21da-4e5e-8808-ade8c3cca8f9 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:39.598868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:39.609787 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2e6753e4-21da-4e5e-8808-ade8c3cca8f9 tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 200 len: 1430 microversion: 2.1 time: 0.213216 Oct 04 21:10:39.614081 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 708/1416] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:39 2022] GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 1430 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:39.630950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-e19c3b2d-3d58-4e6c-bf11-a61621024f03 req-9b504d8e-f21d-4d30-af60-260c7199674a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f201296c-ba54-4f1e-984a-461dfe55d267", "name": "network-vif-deleted", "tag": "1a0e3523-2e2d-43b0-a14b-d80fa3c131ff"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:39.643372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e19c3b2d-3d58-4e6c-bf11-a61621024f03 req-9b504d8e-f21d-4d30-af60-260c7199674a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:39.644114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e19c3b2d-3d58-4e6c-bf11-a61621024f03 req-9b504d8e-f21d-4d30-af60-260c7199674a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:39.644936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e19c3b2d-3d58-4e6c-bf11-a61621024f03 req-9b504d8e-f21d-4d30-af60-260c7199674a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:39.657931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-db59b711-1c40-4f93-8156-2dd8f03ef1ae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:39.658912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-db59b711-1c40-4f93-8156-2dd8f03ef1ae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:39.679505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db59b711-1c40-4f93-8156-2dd8f03ef1ae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:39.679505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db59b711-1c40-4f93-8156-2dd8f03ef1ae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:39.679505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db59b711-1c40-4f93-8156-2dd8f03ef1ae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:39.679505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db59b711-1c40-4f93-8156-2dd8f03ef1ae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:39.680190 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-e19c3b2d-3d58-4e6c-bf11-a61621024f03 req-9b504d8e-f21d-4d30-af60-260c7199674a service nova] Creating event network-vif-deleted:1a0e3523-2e2d-43b0-a14b-d80fa3c131ff for instance f201296c-ba54-4f1e-984a-461dfe55d267 on n-h2-860282-1 Oct 04 21:10:39.680281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db59b711-1c40-4f93-8156-2dd8f03ef1ae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:39.680281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db59b711-1c40-4f93-8156-2dd8f03ef1ae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:39.706294 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-e19c3b2d-3d58-4e6c-bf11-a61621024f03 req-9b504d8e-f21d-4d30-af60-260c7199674a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080177 Oct 04 21:10:39.712023 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 709/1417] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:10:39.760543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cb7fc5b5-7500-4f85-a694-494bd749965b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:39.761865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cb7fc5b5-7500-4f85-a694-494bd749965b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:39.775196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb7fc5b5-7500-4f85-a694-494bd749965b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:39.775764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb7fc5b5-7500-4f85-a694-494bd749965b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:39.776214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb7fc5b5-7500-4f85-a694-494bd749965b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:39.776934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb7fc5b5-7500-4f85-a694-494bd749965b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:39.777406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb7fc5b5-7500-4f85-a694-494bd749965b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:39.777834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb7fc5b5-7500-4f85-a694-494bd749965b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:39.851406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-db59b711-1c40-4f93-8156-2dd8f03ef1ae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:39.864567 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-db59b711-1c40-4f93-8156-2dd8f03ef1ae tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1489 microversion: 2.1 time: 0.213422 Oct 04 21:10:39.879033 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 709/1418] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:39 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1489 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:39.913926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cb7fc5b5-7500-4f85-a694-494bd749965b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:39.926540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cb7fc5b5-7500-4f85-a694-494bd749965b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:39.928945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cb7fc5b5-7500-4f85-a694-494bd749965b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:39.934834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9482549d-86e4-438d-9b69-0a19f4b5e52b tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:39.943989 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cb7fc5b5-7500-4f85-a694-494bd749965b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.182597 Oct 04 21:10:39.944142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9482549d-86e4-438d-9b69-0a19f4b5e52b tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:39.944245 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 710/1419] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:39 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:10:39.956570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9482549d-86e4-438d-9b69-0a19f4b5e52b tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:39.957071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9482549d-86e4-438d-9b69-0a19f4b5e52b tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:39.969543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9482549d-86e4-438d-9b69-0a19f4b5e52b tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:39.970863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9482549d-86e4-438d-9b69-0a19f4b5e52b tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:39.971366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9482549d-86e4-438d-9b69-0a19f4b5e52b tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:39.971819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9482549d-86e4-438d-9b69-0a19f4b5e52b tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:40.039364 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9482549d-86e4-438d-9b69-0a19f4b5e52b tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108249 Oct 04 21:10:40.047000 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 710/1420] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:10:39 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:40.416129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-79c22a1c-9834-4631-9f0a-871454a6bb9e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:40.416738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-79c22a1c-9834-4631-9f0a-871454a6bb9e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:40.423500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79c22a1c-9834-4631-9f0a-871454a6bb9e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:40.424178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79c22a1c-9834-4631-9f0a-871454a6bb9e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:40.427215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79c22a1c-9834-4631-9f0a-871454a6bb9e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:40.427215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79c22a1c-9834-4631-9f0a-871454a6bb9e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:40.427215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79c22a1c-9834-4631-9f0a-871454a6bb9e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:40.427215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79c22a1c-9834-4631-9f0a-871454a6bb9e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:40.564071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4557677a-7ad3-434f-9b9b-95cf46bae421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:40.565363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4557677a-7ad3-434f-9b9b-95cf46bae421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:40.590300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4557677a-7ad3-434f-9b9b-95cf46bae421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:40.591084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4557677a-7ad3-434f-9b9b-95cf46bae421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:40.591705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4557677a-7ad3-434f-9b9b-95cf46bae421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:40.592500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4557677a-7ad3-434f-9b9b-95cf46bae421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:40.593052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4557677a-7ad3-434f-9b9b-95cf46bae421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:40.593518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4557677a-7ad3-434f-9b9b-95cf46bae421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:40.630499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-79c22a1c-9834-4631-9f0a-871454a6bb9e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:40.643204 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-79c22a1c-9834-4631-9f0a-871454a6bb9e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1527 microversion: 2.1 time: 0.231104 Oct 04 21:10:40.644399 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 711/1421] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:40 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1527 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:40.651209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7478d9b4-4add-47bd-b2ee-1d6a9da30b3b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:40.652066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7478d9b4-4add-47bd-b2ee-1d6a9da30b3b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:40.671782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7478d9b4-4add-47bd-b2ee-1d6a9da30b3b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:40.673988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7478d9b4-4add-47bd-b2ee-1d6a9da30b3b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:40.674443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7478d9b4-4add-47bd-b2ee-1d6a9da30b3b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:40.680175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7478d9b4-4add-47bd-b2ee-1d6a9da30b3b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:40.680175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7478d9b4-4add-47bd-b2ee-1d6a9da30b3b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:40.680175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7478d9b4-4add-47bd-b2ee-1d6a9da30b3b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:40.756464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:40.758212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7478d9b4-4add-47bd-b2ee-1d6a9da30b3b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:40.763760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7478d9b4-4add-47bd-b2ee-1d6a9da30b3b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:40.764226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7478d9b4-4add-47bd-b2ee-1d6a9da30b3b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:40.765095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-7478d9b4-4add-47bd-b2ee-1d6a9da30b3b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lazy-loading 'fault' on Instance uuid f201296c-ba54-4f1e-984a-461dfe55d267 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:10:40.866777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7478d9b4-4add-47bd-b2ee-1d6a9da30b3b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ac29dc4e440e785408fa1dfedce5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ce5c5897d4894a6a2ffc1b27191aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:40.888019 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7478d9b4-4add-47bd-b2ee-1d6a9da30b3b tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 200 len: 1307 microversion: 2.1 time: 0.242224 Oct 04 21:10:40.888665 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 712/1422] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:40 2022] GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 1307 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:40.896940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-461ca9c4-a17b-4f2e-a70f-9a5ceb8a3ef4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:40.897596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-461ca9c4-a17b-4f2e-a70f-9a5ceb8a3ef4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:40.922872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-461ca9c4-a17b-4f2e-a70f-9a5ceb8a3ef4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:40.923372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-461ca9c4-a17b-4f2e-a70f-9a5ceb8a3ef4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:40.923818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-461ca9c4-a17b-4f2e-a70f-9a5ceb8a3ef4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:40.924631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-461ca9c4-a17b-4f2e-a70f-9a5ceb8a3ef4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:40.924982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-461ca9c4-a17b-4f2e-a70f-9a5ceb8a3ef4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:40.925406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-461ca9c4-a17b-4f2e-a70f-9a5ceb8a3ef4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:40.942282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4557677a-7ad3-434f-9b9b-95cf46bae421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:40.962784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4557677a-7ad3-434f-9b9b-95cf46bae421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:40.967252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4557677a-7ad3-434f-9b9b-95cf46bae421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:40.973166 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4557677a-7ad3-434f-9b9b-95cf46bae421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.414895 Oct 04 21:10:40.979315 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 711/1423] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:40 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:40.995447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-94efa8e3-9907-4460-b773-18687b47b326 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:40.999518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-94efa8e3-9907-4460-b773-18687b47b326 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:41.015506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94efa8e3-9907-4460-b773-18687b47b326 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:41.016404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94efa8e3-9907-4460-b773-18687b47b326 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:41.016570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94efa8e3-9907-4460-b773-18687b47b326 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:41.019095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94efa8e3-9907-4460-b773-18687b47b326 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:41.019584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94efa8e3-9907-4460-b773-18687b47b326 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:41.022909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94efa8e3-9907-4460-b773-18687b47b326 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:41.144565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-461ca9c4-a17b-4f2e-a70f-9a5ceb8a3ef4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:41.172378 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-461ca9c4-a17b-4f2e-a70f-9a5ceb8a3ef4 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1527 microversion: 2.1 time: 0.268062 Oct 04 21:10:41.174575 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 713/1424] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:40 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1527 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:41.204367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0f0c0f28-054f-41f7-95bd-7a9f705caac0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:41.206874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0f0c0f28-054f-41f7-95bd-7a9f705caac0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:41.219720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f0c0f28-054f-41f7-95bd-7a9f705caac0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:41.223914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f0c0f28-054f-41f7-95bd-7a9f705caac0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:41.224261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f0c0f28-054f-41f7-95bd-7a9f705caac0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:41.224873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f0c0f28-054f-41f7-95bd-7a9f705caac0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:41.227060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f0c0f28-054f-41f7-95bd-7a9f705caac0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:41.228713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f0c0f28-054f-41f7-95bd-7a9f705caac0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:41.330959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0f0c0f28-054f-41f7-95bd-7a9f705caac0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:41.347089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0f0c0f28-054f-41f7-95bd-7a9f705caac0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:41.350529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0f0c0f28-054f-41f7-95bd-7a9f705caac0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:41.359955 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0f0c0f28-054f-41f7-95bd-7a9f705caac0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.163444 Oct 04 21:10:41.361963 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 714/1425] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:41 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:41.367680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-404a103f-fdb3-4b2a-8dcd-a5a1cc703221 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:41.370267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-404a103f-fdb3-4b2a-8dcd-a5a1cc703221 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:41.377023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-404a103f-fdb3-4b2a-8dcd-a5a1cc703221 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:41.377900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-404a103f-fdb3-4b2a-8dcd-a5a1cc703221 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:41.379242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-404a103f-fdb3-4b2a-8dcd-a5a1cc703221 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:41.380932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-404a103f-fdb3-4b2a-8dcd-a5a1cc703221 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:41.381814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-404a103f-fdb3-4b2a-8dcd-a5a1cc703221 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:41.382361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-94efa8e3-9907-4460-b773-18687b47b326 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:41.382756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-404a103f-fdb3-4b2a-8dcd-a5a1cc703221 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:41.397943 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-94efa8e3-9907-4460-b773-18687b47b326 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1477 microversion: 2.1 time: 0.417156 Oct 04 21:10:41.400043 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 712/1426] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:40 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1477 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:41.407816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5d3a264b-5b7b-4c21-809c-830c8466f179 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:41.429110 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-404a103f-fdb3-4b2a-8dcd-a5a1cc703221 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064914 Oct 04 21:10:41.431779 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 715/1427] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:10:41 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:41.546839 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5d3a264b-5b7b-4c21-809c-830c8466f179 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/2cd11cb4-6333-43ab-a095-d4301a490bf8" status: 202 len: 0 microversion: 2.1 time: 0.145582 Oct 04 21:10:41.548408 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 713/1428] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:10:41 2022] DELETE /compute/v2.1/flavors/2cd11cb4-6333-43ab-a095-d4301a490bf8 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:10:41.556511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3f3a0459-0a6f-4c08-9d92-0260d0021994 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:41.599195 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3f3a0459-0a6f-4c08-9d92-0260d0021994 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046495 Oct 04 21:10:41.602086 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 716/1429] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:10:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:41.625790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-019c0904-64c5-499a-bc0c-ed1bb1bfa36a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:41.631178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-019c0904-64c5-499a-bc0c-ed1bb1bfa36a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:41.641553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-019c0904-64c5-499a-bc0c-ed1bb1bfa36a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:41.645759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-019c0904-64c5-499a-bc0c-ed1bb1bfa36a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:41.645759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-019c0904-64c5-499a-bc0c-ed1bb1bfa36a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:41.645759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-019c0904-64c5-499a-bc0c-ed1bb1bfa36a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:41.645759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-019c0904-64c5-499a-bc0c-ed1bb1bfa36a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:41.645759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-019c0904-64c5-499a-bc0c-ed1bb1bfa36a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:41.764732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-019c0904-64c5-499a-bc0c-ed1bb1bfa36a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:41.774140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-019c0904-64c5-499a-bc0c-ed1bb1bfa36a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Old instance type tempest-test_resize_flavor_-1144870918, new instance type m1.heat {{(pid=122757) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:10:41.789951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-019c0904-64c5-499a-bc0c-ed1bb1bfa36a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:10:41.791101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-019c0904-64c5-499a-bc0c-ed1bb1bfa36a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:10:41.794734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-019c0904-64c5-499a-bc0c-ed1bb1bfa36a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:10:41.794734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-019c0904-64c5-499a-bc0c-ed1bb1bfa36a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:10:41.794734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-019c0904-64c5-499a-bc0c-ed1bb1bfa36a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:10:41.915726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0381cbb0-5e65-47be-8475-92d31c647e4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:41.917162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0381cbb0-5e65-47be-8475-92d31c647e4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] [instance: f201296c-ba54-4f1e-984a-461dfe55d267] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:41.928296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0381cbb0-5e65-47be-8475-92d31c647e4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:41.930691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0381cbb0-5e65-47be-8475-92d31c647e4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:41.933711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0381cbb0-5e65-47be-8475-92d31c647e4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:41.935072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0381cbb0-5e65-47be-8475-92d31c647e4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:41.938170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0381cbb0-5e65-47be-8475-92d31c647e4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:41.938802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0381cbb0-5e65-47be-8475-92d31c647e4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:41.968724 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-0381cbb0-5e65-47be-8475-92d31c647e4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] HTTP exception thrown: Instance f201296c-ba54-4f1e-984a-461dfe55d267 could not be found. Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0381cbb0-5e65-47be-8475-92d31c647e4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Request method failure captured: Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 HTTP/1.1 Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKCSppkDAXSjwCSQa1f69X7mZVl7uZCSLTAHkzCtM2WTMjjTMUCKpz98J5Gj1CKCaKAVO-07ppp3m5zpHBQBOvXrxv-C9cE1HJ_RUrNofezjxAPsUNqPHzklSFFJuiasvRr2uETo5d4QJvlemPPKWE4rz9k2ow6zF89U2q-GMS4a-Gw Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 801ce5c5897d4894a6a2ffc1b27191aa Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/801ce5c5897d4894a6a2ffc1b27191aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/801ce5c5897d4894a6a2ffc1b27191aa"}]}] Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 801ce5c5897d4894a6a2ffc1b27191aa Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2051543181 Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersOnMultiNodesTest-2051543181-project Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 0f0ac29dc4e440e785408fa1dfedce5e Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersOnMultiNodesTest-2051543181-project Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance f201296c-ba54-4f1e-984a-461dfe55d267 could not be found. Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'f201296c-ba54-4f1e-984a-461dfe55d267'} Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f201296c-ba54-4f1e-984a-461dfe55d267 could not be found. Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f201296c-ba54-4f1e-984a-461dfe55d267 could not be found. Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:10:41.971131 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:41.976383 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:10:41.976383 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:10:41.976383 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:10:41.976383 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:10:41.976383 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:10:41.976383 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f201296c-ba54-4f1e-984a-461dfe55d267 could not be found. Oct 04 21:10:41.976383 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:10:41.978997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0381cbb0-5e65-47be-8475-92d31c647e4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] Returning 404 to user: Instance f201296c-ba54-4f1e-984a-461dfe55d267 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:10:41.987460 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0381cbb0-5e65-47be-8475-92d31c647e4d tempest-ServersOnMultiNodesTest-2051543181 tempest-ServersOnMultiNodesTest-2051543181-project] 10.222.0.30 "GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267" status: 404 len: 111 microversion: 2.1 time: 0.070625 Oct 04 21:10:42.001723 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 717/1430] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:41 2022] GET /compute/v2.1/servers/f201296c-ba54-4f1e-984a-461dfe55d267 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:10:42.008000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9f4f88da-8575-4a5c-99c6-e5b70b42bd3e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:42.009160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9f4f88da-8575-4a5c-99c6-e5b70b42bd3e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:42.017269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f4f88da-8575-4a5c-99c6-e5b70b42bd3e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:42.018091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f4f88da-8575-4a5c-99c6-e5b70b42bd3e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:42.018781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f4f88da-8575-4a5c-99c6-e5b70b42bd3e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:42.019773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f4f88da-8575-4a5c-99c6-e5b70b42bd3e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:42.020774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f4f88da-8575-4a5c-99c6-e5b70b42bd3e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:42.021515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f4f88da-8575-4a5c-99c6-e5b70b42bd3e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:42.161986 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-019c0904-64c5-499a-bc0c-ed1bb1bfa36a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "POST /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b/action" status: 202 len: 0 microversion: 2.1 time: 0.542555 Oct 04 21:10:42.163191 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 714/1431] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:10:41 2022] POST /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:10:42.178471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-52f3ee3e-8841-4132-a612-5d1ca2c6697a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:42.180334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-52f3ee3e-8841-4132-a612-5d1ca2c6697a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:42.190511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52f3ee3e-8841-4132-a612-5d1ca2c6697a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:42.191309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52f3ee3e-8841-4132-a612-5d1ca2c6697a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:42.192302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52f3ee3e-8841-4132-a612-5d1ca2c6697a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:42.193227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52f3ee3e-8841-4132-a612-5d1ca2c6697a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:42.193997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52f3ee3e-8841-4132-a612-5d1ca2c6697a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:42.194595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52f3ee3e-8841-4132-a612-5d1ca2c6697a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:42.438719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9f4f88da-8575-4a5c-99c6-e5b70b42bd3e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:42.466872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9f4f88da-8575-4a5c-99c6-e5b70b42bd3e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:42.468639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9f4f88da-8575-4a5c-99c6-e5b70b42bd3e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:42.470005 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9f4f88da-8575-4a5c-99c6-e5b70b42bd3e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.466721 Oct 04 21:10:42.470792 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 718/1432] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:42 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:42.483273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fd7e7b4c-f272-4449-88c8-7b2dbdb920e4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:42.488838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fd7e7b4c-f272-4449-88c8-7b2dbdb920e4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:42.501266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd7e7b4c-f272-4449-88c8-7b2dbdb920e4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:42.501842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd7e7b4c-f272-4449-88c8-7b2dbdb920e4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:42.502293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd7e7b4c-f272-4449-88c8-7b2dbdb920e4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:42.503025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd7e7b4c-f272-4449-88c8-7b2dbdb920e4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:42.503490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd7e7b4c-f272-4449-88c8-7b2dbdb920e4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:42.503926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd7e7b4c-f272-4449-88c8-7b2dbdb920e4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:42.513248 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:10:42.517597 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 21:10:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e (ip 10.222.0.30) !!! Oct 04 21:10:42.526087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-52f3ee3e-8841-4132-a612-5d1ca2c6697a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:42.539366 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-52f3ee3e-8841-4132-a612-5d1ca2c6697a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1536 microversion: 2.1 time: 0.371525 Oct 04 21:10:42.541490 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 715/1433] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:42 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1536 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:42.568051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-33761841-d1e3-454f-9b35-03fcaa004438 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:42.568731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-33761841-d1e3-454f-9b35-03fcaa004438 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:42.588146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33761841-d1e3-454f-9b35-03fcaa004438 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:42.595816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33761841-d1e3-454f-9b35-03fcaa004438 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:42.596859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33761841-d1e3-454f-9b35-03fcaa004438 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:42.599590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33761841-d1e3-454f-9b35-03fcaa004438 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:42.602380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33761841-d1e3-454f-9b35-03fcaa004438 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:42.606538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33761841-d1e3-454f-9b35-03fcaa004438 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:42.606920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:42.720547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fd7e7b4c-f272-4449-88c8-7b2dbdb920e4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:42.738970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fd7e7b4c-f272-4449-88c8-7b2dbdb920e4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:42.741848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fd7e7b4c-f272-4449-88c8-7b2dbdb920e4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:42.748856 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fd7e7b4c-f272-4449-88c8-7b2dbdb920e4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.277177 Oct 04 21:10:42.757599 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 719/1434] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:42 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:42.757599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f6cdef54-41d0-4cc0-a7b9-8e0fe39b463f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:42.759161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f6cdef54-41d0-4cc0-a7b9-8e0fe39b463f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:42.772887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6cdef54-41d0-4cc0-a7b9-8e0fe39b463f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:42.774152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6cdef54-41d0-4cc0-a7b9-8e0fe39b463f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:42.775021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6cdef54-41d0-4cc0-a7b9-8e0fe39b463f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:42.778488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6cdef54-41d0-4cc0-a7b9-8e0fe39b463f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:42.780571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6cdef54-41d0-4cc0-a7b9-8e0fe39b463f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:42.783245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6cdef54-41d0-4cc0-a7b9-8e0fe39b463f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:42.855904 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f6cdef54-41d0-4cc0-a7b9-8e0fe39b463f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103339 Oct 04 21:10:42.863352 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 720/1435] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:10:42 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:42.966169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-33761841-d1e3-454f-9b35-03fcaa004438 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:42.977175 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-33761841-d1e3-454f-9b35-03fcaa004438 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1477 microversion: 2.1 time: 0.434433 Oct 04 21:10:42.977814 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 716/1436] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:42 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1477 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:43.505642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4a209039-8a1b-43dd-bd15-32b383d5344c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:43.506252 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4a209039-8a1b-43dd-bd15-32b383d5344c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:43.520767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a209039-8a1b-43dd-bd15-32b383d5344c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:43.522649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a209039-8a1b-43dd-bd15-32b383d5344c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:43.523286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a209039-8a1b-43dd-bd15-32b383d5344c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:43.527044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a209039-8a1b-43dd-bd15-32b383d5344c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:43.527808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a209039-8a1b-43dd-bd15-32b383d5344c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:43.528482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a209039-8a1b-43dd-bd15-32b383d5344c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:43.571381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2bdc70c7-e6ae-4c91-a8ad-3accdf96b4b1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:43.572301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2bdc70c7-e6ae-4c91-a8ad-3accdf96b4b1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:43.580762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2bdc70c7-e6ae-4c91-a8ad-3accdf96b4b1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:43.584784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2bdc70c7-e6ae-4c91-a8ad-3accdf96b4b1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:43.585626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2bdc70c7-e6ae-4c91-a8ad-3accdf96b4b1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:43.586556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2bdc70c7-e6ae-4c91-a8ad-3accdf96b4b1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:43.587206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2bdc70c7-e6ae-4c91-a8ad-3accdf96b4b1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:43.587819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2bdc70c7-e6ae-4c91-a8ad-3accdf96b4b1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:44.355648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4a209039-8a1b-43dd-bd15-32b383d5344c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:44.365047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4a209039-8a1b-43dd-bd15-32b383d5344c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:44.367837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4a209039-8a1b-43dd-bd15-32b383d5344c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:44.369876 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4a209039-8a1b-43dd-bd15-32b383d5344c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.868782 Oct 04 21:10:44.371728 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 721/1437] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:43 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:44.380491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8db3c732-ff03-4431-a8b3-9dc344cdcbc9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:44.383290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8db3c732-ff03-4431-a8b3-9dc344cdcbc9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:44.391831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8db3c732-ff03-4431-a8b3-9dc344cdcbc9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:44.393349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8db3c732-ff03-4431-a8b3-9dc344cdcbc9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:44.394084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8db3c732-ff03-4431-a8b3-9dc344cdcbc9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:44.395058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8db3c732-ff03-4431-a8b3-9dc344cdcbc9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:44.395751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8db3c732-ff03-4431-a8b3-9dc344cdcbc9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:44.396419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8db3c732-ff03-4431-a8b3-9dc344cdcbc9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:44.428286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2bdc70c7-e6ae-4c91-a8ad-3accdf96b4b1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:44.444507 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2bdc70c7-e6ae-4c91-a8ad-3accdf96b4b1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1536 microversion: 2.1 time: 0.877052 Oct 04 21:10:44.445826 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 717/1438] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:43 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1536 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:10:44.454250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-32cc9707-66ea-44ca-ba6d-d98d699187a0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:44.456995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-32cc9707-66ea-44ca-ba6d-d98d699187a0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:44.464262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32cc9707-66ea-44ca-ba6d-d98d699187a0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:44.465136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32cc9707-66ea-44ca-ba6d-d98d699187a0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:44.465921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32cc9707-66ea-44ca-ba6d-d98d699187a0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:44.467399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32cc9707-66ea-44ca-ba6d-d98d699187a0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:44.468141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32cc9707-66ea-44ca-ba6d-d98d699187a0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:44.468795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32cc9707-66ea-44ca-ba6d-d98d699187a0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:44.553523 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-32cc9707-66ea-44ca-ba6d-d98d699187a0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101956 Oct 04 21:10:44.554825 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 718/1439] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:10:44 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:44.559149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8db3c732-ff03-4431-a8b3-9dc344cdcbc9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:44.564701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b06335fe-b622-4a5a-9b79-1fd2f338ca63 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:44.565600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b06335fe-b622-4a5a-9b79-1fd2f338ca63 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:44.572953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b06335fe-b622-4a5a-9b79-1fd2f338ca63 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:44.573457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b06335fe-b622-4a5a-9b79-1fd2f338ca63 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:44.574729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b06335fe-b622-4a5a-9b79-1fd2f338ca63 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:44.575612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b06335fe-b622-4a5a-9b79-1fd2f338ca63 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:44.576364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b06335fe-b622-4a5a-9b79-1fd2f338ca63 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:44.577646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b06335fe-b622-4a5a-9b79-1fd2f338ca63 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:44.580138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8db3c732-ff03-4431-a8b3-9dc344cdcbc9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:44.582243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8db3c732-ff03-4431-a8b3-9dc344cdcbc9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:44.589122 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8db3c732-ff03-4431-a8b3-9dc344cdcbc9 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.215622 Oct 04 21:10:44.590120 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 722/1440] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:44 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:44.943667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b06335fe-b622-4a5a-9b79-1fd2f338ca63 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:44.960980 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b06335fe-b622-4a5a-9b79-1fd2f338ca63 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1477 microversion: 2.1 time: 0.404624 Oct 04 21:10:44.962426 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 719/1441] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:44 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1477 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:45.299085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-5d36e880-0281-4263-9726-9574e974445f req-4c538c1b-8d2e-43b8-85b4-16a3441bf507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2480cf36-216a-4565-a5b3-2430424a7a6e", "name": "network-vif-plugged", "status": "completed", "tag": "91abea23-f356-47a5-8b1c-3915d0031ec2"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:45.338575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5d36e880-0281-4263-9726-9574e974445f req-4c538c1b-8d2e-43b8-85b4-16a3441bf507 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:45.338913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5d36e880-0281-4263-9726-9574e974445f req-4c538c1b-8d2e-43b8-85b4-16a3441bf507 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:45.339983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5d36e880-0281-4263-9726-9574e974445f req-4c538c1b-8d2e-43b8-85b4-16a3441bf507 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:45.369951 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-5d36e880-0281-4263-9726-9574e974445f req-4c538c1b-8d2e-43b8-85b4-16a3441bf507 service nova] Creating event network-vif-plugged:91abea23-f356-47a5-8b1c-3915d0031ec2 for instance 2480cf36-216a-4565-a5b3-2430424a7a6e on n-h1-860282-1 Oct 04 21:10:45.378509 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-5d36e880-0281-4263-9726-9574e974445f req-4c538c1b-8d2e-43b8-85b4-16a3441bf507 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080521 Oct 04 21:10:45.380285 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 723/1442] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:45.405046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5d9a814a-2624-4a6e-bca4-63e0ab03ed95 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:45.406258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5d9a814a-2624-4a6e-bca4-63e0ab03ed95 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:45.425507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d9a814a-2624-4a6e-bca4-63e0ab03ed95 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:45.426590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d9a814a-2624-4a6e-bca4-63e0ab03ed95 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:45.427638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d9a814a-2624-4a6e-bca4-63e0ab03ed95 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:45.429154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d9a814a-2624-4a6e-bca4-63e0ab03ed95 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:45.430533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d9a814a-2624-4a6e-bca4-63e0ab03ed95 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:45.431276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d9a814a-2624-4a6e-bca4-63e0ab03ed95 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:45.476706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-98baae04-939f-4b86-a51b-f98abe4c3fa1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:45.477769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-98baae04-939f-4b86-a51b-f98abe4c3fa1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:45.486306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98baae04-939f-4b86-a51b-f98abe4c3fa1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:45.487119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98baae04-939f-4b86-a51b-f98abe4c3fa1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:45.487749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98baae04-939f-4b86-a51b-f98abe4c3fa1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:45.488648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98baae04-939f-4b86-a51b-f98abe4c3fa1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:45.489322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98baae04-939f-4b86-a51b-f98abe4c3fa1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:45.491333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98baae04-939f-4b86-a51b-f98abe4c3fa1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:45.891780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-98baae04-939f-4b86-a51b-f98abe4c3fa1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:45.925811 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-98baae04-939f-4b86-a51b-f98abe4c3fa1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1536 microversion: 2.1 time: 0.433490 Oct 04 21:10:45.925811 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 724/1443] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:45 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1536 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:45.932940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-be3a9403-63e9-4df0-ab59-bf636c16e229 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:45.939698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-be3a9403-63e9-4df0-ab59-bf636c16e229 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:45.957481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-be3a9403-63e9-4df0-ab59-bf636c16e229 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:45.958612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-be3a9403-63e9-4df0-ab59-bf636c16e229 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:45.959496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-be3a9403-63e9-4df0-ab59-bf636c16e229 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:45.961364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-be3a9403-63e9-4df0-ab59-bf636c16e229 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:45.962048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-be3a9403-63e9-4df0-ab59-bf636c16e229 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:45.962821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-be3a9403-63e9-4df0-ab59-bf636c16e229 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:46.036586 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-be3a9403-63e9-4df0-ab59-bf636c16e229 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113544 Oct 04 21:10:46.037579 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 725/1444] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:10:45 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:46.068402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5466cc51-8ff1-4ebd-baac-55b48567867f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:46.070630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5466cc51-8ff1-4ebd-baac-55b48567867f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:46.079183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5466cc51-8ff1-4ebd-baac-55b48567867f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:46.080442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5466cc51-8ff1-4ebd-baac-55b48567867f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:46.081301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5466cc51-8ff1-4ebd-baac-55b48567867f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:46.083412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5466cc51-8ff1-4ebd-baac-55b48567867f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:46.084794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5466cc51-8ff1-4ebd-baac-55b48567867f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:46.085963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5466cc51-8ff1-4ebd-baac-55b48567867f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:46.087444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=24 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:46.223934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5466cc51-8ff1-4ebd-baac-55b48567867f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:46.234325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5466cc51-8ff1-4ebd-baac-55b48567867f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:46.241655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5466cc51-8ff1-4ebd-baac-55b48567867f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:46.254494 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5466cc51-8ff1-4ebd-baac-55b48567867f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.215586 Oct 04 21:10:46.255307 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 726/1445] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:46 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:46.271469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5e79d479-b0dd-43ac-895e-b764bcff4c17 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:46.274324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5e79d479-b0dd-43ac-895e-b764bcff4c17 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:46.286552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e79d479-b0dd-43ac-895e-b764bcff4c17 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:46.290520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e79d479-b0dd-43ac-895e-b764bcff4c17 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:46.290965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e79d479-b0dd-43ac-895e-b764bcff4c17 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:46.291799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e79d479-b0dd-43ac-895e-b764bcff4c17 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:46.295287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e79d479-b0dd-43ac-895e-b764bcff4c17 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:46.295815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e79d479-b0dd-43ac-895e-b764bcff4c17 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:46.349962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5d9a814a-2624-4a6e-bca4-63e0ab03ed95 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:46.361964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5d9a814a-2624-4a6e-bca4-63e0ab03ed95 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:46.363758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5d9a814a-2624-4a6e-bca4-63e0ab03ed95 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:46.365290 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5d9a814a-2624-4a6e-bca4-63e0ab03ed95 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.965091 Oct 04 21:10:46.376489 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 720/1446] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:45 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:46.528418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5e79d479-b0dd-43ac-895e-b764bcff4c17 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:46.566690 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5e79d479-b0dd-43ac-895e-b764bcff4c17 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1477 microversion: 2.1 time: 0.305301 Oct 04 21:10:46.569308 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 727/1447] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:46 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1477 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:46.949531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-53c144f4-632f-41b6-bdb0-48ee891a1ed2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:46.950811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-53c144f4-632f-41b6-bdb0-48ee891a1ed2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:46.974264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53c144f4-632f-41b6-bdb0-48ee891a1ed2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:46.974903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53c144f4-632f-41b6-bdb0-48ee891a1ed2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:46.975349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53c144f4-632f-41b6-bdb0-48ee891a1ed2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:46.976056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53c144f4-632f-41b6-bdb0-48ee891a1ed2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:46.976691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53c144f4-632f-41b6-bdb0-48ee891a1ed2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:46.977636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53c144f4-632f-41b6-bdb0-48ee891a1ed2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:47.050025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4c424973-91d7-4d4f-9c27-c6db31273099 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:47.052336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4c424973-91d7-4d4f-9c27-c6db31273099 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:47.059247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c424973-91d7-4d4f-9c27-c6db31273099 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:47.060654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c424973-91d7-4d4f-9c27-c6db31273099 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:47.061507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c424973-91d7-4d4f-9c27-c6db31273099 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:47.062272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c424973-91d7-4d4f-9c27-c6db31273099 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:47.062731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c424973-91d7-4d4f-9c27-c6db31273099 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:47.063160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c424973-91d7-4d4f-9c27-c6db31273099 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:47.098468 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4c424973-91d7-4d4f-9c27-c6db31273099 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052548 Oct 04 21:10:47.099060 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 728/1448] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:10:47 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:10:47.126835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-53c144f4-632f-41b6-bdb0-48ee891a1ed2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:47.136906 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-53c144f4-632f-41b6-bdb0-48ee891a1ed2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1536 microversion: 2.1 time: 0.192621 Oct 04 21:10:47.137615 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 721/1449] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:46 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1536 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:47.290649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-46f96675-1a91-4f8c-ade7-7d2454cb6c5e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:47.292274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-46f96675-1a91-4f8c-ade7-7d2454cb6c5e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:47.319790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46f96675-1a91-4f8c-ade7-7d2454cb6c5e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:47.319790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46f96675-1a91-4f8c-ade7-7d2454cb6c5e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:47.319790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46f96675-1a91-4f8c-ade7-7d2454cb6c5e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:47.321348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46f96675-1a91-4f8c-ade7-7d2454cb6c5e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:47.321851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46f96675-1a91-4f8c-ade7-7d2454cb6c5e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:47.322294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46f96675-1a91-4f8c-ade7-7d2454cb6c5e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:47.393139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-37673f07-5c35-4c08-b2fe-ab4a2c8010f4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:47.393858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-37673f07-5c35-4c08-b2fe-ab4a2c8010f4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:47.396495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=12 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:47.425640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37673f07-5c35-4c08-b2fe-ab4a2c8010f4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:47.426486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37673f07-5c35-4c08-b2fe-ab4a2c8010f4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:47.427228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37673f07-5c35-4c08-b2fe-ab4a2c8010f4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:47.428692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37673f07-5c35-4c08-b2fe-ab4a2c8010f4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:47.430810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37673f07-5c35-4c08-b2fe-ab4a2c8010f4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:47.434804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37673f07-5c35-4c08-b2fe-ab4a2c8010f4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:48.541662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-46f96675-1a91-4f8c-ade7-7d2454cb6c5e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:48.556922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-46f96675-1a91-4f8c-ade7-7d2454cb6c5e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:48.561731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-46f96675-1a91-4f8c-ade7-7d2454cb6c5e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:48.577043 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-46f96675-1a91-4f8c-ade7-7d2454cb6c5e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 1.293525 Oct 04 21:10:48.590581 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 729/1450] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:47 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:48.604926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3aaf2728-0c9c-4476-a361-3cd78a7e7324 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:48.616828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3aaf2728-0c9c-4476-a361-3cd78a7e7324 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:48.639459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3aaf2728-0c9c-4476-a361-3cd78a7e7324 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:48.640195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3aaf2728-0c9c-4476-a361-3cd78a7e7324 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:48.644868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3aaf2728-0c9c-4476-a361-3cd78a7e7324 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:48.645816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3aaf2728-0c9c-4476-a361-3cd78a7e7324 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:48.655488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3aaf2728-0c9c-4476-a361-3cd78a7e7324 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:48.660308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3aaf2728-0c9c-4476-a361-3cd78a7e7324 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:48.883018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-37673f07-5c35-4c08-b2fe-ab4a2c8010f4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:48.903599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-37673f07-5c35-4c08-b2fe-ab4a2c8010f4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:48.907431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-37673f07-5c35-4c08-b2fe-ab4a2c8010f4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:48.908612 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-37673f07-5c35-4c08-b2fe-ab4a2c8010f4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 1.520225 Oct 04 21:10:48.909845 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 722/1451] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:47 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:10:48.921618 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-be1524ca-6fc5-46a1-8231-2f438cc6a32c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:48.924187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-be1524ca-6fc5-46a1-8231-2f438cc6a32c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:48.945277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be1524ca-6fc5-46a1-8231-2f438cc6a32c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:48.945898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be1524ca-6fc5-46a1-8231-2f438cc6a32c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:48.947652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be1524ca-6fc5-46a1-8231-2f438cc6a32c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:48.947652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be1524ca-6fc5-46a1-8231-2f438cc6a32c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:48.949804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be1524ca-6fc5-46a1-8231-2f438cc6a32c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:48.949804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be1524ca-6fc5-46a1-8231-2f438cc6a32c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:49.026161 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-be1524ca-6fc5-46a1-8231-2f438cc6a32c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110850 Oct 04 21:10:49.026917 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 723/1452] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:10:48 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:10:49.037765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-12a05e03-225c-4ee3-b340-4c603a2fbd43 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:49.038391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-12a05e03-225c-4ee3-b340-4c603a2fbd43 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:49.058492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:49.061291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12a05e03-225c-4ee3-b340-4c603a2fbd43 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:49.061773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12a05e03-225c-4ee3-b340-4c603a2fbd43 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:49.062201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12a05e03-225c-4ee3-b340-4c603a2fbd43 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:49.066636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12a05e03-225c-4ee3-b340-4c603a2fbd43 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:49.067135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12a05e03-225c-4ee3-b340-4c603a2fbd43 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:49.069850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12a05e03-225c-4ee3-b340-4c603a2fbd43 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:49.247024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3aaf2728-0c9c-4476-a361-3cd78a7e7324 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:49.261345 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3aaf2728-0c9c-4476-a361-3cd78a7e7324 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1463 microversion: 2.1 time: 0.668426 Oct 04 21:10:49.265346 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 730/1453] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:48 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1463 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:49.296576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3f0a9325-e77a-47af-9e37-8cc278fdbd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:49.298409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3f0a9325-e77a-47af-9e37-8cc278fdbd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:49.308379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f0a9325-e77a-47af-9e37-8cc278fdbd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:49.310165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f0a9325-e77a-47af-9e37-8cc278fdbd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:49.310650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f0a9325-e77a-47af-9e37-8cc278fdbd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:49.311503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f0a9325-e77a-47af-9e37-8cc278fdbd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:49.311971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f0a9325-e77a-47af-9e37-8cc278fdbd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:49.312456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f0a9325-e77a-47af-9e37-8cc278fdbd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:49.589536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-12a05e03-225c-4ee3-b340-4c603a2fbd43 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:49.600926 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-12a05e03-225c-4ee3-b340-4c603a2fbd43 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1536 microversion: 2.1 time: 0.571425 Oct 04 21:10:49.603486 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 724/1454] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:49 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1536 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:49.629048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2d1ba62e-3c3c-4b3f-9549-3b2cbfe56a09 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:49.629048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2d1ba62e-3c3c-4b3f-9549-3b2cbfe56a09 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:49.632704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d1ba62e-3c3c-4b3f-9549-3b2cbfe56a09 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:49.633505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d1ba62e-3c3c-4b3f-9549-3b2cbfe56a09 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:49.634179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d1ba62e-3c3c-4b3f-9549-3b2cbfe56a09 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:49.635116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d1ba62e-3c3c-4b3f-9549-3b2cbfe56a09 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:49.635821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d1ba62e-3c3c-4b3f-9549-3b2cbfe56a09 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:49.636474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d1ba62e-3c3c-4b3f-9549-3b2cbfe56a09 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:49.730295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:49.897610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3f0a9325-e77a-47af-9e37-8cc278fdbd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:49.924160 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3f0a9325-e77a-47af-9e37-8cc278fdbd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1463 microversion: 2.1 time: 0.633269 Oct 04 21:10:49.949586 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 731/1455] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:49 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1463 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:10:49.962724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-34d8f771-1d90-435e-8c45-fc568f2a2598 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:49.967172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-34d8f771-1d90-435e-8c45-fc568f2a2598 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:49.986149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-34d8f771-1d90-435e-8c45-fc568f2a2598 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:49.989482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-34d8f771-1d90-435e-8c45-fc568f2a2598 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:49.994316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-34d8f771-1d90-435e-8c45-fc568f2a2598 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:49.994316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-34d8f771-1d90-435e-8c45-fc568f2a2598 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:49.996858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-34d8f771-1d90-435e-8c45-fc568f2a2598 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:49.998786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-34d8f771-1d90-435e-8c45-fc568f2a2598 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:50.080631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2d1ba62e-3c3c-4b3f-9549-3b2cbfe56a09 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:50.092994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2d1ba62e-3c3c-4b3f-9549-3b2cbfe56a09 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:50.098031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2d1ba62e-3c3c-4b3f-9549-3b2cbfe56a09 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:50.113340 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2d1ba62e-3c3c-4b3f-9549-3b2cbfe56a09 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.495198 Oct 04 21:10:50.116039 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 725/1456] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:49 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:50.154210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:50.161985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:50.208933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:50.213672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:50.214217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:50.219682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:50.220249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:50.225459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:50.502099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:10:50.505769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:10:50.508607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:10:50.512305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:10:50.514124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:10:50.584684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-34d8f771-1d90-435e-8c45-fc568f2a2598 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:50.605356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-34d8f771-1d90-435e-8c45-fc568f2a2598 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:50.607925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-34d8f771-1d90-435e-8c45-fc568f2a2598 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:50.627293 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-34d8f771-1d90-435e-8c45-fc568f2a2598 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.664730 Oct 04 21:10:50.627293 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 732/1457] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:49 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:50.656476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6624fa76-e52d-4f9e-bf01-7fc6cda586ea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:50.657649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6624fa76-e52d-4f9e-bf01-7fc6cda586ea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:50.673847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6624fa76-e52d-4f9e-bf01-7fc6cda586ea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:50.674615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6624fa76-e52d-4f9e-bf01-7fc6cda586ea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:50.675355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6624fa76-e52d-4f9e-bf01-7fc6cda586ea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:50.676292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6624fa76-e52d-4f9e-bf01-7fc6cda586ea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:50.679078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6624fa76-e52d-4f9e-bf01-7fc6cda586ea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:50.679765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6624fa76-e52d-4f9e-bf01-7fc6cda586ea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:50.932648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:50.958985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:50.959485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:50.961726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:50.961726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:50.962591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:50.963545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:51.041670 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e21fb5a6-5720-42d9-a46c-6d55fcc5fd74 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "POST /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e/action" status: 202 len: 1067 microversion: 2.1 time: 0.923147 Oct 04 21:10:51.062342 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 726/1458] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:10:50 2022] POST /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e/action => generated 1067 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 21:10:51.141550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6624fa76-e52d-4f9e-bf01-7fc6cda586ea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:51.149883 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6624fa76-e52d-4f9e-bf01-7fc6cda586ea tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1541 microversion: 2.1 time: 0.528082 Oct 04 21:10:51.150472 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 733/1459] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:50 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1541 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:51.187423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7ad29202-6fab-4dad-b934-158c41934f39 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:51.193135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7ad29202-6fab-4dad-b934-158c41934f39 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:51.219104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ad29202-6fab-4dad-b934-158c41934f39 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:51.222062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ad29202-6fab-4dad-b934-158c41934f39 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:51.222062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ad29202-6fab-4dad-b934-158c41934f39 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:51.222062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ad29202-6fab-4dad-b934-158c41934f39 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:51.222062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ad29202-6fab-4dad-b934-158c41934f39 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:51.222062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ad29202-6fab-4dad-b934-158c41934f39 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:51.441927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a00cf494-ac1d-46d2-ac0b-74aa8a19c1ed tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-500223518", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:51.956332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7ad29202-6fab-4dad-b934-158c41934f39 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:51.967622 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7ad29202-6fab-4dad-b934-158c41934f39 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1472 microversion: 2.1 time: 0.815835 Oct 04 21:10:51.968774 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 734/1460] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:51 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1472 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:51.974040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-92342e7c-f3a0-41cc-b7e0-614c3274200f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:51.974852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-92342e7c-f3a0-41cc-b7e0-614c3274200f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:51.983164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92342e7c-f3a0-41cc-b7e0-614c3274200f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:51.984153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92342e7c-f3a0-41cc-b7e0-614c3274200f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:51.984770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92342e7c-f3a0-41cc-b7e0-614c3274200f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:51.985982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92342e7c-f3a0-41cc-b7e0-614c3274200f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:51.987054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92342e7c-f3a0-41cc-b7e0-614c3274200f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:51.987936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92342e7c-f3a0-41cc-b7e0-614c3274200f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:52.082753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-92342e7c-f3a0-41cc-b7e0-614c3274200f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:52.098060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-92342e7c-f3a0-41cc-b7e0-614c3274200f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:52.102256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-92342e7c-f3a0-41cc-b7e0-614c3274200f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:52.118607 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-92342e7c-f3a0-41cc-b7e0-614c3274200f tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.146846 Oct 04 21:10:52.121335 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 735/1461] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:51 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:52.129471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-51c16a96-f90b-4f12-96a5-4ebae1ad57a1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:52.130234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-51c16a96-f90b-4f12-96a5-4ebae1ad57a1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:52.166782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51c16a96-f90b-4f12-96a5-4ebae1ad57a1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:52.167338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51c16a96-f90b-4f12-96a5-4ebae1ad57a1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:52.171874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51c16a96-f90b-4f12-96a5-4ebae1ad57a1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:52.174107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51c16a96-f90b-4f12-96a5-4ebae1ad57a1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:52.176877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51c16a96-f90b-4f12-96a5-4ebae1ad57a1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:52.177608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51c16a96-f90b-4f12-96a5-4ebae1ad57a1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:52.415205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-51c16a96-f90b-4f12-96a5-4ebae1ad57a1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:52.420815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:52.428097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-51c16a96-f90b-4f12-96a5-4ebae1ad57a1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:52.429544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-51c16a96-f90b-4f12-96a5-4ebae1ad57a1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:52.431221 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-51c16a96-f90b-4f12-96a5-4ebae1ad57a1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.308640 Oct 04 21:10:52.431985 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 736/1462] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:52 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:52.451160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4df3e4b2-7859-4b08-b83c-225f0f86e2dd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:52.451861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4df3e4b2-7859-4b08-b83c-225f0f86e2dd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:52.481856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4df3e4b2-7859-4b08-b83c-225f0f86e2dd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:52.484762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4df3e4b2-7859-4b08-b83c-225f0f86e2dd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:52.487539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4df3e4b2-7859-4b08-b83c-225f0f86e2dd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:52.490010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4df3e4b2-7859-4b08-b83c-225f0f86e2dd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:52.492695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4df3e4b2-7859-4b08-b83c-225f0f86e2dd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:52.494921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4df3e4b2-7859-4b08-b83c-225f0f86e2dd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:52.920034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4df3e4b2-7859-4b08-b83c-225f0f86e2dd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:52.932856 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4df3e4b2-7859-4b08-b83c-225f0f86e2dd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1541 microversion: 2.1 time: 0.498931 Oct 04 21:10:52.933477 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 737/1463] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:52 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1541 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:52.994507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-74198eee-a523-4b4a-93fe-e615bb1b8e4a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:52.995510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-74198eee-a523-4b4a-93fe-e615bb1b8e4a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:53.005400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74198eee-a523-4b4a-93fe-e615bb1b8e4a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:53.006623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74198eee-a523-4b4a-93fe-e615bb1b8e4a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:53.010434 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74198eee-a523-4b4a-93fe-e615bb1b8e4a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:53.011437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74198eee-a523-4b4a-93fe-e615bb1b8e4a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:53.011919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74198eee-a523-4b4a-93fe-e615bb1b8e4a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:53.014109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74198eee-a523-4b4a-93fe-e615bb1b8e4a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:53.224486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-74198eee-a523-4b4a-93fe-e615bb1b8e4a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:53.237086 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-74198eee-a523-4b4a-93fe-e615bb1b8e4a tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1472 microversion: 2.1 time: 0.246499 Oct 04 21:10:53.238146 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 738/1464] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:52 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1472 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:10:53.249136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9358d0e1-b602-4058-99b3-f4c3248fe302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:53.250269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9358d0e1-b602-4058-99b3-f4c3248fe302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:53.273795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9358d0e1-b602-4058-99b3-f4c3248fe302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:53.274868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9358d0e1-b602-4058-99b3-f4c3248fe302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:53.275677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9358d0e1-b602-4058-99b3-f4c3248fe302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:53.278952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9358d0e1-b602-4058-99b3-f4c3248fe302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:53.278952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9358d0e1-b602-4058-99b3-f4c3248fe302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:53.278952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9358d0e1-b602-4058-99b3-f4c3248fe302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:53.401567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9358d0e1-b602-4058-99b3-f4c3248fe302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:53.418936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9358d0e1-b602-4058-99b3-f4c3248fe302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:53.423403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9358d0e1-b602-4058-99b3-f4c3248fe302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:53.442667 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9358d0e1-b602-4058-99b3-f4c3248fe302 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.203184 Oct 04 21:10:53.462060 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 739/1465] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:53 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:53.480219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b132db5d-c58b-4564-b12a-f667f593cdba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:53.481674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b132db5d-c58b-4564-b12a-f667f593cdba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:53.496613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b132db5d-c58b-4564-b12a-f667f593cdba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:53.499792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b132db5d-c58b-4564-b12a-f667f593cdba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:53.502257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b132db5d-c58b-4564-b12a-f667f593cdba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:53.503279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b132db5d-c58b-4564-b12a-f667f593cdba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:53.504924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b132db5d-c58b-4564-b12a-f667f593cdba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:53.507356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b132db5d-c58b-4564-b12a-f667f593cdba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:54.016582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b132db5d-c58b-4564-b12a-f667f593cdba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:54.035319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b132db5d-c58b-4564-b12a-f667f593cdba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:54.048669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b132db5d-c58b-4564-b12a-f667f593cdba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:54.049961 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b132db5d-c58b-4564-b12a-f667f593cdba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.585999 Oct 04 21:10:54.053576 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 740/1466] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:53 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:54.083635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e43f7bcc-77bf-440b-90ac-d186107c4848 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:54.087430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e43f7bcc-77bf-440b-90ac-d186107c4848 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:54.094455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e43f7bcc-77bf-440b-90ac-d186107c4848 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:54.095563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e43f7bcc-77bf-440b-90ac-d186107c4848 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:54.096479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e43f7bcc-77bf-440b-90ac-d186107c4848 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:54.097660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e43f7bcc-77bf-440b-90ac-d186107c4848 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:54.098499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e43f7bcc-77bf-440b-90ac-d186107c4848 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:54.101305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e43f7bcc-77bf-440b-90ac-d186107c4848 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:54.535165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e43f7bcc-77bf-440b-90ac-d186107c4848 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:54.549613 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e43f7bcc-77bf-440b-90ac-d186107c4848 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1541 microversion: 2.1 time: 0.493280 Oct 04 21:10:54.551485 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 741/1467] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:54 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1541 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:54.565629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-94ce42a2-e54f-4d82-ad61-d29cfe118c73 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:54.565629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-94ce42a2-e54f-4d82-ad61-d29cfe118c73 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:54.584417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94ce42a2-e54f-4d82-ad61-d29cfe118c73 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:54.591685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94ce42a2-e54f-4d82-ad61-d29cfe118c73 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:54.591685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94ce42a2-e54f-4d82-ad61-d29cfe118c73 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:54.591685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94ce42a2-e54f-4d82-ad61-d29cfe118c73 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:54.591685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94ce42a2-e54f-4d82-ad61-d29cfe118c73 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:54.591685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94ce42a2-e54f-4d82-ad61-d29cfe118c73 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:54.884045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-94ce42a2-e54f-4d82-ad61-d29cfe118c73 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:54.902982 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-94ce42a2-e54f-4d82-ad61-d29cfe118c73 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1472 microversion: 2.1 time: 0.349451 Oct 04 21:10:54.904591 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 742/1468] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:54 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1472 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:54.921248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-592dff9f-de55-41fb-9d0d-762ff8342fc3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:54.923442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-592dff9f-de55-41fb-9d0d-762ff8342fc3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:54.939116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-592dff9f-de55-41fb-9d0d-762ff8342fc3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:54.939684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-592dff9f-de55-41fb-9d0d-762ff8342fc3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:54.940185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-592dff9f-de55-41fb-9d0d-762ff8342fc3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:54.941274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-592dff9f-de55-41fb-9d0d-762ff8342fc3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:54.941990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-592dff9f-de55-41fb-9d0d-762ff8342fc3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:54.942726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-592dff9f-de55-41fb-9d0d-762ff8342fc3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:55.200512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-592dff9f-de55-41fb-9d0d-762ff8342fc3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:55.210131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-592dff9f-de55-41fb-9d0d-762ff8342fc3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:55.219240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-592dff9f-de55-41fb-9d0d-762ff8342fc3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:55.235913 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-592dff9f-de55-41fb-9d0d-762ff8342fc3 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.327930 Oct 04 21:10:55.246764 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 743/1469] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:54 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:55.246764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-62101b14-4df4-4f42-9319-ab98da4f46b0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:55.246764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-62101b14-4df4-4f42-9319-ab98da4f46b0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:55.251026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62101b14-4df4-4f42-9319-ab98da4f46b0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:55.251679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62101b14-4df4-4f42-9319-ab98da4f46b0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:55.252226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62101b14-4df4-4f42-9319-ab98da4f46b0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:55.253079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62101b14-4df4-4f42-9319-ab98da4f46b0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:55.253718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62101b14-4df4-4f42-9319-ab98da4f46b0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:55.254232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62101b14-4df4-4f42-9319-ab98da4f46b0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:55.649194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-62101b14-4df4-4f42-9319-ab98da4f46b0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:55.660298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-62101b14-4df4-4f42-9319-ab98da4f46b0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:55.666383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-62101b14-4df4-4f42-9319-ab98da4f46b0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:55.668039 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-62101b14-4df4-4f42-9319-ab98da4f46b0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.429003 Oct 04 21:10:55.669002 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 744/1470] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:55 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:55.684016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-de92ab3d-e050-4ba0-9408-4ebb8d5bf9cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:55.702076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-de92ab3d-e050-4ba0-9408-4ebb8d5bf9cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:55.712578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de92ab3d-e050-4ba0-9408-4ebb8d5bf9cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:55.713144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de92ab3d-e050-4ba0-9408-4ebb8d5bf9cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:55.713677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de92ab3d-e050-4ba0-9408-4ebb8d5bf9cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:55.714485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de92ab3d-e050-4ba0-9408-4ebb8d5bf9cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:55.715103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de92ab3d-e050-4ba0-9408-4ebb8d5bf9cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:55.715566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de92ab3d-e050-4ba0-9408-4ebb8d5bf9cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:56.598646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-de92ab3d-e050-4ba0-9408-4ebb8d5bf9cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:56.607849 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-de92ab3d-e050-4ba0-9408-4ebb8d5bf9cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1541 microversion: 2.1 time: 0.931294 Oct 04 21:10:56.608633 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 745/1471] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:55 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1541 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:56.631745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0b580beb-a751-4622-b960-66b8ec42885f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:56.632628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0b580beb-a751-4622-b960-66b8ec42885f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:56.642123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b580beb-a751-4622-b960-66b8ec42885f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:56.642615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b580beb-a751-4622-b960-66b8ec42885f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:56.643055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b580beb-a751-4622-b960-66b8ec42885f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:56.643767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b580beb-a751-4622-b960-66b8ec42885f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:56.646458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b580beb-a751-4622-b960-66b8ec42885f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:56.646458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b580beb-a751-4622-b960-66b8ec42885f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:56.932243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0b580beb-a751-4622-b960-66b8ec42885f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:56.944008 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0b580beb-a751-4622-b960-66b8ec42885f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1472 microversion: 2.1 time: 0.321204 Oct 04 21:10:56.960709 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 746/1472] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:56 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1472 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:56.971192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-02d6e87a-9e8f-49cc-a548-6cdebc8b6761 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:56.971916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-02d6e87a-9e8f-49cc-a548-6cdebc8b6761 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:56.985554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02d6e87a-9e8f-49cc-a548-6cdebc8b6761 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:56.987055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02d6e87a-9e8f-49cc-a548-6cdebc8b6761 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:56.987704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02d6e87a-9e8f-49cc-a548-6cdebc8b6761 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:56.988618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02d6e87a-9e8f-49cc-a548-6cdebc8b6761 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:56.989264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02d6e87a-9e8f-49cc-a548-6cdebc8b6761 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:56.989924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02d6e87a-9e8f-49cc-a548-6cdebc8b6761 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:57.110211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-02d6e87a-9e8f-49cc-a548-6cdebc8b6761 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:57.123973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-02d6e87a-9e8f-49cc-a548-6cdebc8b6761 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:57.125992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-02d6e87a-9e8f-49cc-a548-6cdebc8b6761 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:57.139845 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-02d6e87a-9e8f-49cc-a548-6cdebc8b6761 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1555 microversion: 2.91 time: 0.177660 Oct 04 21:10:57.140839 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 747/1473] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:56 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:57.155352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a814e7f7-5064-4be6-9423-18690323901a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:57.156649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a814e7f7-5064-4be6-9423-18690323901a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:57.163142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a814e7f7-5064-4be6-9423-18690323901a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:57.168255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a814e7f7-5064-4be6-9423-18690323901a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:57.168255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a814e7f7-5064-4be6-9423-18690323901a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:57.168255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a814e7f7-5064-4be6-9423-18690323901a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:57.168255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a814e7f7-5064-4be6-9423-18690323901a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:57.168255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a814e7f7-5064-4be6-9423-18690323901a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:57.370290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a814e7f7-5064-4be6-9423-18690323901a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:57.383557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a814e7f7-5064-4be6-9423-18690323901a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:57.390129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a814e7f7-5064-4be6-9423-18690323901a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:57.391369 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a814e7f7-5064-4be6-9423-18690323901a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.244528 Oct 04 21:10:57.394309 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 748/1474] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:57 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:57.479362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3cebeaa0-0844-4e0f-af82-78d9cff32e9b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-53322909", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "355d2dfa-09cc-435f-842a-7fc0ed5ae634"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:01.031444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:01.216525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-a00cf494-ac1d-46d2-ac0b-74aa8a19c1ed tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] validate_networks() for None {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:11:01.223978 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-3cebeaa0-0844-4e0f-af82-78d9cff32e9b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] validate_networks() for [('355d2dfa-09cc-435f-842a-7fc0ed5ae634', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:11:01.489147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=12 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:01.547722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-a00cf494-ac1d-46d2-ac0b-74aa8a19c1ed tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:11:01.548517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-a00cf494-ac1d-46d2-ac0b-74aa8a19c1ed tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:11:01.549532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-a00cf494-ac1d-46d2-ac0b-74aa8a19c1ed tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:11:01.550132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-a00cf494-ac1d-46d2-ac0b-74aa8a19c1ed tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:11:01.550953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-a00cf494-ac1d-46d2-ac0b-74aa8a19c1ed tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:11:01.564937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a00cf494-ac1d-46d2-ac0b-74aa8a19c1ed tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:01.565513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a00cf494-ac1d-46d2-ac0b-74aa8a19c1ed tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:01.565890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a00cf494-ac1d-46d2-ac0b-74aa8a19c1ed tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:01.566621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a00cf494-ac1d-46d2-ac0b-74aa8a19c1ed tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:01.567073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a00cf494-ac1d-46d2-ac0b-74aa8a19c1ed tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:01.567496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a00cf494-ac1d-46d2-ac0b-74aa8a19c1ed tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:01.589709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-a00cf494-ac1d-46d2-ac0b-74aa8a19c1ed tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Getting quotas for project 5331b2ee38c64bfb8c8449ed3fd957ed. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:11:01.596826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-a00cf494-ac1d-46d2-ac0b-74aa8a19c1ed tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Getting quotas for user 57285ac83e814f7e8e1971d1d9e97990 and project 5331b2ee38c64bfb8c8449ed3fd957ed. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:11:01.612145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a00cf494-ac1d-46d2-ac0b-74aa8a19c1ed tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:11:01.617686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a00cf494-ac1d-46d2-ac0b-74aa8a19c1ed tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:11:01.796356 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a00cf494-ac1d-46d2-ac0b-74aa8a19c1ed tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.732352 Oct 04 21:11:01.797753 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 727/1475] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:10:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 10735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:11:01.803890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9d6fa4e1-487f-4e69-9e9f-9a019e45a8eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:01.804796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9d6fa4e1-487f-4e69-9e9f-9a019e45a8eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:01.815612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d6fa4e1-487f-4e69-9e9f-9a019e45a8eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:01.816636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d6fa4e1-487f-4e69-9e9f-9a019e45a8eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:01.817322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d6fa4e1-487f-4e69-9e9f-9a019e45a8eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:01.821769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d6fa4e1-487f-4e69-9e9f-9a019e45a8eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:01.822485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d6fa4e1-487f-4e69-9e9f-9a019e45a8eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:01.822865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3cebeaa0-0844-4e0f-af82-78d9cff32e9b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:11:01.823329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d6fa4e1-487f-4e69-9e9f-9a019e45a8eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:01.823739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3cebeaa0-0844-4e0f-af82-78d9cff32e9b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:11:01.824836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3cebeaa0-0844-4e0f-af82-78d9cff32e9b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:11:01.826050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3cebeaa0-0844-4e0f-af82-78d9cff32e9b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:11:01.826743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3cebeaa0-0844-4e0f-af82-78d9cff32e9b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:11:01.858456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3cebeaa0-0844-4e0f-af82-78d9cff32e9b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:01.859280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3cebeaa0-0844-4e0f-af82-78d9cff32e9b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:01.859965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3cebeaa0-0844-4e0f-af82-78d9cff32e9b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:01.861090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3cebeaa0-0844-4e0f-af82-78d9cff32e9b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:01.861974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3cebeaa0-0844-4e0f-af82-78d9cff32e9b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:01.862909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3cebeaa0-0844-4e0f-af82-78d9cff32e9b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:01.892521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-3cebeaa0-0844-4e0f-af82-78d9cff32e9b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Getting quotas for project 7462c68015654227a11892e2a2659ecb. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:11:01.899658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-3cebeaa0-0844-4e0f-af82-78d9cff32e9b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Getting quotas for user c199a13dceec4ae9bd873529c864146e and project 7462c68015654227a11892e2a2659ecb. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:11:01.904846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:01.918403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3cebeaa0-0844-4e0f-af82-78d9cff32e9b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:11:01.923894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3cebeaa0-0844-4e0f-af82-78d9cff32e9b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:11:01.984450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9d6fa4e1-487f-4e69-9e9f-9a019e45a8eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:01.993287 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9d6fa4e1-487f-4e69-9e9f-9a019e45a8eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1541 microversion: 2.1 time: 0.193913 Oct 04 21:11:01.993929 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 728/1476] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:01 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1541 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:02.002355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3651559a-cdcd-4733-93c9-15eb528ed928 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:02.003251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3651559a-cdcd-4733-93c9-15eb528ed928 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:02.010462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3651559a-cdcd-4733-93c9-15eb528ed928 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:02.010963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3651559a-cdcd-4733-93c9-15eb528ed928 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:02.011408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3651559a-cdcd-4733-93c9-15eb528ed928 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:02.012120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3651559a-cdcd-4733-93c9-15eb528ed928 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:02.012576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3651559a-cdcd-4733-93c9-15eb528ed928 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:02.013929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3651559a-cdcd-4733-93c9-15eb528ed928 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:02.058550 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3cebeaa0-0844-4e0f-af82-78d9cff32e9b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.665520 Oct 04 21:11:02.059211 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 749/1477] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:10:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 4667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:11:02.070053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ce56584b-d9bb-4964-99d2-d5695cfa5fe4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:02.079603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ce56584b-d9bb-4964-99d2-d5695cfa5fe4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:02.080895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce56584b-d9bb-4964-99d2-d5695cfa5fe4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:02.081693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce56584b-d9bb-4964-99d2-d5695cfa5fe4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:02.082464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce56584b-d9bb-4964-99d2-d5695cfa5fe4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:02.083732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce56584b-d9bb-4964-99d2-d5695cfa5fe4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:02.084519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce56584b-d9bb-4964-99d2-d5695cfa5fe4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:02.085219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce56584b-d9bb-4964-99d2-d5695cfa5fe4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:02.180955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3651559a-cdcd-4733-93c9-15eb528ed928 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:02.193549 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3651559a-cdcd-4733-93c9-15eb528ed928 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1472 microversion: 2.1 time: 0.196067 Oct 04 21:11:02.197100 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 729/1478] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:01 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1472 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:02.226603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-267c16db-7511-481b-a754-550c56a4817f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:02.226603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-267c16db-7511-481b-a754-550c56a4817f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:02.244864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-267c16db-7511-481b-a754-550c56a4817f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:02.245714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-267c16db-7511-481b-a754-550c56a4817f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:02.246584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-267c16db-7511-481b-a754-550c56a4817f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:02.248594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-267c16db-7511-481b-a754-550c56a4817f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:02.249235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-267c16db-7511-481b-a754-550c56a4817f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:02.249855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-267c16db-7511-481b-a754-550c56a4817f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:02.289979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ce56584b-d9bb-4964-99d2-d5695cfa5fe4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:02.307775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ce56584b-d9bb-4964-99d2-d5695cfa5fe4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:02.313327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ce56584b-d9bb-4964-99d2-d5695cfa5fe4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:02.336007 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ce56584b-d9bb-4964-99d2-d5695cfa5fe4 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1537 microversion: 2.91 time: 0.274396 Oct 04 21:11:02.349486 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 750/1479] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:02 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1537 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:02.349486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4dfa8416-7fe9-4630-b835-1c8c456af087 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:02.359710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4dfa8416-7fe9-4630-b835-1c8c456af087 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:02.361035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4dfa8416-7fe9-4630-b835-1c8c456af087 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Searching by: {'deleted': False, 'project_id': '2b5ab646aa83404ea0006a5cdc439417'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:11:02.376164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4dfa8416-7fe9-4630-b835-1c8c456af087 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:02.376650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4dfa8416-7fe9-4630-b835-1c8c456af087 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:02.377928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4dfa8416-7fe9-4630-b835-1c8c456af087 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:02.378846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4dfa8416-7fe9-4630-b835-1c8c456af087 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:02.380501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4dfa8416-7fe9-4630-b835-1c8c456af087 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:02.380963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4dfa8416-7fe9-4630-b835-1c8c456af087 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:02.433328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.multi_cell_list [None req-4dfa8416-7fe9-4630-b835-1c8c456af087 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:11:02.486902 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4dfa8416-7fe9-4630-b835-1c8c456af087 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.148125 Oct 04 21:11:02.488027 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 751/1480] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Oct 4 21:11:02 2022] GET /compute/v2.1/servers => generated 344 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:02.494579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cec2d3ab-fd3e-456b-b9fd-3ffb6b184c8d tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:02.495714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cec2d3ab-fd3e-456b-b9fd-3ffb6b184c8d tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:02.502300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-267c16db-7511-481b-a754-550c56a4817f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:02.511678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-267c16db-7511-481b-a754-550c56a4817f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:02.513230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-267c16db-7511-481b-a754-550c56a4817f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:02.514664 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-267c16db-7511-481b-a754-550c56a4817f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.300641 Oct 04 21:11:02.515408 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 730/1481] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:02 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:02.520074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8a311e65-6849-43eb-bab0-7a6e19b01a15 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:02.520923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8a311e65-6849-43eb-bab0-7a6e19b01a15 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:02.594120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cec2d3ab-fd3e-456b-b9fd-3ffb6b184c8d tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:02.609731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8a311e65-6849-43eb-bab0-7a6e19b01a15 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:02.612689 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cec2d3ab-fd3e-456b-b9fd-3ffb6b184c8d tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1213 microversion: 2.1 time: 0.122524 Oct 04 21:11:02.613283 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 752/1482] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:02 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1213 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:02.625335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-24ffb4bd-e786-44da-b273-8256808a65de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:02.625568 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8a311e65-6849-43eb-bab0-7a6e19b01a15 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1206 microversion: 2.1 time: 0.105330 Oct 04 21:11:02.625568 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 731/1483] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:02 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1206 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:02.626408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-24ffb4bd-e786-44da-b273-8256808a65de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:02.627166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-24ffb4bd-e786-44da-b273-8256808a65de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Searching by: {'deleted': False, 'project_id': '2b5ab646aa83404ea0006a5cdc439417'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:11:02.633215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24ffb4bd-e786-44da-b273-8256808a65de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:02.633724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24ffb4bd-e786-44da-b273-8256808a65de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:02.634159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24ffb4bd-e786-44da-b273-8256808a65de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:02.634880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24ffb4bd-e786-44da-b273-8256808a65de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:02.635329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24ffb4bd-e786-44da-b273-8256808a65de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:02.635749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24ffb4bd-e786-44da-b273-8256808a65de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:02.663337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.multi_cell_list [None req-24ffb4bd-e786-44da-b273-8256808a65de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:11:02.699945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-24ffb4bd-e786-44da-b273-8256808a65de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:02.706042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24ffb4bd-e786-44da-b273-8256808a65de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:02.707809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24ffb4bd-e786-44da-b273-8256808a65de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:02.707809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24ffb4bd-e786-44da-b273-8256808a65de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:02.851556 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-24ffb4bd-e786-44da-b273-8256808a65de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.237172 Oct 04 21:11:02.852163 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 753/1484] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:11:02 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:02.876363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b68bba17-19df-4bb2-8614-ded56a3a5c86 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:02.885003 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b68bba17-19df-4bb2-8614-ded56a3a5c86 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012903 Oct 04 21:11:02.885599 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 732/1485] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:11:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:03.019092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5ad84a82-1655-4453-bf1c-95c3aa64aa21 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:03.019757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5ad84a82-1655-4453-bf1c-95c3aa64aa21 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:03.025953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ad84a82-1655-4453-bf1c-95c3aa64aa21 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:03.026583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ad84a82-1655-4453-bf1c-95c3aa64aa21 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:03.026982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ad84a82-1655-4453-bf1c-95c3aa64aa21 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:03.027738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ad84a82-1655-4453-bf1c-95c3aa64aa21 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:03.028138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ad84a82-1655-4453-bf1c-95c3aa64aa21 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:03.028569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ad84a82-1655-4453-bf1c-95c3aa64aa21 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:03.033892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:03.182003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5ad84a82-1655-4453-bf1c-95c3aa64aa21 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:03.191287 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5ad84a82-1655-4453-bf1c-95c3aa64aa21 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1541 microversion: 2.1 time: 0.176223 Oct 04 21:11:03.193460 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 754/1486] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:03 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1541 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:03.207095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e55b76ae-5426-4434-a273-001a8e3d3930 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:03.207734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e55b76ae-5426-4434-a273-001a8e3d3930 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:03.213865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e55b76ae-5426-4434-a273-001a8e3d3930 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:03.214685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e55b76ae-5426-4434-a273-001a8e3d3930 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:03.215355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e55b76ae-5426-4434-a273-001a8e3d3930 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:03.216606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e55b76ae-5426-4434-a273-001a8e3d3930 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:03.219180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e55b76ae-5426-4434-a273-001a8e3d3930 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:03.219851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e55b76ae-5426-4434-a273-001a8e3d3930 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:03.223799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0fce939b-171e-4553-9077-d4a4ea2ccab0 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:03.224414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0fce939b-171e-4553-9077-d4a4ea2ccab0 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:03.231422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fce939b-171e-4553-9077-d4a4ea2ccab0 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:03.234101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fce939b-171e-4553-9077-d4a4ea2ccab0 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:03.234101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fce939b-171e-4553-9077-d4a4ea2ccab0 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:03.234101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fce939b-171e-4553-9077-d4a4ea2ccab0 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:03.234101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fce939b-171e-4553-9077-d4a4ea2ccab0 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:03.235908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fce939b-171e-4553-9077-d4a4ea2ccab0 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:03.305571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e55b76ae-5426-4434-a273-001a8e3d3930 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:11:03.437507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0fce939b-171e-4553-9077-d4a4ea2ccab0 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:03.446380 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0fce939b-171e-4553-9077-d4a4ea2ccab0 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1472 microversion: 2.1 time: 0.226640 Oct 04 21:11:03.447559 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 755/1487] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:03 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1472 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:03.453509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dbba5e0b-51ec-4468-a10c-46838d45f964 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:03.454124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dbba5e0b-51ec-4468-a10c-46838d45f964 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:03.460184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbba5e0b-51ec-4468-a10c-46838d45f964 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:03.460671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbba5e0b-51ec-4468-a10c-46838d45f964 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:03.461113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbba5e0b-51ec-4468-a10c-46838d45f964 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:03.461904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbba5e0b-51ec-4468-a10c-46838d45f964 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:03.462362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbba5e0b-51ec-4468-a10c-46838d45f964 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:03.463077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbba5e0b-51ec-4468-a10c-46838d45f964 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:03.544218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dbba5e0b-51ec-4468-a10c-46838d45f964 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:03.553790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dbba5e0b-51ec-4468-a10c-46838d45f964 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:03.555328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dbba5e0b-51ec-4468-a10c-46838d45f964 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:03.561012 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dbba5e0b-51ec-4468-a10c-46838d45f964 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1537 microversion: 2.91 time: 0.112034 Oct 04 21:11:03.561854 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 756/1488] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:03 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1537 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:03.578830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cb11a5e1-cf15-4dd5-87a5-83174a7664d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:03.583664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cb11a5e1-cf15-4dd5-87a5-83174a7664d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:03.585925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb11a5e1-cf15-4dd5-87a5-83174a7664d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:03.586629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb11a5e1-cf15-4dd5-87a5-83174a7664d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:03.587150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb11a5e1-cf15-4dd5-87a5-83174a7664d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:03.588126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb11a5e1-cf15-4dd5-87a5-83174a7664d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:03.588593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb11a5e1-cf15-4dd5-87a5-83174a7664d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:03.589033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb11a5e1-cf15-4dd5-87a5-83174a7664d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:03.729938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cb11a5e1-cf15-4dd5-87a5-83174a7664d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:03.739818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cb11a5e1-cf15-4dd5-87a5-83174a7664d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:03.741267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cb11a5e1-cf15-4dd5-87a5-83174a7664d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:03.742589 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cb11a5e1-cf15-4dd5-87a5-83174a7664d4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.179784 Oct 04 21:11:03.743165 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 757/1489] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:03 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:03.766119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d978101d-04c3-4e2a-af7f-2d249f77ee9e tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:03.766732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d978101d-04c3-4e2a-af7f-2d249f77ee9e tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:03.773180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d978101d-04c3-4e2a-af7f-2d249f77ee9e tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:03.774093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d978101d-04c3-4e2a-af7f-2d249f77ee9e tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:03.774524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d978101d-04c3-4e2a-af7f-2d249f77ee9e tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:03.775240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d978101d-04c3-4e2a-af7f-2d249f77ee9e tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:03.775697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d978101d-04c3-4e2a-af7f-2d249f77ee9e tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:03.776121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d978101d-04c3-4e2a-af7f-2d249f77ee9e tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:03.797750 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e55b76ae-5426-4434-a273-001a8e3d3930 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 204 len: 0 microversion: 2.1 time: 0.594218 Oct 04 21:11:03.802569 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 733/1490] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:11:03 2022] DELETE /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:11:03.806371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3397429f-91b1-4b55-a19d-b7733fbb574d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:03.808167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3397429f-91b1-4b55-a19d-b7733fbb574d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:03.868114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d978101d-04c3-4e2a-af7f-2d249f77ee9e tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:03.878620 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d978101d-04c3-4e2a-af7f-2d249f77ee9e tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1217 microversion: 2.1 time: 0.119757 Oct 04 21:11:03.885933 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 758/1491] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:03 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1217 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:03.885933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-21d35f4c-2a83-4847-b97f-2eac71c4f2dd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:03.885933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-21d35f4c-2a83-4847-b97f-2eac71c4f2dd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:03.891600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21d35f4c-2a83-4847-b97f-2eac71c4f2dd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:03.892095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21d35f4c-2a83-4847-b97f-2eac71c4f2dd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:03.892537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21d35f4c-2a83-4847-b97f-2eac71c4f2dd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:03.893233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21d35f4c-2a83-4847-b97f-2eac71c4f2dd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:03.894228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21d35f4c-2a83-4847-b97f-2eac71c4f2dd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:03.894667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21d35f4c-2a83-4847-b97f-2eac71c4f2dd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:03.896966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3397429f-91b1-4b55-a19d-b7733fbb574d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:03.911423 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3397429f-91b1-4b55-a19d-b7733fbb574d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1206 microversion: 2.1 time: 0.110823 Oct 04 21:11:03.912145 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 734/1492] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:03 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1206 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:04.033403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-21d35f4c-2a83-4847-b97f-2eac71c4f2dd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:04.041801 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-21d35f4c-2a83-4847-b97f-2eac71c4f2dd tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1606 microversion: 2.1 time: 0.161539 Oct 04 21:11:04.045292 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 759/1493] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:03 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1606 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:04.219416 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-de22a4fa-01d5-49ac-ad20-6bc9eedacb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:04.220521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-de22a4fa-01d5-49ac-ad20-6bc9eedacb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:04.237822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de22a4fa-01d5-49ac-ad20-6bc9eedacb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:04.238842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de22a4fa-01d5-49ac-ad20-6bc9eedacb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:04.239903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de22a4fa-01d5-49ac-ad20-6bc9eedacb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:04.241130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de22a4fa-01d5-49ac-ad20-6bc9eedacb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:04.242107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de22a4fa-01d5-49ac-ad20-6bc9eedacb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:04.242869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de22a4fa-01d5-49ac-ad20-6bc9eedacb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:04.431659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-de22a4fa-01d5-49ac-ad20-6bc9eedacb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:04.442303 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-de22a4fa-01d5-49ac-ad20-6bc9eedacb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1541 microversion: 2.1 time: 0.229401 Oct 04 21:11:04.443553 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 735/1494] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:04 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1541 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:04.472659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b1f2ed65-7a1f-445f-8119-c71f93c9ea86 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:04.473213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b1f2ed65-7a1f-445f-8119-c71f93c9ea86 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:04.480325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1f2ed65-7a1f-445f-8119-c71f93c9ea86 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:04.480823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1f2ed65-7a1f-445f-8119-c71f93c9ea86 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:04.484294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1f2ed65-7a1f-445f-8119-c71f93c9ea86 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:04.484294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1f2ed65-7a1f-445f-8119-c71f93c9ea86 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:04.484294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1f2ed65-7a1f-445f-8119-c71f93c9ea86 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:04.484294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1f2ed65-7a1f-445f-8119-c71f93c9ea86 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:04.589173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ee76424a-99a9-4366-9b0e-aac87b208599 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:04.590322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ee76424a-99a9-4366-9b0e-aac87b208599 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:04.602746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee76424a-99a9-4366-9b0e-aac87b208599 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:04.603795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee76424a-99a9-4366-9b0e-aac87b208599 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:04.604468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee76424a-99a9-4366-9b0e-aac87b208599 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:04.605194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee76424a-99a9-4366-9b0e-aac87b208599 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:04.605736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee76424a-99a9-4366-9b0e-aac87b208599 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:04.609035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee76424a-99a9-4366-9b0e-aac87b208599 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:04.651851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b1f2ed65-7a1f-445f-8119-c71f93c9ea86 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:04.662236 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b1f2ed65-7a1f-445f-8119-c71f93c9ea86 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1472 microversion: 2.1 time: 0.193609 Oct 04 21:11:04.680559 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 760/1495] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:04 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1472 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:04.692388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ee76424a-99a9-4366-9b0e-aac87b208599 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:04.713155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ee76424a-99a9-4366-9b0e-aac87b208599 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:04.714645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ee76424a-99a9-4366-9b0e-aac87b208599 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:04.721615 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ee76424a-99a9-4366-9b0e-aac87b208599 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1540 microversion: 2.91 time: 0.136658 Oct 04 21:11:04.725547 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 736/1496] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:04 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1540 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:04.753584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e1323a71-5d4d-4416-8488-e8533b33f488 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-860282-1"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:04.756294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e1323a71-5d4d-4416-8488-e8533b33f488 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:04.764990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1323a71-5d4d-4416-8488-e8533b33f488 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:04.767863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1323a71-5d4d-4416-8488-e8533b33f488 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:04.768388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1323a71-5d4d-4416-8488-e8533b33f488 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:04.769265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1323a71-5d4d-4416-8488-e8533b33f488 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:04.769809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1323a71-5d4d-4416-8488-e8533b33f488 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:04.770297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1323a71-5d4d-4416-8488-e8533b33f488 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:04.774829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3fd9b6b2-ce8c-43db-8d03-9f04c44e07f0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:04.775637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3fd9b6b2-ce8c-43db-8d03-9f04c44e07f0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:04.796623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fd9b6b2-ce8c-43db-8d03-9f04c44e07f0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:04.797240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fd9b6b2-ce8c-43db-8d03-9f04c44e07f0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:04.797854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fd9b6b2-ce8c-43db-8d03-9f04c44e07f0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:04.798636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fd9b6b2-ce8c-43db-8d03-9f04c44e07f0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:04.799379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fd9b6b2-ce8c-43db-8d03-9f04c44e07f0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:04.799819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fd9b6b2-ce8c-43db-8d03-9f04c44e07f0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:04.820613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e1323a71-5d4d-4416-8488-e8533b33f488 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-860282-1". {{(pid=122758) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 21:11:04.986370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3fd9b6b2-ce8c-43db-8d03-9f04c44e07f0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:04.995854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3fd9b6b2-ce8c-43db-8d03-9f04c44e07f0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:04.997657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3fd9b6b2-ce8c-43db-8d03-9f04c44e07f0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:04.999100 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3fd9b6b2-ce8c-43db-8d03-9f04c44e07f0 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.230207 Oct 04 21:11:05.019575 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 737/1497] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:04 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:11:05.025029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b5598de8-944f-4b55-817d-9a77d6204c76 req-bd3db635-2942-4036-9a1d-27ad507e9972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "191d63c3-2de0-4d3a-85f1-c4be3d2f5432", "name": "network-vif-unplugged", "status": "completed", "tag": "816da828-8532-4f45-bd81-2b2098519c9f"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:05.035509 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b5598de8-944f-4b55-817d-9a77d6204c76 req-bd3db635-2942-4036-9a1d-27ad507e9972 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.036013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b5598de8-944f-4b55-817d-9a77d6204c76 req-bd3db635-2942-4036-9a1d-27ad507e9972 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.036441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b5598de8-944f-4b55-817d-9a77d6204c76 req-bd3db635-2942-4036-9a1d-27ad507e9972 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:05.049741 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b5598de8-944f-4b55-817d-9a77d6204c76 req-bd3db635-2942-4036-9a1d-27ad507e9972 service nova] Creating event network-vif-unplugged:816da828-8532-4f45-bd81-2b2098519c9f for instance 191d63c3-2de0-4d3a-85f1-c4be3d2f5432 on n-h2-860282-1 Oct 04 21:11:05.057304 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b5598de8-944f-4b55-817d-9a77d6204c76 req-bd3db635-2942-4036-9a1d-27ad507e9972 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036301 Oct 04 21:11:05.058045 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 738/1498] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:05.064023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-71d3297c-1e47-47a3-8413-adb12a3eb902 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:05.064732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-71d3297c-1e47-47a3-8413-adb12a3eb902 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:05.072925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71d3297c-1e47-47a3-8413-adb12a3eb902 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.073543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71d3297c-1e47-47a3-8413-adb12a3eb902 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.073910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71d3297c-1e47-47a3-8413-adb12a3eb902 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:05.074629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71d3297c-1e47-47a3-8413-adb12a3eb902 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.075730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71d3297c-1e47-47a3-8413-adb12a3eb902 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.075730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71d3297c-1e47-47a3-8413-adb12a3eb902 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:05.142421 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e1323a71-5d4d-4416-8488-e8533b33f488 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e/action" status: 202 len: 0 microversion: 2.91 time: 0.392130 Oct 04 21:11:05.143275 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 761/1499] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Oct 4 21:11:04 2022] POST /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:11:05.152667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5d58bdb3-ae6e-4b6b-8d2b-2a5eff3d1be7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:05.153487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5d58bdb3-ae6e-4b6b-8d2b-2a5eff3d1be7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:05.162276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d58bdb3-ae6e-4b6b-8d2b-2a5eff3d1be7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.163157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d58bdb3-ae6e-4b6b-8d2b-2a5eff3d1be7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.163777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d58bdb3-ae6e-4b6b-8d2b-2a5eff3d1be7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:05.164787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d58bdb3-ae6e-4b6b-8d2b-2a5eff3d1be7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.165453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d58bdb3-ae6e-4b6b-8d2b-2a5eff3d1be7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.166118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d58bdb3-ae6e-4b6b-8d2b-2a5eff3d1be7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:05.168209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-71d3297c-1e47-47a3-8413-adb12a3eb902 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:05.201789 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-71d3297c-1e47-47a3-8413-adb12a3eb902 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1217 microversion: 2.1 time: 0.141480 Oct 04 21:11:05.202446 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 739/1500] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:05 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1217 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:05.217638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4ea507bd-fe34-446a-966c-50b6c201b53a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:05.217638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4ea507bd-fe34-446a-966c-50b6c201b53a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:05.224904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ea507bd-fe34-446a-966c-50b6c201b53a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.225381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ea507bd-fe34-446a-966c-50b6c201b53a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.225381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ea507bd-fe34-446a-966c-50b6c201b53a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:05.226083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ea507bd-fe34-446a-966c-50b6c201b53a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.226543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ea507bd-fe34-446a-966c-50b6c201b53a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.227166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ea507bd-fe34-446a-966c-50b6c201b53a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:05.327320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5d58bdb3-ae6e-4b6b-8d2b-2a5eff3d1be7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:05.358400 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5d58bdb3-ae6e-4b6b-8d2b-2a5eff3d1be7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1210 microversion: 2.1 time: 0.208709 Oct 04 21:11:05.359539 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 762/1501] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:05 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1210 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:05.374770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-eec116c1-28c0-4711-9db8-82d8cf3e6c79 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:05.376919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-eec116c1-28c0-4711-9db8-82d8cf3e6c79 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:05.390134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eec116c1-28c0-4711-9db8-82d8cf3e6c79 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.393310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eec116c1-28c0-4711-9db8-82d8cf3e6c79 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.393310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eec116c1-28c0-4711-9db8-82d8cf3e6c79 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:05.393310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eec116c1-28c0-4711-9db8-82d8cf3e6c79 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.393310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eec116c1-28c0-4711-9db8-82d8cf3e6c79 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.393310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eec116c1-28c0-4711-9db8-82d8cf3e6c79 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:05.558587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-eec116c1-28c0-4711-9db8-82d8cf3e6c79 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:05.570680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-eec116c1-28c0-4711-9db8-82d8cf3e6c79 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:05.573277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-eec116c1-28c0-4711-9db8-82d8cf3e6c79 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:05.592417 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-eec116c1-28c0-4711-9db8-82d8cf3e6c79 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1548 microversion: 2.91 time: 0.230709 Oct 04 21:11:05.597368 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 763/1502] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:05 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1548 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:05.604602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dbbc7fe3-ef78-4b63-b256-9631ad77910f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:05.607700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dbbc7fe3-ef78-4b63-b256-9631ad77910f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:05.633608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbbc7fe3-ef78-4b63-b256-9631ad77910f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.633608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbbc7fe3-ef78-4b63-b256-9631ad77910f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.633608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbbc7fe3-ef78-4b63-b256-9631ad77910f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:05.633608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbbc7fe3-ef78-4b63-b256-9631ad77910f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.633608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbbc7fe3-ef78-4b63-b256-9631ad77910f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.633608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbbc7fe3-ef78-4b63-b256-9631ad77910f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:05.648347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4ea507bd-fe34-446a-966c-50b6c201b53a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:05.666177 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4ea507bd-fe34-446a-966c-50b6c201b53a tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1606 microversion: 2.1 time: 0.462517 Oct 04 21:11:05.674155 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 740/1503] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:05 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1606 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:05.690488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a9d2ceb1-ebec-4ede-b410-c486bb59153b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:05.691300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a9d2ceb1-ebec-4ede-b410-c486bb59153b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:05.702411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9d2ceb1-ebec-4ede-b410-c486bb59153b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.703364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9d2ceb1-ebec-4ede-b410-c486bb59153b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.704038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9d2ceb1-ebec-4ede-b410-c486bb59153b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:05.704961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9d2ceb1-ebec-4ede-b410-c486bb59153b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.705649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9d2ceb1-ebec-4ede-b410-c486bb59153b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.706314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9d2ceb1-ebec-4ede-b410-c486bb59153b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:06.026011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dbbc7fe3-ef78-4b63-b256-9631ad77910f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:06.037858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a9d2ceb1-ebec-4ede-b410-c486bb59153b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:06.050484 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dbbc7fe3-ef78-4b63-b256-9631ad77910f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1541 microversion: 2.1 time: 0.450531 Oct 04 21:11:06.051178 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a9d2ceb1-ebec-4ede-b410-c486bb59153b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1472 microversion: 2.1 time: 0.367556 Oct 04 21:11:06.053290 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 764/1505] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:05 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1541 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:06.055632 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 741/1505] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:05 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1472 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:06.084993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c3ebc4fe-aa1e-4b9e-a8f1-c5f29e71f96f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:06.086899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c3ebc4fe-aa1e-4b9e-a8f1-c5f29e71f96f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:06.095452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3ebc4fe-aa1e-4b9e-a8f1-c5f29e71f96f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:06.096201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3ebc4fe-aa1e-4b9e-a8f1-c5f29e71f96f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:06.096790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3ebc4fe-aa1e-4b9e-a8f1-c5f29e71f96f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:06.097711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3ebc4fe-aa1e-4b9e-a8f1-c5f29e71f96f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:06.099223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3ebc4fe-aa1e-4b9e-a8f1-c5f29e71f96f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:06.100096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3ebc4fe-aa1e-4b9e-a8f1-c5f29e71f96f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:06.232635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2c6ee33a-c2bd-4aff-a979-2fb4807898d0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:06.233796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2c6ee33a-c2bd-4aff-a979-2fb4807898d0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:06.251148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c6ee33a-c2bd-4aff-a979-2fb4807898d0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:06.253946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c6ee33a-c2bd-4aff-a979-2fb4807898d0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:06.255865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c6ee33a-c2bd-4aff-a979-2fb4807898d0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:06.256896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c6ee33a-c2bd-4aff-a979-2fb4807898d0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:06.257969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c6ee33a-c2bd-4aff-a979-2fb4807898d0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:06.262450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c6ee33a-c2bd-4aff-a979-2fb4807898d0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:06.402902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2c6ee33a-c2bd-4aff-a979-2fb4807898d0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:06.411425 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2c6ee33a-c2bd-4aff-a979-2fb4807898d0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1209 microversion: 2.1 time: 0.184791 Oct 04 21:11:06.412897 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 765/1506] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:06 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1209 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:06.441374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d8fb7fb2-a8b2-4ea7-8962-6fcc7539174e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:06.451194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d8fb7fb2-a8b2-4ea7-8962-6fcc7539174e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:06.467777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c3ebc4fe-aa1e-4b9e-a8f1-c5f29e71f96f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:06.470997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8fb7fb2-a8b2-4ea7-8962-6fcc7539174e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:06.477619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8fb7fb2-a8b2-4ea7-8962-6fcc7539174e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:06.478368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8fb7fb2-a8b2-4ea7-8962-6fcc7539174e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:06.479500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8fb7fb2-a8b2-4ea7-8962-6fcc7539174e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:06.480184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8fb7fb2-a8b2-4ea7-8962-6fcc7539174e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:06.486069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8fb7fb2-a8b2-4ea7-8962-6fcc7539174e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:06.488605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c3ebc4fe-aa1e-4b9e-a8f1-c5f29e71f96f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:06.493914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c3ebc4fe-aa1e-4b9e-a8f1-c5f29e71f96f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:06.495838 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c3ebc4fe-aa1e-4b9e-a8f1-c5f29e71f96f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.441277 Oct 04 21:11:06.544010 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 742/1507] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:06 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:06.630442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-240f6228-d262-495d-b050-40c90d5e9fee tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:06.632609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-240f6228-d262-495d-b050-40c90d5e9fee tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:06.643439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-240f6228-d262-495d-b050-40c90d5e9fee tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:06.644394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-240f6228-d262-495d-b050-40c90d5e9fee tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:06.645752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-240f6228-d262-495d-b050-40c90d5e9fee tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:06.646792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-240f6228-d262-495d-b050-40c90d5e9fee tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:06.647495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-240f6228-d262-495d-b050-40c90d5e9fee tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:06.648150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-240f6228-d262-495d-b050-40c90d5e9fee tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:06.697625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d8fb7fb2-a8b2-4ea7-8962-6fcc7539174e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:06.714457 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d8fb7fb2-a8b2-4ea7-8962-6fcc7539174e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1258 microversion: 2.1 time: 0.298944 Oct 04 21:11:06.731478 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 766/1508] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:06 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1258 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:06.738152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aca7ec9d-0861-4986-9696-af9bb7cfa15c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:06.739054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aca7ec9d-0861-4986-9696-af9bb7cfa15c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:06.746697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aca7ec9d-0861-4986-9696-af9bb7cfa15c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:06.748222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aca7ec9d-0861-4986-9696-af9bb7cfa15c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:06.749064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aca7ec9d-0861-4986-9696-af9bb7cfa15c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:06.750043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aca7ec9d-0861-4986-9696-af9bb7cfa15c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:06.750891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aca7ec9d-0861-4986-9696-af9bb7cfa15c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:06.753152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aca7ec9d-0861-4986-9696-af9bb7cfa15c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:06.818348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-240f6228-d262-495d-b050-40c90d5e9fee tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:06.838321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-240f6228-d262-495d-b050-40c90d5e9fee tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:06.840012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-240f6228-d262-495d-b050-40c90d5e9fee tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:06.853382 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-240f6228-d262-495d-b050-40c90d5e9fee tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1488 microversion: 2.91 time: 0.231789 Oct 04 21:11:06.854725 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 743/1509] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:06 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1488 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:06.952864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aca7ec9d-0861-4986-9696-af9bb7cfa15c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:06.961244 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aca7ec9d-0861-4986-9696-af9bb7cfa15c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1606 microversion: 2.1 time: 0.227771 Oct 04 21:11:06.962182 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 767/1510] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:06 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1606 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:07.078531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dc472ce3-0886-4626-9fe1-f135532f24c5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:07.079255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dc472ce3-0886-4626-9fe1-f135532f24c5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:07.083000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-098838fa-9a14-4621-97bf-e780d39ba748 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:07.083827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-098838fa-9a14-4621-97bf-e780d39ba748 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:07.085783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc472ce3-0886-4626-9fe1-f135532f24c5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.086361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc472ce3-0886-4626-9fe1-f135532f24c5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.086881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc472ce3-0886-4626-9fe1-f135532f24c5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.087669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc472ce3-0886-4626-9fe1-f135532f24c5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.088207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc472ce3-0886-4626-9fe1-f135532f24c5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.088719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc472ce3-0886-4626-9fe1-f135532f24c5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.090179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-098838fa-9a14-4621-97bf-e780d39ba748 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.090860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-098838fa-9a14-4621-97bf-e780d39ba748 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.091488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-098838fa-9a14-4621-97bf-e780d39ba748 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.092191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-098838fa-9a14-4621-97bf-e780d39ba748 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.092683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-098838fa-9a14-4621-97bf-e780d39ba748 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.093066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-098838fa-9a14-4621-97bf-e780d39ba748 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.334524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dc472ce3-0886-4626-9fe1-f135532f24c5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:07.347337 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dc472ce3-0886-4626-9fe1-f135532f24c5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1472 microversion: 2.1 time: 0.270475 Oct 04 21:11:07.347337 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 744/1511] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:07 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1472 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:07.355232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-d6e95abe-d9bd-4624-8ff8-4b0640ee3883 req-29e1409f-aad5-4f26-a5fb-69113f1fd8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "191d63c3-2de0-4d3a-85f1-c4be3d2f5432", "tag": "816da828-8532-4f45-bd81-2b2098519c9f"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:07.375893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d6e95abe-d9bd-4624-8ff8-4b0640ee3883 req-29e1409f-aad5-4f26-a5fb-69113f1fd8e1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.376332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d6e95abe-d9bd-4624-8ff8-4b0640ee3883 req-29e1409f-aad5-4f26-a5fb-69113f1fd8e1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.381488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d6e95abe-d9bd-4624-8ff8-4b0640ee3883 req-29e1409f-aad5-4f26-a5fb-69113f1fd8e1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.399278 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-d6e95abe-d9bd-4624-8ff8-4b0640ee3883 req-29e1409f-aad5-4f26-a5fb-69113f1fd8e1 service nova] Creating event network-changed:816da828-8532-4f45-bd81-2b2098519c9f for instance 191d63c3-2de0-4d3a-85f1-c4be3d2f5432 on n-h2-860282-1 Oct 04 21:11:07.405831 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-d6e95abe-d9bd-4624-8ff8-4b0640ee3883 req-29e1409f-aad5-4f26-a5fb-69113f1fd8e1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060803 Oct 04 21:11:07.410990 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 745/1512] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:07.426139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-098838fa-9a14-4621-97bf-e780d39ba748 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:07.436512 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-098838fa-9a14-4621-97bf-e780d39ba748 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1541 microversion: 2.1 time: 0.358970 Oct 04 21:11:07.438372 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 768/1513] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:07 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1541 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:07.467049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4720e858-c21a-455d-8fa5-76b5a69abd43 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:07.468743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4720e858-c21a-455d-8fa5-76b5a69abd43 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:07.481296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4720e858-c21a-455d-8fa5-76b5a69abd43 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.484768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4720e858-c21a-455d-8fa5-76b5a69abd43 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.486219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4720e858-c21a-455d-8fa5-76b5a69abd43 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.487252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4720e858-c21a-455d-8fa5-76b5a69abd43 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.489303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4720e858-c21a-455d-8fa5-76b5a69abd43 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.491366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4720e858-c21a-455d-8fa5-76b5a69abd43 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.536930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4aa66be3-86e1-4c35-8074-c320242f83f6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:07.537586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4aa66be3-86e1-4c35-8074-c320242f83f6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:07.548462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4aa66be3-86e1-4c35-8074-c320242f83f6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.550325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4aa66be3-86e1-4c35-8074-c320242f83f6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.556867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4aa66be3-86e1-4c35-8074-c320242f83f6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.556867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4aa66be3-86e1-4c35-8074-c320242f83f6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.556867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4aa66be3-86e1-4c35-8074-c320242f83f6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.556867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4aa66be3-86e1-4c35-8074-c320242f83f6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.604823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:07.629214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4720e858-c21a-455d-8fa5-76b5a69abd43 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:07.636901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:07.640171 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4720e858-c21a-455d-8fa5-76b5a69abd43 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1209 microversion: 2.1 time: 0.201588 Oct 04 21:11:07.641408 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 746/1514] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:07 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1209 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:07.743039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d80b60c3-a89a-40dd-8630-eedb25f4998d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:07.743653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d80b60c3-a89a-40dd-8630-eedb25f4998d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:07.756906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d80b60c3-a89a-40dd-8630-eedb25f4998d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.757650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d80b60c3-a89a-40dd-8630-eedb25f4998d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.758343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d80b60c3-a89a-40dd-8630-eedb25f4998d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.760373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d80b60c3-a89a-40dd-8630-eedb25f4998d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.762229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d80b60c3-a89a-40dd-8630-eedb25f4998d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.764599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d80b60c3-a89a-40dd-8630-eedb25f4998d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.871606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4aa66be3-86e1-4c35-8074-c320242f83f6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:07.894522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4aa66be3-86e1-4c35-8074-c320242f83f6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:07.895975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4aa66be3-86e1-4c35-8074-c320242f83f6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:07.897185 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4aa66be3-86e1-4c35-8074-c320242f83f6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.371659 Oct 04 21:11:07.898022 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 769/1515] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:07 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:07.912348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d1da33af-7ab0-4041-84f0-de3991aca25b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:07.913227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d1da33af-7ab0-4041-84f0-de3991aca25b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:07.923816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1da33af-7ab0-4041-84f0-de3991aca25b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.925975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1da33af-7ab0-4041-84f0-de3991aca25b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.929994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1da33af-7ab0-4041-84f0-de3991aca25b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.931000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1da33af-7ab0-4041-84f0-de3991aca25b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.932196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1da33af-7ab0-4041-84f0-de3991aca25b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.936900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1da33af-7ab0-4041-84f0-de3991aca25b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.999211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d80b60c3-a89a-40dd-8630-eedb25f4998d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:08.009243 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d80b60c3-a89a-40dd-8630-eedb25f4998d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1266 microversion: 2.1 time: 0.271517 Oct 04 21:11:08.016495 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 747/1516] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:07 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:08.036176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-54f9e334-e137-4039-9907-9327c575a545 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:08.037909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-54f9e334-e137-4039-9907-9327c575a545 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:08.060945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54f9e334-e137-4039-9907-9327c575a545 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:08.074774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54f9e334-e137-4039-9907-9327c575a545 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:08.077795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54f9e334-e137-4039-9907-9327c575a545 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:08.078931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54f9e334-e137-4039-9907-9327c575a545 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:08.079481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54f9e334-e137-4039-9907-9327c575a545 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:08.079983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54f9e334-e137-4039-9907-9327c575a545 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:08.247749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d1da33af-7ab0-4041-84f0-de3991aca25b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:08.258617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d1da33af-7ab0-4041-84f0-de3991aca25b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:08.265245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d1da33af-7ab0-4041-84f0-de3991aca25b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:08.270431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-54f9e334-e137-4039-9907-9327c575a545 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:08.282119 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d1da33af-7ab0-4041-84f0-de3991aca25b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1490 microversion: 2.91 time: 0.378469 Oct 04 21:11:08.293545 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-54f9e334-e137-4039-9907-9327c575a545 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1252 microversion: 2.1 time: 0.275346 Oct 04 21:11:08.294970 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 748/1517] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:08 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1252 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:08.298292 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 770/1518] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:07 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1490 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:08.372131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4cff7c56-31cc-4c6c-a4af-3ff7a6eefff5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:08.373332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4cff7c56-31cc-4c6c-a4af-3ff7a6eefff5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:08.383672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cff7c56-31cc-4c6c-a4af-3ff7a6eefff5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:08.384095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cff7c56-31cc-4c6c-a4af-3ff7a6eefff5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:08.393586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cff7c56-31cc-4c6c-a4af-3ff7a6eefff5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:08.394492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cff7c56-31cc-4c6c-a4af-3ff7a6eefff5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:08.398826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cff7c56-31cc-4c6c-a4af-3ff7a6eefff5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:08.399493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cff7c56-31cc-4c6c-a4af-3ff7a6eefff5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:08.464707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8d211b89-a30e-4b0d-9a58-f7b7a107c9b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:08.465567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8d211b89-a30e-4b0d-9a58-f7b7a107c9b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:08.478446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d211b89-a30e-4b0d-9a58-f7b7a107c9b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:08.482581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d211b89-a30e-4b0d-9a58-f7b7a107c9b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:08.483220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d211b89-a30e-4b0d-9a58-f7b7a107c9b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:08.484060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d211b89-a30e-4b0d-9a58-f7b7a107c9b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:08.484604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d211b89-a30e-4b0d-9a58-f7b7a107c9b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:08.485101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d211b89-a30e-4b0d-9a58-f7b7a107c9b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:08.735964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4cff7c56-31cc-4c6c-a4af-3ff7a6eefff5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:08.745006 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4cff7c56-31cc-4c6c-a4af-3ff7a6eefff5 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1472 microversion: 2.1 time: 0.381143 Oct 04 21:11:08.749937 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 749/1519] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:08 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1472 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:08.755008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1d9a96b8-1091-4ca8-9070-2bb0ccb0c4db tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:08.762960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1d9a96b8-1091-4ca8-9070-2bb0ccb0c4db tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:08.773267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d9a96b8-1091-4ca8-9070-2bb0ccb0c4db tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:08.782031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d9a96b8-1091-4ca8-9070-2bb0ccb0c4db tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:08.782582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d9a96b8-1091-4ca8-9070-2bb0ccb0c4db tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:08.783367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d9a96b8-1091-4ca8-9070-2bb0ccb0c4db tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:08.783862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d9a96b8-1091-4ca8-9070-2bb0ccb0c4db tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:08.784294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d9a96b8-1091-4ca8-9070-2bb0ccb0c4db tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:08.824309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8d211b89-a30e-4b0d-9a58-f7b7a107c9b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:08.837755 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8d211b89-a30e-4b0d-9a58-f7b7a107c9b9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1541 microversion: 2.1 time: 0.376650 Oct 04 21:11:08.839966 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 771/1520] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:08 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1541 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:08.913182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1d9a96b8-1091-4ca8-9070-2bb0ccb0c4db tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:08.926542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aaecac37-beeb-4e93-a881-871d0129c2b5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:08.927850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aaecac37-beeb-4e93-a881-871d0129c2b5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:08.936016 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1d9a96b8-1091-4ca8-9070-2bb0ccb0c4db tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1265 microversion: 2.1 time: 0.184377 Oct 04 21:11:08.936996 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 750/1521] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:08 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:08.941158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aaecac37-beeb-4e93-a881-871d0129c2b5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:08.941158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aaecac37-beeb-4e93-a881-871d0129c2b5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:08.941158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aaecac37-beeb-4e93-a881-871d0129c2b5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:08.941848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aaecac37-beeb-4e93-a881-871d0129c2b5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:08.942537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aaecac37-beeb-4e93-a881-871d0129c2b5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:08.945620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aaecac37-beeb-4e93-a881-871d0129c2b5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:09.044236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3e6a6766-e4f6-4c0e-934d-5a63e2659ef5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:09.045182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3e6a6766-e4f6-4c0e-934d-5a63e2659ef5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:09.051865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e6a6766-e4f6-4c0e-934d-5a63e2659ef5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:09.061341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e6a6766-e4f6-4c0e-934d-5a63e2659ef5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:09.061903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e6a6766-e4f6-4c0e-934d-5a63e2659ef5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:09.062679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e6a6766-e4f6-4c0e-934d-5a63e2659ef5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:09.063165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e6a6766-e4f6-4c0e-934d-5a63e2659ef5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:09.063603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e6a6766-e4f6-4c0e-934d-5a63e2659ef5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:09.168076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3e6a6766-e4f6-4c0e-934d-5a63e2659ef5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:09.182990 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3e6a6766-e4f6-4c0e-934d-5a63e2659ef5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1264 microversion: 2.1 time: 0.144471 Oct 04 21:11:09.197851 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 751/1522] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:09 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:09.293906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aaecac37-beeb-4e93-a881-871d0129c2b5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:09.313765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aaecac37-beeb-4e93-a881-871d0129c2b5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:09.317003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aaecac37-beeb-4e93-a881-871d0129c2b5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:09.322209 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aaecac37-beeb-4e93-a881-871d0129c2b5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.397594 Oct 04 21:11:09.322209 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 772/1523] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:08 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:11:09.331561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a78cde45-e743-4673-92ab-8a654e1af50f tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:09.332300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a78cde45-e743-4673-92ab-8a654e1af50f tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:09.340619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a78cde45-e743-4673-92ab-8a654e1af50f tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:09.344619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a78cde45-e743-4673-92ab-8a654e1af50f tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:09.345386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a78cde45-e743-4673-92ab-8a654e1af50f tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:09.351126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a78cde45-e743-4673-92ab-8a654e1af50f tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:09.351126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a78cde45-e743-4673-92ab-8a654e1af50f tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:09.351126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a78cde45-e743-4673-92ab-8a654e1af50f tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:09.360148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-44500c99-1617-40a6-99f9-f5593f4aef08 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:09.364006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-44500c99-1617-40a6-99f9-f5593f4aef08 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:09.376743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44500c99-1617-40a6-99f9-f5593f4aef08 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:09.377605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44500c99-1617-40a6-99f9-f5593f4aef08 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:09.378469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44500c99-1617-40a6-99f9-f5593f4aef08 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:09.392604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44500c99-1617-40a6-99f9-f5593f4aef08 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:09.393532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44500c99-1617-40a6-99f9-f5593f4aef08 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:09.396612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44500c99-1617-40a6-99f9-f5593f4aef08 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:09.517135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a78cde45-e743-4673-92ab-8a654e1af50f tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:09.526903 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a78cde45-e743-4673-92ab-8a654e1af50f tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1252 microversion: 2.1 time: 0.199166 Oct 04 21:11:09.527832 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 752/1524] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:09 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1252 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:09.543692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-3cf9ddac-a036-446a-9ac4-fc9dca9e9cfb req-3c81492a-5628-47bc-b2f3-138c9009e1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff9a9f7b-0c44-4de4-9171-a14d2c39e096", "name": "network-vif-deleted", "tag": "cac1c9b0-2f6f-49d5-bf55-ff55af059f63"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:09.557016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3cf9ddac-a036-446a-9ac4-fc9dca9e9cfb req-3c81492a-5628-47bc-b2f3-138c9009e1d2 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:09.557158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-44500c99-1617-40a6-99f9-f5593f4aef08 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:09.557277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3cf9ddac-a036-446a-9ac4-fc9dca9e9cfb req-3c81492a-5628-47bc-b2f3-138c9009e1d2 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:09.557728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3cf9ddac-a036-446a-9ac4-fc9dca9e9cfb req-3c81492a-5628-47bc-b2f3-138c9009e1d2 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:09.570698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-44500c99-1617-40a6-99f9-f5593f4aef08 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:09.572900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-44500c99-1617-40a6-99f9-f5593f4aef08 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:09.577415 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-3cf9ddac-a036-446a-9ac4-fc9dca9e9cfb req-3c81492a-5628-47bc-b2f3-138c9009e1d2 service nova] Creating event network-vif-deleted:cac1c9b0-2f6f-49d5-bf55-ff55af059f63 for instance ff9a9f7b-0c44-4de4-9171-a14d2c39e096 on n-h2-860282-1 Oct 04 21:11:09.584964 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-3cf9ddac-a036-446a-9ac4-fc9dca9e9cfb req-3c81492a-5628-47bc-b2f3-138c9009e1d2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054893 Oct 04 21:11:09.590159 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 753/1525] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:09.590730 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-44500c99-1617-40a6-99f9-f5593f4aef08 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.245912 Oct 04 21:11:09.592306 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 773/1526] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:09 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:09.773673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5f41dadd-c762-4a57-bd12-7acecbcf4aaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:09.776515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5f41dadd-c762-4a57-bd12-7acecbcf4aaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:09.797100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f41dadd-c762-4a57-bd12-7acecbcf4aaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:09.797997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f41dadd-c762-4a57-bd12-7acecbcf4aaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:09.798448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f41dadd-c762-4a57-bd12-7acecbcf4aaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:09.799182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f41dadd-c762-4a57-bd12-7acecbcf4aaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:09.802174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f41dadd-c762-4a57-bd12-7acecbcf4aaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:09.802639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f41dadd-c762-4a57-bd12-7acecbcf4aaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:09.864008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-30ce3304-31cb-4dff-9549-c2802f042624 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:09.865981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-30ce3304-31cb-4dff-9549-c2802f042624 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:09.879247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30ce3304-31cb-4dff-9549-c2802f042624 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:09.881273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30ce3304-31cb-4dff-9549-c2802f042624 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:09.882848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30ce3304-31cb-4dff-9549-c2802f042624 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:09.886714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30ce3304-31cb-4dff-9549-c2802f042624 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:09.887128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30ce3304-31cb-4dff-9549-c2802f042624 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:09.887601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30ce3304-31cb-4dff-9549-c2802f042624 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:10.114707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5f41dadd-c762-4a57-bd12-7acecbcf4aaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:10.124236 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5f41dadd-c762-4a57-bd12-7acecbcf4aaa tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1472 microversion: 2.1 time: 0.355548 Oct 04 21:11:10.128857 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 754/1527] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:09 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1472 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:10.130108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1173c339-e2e7-4881-b10d-00301877a5f1 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:10.137720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1173c339-e2e7-4881-b10d-00301877a5f1 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:10.140401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-30ce3304-31cb-4dff-9549-c2802f042624 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:10.147182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1173c339-e2e7-4881-b10d-00301877a5f1 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:10.147827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1173c339-e2e7-4881-b10d-00301877a5f1 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:10.148284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1173c339-e2e7-4881-b10d-00301877a5f1 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:10.149010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1173c339-e2e7-4881-b10d-00301877a5f1 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:10.149386 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-30ce3304-31cb-4dff-9549-c2802f042624 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1541 microversion: 2.1 time: 0.289777 Oct 04 21:11:10.149539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1173c339-e2e7-4881-b10d-00301877a5f1 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:10.150087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1173c339-e2e7-4881-b10d-00301877a5f1 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:10.166238 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 774/1528] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:09 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1541 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:10.210152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7c642358-9034-4cc4-9749-e8107db1578b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:10.210439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7c642358-9034-4cc4-9749-e8107db1578b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:10.217695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c642358-9034-4cc4-9749-e8107db1578b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:10.218442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c642358-9034-4cc4-9749-e8107db1578b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:10.219092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c642358-9034-4cc4-9749-e8107db1578b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:10.222098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c642358-9034-4cc4-9749-e8107db1578b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:10.222734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c642358-9034-4cc4-9749-e8107db1578b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:10.223180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c642358-9034-4cc4-9749-e8107db1578b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:10.223658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1173c339-e2e7-4881-b10d-00301877a5f1 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:10.234454 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1173c339-e2e7-4881-b10d-00301877a5f1 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1271 microversion: 2.1 time: 0.108282 Oct 04 21:11:10.298415 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 755/1529] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:10 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:10.348057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-15daa004-1aa0-4dee-8b83-1d00253a5939 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:10.348677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-15daa004-1aa0-4dee-8b83-1d00253a5939 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:10.355021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15daa004-1aa0-4dee-8b83-1d00253a5939 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:10.355518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15daa004-1aa0-4dee-8b83-1d00253a5939 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:10.355994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15daa004-1aa0-4dee-8b83-1d00253a5939 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:10.356782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15daa004-1aa0-4dee-8b83-1d00253a5939 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:10.357810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15daa004-1aa0-4dee-8b83-1d00253a5939 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:10.358566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15daa004-1aa0-4dee-8b83-1d00253a5939 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:10.376870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7c642358-9034-4cc4-9749-e8107db1578b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:10.387064 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7c642358-9034-4cc4-9749-e8107db1578b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1306 microversion: 2.1 time: 0.181439 Oct 04 21:11:10.387658 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 775/1530] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:10 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1306 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:10.503071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-15daa004-1aa0-4dee-8b83-1d00253a5939 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:10.512036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-15daa004-1aa0-4dee-8b83-1d00253a5939 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:10.514237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-15daa004-1aa0-4dee-8b83-1d00253a5939 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:10.515433 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-15daa004-1aa0-4dee-8b83-1d00253a5939 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.171396 Oct 04 21:11:10.516013 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 756/1531] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:10 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:11:10.550067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f3dac498-75cf-4a5d-b9bd-28cc407ccc99 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:10.550689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f3dac498-75cf-4a5d-b9bd-28cc407ccc99 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:10.556571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3dac498-75cf-4a5d-b9bd-28cc407ccc99 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:10.557049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3dac498-75cf-4a5d-b9bd-28cc407ccc99 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:10.557634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3dac498-75cf-4a5d-b9bd-28cc407ccc99 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:10.558307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3dac498-75cf-4a5d-b9bd-28cc407ccc99 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:10.558760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3dac498-75cf-4a5d-b9bd-28cc407ccc99 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:10.559178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3dac498-75cf-4a5d-b9bd-28cc407ccc99 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:10.621288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-691f4656-6a3d-453c-a495-6b5b621e706b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:10.622345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-691f4656-6a3d-453c-a495-6b5b621e706b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:10.631171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f3dac498-75cf-4a5d-b9bd-28cc407ccc99 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:10.634370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-691f4656-6a3d-453c-a495-6b5b621e706b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:10.634808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-691f4656-6a3d-453c-a495-6b5b621e706b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:10.635253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-691f4656-6a3d-453c-a495-6b5b621e706b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:10.636151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-691f4656-6a3d-453c-a495-6b5b621e706b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:10.636604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-691f4656-6a3d-453c-a495-6b5b621e706b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:10.637037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-691f4656-6a3d-453c-a495-6b5b621e706b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:10.643883 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f3dac498-75cf-4a5d-b9bd-28cc407ccc99 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1252 microversion: 2.1 time: 0.097597 Oct 04 21:11:10.644476 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 776/1532] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:10 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1252 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:10.711407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-691f4656-6a3d-453c-a495-6b5b621e706b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:10.720868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-691f4656-6a3d-453c-a495-6b5b621e706b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:10.722752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-691f4656-6a3d-453c-a495-6b5b621e706b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:10.727848 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-691f4656-6a3d-453c-a495-6b5b621e706b tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.111592 Oct 04 21:11:10.728435 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 757/1533] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:10 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:11:11.148244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c56ff5d3-58b6-474f-b79b-8c9b63601d2e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:11.149054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c56ff5d3-58b6-474f-b79b-8c9b63601d2e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:11.157863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c56ff5d3-58b6-474f-b79b-8c9b63601d2e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:11.158567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c56ff5d3-58b6-474f-b79b-8c9b63601d2e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:11.159204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c56ff5d3-58b6-474f-b79b-8c9b63601d2e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:11.172768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-99a0588a-38ab-4a7a-bc57-50b53bab75a1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:11.173473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-99a0588a-38ab-4a7a-bc57-50b53bab75a1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:11.181954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99a0588a-38ab-4a7a-bc57-50b53bab75a1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:11.185968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99a0588a-38ab-4a7a-bc57-50b53bab75a1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:11.186459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99a0588a-38ab-4a7a-bc57-50b53bab75a1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:11.187206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99a0588a-38ab-4a7a-bc57-50b53bab75a1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:11.187679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99a0588a-38ab-4a7a-bc57-50b53bab75a1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:11.188122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99a0588a-38ab-4a7a-bc57-50b53bab75a1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:11.200264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c56ff5d3-58b6-474f-b79b-8c9b63601d2e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:11.203412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c56ff5d3-58b6-474f-b79b-8c9b63601d2e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:11.204648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c56ff5d3-58b6-474f-b79b-8c9b63601d2e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:11.579234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:11.682148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-99a0588a-38ab-4a7a-bc57-50b53bab75a1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:11.693323 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-99a0588a-38ab-4a7a-bc57-50b53bab75a1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1541 microversion: 2.1 time: 0.525041 Oct 04 21:11:11.693953 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 758/1534] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:11 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1541 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:11.709825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3ca7ced9-deb8-4dc7-8d2f-de010a5662a6 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:11.713196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3ca7ced9-deb8-4dc7-8d2f-de010a5662a6 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:11.718676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c56ff5d3-58b6-474f-b79b-8c9b63601d2e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:11.727780 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c56ff5d3-58b6-474f-b79b-8c9b63601d2e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1472 microversion: 2.1 time: 0.583388 Oct 04 21:11:11.733405 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 777/1535] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:11 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1472 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:11.741981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ca7ced9-deb8-4dc7-8d2f-de010a5662a6 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:11.742737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ca7ced9-deb8-4dc7-8d2f-de010a5662a6 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:11.743642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ca7ced9-deb8-4dc7-8d2f-de010a5662a6 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:11.749918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ca7ced9-deb8-4dc7-8d2f-de010a5662a6 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:11.751176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-33ea689f-57fa-418b-9060-7f6d66cd8cf0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:11.752002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ca7ced9-deb8-4dc7-8d2f-de010a5662a6 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:11.752792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-33ea689f-57fa-418b-9060-7f6d66cd8cf0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:11.753406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ca7ced9-deb8-4dc7-8d2f-de010a5662a6 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:11.770739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33ea689f-57fa-418b-9060-7f6d66cd8cf0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:11.775575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33ea689f-57fa-418b-9060-7f6d66cd8cf0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:11.776024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33ea689f-57fa-418b-9060-7f6d66cd8cf0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:11.785539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33ea689f-57fa-418b-9060-7f6d66cd8cf0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:11.786335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33ea689f-57fa-418b-9060-7f6d66cd8cf0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:11.786969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33ea689f-57fa-418b-9060-7f6d66cd8cf0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:11.965757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3ca7ced9-deb8-4dc7-8d2f-de010a5662a6 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:11.978592 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3ca7ced9-deb8-4dc7-8d2f-de010a5662a6 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1271 microversion: 2.1 time: 0.279827 Oct 04 21:11:11.981069 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 759/1536] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:11 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1271 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:11.987418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8da93e75-8ce4-4e9e-9afc-ad9a1b4448ae tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:11.988323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8da93e75-8ce4-4e9e-9afc-ad9a1b4448ae tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:11.998667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8da93e75-8ce4-4e9e-9afc-ad9a1b4448ae tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:11.999448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8da93e75-8ce4-4e9e-9afc-ad9a1b4448ae tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:12.000108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8da93e75-8ce4-4e9e-9afc-ad9a1b4448ae tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:12.002030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8da93e75-8ce4-4e9e-9afc-ad9a1b4448ae tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:12.002753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8da93e75-8ce4-4e9e-9afc-ad9a1b4448ae tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:12.005593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8da93e75-8ce4-4e9e-9afc-ad9a1b4448ae tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:12.028538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-33ea689f-57fa-418b-9060-7f6d66cd8cf0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:12.039646 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-33ea689f-57fa-418b-9060-7f6d66cd8cf0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1306 microversion: 2.1 time: 0.303575 Oct 04 21:11:12.041113 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 778/1537] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:11 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1306 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:12.046237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cefa7a8f-e4b0-4921-b8f0-a2b208305cf0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:12.050254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cefa7a8f-e4b0-4921-b8f0-a2b208305cf0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:12.054715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cefa7a8f-e4b0-4921-b8f0-a2b208305cf0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:12.055543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cefa7a8f-e4b0-4921-b8f0-a2b208305cf0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:12.056478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cefa7a8f-e4b0-4921-b8f0-a2b208305cf0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:12.057482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cefa7a8f-e4b0-4921-b8f0-a2b208305cf0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:12.058178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cefa7a8f-e4b0-4921-b8f0-a2b208305cf0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:12.058889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cefa7a8f-e4b0-4921-b8f0-a2b208305cf0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:12.330013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cefa7a8f-e4b0-4921-b8f0-a2b208305cf0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:12.356710 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cefa7a8f-e4b0-4921-b8f0-a2b208305cf0 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1252 microversion: 2.1 time: 0.297362 Oct 04 21:11:12.356710 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 779/1538] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:12 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1252 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:12.356710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a1812d4e-e884-497c-ade2-bb5f8854ad64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:12.356710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a1812d4e-e884-497c-ade2-bb5f8854ad64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:12.360764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1812d4e-e884-497c-ade2-bb5f8854ad64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:12.361567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1812d4e-e884-497c-ade2-bb5f8854ad64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:12.363407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1812d4e-e884-497c-ade2-bb5f8854ad64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:12.366347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1812d4e-e884-497c-ade2-bb5f8854ad64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:12.367031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1812d4e-e884-497c-ade2-bb5f8854ad64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:12.367949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1812d4e-e884-497c-ade2-bb5f8854ad64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:12.522233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a1812d4e-e884-497c-ade2-bb5f8854ad64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:12.538539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a1812d4e-e884-497c-ade2-bb5f8854ad64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:12.541890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a1812d4e-e884-497c-ade2-bb5f8854ad64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:12.550399 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a1812d4e-e884-497c-ade2-bb5f8854ad64 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.205931 Oct 04 21:11:12.551729 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 780/1539] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:12 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:12.718761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c34aae7a-28ac-4981-bf58-671e46e9bbdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:12.719445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c34aae7a-28ac-4981-bf58-671e46e9bbdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:12.722604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:12.725224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=10 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:12.731805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c34aae7a-28ac-4981-bf58-671e46e9bbdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:12.738171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c34aae7a-28ac-4981-bf58-671e46e9bbdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:12.738171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c34aae7a-28ac-4981-bf58-671e46e9bbdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:12.738171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c34aae7a-28ac-4981-bf58-671e46e9bbdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:12.738171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c34aae7a-28ac-4981-bf58-671e46e9bbdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:12.738171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c34aae7a-28ac-4981-bf58-671e46e9bbdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:12.807099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8da93e75-8ce4-4e9e-9afc-ad9a1b4448ae tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:12.824449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8da93e75-8ce4-4e9e-9afc-ad9a1b4448ae tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:12.830859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8da93e75-8ce4-4e9e-9afc-ad9a1b4448ae tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:12.834191 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8da93e75-8ce4-4e9e-9afc-ad9a1b4448ae tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.850753 Oct 04 21:11:12.835723 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 760/1540] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:11 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:12.852213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5130f7f7-c26f-4d73-a2c5-911354c22c69 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:12.859485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5130f7f7-c26f-4d73-a2c5-911354c22c69 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:12.869834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5130f7f7-c26f-4d73-a2c5-911354c22c69 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:12.870652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5130f7f7-c26f-4d73-a2c5-911354c22c69 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:12.872709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5130f7f7-c26f-4d73-a2c5-911354c22c69 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:12.873680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5130f7f7-c26f-4d73-a2c5-911354c22c69 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:12.875428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5130f7f7-c26f-4d73-a2c5-911354c22c69 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:12.876645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5130f7f7-c26f-4d73-a2c5-911354c22c69 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:13.904743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=10 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:14.112956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c34aae7a-28ac-4981-bf58-671e46e9bbdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:14.128099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5130f7f7-c26f-4d73-a2c5-911354c22c69 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:14.138605 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c34aae7a-28ac-4981-bf58-671e46e9bbdc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1540 microversion: 2.1 time: 1.422244 Oct 04 21:11:14.145763 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 781/1541] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:12 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1540 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:14.146591 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5130f7f7-c26f-4d73-a2c5-911354c22c69 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1472 microversion: 2.1 time: 1.303028 Oct 04 21:11:14.150031 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 761/1542] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:12 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1472 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:14.167678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-381f14b2-35d7-4293-abcc-154149662fbc tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:14.168398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-381f14b2-35d7-4293-abcc-154149662fbc tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:14.182958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fc1e04d9-9949-4f02-ab33-2ee51fc68113 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:14.183593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fc1e04d9-9949-4f02-ab33-2ee51fc68113 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:14.188650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:14.199117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-381f14b2-35d7-4293-abcc-154149662fbc tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:14.199620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-381f14b2-35d7-4293-abcc-154149662fbc tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:14.200064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-381f14b2-35d7-4293-abcc-154149662fbc tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:14.206318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-381f14b2-35d7-4293-abcc-154149662fbc tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:14.206873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-381f14b2-35d7-4293-abcc-154149662fbc tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:14.210780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-381f14b2-35d7-4293-abcc-154149662fbc tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:14.212814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc1e04d9-9949-4f02-ab33-2ee51fc68113 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:14.213322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc1e04d9-9949-4f02-ab33-2ee51fc68113 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:14.214976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc1e04d9-9949-4f02-ab33-2ee51fc68113 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:14.216816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc1e04d9-9949-4f02-ab33-2ee51fc68113 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:14.219747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc1e04d9-9949-4f02-ab33-2ee51fc68113 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:14.220243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc1e04d9-9949-4f02-ab33-2ee51fc68113 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:14.842287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-381f14b2-35d7-4293-abcc-154149662fbc tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:14.851671 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-381f14b2-35d7-4293-abcc-154149662fbc tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1306 microversion: 2.1 time: 0.700016 Oct 04 21:11:14.858639 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 762/1543] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:14 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1306 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:14.871375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f0535f8d-57dd-4453-83d2-0b64fc3c9a3e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:14.874155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f0535f8d-57dd-4453-83d2-0b64fc3c9a3e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:14.904013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0535f8d-57dd-4453-83d2-0b64fc3c9a3e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:14.906531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0535f8d-57dd-4453-83d2-0b64fc3c9a3e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:14.907225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0535f8d-57dd-4453-83d2-0b64fc3c9a3e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:14.910458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0535f8d-57dd-4453-83d2-0b64fc3c9a3e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:14.910928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0535f8d-57dd-4453-83d2-0b64fc3c9a3e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:14.912269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0535f8d-57dd-4453-83d2-0b64fc3c9a3e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:15.299298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f0535f8d-57dd-4453-83d2-0b64fc3c9a3e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:15.308038 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f0535f8d-57dd-4453-83d2-0b64fc3c9a3e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1252 microversion: 2.1 time: 0.447962 Oct 04 21:11:15.325136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fc1e04d9-9949-4f02-ab33-2ee51fc68113 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:15.330141 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 763/1544] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:14 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1252 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:15.336147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-49424cf3-044a-4fc7-9127-023791451e74 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:15.337435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-49424cf3-044a-4fc7-9127-023791451e74 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:15.345005 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fc1e04d9-9949-4f02-ab33-2ee51fc68113 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1313 microversion: 2.1 time: 1.178653 Oct 04 21:11:15.345753 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 782/1545] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:14 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1313 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:15.346009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49424cf3-044a-4fc7-9127-023791451e74 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:15.347126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49424cf3-044a-4fc7-9127-023791451e74 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:15.347581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49424cf3-044a-4fc7-9127-023791451e74 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:15.348431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49424cf3-044a-4fc7-9127-023791451e74 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:15.348953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49424cf3-044a-4fc7-9127-023791451e74 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:15.349386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49424cf3-044a-4fc7-9127-023791451e74 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:15.355374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:15.397911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6292184a-2a4e-4714-a1e1-0212562763f2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:15.399278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6292184a-2a4e-4714-a1e1-0212562763f2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:15.414285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6292184a-2a4e-4714-a1e1-0212562763f2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:15.417921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6292184a-2a4e-4714-a1e1-0212562763f2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:15.422265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6292184a-2a4e-4714-a1e1-0212562763f2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:15.422265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6292184a-2a4e-4714-a1e1-0212562763f2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:15.422265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6292184a-2a4e-4714-a1e1-0212562763f2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:15.422265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6292184a-2a4e-4714-a1e1-0212562763f2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:15.585913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-49424cf3-044a-4fc7-9127-023791451e74 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:15.611014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-49424cf3-044a-4fc7-9127-023791451e74 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:15.615900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-49424cf3-044a-4fc7-9127-023791451e74 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:15.637407 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-49424cf3-044a-4fc7-9127-023791451e74 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.305917 Oct 04 21:11:15.638333 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 764/1546] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:15 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:15.682716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-5bb1cd2c-f56a-4353-9773-50399c320af3 req-c1db0398-ba49-49c2-ba37-4d47c3990bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d6d417-8aac-434b-a689-84c2743275a4", "tag": "710fdc6c-d6aa-4274-b2e7-cd799803ec89"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:15.698434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-5bb1cd2c-f56a-4353-9773-50399c320af3 req-c1db0398-ba49-49c2-ba37-4d47c3990bb4 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:15.699234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-5bb1cd2c-f56a-4353-9773-50399c320af3 req-c1db0398-ba49-49c2-ba37-4d47c3990bb4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:15.699889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-5bb1cd2c-f56a-4353-9773-50399c320af3 req-c1db0398-ba49-49c2-ba37-4d47c3990bb4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:15.714731 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-5bb1cd2c-f56a-4353-9773-50399c320af3 req-c1db0398-ba49-49c2-ba37-4d47c3990bb4 service nova] Creating event network-changed:710fdc6c-d6aa-4274-b2e7-cd799803ec89 for instance 08d6d417-8aac-434b-a689-84c2743275a4 on n-h2-860282-1 Oct 04 21:11:15.722222 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-5bb1cd2c-f56a-4353-9773-50399c320af3 req-c1db0398-ba49-49c2-ba37-4d47c3990bb4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051733 Oct 04 21:11:15.723526 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 765/1547] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:15.820854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6292184a-2a4e-4714-a1e1-0212562763f2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:15.830863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6292184a-2a4e-4714-a1e1-0212562763f2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:15.832306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6292184a-2a4e-4714-a1e1-0212562763f2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:15.845601 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6292184a-2a4e-4714-a1e1-0212562763f2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.448886 Oct 04 21:11:15.846282 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 783/1548] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:15 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:15.851097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d16a19b5-7500-4a9d-99e4-1e6b6971c2a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:15.851280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-cd1be287-378c-44ab-9f73-ddde6f8f6d6b req-d4fbcfdd-55b3-4db6-9574-bc87231ece27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd2cb6e2-2e03-406a-96ae-8be64d9af891", "tag": "276b608c-4c83-4365-9c25-8af46d2dd192"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:15.852049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d16a19b5-7500-4a9d-99e4-1e6b6971c2a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:15.864257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cd1be287-378c-44ab-9f73-ddde6f8f6d6b req-d4fbcfdd-55b3-4db6-9574-bc87231ece27 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:15.864751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cd1be287-378c-44ab-9f73-ddde6f8f6d6b req-d4fbcfdd-55b3-4db6-9574-bc87231ece27 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:15.865570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cd1be287-378c-44ab-9f73-ddde6f8f6d6b req-d4fbcfdd-55b3-4db6-9574-bc87231ece27 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:15.866737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d16a19b5-7500-4a9d-99e4-1e6b6971c2a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:15.867398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d16a19b5-7500-4a9d-99e4-1e6b6971c2a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:15.868000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d16a19b5-7500-4a9d-99e4-1e6b6971c2a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:15.875134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d16a19b5-7500-4a9d-99e4-1e6b6971c2a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:15.875811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d16a19b5-7500-4a9d-99e4-1e6b6971c2a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:15.878019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d16a19b5-7500-4a9d-99e4-1e6b6971c2a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:15.881112 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-cd1be287-378c-44ab-9f73-ddde6f8f6d6b req-d4fbcfdd-55b3-4db6-9574-bc87231ece27 service nova] Creating event network-changed:276b608c-4c83-4365-9c25-8af46d2dd192 for instance fd2cb6e2-2e03-406a-96ae-8be64d9af891 on n-h2-860282-1 Oct 04 21:11:15.892100 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-cd1be287-378c-44ab-9f73-ddde6f8f6d6b req-d4fbcfdd-55b3-4db6-9574-bc87231ece27 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166566 Oct 04 21:11:15.894920 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 766/1549] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:15.900992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9c0787a3-0f59-4c5c-a9e6-423117ac6d06 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:15.902482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9c0787a3-0f59-4c5c-a9e6-423117ac6d06 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:15.910840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c0787a3-0f59-4c5c-a9e6-423117ac6d06 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:15.912040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c0787a3-0f59-4c5c-a9e6-423117ac6d06 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:15.912496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c0787a3-0f59-4c5c-a9e6-423117ac6d06 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:15.913215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c0787a3-0f59-4c5c-a9e6-423117ac6d06 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:15.913703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c0787a3-0f59-4c5c-a9e6-423117ac6d06 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:15.914238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c0787a3-0f59-4c5c-a9e6-423117ac6d06 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:16.086454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d16a19b5-7500-4a9d-99e4-1e6b6971c2a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:16.099921 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d16a19b5-7500-4a9d-99e4-1e6b6971c2a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1472 microversion: 2.1 time: 0.252544 Oct 04 21:11:16.101439 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 784/1550] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:15 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1472 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:16.115198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9c0787a3-0f59-4c5c-a9e6-423117ac6d06 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:16.123827 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9c0787a3-0f59-4c5c-a9e6-423117ac6d06 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1472 microversion: 2.1 time: 0.227679 Oct 04 21:11:16.124594 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 767/1551] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:15 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1472 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:16.151800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a140c677-b251-4db6-a8d8-9eda329c8cd8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:16.152347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a140c677-b251-4db6-a8d8-9eda329c8cd8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:16.158711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a140c677-b251-4db6-a8d8-9eda329c8cd8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:16.159233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a140c677-b251-4db6-a8d8-9eda329c8cd8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:16.160263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a140c677-b251-4db6-a8d8-9eda329c8cd8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:16.160378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a140c677-b251-4db6-a8d8-9eda329c8cd8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:16.160796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a140c677-b251-4db6-a8d8-9eda329c8cd8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:16.161220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a140c677-b251-4db6-a8d8-9eda329c8cd8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:16.178789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-9aa85e78-d2fe-4e64-9e4b-04c5859584c2 req-a6230c3b-6c28-4d90-934b-a72c719a7882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a7d656-c2a8-46fa-88dc-6c6cb1919c3b", "name": "network-vif-unplugged", "status": "completed", "tag": "0f85098b-592d-4f47-9950-f46b2b886584"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:16.192700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9aa85e78-d2fe-4e64-9e4b-04c5859584c2 req-a6230c3b-6c28-4d90-934b-a72c719a7882 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:16.193344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9aa85e78-d2fe-4e64-9e4b-04c5859584c2 req-a6230c3b-6c28-4d90-934b-a72c719a7882 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:16.194190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9aa85e78-d2fe-4e64-9e4b-04c5859584c2 req-a6230c3b-6c28-4d90-934b-a72c719a7882 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:16.212947 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-9aa85e78-d2fe-4e64-9e4b-04c5859584c2 req-a6230c3b-6c28-4d90-934b-a72c719a7882 service nova] Creating event network-vif-unplugged:0f85098b-592d-4f47-9950-f46b2b886584 for instance 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b on n-h2-860282-1 Oct 04 21:11:16.219886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-9aa85e78-d2fe-4e64-9e4b-04c5859584c2 req-a6230c3b-6c28-4d90-934b-a72c719a7882 service nova] Instance 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:11:16.226914 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-9aa85e78-d2fe-4e64-9e4b-04c5859584c2 req-a6230c3b-6c28-4d90-934b-a72c719a7882 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123549 Oct 04 21:11:16.227540 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 785/1552] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:16.330251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a140c677-b251-4db6-a8d8-9eda329c8cd8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:16.340333 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a140c677-b251-4db6-a8d8-9eda329c8cd8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1306 microversion: 2.1 time: 0.200919 Oct 04 21:11:16.342313 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 768/1553] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:16 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1306 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:16.352935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6db0cfbb-631c-4b80-b8c5-82d09c8827bb tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:16.353778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6db0cfbb-631c-4b80-b8c5-82d09c8827bb tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:16.358325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:16.362407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6db0cfbb-631c-4b80-b8c5-82d09c8827bb tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:16.362997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6db0cfbb-631c-4b80-b8c5-82d09c8827bb tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:16.363513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6db0cfbb-631c-4b80-b8c5-82d09c8827bb tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:16.364333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6db0cfbb-631c-4b80-b8c5-82d09c8827bb tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:16.364914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6db0cfbb-631c-4b80-b8c5-82d09c8827bb tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:16.365512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6db0cfbb-631c-4b80-b8c5-82d09c8827bb tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:16.384218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c1963128-8466-4c35-b819-4494cbd448ab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:16.384833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c1963128-8466-4c35-b819-4494cbd448ab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:16.389389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:16.391065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1963128-8466-4c35-b819-4494cbd448ab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:16.391573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1963128-8466-4c35-b819-4494cbd448ab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:16.392019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1963128-8466-4c35-b819-4494cbd448ab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:16.392740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1963128-8466-4c35-b819-4494cbd448ab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:16.393201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1963128-8466-4c35-b819-4494cbd448ab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:16.393681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1963128-8466-4c35-b819-4494cbd448ab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:16.460271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6db0cfbb-631c-4b80-b8c5-82d09c8827bb tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:16.469658 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6db0cfbb-631c-4b80-b8c5-82d09c8827bb tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1252 microversion: 2.1 time: 0.130187 Oct 04 21:11:16.470836 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 786/1554] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:16 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1252 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:16.564849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c1963128-8466-4c35-b819-4494cbd448ab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:16.573964 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c1963128-8466-4c35-b819-4494cbd448ab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1313 microversion: 2.1 time: 0.193552 Oct 04 21:11:16.574691 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 769/1555] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:16 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:16.676452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-558553b8-24c0-4702-a72a-444c6e7349e8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:16.677362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-558553b8-24c0-4702-a72a-444c6e7349e8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:16.691944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-558553b8-24c0-4702-a72a-444c6e7349e8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:16.692708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-558553b8-24c0-4702-a72a-444c6e7349e8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:16.693379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-558553b8-24c0-4702-a72a-444c6e7349e8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:16.694474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-558553b8-24c0-4702-a72a-444c6e7349e8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:16.695196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-558553b8-24c0-4702-a72a-444c6e7349e8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:16.695727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-558553b8-24c0-4702-a72a-444c6e7349e8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:16.793090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-558553b8-24c0-4702-a72a-444c6e7349e8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:16.809006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-558553b8-24c0-4702-a72a-444c6e7349e8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:16.811793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-558553b8-24c0-4702-a72a-444c6e7349e8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:16.818720 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-558553b8-24c0-4702-a72a-444c6e7349e8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.148270 Oct 04 21:11:16.837470 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 787/1556] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:16 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:16.877559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f87a5deb-93e7-4590-8a7a-e1571cecc837 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:16.878199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f87a5deb-93e7-4590-8a7a-e1571cecc837 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:16.891362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f87a5deb-93e7-4590-8a7a-e1571cecc837 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:16.891890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f87a5deb-93e7-4590-8a7a-e1571cecc837 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:16.895769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f87a5deb-93e7-4590-8a7a-e1571cecc837 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:16.898454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f87a5deb-93e7-4590-8a7a-e1571cecc837 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:16.898964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f87a5deb-93e7-4590-8a7a-e1571cecc837 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:16.900774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f87a5deb-93e7-4590-8a7a-e1571cecc837 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:17.078912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f87a5deb-93e7-4590-8a7a-e1571cecc837 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:17.090153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f87a5deb-93e7-4590-8a7a-e1571cecc837 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:17.092298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f87a5deb-93e7-4590-8a7a-e1571cecc837 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:17.094012 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f87a5deb-93e7-4590-8a7a-e1571cecc837 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.222198 Oct 04 21:11:17.094987 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 770/1557] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:16 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:17.127986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-81b27d9f-381e-4eaa-84ad-3122a70f8d52 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:17.129903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-81b27d9f-381e-4eaa-84ad-3122a70f8d52 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:17.136427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81b27d9f-381e-4eaa-84ad-3122a70f8d52 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:17.138629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81b27d9f-381e-4eaa-84ad-3122a70f8d52 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:17.139391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81b27d9f-381e-4eaa-84ad-3122a70f8d52 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:17.140517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81b27d9f-381e-4eaa-84ad-3122a70f8d52 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:17.141156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81b27d9f-381e-4eaa-84ad-3122a70f8d52 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:17.141832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81b27d9f-381e-4eaa-84ad-3122a70f8d52 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:17.152073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5540ad58-4085-41ea-a09b-f3b959e76c07 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:17.152669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5540ad58-4085-41ea-a09b-f3b959e76c07 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:17.162554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5540ad58-4085-41ea-a09b-f3b959e76c07 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:17.167044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5540ad58-4085-41ea-a09b-f3b959e76c07 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:17.167601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5540ad58-4085-41ea-a09b-f3b959e76c07 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:17.168526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5540ad58-4085-41ea-a09b-f3b959e76c07 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:17.171498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5540ad58-4085-41ea-a09b-f3b959e76c07 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:17.172058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5540ad58-4085-41ea-a09b-f3b959e76c07 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:17.503583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5540ad58-4085-41ea-a09b-f3b959e76c07 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:17.519746 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5540ad58-4085-41ea-a09b-f3b959e76c07 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1472 microversion: 2.1 time: 0.372277 Oct 04 21:11:17.540700 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 771/1558] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:17 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1472 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:17.561298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-09392d6f-d8b3-4065-985e-dc3080866890 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:17.562234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-09392d6f-d8b3-4065-985e-dc3080866890 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:17.582449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09392d6f-d8b3-4065-985e-dc3080866890 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:17.583166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09392d6f-d8b3-4065-985e-dc3080866890 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:17.583738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09392d6f-d8b3-4065-985e-dc3080866890 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:17.585064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09392d6f-d8b3-4065-985e-dc3080866890 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:17.586274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09392d6f-d8b3-4065-985e-dc3080866890 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:17.588922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09392d6f-d8b3-4065-985e-dc3080866890 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:17.715171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-81b27d9f-381e-4eaa-84ad-3122a70f8d52 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:17.725971 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-81b27d9f-381e-4eaa-84ad-3122a70f8d52 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1472 microversion: 2.1 time: 0.603500 Oct 04 21:11:17.726922 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 788/1559] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:17 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1472 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:17.733724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b948f619-a406-4754-878b-b7c95c08e4fa tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:17.734344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b948f619-a406-4754-878b-b7c95c08e4fa tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:17.745062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b948f619-a406-4754-878b-b7c95c08e4fa tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:17.745599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b948f619-a406-4754-878b-b7c95c08e4fa tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:17.746111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b948f619-a406-4754-878b-b7c95c08e4fa tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:17.751242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b948f619-a406-4754-878b-b7c95c08e4fa tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:17.751242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b948f619-a406-4754-878b-b7c95c08e4fa tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:17.751705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b948f619-a406-4754-878b-b7c95c08e4fa tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:17.816367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b948f619-a406-4754-878b-b7c95c08e4fa tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:17.817399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b948f619-a406-4754-878b-b7c95c08e4fa tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:17.817399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b948f619-a406-4754-878b-b7c95c08e4fa tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:17.817882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-b948f619-a406-4754-878b-b7c95c08e4fa tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lazy-loading 'fault' on Instance uuid ff9a9f7b-0c44-4de4-9171-a14d2c39e096 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:17.892384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b948f619-a406-4754-878b-b7c95c08e4fa tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:17.900777 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b948f619-a406-4754-878b-b7c95c08e4fa tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1257 microversion: 2.1 time: 0.172338 Oct 04 21:11:17.901790 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 789/1560] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:17 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1257 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:17.917819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-61670613-f644-4287-a6ab-bea9bb5b9bd7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:17.918548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-61670613-f644-4287-a6ab-bea9bb5b9bd7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:17.924999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61670613-f644-4287-a6ab-bea9bb5b9bd7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:17.925524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61670613-f644-4287-a6ab-bea9bb5b9bd7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:17.925988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61670613-f644-4287-a6ab-bea9bb5b9bd7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:17.926694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61670613-f644-4287-a6ab-bea9bb5b9bd7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:17.927175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61670613-f644-4287-a6ab-bea9bb5b9bd7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:17.927600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61670613-f644-4287-a6ab-bea9bb5b9bd7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:17.933624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-09392d6f-d8b3-4065-985e-dc3080866890 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:17.942693 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-09392d6f-d8b3-4065-985e-dc3080866890 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1306 microversion: 2.1 time: 0.397416 Oct 04 21:11:17.957890 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 772/1561] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:17 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1306 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:17.963717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5f0674c6-26bc-4814-934f-83eb615c019c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:17.964336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5f0674c6-26bc-4814-934f-83eb615c019c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:17.970709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f0674c6-26bc-4814-934f-83eb615c019c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:17.971206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f0674c6-26bc-4814-934f-83eb615c019c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:17.971650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f0674c6-26bc-4814-934f-83eb615c019c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:17.972412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f0674c6-26bc-4814-934f-83eb615c019c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:17.972816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f0674c6-26bc-4814-934f-83eb615c019c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:17.973244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f0674c6-26bc-4814-934f-83eb615c019c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:18.062156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5f0674c6-26bc-4814-934f-83eb615c019c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:18.070432 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5f0674c6-26bc-4814-934f-83eb615c019c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:18.071888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5f0674c6-26bc-4814-934f-83eb615c019c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:18.077122 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5f0674c6-26bc-4814-934f-83eb615c019c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.118274 Oct 04 21:11:18.077993 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 773/1562] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:17 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:18.103220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-61670613-f644-4287-a6ab-bea9bb5b9bd7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:18.111980 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-61670613-f644-4287-a6ab-bea9bb5b9bd7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1313 microversion: 2.1 time: 0.208814 Oct 04 21:11:18.112763 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 790/1563] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:17 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:18.126605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-12d8b357-a55b-4505-97b0-7485111589a6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:18.135005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-12d8b357-a55b-4505-97b0-7485111589a6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:18.135005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12d8b357-a55b-4505-97b0-7485111589a6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:18.135005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12d8b357-a55b-4505-97b0-7485111589a6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:18.135005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12d8b357-a55b-4505-97b0-7485111589a6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:18.135005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12d8b357-a55b-4505-97b0-7485111589a6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:18.135840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12d8b357-a55b-4505-97b0-7485111589a6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:18.135840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12d8b357-a55b-4505-97b0-7485111589a6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:18.273662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-12d8b357-a55b-4505-97b0-7485111589a6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:18.282623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-12d8b357-a55b-4505-97b0-7485111589a6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:18.284086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-12d8b357-a55b-4505-97b0-7485111589a6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:18.285320 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-12d8b357-a55b-4505-97b0-7485111589a6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.163698 Oct 04 21:11:18.285925 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 774/1564] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:18 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:18.550955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-94a46dc5-28f2-427c-a226-ffe5913cf1b2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:18.551568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-94a46dc5-28f2-427c-a226-ffe5913cf1b2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:18.561555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94a46dc5-28f2-427c-a226-ffe5913cf1b2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:18.562047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94a46dc5-28f2-427c-a226-ffe5913cf1b2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:18.565737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94a46dc5-28f2-427c-a226-ffe5913cf1b2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:18.565737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94a46dc5-28f2-427c-a226-ffe5913cf1b2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:18.565737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94a46dc5-28f2-427c-a226-ffe5913cf1b2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:18.565737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94a46dc5-28f2-427c-a226-ffe5913cf1b2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:18.706513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-94a46dc5-28f2-427c-a226-ffe5913cf1b2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:18.716168 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-94a46dc5-28f2-427c-a226-ffe5913cf1b2 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1490 microversion: 2.1 time: 0.169189 Oct 04 21:11:18.716980 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 791/1565] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:18 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1490 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:18.751517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4fa50367-a352-448e-bcd1-71a0a32c9453 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:18.752044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4fa50367-a352-448e-bcd1-71a0a32c9453 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:18.759275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fa50367-a352-448e-bcd1-71a0a32c9453 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:18.759275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fa50367-a352-448e-bcd1-71a0a32c9453 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:18.759531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fa50367-a352-448e-bcd1-71a0a32c9453 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:18.760140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fa50367-a352-448e-bcd1-71a0a32c9453 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:18.760635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fa50367-a352-448e-bcd1-71a0a32c9453 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:18.761060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fa50367-a352-448e-bcd1-71a0a32c9453 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:18.905702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4fa50367-a352-448e-bcd1-71a0a32c9453 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:18.913814 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4fa50367-a352-448e-bcd1-71a0a32c9453 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1472 microversion: 2.1 time: 0.167066 Oct 04 21:11:18.914392 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 775/1566] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:18 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1472 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:18.926210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ecf2a371-9c2f-49b1-8ffe-b2d6b7a1d5a8 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:18.926210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ecf2a371-9c2f-49b1-8ffe-b2d6b7a1d5a8 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:18.931607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ecf2a371-9c2f-49b1-8ffe-b2d6b7a1d5a8 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:18.932087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ecf2a371-9c2f-49b1-8ffe-b2d6b7a1d5a8 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:18.932518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ecf2a371-9c2f-49b1-8ffe-b2d6b7a1d5a8 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:18.933208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ecf2a371-9c2f-49b1-8ffe-b2d6b7a1d5a8 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:18.933689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ecf2a371-9c2f-49b1-8ffe-b2d6b7a1d5a8 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:18.934111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ecf2a371-9c2f-49b1-8ffe-b2d6b7a1d5a8 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:18.965566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ecf2a371-9c2f-49b1-8ffe-b2d6b7a1d5a8 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:18.966068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ecf2a371-9c2f-49b1-8ffe-b2d6b7a1d5a8 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:18.966577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ecf2a371-9c2f-49b1-8ffe-b2d6b7a1d5a8 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:18.966947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-ecf2a371-9c2f-49b1-8ffe-b2d6b7a1d5a8 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lazy-loading 'fault' on Instance uuid ff9a9f7b-0c44-4de4-9171-a14d2c39e096 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:18.971674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7263e5b2-3e6c-45c3-98d5-a68086b67759 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:18.971674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7263e5b2-3e6c-45c3-98d5-a68086b67759 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:18.978341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7263e5b2-3e6c-45c3-98d5-a68086b67759 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:18.978927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7263e5b2-3e6c-45c3-98d5-a68086b67759 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:18.979537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7263e5b2-3e6c-45c3-98d5-a68086b67759 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:18.980333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7263e5b2-3e6c-45c3-98d5-a68086b67759 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:18.981199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7263e5b2-3e6c-45c3-98d5-a68086b67759 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:18.982278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7263e5b2-3e6c-45c3-98d5-a68086b67759 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:19.013665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ecf2a371-9c2f-49b1-8ffe-b2d6b7a1d5a8 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:19.033815 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ecf2a371-9c2f-49b1-8ffe-b2d6b7a1d5a8 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1257 microversion: 2.1 time: 0.112983 Oct 04 21:11:19.034515 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 792/1567] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:18 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1257 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:19.104565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-052ef672-16e3-4ee8-85b1-88ca1c7ab241 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:19.105930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-052ef672-16e3-4ee8-85b1-88ca1c7ab241 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:19.117893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-052ef672-16e3-4ee8-85b1-88ca1c7ab241 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:19.118507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-052ef672-16e3-4ee8-85b1-88ca1c7ab241 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:19.119066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-052ef672-16e3-4ee8-85b1-88ca1c7ab241 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:19.122990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-052ef672-16e3-4ee8-85b1-88ca1c7ab241 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:19.122990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-052ef672-16e3-4ee8-85b1-88ca1c7ab241 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:19.122990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-052ef672-16e3-4ee8-85b1-88ca1c7ab241 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:19.343400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-052ef672-16e3-4ee8-85b1-88ca1c7ab241 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:19.361204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-052ef672-16e3-4ee8-85b1-88ca1c7ab241 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:19.366363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-052ef672-16e3-4ee8-85b1-88ca1c7ab241 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:19.379434 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-052ef672-16e3-4ee8-85b1-88ca1c7ab241 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.277335 Oct 04 21:11:19.380337 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 793/1568] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:19 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:11:19.393628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7263e5b2-3e6c-45c3-98d5-a68086b67759 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:19.400446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3d500941-558e-405c-bb86-6201b3a9e559 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:19.401091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3d500941-558e-405c-bb86-6201b3a9e559 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:19.404889 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7263e5b2-3e6c-45c3-98d5-a68086b67759 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1306 microversion: 2.1 time: 0.439232 Oct 04 21:11:19.418890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d500941-558e-405c-bb86-6201b3a9e559 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:19.419760 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 776/1569] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:18 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1306 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:19.420241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d500941-558e-405c-bb86-6201b3a9e559 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:19.420697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d500941-558e-405c-bb86-6201b3a9e559 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:19.421470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d500941-558e-405c-bb86-6201b3a9e559 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:19.428087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d500941-558e-405c-bb86-6201b3a9e559 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:19.428733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d500941-558e-405c-bb86-6201b3a9e559 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:19.438638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-37b16877-6e6c-4c43-86a4-ed06313b6421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:19.439539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-37b16877-6e6c-4c43-86a4-ed06313b6421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:19.458405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37b16877-6e6c-4c43-86a4-ed06313b6421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:19.459190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37b16877-6e6c-4c43-86a4-ed06313b6421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:19.459799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37b16877-6e6c-4c43-86a4-ed06313b6421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:19.461126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37b16877-6e6c-4c43-86a4-ed06313b6421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:19.462930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37b16877-6e6c-4c43-86a4-ed06313b6421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:19.463731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37b16877-6e6c-4c43-86a4-ed06313b6421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:19.804244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3d500941-558e-405c-bb86-6201b3a9e559 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:19.815287 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3d500941-558e-405c-bb86-6201b3a9e559 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1313 microversion: 2.1 time: 0.431623 Oct 04 21:11:19.816714 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 794/1570] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:19 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:19.821781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c3994cf3-2f92-4dfa-8df3-0d77727bc5fb tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:19.822665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c3994cf3-2f92-4dfa-8df3-0d77727bc5fb tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:19.830397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3994cf3-2f92-4dfa-8df3-0d77727bc5fb tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:19.831147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3994cf3-2f92-4dfa-8df3-0d77727bc5fb tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:19.831754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3994cf3-2f92-4dfa-8df3-0d77727bc5fb tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:19.832634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3994cf3-2f92-4dfa-8df3-0d77727bc5fb tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:19.833246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3994cf3-2f92-4dfa-8df3-0d77727bc5fb tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:19.833914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3994cf3-2f92-4dfa-8df3-0d77727bc5fb tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:19.839787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-37b16877-6e6c-4c43-86a4-ed06313b6421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:19.868736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-37b16877-6e6c-4c43-86a4-ed06313b6421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:19.870836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-37b16877-6e6c-4c43-86a4-ed06313b6421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:19.873341 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-37b16877-6e6c-4c43-86a4-ed06313b6421 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.451857 Oct 04 21:11:19.875230 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 777/1571] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:19 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:19.944262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-57a9a812-47ba-4c34-b160-1ee0f6e74928 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:19.946143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-57a9a812-47ba-4c34-b160-1ee0f6e74928 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:19.958106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57a9a812-47ba-4c34-b160-1ee0f6e74928 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:19.960934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57a9a812-47ba-4c34-b160-1ee0f6e74928 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:19.961636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57a9a812-47ba-4c34-b160-1ee0f6e74928 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:19.967267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57a9a812-47ba-4c34-b160-1ee0f6e74928 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:19.968152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57a9a812-47ba-4c34-b160-1ee0f6e74928 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:19.969030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57a9a812-47ba-4c34-b160-1ee0f6e74928 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:20.116745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c3994cf3-2f92-4dfa-8df3-0d77727bc5fb tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:20.129930 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c3994cf3-2f92-4dfa-8df3-0d77727bc5fb tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1478 microversion: 2.1 time: 0.310455 Oct 04 21:11:20.131674 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 795/1572] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:19 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1478 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:20.144113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3e3476ab-c387-434c-88f8-3b34b13fa7de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:20.144932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3e3476ab-c387-434c-88f8-3b34b13fa7de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:20.159902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3476ab-c387-434c-88f8-3b34b13fa7de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:20.175145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3476ab-c387-434c-88f8-3b34b13fa7de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:20.178862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3476ab-c387-434c-88f8-3b34b13fa7de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:20.179933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3476ab-c387-434c-88f8-3b34b13fa7de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:20.194405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3476ab-c387-434c-88f8-3b34b13fa7de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:20.200688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3476ab-c387-434c-88f8-3b34b13fa7de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:20.282423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-57a9a812-47ba-4c34-b160-1ee0f6e74928 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:20.284331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3476ab-c387-434c-88f8-3b34b13fa7de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:20.285292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3476ab-c387-434c-88f8-3b34b13fa7de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:20.286247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3476ab-c387-434c-88f8-3b34b13fa7de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:20.287202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-3e3476ab-c387-434c-88f8-3b34b13fa7de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lazy-loading 'fault' on Instance uuid ff9a9f7b-0c44-4de4-9171-a14d2c39e096 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:20.296889 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-57a9a812-47ba-4c34-b160-1ee0f6e74928 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1472 microversion: 2.1 time: 0.358201 Oct 04 21:11:20.297502 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 778/1573] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:19 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1472 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:20.342334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3e3476ab-c387-434c-88f8-3b34b13fa7de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:20.353184 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3e3476ab-c387-434c-88f8-3b34b13fa7de tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1257 microversion: 2.1 time: 0.220232 Oct 04 21:11:20.366258 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 796/1574] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:20 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1257 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:20.414998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d547e277-15c1-4784-9047-80241a93c22e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:20.415695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d547e277-15c1-4784-9047-80241a93c22e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:20.445128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ad1fa2ee-da54-4522-b454-a522ccc09e21 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:20.446469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ad1fa2ee-da54-4522-b454-a522ccc09e21 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:20.450318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d547e277-15c1-4784-9047-80241a93c22e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:20.452622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d547e277-15c1-4784-9047-80241a93c22e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:20.454922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d547e277-15c1-4784-9047-80241a93c22e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:20.460554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d547e277-15c1-4784-9047-80241a93c22e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:20.462404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d547e277-15c1-4784-9047-80241a93c22e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:20.464332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d547e277-15c1-4784-9047-80241a93c22e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:20.469292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad1fa2ee-da54-4522-b454-a522ccc09e21 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:20.471734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad1fa2ee-da54-4522-b454-a522ccc09e21 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:20.473772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad1fa2ee-da54-4522-b454-a522ccc09e21 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:20.477238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad1fa2ee-da54-4522-b454-a522ccc09e21 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:20.478815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad1fa2ee-da54-4522-b454-a522ccc09e21 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:20.480283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad1fa2ee-da54-4522-b454-a522ccc09e21 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:20.655150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d547e277-15c1-4784-9047-80241a93c22e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:20.663958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d547e277-15c1-4784-9047-80241a93c22e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:20.671698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d547e277-15c1-4784-9047-80241a93c22e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:20.686471 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d547e277-15c1-4784-9047-80241a93c22e tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.277948 Oct 04 21:11:20.688402 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 779/1575] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:20 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:20.765307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ad1fa2ee-da54-4522-b454-a522ccc09e21 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:20.775542 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ad1fa2ee-da54-4522-b454-a522ccc09e21 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1306 microversion: 2.1 time: 0.341454 Oct 04 21:11:20.789923 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 797/1576] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:20 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1306 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:20.846478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dd1f1963-b6f4-4340-bb71-9fd2be2821f3 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:20.847142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dd1f1963-b6f4-4340-bb71-9fd2be2821f3 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:20.876742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd1f1963-b6f4-4340-bb71-9fd2be2821f3 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:20.876742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd1f1963-b6f4-4340-bb71-9fd2be2821f3 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:20.877210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd1f1963-b6f4-4340-bb71-9fd2be2821f3 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:20.878135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd1f1963-b6f4-4340-bb71-9fd2be2821f3 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:20.878707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd1f1963-b6f4-4340-bb71-9fd2be2821f3 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:20.879257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd1f1963-b6f4-4340-bb71-9fd2be2821f3 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:20.902487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-abf1e669-fcef-4e23-9af2-eefadd696a1c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:20.903151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-abf1e669-fcef-4e23-9af2-eefadd696a1c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:20.910260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abf1e669-fcef-4e23-9af2-eefadd696a1c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:20.910762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abf1e669-fcef-4e23-9af2-eefadd696a1c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:20.911328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abf1e669-fcef-4e23-9af2-eefadd696a1c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:20.912640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abf1e669-fcef-4e23-9af2-eefadd696a1c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:20.913121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abf1e669-fcef-4e23-9af2-eefadd696a1c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:20.913579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abf1e669-fcef-4e23-9af2-eefadd696a1c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:21.104203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dd1f1963-b6f4-4340-bb71-9fd2be2821f3 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:21.113845 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dd1f1963-b6f4-4340-bb71-9fd2be2821f3 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1313 microversion: 2.1 time: 0.275604 Oct 04 21:11:21.114091 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 780/1577] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:20 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:21.161638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-175ca01c-8c0c-4905-8b41-074506c003ca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:21.161638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-175ca01c-8c0c-4905-8b41-074506c003ca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:21.166467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-175ca01c-8c0c-4905-8b41-074506c003ca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:21.166794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-175ca01c-8c0c-4905-8b41-074506c003ca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:21.167347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-175ca01c-8c0c-4905-8b41-074506c003ca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:21.168185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-175ca01c-8c0c-4905-8b41-074506c003ca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:21.168754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-175ca01c-8c0c-4905-8b41-074506c003ca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:21.170082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-175ca01c-8c0c-4905-8b41-074506c003ca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:21.203265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-abf1e669-fcef-4e23-9af2-eefadd696a1c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:21.215935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-abf1e669-fcef-4e23-9af2-eefadd696a1c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:21.218238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-abf1e669-fcef-4e23-9af2-eefadd696a1c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:21.219542 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-abf1e669-fcef-4e23-9af2-eefadd696a1c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.323004 Oct 04 21:11:21.222749 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 798/1578] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:20 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:11:21.326306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f42ca5f8-e72d-4648-a572-08717a41248d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:21.337842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f42ca5f8-e72d-4648-a572-08717a41248d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:21.337842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f42ca5f8-e72d-4648-a572-08717a41248d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:21.337842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f42ca5f8-e72d-4648-a572-08717a41248d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:21.337842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f42ca5f8-e72d-4648-a572-08717a41248d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:21.337842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f42ca5f8-e72d-4648-a572-08717a41248d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:21.337842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f42ca5f8-e72d-4648-a572-08717a41248d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:21.337842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f42ca5f8-e72d-4648-a572-08717a41248d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:21.365393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-175ca01c-8c0c-4905-8b41-074506c003ca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:21.379201 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-175ca01c-8c0c-4905-8b41-074506c003ca tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1478 microversion: 2.1 time: 0.224405 Oct 04 21:11:21.389689 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 781/1579] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:21 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1478 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:21.389689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9c41f10c-8a21-4b01-83be-62e21579c955 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:21.389689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9c41f10c-8a21-4b01-83be-62e21579c955 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:21.401394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c41f10c-8a21-4b01-83be-62e21579c955 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:21.401394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c41f10c-8a21-4b01-83be-62e21579c955 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:21.401394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c41f10c-8a21-4b01-83be-62e21579c955 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:21.401394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c41f10c-8a21-4b01-83be-62e21579c955 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:21.401394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c41f10c-8a21-4b01-83be-62e21579c955 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:21.402005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c41f10c-8a21-4b01-83be-62e21579c955 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:21.429388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:21.445551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c41f10c-8a21-4b01-83be-62e21579c955 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:21.446102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c41f10c-8a21-4b01-83be-62e21579c955 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:21.446560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c41f10c-8a21-4b01-83be-62e21579c955 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:21.447213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-9c41f10c-8a21-4b01-83be-62e21579c955 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lazy-loading 'fault' on Instance uuid ff9a9f7b-0c44-4de4-9171-a14d2c39e096 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:21.534625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9c41f10c-8a21-4b01-83be-62e21579c955 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:21.542997 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9c41f10c-8a21-4b01-83be-62e21579c955 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1257 microversion: 2.1 time: 0.161082 Oct 04 21:11:21.547316 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 782/1580] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:21 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1257 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:21.685824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f42ca5f8-e72d-4648-a572-08717a41248d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:21.703113 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f42ca5f8-e72d-4648-a572-08717a41248d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1472 microversion: 2.1 time: 0.381091 Oct 04 21:11:21.725935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-967197ff-6711-4cc8-951e-6e57a662f3b6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:21.726564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-967197ff-6711-4cc8-951e-6e57a662f3b6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:21.727379 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 799/1581] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:21 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1472 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:21.746628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-fca9699c-371b-476e-ae0b-58df44649bc2 req-0a093cd0-880c-4b73-8210-58499be1958f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d6d417-8aac-434b-a689-84c2743275a4", "name": "network-vif-plugged", "status": "completed", "tag": "710fdc6c-d6aa-4274-b2e7-cd799803ec89"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:21.775335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-967197ff-6711-4cc8-951e-6e57a662f3b6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:21.776395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-967197ff-6711-4cc8-951e-6e57a662f3b6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:21.778682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-967197ff-6711-4cc8-951e-6e57a662f3b6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:21.783418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-fca9699c-371b-476e-ae0b-58df44649bc2 req-0a093cd0-880c-4b73-8210-58499be1958f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:21.784480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-fca9699c-371b-476e-ae0b-58df44649bc2 req-0a093cd0-880c-4b73-8210-58499be1958f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:21.786596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-fca9699c-371b-476e-ae0b-58df44649bc2 req-0a093cd0-880c-4b73-8210-58499be1958f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:21.796439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-967197ff-6711-4cc8-951e-6e57a662f3b6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:21.797263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-967197ff-6711-4cc8-951e-6e57a662f3b6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:21.798045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-967197ff-6711-4cc8-951e-6e57a662f3b6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:21.819491 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-fca9699c-371b-476e-ae0b-58df44649bc2 req-0a093cd0-880c-4b73-8210-58499be1958f service nova] Creating event network-vif-plugged:710fdc6c-d6aa-4274-b2e7-cd799803ec89 for instance 08d6d417-8aac-434b-a689-84c2743275a4 on n-h2-860282-1 Oct 04 21:11:21.830062 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-fca9699c-371b-476e-ae0b-58df44649bc2 req-0a093cd0-880c-4b73-8210-58499be1958f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099504 Oct 04 21:11:21.832162 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 800/1582] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:21.842082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-97686ee5-10bb-4bc9-8fca-021a136efb02 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:21.844050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-97686ee5-10bb-4bc9-8fca-021a136efb02 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:21.861510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-97686ee5-10bb-4bc9-8fca-021a136efb02 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:21.863247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-97686ee5-10bb-4bc9-8fca-021a136efb02 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:21.864896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-97686ee5-10bb-4bc9-8fca-021a136efb02 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:21.866557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-97686ee5-10bb-4bc9-8fca-021a136efb02 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:21.867655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-97686ee5-10bb-4bc9-8fca-021a136efb02 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:21.869645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-97686ee5-10bb-4bc9-8fca-021a136efb02 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:22.134698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-967197ff-6711-4cc8-951e-6e57a662f3b6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:22.192714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-967197ff-6711-4cc8-951e-6e57a662f3b6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:22.200751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-967197ff-6711-4cc8-951e-6e57a662f3b6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:22.215014 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-967197ff-6711-4cc8-951e-6e57a662f3b6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.499433 Oct 04 21:11:22.216619 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 783/1583] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:21 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:22.223119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b2995e10-4107-4a9b-b069-209c89adcf1b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:22.224172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b2995e10-4107-4a9b-b069-209c89adcf1b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:22.236562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2995e10-4107-4a9b-b069-209c89adcf1b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:22.244567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2995e10-4107-4a9b-b069-209c89adcf1b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:22.244567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2995e10-4107-4a9b-b069-209c89adcf1b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:22.244567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2995e10-4107-4a9b-b069-209c89adcf1b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:22.244567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2995e10-4107-4a9b-b069-209c89adcf1b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:22.244567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2995e10-4107-4a9b-b069-209c89adcf1b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:22.583380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-97686ee5-10bb-4bc9-8fca-021a136efb02 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:22.604945 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-97686ee5-10bb-4bc9-8fca-021a136efb02 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1306 microversion: 2.1 time: 0.770544 Oct 04 21:11:22.606502 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 801/1584] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:21 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1306 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:22.626282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b5243100-097c-4b2b-8878-1e1fcdc75961 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:22.627040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b5243100-097c-4b2b-8878-1e1fcdc75961 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:22.645846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5243100-097c-4b2b-8878-1e1fcdc75961 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:22.654538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5243100-097c-4b2b-8878-1e1fcdc75961 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:22.655281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5243100-097c-4b2b-8878-1e1fcdc75961 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:22.661633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5243100-097c-4b2b-8878-1e1fcdc75961 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:22.662292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5243100-097c-4b2b-8878-1e1fcdc75961 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:22.663444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5243100-097c-4b2b-8878-1e1fcdc75961 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:22.911526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b2995e10-4107-4a9b-b069-209c89adcf1b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:22.927911 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b2995e10-4107-4a9b-b069-209c89adcf1b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1313 microversion: 2.1 time: 0.709787 Oct 04 21:11:22.944395 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 784/1585] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:22 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1313 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:22.954400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3286f15e-400d-4cb8-b82a-592b0eed2143 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:22.955345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3286f15e-400d-4cb8-b82a-592b0eed2143 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:22.969674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3286f15e-400d-4cb8-b82a-592b0eed2143 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:22.970418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3286f15e-400d-4cb8-b82a-592b0eed2143 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:22.971260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3286f15e-400d-4cb8-b82a-592b0eed2143 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:22.972148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3286f15e-400d-4cb8-b82a-592b0eed2143 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:22.972775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3286f15e-400d-4cb8-b82a-592b0eed2143 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:22.973192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3286f15e-400d-4cb8-b82a-592b0eed2143 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:22.974766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b5243100-097c-4b2b-8878-1e1fcdc75961 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:22.984972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:22.989331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b5243100-097c-4b2b-8878-1e1fcdc75961 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:22.990922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b5243100-097c-4b2b-8878-1e1fcdc75961 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:22.992347 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b5243100-097c-4b2b-8878-1e1fcdc75961 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.381528 Oct 04 21:11:23.006834 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 802/1586] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:22 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:23.031603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1113dd73-0765-4a52-83a8-b71c2224bb02 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:23.032222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1113dd73-0765-4a52-83a8-b71c2224bb02 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:23.065112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1113dd73-0765-4a52-83a8-b71c2224bb02 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:23.076450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1113dd73-0765-4a52-83a8-b71c2224bb02 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:23.076450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1113dd73-0765-4a52-83a8-b71c2224bb02 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:23.076450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1113dd73-0765-4a52-83a8-b71c2224bb02 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:23.076450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1113dd73-0765-4a52-83a8-b71c2224bb02 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:23.076450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1113dd73-0765-4a52-83a8-b71c2224bb02 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:23.173788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1113dd73-0765-4a52-83a8-b71c2224bb02 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:23.178201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1113dd73-0765-4a52-83a8-b71c2224bb02 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:23.181699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1113dd73-0765-4a52-83a8-b71c2224bb02 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:23.182304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-1113dd73-0765-4a52-83a8-b71c2224bb02 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lazy-loading 'fault' on Instance uuid ff9a9f7b-0c44-4de4-9171-a14d2c39e096 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:23.255408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3286f15e-400d-4cb8-b82a-592b0eed2143 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:23.261195 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3286f15e-400d-4cb8-b82a-592b0eed2143 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1478 microversion: 2.1 time: 0.312283 Oct 04 21:11:23.265976 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 785/1587] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:22 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1478 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:23.275518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d61971a9-269a-4cfb-950b-5c5cc7331002 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:23.276373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d61971a9-269a-4cfb-950b-5c5cc7331002 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:23.284148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d61971a9-269a-4cfb-950b-5c5cc7331002 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:23.284312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d61971a9-269a-4cfb-950b-5c5cc7331002 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:23.284728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d61971a9-269a-4cfb-950b-5c5cc7331002 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:23.285702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d61971a9-269a-4cfb-950b-5c5cc7331002 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:23.286174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d61971a9-269a-4cfb-950b-5c5cc7331002 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:23.286604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d61971a9-269a-4cfb-950b-5c5cc7331002 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:23.288256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1113dd73-0765-4a52-83a8-b71c2224bb02 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:23.299613 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1113dd73-0765-4a52-83a8-b71c2224bb02 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1257 microversion: 2.1 time: 0.281125 Oct 04 21:11:23.324467 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 803/1588] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:23 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1257 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:23.333193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fcbc7afa-666d-492e-a916-1879334df243 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:23.334127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fcbc7afa-666d-492e-a916-1879334df243 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:23.341441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcbc7afa-666d-492e-a916-1879334df243 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:23.341949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcbc7afa-666d-492e-a916-1879334df243 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:23.342395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcbc7afa-666d-492e-a916-1879334df243 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:23.343109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcbc7afa-666d-492e-a916-1879334df243 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:23.343578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcbc7afa-666d-492e-a916-1879334df243 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:23.343995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcbc7afa-666d-492e-a916-1879334df243 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:23.706100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fcbc7afa-666d-492e-a916-1879334df243 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:23.716646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fcbc7afa-666d-492e-a916-1879334df243 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:23.734303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fcbc7afa-666d-492e-a916-1879334df243 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:23.740032 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fcbc7afa-666d-492e-a916-1879334df243 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.414711 Oct 04 21:11:23.760473 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 804/1589] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:23 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:23.766272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2bec80f5-74b7-414d-bfb7-592c206d7dd7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:23.766470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2bec80f5-74b7-414d-bfb7-592c206d7dd7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:23.783288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bec80f5-74b7-414d-bfb7-592c206d7dd7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:23.790330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bec80f5-74b7-414d-bfb7-592c206d7dd7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:23.790330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bec80f5-74b7-414d-bfb7-592c206d7dd7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:23.790330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bec80f5-74b7-414d-bfb7-592c206d7dd7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:23.790330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bec80f5-74b7-414d-bfb7-592c206d7dd7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:23.790330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bec80f5-74b7-414d-bfb7-592c206d7dd7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:23.934886 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d61971a9-269a-4cfb-950b-5c5cc7331002 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:23.949332 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d61971a9-269a-4cfb-950b-5c5cc7331002 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1469 microversion: 2.1 time: 0.681405 Oct 04 21:11:23.950710 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 786/1590] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:23 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1469 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:23.965075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-bbe959db-9a97-4181-823e-c13288cda013 req-f1909322-d7a0-4fe4-ab0d-8729c911e45c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2480cf36-216a-4565-a5b3-2430424a7a6e", "name": "network-vif-unplugged", "status": "completed", "tag": "91abea23-f356-47a5-8b1c-3915d0031ec2"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:24.006397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bbe959db-9a97-4181-823e-c13288cda013 req-f1909322-d7a0-4fe4-ab0d-8729c911e45c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:24.007117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bbe959db-9a97-4181-823e-c13288cda013 req-f1909322-d7a0-4fe4-ab0d-8729c911e45c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:24.007571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bbe959db-9a97-4181-823e-c13288cda013 req-f1909322-d7a0-4fe4-ab0d-8729c911e45c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:24.041190 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-bbe959db-9a97-4181-823e-c13288cda013 req-f1909322-d7a0-4fe4-ab0d-8729c911e45c service nova] Creating event network-vif-unplugged:91abea23-f356-47a5-8b1c-3915d0031ec2 for instance 2480cf36-216a-4565-a5b3-2430424a7a6e on n-h1-860282-1 Oct 04 21:11:24.049090 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-bbe959db-9a97-4181-823e-c13288cda013 req-f1909322-d7a0-4fe4-ab0d-8729c911e45c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097007 Oct 04 21:11:24.064696 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 787/1591] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:24.070413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-42d11abe-43c4-4fa4-9235-0bd74424b503 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:24.071105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-42d11abe-43c4-4fa4-9235-0bd74424b503 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:24.093638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42d11abe-43c4-4fa4-9235-0bd74424b503 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:24.094146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42d11abe-43c4-4fa4-9235-0bd74424b503 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:24.100124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42d11abe-43c4-4fa4-9235-0bd74424b503 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:24.100939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42d11abe-43c4-4fa4-9235-0bd74424b503 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:24.101487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42d11abe-43c4-4fa4-9235-0bd74424b503 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:24.102143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42d11abe-43c4-4fa4-9235-0bd74424b503 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:24.384875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2bec80f5-74b7-414d-bfb7-592c206d7dd7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:24.394675 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2bec80f5-74b7-414d-bfb7-592c206d7dd7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1306 microversion: 2.1 time: 0.652550 Oct 04 21:11:24.395999 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 805/1592] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:23 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1306 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:24.401510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-daa69917-fc64-45ef-8fd5-4d8623897733 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:24.402462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-daa69917-fc64-45ef-8fd5-4d8623897733 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:24.410010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-daa69917-fc64-45ef-8fd5-4d8623897733 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:24.410943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-daa69917-fc64-45ef-8fd5-4d8623897733 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:24.411452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-daa69917-fc64-45ef-8fd5-4d8623897733 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:24.412376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-daa69917-fc64-45ef-8fd5-4d8623897733 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:24.412898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-daa69917-fc64-45ef-8fd5-4d8623897733 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:24.413385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-daa69917-fc64-45ef-8fd5-4d8623897733 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:24.427990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-42d11abe-43c4-4fa4-9235-0bd74424b503 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:24.441966 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-42d11abe-43c4-4fa4-9235-0bd74424b503 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1313 microversion: 2.1 time: 0.375819 Oct 04 21:11:24.442811 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 788/1593] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:24 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:24.450468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ef5ae339-0217-48b6-af47-6330a25d36bb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:24.452319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ef5ae339-0217-48b6-af47-6330a25d36bb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:24.462725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef5ae339-0217-48b6-af47-6330a25d36bb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:24.463662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef5ae339-0217-48b6-af47-6330a25d36bb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:24.464561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef5ae339-0217-48b6-af47-6330a25d36bb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:24.466272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef5ae339-0217-48b6-af47-6330a25d36bb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:24.468001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef5ae339-0217-48b6-af47-6330a25d36bb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:24.468649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef5ae339-0217-48b6-af47-6330a25d36bb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:24.478714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-daa69917-fc64-45ef-8fd5-4d8623897733 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:24.479288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-daa69917-fc64-45ef-8fd5-4d8623897733 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:24.479800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-daa69917-fc64-45ef-8fd5-4d8623897733 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:24.480724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-daa69917-fc64-45ef-8fd5-4d8623897733 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:24.481306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-daa69917-fc64-45ef-8fd5-4d8623897733 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:24.482659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-daa69917-fc64-45ef-8fd5-4d8623897733 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:24.507200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-daa69917-fc64-45ef-8fd5-4d8623897733 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Getting quotas for project e11e3d4d14b240a3b934701459ada871. Resources: {'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:11:24.513473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-daa69917-fc64-45ef-8fd5-4d8623897733 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Getting quotas for user 150625a9472d43e0b0509ef044c58d34 and project e11e3d4d14b240a3b934701459ada871. Resources: {'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:11:24.688954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ef5ae339-0217-48b6-af47-6330a25d36bb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:24.702312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ef5ae339-0217-48b6-af47-6330a25d36bb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:24.719451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ef5ae339-0217-48b6-af47-6330a25d36bb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:24.719451 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ef5ae339-0217-48b6-af47-6330a25d36bb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.263748 Oct 04 21:11:24.719451 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 789/1594] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:24 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:24.719451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9d9960da-e7b7-4140-8e09-a899249ebe3b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:24.719451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9d9960da-e7b7-4140-8e09-a899249ebe3b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:24.724128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d9960da-e7b7-4140-8e09-a899249ebe3b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:24.725569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d9960da-e7b7-4140-8e09-a899249ebe3b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:24.726186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d9960da-e7b7-4140-8e09-a899249ebe3b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:24.727073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d9960da-e7b7-4140-8e09-a899249ebe3b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:24.727709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d9960da-e7b7-4140-8e09-a899249ebe3b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:24.728298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d9960da-e7b7-4140-8e09-a899249ebe3b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:24.906575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9d9960da-e7b7-4140-8e09-a899249ebe3b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:24.917182 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9d9960da-e7b7-4140-8e09-a899249ebe3b tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1478 microversion: 2.1 time: 0.205297 Oct 04 21:11:24.935268 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 790/1595] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:24 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1478 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:24.941369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3326db0b-3d4b-4139-8c9e-8799ec6de85e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:24.942315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3326db0b-3d4b-4139-8c9e-8799ec6de85e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:24.948834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3326db0b-3d4b-4139-8c9e-8799ec6de85e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:24.949611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3326db0b-3d4b-4139-8c9e-8799ec6de85e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:24.950442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3326db0b-3d4b-4139-8c9e-8799ec6de85e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:24.951500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3326db0b-3d4b-4139-8c9e-8799ec6de85e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:24.952149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3326db0b-3d4b-4139-8c9e-8799ec6de85e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:24.952759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3326db0b-3d4b-4139-8c9e-8799ec6de85e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:24.994211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3326db0b-3d4b-4139-8c9e-8799ec6de85e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:24.995050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3326db0b-3d4b-4139-8c9e-8799ec6de85e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:24.995689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3326db0b-3d4b-4139-8c9e-8799ec6de85e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:24.996394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-3326db0b-3d4b-4139-8c9e-8799ec6de85e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lazy-loading 'fault' on Instance uuid ff9a9f7b-0c44-4de4-9171-a14d2c39e096 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:25.054613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3326db0b-3d4b-4139-8c9e-8799ec6de85e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:25.064707 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3326db0b-3d4b-4139-8c9e-8799ec6de85e tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1257 microversion: 2.1 time: 0.132496 Oct 04 21:11:25.073106 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 791/1596] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:24 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1257 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:25.073106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-64b9f0df-a92a-465a-86c4-5487d07b8561 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:25.073106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-64b9f0df-a92a-465a-86c4-5487d07b8561 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:25.079128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64b9f0df-a92a-465a-86c4-5487d07b8561 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:25.079903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64b9f0df-a92a-465a-86c4-5487d07b8561 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:25.080523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64b9f0df-a92a-465a-86c4-5487d07b8561 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:25.081446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64b9f0df-a92a-465a-86c4-5487d07b8561 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:25.082078 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64b9f0df-a92a-465a-86c4-5487d07b8561 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:25.082675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64b9f0df-a92a-465a-86c4-5487d07b8561 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:25.178984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-64b9f0df-a92a-465a-86c4-5487d07b8561 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:25.189338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-64b9f0df-a92a-465a-86c4-5487d07b8561 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:25.190731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-64b9f0df-a92a-465a-86c4-5487d07b8561 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:25.206666 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-64b9f0df-a92a-465a-86c4-5487d07b8561 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.139951 Oct 04 21:11:25.207263 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 792/1597] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:25 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:25.375811 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-daa69917-fc64-45ef-8fd5-4d8623897733 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "POST /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b/action" status: 202 len: 0 microversion: 2.1 time: 0.978192 Oct 04 21:11:25.379891 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 806/1598] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:11:24 2022] POST /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b/action => generated 0 bytes in 983 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:11:25.384902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-34ff96cc-68cb-4acf-b74e-bfcf5b20c3e9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:25.385575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-34ff96cc-68cb-4acf-b74e-bfcf5b20c3e9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:25.392329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34ff96cc-68cb-4acf-b74e-bfcf5b20c3e9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:25.392813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34ff96cc-68cb-4acf-b74e-bfcf5b20c3e9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:25.393246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34ff96cc-68cb-4acf-b74e-bfcf5b20c3e9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:25.393976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34ff96cc-68cb-4acf-b74e-bfcf5b20c3e9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:25.394432 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34ff96cc-68cb-4acf-b74e-bfcf5b20c3e9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:25.394853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34ff96cc-68cb-4acf-b74e-bfcf5b20c3e9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:25.423003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-df3ebab3-a848-4ae6-896d-aeb96e57b0c1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:25.423865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-df3ebab3-a848-4ae6-896d-aeb96e57b0c1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:25.431080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df3ebab3-a848-4ae6-896d-aeb96e57b0c1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:25.431919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df3ebab3-a848-4ae6-896d-aeb96e57b0c1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:25.432517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df3ebab3-a848-4ae6-896d-aeb96e57b0c1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:25.433246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df3ebab3-a848-4ae6-896d-aeb96e57b0c1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:25.433766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df3ebab3-a848-4ae6-896d-aeb96e57b0c1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:25.434913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df3ebab3-a848-4ae6-896d-aeb96e57b0c1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:25.622354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-34ff96cc-68cb-4acf-b74e-bfcf5b20c3e9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:25.632530 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-34ff96cc-68cb-4acf-b74e-bfcf5b20c3e9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1468 microversion: 2.1 time: 0.251466 Oct 04 21:11:25.640344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-df3ebab3-a848-4ae6-896d-aeb96e57b0c1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:25.641255 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 793/1599] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:25 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1468 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:25.648412 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-df3ebab3-a848-4ae6-896d-aeb96e57b0c1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1306 microversion: 2.1 time: 0.230910 Oct 04 21:11:25.650446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cb42c6ef-fb05-499f-9f3f-18691d704725 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:25.651274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cb42c6ef-fb05-499f-9f3f-18691d704725 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:25.659058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb42c6ef-fb05-499f-9f3f-18691d704725 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:25.659546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb42c6ef-fb05-499f-9f3f-18691d704725 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:25.659985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb42c6ef-fb05-499f-9f3f-18691d704725 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:25.660692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb42c6ef-fb05-499f-9f3f-18691d704725 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:25.661144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb42c6ef-fb05-499f-9f3f-18691d704725 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:25.661635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb42c6ef-fb05-499f-9f3f-18691d704725 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:25.661999 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 807/1600] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:25 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1306 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:25.766980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cc271afe-af23-4653-957c-b6ec8402d0c7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:25.766980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cc271afe-af23-4653-957c-b6ec8402d0c7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:25.766980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc271afe-af23-4653-957c-b6ec8402d0c7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:25.766980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc271afe-af23-4653-957c-b6ec8402d0c7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:25.766980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc271afe-af23-4653-957c-b6ec8402d0c7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:25.766980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc271afe-af23-4653-957c-b6ec8402d0c7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:25.766980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc271afe-af23-4653-957c-b6ec8402d0c7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:25.766980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc271afe-af23-4653-957c-b6ec8402d0c7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:25.887247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cb42c6ef-fb05-499f-9f3f-18691d704725 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:25.897223 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cb42c6ef-fb05-499f-9f3f-18691d704725 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1313 microversion: 2.1 time: 0.254188 Oct 04 21:11:25.909452 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 794/1601] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:25 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:25.945687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fd48fe96-9e28-41b0-86fb-42107d687aea tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:25.946468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fd48fe96-9e28-41b0-86fb-42107d687aea tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:25.959758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd48fe96-9e28-41b0-86fb-42107d687aea tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:25.960484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd48fe96-9e28-41b0-86fb-42107d687aea tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:25.961125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd48fe96-9e28-41b0-86fb-42107d687aea tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:25.962122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd48fe96-9e28-41b0-86fb-42107d687aea tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:25.962907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd48fe96-9e28-41b0-86fb-42107d687aea tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:25.963516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd48fe96-9e28-41b0-86fb-42107d687aea tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.073825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cc271afe-af23-4653-957c-b6ec8402d0c7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:26.084070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cc271afe-af23-4653-957c-b6ec8402d0c7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:26.088285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cc271afe-af23-4653-957c-b6ec8402d0c7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:26.089709 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cc271afe-af23-4653-957c-b6ec8402d0c7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.349321 Oct 04 21:11:26.091893 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 808/1602] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:25 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:26.096118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-ff0a64ff-c943-45f7-8e65-7c8a8716a52d req-937609e5-2d18-4976-a034-7742bce69fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a7d656-c2a8-46fa-88dc-6c6cb1919c3b", "name": "network-vif-plugged", "status": "completed", "tag": "0f85098b-592d-4f47-9950-f46b2b886584"}, {"server_uuid": "2480cf36-216a-4565-a5b3-2430424a7a6e", "name": "network-vif-plugged", "status": "completed", "tag": "91abea23-f356-47a5-8b1c-3915d0031ec2"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:26.237687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ff0a64ff-c943-45f7-8e65-7c8a8716a52d req-937609e5-2d18-4976-a034-7742bce69fe9 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:26.237687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ff0a64ff-c943-45f7-8e65-7c8a8716a52d req-937609e5-2d18-4976-a034-7742bce69fe9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:26.237687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ff0a64ff-c943-45f7-8e65-7c8a8716a52d req-937609e5-2d18-4976-a034-7742bce69fe9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.237687 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-ff0a64ff-c943-45f7-8e65-7c8a8716a52d req-937609e5-2d18-4976-a034-7742bce69fe9 service nova] Creating event network-vif-plugged:0f85098b-592d-4f47-9950-f46b2b886584 for instance 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b on n-h2-860282-1 Oct 04 21:11:26.237687 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-ff0a64ff-c943-45f7-8e65-7c8a8716a52d req-937609e5-2d18-4976-a034-7742bce69fe9 service nova] Creating event network-vif-plugged:91abea23-f356-47a5-8b1c-3915d0031ec2 for instance 2480cf36-216a-4565-a5b3-2430424a7a6e on n-h1-860282-1 Oct 04 21:11:26.237687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-ff0a64ff-c943-45f7-8e65-7c8a8716a52d req-937609e5-2d18-4976-a034-7742bce69fe9 service nova] Instance 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:11:26.237687 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-ff0a64ff-c943-45f7-8e65-7c8a8716a52d req-937609e5-2d18-4976-a034-7742bce69fe9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044834 Oct 04 21:11:26.237687 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 809/1603] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:26.240032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fd48fe96-9e28-41b0-86fb-42107d687aea tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:26.241277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-49cacc56-1aae-43fd-87f5-449ca7f1a00d tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:26.241277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-49cacc56-1aae-43fd-87f5-449ca7f1a00d tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:26.245071 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fd48fe96-9e28-41b0-86fb-42107d687aea tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1478 microversion: 2.1 time: 0.206886 Oct 04 21:11:26.245071 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 795/1604] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:25 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1478 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:26.245296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49cacc56-1aae-43fd-87f5-449ca7f1a00d tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:26.245296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49cacc56-1aae-43fd-87f5-449ca7f1a00d tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:26.245296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49cacc56-1aae-43fd-87f5-449ca7f1a00d tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.245296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49cacc56-1aae-43fd-87f5-449ca7f1a00d tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:26.245296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49cacc56-1aae-43fd-87f5-449ca7f1a00d tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:26.245296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49cacc56-1aae-43fd-87f5-449ca7f1a00d tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.245296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49cacc56-1aae-43fd-87f5-449ca7f1a00d tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:26.245296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49cacc56-1aae-43fd-87f5-449ca7f1a00d tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:26.245296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49cacc56-1aae-43fd-87f5-449ca7f1a00d tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.245296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-49cacc56-1aae-43fd-87f5-449ca7f1a00d tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lazy-loading 'fault' on Instance uuid ff9a9f7b-0c44-4de4-9171-a14d2c39e096 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:26.247493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8e5ec3f8-b3da-4ccf-b3ed-19c9d8ce1350 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:26.249560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8e5ec3f8-b3da-4ccf-b3ed-19c9d8ce1350 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:26.260977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e5ec3f8-b3da-4ccf-b3ed-19c9d8ce1350 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:26.261500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e5ec3f8-b3da-4ccf-b3ed-19c9d8ce1350 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:26.261930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e5ec3f8-b3da-4ccf-b3ed-19c9d8ce1350 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.263179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e5ec3f8-b3da-4ccf-b3ed-19c9d8ce1350 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:26.263643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e5ec3f8-b3da-4ccf-b3ed-19c9d8ce1350 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:26.264168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e5ec3f8-b3da-4ccf-b3ed-19c9d8ce1350 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.269868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-49cacc56-1aae-43fd-87f5-449ca7f1a00d tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:26.279780 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-49cacc56-1aae-43fd-87f5-449ca7f1a00d tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1257 microversion: 2.1 time: 0.139802 Oct 04 21:11:26.280672 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 810/1605] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:26 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1257 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:26.368906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8e5ec3f8-b3da-4ccf-b3ed-19c9d8ce1350 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:26.377091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8e5ec3f8-b3da-4ccf-b3ed-19c9d8ce1350 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:26.378608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8e5ec3f8-b3da-4ccf-b3ed-19c9d8ce1350 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:26.383435 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8e5ec3f8-b3da-4ccf-b3ed-19c9d8ce1350 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.147004 Oct 04 21:11:26.384017 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 796/1606] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:26 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:26.664992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-172b74a4-1b88-4858-8900-da5d05ac92d1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:26.665730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-172b74a4-1b88-4858-8900-da5d05ac92d1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:26.673756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-172b74a4-1b88-4858-8900-da5d05ac92d1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:26.674255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-172b74a4-1b88-4858-8900-da5d05ac92d1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:26.674784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-172b74a4-1b88-4858-8900-da5d05ac92d1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.675501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-172b74a4-1b88-4858-8900-da5d05ac92d1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:26.675955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-172b74a4-1b88-4858-8900-da5d05ac92d1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:26.676382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-172b74a4-1b88-4858-8900-da5d05ac92d1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.677702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-104bc4ab-486d-45e2-8aee-e544b833e213 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:26.678329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-104bc4ab-486d-45e2-8aee-e544b833e213 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:26.686762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-104bc4ab-486d-45e2-8aee-e544b833e213 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:26.687513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-104bc4ab-486d-45e2-8aee-e544b833e213 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:26.687952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-104bc4ab-486d-45e2-8aee-e544b833e213 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.688646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-104bc4ab-486d-45e2-8aee-e544b833e213 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:26.689235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-104bc4ab-486d-45e2-8aee-e544b833e213 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:26.689685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-104bc4ab-486d-45e2-8aee-e544b833e213 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.915926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-172b74a4-1b88-4858-8900-da5d05ac92d1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:26.919890 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-172b74a4-1b88-4858-8900-da5d05ac92d1 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1468 microversion: 2.1 time: 0.259339 Oct 04 21:11:26.920143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-104bc4ab-486d-45e2-8aee-e544b833e213 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:26.921240 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 811/1607] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:26 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1468 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:26.926724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c5d23a46-560f-447d-8d66-0a19bbce8722 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:26.927779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c5d23a46-560f-447d-8d66-0a19bbce8722 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:26.930029 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-104bc4ab-486d-45e2-8aee-e544b833e213 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1306 microversion: 2.1 time: 0.256097 Oct 04 21:11:26.936808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5d23a46-560f-447d-8d66-0a19bbce8722 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:26.937599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5d23a46-560f-447d-8d66-0a19bbce8722 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:26.938283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5d23a46-560f-447d-8d66-0a19bbce8722 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.939160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5d23a46-560f-447d-8d66-0a19bbce8722 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:26.939777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5d23a46-560f-447d-8d66-0a19bbce8722 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:26.940361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5d23a46-560f-447d-8d66-0a19bbce8722 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.946758 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 797/1608] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:26 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1306 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:27.081184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c5d23a46-560f-447d-8d66-0a19bbce8722 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:27.090225 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c5d23a46-560f-447d-8d66-0a19bbce8722 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1313 microversion: 2.1 time: 0.167654 Oct 04 21:11:27.091388 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 812/1609] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:26 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:27.245956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c484384c-72ed-4585-b944-fe45548f4f62 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:27.246643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c484384c-72ed-4585-b944-fe45548f4f62 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:27.250920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d19c423d-f700-41a9-a225-d515e78cbc81 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:27.251678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d19c423d-f700-41a9-a225-d515e78cbc81 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:27.253200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c484384c-72ed-4585-b944-fe45548f4f62 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:27.253727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c484384c-72ed-4585-b944-fe45548f4f62 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:27.254173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c484384c-72ed-4585-b944-fe45548f4f62 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:27.254873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c484384c-72ed-4585-b944-fe45548f4f62 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:27.255336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c484384c-72ed-4585-b944-fe45548f4f62 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:27.255767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c484384c-72ed-4585-b944-fe45548f4f62 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:27.258768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d19c423d-f700-41a9-a225-d515e78cbc81 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:27.259269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d19c423d-f700-41a9-a225-d515e78cbc81 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:27.261033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d19c423d-f700-41a9-a225-d515e78cbc81 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:27.261033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d19c423d-f700-41a9-a225-d515e78cbc81 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:27.261033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d19c423d-f700-41a9-a225-d515e78cbc81 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:27.261332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d19c423d-f700-41a9-a225-d515e78cbc81 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:27.454247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c484384c-72ed-4585-b944-fe45548f4f62 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:27.457566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d19c423d-f700-41a9-a225-d515e78cbc81 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:27.457802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:27.462387 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c484384c-72ed-4585-b944-fe45548f4f62 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1478 microversion: 2.1 time: 0.220500 Oct 04 21:11:27.470734 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 798/1610] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:27 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1478 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:27.470734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7f159615-22c2-46c7-9c1c-7ab9759ab9c5 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:27.470984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d19c423d-f700-41a9-a225-d515e78cbc81 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:27.471116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7f159615-22c2-46c7-9c1c-7ab9759ab9c5 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:27.471221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d19c423d-f700-41a9-a225-d515e78cbc81 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:27.471221 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d19c423d-f700-41a9-a225-d515e78cbc81 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.224029 Oct 04 21:11:27.474504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f159615-22c2-46c7-9c1c-7ab9759ab9c5 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:27.475190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f159615-22c2-46c7-9c1c-7ab9759ab9c5 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:27.475627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f159615-22c2-46c7-9c1c-7ab9759ab9c5 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:27.476554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f159615-22c2-46c7-9c1c-7ab9759ab9c5 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:27.477009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f159615-22c2-46c7-9c1c-7ab9759ab9c5 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:27.477458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f159615-22c2-46c7-9c1c-7ab9759ab9c5 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:27.482451 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 813/1611] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:27 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:11:27.486964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c0d6c192-0c46-4a62-ae76-90acd0d5d3a1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:27.487585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c0d6c192-0c46-4a62-ae76-90acd0d5d3a1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:27.493726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0d6c192-0c46-4a62-ae76-90acd0d5d3a1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:27.494230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0d6c192-0c46-4a62-ae76-90acd0d5d3a1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:27.494657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0d6c192-0c46-4a62-ae76-90acd0d5d3a1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:27.495354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0d6c192-0c46-4a62-ae76-90acd0d5d3a1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:27.495812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0d6c192-0c46-4a62-ae76-90acd0d5d3a1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:27.496240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0d6c192-0c46-4a62-ae76-90acd0d5d3a1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:27.511031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f159615-22c2-46c7-9c1c-7ab9759ab9c5 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:27.511569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f159615-22c2-46c7-9c1c-7ab9759ab9c5 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:27.511945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f159615-22c2-46c7-9c1c-7ab9759ab9c5 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:27.512397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-7f159615-22c2-46c7-9c1c-7ab9759ab9c5 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lazy-loading 'fault' on Instance uuid ff9a9f7b-0c44-4de4-9171-a14d2c39e096 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:27.569330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7f159615-22c2-46c7-9c1c-7ab9759ab9c5 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5cc145484d4444b7e93cec0d14d062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b5ab646aa83404ea0006a5cdc439417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:27.578830 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7f159615-22c2-46c7-9c1c-7ab9759ab9c5 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 200 len: 1257 microversion: 2.1 time: 0.114765 Oct 04 21:11:27.584715 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 799/1612] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:27 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 1257 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:27.894931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c0d6c192-0c46-4a62-ae76-90acd0d5d3a1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:27.903680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c0d6c192-0c46-4a62-ae76-90acd0d5d3a1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:27.905294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c0d6c192-0c46-4a62-ae76-90acd0d5d3a1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:27.911109 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c0d6c192-0c46-4a62-ae76-90acd0d5d3a1 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.428283 Oct 04 21:11:27.911686 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 814/1613] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:27 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:27.948016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8e228fe8-63eb-487f-b77f-1cadbb31c07a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:27.949005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8e228fe8-63eb-487f-b77f-1cadbb31c07a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:27.954246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-844f4221-ae60-409f-bf59-b448a5b290b1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:27.954853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-844f4221-ae60-409f-bf59-b448a5b290b1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:27.956207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e228fe8-63eb-487f-b77f-1cadbb31c07a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:27.956712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e228fe8-63eb-487f-b77f-1cadbb31c07a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:27.957166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e228fe8-63eb-487f-b77f-1cadbb31c07a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:27.957940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e228fe8-63eb-487f-b77f-1cadbb31c07a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:27.958437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e228fe8-63eb-487f-b77f-1cadbb31c07a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:27.959024 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e228fe8-63eb-487f-b77f-1cadbb31c07a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:27.961495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-844f4221-ae60-409f-bf59-b448a5b290b1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:27.964574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-844f4221-ae60-409f-bf59-b448a5b290b1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:27.964574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-844f4221-ae60-409f-bf59-b448a5b290b1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:27.964574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-844f4221-ae60-409f-bf59-b448a5b290b1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:27.964574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-844f4221-ae60-409f-bf59-b448a5b290b1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:27.964574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-844f4221-ae60-409f-bf59-b448a5b290b1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:28.213463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8e228fe8-63eb-487f-b77f-1cadbb31c07a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:28.227032 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8e228fe8-63eb-487f-b77f-1cadbb31c07a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1468 microversion: 2.1 time: 0.283025 Oct 04 21:11:28.241834 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 800/1614] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:27 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1468 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:28.244257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-844f4221-ae60-409f-bf59-b448a5b290b1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:28.250726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-10dd41bb-341e-4832-aa95-90ff58901a17 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:28.251393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-10dd41bb-341e-4832-aa95-90ff58901a17 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:28.258627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10dd41bb-341e-4832-aa95-90ff58901a17 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:28.259380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10dd41bb-341e-4832-aa95-90ff58901a17 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:28.260192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10dd41bb-341e-4832-aa95-90ff58901a17 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:28.261103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10dd41bb-341e-4832-aa95-90ff58901a17 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:28.261769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10dd41bb-341e-4832-aa95-90ff58901a17 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:28.262368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10dd41bb-341e-4832-aa95-90ff58901a17 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:28.266742 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-844f4221-ae60-409f-bf59-b448a5b290b1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1306 microversion: 2.1 time: 0.316677 Oct 04 21:11:28.267534 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 815/1615] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:27 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1306 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:28.483540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-10dd41bb-341e-4832-aa95-90ff58901a17 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:28.489933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-45ba11a8-b69d-414a-85d6-ee9b06409c9d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:28.490551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-45ba11a8-b69d-414a-85d6-ee9b06409c9d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:28.491537 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-10dd41bb-341e-4832-aa95-90ff58901a17 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1462 microversion: 2.1 time: 0.248546 Oct 04 21:11:28.497017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45ba11a8-b69d-414a-85d6-ee9b06409c9d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:28.498263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45ba11a8-b69d-414a-85d6-ee9b06409c9d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:28.498845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45ba11a8-b69d-414a-85d6-ee9b06409c9d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:28.499557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45ba11a8-b69d-414a-85d6-ee9b06409c9d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:28.500020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45ba11a8-b69d-414a-85d6-ee9b06409c9d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:28.500504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45ba11a8-b69d-414a-85d6-ee9b06409c9d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:28.505464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:28.506134 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 801/1616] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:28 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1462 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:28.511038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-863d7ea9-796e-4065-ab2a-b44dfa92f5c5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:28.511665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-863d7ea9-796e-4065-ab2a-b44dfa92f5c5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:28.518251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-863d7ea9-796e-4065-ab2a-b44dfa92f5c5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:28.518735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-863d7ea9-796e-4065-ab2a-b44dfa92f5c5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:28.519173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-863d7ea9-796e-4065-ab2a-b44dfa92f5c5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:28.519876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-863d7ea9-796e-4065-ab2a-b44dfa92f5c5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:28.520870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-863d7ea9-796e-4065-ab2a-b44dfa92f5c5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:28.520870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-863d7ea9-796e-4065-ab2a-b44dfa92f5c5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:28.710322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-45ba11a8-b69d-414a-85d6-ee9b06409c9d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:28.718244 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-45ba11a8-b69d-414a-85d6-ee9b06409c9d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1463 microversion: 2.1 time: 0.232075 Oct 04 21:11:28.718966 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 816/1617] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:28 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1463 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:28.721970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-863d7ea9-796e-4065-ab2a-b44dfa92f5c5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:28.738984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-863d7ea9-796e-4065-ab2a-b44dfa92f5c5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:28.740733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-863d7ea9-796e-4065-ab2a-b44dfa92f5c5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:28.742318 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-863d7ea9-796e-4065-ab2a-b44dfa92f5c5 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1815 microversion: 2.25 time: 0.234954 Oct 04 21:11:28.743116 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 802/1618] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:28 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1815 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:28.748402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d17eeb69-1254-40dc-84ad-0c12652a293c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:28.749027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d17eeb69-1254-40dc-84ad-0c12652a293c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] [instance: ff9a9f7b-0c44-4de4-9171-a14d2c39e096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:28.755011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:28.756665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d17eeb69-1254-40dc-84ad-0c12652a293c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:28.757332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d17eeb69-1254-40dc-84ad-0c12652a293c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:28.757983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d17eeb69-1254-40dc-84ad-0c12652a293c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:28.758858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d17eeb69-1254-40dc-84ad-0c12652a293c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:28.759625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d17eeb69-1254-40dc-84ad-0c12652a293c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:28.760283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d17eeb69-1254-40dc-84ad-0c12652a293c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:28.774893 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-d17eeb69-1254-40dc-84ad-0c12652a293c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] HTTP exception thrown: Instance ff9a9f7b-0c44-4de4-9171-a14d2c39e096 could not be found. Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d17eeb69-1254-40dc-84ad-0c12652a293c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Request method failure captured: Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 HTTP/1.1 Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKC8lZKbIvM7eqUKI7P6IzyHkxBgSrmKVW_YnZR4dT1lde-ZbLO7QrijWhEpBnAZMxRQSFYBUxYFrIeISp-513ANCPR2QDDO7tT-YlwJ_e5hJfU2nk4JFcizP0CN2NMX8TjmHxEa42s-GWWxS3TprqpWedFkvB6IF2Vs1MEp-s_adrE Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 2b5ab646aa83404ea0006a5cdc439417 Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestBootFromVolume-285315238 Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2b5ab646aa83404ea0006a5cdc439417"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2b5ab646aa83404ea0006a5cdc439417"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2b5ab646aa83404ea0006a5cdc439417"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2b5ab646aa83404ea0006a5cdc439417"}]}] Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestBootFromVolume-285315238 Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 2b5ab646aa83404ea0006a5cdc439417 Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestBootFromVolume-285315238 Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestBootFromVolume-285315238-project Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: fc5cc145484d4444b7e93cec0d14d062 Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestBootFromVolume-285315238-project Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance ff9a9f7b-0c44-4de4-9171-a14d2c39e096 could not be found. Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'ff9a9f7b-0c44-4de4-9171-a14d2c39e096'} Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff9a9f7b-0c44-4de4-9171-a14d2c39e096 could not be found. Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff9a9f7b-0c44-4de4-9171-a14d2c39e096 could not be found. Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:28.776562 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:28.782831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:28.782831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:28.782831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:28.782831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:11:28.782831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:11:28.782831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff9a9f7b-0c44-4de4-9171-a14d2c39e096 could not be found. Oct 04 21:11:28.782831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:28.782831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d17eeb69-1254-40dc-84ad-0c12652a293c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Returning 404 to user: Instance ff9a9f7b-0c44-4de4-9171-a14d2c39e096 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:11:28.782831 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d17eeb69-1254-40dc-84ad-0c12652a293c tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096" status: 404 len: 111 microversion: 2.1 time: 0.033772 Oct 04 21:11:28.782831 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 803/1619] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:28 2022] GET /compute/v2.1/servers/ff9a9f7b-0c44-4de4-9171-a14d2c39e096 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:11:28.783962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-214a8c3c-0077-41b9-a3a3-aa48ede4c5b9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:28.786149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-214a8c3c-0077-41b9-a3a3-aa48ede4c5b9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:28.791840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-214a8c3c-0077-41b9-a3a3-aa48ede4c5b9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:28.797250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-214a8c3c-0077-41b9-a3a3-aa48ede4c5b9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:28.797250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-214a8c3c-0077-41b9-a3a3-aa48ede4c5b9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:28.797250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-214a8c3c-0077-41b9-a3a3-aa48ede4c5b9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:28.797250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-214a8c3c-0077-41b9-a3a3-aa48ede4c5b9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:28.797250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-214a8c3c-0077-41b9-a3a3-aa48ede4c5b9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:28.803947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7cedb4ed-57e2-404d-8b4f-667faae2cffe tempest-TenantUsagesTestJSON-889644512 tempest-TenantUsagesTestJSON-889644512-project-admin] Calling method '.version_select at 0x7f579461dee0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:28.816655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cedb4ed-57e2-404d-8b4f-667faae2cffe tempest-TenantUsagesTestJSON-889644512 tempest-TenantUsagesTestJSON-889644512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:28.817144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cedb4ed-57e2-404d-8b4f-667faae2cffe tempest-TenantUsagesTestJSON-889644512 tempest-TenantUsagesTestJSON-889644512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:28.817615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cedb4ed-57e2-404d-8b4f-667faae2cffe tempest-TenantUsagesTestJSON-889644512 tempest-TenantUsagesTestJSON-889644512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:28.834489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cedb4ed-57e2-404d-8b4f-667faae2cffe tempest-TenantUsagesTestJSON-889644512 tempest-TenantUsagesTestJSON-889644512-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:28.834974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cedb4ed-57e2-404d-8b4f-667faae2cffe tempest-TenantUsagesTestJSON-889644512 tempest-TenantUsagesTestJSON-889644512-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:28.835415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cedb4ed-57e2-404d-8b4f-667faae2cffe tempest-TenantUsagesTestJSON-889644512 tempest-TenantUsagesTestJSON-889644512-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:28.852420 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7cedb4ed-57e2-404d-8b4f-667faae2cffe tempest-TenantUsagesTestJSON-889644512 tempest-TenantUsagesTestJSON-889644512-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/5331b2ee38c64bfb8c8449ed3fd957ed?start=2022-10-03T21%3A11%3A28.507824&end=2022-10-05T21%3A11%3A28.507824" status: 200 len: 694 microversion: 2.1 time: 0.132628 Oct 04 21:11:28.852996 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 817/1620] 10.222.0.30 () {58 vars in 1412 bytes} [Tue Oct 4 21:11:28 2022] GET /compute/v2.1/os-simple-tenant-usage/5331b2ee38c64bfb8c8449ed3fd957ed?start=2022-10-03T21%3A11%3A28.507824&end=2022-10-05T21%3A11%3A28.507824 => generated 694 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:28.859336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-645d4ed7-9bcf-4270-8b86-c333cf39df01 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] Calling method '.version_select at 0x7f57945f2f70>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:28.875792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:29.015230 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-645d4ed7-9bcf-4270-8b86-c333cf39df01 tempest-ServersTestBootFromVolume-285315238 tempest-ServersTestBootFromVolume-285315238-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-513931149" status: 202 len: 0 microversion: 2.1 time: 0.161085 Oct 04 21:11:29.015975 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 818/1621] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Oct 4 21:11:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-513931149 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:11:29.031124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-485af5f3-0f54-4428-bbe1-7a72140bb084 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '.version_select at 0x7f578bc3df70>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:29.031124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-485af5f3-0f54-4428-bbe1-7a72140bb084 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:29.031410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-485af5f3-0f54-4428-bbe1-7a72140bb084 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:29.031834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-485af5f3-0f54-4428-bbe1-7a72140bb084 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:29.040459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-485af5f3-0f54-4428-bbe1-7a72140bb084 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:29.040932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-485af5f3-0f54-4428-bbe1-7a72140bb084 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:29.041368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-485af5f3-0f54-4428-bbe1-7a72140bb084 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:29.052971 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-485af5f3-0f54-4428-bbe1-7a72140bb084 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/5331b2ee38c64bfb8c8449ed3fd957ed?start=2022-10-03T21%3A11%3A28.507824&end=2022-10-05T21%3A11%3A28.507824" status: 200 len: 694 microversion: 2.1 time: 0.035877 Oct 04 21:11:29.053589 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 819/1622] 10.222.0.30 () {58 vars in 1412 bytes} [Tue Oct 4 21:11:29 2022] GET /compute/v2.1/os-simple-tenant-usage/5331b2ee38c64bfb8c8449ed3fd957ed?start=2022-10-03T21%3A11%3A28.507824&end=2022-10-05T21%3A11%3A28.507824 => generated 694 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:29.058111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-63bd63de-565c-49ef-b272-abe3bc35f014 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:29.058678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-63bd63de-565c-49ef-b272-abe3bc35f014 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:29.065594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63bd63de-565c-49ef-b272-abe3bc35f014 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:29.066089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63bd63de-565c-49ef-b272-abe3bc35f014 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:29.066533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63bd63de-565c-49ef-b272-abe3bc35f014 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:29.067243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63bd63de-565c-49ef-b272-abe3bc35f014 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:29.067705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63bd63de-565c-49ef-b272-abe3bc35f014 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:29.068135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63bd63de-565c-49ef-b272-abe3bc35f014 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:29.137636 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-63bd63de-565c-49ef-b272-abe3bc35f014 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:29.146236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-63bd63de-565c-49ef-b272-abe3bc35f014 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:29.151532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-63bd63de-565c-49ef-b272-abe3bc35f014 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:29.152921 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-63bd63de-565c-49ef-b272-abe3bc35f014 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.098276 Oct 04 21:11:29.154371 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 820/1623] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:29 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:29.158902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c769b851-5d1a-4cbd-a337-f16f154a15dd tempest-TenantUsagesTestJSON-889644512 tempest-TenantUsagesTestJSON-889644512-project-admin] Calling method '.version_select at 0x7f578bc3d8b0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:29.167710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c769b851-5d1a-4cbd-a337-f16f154a15dd tempest-TenantUsagesTestJSON-889644512 tempest-TenantUsagesTestJSON-889644512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:29.168277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c769b851-5d1a-4cbd-a337-f16f154a15dd tempest-TenantUsagesTestJSON-889644512 tempest-TenantUsagesTestJSON-889644512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:29.169760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c769b851-5d1a-4cbd-a337-f16f154a15dd tempest-TenantUsagesTestJSON-889644512 tempest-TenantUsagesTestJSON-889644512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:29.187582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c769b851-5d1a-4cbd-a337-f16f154a15dd tempest-TenantUsagesTestJSON-889644512 tempest-TenantUsagesTestJSON-889644512-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:29.197589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c769b851-5d1a-4cbd-a337-f16f154a15dd tempest-TenantUsagesTestJSON-889644512 tempest-TenantUsagesTestJSON-889644512-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:29.197589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c769b851-5d1a-4cbd-a337-f16f154a15dd tempest-TenantUsagesTestJSON-889644512 tempest-TenantUsagesTestJSON-889644512-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:29.254973 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c769b851-5d1a-4cbd-a337-f16f154a15dd tempest-TenantUsagesTestJSON-889644512 tempest-TenantUsagesTestJSON-889644512-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T21%3A11%3A28.507824&end=2022-10-05T21%3A11%3A28.507824&detailed=1" status: 200 len: 15858 microversion: 2.1 time: 0.099341 Oct 04 21:11:29.255879 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 821/1624] 10.222.0.30 () {58 vars in 1335 bytes} [Tue Oct 4 21:11:29 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T21%3A11%3A28.507824&end=2022-10-05T21%3A11%3A28.507824&detailed=1 => generated 15858 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:11:29.260515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dd233ac3-ec04-44dd-9500-6c7bba680705 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:29.261128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dd233ac3-ec04-44dd-9500-6c7bba680705 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:29.270133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd233ac3-ec04-44dd-9500-6c7bba680705 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:29.270533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd233ac3-ec04-44dd-9500-6c7bba680705 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:29.270979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd233ac3-ec04-44dd-9500-6c7bba680705 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:29.271691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd233ac3-ec04-44dd-9500-6c7bba680705 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:29.272146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd233ac3-ec04-44dd-9500-6c7bba680705 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:29.272574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd233ac3-ec04-44dd-9500-6c7bba680705 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:29.300303 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-214a8c3c-0077-41b9-a3a3-aa48ede4c5b9 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e/action" status: 202 len: 0 microversion: 2.1 time: 0.520622 Oct 04 21:11:29.301670 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 804/1625] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:11:28 2022] POST /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:11:29.307127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1690193c-a08e-4dc1-9304-7a2ac10b777f tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:29.307773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1690193c-a08e-4dc1-9304-7a2ac10b777f tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:29.317132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1690193c-a08e-4dc1-9304-7a2ac10b777f tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:29.318092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1690193c-a08e-4dc1-9304-7a2ac10b777f tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:29.320057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1690193c-a08e-4dc1-9304-7a2ac10b777f tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:29.320972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1690193c-a08e-4dc1-9304-7a2ac10b777f tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:29.321545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1690193c-a08e-4dc1-9304-7a2ac10b777f tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:29.322050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1690193c-a08e-4dc1-9304-7a2ac10b777f tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:29.351012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1690193c-a08e-4dc1-9304-7a2ac10b777f tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:11:29.677702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dd233ac3-ec04-44dd-9500-6c7bba680705 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:29.711674 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dd233ac3-ec04-44dd-9500-6c7bba680705 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1468 microversion: 2.1 time: 0.454700 Oct 04 21:11:29.712273 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 822/1626] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:29 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1468 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:29.717952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7262fd12-7f79-4c05-8dc4-5c09f9d88c79 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:29.718573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7262fd12-7f79-4c05-8dc4-5c09f9d88c79 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:29.726889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7262fd12-7f79-4c05-8dc4-5c09f9d88c79 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:29.727702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7262fd12-7f79-4c05-8dc4-5c09f9d88c79 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:29.728369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7262fd12-7f79-4c05-8dc4-5c09f9d88c79 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:29.729216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7262fd12-7f79-4c05-8dc4-5c09f9d88c79 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:29.729799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7262fd12-7f79-4c05-8dc4-5c09f9d88c79 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:29.731343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7262fd12-7f79-4c05-8dc4-5c09f9d88c79 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:29.835378 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1690193c-a08e-4dc1-9304-7a2ac10b777f tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "DELETE /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 204 len: 0 microversion: 2.1 time: 0.528444 Oct 04 21:11:29.836778 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 805/1627] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:11:29 2022] DELETE /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:11:29.849066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d958608f-16d3-4769-b495-e652e549d903 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:29.853192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d958608f-16d3-4769-b495-e652e549d903 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:29.868497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d958608f-16d3-4769-b495-e652e549d903 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:29.869389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d958608f-16d3-4769-b495-e652e549d903 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:29.870134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d958608f-16d3-4769-b495-e652e549d903 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:29.871067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d958608f-16d3-4769-b495-e652e549d903 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:29.871709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d958608f-16d3-4769-b495-e652e549d903 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:29.872956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d958608f-16d3-4769-b495-e652e549d903 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:29.911051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d958608f-16d3-4769-b495-e652e549d903 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:29.911639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d958608f-16d3-4769-b495-e652e549d903 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:29.912138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d958608f-16d3-4769-b495-e652e549d903 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:29.912795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-d958608f-16d3-4769-b495-e652e549d903 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lazy-loading 'fault' on Instance uuid 2480cf36-216a-4565-a5b3-2430424a7a6e {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:30.074382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7262fd12-7f79-4c05-8dc4-5c09f9d88c79 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:30.085136 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7262fd12-7f79-4c05-8dc4-5c09f9d88c79 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1306 microversion: 2.1 time: 0.371580 Oct 04 21:11:30.095467 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 823/1628] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:29 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1306 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:30.095467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e016e9a8-4477-42ad-8b82-a34ee1f3296c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:30.095467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e016e9a8-4477-42ad-8b82-a34ee1f3296c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:30.102184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e016e9a8-4477-42ad-8b82-a34ee1f3296c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.103211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e016e9a8-4477-42ad-8b82-a34ee1f3296c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.103503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e016e9a8-4477-42ad-8b82-a34ee1f3296c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.104227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e016e9a8-4477-42ad-8b82-a34ee1f3296c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.104757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e016e9a8-4477-42ad-8b82-a34ee1f3296c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.105191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e016e9a8-4477-42ad-8b82-a34ee1f3296c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.138845 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d958608f-16d3-4769-b495-e652e549d903 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1597 microversion: 2.1 time: 0.297615 Oct 04 21:11:30.139087 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 806/1629] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:29 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1597 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:30.160469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ebd643ff-c3bc-4449-aada-5485fb03d1c0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:30.161129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ebd643ff-c3bc-4449-aada-5485fb03d1c0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:30.173479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ebd643ff-c3bc-4449-aada-5485fb03d1c0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.174016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ebd643ff-c3bc-4449-aada-5485fb03d1c0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.175915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ebd643ff-c3bc-4449-aada-5485fb03d1c0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.179432 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ebd643ff-c3bc-4449-aada-5485fb03d1c0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.179937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ebd643ff-c3bc-4449-aada-5485fb03d1c0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.180424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ebd643ff-c3bc-4449-aada-5485fb03d1c0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.386406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e016e9a8-4477-42ad-8b82-a34ee1f3296c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:30.391646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ebd643ff-c3bc-4449-aada-5485fb03d1c0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:30.401232 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ebd643ff-c3bc-4449-aada-5485fb03d1c0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1468 microversion: 2.1 time: 0.251811 Oct 04 21:11:30.406437 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 807/1630] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:30 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1468 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:30.406591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e016e9a8-4477-42ad-8b82-a34ee1f3296c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:30.407528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2082a78e-623b-4f9b-a4de-e03a4e8c9f07 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:30.409044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e016e9a8-4477-42ad-8b82-a34ee1f3296c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:30.410366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2082a78e-623b-4f9b-a4de-e03a4e8c9f07 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:30.411821 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e016e9a8-4477-42ad-8b82-a34ee1f3296c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1805 microversion: 2.25 time: 0.324941 Oct 04 21:11:30.412940 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 824/1631] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:30 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1805 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:30.418498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-90db6ab7-b4a1-47fa-bf0b-e3b5329d26de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:30.418877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-90db6ab7-b4a1-47fa-bf0b-e3b5329d26de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:30.427752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90db6ab7-b4a1-47fa-bf0b-e3b5329d26de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.428014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2082a78e-623b-4f9b-a4de-e03a4e8c9f07 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.428460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90db6ab7-b4a1-47fa-bf0b-e3b5329d26de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.429169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90db6ab7-b4a1-47fa-bf0b-e3b5329d26de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.429341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2082a78e-623b-4f9b-a4de-e03a4e8c9f07 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.430686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90db6ab7-b4a1-47fa-bf0b-e3b5329d26de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.431453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90db6ab7-b4a1-47fa-bf0b-e3b5329d26de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.432084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2082a78e-623b-4f9b-a4de-e03a4e8c9f07 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.432327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90db6ab7-b4a1-47fa-bf0b-e3b5329d26de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.432907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2082a78e-623b-4f9b-a4de-e03a4e8c9f07 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.433396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2082a78e-623b-4f9b-a4de-e03a4e8c9f07 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.433883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2082a78e-623b-4f9b-a4de-e03a4e8c9f07 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.513782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-90db6ab7-b4a1-47fa-bf0b-e3b5329d26de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:30.523081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-90db6ab7-b4a1-47fa-bf0b-e3b5329d26de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:30.524502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-90db6ab7-b4a1-47fa-bf0b-e3b5329d26de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:30.530201 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-90db6ab7-b4a1-47fa-bf0b-e3b5329d26de tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.116050 Oct 04 21:11:30.531006 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 825/1632] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:30 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:30.535297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7531bc96-7127-40d5-a167-23c22e039b6f tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '.version_select at 0x7f579461df70>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:30.538771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7531bc96-7127-40d5-a167-23c22e039b6f tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.539253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7531bc96-7127-40d5-a167-23c22e039b6f tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.544309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7531bc96-7127-40d5-a167-23c22e039b6f tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.552580 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7531bc96-7127-40d5-a167-23c22e039b6f tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 4046 microversion: 2.25 time: 0.020121 Oct 04 21:11:30.565146 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 826/1633] 10.222.0.30 () {60 vars in 1184 bytes} [Tue Oct 4 21:11:30 2022] GET /compute/v2.1/os-migrations => generated 4046 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:30.570446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-25d9ee9a-9b15-4452-b7e9-ea5dc94a67cf tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:30.571068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-25d9ee9a-9b15-4452-b7e9-ea5dc94a67cf tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:30.577956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25d9ee9a-9b15-4452-b7e9-ea5dc94a67cf tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.578455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25d9ee9a-9b15-4452-b7e9-ea5dc94a67cf tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.584314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25d9ee9a-9b15-4452-b7e9-ea5dc94a67cf tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.584314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25d9ee9a-9b15-4452-b7e9-ea5dc94a67cf tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.584314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25d9ee9a-9b15-4452-b7e9-ea5dc94a67cf tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.584314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25d9ee9a-9b15-4452-b7e9-ea5dc94a67cf tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.742290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-25d9ee9a-9b15-4452-b7e9-ea5dc94a67cf tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lazy-loading 'services' on Instance uuid 191d63c3-2de0-4d3a-85f1-c4be3d2f5432 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:30.759575 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-25d9ee9a-9b15-4452-b7e9-ea5dc94a67cf tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 2424 microversion: 2.25 time: 0.192721 Oct 04 21:11:30.760383 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 827/1634] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:30 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 2424 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:30.783336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b4257dc1-c130-4cd4-aef3-f2ebb9e8ca8c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:30.784315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b4257dc1-c130-4cd4-aef3-f2ebb9e8ca8c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:30.790582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b4257dc1-c130-4cd4-aef3-f2ebb9e8ca8c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.790912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b4257dc1-c130-4cd4-aef3-f2ebb9e8ca8c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.791345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b4257dc1-c130-4cd4-aef3-f2ebb9e8ca8c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.792036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b4257dc1-c130-4cd4-aef3-f2ebb9e8ca8c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.792488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b4257dc1-c130-4cd4-aef3-f2ebb9e8ca8c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.792906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b4257dc1-c130-4cd4-aef3-f2ebb9e8ca8c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.941094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b4257dc1-c130-4cd4-aef3-f2ebb9e8ca8c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:30.949363 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b4257dc1-c130-4cd4-aef3-f2ebb9e8ca8c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1468 microversion: 2.1 time: 0.170827 Oct 04 21:11:30.965054 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 828/1635] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:30 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1468 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:30.965281 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2082a78e-623b-4f9b-a4de-e03a4e8c9f07 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e/action" status: 202 len: 0 microversion: 2.1 time: 0.547498 Oct 04 21:11:30.965281 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 808/1636] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:11:30 2022] POST /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:11:30.965502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-33503e87-af11-4080-8bab-65f64fb423fb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:30.965502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-33503e87-af11-4080-8bab-65f64fb423fb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:30.965922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bf3bec81-70d5-4f70-b67d-978fc9603c45 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:30.965922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bf3bec81-70d5-4f70-b67d-978fc9603c45 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:30.966086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33503e87-af11-4080-8bab-65f64fb423fb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.966086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33503e87-af11-4080-8bab-65f64fb423fb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.966086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33503e87-af11-4080-8bab-65f64fb423fb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.966086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33503e87-af11-4080-8bab-65f64fb423fb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.966086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33503e87-af11-4080-8bab-65f64fb423fb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.966086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33503e87-af11-4080-8bab-65f64fb423fb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.968472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf3bec81-70d5-4f70-b67d-978fc9603c45 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.968678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf3bec81-70d5-4f70-b67d-978fc9603c45 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.969123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf3bec81-70d5-4f70-b67d-978fc9603c45 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.969866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf3bec81-70d5-4f70-b67d-978fc9603c45 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.970333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf3bec81-70d5-4f70-b67d-978fc9603c45 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.970758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf3bec81-70d5-4f70-b67d-978fc9603c45 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:31.166200 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bf3bec81-70d5-4f70-b67d-978fc9603c45 tempest-ServersAdminTestJSON-400556442 tempest-ServersAdminTestJSON-400556442-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1614 microversion: 2.1 time: 0.210673 Oct 04 21:11:31.166788 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 809/1637] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:30 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1614 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:31.177293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-33503e87-af11-4080-8bab-65f64fb423fb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lazy-loading 'services' on Instance uuid 191d63c3-2de0-4d3a-85f1-c4be3d2f5432 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:31.177989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fdb0244f-4191-4986-8332-b9596e6538e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:31.177989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fdb0244f-4191-4986-8332-b9596e6538e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:31.178508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fdb0244f-4191-4986-8332-b9596e6538e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:31.178896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fdb0244f-4191-4986-8332-b9596e6538e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:31.179334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fdb0244f-4191-4986-8332-b9596e6538e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:31.180098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fdb0244f-4191-4986-8332-b9596e6538e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:31.180553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fdb0244f-4191-4986-8332-b9596e6538e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:31.181004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fdb0244f-4191-4986-8332-b9596e6538e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:31.189117 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-33503e87-af11-4080-8bab-65f64fb423fb tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 2424 microversion: 2.25 time: 0.237657 Oct 04 21:11:31.190181 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 829/1638] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:30 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 2424 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:31.201687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f830c4f9-e464-4d2f-804e-d7574f3a5411 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:31.202264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f830c4f9-e464-4d2f-804e-d7574f3a5411 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:31.208717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f830c4f9-e464-4d2f-804e-d7574f3a5411 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:31.209699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f830c4f9-e464-4d2f-804e-d7574f3a5411 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:31.209827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f830c4f9-e464-4d2f-804e-d7574f3a5411 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:31.210525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f830c4f9-e464-4d2f-804e-d7574f3a5411 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:31.211181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f830c4f9-e464-4d2f-804e-d7574f3a5411 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:31.211826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f830c4f9-e464-4d2f-804e-d7574f3a5411 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:31.246735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f830c4f9-e464-4d2f-804e-d7574f3a5411 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:11:31.359724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fdb0244f-4191-4986-8332-b9596e6538e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:31.363545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:31.368017 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fdb0244f-4191-4986-8332-b9596e6538e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1306 microversion: 2.1 time: 0.200264 Oct 04 21:11:31.368580 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 810/1639] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:31 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1306 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:31.373524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ff786648-cd05-467d-bde3-221be06e48ba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:31.374339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ff786648-cd05-467d-bde3-221be06e48ba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:31.380549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff786648-cd05-467d-bde3-221be06e48ba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:31.381676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff786648-cd05-467d-bde3-221be06e48ba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:31.382112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff786648-cd05-467d-bde3-221be06e48ba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:31.383054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff786648-cd05-467d-bde3-221be06e48ba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:31.383674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff786648-cd05-467d-bde3-221be06e48ba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:31.384106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff786648-cd05-467d-bde3-221be06e48ba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:31.491795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-ff786648-cd05-467d-bde3-221be06e48ba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lazy-loading 'services' on Instance uuid 191d63c3-2de0-4d3a-85f1-c4be3d2f5432 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:31.808763 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f830c4f9-e464-4d2f-804e-d7574f3a5411 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 204 len: 0 microversion: 2.1 time: 0.611011 Oct 04 21:11:31.813793 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ff786648-cd05-467d-bde3-221be06e48ba tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "DELETE /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-volume_attachments/6bd72c14-55c5-4213-a451-85dd01487f4b" status: 202 len: 0 microversion: 2.25 time: 0.443858 Oct 04 21:11:31.814331 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 811/1640] 10.222.0.30 () {60 vars in 1457 bytes} [Tue Oct 4 21:11:31 2022] DELETE /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-volume_attachments/6bd72c14-55c5-4213-a451-85dd01487f4b => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:11:31.818049 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 830/1641] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:11:31 2022] DELETE /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:11:31.822728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fe8b87f6-3ae9-44ff-9d94-446a0ef0d7f6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:31.828974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fe8b87f6-3ae9-44ff-9d94-446a0ef0d7f6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:31.832259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f96ee463-113c-4442-997d-5fe02fe89d9c tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:31.833177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f96ee463-113c-4442-997d-5fe02fe89d9c tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:31.854828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f96ee463-113c-4442-997d-5fe02fe89d9c tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:31.855244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f96ee463-113c-4442-997d-5fe02fe89d9c tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:31.855684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f96ee463-113c-4442-997d-5fe02fe89d9c tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:31.857048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f96ee463-113c-4442-997d-5fe02fe89d9c tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:31.857690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f96ee463-113c-4442-997d-5fe02fe89d9c tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:31.858124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f96ee463-113c-4442-997d-5fe02fe89d9c tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:31.860846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe8b87f6-3ae9-44ff-9d94-446a0ef0d7f6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:31.861457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe8b87f6-3ae9-44ff-9d94-446a0ef0d7f6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:31.868500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe8b87f6-3ae9-44ff-9d94-446a0ef0d7f6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:31.869708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe8b87f6-3ae9-44ff-9d94-446a0ef0d7f6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:31.870345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe8b87f6-3ae9-44ff-9d94-446a0ef0d7f6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:31.870948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe8b87f6-3ae9-44ff-9d94-446a0ef0d7f6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:32.128428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fe8b87f6-3ae9-44ff-9d94-446a0ef0d7f6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:32.151572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fe8b87f6-3ae9-44ff-9d94-446a0ef0d7f6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:32.156019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fe8b87f6-3ae9-44ff-9d94-446a0ef0d7f6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:32.182243 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fe8b87f6-3ae9-44ff-9d94-446a0ef0d7f6 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.352092 Oct 04 21:11:32.182243 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 831/1642] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:31 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:32.182243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-acc4755e-cef1-4e84-8e49-0565ecbf6fc9 req-c65913fd-6d52-4e3d-9953-985303f21b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2cb6e2-2e03-406a-96ae-8be64d9af891", "name": "network-vif-plugged", "status": "completed", "tag": "276b608c-4c83-4365-9c25-8af46d2dd192"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:32.220768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-acc4755e-cef1-4e84-8e49-0565ecbf6fc9 req-c65913fd-6d52-4e3d-9953-985303f21b8e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:32.223107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-acc4755e-cef1-4e84-8e49-0565ecbf6fc9 req-c65913fd-6d52-4e3d-9953-985303f21b8e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:32.224675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-acc4755e-cef1-4e84-8e49-0565ecbf6fc9 req-c65913fd-6d52-4e3d-9953-985303f21b8e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:32.245298 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-acc4755e-cef1-4e84-8e49-0565ecbf6fc9 req-c65913fd-6d52-4e3d-9953-985303f21b8e service nova] Creating event network-vif-plugged:276b608c-4c83-4365-9c25-8af46d2dd192 for instance fd2cb6e2-2e03-406a-96ae-8be64d9af891 on n-h2-860282-1 Oct 04 21:11:32.259411 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-acc4755e-cef1-4e84-8e49-0565ecbf6fc9 req-c65913fd-6d52-4e3d-9953-985303f21b8e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079834 Oct 04 21:11:32.280789 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 832/1643] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:32.289800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7cc13565-639f-4434-b1c9-a359991fab9c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:32.295087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7cc13565-639f-4434-b1c9-a359991fab9c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:32.320650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cc13565-639f-4434-b1c9-a359991fab9c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:32.321271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cc13565-639f-4434-b1c9-a359991fab9c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:32.321859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cc13565-639f-4434-b1c9-a359991fab9c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:32.322673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cc13565-639f-4434-b1c9-a359991fab9c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:32.323204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cc13565-639f-4434-b1c9-a359991fab9c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:32.323707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cc13565-639f-4434-b1c9-a359991fab9c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:32.363598 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7cc13565-639f-4434-b1c9-a359991fab9c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.081214 Oct 04 21:11:32.364633 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 833/1644] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Oct 4 21:11:32 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:11:32.370604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d30b9ca9-5202-4b7c-b193-53bcc2bd5350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:32.374480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d30b9ca9-5202-4b7c-b193-53bcc2bd5350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:32.381849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d30b9ca9-5202-4b7c-b193-53bcc2bd5350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:32.382376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d30b9ca9-5202-4b7c-b193-53bcc2bd5350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:32.383188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d30b9ca9-5202-4b7c-b193-53bcc2bd5350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:32.384055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d30b9ca9-5202-4b7c-b193-53bcc2bd5350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:32.384452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d30b9ca9-5202-4b7c-b193-53bcc2bd5350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:32.384888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d30b9ca9-5202-4b7c-b193-53bcc2bd5350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:32.665780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f96ee463-113c-4442-997d-5fe02fe89d9c tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:32.690866 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f96ee463-113c-4442-997d-5fe02fe89d9c tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1468 microversion: 2.1 time: 0.870532 Oct 04 21:11:32.692191 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 812/1645] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:31 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1468 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:32.700244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5d86576e-00a3-474a-8715-1fbd17721295 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:32.701062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5d86576e-00a3-474a-8715-1fbd17721295 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:32.722328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d86576e-00a3-474a-8715-1fbd17721295 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:32.723959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d86576e-00a3-474a-8715-1fbd17721295 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:32.724577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d86576e-00a3-474a-8715-1fbd17721295 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:32.725295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d86576e-00a3-474a-8715-1fbd17721295 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:32.725902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d86576e-00a3-474a-8715-1fbd17721295 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:32.726361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d86576e-00a3-474a-8715-1fbd17721295 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.021544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d30b9ca9-5202-4b7c-b193-53bcc2bd5350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:33.021544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:33.021544 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d30b9ca9-5202-4b7c-b193-53bcc2bd5350 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1469 microversion: 2.1 time: 0.652117 Oct 04 21:11:33.023014 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 834/1646] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:32 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1469 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:33.032201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e55ad3cd-d0c0-4797-9002-44af75fd9f8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:33.032813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e55ad3cd-d0c0-4797-9002-44af75fd9f8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:33.046054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e55ad3cd-d0c0-4797-9002-44af75fd9f8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.046564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e55ad3cd-d0c0-4797-9002-44af75fd9f8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.047141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e55ad3cd-d0c0-4797-9002-44af75fd9f8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.047860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e55ad3cd-d0c0-4797-9002-44af75fd9f8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.048319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e55ad3cd-d0c0-4797-9002-44af75fd9f8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.049108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e55ad3cd-d0c0-4797-9002-44af75fd9f8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.117938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5d86576e-00a3-474a-8715-1fbd17721295 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:33.127588 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5d86576e-00a3-474a-8715-1fbd17721295 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1468 microversion: 2.1 time: 0.434192 Oct 04 21:11:33.148200 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 813/1647] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:32 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1468 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:33.204390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2a230679-e7bb-4208-98ef-41f4ee11eb41 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:33.205038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2a230679-e7bb-4208-98ef-41f4ee11eb41 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:33.222018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a230679-e7bb-4208-98ef-41f4ee11eb41 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.223220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a230679-e7bb-4208-98ef-41f4ee11eb41 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.223681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a230679-e7bb-4208-98ef-41f4ee11eb41 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.224502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a230679-e7bb-4208-98ef-41f4ee11eb41 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.225122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a230679-e7bb-4208-98ef-41f4ee11eb41 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.225588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a230679-e7bb-4208-98ef-41f4ee11eb41 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.316713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e55ad3cd-d0c0-4797-9002-44af75fd9f8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:33.324577 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e55ad3cd-d0c0-4797-9002-44af75fd9f8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1306 microversion: 2.1 time: 0.300392 Oct 04 21:11:33.333938 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 835/1648] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:33 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1306 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:33.377398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-16638389-459b-407e-8acc-9e135ecfecbd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:33.379913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-16638389-459b-407e-8acc-9e135ecfecbd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:33.398011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16638389-459b-407e-8acc-9e135ecfecbd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.398506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16638389-459b-407e-8acc-9e135ecfecbd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.398945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16638389-459b-407e-8acc-9e135ecfecbd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.399658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16638389-459b-407e-8acc-9e135ecfecbd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.400107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16638389-459b-407e-8acc-9e135ecfecbd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.410177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16638389-459b-407e-8acc-9e135ecfecbd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.453772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2a230679-e7bb-4208-98ef-41f4ee11eb41 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:33.463227 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-16638389-459b-407e-8acc-9e135ecfecbd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.090158 Oct 04 21:11:33.463816 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 836/1649] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Oct 4 21:11:33 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:11:33.480285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2a230679-e7bb-4208-98ef-41f4ee11eb41 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:33.482100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2a230679-e7bb-4208-98ef-41f4ee11eb41 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:33.487970 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2a230679-e7bb-4208-98ef-41f4ee11eb41 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1546 microversion: 2.91 time: 0.290693 Oct 04 21:11:33.493457 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 814/1650] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:33 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1546 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:33.602723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-8b0cd29a-31c5-4659-8a9b-7f6b00e945d5 req-03194b86-33d6-4436-a32b-45a8276a5c05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d6d417-8aac-434b-a689-84c2743275a4", "name": "network-vif-deleted", "tag": "710fdc6c-d6aa-4274-b2e7-cd799803ec89"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:33.617345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8b0cd29a-31c5-4659-8a9b-7f6b00e945d5 req-03194b86-33d6-4436-a32b-45a8276a5c05 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.617857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8b0cd29a-31c5-4659-8a9b-7f6b00e945d5 req-03194b86-33d6-4436-a32b-45a8276a5c05 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.618284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8b0cd29a-31c5-4659-8a9b-7f6b00e945d5 req-03194b86-33d6-4436-a32b-45a8276a5c05 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.641674 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-8b0cd29a-31c5-4659-8a9b-7f6b00e945d5 req-03194b86-33d6-4436-a32b-45a8276a5c05 service nova] Creating event network-vif-deleted:710fdc6c-d6aa-4274-b2e7-cd799803ec89 for instance 08d6d417-8aac-434b-a689-84c2743275a4 on n-h2-860282-1 Oct 04 21:11:33.647437 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-8b0cd29a-31c5-4659-8a9b-7f6b00e945d5 req-03194b86-33d6-4436-a32b-45a8276a5c05 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048269 Oct 04 21:11:33.648175 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 837/1651] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:33.718780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-68767095-2f79-45af-9d34-89726221f8d7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:33.720624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-68767095-2f79-45af-9d34-89726221f8d7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:33.729047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68767095-2f79-45af-9d34-89726221f8d7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.729627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68767095-2f79-45af-9d34-89726221f8d7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.730072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68767095-2f79-45af-9d34-89726221f8d7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.736838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68767095-2f79-45af-9d34-89726221f8d7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.737941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68767095-2f79-45af-9d34-89726221f8d7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.746023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68767095-2f79-45af-9d34-89726221f8d7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.850371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-68767095-2f79-45af-9d34-89726221f8d7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:33.860159 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-68767095-2f79-45af-9d34-89726221f8d7 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1426 microversion: 2.1 time: 0.145788 Oct 04 21:11:33.860769 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 815/1652] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:33 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1426 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:33.952512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a2f4d96d-8bcb-4fd9-89cf-2b7cf8ad1d40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1546800915", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "324f5d32-9535-4c31-8532-24f98392bc42"}], "block_device_mapping_v2": [{"uuid": "35a08c41-a5c6-46de-8bdd-af9b995df907", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:34.029327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-a2f4d96d-8bcb-4fd9-89cf-2b7cf8ad1d40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] validate_networks() for [('324f5d32-9535-4c31-8532-24f98392bc42', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:11:34.043152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4ca380f8-de59-4d01-a5be-c71f4ffbb5a1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:34.044999 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4ca380f8-de59-4d01-a5be-c71f4ffbb5a1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:34.053330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ca380f8-de59-4d01-a5be-c71f4ffbb5a1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:34.054400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ca380f8-de59-4d01-a5be-c71f4ffbb5a1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:34.055382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ca380f8-de59-4d01-a5be-c71f4ffbb5a1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:34.056314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ca380f8-de59-4d01-a5be-c71f4ffbb5a1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:34.056989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ca380f8-de59-4d01-a5be-c71f4ffbb5a1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:34.057749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ca380f8-de59-4d01-a5be-c71f4ffbb5a1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:34.501097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4ca380f8-de59-4d01-a5be-c71f4ffbb5a1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:34.510874 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4ca380f8-de59-4d01-a5be-c71f4ffbb5a1 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1469 microversion: 2.1 time: 0.472277 Oct 04 21:11:34.546101 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 816/1653] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:34 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1469 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:34.560831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-36b3fe6a-635e-4f93-bc82-4e5a0ddf0ee3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:34.561564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-36b3fe6a-635e-4f93-bc82-4e5a0ddf0ee3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:34.574558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36b3fe6a-635e-4f93-bc82-4e5a0ddf0ee3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:34.574558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36b3fe6a-635e-4f93-bc82-4e5a0ddf0ee3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:34.574778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36b3fe6a-635e-4f93-bc82-4e5a0ddf0ee3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:34.580293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36b3fe6a-635e-4f93-bc82-4e5a0ddf0ee3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:34.580665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36b3fe6a-635e-4f93-bc82-4e5a0ddf0ee3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:34.581121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36b3fe6a-635e-4f93-bc82-4e5a0ddf0ee3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:34.948092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-36b3fe6a-635e-4f93-bc82-4e5a0ddf0ee3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:34.966602 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-36b3fe6a-635e-4f93-bc82-4e5a0ddf0ee3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1468 microversion: 2.1 time: 0.411722 Oct 04 21:11:34.966602 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 817/1654] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:34 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1468 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:34.972804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a8a42b6e-b52f-486f-9c1d-2fedbef3b1e5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:34.975377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a8a42b6e-b52f-486f-9c1d-2fedbef3b1e5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:34.989826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8a42b6e-b52f-486f-9c1d-2fedbef3b1e5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:34.990689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8a42b6e-b52f-486f-9c1d-2fedbef3b1e5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:34.991405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8a42b6e-b52f-486f-9c1d-2fedbef3b1e5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:34.992345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8a42b6e-b52f-486f-9c1d-2fedbef3b1e5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:34.993770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8a42b6e-b52f-486f-9c1d-2fedbef3b1e5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:34.995262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8a42b6e-b52f-486f-9c1d-2fedbef3b1e5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:35.195559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a2f4d96d-8bcb-4fd9-89cf-2b7cf8ad1d40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:11:35.197362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a2f4d96d-8bcb-4fd9-89cf-2b7cf8ad1d40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:11:35.198109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a2f4d96d-8bcb-4fd9-89cf-2b7cf8ad1d40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:11:35.198849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a2f4d96d-8bcb-4fd9-89cf-2b7cf8ad1d40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:11:35.199601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a2f4d96d-8bcb-4fd9-89cf-2b7cf8ad1d40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:11:35.219597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2f4d96d-8bcb-4fd9-89cf-2b7cf8ad1d40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:35.235959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2f4d96d-8bcb-4fd9-89cf-2b7cf8ad1d40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:35.236413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2f4d96d-8bcb-4fd9-89cf-2b7cf8ad1d40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:35.242903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2f4d96d-8bcb-4fd9-89cf-2b7cf8ad1d40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:35.243418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2f4d96d-8bcb-4fd9-89cf-2b7cf8ad1d40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:35.246192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2f4d96d-8bcb-4fd9-89cf-2b7cf8ad1d40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:35.301165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-a2f4d96d-8bcb-4fd9-89cf-2b7cf8ad1d40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Getting quotas for project 7e9215d1ae0947ce84469bed21fc05ac. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:11:35.306796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-a2f4d96d-8bcb-4fd9-89cf-2b7cf8ad1d40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Getting quotas for user 8bfa449eb3144332afa616cc85d9643f and project 7e9215d1ae0947ce84469bed21fc05ac. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:11:35.394061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a2f4d96d-8bcb-4fd9-89cf-2b7cf8ad1d40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:11:35.398732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a2f4d96d-8bcb-4fd9-89cf-2b7cf8ad1d40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='35a08c41-a5c6-46de-8bdd-af9b995df907',volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:11:35.522789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a8a42b6e-b52f-486f-9c1d-2fedbef3b1e5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:35.552734 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a8a42b6e-b52f-486f-9c1d-2fedbef3b1e5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1306 microversion: 2.1 time: 0.584975 Oct 04 21:11:35.556660 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 818/1655] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:34 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1306 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:35.714581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-9a792cf6-071a-4b2e-bcab-7b065d1cd62a req-d33be99d-cef4-449c-b692-2180f21c4ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a255f2-7c48-4148-bdc8-6603ac47d2a3", "name": "network-vif-deleted", "tag": "9d8db50d-d745-4054-ac10-dc90ebaf61be"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:35.727574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9a792cf6-071a-4b2e-bcab-7b065d1cd62a req-d33be99d-cef4-449c-b692-2180f21c4ad4 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:35.728318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9a792cf6-071a-4b2e-bcab-7b065d1cd62a req-d33be99d-cef4-449c-b692-2180f21c4ad4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:35.729924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9a792cf6-071a-4b2e-bcab-7b065d1cd62a req-d33be99d-cef4-449c-b692-2180f21c4ad4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:35.762536 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-9a792cf6-071a-4b2e-bcab-7b065d1cd62a req-d33be99d-cef4-449c-b692-2180f21c4ad4 service nova] Creating event network-vif-deleted:9d8db50d-d745-4054-ac10-dc90ebaf61be for instance a8a255f2-7c48-4148-bdc8-6603ac47d2a3 on n-h1-860282-1 Oct 04 21:11:35.777919 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-9a792cf6-071a-4b2e-bcab-7b065d1cd62a req-d33be99d-cef4-449c-b692-2180f21c4ad4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219687 Oct 04 21:11:35.779845 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 819/1656] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:35.786646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-61bde0d7-ec12-4793-8da5-0e0fefa6ce1d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:35.789560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-61bde0d7-ec12-4793-8da5-0e0fefa6ce1d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:35.797170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61bde0d7-ec12-4793-8da5-0e0fefa6ce1d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:35.797810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61bde0d7-ec12-4793-8da5-0e0fefa6ce1d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:35.798445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61bde0d7-ec12-4793-8da5-0e0fefa6ce1d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:35.799247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61bde0d7-ec12-4793-8da5-0e0fefa6ce1d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:35.799963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61bde0d7-ec12-4793-8da5-0e0fefa6ce1d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:35.800619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61bde0d7-ec12-4793-8da5-0e0fefa6ce1d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:35.861474 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-61bde0d7-ec12-4793-8da5-0e0fefa6ce1d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.079789 Oct 04 21:11:35.863139 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 820/1657] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Oct 4 21:11:35 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:11:35.873682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5cd89ac9-44b2-4a75-8516-e66bf489c48c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:35.874941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5cd89ac9-44b2-4a75-8516-e66bf489c48c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:35.882533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd89ac9-44b2-4a75-8516-e66bf489c48c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:35.883233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd89ac9-44b2-4a75-8516-e66bf489c48c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:35.883883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd89ac9-44b2-4a75-8516-e66bf489c48c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:35.898081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd89ac9-44b2-4a75-8516-e66bf489c48c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:35.898603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd89ac9-44b2-4a75-8516-e66bf489c48c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:35.899060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd89ac9-44b2-4a75-8516-e66bf489c48c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:36.036332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5cd89ac9-44b2-4a75-8516-e66bf489c48c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:36.048681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5cd89ac9-44b2-4a75-8516-e66bf489c48c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:36.050594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5cd89ac9-44b2-4a75-8516-e66bf489c48c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:36.057541 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5cd89ac9-44b2-4a75-8516-e66bf489c48c tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1533 microversion: 2.91 time: 0.192530 Oct 04 21:11:36.077046 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 821/1658] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:35 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1533 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:36.083519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3b97669f-f6aa-453c-957f-9c76e24350f0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:36.089650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3b97669f-f6aa-453c-957f-9c76e24350f0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:36.093838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b97669f-f6aa-453c-957f-9c76e24350f0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:36.095072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b97669f-f6aa-453c-957f-9c76e24350f0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:36.095588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b97669f-f6aa-453c-957f-9c76e24350f0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:36.096417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b97669f-f6aa-453c-957f-9c76e24350f0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:36.097236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b97669f-f6aa-453c-957f-9c76e24350f0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:36.098059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b97669f-f6aa-453c-957f-9c76e24350f0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:36.124015 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a2f4d96d-8bcb-4fd9-89cf-2b7cf8ad1d40 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.177216 Oct 04 21:11:36.129347 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 838/1659] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:11:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:11:36.140394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-848eb7d8-dd17-4ec6-a632-023f905966a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:36.141025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-848eb7d8-dd17-4ec6-a632-023f905966a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:36.152011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-848eb7d8-dd17-4ec6-a632-023f905966a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:36.152519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-848eb7d8-dd17-4ec6-a632-023f905966a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:36.152961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-848eb7d8-dd17-4ec6-a632-023f905966a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:36.166550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-848eb7d8-dd17-4ec6-a632-023f905966a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:36.167289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-848eb7d8-dd17-4ec6-a632-023f905966a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:36.167968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-848eb7d8-dd17-4ec6-a632-023f905966a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:36.218082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b97669f-f6aa-453c-957f-9c76e24350f0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:36.218596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b97669f-f6aa-453c-957f-9c76e24350f0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:36.219052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b97669f-f6aa-453c-957f-9c76e24350f0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:36.219519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-3b97669f-f6aa-453c-957f-9c76e24350f0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lazy-loading 'fault' on Instance uuid 08d6d417-8aac-434b-a689-84c2743275a4 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:36.302711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3b97669f-f6aa-453c-957f-9c76e24350f0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:36.315480 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3b97669f-f6aa-453c-957f-9c76e24350f0 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1303 microversion: 2.1 time: 0.251254 Oct 04 21:11:36.319648 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 822/1660] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:36 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1303 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:36.330275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-775257e5-1fd6-4ffa-982f-5e371b176315 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:36.330897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-775257e5-1fd6-4ffa-982f-5e371b176315 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:36.335159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-848eb7d8-dd17-4ec6-a632-023f905966a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:36.335665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-848eb7d8-dd17-4ec6-a632-023f905966a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:36.337218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-848eb7d8-dd17-4ec6-a632-023f905966a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:36.337911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-848eb7d8-dd17-4ec6-a632-023f905966a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lazy-loading 'fault' on Instance uuid a8a255f2-7c48-4148-bdc8-6603ac47d2a3 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:36.345789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-775257e5-1fd6-4ffa-982f-5e371b176315 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:36.346294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-775257e5-1fd6-4ffa-982f-5e371b176315 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:36.346750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-775257e5-1fd6-4ffa-982f-5e371b176315 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:36.347473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-775257e5-1fd6-4ffa-982f-5e371b176315 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:36.347937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-775257e5-1fd6-4ffa-982f-5e371b176315 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:36.348488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-775257e5-1fd6-4ffa-982f-5e371b176315 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:36.459758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-848eb7d8-dd17-4ec6-a632-023f905966a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:36.474567 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-848eb7d8-dd17-4ec6-a632-023f905966a4 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 200 len: 1303 microversion: 2.1 time: 0.344064 Oct 04 21:11:36.475197 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 839/1661] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:36 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 1303 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:36.504610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cc88b75d-9506-44a7-b76b-66fe9163a943 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:36.508802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cc88b75d-9506-44a7-b76b-66fe9163a943 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:36.524961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc88b75d-9506-44a7-b76b-66fe9163a943 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:36.525447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc88b75d-9506-44a7-b76b-66fe9163a943 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:36.525904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc88b75d-9506-44a7-b76b-66fe9163a943 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:36.531232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc88b75d-9506-44a7-b76b-66fe9163a943 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:36.531837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc88b75d-9506-44a7-b76b-66fe9163a943 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:36.532283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc88b75d-9506-44a7-b76b-66fe9163a943 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:36.718149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-cc88b75d-9506-44a7-b76b-66fe9163a943 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] Lazy-loading 'services' on Instance uuid 6a60b592-6e55-4259-aff7-b06203ef2d1e {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:36.758197 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cc88b75d-9506-44a7-b76b-66fe9163a943 tempest-UnshelveToHostMultiNodesTest-1475463504 tempest-UnshelveToHostMultiNodesTest-1475463504-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1938 microversion: 2.91 time: 0.261764 Oct 04 21:11:36.759112 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 840/1662] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:36 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1938 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:36.765091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-775257e5-1fd6-4ffa-982f-5e371b176315 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:36.769218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-87926411-a78a-41d7-ac53-703246ac831c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:36.769802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-87926411-a78a-41d7-ac53-703246ac831c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:36.773499 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-775257e5-1fd6-4ffa-982f-5e371b176315 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1468 microversion: 2.1 time: 0.450893 Oct 04 21:11:36.776486 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 823/1663] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:36 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1468 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:36.779815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c44453e1-7f05-44b0-b944-ce90afa2f9b4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:36.780756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c44453e1-7f05-44b0-b944-ce90afa2f9b4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:36.789839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c44453e1-7f05-44b0-b944-ce90afa2f9b4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:36.790928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c44453e1-7f05-44b0-b944-ce90afa2f9b4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:36.791988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c44453e1-7f05-44b0-b944-ce90afa2f9b4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:36.792938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c44453e1-7f05-44b0-b944-ce90afa2f9b4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:36.793599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c44453e1-7f05-44b0-b944-ce90afa2f9b4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:36.794781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c44453e1-7f05-44b0-b944-ce90afa2f9b4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:36.944030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-87926411-a78a-41d7-ac53-703246ac831c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:36.952131 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-87926411-a78a-41d7-ac53-703246ac831c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1053 microversion: 2.1 time: 0.191964 Oct 04 21:11:36.954886 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 841/1664] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:36 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1053 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:36.966823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3a609894-7270-43d1-a042-4e51ac1958d8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:36.967331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3a609894-7270-43d1-a042-4e51ac1958d8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:36.980468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a609894-7270-43d1-a042-4e51ac1958d8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:36.980975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a609894-7270-43d1-a042-4e51ac1958d8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:36.981977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a609894-7270-43d1-a042-4e51ac1958d8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:36.986565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a609894-7270-43d1-a042-4e51ac1958d8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:36.991107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a609894-7270-43d1-a042-4e51ac1958d8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:36.991768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a609894-7270-43d1-a042-4e51ac1958d8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:37.047504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3a609894-7270-43d1-a042-4e51ac1958d8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:11:37.050986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c44453e1-7f05-44b0-b944-ce90afa2f9b4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:37.062478 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c44453e1-7f05-44b0-b944-ce90afa2f9b4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1486 microversion: 2.1 time: 0.285673 Oct 04 21:11:37.063703 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 824/1665] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:36 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1486 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:37.070727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ca8eed1b-d28e-401c-b13a-5dbaa726bfc3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:37.075575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ca8eed1b-d28e-401c-b13a-5dbaa726bfc3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:37.086920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ca8eed1b-d28e-401c-b13a-5dbaa726bfc3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:37.086920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ca8eed1b-d28e-401c-b13a-5dbaa726bfc3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:37.086920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ca8eed1b-d28e-401c-b13a-5dbaa726bfc3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:37.087306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ca8eed1b-d28e-401c-b13a-5dbaa726bfc3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:37.087918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ca8eed1b-d28e-401c-b13a-5dbaa726bfc3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:37.088425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ca8eed1b-d28e-401c-b13a-5dbaa726bfc3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:37.139442 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ca8eed1b-d28e-401c-b13a-5dbaa726bfc3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.074257 Oct 04 21:11:37.140158 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 825/1666] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Oct 4 21:11:37 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:11:37.147213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a9ef1ecd-c43e-40a6-b9d6-098c97a7ef8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:37.148129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a9ef1ecd-c43e-40a6-b9d6-098c97a7ef8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:37.155391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9ef1ecd-c43e-40a6-b9d6-098c97a7ef8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:37.156342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9ef1ecd-c43e-40a6-b9d6-098c97a7ef8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:37.157020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9ef1ecd-c43e-40a6-b9d6-098c97a7ef8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:37.157999 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9ef1ecd-c43e-40a6-b9d6-098c97a7ef8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:37.158702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9ef1ecd-c43e-40a6-b9d6-098c97a7ef8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:37.159379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9ef1ecd-c43e-40a6-b9d6-098c97a7ef8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:37.206238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:37.466353 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a9ef1ecd-c43e-40a6-b9d6-098c97a7ef8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "POST /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891/action" status: 202 len: 0 microversion: 2.1 time: 0.323835 Oct 04 21:11:37.467681 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 826/1667] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:11:37 2022] POST /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:11:37.486480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4d6845ec-b4e0-4cd6-993d-b88b9b69b194 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:37.488220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4d6845ec-b4e0-4cd6-993d-b88b9b69b194 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:37.502597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d6845ec-b4e0-4cd6-993d-b88b9b69b194 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:37.503920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d6845ec-b4e0-4cd6-993d-b88b9b69b194 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:37.504528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d6845ec-b4e0-4cd6-993d-b88b9b69b194 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:37.505407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d6845ec-b4e0-4cd6-993d-b88b9b69b194 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:37.506237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d6845ec-b4e0-4cd6-993d-b88b9b69b194 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:37.506830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d6845ec-b4e0-4cd6-993d-b88b9b69b194 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:37.569901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d6845ec-b4e0-4cd6-993d-b88b9b69b194 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:37.570399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d6845ec-b4e0-4cd6-993d-b88b9b69b194 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:37.570874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d6845ec-b4e0-4cd6-993d-b88b9b69b194 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:37.571309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-4d6845ec-b4e0-4cd6-993d-b88b9b69b194 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lazy-loading 'fault' on Instance uuid 08d6d417-8aac-434b-a689-84c2743275a4 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:37.602735 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3a609894-7270-43d1-a042-4e51ac1958d8 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 204 len: 0 microversion: 2.91 time: 0.645270 Oct 04 21:11:37.605116 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 842/1668] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:11:36 2022] DELETE /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:11:37.614828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-47c610e3-9815-40cb-9a62-fb3a5205470d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:37.615879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-47c610e3-9815-40cb-9a62-fb3a5205470d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:37.630864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47c610e3-9815-40cb-9a62-fb3a5205470d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:37.636237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47c610e3-9815-40cb-9a62-fb3a5205470d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:37.636756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4d6845ec-b4e0-4cd6-993d-b88b9b69b194 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:37.638944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47c610e3-9815-40cb-9a62-fb3a5205470d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:37.641193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47c610e3-9815-40cb-9a62-fb3a5205470d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:37.643834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47c610e3-9815-40cb-9a62-fb3a5205470d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:37.644591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47c610e3-9815-40cb-9a62-fb3a5205470d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:37.646582 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4d6845ec-b4e0-4cd6-993d-b88b9b69b194 tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1303 microversion: 2.1 time: 0.176400 Oct 04 21:11:37.647545 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 827/1669] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:37 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1303 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:37.657726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-00116849-6788-47a3-9fed-1e0742872fb6 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:37.658354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-00116849-6788-47a3-9fed-1e0742872fb6 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: a8a255f2-7c48-4148-bdc8-6603ac47d2a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:37.664423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00116849-6788-47a3-9fed-1e0742872fb6 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:37.673848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00116849-6788-47a3-9fed-1e0742872fb6 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:37.673848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00116849-6788-47a3-9fed-1e0742872fb6 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:37.673848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00116849-6788-47a3-9fed-1e0742872fb6 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:37.673848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00116849-6788-47a3-9fed-1e0742872fb6 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:37.673848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00116849-6788-47a3-9fed-1e0742872fb6 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:37.684615 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-00116849-6788-47a3-9fed-1e0742872fb6 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] HTTP exception thrown: Instance a8a255f2-7c48-4148-bdc8-6603ac47d2a3 could not be found. Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-00116849-6788-47a3-9fed-1e0742872fb6 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Request method failure captured: Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 HTTP/1.1 Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKD0xmS47Z_zq55vtUDgFpaHSkNSbiA2KshZNGw3XdxNTV6T9FHin-vydgPFNrWJnTcZ7jbWTGSV3E5_EgZUHm3dxdLE1OsN4AVFl-QwD-kOlADHO5MXUU81bBiPID3dau_a5djHY1r8ytA3IZaEk1q--_PyHBSrNgM3kY1P7-c3GN4 Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: aa2f4ca02ad74730963245d9e018a386 Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersAdminTestJSON-1028141702 Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aa2f4ca02ad74730963245d9e018a386"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aa2f4ca02ad74730963245d9e018a386"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aa2f4ca02ad74730963245d9e018a386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aa2f4ca02ad74730963245d9e018a386"}]}] Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersAdminTestJSON-1028141702 Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: aa2f4ca02ad74730963245d9e018a386 Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersAdminTestJSON-1028141702 Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersAdminTestJSON-1028141702-project Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 5320f1606bbc49d693ae96f7b7ac516a Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersAdminTestJSON-1028141702-project Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance a8a255f2-7c48-4148-bdc8-6603ac47d2a3 could not be found. Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'a8a255f2-7c48-4148-bdc8-6603ac47d2a3'} Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a255f2-7c48-4148-bdc8-6603ac47d2a3 could not be found. Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a255f2-7c48-4148-bdc8-6603ac47d2a3 could not be found. Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:37.686878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:37.692587 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:37.692587 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:37.692587 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:37.692587 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:11:37.692587 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:11:37.692587 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a255f2-7c48-4148-bdc8-6603ac47d2a3 could not be found. Oct 04 21:11:37.692587 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:37.692587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-00116849-6788-47a3-9fed-1e0742872fb6 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Returning 404 to user: Instance a8a255f2-7c48-4148-bdc8-6603ac47d2a3 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:11:37.692587 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-00116849-6788-47a3-9fed-1e0742872fb6 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3" status: 404 len: 111 microversion: 2.1 time: 0.039762 Oct 04 21:11:37.692587 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 828/1670] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:37 2022] GET /compute/v2.1/servers/a8a255f2-7c48-4148-bdc8-6603ac47d2a3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:11:37.694946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-38012794-e91a-451a-b461-bd4680c296e2 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:37.695793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-38012794-e91a-451a-b461-bd4680c296e2 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:37.702950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38012794-e91a-451a-b461-bd4680c296e2 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:37.703908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38012794-e91a-451a-b461-bd4680c296e2 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:37.704055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38012794-e91a-451a-b461-bd4680c296e2 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:37.704967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38012794-e91a-451a-b461-bd4680c296e2 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:37.705204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38012794-e91a-451a-b461-bd4680c296e2 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:37.705664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38012794-e91a-451a-b461-bd4680c296e2 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:37.814210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-38012794-e91a-451a-b461-bd4680c296e2 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:37.824751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-38012794-e91a-451a-b461-bd4680c296e2 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:37.831413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-38012794-e91a-451a-b461-bd4680c296e2 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:37.839867 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-38012794-e91a-451a-b461-bd4680c296e2 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.149830 Oct 04 21:11:37.841260 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 829/1671] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:37 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:37.846751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a2962c1c-8b74-4f36-904a-98cb367e5898 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:37.847557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a2962c1c-8b74-4f36-904a-98cb367e5898 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:37.856356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2962c1c-8b74-4f36-904a-98cb367e5898 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:37.858023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2962c1c-8b74-4f36-904a-98cb367e5898 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:37.859528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2962c1c-8b74-4f36-904a-98cb367e5898 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:37.861166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2962c1c-8b74-4f36-904a-98cb367e5898 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:37.862046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2962c1c-8b74-4f36-904a-98cb367e5898 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:37.862651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2962c1c-8b74-4f36-904a-98cb367e5898 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:37.934306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a2962c1c-8b74-4f36-904a-98cb367e5898 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:11:38.103760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-47c610e3-9815-40cb-9a62-fb3a5205470d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:38.119644 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-47c610e3-9815-40cb-9a62-fb3a5205470d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1491 microversion: 2.1 time: 0.512846 Oct 04 21:11:38.123476 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 843/1672] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:37 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1491 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:38.130906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-6074d12a-1b61-4d8a-9736-cab334a31dad req-6620d1bb-8b5b-4592-aaf1-03cfee4b8205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a7d656-c2a8-46fa-88dc-6c6cb1919c3b", "name": "network-vif-unplugged", "status": "completed", "tag": "0f85098b-592d-4f47-9950-f46b2b886584"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:38.142161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6074d12a-1b61-4d8a-9736-cab334a31dad req-6620d1bb-8b5b-4592-aaf1-03cfee4b8205 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:38.142889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6074d12a-1b61-4d8a-9736-cab334a31dad req-6620d1bb-8b5b-4592-aaf1-03cfee4b8205 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:38.143516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6074d12a-1b61-4d8a-9736-cab334a31dad req-6620d1bb-8b5b-4592-aaf1-03cfee4b8205 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:38.202725 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-6074d12a-1b61-4d8a-9736-cab334a31dad req-6620d1bb-8b5b-4592-aaf1-03cfee4b8205 service nova] Creating event network-vif-unplugged:0f85098b-592d-4f47-9950-f46b2b886584 for instance 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b on n-h2-860282-1 Oct 04 21:11:38.210780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-6074d12a-1b61-4d8a-9736-cab334a31dad req-6620d1bb-8b5b-4592-aaf1-03cfee4b8205 service nova] Instance 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:11:38.225221 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-6074d12a-1b61-4d8a-9736-cab334a31dad req-6620d1bb-8b5b-4592-aaf1-03cfee4b8205 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103200 Oct 04 21:11:38.226818 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 844/1673] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:38.236066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-41512fca-fa34-46a2-9747-fe55e0e2b1cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:38.236943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-41512fca-fa34-46a2-9747-fe55e0e2b1cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:38.265792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41512fca-fa34-46a2-9747-fe55e0e2b1cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:38.268159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41512fca-fa34-46a2-9747-fe55e0e2b1cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:38.268630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41512fca-fa34-46a2-9747-fe55e0e2b1cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:38.269358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41512fca-fa34-46a2-9747-fe55e0e2b1cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:38.274972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41512fca-fa34-46a2-9747-fe55e0e2b1cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:38.276000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41512fca-fa34-46a2-9747-fe55e0e2b1cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:38.334928 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a2962c1c-8b74-4f36-904a-98cb367e5898 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 204 len: 0 microversion: 2.1 time: 0.492062 Oct 04 21:11:38.335545 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 830/1674] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:11:37 2022] DELETE /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:11:38.342984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d1d613a7-0c13-4445-a4da-febfb2bc4f56 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:38.349129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d1d613a7-0c13-4445-a4da-febfb2bc4f56 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:38.355246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1d613a7-0c13-4445-a4da-febfb2bc4f56 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:38.355830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1d613a7-0c13-4445-a4da-febfb2bc4f56 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:38.356369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1d613a7-0c13-4445-a4da-febfb2bc4f56 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:38.357511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1d613a7-0c13-4445-a4da-febfb2bc4f56 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:38.357688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1d613a7-0c13-4445-a4da-febfb2bc4f56 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:38.358220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1d613a7-0c13-4445-a4da-febfb2bc4f56 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:38.446684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d1d613a7-0c13-4445-a4da-febfb2bc4f56 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:38.463731 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d1d613a7-0c13-4445-a4da-febfb2bc4f56 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1095 microversion: 2.1 time: 0.120742 Oct 04 21:11:38.463731 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 831/1675] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:38 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1095 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:38.463731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e0409a1e-0cce-49ab-acbd-2063663c1f72 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:38.466458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e0409a1e-0cce-49ab-acbd-2063663c1f72 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:38.473148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0409a1e-0cce-49ab-acbd-2063663c1f72 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:38.473679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0409a1e-0cce-49ab-acbd-2063663c1f72 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:38.474190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0409a1e-0cce-49ab-acbd-2063663c1f72 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:38.474929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0409a1e-0cce-49ab-acbd-2063663c1f72 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:38.475391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0409a1e-0cce-49ab-acbd-2063663c1f72 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:38.475817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0409a1e-0cce-49ab-acbd-2063663c1f72 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:38.535912 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e0409a1e-0cce-49ab-acbd-2063663c1f72 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.076190 Oct 04 21:11:38.540395 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 832/1676] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Oct 4 21:11:38 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:11:38.544798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eaf9e3ab-a108-4871-9f56-08f0c61b0f19 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:38.545997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eaf9e3ab-a108-4871-9f56-08f0c61b0f19 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:38.553373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eaf9e3ab-a108-4871-9f56-08f0c61b0f19 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:38.554058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eaf9e3ab-a108-4871-9f56-08f0c61b0f19 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:38.554529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eaf9e3ab-a108-4871-9f56-08f0c61b0f19 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:38.555547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eaf9e3ab-a108-4871-9f56-08f0c61b0f19 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:38.555753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eaf9e3ab-a108-4871-9f56-08f0c61b0f19 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:38.556124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eaf9e3ab-a108-4871-9f56-08f0c61b0f19 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:38.576798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-41512fca-fa34-46a2-9747-fe55e0e2b1cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:38.585127 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-41512fca-fa34-46a2-9747-fe55e0e2b1cd tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1534 microversion: 2.1 time: 0.356589 Oct 04 21:11:38.586564 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 845/1677] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:38 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1534 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:38.671915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1c153e06-e624-45c3-b1fa-cf08cfcc355b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:38.672594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1c153e06-e624-45c3-b1fa-cf08cfcc355b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:38.681010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c153e06-e624-45c3-b1fa-cf08cfcc355b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:38.681546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c153e06-e624-45c3-b1fa-cf08cfcc355b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:38.681966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c153e06-e624-45c3-b1fa-cf08cfcc355b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:38.689685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c153e06-e624-45c3-b1fa-cf08cfcc355b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:38.689685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c153e06-e624-45c3-b1fa-cf08cfcc355b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:38.689685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c153e06-e624-45c3-b1fa-cf08cfcc355b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:38.707425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eaf9e3ab-a108-4871-9f56-08f0c61b0f19 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:38.716205 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eaf9e3ab-a108-4871-9f56-08f0c61b0f19 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1469 microversion: 2.1 time: 0.178340 Oct 04 21:11:38.717034 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 833/1678] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:38 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1469 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:38.723348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c153e06-e624-45c3-b1fa-cf08cfcc355b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:38.725335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c153e06-e624-45c3-b1fa-cf08cfcc355b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:38.732557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c153e06-e624-45c3-b1fa-cf08cfcc355b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:38.732557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-1c153e06-e624-45c3-b1fa-cf08cfcc355b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lazy-loading 'fault' on Instance uuid 08d6d417-8aac-434b-a689-84c2743275a4 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:38.782615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1c153e06-e624-45c3-b1fa-cf08cfcc355b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57285ac83e814f7e8e1971d1d9e97990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5331b2ee38c64bfb8c8449ed3fd957ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:38.790805 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1c153e06-e624-45c3-b1fa-cf08cfcc355b tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 200 len: 1303 microversion: 2.1 time: 0.122960 Oct 04 21:11:38.791394 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 846/1679] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:38 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 1303 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:38.869075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b8c1a53d-e455-40c2-a425-c09e9d427c97 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:38.869724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b8c1a53d-e455-40c2-a425-c09e9d427c97 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:38.876807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8c1a53d-e455-40c2-a425-c09e9d427c97 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:38.877297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8c1a53d-e455-40c2-a425-c09e9d427c97 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:38.878049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8c1a53d-e455-40c2-a425-c09e9d427c97 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:38.878952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8c1a53d-e455-40c2-a425-c09e9d427c97 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:38.880250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8c1a53d-e455-40c2-a425-c09e9d427c97 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:38.882263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8c1a53d-e455-40c2-a425-c09e9d427c97 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:38.955431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b8c1a53d-e455-40c2-a425-c09e9d427c97 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:38.966288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b8c1a53d-e455-40c2-a425-c09e9d427c97 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:38.967897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b8c1a53d-e455-40c2-a425-c09e9d427c97 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:38.973688 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b8c1a53d-e455-40c2-a425-c09e9d427c97 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.108586 Oct 04 21:11:38.974184 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 834/1680] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:38 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:39.144147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e024565f-572f-46ac-bb95-eaf825b5211e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:39.144834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e024565f-572f-46ac-bb95-eaf825b5211e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:39.150881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e024565f-572f-46ac-bb95-eaf825b5211e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.151360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e024565f-572f-46ac-bb95-eaf825b5211e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.151803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e024565f-572f-46ac-bb95-eaf825b5211e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.152479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e024565f-572f-46ac-bb95-eaf825b5211e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.152926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e024565f-572f-46ac-bb95-eaf825b5211e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.153775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e024565f-572f-46ac-bb95-eaf825b5211e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.306888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e024565f-572f-46ac-bb95-eaf825b5211e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:39.316124 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e024565f-572f-46ac-bb95-eaf825b5211e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 200 len: 1471 microversion: 2.1 time: 0.175775 Oct 04 21:11:39.316807 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 847/1681] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:39 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:39.338988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1fcb2927-74cd-44b4-9e09-4b05ca083a21 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-628987120"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:39.341493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1fcb2927-74cd-44b4-9e09-4b05ca083a21 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:39.348510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fcb2927-74cd-44b4-9e09-4b05ca083a21 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.348998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fcb2927-74cd-44b4-9e09-4b05ca083a21 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.349459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fcb2927-74cd-44b4-9e09-4b05ca083a21 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.350165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fcb2927-74cd-44b4-9e09-4b05ca083a21 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.350622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fcb2927-74cd-44b4-9e09-4b05ca083a21 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.351047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fcb2927-74cd-44b4-9e09-4b05ca083a21 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.493483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6a5f7cf2-571f-4002-b348-585b0512398c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:39.494892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6a5f7cf2-571f-4002-b348-585b0512398c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:39.506244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a5f7cf2-571f-4002-b348-585b0512398c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.511209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a5f7cf2-571f-4002-b348-585b0512398c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.512776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a5f7cf2-571f-4002-b348-585b0512398c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.512776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a5f7cf2-571f-4002-b348-585b0512398c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.513085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a5f7cf2-571f-4002-b348-585b0512398c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.515254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a5f7cf2-571f-4002-b348-585b0512398c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.663373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6a5f7cf2-571f-4002-b348-585b0512398c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:39.679243 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6a5f7cf2-571f-4002-b348-585b0512398c tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1151 microversion: 2.1 time: 0.188855 Oct 04 21:11:39.681862 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 848/1682] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:39 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1151 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:39.706644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2b057a84-8415-458c-a251-e4ef7291611b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:39.711077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2b057a84-8415-458c-a251-e4ef7291611b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:39.716089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:39.721278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b057a84-8415-458c-a251-e4ef7291611b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.721831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b057a84-8415-458c-a251-e4ef7291611b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.722274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b057a84-8415-458c-a251-e4ef7291611b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.722993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b057a84-8415-458c-a251-e4ef7291611b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.723609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b057a84-8415-458c-a251-e4ef7291611b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.724037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b057a84-8415-458c-a251-e4ef7291611b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.773835 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2b057a84-8415-458c-a251-e4ef7291611b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.071904 Oct 04 21:11:39.776241 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 849/1683] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Oct 4 21:11:39 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:11:39.784258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ba7345c5-e923-4fe2-8c15-c25b853e64f6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:39.785467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ba7345c5-e923-4fe2-8c15-c25b853e64f6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:39.795786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7345c5-e923-4fe2-8c15-c25b853e64f6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.796600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7345c5-e923-4fe2-8c15-c25b853e64f6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.797316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7345c5-e923-4fe2-8c15-c25b853e64f6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.798227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7345c5-e923-4fe2-8c15-c25b853e64f6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.798874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7345c5-e923-4fe2-8c15-c25b853e64f6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.799493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7345c5-e923-4fe2-8c15-c25b853e64f6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.930190 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1fcb2927-74cd-44b4-9e09-4b05ca083a21 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "POST /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891/action" status: 202 len: 0 microversion: 2.1 time: 0.594911 Oct 04 21:11:39.931706 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 835/1684] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:11:39 2022] POST /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 04 21:11:39.939478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-66927865-699f-4853-a83d-237ec5dcc933 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:39.940566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-66927865-699f-4853-a83d-237ec5dcc933 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:39.952806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66927865-699f-4853-a83d-237ec5dcc933 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.954546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66927865-699f-4853-a83d-237ec5dcc933 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.955267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66927865-699f-4853-a83d-237ec5dcc933 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.956257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66927865-699f-4853-a83d-237ec5dcc933 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.957973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66927865-699f-4853-a83d-237ec5dcc933 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.958848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66927865-699f-4853-a83d-237ec5dcc933 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:40.353253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ba7345c5-e923-4fe2-8c15-c25b853e64f6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:40.360959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-66927865-699f-4853-a83d-237ec5dcc933 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:40.365395 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ba7345c5-e923-4fe2-8c15-c25b853e64f6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1534 microversion: 2.1 time: 0.586651 Oct 04 21:11:40.369506 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 850/1685] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:39 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1534 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:40.372794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6cfaf43d-5934-4b39-a6e7-addab8990cab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:40.373442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6cfaf43d-5934-4b39-a6e7-addab8990cab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] [instance: 08d6d417-8aac-434b-a689-84c2743275a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:40.374663 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-66927865-699f-4853-a83d-237ec5dcc933 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1469 microversion: 2.1 time: 0.441243 Oct 04 21:11:40.375420 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 836/1686] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:39 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1469 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:40.389254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c599bb51-5896-4a8b-acd7-baacb6b319ef tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f5790a64e50>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:40.394692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cfaf43d-5934-4b39-a6e7-addab8990cab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:40.395445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cfaf43d-5934-4b39-a6e7-addab8990cab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:40.395938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cfaf43d-5934-4b39-a6e7-addab8990cab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:40.396499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cfaf43d-5934-4b39-a6e7-addab8990cab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:40.396968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cfaf43d-5934-4b39-a6e7-addab8990cab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:40.397397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cfaf43d-5934-4b39-a6e7-addab8990cab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:40.417601 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-6cfaf43d-5934-4b39-a6e7-addab8990cab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] HTTP exception thrown: Instance 08d6d417-8aac-434b-a689-84c2743275a4 could not be found. Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6cfaf43d-5934-4b39-a6e7-addab8990cab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Request method failure captured: Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 HTTP/1.1 Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKFYPmwSjHiZ0AbBQSe3REwSnb3as87f7Pxj1KWnEssb9qH8IeTnp48xox2MzuWUj-rucjJIF11VqsRIXeuaYEf3XCFtnHB6fuGFQW39rfyC1Ie5jwHgtLEbc7722Xs3sfQA9XqmDFQlmp9kFu_6OetHvP7n_gToHK1jf_CUNhCxDek Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 5331b2ee38c64bfb8c8449ed3fd957ed Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TenantUsagesTestJSON-562917289 Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5331b2ee38c64bfb8c8449ed3fd957ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5331b2ee38c64bfb8c8449ed3fd957ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5331b2ee38c64bfb8c8449ed3fd957ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5331b2ee38c64bfb8c8449ed3fd957ed"}]}] Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TenantUsagesTestJSON-562917289 Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 5331b2ee38c64bfb8c8449ed3fd957ed Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TenantUsagesTestJSON-562917289 Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TenantUsagesTestJSON-562917289-project Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 57285ac83e814f7e8e1971d1d9e97990 Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TenantUsagesTestJSON-562917289-project Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 08d6d417-8aac-434b-a689-84c2743275a4 could not be found. Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '08d6d417-8aac-434b-a689-84c2743275a4'} Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08d6d417-8aac-434b-a689-84c2743275a4 could not be found. Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08d6d417-8aac-434b-a689-84c2743275a4 could not be found. Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:40.425745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:40.430008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:40.430008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:40.430008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:40.430008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:11:40.430008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:11:40.430008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08d6d417-8aac-434b-a689-84c2743275a4 could not be found. Oct 04 21:11:40.430008 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:40.431355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6cfaf43d-5934-4b39-a6e7-addab8990cab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] Returning 404 to user: Instance 08d6d417-8aac-434b-a689-84c2743275a4 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:11:40.432245 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6cfaf43d-5934-4b39-a6e7-addab8990cab tempest-TenantUsagesTestJSON-562917289 tempest-TenantUsagesTestJSON-562917289-project] 10.222.0.30 "GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4" status: 404 len: 111 microversion: 2.1 time: 0.063924 Oct 04 21:11:40.433059 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 851/1687] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:40 2022] GET /compute/v2.1/servers/08d6d417-8aac-434b-a689-84c2743275a4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:11:40.437862 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c599bb51-5896-4a8b-acd7-baacb6b319ef tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b" status: 200 len: 1413 microversion: 2.1 time: 0.061535 Oct 04 21:11:40.438461 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 837/1688] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:11:40 2022] GET /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b => generated 1413 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:40.439601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a9e55503-492f-4f91-a5b9-53f4e8f9cbda tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:40.441375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a9e55503-492f-4f91-a5b9-53f4e8f9cbda tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:40.450917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a9e55503-492f-4f91-a5b9-53f4e8f9cbda tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:40.451575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a9e55503-492f-4f91-a5b9-53f4e8f9cbda tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:40.452029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a9e55503-492f-4f91-a5b9-53f4e8f9cbda tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:40.453110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a9e55503-492f-4f91-a5b9-53f4e8f9cbda tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:40.453673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a9e55503-492f-4f91-a5b9-53f4e8f9cbda tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:40.454106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a9e55503-492f-4f91-a5b9-53f4e8f9cbda tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:40.459792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:40.592997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a9e55503-492f-4f91-a5b9-53f4e8f9cbda tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:40.607529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a9e55503-492f-4f91-a5b9-53f4e8f9cbda tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:40.610084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a9e55503-492f-4f91-a5b9-53f4e8f9cbda tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a07e879a204d4cf48e68655838e27e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79808dd205e4a8c87a0a32c9e38da30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:40.620518 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a9e55503-492f-4f91-a5b9-53f4e8f9cbda tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 200 len: 1539 microversion: 2.91 time: 0.185821 Oct 04 21:11:40.621387 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 852/1689] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:40 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 1539 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:40.635746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-c7230a6a-2173-4e9d-ba54-8593638a3eac req-a9f65b38-5539-41e2-8976-c78be339e0de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e8b58cf-bd44-497d-8bb6-01ffbf4b8429", "name": "network-vif-deleted", "tag": "5d2cde1b-5598-46bc-b281-5449bd749072"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:40.669560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c7230a6a-2173-4e9d-ba54-8593638a3eac req-a9f65b38-5539-41e2-8976-c78be339e0de service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:40.670403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c7230a6a-2173-4e9d-ba54-8593638a3eac req-a9f65b38-5539-41e2-8976-c78be339e0de service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:40.671821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c7230a6a-2173-4e9d-ba54-8593638a3eac req-a9f65b38-5539-41e2-8976-c78be339e0de service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:40.693397 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-c7230a6a-2173-4e9d-ba54-8593638a3eac req-a9f65b38-5539-41e2-8976-c78be339e0de service nova] Creating event network-vif-deleted:5d2cde1b-5598-46bc-b281-5449bd749072 for instance 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 on n-h1-860282-1 Oct 04 21:11:40.701717 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-c7230a6a-2173-4e9d-ba54-8593638a3eac req-a9f65b38-5539-41e2-8976-c78be339e0de service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075752 Oct 04 21:11:40.702818 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 853/1690] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:40.704049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-01d0c340-9e15-40a5-99ac-2cf730dc8504 tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-509737181", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:40.713139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8f0c3732-21a2-4854-860d-de584aa7c904 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:40.713958 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-01d0c340-9e15-40a5-99ac-2cf730dc8504 tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] HTTP exception thrown: min_count must be <= max_count Oct 04 21:11:40.715005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8f0c3732-21a2-4854-860d-de584aa7c904 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-01d0c340-9e15-40a5-99ac-2cf730dc8504 tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] Request method failure captured: Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 183 Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKGL38Go9iN7v0nsYLaVdAD7QCBeXUT5DJG9Xwam4IvxzdgG3zCDB6K9J4fQ-yqaW9YgkNfe7IO9Tk1M2Kvh1rrfe-4Stbuef5Xeap7PJDRCImsXqhNRqnQsPJi_FEFRwiZE2V8u7-edPxfSwl7qDiM8lbbV45Tjpvf_p3dWPVsrS3A Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 2cacd6c1929c444a9929ea6f93423e2e Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-909011431 Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2cacd6c1929c444a9929ea6f93423e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2cacd6c1929c444a9929ea6f93423e2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2cacd6c1929c444a9929ea6f93423e2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2cacd6c1929c444a9929ea6f93423e2e"}]}] Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-909011431 Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 2cacd6c1929c444a9929ea6f93423e2e Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-909011431 Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-MultipleCreateNegativeTestJSON-909011431-project Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 34af3ea41497457d9547596dc0ab1ee6 Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-909011431-project Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-509737181", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: exception: min_count must be <= max_count Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-509737181', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 04 21:11:40.721585 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:40.734697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-01d0c340-9e15-40a5-99ac-2cf730dc8504 tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] Returning 400 to user: min_count must be <= max_count {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:11:40.734807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f0c3732-21a2-4854-860d-de584aa7c904 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:40.734807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f0c3732-21a2-4854-860d-de584aa7c904 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:40.734970 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-01d0c340-9e15-40a5-99ac-2cf730dc8504 tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.284400 Oct 04 21:11:40.735074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f0c3732-21a2-4854-860d-de584aa7c904 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:40.735074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f0c3732-21a2-4854-860d-de584aa7c904 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:40.735074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f0c3732-21a2-4854-860d-de584aa7c904 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:40.735074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f0c3732-21a2-4854-860d-de584aa7c904 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:40.741102 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 838/1691] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:11:40 2022] POST /compute/v2.1/servers => generated 74 bytes in 299 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:11:40.783994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dc982c1f-775c-42d5-9915-c66cd2ef97db tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:40.786212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dc982c1f-775c-42d5-9915-c66cd2ef97db tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:40.797100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc982c1f-775c-42d5-9915-c66cd2ef97db tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:40.797981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc982c1f-775c-42d5-9915-c66cd2ef97db tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:40.798764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc982c1f-775c-42d5-9915-c66cd2ef97db tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:40.799882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc982c1f-775c-42d5-9915-c66cd2ef97db tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:40.800589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc982c1f-775c-42d5-9915-c66cd2ef97db tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:40.801035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc982c1f-775c-42d5-9915-c66cd2ef97db tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:40.854640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8f0c3732-21a2-4854-860d-de584aa7c904 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:40.881462 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8f0c3732-21a2-4854-860d-de584aa7c904 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1159 microversion: 2.1 time: 0.176197 Oct 04 21:11:40.882211 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dc982c1f-775c-42d5-9915-c66cd2ef97db tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.098945 Oct 04 21:11:40.900717 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 839/1692] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Oct 4 21:11:40 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:40.908157 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 854/1693] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:40 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1159 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:40.922913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-53bccf18-c3aa-4631-a26e-19fbf7c1ba35 tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-68129176", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "max_count": 0}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-53bccf18-c3aa-4631-a26e-19fbf7c1ba35 tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] Request method failure captured: Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 166 Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKGL38Go9iN7v0nsYLaVdAD7QCBeXUT5DJG9Xwam4IvxzdgG3zCDB6K9J4fQ-yqaW9YgkNfe7IO9Tk1M2Kvh1rrfe-4Stbuef5Xeap7PJDRCImsXqhNRqnQsPJi_FEFRwiZE2V8u7-edPxfSwl7qDiM8lbbV45Tjpvf_p3dWPVsrS3A Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 2cacd6c1929c444a9929ea6f93423e2e Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-909011431 Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2cacd6c1929c444a9929ea6f93423e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2cacd6c1929c444a9929ea6f93423e2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2cacd6c1929c444a9929ea6f93423e2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2cacd6c1929c444a9929ea6f93423e2e"}]}] Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-909011431 Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 2cacd6c1929c444a9929ea6f93423e2e Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-909011431 Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-MultipleCreateNegativeTestJSON-909011431-project Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 34af3ea41497457d9547596dc0ab1ee6 Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-909011431-project Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-68129176", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "max_count": 0}} Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-68129176', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'max_count': 0}}} Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 0 Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:11:40.937738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:11:40.941889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:11:40.941889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:11:40.941889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:11:40.941889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:11:40.941889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 21:11:40.941889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:40.941889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:40.941889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:40.941889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:40.941889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:40.941889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:40.941889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:11:40.941889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:11:40.941889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 21:11:40.941889 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:40.941889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-53bccf18-c3aa-4631-a26e-19fbf7c1ba35 tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:11:40.941889 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-53bccf18-c3aa-4631-a26e-19fbf7c1ba35 tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.033555 Oct 04 21:11:40.949841 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 840/1694] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:11:40 2022] POST /compute/v2.1/servers => generated 130 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:11:41.006988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-435751eb-189a-4374-9bbe-919646ff187f tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-318324251", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "max_count": 2.5}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-435751eb-189a-4374-9bbe-919646ff187f tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] Request method failure captured: Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 169 Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKGL38Go9iN7v0nsYLaVdAD7QCBeXUT5DJG9Xwam4IvxzdgG3zCDB6K9J4fQ-yqaW9YgkNfe7IO9Tk1M2Kvh1rrfe-4Stbuef5Xeap7PJDRCImsXqhNRqnQsPJi_FEFRwiZE2V8u7-edPxfSwl7qDiM8lbbV45Tjpvf_p3dWPVsrS3A Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 2cacd6c1929c444a9929ea6f93423e2e Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-909011431 Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2cacd6c1929c444a9929ea6f93423e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2cacd6c1929c444a9929ea6f93423e2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2cacd6c1929c444a9929ea6f93423e2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2cacd6c1929c444a9929ea6f93423e2e"}]}] Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-909011431 Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 2cacd6c1929c444a9929ea6f93423e2e Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-909011431 Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-MultipleCreateNegativeTestJSON-909011431-project Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 34af3ea41497457d9547596dc0ab1ee6 Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-909011431-project Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-318324251", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "max_count": 2.5}} Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-318324251', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'max_count': 2.5}}} Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:11:41.012111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:11:41.028976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:11:41.028976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:11:41.028976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:11:41.028976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:11:41.028976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 21:11:41.028976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.028976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:41.028976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.028976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:41.028976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:41.028976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:41.028976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:11:41.028976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:11:41.028976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 21:11:41.028976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.028976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-435751eb-189a-4374-9bbe-919646ff187f tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:11:41.028976 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-435751eb-189a-4374-9bbe-919646ff187f tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.012585 Oct 04 21:11:41.028976 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 855/1695] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:11:41 2022] POST /compute/v2.1/servers => generated 139 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:11:41.164070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-200fd522-2015-4b82-8409-c23c765890d3 tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1389709444", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "min_count": 0}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-200fd522-2015-4b82-8409-c23c765890d3 tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] Request method failure captured: Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 168 Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKGL38Go9iN7v0nsYLaVdAD7QCBeXUT5DJG9Xwam4IvxzdgG3zCDB6K9J4fQ-yqaW9YgkNfe7IO9Tk1M2Kvh1rrfe-4Stbuef5Xeap7PJDRCImsXqhNRqnQsPJi_FEFRwiZE2V8u7-edPxfSwl7qDiM8lbbV45Tjpvf_p3dWPVsrS3A Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 2cacd6c1929c444a9929ea6f93423e2e Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-909011431 Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2cacd6c1929c444a9929ea6f93423e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2cacd6c1929c444a9929ea6f93423e2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2cacd6c1929c444a9929ea6f93423e2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2cacd6c1929c444a9929ea6f93423e2e"}]}] Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-909011431 Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 2cacd6c1929c444a9929ea6f93423e2e Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-909011431 Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-MultipleCreateNegativeTestJSON-909011431-project Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 34af3ea41497457d9547596dc0ab1ee6 Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-909011431-project Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1389709444", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "min_count": 0}} Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1389709444', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'min_count': 0}}} Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 0 Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:11:41.168167 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:11:41.178855 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:11:41.178855 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:11:41.178855 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:11:41.178855 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:11:41.178855 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 21:11:41.178855 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.178855 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:41.178855 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.178855 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:41.178855 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:41.178855 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:41.178855 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:11:41.178855 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:11:41.178855 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 21:11:41.178855 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.178855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-200fd522-2015-4b82-8409-c23c765890d3 tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:11:41.178855 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-200fd522-2015-4b82-8409-c23c765890d3 tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.010211 Oct 04 21:11:41.178855 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 841/1696] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:11:41 2022] POST /compute/v2.1/servers => generated 130 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:11:41.398015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-89308ec8-9fa8-43ed-be27-d2320d505e1b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:41.398976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-89308ec8-9fa8-43ed-be27-d2320d505e1b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:41.404018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9e317755-1e53-46c3-8775-b353fae4ad8d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:41.404985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9e317755-1e53-46c3-8775-b353fae4ad8d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:41.417886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89308ec8-9fa8-43ed-be27-d2320d505e1b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:41.424834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e317755-1e53-46c3-8775-b353fae4ad8d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:41.425317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89308ec8-9fa8-43ed-be27-d2320d505e1b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:41.425456 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e317755-1e53-46c3-8775-b353fae4ad8d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:41.425556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89308ec8-9fa8-43ed-be27-d2320d505e1b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:41.425640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e317755-1e53-46c3-8775-b353fae4ad8d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:41.425640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e317755-1e53-46c3-8775-b353fae4ad8d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:41.425640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e317755-1e53-46c3-8775-b353fae4ad8d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:41.425640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e317755-1e53-46c3-8775-b353fae4ad8d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:41.425936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89308ec8-9fa8-43ed-be27-d2320d505e1b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:41.425936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89308ec8-9fa8-43ed-be27-d2320d505e1b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:41.425936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89308ec8-9fa8-43ed-be27-d2320d505e1b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:41.557966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e317755-1e53-46c3-8775-b353fae4ad8d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:41.558659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e317755-1e53-46c3-8775-b353fae4ad8d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:41.559552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e317755-1e53-46c3-8775-b353fae4ad8d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:41.560233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-9e317755-1e53-46c3-8775-b353fae4ad8d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lazy-loading 'fault' on Instance uuid 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:41.678151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9e317755-1e53-46c3-8775-b353fae4ad8d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:41.687375 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9e317755-1e53-46c3-8775-b353fae4ad8d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 200 len: 1304 microversion: 2.1 time: 0.288466 Oct 04 21:11:41.687959 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 842/1697] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:41 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 1304 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:41.693639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0aa1e06e-131d-4507-8c48-8a3614c2fa9d tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1008146779", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "min_count": 2.5}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0aa1e06e-131d-4507-8c48-8a3614c2fa9d tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] Request method failure captured: Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 170 Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKGL38Go9iN7v0nsYLaVdAD7QCBeXUT5DJG9Xwam4IvxzdgG3zCDB6K9J4fQ-yqaW9YgkNfe7IO9Tk1M2Kvh1rrfe-4Stbuef5Xeap7PJDRCImsXqhNRqnQsPJi_FEFRwiZE2V8u7-edPxfSwl7qDiM8lbbV45Tjpvf_p3dWPVsrS3A Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 2cacd6c1929c444a9929ea6f93423e2e Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-909011431 Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2cacd6c1929c444a9929ea6f93423e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2cacd6c1929c444a9929ea6f93423e2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2cacd6c1929c444a9929ea6f93423e2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2cacd6c1929c444a9929ea6f93423e2e"}]}] Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-909011431 Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 2cacd6c1929c444a9929ea6f93423e2e Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-909011431 Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-MultipleCreateNegativeTestJSON-909011431-project Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 34af3ea41497457d9547596dc0ab1ee6 Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-909011431-project Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1008146779", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "min_count": 2.5}} Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1008146779', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'min_count': 2.5}}} Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:11:41.697890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:11:41.703013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:11:41.703013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:11:41.703013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:11:41.703013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:11:41.703013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 21:11:41.703013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.703013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:41.703013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.703013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:41.703013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:41.703013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:41.703013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:11:41.703013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:11:41.703013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 21:11:41.703013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.705241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0aa1e06e-131d-4507-8c48-8a3614c2fa9d tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:11:41.706282 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0aa1e06e-131d-4507-8c48-8a3614c2fa9d tempest-MultipleCreateNegativeTestJSON-909011431 tempest-MultipleCreateNegativeTestJSON-909011431-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.016337 Oct 04 21:11:41.707231 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 843/1698] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:11:41 2022] POST /compute/v2.1/servers => generated 139 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:11:41.712152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-035e01df-9d6b-413c-82a6-ae932f5c8907 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f57908d55e0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:41.776850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-89308ec8-9fa8-43ed-be27-d2320d505e1b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:41.785302 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-89308ec8-9fa8-43ed-be27-d2320d505e1b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1534 microversion: 2.1 time: 0.391755 Oct 04 21:11:41.802101 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-035e01df-9d6b-413c-82a6-ae932f5c8907 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b" status: 200 len: 1413 microversion: 2.1 time: 0.077295 Oct 04 21:11:41.803287 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 856/1699] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:41 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1534 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:41.808038 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 844/1700] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:11:41 2022] GET /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:41.811667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a3f76e84-112f-4f2c-95fe-07ee033318e0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:41.812606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a3f76e84-112f-4f2c-95fe-07ee033318e0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] [instance: 6a60b592-6e55-4259-aff7-b06203ef2d1e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:41.820348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3f76e84-112f-4f2c-95fe-07ee033318e0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:41.821160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3f76e84-112f-4f2c-95fe-07ee033318e0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:41.821869 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3f76e84-112f-4f2c-95fe-07ee033318e0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:41.822995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3f76e84-112f-4f2c-95fe-07ee033318e0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:41.823675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3f76e84-112f-4f2c-95fe-07ee033318e0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:41.824919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3f76e84-112f-4f2c-95fe-07ee033318e0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:41.844275 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-a3f76e84-112f-4f2c-95fe-07ee033318e0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] HTTP exception thrown: Instance 6a60b592-6e55-4259-aff7-b06203ef2d1e could not be found. Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a3f76e84-112f-4f2c-95fe-07ee033318e0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Request method failure captured: Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e HTTP/1.1 Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKDGsEztyEXAEOLzauwnW7P1HSIOARnn3Y6YnAtvMZoAcaCXZWdfTwHdR-Ps5RJYw8GHor6FzL-hGaKs7V_L0pVHqxfvpl_Migbor7nR769qchy3kkZ2XYQZqoXY8VwpzvBYBQfb608rudfKClzdFGoEQ905Rrv-jiOTuhUAQC6lj7M Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-Openstack-Nova-Api-Version: 2.91 Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: b79808dd205e4a8c87a0a32c9e38da30 Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-592524325 Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b79808dd205e4a8c87a0a32c9e38da30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b79808dd205e4a8c87a0a32c9e38da30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b79808dd205e4a8c87a0a32c9e38da30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b79808dd205e4a8c87a0a32c9e38da30"}]}] Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-592524325 Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: b79808dd205e4a8c87a0a32c9e38da30 Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-592524325 Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-UnshelveToHostMultiNodesTest-592524325-project Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: a07e879a204d4cf48e68655838e27e98 Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-592524325-project Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 6a60b592-6e55-4259-aff7-b06203ef2d1e could not be found. Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '6a60b592-6e55-4259-aff7-b06203ef2d1e'} Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a60b592-6e55-4259-aff7-b06203ef2d1e could not be found. Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a60b592-6e55-4259-aff7-b06203ef2d1e could not be found. Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.846303 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:41.855348 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.855348 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:41.855348 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:41.855348 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:41.855348 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:11:41.855348 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:11:41.855348 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a60b592-6e55-4259-aff7-b06203ef2d1e could not be found. Oct 04 21:11:41.855348 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:41.855348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a3f76e84-112f-4f2c-95fe-07ee033318e0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] Returning 404 to user: Instance 6a60b592-6e55-4259-aff7-b06203ef2d1e could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:11:41.855348 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a3f76e84-112f-4f2c-95fe-07ee033318e0 tempest-UnshelveToHostMultiNodesTest-592524325 tempest-UnshelveToHostMultiNodesTest-592524325-project] 10.222.0.30 "GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e" status: 404 len: 111 microversion: 2.91 time: 0.046882 Oct 04 21:11:41.855348 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 857/1701] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:41 2022] GET /compute/v2.1/servers/6a60b592-6e55-4259-aff7-b06203ef2d1e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:11:41.924935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ec9a05a7-a8a9-4005-b66e-24a899139d7e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:41.925688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ec9a05a7-a8a9-4005-b66e-24a899139d7e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:41.931670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:41.932824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec9a05a7-a8a9-4005-b66e-24a899139d7e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:41.933476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec9a05a7-a8a9-4005-b66e-24a899139d7e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:41.934498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec9a05a7-a8a9-4005-b66e-24a899139d7e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:41.935766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec9a05a7-a8a9-4005-b66e-24a899139d7e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:41.936443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec9a05a7-a8a9-4005-b66e-24a899139d7e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:41.937166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec9a05a7-a8a9-4005-b66e-24a899139d7e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:42.140570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ec9a05a7-a8a9-4005-b66e-24a899139d7e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:42.144338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:42.154295 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ec9a05a7-a8a9-4005-b66e-24a899139d7e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1211 microversion: 2.1 time: 0.233149 Oct 04 21:11:42.169917 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 845/1702] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:41 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1211 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:42.717785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9b0013f0-df3d-4ece-8f12-f98d0172c7fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:42.718411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9b0013f0-df3d-4ece-8f12-f98d0172c7fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:42.728525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b0013f0-df3d-4ece-8f12-f98d0172c7fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:42.730494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b0013f0-df3d-4ece-8f12-f98d0172c7fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:42.735770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b0013f0-df3d-4ece-8f12-f98d0172c7fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:42.740243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b0013f0-df3d-4ece-8f12-f98d0172c7fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:42.741769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b0013f0-df3d-4ece-8f12-f98d0172c7fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:42.742229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b0013f0-df3d-4ece-8f12-f98d0172c7fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:42.776453 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-9b0013f0-df3d-4ece-8f12-f98d0172c7fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] HTTP exception thrown: Instance 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 could not be found. Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9b0013f0-df3d-4ece-8f12-f98d0172c7fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Request method failure captured: Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 HTTP/1.1 Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKD0xmS47Z_zq55vtUDgFpaHSkNSbiA2KshZNGw3XdxNTV6T9FHin-vydgPFNrWJnTcZ7jbWTGSV3E5_EgZUHm3dxdLE1OsN4AVFl-QwD-kOlADHO5MXUU81bBiPID3dau_a5djHY1r8ytA3IZaEk1q--_PyHBSrNgM3kY1P7-c3GN4 Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: aa2f4ca02ad74730963245d9e018a386 Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersAdminTestJSON-1028141702 Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aa2f4ca02ad74730963245d9e018a386"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aa2f4ca02ad74730963245d9e018a386"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aa2f4ca02ad74730963245d9e018a386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aa2f4ca02ad74730963245d9e018a386"}]}] Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersAdminTestJSON-1028141702 Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: aa2f4ca02ad74730963245d9e018a386 Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersAdminTestJSON-1028141702 Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersAdminTestJSON-1028141702-project Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 5320f1606bbc49d693ae96f7b7ac516a Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersAdminTestJSON-1028141702-project Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 could not be found. Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '6e8b58cf-bd44-497d-8bb6-01ffbf4b8429'} Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 could not be found. Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 could not be found. Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:42.781535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:42.788091 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:42.788091 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:42.788091 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:42.788091 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:11:42.788091 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:11:42.788091 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 could not be found. Oct 04 21:11:42.788091 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:42.788677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9b0013f0-df3d-4ece-8f12-f98d0172c7fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Returning 404 to user: Instance 6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:11:42.789813 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9b0013f0-df3d-4ece-8f12-f98d0172c7fd tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429" status: 404 len: 111 microversion: 2.1 time: 0.076869 Oct 04 21:11:42.795784 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 858/1703] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:42 2022] GET /compute/v2.1/servers/6e8b58cf-bd44-497d-8bb6-01ffbf4b8429 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:11:42.799975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e52434c0-5bf4-4266-8269-809a8eafe67f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:42.800711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e52434c0-5bf4-4266-8269-809a8eafe67f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:42.818367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e52434c0-5bf4-4266-8269-809a8eafe67f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:42.822295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e52434c0-5bf4-4266-8269-809a8eafe67f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:42.822295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e52434c0-5bf4-4266-8269-809a8eafe67f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:42.822295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e52434c0-5bf4-4266-8269-809a8eafe67f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:42.822760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d5bc3382-8f85-46be-9dd7-693afa5d0ed8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f579453e1f0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:42.822866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e52434c0-5bf4-4266-8269-809a8eafe67f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:42.822866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e52434c0-5bf4-4266-8269-809a8eafe67f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:42.857694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e52434c0-5bf4-4266-8269-809a8eafe67f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:11:42.895511 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d5bc3382-8f85-46be-9dd7-693afa5d0ed8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b" status: 200 len: 1413 microversion: 2.1 time: 0.078671 Oct 04 21:11:42.897072 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 859/1704] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:11:42 2022] GET /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b => generated 1413 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:42.902964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0f7d4e4a-64dc-4fb5-8be6-f09242aaf893 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:42.904452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0f7d4e4a-64dc-4fb5-8be6-f09242aaf893 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:42.913601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f7d4e4a-64dc-4fb5-8be6-f09242aaf893 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:42.914779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f7d4e4a-64dc-4fb5-8be6-f09242aaf893 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:42.915250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f7d4e4a-64dc-4fb5-8be6-f09242aaf893 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:42.916036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f7d4e4a-64dc-4fb5-8be6-f09242aaf893 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:42.916699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f7d4e4a-64dc-4fb5-8be6-f09242aaf893 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:42.917146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f7d4e4a-64dc-4fb5-8be6-f09242aaf893 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:43.098732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0f7d4e4a-64dc-4fb5-8be6-f09242aaf893 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:43.108771 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0f7d4e4a-64dc-4fb5-8be6-f09242aaf893 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1534 microversion: 2.1 time: 0.210252 Oct 04 21:11:43.111011 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 860/1705] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:42 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1534 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:43.178158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8dfa34a6-eed4-4de4-a207-641d9b3a0f73 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:43.188450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8dfa34a6-eed4-4de4-a207-641d9b3a0f73 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:43.204409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dfa34a6-eed4-4de4-a207-641d9b3a0f73 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:43.214508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dfa34a6-eed4-4de4-a207-641d9b3a0f73 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:43.216101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dfa34a6-eed4-4de4-a207-641d9b3a0f73 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:43.220507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dfa34a6-eed4-4de4-a207-641d9b3a0f73 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:43.222342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dfa34a6-eed4-4de4-a207-641d9b3a0f73 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:43.234212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dfa34a6-eed4-4de4-a207-641d9b3a0f73 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:43.360551 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e52434c0-5bf4-4266-8269-809a8eafe67f tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 204 len: 0 microversion: 2.1 time: 0.564090 Oct 04 21:11:43.362822 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 846/1706] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:11:42 2022] DELETE /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:11:43.371601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e001694c-0f31-4e88-8e64-a619ba39819e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:43.382799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e001694c-0f31-4e88-8e64-a619ba39819e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:43.399541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e001694c-0f31-4e88-8e64-a619ba39819e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:43.400798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e001694c-0f31-4e88-8e64-a619ba39819e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:43.406337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e001694c-0f31-4e88-8e64-a619ba39819e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:43.407282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e001694c-0f31-4e88-8e64-a619ba39819e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:43.409298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e001694c-0f31-4e88-8e64-a619ba39819e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:43.411154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e001694c-0f31-4e88-8e64-a619ba39819e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:43.681163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8dfa34a6-eed4-4de4-a207-641d9b3a0f73 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:43.694610 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8dfa34a6-eed4-4de4-a207-641d9b3a0f73 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1211 microversion: 2.1 time: 0.520226 Oct 04 21:11:43.695550 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 861/1707] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:43 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1211 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:43.759245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-412db011-2a00-4bce-9d5d-6736b539b45d req-00f99ea9-d86e-46c4-a687-6519a3f5f247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95674198-fb96-434e-82bf-f3b189599f0e", "tag": "9e441d3d-b8e8-4963-9f5c-ac245f115ac5"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:43.783015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-412db011-2a00-4bce-9d5d-6736b539b45d req-00f99ea9-d86e-46c4-a687-6519a3f5f247 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:43.783666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-412db011-2a00-4bce-9d5d-6736b539b45d req-00f99ea9-d86e-46c4-a687-6519a3f5f247 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:43.784732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-412db011-2a00-4bce-9d5d-6736b539b45d req-00f99ea9-d86e-46c4-a687-6519a3f5f247 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:43.814194 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-412db011-2a00-4bce-9d5d-6736b539b45d req-00f99ea9-d86e-46c4-a687-6519a3f5f247 service nova] Creating event network-changed:9e441d3d-b8e8-4963-9f5c-ac245f115ac5 for instance 95674198-fb96-434e-82bf-f3b189599f0e on n-h1-860282-1 Oct 04 21:11:43.828111 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-412db011-2a00-4bce-9d5d-6736b539b45d req-00f99ea9-d86e-46c4-a687-6519a3f5f247 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071814 Oct 04 21:11:43.829492 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 862/1708] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:43.913771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9276b754-86a6-40e1-82b1-49b0ce0f8b84 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f57945561f0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:43.953843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e001694c-0f31-4e88-8e64-a619ba39819e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:43.967796 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e001694c-0f31-4e88-8e64-a619ba39819e tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1469 microversion: 2.1 time: 0.600400 Oct 04 21:11:43.968167 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 847/1709] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:43 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1469 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:43.995549 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9276b754-86a6-40e1-82b1-49b0ce0f8b84 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b" status: 200 len: 1413 microversion: 2.1 time: 0.086890 Oct 04 21:11:43.999483 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 863/1710] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:11:43 2022] GET /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b => generated 1413 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:44.139730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fd193715-e17f-4b67-9a69-e02dc51a4bf6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:44.140607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fd193715-e17f-4b67-9a69-e02dc51a4bf6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:44.149360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd193715-e17f-4b67-9a69-e02dc51a4bf6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:44.150249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd193715-e17f-4b67-9a69-e02dc51a4bf6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:44.150846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd193715-e17f-4b67-9a69-e02dc51a4bf6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:44.151712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd193715-e17f-4b67-9a69-e02dc51a4bf6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:44.152344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd193715-e17f-4b67-9a69-e02dc51a4bf6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:44.152967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd193715-e17f-4b67-9a69-e02dc51a4bf6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:44.376401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fd193715-e17f-4b67-9a69-e02dc51a4bf6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:44.388921 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fd193715-e17f-4b67-9a69-e02dc51a4bf6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1527 microversion: 2.1 time: 0.252539 Oct 04 21:11:44.390253 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 848/1711] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:44 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1527 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:44.413297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5521da33-2bd4-4ecb-8a3f-694cea594a09 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:44.414083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5521da33-2bd4-4ecb-8a3f-694cea594a09 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:44.441614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5521da33-2bd4-4ecb-8a3f-694cea594a09 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:44.442412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5521da33-2bd4-4ecb-8a3f-694cea594a09 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:44.443749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5521da33-2bd4-4ecb-8a3f-694cea594a09 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:44.447584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5521da33-2bd4-4ecb-8a3f-694cea594a09 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:44.449734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5521da33-2bd4-4ecb-8a3f-694cea594a09 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:44.452119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5521da33-2bd4-4ecb-8a3f-694cea594a09 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:44.730068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3120bbad-939e-4b4a-b77e-ed6a382a39a9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:44.731845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3120bbad-939e-4b4a-b77e-ed6a382a39a9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:44.736955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5521da33-2bd4-4ecb-8a3f-694cea594a09 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:44.751113 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5521da33-2bd4-4ecb-8a3f-694cea594a09 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1527 microversion: 2.1 time: 0.341904 Oct 04 21:11:44.761674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3120bbad-939e-4b4a-b77e-ed6a382a39a9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:44.761674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3120bbad-939e-4b4a-b77e-ed6a382a39a9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:44.761674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3120bbad-939e-4b4a-b77e-ed6a382a39a9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:44.762373 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 864/1712] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:44 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1527 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:44.762766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3120bbad-939e-4b4a-b77e-ed6a382a39a9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:44.763550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3120bbad-939e-4b4a-b77e-ed6a382a39a9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:44.764015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3120bbad-939e-4b4a-b77e-ed6a382a39a9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:44.779508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bfb875ed-2d0a-4e46-8d10-d1f1577fe137 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:44.805402 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-bfb875ed-2d0a-4e46-8d10-d1f1577fe137 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] HTTP exception thrown: Flavor 2cd11cb4-6333-43ab-a095-d4301a490bf8 could not be found. Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bfb875ed-2d0a-4e46-8d10-d1f1577fe137 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Request method failure captured: Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/flavors/2cd11cb4-6333-43ab-a095-d4301a490bf8 HTTP/1.1 Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKCgwsM3n16LoJ3FTRHrwcRGUcxnZ4bYnWo20fUo4jzreI_GIpMFEXHVTsB2Xi6U18lgDblsdiXrRYDr6BG-63CGlSUnguCoh0kAGQy3DKTFgEiUHg8RnuEfDFXSEA1SfupGTrN5lk_yt6UJy38fvLSLBjKYIwqGRXYx5SYXdt0RN6c Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 05f1585595be4d9a8ac10069615004c1 Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-MigrationsAdminTest-1217011000 Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/05f1585595be4d9a8ac10069615004c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_05f1585595be4d9a8ac10069615004c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/05f1585595be4d9a8ac10069615004c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/05f1585595be4d9a8ac10069615004c1"}]}] Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-MigrationsAdminTest-1217011000 Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 05f1585595be4d9a8ac10069615004c1 Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-MigrationsAdminTest-1217011000 Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-MigrationsAdminTest-1217011000-project-admin Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 46403f4804524b49b6e6a819eacf9316 Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-MigrationsAdminTest-1217011000-project-admin Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: exception: Flavor 2cd11cb4-6333-43ab-a095-d4301a490bf8 could not be found. Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '2cd11cb4-6333-43ab-a095-d4301a490bf8'} Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2cd11cb4-6333-43ab-a095-d4301a490bf8 could not be found. Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2cd11cb4-6333-43ab-a095-d4301a490bf8 could not be found. Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:44.826864 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:44.831953 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:44.831953 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:44.831953 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:44.831953 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:44.831953 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:11:44.831953 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:11:44.831953 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2cd11cb4-6333-43ab-a095-d4301a490bf8 could not be found. Oct 04 21:11:44.831953 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:11:44.834977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bfb875ed-2d0a-4e46-8d10-d1f1577fe137 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Returning 404 to user: Flavor 2cd11cb4-6333-43ab-a095-d4301a490bf8 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:11:44.836035 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bfb875ed-2d0a-4e46-8d10-d1f1577fe137 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/2cd11cb4-6333-43ab-a095-d4301a490bf8" status: 404 len: 109 microversion: 2.1 time: 0.062284 Oct 04 21:11:44.837230 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 865/1713] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:11:44 2022] DELETE /compute/v2.1/flavors/2cd11cb4-6333-43ab-a095-d4301a490bf8 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:11:44.994191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e0c4044d-96e1-4413-9fe1-f1ba8ea9ee6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:44.995003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e0c4044d-96e1-4413-9fe1-f1ba8ea9ee6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:45.020660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0c4044d-96e1-4413-9fe1-f1ba8ea9ee6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:45.021179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0c4044d-96e1-4413-9fe1-f1ba8ea9ee6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:45.021761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0c4044d-96e1-4413-9fe1-f1ba8ea9ee6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:45.022463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0c4044d-96e1-4413-9fe1-f1ba8ea9ee6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:45.022823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0c4044d-96e1-4413-9fe1-f1ba8ea9ee6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:45.023250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0c4044d-96e1-4413-9fe1-f1ba8ea9ee6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:45.291691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=11 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:45.336218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3120bbad-939e-4b4a-b77e-ed6a382a39a9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:45.355030 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3120bbad-939e-4b4a-b77e-ed6a382a39a9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1211 microversion: 2.1 time: 0.634475 Oct 04 21:11:45.358163 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 849/1714] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:44 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1211 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:45.370708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3ea6ec70-8f84-4801-bf24-4631822786d5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f579450cb80>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:45.497673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e0c4044d-96e1-4413-9fe1-f1ba8ea9ee6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:45.517456 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e0c4044d-96e1-4413-9fe1-f1ba8ea9ee6d tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1469 microversion: 2.1 time: 0.521657 Oct 04 21:11:45.523163 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 866/1715] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:44 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1469 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:45.540183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9a8d77a-2519-41fc-bce5-a476b3365185 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-444183652", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:45.611018 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3ea6ec70-8f84-4801-bf24-4631822786d5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b" status: 200 len: 1413 microversion: 2.1 time: 0.250199 Oct 04 21:11:45.613279 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 850/1716] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:11:45 2022] GET /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b => generated 1413 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:46.300970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-a3747318-bbeb-4dd8-8d83-bc38754be57d req-383c8756-5449-474f-85bd-a060d7c627a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2480cf36-216a-4565-a5b3-2430424a7a6e", "name": "network-vif-deleted", "tag": "91abea23-f356-47a5-8b1c-3915d0031ec2"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:46.350049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a3747318-bbeb-4dd8-8d83-bc38754be57d req-383c8756-5449-474f-85bd-a060d7c627a6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:46.350049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a3747318-bbeb-4dd8-8d83-bc38754be57d req-383c8756-5449-474f-85bd-a060d7c627a6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:46.350049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a3747318-bbeb-4dd8-8d83-bc38754be57d req-383c8756-5449-474f-85bd-a060d7c627a6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:46.373077 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-a3747318-bbeb-4dd8-8d83-bc38754be57d req-383c8756-5449-474f-85bd-a060d7c627a6 service nova] Creating event network-vif-deleted:91abea23-f356-47a5-8b1c-3915d0031ec2 for instance 2480cf36-216a-4565-a5b3-2430424a7a6e on n-h1-860282-1 Oct 04 21:11:46.389294 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-a3747318-bbeb-4dd8-8d83-bc38754be57d req-383c8756-5449-474f-85bd-a060d7c627a6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093360 Oct 04 21:11:46.391146 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 851/1717] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:11:46.406659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-79f494c3-2bd9-4acf-80c9-c5ffa002c525 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:46.406659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-79f494c3-2bd9-4acf-80c9-c5ffa002c525 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:46.425586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79f494c3-2bd9-4acf-80c9-c5ffa002c525 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:46.427848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79f494c3-2bd9-4acf-80c9-c5ffa002c525 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:46.430515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79f494c3-2bd9-4acf-80c9-c5ffa002c525 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:46.437350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79f494c3-2bd9-4acf-80c9-c5ffa002c525 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:46.438576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79f494c3-2bd9-4acf-80c9-c5ffa002c525 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:46.439349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79f494c3-2bd9-4acf-80c9-c5ffa002c525 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:46.666310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-79f494c3-2bd9-4acf-80c9-c5ffa002c525 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:46.675921 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-79f494c3-2bd9-4acf-80c9-c5ffa002c525 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1211 microversion: 2.1 time: 0.280983 Oct 04 21:11:46.692693 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 852/1718] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:46 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1211 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:46.708824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e755f4fe-1251-42ce-87f8-6529ea5114b9 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:46.710808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e755f4fe-1251-42ce-87f8-6529ea5114b9 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:46.726076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e755f4fe-1251-42ce-87f8-6529ea5114b9 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:46.726595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e755f4fe-1251-42ce-87f8-6529ea5114b9 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:46.727095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e755f4fe-1251-42ce-87f8-6529ea5114b9 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:46.731454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e755f4fe-1251-42ce-87f8-6529ea5114b9 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:46.731454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e755f4fe-1251-42ce-87f8-6529ea5114b9 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:46.731454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e755f4fe-1251-42ce-87f8-6529ea5114b9 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:46.922474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e755f4fe-1251-42ce-87f8-6529ea5114b9 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5320f1606bbc49d693ae96f7b7ac516a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa2f4ca02ad74730963245d9e018a386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:46.943161 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e755f4fe-1251-42ce-87f8-6529ea5114b9 tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 200 len: 1298 microversion: 2.1 time: 0.241222 Oct 04 21:11:46.945204 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 853/1719] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:46 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 1298 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:46.948637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:46.955388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f09e10fc-ace0-4768-84c9-6ed99a193328 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f5794563790>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:55.505662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=48 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:55.593072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=32 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:56.718876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:56.927359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:04.475080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-d9a8d77a-2519-41fc-bce5-a476b3365185 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:12:04.487173 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f09e10fc-ace0-4768-84c9-6ed99a193328 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b" status: 200 len: 1413 microversion: 2.1 time: 17.540245 Oct 04 21:12:04.500109 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 854/1720] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:11:46 2022] GET /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b => generated 1413 bytes in 17554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:04.519971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8f022e91-54e5-43f3-b5cd-2ec3d03cf5f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:04.519971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8f022e91-54e5-43f3-b5cd-2ec3d03cf5f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:04.524319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f022e91-54e5-43f3-b5cd-2ec3d03cf5f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:04.524928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f022e91-54e5-43f3-b5cd-2ec3d03cf5f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:04.525854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f022e91-54e5-43f3-b5cd-2ec3d03cf5f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:04.526945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f022e91-54e5-43f3-b5cd-2ec3d03cf5f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:04.527495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f022e91-54e5-43f3-b5cd-2ec3d03cf5f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:04.528627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f022e91-54e5-43f3-b5cd-2ec3d03cf5f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:04.938026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-d9a8d77a-2519-41fc-bce5-a476b3365185 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:12:04.939690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-d9a8d77a-2519-41fc-bce5-a476b3365185 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:12:04.940427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-d9a8d77a-2519-41fc-bce5-a476b3365185 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:12:04.941091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-d9a8d77a-2519-41fc-bce5-a476b3365185 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:12:04.941828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-d9a8d77a-2519-41fc-bce5-a476b3365185 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:12:04.961873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9a8d77a-2519-41fc-bce5-a476b3365185 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:04.962725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9a8d77a-2519-41fc-bce5-a476b3365185 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:04.964226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9a8d77a-2519-41fc-bce5-a476b3365185 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:04.965814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9a8d77a-2519-41fc-bce5-a476b3365185 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:04.966544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9a8d77a-2519-41fc-bce5-a476b3365185 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:04.967781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9a8d77a-2519-41fc-bce5-a476b3365185 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:04.984173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8f022e91-54e5-43f3-b5cd-2ec3d03cf5f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:04.994058 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8f022e91-54e5-43f3-b5cd-2ec3d03cf5f9 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1199 microversion: 2.1 time: 0.490481 Oct 04 21:12:05.001335 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 855/1721] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:04 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1199 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:05.006536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2ab436bc-2b11-4ebe-be66-c4521cc61bcf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:05.010586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-d9a8d77a-2519-41fc-bce5-a476b3365185 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Getting quotas for project e11e3d4d14b240a3b934701459ada871. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:12:05.013485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2ab436bc-2b11-4ebe-be66-c4521cc61bcf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] [instance: 2480cf36-216a-4565-a5b3-2430424a7a6e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:05.023662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-d9a8d77a-2519-41fc-bce5-a476b3365185 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Getting quotas for user 150625a9472d43e0b0509ef044c58d34 and project e11e3d4d14b240a3b934701459ada871. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:12:05.025748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ab436bc-2b11-4ebe-be66-c4521cc61bcf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:05.028185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ab436bc-2b11-4ebe-be66-c4521cc61bcf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:05.030144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ab436bc-2b11-4ebe-be66-c4521cc61bcf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:05.031166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ab436bc-2b11-4ebe-be66-c4521cc61bcf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:05.034742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ab436bc-2b11-4ebe-be66-c4521cc61bcf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:05.035321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ab436bc-2b11-4ebe-be66-c4521cc61bcf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:05.056627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d9a8d77a-2519-41fc-bce5-a476b3365185 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:12:05.059829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d9a8d77a-2519-41fc-bce5-a476b3365185 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:12:05.062123 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-2ab436bc-2b11-4ebe-be66-c4521cc61bcf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] HTTP exception thrown: Instance 2480cf36-216a-4565-a5b3-2430424a7a6e could not be found. Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2ab436bc-2b11-4ebe-be66-c4521cc61bcf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Request method failure captured: Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e HTTP/1.1 Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKD0xmS47Z_zq55vtUDgFpaHSkNSbiA2KshZNGw3XdxNTV6T9FHin-vydgPFNrWJnTcZ7jbWTGSV3E5_EgZUHm3dxdLE1OsN4AVFl-QwD-kOlADHO5MXUU81bBiPID3dau_a5djHY1r8ytA3IZaEk1q--_PyHBSrNgM3kY1P7-c3GN4 Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: aa2f4ca02ad74730963245d9e018a386 Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersAdminTestJSON-1028141702 Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aa2f4ca02ad74730963245d9e018a386"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aa2f4ca02ad74730963245d9e018a386"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aa2f4ca02ad74730963245d9e018a386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aa2f4ca02ad74730963245d9e018a386"}]}] Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersAdminTestJSON-1028141702 Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: aa2f4ca02ad74730963245d9e018a386 Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersAdminTestJSON-1028141702 Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersAdminTestJSON-1028141702-project Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 5320f1606bbc49d693ae96f7b7ac516a Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersAdminTestJSON-1028141702-project Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 2480cf36-216a-4565-a5b3-2430424a7a6e could not be found. Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '2480cf36-216a-4565-a5b3-2430424a7a6e'} Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2480cf36-216a-4565-a5b3-2430424a7a6e could not be found. Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2480cf36-216a-4565-a5b3-2430424a7a6e could not be found. Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:05.079430 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:12:05.084895 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:05.084895 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:05.084895 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:05.084895 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:12:05.084895 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:12:05.084895 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2480cf36-216a-4565-a5b3-2430424a7a6e could not be found. Oct 04 21:12:05.084895 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:12:05.084895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2ab436bc-2b11-4ebe-be66-c4521cc61bcf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] Returning 404 to user: Instance 2480cf36-216a-4565-a5b3-2430424a7a6e could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:12:05.087134 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2ab436bc-2b11-4ebe-be66-c4521cc61bcf tempest-ServersAdminTestJSON-1028141702 tempest-ServersAdminTestJSON-1028141702-project] 10.222.0.30 "GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e" status: 404 len: 111 microversion: 2.1 time: 0.082625 Oct 04 21:12:05.087816 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 856/1722] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:05 2022] GET /compute/v2.1/servers/2480cf36-216a-4565-a5b3-2430424a7a6e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:12:05.093466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-f7b8f231-19e6-4422-843f-01d31d95fa31 req-5f70b357-5937-4e35-b408-9ea16a670ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2cb6e2-2e03-406a-96ae-8be64d9af891", "name": "network-vif-plugged", "status": "completed", "tag": "276b608c-4c83-4365-9c25-8af46d2dd192"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:05.125930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f7b8f231-19e6-4422-843f-01d31d95fa31 req-5f70b357-5937-4e35-b408-9ea16a670ee5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:05.126676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f7b8f231-19e6-4422-843f-01d31d95fa31 req-5f70b357-5937-4e35-b408-9ea16a670ee5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:05.127207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f7b8f231-19e6-4422-843f-01d31d95fa31 req-5f70b357-5937-4e35-b408-9ea16a670ee5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:05.142115 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-f7b8f231-19e6-4422-843f-01d31d95fa31 req-5f70b357-5937-4e35-b408-9ea16a670ee5 service nova] Creating event network-vif-plugged:276b608c-4c83-4365-9c25-8af46d2dd192 for instance fd2cb6e2-2e03-406a-96ae-8be64d9af891 on n-h2-860282-1 Oct 04 21:12:05.148821 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-f7b8f231-19e6-4422-843f-01d31d95fa31 req-5f70b357-5937-4e35-b408-9ea16a670ee5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058591 Oct 04 21:12:05.148821 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 857/1723] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:05.314993 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d9a8d77a-2519-41fc-bce5-a476b3365185 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 19.769023 Oct 04 21:12:05.339400 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 867/1724] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:11:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 19815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:12:05.486589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4a1f1d01-9ea3-476b-a38f-b289cfcaa064 tempest-AZV2TestJSON-1972298307 tempest-AZV2TestJSON-1972298307-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:05.488704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a1f1d01-9ea3-476b-a38f-b289cfcaa064 tempest-AZV2TestJSON-1972298307 tempest-AZV2TestJSON-1972298307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:05.489886 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a1f1d01-9ea3-476b-a38f-b289cfcaa064 tempest-AZV2TestJSON-1972298307 tempest-AZV2TestJSON-1972298307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:05.497096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a1f1d01-9ea3-476b-a38f-b289cfcaa064 tempest-AZV2TestJSON-1972298307 tempest-AZV2TestJSON-1972298307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:05.497096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a1f1d01-9ea3-476b-a38f-b289cfcaa064 tempest-AZV2TestJSON-1972298307 tempest-AZV2TestJSON-1972298307-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:05.497096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a1f1d01-9ea3-476b-a38f-b289cfcaa064 tempest-AZV2TestJSON-1972298307 tempest-AZV2TestJSON-1972298307-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:05.497096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a1f1d01-9ea3-476b-a38f-b289cfcaa064 tempest-AZV2TestJSON-1972298307 tempest-AZV2TestJSON-1972298307-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:05.615430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7e7a7f01-3184-47c2-ab3a-562d515fdc1b tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1635647461", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "746d3f0e-2b04-42bd-b0a0-f66afb9de765"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:05.621025 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4a1f1d01-9ea3-476b-a38f-b289cfcaa064 tempest-AZV2TestJSON-1972298307 tempest-AZV2TestJSON-1972298307-project] 10.222.0.30 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.466510 Oct 04 21:12:05.621025 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 858/1725] 10.222.0.30 () {58 vars in 1164 bytes} [Tue Oct 4 21:12:05 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:12:05.755486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-7e7a7f01-3184-47c2-ab3a-562d515fdc1b tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] validate_networks() for [('746d3f0e-2b04-42bd-b0a0-f66afb9de765', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:12:05.986315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d0e8a64a-4e94-440e-9086-fad5d455fdce tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] Action: 'create', calling method: .version_select at 0x7f57908bd280>, body: {"pool": null} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:06.949413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7e7a7f01-3184-47c2-ab3a-562d515fdc1b tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:12:06.950112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7e7a7f01-3184-47c2-ab3a-562d515fdc1b tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:12:06.950695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7e7a7f01-3184-47c2-ab3a-562d515fdc1b tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:12:06.951123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7e7a7f01-3184-47c2-ab3a-562d515fdc1b tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:12:06.951896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7e7a7f01-3184-47c2-ab3a-562d515fdc1b tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:12:06.990823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e7a7f01-3184-47c2-ab3a-562d515fdc1b tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:06.992046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e7a7f01-3184-47c2-ab3a-562d515fdc1b tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:06.994609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e7a7f01-3184-47c2-ab3a-562d515fdc1b tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:06.996196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e7a7f01-3184-47c2-ab3a-562d515fdc1b tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:06.997765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e7a7f01-3184-47c2-ab3a-562d515fdc1b tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:06.999686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e7a7f01-3184-47c2-ab3a-562d515fdc1b tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:07.067816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7e7a7f01-3184-47c2-ab3a-562d515fdc1b tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Getting quotas for project b9adbb13ad5d4747be2d0ceb588255ab. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:12:07.083428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7e7a7f01-3184-47c2-ab3a-562d515fdc1b tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Getting quotas for user 64760b4bb6a54c048008aa00f4ecd163 and project b9adbb13ad5d4747be2d0ceb588255ab. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:12:07.098936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7e7a7f01-3184-47c2-ab3a-562d515fdc1b tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:12:07.101851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7e7a7f01-3184-47c2-ab3a-562d515fdc1b tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] [instance: c435602c-12c6-4356-8fb7-5883305ea5f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:12:07.422391 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7e7a7f01-3184-47c2-ab3a-562d515fdc1b tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.067119 Oct 04 21:12:07.435982 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 868/1726] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:12:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:12:07.463718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-14682e36-5fc4-4897-91cd-c85b5cbd2b87 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:07.468731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-14682e36-5fc4-4897-91cd-c85b5cbd2b87 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:07.502701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14682e36-5fc4-4897-91cd-c85b5cbd2b87 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:07.503747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14682e36-5fc4-4897-91cd-c85b5cbd2b87 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:07.506246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14682e36-5fc4-4897-91cd-c85b5cbd2b87 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:07.507356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14682e36-5fc4-4897-91cd-c85b5cbd2b87 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:07.508162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14682e36-5fc4-4897-91cd-c85b5cbd2b87 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:07.521554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14682e36-5fc4-4897-91cd-c85b5cbd2b87 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:07.721626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-14682e36-5fc4-4897-91cd-c85b5cbd2b87 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:07.738163 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-14682e36-5fc4-4897-91cd-c85b5cbd2b87 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1216 microversion: 2.1 time: 0.302152 Oct 04 21:12:07.738770 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 869/1727] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:07 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1216 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:07.744744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4b591531-6d6a-462a-88d5-94555f37158b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f5794540310>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:07.883364 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4b591531-6d6a-462a-88d5-94555f37158b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b" status: 200 len: 1422 microversion: 2.1 time: 0.143513 Oct 04 21:12:07.883940 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 870/1728] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:12:07 2022] GET /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b => generated 1422 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:07.889607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b811dc75-92e9-4578-a248-5e7e4216afd3 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:07.890231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b811dc75-92e9-4578-a248-5e7e4216afd3 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:07.901485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b811dc75-92e9-4578-a248-5e7e4216afd3 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:07.902187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b811dc75-92e9-4578-a248-5e7e4216afd3 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:07.902879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b811dc75-92e9-4578-a248-5e7e4216afd3 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:07.903882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b811dc75-92e9-4578-a248-5e7e4216afd3 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:07.904649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b811dc75-92e9-4578-a248-5e7e4216afd3 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:07.905245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b811dc75-92e9-4578-a248-5e7e4216afd3 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:08.245396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b811dc75-92e9-4578-a248-5e7e4216afd3 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:08.254287 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b811dc75-92e9-4578-a248-5e7e4216afd3 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1199 microversion: 2.1 time: 0.369304 Oct 04 21:12:08.255477 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 871/1729] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:07 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1199 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:08.260125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-9fb6828d-b4a3-4c91-87bc-4b3e2a6255f1 req-53e56f9d-6af3-416a-b8ff-5f75db6b2bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a7d656-c2a8-46fa-88dc-6c6cb1919c3b", "name": "network-vif-plugged", "status": "completed", "tag": "0f85098b-592d-4f47-9950-f46b2b886584"}, {"server_uuid": "95674198-fb96-434e-82bf-f3b189599f0e", "name": "network-vif-plugged", "status": "completed", "tag": "9e441d3d-b8e8-4963-9f5c-ac245f115ac5"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:08.314808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9fb6828d-b4a3-4c91-87bc-4b3e2a6255f1 req-53e56f9d-6af3-416a-b8ff-5f75db6b2bd7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:08.315117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9fb6828d-b4a3-4c91-87bc-4b3e2a6255f1 req-53e56f9d-6af3-416a-b8ff-5f75db6b2bd7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:08.321141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9fb6828d-b4a3-4c91-87bc-4b3e2a6255f1 req-53e56f9d-6af3-416a-b8ff-5f75db6b2bd7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:08.352669 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-9fb6828d-b4a3-4c91-87bc-4b3e2a6255f1 req-53e56f9d-6af3-416a-b8ff-5f75db6b2bd7 service nova] Creating event network-vif-plugged:0f85098b-592d-4f47-9950-f46b2b886584 for instance 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b on n-h2-860282-1 Oct 04 21:12:08.353194 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-9fb6828d-b4a3-4c91-87bc-4b3e2a6255f1 req-53e56f9d-6af3-416a-b8ff-5f75db6b2bd7 service nova] Creating event network-vif-plugged:9e441d3d-b8e8-4963-9f5c-ac245f115ac5 for instance 95674198-fb96-434e-82bf-f3b189599f0e on n-h1-860282-1 Oct 04 21:12:08.382065 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-9fb6828d-b4a3-4c91-87bc-4b3e2a6255f1 req-53e56f9d-6af3-416a-b8ff-5f75db6b2bd7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.125104 Oct 04 21:12:08.385739 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 872/1730] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:08.421693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b94e7b77-47a5-4585-975f-142651c81894 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:08.425750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b94e7b77-47a5-4585-975f-142651c81894 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] [instance: c435602c-12c6-4356-8fb7-5883305ea5f0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:08.684694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b94e7b77-47a5-4585-975f-142651c81894 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64760b4bb6a54c048008aa00f4ecd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9adbb13ad5d4747be2d0ceb588255ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:08.712413 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b94e7b77-47a5-4585-975f-142651c81894 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] 10.222.0.30 "GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0" status: 200 len: 1225 microversion: 2.1 time: 0.322379 Oct 04 21:12:08.727300 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 873/1731] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:08 2022] GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0 => generated 1225 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:08.744875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3565774d-4ebd-492e-b521-f4740a18b249 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f5794563670>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:08.815456 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3565774d-4ebd-492e-b521-f4740a18b249 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b" status: 200 len: 1422 microversion: 2.1 time: 0.086785 Oct 04 21:12:08.816236 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 874/1732] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:12:08 2022] GET /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b => generated 1422 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:08.838389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dfd7803c-8701-472d-b4c3-d32f0bbac6ec tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:08.838389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dfd7803c-8701-472d-b4c3-d32f0bbac6ec tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:08.865962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd7803c-8701-472d-b4c3-d32f0bbac6ec tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:08.865962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd7803c-8701-472d-b4c3-d32f0bbac6ec tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:08.865962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd7803c-8701-472d-b4c3-d32f0bbac6ec tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:08.865962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd7803c-8701-472d-b4c3-d32f0bbac6ec tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:08.865962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd7803c-8701-472d-b4c3-d32f0bbac6ec tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:08.865962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd7803c-8701-472d-b4c3-d32f0bbac6ec tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:08.943475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dfd7803c-8701-472d-b4c3-d32f0bbac6ec tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:08.951826 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dfd7803c-8701-472d-b4c3-d32f0bbac6ec tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1264 microversion: 2.1 time: 0.133809 Oct 04 21:12:08.952406 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 875/1733] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:08 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1264 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:08.957040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9367d058-363b-46fd-a80a-5bfc62062b54 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f57945a7af0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:09.632792 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d0e8a64a-4e94-440e-9086-fad5d455fdce tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.014346 Oct 04 21:12:09.634463 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 859/1734] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Oct 4 21:12:05 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:09.664642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-14d51e84-5d22-4b50-917a-4b0632e24ccb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:09.667213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-14d51e84-5d22-4b50-917a-4b0632e24ccb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:09.701793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14d51e84-5d22-4b50-917a-4b0632e24ccb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:09.702573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14d51e84-5d22-4b50-917a-4b0632e24ccb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:09.703031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14d51e84-5d22-4b50-917a-4b0632e24ccb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:09.705776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14d51e84-5d22-4b50-917a-4b0632e24ccb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:09.706264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14d51e84-5d22-4b50-917a-4b0632e24ccb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:09.706709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14d51e84-5d22-4b50-917a-4b0632e24ccb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:10.076860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-14d51e84-5d22-4b50-917a-4b0632e24ccb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:10.086011 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-14d51e84-5d22-4b50-917a-4b0632e24ccb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1199 microversion: 2.1 time: 0.450247 Oct 04 21:12:10.089762 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 860/1735] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:09 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1199 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:10.105838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a3bc47a4-5753-45f4-a19a-44869471c983 tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] Calling method '.version_select at 0x7f579450c430>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:10.390266 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a3bc47a4-5753-45f4-a19a-44869471c983 tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/00033723-58a2-4405-a509-0acdc2f242e6" status: 200 len: 141 microversion: 2.1 time: 0.296077 Oct 04 21:12:10.390893 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 861/1736] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Oct 4 21:12:10 2022] GET /compute/v2.1/os-floating-ips/00033723-58a2-4405-a509-0acdc2f242e6 => generated 141 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:10.396231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0a155c2d-32a7-4055-9211-e6661dd810cc tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:10.396861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0a155c2d-32a7-4055-9211-e6661dd810cc tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] [instance: c435602c-12c6-4356-8fb7-5883305ea5f0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:10.403897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a155c2d-32a7-4055-9211-e6661dd810cc tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:10.404423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a155c2d-32a7-4055-9211-e6661dd810cc tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:10.404879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a155c2d-32a7-4055-9211-e6661dd810cc tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:10.405630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a155c2d-32a7-4055-9211-e6661dd810cc tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:10.406283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a155c2d-32a7-4055-9211-e6661dd810cc tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:10.406716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a155c2d-32a7-4055-9211-e6661dd810cc tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:10.601393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0a155c2d-32a7-4055-9211-e6661dd810cc tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64760b4bb6a54c048008aa00f4ecd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9adbb13ad5d4747be2d0ceb588255ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:10.617440 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0a155c2d-32a7-4055-9211-e6661dd810cc tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] 10.222.0.30 "GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0" status: 200 len: 1277 microversion: 2.1 time: 0.225202 Oct 04 21:12:10.625904 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 862/1737] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:10 2022] GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0 => generated 1277 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:10.632934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b0744aa9-871c-4c76-bf7f-911d53c213bf tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:10.636500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b0744aa9-871c-4c76-bf7f-911d53c213bf tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:10.649083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b0744aa9-871c-4c76-bf7f-911d53c213bf tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:10.651487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b0744aa9-871c-4c76-bf7f-911d53c213bf tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:10.655073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b0744aa9-871c-4c76-bf7f-911d53c213bf tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:10.660424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b0744aa9-871c-4c76-bf7f-911d53c213bf tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:10.661379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b0744aa9-871c-4c76-bf7f-911d53c213bf tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:10.662410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b0744aa9-871c-4c76-bf7f-911d53c213bf tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:10.815956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b0744aa9-871c-4c76-bf7f-911d53c213bf tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:10.831196 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b0744aa9-871c-4c76-bf7f-911d53c213bf tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1270 microversion: 2.1 time: 0.197120 Oct 04 21:12:10.832574 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 863/1738] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:10 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1270 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:10.849331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-645476cb-33ea-4429-bf46-acb65a851ac6 tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] Calling method '.version_select at 0x7f5794563160>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:10.982774 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9367d058-363b-46fd-a80a-5bfc62062b54 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "DELETE /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b" status: 204 len: 0 microversion: 2.1 time: 2.029277 Oct 04 21:12:10.983665 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 876/1739] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:08 2022] DELETE /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b => generated 0 bytes in 2030 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:12:10.991692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-95535fc0-c077-4c9e-a870-07facda6c3fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:10.992202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-95535fc0-c077-4c9e-a870-07facda6c3fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:11.018924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95535fc0-c077-4c9e-a870-07facda6c3fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:11.018924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95535fc0-c077-4c9e-a870-07facda6c3fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:11.018924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95535fc0-c077-4c9e-a870-07facda6c3fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:11.018924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95535fc0-c077-4c9e-a870-07facda6c3fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:11.018924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95535fc0-c077-4c9e-a870-07facda6c3fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:11.018924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95535fc0-c077-4c9e-a870-07facda6c3fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:11.109842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-95535fc0-c077-4c9e-a870-07facda6c3fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:12:11.461744 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-645476cb-33ea-4429-bf46-acb65a851ac6 tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.627765 Oct 04 21:12:11.471143 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 864/1740] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Oct 4 21:12:10 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:11.476059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d378a144-17ac-4e47-a857-f0d5d146b536 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:11.476889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d378a144-17ac-4e47-a857-f0d5d146b536 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:11.497714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d378a144-17ac-4e47-a857-f0d5d146b536 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:11.498949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d378a144-17ac-4e47-a857-f0d5d146b536 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:11.500047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d378a144-17ac-4e47-a857-f0d5d146b536 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:11.501010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d378a144-17ac-4e47-a857-f0d5d146b536 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:11.501779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d378a144-17ac-4e47-a857-f0d5d146b536 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:11.502429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d378a144-17ac-4e47-a857-f0d5d146b536 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:12.026237 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-95535fc0-c077-4c9e-a870-07facda6c3fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 204 len: 0 microversion: 2.1 time: 1.037534 Oct 04 21:12:12.028864 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 877/1741] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:12:10 2022] DELETE /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 0 bytes in 1042 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:12:12.044897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d378a144-17ac-4e47-a857-f0d5d146b536 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:12.047264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-efda521b-dcad-432c-bafb-dfc09c469814 tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] Calling method '.version_select at 0x7f578bbf6280>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:12.070081 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d378a144-17ac-4e47-a857-f0d5d146b536 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1382 microversion: 2.1 time: 0.597541 Oct 04 21:12:12.070759 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 865/1742] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:11 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1382 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:12.098990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-604ca07e-ab8f-41f0-aeda-dc8cf87c5850 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:12.105358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-604ca07e-ab8f-41f0-aeda-dc8cf87c5850 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] [instance: c435602c-12c6-4356-8fb7-5883305ea5f0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:12.113200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-604ca07e-ab8f-41f0-aeda-dc8cf87c5850 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:12.113927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-604ca07e-ab8f-41f0-aeda-dc8cf87c5850 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:12.114802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-604ca07e-ab8f-41f0-aeda-dc8cf87c5850 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:12.117200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-604ca07e-ab8f-41f0-aeda-dc8cf87c5850 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:12.117945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-604ca07e-ab8f-41f0-aeda-dc8cf87c5850 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:12.121242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-604ca07e-ab8f-41f0-aeda-dc8cf87c5850 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:12.409260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-604ca07e-ab8f-41f0-aeda-dc8cf87c5850 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64760b4bb6a54c048008aa00f4ecd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9adbb13ad5d4747be2d0ceb588255ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:12.429931 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-604ca07e-ab8f-41f0-aeda-dc8cf87c5850 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] 10.222.0.30 "GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0" status: 200 len: 1283 microversion: 2.1 time: 0.347837 Oct 04 21:12:12.446473 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 866/1743] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:12 2022] GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0 => generated 1283 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:12.447125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-060dd061-9445-4f92-ba36-87a853a266ca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:12.447774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-060dd061-9445-4f92-ba36-87a853a266ca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:12.475398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-060dd061-9445-4f92-ba36-87a853a266ca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:12.475398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-060dd061-9445-4f92-ba36-87a853a266ca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:12.475768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-060dd061-9445-4f92-ba36-87a853a266ca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:12.477721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-060dd061-9445-4f92-ba36-87a853a266ca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:12.481214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-060dd061-9445-4f92-ba36-87a853a266ca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:12.482049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-060dd061-9445-4f92-ba36-87a853a266ca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:13.097141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-060dd061-9445-4f92-ba36-87a853a266ca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:13.105462 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-060dd061-9445-4f92-ba36-87a853a266ca tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1312 microversion: 2.1 time: 0.670511 Oct 04 21:12:13.107569 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 867/1744] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:12 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1312 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:13.125853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-19354934-b3bd-4c45-b48b-94ce57391869 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:13.126577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-19354934-b3bd-4c45-b48b-94ce57391869 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:13.132730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19354934-b3bd-4c45-b48b-94ce57391869 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:13.133514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19354934-b3bd-4c45-b48b-94ce57391869 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:13.134178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19354934-b3bd-4c45-b48b-94ce57391869 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:13.135249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19354934-b3bd-4c45-b48b-94ce57391869 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:13.142360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19354934-b3bd-4c45-b48b-94ce57391869 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:13.143060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19354934-b3bd-4c45-b48b-94ce57391869 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:13.975290 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-19354934-b3bd-4c45-b48b-94ce57391869 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1533 microversion: 2.1 time: 0.865136 Oct 04 21:12:13.989000 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 868/1745] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:13 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1533 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:14.000629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-557f698a-5975-4f68-be1f-a906a87a5061 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-557089766", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "355d2dfa-09cc-435f-842a-7fc0ed5ae634"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:14.094298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-557f698a-5975-4f68-be1f-a906a87a5061 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] validate_networks() for [('355d2dfa-09cc-435f-842a-7fc0ed5ae634', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:12:15.069098 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-efda521b-dcad-432c-bafb-dfc09c469814 tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/00033723-58a2-4405-a509-0acdc2f242e6" status: 202 len: 0 microversion: 2.1 time: 3.035532 Oct 04 21:12:15.070068 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 878/1746] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Oct 4 21:12:12 2022] DELETE /compute/v2.1/os-floating-ips/00033723-58a2-4405-a509-0acdc2f242e6 => generated 0 bytes in 3037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:12:15.077650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-9d1a3fc7-6172-4a44-b3ea-36464fdb83ff req-c405b1f1-9eb3-4844-8052-a045bd731446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2cb6e2-2e03-406a-96ae-8be64d9af891", "name": "network-vif-unplugged", "status": "completed", "tag": "276b608c-4c83-4365-9c25-8af46d2dd192"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:15.101031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9d1a3fc7-6172-4a44-b3ea-36464fdb83ff req-c405b1f1-9eb3-4844-8052-a045bd731446 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:15.101999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9d1a3fc7-6172-4a44-b3ea-36464fdb83ff req-c405b1f1-9eb3-4844-8052-a045bd731446 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:15.103066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9d1a3fc7-6172-4a44-b3ea-36464fdb83ff req-c405b1f1-9eb3-4844-8052-a045bd731446 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:15.119110 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-9d1a3fc7-6172-4a44-b3ea-36464fdb83ff req-c405b1f1-9eb3-4844-8052-a045bd731446 service nova] Creating event network-vif-unplugged:276b608c-4c83-4365-9c25-8af46d2dd192 for instance fd2cb6e2-2e03-406a-96ae-8be64d9af891 on n-h2-860282-1 Oct 04 21:12:15.126133 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-9d1a3fc7-6172-4a44-b3ea-36464fdb83ff req-c405b1f1-9eb3-4844-8052-a045bd731446 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053926 Oct 04 21:12:15.127436 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 879/1747] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:15.486202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a69e4717-1708-4cf6-bce7-0d17a4585345 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1409534361", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:15.520780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:15.583677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-a69e4717-1708-4cf6-bce7-0d17a4585345 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:12:16.267653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-557f698a-5975-4f68-be1f-a906a87a5061 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:12:16.268084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-557f698a-5975-4f68-be1f-a906a87a5061 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:12:16.268568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-557f698a-5975-4f68-be1f-a906a87a5061 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:12:16.268983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-557f698a-5975-4f68-be1f-a906a87a5061 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:12:16.269399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-557f698a-5975-4f68-be1f-a906a87a5061 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:12:16.302900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-557f698a-5975-4f68-be1f-a906a87a5061 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:16.305365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-557f698a-5975-4f68-be1f-a906a87a5061 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:16.306092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-557f698a-5975-4f68-be1f-a906a87a5061 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:16.309656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-557f698a-5975-4f68-be1f-a906a87a5061 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:16.310504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-557f698a-5975-4f68-be1f-a906a87a5061 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:16.311270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-557f698a-5975-4f68-be1f-a906a87a5061 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:16.317055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a69e4717-1708-4cf6-bce7-0d17a4585345 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:12:16.324136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a69e4717-1708-4cf6-bce7-0d17a4585345 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:12:16.328971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a69e4717-1708-4cf6-bce7-0d17a4585345 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:12:16.329673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a69e4717-1708-4cf6-bce7-0d17a4585345 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:12:16.331173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a69e4717-1708-4cf6-bce7-0d17a4585345 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:12:16.344919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-557f698a-5975-4f68-be1f-a906a87a5061 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Getting quotas for project 7462c68015654227a11892e2a2659ecb. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:12:16.351917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a69e4717-1708-4cf6-bce7-0d17a4585345 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:16.355564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-557f698a-5975-4f68-be1f-a906a87a5061 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Getting quotas for user c199a13dceec4ae9bd873529c864146e and project 7462c68015654227a11892e2a2659ecb. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:12:16.356847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a69e4717-1708-4cf6-bce7-0d17a4585345 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:16.358280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a69e4717-1708-4cf6-bce7-0d17a4585345 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:16.360068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a69e4717-1708-4cf6-bce7-0d17a4585345 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:16.361045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a69e4717-1708-4cf6-bce7-0d17a4585345 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:16.363323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a69e4717-1708-4cf6-bce7-0d17a4585345 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:16.380579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-557f698a-5975-4f68-be1f-a906a87a5061 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:12:16.384603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-557f698a-5975-4f68-be1f-a906a87a5061 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:12:16.410119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-a69e4717-1708-4cf6-bce7-0d17a4585345 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Getting quotas for project f439ca730404443ba4b48e7fb79b62ac. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:12:16.423318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-a69e4717-1708-4cf6-bce7-0d17a4585345 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Getting quotas for user 1d298c8e0c0a4186a15c745957c691fa and project f439ca730404443ba4b48e7fb79b62ac. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:12:16.438554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a69e4717-1708-4cf6-bce7-0d17a4585345 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:12:16.441535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a69e4717-1708-4cf6-bce7-0d17a4585345 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: 04b031f2-40e3-486e-9066-ff87fbffb8ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:12:16.579244 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a69e4717-1708-4cf6-bce7-0d17a4585345 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.449844 Oct 04 21:12:16.580574 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 880/1748] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:12:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:12:16.586921 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-557f698a-5975-4f68-be1f-a906a87a5061 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.596567 Oct 04 21:12:16.591486 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 869/1749] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:12:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:12:16.598111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c952bfa8-dc14-4fad-add7-97a50031ed4f tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:16.599915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c952bfa8-dc14-4fad-add7-97a50031ed4f tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] [instance: c435602c-12c6-4356-8fb7-5883305ea5f0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:16.604766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-24eb3715-32ae-4860-a15c-e73e68c1a1a2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:16.607354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-24eb3715-32ae-4860-a15c-e73e68c1a1a2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:16.620600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c952bfa8-dc14-4fad-add7-97a50031ed4f tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:16.623749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c952bfa8-dc14-4fad-add7-97a50031ed4f tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:16.626818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c952bfa8-dc14-4fad-add7-97a50031ed4f tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:16.626964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24eb3715-32ae-4860-a15c-e73e68c1a1a2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:16.627090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c952bfa8-dc14-4fad-add7-97a50031ed4f tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:16.627196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c952bfa8-dc14-4fad-add7-97a50031ed4f tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:16.627575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c952bfa8-dc14-4fad-add7-97a50031ed4f tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:16.627758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24eb3715-32ae-4860-a15c-e73e68c1a1a2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:16.628744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24eb3715-32ae-4860-a15c-e73e68c1a1a2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:16.630167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24eb3715-32ae-4860-a15c-e73e68c1a1a2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:16.630819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24eb3715-32ae-4860-a15c-e73e68c1a1a2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:16.636015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24eb3715-32ae-4860-a15c-e73e68c1a1a2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:17.014042 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-24eb3715-32ae-4860-a15c-e73e68c1a1a2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1533 microversion: 2.1 time: 0.420901 Oct 04 21:12:17.014635 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 870/1750] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:16 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1533 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:17.032731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c952bfa8-dc14-4fad-add7-97a50031ed4f tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64760b4bb6a54c048008aa00f4ecd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9adbb13ad5d4747be2d0ceb588255ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:17.032731 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c952bfa8-dc14-4fad-add7-97a50031ed4f tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] 10.222.0.30 "GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0" status: 200 len: 1325 microversion: 2.1 time: 0.449837 Oct 04 21:12:17.037904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1866ec21-c85f-478d-a979-5ab3bb79ca1d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:17.037904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1866ec21-c85f-478d-a979-5ab3bb79ca1d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:17.038090 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 881/1751] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:16 2022] GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0 => generated 1325 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:17.042137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-ec4b2df4-d8f8-4296-9e88-df2c1e74b55c req-41de2155-c4a1-4c57-9d9d-abccbc55195e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2cb6e2-2e03-406a-96ae-8be64d9af891", "name": "network-vif-deleted", "tag": "276b608c-4c83-4365-9c25-8af46d2dd192"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:17.053452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1866ec21-c85f-478d-a979-5ab3bb79ca1d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:17.054013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1866ec21-c85f-478d-a979-5ab3bb79ca1d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:17.054479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1866ec21-c85f-478d-a979-5ab3bb79ca1d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:17.055641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1866ec21-c85f-478d-a979-5ab3bb79ca1d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:17.056122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1866ec21-c85f-478d-a979-5ab3bb79ca1d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:17.056558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1866ec21-c85f-478d-a979-5ab3bb79ca1d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:17.072003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ec4b2df4-d8f8-4296-9e88-df2c1e74b55c req-41de2155-c4a1-4c57-9d9d-abccbc55195e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:17.072533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ec4b2df4-d8f8-4296-9e88-df2c1e74b55c req-41de2155-c4a1-4c57-9d9d-abccbc55195e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:17.073222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ec4b2df4-d8f8-4296-9e88-df2c1e74b55c req-41de2155-c4a1-4c57-9d9d-abccbc55195e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:17.097757 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-ec4b2df4-d8f8-4296-9e88-df2c1e74b55c req-41de2155-c4a1-4c57-9d9d-abccbc55195e service nova] Creating event network-vif-deleted:276b608c-4c83-4365-9c25-8af46d2dd192 for instance fd2cb6e2-2e03-406a-96ae-8be64d9af891 on n-h2-860282-1 Oct 04 21:12:17.110151 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-ec4b2df4-d8f8-4296-9e88-df2c1e74b55c req-41de2155-c4a1-4c57-9d9d-abccbc55195e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071431 Oct 04 21:12:17.120290 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 882/1752] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:17.127917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-89073175-5c0b-4647-834d-13d39acadd8d req-14e577d8-9271-4e19-be57-6386dc4ff8df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0dbeb11-0fb1-48ab-aa70-d33e03b8093d", "tag": "622d2354-1aa7-4c56-9968-1dc840e8b049"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:17.141946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-89073175-5c0b-4647-834d-13d39acadd8d req-14e577d8-9271-4e19-be57-6386dc4ff8df service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:17.142806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-89073175-5c0b-4647-834d-13d39acadd8d req-14e577d8-9271-4e19-be57-6386dc4ff8df service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:17.143460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-89073175-5c0b-4647-834d-13d39acadd8d req-14e577d8-9271-4e19-be57-6386dc4ff8df service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:17.156669 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-89073175-5c0b-4647-834d-13d39acadd8d req-14e577d8-9271-4e19-be57-6386dc4ff8df service nova] Creating event network-changed:622d2354-1aa7-4c56-9968-1dc840e8b049 for instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d on n-h2-860282-1 Oct 04 21:12:17.164868 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-89073175-5c0b-4647-834d-13d39acadd8d req-14e577d8-9271-4e19-be57-6386dc4ff8df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044835 Oct 04 21:12:17.168513 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 883/1753] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:17.177906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bd8257e9-da32-467d-b414-d79cf09d74e8 tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] Action: 'create', calling method: .version_select at 0x7f578bc2b940>, body: {"pool": null} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:17.465742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1866ec21-c85f-478d-a979-5ab3bb79ca1d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:17.468265 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1866ec21-c85f-478d-a979-5ab3bb79ca1d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1312 microversion: 2.1 time: 0.452413 Oct 04 21:12:17.472626 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 871/1754] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:17 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1312 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:17.478420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-72e38c79-3184-4188-8f7f-5e0298dc2193 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:17.483327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-72e38c79-3184-4188-8f7f-5e0298dc2193 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: 04b031f2-40e3-486e-9066-ff87fbffb8ec] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:17.684203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-72e38c79-3184-4188-8f7f-5e0298dc2193 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:17.689809 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-72e38c79-3184-4188-8f7f-5e0298dc2193 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec" status: 200 len: 1222 microversion: 2.1 time: 0.215665 Oct 04 21:12:17.690718 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 872/1755] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:17 2022] GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec => generated 1222 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:17.702866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b47df7d4-ec37-4df1-b025-a42b5b315cb0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:17.703787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b47df7d4-ec37-4df1-b025-a42b5b315cb0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:17.838740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b47df7d4-ec37-4df1-b025-a42b5b315cb0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:17.852678 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b47df7d4-ec37-4df1-b025-a42b5b315cb0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1207 microversion: 2.1 time: 0.159976 Oct 04 21:12:17.853363 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 873/1756] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:17 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1207 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:17.860225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ddd0321e-388d-46af-b368-d6769e5c879d tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:17.866165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ddd0321e-388d-46af-b368-d6769e5c879d tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:17.866923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ddd0321e-388d-46af-b368-d6769e5c879d tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:17.867622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ddd0321e-388d-46af-b368-d6769e5c879d tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:17.868586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ddd0321e-388d-46af-b368-d6769e5c879d tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:17.869217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ddd0321e-388d-46af-b368-d6769e5c879d tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:17.869856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ddd0321e-388d-46af-b368-d6769e5c879d tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:17.903843 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ddd0321e-388d-46af-b368-d6769e5c879d tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048856 Oct 04 21:12:17.904795 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 874/1757] 10.222.0.30 () {58 vars in 1176 bytes} [Tue Oct 4 21:12:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:17.941779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6e73c5b0-287a-4ace-8d2d-97ff5644bcdc tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860282-1", "block_migration": false, "disk_over_commit": false}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:17.944498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6e73c5b0-287a-4ace-8d2d-97ff5644bcdc tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:17.952996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e73c5b0-287a-4ace-8d2d-97ff5644bcdc tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:17.953767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e73c5b0-287a-4ace-8d2d-97ff5644bcdc tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:17.954543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e73c5b0-287a-4ace-8d2d-97ff5644bcdc tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:17.955451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e73c5b0-287a-4ace-8d2d-97ff5644bcdc tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:17.957708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e73c5b0-287a-4ace-8d2d-97ff5644bcdc tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:17.966785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e73c5b0-287a-4ace-8d2d-97ff5644bcdc tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:18.004037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-6e73c5b0-287a-4ace-8d2d-97ff5644bcdc tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lazy-loading 'flavor' on Instance uuid 95674198-fb96-434e-82bf-f3b189599f0e {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:12:18.035268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6e73c5b0-287a-4ace-8d2d-97ff5644bcdc tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Going to try to live migrate instance to n-h2-860282-1 {{(pid=122757) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:12:20.772428 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bd8257e9-da32-467d-b414-d79cf09d74e8 tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.602328 Oct 04 21:12:20.773098 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 884/1758] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Oct 4 21:12:17 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:20.786688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5d7ac3bb-b60a-4f6b-b568-cd4b8d47b666 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:20.788053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5d7ac3bb-b60a-4f6b-b568-cd4b8d47b666 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] [instance: c435602c-12c6-4356-8fb7-5883305ea5f0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:20.797364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d7ac3bb-b60a-4f6b-b568-cd4b8d47b666 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:20.798031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d7ac3bb-b60a-4f6b-b568-cd4b8d47b666 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:20.798841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d7ac3bb-b60a-4f6b-b568-cd4b8d47b666 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:20.800244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d7ac3bb-b60a-4f6b-b568-cd4b8d47b666 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:20.800736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d7ac3bb-b60a-4f6b-b568-cd4b8d47b666 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:20.801329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d7ac3bb-b60a-4f6b-b568-cd4b8d47b666 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:20.988774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5d7ac3bb-b60a-4f6b-b568-cd4b8d47b666 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64760b4bb6a54c048008aa00f4ecd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9adbb13ad5d4747be2d0ceb588255ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:21.000723 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5d7ac3bb-b60a-4f6b-b568-cd4b8d47b666 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] 10.222.0.30 "GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0" status: 200 len: 1325 microversion: 2.1 time: 0.217955 Oct 04 21:12:21.001543 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 885/1759] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:20 2022] GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0 => generated 1325 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:21.006762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-80dc8166-71d1-4abe-a4fa-b0991d29bb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:21.007480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-80dc8166-71d1-4abe-a4fa-b0991d29bb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:21.015304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80dc8166-71d1-4abe-a4fa-b0991d29bb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:21.016193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80dc8166-71d1-4abe-a4fa-b0991d29bb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:21.016794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80dc8166-71d1-4abe-a4fa-b0991d29bb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:21.017606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80dc8166-71d1-4abe-a4fa-b0991d29bb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:21.018667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80dc8166-71d1-4abe-a4fa-b0991d29bb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:21.019357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80dc8166-71d1-4abe-a4fa-b0991d29bb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:21.196989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-80dc8166-71d1-4abe-a4fa-b0991d29bb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:21.209377 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-80dc8166-71d1-4abe-a4fa-b0991d29bb03 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1312 microversion: 2.1 time: 0.205107 Oct 04 21:12:21.224733 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 886/1760] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:21 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1312 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:21.237076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4a69cec7-5499-4c38-8e8f-09513421e7e7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:21.237781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4a69cec7-5499-4c38-8e8f-09513421e7e7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: 04b031f2-40e3-486e-9066-ff87fbffb8ec] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:21.245221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a69cec7-5499-4c38-8e8f-09513421e7e7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:21.246165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a69cec7-5499-4c38-8e8f-09513421e7e7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:21.247032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a69cec7-5499-4c38-8e8f-09513421e7e7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:21.247784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a69cec7-5499-4c38-8e8f-09513421e7e7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:21.248995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a69cec7-5499-4c38-8e8f-09513421e7e7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:21.249750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a69cec7-5499-4c38-8e8f-09513421e7e7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:21.324284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4a69cec7-5499-4c38-8e8f-09513421e7e7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:21.345874 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4a69cec7-5499-4c38-8e8f-09513421e7e7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec" status: 200 len: 1282 microversion: 2.1 time: 0.106816 Oct 04 21:12:21.345874 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 887/1761] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:21 2022] GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec => generated 1282 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:21.427080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6f0c5027-9780-4990-a92a-dd2ab14df1ed tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-316243740", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "e6d9504a-37ea-465a-be81-21872418b789"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:21.509476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-6f0c5027-9780-4990-a92a-dd2ab14df1ed tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] validate_networks() for [('e6d9504a-37ea-465a-be81-21872418b789', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:12:22.291424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6f0c5027-9780-4990-a92a-dd2ab14df1ed tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:12:22.292072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6f0c5027-9780-4990-a92a-dd2ab14df1ed tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:12:22.292311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6f0c5027-9780-4990-a92a-dd2ab14df1ed tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:12:22.292805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6f0c5027-9780-4990-a92a-dd2ab14df1ed tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:12:22.297093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6f0c5027-9780-4990-a92a-dd2ab14df1ed tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:12:22.304441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f0c5027-9780-4990-a92a-dd2ab14df1ed tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:22.304939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f0c5027-9780-4990-a92a-dd2ab14df1ed tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:22.305378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f0c5027-9780-4990-a92a-dd2ab14df1ed tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:22.306231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f0c5027-9780-4990-a92a-dd2ab14df1ed tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:22.306691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f0c5027-9780-4990-a92a-dd2ab14df1ed tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:22.307116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f0c5027-9780-4990-a92a-dd2ab14df1ed tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:22.327288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-6f0c5027-9780-4990-a92a-dd2ab14df1ed tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Getting quotas for project f3919c90cb804d55b68b3d4d92141e84. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:12:22.333533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-6f0c5027-9780-4990-a92a-dd2ab14df1ed tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Getting quotas for user dc12643b5df642129dd351a2c8df9f70 and project f3919c90cb804d55b68b3d4d92141e84. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:12:22.349959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6f0c5027-9780-4990-a92a-dd2ab14df1ed tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:12:22.352721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6f0c5027-9780-4990-a92a-dd2ab14df1ed tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:12:22.495352 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6f0c5027-9780-4990-a92a-dd2ab14df1ed tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.136210 Oct 04 21:12:22.495352 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 888/1762] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:12:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:12:22.495352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ae047107-e5cd-46d3-b187-e4ffa8b1d25b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:22.495352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ae047107-e5cd-46d3-b187-e4ffa8b1d25b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:22.499522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae047107-e5cd-46d3-b187-e4ffa8b1d25b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:22.500022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae047107-e5cd-46d3-b187-e4ffa8b1d25b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:22.500462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae047107-e5cd-46d3-b187-e4ffa8b1d25b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:22.501165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae047107-e5cd-46d3-b187-e4ffa8b1d25b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:22.506980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae047107-e5cd-46d3-b187-e4ffa8b1d25b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:22.507459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae047107-e5cd-46d3-b187-e4ffa8b1d25b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:22.706599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ae047107-e5cd-46d3-b187-e4ffa8b1d25b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:22.719088 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ae047107-e5cd-46d3-b187-e4ffa8b1d25b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1307 microversion: 2.1 time: 0.231703 Oct 04 21:12:22.721258 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 889/1763] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:22 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1307 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:22.732686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-721038e1-4ec5-41cf-9043-db32ab292783 req-ad9aeccf-51e7-4cf5-a4b6-6fb7c29f9532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c435602c-12c6-4356-8fb7-5883305ea5f0", "tag": "65ccfa33-2e93-431f-b01b-e2f73b23dcea"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:22.750048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:22.760766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-721038e1-4ec5-41cf-9043-db32ab292783 req-ad9aeccf-51e7-4cf5-a4b6-6fb7c29f9532 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:22.762711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-721038e1-4ec5-41cf-9043-db32ab292783 req-ad9aeccf-51e7-4cf5-a4b6-6fb7c29f9532 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:22.763355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-721038e1-4ec5-41cf-9043-db32ab292783 req-ad9aeccf-51e7-4cf5-a4b6-6fb7c29f9532 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:22.781266 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-721038e1-4ec5-41cf-9043-db32ab292783 req-ad9aeccf-51e7-4cf5-a4b6-6fb7c29f9532 service nova] Creating event network-changed:65ccfa33-2e93-431f-b01b-e2f73b23dcea for instance c435602c-12c6-4356-8fb7-5883305ea5f0 on n-h2-860282-1 Oct 04 21:12:22.806478 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-721038e1-4ec5-41cf-9043-db32ab292783 req-ad9aeccf-51e7-4cf5-a4b6-6fb7c29f9532 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078322 Oct 04 21:12:22.807698 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 890/1764] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:22.829827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3236a2a2-91bd-4a2b-88e2-625e0fc174a2 tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] Calling method '.version_select at 0x7f578bc5b5e0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:22.873879 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6e73c5b0-287a-4ace-8d2d-97ff5644bcdc tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e/action" status: 202 len: 0 microversion: 2.1 time: 4.938051 Oct 04 21:12:22.875192 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 875/1765] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:12:17 2022] POST /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e/action => generated 0 bytes in 4947 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:12:22.880837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e594a03c-24fc-4e5e-903f-e9252cf38d44 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-495856628", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "d8cfe5e7-54b8-4178-9c64-fdf6c3f1a916"}], "block_device_mapping_v2": [{"uuid": "e6cf6001-bbe8-4667-82f6-6d551559d011", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:23.027865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-e594a03c-24fc-4e5e-903f-e9252cf38d44 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] validate_networks() for [('d8cfe5e7-54b8-4178-9c64-fdf6c3f1a916', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:12:24.373237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e594a03c-24fc-4e5e-903f-e9252cf38d44 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:12:24.373976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e594a03c-24fc-4e5e-903f-e9252cf38d44 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:12:24.378488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e594a03c-24fc-4e5e-903f-e9252cf38d44 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:12:24.380196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e594a03c-24fc-4e5e-903f-e9252cf38d44 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:12:24.380797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e594a03c-24fc-4e5e-903f-e9252cf38d44 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:12:24.401997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e594a03c-24fc-4e5e-903f-e9252cf38d44 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:24.403712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e594a03c-24fc-4e5e-903f-e9252cf38d44 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:24.404386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e594a03c-24fc-4e5e-903f-e9252cf38d44 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:24.406987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e594a03c-24fc-4e5e-903f-e9252cf38d44 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:24.407924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e594a03c-24fc-4e5e-903f-e9252cf38d44 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:24.408619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e594a03c-24fc-4e5e-903f-e9252cf38d44 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:24.441577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-e594a03c-24fc-4e5e-903f-e9252cf38d44 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Getting quotas for project d06810bbad6e4914aa53b43ef390f52e. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:12:24.452369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-e594a03c-24fc-4e5e-903f-e9252cf38d44 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Getting quotas for user 95f0cc0f93b244cea8818c7bbdcfb90a and project d06810bbad6e4914aa53b43ef390f52e. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:12:24.533140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e594a03c-24fc-4e5e-903f-e9252cf38d44 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:12:24.537696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e594a03c-24fc-4e5e-903f-e9252cf38d44 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e6cf6001-bbe8-4667-82f6-6d551559d011',volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:12:25.012849 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3236a2a2-91bd-4a2b-88e2-625e0fc174a2 tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/a97991e4-47c5-4eb7-852a-c586712876c7" status: 202 len: 0 microversion: 2.1 time: 2.202386 Oct 04 21:12:25.016690 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 891/1766] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Oct 4 21:12:22 2022] DELETE /compute/v2.1/os-floating-ips/a97991e4-47c5-4eb7-852a-c586712876c7 => generated 0 bytes in 2205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:12:25.018597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-79e3baf3-6705-4072-a232-c47d0f3a5686 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:25.019368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-79e3baf3-6705-4072-a232-c47d0f3a5686 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] [instance: c435602c-12c6-4356-8fb7-5883305ea5f0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:25.026268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79e3baf3-6705-4072-a232-c47d0f3a5686 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.027066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79e3baf3-6705-4072-a232-c47d0f3a5686 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:25.027602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79e3baf3-6705-4072-a232-c47d0f3a5686 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:25.028508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79e3baf3-6705-4072-a232-c47d0f3a5686 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.028970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79e3baf3-6705-4072-a232-c47d0f3a5686 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:25.029407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79e3baf3-6705-4072-a232-c47d0f3a5686 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:25.182121 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e594a03c-24fc-4e5e-903f-e9252cf38d44 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.305567 Oct 04 21:12:25.190355 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 876/1767] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Oct 4 21:12:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2314 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:12:25.195687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b5af0f58-e844-45f2-8fd2-64aef3c15a29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:25.196439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b5af0f58-e844-45f2-8fd2-64aef3c15a29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:25.201586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-79e3baf3-6705-4072-a232-c47d0f3a5686 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64760b4bb6a54c048008aa00f4ecd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9adbb13ad5d4747be2d0ceb588255ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:25.203147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5af0f58-e844-45f2-8fd2-64aef3c15a29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.203903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5af0f58-e844-45f2-8fd2-64aef3c15a29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:25.210067 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-79e3baf3-6705-4072-a232-c47d0f3a5686 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] 10.222.0.30 "GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0" status: 200 len: 1325 microversion: 2.1 time: 0.195203 Oct 04 21:12:25.226390 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 892/1768] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:25 2022] GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0 => generated 1325 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:25.226390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4b426e09-0139-4542-9b40-6fcefd7c04c6 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:25.227894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5af0f58-e844-45f2-8fd2-64aef3c15a29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:25.228004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4b426e09-0139-4542-9b40-6fcefd7c04c6 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: 04b031f2-40e3-486e-9066-ff87fbffb8ec] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:25.228106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5af0f58-e844-45f2-8fd2-64aef3c15a29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.228106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5af0f58-e844-45f2-8fd2-64aef3c15a29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:25.228106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5af0f58-e844-45f2-8fd2-64aef3c15a29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:25.244722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b426e09-0139-4542-9b40-6fcefd7c04c6 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.245513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b426e09-0139-4542-9b40-6fcefd7c04c6 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:25.246246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b426e09-0139-4542-9b40-6fcefd7c04c6 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:25.247421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b426e09-0139-4542-9b40-6fcefd7c04c6 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.248051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b426e09-0139-4542-9b40-6fcefd7c04c6 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:25.248728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b426e09-0139-4542-9b40-6fcefd7c04c6 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:25.522960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b5af0f58-e844-45f2-8fd2-64aef3c15a29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:25.540052 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b5af0f58-e844-45f2-8fd2-64aef3c15a29 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1312 microversion: 2.1 time: 0.346950 Oct 04 21:12:25.544724 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 877/1769] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:25 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1312 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:25.557471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-4e517eb8-a027-4879-8e59-2f0c72b87614 req-fdc7b1ad-b69f-4ee0-97fd-a89ac9a8d827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0dbeb11-0fb1-48ab-aa70-d33e03b8093d", "name": "network-vif-plugged", "status": "completed", "tag": "622d2354-1aa7-4c56-9968-1dc840e8b049"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:25.568838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4e517eb8-a027-4879-8e59-2f0c72b87614 req-fdc7b1ad-b69f-4ee0-97fd-a89ac9a8d827 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.569653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4e517eb8-a027-4879-8e59-2f0c72b87614 req-fdc7b1ad-b69f-4ee0-97fd-a89ac9a8d827 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:25.570700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4e517eb8-a027-4879-8e59-2f0c72b87614 req-fdc7b1ad-b69f-4ee0-97fd-a89ac9a8d827 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:25.582525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4b426e09-0139-4542-9b40-6fcefd7c04c6 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:25.584898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:25.585958 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-4e517eb8-a027-4879-8e59-2f0c72b87614 req-fdc7b1ad-b69f-4ee0-97fd-a89ac9a8d827 service nova] Creating event network-vif-plugged:622d2354-1aa7-4c56-9968-1dc840e8b049 for instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d on n-h2-860282-1 Oct 04 21:12:25.592651 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-4e517eb8-a027-4879-8e59-2f0c72b87614 req-fdc7b1ad-b69f-4ee0-97fd-a89ac9a8d827 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046731 Oct 04 21:12:25.593261 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 878/1770] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:25.598247 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4b426e09-0139-4542-9b40-6fcefd7c04c6 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec" status: 200 len: 1322 microversion: 2.1 time: 0.386532 Oct 04 21:12:25.599162 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 893/1771] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:25 2022] GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:25.599928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-10a276f2-6ae5-4472-9655-d3ad42a1c074 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:25.601344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-10a276f2-6ae5-4472-9655-d3ad42a1c074 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:25.608754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-19c1d8df-a3b3-4151-8427-bc217163e7e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:25.608754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-19c1d8df-a3b3-4151-8427-bc217163e7e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:25.610470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19c1d8df-a3b3-4151-8427-bc217163e7e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.610966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19c1d8df-a3b3-4151-8427-bc217163e7e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:25.611483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19c1d8df-a3b3-4151-8427-bc217163e7e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:25.612089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19c1d8df-a3b3-4151-8427-bc217163e7e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.612544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19c1d8df-a3b3-4151-8427-bc217163e7e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:25.612971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19c1d8df-a3b3-4151-8427-bc217163e7e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:25.622503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10a276f2-6ae5-4472-9655-d3ad42a1c074 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.623259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10a276f2-6ae5-4472-9655-d3ad42a1c074 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:25.623863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10a276f2-6ae5-4472-9655-d3ad42a1c074 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:25.624884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10a276f2-6ae5-4472-9655-d3ad42a1c074 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.625531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10a276f2-6ae5-4472-9655-d3ad42a1c074 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:25.626959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10a276f2-6ae5-4472-9655-d3ad42a1c074 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:25.633752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:26.122904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-10a276f2-6ae5-4472-9655-d3ad42a1c074 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:26.135075 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-10a276f2-6ae5-4472-9655-d3ad42a1c074 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 200 len: 1268 microversion: 2.1 time: 0.540353 Oct 04 21:12:26.135680 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 879/1772] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:25 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 1268 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:26.150858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-84ca8ebd-d62c-41c9-bf3d-f23e1faddc25 req-a2e9ce20-01ee-4197-9aa1-b8f9d9df9d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2babc3b5-0147-43b1-8f42-8a536a46ddce", "tag": "766e621d-fb6f-4386-b54e-a70fe38c5ba4"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:26.166256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-84ca8ebd-d62c-41c9-bf3d-f23e1faddc25 req-a2e9ce20-01ee-4197-9aa1-b8f9d9df9d96 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:26.166742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-84ca8ebd-d62c-41c9-bf3d-f23e1faddc25 req-a2e9ce20-01ee-4197-9aa1-b8f9d9df9d96 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:26.167180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-84ca8ebd-d62c-41c9-bf3d-f23e1faddc25 req-a2e9ce20-01ee-4197-9aa1-b8f9d9df9d96 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:26.182779 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-84ca8ebd-d62c-41c9-bf3d-f23e1faddc25 req-a2e9ce20-01ee-4197-9aa1-b8f9d9df9d96 service nova] Creating event network-changed:766e621d-fb6f-4386-b54e-a70fe38c5ba4 for instance 2babc3b5-0147-43b1-8f42-8a536a46ddce on n-h1-860282-1 Oct 04 21:12:26.190929 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-84ca8ebd-d62c-41c9-bf3d-f23e1faddc25 req-a2e9ce20-01ee-4197-9aa1-b8f9d9df9d96 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053764 Oct 04 21:12:26.192143 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 880/1773] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:26.198877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7bd2b4e4-34f4-48ac-a5d4-92b32a7ca3e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:26.199632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7bd2b4e4-34f4-48ac-a5d4-92b32a7ca3e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:26.208235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bd2b4e4-34f4-48ac-a5d4-92b32a7ca3e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:26.208917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bd2b4e4-34f4-48ac-a5d4-92b32a7ca3e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:26.209762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bd2b4e4-34f4-48ac-a5d4-92b32a7ca3e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:26.210642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bd2b4e4-34f4-48ac-a5d4-92b32a7ca3e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:26.211066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bd2b4e4-34f4-48ac-a5d4-92b32a7ca3e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:26.212182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bd2b4e4-34f4-48ac-a5d4-92b32a7ca3e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:26.219930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-19c1d8df-a3b3-4151-8427-bc217163e7e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:26.227695 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-19c1d8df-a3b3-4151-8427-bc217163e7e8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1392 microversion: 2.1 time: 0.627460 Oct 04 21:12:26.234895 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 894/1774] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:25 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1392 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:26.241003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f05cc8d4-d955-4b24-8a4d-78722e4bbadd tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] Calling method '.version_select at 0x7f578bc5bd30>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:26.356787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG neutronclient.v2_0.client [None req-f05cc8d4-d955-4b24-8a4d-78722e4bbadd tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a97991e4-47c5-4eb7-852a-c586712876c7 could not be found", "detail": ""}} {{(pid=122758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:12:26.358062 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-f05cc8d4-d955-4b24-8a4d-78722e4bbadd tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] HTTP exception thrown: Floating IP not found for ID a97991e4-47c5-4eb7-852a-c586712876c7 Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f05cc8d4-d955-4b24-8a4d-78722e4bbadd tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] Request method failure captured: Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-floating-ips/a97991e4-47c5-4eb7-852a-c586712876c7 HTTP/1.1 Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKGhQiVMbozD8DGwwIw2hLpE1Od9SdVUA_51doAeAyctxBRszEfaMTZI1hBIV2gjj4GXH0M1OSoZU3FyusTF7XGxrVEXDmAROzzmyUnJJytwfFfI2QGuQYagSwvNA0_JvOswVW9fuTW2MlCnqN-7QzUhLZo_19DXF_UzEXd3uIYI4pE Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7a574ef7450845bba21034637749b3af Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-FloatingIPsTestJSON-1938658248 Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a574ef7450845bba21034637749b3af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7a574ef7450845bba21034637749b3af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7a574ef7450845bba21034637749b3af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a574ef7450845bba21034637749b3af"}]}] Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-FloatingIPsTestJSON-1938658248 Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7a574ef7450845bba21034637749b3af Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1938658248 Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-FloatingIPsTestJSON-1938658248-project Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 9d04ce813f654254b58639d6cd9d3052 Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-FloatingIPsTestJSON-1938658248-project Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: exception: Floating IP not found for ID a97991e4-47c5-4eb7-852a-c586712876c7 Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'a97991e4-47c5-4eb7-852a-c586712876c7'} Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a97991e4-47c5-4eb7-852a-c586712876c7 could not be found Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c74a02cd-ab05-4b44-96fb-235c629a238c'] Oct 04 21:12:26.361279 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a97991e4-47c5-4eb7-852a-c586712876c7. Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a97991e4-47c5-4eb7-852a-c586712876c7 Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a97991e4-47c5-4eb7-852a-c586712876c7 Oct 04 21:12:26.367588 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:26.376173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f05cc8d4-d955-4b24-8a4d-78722e4bbadd tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] Returning 404 to user: Floating IP not found for ID a97991e4-47c5-4eb7-852a-c586712876c7 {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:12:26.377298 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f05cc8d4-d955-4b24-8a4d-78722e4bbadd tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/a97991e4-47c5-4eb7-852a-c586712876c7" status: 404 len: 111 microversion: 2.1 time: 0.141195 Oct 04 21:12:26.379023 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 895/1775] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Oct 4 21:12:26 2022] GET /compute/v2.1/os-floating-ips/a97991e4-47c5-4eb7-852a-c586712876c7 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:12:26.385951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-65c0c09b-d4f1-41d6-be7b-e1e6add19d82 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:26.387322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-65c0c09b-d4f1-41d6-be7b-e1e6add19d82 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:26.511128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-65c0c09b-d4f1-41d6-be7b-e1e6add19d82 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:26.527064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-65c0c09b-d4f1-41d6-be7b-e1e6add19d82 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:26.529255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-65c0c09b-d4f1-41d6-be7b-e1e6add19d82 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:26.531125 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-65c0c09b-d4f1-41d6-be7b-e1e6add19d82 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1103 microversion: 2.25 time: 0.151505 Oct 04 21:12:26.547534 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 896/1776] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:26 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1103 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:26.554393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e1b01334-0945-4b4a-a338-fa40c26c6772 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:26.555244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e1b01334-0945-4b4a-a338-fa40c26c6772 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] [instance: c435602c-12c6-4356-8fb7-5883305ea5f0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:26.564230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7bd2b4e4-34f4-48ac-a5d4-92b32a7ca3e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:26.568300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1b01334-0945-4b4a-a338-fa40c26c6772 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:26.568876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1b01334-0945-4b4a-a338-fa40c26c6772 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:26.569535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1b01334-0945-4b4a-a338-fa40c26c6772 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:26.570559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1b01334-0945-4b4a-a338-fa40c26c6772 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:26.571232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1b01334-0945-4b4a-a338-fa40c26c6772 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:26.571841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1b01334-0945-4b4a-a338-fa40c26c6772 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:26.575379 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7bd2b4e4-34f4-48ac-a5d4-92b32a7ca3e7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1307 microversion: 2.1 time: 0.381816 Oct 04 21:12:26.576484 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 881/1777] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:26 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1307 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:26.625705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fbc9780d-da87-4747-aa14-ece102889a25 tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] Calling method '.version_select at 0x7f57944b0160>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:26.739489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG neutronclient.v2_0.client [None req-fbc9780d-da87-4747-aa14-ece102889a25 tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a97991e4-47c5-4eb7-852a-c586712876c7 could not be found", "detail": ""}} {{(pid=122757) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:12:26.741502 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-fbc9780d-da87-4747-aa14-ece102889a25 tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] HTTP exception thrown: Floating IP not found for ID a97991e4-47c5-4eb7-852a-c586712876c7 Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fbc9780d-da87-4747-aa14-ece102889a25 tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] Request method failure captured: Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/os-floating-ips/a97991e4-47c5-4eb7-852a-c586712876c7 HTTP/1.1 Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKGhQiVMbozD8DGwwIw2hLpE1Od9SdVUA_51doAeAyctxBRszEfaMTZI1hBIV2gjj4GXH0M1OSoZU3FyusTF7XGxrVEXDmAROzzmyUnJJytwfFfI2QGuQYagSwvNA0_JvOswVW9fuTW2MlCnqN-7QzUhLZo_19DXF_UzEXd3uIYI4pE Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 7a574ef7450845bba21034637749b3af Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-FloatingIPsTestJSON-1938658248 Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a574ef7450845bba21034637749b3af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7a574ef7450845bba21034637749b3af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7a574ef7450845bba21034637749b3af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a574ef7450845bba21034637749b3af"}]}] Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-FloatingIPsTestJSON-1938658248 Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 7a574ef7450845bba21034637749b3af Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1938658248 Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-FloatingIPsTestJSON-1938658248-project Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 9d04ce813f654254b58639d6cd9d3052 Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-FloatingIPsTestJSON-1938658248-project Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: exception: Floating IP not found for ID a97991e4-47c5-4eb7-852a-c586712876c7 Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'a97991e4-47c5-4eb7-852a-c586712876c7'} Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a97991e4-47c5-4eb7-852a-c586712876c7 could not be found Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e96b6f0-74f6-45f5-8d7c-43afe3acce13'] Oct 04 21:12:26.751046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a97991e4-47c5-4eb7-852a-c586712876c7. Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a97991e4-47c5-4eb7-852a-c586712876c7 Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a97991e4-47c5-4eb7-852a-c586712876c7 Oct 04 21:12:26.757112 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:12:26.763313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fbc9780d-da87-4747-aa14-ece102889a25 tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] Returning 404 to user: Floating IP not found for ID a97991e4-47c5-4eb7-852a-c586712876c7 {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:12:26.764845 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fbc9780d-da87-4747-aa14-ece102889a25 tempest-FloatingIPsTestJSON-1938658248 tempest-FloatingIPsTestJSON-1938658248-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/a97991e4-47c5-4eb7-852a-c586712876c7" status: 404 len: 111 microversion: 2.1 time: 0.153957 Oct 04 21:12:26.765764 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 882/1778] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Oct 4 21:12:26 2022] DELETE /compute/v2.1/os-floating-ips/a97991e4-47c5-4eb7-852a-c586712876c7 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:12:26.774506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0545eec5-f302-4af6-8f55-de76e6fd43bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:26.778554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0545eec5-f302-4af6-8f55-de76e6fd43bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:26.784732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0545eec5-f302-4af6-8f55-de76e6fd43bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:26.785465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0545eec5-f302-4af6-8f55-de76e6fd43bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:26.786116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0545eec5-f302-4af6-8f55-de76e6fd43bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:26.787779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0545eec5-f302-4af6-8f55-de76e6fd43bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:26.788451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0545eec5-f302-4af6-8f55-de76e6fd43bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:26.789039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0545eec5-f302-4af6-8f55-de76e6fd43bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.005604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e1b01334-0945-4b4a-a338-fa40c26c6772 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64760b4bb6a54c048008aa00f4ecd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9adbb13ad5d4747be2d0ceb588255ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:27.014808 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e1b01334-0945-4b4a-a338-fa40c26c6772 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] 10.222.0.30 "GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0" status: 200 len: 1325 microversion: 2.1 time: 0.471152 Oct 04 21:12:27.015736 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 897/1779] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:26 2022] GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0 => generated 1325 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:27.022030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cc0ec211-dd63-4387-8dbb-9fbbbc763e65 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:27.022949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cc0ec211-dd63-4387-8dbb-9fbbbc763e65 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: 04b031f2-40e3-486e-9066-ff87fbffb8ec] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:27.032104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc0ec211-dd63-4387-8dbb-9fbbbc763e65 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.032965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc0ec211-dd63-4387-8dbb-9fbbbc763e65 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.033552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc0ec211-dd63-4387-8dbb-9fbbbc763e65 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.034530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc0ec211-dd63-4387-8dbb-9fbbbc763e65 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.035085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc0ec211-dd63-4387-8dbb-9fbbbc763e65 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.035624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc0ec211-dd63-4387-8dbb-9fbbbc763e65 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.120614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0545eec5-f302-4af6-8f55-de76e6fd43bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:27.129722 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0545eec5-f302-4af6-8f55-de76e6fd43bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1312 microversion: 2.1 time: 0.361770 Oct 04 21:12:27.130832 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 883/1780] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:26 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1312 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:27.170419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-065a3633-180f-4361-9788-1a6493283546 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:27.171454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-065a3633-180f-4361-9788-1a6493283546 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:27.195522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-065a3633-180f-4361-9788-1a6493283546 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.196401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-065a3633-180f-4361-9788-1a6493283546 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.196916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-065a3633-180f-4361-9788-1a6493283546 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.197891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-065a3633-180f-4361-9788-1a6493283546 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.198445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-065a3633-180f-4361-9788-1a6493283546 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.199791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-065a3633-180f-4361-9788-1a6493283546 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.323391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-065a3633-180f-4361-9788-1a6493283546 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:27.335975 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-065a3633-180f-4361-9788-1a6493283546 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 200 len: 1286 microversion: 2.1 time: 0.181526 Oct 04 21:12:27.336566 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 884/1781] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:27 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 1286 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:12:27.341838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d72ff3c6-164b-4203-aaa4-906c8c497512 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:27.342655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d72ff3c6-164b-4203-aaa4-906c8c497512 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:27.348830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d72ff3c6-164b-4203-aaa4-906c8c497512 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.349935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d72ff3c6-164b-4203-aaa4-906c8c497512 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.350547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d72ff3c6-164b-4203-aaa4-906c8c497512 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.351466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d72ff3c6-164b-4203-aaa4-906c8c497512 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.352083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d72ff3c6-164b-4203-aaa4-906c8c497512 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.352670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d72ff3c6-164b-4203-aaa4-906c8c497512 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.467237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cc0ec211-dd63-4387-8dbb-9fbbbc763e65 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:27.477849 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cc0ec211-dd63-4387-8dbb-9fbbbc763e65 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec" status: 200 len: 1322 microversion: 2.1 time: 0.460846 Oct 04 21:12:27.490092 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 898/1782] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:27 2022] GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec => generated 1322 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:27.560491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-04c313f1-48f9-4b0e-b6ae-cb4c6ffb805e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:27.561663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-04c313f1-48f9-4b0e-b6ae-cb4c6ffb805e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:27.575857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04c313f1-48f9-4b0e-b6ae-cb4c6ffb805e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.578166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04c313f1-48f9-4b0e-b6ae-cb4c6ffb805e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.578963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04c313f1-48f9-4b0e-b6ae-cb4c6ffb805e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.581351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04c313f1-48f9-4b0e-b6ae-cb4c6ffb805e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.582170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04c313f1-48f9-4b0e-b6ae-cb4c6ffb805e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.583334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04c313f1-48f9-4b0e-b6ae-cb4c6ffb805e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.718134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-04c313f1-48f9-4b0e-b6ae-cb4c6ffb805e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:27.726806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-04c313f1-48f9-4b0e-b6ae-cb4c6ffb805e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:27.728280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-04c313f1-48f9-4b0e-b6ae-cb4c6ffb805e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:27.729568 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-04c313f1-48f9-4b0e-b6ae-cb4c6ffb805e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1176 microversion: 2.25 time: 0.174719 Oct 04 21:12:27.731229 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 899/1783] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:27 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1176 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:27.736197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0071e95b-1527-4ea3-ac0b-882b7d14bd96 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:27.736797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0071e95b-1527-4ea3-ac0b-882b7d14bd96 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:27.743092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0071e95b-1527-4ea3-ac0b-882b7d14bd96 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.743783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0071e95b-1527-4ea3-ac0b-882b7d14bd96 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.744381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0071e95b-1527-4ea3-ac0b-882b7d14bd96 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.745260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0071e95b-1527-4ea3-ac0b-882b7d14bd96 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.746625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0071e95b-1527-4ea3-ac0b-882b7d14bd96 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.747223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0071e95b-1527-4ea3-ac0b-882b7d14bd96 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.767521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d72ff3c6-164b-4203-aaa4-906c8c497512 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:27.780748 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d72ff3c6-164b-4203-aaa4-906c8c497512 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1392 microversion: 2.1 time: 0.442948 Oct 04 21:12:27.782429 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 885/1784] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:27 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1392 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:27.787346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-0cad52bd-c5f9-470d-af59-534a0a4e00c8 req-d66e766c-c00f-4de3-aacb-848673770832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c435602c-12c6-4356-8fb7-5883305ea5f0", "name": "network-vif-plugged", "status": "completed", "tag": "65ccfa33-2e93-431f-b01b-e2f73b23dcea"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:27.795199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:27.802359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0cad52bd-c5f9-470d-af59-534a0a4e00c8 req-d66e766c-c00f-4de3-aacb-848673770832 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.803161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0cad52bd-c5f9-470d-af59-534a0a4e00c8 req-d66e766c-c00f-4de3-aacb-848673770832 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.803823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0cad52bd-c5f9-470d-af59-534a0a4e00c8 req-d66e766c-c00f-4de3-aacb-848673770832 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.818248 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-0cad52bd-c5f9-470d-af59-534a0a4e00c8 req-d66e766c-c00f-4de3-aacb-848673770832 service nova] Creating event network-vif-plugged:65ccfa33-2e93-431f-b01b-e2f73b23dcea for instance c435602c-12c6-4356-8fb7-5883305ea5f0 on n-h2-860282-1 Oct 04 21:12:27.824568 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-0cad52bd-c5f9-470d-af59-534a0a4e00c8 req-d66e766c-c00f-4de3-aacb-848673770832 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040301 Oct 04 21:12:27.825559 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 886/1785] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:28.045373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4c483d02-d69f-45f6-825d-89ded6306068 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:28.047032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4c483d02-d69f-45f6-825d-89ded6306068 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] [instance: c435602c-12c6-4356-8fb7-5883305ea5f0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:28.055941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c483d02-d69f-45f6-825d-89ded6306068 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:28.056818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c483d02-d69f-45f6-825d-89ded6306068 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:28.057704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c483d02-d69f-45f6-825d-89ded6306068 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:28.059592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c483d02-d69f-45f6-825d-89ded6306068 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:28.060395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c483d02-d69f-45f6-825d-89ded6306068 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:28.061072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c483d02-d69f-45f6-825d-89ded6306068 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:28.248568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0071e95b-1527-4ea3-ac0b-882b7d14bd96 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:28.266591 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0071e95b-1527-4ea3-ac0b-882b7d14bd96 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1307 microversion: 2.1 time: 0.533578 Oct 04 21:12:28.279655 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 900/1786] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:27 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1307 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:28.284355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dc6cb1cd-75a8-4c64-8dfd-a98a428b8cf7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:28.285544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dc6cb1cd-75a8-4c64-8dfd-a98a428b8cf7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:28.296548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc6cb1cd-75a8-4c64-8dfd-a98a428b8cf7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:28.297106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc6cb1cd-75a8-4c64-8dfd-a98a428b8cf7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:28.297733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc6cb1cd-75a8-4c64-8dfd-a98a428b8cf7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:28.301474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc6cb1cd-75a8-4c64-8dfd-a98a428b8cf7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:28.302154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc6cb1cd-75a8-4c64-8dfd-a98a428b8cf7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:28.302790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc6cb1cd-75a8-4c64-8dfd-a98a428b8cf7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:28.464320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4c483d02-d69f-45f6-825d-89ded6306068 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64760b4bb6a54c048008aa00f4ecd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9adbb13ad5d4747be2d0ceb588255ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:28.474535 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4c483d02-d69f-45f6-825d-89ded6306068 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] 10.222.0.30 "GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0" status: 200 len: 1325 microversion: 2.1 time: 0.435696 Oct 04 21:12:28.475221 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 887/1787] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:28 2022] GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0 => generated 1325 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:12:28.481277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-306b8f10-38cc-4ec7-a7b7-4514945f0e39 req-76c2a9fa-6629-4556-a058-827db944e099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b031f2-40e3-486e-9066-ff87fbffb8ec", "tag": "5c7832a4-d19a-4ba1-8d1d-3a0f05b4845e"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:28.492448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-306b8f10-38cc-4ec7-a7b7-4514945f0e39 req-76c2a9fa-6629-4556-a058-827db944e099 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:28.493567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-306b8f10-38cc-4ec7-a7b7-4514945f0e39 req-76c2a9fa-6629-4556-a058-827db944e099 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:28.494333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-306b8f10-38cc-4ec7-a7b7-4514945f0e39 req-76c2a9fa-6629-4556-a058-827db944e099 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:28.508455 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-306b8f10-38cc-4ec7-a7b7-4514945f0e39 req-76c2a9fa-6629-4556-a058-827db944e099 service nova] Creating event network-changed:5c7832a4-d19a-4ba1-8d1d-3a0f05b4845e for instance 04b031f2-40e3-486e-9066-ff87fbffb8ec on n-h1-860282-1 Oct 04 21:12:28.515146 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-306b8f10-38cc-4ec7-a7b7-4514945f0e39 req-76c2a9fa-6629-4556-a058-827db944e099 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038433 Oct 04 21:12:28.515831 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 888/1788] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:28.525371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-741d674f-3d1b-4895-9d71-0da74e918189 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:28.526600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-741d674f-3d1b-4895-9d71-0da74e918189 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:28.546015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-741d674f-3d1b-4895-9d71-0da74e918189 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:28.546923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-741d674f-3d1b-4895-9d71-0da74e918189 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:28.547543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-741d674f-3d1b-4895-9d71-0da74e918189 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:28.549302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-741d674f-3d1b-4895-9d71-0da74e918189 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:28.549997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-741d674f-3d1b-4895-9d71-0da74e918189 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:28.550789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-741d674f-3d1b-4895-9d71-0da74e918189 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:28.996108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dc6cb1cd-75a8-4c64-8dfd-a98a428b8cf7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:29.008696 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dc6cb1cd-75a8-4c64-8dfd-a98a428b8cf7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1461 microversion: 2.1 time: 0.736544 Oct 04 21:12:29.009336 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 901/1789] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:28 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1461 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:29.020965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2758dbe5-bfa3-48b1-8524-5cee3d429d2e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:29.024440 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2758dbe5-bfa3-48b1-8524-5cee3d429d2e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: 04b031f2-40e3-486e-9066-ff87fbffb8ec] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:29.040395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2758dbe5-bfa3-48b1-8524-5cee3d429d2e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:29.043548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2758dbe5-bfa3-48b1-8524-5cee3d429d2e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:29.044157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2758dbe5-bfa3-48b1-8524-5cee3d429d2e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:29.047684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2758dbe5-bfa3-48b1-8524-5cee3d429d2e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:29.048176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2758dbe5-bfa3-48b1-8524-5cee3d429d2e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:29.049853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2758dbe5-bfa3-48b1-8524-5cee3d429d2e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:29.113987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-741d674f-3d1b-4895-9d71-0da74e918189 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:29.128536 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-741d674f-3d1b-4895-9d71-0da74e918189 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 200 len: 1316 microversion: 2.1 time: 0.607945 Oct 04 21:12:29.129626 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 889/1790] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:28 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 1316 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:29.134549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7ab5edc6-279c-4e06-9e90-308b07242267 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:29.142234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7ab5edc6-279c-4e06-9e90-308b07242267 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:29.177544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ab5edc6-279c-4e06-9e90-308b07242267 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:29.178063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ab5edc6-279c-4e06-9e90-308b07242267 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:29.178698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ab5edc6-279c-4e06-9e90-308b07242267 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:29.180041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ab5edc6-279c-4e06-9e90-308b07242267 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:29.184849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ab5edc6-279c-4e06-9e90-308b07242267 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:29.185367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ab5edc6-279c-4e06-9e90-308b07242267 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:29.338789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7ab5edc6-279c-4e06-9e90-308b07242267 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:29.348412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7ab5edc6-279c-4e06-9e90-308b07242267 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:29.350142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7ab5edc6-279c-4e06-9e90-308b07242267 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:29.356187 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7ab5edc6-279c-4e06-9e90-308b07242267 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1232 microversion: 2.25 time: 0.220637 Oct 04 21:12:29.361315 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 890/1791] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:29 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1232 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:29.366706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8df7b818-7167-4e90-b8b1-8d1ab4b89f21 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:29.367323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8df7b818-7167-4e90-b8b1-8d1ab4b89f21 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:29.373607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8df7b818-7167-4e90-b8b1-8d1ab4b89f21 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:29.374093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8df7b818-7167-4e90-b8b1-8d1ab4b89f21 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:29.374528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8df7b818-7167-4e90-b8b1-8d1ab4b89f21 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:29.375834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8df7b818-7167-4e90-b8b1-8d1ab4b89f21 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:29.378112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8df7b818-7167-4e90-b8b1-8d1ab4b89f21 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:29.380819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8df7b818-7167-4e90-b8b1-8d1ab4b89f21 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:29.454131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2758dbe5-bfa3-48b1-8524-5cee3d429d2e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:29.462874 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2758dbe5-bfa3-48b1-8524-5cee3d429d2e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec" status: 200 len: 1322 microversion: 2.1 time: 0.452389 Oct 04 21:12:29.463599 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 902/1792] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:29 2022] GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec => generated 1322 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:29.468841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2c0ca937-6ace-45cd-b628-11ea3cba29e3 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:29.469778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2c0ca937-6ace-45cd-b628-11ea3cba29e3 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:29.476523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c0ca937-6ace-45cd-b628-11ea3cba29e3 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:29.477347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c0ca937-6ace-45cd-b628-11ea3cba29e3 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:29.478053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c0ca937-6ace-45cd-b628-11ea3cba29e3 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:29.479242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c0ca937-6ace-45cd-b628-11ea3cba29e3 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:29.480067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c0ca937-6ace-45cd-b628-11ea3cba29e3 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:29.480708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c0ca937-6ace-45cd-b628-11ea3cba29e3 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:30.278510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8df7b818-7167-4e90-b8b1-8d1ab4b89f21 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:30.299287 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8df7b818-7167-4e90-b8b1-8d1ab4b89f21 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1392 microversion: 2.1 time: 0.936530 Oct 04 21:12:30.313635 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 891/1793] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:29 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1392 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:30.313635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ca3aba94-de6f-4a31-9de6-acd66f0c3f37 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:30.313635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ca3aba94-de6f-4a31-9de6-acd66f0c3f37 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:30.313635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ca3aba94-de6f-4a31-9de6-acd66f0c3f37 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:30.313635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ca3aba94-de6f-4a31-9de6-acd66f0c3f37 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:30.313635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ca3aba94-de6f-4a31-9de6-acd66f0c3f37 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:30.314797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ca3aba94-de6f-4a31-9de6-acd66f0c3f37 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:30.314797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ca3aba94-de6f-4a31-9de6-acd66f0c3f37 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:30.315293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ca3aba94-de6f-4a31-9de6-acd66f0c3f37 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:30.384306 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2c0ca937-6ace-45cd-b628-11ea3cba29e3 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1612 microversion: 2.1 time: 0.919419 Oct 04 21:12:30.389628 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 903/1794] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:29 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1612 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:30.398796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-632f8e24-95ef-4a01-960c-09137dbdb1d2 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:30.401699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-632f8e24-95ef-4a01-960c-09137dbdb1d2 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] [instance: c435602c-12c6-4356-8fb7-5883305ea5f0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:30.415782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-632f8e24-95ef-4a01-960c-09137dbdb1d2 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:30.416283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-632f8e24-95ef-4a01-960c-09137dbdb1d2 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:30.427990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-632f8e24-95ef-4a01-960c-09137dbdb1d2 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:30.427990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-632f8e24-95ef-4a01-960c-09137dbdb1d2 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:30.427990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-632f8e24-95ef-4a01-960c-09137dbdb1d2 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:30.427990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-632f8e24-95ef-4a01-960c-09137dbdb1d2 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:30.945861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ca3aba94-de6f-4a31-9de6-acd66f0c3f37 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:30.963785 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ca3aba94-de6f-4a31-9de6-acd66f0c3f37 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1307 microversion: 2.1 time: 0.662441 Oct 04 21:12:30.971506 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 892/1795] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:30 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1307 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:30.976709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a9793cd6-3421-4e3d-b59a-7c33af9208f5 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:30.977341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a9793cd6-3421-4e3d-b59a-7c33af9208f5 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:30.977561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-632f8e24-95ef-4a01-960c-09137dbdb1d2 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64760b4bb6a54c048008aa00f4ecd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9adbb13ad5d4747be2d0ceb588255ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:30.987111 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-632f8e24-95ef-4a01-960c-09137dbdb1d2 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] 10.222.0.30 "GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0" status: 200 len: 1522 microversion: 2.1 time: 0.596329 Oct 04 21:12:30.989075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9793cd6-3421-4e3d-b59a-7c33af9208f5 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:30.990959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9793cd6-3421-4e3d-b59a-7c33af9208f5 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:30.998441 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 904/1796] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:30 2022] GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0 => generated 1522 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:30.998736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9793cd6-3421-4e3d-b59a-7c33af9208f5 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:30.998736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9793cd6-3421-4e3d-b59a-7c33af9208f5 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:30.998736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9793cd6-3421-4e3d-b59a-7c33af9208f5 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:30.999542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9793cd6-3421-4e3d-b59a-7c33af9208f5 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:31.002943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ef2ec961-6f67-4b1f-954a-d058d6975c3f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:31.003996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ef2ec961-6f67-4b1f-954a-d058d6975c3f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:31.017894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef2ec961-6f67-4b1f-954a-d058d6975c3f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:31.025817 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef2ec961-6f67-4b1f-954a-d058d6975c3f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:31.027073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef2ec961-6f67-4b1f-954a-d058d6975c3f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:31.027951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef2ec961-6f67-4b1f-954a-d058d6975c3f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:31.028507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef2ec961-6f67-4b1f-954a-d058d6975c3f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:31.029099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef2ec961-6f67-4b1f-954a-d058d6975c3f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:31.227329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ef2ec961-6f67-4b1f-954a-d058d6975c3f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:31.238048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ef2ec961-6f67-4b1f-954a-d058d6975c3f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:31.240149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ef2ec961-6f67-4b1f-954a-d058d6975c3f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:31.242036 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ef2ec961-6f67-4b1f-954a-d058d6975c3f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1250 microversion: 2.25 time: 0.249794 Oct 04 21:12:31.242910 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 905/1797] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:30 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1250 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:31.248614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-18e7e95e-45d1-4300-8591-e541c85b7b09 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:31.249242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-18e7e95e-45d1-4300-8591-e541c85b7b09 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:31.255639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18e7e95e-45d1-4300-8591-e541c85b7b09 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:31.256371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18e7e95e-45d1-4300-8591-e541c85b7b09 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:31.257122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18e7e95e-45d1-4300-8591-e541c85b7b09 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:31.258238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18e7e95e-45d1-4300-8591-e541c85b7b09 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:31.262253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18e7e95e-45d1-4300-8591-e541c85b7b09 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:31.262253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18e7e95e-45d1-4300-8591-e541c85b7b09 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:31.364334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-18e7e95e-45d1-4300-8591-e541c85b7b09 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '46403f4804524b49b6e6a819eacf9316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f1585595be4d9a8ac10069615004c1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:31.364963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-18e7e95e-45d1-4300-8591-e541c85b7b09 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] flavor_id is None. Assuming migration. {{(pid=122758) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 21:12:31.365533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-18e7e95e-45d1-4300-8591-e541c85b7b09 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122758) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:12:31.635517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a9793cd6-3421-4e3d-b59a-7c33af9208f5 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:31.643688 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a9793cd6-3421-4e3d-b59a-7c33af9208f5 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 200 len: 1316 microversion: 2.1 time: 0.670903 Oct 04 21:12:31.658051 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 893/1798] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:30 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 1316 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:31.666338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a0920eb8-52f3-47e7-8d66-5658bde36b77 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:31.667342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a0920eb8-52f3-47e7-8d66-5658bde36b77 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: 04b031f2-40e3-486e-9066-ff87fbffb8ec] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:31.675549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0920eb8-52f3-47e7-8d66-5658bde36b77 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:31.676092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0920eb8-52f3-47e7-8d66-5658bde36b77 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:31.676544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0920eb8-52f3-47e7-8d66-5658bde36b77 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:31.677261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0920eb8-52f3-47e7-8d66-5658bde36b77 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:31.677749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0920eb8-52f3-47e7-8d66-5658bde36b77 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:31.678426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0920eb8-52f3-47e7-8d66-5658bde36b77 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:31.804268 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-18e7e95e-45d1-4300-8591-e541c85b7b09 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d/action" status: 202 len: 0 microversion: 2.1 time: 0.560019 Oct 04 21:12:31.805501 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 906/1799] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:12:31 2022] POST /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:12:31.814874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-cc304f70-bc19-472f-be52-8996e9bb0beb req-eb1dde10-6881-4644-9811-459b2e946cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2babc3b5-0147-43b1-8f42-8a536a46ddce", "name": "network-vif-plugged", "status": "completed", "tag": "766e621d-fb6f-4386-b54e-a70fe38c5ba4"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:31.828403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-cc304f70-bc19-472f-be52-8996e9bb0beb req-eb1dde10-6881-4644-9811-459b2e946cd7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:31.829100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-cc304f70-bc19-472f-be52-8996e9bb0beb req-eb1dde10-6881-4644-9811-459b2e946cd7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:31.830732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-cc304f70-bc19-472f-be52-8996e9bb0beb req-eb1dde10-6881-4644-9811-459b2e946cd7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:31.850407 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-cc304f70-bc19-472f-be52-8996e9bb0beb req-eb1dde10-6881-4644-9811-459b2e946cd7 service nova] Creating event network-vif-plugged:766e621d-fb6f-4386-b54e-a70fe38c5ba4 for instance 2babc3b5-0147-43b1-8f42-8a536a46ddce on n-h1-860282-1 Oct 04 21:12:31.856829 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-cc304f70-bc19-472f-be52-8996e9bb0beb req-eb1dde10-6881-4644-9811-459b2e946cd7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048576 Oct 04 21:12:31.857981 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 907/1800] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:31.864153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6b0b5548-cb8b-4dd7-9dff-7c663257890d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:31.864942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6b0b5548-cb8b-4dd7-9dff-7c663257890d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] [instance: c435602c-12c6-4356-8fb7-5883305ea5f0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:31.872604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b0b5548-cb8b-4dd7-9dff-7c663257890d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:31.873240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b0b5548-cb8b-4dd7-9dff-7c663257890d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:31.873820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b0b5548-cb8b-4dd7-9dff-7c663257890d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:31.874743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b0b5548-cb8b-4dd7-9dff-7c663257890d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:31.875343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b0b5548-cb8b-4dd7-9dff-7c663257890d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:31.875855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b0b5548-cb8b-4dd7-9dff-7c663257890d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:31.903165 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-6b0b5548-cb8b-4dd7-9dff-7c663257890d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] HTTP exception thrown: Instance is not a member of specified network Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6b0b5548-cb8b-4dd7-9dff-7c663257890d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Request method failure captured: Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0/ips/invalid HTTP/1.1 Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKGfWk9lkUtA1dx_mD11pUmTNCnXcLN3rsnBFU2QLGbS3MWGaoaLRII18g1R31oKtFghsxcZ6cAt9l4PF6qy3_jrCmkN9kv8wTfidM9Qv0jkZBZ0mUzpGXX--5S5YM5gEAAcGI_Bfp9ww-G2542Mrq1QI2QmAimb6TNUsg9W-crlwlc Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: b9adbb13ad5d4747be2d0ceb588255ab Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-133353342 Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9adbb13ad5d4747be2d0ceb588255ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9adbb13ad5d4747be2d0ceb588255ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9adbb13ad5d4747be2d0ceb588255ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9adbb13ad5d4747be2d0ceb588255ab"}]}] Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-133353342 Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: b9adbb13ad5d4747be2d0ceb588255ab Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-133353342 Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerAddressesNegativeTestJSON-133353342-project Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 64760b4bb6a54c048008aa00f4ecd163 Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-133353342-project Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance is not a member of specified network Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'server_id': 'c435602c-12c6-4356-8fb7-5883305ea5f0', 'id': 'invalid'} Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 04 21:12:31.906910 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:31.911306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6b0b5548-cb8b-4dd7-9dff-7c663257890d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:12:31.911306 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6b0b5548-cb8b-4dd7-9dff-7c663257890d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] 10.222.0.30 "GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.050048 Oct 04 21:12:31.914432 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 908/1801] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:12:31 2022] GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0/ips/invalid => generated 91 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:12:31.920213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dd3658ae-7ba3-4ecf-bcec-962e65500226 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:31.920838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dd3658ae-7ba3-4ecf-bcec-962e65500226 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:31.927220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd3658ae-7ba3-4ecf-bcec-962e65500226 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:31.927867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd3658ae-7ba3-4ecf-bcec-962e65500226 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:31.928239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd3658ae-7ba3-4ecf-bcec-962e65500226 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:31.929410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd3658ae-7ba3-4ecf-bcec-962e65500226 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:31.929410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd3658ae-7ba3-4ecf-bcec-962e65500226 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:31.929983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd3658ae-7ba3-4ecf-bcec-962e65500226 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:32.237646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a0920eb8-52f3-47e7-8d66-5658bde36b77 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:32.248020 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a0920eb8-52f3-47e7-8d66-5658bde36b77 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec" status: 200 len: 1322 microversion: 2.1 time: 0.588253 Oct 04 21:12:32.260957 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 894/1802] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:31 2022] GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec => generated 1322 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:32.274439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-af36084c-bd50-4a98-8866-f667be9cb1a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:32.275243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-af36084c-bd50-4a98-8866-f667be9cb1a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:32.287134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af36084c-bd50-4a98-8866-f667be9cb1a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:32.287882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af36084c-bd50-4a98-8866-f667be9cb1a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:32.289551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af36084c-bd50-4a98-8866-f667be9cb1a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:32.292226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af36084c-bd50-4a98-8866-f667be9cb1a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:32.293762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af36084c-bd50-4a98-8866-f667be9cb1a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:32.293901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af36084c-bd50-4a98-8866-f667be9cb1a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:32.318034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:32.781174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dd3658ae-7ba3-4ecf-bcec-962e65500226 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:32.795193 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dd3658ae-7ba3-4ecf-bcec-962e65500226 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1392 microversion: 2.1 time: 0.875947 Oct 04 21:12:32.795193 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 909/1803] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:31 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1392 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:32.818510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-92c9628f-a711-4b75-a48c-0679a4451b8c tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:32.820295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-92c9628f-a711-4b75-a48c-0679a4451b8c tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Failed to fetch instance by id 999 {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 21:12:32.821046 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-92c9628f-a711-4b75-a48c-0679a4451b8c tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] HTTP exception thrown: Instance 999 could not be found. Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-92c9628f-a711-4b75-a48c-0679a4451b8c tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Request method failure captured: Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKGfWk9lkUtA1dx_mD11pUmTNCnXcLN3rsnBFU2QLGbS3MWGaoaLRII18g1R31oKtFghsxcZ6cAt9l4PF6qy3_jrCmkN9kv8wTfidM9Qv0jkZBZ0mUzpGXX--5S5YM5gEAAcGI_Bfp9ww-G2542Mrq1QI2QmAimb6TNUsg9W-crlwlc Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: b9adbb13ad5d4747be2d0ceb588255ab Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-133353342 Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9adbb13ad5d4747be2d0ceb588255ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9adbb13ad5d4747be2d0ceb588255ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9adbb13ad5d4747be2d0ceb588255ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9adbb13ad5d4747be2d0ceb588255ab"}]}] Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-133353342 Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: b9adbb13ad5d4747be2d0ceb588255ab Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-133353342 Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerAddressesNegativeTestJSON-133353342-project Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 64760b4bb6a54c048008aa00f4ecd163 Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-133353342-project Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 999 could not be found. Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'server_id': '999'} Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 21:12:32.829047 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:32.842357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-92c9628f-a711-4b75-a48c-0679a4451b8c tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:12:32.843360 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-92c9628f-a711-4b75-a48c-0679a4451b8c tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] 10.222.0.30 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.049170 Oct 04 21:12:32.853983 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 910/1804] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Oct 4 21:12:32 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:12:32.859698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bb30b1f4-40e6-4641-8300-3487015b9f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:32.860310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bb30b1f4-40e6-4641-8300-3487015b9f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:32.885513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb30b1f4-40e6-4641-8300-3487015b9f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:32.886334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb30b1f4-40e6-4641-8300-3487015b9f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:32.887426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb30b1f4-40e6-4641-8300-3487015b9f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:32.889442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb30b1f4-40e6-4641-8300-3487015b9f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:32.890421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb30b1f4-40e6-4641-8300-3487015b9f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:32.893139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb30b1f4-40e6-4641-8300-3487015b9f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:32.958957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-af36084c-bd50-4a98-8866-f667be9cb1a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:32.972363 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-af36084c-bd50-4a98-8866-f667be9cb1a6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1470 microversion: 2.1 time: 0.703271 Oct 04 21:12:32.975758 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 895/1805] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:32 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1470 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:32.997830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-627a9344-5e2a-4e2c-82bc-0e4fe0787e97 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:32.999726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-627a9344-5e2a-4e2c-82bc-0e4fe0787e97 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:33.020662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-627a9344-5e2a-4e2c-82bc-0e4fe0787e97 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:33.026699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-627a9344-5e2a-4e2c-82bc-0e4fe0787e97 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:33.028016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-627a9344-5e2a-4e2c-82bc-0e4fe0787e97 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:33.033255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-627a9344-5e2a-4e2c-82bc-0e4fe0787e97 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:33.033778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-627a9344-5e2a-4e2c-82bc-0e4fe0787e97 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:33.034223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-627a9344-5e2a-4e2c-82bc-0e4fe0787e97 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:33.603069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bb30b1f4-40e6-4641-8300-3487015b9f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:33.616951 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bb30b1f4-40e6-4641-8300-3487015b9f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1307 microversion: 2.1 time: 0.761825 Oct 04 21:12:33.622360 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 911/1806] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:32 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1307 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:33.643517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7d71fd74-0f26-405a-b370-68b8904ee8bf tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:33.647007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7d71fd74-0f26-405a-b370-68b8904ee8bf tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:33.702553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d71fd74-0f26-405a-b370-68b8904ee8bf tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:33.702553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d71fd74-0f26-405a-b370-68b8904ee8bf tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:33.702553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d71fd74-0f26-405a-b370-68b8904ee8bf tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:33.702553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d71fd74-0f26-405a-b370-68b8904ee8bf tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:33.702553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d71fd74-0f26-405a-b370-68b8904ee8bf tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:33.702553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d71fd74-0f26-405a-b370-68b8904ee8bf tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:33.921787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-627a9344-5e2a-4e2c-82bc-0e4fe0787e97 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:33.921787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-627a9344-5e2a-4e2c-82bc-0e4fe0787e97 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:33.921787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-627a9344-5e2a-4e2c-82bc-0e4fe0787e97 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:33.921787 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-627a9344-5e2a-4e2c-82bc-0e4fe0787e97 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1292 microversion: 2.25 time: 0.846948 Oct 04 21:12:33.921787 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 896/1807] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:32 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1292 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:33.921787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9761212f-9282-4258-a923-5ce933dbe12d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:33.921787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9761212f-9282-4258-a923-5ce933dbe12d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] [instance: c435602c-12c6-4356-8fb7-5883305ea5f0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:33.921787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9761212f-9282-4258-a923-5ce933dbe12d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:33.921787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9761212f-9282-4258-a923-5ce933dbe12d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:33.921787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9761212f-9282-4258-a923-5ce933dbe12d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:33.921787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9761212f-9282-4258-a923-5ce933dbe12d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:33.925161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9761212f-9282-4258-a923-5ce933dbe12d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:33.925161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9761212f-9282-4258-a923-5ce933dbe12d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:33.932701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9761212f-9282-4258-a923-5ce933dbe12d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] [instance: c435602c-12c6-4356-8fb7-5883305ea5f0] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:12:34.026190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:34.210376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7d71fd74-0f26-405a-b370-68b8904ee8bf tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:34.212935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:34.221113 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7d71fd74-0f26-405a-b370-68b8904ee8bf tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 200 len: 1316 microversion: 2.1 time: 0.597358 Oct 04 21:12:34.231624 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 912/1808] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:33 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 1316 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:34.249577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-d6739b80-0dc5-4fab-8832-d50f0a4bb481 req-ca04e663-0f1f-4ebe-b0b4-3e55319f1205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47ef2ed7-3bd6-443a-84dd-5eda292e483d", "tag": "65d1e6fd-5827-4499-92a8-5c2559cce40f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:34.267218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d6739b80-0dc5-4fab-8832-d50f0a4bb481 req-ca04e663-0f1f-4ebe-b0b4-3e55319f1205 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:34.268208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d6739b80-0dc5-4fab-8832-d50f0a4bb481 req-ca04e663-0f1f-4ebe-b0b4-3e55319f1205 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:34.269123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d6739b80-0dc5-4fab-8832-d50f0a4bb481 req-ca04e663-0f1f-4ebe-b0b4-3e55319f1205 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:34.282690 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-d6739b80-0dc5-4fab-8832-d50f0a4bb481 req-ca04e663-0f1f-4ebe-b0b4-3e55319f1205 service nova] Creating event network-changed:65d1e6fd-5827-4499-92a8-5c2559cce40f for instance 47ef2ed7-3bd6-443a-84dd-5eda292e483d on n-h2-860282-1 Oct 04 21:12:34.289394 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-d6739b80-0dc5-4fab-8832-d50f0a4bb481 req-ca04e663-0f1f-4ebe-b0b4-3e55319f1205 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055958 Oct 04 21:12:34.291018 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 913/1809] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:34.299139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2bf8c727-edce-4bf9-bd45-b0fb338a2be8 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:34.300189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2bf8c727-edce-4bf9-bd45-b0fb338a2be8 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: 04b031f2-40e3-486e-9066-ff87fbffb8ec] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:34.306888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bf8c727-edce-4bf9-bd45-b0fb338a2be8 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:34.307867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bf8c727-edce-4bf9-bd45-b0fb338a2be8 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:34.308848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bf8c727-edce-4bf9-bd45-b0fb338a2be8 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:34.311236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bf8c727-edce-4bf9-bd45-b0fb338a2be8 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:34.312102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bf8c727-edce-4bf9-bd45-b0fb338a2be8 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:34.312788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bf8c727-edce-4bf9-bd45-b0fb338a2be8 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:34.429625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:34.461139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=16 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:34.619760 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9761212f-9282-4258-a923-5ce933dbe12d tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0" status: 204 len: 0 microversion: 2.1 time: 0.785021 Oct 04 21:12:34.621191 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 897/1810] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:12:33 2022] DELETE /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:12:34.629985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b089712f-146b-4f0b-92be-1cfb3b7da1bf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:34.631468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b089712f-146b-4f0b-92be-1cfb3b7da1bf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:34.642643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b089712f-146b-4f0b-92be-1cfb3b7da1bf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:34.645038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b089712f-146b-4f0b-92be-1cfb3b7da1bf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:34.645641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b089712f-146b-4f0b-92be-1cfb3b7da1bf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:34.646643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b089712f-146b-4f0b-92be-1cfb3b7da1bf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:34.647331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b089712f-146b-4f0b-92be-1cfb3b7da1bf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:34.648014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b089712f-146b-4f0b-92be-1cfb3b7da1bf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:34.685280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2bf8c727-edce-4bf9-bd45-b0fb338a2be8 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:34.693600 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2bf8c727-edce-4bf9-bd45-b0fb338a2be8 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec" status: 200 len: 1322 microversion: 2.1 time: 0.401062 Oct 04 21:12:34.709446 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 914/1811] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:34 2022] GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:34.732019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-2d4a3c49-06f2-44ae-895b-b12bf44a615b req-405f26f3-f32b-4547-b43a-cf11f2481440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b031f2-40e3-486e-9066-ff87fbffb8ec", "name": "network-vif-plugged", "status": "completed", "tag": "5c7832a4-d19a-4ba1-8d1d-3a0f05b4845e"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:34.748366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2d4a3c49-06f2-44ae-895b-b12bf44a615b req-405f26f3-f32b-4547-b43a-cf11f2481440 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:34.749371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2d4a3c49-06f2-44ae-895b-b12bf44a615b req-405f26f3-f32b-4547-b43a-cf11f2481440 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:34.750214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2d4a3c49-06f2-44ae-895b-b12bf44a615b req-405f26f3-f32b-4547-b43a-cf11f2481440 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:34.772941 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-2d4a3c49-06f2-44ae-895b-b12bf44a615b req-405f26f3-f32b-4547-b43a-cf11f2481440 service nova] Creating event network-vif-plugged:5c7832a4-d19a-4ba1-8d1d-3a0f05b4845e for instance 04b031f2-40e3-486e-9066-ff87fbffb8ec on n-h1-860282-1 Oct 04 21:12:34.793493 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-2d4a3c49-06f2-44ae-895b-b12bf44a615b req-405f26f3-f32b-4547-b43a-cf11f2481440 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068696 Oct 04 21:12:34.802211 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 915/1812] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:34.815422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2ca9c507-60d1-45a6-aa08-18e0f8fb3755 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:34.816498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2ca9c507-60d1-45a6-aa08-18e0f8fb3755 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:34.828383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ca9c507-60d1-45a6-aa08-18e0f8fb3755 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:34.828383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ca9c507-60d1-45a6-aa08-18e0f8fb3755 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:34.828383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ca9c507-60d1-45a6-aa08-18e0f8fb3755 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:34.828383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ca9c507-60d1-45a6-aa08-18e0f8fb3755 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:34.828383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ca9c507-60d1-45a6-aa08-18e0f8fb3755 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:34.828383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ca9c507-60d1-45a6-aa08-18e0f8fb3755 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:35.015843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b089712f-146b-4f0b-92be-1cfb3b7da1bf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:35.028037 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b089712f-146b-4f0b-92be-1cfb3b7da1bf tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1392 microversion: 2.1 time: 0.405088 Oct 04 21:12:35.029669 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 898/1813] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:34 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1392 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:35.035870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b2d55dfe-a6af-4348-a9b5-3bc501fbc175 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:35.049360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b2d55dfe-a6af-4348-a9b5-3bc501fbc175 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] [instance: c435602c-12c6-4356-8fb7-5883305ea5f0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:35.055570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2d55dfe-a6af-4348-a9b5-3bc501fbc175 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:35.056474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2d55dfe-a6af-4348-a9b5-3bc501fbc175 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:35.057109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2d55dfe-a6af-4348-a9b5-3bc501fbc175 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:35.058077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2d55dfe-a6af-4348-a9b5-3bc501fbc175 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:35.060195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2d55dfe-a6af-4348-a9b5-3bc501fbc175 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:35.060860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2d55dfe-a6af-4348-a9b5-3bc501fbc175 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:35.080783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2ca9c507-60d1-45a6-aa08-18e0f8fb3755 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:35.089023 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2ca9c507-60d1-45a6-aa08-18e0f8fb3755 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1470 microversion: 2.1 time: 0.278309 Oct 04 21:12:35.099553 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 916/1814] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:34 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1470 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:35.109189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a5a9ccfa-c5ae-4bed-a448-91f852006625 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:35.111213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a5a9ccfa-c5ae-4bed-a448-91f852006625 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:35.128486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a5a9ccfa-c5ae-4bed-a448-91f852006625 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:35.129381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a5a9ccfa-c5ae-4bed-a448-91f852006625 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:35.144705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a5a9ccfa-c5ae-4bed-a448-91f852006625 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:35.157067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a5a9ccfa-c5ae-4bed-a448-91f852006625 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:35.157067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a5a9ccfa-c5ae-4bed-a448-91f852006625 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:35.157067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a5a9ccfa-c5ae-4bed-a448-91f852006625 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:35.555309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b2d55dfe-a6af-4348-a9b5-3bc501fbc175 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64760b4bb6a54c048008aa00f4ecd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9adbb13ad5d4747be2d0ceb588255ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:35.570124 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b2d55dfe-a6af-4348-a9b5-3bc501fbc175 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] 10.222.0.30 "GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0" status: 200 len: 1528 microversion: 2.1 time: 0.536110 Oct 04 21:12:35.572355 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 899/1815] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:35 2022] GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0 => generated 1528 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:35.610260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b54b1471-313a-4527-ab50-cb15bbd7846a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:35.611767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b54b1471-313a-4527-ab50-cb15bbd7846a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:35.628017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b54b1471-313a-4527-ab50-cb15bbd7846a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:35.630000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b54b1471-313a-4527-ab50-cb15bbd7846a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:35.633178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b54b1471-313a-4527-ab50-cb15bbd7846a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:35.641480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b54b1471-313a-4527-ab50-cb15bbd7846a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:35.642433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b54b1471-313a-4527-ab50-cb15bbd7846a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:35.643152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b54b1471-313a-4527-ab50-cb15bbd7846a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:35.828375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a5a9ccfa-c5ae-4bed-a448-91f852006625 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:35.850579 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a5a9ccfa-c5ae-4bed-a448-91f852006625 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1487 microversion: 2.1 time: 0.753462 Oct 04 21:12:35.850579 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 917/1816] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:35 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1487 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:35.888012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-91ab5d40-bdca-4b92-8bb7-5530e26009cc tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:35.892333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-91ab5d40-bdca-4b92-8bb7-5530e26009cc tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:35.926015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91ab5d40-bdca-4b92-8bb7-5530e26009cc tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:35.927450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91ab5d40-bdca-4b92-8bb7-5530e26009cc tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:35.929554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91ab5d40-bdca-4b92-8bb7-5530e26009cc tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:35.935410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91ab5d40-bdca-4b92-8bb7-5530e26009cc tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:35.936345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91ab5d40-bdca-4b92-8bb7-5530e26009cc tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:35.948312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91ab5d40-bdca-4b92-8bb7-5530e26009cc tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:36.151285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b54b1471-313a-4527-ab50-cb15bbd7846a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:36.166976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b54b1471-313a-4527-ab50-cb15bbd7846a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:36.169564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b54b1471-313a-4527-ab50-cb15bbd7846a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:36.176631 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b54b1471-313a-4527-ab50-cb15bbd7846a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1292 microversion: 2.25 time: 0.602592 Oct 04 21:12:36.199462 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 900/1817] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:35 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1292 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:36.210068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6954b27f-f0e1-4964-964e-281d779fa2fb tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:36.210068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6954b27f-f0e1-4964-964e-281d779fa2fb tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: 04b031f2-40e3-486e-9066-ff87fbffb8ec] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:36.228579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6954b27f-f0e1-4964-964e-281d779fa2fb tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:36.233352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6954b27f-f0e1-4964-964e-281d779fa2fb tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:36.234093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6954b27f-f0e1-4964-964e-281d779fa2fb tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:36.235283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6954b27f-f0e1-4964-964e-281d779fa2fb tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:36.235913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6954b27f-f0e1-4964-964e-281d779fa2fb tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:36.236530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6954b27f-f0e1-4964-964e-281d779fa2fb tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:36.496583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-91ab5d40-bdca-4b92-8bb7-5530e26009cc tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:36.505883 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-91ab5d40-bdca-4b92-8bb7-5530e26009cc tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 200 len: 1316 microversion: 2.1 time: 0.653169 Oct 04 21:12:36.507053 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 918/1818] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:35 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 1316 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:36.513440 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ed8d77d9-e489-4916-806c-e1380ff15b61 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:36.529555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=28 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:36.531737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed8d77d9-e489-4916-806c-e1380ff15b61 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:36.532987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed8d77d9-e489-4916-806c-e1380ff15b61 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:36.533447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed8d77d9-e489-4916-806c-e1380ff15b61 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:36.547840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6954b27f-f0e1-4964-964e-281d779fa2fb tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:36.568122 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6954b27f-f0e1-4964-964e-281d779fa2fb tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec" status: 200 len: 1322 microversion: 2.1 time: 0.367145 Oct 04 21:12:36.579169 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 901/1819] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:36 2022] GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec => generated 1322 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:36.584633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f083d674-5ba7-44d7-9c46-39e901020cf1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:36.596624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f083d674-5ba7-44d7-9c46-39e901020cf1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:36.603524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f083d674-5ba7-44d7-9c46-39e901020cf1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:36.604030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f083d674-5ba7-44d7-9c46-39e901020cf1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:36.605032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f083d674-5ba7-44d7-9c46-39e901020cf1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:36.606704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f083d674-5ba7-44d7-9c46-39e901020cf1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:36.607194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f083d674-5ba7-44d7-9c46-39e901020cf1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:36.607636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f083d674-5ba7-44d7-9c46-39e901020cf1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:36.657700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ed8d77d9-e489-4916-806c-e1380ff15b61 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Going to try to stop instance {{(pid=122758) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:12:36.877576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f083d674-5ba7-44d7-9c46-39e901020cf1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:36.884824 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f083d674-5ba7-44d7-9c46-39e901020cf1 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1392 microversion: 2.1 time: 0.314329 Oct 04 21:12:36.885603 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 902/1820] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:36 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1392 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:36.907326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-073779b7-f881-46c5-b090-08227e3604eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:36.908331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-073779b7-f881-46c5-b090-08227e3604eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:36.922713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-073779b7-f881-46c5-b090-08227e3604eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:36.923603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-073779b7-f881-46c5-b090-08227e3604eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:36.924346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-073779b7-f881-46c5-b090-08227e3604eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:36.925307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-073779b7-f881-46c5-b090-08227e3604eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:36.927654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-073779b7-f881-46c5-b090-08227e3604eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:36.928487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-073779b7-f881-46c5-b090-08227e3604eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:36.929367 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ed8d77d9-e489-4916-806c-e1380ff15b61 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "POST /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce/action" status: 202 len: 0 microversion: 2.1 time: 0.420363 Oct 04 21:12:36.933914 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 919/1821] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:12:36 2022] POST /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:12:36.940663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-656cb6e5-8b01-4794-bae6-96c7bf55960c tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:36.945294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-656cb6e5-8b01-4794-bae6-96c7bf55960c tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] [instance: c435602c-12c6-4356-8fb7-5883305ea5f0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:36.961542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-656cb6e5-8b01-4794-bae6-96c7bf55960c tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:36.962333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-656cb6e5-8b01-4794-bae6-96c7bf55960c tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:36.962859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-656cb6e5-8b01-4794-bae6-96c7bf55960c tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:36.964466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-656cb6e5-8b01-4794-bae6-96c7bf55960c tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:36.965781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-656cb6e5-8b01-4794-bae6-96c7bf55960c tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:36.966678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-656cb6e5-8b01-4794-bae6-96c7bf55960c tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:37.171958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-073779b7-f881-46c5-b090-08227e3604eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:37.187196 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-073779b7-f881-46c5-b090-08227e3604eb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1470 microversion: 2.1 time: 0.285446 Oct 04 21:12:37.188459 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 903/1822] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:36 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1470 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:37.195008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-8e25edc6-e1ab-49c9-8ef5-9ce3b60d6680 req-687ba98a-1cda-4574-b5de-f67c5bf2bca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c86d6b4-12a8-464a-84d7-2d6454aee597", "tag": "9229c565-3c30-423f-9b59-78ca89772437"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:37.206325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-656cb6e5-8b01-4794-bae6-96c7bf55960c tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64760b4bb6a54c048008aa00f4ecd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9adbb13ad5d4747be2d0ceb588255ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:37.210343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8e25edc6-e1ab-49c9-8ef5-9ce3b60d6680 req-687ba98a-1cda-4574-b5de-f67c5bf2bca7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:37.212640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8e25edc6-e1ab-49c9-8ef5-9ce3b60d6680 req-687ba98a-1cda-4574-b5de-f67c5bf2bca7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:37.213263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8e25edc6-e1ab-49c9-8ef5-9ce3b60d6680 req-687ba98a-1cda-4574-b5de-f67c5bf2bca7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:37.215159 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-656cb6e5-8b01-4794-bae6-96c7bf55960c tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] 10.222.0.30 "GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0" status: 200 len: 1528 microversion: 2.1 time: 0.283295 Oct 04 21:12:37.215921 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 920/1823] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:36 2022] GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0 => generated 1528 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:37.220937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-263aa9c5-f7b4-4342-a5ff-475cd0062ce7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:37.221675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-263aa9c5-f7b4-4342-a5ff-475cd0062ce7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:37.227878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-263aa9c5-f7b4-4342-a5ff-475cd0062ce7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:37.239379 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-8e25edc6-e1ab-49c9-8ef5-9ce3b60d6680 req-687ba98a-1cda-4574-b5de-f67c5bf2bca7 service nova] Creating event network-changed:9229c565-3c30-423f-9b59-78ca89772437 for instance 4c86d6b4-12a8-464a-84d7-2d6454aee597 on n-h2-860282-1 Oct 04 21:12:37.246604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-263aa9c5-f7b4-4342-a5ff-475cd0062ce7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:37.246604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-263aa9c5-f7b4-4342-a5ff-475cd0062ce7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:37.246604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-263aa9c5-f7b4-4342-a5ff-475cd0062ce7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:37.246604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-263aa9c5-f7b4-4342-a5ff-475cd0062ce7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:37.247123 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-8e25edc6-e1ab-49c9-8ef5-9ce3b60d6680 req-687ba98a-1cda-4574-b5de-f67c5bf2bca7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053408 Oct 04 21:12:37.247235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-263aa9c5-f7b4-4342-a5ff-475cd0062ce7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:37.247373 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 904/1824] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:37.253531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3cbd2efa-afe5-4a2b-a687-7a1235a18819 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:37.254236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3cbd2efa-afe5-4a2b-a687-7a1235a18819 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:37.261738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3cbd2efa-afe5-4a2b-a687-7a1235a18819 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:37.263855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3cbd2efa-afe5-4a2b-a687-7a1235a18819 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:37.268127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3cbd2efa-afe5-4a2b-a687-7a1235a18819 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:37.268127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3cbd2efa-afe5-4a2b-a687-7a1235a18819 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:37.268127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3cbd2efa-afe5-4a2b-a687-7a1235a18819 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:37.268127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3cbd2efa-afe5-4a2b-a687-7a1235a18819 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:37.521084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3cbd2efa-afe5-4a2b-a687-7a1235a18819 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:37.527987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-263aa9c5-f7b4-4342-a5ff-475cd0062ce7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:37.537985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3cbd2efa-afe5-4a2b-a687-7a1235a18819 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:37.543895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3cbd2efa-afe5-4a2b-a687-7a1235a18819 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:37.543895 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3cbd2efa-afe5-4a2b-a687-7a1235a18819 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1292 microversion: 2.25 time: 0.294165 Oct 04 21:12:37.544175 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-263aa9c5-f7b4-4342-a5ff-475cd0062ce7 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1497 microversion: 2.1 time: 0.324333 Oct 04 21:12:37.544175 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 921/1825] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:37 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1497 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:37.544399 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 905/1826] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:37 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1292 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:37.548072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-988cce6d-930d-40e0-bf82-efc0afaa3267 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:37.549556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-988cce6d-930d-40e0-bf82-efc0afaa3267 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:37.556957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-988cce6d-930d-40e0-bf82-efc0afaa3267 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:37.557895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-988cce6d-930d-40e0-bf82-efc0afaa3267 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:37.558822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-988cce6d-930d-40e0-bf82-efc0afaa3267 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:37.559774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-988cce6d-930d-40e0-bf82-efc0afaa3267 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:37.560389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-988cce6d-930d-40e0-bf82-efc0afaa3267 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:37.560994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-988cce6d-930d-40e0-bf82-efc0afaa3267 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:37.593117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-72d5c52b-8291-4457-aea1-fa207c73e50e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:37.597340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-72d5c52b-8291-4457-aea1-fa207c73e50e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: 04b031f2-40e3-486e-9066-ff87fbffb8ec] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:37.615001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72d5c52b-8291-4457-aea1-fa207c73e50e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:37.615503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72d5c52b-8291-4457-aea1-fa207c73e50e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:37.615941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72d5c52b-8291-4457-aea1-fa207c73e50e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:37.620163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72d5c52b-8291-4457-aea1-fa207c73e50e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:37.620940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72d5c52b-8291-4457-aea1-fa207c73e50e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:37.621959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72d5c52b-8291-4457-aea1-fa207c73e50e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:37.927200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-72d5c52b-8291-4457-aea1-fa207c73e50e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:37.937805 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-72d5c52b-8291-4457-aea1-fa207c73e50e tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec" status: 200 len: 1472 microversion: 2.1 time: 0.350055 Oct 04 21:12:37.951852 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 906/1827] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:37 2022] GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec => generated 1472 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:37.953052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-988cce6d-930d-40e0-bf82-efc0afaa3267 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:37.962537 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-988cce6d-930d-40e0-bf82-efc0afaa3267 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 200 len: 1316 microversion: 2.1 time: 0.419134 Oct 04 21:12:37.963459 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 922/1828] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:37 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:37.967678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0561f5ff-30b2-4efc-bdb2-908b6cd7d915 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:37.972142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0561f5ff-30b2-4efc-bdb2-908b6cd7d915 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:37.988535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0561f5ff-30b2-4efc-bdb2-908b6cd7d915 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:37.989558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0561f5ff-30b2-4efc-bdb2-908b6cd7d915 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:37.990177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0561f5ff-30b2-4efc-bdb2-908b6cd7d915 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:37.991064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0561f5ff-30b2-4efc-bdb2-908b6cd7d915 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:37.991816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0561f5ff-30b2-4efc-bdb2-908b6cd7d915 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:37.992912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0561f5ff-30b2-4efc-bdb2-908b6cd7d915 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:38.181746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0561f5ff-30b2-4efc-bdb2-908b6cd7d915 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:38.194668 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0561f5ff-30b2-4efc-bdb2-908b6cd7d915 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1392 microversion: 2.1 time: 0.241399 Oct 04 21:12:38.212421 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 907/1829] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:37 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1392 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:38.212421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-e22a8c68-8ad6-4b41-ac5a-2d0d65401599 req-de8b47a0-2af9-4924-b5e4-95ef5d254e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c435602c-12c6-4356-8fb7-5883305ea5f0", "name": "network-vif-deleted", "tag": "65ccfa33-2e93-431f-b01b-e2f73b23dcea"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:38.232356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e22a8c68-8ad6-4b41-ac5a-2d0d65401599 req-de8b47a0-2af9-4924-b5e4-95ef5d254e3a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:38.241568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e22a8c68-8ad6-4b41-ac5a-2d0d65401599 req-de8b47a0-2af9-4924-b5e4-95ef5d254e3a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:38.243477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e22a8c68-8ad6-4b41-ac5a-2d0d65401599 req-de8b47a0-2af9-4924-b5e4-95ef5d254e3a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:38.249213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b27d2cf8-ba0c-435e-bd2e-7c96011c492c tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:38.250969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b27d2cf8-ba0c-435e-bd2e-7c96011c492c tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] [instance: 775df8d1-fb81-4e08-b040-2d7c661f5956] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:38.265128 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-e22a8c68-8ad6-4b41-ac5a-2d0d65401599 req-de8b47a0-2af9-4924-b5e4-95ef5d254e3a service nova] Creating event network-vif-deleted:65ccfa33-2e93-431f-b01b-e2f73b23dcea for instance c435602c-12c6-4356-8fb7-5883305ea5f0 on n-h2-860282-1 Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-b27d2cf8-ba0c-435e-bd2e-7c96011c492c tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] HTTP exception thrown: Instance 775df8d1-fb81-4e08-b040-2d7c661f5956 could not be found. Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b27d2cf8-ba0c-435e-bd2e-7c96011c492c tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Request method failure captured: Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/775df8d1-fb81-4e08-b040-2d7c661f5956/action HTTP/1.1 Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 15 Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKGszvyjgavIMCp3eaOQztnuWW_0msh-zOsnYOJ2APZaP7DjyQcaY8WDQR4T12H3Pl0BFA9MxsUrCdBCKM_JkQahu81di7TRrsWtKWtzImjzeEKVBRX3bUBxXHIx532Z0rVBTtjKvH-VzFjJQIXLfoZ5oRRczYQbZ7I9FnHJzzZmlNk Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: b288159fdd074bd4a1947d38bcb5fb7a Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1207072545 Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b288159fdd074bd4a1947d38bcb5fb7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b288159fdd074bd4a1947d38bcb5fb7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b288159fdd074bd4a1947d38bcb5fb7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b288159fdd074bd4a1947d38bcb5fb7a"}]}] Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1207072545 Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: b288159fdd074bd4a1947d38bcb5fb7a Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1207072545 Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersAdminNegativeTestJSON-1207072545-project-admin Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 78e967adc4f846c8aba9ff9593da90ed Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1207072545-project-admin Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: {"migrate": {}} Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 775df8d1-fb81-4e08-b040-2d7c661f5956 could not be found. Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '775df8d1-fb81-4e08-b040-2d7c661f5956', 'body': {'migrate': {}}} Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 775df8d1-fb81-4e08-b040-2d7c661f5956 could not be found. Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:12:38.271711 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:12:38.277224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 775df8d1-fb81-4e08-b040-2d7c661f5956 could not be found. Oct 04 21:12:38.277224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:38.277224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:38.277224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:38.277224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:38.277224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:38.277224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:38.277224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:12:38.277224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:12:38.277224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 775df8d1-fb81-4e08-b040-2d7c661f5956 could not be found. Oct 04 21:12:38.277224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:38.277224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b27d2cf8-ba0c-435e-bd2e-7c96011c492c tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Returning 404 to user: Instance 775df8d1-fb81-4e08-b040-2d7c661f5956 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:12:38.277224 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b27d2cf8-ba0c-435e-bd2e-7c96011c492c tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/775df8d1-fb81-4e08-b040-2d7c661f5956/action" status: 404 len: 111 microversion: 2.1 time: 0.306359 Oct 04 21:12:38.277224 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 923/1830] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:12:37 2022] POST /compute/v2.1/servers/775df8d1-fb81-4e08-b040-2d7c661f5956/action => generated 111 bytes in 307 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:12:38.278560 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-e22a8c68-8ad6-4b41-ac5a-2d0d65401599 req-de8b47a0-2af9-4924-b5e4-95ef5d254e3a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067328 Oct 04 21:12:38.278560 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 908/1831] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:38.292469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dc192d84-b82e-43f5-924d-ce7eceecdce6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:38.294171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dc192d84-b82e-43f5-924d-ce7eceecdce6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:38.298592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a5e87ef7-c5cf-4c00-9974-d027618d595a tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:38.301889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a5e87ef7-c5cf-4c00-9974-d027618d595a tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] [instance: c435602c-12c6-4356-8fb7-5883305ea5f0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:38.303289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc192d84-b82e-43f5-924d-ce7eceecdce6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:38.304006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc192d84-b82e-43f5-924d-ce7eceecdce6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:38.304665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc192d84-b82e-43f5-924d-ce7eceecdce6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:38.313941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc192d84-b82e-43f5-924d-ce7eceecdce6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:38.314679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc192d84-b82e-43f5-924d-ce7eceecdce6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:38.315363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc192d84-b82e-43f5-924d-ce7eceecdce6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:38.316005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5e87ef7-c5cf-4c00-9974-d027618d595a tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:38.316521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5e87ef7-c5cf-4c00-9974-d027618d595a tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:38.316973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5e87ef7-c5cf-4c00-9974-d027618d595a tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:38.319714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5e87ef7-c5cf-4c00-9974-d027618d595a tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:38.320724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5e87ef7-c5cf-4c00-9974-d027618d595a tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:38.321180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5e87ef7-c5cf-4c00-9974-d027618d595a tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:38.536123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a5e87ef7-c5cf-4c00-9974-d027618d595a tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64760b4bb6a54c048008aa00f4ecd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9adbb13ad5d4747be2d0ceb588255ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:38.546796 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a5e87ef7-c5cf-4c00-9974-d027618d595a tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] 10.222.0.30 "GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0" status: 200 len: 1486 microversion: 2.1 time: 0.266694 Oct 04 21:12:38.552174 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 909/1832] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:38 2022] GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0 => generated 1486 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:38.578975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-52bc5e10-e626-4d95-bb60-d637a8cff521 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:38.579821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-52bc5e10-e626-4d95-bb60-d637a8cff521 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:38.591606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52bc5e10-e626-4d95-bb60-d637a8cff521 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:38.600914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52bc5e10-e626-4d95-bb60-d637a8cff521 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:38.602377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52bc5e10-e626-4d95-bb60-d637a8cff521 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:38.604466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52bc5e10-e626-4d95-bb60-d637a8cff521 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:38.605074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52bc5e10-e626-4d95-bb60-d637a8cff521 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:38.606236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52bc5e10-e626-4d95-bb60-d637a8cff521 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:38.906128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dc192d84-b82e-43f5-924d-ce7eceecdce6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:38.920601 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dc192d84-b82e-43f5-924d-ce7eceecdce6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1470 microversion: 2.1 time: 0.637444 Oct 04 21:12:38.933721 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 924/1833] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:38 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1470 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:38.952556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-feadcd9f-4201-4f34-9f2a-fb0295f7e1ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:38.955941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-feadcd9f-4201-4f34-9f2a-fb0295f7e1ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:38.976514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feadcd9f-4201-4f34-9f2a-fb0295f7e1ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:38.977904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feadcd9f-4201-4f34-9f2a-fb0295f7e1ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:38.978977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feadcd9f-4201-4f34-9f2a-fb0295f7e1ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:38.988269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feadcd9f-4201-4f34-9f2a-fb0295f7e1ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:38.989143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feadcd9f-4201-4f34-9f2a-fb0295f7e1ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:38.991431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feadcd9f-4201-4f34-9f2a-fb0295f7e1ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:39.035853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-52bc5e10-e626-4d95-bb60-d637a8cff521 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:39.050196 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-52bc5e10-e626-4d95-bb60-d637a8cff521 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1497 microversion: 2.1 time: 0.477902 Oct 04 21:12:39.050939 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 910/1834] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:38 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1497 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:12:39.055489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e730dead-f097-4c8d-b946-5fc9384ba0b3 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1850849705", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:39.146176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-e730dead-f097-4c8d-b946-5fc9384ba0b3 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] validate_networks() for None {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:12:39.502835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-feadcd9f-4201-4f34-9f2a-fb0295f7e1ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:39.518204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-feadcd9f-4201-4f34-9f2a-fb0295f7e1ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:39.520166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-feadcd9f-4201-4f34-9f2a-fb0295f7e1ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:39.521664 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-feadcd9f-4201-4f34-9f2a-fb0295f7e1ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1292 microversion: 2.25 time: 0.598698 Oct 04 21:12:39.540834 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 925/1835] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:38 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1292 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:39.557931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6deea11c-189e-4726-82b5-1214494c62e6 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:39.564845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6deea11c-189e-4726-82b5-1214494c62e6 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:39.566127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6deea11c-189e-4726-82b5-1214494c62e6 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:39.566752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6deea11c-189e-4726-82b5-1214494c62e6 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:39.567453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6deea11c-189e-4726-82b5-1214494c62e6 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:39.568313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6deea11c-189e-4726-82b5-1214494c62e6 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:39.568853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6deea11c-189e-4726-82b5-1214494c62e6 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:39.571213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6deea11c-189e-4726-82b5-1214494c62e6 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:40.245348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e730dead-f097-4c8d-b946-5fc9384ba0b3 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:12:40.245972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e730dead-f097-4c8d-b946-5fc9384ba0b3 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:12:40.246413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e730dead-f097-4c8d-b946-5fc9384ba0b3 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:12:40.246950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e730dead-f097-4c8d-b946-5fc9384ba0b3 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:12:40.247390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e730dead-f097-4c8d-b946-5fc9384ba0b3 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:12:40.260509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6deea11c-189e-4726-82b5-1214494c62e6 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:40.273276 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6deea11c-189e-4726-82b5-1214494c62e6 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 200 len: 1316 microversion: 2.1 time: 0.730697 Oct 04 21:12:40.277871 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 926/1836] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:39 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 1316 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:40.284354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-203dd7a7-6961-4eb9-92c5-3e252dce4d8f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:40.285078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-203dd7a7-6961-4eb9-92c5-3e252dce4d8f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:40.287813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e730dead-f097-4c8d-b946-5fc9384ba0b3 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:40.288319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e730dead-f097-4c8d-b946-5fc9384ba0b3 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:40.288769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e730dead-f097-4c8d-b946-5fc9384ba0b3 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:40.297504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e730dead-f097-4c8d-b946-5fc9384ba0b3 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:40.297504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e730dead-f097-4c8d-b946-5fc9384ba0b3 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:40.297504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e730dead-f097-4c8d-b946-5fc9384ba0b3 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:40.303554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-203dd7a7-6961-4eb9-92c5-3e252dce4d8f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:40.304062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-203dd7a7-6961-4eb9-92c5-3e252dce4d8f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:40.304774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-203dd7a7-6961-4eb9-92c5-3e252dce4d8f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:40.305724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-203dd7a7-6961-4eb9-92c5-3e252dce4d8f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:40.306358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-203dd7a7-6961-4eb9-92c5-3e252dce4d8f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:40.307117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-203dd7a7-6961-4eb9-92c5-3e252dce4d8f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:40.342083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-e730dead-f097-4c8d-b946-5fc9384ba0b3 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Getting quotas for project f439ca730404443ba4b48e7fb79b62ac. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:12:40.349171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-e730dead-f097-4c8d-b946-5fc9384ba0b3 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Getting quotas for user 1d298c8e0c0a4186a15c745957c691fa and project f439ca730404443ba4b48e7fb79b62ac. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:12:40.365376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e730dead-f097-4c8d-b946-5fc9384ba0b3 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:12:40.383617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e730dead-f097-4c8d-b946-5fc9384ba0b3 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:12:40.603549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-203dd7a7-6961-4eb9-92c5-3e252dce4d8f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:40.611613 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-203dd7a7-6961-4eb9-92c5-3e252dce4d8f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1392 microversion: 2.1 time: 0.336428 Oct 04 21:12:40.614725 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 927/1837] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:40 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1392 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:40.617143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-842ecc86-db09-430f-a4c7-89b7649dc676 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:40.618084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-842ecc86-db09-430f-a4c7-89b7649dc676 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] [instance: c435602c-12c6-4356-8fb7-5883305ea5f0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:40.625258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-842ecc86-db09-430f-a4c7-89b7649dc676 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:40.625996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-842ecc86-db09-430f-a4c7-89b7649dc676 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:40.626591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-842ecc86-db09-430f-a4c7-89b7649dc676 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:40.626834 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e730dead-f097-4c8d-b946-5fc9384ba0b3 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.575031 Oct 04 21:12:40.627754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-842ecc86-db09-430f-a4c7-89b7649dc676 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:40.628512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-842ecc86-db09-430f-a4c7-89b7649dc676 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:40.629009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-842ecc86-db09-430f-a4c7-89b7649dc676 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:40.634438 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 911/1838] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:12:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:12:40.640742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-06a770b4-e657-49a9-a5aa-0705b6e0de41 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:40.649145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-06a770b4-e657-49a9-a5aa-0705b6e0de41 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:40.649302 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-842ecc86-db09-430f-a4c7-89b7649dc676 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] HTTP exception thrown: Instance c435602c-12c6-4356-8fb7-5883305ea5f0 could not be found. Oct 04 21:12:40.649686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06a770b4-e657-49a9-a5aa-0705b6e0de41 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:40.650351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06a770b4-e657-49a9-a5aa-0705b6e0de41 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:40.650972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06a770b4-e657-49a9-a5aa-0705b6e0de41 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:40.651877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06a770b4-e657-49a9-a5aa-0705b6e0de41 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:40.653044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06a770b4-e657-49a9-a5aa-0705b6e0de41 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:40.653683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06a770b4-e657-49a9-a5aa-0705b6e0de41 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-842ecc86-db09-430f-a4c7-89b7649dc676 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Request method failure captured: Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0 HTTP/1.1 Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKGfWk9lkUtA1dx_mD11pUmTNCnXcLN3rsnBFU2QLGbS3MWGaoaLRII18g1R31oKtFghsxcZ6cAt9l4PF6qy3_jrCmkN9kv8wTfidM9Qv0jkZBZ0mUzpGXX--5S5YM5gEAAcGI_Bfp9ww-G2542Mrq1QI2QmAimb6TNUsg9W-crlwlc Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: b9adbb13ad5d4747be2d0ceb588255ab Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-133353342 Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9adbb13ad5d4747be2d0ceb588255ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9adbb13ad5d4747be2d0ceb588255ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9adbb13ad5d4747be2d0ceb588255ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9adbb13ad5d4747be2d0ceb588255ab"}]}] Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-133353342 Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: b9adbb13ad5d4747be2d0ceb588255ab Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-133353342 Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerAddressesNegativeTestJSON-133353342-project Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 64760b4bb6a54c048008aa00f4ecd163 Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-133353342-project Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance c435602c-12c6-4356-8fb7-5883305ea5f0 could not be found. Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'c435602c-12c6-4356-8fb7-5883305ea5f0'} Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c435602c-12c6-4356-8fb7-5883305ea5f0 could not be found. Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c435602c-12c6-4356-8fb7-5883305ea5f0 could not be found. Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:40.667099 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:40.673217 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:40.673217 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:40.673217 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:40.673217 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:40.673217 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:12:40.673217 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:12:40.673217 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c435602c-12c6-4356-8fb7-5883305ea5f0 could not be found. Oct 04 21:12:40.673217 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:40.686692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-842ecc86-db09-430f-a4c7-89b7649dc676 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] Returning 404 to user: Instance c435602c-12c6-4356-8fb7-5883305ea5f0 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:12:40.687272 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-842ecc86-db09-430f-a4c7-89b7649dc676 tempest-ServerAddressesNegativeTestJSON-133353342 tempest-ServerAddressesNegativeTestJSON-133353342-project] 10.222.0.30 "GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0" status: 404 len: 111 microversion: 2.1 time: 0.073927 Oct 04 21:12:40.693137 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 928/1839] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:40 2022] GET /compute/v2.1/servers/c435602c-12c6-4356-8fb7-5883305ea5f0 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:12:40.700276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-70863c50-3ec4-4863-a029-813709e21262 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:40.706391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-70863c50-3ec4-4863-a029-813709e21262 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:40.713750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70863c50-3ec4-4863-a029-813709e21262 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:40.714166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70863c50-3ec4-4863-a029-813709e21262 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:40.715592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70863c50-3ec4-4863-a029-813709e21262 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:40.719230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70863c50-3ec4-4863-a029-813709e21262 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:40.722026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70863c50-3ec4-4863-a029-813709e21262 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:40.722690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70863c50-3ec4-4863-a029-813709e21262 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:41.159869 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-70863c50-3ec4-4863-a029-813709e21262 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:41.170897 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-70863c50-3ec4-4863-a029-813709e21262 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1497 microversion: 2.1 time: 0.476398 Oct 04 21:12:41.181478 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 929/1840] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:40 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1497 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:41.182197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-06a770b4-e657-49a9-a5aa-0705b6e0de41 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:41.201352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-09bdc6ed-f9bc-4d21-87bd-9fed8a2ccae4 req-9a22b6e3-cf22-47dd-a58e-a14315ad7d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95674198-fb96-434e-82bf-f3b189599f0e", "name": "network-vif-unplugged", "status": "completed", "tag": "9e441d3d-b8e8-4963-9f5c-ac245f115ac5"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:41.205222 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-06a770b4-e657-49a9-a5aa-0705b6e0de41 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1470 microversion: 2.1 time: 0.569193 Oct 04 21:12:41.218081 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 912/1841] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:40 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1470 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:41.233961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-669fae05-50eb-4191-ab75-dadb86cce008 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:41.234585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-669fae05-50eb-4191-ab75-dadb86cce008 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:41.243541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-09bdc6ed-f9bc-4d21-87bd-9fed8a2ccae4 req-9a22b6e3-cf22-47dd-a58e-a14315ad7d4c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:41.244024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-09bdc6ed-f9bc-4d21-87bd-9fed8a2ccae4 req-9a22b6e3-cf22-47dd-a58e-a14315ad7d4c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:41.244569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-09bdc6ed-f9bc-4d21-87bd-9fed8a2ccae4 req-9a22b6e3-cf22-47dd-a58e-a14315ad7d4c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:41.246716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-669fae05-50eb-4191-ab75-dadb86cce008 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:41.248869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-669fae05-50eb-4191-ab75-dadb86cce008 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:41.251613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-669fae05-50eb-4191-ab75-dadb86cce008 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:41.260677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-669fae05-50eb-4191-ab75-dadb86cce008 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:41.260677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-669fae05-50eb-4191-ab75-dadb86cce008 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:41.260677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-669fae05-50eb-4191-ab75-dadb86cce008 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:41.268999 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-09bdc6ed-f9bc-4d21-87bd-9fed8a2ccae4 req-9a22b6e3-cf22-47dd-a58e-a14315ad7d4c service nova] Creating event network-vif-unplugged:9e441d3d-b8e8-4963-9f5c-ac245f115ac5 for instance 95674198-fb96-434e-82bf-f3b189599f0e on n-h1-860282-1 Oct 04 21:12:41.274922 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-09bdc6ed-f9bc-4d21-87bd-9fed8a2ccae4 req-9a22b6e3-cf22-47dd-a58e-a14315ad7d4c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102314 Oct 04 21:12:41.275769 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 930/1842] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:41.291639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5b4c7103-b4f6-4893-b8b2-9c51083bad79 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:41.291639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5b4c7103-b4f6-4893-b8b2-9c51083bad79 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:41.422279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5b4c7103-b4f6-4893-b8b2-9c51083bad79 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:41.433215 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5b4c7103-b4f6-4893-b8b2-9c51083bad79 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705" status: 200 len: 1222 microversion: 2.1 time: 0.149513 Oct 04 21:12:41.434284 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 931/1843] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:41 2022] GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 => generated 1222 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:41.441028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bad4cad9-3e22-4e96-b6d2-98fbc44a95f1 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:41.442114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bad4cad9-3e22-4e96-b6d2-98fbc44a95f1 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:41.458842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bad4cad9-3e22-4e96-b6d2-98fbc44a95f1 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:41.458842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bad4cad9-3e22-4e96-b6d2-98fbc44a95f1 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:41.458842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bad4cad9-3e22-4e96-b6d2-98fbc44a95f1 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:41.458842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bad4cad9-3e22-4e96-b6d2-98fbc44a95f1 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:41.458842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bad4cad9-3e22-4e96-b6d2-98fbc44a95f1 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:41.458842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bad4cad9-3e22-4e96-b6d2-98fbc44a95f1 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:41.609170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-669fae05-50eb-4191-ab75-dadb86cce008 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:41.619693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-669fae05-50eb-4191-ab75-dadb86cce008 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:41.622205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-669fae05-50eb-4191-ab75-dadb86cce008 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:41.623625 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-669fae05-50eb-4191-ab75-dadb86cce008 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1280 microversion: 2.25 time: 0.404507 Oct 04 21:12:41.624208 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 913/1844] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:41 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1280 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:41.642173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ded8339d-61db-4885-aab4-4542583b73a2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:41.642878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ded8339d-61db-4885-aab4-4542583b73a2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:41.649359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ded8339d-61db-4885-aab4-4542583b73a2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:41.650322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ded8339d-61db-4885-aab4-4542583b73a2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:41.650467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ded8339d-61db-4885-aab4-4542583b73a2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:41.651693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ded8339d-61db-4885-aab4-4542583b73a2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:41.652484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ded8339d-61db-4885-aab4-4542583b73a2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:41.652900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ded8339d-61db-4885-aab4-4542583b73a2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:41.775114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bad4cad9-3e22-4e96-b6d2-98fbc44a95f1 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:41.784179 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bad4cad9-3e22-4e96-b6d2-98fbc44a95f1 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 200 len: 1316 microversion: 2.1 time: 0.348754 Oct 04 21:12:41.785077 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 932/1845] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:41 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:41.964454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ded8339d-61db-4885-aab4-4542583b73a2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:41.975693 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ded8339d-61db-4885-aab4-4542583b73a2 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1392 microversion: 2.1 time: 0.339041 Oct 04 21:12:41.976284 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 914/1846] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:41 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1392 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:42.195786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-545536de-ac86-4d8a-adf1-8ec419054e80 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:42.196447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-545536de-ac86-4d8a-adf1-8ec419054e80 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:42.202694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-545536de-ac86-4d8a-adf1-8ec419054e80 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:42.203185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-545536de-ac86-4d8a-adf1-8ec419054e80 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:42.203628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-545536de-ac86-4d8a-adf1-8ec419054e80 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:42.204399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-545536de-ac86-4d8a-adf1-8ec419054e80 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:42.204862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-545536de-ac86-4d8a-adf1-8ec419054e80 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:42.205294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-545536de-ac86-4d8a-adf1-8ec419054e80 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:42.209818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:42.234370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-239e5609-c144-4f43-a5ab-7989ecc5528e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:42.235288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-239e5609-c144-4f43-a5ab-7989ecc5528e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:42.242631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-239e5609-c144-4f43-a5ab-7989ecc5528e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:42.243390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-239e5609-c144-4f43-a5ab-7989ecc5528e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:42.244019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-239e5609-c144-4f43-a5ab-7989ecc5528e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:42.244916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-239e5609-c144-4f43-a5ab-7989ecc5528e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:42.245652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-239e5609-c144-4f43-a5ab-7989ecc5528e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:42.246978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-239e5609-c144-4f43-a5ab-7989ecc5528e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:42.562385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-545536de-ac86-4d8a-adf1-8ec419054e80 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:42.567608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-239e5609-c144-4f43-a5ab-7989ecc5528e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:42.573707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:42.583463 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-239e5609-c144-4f43-a5ab-7989ecc5528e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1475 microversion: 2.1 time: 0.353346 Oct 04 21:12:42.585025 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 915/1847] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:42 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1475 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:12:42.586675 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-545536de-ac86-4d8a-adf1-8ec419054e80 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1497 microversion: 2.1 time: 0.394912 Oct 04 21:12:42.595499 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 933/1848] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:42 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1497 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:42.609067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-a964fc7e-21f2-431b-8788-feb05a5b57d1 req-968ff8e8-4ec5-480e-97ed-e2ee04e0de20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47ef2ed7-3bd6-443a-84dd-5eda292e483d", "name": "network-vif-plugged", "status": "completed", "tag": "65d1e6fd-5827-4499-92a8-5c2559cce40f"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:42.610273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7b26b123-625f-48d5-8292-b0335a38ffc7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:42.611999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7b26b123-625f-48d5-8292-b0335a38ffc7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:42.622281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b26b123-625f-48d5-8292-b0335a38ffc7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:42.622958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b26b123-625f-48d5-8292-b0335a38ffc7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:42.623512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b26b123-625f-48d5-8292-b0335a38ffc7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:42.624316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b26b123-625f-48d5-8292-b0335a38ffc7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:42.624533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a964fc7e-21f2-431b-8788-feb05a5b57d1 req-968ff8e8-4ec5-480e-97ed-e2ee04e0de20 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:42.624909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a964fc7e-21f2-431b-8788-feb05a5b57d1 req-968ff8e8-4ec5-480e-97ed-e2ee04e0de20 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:42.625351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a964fc7e-21f2-431b-8788-feb05a5b57d1 req-968ff8e8-4ec5-480e-97ed-e2ee04e0de20 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:42.625595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b26b123-625f-48d5-8292-b0335a38ffc7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:42.626125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b26b123-625f-48d5-8292-b0335a38ffc7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:42.639800 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-a964fc7e-21f2-431b-8788-feb05a5b57d1 req-968ff8e8-4ec5-480e-97ed-e2ee04e0de20 service nova] Creating event network-vif-plugged:65d1e6fd-5827-4499-92a8-5c2559cce40f for instance 47ef2ed7-3bd6-443a-84dd-5eda292e483d on n-h2-860282-1 Oct 04 21:12:42.645078 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-a964fc7e-21f2-431b-8788-feb05a5b57d1 req-968ff8e8-4ec5-480e-97ed-e2ee04e0de20 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058522 Oct 04 21:12:42.646105 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 916/1849] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:42.668742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0b26fb87-dc5e-4929-b2b8-623bd478118b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:42.669703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0b26fb87-dc5e-4929-b2b8-623bd478118b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:42.676063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b26fb87-dc5e-4929-b2b8-623bd478118b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:42.676556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b26fb87-dc5e-4929-b2b8-623bd478118b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:42.677001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b26fb87-dc5e-4929-b2b8-623bd478118b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:42.677728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b26fb87-dc5e-4929-b2b8-623bd478118b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:42.678368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b26fb87-dc5e-4929-b2b8-623bd478118b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:42.678965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b26fb87-dc5e-4929-b2b8-623bd478118b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:42.738948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7b26b123-625f-48d5-8292-b0335a38ffc7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:42.750272 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7b26b123-625f-48d5-8292-b0335a38ffc7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705" status: 200 len: 1274 microversion: 2.1 time: 0.159038 Oct 04 21:12:42.755087 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 934/1850] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:42 2022] GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 => generated 1274 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:42.814607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d0b747e2-766d-4b65-bd30-1cb49eff3f8d tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:42.815714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d0b747e2-766d-4b65-bd30-1cb49eff3f8d tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:42.838711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0b747e2-766d-4b65-bd30-1cb49eff3f8d tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:42.841087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0b747e2-766d-4b65-bd30-1cb49eff3f8d tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:42.849573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0b747e2-766d-4b65-bd30-1cb49eff3f8d tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:42.849573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0b747e2-766d-4b65-bd30-1cb49eff3f8d tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:42.849573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0b747e2-766d-4b65-bd30-1cb49eff3f8d tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:42.849573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0b747e2-766d-4b65-bd30-1cb49eff3f8d tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:43.099055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0b26fb87-dc5e-4929-b2b8-623bd478118b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:43.111602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0b26fb87-dc5e-4929-b2b8-623bd478118b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:43.117215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0b26fb87-dc5e-4929-b2b8-623bd478118b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:43.118735 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0b26fb87-dc5e-4929-b2b8-623bd478118b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1280 microversion: 2.25 time: 0.463806 Oct 04 21:12:43.120492 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 917/1851] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:42 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1280 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:43.140141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b5aac297-e758-46f9-bc1c-a67da1798098 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:43.140809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b5aac297-e758-46f9-bc1c-a67da1798098 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:43.149934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5aac297-e758-46f9-bc1c-a67da1798098 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:43.150691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5aac297-e758-46f9-bc1c-a67da1798098 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:43.156411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5aac297-e758-46f9-bc1c-a67da1798098 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:43.156411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5aac297-e758-46f9-bc1c-a67da1798098 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:43.156411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5aac297-e758-46f9-bc1c-a67da1798098 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:43.156411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5aac297-e758-46f9-bc1c-a67da1798098 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:43.190238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d0b747e2-766d-4b65-bd30-1cb49eff3f8d tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:43.199623 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d0b747e2-766d-4b65-bd30-1cb49eff3f8d tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 200 len: 1316 microversion: 2.1 time: 0.393908 Oct 04 21:12:43.208127 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 935/1852] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:42 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 1316 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:43.298990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-dc50c426-5b05-42f6-839e-3092639a2b18 req-e7addaff-504a-48e2-a83d-c02a77ddf6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95674198-fb96-434e-82bf-f3b189599f0e", "tag": "9e441d3d-b8e8-4963-9f5c-ac245f115ac5"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:43.311389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-dc50c426-5b05-42f6-839e-3092639a2b18 req-e7addaff-504a-48e2-a83d-c02a77ddf6a3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:43.312163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-dc50c426-5b05-42f6-839e-3092639a2b18 req-e7addaff-504a-48e2-a83d-c02a77ddf6a3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:43.312777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-dc50c426-5b05-42f6-839e-3092639a2b18 req-e7addaff-504a-48e2-a83d-c02a77ddf6a3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:43.331338 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-dc50c426-5b05-42f6-839e-3092639a2b18 req-e7addaff-504a-48e2-a83d-c02a77ddf6a3 service nova] Creating event network-changed:9e441d3d-b8e8-4963-9f5c-ac245f115ac5 for instance 95674198-fb96-434e-82bf-f3b189599f0e on n-h1-860282-1 Oct 04 21:12:43.337667 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-dc50c426-5b05-42f6-839e-3092639a2b18 req-e7addaff-504a-48e2-a83d-c02a77ddf6a3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044393 Oct 04 21:12:43.341740 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 936/1853] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:12:43.488022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b5aac297-e758-46f9-bc1c-a67da1798098 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:43.496530 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b5aac297-e758-46f9-bc1c-a67da1798098 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1392 microversion: 2.1 time: 0.373450 Oct 04 21:12:43.497147 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 918/1854] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:43 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1392 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:43.611627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4812bf1a-78d8-4b1f-8438-98c1022a98e1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:43.612581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4812bf1a-78d8-4b1f-8438-98c1022a98e1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:43.619746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4812bf1a-78d8-4b1f-8438-98c1022a98e1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:43.619949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-44bc031d-4cab-49f6-be80-65adede6800b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:43.620496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-44bc031d-4cab-49f6-be80-65adede6800b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:43.622100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4812bf1a-78d8-4b1f-8438-98c1022a98e1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:43.622761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4812bf1a-78d8-4b1f-8438-98c1022a98e1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:43.627011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4812bf1a-78d8-4b1f-8438-98c1022a98e1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:43.627011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4812bf1a-78d8-4b1f-8438-98c1022a98e1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:43.627011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4812bf1a-78d8-4b1f-8438-98c1022a98e1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:43.638770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44bc031d-4cab-49f6-be80-65adede6800b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:43.639231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44bc031d-4cab-49f6-be80-65adede6800b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:43.643674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44bc031d-4cab-49f6-be80-65adede6800b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:43.645578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44bc031d-4cab-49f6-be80-65adede6800b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:43.650050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44bc031d-4cab-49f6-be80-65adede6800b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:43.650050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44bc031d-4cab-49f6-be80-65adede6800b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:44.381560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4812bf1a-78d8-4b1f-8438-98c1022a98e1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:44.394136 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4812bf1a-78d8-4b1f-8438-98c1022a98e1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1497 microversion: 2.1 time: 0.786690 Oct 04 21:12:44.395331 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 919/1855] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:43 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1497 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:44.400226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3b8db09c-3675-4ffe-8648-e26d1f14a125 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:44.410986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3b8db09c-3675-4ffe-8648-e26d1f14a125 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:44.411301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-44bc031d-4cab-49f6-be80-65adede6800b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:44.411448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b8db09c-3675-4ffe-8648-e26d1f14a125 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:44.411448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b8db09c-3675-4ffe-8648-e26d1f14a125 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:44.411448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b8db09c-3675-4ffe-8648-e26d1f14a125 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:44.411448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b8db09c-3675-4ffe-8648-e26d1f14a125 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:44.411448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b8db09c-3675-4ffe-8648-e26d1f14a125 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:44.412282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b8db09c-3675-4ffe-8648-e26d1f14a125 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:44.421091 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-44bc031d-4cab-49f6-be80-65adede6800b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1475 microversion: 2.1 time: 0.816839 Oct 04 21:12:44.437461 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 937/1856] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:43 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1475 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:44.437461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e165c2b3-e252-42c9-8190-142eda36b2af tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:44.443168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e165c2b3-e252-42c9-8190-142eda36b2af tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:44.456580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e165c2b3-e252-42c9-8190-142eda36b2af tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:44.457914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e165c2b3-e252-42c9-8190-142eda36b2af tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:44.459147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e165c2b3-e252-42c9-8190-142eda36b2af tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:44.460160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e165c2b3-e252-42c9-8190-142eda36b2af tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:44.463970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e165c2b3-e252-42c9-8190-142eda36b2af tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:44.464613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e165c2b3-e252-42c9-8190-142eda36b2af tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:44.516364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3b8db09c-3675-4ffe-8648-e26d1f14a125 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:44.535443 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3b8db09c-3675-4ffe-8648-e26d1f14a125 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705" status: 200 len: 1280 microversion: 2.1 time: 0.135908 Oct 04 21:12:44.555995 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 920/1857] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:44 2022] GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 => generated 1280 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:44.562690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8f87ef46-364f-4147-bd3f-4dba43c82ce4 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:44.563664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8f87ef46-364f-4147-bd3f-4dba43c82ce4 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:44.573540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f87ef46-364f-4147-bd3f-4dba43c82ce4 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:44.574521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f87ef46-364f-4147-bd3f-4dba43c82ce4 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:44.575762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f87ef46-364f-4147-bd3f-4dba43c82ce4 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:44.578316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f87ef46-364f-4147-bd3f-4dba43c82ce4 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:44.578316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f87ef46-364f-4147-bd3f-4dba43c82ce4 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:44.578316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f87ef46-364f-4147-bd3f-4dba43c82ce4 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:44.952756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8f87ef46-364f-4147-bd3f-4dba43c82ce4 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:44.961732 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8f87ef46-364f-4147-bd3f-4dba43c82ce4 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 200 len: 1316 microversion: 2.1 time: 0.404214 Oct 04 21:12:44.967552 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 921/1858] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:44 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:44.973938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e165c2b3-e252-42c9-8190-142eda36b2af tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:44.994243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-75b90a02-129d-4b13-9f54-2d4d4a189428 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:44.998442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e165c2b3-e252-42c9-8190-142eda36b2af tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:45.000970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-75b90a02-129d-4b13-9f54-2d4d4a189428 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:45.003162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e165c2b3-e252-42c9-8190-142eda36b2af tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:45.004402 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e165c2b3-e252-42c9-8190-142eda36b2af tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1280 microversion: 2.25 time: 0.576992 Oct 04 21:12:45.008653 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 938/1859] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:44 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1280 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:45.010708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75b90a02-129d-4b13-9f54-2d4d4a189428 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:45.011742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75b90a02-129d-4b13-9f54-2d4d4a189428 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:45.013440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75b90a02-129d-4b13-9f54-2d4d4a189428 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:45.013440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75b90a02-129d-4b13-9f54-2d4d4a189428 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:45.014174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75b90a02-129d-4b13-9f54-2d4d4a189428 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:45.014764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75b90a02-129d-4b13-9f54-2d4d4a189428 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:45.207869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-75b90a02-129d-4b13-9f54-2d4d4a189428 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:45.225116 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-75b90a02-129d-4b13-9f54-2d4d4a189428 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1392 microversion: 2.1 time: 0.256070 Oct 04 21:12:45.228883 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 922/1860] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:44 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1392 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:45.419684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-987a95c6-d187-49bc-9519-c630c23b61d6 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:45.420320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-987a95c6-d187-49bc-9519-c630c23b61d6 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:45.428356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-987a95c6-d187-49bc-9519-c630c23b61d6 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:45.429094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-987a95c6-d187-49bc-9519-c630c23b61d6 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:45.430429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-987a95c6-d187-49bc-9519-c630c23b61d6 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:45.434735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-987a95c6-d187-49bc-9519-c630c23b61d6 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:45.434735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-987a95c6-d187-49bc-9519-c630c23b61d6 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:45.434735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-987a95c6-d187-49bc-9519-c630c23b61d6 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:45.456716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-392b983a-7959-4507-8130-e67545cc88bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:45.456716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-392b983a-7959-4507-8130-e67545cc88bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:45.472418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-392b983a-7959-4507-8130-e67545cc88bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:45.472922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-392b983a-7959-4507-8130-e67545cc88bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:45.473361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-392b983a-7959-4507-8130-e67545cc88bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:45.474890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-392b983a-7959-4507-8130-e67545cc88bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:45.474890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-392b983a-7959-4507-8130-e67545cc88bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:45.486949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-392b983a-7959-4507-8130-e67545cc88bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:46.104720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-987a95c6-d187-49bc-9519-c630c23b61d6 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:46.118251 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-987a95c6-d187-49bc-9519-c630c23b61d6 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1497 microversion: 2.1 time: 0.703033 Oct 04 21:12:46.118450 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 939/1861] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:45 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1497 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:12:46.134061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3c0c50c3-74a2-4085-b216-2e192250a8c7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:46.135617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3c0c50c3-74a2-4085-b216-2e192250a8c7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:46.156802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:46.164397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c0c50c3-74a2-4085-b216-2e192250a8c7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:46.165608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c0c50c3-74a2-4085-b216-2e192250a8c7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:46.166308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c0c50c3-74a2-4085-b216-2e192250a8c7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:46.169907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c0c50c3-74a2-4085-b216-2e192250a8c7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:46.173589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c0c50c3-74a2-4085-b216-2e192250a8c7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:46.176928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c0c50c3-74a2-4085-b216-2e192250a8c7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:46.231783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-392b983a-7959-4507-8130-e67545cc88bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:46.243620 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-392b983a-7959-4507-8130-e67545cc88bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1475 microversion: 2.1 time: 0.796373 Oct 04 21:12:46.244942 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 923/1862] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:45 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1475 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:12:46.255243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7aab5821-c470-461d-be11-6b7f18475d98 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:46.256114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7aab5821-c470-461d-be11-6b7f18475d98 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:46.267287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7aab5821-c470-461d-be11-6b7f18475d98 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:46.274863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7aab5821-c470-461d-be11-6b7f18475d98 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:46.275593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7aab5821-c470-461d-be11-6b7f18475d98 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:46.277987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7aab5821-c470-461d-be11-6b7f18475d98 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:46.279010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7aab5821-c470-461d-be11-6b7f18475d98 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:46.282468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7aab5821-c470-461d-be11-6b7f18475d98 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:46.346876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3c0c50c3-74a2-4085-b216-2e192250a8c7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:46.365125 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3c0c50c3-74a2-4085-b216-2e192250a8c7 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705" status: 200 len: 1280 microversion: 2.1 time: 0.245569 Oct 04 21:12:46.374966 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 940/1863] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:46 2022] GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 => generated 1280 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:46.384660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5b758c2a-f223-46c3-91eb-caffeb94f16f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:46.386009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5b758c2a-f223-46c3-91eb-caffeb94f16f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:46.412002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5b758c2a-f223-46c3-91eb-caffeb94f16f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:46.412726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5b758c2a-f223-46c3-91eb-caffeb94f16f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:46.413190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5b758c2a-f223-46c3-91eb-caffeb94f16f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:46.413987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5b758c2a-f223-46c3-91eb-caffeb94f16f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:46.414645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5b758c2a-f223-46c3-91eb-caffeb94f16f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:46.415326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5b758c2a-f223-46c3-91eb-caffeb94f16f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:46.757549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7aab5821-c470-461d-be11-6b7f18475d98 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:46.765352 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7aab5821-c470-461d-be11-6b7f18475d98 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 200 len: 1505 microversion: 2.1 time: 0.515647 Oct 04 21:12:46.775845 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 924/1864] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:46 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:46.780923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a2ca8fff-a7eb-4444-b843-f2c6afaa444e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:46.781693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a2ca8fff-a7eb-4444-b843-f2c6afaa444e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:46.810381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2ca8fff-a7eb-4444-b843-f2c6afaa444e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:46.815807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2ca8fff-a7eb-4444-b843-f2c6afaa444e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:46.816502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2ca8fff-a7eb-4444-b843-f2c6afaa444e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:46.817482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2ca8fff-a7eb-4444-b843-f2c6afaa444e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:46.826280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2ca8fff-a7eb-4444-b843-f2c6afaa444e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:46.828832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5b758c2a-f223-46c3-91eb-caffeb94f16f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:46.829600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2ca8fff-a7eb-4444-b843-f2c6afaa444e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:46.844470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5b758c2a-f223-46c3-91eb-caffeb94f16f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:46.846550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5b758c2a-f223-46c3-91eb-caffeb94f16f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:46.849849 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5b758c2a-f223-46c3-91eb-caffeb94f16f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1280 microversion: 2.25 time: 0.473526 Oct 04 21:12:46.852113 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 941/1865] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:46 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1280 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:46.858551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-74ed1315-09e5-4802-ba1e-d5b51e88628b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:46.859526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-74ed1315-09e5-4802-ba1e-d5b51e88628b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:46.891772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74ed1315-09e5-4802-ba1e-d5b51e88628b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:46.891772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74ed1315-09e5-4802-ba1e-d5b51e88628b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:46.891772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74ed1315-09e5-4802-ba1e-d5b51e88628b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:46.892056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74ed1315-09e5-4802-ba1e-d5b51e88628b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:46.892304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74ed1315-09e5-4802-ba1e-d5b51e88628b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:46.902671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74ed1315-09e5-4802-ba1e-d5b51e88628b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:46.965632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-74ed1315-09e5-4802-ba1e-d5b51e88628b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:46.966666 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-74ed1315-09e5-4802-ba1e-d5b51e88628b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d/os-instance-actions/req-6f0c5027-9780-4990-a92a-dd2ab14df1ed" status: 200 len: 313 microversion: 2.1 time: 0.113395 Oct 04 21:12:46.967280 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 942/1866] 10.222.0.30 () {58 vars in 1419 bytes} [Tue Oct 4 21:12:46 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d/os-instance-actions/req-6f0c5027-9780-4990-a92a-dd2ab14df1ed => generated 313 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:46.983265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a65fb6ab-3ca9-4e17-8eff-9bd89dfc8fb6 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:46.992367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a65fb6ab-3ca9-4e17-8eff-9bd89dfc8fb6 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:47.023939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a65fb6ab-3ca9-4e17-8eff-9bd89dfc8fb6 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:47.024484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a65fb6ab-3ca9-4e17-8eff-9bd89dfc8fb6 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:47.024924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a65fb6ab-3ca9-4e17-8eff-9bd89dfc8fb6 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:47.025681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a65fb6ab-3ca9-4e17-8eff-9bd89dfc8fb6 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:47.026133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a65fb6ab-3ca9-4e17-8eff-9bd89dfc8fb6 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:47.032718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a65fb6ab-3ca9-4e17-8eff-9bd89dfc8fb6 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:47.251920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a2ca8fff-a7eb-4444-b843-f2c6afaa444e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:47.271702 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a2ca8fff-a7eb-4444-b843-f2c6afaa444e tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1392 microversion: 2.1 time: 0.493261 Oct 04 21:12:47.272936 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 925/1867] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:46 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1392 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:47.280646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7bfa717b-deca-40e3-a90b-b63bfef85ec5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:47.281515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7bfa717b-deca-40e3-a90b-b63bfef85ec5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:47.291578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:47.295705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bfa717b-deca-40e3-a90b-b63bfef85ec5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:47.299458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bfa717b-deca-40e3-a90b-b63bfef85ec5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:47.299458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bfa717b-deca-40e3-a90b-b63bfef85ec5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:47.299458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bfa717b-deca-40e3-a90b-b63bfef85ec5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:47.299458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bfa717b-deca-40e3-a90b-b63bfef85ec5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:47.299458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bfa717b-deca-40e3-a90b-b63bfef85ec5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:47.368860 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a65fb6ab-3ca9-4e17-8eff-9bd89dfc8fb6 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "POST /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d/action" status: 202 len: 0 microversion: 2.1 time: 0.391128 Oct 04 21:12:47.369902 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 943/1868] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:12:46 2022] POST /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:12:47.379826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-574bb277-b2a5-4e90-9eb5-c48c6e354215 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:47.380535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-574bb277-b2a5-4e90-9eb5-c48c6e354215 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:47.398849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-574bb277-b2a5-4e90-9eb5-c48c6e354215 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:47.401439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-574bb277-b2a5-4e90-9eb5-c48c6e354215 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:47.402319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-574bb277-b2a5-4e90-9eb5-c48c6e354215 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:47.404177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-574bb277-b2a5-4e90-9eb5-c48c6e354215 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:47.405350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-574bb277-b2a5-4e90-9eb5-c48c6e354215 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:47.408382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-574bb277-b2a5-4e90-9eb5-c48c6e354215 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:47.834254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-574bb277-b2a5-4e90-9eb5-c48c6e354215 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:47.854444 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-574bb277-b2a5-4e90-9eb5-c48c6e354215 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1475 microversion: 2.1 time: 0.479568 Oct 04 21:12:47.855836 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 944/1869] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:47 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1475 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:47.879750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6cebb5ba-6971-411f-b4bd-ffca96894c15 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:47.881683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6cebb5ba-6971-411f-b4bd-ffca96894c15 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:47.885822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7bfa717b-deca-40e3-a90b-b63bfef85ec5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:47.901945 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7bfa717b-deca-40e3-a90b-b63bfef85ec5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1497 microversion: 2.1 time: 0.626193 Oct 04 21:12:47.903675 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 926/1870] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:47 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1497 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:47.908976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cebb5ba-6971-411f-b4bd-ffca96894c15 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:47.910563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cebb5ba-6971-411f-b4bd-ffca96894c15 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:47.912547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cebb5ba-6971-411f-b4bd-ffca96894c15 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:47.913640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cebb5ba-6971-411f-b4bd-ffca96894c15 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:47.918996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7411cb12-533c-43ef-96ce-4e13c7349530 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:47.918996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7411cb12-533c-43ef-96ce-4e13c7349530 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:47.919348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cebb5ba-6971-411f-b4bd-ffca96894c15 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:47.919876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cebb5ba-6971-411f-b4bd-ffca96894c15 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:47.943391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7411cb12-533c-43ef-96ce-4e13c7349530 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:47.944921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7411cb12-533c-43ef-96ce-4e13c7349530 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:47.947434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7411cb12-533c-43ef-96ce-4e13c7349530 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:47.952231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7411cb12-533c-43ef-96ce-4e13c7349530 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:47.952770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7411cb12-533c-43ef-96ce-4e13c7349530 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:47.956044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7411cb12-533c-43ef-96ce-4e13c7349530 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:48.397290 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7411cb12-533c-43ef-96ce-4e13c7349530 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:48.414956 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7411cb12-533c-43ef-96ce-4e13c7349530 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705" status: 200 len: 1322 microversion: 2.1 time: 0.509221 Oct 04 21:12:48.416993 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 927/1871] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:47 2022] GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 => generated 1322 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:48.418376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6cebb5ba-6971-411f-b4bd-ffca96894c15 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:48.427908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8d39680c-cab9-4c05-906c-c1997e965507 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:48.428850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8d39680c-cab9-4c05-906c-c1997e965507 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:48.440279 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6cebb5ba-6971-411f-b4bd-ffca96894c15 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 200 len: 1507 microversion: 2.1 time: 0.573523 Oct 04 21:12:48.440695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d39680c-cab9-4c05-906c-c1997e965507 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:48.441728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d39680c-cab9-4c05-906c-c1997e965507 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:48.442426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d39680c-cab9-4c05-906c-c1997e965507 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:48.443416 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d39680c-cab9-4c05-906c-c1997e965507 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:48.444121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d39680c-cab9-4c05-906c-c1997e965507 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:48.445286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d39680c-cab9-4c05-906c-c1997e965507 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:48.453736 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 945/1872] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:47 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 1507 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:48.466512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-94651498-142a-4aca-9c82-09aadb0063cb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:48.467519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-94651498-142a-4aca-9c82-09aadb0063cb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:48.474529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94651498-142a-4aca-9c82-09aadb0063cb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:48.475379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94651498-142a-4aca-9c82-09aadb0063cb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:48.476021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94651498-142a-4aca-9c82-09aadb0063cb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:48.476914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94651498-142a-4aca-9c82-09aadb0063cb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:48.477571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94651498-142a-4aca-9c82-09aadb0063cb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:48.478160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94651498-142a-4aca-9c82-09aadb0063cb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:48.939433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8d39680c-cab9-4c05-906c-c1997e965507 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:48.950860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8d39680c-cab9-4c05-906c-c1997e965507 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:48.953346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-94651498-142a-4aca-9c82-09aadb0063cb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:48.953868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8d39680c-cab9-4c05-906c-c1997e965507 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:48.955734 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8d39680c-cab9-4c05-906c-c1997e965507 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1280 microversion: 2.25 time: 0.535970 Oct 04 21:12:48.957474 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 928/1873] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:48 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1280 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:48.963069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e65ccd7c-cb25-4833-9aed-8111443a3ad7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:48.969645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e65ccd7c-cb25-4833-9aed-8111443a3ad7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:48.970336 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-94651498-142a-4aca-9c82-09aadb0063cb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1392 microversion: 2.1 time: 0.511582 Oct 04 21:12:48.970336 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 946/1874] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:48 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1392 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:48.972752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e65ccd7c-cb25-4833-9aed-8111443a3ad7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:48.973549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e65ccd7c-cb25-4833-9aed-8111443a3ad7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:48.974431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e65ccd7c-cb25-4833-9aed-8111443a3ad7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:48.975526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e65ccd7c-cb25-4833-9aed-8111443a3ad7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:48.976243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e65ccd7c-cb25-4833-9aed-8111443a3ad7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:48.976898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e65ccd7c-cb25-4833-9aed-8111443a3ad7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:48.984940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4994f3f6-4276-4779-ad1b-5b7c3596dac0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:48.986423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4994f3f6-4276-4779-ad1b-5b7c3596dac0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:48.997194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4994f3f6-4276-4779-ad1b-5b7c3596dac0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:48.997671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4994f3f6-4276-4779-ad1b-5b7c3596dac0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:48.998119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4994f3f6-4276-4779-ad1b-5b7c3596dac0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:48.998837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4994f3f6-4276-4779-ad1b-5b7c3596dac0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:48.999659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4994f3f6-4276-4779-ad1b-5b7c3596dac0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:49.000568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4994f3f6-4276-4779-ad1b-5b7c3596dac0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:49.309747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e65ccd7c-cb25-4833-9aed-8111443a3ad7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:49.324680 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e65ccd7c-cb25-4833-9aed-8111443a3ad7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1475 microversion: 2.1 time: 0.365098 Oct 04 21:12:49.326690 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 929/1875] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:48 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1475 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:49.441752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-862cf62f-2dad-4e27-903d-d55ce01a363d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:49.442371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-862cf62f-2dad-4e27-903d-d55ce01a363d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:49.452205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-862cf62f-2dad-4e27-903d-d55ce01a363d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:49.455505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-862cf62f-2dad-4e27-903d-d55ce01a363d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:49.456426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-862cf62f-2dad-4e27-903d-d55ce01a363d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:49.458822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-862cf62f-2dad-4e27-903d-d55ce01a363d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:49.460104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-862cf62f-2dad-4e27-903d-d55ce01a363d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:49.460831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-862cf62f-2dad-4e27-903d-d55ce01a363d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:49.667850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4994f3f6-4276-4779-ad1b-5b7c3596dac0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:49.678340 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4994f3f6-4276-4779-ad1b-5b7c3596dac0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1497 microversion: 2.1 time: 0.706006 Oct 04 21:12:49.678955 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 947/1876] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:48 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1497 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:49.684938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a000f77e-aa3c-474a-abd8-24ef5e397b94 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:49.685953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a000f77e-aa3c-474a-abd8-24ef5e397b94 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:49.692552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a000f77e-aa3c-474a-abd8-24ef5e397b94 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:49.693021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a000f77e-aa3c-474a-abd8-24ef5e397b94 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:49.693540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a000f77e-aa3c-474a-abd8-24ef5e397b94 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:49.694691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a000f77e-aa3c-474a-abd8-24ef5e397b94 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:49.695329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a000f77e-aa3c-474a-abd8-24ef5e397b94 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:49.695919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a000f77e-aa3c-474a-abd8-24ef5e397b94 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:49.748153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-862cf62f-2dad-4e27-903d-d55ce01a363d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:49.757577 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-862cf62f-2dad-4e27-903d-d55ce01a363d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705" status: 200 len: 1322 microversion: 2.1 time: 0.320790 Oct 04 21:12:49.778075 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 930/1877] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:49 2022] GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:49.781249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-4d7a52ba-e810-427a-ad4b-ca45c9ed9c56 req-a7ac3bb6-e111-4ac9-acc3-a20698e78483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed428d1d-ba10-4fd4-b147-b28c9eb09705", "tag": "df0ba774-752b-421c-9804-8dcf3b95999f"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:49.792643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4d7a52ba-e810-427a-ad4b-ca45c9ed9c56 req-a7ac3bb6-e111-4ac9-acc3-a20698e78483 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:49.793398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4d7a52ba-e810-427a-ad4b-ca45c9ed9c56 req-a7ac3bb6-e111-4ac9-acc3-a20698e78483 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:49.794077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4d7a52ba-e810-427a-ad4b-ca45c9ed9c56 req-a7ac3bb6-e111-4ac9-acc3-a20698e78483 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:49.806983 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-4d7a52ba-e810-427a-ad4b-ca45c9ed9c56 req-a7ac3bb6-e111-4ac9-acc3-a20698e78483 service nova] Creating event network-changed:df0ba774-752b-421c-9804-8dcf3b95999f for instance ed428d1d-ba10-4fd4-b147-b28c9eb09705 on n-h1-860282-1 Oct 04 21:12:49.814028 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-4d7a52ba-e810-427a-ad4b-ca45c9ed9c56 req-a7ac3bb6-e111-4ac9-acc3-a20698e78483 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041970 Oct 04 21:12:49.815210 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 931/1878] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:49.969661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a000f77e-aa3c-474a-abd8-24ef5e397b94 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:49.983115 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a000f77e-aa3c-474a-abd8-24ef5e397b94 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 200 len: 1512 microversion: 2.1 time: 0.302653 Oct 04 21:12:49.993523 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 948/1879] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:49 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 1512 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:49.996516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d9cc3cd1-9458-4c36-b671-d881eb45a58e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:49.997650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d9cc3cd1-9458-4c36-b671-d881eb45a58e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:50.010401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ec01876f-62c1-4f59-9fc3-4d2ec074d043 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:50.013619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ec01876f-62c1-4f59-9fc3-4d2ec074d043 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:50.024915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9cc3cd1-9458-4c36-b671-d881eb45a58e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:50.025958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9cc3cd1-9458-4c36-b671-d881eb45a58e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:50.027835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9cc3cd1-9458-4c36-b671-d881eb45a58e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:50.029602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9cc3cd1-9458-4c36-b671-d881eb45a58e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:50.030310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9cc3cd1-9458-4c36-b671-d881eb45a58e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:50.031652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9cc3cd1-9458-4c36-b671-d881eb45a58e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:50.037787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec01876f-62c1-4f59-9fc3-4d2ec074d043 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:50.038531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec01876f-62c1-4f59-9fc3-4d2ec074d043 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:50.041689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec01876f-62c1-4f59-9fc3-4d2ec074d043 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:50.042779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec01876f-62c1-4f59-9fc3-4d2ec074d043 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:50.043450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec01876f-62c1-4f59-9fc3-4d2ec074d043 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:50.044060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec01876f-62c1-4f59-9fc3-4d2ec074d043 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:50.090999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:50.319332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:50.360254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:50.841585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d9cc3cd1-9458-4c36-b671-d881eb45a58e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:50.853650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d9cc3cd1-9458-4c36-b671-d881eb45a58e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:50.858063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ec01876f-62c1-4f59-9fc3-4d2ec074d043 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:50.864164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d9cc3cd1-9458-4c36-b671-d881eb45a58e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:50.868911 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d9cc3cd1-9458-4c36-b671-d881eb45a58e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1280 microversion: 2.25 time: 0.875617 Oct 04 21:12:50.872023 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 932/1880] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:49 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1280 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:50.876347 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ec01876f-62c1-4f59-9fc3-4d2ec074d043 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1392 microversion: 2.1 time: 0.877076 Oct 04 21:12:50.894192 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 949/1881] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:49 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1392 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:50.897899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-155e289c-71e7-4d26-8529-b24cc523e1e7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:50.902631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-155e289c-71e7-4d26-8529-b24cc523e1e7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:50.905689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0aa1ccbb-9290-40cc-870e-b6ccd28c5968 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:50.906315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0aa1ccbb-9290-40cc-870e-b6ccd28c5968 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:50.910126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-155e289c-71e7-4d26-8529-b24cc523e1e7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:50.910874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-155e289c-71e7-4d26-8529-b24cc523e1e7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:50.914059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-155e289c-71e7-4d26-8529-b24cc523e1e7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:50.914059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-155e289c-71e7-4d26-8529-b24cc523e1e7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:50.914059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-155e289c-71e7-4d26-8529-b24cc523e1e7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:50.914059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-155e289c-71e7-4d26-8529-b24cc523e1e7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:50.914481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0aa1ccbb-9290-40cc-870e-b6ccd28c5968 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:50.915864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0aa1ccbb-9290-40cc-870e-b6ccd28c5968 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:50.916507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0aa1ccbb-9290-40cc-870e-b6ccd28c5968 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:50.917550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0aa1ccbb-9290-40cc-870e-b6ccd28c5968 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:50.920205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0aa1ccbb-9290-40cc-870e-b6ccd28c5968 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:50.920838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0aa1ccbb-9290-40cc-870e-b6ccd28c5968 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:51.227460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-155e289c-71e7-4d26-8529-b24cc523e1e7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:51.231026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:51.236014 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-155e289c-71e7-4d26-8529-b24cc523e1e7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1475 microversion: 2.1 time: 0.362700 Oct 04 21:12:51.236597 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 933/1882] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:50 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1475 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:51.254152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-319c0161-1eab-4ad8-adbd-f31353694a63 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:51.254766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-319c0161-1eab-4ad8-adbd-f31353694a63 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:51.267403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-319c0161-1eab-4ad8-adbd-f31353694a63 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:51.267917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-319c0161-1eab-4ad8-adbd-f31353694a63 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:51.268354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-319c0161-1eab-4ad8-adbd-f31353694a63 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:51.272975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-319c0161-1eab-4ad8-adbd-f31353694a63 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:51.273701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-319c0161-1eab-4ad8-adbd-f31353694a63 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:51.274403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-319c0161-1eab-4ad8-adbd-f31353694a63 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:51.329058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0aa1ccbb-9290-40cc-870e-b6ccd28c5968 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:51.340222 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0aa1ccbb-9290-40cc-870e-b6ccd28c5968 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1497 microversion: 2.1 time: 0.443520 Oct 04 21:12:51.341293 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 950/1883] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:50 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1497 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:51.359643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2b7a13b3-f073-4dc7-a279-c7b9ba995637 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:51.361247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2b7a13b3-f073-4dc7-a279-c7b9ba995637 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:51.385328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b7a13b3-f073-4dc7-a279-c7b9ba995637 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:51.390793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b7a13b3-f073-4dc7-a279-c7b9ba995637 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:51.392448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b7a13b3-f073-4dc7-a279-c7b9ba995637 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:51.393492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b7a13b3-f073-4dc7-a279-c7b9ba995637 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:51.394179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b7a13b3-f073-4dc7-a279-c7b9ba995637 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:51.394829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b7a13b3-f073-4dc7-a279-c7b9ba995637 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:51.441707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:51.650939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-319c0161-1eab-4ad8-adbd-f31353694a63 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:51.664807 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-319c0161-1eab-4ad8-adbd-f31353694a63 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705" status: 200 len: 1322 microversion: 2.1 time: 0.422901 Oct 04 21:12:51.666192 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 934/1884] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:51 2022] GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 => generated 1322 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:51.681895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b5a1e80f-c246-48bd-98a2-cf4734df3121 req-56629f17-b317-4622-92ec-542d5afc1ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c86d6b4-12a8-464a-84d7-2d6454aee597", "name": "network-vif-plugged", "status": "completed", "tag": "9229c565-3c30-423f-9b59-78ca89772437"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:51.704777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b5a1e80f-c246-48bd-98a2-cf4734df3121 req-56629f17-b317-4622-92ec-542d5afc1ac7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:51.705935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b5a1e80f-c246-48bd-98a2-cf4734df3121 req-56629f17-b317-4622-92ec-542d5afc1ac7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:51.706386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b5a1e80f-c246-48bd-98a2-cf4734df3121 req-56629f17-b317-4622-92ec-542d5afc1ac7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:51.731569 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b5a1e80f-c246-48bd-98a2-cf4734df3121 req-56629f17-b317-4622-92ec-542d5afc1ac7 service nova] Creating event network-vif-plugged:9229c565-3c30-423f-9b59-78ca89772437 for instance 4c86d6b4-12a8-464a-84d7-2d6454aee597 on n-h2-860282-1 Oct 04 21:12:51.748026 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b5a1e80f-c246-48bd-98a2-cf4734df3121 req-56629f17-b317-4622-92ec-542d5afc1ac7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080169 Oct 04 21:12:51.758470 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 935/1885] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:51.823393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2b7a13b3-f073-4dc7-a279-c7b9ba995637 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:51.833940 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2b7a13b3-f073-4dc7-a279-c7b9ba995637 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 200 len: 1505 microversion: 2.1 time: 0.491241 Oct 04 21:12:51.837070 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 951/1886] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:51 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:51.862410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-df14823d-5bb0-4fa9-933a-4678d6a64150 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '.version_select at 0x7f57943f70d0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:51.863061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-df14823d-5bb0-4fa9-933a-4678d6a64150 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:51.883824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df14823d-5bb0-4fa9-933a-4678d6a64150 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:51.886313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df14823d-5bb0-4fa9-933a-4678d6a64150 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:51.888432 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df14823d-5bb0-4fa9-933a-4678d6a64150 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:51.889709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df14823d-5bb0-4fa9-933a-4678d6a64150 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:51.890526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df14823d-5bb0-4fa9-933a-4678d6a64150 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:51.891252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df14823d-5bb0-4fa9-933a-4678d6a64150 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:51.900268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-04f35ed8-5f75-4a4f-b651-7e4e15c066a7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:51.905201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-04f35ed8-5f75-4a4f-b651-7e4e15c066a7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:51.921671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04f35ed8-5f75-4a4f-b651-7e4e15c066a7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:51.922611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04f35ed8-5f75-4a4f-b651-7e4e15c066a7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:51.923345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04f35ed8-5f75-4a4f-b651-7e4e15c066a7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:51.924989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04f35ed8-5f75-4a4f-b651-7e4e15c066a7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:51.925483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04f35ed8-5f75-4a4f-b651-7e4e15c066a7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:51.926040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04f35ed8-5f75-4a4f-b651-7e4e15c066a7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:51.981466 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-df14823d-5bb0-4fa9-933a-4678d6a64150 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.123802 Oct 04 21:12:51.982036 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 936/1887] 10.222.0.30 () {58 vars in 1296 bytes} [Tue Oct 4 21:12:51 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d/os-instance-actions => generated 611 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:12:51.997648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cb6eb7b4-0dea-4d88-a588-de0b547f54fc tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:51.998550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cb6eb7b4-0dea-4d88-a588-de0b547f54fc tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:52.008413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb6eb7b4-0dea-4d88-a588-de0b547f54fc tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:52.011604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb6eb7b4-0dea-4d88-a588-de0b547f54fc tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:52.012266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb6eb7b4-0dea-4d88-a588-de0b547f54fc tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:52.014730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb6eb7b4-0dea-4d88-a588-de0b547f54fc tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:52.015587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb6eb7b4-0dea-4d88-a588-de0b547f54fc tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:52.016062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb6eb7b4-0dea-4d88-a588-de0b547f54fc tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:52.192404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-04f35ed8-5f75-4a4f-b651-7e4e15c066a7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:52.203391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-04f35ed8-5f75-4a4f-b651-7e4e15c066a7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:52.205544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-04f35ed8-5f75-4a4f-b651-7e4e15c066a7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:52.212507 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-04f35ed8-5f75-4a4f-b651-7e4e15c066a7 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1280 microversion: 2.25 time: 0.316120 Oct 04 21:12:52.213754 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 952/1888] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:51 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1280 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:12:52.223162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e1767cb8-9ca4-4c76-87a5-543358145b52 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:52.223916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e1767cb8-9ca4-4c76-87a5-543358145b52 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:52.238781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1767cb8-9ca4-4c76-87a5-543358145b52 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:52.239295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1767cb8-9ca4-4c76-87a5-543358145b52 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:52.240494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1767cb8-9ca4-4c76-87a5-543358145b52 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:52.241553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1767cb8-9ca4-4c76-87a5-543358145b52 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:52.242016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1767cb8-9ca4-4c76-87a5-543358145b52 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:52.242640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1767cb8-9ca4-4c76-87a5-543358145b52 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:52.268737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cb6eb7b4-0dea-4d88-a588-de0b547f54fc tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:52.278858 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cb6eb7b4-0dea-4d88-a588-de0b547f54fc tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1392 microversion: 2.1 time: 0.285773 Oct 04 21:12:52.280001 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 937/1889] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:51 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1392 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:52.285041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0446b384-d380-4731-978f-5f0dad0b627e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:52.286194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0446b384-d380-4731-978f-5f0dad0b627e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:52.294297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0446b384-d380-4731-978f-5f0dad0b627e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:52.295103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0446b384-d380-4731-978f-5f0dad0b627e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:52.295783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0446b384-d380-4731-978f-5f0dad0b627e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:52.296730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0446b384-d380-4731-978f-5f0dad0b627e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:52.297462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0446b384-d380-4731-978f-5f0dad0b627e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:52.298477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0446b384-d380-4731-978f-5f0dad0b627e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:52.314949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e1767cb8-9ca4-4c76-87a5-543358145b52 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:12:52.472273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0446b384-d380-4731-978f-5f0dad0b627e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:52.482040 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0446b384-d380-4731-978f-5f0dad0b627e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1475 microversion: 2.1 time: 0.200691 Oct 04 21:12:52.497304 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 938/1890] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:52 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1475 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:52.672526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-48611f83-3ca5-492f-9f09-5b6ef1899bbb tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1724301526", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "69a2e9c2-d30c-422a-9bd2-cbb194fceff0"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:52.728430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-48611f83-3ca5-492f-9f09-5b6ef1899bbb tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] validate_networks() for [('69a2e9c2-d30c-422a-9bd2-cbb194fceff0', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:12:52.762637 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e1767cb8-9ca4-4c76-87a5-543358145b52 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "DELETE /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 204 len: 0 microversion: 2.1 time: 0.546215 Oct 04 21:12:52.763365 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 953/1891] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:12:52 2022] DELETE /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 0 bytes in 549 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:12:52.769459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c1cf2e94-ba68-4bde-928a-6babbb39e1bd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:52.775956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c1cf2e94-ba68-4bde-928a-6babbb39e1bd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:52.777889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1cf2e94-ba68-4bde-928a-6babbb39e1bd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:52.778503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1cf2e94-ba68-4bde-928a-6babbb39e1bd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:52.779404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1cf2e94-ba68-4bde-928a-6babbb39e1bd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:52.780313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1cf2e94-ba68-4bde-928a-6babbb39e1bd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:52.781156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1cf2e94-ba68-4bde-928a-6babbb39e1bd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:52.781633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1cf2e94-ba68-4bde-928a-6babbb39e1bd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:52.986874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c1cf2e94-ba68-4bde-928a-6babbb39e1bd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:52.994784 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c1cf2e94-ba68-4bde-928a-6babbb39e1bd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1497 microversion: 2.1 time: 0.229981 Oct 04 21:12:53.013750 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 954/1892] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:52 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1497 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:53.019767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cd1e5309-2e61-4ad3-ad72-643c3e88c154 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:53.021324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cd1e5309-2e61-4ad3-ad72-643c3e88c154 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:53.029290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd1e5309-2e61-4ad3-ad72-643c3e88c154 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:53.030120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd1e5309-2e61-4ad3-ad72-643c3e88c154 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:53.030547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd1e5309-2e61-4ad3-ad72-643c3e88c154 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:53.031269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd1e5309-2e61-4ad3-ad72-643c3e88c154 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:53.031723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd1e5309-2e61-4ad3-ad72-643c3e88c154 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:53.032328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd1e5309-2e61-4ad3-ad72-643c3e88c154 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:53.309121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cd1e5309-2e61-4ad3-ad72-643c3e88c154 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:53.322508 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cd1e5309-2e61-4ad3-ad72-643c3e88c154 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705" status: 200 len: 1322 microversion: 2.1 time: 0.307147 Oct 04 21:12:53.324243 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 955/1893] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:53 2022] GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:53.347448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-602c4b43-05f1-45c5-b90b-7b380367f283 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:53.348574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-602c4b43-05f1-45c5-b90b-7b380367f283 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:53.360344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-602c4b43-05f1-45c5-b90b-7b380367f283 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:53.360836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-602c4b43-05f1-45c5-b90b-7b380367f283 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:53.361277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-602c4b43-05f1-45c5-b90b-7b380367f283 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:53.365270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-602c4b43-05f1-45c5-b90b-7b380367f283 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:53.370706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-602c4b43-05f1-45c5-b90b-7b380367f283 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:53.370706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-602c4b43-05f1-45c5-b90b-7b380367f283 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:53.371551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-48611f83-3ca5-492f-9f09-5b6ef1899bbb tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:12:53.372407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-48611f83-3ca5-492f-9f09-5b6ef1899bbb tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:12:53.373080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-48611f83-3ca5-492f-9f09-5b6ef1899bbb tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:12:53.373594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-48611f83-3ca5-492f-9f09-5b6ef1899bbb tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:12:53.374173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-48611f83-3ca5-492f-9f09-5b6ef1899bbb tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:12:53.392720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48611f83-3ca5-492f-9f09-5b6ef1899bbb tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:53.393742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48611f83-3ca5-492f-9f09-5b6ef1899bbb tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:53.402298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48611f83-3ca5-492f-9f09-5b6ef1899bbb tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:53.403255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48611f83-3ca5-492f-9f09-5b6ef1899bbb tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:53.403736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48611f83-3ca5-492f-9f09-5b6ef1899bbb tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:53.404170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48611f83-3ca5-492f-9f09-5b6ef1899bbb tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:53.445572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-48611f83-3ca5-492f-9f09-5b6ef1899bbb tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Getting quotas for project a735a9ba00c04c2fa6ed960ccc771d4a. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:12:53.453663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-48611f83-3ca5-492f-9f09-5b6ef1899bbb tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Getting quotas for user 7f6433ac83e746a1b8e5c4f7ec37d4b4 and project a735a9ba00c04c2fa6ed960ccc771d4a. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:12:53.481697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-48611f83-3ca5-492f-9f09-5b6ef1899bbb tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:12:53.484634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-48611f83-3ca5-492f-9f09-5b6ef1899bbb tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:12:53.577027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-602c4b43-05f1-45c5-b90b-7b380367f283 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:53.585056 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-602c4b43-05f1-45c5-b90b-7b380367f283 tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 200 len: 1511 microversion: 2.1 time: 0.259258 Oct 04 21:12:53.585986 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 956/1894] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:53 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 1511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:53.591136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-60c15865-cf99-4eb2-b15e-47ec6d6c7206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:53.591782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-60c15865-cf99-4eb2-b15e-47ec6d6c7206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:53.598318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60c15865-cf99-4eb2-b15e-47ec6d6c7206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:53.598846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60c15865-cf99-4eb2-b15e-47ec6d6c7206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:53.599330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60c15865-cf99-4eb2-b15e-47ec6d6c7206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:53.600242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60c15865-cf99-4eb2-b15e-47ec6d6c7206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:53.600714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60c15865-cf99-4eb2-b15e-47ec6d6c7206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:53.601161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60c15865-cf99-4eb2-b15e-47ec6d6c7206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:53.668097 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-48611f83-3ca5-492f-9f09-5b6ef1899bbb tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.168813 Oct 04 21:12:53.668858 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 939/1895] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:12:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:12:53.678487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-14822ddc-e552-4521-a8a4-14c8b6c36a77 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:53.679205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-14822ddc-e552-4521-a8a4-14c8b6c36a77 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:53.693870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14822ddc-e552-4521-a8a4-14c8b6c36a77 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:53.697273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14822ddc-e552-4521-a8a4-14c8b6c36a77 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:53.697273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14822ddc-e552-4521-a8a4-14c8b6c36a77 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:53.701947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14822ddc-e552-4521-a8a4-14c8b6c36a77 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:53.702710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14822ddc-e552-4521-a8a4-14c8b6c36a77 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:53.703344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14822ddc-e552-4521-a8a4-14c8b6c36a77 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:53.798964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-60c15865-cf99-4eb2-b15e-47ec6d6c7206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:53.811526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-60c15865-cf99-4eb2-b15e-47ec6d6c7206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:53.820654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-60c15865-cf99-4eb2-b15e-47ec6d6c7206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:53.822771 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-60c15865-cf99-4eb2-b15e-47ec6d6c7206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1280 microversion: 2.25 time: 0.235425 Oct 04 21:12:53.832870 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 957/1896] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:53 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1280 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:53.842226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ae4d9a1b-3a10-481b-8fe2-dc0ed7459343 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:53.842226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ae4d9a1b-3a10-481b-8fe2-dc0ed7459343 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:53.852740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae4d9a1b-3a10-481b-8fe2-dc0ed7459343 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:53.854756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae4d9a1b-3a10-481b-8fe2-dc0ed7459343 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:53.856112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae4d9a1b-3a10-481b-8fe2-dc0ed7459343 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:53.864732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae4d9a1b-3a10-481b-8fe2-dc0ed7459343 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:53.867200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae4d9a1b-3a10-481b-8fe2-dc0ed7459343 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:53.867916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae4d9a1b-3a10-481b-8fe2-dc0ed7459343 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:53.930554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-14822ddc-e552-4521-a8a4-14c8b6c36a77 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:53.941067 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-14822ddc-e552-4521-a8a4-14c8b6c36a77 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1382 microversion: 2.1 time: 0.270794 Oct 04 21:12:53.954570 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 940/1897] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:53 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1382 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:53.967476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b99d277d-82f0-4302-a0af-1be62c3b4bf6 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:53.972926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b99d277d-82f0-4302-a0af-1be62c3b4bf6 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:54.055841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b99d277d-82f0-4302-a0af-1be62c3b4bf6 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6433ac83e746a1b8e5c4f7ec37d4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a735a9ba00c04c2fa6ed960ccc771d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:54.063449 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b99d277d-82f0-4302-a0af-1be62c3b4bf6 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785" status: 200 len: 1216 microversion: 2.1 time: 0.102263 Oct 04 21:12:54.079545 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 941/1898] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:53 2022] GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 => generated 1216 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:54.084430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b41b8026-49cc-4472-9aa6-2ea94c9931f2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '.version_select at 0x7f579445be50>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:54.088176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b41b8026-49cc-4472-9aa6-2ea94c9931f2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:54.088660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b41b8026-49cc-4472-9aa6-2ea94c9931f2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:54.089122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b41b8026-49cc-4472-9aa6-2ea94c9931f2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:54.108048 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b41b8026-49cc-4472-9aa6-2ea94c9931f2 tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 4275 microversion: 2.1 time: 0.027285 Oct 04 21:12:54.120961 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 942/1899] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Oct 4 21:12:54 2022] GET /compute/v2.1/os-migrations => generated 4275 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:54.126079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ae5e9421-cb9e-46cf-9760-cd5754f7deab tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:54.126691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ae5e9421-cb9e-46cf-9760-cd5754f7deab tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:54.133098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae5e9421-cb9e-46cf-9760-cd5754f7deab tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:54.133685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae5e9421-cb9e-46cf-9760-cd5754f7deab tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:54.139250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae5e9421-cb9e-46cf-9760-cd5754f7deab tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:54.139250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae5e9421-cb9e-46cf-9760-cd5754f7deab tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:54.139250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae5e9421-cb9e-46cf-9760-cd5754f7deab tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:54.139250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae5e9421-cb9e-46cf-9760-cd5754f7deab tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:54.144373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ae4d9a1b-3a10-481b-8fe2-dc0ed7459343 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:54.153026 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ae4d9a1b-3a10-481b-8fe2-dc0ed7459343 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1475 microversion: 2.1 time: 0.327526 Oct 04 21:12:54.153894 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 958/1900] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:53 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1475 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:54.158781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cdb3372a-1659-4903-9583-b319e634e24c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:54.159596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cdb3372a-1659-4903-9583-b319e634e24c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:54.166083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cdb3372a-1659-4903-9583-b319e634e24c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:54.168039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cdb3372a-1659-4903-9583-b319e634e24c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:54.168039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cdb3372a-1659-4903-9583-b319e634e24c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:54.168039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cdb3372a-1659-4903-9583-b319e634e24c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:54.168480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cdb3372a-1659-4903-9583-b319e634e24c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:54.168865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cdb3372a-1659-4903-9583-b319e634e24c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:54.506515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ae5e9421-cb9e-46cf-9760-cd5754f7deab tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:54.517753 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ae5e9421-cb9e-46cf-9760-cd5754f7deab tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1497 microversion: 2.1 time: 0.395503 Oct 04 21:12:54.518350 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 943/1901] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:54 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1497 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:54.537698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2aa73326-f68c-4885-82e6-038f7362f4de tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:54.539849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2aa73326-f68c-4885-82e6-038f7362f4de tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:54.548308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2aa73326-f68c-4885-82e6-038f7362f4de tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:54.548805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2aa73326-f68c-4885-82e6-038f7362f4de tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:54.549569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2aa73326-f68c-4885-82e6-038f7362f4de tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:54.551030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2aa73326-f68c-4885-82e6-038f7362f4de tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:54.556985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2aa73326-f68c-4885-82e6-038f7362f4de tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:54.556985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2aa73326-f68c-4885-82e6-038f7362f4de tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:54.558877 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cdb3372a-1659-4903-9583-b319e634e24c tempest-LiveMigrationTest-668772700 tempest-LiveMigrationTest-668772700-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1533 microversion: 2.1 time: 0.402552 Oct 04 21:12:54.560281 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 959/1902] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:54 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1533 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:54.603836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d15b599a-c4d7-4609-9430-7619914a1253 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:54.605052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d15b599a-c4d7-4609-9430-7619914a1253 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:54.615896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d15b599a-c4d7-4609-9430-7619914a1253 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:54.617109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d15b599a-c4d7-4609-9430-7619914a1253 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:54.617914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d15b599a-c4d7-4609-9430-7619914a1253 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:54.618988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d15b599a-c4d7-4609-9430-7619914a1253 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:54.619730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d15b599a-c4d7-4609-9430-7619914a1253 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:54.621586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d15b599a-c4d7-4609-9430-7619914a1253 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:54.652104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d15b599a-c4d7-4609-9430-7619914a1253 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:12:54.815713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2aa73326-f68c-4885-82e6-038f7362f4de tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:54.824326 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2aa73326-f68c-4885-82e6-038f7362f4de tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705" status: 200 len: 1322 microversion: 2.1 time: 0.301609 Oct 04 21:12:54.829928 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 944/1903] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:54 2022] GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:54.830974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-74cc4b5b-573a-47fa-9882-b49c7a72c3ee tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:54.831772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-74cc4b5b-573a-47fa-9882-b49c7a72c3ee tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:54.838851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74cc4b5b-573a-47fa-9882-b49c7a72c3ee tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:54.839577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74cc4b5b-573a-47fa-9882-b49c7a72c3ee tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:54.840194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74cc4b5b-573a-47fa-9882-b49c7a72c3ee tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:54.841020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74cc4b5b-573a-47fa-9882-b49c7a72c3ee tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:54.845515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74cc4b5b-573a-47fa-9882-b49c7a72c3ee tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:54.845970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74cc4b5b-573a-47fa-9882-b49c7a72c3ee tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:55.123753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-74cc4b5b-573a-47fa-9882-b49c7a72c3ee tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:55.136082 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-74cc4b5b-573a-47fa-9882-b49c7a72c3ee tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 200 len: 1511 microversion: 2.1 time: 0.309247 Oct 04 21:12:55.137311 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 945/1904] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:54 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 1511 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:55.169524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d4fa955c-4a4a-4c8a-9e40-a3026905371c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:55.170858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d4fa955c-4a4a-4c8a-9e40-a3026905371c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:55.181125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4fa955c-4a4a-4c8a-9e40-a3026905371c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:55.181812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4fa955c-4a4a-4c8a-9e40-a3026905371c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:55.182564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4fa955c-4a4a-4c8a-9e40-a3026905371c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:55.183794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4fa955c-4a4a-4c8a-9e40-a3026905371c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:55.184490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4fa955c-4a4a-4c8a-9e40-a3026905371c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:55.185162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4fa955c-4a4a-4c8a-9e40-a3026905371c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:55.195940 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d15b599a-c4d7-4609-9430-7619914a1253 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "DELETE /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 204 len: 0 microversion: 2.1 time: 0.598706 Oct 04 21:12:55.198962 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 960/1905] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:12:54 2022] DELETE /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:12:55.205830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a2b5e0d8-2ec8-403d-86ef-1c07a5e75b72 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:55.208908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a2b5e0d8-2ec8-403d-86ef-1c07a5e75b72 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:55.223352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2b5e0d8-2ec8-403d-86ef-1c07a5e75b72 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:55.224339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2b5e0d8-2ec8-403d-86ef-1c07a5e75b72 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:55.227861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2b5e0d8-2ec8-403d-86ef-1c07a5e75b72 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:55.228801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2b5e0d8-2ec8-403d-86ef-1c07a5e75b72 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:55.229293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2b5e0d8-2ec8-403d-86ef-1c07a5e75b72 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:55.232731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2b5e0d8-2ec8-403d-86ef-1c07a5e75b72 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:55.416580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a2b5e0d8-2ec8-403d-86ef-1c07a5e75b72 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6433ac83e746a1b8e5c4f7ec37d4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a735a9ba00c04c2fa6ed960ccc771d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:55.429608 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a2b5e0d8-2ec8-403d-86ef-1c07a5e75b72 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785" status: 200 len: 1220 microversion: 2.1 time: 0.230883 Oct 04 21:12:55.430948 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 961/1906] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:55 2022] GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 => generated 1220 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:55.436982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6612f78b-5602-46a6-9c2f-a45659bcf442 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:55.437914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6612f78b-5602-46a6-9c2f-a45659bcf442 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:55.445639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6612f78b-5602-46a6-9c2f-a45659bcf442 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:55.446501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6612f78b-5602-46a6-9c2f-a45659bcf442 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:55.447290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6612f78b-5602-46a6-9c2f-a45659bcf442 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:55.448317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6612f78b-5602-46a6-9c2f-a45659bcf442 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:55.450064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6612f78b-5602-46a6-9c2f-a45659bcf442 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:55.450933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6612f78b-5602-46a6-9c2f-a45659bcf442 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:55.492389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d4fa955c-4a4a-4c8a-9e40-a3026905371c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:55.509364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d4fa955c-4a4a-4c8a-9e40-a3026905371c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:55.512167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d4fa955c-4a4a-4c8a-9e40-a3026905371c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:55.513655 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d4fa955c-4a4a-4c8a-9e40-a3026905371c tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1476 microversion: 2.25 time: 0.374990 Oct 04 21:12:55.532735 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 946/1907] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:55 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1476 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:55.570386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e17a1247-7ad1-4268-b02d-c7a646807478 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:55.575997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e17a1247-7ad1-4268-b02d-c7a646807478 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:55.603087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e17a1247-7ad1-4268-b02d-c7a646807478 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:55.603087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e17a1247-7ad1-4268-b02d-c7a646807478 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:55.603087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e17a1247-7ad1-4268-b02d-c7a646807478 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:55.603087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e17a1247-7ad1-4268-b02d-c7a646807478 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:55.603087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e17a1247-7ad1-4268-b02d-c7a646807478 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:55.608523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e17a1247-7ad1-4268-b02d-c7a646807478 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:55.726957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6612f78b-5602-46a6-9c2f-a45659bcf442 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:55.730214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:55.742964 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6612f78b-5602-46a6-9c2f-a45659bcf442 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1475 microversion: 2.1 time: 0.310616 Oct 04 21:12:55.747028 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 962/1908] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:55 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1475 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:56.064686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e17a1247-7ad1-4268-b02d-c7a646807478 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:56.079920 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e17a1247-7ad1-4268-b02d-c7a646807478 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1388 microversion: 2.1 time: 0.550121 Oct 04 21:12:56.081938 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 947/1909] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:55 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1388 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:56.094969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-258db0eb-5bc9-4f13-9102-52b7e0463f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:56.097962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-258db0eb-5bc9-4f13-9102-52b7e0463f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:56.119504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-258db0eb-5bc9-4f13-9102-52b7e0463f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:56.126748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4c525d6c-8a8f-471f-a613-248d7383f152 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:56.127579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4c525d6c-8a8f-471f-a613-248d7383f152 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:56.132682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-258db0eb-5bc9-4f13-9102-52b7e0463f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:56.139860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-258db0eb-5bc9-4f13-9102-52b7e0463f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:56.140988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-258db0eb-5bc9-4f13-9102-52b7e0463f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:56.142931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-258db0eb-5bc9-4f13-9102-52b7e0463f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:56.144439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-258db0eb-5bc9-4f13-9102-52b7e0463f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:56.145587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c525d6c-8a8f-471f-a613-248d7383f152 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:56.147256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c525d6c-8a8f-471f-a613-248d7383f152 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:56.149250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c525d6c-8a8f-471f-a613-248d7383f152 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:56.154601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c525d6c-8a8f-471f-a613-248d7383f152 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:56.155477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c525d6c-8a8f-471f-a613-248d7383f152 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:56.159823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c525d6c-8a8f-471f-a613-248d7383f152 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:56.619382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-4c525d6c-8a8f-471f-a613-248d7383f152 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lazy-loading 'services' on Instance uuid 4c86d6b4-12a8-464a-84d7-2d6454aee597 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:12:56.628620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-258db0eb-5bc9-4f13-9102-52b7e0463f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:56.638546 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-258db0eb-5bc9-4f13-9102-52b7e0463f47 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1497 microversion: 2.1 time: 0.555010 Oct 04 21:12:56.643332 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 948/1910] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:56 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1497 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:56.665917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-23dfa3ea-d25a-432d-918c-72d2aa202a47 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:56.666676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-23dfa3ea-d25a-432d-918c-72d2aa202a47 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:56.675051 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4c525d6c-8a8f-471f-a613-248d7383f152 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1968 microversion: 2.25 time: 0.925947 Oct 04 21:12:56.679574 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 963/1911] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:55 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1968 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:56.702758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23dfa3ea-d25a-432d-918c-72d2aa202a47 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:56.705643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23dfa3ea-d25a-432d-918c-72d2aa202a47 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:56.706991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23dfa3ea-d25a-432d-918c-72d2aa202a47 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:56.708161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23dfa3ea-d25a-432d-918c-72d2aa202a47 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:56.708872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23dfa3ea-d25a-432d-918c-72d2aa202a47 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:56.709510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23dfa3ea-d25a-432d-918c-72d2aa202a47 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:56.710688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dd4d7174-d62e-4767-af3d-7a27b8be7d1b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:56.720359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dd4d7174-d62e-4767-af3d-7a27b8be7d1b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:56.746247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd4d7174-d62e-4767-af3d-7a27b8be7d1b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:56.747423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd4d7174-d62e-4767-af3d-7a27b8be7d1b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:56.749977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd4d7174-d62e-4767-af3d-7a27b8be7d1b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:56.752481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd4d7174-d62e-4767-af3d-7a27b8be7d1b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:56.754551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd4d7174-d62e-4767-af3d-7a27b8be7d1b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:56.755009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd4d7174-d62e-4767-af3d-7a27b8be7d1b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:56.892005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dd4d7174-d62e-4767-af3d-7a27b8be7d1b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:56.927023 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dd4d7174-d62e-4767-af3d-7a27b8be7d1b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 200 len: 1301 microversion: 2.1 time: 0.246167 Oct 04 21:12:56.934191 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 964/1912] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:56 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 1301 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:56.941906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-3f4bb9fb-57c5-4a21-9050-0c2412e3d9f5 req-c89f90e1-41b5-484c-a89d-1798f1256db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47ef2ed7-3bd6-443a-84dd-5eda292e483d", "name": "network-vif-deleted", "tag": "65d1e6fd-5827-4499-92a8-5c2559cce40f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:56.970993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3f4bb9fb-57c5-4a21-9050-0c2412e3d9f5 req-c89f90e1-41b5-484c-a89d-1798f1256db0 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:56.973396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3f4bb9fb-57c5-4a21-9050-0c2412e3d9f5 req-c89f90e1-41b5-484c-a89d-1798f1256db0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:56.975566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3f4bb9fb-57c5-4a21-9050-0c2412e3d9f5 req-c89f90e1-41b5-484c-a89d-1798f1256db0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:56.992425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-23dfa3ea-d25a-432d-918c-72d2aa202a47 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:56.994998 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-3f4bb9fb-57c5-4a21-9050-0c2412e3d9f5 req-c89f90e1-41b5-484c-a89d-1798f1256db0 service nova] Creating event network-vif-deleted:65d1e6fd-5827-4499-92a8-5c2559cce40f for instance 47ef2ed7-3bd6-443a-84dd-5eda292e483d on n-h2-860282-1 Oct 04 21:12:57.000606 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-3f4bb9fb-57c5-4a21-9050-0c2412e3d9f5 req-c89f90e1-41b5-484c-a89d-1798f1256db0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064840 Oct 04 21:12:57.001126 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-23dfa3ea-d25a-432d-918c-72d2aa202a47 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705" status: 200 len: 1322 microversion: 2.1 time: 0.356696 Oct 04 21:12:57.001710 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 965/1913] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:57.002224 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 949/1914] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:56 2022] GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 => generated 1322 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:57.006758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e2c39764-fc97-49ba-b08e-71d324cd646c tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:57.007373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e2c39764-fc97-49ba-b08e-71d324cd646c tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:57.007768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0489468b-3aaa-4fb2-8051-cef8aac6871a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:57.008719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0489468b-3aaa-4fb2-8051-cef8aac6871a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:57.015038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2c39764-fc97-49ba-b08e-71d324cd646c tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.015768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2c39764-fc97-49ba-b08e-71d324cd646c tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.016466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2c39764-fc97-49ba-b08e-71d324cd646c tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.017368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2c39764-fc97-49ba-b08e-71d324cd646c tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.018292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2c39764-fc97-49ba-b08e-71d324cd646c tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.019226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2c39764-fc97-49ba-b08e-71d324cd646c tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.039265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0489468b-3aaa-4fb2-8051-cef8aac6871a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.039767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0489468b-3aaa-4fb2-8051-cef8aac6871a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.045506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0489468b-3aaa-4fb2-8051-cef8aac6871a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.045506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0489468b-3aaa-4fb2-8051-cef8aac6871a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.045506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0489468b-3aaa-4fb2-8051-cef8aac6871a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.056135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0489468b-3aaa-4fb2-8051-cef8aac6871a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.275301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0489468b-3aaa-4fb2-8051-cef8aac6871a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6433ac83e746a1b8e5c4f7ec37d4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a735a9ba00c04c2fa6ed960ccc771d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:57.297854 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0489468b-3aaa-4fb2-8051-cef8aac6871a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785" status: 200 len: 1268 microversion: 2.1 time: 0.282336 Oct 04 21:12:57.298706 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 966/1915] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:57 2022] GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 => generated 1268 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:57.306747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3ba59314-382f-45f4-96ed-913dbc7d0ff5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:57.307672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3ba59314-382f-45f4-96ed-913dbc7d0ff5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:57.316671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ba59314-382f-45f4-96ed-913dbc7d0ff5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.317929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ba59314-382f-45f4-96ed-913dbc7d0ff5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.318836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ba59314-382f-45f4-96ed-913dbc7d0ff5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.319848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ba59314-382f-45f4-96ed-913dbc7d0ff5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.320318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ba59314-382f-45f4-96ed-913dbc7d0ff5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.320751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ba59314-382f-45f4-96ed-913dbc7d0ff5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.332426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-e2c39764-fc97-49ba-b08e-71d324cd646c tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lazy-loading 'services' on Instance uuid 4c86d6b4-12a8-464a-84d7-2d6454aee597 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:12:57.373573 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e2c39764-fc97-49ba-b08e-71d324cd646c tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1968 microversion: 2.25 time: 0.361986 Oct 04 21:12:57.374241 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 950/1916] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:57 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1968 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:57.410815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c5d9a784-2cb3-4ba2-9906-858c53eeb6ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:57.411831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c5d9a784-2cb3-4ba2-9906-858c53eeb6ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:57.428038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5d9a784-2cb3-4ba2-9906-858c53eeb6ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.442660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5d9a784-2cb3-4ba2-9906-858c53eeb6ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.442660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5d9a784-2cb3-4ba2-9906-858c53eeb6ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.444558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5d9a784-2cb3-4ba2-9906-858c53eeb6ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.449334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5d9a784-2cb3-4ba2-9906-858c53eeb6ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.454086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5d9a784-2cb3-4ba2-9906-858c53eeb6ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.647105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c5d9a784-2cb3-4ba2-9906-858c53eeb6ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:57.667659 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c5d9a784-2cb3-4ba2-9906-858c53eeb6ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1346 microversion: 2.1 time: 0.276818 Oct 04 21:12:57.669690 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 951/1917] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:57 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1346 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:57.675759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3ba59314-382f-45f4-96ed-913dbc7d0ff5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:57.685457 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3ba59314-382f-45f4-96ed-913dbc7d0ff5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1475 microversion: 2.1 time: 0.385270 Oct 04 21:12:57.703869 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 967/1918] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:57 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1475 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:57.705077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-ad1215ad-dccd-438a-91ec-6b867f6f970d req-02e11b1c-73b7-4244-8147-9ca5efe61239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95674198-fb96-434e-82bf-f3b189599f0e", "name": "network-vif-deleted", "tag": "9e441d3d-b8e8-4963-9f5c-ac245f115ac5"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:57.713866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-88eb7e4e-dc16-4e0d-8235-a989026b3a58 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:57.719591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88eb7e4e-dc16-4e0d-8235-a989026b3a58 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.720434 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88eb7e4e-dc16-4e0d-8235-a989026b3a58 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.721123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88eb7e4e-dc16-4e0d-8235-a989026b3a58 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.722899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88eb7e4e-dc16-4e0d-8235-a989026b3a58 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.723589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88eb7e4e-dc16-4e0d-8235-a989026b3a58 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.724239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88eb7e4e-dc16-4e0d-8235-a989026b3a58 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.734414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ad1215ad-dccd-438a-91ec-6b867f6f970d req-02e11b1c-73b7-4244-8147-9ca5efe61239 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.734681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ad1215ad-dccd-438a-91ec-6b867f6f970d req-02e11b1c-73b7-4244-8147-9ca5efe61239 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.735041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ad1215ad-dccd-438a-91ec-6b867f6f970d req-02e11b1c-73b7-4244-8147-9ca5efe61239 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.758980 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-88eb7e4e-dc16-4e0d-8235-a989026b3a58 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.070544 Oct 04 21:12:57.767443 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-ad1215ad-dccd-438a-91ec-6b867f6f970d req-02e11b1c-73b7-4244-8147-9ca5efe61239 service nova] Creating event network-vif-deleted:9e441d3d-b8e8-4963-9f5c-ac245f115ac5 for instance 95674198-fb96-434e-82bf-f3b189599f0e on n-h2-860282-1 Oct 04 21:12:57.768349 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 968/1919] 10.222.0.30 () {60 vars in 1217 bytes} [Tue Oct 4 21:12:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:12:57.774594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e2ddc7ca-ba23-4bdb-9d66-821ea1a593f1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:57.775695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e2ddc7ca-ba23-4bdb-9d66-821ea1a593f1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:57.782670 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-ad1215ad-dccd-438a-91ec-6b867f6f970d req-02e11b1c-73b7-4244-8147-9ca5efe61239 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103669 Oct 04 21:12:57.785513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2ddc7ca-ba23-4bdb-9d66-821ea1a593f1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.785513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2ddc7ca-ba23-4bdb-9d66-821ea1a593f1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.785513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2ddc7ca-ba23-4bdb-9d66-821ea1a593f1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.786428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2ddc7ca-ba23-4bdb-9d66-821ea1a593f1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.787180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2ddc7ca-ba23-4bdb-9d66-821ea1a593f1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.787808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2ddc7ca-ba23-4bdb-9d66-821ea1a593f1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.795480 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 952/1920] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:57.818797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3e3795a6-0d53-4148-a7a5-c950151368e7 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860282-1", "block_migration": "auto"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:57.826637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3e3795a6-0d53-4148-a7a5-c950151368e7 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:57.838986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e3795a6-0d53-4148-a7a5-c950151368e7 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.840395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e3795a6-0d53-4148-a7a5-c950151368e7 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.841018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e3795a6-0d53-4148-a7a5-c950151368e7 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.843255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e3795a6-0d53-4148-a7a5-c950151368e7 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.843255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e3795a6-0d53-4148-a7a5-c950151368e7 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.843255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e3795a6-0d53-4148-a7a5-c950151368e7 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.880219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-3e3795a6-0d53-4148-a7a5-c950151368e7 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lazy-loading 'flavor' on Instance uuid 4c86d6b4-12a8-464a-84d7-2d6454aee597 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:12:57.897014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:57.902272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3e3795a6-0d53-4148-a7a5-c950151368e7 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Going to try to live migrate instance to n-h1-860282-1 {{(pid=122757) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:12:57.957243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e2ddc7ca-ba23-4bdb-9d66-821ea1a593f1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:57.985055 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e2ddc7ca-ba23-4bdb-9d66-821ea1a593f1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1497 microversion: 2.1 time: 0.213496 Oct 04 21:12:57.985873 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 969/1921] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:57 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1497 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:57.993350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8662f77f-969c-4f41-8a45-9ddc341e158e tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:57.994622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8662f77f-969c-4f41-8a45-9ddc341e158e tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:58.006229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8662f77f-969c-4f41-8a45-9ddc341e158e tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.007209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8662f77f-969c-4f41-8a45-9ddc341e158e tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.007840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8662f77f-969c-4f41-8a45-9ddc341e158e tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.015141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8662f77f-969c-4f41-8a45-9ddc341e158e tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.015141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8662f77f-969c-4f41-8a45-9ddc341e158e tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.015141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8662f77f-969c-4f41-8a45-9ddc341e158e tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.067260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8662f77f-969c-4f41-8a45-9ddc341e158e tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.068961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8662f77f-969c-4f41-8a45-9ddc341e158e tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.069667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8662f77f-969c-4f41-8a45-9ddc341e158e tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.070923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-8662f77f-969c-4f41-8a45-9ddc341e158e tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lazy-loading 'fault' on Instance uuid 47ef2ed7-3bd6-443a-84dd-5eda292e483d {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:12:58.139581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8662f77f-969c-4f41-8a45-9ddc341e158e tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc12643b5df642129dd351a2c8df9f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3919c90cb804d55b68b3d4d92141e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:58.148224 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8662f77f-969c-4f41-8a45-9ddc341e158e tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 200 len: 1306 microversion: 2.1 time: 0.160793 Oct 04 21:12:58.148806 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 970/1922] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:57 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 1306 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:58.154382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-19a4db79-4004-4f79-b103-26141b2c8b78 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:58.155255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-19a4db79-4004-4f79-b103-26141b2c8b78 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:58.161462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19a4db79-4004-4f79-b103-26141b2c8b78 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.162230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19a4db79-4004-4f79-b103-26141b2c8b78 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.162921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19a4db79-4004-4f79-b103-26141b2c8b78 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.163866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19a4db79-4004-4f79-b103-26141b2c8b78 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.164544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19a4db79-4004-4f79-b103-26141b2c8b78 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.165198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19a4db79-4004-4f79-b103-26141b2c8b78 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.380035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-19a4db79-4004-4f79-b103-26141b2c8b78 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:58.391061 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-19a4db79-4004-4f79-b103-26141b2c8b78 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705" status: 200 len: 1322 microversion: 2.1 time: 0.240812 Oct 04 21:12:58.392134 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 971/1923] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:58 2022] GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:58.398192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a3baa51c-1f51-4b68-8a00-136a2fab7da2 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:58.398908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a3baa51c-1f51-4b68-8a00-136a2fab7da2 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:58.409851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3baa51c-1f51-4b68-8a00-136a2fab7da2 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.410642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3baa51c-1f51-4b68-8a00-136a2fab7da2 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.410899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3baa51c-1f51-4b68-8a00-136a2fab7da2 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.411691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3baa51c-1f51-4b68-8a00-136a2fab7da2 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.412246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3baa51c-1f51-4b68-8a00-136a2fab7da2 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.412903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3baa51c-1f51-4b68-8a00-136a2fab7da2 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.534083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a3baa51c-1f51-4b68-8a00-136a2fab7da2 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6433ac83e746a1b8e5c4f7ec37d4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a735a9ba00c04c2fa6ed960ccc771d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:58.544836 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a3baa51c-1f51-4b68-8a00-136a2fab7da2 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785" status: 200 len: 1286 microversion: 2.1 time: 0.151357 Oct 04 21:12:58.547335 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 972/1924] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:58 2022] GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 => generated 1286 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:58.671668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-db8df76c-61b0-4062-aa77-76cdda5db201 req-54650a6f-301b-4393-adfb-1de44c373afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed428d1d-ba10-4fd4-b147-b28c9eb09705", "name": "network-vif-plugged", "status": "completed", "tag": "df0ba774-752b-421c-9804-8dcf3b95999f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:58.682503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-db8df76c-61b0-4062-aa77-76cdda5db201 req-54650a6f-301b-4393-adfb-1de44c373afd service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.683488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-db8df76c-61b0-4062-aa77-76cdda5db201 req-54650a6f-301b-4393-adfb-1de44c373afd service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.683908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-db8df76c-61b0-4062-aa77-76cdda5db201 req-54650a6f-301b-4393-adfb-1de44c373afd service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.697745 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-db8df76c-61b0-4062-aa77-76cdda5db201 req-54650a6f-301b-4393-adfb-1de44c373afd service nova] Creating event network-vif-plugged:df0ba774-752b-421c-9804-8dcf3b95999f for instance ed428d1d-ba10-4fd4-b147-b28c9eb09705 on n-h1-860282-1 Oct 04 21:12:58.703621 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-db8df76c-61b0-4062-aa77-76cdda5db201 req-54650a6f-301b-4393-adfb-1de44c373afd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036503 Oct 04 21:12:58.707976 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 973/1925] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:58.716247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f6c71f0e-ae19-4bde-9bb9-abb51a2c3d0d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:58.717227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f6c71f0e-ae19-4bde-9bb9-abb51a2c3d0d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:58.727261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6c71f0e-ae19-4bde-9bb9-abb51a2c3d0d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.727821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6c71f0e-ae19-4bde-9bb9-abb51a2c3d0d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.729026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6c71f0e-ae19-4bde-9bb9-abb51a2c3d0d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.729281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6c71f0e-ae19-4bde-9bb9-abb51a2c3d0d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.730047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6c71f0e-ae19-4bde-9bb9-abb51a2c3d0d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.730522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6c71f0e-ae19-4bde-9bb9-abb51a2c3d0d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.857487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f6c71f0e-ae19-4bde-9bb9-abb51a2c3d0d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:58.866005 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f6c71f0e-ae19-4bde-9bb9-abb51a2c3d0d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1184 microversion: 2.1 time: 0.156597 Oct 04 21:12:58.866772 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 974/1926] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:58 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1184 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:58.879655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0b169975-4380-4271-96dd-70cdbc46c31c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:58.880307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0b169975-4380-4271-96dd-70cdbc46c31c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:58.891764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b169975-4380-4271-96dd-70cdbc46c31c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.891764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b169975-4380-4271-96dd-70cdbc46c31c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.892235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b169975-4380-4271-96dd-70cdbc46c31c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.892884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b169975-4380-4271-96dd-70cdbc46c31c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.893673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b169975-4380-4271-96dd-70cdbc46c31c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.894113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b169975-4380-4271-96dd-70cdbc46c31c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:59.093438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0b169975-4380-4271-96dd-70cdbc46c31c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:59.107254 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0b169975-4380-4271-96dd-70cdbc46c31c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1475 microversion: 2.1 time: 0.239609 Oct 04 21:12:59.127416 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 975/1927] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:58 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1475 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:59.130650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-67d3436b-9713-41e5-8660-3499c0f3c797 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:59.131353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-67d3436b-9713-41e5-8660-3499c0f3c797 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:59.143332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d3436b-9713-41e5-8660-3499c0f3c797 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:59.144170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d3436b-9713-41e5-8660-3499c0f3c797 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:59.144956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d3436b-9713-41e5-8660-3499c0f3c797 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:59.145941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d3436b-9713-41e5-8660-3499c0f3c797 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:59.146584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d3436b-9713-41e5-8660-3499c0f3c797 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:59.147506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d3436b-9713-41e5-8660-3499c0f3c797 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:59.373202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67d3436b-9713-41e5-8660-3499c0f3c797 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:59.386719 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-67d3436b-9713-41e5-8660-3499c0f3c797 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1497 microversion: 2.1 time: 0.260609 Oct 04 21:12:59.415890 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 976/1928] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:59 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1497 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:59.421763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d5328af3-33d4-447d-b135-7060f77c882b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:59.422705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d5328af3-33d4-447d-b135-7060f77c882b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] [instance: 47ef2ed7-3bd6-443a-84dd-5eda292e483d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:59.431352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5328af3-33d4-447d-b135-7060f77c882b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:59.431352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5328af3-33d4-447d-b135-7060f77c882b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:59.431352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5328af3-33d4-447d-b135-7060f77c882b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:59.432349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5328af3-33d4-447d-b135-7060f77c882b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:59.432349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5328af3-33d4-447d-b135-7060f77c882b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:59.433654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5328af3-33d4-447d-b135-7060f77c882b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:59.448422 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-d5328af3-33d4-447d-b135-7060f77c882b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] HTTP exception thrown: Instance 47ef2ed7-3bd6-443a-84dd-5eda292e483d could not be found. Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d5328af3-33d4-447d-b135-7060f77c882b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Request method failure captured: Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d HTTP/1.1 Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKGyFjchZck_rhhgVD6ByydHQ4QkSsJ1GftRmKNXyF6wyjUsXUcOwumQ26r6tw_7Vyr-11T8EOR3xYXbpwPdxbTgH2cO7U9d-RojiLlvttDXip9mnGZ5pGEMU6zxlwh0g_VvXJQFRIPHWqlcwnwdjwSVh-DKOZDJTiCsNyqL6aLz0_0 Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f3919c90cb804d55b68b3d4d92141e84 Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-InstanceActionsTestJSON-1534042652 Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f3919c90cb804d55b68b3d4d92141e84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f3919c90cb804d55b68b3d4d92141e84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f3919c90cb804d55b68b3d4d92141e84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f3919c90cb804d55b68b3d4d92141e84"}]}] Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-InstanceActionsTestJSON-1534042652 Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f3919c90cb804d55b68b3d4d92141e84 Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1534042652 Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-InstanceActionsTestJSON-1534042652-project Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: dc12643b5df642129dd351a2c8df9f70 Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-InstanceActionsTestJSON-1534042652-project Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 47ef2ed7-3bd6-443a-84dd-5eda292e483d could not be found. Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '47ef2ed7-3bd6-443a-84dd-5eda292e483d'} Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47ef2ed7-3bd6-443a-84dd-5eda292e483d could not be found. Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47ef2ed7-3bd6-443a-84dd-5eda292e483d could not be found. Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:59.450376 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:59.456156 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:59.456156 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:59.456156 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:59.456156 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:12:59.456156 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:12:59.456156 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47ef2ed7-3bd6-443a-84dd-5eda292e483d could not be found. Oct 04 21:12:59.456156 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:12:59.456156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d5328af3-33d4-447d-b135-7060f77c882b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] Returning 404 to user: Instance 47ef2ed7-3bd6-443a-84dd-5eda292e483d could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:12:59.456156 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d5328af3-33d4-447d-b135-7060f77c882b tempest-InstanceActionsTestJSON-1534042652 tempest-InstanceActionsTestJSON-1534042652-project] 10.222.0.30 "GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d" status: 404 len: 111 microversion: 2.1 time: 0.034800 Oct 04 21:12:59.464469 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 977/1929] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:59 2022] GET /compute/v2.1/servers/47ef2ed7-3bd6-443a-84dd-5eda292e483d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:12:59.476895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8afffe4d-5ca2-40d6-a9d0-21d0607f9719 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:59.482845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8afffe4d-5ca2-40d6-a9d0-21d0607f9719 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:59.498160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8afffe4d-5ca2-40d6-a9d0-21d0607f9719 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:59.498906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8afffe4d-5ca2-40d6-a9d0-21d0607f9719 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:59.499117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8afffe4d-5ca2-40d6-a9d0-21d0607f9719 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:59.500051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8afffe4d-5ca2-40d6-a9d0-21d0607f9719 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:59.500666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8afffe4d-5ca2-40d6-a9d0-21d0607f9719 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:59.501289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8afffe4d-5ca2-40d6-a9d0-21d0607f9719 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:59.772395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8afffe4d-5ca2-40d6-a9d0-21d0607f9719 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:59.783748 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8afffe4d-5ca2-40d6-a9d0-21d0607f9719 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705" status: 200 len: 1322 microversion: 2.1 time: 0.319151 Oct 04 21:12:59.784342 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 978/1930] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:59 2022] GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:59.805565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b86ce0c5-f7a7-40d9-9644-25a3cd5f9444 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:59.807411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b86ce0c5-f7a7-40d9-9644-25a3cd5f9444 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:59.826090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b86ce0c5-f7a7-40d9-9644-25a3cd5f9444 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:59.826595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b86ce0c5-f7a7-40d9-9644-25a3cd5f9444 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:59.827021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b86ce0c5-f7a7-40d9-9644-25a3cd5f9444 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:59.827739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b86ce0c5-f7a7-40d9-9644-25a3cd5f9444 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:59.828188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b86ce0c5-f7a7-40d9-9644-25a3cd5f9444 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:59.828786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b86ce0c5-f7a7-40d9-9644-25a3cd5f9444 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:00.287840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b86ce0c5-f7a7-40d9-9644-25a3cd5f9444 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6433ac83e746a1b8e5c4f7ec37d4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a735a9ba00c04c2fa6ed960ccc771d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:00.298772 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b86ce0c5-f7a7-40d9-9644-25a3cd5f9444 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785" status: 200 len: 1316 microversion: 2.1 time: 0.513349 Oct 04 21:13:00.303730 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 979/1931] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:59 2022] GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:00.319687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3a8b1ab0-60ef-4c14-bb21-b0eca66b83bb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:00.321340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3a8b1ab0-60ef-4c14-bb21-b0eca66b83bb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:00.333816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a8b1ab0-60ef-4c14-bb21-b0eca66b83bb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:00.338017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a8b1ab0-60ef-4c14-bb21-b0eca66b83bb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:00.338017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a8b1ab0-60ef-4c14-bb21-b0eca66b83bb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:00.338017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a8b1ab0-60ef-4c14-bb21-b0eca66b83bb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:00.338017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a8b1ab0-60ef-4c14-bb21-b0eca66b83bb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:00.338707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a8b1ab0-60ef-4c14-bb21-b0eca66b83bb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:00.441442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3a8b1ab0-60ef-4c14-bb21-b0eca66b83bb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:00.458167 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3a8b1ab0-60ef-4c14-bb21-b0eca66b83bb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1184 microversion: 2.1 time: 0.150636 Oct 04 21:13:00.458882 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 980/1932] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:00 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1184 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:00.483608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d2bc8377-c150-47ed-8171-e6fa6f139154 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:00.484556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d2bc8377-c150-47ed-8171-e6fa6f139154 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:00.492000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2bc8377-c150-47ed-8171-e6fa6f139154 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:00.492771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2bc8377-c150-47ed-8171-e6fa6f139154 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:00.494547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2bc8377-c150-47ed-8171-e6fa6f139154 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:00.495785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2bc8377-c150-47ed-8171-e6fa6f139154 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:00.496710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2bc8377-c150-47ed-8171-e6fa6f139154 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:00.497402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2bc8377-c150-47ed-8171-e6fa6f139154 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:00.538399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:01.036924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d2bc8377-c150-47ed-8171-e6fa6f139154 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:01.047546 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d2bc8377-c150-47ed-8171-e6fa6f139154 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1475 microversion: 2.1 time: 0.576224 Oct 04 21:13:01.049646 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 981/1933] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:00 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1475 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:01.066195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-496df99c-b4b6-45cb-99e6-eaae507547dd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:01.067340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-496df99c-b4b6-45cb-99e6-eaae507547dd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:01.075595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:01.077631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-496df99c-b4b6-45cb-99e6-eaae507547dd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:01.078476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-496df99c-b4b6-45cb-99e6-eaae507547dd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:01.080413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-496df99c-b4b6-45cb-99e6-eaae507547dd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:01.084571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-496df99c-b4b6-45cb-99e6-eaae507547dd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:01.085624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-496df99c-b4b6-45cb-99e6-eaae507547dd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:01.087210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-496df99c-b4b6-45cb-99e6-eaae507547dd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:01.338033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-496df99c-b4b6-45cb-99e6-eaae507547dd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:01.349787 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-496df99c-b4b6-45cb-99e6-eaae507547dd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1497 microversion: 2.1 time: 0.298706 Oct 04 21:13:01.351825 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 982/1934] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:01 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1497 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:01.359508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-69162ef3-bd4a-4035-a71d-003679ca0516 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:01.360837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-69162ef3-bd4a-4035-a71d-003679ca0516 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:01.377664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-69162ef3-bd4a-4035-a71d-003679ca0516 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:01.378332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-69162ef3-bd4a-4035-a71d-003679ca0516 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:01.379052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-69162ef3-bd4a-4035-a71d-003679ca0516 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:01.381532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-69162ef3-bd4a-4035-a71d-003679ca0516 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:01.382433 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-69162ef3-bd4a-4035-a71d-003679ca0516 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:01.383133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-69162ef3-bd4a-4035-a71d-003679ca0516 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:01.635234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-69162ef3-bd4a-4035-a71d-003679ca0516 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:01.648727 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-69162ef3-bd4a-4035-a71d-003679ca0516 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705" status: 200 len: 1472 microversion: 2.1 time: 0.295576 Oct 04 21:13:01.653617 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 983/1935] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:01 2022] GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 => generated 1472 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:01.662660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4359e913-cd3a-40f7-8e1f-3f72caa1bbbf tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:01.666889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4359e913-cd3a-40f7-8e1f-3f72caa1bbbf tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:01.694460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4359e913-cd3a-40f7-8e1f-3f72caa1bbbf tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:01.695168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4359e913-cd3a-40f7-8e1f-3f72caa1bbbf tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:01.695979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4359e913-cd3a-40f7-8e1f-3f72caa1bbbf tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:01.696833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4359e913-cd3a-40f7-8e1f-3f72caa1bbbf tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:01.698836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4359e913-cd3a-40f7-8e1f-3f72caa1bbbf tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:01.701129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4359e913-cd3a-40f7-8e1f-3f72caa1bbbf tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:02.423192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4359e913-cd3a-40f7-8e1f-3f72caa1bbbf tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6433ac83e746a1b8e5c4f7ec37d4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a735a9ba00c04c2fa6ed960ccc771d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:02.434881 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4359e913-cd3a-40f7-8e1f-3f72caa1bbbf tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785" status: 200 len: 1316 microversion: 2.1 time: 0.777478 Oct 04 21:13:02.441584 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 984/1936] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:01 2022] GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 => generated 1316 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:02.446862 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3e3795a6-0d53-4148-a7a5-c950151368e7 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597/action" status: 202 len: 0 microversion: 2.25 time: 4.649835 Oct 04 21:13:02.450331 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 953/1937] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Oct 4 21:12:57 2022] POST /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597/action => generated 0 bytes in 4653 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:13:02.456694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e8e27fbe-7941-481d-9e4d-76dd74c9064a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:02.458222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e8e27fbe-7941-481d-9e4d-76dd74c9064a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:02.467617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-54524b42-6987-42bd-82ea-0081fa629aff tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:02.468887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-54524b42-6987-42bd-82ea-0081fa629aff tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:02.473741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8e27fbe-7941-481d-9e4d-76dd74c9064a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:02.474244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8e27fbe-7941-481d-9e4d-76dd74c9064a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:02.474682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8e27fbe-7941-481d-9e4d-76dd74c9064a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:02.475393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8e27fbe-7941-481d-9e4d-76dd74c9064a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:02.477264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8e27fbe-7941-481d-9e4d-76dd74c9064a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:02.477956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8e27fbe-7941-481d-9e4d-76dd74c9064a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:02.484872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54524b42-6987-42bd-82ea-0081fa629aff tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:02.485379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54524b42-6987-42bd-82ea-0081fa629aff tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:02.485901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54524b42-6987-42bd-82ea-0081fa629aff tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:02.486825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54524b42-6987-42bd-82ea-0081fa629aff tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:02.487679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54524b42-6987-42bd-82ea-0081fa629aff tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:02.488289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54524b42-6987-42bd-82ea-0081fa629aff tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:02.548390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-54524b42-6987-42bd-82ea-0081fa629aff tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Lazy-loading 'flavor' on Instance uuid ed428d1d-ba10-4fd4-b147-b28c9eb09705 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:13:02.620932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e8e27fbe-7941-481d-9e4d-76dd74c9064a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:02.629928 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e8e27fbe-7941-481d-9e4d-76dd74c9064a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1184 microversion: 2.1 time: 0.186919 Oct 04 21:13:02.641459 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 985/1938] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:02 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1184 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:02.648085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9009bf40-4f35-49b7-95a4-ff82d0818599 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:02.648840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9009bf40-4f35-49b7-95a4-ff82d0818599 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:02.659164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9009bf40-4f35-49b7-95a4-ff82d0818599 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:02.659668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9009bf40-4f35-49b7-95a4-ff82d0818599 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:02.660182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9009bf40-4f35-49b7-95a4-ff82d0818599 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:02.660906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9009bf40-4f35-49b7-95a4-ff82d0818599 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:02.661373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9009bf40-4f35-49b7-95a4-ff82d0818599 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:02.661838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9009bf40-4f35-49b7-95a4-ff82d0818599 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:02.948293 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-54524b42-6987-42bd-82ea-0081fa629aff tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705/action" status: 202 len: 0 microversion: 2.1 time: 0.496424 Oct 04 21:13:02.948773 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 954/1939] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:13:02 2022] POST /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:13:02.969275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9551e5bc-4ce0-408c-8d67-8d7c661a0dac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:02.970132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9551e5bc-4ce0-408c-8d67-8d7c661a0dac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:02.984284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9551e5bc-4ce0-408c-8d67-8d7c661a0dac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:02.990970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9551e5bc-4ce0-408c-8d67-8d7c661a0dac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:02.990970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9551e5bc-4ce0-408c-8d67-8d7c661a0dac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:02.990970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9551e5bc-4ce0-408c-8d67-8d7c661a0dac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:02.990970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9551e5bc-4ce0-408c-8d67-8d7c661a0dac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:02.990970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9551e5bc-4ce0-408c-8d67-8d7c661a0dac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:03.160036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9009bf40-4f35-49b7-95a4-ff82d0818599 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:03.178743 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9009bf40-4f35-49b7-95a4-ff82d0818599 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1475 microversion: 2.1 time: 0.546662 Oct 04 21:13:03.179606 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 986/1940] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:02 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1475 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:03.184702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4e8fa36a-c0b2-4104-897d-4d7464b6078e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:03.185584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4e8fa36a-c0b2-4104-897d-4d7464b6078e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:03.201296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e8fa36a-c0b2-4104-897d-4d7464b6078e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:03.202234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e8fa36a-c0b2-4104-897d-4d7464b6078e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:03.204771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e8fa36a-c0b2-4104-897d-4d7464b6078e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:03.217239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e8fa36a-c0b2-4104-897d-4d7464b6078e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:03.218010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e8fa36a-c0b2-4104-897d-4d7464b6078e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:03.218624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e8fa36a-c0b2-4104-897d-4d7464b6078e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:03.417012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:03.857411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4e8fa36a-c0b2-4104-897d-4d7464b6078e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:03.872732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4e8fa36a-c0b2-4104-897d-4d7464b6078e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:03.875771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4e8fa36a-c0b2-4104-897d-4d7464b6078e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:03.875771 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4e8fa36a-c0b2-4104-897d-4d7464b6078e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 0.695074 Oct 04 21:13:03.889718 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 987/1941] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:03 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:03.889718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-45412f16-9c76-4c90-997c-11dffd1b214c req-cd040425-982f-41b5-90ba-540dc335e153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69eb8120-e4a4-47cd-b41d-b278ad6fd785", "tag": "9bdba8e5-2ed1-48e3-ba5a-c7cbc9bb9e2e"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:03.916329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-45412f16-9c76-4c90-997c-11dffd1b214c req-cd040425-982f-41b5-90ba-540dc335e153 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:03.917145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-45412f16-9c76-4c90-997c-11dffd1b214c req-cd040425-982f-41b5-90ba-540dc335e153 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:03.919562 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-45412f16-9c76-4c90-997c-11dffd1b214c req-cd040425-982f-41b5-90ba-540dc335e153 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:03.939111 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-45412f16-9c76-4c90-997c-11dffd1b214c req-cd040425-982f-41b5-90ba-540dc335e153 service nova] Creating event network-changed:9bdba8e5-2ed1-48e3-ba5a-c7cbc9bb9e2e for instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 on n-h1-860282-1 Oct 04 21:13:03.950536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9551e5bc-4ce0-408c-8d67-8d7c661a0dac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:03.954370 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-45412f16-9c76-4c90-997c-11dffd1b214c req-cd040425-982f-41b5-90ba-540dc335e153 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071285 Oct 04 21:13:03.955301 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 988/1942] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:03.963645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0e8b198b-9825-44cd-b1e8-8243969f39f5 tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:03.967174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0e8b198b-9825-44cd-b1e8-8243969f39f5 tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:03.973249 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9551e5bc-4ce0-408c-8d67-8d7c661a0dac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 200 len: 1474 microversion: 2.1 time: 1.023057 Oct 04 21:13:03.977586 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 955/1943] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:02 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 1474 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:03.977723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e8b198b-9825-44cd-b1e8-8243969f39f5 tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:03.977723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e8b198b-9825-44cd-b1e8-8243969f39f5 tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:03.978028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e8b198b-9825-44cd-b1e8-8243969f39f5 tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:03.979290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e8b198b-9825-44cd-b1e8-8243969f39f5 tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:03.980055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e8b198b-9825-44cd-b1e8-8243969f39f5 tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:03.980780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e8b198b-9825-44cd-b1e8-8243969f39f5 tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:03.999237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-64e03ea7-a7b1-48e4-aa19-d2af05264f34 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:04.001211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-64e03ea7-a7b1-48e4-aa19-d2af05264f34 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:04.025961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64e03ea7-a7b1-48e4-aa19-d2af05264f34 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:04.027716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64e03ea7-a7b1-48e4-aa19-d2af05264f34 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:04.028171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64e03ea7-a7b1-48e4-aa19-d2af05264f34 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:04.035073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64e03ea7-a7b1-48e4-aa19-d2af05264f34 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:04.035073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64e03ea7-a7b1-48e4-aa19-d2af05264f34 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:04.036080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64e03ea7-a7b1-48e4-aa19-d2af05264f34 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:04.080575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:04.642217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-64e03ea7-a7b1-48e4-aa19-d2af05264f34 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6433ac83e746a1b8e5c4f7ec37d4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a735a9ba00c04c2fa6ed960ccc771d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:04.653393 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-64e03ea7-a7b1-48e4-aa19-d2af05264f34 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785" status: 200 len: 1316 microversion: 2.1 time: 0.678336 Oct 04 21:13:04.654789 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 956/1944] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:03 2022] GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 => generated 1316 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:04.660292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-245688d0-fecd-4798-9eaf-48314a52254d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:04.661382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-245688d0-fecd-4798-9eaf-48314a52254d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:04.675557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-245688d0-fecd-4798-9eaf-48314a52254d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:04.676073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-245688d0-fecd-4798-9eaf-48314a52254d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:04.676521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-245688d0-fecd-4798-9eaf-48314a52254d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:04.677256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-245688d0-fecd-4798-9eaf-48314a52254d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:04.680666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-245688d0-fecd-4798-9eaf-48314a52254d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:04.681908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-245688d0-fecd-4798-9eaf-48314a52254d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:04.801762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-245688d0-fecd-4798-9eaf-48314a52254d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:04.820549 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-245688d0-fecd-4798-9eaf-48314a52254d tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 200 len: 1184 microversion: 2.1 time: 0.159333 Oct 04 21:13:04.823123 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0e8b198b-9825-44cd-b1e8-8243969f39f5 tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705" status: 200 len: 1614 microversion: 2.1 time: 0.865072 Oct 04 21:13:04.823793 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 957/1945] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:04 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 1184 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:04.823958 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 989/1946] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:03 2022] GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 => generated 1614 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:04.829073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c2ee4c42-70e5-497f-b21a-f39b7fadc97d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:04.829718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c2ee4c42-70e5-497f-b21a-f39b7fadc97d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:04.846362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-15b9ab5f-9606-4784-b10b-5dc0ca39888b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2012324093"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:04.849914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-15b9ab5f-9606-4784-b10b-5dc0ca39888b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:04.850046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2ee4c42-70e5-497f-b21a-f39b7fadc97d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:04.850541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2ee4c42-70e5-497f-b21a-f39b7fadc97d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:04.855732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2ee4c42-70e5-497f-b21a-f39b7fadc97d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:04.857008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2ee4c42-70e5-497f-b21a-f39b7fadc97d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:04.857665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2ee4c42-70e5-497f-b21a-f39b7fadc97d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:04.859148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2ee4c42-70e5-497f-b21a-f39b7fadc97d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:04.861107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15b9ab5f-9606-4784-b10b-5dc0ca39888b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:04.861872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15b9ab5f-9606-4784-b10b-5dc0ca39888b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:04.862470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15b9ab5f-9606-4784-b10b-5dc0ca39888b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:04.867225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15b9ab5f-9606-4784-b10b-5dc0ca39888b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:04.868038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15b9ab5f-9606-4784-b10b-5dc0ca39888b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:04.868641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15b9ab5f-9606-4784-b10b-5dc0ca39888b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:05.149141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c2ee4c42-70e5-497f-b21a-f39b7fadc97d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:05.161236 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c2ee4c42-70e5-497f-b21a-f39b7fadc97d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1474 microversion: 2.1 time: 0.337899 Oct 04 21:13:05.162117 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 990/1947] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:04 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1474 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:05.170486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a7941b89-5437-4c30-8f6e-334446b0832b tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:05.174457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a7941b89-5437-4c30-8f6e-334446b0832b tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:05.182045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7941b89-5437-4c30-8f6e-334446b0832b tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:05.185058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7941b89-5437-4c30-8f6e-334446b0832b tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:05.185922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7941b89-5437-4c30-8f6e-334446b0832b tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:05.187511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7941b89-5437-4c30-8f6e-334446b0832b tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:05.188303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7941b89-5437-4c30-8f6e-334446b0832b tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:05.188976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7941b89-5437-4c30-8f6e-334446b0832b tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:05.286199 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-a7941b89-5437-4c30-8f6e-334446b0832b tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] HTTP exception thrown: Cannot 'migrate' instance ed428d1d-ba10-4fd4-b147-b28c9eb09705 while it is in vm_state suspended Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a7941b89-5437-4c30-8f6e-334446b0832b tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Request method failure captured: Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705/action HTTP/1.1 Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 15 Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKGszvyjgavIMCp3eaOQztnuWW_0msh-zOsnYOJ2APZaP7DjyQcaY8WDQR4T12H3Pl0BFA9MxsUrCdBCKM_JkQahu81di7TRrsWtKWtzImjzeEKVBRX3bUBxXHIx532Z0rVBTtjKvH-VzFjJQIXLfoZ5oRRczYQbZ7I9FnHJzzZmlNk Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: b288159fdd074bd4a1947d38bcb5fb7a Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1207072545 Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b288159fdd074bd4a1947d38bcb5fb7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b288159fdd074bd4a1947d38bcb5fb7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b288159fdd074bd4a1947d38bcb5fb7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b288159fdd074bd4a1947d38bcb5fb7a"}]}] Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1207072545 Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: b288159fdd074bd4a1947d38bcb5fb7a Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1207072545 Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersAdminNegativeTestJSON-1207072545-project-admin Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 78e967adc4f846c8aba9ff9593da90ed Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1207072545-project-admin Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: {"migrate": {}} Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: exception: Cannot 'migrate' instance ed428d1d-ba10-4fd4-b147-b28c9eb09705 while it is in vm_state suspended Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'ed428d1d-ba10-4fd4-b147-b28c9eb09705', 'body': {'migrate': {}}} Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ed428d1d-ba10-4fd4-b147-b28c9eb09705 in vm_state suspended. Cannot resize while the instance is in this state. Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:13:05.287989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 04 21:13:05.299986 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:13:05.299986 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:13:05.299986 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:13:05.299986 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance ed428d1d-ba10-4fd4-b147-b28c9eb09705 while it is in vm_state suspended Oct 04 21:13:05.299986 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:05.299986 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:05.299986 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:05.299986 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:05.299986 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:05.299986 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:05.299986 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:05.299986 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:05.299986 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance ed428d1d-ba10-4fd4-b147-b28c9eb09705 while it is in vm_state suspended Oct 04 21:13:05.299986 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:05.299986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a7941b89-5437-4c30-8f6e-334446b0832b tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Returning 409 to user: Cannot 'migrate' instance ed428d1d-ba10-4fd4-b147-b28c9eb09705 while it is in vm_state suspended {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:05.299986 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a7941b89-5437-4c30-8f6e-334446b0832b tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705/action" status: 409 len: 148 microversion: 2.1 time: 0.126698 Oct 04 21:13:05.299986 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 991/1948] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:13:05 2022] POST /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705/action => generated 148 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:13:05.311260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ebc3986b-447b-4151-82fa-b29db1cec3de tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:05.311260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ebc3986b-447b-4151-82fa-b29db1cec3de tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:05.314256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebc3986b-447b-4151-82fa-b29db1cec3de tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:05.314818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebc3986b-447b-4151-82fa-b29db1cec3de tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:05.315250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebc3986b-447b-4151-82fa-b29db1cec3de tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:05.315965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebc3986b-447b-4151-82fa-b29db1cec3de tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:05.316420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebc3986b-447b-4151-82fa-b29db1cec3de tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:05.316838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebc3986b-447b-4151-82fa-b29db1cec3de tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:05.592724 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-15b9ab5f-9606-4784-b10b-5dc0ca39888b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "POST /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce/action" status: 202 len: 0 microversion: 2.1 time: 0.755264 Oct 04 21:13:05.609561 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 958/1949] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:13:04 2022] POST /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce/action => generated 0 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 21:13:05.623445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-97db5c7a-b158-45ed-a8eb-3aefa4633c5c tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-97db5c7a-b158-45ed-a8eb-3aefa4633c5c tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Request method failure captured: Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec/action HTTP/1.1 Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 39 Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKGszvyjgavIMCp3eaOQztnuWW_0msh-zOsnYOJ2APZaP7DjyQcaY8WDQR4T12H3Pl0BFA9MxsUrCdBCKM_JkQahu81di7TRrsWtKWtzImjzeEKVBRX3bUBxXHIx532Z0rVBTtjKvH-VzFjJQIXLfoZ5oRRczYQbZ7I9FnHJzzZmlNk Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: b288159fdd074bd4a1947d38bcb5fb7a Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1207072545 Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b288159fdd074bd4a1947d38bcb5fb7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b288159fdd074bd4a1947d38bcb5fb7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b288159fdd074bd4a1947d38bcb5fb7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b288159fdd074bd4a1947d38bcb5fb7a"}]}] Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1207072545 Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: b288159fdd074bd4a1947d38bcb5fb7a Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1207072545 Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersAdminNegativeTestJSON-1207072545-project-admin Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 78e967adc4f846c8aba9ff9593da90ed Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1207072545-project-admin Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: {"os-resetState": {"state": "invalid"}} Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '04b031f2-40e3-486e-9066-ff87fbffb8ec', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:13:05.627202 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:13:05.646197 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 21:13:05.646197 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:05.646197 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:05.646197 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:05.646197 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:05.646197 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:05.646197 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:05.646197 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:13:05.646197 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:13:05.646197 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 21:13:05.646197 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:05.646197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-97db5c7a-b158-45ed-a8eb-3aefa4633c5c tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:05.646197 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-97db5c7a-b158-45ed-a8eb-3aefa4633c5c tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec/action" status: 400 len: 144 microversion: 2.1 time: 0.017632 Oct 04 21:13:05.646197 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 959/1950] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:13:05 2022] POST /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec/action => generated 144 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:13:05.758465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-28a246dd-b6e3-4870-b517-a99211143070 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-591355086", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "782895f5-1d71-4a4c-a957-454ea4f0d913"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:05.867231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-28a246dd-b6e3-4870-b517-a99211143070 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] validate_networks() for [('782895f5-1d71-4a4c-a957-454ea4f0d913', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:13:06.609705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ebc3986b-447b-4151-82fa-b29db1cec3de tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:06.628284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ebc3986b-447b-4151-82fa-b29db1cec3de tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:06.632941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ebc3986b-447b-4151-82fa-b29db1cec3de tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:06.634566 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ebc3986b-447b-4151-82fa-b29db1cec3de tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 1.340184 Oct 04 21:13:06.658829 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 992/1951] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:05 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:06.664410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-12eb3c75-b40e-46d4-85f7-7a5d7fd9e521 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f579013eee0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:06.761810 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-12eb3c75-b40e-46d4-85f7-7a5d7fd9e521 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.100864 Oct 04 21:13:06.769039 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 993/1952] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:06 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:06.781002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c20fdf10-bee8-4052-9172-c114c2f893bd tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c20fdf10-bee8-4052-9172-c114c2f893bd tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Request method failure captured: Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec/action HTTP/1.1 Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 31 Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKGszvyjgavIMCp3eaOQztnuWW_0msh-zOsnYOJ2APZaP7DjyQcaY8WDQR4T12H3Pl0BFA9MxsUrCdBCKM_JkQahu81di7TRrsWtKWtzImjzeEKVBRX3bUBxXHIx532Z0rVBTtjKvH-VzFjJQIXLfoZ5oRRczYQbZ7I9FnHJzzZmlNk Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: b288159fdd074bd4a1947d38bcb5fb7a Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1207072545 Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b288159fdd074bd4a1947d38bcb5fb7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b288159fdd074bd4a1947d38bcb5fb7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b288159fdd074bd4a1947d38bcb5fb7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b288159fdd074bd4a1947d38bcb5fb7a"}]}] Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1207072545 Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: b288159fdd074bd4a1947d38bcb5fb7a Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1207072545 Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersAdminNegativeTestJSON-1207072545-project-admin Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 78e967adc4f846c8aba9ff9593da90ed Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1207072545-project-admin Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: {"os-resetState": {"state": 1}} Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '04b031f2-40e3-486e-9066-ff87fbffb8ec', 'body': {'os-resetState': {'state': 1}}} Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 1 Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 21:13:06.793720 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:06.799736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:06.799736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:06.799736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:06.799736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:06.799736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:06.799736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:13:06.799736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:13:06.799736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 21:13:06.799736 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:06.803601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c20fdf10-bee8-4052-9172-c114c2f893bd tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:06.807970 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c20fdf10-bee8-4052-9172-c114c2f893bd tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec/action" status: 400 len: 120 microversion: 2.1 time: 0.037391 Oct 04 21:13:06.809299 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 994/1953] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:13:06 2022] POST /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec/action => generated 120 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:13:06.828277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f536a85d-19dc-4aa5-ae99-cc1916bf778c tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:06.829331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f536a85d-19dc-4aa5-ae99-cc1916bf778c tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:06.840709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f536a85d-19dc-4aa5-ae99-cc1916bf778c tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:06.842090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f536a85d-19dc-4aa5-ae99-cc1916bf778c tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:06.842795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f536a85d-19dc-4aa5-ae99-cc1916bf778c tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:06.844847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f536a85d-19dc-4aa5-ae99-cc1916bf778c tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:06.845826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f536a85d-19dc-4aa5-ae99-cc1916bf778c tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:06.846575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f536a85d-19dc-4aa5-ae99-cc1916bf778c tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:07.625109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f536a85d-19dc-4aa5-ae99-cc1916bf778c tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6433ac83e746a1b8e5c4f7ec37d4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a735a9ba00c04c2fa6ed960ccc771d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:07.637438 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f536a85d-19dc-4aa5-ae99-cc1916bf778c tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785" status: 200 len: 1316 microversion: 2.1 time: 0.826649 Oct 04 21:13:07.645011 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 995/1954] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:06 2022] GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 => generated 1316 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:07.654365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1213e445-140c-4a24-a4e1-29fa312b42ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:07.664290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1213e445-140c-4a24-a4e1-29fa312b42ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 95674198-fb96-434e-82bf-f3b189599f0e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:07.697963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1213e445-140c-4a24-a4e1-29fa312b42ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:07.699028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1213e445-140c-4a24-a4e1-29fa312b42ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:07.704160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1213e445-140c-4a24-a4e1-29fa312b42ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:07.705352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1213e445-140c-4a24-a4e1-29fa312b42ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:07.713041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1213e445-140c-4a24-a4e1-29fa312b42ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:07.718346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1213e445-140c-4a24-a4e1-29fa312b42ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:07.747976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:07.750051 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-1213e445-140c-4a24-a4e1-29fa312b42ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] HTTP exception thrown: Instance 95674198-fb96-434e-82bf-f3b189599f0e could not be found. Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1213e445-140c-4a24-a4e1-29fa312b42ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Request method failure captured: Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e HTTP/1.1 Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKBT-XKr348wZ9WTMvXM6gFaW0uZDmbpTA5cPm3mvF7iwM1X1XqcLWWCvbMgfgLCsUBiWuE9ndMAkk1P6Mmk_UTB3LCm5YbIIJc9-Zz6g4AhEA5xGKmq5Peob5aZPnBhBXYpm3oFsT4-W53Qa_eD4upvWJGHmDwrhE7jn-Hj-m0vRUc Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7e9215d1ae0947ce84469bed21fc05ac Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-LiveMigrationTest-1421388441 Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7e9215d1ae0947ce84469bed21fc05ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7e9215d1ae0947ce84469bed21fc05ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7e9215d1ae0947ce84469bed21fc05ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7e9215d1ae0947ce84469bed21fc05ac"}]}] Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-LiveMigrationTest-1421388441 Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7e9215d1ae0947ce84469bed21fc05ac Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-LiveMigrationTest-1421388441 Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-LiveMigrationTest-1421388441-project Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 8bfa449eb3144332afa616cc85d9643f Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-LiveMigrationTest-1421388441-project Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 95674198-fb96-434e-82bf-f3b189599f0e could not be found. Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '95674198-fb96-434e-82bf-f3b189599f0e'} Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95674198-fb96-434e-82bf-f3b189599f0e could not be found. Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95674198-fb96-434e-82bf-f3b189599f0e could not be found. Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:07.754592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:07.759707 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:07.759707 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:07.759707 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:07.759707 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:07.759707 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:07.759707 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95674198-fb96-434e-82bf-f3b189599f0e could not be found. Oct 04 21:13:07.759707 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:07.764488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1213e445-140c-4a24-a4e1-29fa312b42ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Returning 404 to user: Instance 95674198-fb96-434e-82bf-f3b189599f0e could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:07.767227 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1213e445-140c-4a24-a4e1-29fa312b42ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e" status: 404 len: 111 microversion: 2.1 time: 0.120677 Oct 04 21:13:07.776338 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 996/1955] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:07 2022] GET /compute/v2.1/servers/95674198-fb96-434e-82bf-f3b189599f0e => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:07.783251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f25bce59-84c4-4ca2-9755-f81e5d54bab3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:07.787133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f25bce59-84c4-4ca2-9755-f81e5d54bab3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:07.806355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f25bce59-84c4-4ca2-9755-f81e5d54bab3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:07.807263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f25bce59-84c4-4ca2-9755-f81e5d54bab3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:07.809590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f25bce59-84c4-4ca2-9755-f81e5d54bab3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:07.810621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f25bce59-84c4-4ca2-9755-f81e5d54bab3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:07.811357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f25bce59-84c4-4ca2-9755-f81e5d54bab3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:07.816163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f25bce59-84c4-4ca2-9755-f81e5d54bab3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:08.869194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f25bce59-84c4-4ca2-9755-f81e5d54bab3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:08.884910 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f25bce59-84c4-4ca2-9755-f81e5d54bab3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1474 microversion: 2.1 time: 1.101104 Oct 04 21:13:08.884910 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 997/1956] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:07 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1474 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:08.902997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-94cc29b0-9212-40b3-9bbc-2c2ef7d0a38f tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:08.905384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-94cc29b0-9212-40b3-9bbc-2c2ef7d0a38f tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Failed to fetch instance by id 999 {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 21:13:08.912667 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-94cc29b0-9212-40b3-9bbc-2c2ef7d0a38f tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-94cc29b0-9212-40b3-9bbc-2c2ef7d0a38f tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Request method failure captured: Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 37 Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKGszvyjgavIMCp3eaOQztnuWW_0msh-zOsnYOJ2APZaP7DjyQcaY8WDQR4T12H3Pl0BFA9MxsUrCdBCKM_JkQahu81di7TRrsWtKWtzImjzeEKVBRX3bUBxXHIx532Z0rVBTtjKvH-VzFjJQIXLfoZ5oRRczYQbZ7I9FnHJzzZmlNk Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: b288159fdd074bd4a1947d38bcb5fb7a Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1207072545 Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b288159fdd074bd4a1947d38bcb5fb7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b288159fdd074bd4a1947d38bcb5fb7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b288159fdd074bd4a1947d38bcb5fb7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b288159fdd074bd4a1947d38bcb5fb7a"}]}] Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1207072545 Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: b288159fdd074bd4a1947d38bcb5fb7a Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1207072545 Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersAdminNegativeTestJSON-1207072545-project-admin Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 78e967adc4f846c8aba9ff9593da90ed Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1207072545-project-admin Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: {"os-resetState": {"state": "error"}} Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 999 could not be found. Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:08.922346 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:08.928056 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:08.928056 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 21:13:08.928056 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:08.928056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-94cc29b0-9212-40b3-9bbc-2c2ef7d0a38f tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:08.928056 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-94cc29b0-9212-40b3-9bbc-2c2ef7d0a38f tempest-ServersAdminNegativeTestJSON-1207072545 tempest-ServersAdminNegativeTestJSON-1207072545-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.039047 Oct 04 21:13:08.930815 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 998/1957] 10.222.0.30 () {60 vars in 1179 bytes} [Tue Oct 4 21:13:08 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:13:08.950367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-e2de1832-4a58-46a8-939f-7bb19c55a04d req-b8c48586-6304-4f4a-b9bc-4b81a16fb151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0dbeb11-0fb1-48ab-aa70-d33e03b8093d", "name": "network-vif-unplugged", "status": "completed", "tag": "622d2354-1aa7-4c56-9968-1dc840e8b049"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:08.988539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e2de1832-4a58-46a8-939f-7bb19c55a04d req-b8c48586-6304-4f4a-b9bc-4b81a16fb151 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:08.989040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e2de1832-4a58-46a8-939f-7bb19c55a04d req-b8c48586-6304-4f4a-b9bc-4b81a16fb151 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:08.993783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e2de1832-4a58-46a8-939f-7bb19c55a04d req-b8c48586-6304-4f4a-b9bc-4b81a16fb151 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:09.055875 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-e2de1832-4a58-46a8-939f-7bb19c55a04d req-b8c48586-6304-4f4a-b9bc-4b81a16fb151 service nova] Creating event network-vif-unplugged:622d2354-1aa7-4c56-9968-1dc840e8b049 for instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d on n-h1-860282-1 Oct 04 21:13:09.063605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-28a246dd-b6e3-4870-b517-a99211143070 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:13:09.073436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-28a246dd-b6e3-4870-b517-a99211143070 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:13:09.073436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-28a246dd-b6e3-4870-b517-a99211143070 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:13:09.073436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-28a246dd-b6e3-4870-b517-a99211143070 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:13:09.073436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-28a246dd-b6e3-4870-b517-a99211143070 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:13:09.082901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-e2de1832-4a58-46a8-939f-7bb19c55a04d req-b8c48586-6304-4f4a-b9bc-4b81a16fb151 service nova] Instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:13:09.097529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28a246dd-b6e3-4870-b517-a99211143070 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:09.098904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28a246dd-b6e3-4870-b517-a99211143070 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:09.101647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28a246dd-b6e3-4870-b517-a99211143070 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:09.104127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28a246dd-b6e3-4870-b517-a99211143070 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:09.106744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28a246dd-b6e3-4870-b517-a99211143070 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:09.109735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28a246dd-b6e3-4870-b517-a99211143070 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:09.114629 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-e2de1832-4a58-46a8-939f-7bb19c55a04d req-b8c48586-6304-4f4a-b9bc-4b81a16fb151 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.181513 Oct 04 21:13:09.117930 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 999/1958] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:09.134507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-12d1d759-23ea-49a6-b057-e5ceab8e8206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:09.137397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-12d1d759-23ea-49a6-b057-e5ceab8e8206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:09.156781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12d1d759-23ea-49a6-b057-e5ceab8e8206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:09.159175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12d1d759-23ea-49a6-b057-e5ceab8e8206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:09.159175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12d1d759-23ea-49a6-b057-e5ceab8e8206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:09.159175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12d1d759-23ea-49a6-b057-e5ceab8e8206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:09.160050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12d1d759-23ea-49a6-b057-e5ceab8e8206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:09.162585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12d1d759-23ea-49a6-b057-e5ceab8e8206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:09.174689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-28a246dd-b6e3-4870-b517-a99211143070 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Getting quotas for project 768a2825f91e4225926d0ae4d55da568. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:13:09.182338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-28a246dd-b6e3-4870-b517-a99211143070 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Getting quotas for user c7b42771389c468c90ed797f6d84808d and project 768a2825f91e4225926d0ae4d55da568. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:13:09.210497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-28a246dd-b6e3-4870-b517-a99211143070 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:13:09.219092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-28a246dd-b6e3-4870-b517-a99211143070 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:13:09.386638 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-28a246dd-b6e3-4870-b517-a99211143070 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.740886 Oct 04 21:13:09.390241 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 960/1959] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:13:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:13:09.409434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a4117b87-ccd3-4095-8b90-c4e11ab518bb tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f57943c7ee0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:09.552029 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a4117b87-ccd3-4095-8b90-c4e11ab518bb tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.155462 Oct 04 21:13:09.554414 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 961/1960] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:09 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:09.572480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-237b46e1-de19-4a99-923c-8ac57093dbb1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:09.580860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-237b46e1-de19-4a99-923c-8ac57093dbb1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:09.595831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-237b46e1-de19-4a99-923c-8ac57093dbb1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:09.596834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-237b46e1-de19-4a99-923c-8ac57093dbb1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:09.598069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-237b46e1-de19-4a99-923c-8ac57093dbb1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:09.601529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-12d1d759-23ea-49a6-b057-e5ceab8e8206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:09.606275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-237b46e1-de19-4a99-923c-8ac57093dbb1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:09.606275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-237b46e1-de19-4a99-923c-8ac57093dbb1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:09.606275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-237b46e1-de19-4a99-923c-8ac57093dbb1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:09.615470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-12d1d759-23ea-49a6-b057-e5ceab8e8206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:09.618460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-12d1d759-23ea-49a6-b057-e5ceab8e8206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:09.620657 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-12d1d759-23ea-49a6-b057-e5ceab8e8206 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 0.500291 Oct 04 21:13:09.621974 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1000/1961] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:09 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:09.628332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d5b49a13-10fd-4963-8c02-ad29c04d1bd2 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:09.629079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d5b49a13-10fd-4963-8c02-ad29c04d1bd2 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:09.637977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5b49a13-10fd-4963-8c02-ad29c04d1bd2 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:09.657478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5b49a13-10fd-4963-8c02-ad29c04d1bd2 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:09.657478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5b49a13-10fd-4963-8c02-ad29c04d1bd2 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:09.657478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5b49a13-10fd-4963-8c02-ad29c04d1bd2 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:09.657478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5b49a13-10fd-4963-8c02-ad29c04d1bd2 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:09.657478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5b49a13-10fd-4963-8c02-ad29c04d1bd2 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:09.708896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d5b49a13-10fd-4963-8c02-ad29c04d1bd2 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:13:09.959099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:10.270505 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d5b49a13-10fd-4963-8c02-ad29c04d1bd2 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705" status: 204 len: 0 microversion: 2.1 time: 0.646947 Oct 04 21:13:10.272172 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1001/1962] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:09 2022] DELETE /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:13:10.278279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a9943d73-185a-4703-bd47-5c97d69cb031 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:10.282412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a9943d73-185a-4703-bd47-5c97d69cb031 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:10.446779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-237b46e1-de19-4a99-923c-8ac57093dbb1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6433ac83e746a1b8e5c4f7ec37d4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a735a9ba00c04c2fa6ed960ccc771d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:10.466662 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-237b46e1-de19-4a99-923c-8ac57093dbb1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785" status: 200 len: 1316 microversion: 2.1 time: 0.910482 Oct 04 21:13:10.470448 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 962/1963] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:09 2022] GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 => generated 1316 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:10.481926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-43c12007-7a19-4e33-981e-ed18d3ece3cc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:10.486221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-43c12007-7a19-4e33-981e-ed18d3ece3cc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:10.497611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:10.502763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43c12007-7a19-4e33-981e-ed18d3ece3cc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:10.503602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43c12007-7a19-4e33-981e-ed18d3ece3cc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:10.504305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43c12007-7a19-4e33-981e-ed18d3ece3cc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:10.506573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43c12007-7a19-4e33-981e-ed18d3ece3cc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:10.507286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43c12007-7a19-4e33-981e-ed18d3ece3cc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:10.508835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43c12007-7a19-4e33-981e-ed18d3ece3cc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:10.559749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a9943d73-185a-4703-bd47-5c97d69cb031 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b42771389c468c90ed797f6d84808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a2825f91e4225926d0ae4d55da568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:10.568169 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a9943d73-185a-4703-bd47-5c97d69cb031 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa" status: 200 len: 1223 microversion: 2.1 time: 0.294506 Oct 04 21:13:10.568773 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1002/1964] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:10 2022] GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa => generated 1223 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:10.586673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-26d1a910-dbc3-4e32-bcb3-3e9f7264f2a9 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:10.587227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-26d1a910-dbc3-4e32-bcb3-3e9f7264f2a9 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:10.638604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26d1a910-dbc3-4e32-bcb3-3e9f7264f2a9 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:10.641960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26d1a910-dbc3-4e32-bcb3-3e9f7264f2a9 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:10.641960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26d1a910-dbc3-4e32-bcb3-3e9f7264f2a9 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:10.643024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26d1a910-dbc3-4e32-bcb3-3e9f7264f2a9 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:10.647983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26d1a910-dbc3-4e32-bcb3-3e9f7264f2a9 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:10.653875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26d1a910-dbc3-4e32-bcb3-3e9f7264f2a9 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:11.102715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-43c12007-7a19-4e33-981e-ed18d3ece3cc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:11.139096 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-43c12007-7a19-4e33-981e-ed18d3ece3cc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1474 microversion: 2.1 time: 0.666741 Oct 04 21:13:11.142173 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 963/1965] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:10 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1474 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:11.165504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-38b509a1-2c94-467f-860d-9a2875cc84aa tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f57943e81f0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:11.236993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-26d1a910-dbc3-4e32-bcb3-3e9f7264f2a9 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:11.255546 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-26d1a910-dbc3-4e32-bcb3-3e9f7264f2a9 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705" status: 200 len: 1469 microversion: 2.1 time: 0.681918 Oct 04 21:13:11.256583 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1003/1966] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:10 2022] GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 => generated 1469 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:11.269611 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-38b509a1-2c94-467f-860d-9a2875cc84aa tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.125417 Oct 04 21:13:11.270277 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 964/1967] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:11 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:11.278513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a59a9859-b782-4910-9fbf-f3e73bb26f6d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:11.279667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-1bb6898f-12f1-4c27-b9b8-86054c586439 req-d652da71-04c0-4d36-b53c-62049c632d4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0dbeb11-0fb1-48ab-aa70-d33e03b8093d", "tag": "622d2354-1aa7-4c56-9968-1dc840e8b049"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:11.280497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a59a9859-b782-4910-9fbf-f3e73bb26f6d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:11.288129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a59a9859-b782-4910-9fbf-f3e73bb26f6d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:11.288696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a59a9859-b782-4910-9fbf-f3e73bb26f6d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:11.289193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a59a9859-b782-4910-9fbf-f3e73bb26f6d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:11.290045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a59a9859-b782-4910-9fbf-f3e73bb26f6d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:11.290555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a59a9859-b782-4910-9fbf-f3e73bb26f6d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:11.295895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a59a9859-b782-4910-9fbf-f3e73bb26f6d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:11.302835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1bb6898f-12f1-4c27-b9b8-86054c586439 req-d652da71-04c0-4d36-b53c-62049c632d4f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:11.303619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1bb6898f-12f1-4c27-b9b8-86054c586439 req-d652da71-04c0-4d36-b53c-62049c632d4f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:11.304305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1bb6898f-12f1-4c27-b9b8-86054c586439 req-d652da71-04c0-4d36-b53c-62049c632d4f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:11.328190 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-1bb6898f-12f1-4c27-b9b8-86054c586439 req-d652da71-04c0-4d36-b53c-62049c632d4f service nova] Creating event network-changed:622d2354-1aa7-4c56-9968-1dc840e8b049 for instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d on n-h1-860282-1 Oct 04 21:13:11.342075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [req-1bb6898f-12f1-4c27-b9b8-86054c586439 req-d652da71-04c0-4d36-b53c-62049c632d4f service nova] Instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122757) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:13:11.375547 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-1bb6898f-12f1-4c27-b9b8-86054c586439 req-d652da71-04c0-4d36-b53c-62049c632d4f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100836 Oct 04 21:13:11.378140 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 965/1968] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:11.411064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-732e35a3-1958-4805-8411-4cc00e7192c6 req-8f4981e2-0227-49ff-a4b0-49555cafc9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69eb8120-e4a4-47cd-b41d-b278ad6fd785", "name": "network-vif-plugged", "status": "completed", "tag": "9bdba8e5-2ed1-48e3-ba5a-c7cbc9bb9e2e"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:11.449008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-732e35a3-1958-4805-8411-4cc00e7192c6 req-8f4981e2-0227-49ff-a4b0-49555cafc9df service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:11.453180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-732e35a3-1958-4805-8411-4cc00e7192c6 req-8f4981e2-0227-49ff-a4b0-49555cafc9df service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:11.454564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-732e35a3-1958-4805-8411-4cc00e7192c6 req-8f4981e2-0227-49ff-a4b0-49555cafc9df service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:11.535665 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-732e35a3-1958-4805-8411-4cc00e7192c6 req-8f4981e2-0227-49ff-a4b0-49555cafc9df service nova] Creating event network-vif-plugged:9bdba8e5-2ed1-48e3-ba5a-c7cbc9bb9e2e for instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 on n-h1-860282-1 Oct 04 21:13:11.575259 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-732e35a3-1958-4805-8411-4cc00e7192c6 req-8f4981e2-0227-49ff-a4b0-49555cafc9df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193895 Oct 04 21:13:11.589545 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 966/1969] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:11.634906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-813d652f-d00f-4109-8f91-e8610fc5818a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:11.635856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-813d652f-d00f-4109-8f91-e8610fc5818a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:11.661280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-813d652f-d00f-4109-8f91-e8610fc5818a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:11.661832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-813d652f-d00f-4109-8f91-e8610fc5818a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:11.662283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-813d652f-d00f-4109-8f91-e8610fc5818a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:11.662986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-813d652f-d00f-4109-8f91-e8610fc5818a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:11.682241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-813d652f-d00f-4109-8f91-e8610fc5818a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:11.684199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-813d652f-d00f-4109-8f91-e8610fc5818a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:12.434448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a59a9859-b782-4910-9fbf-f3e73bb26f6d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:12.466640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a59a9859-b782-4910-9fbf-f3e73bb26f6d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:12.468228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a59a9859-b782-4910-9fbf-f3e73bb26f6d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:12.469600 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a59a9859-b782-4910-9fbf-f3e73bb26f6d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 1.211333 Oct 04 21:13:12.510152 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1004/1970] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:11 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:12.541597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3f8bba01-8c63-42b2-bfe2-9abf738ab00a tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:12.541597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3f8bba01-8c63-42b2-bfe2-9abf738ab00a tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:12.568149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f8bba01-8c63-42b2-bfe2-9abf738ab00a tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:12.568655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f8bba01-8c63-42b2-bfe2-9abf738ab00a tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:12.569185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f8bba01-8c63-42b2-bfe2-9abf738ab00a tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:12.569838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f8bba01-8c63-42b2-bfe2-9abf738ab00a tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:12.570298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f8bba01-8c63-42b2-bfe2-9abf738ab00a tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:12.570722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f8bba01-8c63-42b2-bfe2-9abf738ab00a tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:12.712647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-813d652f-d00f-4109-8f91-e8610fc5818a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6433ac83e746a1b8e5c4f7ec37d4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a735a9ba00c04c2fa6ed960ccc771d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:12.729256 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-813d652f-d00f-4109-8f91-e8610fc5818a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785" status: 200 len: 1316 microversion: 2.1 time: 1.138806 Oct 04 21:13:12.741850 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 967/1971] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:11 2022] GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 => generated 1316 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:12.762988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6d073c89-5c55-47e7-bb43-717e328006bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:12.763625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6d073c89-5c55-47e7-bb43-717e328006bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:12.798619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d073c89-5c55-47e7-bb43-717e328006bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:12.799144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d073c89-5c55-47e7-bb43-717e328006bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:12.800755 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d073c89-5c55-47e7-bb43-717e328006bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:12.803030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d073c89-5c55-47e7-bb43-717e328006bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:12.805563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d073c89-5c55-47e7-bb43-717e328006bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:12.806023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d073c89-5c55-47e7-bb43-717e328006bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:12.862868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3f8bba01-8c63-42b2-bfe2-9abf738ab00a tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b42771389c468c90ed797f6d84808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a2825f91e4225926d0ae4d55da568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:12.871651 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3f8bba01-8c63-42b2-bfe2-9abf738ab00a tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa" status: 200 len: 1275 microversion: 2.1 time: 0.341231 Oct 04 21:13:12.876146 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1005/1972] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:12 2022] GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa => generated 1275 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:12.894205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c47738d8-8ead-47a8-97b6-d85292bc6b5a tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f57907ca280>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:13.035027 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c47738d8-8ead-47a8-97b6-d85292bc6b5a tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.144515 Oct 04 21:13:13.035621 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1006/1973] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:12 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:13.049119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-63f0b0cc-f9d5-4526-9229-9c0bfb88dbda tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:13.051957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-63f0b0cc-f9d5-4526-9229-9c0bfb88dbda tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:13.063665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63f0b0cc-f9d5-4526-9229-9c0bfb88dbda tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:13.067292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63f0b0cc-f9d5-4526-9229-9c0bfb88dbda tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:13.070195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63f0b0cc-f9d5-4526-9229-9c0bfb88dbda tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:13.071432 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63f0b0cc-f9d5-4526-9229-9c0bfb88dbda tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:13.072138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63f0b0cc-f9d5-4526-9229-9c0bfb88dbda tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:13.075129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63f0b0cc-f9d5-4526-9229-9c0bfb88dbda tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:13.447360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-63f0b0cc-f9d5-4526-9229-9c0bfb88dbda tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:13.474335 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-63f0b0cc-f9d5-4526-9229-9c0bfb88dbda tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705" status: 200 len: 1427 microversion: 2.1 time: 0.418557 Oct 04 21:13:13.475092 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1007/1974] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:13 2022] GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 => generated 1427 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:13.517093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-24633da6-e8d0-4631-9c45-a7e52a88ad79 req-c64569df-68a1-4b3d-a77f-f882a0c7f05d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed428d1d-ba10-4fd4-b147-b28c9eb09705", "name": "network-vif-deleted", "tag": "df0ba774-752b-421c-9804-8dcf3b95999f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:13.550251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-24633da6-e8d0-4631-9c45-a7e52a88ad79 req-c64569df-68a1-4b3d-a77f-f882a0c7f05d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:13.555088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-24633da6-e8d0-4631-9c45-a7e52a88ad79 req-c64569df-68a1-4b3d-a77f-f882a0c7f05d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:13.557492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-24633da6-e8d0-4631-9c45-a7e52a88ad79 req-c64569df-68a1-4b3d-a77f-f882a0c7f05d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:13.589400 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-24633da6-e8d0-4631-9c45-a7e52a88ad79 req-c64569df-68a1-4b3d-a77f-f882a0c7f05d service nova] Creating event network-vif-deleted:df0ba774-752b-421c-9804-8dcf3b95999f for instance ed428d1d-ba10-4fd4-b147-b28c9eb09705 on n-h1-860282-1 Oct 04 21:13:13.600815 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-24633da6-e8d0-4631-9c45-a7e52a88ad79 req-c64569df-68a1-4b3d-a77f-f882a0c7f05d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107659 Oct 04 21:13:13.608582 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1008/1975] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:13.647052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-204b9cf6-e817-40c0-994c-b7f8f7f13ccd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:13.650257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-204b9cf6-e817-40c0-994c-b7f8f7f13ccd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:13.679723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-204b9cf6-e817-40c0-994c-b7f8f7f13ccd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:13.682087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-204b9cf6-e817-40c0-994c-b7f8f7f13ccd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:13.683819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-204b9cf6-e817-40c0-994c-b7f8f7f13ccd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:13.689314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-204b9cf6-e817-40c0-994c-b7f8f7f13ccd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:13.689918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-204b9cf6-e817-40c0-994c-b7f8f7f13ccd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:13.690444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-204b9cf6-e817-40c0-994c-b7f8f7f13ccd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:13.919500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6d073c89-5c55-47e7-bb43-717e328006bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:13.931593 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6d073c89-5c55-47e7-bb43-717e328006bc tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1472 microversion: 2.1 time: 1.188470 Oct 04 21:13:13.933863 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 968/1976] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:12 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1472 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:13.941315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-ca87e82a-fcfc-4e0f-929e-113af81f1498 req-11173cf9-80f2-4d19-9732-5784d339fb7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2babc3b5-0147-43b1-8f42-8a536a46ddce", "name": "network-vif-plugged", "status": "completed", "tag": "766e621d-fb6f-4386-b54e-a70fe38c5ba4"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:13.955030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ca87e82a-fcfc-4e0f-929e-113af81f1498 req-11173cf9-80f2-4d19-9732-5784d339fb7e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:13.955817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ca87e82a-fcfc-4e0f-929e-113af81f1498 req-11173cf9-80f2-4d19-9732-5784d339fb7e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:13.956448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ca87e82a-fcfc-4e0f-929e-113af81f1498 req-11173cf9-80f2-4d19-9732-5784d339fb7e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:13.975845 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-ca87e82a-fcfc-4e0f-929e-113af81f1498 req-11173cf9-80f2-4d19-9732-5784d339fb7e service nova] Creating event network-vif-plugged:766e621d-fb6f-4386-b54e-a70fe38c5ba4 for instance 2babc3b5-0147-43b1-8f42-8a536a46ddce on n-h1-860282-1 Oct 04 21:13:13.985319 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-ca87e82a-fcfc-4e0f-929e-113af81f1498 req-11173cf9-80f2-4d19-9732-5784d339fb7e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049289 Oct 04 21:13:13.991836 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 969/1977] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:13.999915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e0e4b466-5b48-4329-bc5a-1bf93de1ff08 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:14.001284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e0e4b466-5b48-4329-bc5a-1bf93de1ff08 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:14.017694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0e4b466-5b48-4329-bc5a-1bf93de1ff08 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:14.023271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0e4b466-5b48-4329-bc5a-1bf93de1ff08 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:14.024109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0e4b466-5b48-4329-bc5a-1bf93de1ff08 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:14.025130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0e4b466-5b48-4329-bc5a-1bf93de1ff08 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:14.033110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0e4b466-5b48-4329-bc5a-1bf93de1ff08 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:14.034178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0e4b466-5b48-4329-bc5a-1bf93de1ff08 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:14.663923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-204b9cf6-e817-40c0-994c-b7f8f7f13ccd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:14.678733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-204b9cf6-e817-40c0-994c-b7f8f7f13ccd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:14.680201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-204b9cf6-e817-40c0-994c-b7f8f7f13ccd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:14.685828 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-204b9cf6-e817-40c0-994c-b7f8f7f13ccd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 1.079019 Oct 04 21:13:14.686684 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1009/1978] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:13 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:14.696276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4e4e7897-267b-492a-9c4f-a7c1d6cae976 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:14.699315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4e4e7897-267b-492a-9c4f-a7c1d6cae976 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:14.706291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e0e4b466-5b48-4329-bc5a-1bf93de1ff08 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6433ac83e746a1b8e5c4f7ec37d4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a735a9ba00c04c2fa6ed960ccc771d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:14.713786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:14.715553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e4e7897-267b-492a-9c4f-a7c1d6cae976 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:14.716059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e4e7897-267b-492a-9c4f-a7c1d6cae976 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:14.716497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e4e7897-267b-492a-9c4f-a7c1d6cae976 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:14.717578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e4e7897-267b-492a-9c4f-a7c1d6cae976 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:14.718280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e4e7897-267b-492a-9c4f-a7c1d6cae976 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:14.718852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e4e7897-267b-492a-9c4f-a7c1d6cae976 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:14.730110 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e0e4b466-5b48-4329-bc5a-1bf93de1ff08 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785" status: 200 len: 1316 microversion: 2.1 time: 0.736621 Oct 04 21:13:14.733340 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 970/1979] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:13 2022] GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 => generated 1316 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:14.757221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c5ac2ad4-7242-447c-b9b3-78c97d9f0828 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f578ba95ee0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:14.868265 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c5ac2ad4-7242-447c-b9b3-78c97d9f0828 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.122622 Oct 04 21:13:14.875100 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 971/1980] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:14 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:14.888605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ff75e5e4-5138-4b6a-a6ee-c126643648af tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:14.889394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ff75e5e4-5138-4b6a-a6ee-c126643648af tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:14.926086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff75e5e4-5138-4b6a-a6ee-c126643648af tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:14.926628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff75e5e4-5138-4b6a-a6ee-c126643648af tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:14.927022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff75e5e4-5138-4b6a-a6ee-c126643648af tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:14.927748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff75e5e4-5138-4b6a-a6ee-c126643648af tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:14.936060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff75e5e4-5138-4b6a-a6ee-c126643648af tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:14.937995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff75e5e4-5138-4b6a-a6ee-c126643648af tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:15.041694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4e4e7897-267b-492a-9c4f-a7c1d6cae976 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b42771389c468c90ed797f6d84808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a2825f91e4225926d0ae4d55da568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:15.047453 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff75e5e4-5138-4b6a-a6ee-c126643648af tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:15.047995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff75e5e4-5138-4b6a-a6ee-c126643648af tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:15.048460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff75e5e4-5138-4b6a-a6ee-c126643648af tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:15.048934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-ff75e5e4-5138-4b6a-a6ee-c126643648af tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lazy-loading 'fault' on Instance uuid ed428d1d-ba10-4fd4-b147-b28c9eb09705 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:13:15.057139 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4e4e7897-267b-492a-9c4f-a7c1d6cae976 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa" status: 200 len: 1281 microversion: 2.1 time: 0.369045 Oct 04 21:13:15.066371 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1010/1981] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:14 2022] GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa => generated 1281 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:15.087479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dbb62f48-c2f2-437d-a01b-c00b4e38c0c9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:15.096454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dbb62f48-c2f2-437d-a01b-c00b4e38c0c9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:15.117118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbb62f48-c2f2-437d-a01b-c00b4e38c0c9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:15.117819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbb62f48-c2f2-437d-a01b-c00b4e38c0c9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:15.118365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbb62f48-c2f2-437d-a01b-c00b4e38c0c9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:15.119244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbb62f48-c2f2-437d-a01b-c00b4e38c0c9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:15.119821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbb62f48-c2f2-437d-a01b-c00b4e38c0c9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:15.120905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbb62f48-c2f2-437d-a01b-c00b4e38c0c9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:15.196367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ff75e5e4-5138-4b6a-a6ee-c126643648af tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:15.211364 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ff75e5e4-5138-4b6a-a6ee-c126643648af tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705" status: 200 len: 1312 microversion: 2.1 time: 0.334667 Oct 04 21:13:15.213777 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 972/1982] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:14 2022] GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 => generated 1312 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:15.716645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e085e31d-1813-4867-9877-0ee6acbf9a23 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:15.718989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e085e31d-1813-4867-9877-0ee6acbf9a23 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:15.737079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e085e31d-1813-4867-9877-0ee6acbf9a23 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:15.737905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e085e31d-1813-4867-9877-0ee6acbf9a23 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:15.738533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e085e31d-1813-4867-9877-0ee6acbf9a23 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:15.742837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e085e31d-1813-4867-9877-0ee6acbf9a23 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:15.743546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e085e31d-1813-4867-9877-0ee6acbf9a23 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:15.744181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e085e31d-1813-4867-9877-0ee6acbf9a23 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:15.786263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dbb62f48-c2f2-437d-a01b-c00b4e38c0c9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:15.802327 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dbb62f48-c2f2-437d-a01b-c00b4e38c0c9 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1469 microversion: 2.1 time: 0.718410 Oct 04 21:13:15.803907 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1011/1983] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:15 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1469 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:15.853629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7d6e7d2c-b558-46cd-8dc7-7760092e10ce tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:15.857352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7d6e7d2c-b558-46cd-8dc7-7760092e10ce tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:15.876157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d6e7d2c-b558-46cd-8dc7-7760092e10ce tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:15.880329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d6e7d2c-b558-46cd-8dc7-7760092e10ce tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:15.882537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d6e7d2c-b558-46cd-8dc7-7760092e10ce tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:15.883493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d6e7d2c-b558-46cd-8dc7-7760092e10ce tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:15.885912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d6e7d2c-b558-46cd-8dc7-7760092e10ce tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:15.887776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d6e7d2c-b558-46cd-8dc7-7760092e10ce tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:16.221965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7d6e7d2c-b558-46cd-8dc7-7760092e10ce tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6433ac83e746a1b8e5c4f7ec37d4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a735a9ba00c04c2fa6ed960ccc771d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:16.237720 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7d6e7d2c-b558-46cd-8dc7-7760092e10ce tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785" status: 200 len: 1505 microversion: 2.1 time: 0.416366 Oct 04 21:13:16.262211 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1012/1984] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:15 2022] GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 => generated 1505 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:16.284153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-16455cf7-4967-46a7-87df-169ec411c68b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:16.288282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-16455cf7-4967-46a7-87df-169ec411c68b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:16.297872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e085e31d-1813-4867-9877-0ee6acbf9a23 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:16.314622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e085e31d-1813-4867-9877-0ee6acbf9a23 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:16.319506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e085e31d-1813-4867-9877-0ee6acbf9a23 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:16.320928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16455cf7-4967-46a7-87df-169ec411c68b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:16.322222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16455cf7-4967-46a7-87df-169ec411c68b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:16.324933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16455cf7-4967-46a7-87df-169ec411c68b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:16.325744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16455cf7-4967-46a7-87df-169ec411c68b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:16.326237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16455cf7-4967-46a7-87df-169ec411c68b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:16.327038 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e085e31d-1813-4867-9877-0ee6acbf9a23 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 0.612969 Oct 04 21:13:16.338303 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 973/1985] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:15 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:13:16.351642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16455cf7-4967-46a7-87df-169ec411c68b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:16.367779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-edf7a0b9-42a7-4a3c-96d6-5f7308757366 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f578ba95820>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:16.483626 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-edf7a0b9-42a7-4a3c-96d6-5f7308757366 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.127690 Oct 04 21:13:16.492835 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 974/1986] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:16 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:16.492835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-48040070-2e69-4409-90ba-c753fb8e2274 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:16.492835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-48040070-2e69-4409-90ba-c753fb8e2274 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:16.522414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48040070-2e69-4409-90ba-c753fb8e2274 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:16.522924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48040070-2e69-4409-90ba-c753fb8e2274 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:16.523366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48040070-2e69-4409-90ba-c753fb8e2274 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:16.543116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48040070-2e69-4409-90ba-c753fb8e2274 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:16.557575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48040070-2e69-4409-90ba-c753fb8e2274 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:16.562368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48040070-2e69-4409-90ba-c753fb8e2274 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:16.896866 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-16455cf7-4967-46a7-87df-169ec411c68b tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "POST /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d/action" status: 202 len: 0 microversion: 2.1 time: 0.629300 Oct 04 21:13:16.903989 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1013/1987] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:13:16 2022] POST /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d/action => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:13:16.913557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-48040070-2e69-4409-90ba-c753fb8e2274 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b42771389c468c90ed797f6d84808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a2825f91e4225926d0ae4d55da568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:16.922987 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-48040070-2e69-4409-90ba-c753fb8e2274 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa" status: 200 len: 1323 microversion: 2.1 time: 0.436515 Oct 04 21:13:16.931625 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 975/1988] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:16 2022] GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa => generated 1323 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:16.934138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-487586af-4575-4c55-94bf-90f3eb8d0395 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:16.935088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-487586af-4575-4c55-94bf-90f3eb8d0395 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: ed428d1d-ba10-4fd4-b147-b28c9eb09705] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:16.941843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-76740d8a-2b55-41ac-b246-7c7f328847d1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:16.943544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-76740d8a-2b55-41ac-b246-7c7f328847d1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:16.960239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76740d8a-2b55-41ac-b246-7c7f328847d1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:16.961099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76740d8a-2b55-41ac-b246-7c7f328847d1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:16.962274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76740d8a-2b55-41ac-b246-7c7f328847d1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:16.962420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-487586af-4575-4c55-94bf-90f3eb8d0395 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:16.965710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-487586af-4575-4c55-94bf-90f3eb8d0395 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:16.967100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76740d8a-2b55-41ac-b246-7c7f328847d1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:16.967571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76740d8a-2b55-41ac-b246-7c7f328847d1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:16.968198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76740d8a-2b55-41ac-b246-7c7f328847d1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:16.969475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-487586af-4575-4c55-94bf-90f3eb8d0395 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:16.970319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-487586af-4575-4c55-94bf-90f3eb8d0395 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:16.970810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-487586af-4575-4c55-94bf-90f3eb8d0395 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:16.971258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-487586af-4575-4c55-94bf-90f3eb8d0395 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:17.031879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-76740d8a-2b55-41ac-b246-7c7f328847d1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:13:17.055286 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-487586af-4575-4c55-94bf-90f3eb8d0395 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] HTTP exception thrown: Instance ed428d1d-ba10-4fd4-b147-b28c9eb09705 could not be found. Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-487586af-4575-4c55-94bf-90f3eb8d0395 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Request method failure captured: Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 HTTP/1.1 Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKGqAnkSmVZjs6DphHuP9pEtwfX42iSvDlQLz1tK0HYVYuC-VWR1Vn2wZ_ukGkH8EiF-1Q743JuXGtq7Awl0QPGiHvJGcfVy821mazf8Be7yEGrAiG-MeRDIpRWXbaJTcuBBkAoy1gj4zRKATAuEvYgI-ROpOghd_-U0uxIboVzbJQc Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f439ca730404443ba4b48e7fb79b62ac Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1891594107 Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f439ca730404443ba4b48e7fb79b62ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f439ca730404443ba4b48e7fb79b62ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f439ca730404443ba4b48e7fb79b62ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f439ca730404443ba4b48e7fb79b62ac"}]}] Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1891594107 Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f439ca730404443ba4b48e7fb79b62ac Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1891594107 Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersAdminNegativeTestJSON-1891594107-project Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 1d298c8e0c0a4186a15c745957c691fa Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1891594107-project Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance ed428d1d-ba10-4fd4-b147-b28c9eb09705 could not be found. Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'ed428d1d-ba10-4fd4-b147-b28c9eb09705'} Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed428d1d-ba10-4fd4-b147-b28c9eb09705 could not be found. Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed428d1d-ba10-4fd4-b147-b28c9eb09705 could not be found. Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:17.056927 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:17.064405 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:17.064405 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:17.064405 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:17.064405 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:17.064405 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:17.064405 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:17.064405 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed428d1d-ba10-4fd4-b147-b28c9eb09705 could not be found. Oct 04 21:13:17.064405 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:17.070764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-487586af-4575-4c55-94bf-90f3eb8d0395 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Returning 404 to user: Instance ed428d1d-ba10-4fd4-b147-b28c9eb09705 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:17.078216 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-487586af-4575-4c55-94bf-90f3eb8d0395 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705" status: 404 len: 111 microversion: 2.1 time: 0.169868 Oct 04 21:13:17.078806 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1014/1989] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:16 2022] GET /compute/v2.1/servers/ed428d1d-ba10-4fd4-b147-b28c9eb09705 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:17.099846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4cf824cb-7e94-48d5-93c7-6b5a2e7bbe55 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:17.111595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4cf824cb-7e94-48d5-93c7-6b5a2e7bbe55 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:17.133096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cf824cb-7e94-48d5-93c7-6b5a2e7bbe55 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:17.136523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cf824cb-7e94-48d5-93c7-6b5a2e7bbe55 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:17.140068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cf824cb-7e94-48d5-93c7-6b5a2e7bbe55 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:17.143203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cf824cb-7e94-48d5-93c7-6b5a2e7bbe55 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:17.143203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cf824cb-7e94-48d5-93c7-6b5a2e7bbe55 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:17.143203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cf824cb-7e94-48d5-93c7-6b5a2e7bbe55 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:17.472153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4cf824cb-7e94-48d5-93c7-6b5a2e7bbe55 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:17.485510 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4cf824cb-7e94-48d5-93c7-6b5a2e7bbe55 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1468 microversion: 2.1 time: 0.399342 Oct 04 21:13:17.492849 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1015/1990] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:17 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1468 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:17.511890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5bc157be-02af-4a90-ba17-ca83dfbdd359 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:17.514874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5bc157be-02af-4a90-ba17-ca83dfbdd359 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: 04b031f2-40e3-486e-9066-ff87fbffb8ec] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:17.559209 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-76740d8a-2b55-41ac-b246-7c7f328847d1 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "DELETE /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785" status: 204 len: 0 microversion: 2.1 time: 0.627276 Oct 04 21:13:17.561001 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 976/1991] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:16 2022] DELETE /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:13:17.563331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bc157be-02af-4a90-ba17-ca83dfbdd359 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:17.564801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bc157be-02af-4a90-ba17-ca83dfbdd359 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:17.567009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bc157be-02af-4a90-ba17-ca83dfbdd359 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:17.570571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c212a4b7-348d-496a-aba7-f9a6b8598f61 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:17.571417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bc157be-02af-4a90-ba17-ca83dfbdd359 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:17.571662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c212a4b7-348d-496a-aba7-f9a6b8598f61 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:17.573119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bc157be-02af-4a90-ba17-ca83dfbdd359 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:17.577294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bc157be-02af-4a90-ba17-ca83dfbdd359 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:17.585386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c212a4b7-348d-496a-aba7-f9a6b8598f61 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:17.587196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c212a4b7-348d-496a-aba7-f9a6b8598f61 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:17.601249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c212a4b7-348d-496a-aba7-f9a6b8598f61 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:17.603116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c212a4b7-348d-496a-aba7-f9a6b8598f61 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:17.604918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c212a4b7-348d-496a-aba7-f9a6b8598f61 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:17.606300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c212a4b7-348d-496a-aba7-f9a6b8598f61 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:17.688025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5bc157be-02af-4a90-ba17-ca83dfbdd359 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: 04b031f2-40e3-486e-9066-ff87fbffb8ec] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:13:18.065871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c212a4b7-348d-496a-aba7-f9a6b8598f61 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:18.080083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c212a4b7-348d-496a-aba7-f9a6b8598f61 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:18.082581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c212a4b7-348d-496a-aba7-f9a6b8598f61 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:18.084009 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c212a4b7-348d-496a-aba7-f9a6b8598f61 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 0.521425 Oct 04 21:13:18.098539 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 977/1992] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:17 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:18.114939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-34d7383a-b38a-4e54-80bb-f0af233203dc tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f578baadee0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:18.209775 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5bc157be-02af-4a90-ba17-ca83dfbdd359 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "DELETE /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec" status: 204 len: 0 microversion: 2.1 time: 0.713128 Oct 04 21:13:18.210370 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1016/1993] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:17 2022] DELETE /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec => generated 0 bytes in 717 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:13:18.216688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fc333c19-3168-464c-95c7-25afae3b6eda tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:18.219895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fc333c19-3168-464c-95c7-25afae3b6eda tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:18.224013 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-34d7383a-b38a-4e54-80bb-f0af233203dc tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.123866 Oct 04 21:13:18.228724 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 978/1994] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:18 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:18.242761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-286b09c5-6da3-408a-98d7-b0b887aa86d7 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:18.243257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-286b09c5-6da3-408a-98d7-b0b887aa86d7 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:18.254069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc333c19-3168-464c-95c7-25afae3b6eda tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:18.254069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc333c19-3168-464c-95c7-25afae3b6eda tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:18.254069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc333c19-3168-464c-95c7-25afae3b6eda tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:18.254069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc333c19-3168-464c-95c7-25afae3b6eda tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:18.254069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc333c19-3168-464c-95c7-25afae3b6eda tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:18.254069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc333c19-3168-464c-95c7-25afae3b6eda tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:18.274246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-286b09c5-6da3-408a-98d7-b0b887aa86d7 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:18.288487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-286b09c5-6da3-408a-98d7-b0b887aa86d7 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:18.289082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-286b09c5-6da3-408a-98d7-b0b887aa86d7 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:18.289895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-286b09c5-6da3-408a-98d7-b0b887aa86d7 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:18.290382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-286b09c5-6da3-408a-98d7-b0b887aa86d7 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:18.290827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-286b09c5-6da3-408a-98d7-b0b887aa86d7 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:18.843575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fc333c19-3168-464c-95c7-25afae3b6eda tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6433ac83e746a1b8e5c4f7ec37d4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a735a9ba00c04c2fa6ed960ccc771d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:18.851682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:18.859476 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fc333c19-3168-464c-95c7-25afae3b6eda tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785" status: 200 len: 1511 microversion: 2.1 time: 0.647845 Oct 04 21:13:18.867800 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1017/1995] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:18 2022] GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 => generated 1511 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:18.877098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-0acadf69-4601-4b40-882a-b9497170d274 req-7df7fe30-fc6d-48c2-be40-a131d5888848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0dbeb11-0fb1-48ab-aa70-d33e03b8093d", "name": "network-vif-plugged", "status": "completed", "tag": "622d2354-1aa7-4c56-9968-1dc840e8b049"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:18.908942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0acadf69-4601-4b40-882a-b9497170d274 req-7df7fe30-fc6d-48c2-be40-a131d5888848 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:18.909780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0acadf69-4601-4b40-882a-b9497170d274 req-7df7fe30-fc6d-48c2-be40-a131d5888848 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:18.914866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0acadf69-4601-4b40-882a-b9497170d274 req-7df7fe30-fc6d-48c2-be40-a131d5888848 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:18.952393 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-0acadf69-4601-4b40-882a-b9497170d274 req-7df7fe30-fc6d-48c2-be40-a131d5888848 service nova] Creating event network-vif-plugged:622d2354-1aa7-4c56-9968-1dc840e8b049 for instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d on n-h1-860282-1 Oct 04 21:13:18.968420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-0acadf69-4601-4b40-882a-b9497170d274 req-7df7fe30-fc6d-48c2-be40-a131d5888848 service nova] Instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:13:18.991356 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-0acadf69-4601-4b40-882a-b9497170d274 req-7df7fe30-fc6d-48c2-be40-a131d5888848 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121579 Oct 04 21:13:18.992518 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1018/1996] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:18.999518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-205688d1-812f-41f9-b058-e0b6ad734038 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:19.006283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-205688d1-812f-41f9-b058-e0b6ad734038 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: 04b031f2-40e3-486e-9066-ff87fbffb8ec] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:19.020726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-205688d1-812f-41f9-b058-e0b6ad734038 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:19.021558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-205688d1-812f-41f9-b058-e0b6ad734038 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:19.022480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-205688d1-812f-41f9-b058-e0b6ad734038 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:19.023444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-205688d1-812f-41f9-b058-e0b6ad734038 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:19.024089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-205688d1-812f-41f9-b058-e0b6ad734038 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:19.024922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-205688d1-812f-41f9-b058-e0b6ad734038 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:19.158325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:19.163623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-286b09c5-6da3-408a-98d7-b0b887aa86d7 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b42771389c468c90ed797f6d84808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a2825f91e4225926d0ae4d55da568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:19.183854 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-286b09c5-6da3-408a-98d7-b0b887aa86d7 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa" status: 200 len: 1323 microversion: 2.1 time: 0.950385 Oct 04 21:13:19.184398 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 979/1997] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:18 2022] GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa => generated 1323 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:19.195730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-d035cb26-6ef3-46cf-8f4e-8da4896cc624 req-15603f9e-da89-4c42-9b48-5f809afae8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa", "tag": "eb5bc8e0-bcca-4140-8d63-ab28b04cd3d8"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:19.211174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:19.214001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d035cb26-6ef3-46cf-8f4e-8da4896cc624 req-15603f9e-da89-4c42-9b48-5f809afae8d6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:19.215284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d035cb26-6ef3-46cf-8f4e-8da4896cc624 req-15603f9e-da89-4c42-9b48-5f809afae8d6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:19.218924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d035cb26-6ef3-46cf-8f4e-8da4896cc624 req-15603f9e-da89-4c42-9b48-5f809afae8d6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:19.241108 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-d035cb26-6ef3-46cf-8f4e-8da4896cc624 req-15603f9e-da89-4c42-9b48-5f809afae8d6 service nova] Creating event network-changed:eb5bc8e0-bcca-4140-8d63-ab28b04cd3d8 for instance b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa on n-h2-860282-1 Oct 04 21:13:19.249306 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-d035cb26-6ef3-46cf-8f4e-8da4896cc624 req-15603f9e-da89-4c42-9b48-5f809afae8d6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063128 Oct 04 21:13:19.250766 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 980/1998] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:19.256619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f691a359-de20-4750-ad43-5c1023dd9bd7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:19.257787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f691a359-de20-4750-ad43-5c1023dd9bd7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:19.268003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f691a359-de20-4750-ad43-5c1023dd9bd7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:19.268869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f691a359-de20-4750-ad43-5c1023dd9bd7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:19.269609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f691a359-de20-4750-ad43-5c1023dd9bd7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:19.271016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f691a359-de20-4750-ad43-5c1023dd9bd7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:19.271953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f691a359-de20-4750-ad43-5c1023dd9bd7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:19.272698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f691a359-de20-4750-ad43-5c1023dd9bd7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:19.595693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-205688d1-812f-41f9-b058-e0b6ad734038 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:19.621773 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-205688d1-812f-41f9-b058-e0b6ad734038 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec" status: 200 len: 1478 microversion: 2.1 time: 0.627623 Oct 04 21:13:19.623338 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1019/1999] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:18 2022] GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec => generated 1478 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:19.635409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-55c9b306-6b4b-4024-a354-4425e2e81d51 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:19.638785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-55c9b306-6b4b-4024-a354-4425e2e81d51 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:19.676501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55c9b306-6b4b-4024-a354-4425e2e81d51 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:19.678414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55c9b306-6b4b-4024-a354-4425e2e81d51 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:19.681626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55c9b306-6b4b-4024-a354-4425e2e81d51 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:19.682307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55c9b306-6b4b-4024-a354-4425e2e81d51 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:19.687060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55c9b306-6b4b-4024-a354-4425e2e81d51 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:19.691253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55c9b306-6b4b-4024-a354-4425e2e81d51 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:20.004787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f691a359-de20-4750-ad43-5c1023dd9bd7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:20.015636 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f691a359-de20-4750-ad43-5c1023dd9bd7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1468 microversion: 2.1 time: 0.763412 Oct 04 21:13:20.016434 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 981/2000] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:19 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1468 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:20.028492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c0dc3e19-f87a-44cb-9fb1-45ca281cb460 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f579459a940>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:20.136413 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c0dc3e19-f87a-44cb-9fb1-45ca281cb460 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.112495 Oct 04 21:13:20.138396 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 982/2001] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:20 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:20.147918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-13c6dd53-175e-4109-9f85-b8b22651c11e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:20.152207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-13c6dd53-175e-4109-9f85-b8b22651c11e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:20.175706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13c6dd53-175e-4109-9f85-b8b22651c11e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:20.177834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13c6dd53-175e-4109-9f85-b8b22651c11e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:20.181942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13c6dd53-175e-4109-9f85-b8b22651c11e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:20.184169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13c6dd53-175e-4109-9f85-b8b22651c11e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:20.184931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13c6dd53-175e-4109-9f85-b8b22651c11e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:20.186253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13c6dd53-175e-4109-9f85-b8b22651c11e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:20.303744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-55c9b306-6b4b-4024-a354-4425e2e81d51 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:20.323315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-55c9b306-6b4b-4024-a354-4425e2e81d51 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:20.326631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-55c9b306-6b4b-4024-a354-4425e2e81d51 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:20.328563 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-55c9b306-6b4b-4024-a354-4425e2e81d51 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 0.702517 Oct 04 21:13:20.331359 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1020/2002] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:19 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:20.337886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f3ca2eb7-b7a6-4f45-837c-4cddb7276955 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:20.340009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f3ca2eb7-b7a6-4f45-837c-4cddb7276955 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:20.349974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3ca2eb7-b7a6-4f45-837c-4cddb7276955 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:20.351600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3ca2eb7-b7a6-4f45-837c-4cddb7276955 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:20.352154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3ca2eb7-b7a6-4f45-837c-4cddb7276955 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:20.353159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3ca2eb7-b7a6-4f45-837c-4cddb7276955 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:20.354127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3ca2eb7-b7a6-4f45-837c-4cddb7276955 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:20.355244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3ca2eb7-b7a6-4f45-837c-4cddb7276955 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:20.567692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:21.598874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f3ca2eb7-b7a6-4f45-837c-4cddb7276955 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b42771389c468c90ed797f6d84808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a2825f91e4225926d0ae4d55da568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:21.614244 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f3ca2eb7-b7a6-4f45-837c-4cddb7276955 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa" status: 200 len: 1323 microversion: 2.1 time: 1.281398 Oct 04 21:13:21.615299 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1021/2003] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:20 2022] GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa => generated 1323 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:21.635087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1b1b7c67-d5f1-4df0-bd6c-6d085e6acfb8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:21.636757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1b1b7c67-d5f1-4df0-bd6c-6d085e6acfb8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:21.651003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b1b7c67-d5f1-4df0-bd6c-6d085e6acfb8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:21.651913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b1b7c67-d5f1-4df0-bd6c-6d085e6acfb8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:21.652512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b1b7c67-d5f1-4df0-bd6c-6d085e6acfb8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:21.653267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b1b7c67-d5f1-4df0-bd6c-6d085e6acfb8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:21.656546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b1b7c67-d5f1-4df0-bd6c-6d085e6acfb8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:21.658215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b1b7c67-d5f1-4df0-bd6c-6d085e6acfb8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:21.751278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1b1b7c67-d5f1-4df0-bd6c-6d085e6acfb8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:13:21.796610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-13c6dd53-175e-4109-9f85-b8b22651c11e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6433ac83e746a1b8e5c4f7ec37d4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a735a9ba00c04c2fa6ed960ccc771d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:21.811953 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-13c6dd53-175e-4109-9f85-b8b22651c11e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785" status: 200 len: 1511 microversion: 2.1 time: 1.667600 Oct 04 21:13:21.828284 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 983/2004] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:20 2022] GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 => generated 1511 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:21.843012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-33e5bcf5-4017-4741-afcb-b3e684e8803d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:21.844014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-33e5bcf5-4017-4741-afcb-b3e684e8803d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: 04b031f2-40e3-486e-9066-ff87fbffb8ec] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:21.851700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33e5bcf5-4017-4741-afcb-b3e684e8803d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:21.851700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33e5bcf5-4017-4741-afcb-b3e684e8803d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:21.851700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33e5bcf5-4017-4741-afcb-b3e684e8803d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:21.852960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33e5bcf5-4017-4741-afcb-b3e684e8803d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:21.853757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33e5bcf5-4017-4741-afcb-b3e684e8803d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:21.855089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33e5bcf5-4017-4741-afcb-b3e684e8803d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:22.085641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-33e5bcf5-4017-4741-afcb-b3e684e8803d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:22.097776 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-33e5bcf5-4017-4741-afcb-b3e684e8803d tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec" status: 200 len: 1436 microversion: 2.1 time: 0.264115 Oct 04 21:13:22.125515 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 984/2005] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:21 2022] GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec => generated 1436 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:22.135348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0aabfa12-4827-4bc7-b8a4-ac0218ebcd99 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:22.137293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0aabfa12-4827-4bc7-b8a4-ac0218ebcd99 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:22.158245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0aabfa12-4827-4bc7-b8a4-ac0218ebcd99 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:22.159049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0aabfa12-4827-4bc7-b8a4-ac0218ebcd99 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:22.159756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0aabfa12-4827-4bc7-b8a4-ac0218ebcd99 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:22.160888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0aabfa12-4827-4bc7-b8a4-ac0218ebcd99 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:22.161569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0aabfa12-4827-4bc7-b8a4-ac0218ebcd99 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:22.162446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0aabfa12-4827-4bc7-b8a4-ac0218ebcd99 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:22.303928 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1b1b7c67-d5f1-4df0-bd6c-6d085e6acfb8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 204 len: 0 microversion: 2.1 time: 0.686726 Oct 04 21:13:22.307633 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1022/2006] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:21 2022] DELETE /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 0 bytes in 689 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:13:22.310821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-90516505-9284-440d-ad00-8999cfc7c205 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f5790925ca0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:22.404066 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-90516505-9284-440d-ad00-8999cfc7c205 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.094728 Oct 04 21:13:22.405337 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1023/2007] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:22 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:22.433243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b7b6922b-7bd5-4d59-ae87-40c67bd33e9a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:22.436600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b7b6922b-7bd5-4d59-ae87-40c67bd33e9a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:22.450797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7b6922b-7bd5-4d59-ae87-40c67bd33e9a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:22.451577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7b6922b-7bd5-4d59-ae87-40c67bd33e9a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:22.452215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7b6922b-7bd5-4d59-ae87-40c67bd33e9a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:22.454234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7b6922b-7bd5-4d59-ae87-40c67bd33e9a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:22.458017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7b6922b-7bd5-4d59-ae87-40c67bd33e9a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:22.464822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7b6922b-7bd5-4d59-ae87-40c67bd33e9a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:22.747743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0aabfa12-4827-4bc7-b8a4-ac0218ebcd99 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:22.762030 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0aabfa12-4827-4bc7-b8a4-ac0218ebcd99 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1468 microversion: 2.1 time: 0.641853 Oct 04 21:13:22.764688 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 985/2008] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:22 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1468 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:22.773387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-9aba9a87-3080-4634-84cc-ac8521d3ccca req-7e9b6a86-5d81-4c94-9a95-495cff967030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69eb8120-e4a4-47cd-b41d-b278ad6fd785", "name": "network-vif-deleted", "tag": "9bdba8e5-2ed1-48e3-ba5a-c7cbc9bb9e2e"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:22.792652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9aba9a87-3080-4634-84cc-ac8521d3ccca req-7e9b6a86-5d81-4c94-9a95-495cff967030 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:22.793814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9aba9a87-3080-4634-84cc-ac8521d3ccca req-7e9b6a86-5d81-4c94-9a95-495cff967030 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:22.794492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9aba9a87-3080-4634-84cc-ac8521d3ccca req-7e9b6a86-5d81-4c94-9a95-495cff967030 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:22.813889 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-9aba9a87-3080-4634-84cc-ac8521d3ccca req-7e9b6a86-5d81-4c94-9a95-495cff967030 service nova] Creating event network-vif-deleted:9bdba8e5-2ed1-48e3-ba5a-c7cbc9bb9e2e for instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 on n-h1-860282-1 Oct 04 21:13:22.823756 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-9aba9a87-3080-4634-84cc-ac8521d3ccca req-7e9b6a86-5d81-4c94-9a95-495cff967030 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057239 Oct 04 21:13:22.825062 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 986/2009] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:22.833735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-28fe922d-f89a-4844-bd86-c4eeaa87352f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:22.835050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-28fe922d-f89a-4844-bd86-c4eeaa87352f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:22.844350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28fe922d-f89a-4844-bd86-c4eeaa87352f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:22.845669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28fe922d-f89a-4844-bd86-c4eeaa87352f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:22.846497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28fe922d-f89a-4844-bd86-c4eeaa87352f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:22.848479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28fe922d-f89a-4844-bd86-c4eeaa87352f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:22.849241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28fe922d-f89a-4844-bd86-c4eeaa87352f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:22.849943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28fe922d-f89a-4844-bd86-c4eeaa87352f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:23.005554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b7b6922b-7bd5-4d59-ae87-40c67bd33e9a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:23.024837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b7b6922b-7bd5-4d59-ae87-40c67bd33e9a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:23.028899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b7b6922b-7bd5-4d59-ae87-40c67bd33e9a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:23.033360 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b7b6922b-7bd5-4d59-ae87-40c67bd33e9a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 0.625031 Oct 04 21:13:23.036088 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1024/2010] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:22 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:23.048328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f14fad10-b336-4f41-be1f-7d1b88d8c621 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:23.049065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f14fad10-b336-4f41-be1f-7d1b88d8c621 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:23.053082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:23.057877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f14fad10-b336-4f41-be1f-7d1b88d8c621 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:23.058733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f14fad10-b336-4f41-be1f-7d1b88d8c621 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:23.059173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f14fad10-b336-4f41-be1f-7d1b88d8c621 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:23.065041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f14fad10-b336-4f41-be1f-7d1b88d8c621 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:23.065730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f14fad10-b336-4f41-be1f-7d1b88d8c621 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:23.066184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f14fad10-b336-4f41-be1f-7d1b88d8c621 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:23.432340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-28fe922d-f89a-4844-bd86-c4eeaa87352f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:23.451439 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-28fe922d-f89a-4844-bd86-c4eeaa87352f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1664 microversion: 2.1 time: 0.620107 Oct 04 21:13:23.453757 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 987/2011] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:22 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1664 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:23.474729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-742f161c-e269-4163-8095-e6baff60bb0e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:23.482143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-742f161c-e269-4163-8095-e6baff60bb0e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:23.508411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f14fad10-b336-4f41-be1f-7d1b88d8c621 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b42771389c468c90ed797f6d84808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a2825f91e4225926d0ae4d55da568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:23.509382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-742f161c-e269-4163-8095-e6baff60bb0e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:23.510147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-742f161c-e269-4163-8095-e6baff60bb0e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:23.511261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-742f161c-e269-4163-8095-e6baff60bb0e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:23.512011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-742f161c-e269-4163-8095-e6baff60bb0e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:23.512485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-742f161c-e269-4163-8095-e6baff60bb0e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:23.512922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-742f161c-e269-4163-8095-e6baff60bb0e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:23.523236 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f14fad10-b336-4f41-be1f-7d1b88d8c621 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa" status: 200 len: 1323 microversion: 2.1 time: 0.485893 Oct 04 21:13:23.525213 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1025/2012] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:23 2022] GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa => generated 1323 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:23.547116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-164142b6-b61c-4269-b2fb-5925d2b81fae tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:23.548492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-164142b6-b61c-4269-b2fb-5925d2b81fae tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: 04b031f2-40e3-486e-9066-ff87fbffb8ec] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:23.560792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-164142b6-b61c-4269-b2fb-5925d2b81fae tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:23.561654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-164142b6-b61c-4269-b2fb-5925d2b81fae tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:23.562302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-164142b6-b61c-4269-b2fb-5925d2b81fae tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:23.568100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-164142b6-b61c-4269-b2fb-5925d2b81fae tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:23.568100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-164142b6-b61c-4269-b2fb-5925d2b81fae tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:23.568100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-164142b6-b61c-4269-b2fb-5925d2b81fae tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:23.580564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-742f161c-e269-4163-8095-e6baff60bb0e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:23.581068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-742f161c-e269-4163-8095-e6baff60bb0e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:23.581541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-742f161c-e269-4163-8095-e6baff60bb0e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:23.582006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-742f161c-e269-4163-8095-e6baff60bb0e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lazy-loading 'fault' on Instance uuid 69eb8120-e4a4-47cd-b41d-b278ad6fd785 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:13:23.666354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-742f161c-e269-4163-8095-e6baff60bb0e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6433ac83e746a1b8e5c4f7ec37d4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a735a9ba00c04c2fa6ed960ccc771d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:23.675767 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-742f161c-e269-4163-8095-e6baff60bb0e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785" status: 200 len: 1306 microversion: 2.1 time: 0.220148 Oct 04 21:13:23.677011 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 988/2013] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:23 2022] GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 => generated 1306 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:23.683973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-73fb0007-3313-4000-90d3-56ec641fb5c5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f57943e89d0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:23.710578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-164142b6-b61c-4269-b2fb-5925d2b81fae tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:23.734595 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-164142b6-b61c-4269-b2fb-5925d2b81fae tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec" status: 200 len: 1307 microversion: 2.1 time: 0.207653 Oct 04 21:13:23.737126 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1026/2014] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:23 2022] GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec => generated 1307 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:23.771452 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-73fb0007-3313-4000-90d3-56ec641fb5c5 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.092587 Oct 04 21:13:23.781118 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 989/2015] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:23 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:23.800406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-47776b21-a7cf-4c48-aa4a-16fb021b7a78 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:23.809488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-47776b21-a7cf-4c48-aa4a-16fb021b7a78 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:23.811084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47776b21-a7cf-4c48-aa4a-16fb021b7a78 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:23.816538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47776b21-a7cf-4c48-aa4a-16fb021b7a78 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:23.817415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47776b21-a7cf-4c48-aa4a-16fb021b7a78 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:23.818633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47776b21-a7cf-4c48-aa4a-16fb021b7a78 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:23.819143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47776b21-a7cf-4c48-aa4a-16fb021b7a78 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:23.821639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47776b21-a7cf-4c48-aa4a-16fb021b7a78 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:24.067224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0b89fcb9-e91a-4d82-8b9f-d134c5334cf8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:24.067224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0b89fcb9-e91a-4d82-8b9f-d134c5334cf8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:24.073047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b89fcb9-e91a-4d82-8b9f-d134c5334cf8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:24.079053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b89fcb9-e91a-4d82-8b9f-d134c5334cf8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:24.079917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b89fcb9-e91a-4d82-8b9f-d134c5334cf8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:24.082253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b89fcb9-e91a-4d82-8b9f-d134c5334cf8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:24.083993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b89fcb9-e91a-4d82-8b9f-d134c5334cf8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:24.084699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b89fcb9-e91a-4d82-8b9f-d134c5334cf8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:24.292316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-47776b21-a7cf-4c48-aa4a-16fb021b7a78 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:24.408828 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-47776b21-a7cf-4c48-aa4a-16fb021b7a78 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1468 microversion: 2.1 time: 0.522037 Oct 04 21:13:24.408828 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1027/2016] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:23 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1468 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:24.450319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0b89fcb9-e91a-4d82-8b9f-d134c5334cf8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:24.470032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0b89fcb9-e91a-4d82-8b9f-d134c5334cf8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:24.474687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0b89fcb9-e91a-4d82-8b9f-d134c5334cf8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:24.477243 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0b89fcb9-e91a-4d82-8b9f-d134c5334cf8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 0.416092 Oct 04 21:13:24.479924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9ee693ba-4c5c-405b-8622-0ace047f15f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:24.480828 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 990/2017] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:24 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:13:24.482190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9ee693ba-4c5c-405b-8622-0ace047f15f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:24.508867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ee693ba-4c5c-405b-8622-0ace047f15f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:24.509679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ee693ba-4c5c-405b-8622-0ace047f15f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:24.510152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ee693ba-4c5c-405b-8622-0ace047f15f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:24.511515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ee693ba-4c5c-405b-8622-0ace047f15f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:24.512392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ee693ba-4c5c-405b-8622-0ace047f15f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:24.512392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ee693ba-4c5c-405b-8622-0ace047f15f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:24.554138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5fa67e2f-a138-40d5-8a01-f91c7398729c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:24.557097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5fa67e2f-a138-40d5-8a01-f91c7398729c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:24.575440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fa67e2f-a138-40d5-8a01-f91c7398729c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:24.575951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fa67e2f-a138-40d5-8a01-f91c7398729c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:24.576408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fa67e2f-a138-40d5-8a01-f91c7398729c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:24.577142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fa67e2f-a138-40d5-8a01-f91c7398729c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:24.581222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fa67e2f-a138-40d5-8a01-f91c7398729c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:24.581757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fa67e2f-a138-40d5-8a01-f91c7398729c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:24.616303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:25.123753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9ee693ba-4c5c-405b-8622-0ace047f15f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:25.134982 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9ee693ba-4c5c-405b-8622-0ace047f15f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1664 microversion: 2.1 time: 0.659270 Oct 04 21:13:25.138249 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1028/2018] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:24 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1664 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:25.150068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ed548389-37a6-4fc3-bb31-b146c96ca0f7 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:25.150933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ed548389-37a6-4fc3-bb31-b146c96ca0f7 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:25.164915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed548389-37a6-4fc3-bb31-b146c96ca0f7 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:25.170338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed548389-37a6-4fc3-bb31-b146c96ca0f7 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:25.171963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed548389-37a6-4fc3-bb31-b146c96ca0f7 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:25.174168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed548389-37a6-4fc3-bb31-b146c96ca0f7 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:25.175317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed548389-37a6-4fc3-bb31-b146c96ca0f7 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:25.177809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed548389-37a6-4fc3-bb31-b146c96ca0f7 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:25.226064 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-ed548389-37a6-4fc3-bb31-b146c96ca0f7 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] HTTP exception thrown: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ed548389-37a6-4fc3-bb31-b146c96ca0f7 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Request method failure captured: Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 HTTP/1.1 Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKHUXRzBCEf2TrGnZHy_t-TpK6l6EyyU3IOUsS9G1H4ppMGpi0kqxkVhsRHGUe2ICn9KGrQVjDvakGIXp2xOuF0IGLRE9KVa3_ti3_QBW0TAOvgTmctw2ExKMed6Kib7crLqlrE70ycD37024p_QvPQkPsugW4szPus96mPTkkLf3R4 Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a735a9ba00c04c2fa6ed960ccc771d4a Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a735a9ba00c04c2fa6ed960ccc771d4a"}]}] Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a735a9ba00c04c2fa6ed960ccc771d4a Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesNegativeTestJSON-299812671-project Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 7f6433ac83e746a1b8e5c4f7ec37d4b4 Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesNegativeTestJSON-299812671-project Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '69eb8120-e4a4-47cd-b41d-b278ad6fd785'} Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:25.231626 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:25.242962 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:25.242962 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:25.242962 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:25.242962 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:25.242962 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:25.242962 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:25.242962 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:25.242962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ed548389-37a6-4fc3-bb31-b146c96ca0f7 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Returning 404 to user: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:25.246589 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ed548389-37a6-4fc3-bb31-b146c96ca0f7 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785" status: 404 len: 111 microversion: 2.1 time: 0.104133 Oct 04 21:13:25.248251 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1029/2019] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:25 2022] GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:25.260679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3e6b25c7-0043-4118-a291-5c460c871fce tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:25.264120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3e6b25c7-0043-4118-a291-5c460c871fce tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: 04b031f2-40e3-486e-9066-ff87fbffb8ec] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:25.279425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e6b25c7-0043-4118-a291-5c460c871fce tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:25.280146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e6b25c7-0043-4118-a291-5c460c871fce tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:25.281254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e6b25c7-0043-4118-a291-5c460c871fce tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:25.287089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e6b25c7-0043-4118-a291-5c460c871fce tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:25.287089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e6b25c7-0043-4118-a291-5c460c871fce tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:25.287089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e6b25c7-0043-4118-a291-5c460c871fce tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:25.350153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e6b25c7-0043-4118-a291-5c460c871fce tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:25.351639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e6b25c7-0043-4118-a291-5c460c871fce tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:25.352163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e6b25c7-0043-4118-a291-5c460c871fce tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:25.352957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-3e6b25c7-0043-4118-a291-5c460c871fce tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lazy-loading 'fault' on Instance uuid 04b031f2-40e3-486e-9066-ff87fbffb8ec {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:13:25.435765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3e6b25c7-0043-4118-a291-5c460c871fce tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:25.448632 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3e6b25c7-0043-4118-a291-5c460c871fce tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec" status: 200 len: 1312 microversion: 2.1 time: 0.199077 Oct 04 21:13:25.454141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5fa67e2f-a138-40d5-8a01-f91c7398729c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b42771389c468c90ed797f6d84808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a2825f91e4225926d0ae4d55da568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:25.461781 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1030/2020] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:25 2022] GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec => generated 1312 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:25.467125 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5fa67e2f-a138-40d5-8a01-f91c7398729c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa" status: 200 len: 1323 microversion: 2.1 time: 0.916774 Oct 04 21:13:25.474926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-27a21933-7a8c-45ad-b878-eaac55b7a1c3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f57900b5940>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:25.489504 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 991/2021] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:24 2022] GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa => generated 1323 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:13:25.504407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-4daee529-19ab-4443-a6af-583cfe3e097b req-1330bb7c-db5d-4562-8cf8-d1a4850f04c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b031f2-40e3-486e-9066-ff87fbffb8ec", "name": "network-vif-deleted", "tag": "5c7832a4-d19a-4ba1-8d1d-3a0f05b4845e"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:25.547476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4daee529-19ab-4443-a6af-583cfe3e097b req-1330bb7c-db5d-4562-8cf8-d1a4850f04c5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:25.548265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4daee529-19ab-4443-a6af-583cfe3e097b req-1330bb7c-db5d-4562-8cf8-d1a4850f04c5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:25.548888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4daee529-19ab-4443-a6af-583cfe3e097b req-1330bb7c-db5d-4562-8cf8-d1a4850f04c5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:25.558786 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-27a21933-7a8c-45ad-b878-eaac55b7a1c3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.095543 Oct 04 21:13:25.560536 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1031/2022] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:25 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:25.567228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9988f3de-8042-4877-9bd0-28b645c9de1a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-653341818", "metadata": {"image_type": "test"}}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:25.570483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9988f3de-8042-4877-9bd0-28b645c9de1a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:25.578972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9988f3de-8042-4877-9bd0-28b645c9de1a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:25.579865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9988f3de-8042-4877-9bd0-28b645c9de1a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:25.580693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9988f3de-8042-4877-9bd0-28b645c9de1a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:25.581763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9988f3de-8042-4877-9bd0-28b645c9de1a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:25.582458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9988f3de-8042-4877-9bd0-28b645c9de1a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:25.583111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9988f3de-8042-4877-9bd0-28b645c9de1a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:25.596884 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-4daee529-19ab-4443-a6af-583cfe3e097b req-1330bb7c-db5d-4562-8cf8-d1a4850f04c5 service nova] Creating event network-vif-deleted:5c7832a4-d19a-4ba1-8d1d-3a0f05b4845e for instance 04b031f2-40e3-486e-9066-ff87fbffb8ec on n-h1-860282-1 Oct 04 21:13:25.610693 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-4daee529-19ab-4443-a6af-583cfe3e097b req-1330bb7c-db5d-4562-8cf8-d1a4850f04c5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117437 Oct 04 21:13:25.612581 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 992/2023] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:25.623622 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-9988f3de-8042-4877-9bd0-28b645c9de1a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] HTTP exception thrown: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:25.626626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3613eed2-e1ce-40aa-b81c-748848d7147f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9988f3de-8042-4877-9bd0-28b645c9de1a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Request method failure captured: Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785/action HTTP/1.1 Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 111 Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKHUXRzBCEf2TrGnZHy_t-TpK6l6EyyU3IOUsS9G1H4ppMGpi0kqxkVhsRHGUe2ICn9KGrQVjDvakGIXp2xOuF0IGLRE9KVa3_ti3_QBW0TAOvgTmctw2ExKMed6Kib7crLqlrE70ycD37024p_QvPQkPsugW4szPus96mPTkkLf3R4 Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a735a9ba00c04c2fa6ed960ccc771d4a Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a735a9ba00c04c2fa6ed960ccc771d4a"}]}] Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a735a9ba00c04c2fa6ed960ccc771d4a Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesNegativeTestJSON-299812671-project Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 7f6433ac83e746a1b8e5c4f7ec37d4b4 Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesNegativeTestJSON-299812671-project Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-653341818", "metadata": {"image_type": "test"}}} Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '69eb8120-e4a4-47cd-b41d-b278ad6fd785', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-653341818', 'metadata': {'image_type': 'test'}}}} Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 21:13:25.627164 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:25.632965 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:25.632965 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:25.632965 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:25.632965 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:25.632965 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:25.632965 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:25.632965 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:25.632965 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:25.632965 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:25.632965 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:25.632965 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:25.632965 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:25.632965 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:25.632965 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:25.637572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3613eed2-e1ce-40aa-b81c-748848d7147f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:25.638607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9988f3de-8042-4877-9bd0-28b645c9de1a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Returning 404 to user: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:25.641186 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9988f3de-8042-4877-9bd0-28b645c9de1a tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "POST /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785/action" status: 404 len: 111 microversion: 2.1 time: 0.077499 Oct 04 21:13:25.643243 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1032/2024] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Oct 4 21:13:25 2022] POST /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:25.655653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-8570ccfe-ddde-4346-a38a-8121dc64d7c0 req-9406e25f-36f5-4cd7-838e-16d736f0a016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa", "name": "network-vif-plugged", "status": "completed", "tag": "eb5bc8e0-bcca-4140-8d63-ab28b04cd3d8"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:25.656233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3613eed2-e1ce-40aa-b81c-748848d7147f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:25.658906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3613eed2-e1ce-40aa-b81c-748848d7147f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:25.659586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3613eed2-e1ce-40aa-b81c-748848d7147f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:25.665595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3613eed2-e1ce-40aa-b81c-748848d7147f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:25.666401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3613eed2-e1ce-40aa-b81c-748848d7147f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:25.669521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3613eed2-e1ce-40aa-b81c-748848d7147f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:25.683537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8570ccfe-ddde-4346-a38a-8121dc64d7c0 req-9406e25f-36f5-4cd7-838e-16d736f0a016 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:25.687369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8570ccfe-ddde-4346-a38a-8121dc64d7c0 req-9406e25f-36f5-4cd7-838e-16d736f0a016 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:25.688167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8570ccfe-ddde-4346-a38a-8121dc64d7c0 req-9406e25f-36f5-4cd7-838e-16d736f0a016 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:25.725092 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-8570ccfe-ddde-4346-a38a-8121dc64d7c0 req-9406e25f-36f5-4cd7-838e-16d736f0a016 service nova] Creating event network-vif-plugged:eb5bc8e0-bcca-4140-8d63-ab28b04cd3d8 for instance b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa on n-h2-860282-1 Oct 04 21:13:25.746771 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-8570ccfe-ddde-4346-a38a-8121dc64d7c0 req-9406e25f-36f5-4cd7-838e-16d736f0a016 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096340 Oct 04 21:13:25.753084 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1033/2025] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:25.778543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-07856559-a969-46ab-811e-23a3f7d055d2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:25.779488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-07856559-a969-46ab-811e-23a3f7d055d2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:25.817837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07856559-a969-46ab-811e-23a3f7d055d2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:25.821538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07856559-a969-46ab-811e-23a3f7d055d2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:25.822347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07856559-a969-46ab-811e-23a3f7d055d2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:25.826456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07856559-a969-46ab-811e-23a3f7d055d2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:25.829376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07856559-a969-46ab-811e-23a3f7d055d2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:25.830798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07856559-a969-46ab-811e-23a3f7d055d2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:26.285995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3613eed2-e1ce-40aa-b81c-748848d7147f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:26.295536 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3613eed2-e1ce-40aa-b81c-748848d7147f tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1468 microversion: 2.1 time: 0.679478 Oct 04 21:13:26.307138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-07856559-a969-46ab-811e-23a3f7d055d2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:26.314730 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 993/2026] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:25 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1468 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:26.323424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bfdadff3-ea6c-4b66-b009-6a58d7a1a49c tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1644335343", "metadata": {"image_type": "test"}}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:26.324814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-07856559-a969-46ab-811e-23a3f7d055d2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:26.326310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-07856559-a969-46ab-811e-23a3f7d055d2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:26.326738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bfdadff3-ea6c-4b66-b009-6a58d7a1a49c tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Failed to fetch instance by id tempest-invalid-1802549184 {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 21:13:26.327514 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-07856559-a969-46ab-811e-23a3f7d055d2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 0.573091 Oct 04 21:13:26.327859 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-bfdadff3-ea6c-4b66-b009-6a58d7a1a49c tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] HTTP exception thrown: Instance tempest-invalid-1802549184 could not be found. Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bfdadff3-ea6c-4b66-b009-6a58d7a1a49c tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Request method failure captured: Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/tempest-invalid-1802549184/action HTTP/1.1 Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 112 Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKHUXRzBCEf2TrGnZHy_t-TpK6l6EyyU3IOUsS9G1H4ppMGpi0kqxkVhsRHGUe2ICn9KGrQVjDvakGIXp2xOuF0IGLRE9KVa3_ti3_QBW0TAOvgTmctw2ExKMed6Kib7crLqlrE70ycD37024p_QvPQkPsugW4szPus96mPTkkLf3R4 Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a735a9ba00c04c2fa6ed960ccc771d4a Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a735a9ba00c04c2fa6ed960ccc771d4a"}]}] Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a735a9ba00c04c2fa6ed960ccc771d4a Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ImagesNegativeTestJSON-299812671-project Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 7f6433ac83e746a1b8e5c4f7ec37d4b4 Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ImagesNegativeTestJSON-299812671-project Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1644335343", "metadata": {"image_type": "test"}}} Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance tempest-invalid-1802549184 could not be found. Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'tempest-invalid-1802549184', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1644335343', 'metadata': {'image_type': 'test'}}}} Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1802549184 could not be found. Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:26.329993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1802549184 could not be found. Oct 04 21:13:26.335029 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.335029 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:26.335029 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.335029 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:26.335029 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:26.335029 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:26.335029 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:26.335029 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:26.335029 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1802549184 could not be found. Oct 04 21:13:26.335029 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.335917 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1034/2027] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:25 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:26.336431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e4649942-6bb1-463a-a4bd-2bce0af12861 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:26.337053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e4649942-6bb1-463a-a4bd-2bce0af12861 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:26.337218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bfdadff3-ea6c-4b66-b009-6a58d7a1a49c tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Returning 404 to user: Instance tempest-invalid-1802549184 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:26.338299 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bfdadff3-ea6c-4b66-b009-6a58d7a1a49c tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "POST /compute/v2.1/servers/tempest-invalid-1802549184/action" status: 404 len: 101 microversion: 2.1 time: 0.022235 Oct 04 21:13:26.357509 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 994/2028] 10.222.0.30 () {60 vars in 1249 bytes} [Tue Oct 4 21:13:26 2022] POST /compute/v2.1/servers/tempest-invalid-1802549184/action => generated 101 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:26.372304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-53d07e36-e241-4386-a82d-80a8b7048ff4 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1122872598"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:26.380961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-53d07e36-e241-4386-a82d-80a8b7048ff4 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 21:13:26.381807 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-53d07e36-e241-4386-a82d-80a8b7048ff4 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:13:26.383671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4649942-6bb1-463a-a4bd-2bce0af12861 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-53d07e36-e241-4386-a82d-80a8b7048ff4 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Request method failure captured: Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 57 Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKHUXRzBCEf2TrGnZHy_t-TpK6l6EyyU3IOUsS9G1H4ppMGpi0kqxkVhsRHGUe2ICn9KGrQVjDvakGIXp2xOuF0IGLRE9KVa3_ti3_QBW0TAOvgTmctw2ExKMed6Kib7crLqlrE70ycD37024p_QvPQkPsugW4szPus96mPTkkLf3R4 Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a735a9ba00c04c2fa6ed960ccc771d4a Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a735a9ba00c04c2fa6ed960ccc771d4a"}]}] Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a735a9ba00c04c2fa6ed960ccc771d4a Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ImagesNegativeTestJSON-299812671-project Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 7f6433ac83e746a1b8e5c4f7ec37d4b4 Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ImagesNegativeTestJSON-299812671-project Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: {"createImage": {"name": "tempest-test-snap-1122872598"}} Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1122872598'}}} Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:13:26.387937 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.393599 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:26.393599 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.393599 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:26.393599 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:26.393599 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:26.393599 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:26.393599 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:26.393599 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:13:26.393599 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.394377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4649942-6bb1-463a-a4bd-2bce0af12861 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:26.394377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4649942-6bb1-463a-a4bd-2bce0af12861 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:26.394377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4649942-6bb1-463a-a4bd-2bce0af12861 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:26.394377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4649942-6bb1-463a-a4bd-2bce0af12861 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:26.395535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-53d07e36-e241-4386-a82d-80a8b7048ff4 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:26.396029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4649942-6bb1-463a-a4bd-2bce0af12861 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:26.397001 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-53d07e36-e241-4386-a82d-80a8b7048ff4 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.037808 Oct 04 21:13:26.405082 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 995/2029] 10.222.0.30 () {60 vars in 1275 bytes} [Tue Oct 4 21:13:26 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:26.418599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-968edce3-9f7a-4db9-977d-0a3788b682a2 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-219808726"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:26.423168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-968edce3-9f7a-4db9-977d-0a3788b682a2 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 21:13:26.427493 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-968edce3-9f7a-4db9-977d-0a3788b682a2 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-968edce3-9f7a-4db9-977d-0a3788b682a2 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Request method failure captured: Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 56 Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKHUXRzBCEf2TrGnZHy_t-TpK6l6EyyU3IOUsS9G1H4ppMGpi0kqxkVhsRHGUe2ICn9KGrQVjDvakGIXp2xOuF0IGLRE9KVa3_ti3_QBW0TAOvgTmctw2ExKMed6Kib7crLqlrE70ycD37024p_QvPQkPsugW4szPus96mPTkkLf3R4 Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a735a9ba00c04c2fa6ed960ccc771d4a Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a735a9ba00c04c2fa6ed960ccc771d4a"}]}] Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a735a9ba00c04c2fa6ed960ccc771d4a Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ImagesNegativeTestJSON-299812671-project Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 7f6433ac83e746a1b8e5c4f7ec37d4b4 Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ImagesNegativeTestJSON-299812671-project Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: {"createImage": {"name": "tempest-test-snap-219808726"}} Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-219808726'}}} Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:13:26.430328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.437181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:26.437181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.437181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:26.437181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:26.437181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:26.437181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:26.437181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:26.437181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 21:13:26.437181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.448688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-968edce3-9f7a-4db9-977d-0a3788b682a2 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:26.448688 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-968edce3-9f7a-4db9-977d-0a3788b682a2 tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.040499 Oct 04 21:13:26.458857 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 996/2030] 10.222.0.30 () {60 vars in 1281 bytes} [Tue Oct 4 21:13:26 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:26.472480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9b3b7c8e-ff48-4789-af9c-697553e3fffe tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:26.473370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9b3b7c8e-ff48-4789-af9c-697553e3fffe tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:26.488249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b3b7c8e-ff48-4789-af9c-697553e3fffe tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:26.489246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b3b7c8e-ff48-4789-af9c-697553e3fffe tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:26.499803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b3b7c8e-ff48-4789-af9c-697553e3fffe tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:26.501145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b3b7c8e-ff48-4789-af9c-697553e3fffe tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:26.503408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b3b7c8e-ff48-4789-af9c-697553e3fffe tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:26.504098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b3b7c8e-ff48-4789-af9c-697553e3fffe tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:26.552284 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-9b3b7c8e-ff48-4789-af9c-697553e3fffe tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] HTTP exception thrown: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9b3b7c8e-ff48-4789-af9c-697553e3fffe tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Request method failure captured: Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 HTTP/1.1 Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKHUXRzBCEf2TrGnZHy_t-TpK6l6EyyU3IOUsS9G1H4ppMGpi0kqxkVhsRHGUe2ICn9KGrQVjDvakGIXp2xOuF0IGLRE9KVa3_ti3_QBW0TAOvgTmctw2ExKMed6Kib7crLqlrE70ycD37024p_QvPQkPsugW4szPus96mPTkkLf3R4 Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a735a9ba00c04c2fa6ed960ccc771d4a Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a735a9ba00c04c2fa6ed960ccc771d4a"}]}] Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a735a9ba00c04c2fa6ed960ccc771d4a Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ImagesNegativeTestJSON-299812671-project Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 7f6433ac83e746a1b8e5c4f7ec37d4b4 Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ImagesNegativeTestJSON-299812671-project Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '69eb8120-e4a4-47cd-b41d-b278ad6fd785'} Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:26.555972 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:26.562422 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:26.562422 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.562422 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:26.562422 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.562422 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:26.562422 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:26.562422 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:26.562422 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:26.562422 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:26.562422 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:26.562422 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:26.562422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9b3b7c8e-ff48-4789-af9c-697553e3fffe tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Returning 404 to user: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:26.567391 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9b3b7c8e-ff48-4789-af9c-697553e3fffe tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "DELETE /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785" status: 404 len: 111 microversion: 2.1 time: 0.105299 Oct 04 21:13:26.569976 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 997/2031] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:26 2022] DELETE /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:26.582397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-519f6d0a-ebbf-4cb4-9940-4a2d7d268409 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:26.583036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-519f6d0a-ebbf-4cb4-9940-4a2d7d268409 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: 04b031f2-40e3-486e-9066-ff87fbffb8ec] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:26.600774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-519f6d0a-ebbf-4cb4-9940-4a2d7d268409 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:26.601442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-519f6d0a-ebbf-4cb4-9940-4a2d7d268409 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:26.601919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-519f6d0a-ebbf-4cb4-9940-4a2d7d268409 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:26.602653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-519f6d0a-ebbf-4cb4-9940-4a2d7d268409 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:26.603115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-519f6d0a-ebbf-4cb4-9940-4a2d7d268409 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:26.606514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-519f6d0a-ebbf-4cb4-9940-4a2d7d268409 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:26.681848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-519f6d0a-ebbf-4cb4-9940-4a2d7d268409 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:26.682396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-519f6d0a-ebbf-4cb4-9940-4a2d7d268409 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:26.682815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-519f6d0a-ebbf-4cb4-9940-4a2d7d268409 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:26.688107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-519f6d0a-ebbf-4cb4-9940-4a2d7d268409 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lazy-loading 'fault' on Instance uuid 04b031f2-40e3-486e-9066-ff87fbffb8ec {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:13:27.080659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e4649942-6bb1-463a-a4bd-2bce0af12861 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:27.097891 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e4649942-6bb1-463a-a4bd-2bce0af12861 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1596 microversion: 2.1 time: 0.765736 Oct 04 21:13:27.110394 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1035/2032] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:26 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1596 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:27.136344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e2b94f28-7a91-4871-9b27-ad204725c120 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:27.140283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e2b94f28-7a91-4871-9b27-ad204725c120 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:27.182441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2b94f28-7a91-4871-9b27-ad204725c120 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:27.185386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2b94f28-7a91-4871-9b27-ad204725c120 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:27.187040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2b94f28-7a91-4871-9b27-ad204725c120 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:27.193789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2b94f28-7a91-4871-9b27-ad204725c120 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:27.193789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2b94f28-7a91-4871-9b27-ad204725c120 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:27.196769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2b94f28-7a91-4871-9b27-ad204725c120 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:27.228406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-519f6d0a-ebbf-4cb4-9940-4a2d7d268409 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d298c8e0c0a4186a15c745957c691fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f439ca730404443ba4b48e7fb79b62ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:27.239163 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-519f6d0a-ebbf-4cb4-9940-4a2d7d268409 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec" status: 200 len: 1312 microversion: 2.1 time: 0.668064 Oct 04 21:13:27.263823 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 998/2033] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:26 2022] GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec => generated 1312 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:27.294039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b44521d8-379f-482d-b9c0-ace3b1679e1e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:27.309387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b44521d8-379f-482d-b9c0-ace3b1679e1e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] [instance: 69eb8120-e4a4-47cd-b41d-b278ad6fd785] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:27.358952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b44521d8-379f-482d-b9c0-ace3b1679e1e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:27.363916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b44521d8-379f-482d-b9c0-ace3b1679e1e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:27.366295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b44521d8-379f-482d-b9c0-ace3b1679e1e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:27.374500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b44521d8-379f-482d-b9c0-ace3b1679e1e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:27.380511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b44521d8-379f-482d-b9c0-ace3b1679e1e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:27.382073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b44521d8-379f-482d-b9c0-ace3b1679e1e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:27.419116 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-b44521d8-379f-482d-b9c0-ace3b1679e1e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] HTTP exception thrown: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b44521d8-379f-482d-b9c0-ace3b1679e1e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Request method failure captured: Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 HTTP/1.1 Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKHUXRzBCEf2TrGnZHy_t-TpK6l6EyyU3IOUsS9G1H4ppMGpi0kqxkVhsRHGUe2ICn9KGrQVjDvakGIXp2xOuF0IGLRE9KVa3_ti3_QBW0TAOvgTmctw2ExKMed6Kib7crLqlrE70ycD37024p_QvPQkPsugW4szPus96mPTkkLf3R4 Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a735a9ba00c04c2fa6ed960ccc771d4a Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a735a9ba00c04c2fa6ed960ccc771d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a735a9ba00c04c2fa6ed960ccc771d4a"}]}] Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a735a9ba00c04c2fa6ed960ccc771d4a Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-299812671 Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ImagesNegativeTestJSON-299812671-project Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 7f6433ac83e746a1b8e5c4f7ec37d4b4 Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ImagesNegativeTestJSON-299812671-project Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '69eb8120-e4a4-47cd-b41d-b278ad6fd785'} Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:27.422993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:27.436059 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:27.436059 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:27.436059 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:27.436059 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:27.436059 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:27.436059 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. Oct 04 21:13:27.436059 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:27.436059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b44521d8-379f-482d-b9c0-ace3b1679e1e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] Returning 404 to user: Instance 69eb8120-e4a4-47cd-b41d-b278ad6fd785 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:27.436059 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b44521d8-379f-482d-b9c0-ace3b1679e1e tempest-ImagesNegativeTestJSON-299812671 tempest-ImagesNegativeTestJSON-299812671-project] 10.222.0.30 "GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785" status: 404 len: 111 microversion: 2.1 time: 0.156325 Oct 04 21:13:27.441339 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 999/2034] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:27 2022] GET /compute/v2.1/servers/69eb8120-e4a4-47cd-b41d-b278ad6fd785 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:27.455715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-50a99be5-d95d-48ce-994a-c816f68c111f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f578ba9a670>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:27.680633 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-50a99be5-d95d-48ce-994a-c816f68c111f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.237609 Oct 04 21:13:27.682030 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1000/2035] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:27 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:27.697992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-261be54d-11f6-4e91-b23b-141b0045e546 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:27.707497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-261be54d-11f6-4e91-b23b-141b0045e546 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:27.738573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-261be54d-11f6-4e91-b23b-141b0045e546 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:27.745771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-261be54d-11f6-4e91-b23b-141b0045e546 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:27.749738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-261be54d-11f6-4e91-b23b-141b0045e546 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:27.752090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-261be54d-11f6-4e91-b23b-141b0045e546 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:27.753027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-261be54d-11f6-4e91-b23b-141b0045e546 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:27.755767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-261be54d-11f6-4e91-b23b-141b0045e546 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:28.257583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e2b94f28-7a91-4871-9b27-ad204725c120 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b42771389c468c90ed797f6d84808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a2825f91e4225926d0ae4d55da568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:28.262454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:28.269891 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e2b94f28-7a91-4871-9b27-ad204725c120 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa" status: 200 len: 1323 microversion: 2.1 time: 1.158082 Oct 04 21:13:28.275244 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1036/2036] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:27 2022] GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa => generated 1323 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:28.290792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-261be54d-11f6-4e91-b23b-141b0045e546 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:28.300117 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-261be54d-11f6-4e91-b23b-141b0045e546 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1468 microversion: 2.1 time: 0.610542 Oct 04 21:13:28.301350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e4aa2990-a462-45c9-8160-51d340924e31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:28.303815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e4aa2990-a462-45c9-8160-51d340924e31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:28.309754 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1001/2037] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:27 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1468 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:28.317259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-bb00d06a-c966-401b-a567-902efdfeaf10 req-41c604a1-a9b5-4141-9174-683421f306af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf618d0-9d79-435c-ac4f-636ac63dbbda", "name": "network-vif-deleted", "tag": "dd232c2f-36a6-4a3c-93d1-396a660ea091"}, {"server_uuid": "4c86d6b4-12a8-464a-84d7-2d6454aee597", "name": "network-vif-unplugged", "status": "completed", "tag": "9229c565-3c30-423f-9b59-78ca89772437"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:28.330414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4aa2990-a462-45c9-8160-51d340924e31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:28.331393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4aa2990-a462-45c9-8160-51d340924e31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:28.333897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4aa2990-a462-45c9-8160-51d340924e31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:28.336801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4aa2990-a462-45c9-8160-51d340924e31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:28.337457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4aa2990-a462-45c9-8160-51d340924e31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:28.338118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4aa2990-a462-45c9-8160-51d340924e31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:28.364756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bb00d06a-c966-401b-a567-902efdfeaf10 req-41c604a1-a9b5-4141-9174-683421f306af service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:28.368978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bb00d06a-c966-401b-a567-902efdfeaf10 req-41c604a1-a9b5-4141-9174-683421f306af service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:28.371680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bb00d06a-c966-401b-a567-902efdfeaf10 req-41c604a1-a9b5-4141-9174-683421f306af service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:28.431974 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-bb00d06a-c966-401b-a567-902efdfeaf10 req-41c604a1-a9b5-4141-9174-683421f306af service nova] Creating event network-vif-deleted:dd232c2f-36a6-4a3c-93d1-396a660ea091 for instance fcf618d0-9d79-435c-ac4f-636ac63dbbda on n-h1-860282-1 Oct 04 21:13:28.434575 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-bb00d06a-c966-401b-a567-902efdfeaf10 req-41c604a1-a9b5-4141-9174-683421f306af service nova] Creating event network-vif-unplugged:9229c565-3c30-423f-9b59-78ca89772437 for instance 4c86d6b4-12a8-464a-84d7-2d6454aee597 on n-h2-860282-1 Oct 04 21:13:28.489596 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-bb00d06a-c966-401b-a567-902efdfeaf10 req-41c604a1-a9b5-4141-9174-683421f306af service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.165387 Oct 04 21:13:28.489596 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1002/2038] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:28.489596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-dcf76442-bdcc-45e0-8062-b910f16741db req-247f9c3d-a4af-4db8-821c-d25403d5513e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0dbeb11-0fb1-48ab-aa70-d33e03b8093d", "name": "network-vif-unplugged", "status": "completed", "tag": "622d2354-1aa7-4c56-9968-1dc840e8b049"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:28.524463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-dcf76442-bdcc-45e0-8062-b910f16741db req-247f9c3d-a4af-4db8-821c-d25403d5513e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:28.525011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-dcf76442-bdcc-45e0-8062-b910f16741db req-247f9c3d-a4af-4db8-821c-d25403d5513e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:28.525486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-dcf76442-bdcc-45e0-8062-b910f16741db req-247f9c3d-a4af-4db8-821c-d25403d5513e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:28.572468 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-dcf76442-bdcc-45e0-8062-b910f16741db req-247f9c3d-a4af-4db8-821c-d25403d5513e service nova] Creating event network-vif-unplugged:622d2354-1aa7-4c56-9968-1dc840e8b049 for instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d on n-h2-860282-1 Oct 04 21:13:28.586061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [req-dcf76442-bdcc-45e0-8062-b910f16741db req-247f9c3d-a4af-4db8-821c-d25403d5513e service nova] Instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122757) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:13:28.609596 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-dcf76442-bdcc-45e0-8062-b910f16741db req-247f9c3d-a4af-4db8-821c-d25403d5513e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130698 Oct 04 21:13:28.610614 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1003/2039] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:28.615978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-29ed7349-b529-4ef3-9358-1da334959cfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:28.616700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-29ed7349-b529-4ef3-9358-1da334959cfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:28.630074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29ed7349-b529-4ef3-9358-1da334959cfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:28.630578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29ed7349-b529-4ef3-9358-1da334959cfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:28.631025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29ed7349-b529-4ef3-9358-1da334959cfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:28.631741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29ed7349-b529-4ef3-9358-1da334959cfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:28.632442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29ed7349-b529-4ef3-9358-1da334959cfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:28.633082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29ed7349-b529-4ef3-9358-1da334959cfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:28.704173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e4aa2990-a462-45c9-8160-51d340924e31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:28.716179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e4aa2990-a462-45c9-8160-51d340924e31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:28.717863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e4aa2990-a462-45c9-8160-51d340924e31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:28.720731 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e4aa2990-a462-45c9-8160-51d340924e31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 0.440083 Oct 04 21:13:28.721469 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1037/2040] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:28 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:28.727696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-400be98a-3d91-4300-b08a-2830daab7583 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:28.728736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-400be98a-3d91-4300-b08a-2830daab7583 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] [instance: 04b031f2-40e3-486e-9066-ff87fbffb8ec] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:28.737822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-400be98a-3d91-4300-b08a-2830daab7583 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:28.738909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-400be98a-3d91-4300-b08a-2830daab7583 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:28.739473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-400be98a-3d91-4300-b08a-2830daab7583 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:28.740307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-400be98a-3d91-4300-b08a-2830daab7583 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:28.741113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-400be98a-3d91-4300-b08a-2830daab7583 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:28.741865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-400be98a-3d91-4300-b08a-2830daab7583 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:28.759781 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-400be98a-3d91-4300-b08a-2830daab7583 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] HTTP exception thrown: Instance 04b031f2-40e3-486e-9066-ff87fbffb8ec could not be found. Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-400be98a-3d91-4300-b08a-2830daab7583 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Request method failure captured: Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec HTTP/1.1 Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKGqAnkSmVZjs6DphHuP9pEtwfX42iSvDlQLz1tK0HYVYuC-VWR1Vn2wZ_ukGkH8EiF-1Q743JuXGtq7Awl0QPGiHvJGcfVy821mazf8Be7yEGrAiG-MeRDIpRWXbaJTcuBBkAoy1gj4zRKATAuEvYgI-ROpOghd_-U0uxIboVzbJQc Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f439ca730404443ba4b48e7fb79b62ac Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1891594107 Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f439ca730404443ba4b48e7fb79b62ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f439ca730404443ba4b48e7fb79b62ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f439ca730404443ba4b48e7fb79b62ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f439ca730404443ba4b48e7fb79b62ac"}]}] Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1891594107 Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f439ca730404443ba4b48e7fb79b62ac Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1891594107 Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersAdminNegativeTestJSON-1891594107-project Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 1d298c8e0c0a4186a15c745957c691fa Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1891594107-project Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 04b031f2-40e3-486e-9066-ff87fbffb8ec could not be found. Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '04b031f2-40e3-486e-9066-ff87fbffb8ec'} Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04b031f2-40e3-486e-9066-ff87fbffb8ec could not be found. Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04b031f2-40e3-486e-9066-ff87fbffb8ec could not be found. Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:28.761890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:28.766766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:28.766766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:28.766766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:28.766766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:28.766766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:28.766766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:28.766766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04b031f2-40e3-486e-9066-ff87fbffb8ec could not be found. Oct 04 21:13:28.766766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:28.766766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-400be98a-3d91-4300-b08a-2830daab7583 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] Returning 404 to user: Instance 04b031f2-40e3-486e-9066-ff87fbffb8ec could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:28.766766 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-400be98a-3d91-4300-b08a-2830daab7583 tempest-ServersAdminNegativeTestJSON-1891594107 tempest-ServersAdminNegativeTestJSON-1891594107-project] 10.222.0.30 "GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec" status: 404 len: 111 microversion: 2.1 time: 0.041808 Oct 04 21:13:28.766766 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1038/2041] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:28 2022] GET /compute/v2.1/servers/04b031f2-40e3-486e-9066-ff87fbffb8ec => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:28.771686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-570392a3-cb05-4338-a777-a84d758acff1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f5790054280>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:28.839492 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-570392a3-cb05-4338-a777-a84d758acff1 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.072137 Oct 04 21:13:28.841064 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1039/2042] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:28 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:29.226376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29ed7349-b529-4ef3-9358-1da334959cfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:29.227020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29ed7349-b529-4ef3-9358-1da334959cfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:29.227528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29ed7349-b529-4ef3-9358-1da334959cfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:29.228084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-29ed7349-b529-4ef3-9358-1da334959cfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lazy-loading 'fault' on Instance uuid fcf618d0-9d79-435c-ac4f-636ac63dbbda {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:13:29.274765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-29ed7349-b529-4ef3-9358-1da334959cfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:29.283465 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-29ed7349-b529-4ef3-9358-1da334959cfb tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 200 len: 1321 microversion: 2.1 time: 0.671543 Oct 04 21:13:29.289605 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1004/2043] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:28 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 1321 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:29.308158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7f2ff3d7-a4db-445c-9b45-dac2cd172388 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:29.309043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7f2ff3d7-a4db-445c-9b45-dac2cd172388 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:29.328199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f2ff3d7-a4db-445c-9b45-dac2cd172388 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:29.328199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f2ff3d7-a4db-445c-9b45-dac2cd172388 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:29.328199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f2ff3d7-a4db-445c-9b45-dac2cd172388 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:29.329412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f2ff3d7-a4db-445c-9b45-dac2cd172388 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:29.330083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f2ff3d7-a4db-445c-9b45-dac2cd172388 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:29.330683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f2ff3d7-a4db-445c-9b45-dac2cd172388 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:29.336588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9e043a91-3d5f-4063-8050-1cfae4ce32b7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:29.337218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9e043a91-3d5f-4063-8050-1cfae4ce32b7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:29.348790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e043a91-3d5f-4063-8050-1cfae4ce32b7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:29.353877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e043a91-3d5f-4063-8050-1cfae4ce32b7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:29.388773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e043a91-3d5f-4063-8050-1cfae4ce32b7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:29.391009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e043a91-3d5f-4063-8050-1cfae4ce32b7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:29.406774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e043a91-3d5f-4063-8050-1cfae4ce32b7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:29.408261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e043a91-3d5f-4063-8050-1cfae4ce32b7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:29.836378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9e043a91-3d5f-4063-8050-1cfae4ce32b7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:29.843167 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9e043a91-3d5f-4063-8050-1cfae4ce32b7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1468 microversion: 2.1 time: 0.510570 Oct 04 21:13:29.843756 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1005/2044] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:29 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1468 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:29.857122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2d4e6ea2-12dd-42c1-8e57-ef83b60d7740 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:29.866176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2d4e6ea2-12dd-42c1-8e57-ef83b60d7740 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:29.884001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d4e6ea2-12dd-42c1-8e57-ef83b60d7740 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:29.884523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d4e6ea2-12dd-42c1-8e57-ef83b60d7740 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:29.884973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d4e6ea2-12dd-42c1-8e57-ef83b60d7740 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:29.886140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d4e6ea2-12dd-42c1-8e57-ef83b60d7740 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:29.886612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d4e6ea2-12dd-42c1-8e57-ef83b60d7740 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:29.887278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d4e6ea2-12dd-42c1-8e57-ef83b60d7740 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:30.127104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7f2ff3d7-a4db-445c-9b45-dac2cd172388 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b42771389c468c90ed797f6d84808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a2825f91e4225926d0ae4d55da568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:30.136439 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7f2ff3d7-a4db-445c-9b45-dac2cd172388 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa" status: 200 len: 1519 microversion: 2.1 time: 0.832620 Oct 04 21:13:30.173284 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1040/2045] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:29 2022] GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa => generated 1519 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:30.173284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2d5eaaff-d2fb-4f5e-89aa-b95f5a34ef1b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f57900b5940>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:30.353760 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2d5eaaff-d2fb-4f5e-89aa-b95f5a34ef1b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.193531 Oct 04 21:13:30.357795 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1041/2046] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:30 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:30.368317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-64a270e5-4aec-4c5d-b275-5b2af46dcc64 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:30.373987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-64a270e5-4aec-4c5d-b275-5b2af46dcc64 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: fcf618d0-9d79-435c-ac4f-636ac63dbbda] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:30.427507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64a270e5-4aec-4c5d-b275-5b2af46dcc64 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:30.436288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64a270e5-4aec-4c5d-b275-5b2af46dcc64 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:30.439308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64a270e5-4aec-4c5d-b275-5b2af46dcc64 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:30.447877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64a270e5-4aec-4c5d-b275-5b2af46dcc64 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:30.447877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64a270e5-4aec-4c5d-b275-5b2af46dcc64 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:30.447877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64a270e5-4aec-4c5d-b275-5b2af46dcc64 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:30.508576 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-64a270e5-4aec-4c5d-b275-5b2af46dcc64 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] HTTP exception thrown: Instance fcf618d0-9d79-435c-ac4f-636ac63dbbda could not be found. Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-64a270e5-4aec-4c5d-b275-5b2af46dcc64 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Request method failure captured: Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda HTTP/1.1 Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKBT-XKr348wZ9WTMvXM6gFaW0uZDmbpTA5cPm3mvF7iwM1X1XqcLWWCvbMgfgLCsUBiWuE9ndMAkk1P6Mmk_UTB3LCm5YbIIJc9-Zz6g4AhEA5xGKmq5Peob5aZPnBhBXYpm3oFsT4-W53Qa_eD4upvWJGHmDwrhE7jn-Hj-m0vRUc Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7e9215d1ae0947ce84469bed21fc05ac Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-LiveMigrationTest-1421388441 Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7e9215d1ae0947ce84469bed21fc05ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7e9215d1ae0947ce84469bed21fc05ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7e9215d1ae0947ce84469bed21fc05ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7e9215d1ae0947ce84469bed21fc05ac"}]}] Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-LiveMigrationTest-1421388441 Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7e9215d1ae0947ce84469bed21fc05ac Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-LiveMigrationTest-1421388441 Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-LiveMigrationTest-1421388441-project Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 8bfa449eb3144332afa616cc85d9643f Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-LiveMigrationTest-1421388441-project Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance fcf618d0-9d79-435c-ac4f-636ac63dbbda could not be found. Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'fcf618d0-9d79-435c-ac4f-636ac63dbbda'} Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcf618d0-9d79-435c-ac4f-636ac63dbbda could not be found. Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcf618d0-9d79-435c-ac4f-636ac63dbbda could not be found. Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:30.517088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:30.522571 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:30.522571 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:30.522571 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:30.522571 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:30.522571 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:30.522571 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcf618d0-9d79-435c-ac4f-636ac63dbbda could not be found. Oct 04 21:13:30.522571 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:30.527512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-64a270e5-4aec-4c5d-b275-5b2af46dcc64 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Returning 404 to user: Instance fcf618d0-9d79-435c-ac4f-636ac63dbbda could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:30.543357 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-64a270e5-4aec-4c5d-b275-5b2af46dcc64 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda" status: 404 len: 111 microversion: 2.1 time: 0.180981 Oct 04 21:13:30.550405 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1042/2047] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:30 2022] GET /compute/v2.1/servers/fcf618d0-9d79-435c-ac4f-636ac63dbbda => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:30.561094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-14fccbe6-6be4-421e-b121-295daa56f02d tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2122521400", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "782895f5-1d71-4a4c-a957-454ea4f0d913"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-14fccbe6-6be4-421e-b121-295daa56f02d tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Request method failure captured: Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 243 Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKHhTUncyX5VZnnozTwz6vZDI0gktU1iw8ChKNNt-Ro2DCOH_IuMdn2qz3GTcKAWnjLHzlzElTHXOUrT6IeJkUMj7VQ4OYnpZbUiJopvTMjwN2aT8AQ1OL5j3XU0U9iLMCpxlz_CYpozW-b4KHsTbhbR9UatBecRlVfHnsX0vRMWX38 Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 768a2825f91e4225926d0ae4d55da568 Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/768a2825f91e4225926d0ae4d55da568"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_768a2825f91e4225926d0ae4d55da568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/768a2825f91e4225926d0ae4d55da568"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/768a2825f91e4225926d0ae4d55da568"}]}] Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 768a2825f91e4225926d0ae4d55da568 Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerMetadataNegativeTestJSON-1803334219-project Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c7b42771389c468c90ed797f6d84808d Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1803334219-project Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2122521400", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "782895f5-1d71-4a4c-a957-454ea4f0d913"}]}} Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2122521400', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '782895f5-1d71-4a4c-a957-454ea4f0d913'}]}}} Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:30.576672 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-14fccbe6-6be4-421e-b121-295daa56f02d tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-14fccbe6-6be4-421e-b121-295daa56f02d tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.031676 Oct 04 21:13:30.587943 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1043/2048] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:13:30 2022] POST /compute/v2.1/servers => generated 175 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:13:30.598233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-644994e0-d13f-40ac-9781-a4677c9b434a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '.version_select at 0x7f5790925790>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:30.751096 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-644994e0-d13f-40ac-9781-a4677c9b434a tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792744913" status: 202 len: 0 microversion: 2.1 time: 0.164829 Oct 04 21:13:30.751900 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1044/2049] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Oct 4 21:13:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792744913 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:13:30.757383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-a838a840-a910-45ae-beb5-86ac030145da req-03e62767-a77a-42fb-8858-a1517cc83fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c86d6b4-12a8-464a-84d7-2d6454aee597", "tag": "9229c565-3c30-423f-9b59-78ca89772437"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:30.783958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a838a840-a910-45ae-beb5-86ac030145da req-03e62767-a77a-42fb-8858-a1517cc83fa9 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:30.784470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a838a840-a910-45ae-beb5-86ac030145da req-03e62767-a77a-42fb-8858-a1517cc83fa9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:30.784904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a838a840-a910-45ae-beb5-86ac030145da req-03e62767-a77a-42fb-8858-a1517cc83fa9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:30.810742 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-a838a840-a910-45ae-beb5-86ac030145da req-03e62767-a77a-42fb-8858-a1517cc83fa9 service nova] Creating event network-changed:9229c565-3c30-423f-9b59-78ca89772437 for instance 4c86d6b4-12a8-464a-84d7-2d6454aee597 on n-h2-860282-1 Oct 04 21:13:30.822778 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-a838a840-a910-45ae-beb5-86ac030145da req-03e62767-a77a-42fb-8858-a1517cc83fa9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069282 Oct 04 21:13:30.827745 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1045/2050] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:30.842728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-22a52583-2ded-490e-9cf6-5201f8f549c0 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:30.843757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-22a52583-2ded-490e-9cf6-5201f8f549c0 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: 890cccb4-4974-435e-ad70-cbabab7d25dc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:30.859751 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-22a52583-2ded-490e-9cf6-5201f8f549c0 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] HTTP exception thrown: Instance 890cccb4-4974-435e-ad70-cbabab7d25dc could not be found. Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-22a52583-2ded-490e-9cf6-5201f8f549c0 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Request method failure captured: Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/890cccb4-4974-435e-ad70-cbabab7d25dc/metadata HTTP/1.1 Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKHhTUncyX5VZnnozTwz6vZDI0gktU1iw8ChKNNt-Ro2DCOH_IuMdn2qz3GTcKAWnjLHzlzElTHXOUrT6IeJkUMj7VQ4OYnpZbUiJopvTMjwN2aT8AQ1OL5j3XU0U9iLMCpxlz_CYpozW-b4KHsTbhbR9UatBecRlVfHnsX0vRMWX38 Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 768a2825f91e4225926d0ae4d55da568 Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/768a2825f91e4225926d0ae4d55da568"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_768a2825f91e4225926d0ae4d55da568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/768a2825f91e4225926d0ae4d55da568"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/768a2825f91e4225926d0ae4d55da568"}]}] Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 768a2825f91e4225926d0ae4d55da568 Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerMetadataNegativeTestJSON-1803334219-project Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c7b42771389c468c90ed797f6d84808d Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1803334219-project Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 890cccb4-4974-435e-ad70-cbabab7d25dc could not be found. Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'server_id': '890cccb4-4974-435e-ad70-cbabab7d25dc'} Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 890cccb4-4974-435e-ad70-cbabab7d25dc could not be found. Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 890cccb4-4974-435e-ad70-cbabab7d25dc could not be found. Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:30.868347 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:30.878419 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:30.878419 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:30.878419 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 890cccb4-4974-435e-ad70-cbabab7d25dc could not be found. Oct 04 21:13:30.878419 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:30.878419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-22a52583-2ded-490e-9cf6-5201f8f549c0 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Returning 404 to user: Instance 890cccb4-4974-435e-ad70-cbabab7d25dc could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:30.878419 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-22a52583-2ded-490e-9cf6-5201f8f549c0 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "GET /compute/v2.1/servers/890cccb4-4974-435e-ad70-cbabab7d25dc/metadata" status: 404 len: 111 microversion: 2.1 time: 0.041518 Oct 04 21:13:30.890443 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1046/2051] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Oct 4 21:13:30 2022] GET /compute/v2.1/servers/890cccb4-4974-435e-ad70-cbabab7d25dc/metadata => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:30.896843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b8ccc5aa-435e-4149-ade1-51d6a2f2289e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:30.900657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b8ccc5aa-435e-4149-ade1-51d6a2f2289e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:30.923228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8ccc5aa-435e-4149-ade1-51d6a2f2289e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:30.928140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8ccc5aa-435e-4149-ade1-51d6a2f2289e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:30.928600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8ccc5aa-435e-4149-ade1-51d6a2f2289e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:30.931946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8ccc5aa-435e-4149-ade1-51d6a2f2289e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:30.933810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8ccc5aa-435e-4149-ade1-51d6a2f2289e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:30.934256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8ccc5aa-435e-4149-ade1-51d6a2f2289e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:31.191814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2d4e6ea2-12dd-42c1-8e57-ef83b60d7740 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:31.217164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2d4e6ea2-12dd-42c1-8e57-ef83b60d7740 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:31.222236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2d4e6ea2-12dd-42c1-8e57-ef83b60d7740 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:31.233261 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2d4e6ea2-12dd-42c1-8e57-ef83b60d7740 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 1.385229 Oct 04 21:13:31.234608 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1006/2052] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:29 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:31.242010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c2dfa5b5-459c-4052-b89e-86053f73c601 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2067562038", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "782895f5-1d71-4a4c-a957-454ea4f0d913"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c2dfa5b5-459c-4052-b89e-86053f73c601 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Request method failure captured: Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 499 Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKHhTUncyX5VZnnozTwz6vZDI0gktU1iw8ChKNNt-Ro2DCOH_IuMdn2qz3GTcKAWnjLHzlzElTHXOUrT6IeJkUMj7VQ4OYnpZbUiJopvTMjwN2aT8AQ1OL5j3XU0U9iLMCpxlz_CYpozW-b4KHsTbhbR9UatBecRlVfHnsX0vRMWX38 Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 768a2825f91e4225926d0ae4d55da568 Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/768a2825f91e4225926d0ae4d55da568"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_768a2825f91e4225926d0ae4d55da568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/768a2825f91e4225926d0ae4d55da568"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/768a2825f91e4225926d0ae4d55da568"}]}] Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 768a2825f91e4225926d0ae4d55da568 Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerMetadataNegativeTestJSON-1803334219-project Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c7b42771389c468c90ed797f6d84808d Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1803334219-project Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2067562038", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "782895f5-1d71-4a4c-a957-454ea4f0d913"}]}} Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2067562038', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '782895f5-1d71-4a4c-a957-454ea4f0d913'}]}}} Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 21:13:31.252038 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:31.255555 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.264669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c2dfa5b5-459c-4052-b89e-86053f73c601 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:31.265846 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c2dfa5b5-459c-4052-b89e-86053f73c601 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.029979 Oct 04 21:13:31.270475 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1007/2053] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:13:31 2022] POST /compute/v2.1/servers => generated 687 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:13:31.351776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4b264139-d981-4d18-abd9-3406afa06399 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2058090811", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "782895f5-1d71-4a4c-a957-454ea4f0d913"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4b264139-d981-4d18-abd9-3406afa06399 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Request method failure captured: Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 500 Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKHhTUncyX5VZnnozTwz6vZDI0gktU1iw8ChKNNt-Ro2DCOH_IuMdn2qz3GTcKAWnjLHzlzElTHXOUrT6IeJkUMj7VQ4OYnpZbUiJopvTMjwN2aT8AQ1OL5j3XU0U9iLMCpxlz_CYpozW-b4KHsTbhbR9UatBecRlVfHnsX0vRMWX38 Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 768a2825f91e4225926d0ae4d55da568 Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/768a2825f91e4225926d0ae4d55da568"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_768a2825f91e4225926d0ae4d55da568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/768a2825f91e4225926d0ae4d55da568"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/768a2825f91e4225926d0ae4d55da568"}]}] Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 768a2825f91e4225926d0ae4d55da568 Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerMetadataNegativeTestJSON-1803334219-project Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c7b42771389c468c90ed797f6d84808d Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1803334219-project Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2058090811", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "782895f5-1d71-4a4c-a957-454ea4f0d913"}]}} Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2058090811', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '782895f5-1d71-4a4c-a957-454ea4f0d913'}]}}} Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 21:13:31.372564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4b264139-d981-4d18-abd9-3406afa06399 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4b264139-d981-4d18-abd9-3406afa06399 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.012258 Oct 04 21:13:31.377321 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1008/2054] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:13:31 2022] POST /compute/v2.1/servers => generated 689 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:13:31.398286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e8c37fac-4ee1-4e2d-b66a-d26a666789e3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f5794516ee0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:31.465903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b8ccc5aa-435e-4149-ade1-51d6a2f2289e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:31.467672 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e8c37fac-4ee1-4e2d-b66a-d26a666789e3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.098412 Oct 04 21:13:31.475430 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b8ccc5aa-435e-4149-ade1-51d6a2f2289e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1468 microversion: 2.1 time: 0.583507 Oct 04 21:13:31.476348 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1009/2055] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:31 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:31.478056 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1047/2056] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:30 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1468 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:31.498372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-da2ed778-efd9-4450-9c28-6a71ee8021cf tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-792259797", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "782895f5-1d71-4a4c-a957-454ea4f0d913"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-da2ed778-efd9-4450-9c28-6a71ee8021cf tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Request method failure captured: Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 753 Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKHhTUncyX5VZnnozTwz6vZDI0gktU1iw8ChKNNt-Ro2DCOH_IuMdn2qz3GTcKAWnjLHzlzElTHXOUrT6IeJkUMj7VQ4OYnpZbUiJopvTMjwN2aT8AQ1OL5j3XU0U9iLMCpxlz_CYpozW-b4KHsTbhbR9UatBecRlVfHnsX0vRMWX38 Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 768a2825f91e4225926d0ae4d55da568 Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/768a2825f91e4225926d0ae4d55da568"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_768a2825f91e4225926d0ae4d55da568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/768a2825f91e4225926d0ae4d55da568"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/768a2825f91e4225926d0ae4d55da568"}]}] Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 768a2825f91e4225926d0ae4d55da568 Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerMetadataNegativeTestJSON-1803334219-project Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c7b42771389c468c90ed797f6d84808d Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1803334219-project Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-792259797", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "782895f5-1d71-4a4c-a957-454ea4f0d913"}]}} Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-792259797', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '782895f5-1d71-4a4c-a957-454ea4f0d913'}]}}} Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:13:31.502986 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:13:31.511275 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:13:31.515115 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:31.515115 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.515115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-da2ed778-efd9-4450-9c28-6a71ee8021cf tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:31.515115 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-da2ed778-efd9-4450-9c28-6a71ee8021cf tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.026905 Oct 04 21:13:31.515115 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1010/2057] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:13:31 2022] POST /compute/v2.1/servers => generated 1197 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 04 21:13:31.575799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b04a9ea3-ee28-413b-bbe0-c63841b93221 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1531710281", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "782895f5-1d71-4a4c-a957-454ea4f0d913"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b04a9ea3-ee28-413b-bbe0-c63841b93221 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Request method failure captured: Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 1266 Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKHhTUncyX5VZnnozTwz6vZDI0gktU1iw8ChKNNt-Ro2DCOH_IuMdn2qz3GTcKAWnjLHzlzElTHXOUrT6IeJkUMj7VQ4OYnpZbUiJopvTMjwN2aT8AQ1OL5j3XU0U9iLMCpxlz_CYpozW-b4KHsTbhbR9UatBecRlVfHnsX0vRMWX38 Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 768a2825f91e4225926d0ae4d55da568 Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/768a2825f91e4225926d0ae4d55da568"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_768a2825f91e4225926d0ae4d55da568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/768a2825f91e4225926d0ae4d55da568"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/768a2825f91e4225926d0ae4d55da568"}]}] Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 768a2825f91e4225926d0ae4d55da568 Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerMetadataNegativeTestJSON-1803334219-project Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c7b42771389c468c90ed797f6d84808d Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1803334219-project Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1531710281", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "782895f5-1d71-4a4c-a957-454ea4f0d913"}]}} Oct 04 21:13:31.581520 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:13:31.594888 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:31.594888 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1531710281', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '782895f5-1d71-4a4c-a957-454ea4f0d913'}]}}} Oct 04 21:13:31.594888 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:31.594888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:31.594888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:13:31.594888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:13:31.594888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:13:31.594888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:13:31.594888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:31.594888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.594888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 21:13:31.594888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 21:13:31.594888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 21:13:31.594888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 21:13:31.594888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 21:13:31.594888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.594888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:13:31.596673 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:13:31.599061 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:13:31.599061 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.599061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b04a9ea3-ee28-413b-bbe0-c63841b93221 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:31.599061 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b04a9ea3-ee28-413b-bbe0-c63841b93221 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.011584 Oct 04 21:13:31.599061 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1048/2058] 10.222.0.30 () {60 vars in 1148 bytes} [Tue Oct 4 21:13:31 2022] POST /compute/v2.1/servers => generated 2221 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 04 21:13:31.599592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2b6a2442-f9e0-44e3-b6b5-05801bde92a6 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:31.599592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2b6a2442-f9e0-44e3-b6b5-05801bde92a6 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: 5aced536-db4b-4352-bd54-f731fedbc5a7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:31.606406 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-2b6a2442-f9e0-44e3-b6b5-05801bde92a6 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] HTTP exception thrown: Instance 5aced536-db4b-4352-bd54-f731fedbc5a7 could not be found. Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2b6a2442-f9e0-44e3-b6b5-05801bde92a6 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Request method failure captured: Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/5aced536-db4b-4352-bd54-f731fedbc5a7/metadata/test2 HTTP/1.1 Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKHhTUncyX5VZnnozTwz6vZDI0gktU1iw8ChKNNt-Ro2DCOH_IuMdn2qz3GTcKAWnjLHzlzElTHXOUrT6IeJkUMj7VQ4OYnpZbUiJopvTMjwN2aT8AQ1OL5j3XU0U9iLMCpxlz_CYpozW-b4KHsTbhbR9UatBecRlVfHnsX0vRMWX38 Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 768a2825f91e4225926d0ae4d55da568 Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/768a2825f91e4225926d0ae4d55da568"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_768a2825f91e4225926d0ae4d55da568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/768a2825f91e4225926d0ae4d55da568"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/768a2825f91e4225926d0ae4d55da568"}]}] Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 768a2825f91e4225926d0ae4d55da568 Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerMetadataNegativeTestJSON-1803334219-project Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c7b42771389c468c90ed797f6d84808d Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1803334219-project Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 5aced536-db4b-4352-bd54-f731fedbc5a7 could not be found. Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'server_id': '5aced536-db4b-4352-bd54-f731fedbc5a7', 'id': 'test2'} Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aced536-db4b-4352-bd54-f731fedbc5a7 could not be found. Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aced536-db4b-4352-bd54-f731fedbc5a7 could not be found. Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:31.608291 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:31.626138 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:31.626138 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:31.626138 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aced536-db4b-4352-bd54-f731fedbc5a7 could not be found. Oct 04 21:13:31.626138 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:31.626138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2b6a2442-f9e0-44e3-b6b5-05801bde92a6 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Returning 404 to user: Instance 5aced536-db4b-4352-bd54-f731fedbc5a7 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:31.626138 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2b6a2442-f9e0-44e3-b6b5-05801bde92a6 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "GET /compute/v2.1/servers/5aced536-db4b-4352-bd54-f731fedbc5a7/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.015130 Oct 04 21:13:31.626138 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1011/2059] 10.222.0.30 () {58 vars in 1281 bytes} [Tue Oct 4 21:13:31 2022] GET /compute/v2.1/servers/5aced536-db4b-4352-bd54-f731fedbc5a7/metadata/test2 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:31.648869 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-08ed1cb5-b148-4b53-a828-892e004279fd tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:31.649486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-08ed1cb5-b148-4b53-a828-892e004279fd tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:31.669500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08ed1cb5-b148-4b53-a828-892e004279fd tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:31.672514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08ed1cb5-b148-4b53-a828-892e004279fd tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:31.675404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08ed1cb5-b148-4b53-a828-892e004279fd tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:31.676705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08ed1cb5-b148-4b53-a828-892e004279fd tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:31.680377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08ed1cb5-b148-4b53-a828-892e004279fd tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:31.680894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08ed1cb5-b148-4b53-a828-892e004279fd tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:31.730052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-08ed1cb5-b148-4b53-a828-892e004279fd tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:13:32.264916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0138b2f9-0a93-4050-999d-7e537ae64341 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:32.266939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0138b2f9-0a93-4050-999d-7e537ae64341 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:32.277043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0138b2f9-0a93-4050-999d-7e537ae64341 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:32.277919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0138b2f9-0a93-4050-999d-7e537ae64341 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:32.279100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0138b2f9-0a93-4050-999d-7e537ae64341 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:32.280183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0138b2f9-0a93-4050-999d-7e537ae64341 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:32.280829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0138b2f9-0a93-4050-999d-7e537ae64341 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:32.281470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0138b2f9-0a93-4050-999d-7e537ae64341 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:32.339401 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-08ed1cb5-b148-4b53-a828-892e004279fd tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa" status: 204 len: 0 microversion: 2.1 time: 0.695474 Oct 04 21:13:32.347183 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1049/2060] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:31 2022] DELETE /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa => generated 0 bytes in 704 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:13:32.360324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b650e0d2-00bd-47d5-827c-cc87da9b9687 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:32.361061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b650e0d2-00bd-47d5-827c-cc87da9b9687 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:32.376416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b650e0d2-00bd-47d5-827c-cc87da9b9687 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:32.376929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b650e0d2-00bd-47d5-827c-cc87da9b9687 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:32.377351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b650e0d2-00bd-47d5-827c-cc87da9b9687 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:32.379308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b650e0d2-00bd-47d5-827c-cc87da9b9687 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:32.384488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b650e0d2-00bd-47d5-827c-cc87da9b9687 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:32.384867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b650e0d2-00bd-47d5-827c-cc87da9b9687 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:32.799209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b650e0d2-00bd-47d5-827c-cc87da9b9687 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b42771389c468c90ed797f6d84808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a2825f91e4225926d0ae4d55da568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:32.819849 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b650e0d2-00bd-47d5-827c-cc87da9b9687 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa" status: 200 len: 1525 microversion: 2.1 time: 0.468086 Oct 04 21:13:32.831549 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1050/2061] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:32 2022] GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa => generated 1525 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:13:32.848986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f6a9161c-848c-406d-b60e-ada8c5b6abdc tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f5790032f70>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:32.872871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0138b2f9-0a93-4050-999d-7e537ae64341 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:32.882745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0138b2f9-0a93-4050-999d-7e537ae64341 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:32.890789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0138b2f9-0a93-4050-999d-7e537ae64341 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:32.900656 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0138b2f9-0a93-4050-999d-7e537ae64341 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 0.640134 Oct 04 21:13:32.905510 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1012/2062] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:32 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:13:32.907741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-82ff7e98-ee6f-4254-8e67-fe6a7fab82a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:32.908430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-82ff7e98-ee6f-4254-8e67-fe6a7fab82a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:32.941506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82ff7e98-ee6f-4254-8e67-fe6a7fab82a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:32.941506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82ff7e98-ee6f-4254-8e67-fe6a7fab82a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:32.941506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82ff7e98-ee6f-4254-8e67-fe6a7fab82a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:32.942843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82ff7e98-ee6f-4254-8e67-fe6a7fab82a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:32.943858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82ff7e98-ee6f-4254-8e67-fe6a7fab82a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:32.948628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82ff7e98-ee6f-4254-8e67-fe6a7fab82a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:32.966269 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f6a9161c-848c-406d-b60e-ada8c5b6abdc tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.128985 Oct 04 21:13:32.968029 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1051/2063] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:32 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:32.983200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-714ab8eb-4810-403b-becc-e1fd85128125 req-d763eaa7-76d4-4e5f-bfdd-821565bcf08f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0dbeb11-0fb1-48ab-aa70-d33e03b8093d", "tag": "622d2354-1aa7-4c56-9968-1dc840e8b049"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:33.005482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-714ab8eb-4810-403b-becc-e1fd85128125 req-d763eaa7-76d4-4e5f-bfdd-821565bcf08f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:33.021367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-714ab8eb-4810-403b-becc-e1fd85128125 req-d763eaa7-76d4-4e5f-bfdd-821565bcf08f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:33.022138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-714ab8eb-4810-403b-becc-e1fd85128125 req-d763eaa7-76d4-4e5f-bfdd-821565bcf08f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:33.068067 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-714ab8eb-4810-403b-becc-e1fd85128125 req-d763eaa7-76d4-4e5f-bfdd-821565bcf08f service nova] Creating event network-changed:622d2354-1aa7-4c56-9968-1dc840e8b049 for instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d on n-h2-860282-1 Oct 04 21:13:33.092548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-714ab8eb-4810-403b-becc-e1fd85128125 req-d763eaa7-76d4-4e5f-bfdd-821565bcf08f service nova] Instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:13:33.132088 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-714ab8eb-4810-403b-becc-e1fd85128125 req-d763eaa7-76d4-4e5f-bfdd-821565bcf08f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159310 Oct 04 21:13:33.132869 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1052/2064] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:33.532512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-82ff7e98-ee6f-4254-8e67-fe6a7fab82a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:33.548821 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-82ff7e98-ee6f-4254-8e67-fe6a7fab82a0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1468 microversion: 2.1 time: 0.645044 Oct 04 21:13:33.552614 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1013/2065] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:32 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1468 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:33.860425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9ac13d19-1d43-4ddf-8589-a031ecd7182c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:33.862664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9ac13d19-1d43-4ddf-8589-a031ecd7182c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:33.896789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ac13d19-1d43-4ddf-8589-a031ecd7182c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:33.900509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ac13d19-1d43-4ddf-8589-a031ecd7182c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:33.906929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ac13d19-1d43-4ddf-8589-a031ecd7182c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:33.913688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ac13d19-1d43-4ddf-8589-a031ecd7182c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:33.917540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ac13d19-1d43-4ddf-8589-a031ecd7182c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:33.922095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ac13d19-1d43-4ddf-8589-a031ecd7182c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:33.927658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-82c23884-9eb7-40d5-a24d-873655f46a31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:33.932546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-82c23884-9eb7-40d5-a24d-873655f46a31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:33.939351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82c23884-9eb7-40d5-a24d-873655f46a31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:33.940171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82c23884-9eb7-40d5-a24d-873655f46a31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:33.941085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82c23884-9eb7-40d5-a24d-873655f46a31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:33.942049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82c23884-9eb7-40d5-a24d-873655f46a31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:33.943635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82c23884-9eb7-40d5-a24d-873655f46a31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:33.944282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82c23884-9eb7-40d5-a24d-873655f46a31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:34.571463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9ac13d19-1d43-4ddf-8589-a031ecd7182c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b42771389c468c90ed797f6d84808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a2825f91e4225926d0ae4d55da568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:34.584473 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9ac13d19-1d43-4ddf-8589-a031ecd7182c tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa" status: 200 len: 1525 microversion: 2.1 time: 0.732613 Oct 04 21:13:34.585769 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1053/2066] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:33 2022] GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa => generated 1525 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:34.591461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aae71f30-4459-4825-83b2-d1686afdc0a2 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f578bf1a430>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:34.652623 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aae71f30-4459-4825-83b2-d1686afdc0a2 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.064173 Oct 04 21:13:34.660261 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1054/2067] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:34 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:34.660261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-82473a49-1e0f-4cca-8b79-82ebde997cf7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:34.660261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-82473a49-1e0f-4cca-8b79-82ebde997cf7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:34.698697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82473a49-1e0f-4cca-8b79-82ebde997cf7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:34.699670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82473a49-1e0f-4cca-8b79-82ebde997cf7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:34.700573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82473a49-1e0f-4cca-8b79-82ebde997cf7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:34.701621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82473a49-1e0f-4cca-8b79-82ebde997cf7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:34.702474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82473a49-1e0f-4cca-8b79-82ebde997cf7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:34.706088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82473a49-1e0f-4cca-8b79-82ebde997cf7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:34.765796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-82473a49-1e0f-4cca-8b79-82ebde997cf7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:13:35.275098 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-82473a49-1e0f-4cca-8b79-82ebde997cf7 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 204 len: 0 microversion: 2.1 time: 0.614349 Oct 04 21:13:35.280034 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1055/2068] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:34 2022] DELETE /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:13:35.287268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fda5f074-2946-4b83-aad9-05c930d8e0f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:35.289043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fda5f074-2946-4b83-aad9-05c930d8e0f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:35.333012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fda5f074-2946-4b83-aad9-05c930d8e0f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:35.333012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fda5f074-2946-4b83-aad9-05c930d8e0f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:35.333012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fda5f074-2946-4b83-aad9-05c930d8e0f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:35.338381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fda5f074-2946-4b83-aad9-05c930d8e0f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:35.353501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fda5f074-2946-4b83-aad9-05c930d8e0f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:35.363582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fda5f074-2946-4b83-aad9-05c930d8e0f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:35.701682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-82c23884-9eb7-40d5-a24d-873655f46a31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:35.725867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-82c23884-9eb7-40d5-a24d-873655f46a31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:35.739468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-82c23884-9eb7-40d5-a24d-873655f46a31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:35.748358 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-82c23884-9eb7-40d5-a24d-873655f46a31 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 1.825295 Oct 04 21:13:35.766846 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1014/2069] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:33 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:35.777670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4e9d7d1b-aa98-439f-8d09-1bcbd1bcdc1f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:35.778722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4e9d7d1b-aa98-439f-8d09-1bcbd1bcdc1f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:35.791483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e9d7d1b-aa98-439f-8d09-1bcbd1bcdc1f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:35.796706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e9d7d1b-aa98-439f-8d09-1bcbd1bcdc1f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:35.797324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e9d7d1b-aa98-439f-8d09-1bcbd1bcdc1f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:35.804492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e9d7d1b-aa98-439f-8d09-1bcbd1bcdc1f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:35.807698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e9d7d1b-aa98-439f-8d09-1bcbd1bcdc1f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:35.816211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e9d7d1b-aa98-439f-8d09-1bcbd1bcdc1f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:37.220205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fda5f074-2946-4b83-aad9-05c930d8e0f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:37.234790 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fda5f074-2946-4b83-aad9-05c930d8e0f8 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1468 microversion: 2.1 time: 1.951140 Oct 04 21:13:37.236704 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1056/2070] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:35 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1468 bytes in 1956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:37.249901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3d56f4e3-842e-4efd-b45c-a3115fb74c29 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:37.250770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3d56f4e3-842e-4efd-b45c-a3115fb74c29 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:37.270277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d56f4e3-842e-4efd-b45c-a3115fb74c29 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:37.270277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d56f4e3-842e-4efd-b45c-a3115fb74c29 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:37.270277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d56f4e3-842e-4efd-b45c-a3115fb74c29 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:37.270277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d56f4e3-842e-4efd-b45c-a3115fb74c29 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:37.273532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d56f4e3-842e-4efd-b45c-a3115fb74c29 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:37.274267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d56f4e3-842e-4efd-b45c-a3115fb74c29 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:37.356533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4e9d7d1b-aa98-439f-8d09-1bcbd1bcdc1f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:37.391782 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4e9d7d1b-aa98-439f-8d09-1bcbd1bcdc1f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1483 microversion: 2.1 time: 1.602474 Oct 04 21:13:37.395698 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1015/2071] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:35 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1483 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:37.417945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0c9ef168-4c3b-4c7e-bc9d-f10d82dda7d6 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f57943f7940>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:37.581469 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0c9ef168-4c3b-4c7e-bc9d-f10d82dda7d6 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.182709 Oct 04 21:13:37.585772 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1016/2072] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:37 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:37.605105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-18ed0f77-02c3-416c-aba3-f64f982ba13e req-86c2c091-4235-4578-a2ff-0c113b890990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa", "name": "network-vif-unplugged", "status": "completed", "tag": "eb5bc8e0-bcca-4140-8d63-ab28b04cd3d8"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:37.639683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-18ed0f77-02c3-416c-aba3-f64f982ba13e req-86c2c091-4235-4578-a2ff-0c113b890990 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:37.644390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-18ed0f77-02c3-416c-aba3-f64f982ba13e req-86c2c091-4235-4578-a2ff-0c113b890990 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:37.644390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-18ed0f77-02c3-416c-aba3-f64f982ba13e req-86c2c091-4235-4578-a2ff-0c113b890990 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:37.672185 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-18ed0f77-02c3-416c-aba3-f64f982ba13e req-86c2c091-4235-4578-a2ff-0c113b890990 service nova] Creating event network-vif-unplugged:eb5bc8e0-bcca-4140-8d63-ab28b04cd3d8 for instance b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa on n-h2-860282-1 Oct 04 21:13:37.713077 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-18ed0f77-02c3-416c-aba3-f64f982ba13e req-86c2c091-4235-4578-a2ff-0c113b890990 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120761 Oct 04 21:13:37.713077 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1017/2073] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:37.741588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2f584c49-e0c6-4d9c-8b25-9bdad39081a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:37.750737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2f584c49-e0c6-4d9c-8b25-9bdad39081a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:37.788894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f584c49-e0c6-4d9c-8b25-9bdad39081a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:37.792127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f584c49-e0c6-4d9c-8b25-9bdad39081a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:37.795934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f584c49-e0c6-4d9c-8b25-9bdad39081a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:37.799699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f584c49-e0c6-4d9c-8b25-9bdad39081a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:37.809321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f584c49-e0c6-4d9c-8b25-9bdad39081a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:37.812628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f584c49-e0c6-4d9c-8b25-9bdad39081a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:37.986478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3d56f4e3-842e-4efd-b45c-a3115fb74c29 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b42771389c468c90ed797f6d84808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a2825f91e4225926d0ae4d55da568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:37.998587 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3d56f4e3-842e-4efd-b45c-a3115fb74c29 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa" status: 200 len: 1483 microversion: 2.1 time: 0.759920 Oct 04 21:13:38.020893 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1057/2074] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:37 2022] GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa => generated 1483 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:38.048310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-334b151a-e22b-4dde-b2b3-33f6655e3d15 req-5e5d5e67-4c12-4e75-9355-2eebbc13c1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa", "name": "network-vif-deleted", "tag": "eb5bc8e0-bcca-4140-8d63-ab28b04cd3d8"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:38.083738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-334b151a-e22b-4dde-b2b3-33f6655e3d15 req-5e5d5e67-4c12-4e75-9355-2eebbc13c1d1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:38.084481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-334b151a-e22b-4dde-b2b3-33f6655e3d15 req-5e5d5e67-4c12-4e75-9355-2eebbc13c1d1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:38.098407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-334b151a-e22b-4dde-b2b3-33f6655e3d15 req-5e5d5e67-4c12-4e75-9355-2eebbc13c1d1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:38.141156 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-334b151a-e22b-4dde-b2b3-33f6655e3d15 req-5e5d5e67-4c12-4e75-9355-2eebbc13c1d1 service nova] Creating event network-vif-deleted:eb5bc8e0-bcca-4140-8d63-ab28b04cd3d8 for instance b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa on n-h2-860282-1 Oct 04 21:13:38.168970 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-334b151a-e22b-4dde-b2b3-33f6655e3d15 req-5e5d5e67-4c12-4e75-9355-2eebbc13c1d1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146073 Oct 04 21:13:38.189847 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1058/2075] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:38.272854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-37187cb3-18f8-4de1-b2d6-11fc850ea2fa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:38.273705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-37187cb3-18f8-4de1-b2d6-11fc850ea2fa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:38.294539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37187cb3-18f8-4de1-b2d6-11fc850ea2fa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:38.299354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37187cb3-18f8-4de1-b2d6-11fc850ea2fa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:38.299909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37187cb3-18f8-4de1-b2d6-11fc850ea2fa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:38.300823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37187cb3-18f8-4de1-b2d6-11fc850ea2fa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:38.301344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37187cb3-18f8-4de1-b2d6-11fc850ea2fa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:38.306122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37187cb3-18f8-4de1-b2d6-11fc850ea2fa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:39.363107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2f584c49-e0c6-4d9c-8b25-9bdad39081a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:39.379145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2f584c49-e0c6-4d9c-8b25-9bdad39081a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:39.383524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2f584c49-e0c6-4d9c-8b25-9bdad39081a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:39.387429 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2f584c49-e0c6-4d9c-8b25-9bdad39081a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 1.668197 Oct 04 21:13:39.389277 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1018/2076] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:37 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:39.396896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a2069732-96ce-422a-aeb9-ad28f40e5be0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:39.400947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a2069732-96ce-422a-aeb9-ad28f40e5be0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:39.419864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2069732-96ce-422a-aeb9-ad28f40e5be0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:39.421101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2069732-96ce-422a-aeb9-ad28f40e5be0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:39.425763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2069732-96ce-422a-aeb9-ad28f40e5be0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:39.427445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2069732-96ce-422a-aeb9-ad28f40e5be0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:39.429216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2069732-96ce-422a-aeb9-ad28f40e5be0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:39.430033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2069732-96ce-422a-aeb9-ad28f40e5be0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:39.609832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-37187cb3-18f8-4de1-b2d6-11fc850ea2fa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:39.619319 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-37187cb3-18f8-4de1-b2d6-11fc850ea2fa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1468 microversion: 2.1 time: 1.362667 Oct 04 21:13:39.621614 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1059/2077] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:38 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1468 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:39.643006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-08796c46-d84c-4d29-b699-ad73218903b2 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f57900b5040>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:39.732171 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-08796c46-d84c-4d29-b699-ad73218903b2 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.107614 Oct 04 21:13:39.733176 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1060/2078] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:39 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:39.748945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2395edc0-b771-42ec-8848-51a657297919 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:39.751612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2395edc0-b771-42ec-8848-51a657297919 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:39.788079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2395edc0-b771-42ec-8848-51a657297919 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:39.788079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2395edc0-b771-42ec-8848-51a657297919 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:39.788079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2395edc0-b771-42ec-8848-51a657297919 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:39.788079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2395edc0-b771-42ec-8848-51a657297919 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:39.788079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2395edc0-b771-42ec-8848-51a657297919 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:39.788079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2395edc0-b771-42ec-8848-51a657297919 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:39.859339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2395edc0-b771-42ec-8848-51a657297919 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:39.860058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2395edc0-b771-42ec-8848-51a657297919 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:39.860670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2395edc0-b771-42ec-8848-51a657297919 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:39.861770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-2395edc0-b771-42ec-8848-51a657297919 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lazy-loading 'fault' on Instance uuid b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:13:39.941382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a2069732-96ce-422a-aeb9-ad28f40e5be0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:39.952196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2395edc0-b771-42ec-8848-51a657297919 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b42771389c468c90ed797f6d84808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768a2825f91e4225926d0ae4d55da568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:39.953543 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a2069732-96ce-422a-aeb9-ad28f40e5be0 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1483 microversion: 2.1 time: 0.562456 Oct 04 21:13:39.956649 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1019/2079] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:39 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1483 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:39.962279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:39.972388 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2395edc0-b771-42ec-8848-51a657297919 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa" status: 200 len: 1313 microversion: 2.1 time: 0.230827 Oct 04 21:13:39.973395 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1061/2080] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:39 2022] GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:40.423896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-612fa06b-ea55-4080-a799-932f6de827e2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:40.424701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-612fa06b-ea55-4080-a799-932f6de827e2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:40.425946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-1ab5d8ad-c012-4c8b-9c2c-c6b3d0e1f61f req-572c5cdf-a228-4bc6-9724-2affc1bf959a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e14e448-c2c9-4904-823a-4febd5b537b2", "name": "network-vif-deleted", "tag": "fd07f72b-4442-4b44-b1f2-27824c689273"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:40.437048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1ab5d8ad-c012-4c8b-9c2c-c6b3d0e1f61f req-572c5cdf-a228-4bc6-9724-2affc1bf959a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:40.438084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1ab5d8ad-c012-4c8b-9c2c-c6b3d0e1f61f req-572c5cdf-a228-4bc6-9724-2affc1bf959a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:40.439604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1ab5d8ad-c012-4c8b-9c2c-c6b3d0e1f61f req-572c5cdf-a228-4bc6-9724-2affc1bf959a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:40.440270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-612fa06b-ea55-4080-a799-932f6de827e2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:40.440969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-612fa06b-ea55-4080-a799-932f6de827e2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:40.441644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-612fa06b-ea55-4080-a799-932f6de827e2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:40.443874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-612fa06b-ea55-4080-a799-932f6de827e2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:40.446862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-612fa06b-ea55-4080-a799-932f6de827e2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:40.447560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-612fa06b-ea55-4080-a799-932f6de827e2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:40.466385 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-1ab5d8ad-c012-4c8b-9c2c-c6b3d0e1f61f req-572c5cdf-a228-4bc6-9724-2affc1bf959a service nova] Creating event network-vif-deleted:fd07f72b-4442-4b44-b1f2-27824c689273 for instance 6e14e448-c2c9-4904-823a-4febd5b537b2 on n-h2-860282-1 Oct 04 21:13:40.475117 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-1ab5d8ad-c012-4c8b-9c2c-c6b3d0e1f61f req-572c5cdf-a228-4bc6-9724-2affc1bf959a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064225 Oct 04 21:13:40.478250 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1020/2081] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:40.645934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-275c6d13-6826-48a3-8425-943173976ffa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:40.662652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-275c6d13-6826-48a3-8425-943173976ffa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:40.662652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:40.665960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-275c6d13-6826-48a3-8425-943173976ffa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:40.667547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-275c6d13-6826-48a3-8425-943173976ffa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:40.668197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-275c6d13-6826-48a3-8425-943173976ffa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:40.669118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-275c6d13-6826-48a3-8425-943173976ffa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:40.674932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-275c6d13-6826-48a3-8425-943173976ffa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:40.675660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-275c6d13-6826-48a3-8425-943173976ffa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:41.191604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-612fa06b-ea55-4080-a799-932f6de827e2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:41.239449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-612fa06b-ea55-4080-a799-932f6de827e2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:41.244295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-612fa06b-ea55-4080-a799-932f6de827e2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:41.257324 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-612fa06b-ea55-4080-a799-932f6de827e2 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 0.837098 Oct 04 21:13:41.258167 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1062/2082] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:40 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:41.282371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-146c5ee0-6a58-4264-872e-48cb5906df98 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f578be43670>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:41.366225 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-146c5ee0-6a58-4264-872e-48cb5906df98 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1414 microversion: 2.1 time: 0.097939 Oct 04 21:13:41.374807 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1063/2083] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:41 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1414 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:41.392389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6a1a517d-78ef-47b7-b2fb-a08b6d79c7ff tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:41.401657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6a1a517d-78ef-47b7-b2fb-a08b6d79c7ff tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:41.426608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a1a517d-78ef-47b7-b2fb-a08b6d79c7ff tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:41.429257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a1a517d-78ef-47b7-b2fb-a08b6d79c7ff tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:41.433761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a1a517d-78ef-47b7-b2fb-a08b6d79c7ff tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:41.434797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a1a517d-78ef-47b7-b2fb-a08b6d79c7ff tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:41.457865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a1a517d-78ef-47b7-b2fb-a08b6d79c7ff tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:41.458723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a1a517d-78ef-47b7-b2fb-a08b6d79c7ff tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:41.485468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-275c6d13-6826-48a3-8425-943173976ffa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:41.516610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:41.528893 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-275c6d13-6826-48a3-8425-943173976ffa tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1461 microversion: 2.1 time: 0.887519 Oct 04 21:13:41.532811 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1021/2084] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:40 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1461 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:41.568153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a1a517d-78ef-47b7-b2fb-a08b6d79c7ff tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:41.568153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a1a517d-78ef-47b7-b2fb-a08b6d79c7ff tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:41.568153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a1a517d-78ef-47b7-b2fb-a08b6d79c7ff tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:41.568153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-6a1a517d-78ef-47b7-b2fb-a08b6d79c7ff tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lazy-loading 'fault' on Instance uuid 6e14e448-c2c9-4904-823a-4febd5b537b2 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:13:41.568526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-66d01617-7910-406d-80f8-bcfb38587297 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:41.568526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-66d01617-7910-406d-80f8-bcfb38587297 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] [instance: b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:41.590978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66d01617-7910-406d-80f8-bcfb38587297 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:41.594025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66d01617-7910-406d-80f8-bcfb38587297 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:41.594485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66d01617-7910-406d-80f8-bcfb38587297 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:41.597658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66d01617-7910-406d-80f8-bcfb38587297 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:41.598444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66d01617-7910-406d-80f8-bcfb38587297 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:41.599743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66d01617-7910-406d-80f8-bcfb38587297 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:41.639904 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-66d01617-7910-406d-80f8-bcfb38587297 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] HTTP exception thrown: Instance b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa could not be found. Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-66d01617-7910-406d-80f8-bcfb38587297 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Request method failure captured: Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa HTTP/1.1 Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKHhTUncyX5VZnnozTwz6vZDI0gktU1iw8ChKNNt-Ro2DCOH_IuMdn2qz3GTcKAWnjLHzlzElTHXOUrT6IeJkUMj7VQ4OYnpZbUiJopvTMjwN2aT8AQ1OL5j3XU0U9iLMCpxlz_CYpozW-b4KHsTbhbR9UatBecRlVfHnsX0vRMWX38 Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 768a2825f91e4225926d0ae4d55da568 Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/768a2825f91e4225926d0ae4d55da568"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_768a2825f91e4225926d0ae4d55da568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/768a2825f91e4225926d0ae4d55da568"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/768a2825f91e4225926d0ae4d55da568"}]}] Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 768a2825f91e4225926d0ae4d55da568 Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1803334219 Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerMetadataNegativeTestJSON-1803334219-project Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c7b42771389c468c90ed797f6d84808d Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1803334219-project Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa could not be found. Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa'} Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa could not be found. Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa could not be found. Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:41.646355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:41.653254 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:41.653254 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:41.653254 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:41.653254 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:41.653254 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:41.653254 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:41.653254 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa could not be found. Oct 04 21:13:41.653254 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:41.655255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-66d01617-7910-406d-80f8-bcfb38587297 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] Returning 404 to user: Instance b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:41.656768 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-66d01617-7910-406d-80f8-bcfb38587297 tempest-ServerMetadataNegativeTestJSON-1803334219 tempest-ServerMetadataNegativeTestJSON-1803334219-project] 10.222.0.30 "GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa" status: 404 len: 111 microversion: 2.1 time: 0.118159 Oct 04 21:13:41.661390 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1022/2085] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:41 2022] GET /compute/v2.1/servers/b7ad6292-8f11-4a51-b7c7-f1e9d1acbbfa => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:41.740524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6a1a517d-78ef-47b7-b2fb-a08b6d79c7ff tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:41.759182 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6a1a517d-78ef-47b7-b2fb-a08b6d79c7ff tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 200 len: 1300 microversion: 2.1 time: 0.380807 Oct 04 21:13:41.764106 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1064/2086] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:41 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 1300 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:42.166903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-09a66afe-2fc7-481b-8333-ca6024cbac17 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:42.168087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-09a66afe-2fc7-481b-8333-ca6024cbac17 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:42.185914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09a66afe-2fc7-481b-8333-ca6024cbac17 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:42.186610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09a66afe-2fc7-481b-8333-ca6024cbac17 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:42.187243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09a66afe-2fc7-481b-8333-ca6024cbac17 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:42.188133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09a66afe-2fc7-481b-8333-ca6024cbac17 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:42.188785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09a66afe-2fc7-481b-8333-ca6024cbac17 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:42.189390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09a66afe-2fc7-481b-8333-ca6024cbac17 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:42.289043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4c9bc5e4-bd85-40f2-9cce-04537d0fb69e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:42.291014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4c9bc5e4-bd85-40f2-9cce-04537d0fb69e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:42.305275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c9bc5e4-bd85-40f2-9cce-04537d0fb69e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:42.312175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c9bc5e4-bd85-40f2-9cce-04537d0fb69e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:42.314803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c9bc5e4-bd85-40f2-9cce-04537d0fb69e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:42.321827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c9bc5e4-bd85-40f2-9cce-04537d0fb69e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:42.326882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c9bc5e4-bd85-40f2-9cce-04537d0fb69e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:42.327629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c9bc5e4-bd85-40f2-9cce-04537d0fb69e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:42.934388 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-09a66afe-2fc7-481b-8333-ca6024cbac17 tempest-MigrationsAdminTest-1217011000 tempest-MigrationsAdminTest-1217011000-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1612 microversion: 2.1 time: 1.271562 Oct 04 21:13:42.940772 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1023/2087] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:41 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1612 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:42.951962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ae571e0d-4d80-4f92-ba0c-a594b2cfd273 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f57943c73a0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:43.077102 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ae571e0d-4d80-4f92-ba0c-a594b2cfd273 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1423 microversion: 2.1 time: 0.134623 Oct 04 21:13:43.078706 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1024/2088] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:42 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1423 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:43.090950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-42fea986-1b4b-4177-aaa8-23a8525b9734 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:43.092205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-42fea986-1b4b-4177-aaa8-23a8525b9734 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: 6e14e448-c2c9-4904-823a-4febd5b537b2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:43.107217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4c9bc5e4-bd85-40f2-9cce-04537d0fb69e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:43.130146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4c9bc5e4-bd85-40f2-9cce-04537d0fb69e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:43.136182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42fea986-1b4b-4177-aaa8-23a8525b9734 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:43.136182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42fea986-1b4b-4177-aaa8-23a8525b9734 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:43.136948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4c9bc5e4-bd85-40f2-9cce-04537d0fb69e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:43.139064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42fea986-1b4b-4177-aaa8-23a8525b9734 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:43.140952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42fea986-1b4b-4177-aaa8-23a8525b9734 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:43.141671 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4c9bc5e4-bd85-40f2-9cce-04537d0fb69e tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 0.855986 Oct 04 21:13:43.143398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42fea986-1b4b-4177-aaa8-23a8525b9734 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:43.144505 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1065/2089] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:42 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:13:43.146974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42fea986-1b4b-4177-aaa8-23a8525b9734 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:43.165169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3daeb782-d37e-4ecd-9b04-fc79f3c861c5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:43.166131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3daeb782-d37e-4ecd-9b04-fc79f3c861c5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:43.185493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3daeb782-d37e-4ecd-9b04-fc79f3c861c5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:43.188850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3daeb782-d37e-4ecd-9b04-fc79f3c861c5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:43.190552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3daeb782-d37e-4ecd-9b04-fc79f3c861c5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:43.192764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3daeb782-d37e-4ecd-9b04-fc79f3c861c5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:43.193943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3daeb782-d37e-4ecd-9b04-fc79f3c861c5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:43.198965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3daeb782-d37e-4ecd-9b04-fc79f3c861c5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:43.204504 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-42fea986-1b4b-4177-aaa8-23a8525b9734 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] HTTP exception thrown: Instance 6e14e448-c2c9-4904-823a-4febd5b537b2 could not be found. Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-42fea986-1b4b-4177-aaa8-23a8525b9734 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Request method failure captured: Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 HTTP/1.1 Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKBT-XKr348wZ9WTMvXM6gFaW0uZDmbpTA5cPm3mvF7iwM1X1XqcLWWCvbMgfgLCsUBiWuE9ndMAkk1P6Mmk_UTB3LCm5YbIIJc9-Zz6g4AhEA5xGKmq5Peob5aZPnBhBXYpm3oFsT4-W53Qa_eD4upvWJGHmDwrhE7jn-Hj-m0vRUc Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 7e9215d1ae0947ce84469bed21fc05ac Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-LiveMigrationTest-1421388441 Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7e9215d1ae0947ce84469bed21fc05ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7e9215d1ae0947ce84469bed21fc05ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7e9215d1ae0947ce84469bed21fc05ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7e9215d1ae0947ce84469bed21fc05ac"}]}] Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-LiveMigrationTest-1421388441 Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 7e9215d1ae0947ce84469bed21fc05ac Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-LiveMigrationTest-1421388441 Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-LiveMigrationTest-1421388441-project Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 8bfa449eb3144332afa616cc85d9643f Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-LiveMigrationTest-1421388441-project Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 6e14e448-c2c9-4904-823a-4febd5b537b2 could not be found. Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '6e14e448-c2c9-4904-823a-4febd5b537b2'} Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e14e448-c2c9-4904-823a-4febd5b537b2 could not be found. Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e14e448-c2c9-4904-823a-4febd5b537b2 could not be found. Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:43.212694 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:43.220643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:43.220643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:43.220643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:43.220643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:43.220643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:43.220643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e14e448-c2c9-4904-823a-4febd5b537b2 could not be found. Oct 04 21:13:43.220643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:43.227762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-42fea986-1b4b-4177-aaa8-23a8525b9734 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Returning 404 to user: Instance 6e14e448-c2c9-4904-823a-4febd5b537b2 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:43.233140 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-42fea986-1b4b-4177-aaa8-23a8525b9734 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2" status: 404 len: 111 microversion: 2.1 time: 0.153099 Oct 04 21:13:43.235075 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1025/2090] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:43 2022] GET /compute/v2.1/servers/6e14e448-c2c9-4904-823a-4febd5b537b2 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:43.251186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7aa6bb8d-ca9f-407d-a653-cb6249488943 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f5794516f70>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:43.311603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3daeb782-d37e-4ecd-9b04-fc79f3c861c5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:13:43.363871 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7aa6bb8d-ca9f-407d-a653-cb6249488943 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 200 len: 1423 microversion: 2.1 time: 0.123874 Oct 04 21:13:43.365866 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1026/2091] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:43 2022] GET /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 1423 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:43.384231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1c6dd699-61ec-461a-ba62-62310edbf9ea tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:43.384231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1c6dd699-61ec-461a-ba62-62310edbf9ea tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:43.405377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c6dd699-61ec-461a-ba62-62310edbf9ea tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:43.405909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c6dd699-61ec-461a-ba62-62310edbf9ea tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:43.406361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c6dd699-61ec-461a-ba62-62310edbf9ea tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:43.419450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c6dd699-61ec-461a-ba62-62310edbf9ea tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:43.420029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c6dd699-61ec-461a-ba62-62310edbf9ea tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:43.423637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c6dd699-61ec-461a-ba62-62310edbf9ea tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:43.479916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1c6dd699-61ec-461a-ba62-62310edbf9ea tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:13:43.820484 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3daeb782-d37e-4ecd-9b04-fc79f3c861c5 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 204 len: 0 microversion: 2.1 time: 0.673630 Oct 04 21:13:43.821394 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1066/2092] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:43 2022] DELETE /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 0 bytes in 676 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:13:43.821785 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1c6dd699-61ec-461a-ba62-62310edbf9ea tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 204 len: 0 microversion: 2.1 time: 0.453458 Oct 04 21:13:43.823825 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1027/2093] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:43 2022] DELETE /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:13:43.830774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3b8648db-155b-4ff1-9e5c-09d310c444a3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:43.831480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3b8648db-155b-4ff1-9e5c-09d310c444a3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:43.833413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a9ae1946-0dd6-4ecf-8b7d-7c998e1fa410 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f578bf2e820>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:43.840484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b8648db-155b-4ff1-9e5c-09d310c444a3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:43.841274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b8648db-155b-4ff1-9e5c-09d310c444a3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:43.841903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b8648db-155b-4ff1-9e5c-09d310c444a3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:43.842822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b8648db-155b-4ff1-9e5c-09d310c444a3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:43.843810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b8648db-155b-4ff1-9e5c-09d310c444a3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:43.844450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b8648db-155b-4ff1-9e5c-09d310c444a3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:44.632606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3b8648db-155b-4ff1-9e5c-09d310c444a3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:44.642422 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3b8648db-155b-4ff1-9e5c-09d310c444a3 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1467 microversion: 2.1 time: 0.815696 Oct 04 21:13:44.643429 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1028/2094] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:43 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1467 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:13:44.661190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d7c9ac4f-41f0-47a9-a75c-faa07afbc3f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:44.662161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d7c9ac4f-41f0-47a9-a75c-faa07afbc3f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:44.672861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7c9ac4f-41f0-47a9-a75c-faa07afbc3f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:44.673497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7c9ac4f-41f0-47a9-a75c-faa07afbc3f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:44.674168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7c9ac4f-41f0-47a9-a75c-faa07afbc3f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:44.675117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7c9ac4f-41f0-47a9-a75c-faa07afbc3f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:44.675803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7c9ac4f-41f0-47a9-a75c-faa07afbc3f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:44.676456 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7c9ac4f-41f0-47a9-a75c-faa07afbc3f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:45.586828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d7c9ac4f-41f0-47a9-a75c-faa07afbc3f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:45.598993 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d7c9ac4f-41f0-47a9-a75c-faa07afbc3f8 tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1498 microversion: 2.1 time: 0.944087 Oct 04 21:13:45.603006 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1029/2095] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:44 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1498 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:45.622051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-3582ddd2-361e-42be-b84f-349a2b649760 req-7648d274-de12-4a8d-ae76-2fae23e9091d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0dbeb11-0fb1-48ab-aa70-d33e03b8093d", "name": "network-vif-plugged", "status": "completed", "tag": "622d2354-1aa7-4c56-9968-1dc840e8b049"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:45.635627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3582ddd2-361e-42be-b84f-349a2b649760 req-7648d274-de12-4a8d-ae76-2fae23e9091d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:45.642166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3582ddd2-361e-42be-b84f-349a2b649760 req-7648d274-de12-4a8d-ae76-2fae23e9091d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:45.642892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3582ddd2-361e-42be-b84f-349a2b649760 req-7648d274-de12-4a8d-ae76-2fae23e9091d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:45.686103 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-3582ddd2-361e-42be-b84f-349a2b649760 req-7648d274-de12-4a8d-ae76-2fae23e9091d service nova] Creating event network-vif-plugged:622d2354-1aa7-4c56-9968-1dc840e8b049 for instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d on n-h2-860282-1 Oct 04 21:13:45.700864 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-3582ddd2-361e-42be-b84f-349a2b649760 req-7648d274-de12-4a8d-ae76-2fae23e9091d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093996 Oct 04 21:13:45.702576 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1030/2096] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:45.709711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e8ec83b1-90a0-4d26-a1bb-30fa7a7da134 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:45.719696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e8ec83b1-90a0-4d26-a1bb-30fa7a7da134 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:45.741313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8ec83b1-90a0-4d26-a1bb-30fa7a7da134 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:45.743201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8ec83b1-90a0-4d26-a1bb-30fa7a7da134 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:45.753610 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a9ae1946-0dd6-4ecf-8b7d-7c998e1fa410 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "DELETE /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 204 len: 0 microversion: 2.1 time: 1.929694 Oct 04 21:13:45.757736 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1067/2097] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:43 2022] DELETE /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 0 bytes in 1932 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:13:45.764153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8ec83b1-90a0-4d26-a1bb-30fa7a7da134 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:45.765496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8ec83b1-90a0-4d26-a1bb-30fa7a7da134 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:45.766186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8ec83b1-90a0-4d26-a1bb-30fa7a7da134 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:45.766849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c8ed1389-c568-4acf-bb6b-94140936dcbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:45.767458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c8ed1389-c568-4acf-bb6b-94140936dcbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:45.768352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8ec83b1-90a0-4d26-a1bb-30fa7a7da134 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:45.796662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8ed1389-c568-4acf-bb6b-94140936dcbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:45.797228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8ed1389-c568-4acf-bb6b-94140936dcbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:45.797711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8ed1389-c568-4acf-bb6b-94140936dcbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:45.800221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8ed1389-c568-4acf-bb6b-94140936dcbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:45.800732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8ed1389-c568-4acf-bb6b-94140936dcbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:45.801189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8ed1389-c568-4acf-bb6b-94140936dcbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:46.801129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c8ed1389-c568-4acf-bb6b-94140936dcbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:46.812403 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c8ed1389-c568-4acf-bb6b-94140936dcbe tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1467 microversion: 2.1 time: 1.053320 Oct 04 21:13:46.816681 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1068/2098] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:45 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1467 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:46.823611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6756c15d-414d-4bc3-8392-463d722b11e0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:46.825081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6756c15d-414d-4bc3-8392-463d722b11e0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:46.830757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6756c15d-414d-4bc3-8392-463d722b11e0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:46.831458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6756c15d-414d-4bc3-8392-463d722b11e0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:46.835386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6756c15d-414d-4bc3-8392-463d722b11e0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:46.836478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6756c15d-414d-4bc3-8392-463d722b11e0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:46.837646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6756c15d-414d-4bc3-8392-463d722b11e0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:46.841581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6756c15d-414d-4bc3-8392-463d722b11e0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:46.883587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6756c15d-414d-4bc3-8392-463d722b11e0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:13:46.959486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e8ec83b1-90a0-4d26-a1bb-30fa7a7da134 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:46.972803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e8ec83b1-90a0-4d26-a1bb-30fa7a7da134 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:46.978186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e8ec83b1-90a0-4d26-a1bb-30fa7a7da134 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:46.981842 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e8ec83b1-90a0-4d26-a1bb-30fa7a7da134 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 1.277666 Oct 04 21:13:46.997473 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1031/2099] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:45 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:47.007889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3bc970b7-d77e-4b2f-a37d-638962fc92ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:47.007889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3bc970b7-d77e-4b2f-a37d-638962fc92ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:47.009304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bc970b7-d77e-4b2f-a37d-638962fc92ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:47.010010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bc970b7-d77e-4b2f-a37d-638962fc92ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:47.010977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bc970b7-d77e-4b2f-a37d-638962fc92ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:47.011865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bc970b7-d77e-4b2f-a37d-638962fc92ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:47.012530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bc970b7-d77e-4b2f-a37d-638962fc92ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:47.013106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bc970b7-d77e-4b2f-a37d-638962fc92ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:47.223482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3bc970b7-d77e-4b2f-a37d-638962fc92ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfa449eb3144332afa616cc85d9643f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9215d1ae0947ce84469bed21fc05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:47.253972 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3bc970b7-d77e-4b2f-a37d-638962fc92ae tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 200 len: 1456 microversion: 2.1 time: 0.262617 Oct 04 21:13:47.283785 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1032/2100] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:46 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 1456 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:47.283917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:47.290148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-7d076397-5169-4c13-aabc-33b024f0623d req-51d67c62-0eb3-4db3-9bc1-cbccae9f2aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee48d230-2152-48c0-b95f-29a55787f7a4", "name": "network-vif-deleted", "tag": "a4684f8a-e6a9-4608-b21b-3aaef38405be"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:47.310395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7d076397-5169-4c13-aabc-33b024f0623d req-51d67c62-0eb3-4db3-9bc1-cbccae9f2aa3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:47.310889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7d076397-5169-4c13-aabc-33b024f0623d req-51d67c62-0eb3-4db3-9bc1-cbccae9f2aa3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:47.311326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7d076397-5169-4c13-aabc-33b024f0623d req-51d67c62-0eb3-4db3-9bc1-cbccae9f2aa3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:47.357994 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-7d076397-5169-4c13-aabc-33b024f0623d req-51d67c62-0eb3-4db3-9bc1-cbccae9f2aa3 service nova] Creating event network-vif-deleted:a4684f8a-e6a9-4608-b21b-3aaef38405be for instance ee48d230-2152-48c0-b95f-29a55787f7a4 on n-h2-860282-1 Oct 04 21:13:47.367898 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-7d076397-5169-4c13-aabc-33b024f0623d req-51d67c62-0eb3-4db3-9bc1-cbccae9f2aa3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082802 Oct 04 21:13:47.370491 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1033/2101] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:47.424790 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6756c15d-414d-4bc3-8392-463d722b11e0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 204 len: 0 microversion: 2.1 time: 0.604159 Oct 04 21:13:47.429299 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1069/2102] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:46 2022] DELETE /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:13:47.670881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2523ecd9-b078-421d-bbf4-da54ef844f29 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2036473594", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "355d2dfa-09cc-435f-842a-7fc0ed5ae634"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:47.843000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c176966d-6857-43d8-97e4-bf079d28242c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:47.851051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c176966d-6857-43d8-97e4-bf079d28242c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:47.868906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-2523ecd9-b078-421d-bbf4-da54ef844f29 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] validate_networks() for [('355d2dfa-09cc-435f-842a-7fc0ed5ae634', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:13:47.879735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c176966d-6857-43d8-97e4-bf079d28242c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:47.882094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c176966d-6857-43d8-97e4-bf079d28242c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:47.883007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c176966d-6857-43d8-97e4-bf079d28242c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:47.887332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c176966d-6857-43d8-97e4-bf079d28242c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:47.890347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c176966d-6857-43d8-97e4-bf079d28242c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:47.893992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c176966d-6857-43d8-97e4-bf079d28242c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:48.721531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c176966d-6857-43d8-97e4-bf079d28242c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:48.736931 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c176966d-6857-43d8-97e4-bf079d28242c tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1425 microversion: 2.1 time: 0.900834 Oct 04 21:13:48.763858 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1070/2103] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:47 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1425 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:13:48.769175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aefc6b32-0323-492d-be6f-e0d51ac472e4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:48.770116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aefc6b32-0323-492d-be6f-e0d51ac472e4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:48.793293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aefc6b32-0323-492d-be6f-e0d51ac472e4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:48.795572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aefc6b32-0323-492d-be6f-e0d51ac472e4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:48.796263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aefc6b32-0323-492d-be6f-e0d51ac472e4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:48.800140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aefc6b32-0323-492d-be6f-e0d51ac472e4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:48.800907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aefc6b32-0323-492d-be6f-e0d51ac472e4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:48.803140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aefc6b32-0323-492d-be6f-e0d51ac472e4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:49.902145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aefc6b32-0323-492d-be6f-e0d51ac472e4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:49.922021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aefc6b32-0323-492d-be6f-e0d51ac472e4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:49.926748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aefc6b32-0323-492d-be6f-e0d51ac472e4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:49.929863 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aefc6b32-0323-492d-be6f-e0d51ac472e4 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1486 microversion: 2.25 time: 1.163636 Oct 04 21:13:49.930539 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1071/2104] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:48 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1486 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:49.937383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-66b5709c-ee7e-466c-b71e-b9114d459d1e req-1b1c3afd-d577-4d49-952e-8ecc904b6a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2babc3b5-0147-43b1-8f42-8a536a46ddce", "name": "network-vif-unplugged", "status": "completed", "tag": "766e621d-fb6f-4386-b54e-a70fe38c5ba4"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:49.967749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-66b5709c-ee7e-466c-b71e-b9114d459d1e req-1b1c3afd-d577-4d49-952e-8ecc904b6a1d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:49.967749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-66b5709c-ee7e-466c-b71e-b9114d459d1e req-1b1c3afd-d577-4d49-952e-8ecc904b6a1d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:49.967749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-66b5709c-ee7e-466c-b71e-b9114d459d1e req-1b1c3afd-d577-4d49-952e-8ecc904b6a1d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:49.975163 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-66b5709c-ee7e-466c-b71e-b9114d459d1e req-1b1c3afd-d577-4d49-952e-8ecc904b6a1d service nova] Creating event network-vif-unplugged:766e621d-fb6f-4386-b54e-a70fe38c5ba4 for instance 2babc3b5-0147-43b1-8f42-8a536a46ddce on n-h1-860282-1 Oct 04 21:13:49.981854 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-66b5709c-ee7e-466c-b71e-b9114d459d1e req-1b1c3afd-d577-4d49-952e-8ecc904b6a1d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048823 Oct 04 21:13:49.987091 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1072/2105] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:49.989379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5c949d23-12c2-48f9-874f-663688b78c0f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:49.990115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5c949d23-12c2-48f9-874f-663688b78c0f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] [instance: ee48d230-2152-48c0-b95f-29a55787f7a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:49.997118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c949d23-12c2-48f9-874f-663688b78c0f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:49.997930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c949d23-12c2-48f9-874f-663688b78c0f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:49.998696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c949d23-12c2-48f9-874f-663688b78c0f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:49.999626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c949d23-12c2-48f9-874f-663688b78c0f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:50.000247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c949d23-12c2-48f9-874f-663688b78c0f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:50.000852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c949d23-12c2-48f9-874f-663688b78c0f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:50.018684 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-5c949d23-12c2-48f9-874f-663688b78c0f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] HTTP exception thrown: Instance ee48d230-2152-48c0-b95f-29a55787f7a4 could not be found. Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5c949d23-12c2-48f9-874f-663688b78c0f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Request method failure captured: Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 HTTP/1.1 Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKBT-XKr348wZ9WTMvXM6gFaW0uZDmbpTA5cPm3mvF7iwM1X1XqcLWWCvbMgfgLCsUBiWuE9ndMAkk1P6Mmk_UTB3LCm5YbIIJc9-Zz6g4AhEA5xGKmq5Peob5aZPnBhBXYpm3oFsT4-W53Qa_eD4upvWJGHmDwrhE7jn-Hj-m0vRUc Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7e9215d1ae0947ce84469bed21fc05ac Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-LiveMigrationTest-1421388441 Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7e9215d1ae0947ce84469bed21fc05ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7e9215d1ae0947ce84469bed21fc05ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7e9215d1ae0947ce84469bed21fc05ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7e9215d1ae0947ce84469bed21fc05ac"}]}] Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-LiveMigrationTest-1421388441 Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7e9215d1ae0947ce84469bed21fc05ac Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-LiveMigrationTest-1421388441 Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-LiveMigrationTest-1421388441-project Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 8bfa449eb3144332afa616cc85d9643f Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-LiveMigrationTest-1421388441-project Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance ee48d230-2152-48c0-b95f-29a55787f7a4 could not be found. Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'ee48d230-2152-48c0-b95f-29a55787f7a4'} Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee48d230-2152-48c0-b95f-29a55787f7a4 could not be found. Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee48d230-2152-48c0-b95f-29a55787f7a4 could not be found. Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:50.020590 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:50.026537 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:50.026537 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:50.026537 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:50.026537 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:50.026537 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:50.026537 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee48d230-2152-48c0-b95f-29a55787f7a4 could not be found. Oct 04 21:13:50.026537 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:13:50.028626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5c949d23-12c2-48f9-874f-663688b78c0f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] Returning 404 to user: Instance ee48d230-2152-48c0-b95f-29a55787f7a4 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:50.029723 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5c949d23-12c2-48f9-874f-663688b78c0f tempest-LiveMigrationTest-1421388441 tempest-LiveMigrationTest-1421388441-project] 10.222.0.30 "GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4" status: 404 len: 111 microversion: 2.1 time: 0.045408 Oct 04 21:13:50.031159 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1073/2106] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:49 2022] GET /compute/v2.1/servers/ee48d230-2152-48c0-b95f-29a55787f7a4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:50.036492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-f3ca62f3-773b-4e04-b0dc-4a90fe8f51c1 req-7f07e802-f6c8-4ed3-a715-b183f58b5a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0dbeb11-0fb1-48ab-aa70-d33e03b8093d", "name": "network-vif-deleted", "tag": "622d2354-1aa7-4c56-9968-1dc840e8b049"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:50.047795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f3ca62f3-773b-4e04-b0dc-4a90fe8f51c1 req-7f07e802-f6c8-4ed3-a715-b183f58b5a34 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:50.048582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f3ca62f3-773b-4e04-b0dc-4a90fe8f51c1 req-7f07e802-f6c8-4ed3-a715-b183f58b5a34 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:50.049339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f3ca62f3-773b-4e04-b0dc-4a90fe8f51c1 req-7f07e802-f6c8-4ed3-a715-b183f58b5a34 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:50.069730 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-f3ca62f3-773b-4e04-b0dc-4a90fe8f51c1 req-7f07e802-f6c8-4ed3-a715-b183f58b5a34 service nova] Creating event network-vif-deleted:622d2354-1aa7-4c56-9968-1dc840e8b049 for instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d on n-h2-860282-1 Oct 04 21:13:50.075479 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-f3ca62f3-773b-4e04-b0dc-4a90fe8f51c1 req-7f07e802-f6c8-4ed3-a715-b183f58b5a34 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042876 Oct 04 21:13:50.076735 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1074/2107] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:50.083571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e5ab6059-9ad2-4e95-9aae-d8a6a76c4c47 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:50.084490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e5ab6059-9ad2-4e95-9aae-d8a6a76c4c47 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:50.097821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5ab6059-9ad2-4e95-9aae-d8a6a76c4c47 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:50.097821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5ab6059-9ad2-4e95-9aae-d8a6a76c4c47 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:50.097821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5ab6059-9ad2-4e95-9aae-d8a6a76c4c47 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:50.097821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5ab6059-9ad2-4e95-9aae-d8a6a76c4c47 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:50.097821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5ab6059-9ad2-4e95-9aae-d8a6a76c4c47 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:50.097821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5ab6059-9ad2-4e95-9aae-d8a6a76c4c47 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:50.156613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5ab6059-9ad2-4e95-9aae-d8a6a76c4c47 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:50.157593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5ab6059-9ad2-4e95-9aae-d8a6a76c4c47 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:50.158279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5ab6059-9ad2-4e95-9aae-d8a6a76c4c47 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:50.159594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-e5ab6059-9ad2-4e95-9aae-d8a6a76c4c47 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lazy-loading 'fault' on Instance uuid b0dbeb11-0fb1-48ab-aa70-d33e03b8093d {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:13:50.265773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e5ab6059-9ad2-4e95-9aae-d8a6a76c4c47 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:50.287045 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e5ab6059-9ad2-4e95-9aae-d8a6a76c4c47 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 200 len: 1302 microversion: 2.1 time: 0.208776 Oct 04 21:13:50.288531 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1075/2108] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:50 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 1302 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:50.484584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7949a1a3-e08a-45a1-8cb1-1b61b557cbf2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-996622582", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "f139de82-6406-4971-977c-f3b58c06989a"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:50.580178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-7949a1a3-e08a-45a1-8cb1-1b61b557cbf2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] validate_networks() for [('f139de82-6406-4971-977c-f3b58c06989a', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:13:50.900296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-2523ecd9-b078-421d-bbf4-da54ef844f29 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:13:50.901642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-2523ecd9-b078-421d-bbf4-da54ef844f29 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:13:50.902058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-2523ecd9-b078-421d-bbf4-da54ef844f29 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:13:50.902481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-2523ecd9-b078-421d-bbf4-da54ef844f29 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:13:50.902915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-2523ecd9-b078-421d-bbf4-da54ef844f29 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:13:50.917033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2523ecd9-b078-421d-bbf4-da54ef844f29 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:50.917984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2523ecd9-b078-421d-bbf4-da54ef844f29 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:50.918633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2523ecd9-b078-421d-bbf4-da54ef844f29 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:50.919580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2523ecd9-b078-421d-bbf4-da54ef844f29 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:50.920260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2523ecd9-b078-421d-bbf4-da54ef844f29 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:50.920977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2523ecd9-b078-421d-bbf4-da54ef844f29 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:50.950426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-2523ecd9-b078-421d-bbf4-da54ef844f29 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Getting quotas for project 7462c68015654227a11892e2a2659ecb. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:13:50.956559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-2523ecd9-b078-421d-bbf4-da54ef844f29 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Getting quotas for user c199a13dceec4ae9bd873529c864146e and project 7462c68015654227a11892e2a2659ecb. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:13:50.973341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2523ecd9-b078-421d-bbf4-da54ef844f29 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:13:50.977747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2523ecd9-b078-421d-bbf4-da54ef844f29 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:13:51.207071 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2523ecd9-b078-421d-bbf4-da54ef844f29 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.541688 Oct 04 21:13:51.212046 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1034/2109] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:13:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:13:51.232458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-10f5064f-b89c-4f64-ab15-8576ce303876 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:51.234565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-10f5064f-b89c-4f64-ab15-8576ce303876 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:51.305515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10f5064f-b89c-4f64-ab15-8576ce303876 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:51.305515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10f5064f-b89c-4f64-ab15-8576ce303876 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:51.308771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10f5064f-b89c-4f64-ab15-8576ce303876 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:51.313904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10f5064f-b89c-4f64-ab15-8576ce303876 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:51.317627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10f5064f-b89c-4f64-ab15-8576ce303876 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:51.319148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10f5064f-b89c-4f64-ab15-8576ce303876 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:52.601481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-10f5064f-b89c-4f64-ab15-8576ce303876 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:52.610768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-10f5064f-b89c-4f64-ab15-8576ce303876 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:52.623677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-10f5064f-b89c-4f64-ab15-8576ce303876 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:52.625219 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-10f5064f-b89c-4f64-ab15-8576ce303876 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1476 microversion: 2.25 time: 1.411608 Oct 04 21:13:52.626698 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1035/2110] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:51 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1476 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:52.633341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-efaff98c-760c-491c-ac2c-ea7de0a055d4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:52.634459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-efaff98c-760c-491c-ac2c-ea7de0a055d4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:53.050709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-efaff98c-760c-491c-ac2c-ea7de0a055d4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:53.069480 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-efaff98c-760c-491c-ac2c-ea7de0a055d4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1" status: 200 len: 1208 microversion: 2.1 time: 0.440117 Oct 04 21:13:53.071247 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1036/2111] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:52 2022] GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 => generated 1208 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:53.080202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9a6557e6-7edd-4459-87c0-977c1eed6123 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:53.081783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9a6557e6-7edd-4459-87c0-977c1eed6123 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: b0dbeb11-0fb1-48ab-aa70-d33e03b8093d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:53.092058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a6557e6-7edd-4459-87c0-977c1eed6123 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:53.092927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a6557e6-7edd-4459-87c0-977c1eed6123 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:53.094440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a6557e6-7edd-4459-87c0-977c1eed6123 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:53.095730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a6557e6-7edd-4459-87c0-977c1eed6123 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:53.096442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a6557e6-7edd-4459-87c0-977c1eed6123 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:53.097274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a6557e6-7edd-4459-87c0-977c1eed6123 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:53.131210 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-9a6557e6-7edd-4459-87c0-977c1eed6123 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] HTTP exception thrown: Instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d could not be found. Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9a6557e6-7edd-4459-87c0-977c1eed6123 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Request method failure captured: Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d HTTP/1.1 Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKCf9yyiZcOfG9wQE0mXchm3gM3-BLdAV2E2Cw3KmIPseB95kyUMu6izjk2Fb9-RRhkDo6uP2yfcEbbrXpfB_CIjQnCxYhyIF4Yce2NxHKLTleC43S5lJT37GbbbePFy6Ka5tkxDhTA1nO10dZHm8WGVjoen21KqHv-DqAIkeAsxY6o Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: e11e3d4d14b240a3b934701459ada871 Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-MigrationsAdminTest-1715070443 Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e11e3d4d14b240a3b934701459ada871"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e11e3d4d14b240a3b934701459ada871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e11e3d4d14b240a3b934701459ada871"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e11e3d4d14b240a3b934701459ada871"}]}] Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-MigrationsAdminTest-1715070443 Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: e11e3d4d14b240a3b934701459ada871 Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-MigrationsAdminTest-1715070443 Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-MigrationsAdminTest-1715070443-project Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 150625a9472d43e0b0509ef044c58d34 Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-MigrationsAdminTest-1715070443-project Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d could not be found. Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'b0dbeb11-0fb1-48ab-aa70-d33e03b8093d'} Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d could not be found. Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d could not be found. Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:53.138278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:53.146482 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:53.146482 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:53.146482 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:53.146482 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:53.146482 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:53.146482 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d could not be found. Oct 04 21:13:53.146482 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:13:53.146482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9a6557e6-7edd-4459-87c0-977c1eed6123 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Returning 404 to user: Instance b0dbeb11-0fb1-48ab-aa70-d33e03b8093d could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:53.148725 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9a6557e6-7edd-4459-87c0-977c1eed6123 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d" status: 404 len: 111 microversion: 2.1 time: 0.074527 Oct 04 21:13:53.152230 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1037/2112] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:53 2022] GET /compute/v2.1/servers/b0dbeb11-0fb1-48ab-aa70-d33e03b8093d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:53.165643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-02db0b9d-dbf5-4a64-bc04-595d3ef4fe39 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '.version_select at 0x7f57943f7940>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:53.170210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02db0b9d-dbf5-4a64-bc04-595d3ef4fe39 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:53.170718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02db0b9d-dbf5-4a64-bc04-595d3ef4fe39 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:53.172455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02db0b9d-dbf5-4a64-bc04-595d3ef4fe39 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:53.189348 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-02db0b9d-dbf5-4a64-bc04-595d3ef4fe39 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 2962 microversion: 2.25 time: 0.033934 Oct 04 21:13:53.190396 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1038/2113] 10.222.0.30 () {60 vars in 1184 bytes} [Tue Oct 4 21:13:53 2022] GET /compute/v2.1/os-migrations => generated 2962 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:53.198671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-19a77546-9aab-4de2-885f-afac97b76a39 req-c0e4c10f-faec-41c1-8ab5-1fc1a031d6b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2babc3b5-0147-43b1-8f42-8a536a46ddce", "name": "network-vif-deleted", "tag": "766e621d-fb6f-4386-b54e-a70fe38c5ba4"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:53.225405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-19a77546-9aab-4de2-885f-afac97b76a39 req-c0e4c10f-faec-41c1-8ab5-1fc1a031d6b3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:53.225995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-19a77546-9aab-4de2-885f-afac97b76a39 req-c0e4c10f-faec-41c1-8ab5-1fc1a031d6b3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:53.226449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-19a77546-9aab-4de2-885f-afac97b76a39 req-c0e4c10f-faec-41c1-8ab5-1fc1a031d6b3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:53.242944 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-19a77546-9aab-4de2-885f-afac97b76a39 req-c0e4c10f-faec-41c1-8ab5-1fc1a031d6b3 service nova] Creating event network-vif-deleted:766e621d-fb6f-4386-b54e-a70fe38c5ba4 for instance 2babc3b5-0147-43b1-8f42-8a536a46ddce on n-h1-860282-1 Oct 04 21:13:53.253394 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-19a77546-9aab-4de2-885f-afac97b76a39 req-c0e4c10f-faec-41c1-8ab5-1fc1a031d6b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060838 Oct 04 21:13:53.254586 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1039/2114] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:53.266872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-85749d3c-ff3c-443a-8d1b-1f5b6ed0a891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:53.267862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-85749d3c-ff3c-443a-8d1b-1f5b6ed0a891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:53.279242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-85749d3c-ff3c-443a-8d1b-1f5b6ed0a891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:53.280090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-85749d3c-ff3c-443a-8d1b-1f5b6ed0a891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:53.281307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-85749d3c-ff3c-443a-8d1b-1f5b6ed0a891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:53.282728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-85749d3c-ff3c-443a-8d1b-1f5b6ed0a891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:53.283575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-85749d3c-ff3c-443a-8d1b-1f5b6ed0a891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:53.284241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-85749d3c-ff3c-443a-8d1b-1f5b6ed0a891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:53.347316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-85749d3c-ff3c-443a-8d1b-1f5b6ed0a891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:13:53.510208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7949a1a3-e08a-45a1-8cb1-1b61b557cbf2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:13:53.511316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7949a1a3-e08a-45a1-8cb1-1b61b557cbf2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:13:53.511978 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7949a1a3-e08a-45a1-8cb1-1b61b557cbf2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:13:53.512569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7949a1a3-e08a-45a1-8cb1-1b61b557cbf2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:13:53.513165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7949a1a3-e08a-45a1-8cb1-1b61b557cbf2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:13:53.540147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7949a1a3-e08a-45a1-8cb1-1b61b557cbf2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:53.540696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7949a1a3-e08a-45a1-8cb1-1b61b557cbf2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:53.541901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7949a1a3-e08a-45a1-8cb1-1b61b557cbf2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:53.542941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7949a1a3-e08a-45a1-8cb1-1b61b557cbf2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:53.543607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7949a1a3-e08a-45a1-8cb1-1b61b557cbf2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:53.544221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7949a1a3-e08a-45a1-8cb1-1b61b557cbf2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:53.597967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7949a1a3-e08a-45a1-8cb1-1b61b557cbf2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Getting quotas for project b2a3f169c94b49c097ef061ac48e52a7. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:13:53.608295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7949a1a3-e08a-45a1-8cb1-1b61b557cbf2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Getting quotas for user 8630706184384900b96e774385ec420b and project b2a3f169c94b49c097ef061ac48e52a7. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:13:53.634725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7949a1a3-e08a-45a1-8cb1-1b61b557cbf2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:13:53.637569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7949a1a3-e08a-45a1-8cb1-1b61b557cbf2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:13:53.805397 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-85749d3c-ff3c-443a-8d1b-1f5b6ed0a891 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "DELETE /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 204 len: 0 microversion: 2.1 time: 0.546688 Oct 04 21:13:53.808270 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1040/2115] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:53 2022] DELETE /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:13:53.819403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1877640b-6f26-4d5b-b401-6b8581927ab8 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:53.821240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1877640b-6f26-4d5b-b401-6b8581927ab8 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:53.859911 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7949a1a3-e08a-45a1-8cb1-1b61b557cbf2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.569881 Oct 04 21:13:53.862591 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1076/2116] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:13:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:13:53.872711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1877640b-6f26-4d5b-b401-6b8581927ab8 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:53.878662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1877640b-6f26-4d5b-b401-6b8581927ab8 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:53.880762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1877640b-6f26-4d5b-b401-6b8581927ab8 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:53.892871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0a75a8ea-fb13-4374-a15d-a805791b0192 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:53.892871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0a75a8ea-fb13-4374-a15d-a805791b0192 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:53.893161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1877640b-6f26-4d5b-b401-6b8581927ab8 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:53.893161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1877640b-6f26-4d5b-b401-6b8581927ab8 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:53.898098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1877640b-6f26-4d5b-b401-6b8581927ab8 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:53.907980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a75a8ea-fb13-4374-a15d-a805791b0192 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:53.908489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a75a8ea-fb13-4374-a15d-a805791b0192 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:53.908938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a75a8ea-fb13-4374-a15d-a805791b0192 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:53.916274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a75a8ea-fb13-4374-a15d-a805791b0192 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:53.916274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a75a8ea-fb13-4374-a15d-a805791b0192 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:53.916274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a75a8ea-fb13-4374-a15d-a805791b0192 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:54.450814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0a75a8ea-fb13-4374-a15d-a805791b0192 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:54.459878 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0a75a8ea-fb13-4374-a15d-a805791b0192 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1533 microversion: 2.1 time: 0.594386 Oct 04 21:13:54.460568 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1077/2117] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:53 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1533 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:54.469462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-476c0156-6908-4b53-9f32-d7737edb151d tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:54.470079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-476c0156-6908-4b53-9f32-d7737edb151d tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:54.497013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-1877640b-6f26-4d5b-b401-6b8581927ab8 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] Lazy-loading 'services' on Instance uuid 4c86d6b4-12a8-464a-84d7-2d6454aee597 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:13:54.560831 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1877640b-6f26-4d5b-b401-6b8581927ab8 tempest-LiveAutoBlockMigrationV225Test-218412154 tempest-LiveAutoBlockMigrationV225Test-218412154-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1968 microversion: 2.25 time: 0.750577 Oct 04 21:13:54.565658 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1041/2118] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:53 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1968 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:54.601230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-767d453f-c39e-4a6e-847c-aa1f17e4cd17 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:54.602190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-767d453f-c39e-4a6e-847c-aa1f17e4cd17 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:54.616849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-767d453f-c39e-4a6e-847c-aa1f17e4cd17 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:54.616849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-767d453f-c39e-4a6e-847c-aa1f17e4cd17 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:54.616849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-767d453f-c39e-4a6e-847c-aa1f17e4cd17 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:54.616849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-767d453f-c39e-4a6e-847c-aa1f17e4cd17 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:54.616849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-767d453f-c39e-4a6e-847c-aa1f17e4cd17 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:54.616849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-767d453f-c39e-4a6e-847c-aa1f17e4cd17 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:54.715143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-476c0156-6908-4b53-9f32-d7737edb151d tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8630706184384900b96e774385ec420b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a3f169c94b49c097ef061ac48e52a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:54.722713 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-476c0156-6908-4b53-9f32-d7737edb151d tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 200 len: 1227 microversion: 2.1 time: 0.257071 Oct 04 21:13:54.731692 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1078/2119] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:54 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 1227 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:54.736748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ec2d84c3-7ba9-410c-be54-65d6e10a5f2f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:54.745347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ec2d84c3-7ba9-410c-be54-65d6e10a5f2f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:54.771954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec2d84c3-7ba9-410c-be54-65d6e10a5f2f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:54.774544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec2d84c3-7ba9-410c-be54-65d6e10a5f2f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:54.774544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec2d84c3-7ba9-410c-be54-65d6e10a5f2f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:54.774544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec2d84c3-7ba9-410c-be54-65d6e10a5f2f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:54.774544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec2d84c3-7ba9-410c-be54-65d6e10a5f2f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:54.775439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec2d84c3-7ba9-410c-be54-65d6e10a5f2f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:54.817969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ec2d84c3-7ba9-410c-be54-65d6e10a5f2f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:13:54.864621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:54.902351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-767d453f-c39e-4a6e-847c-aa1f17e4cd17 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:54.906505 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-767d453f-c39e-4a6e-847c-aa1f17e4cd17 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1" status: 200 len: 1260 microversion: 2.1 time: 0.335762 Oct 04 21:13:54.907092 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1042/2120] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:54 2022] GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 => generated 1260 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:55.322403 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ec2d84c3-7ba9-410c-be54-65d6e10a5f2f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 204 len: 0 microversion: 2.25 time: 0.589178 Oct 04 21:13:55.332795 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1079/2121] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:13:54 2022] DELETE /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:13:55.341218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c3b90984-9881-4487-bb80-376c26b1d16d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:55.341952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c3b90984-9881-4487-bb80-376c26b1d16d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:55.352096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3b90984-9881-4487-bb80-376c26b1d16d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:55.352584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3b90984-9881-4487-bb80-376c26b1d16d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:55.353090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3b90984-9881-4487-bb80-376c26b1d16d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:55.354457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3b90984-9881-4487-bb80-376c26b1d16d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:55.354915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3b90984-9881-4487-bb80-376c26b1d16d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:55.355343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3b90984-9881-4487-bb80-376c26b1d16d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:55.368558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:55.485791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-442a38b3-a943-4149-ac1e-c0d8938aac9a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:55.486810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-442a38b3-a943-4149-ac1e-c0d8938aac9a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:55.493614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-442a38b3-a943-4149-ac1e-c0d8938aac9a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:55.504421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-442a38b3-a943-4149-ac1e-c0d8938aac9a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:55.504421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-442a38b3-a943-4149-ac1e-c0d8938aac9a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:55.504421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-442a38b3-a943-4149-ac1e-c0d8938aac9a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:55.504421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-442a38b3-a943-4149-ac1e-c0d8938aac9a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:55.504421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-442a38b3-a943-4149-ac1e-c0d8938aac9a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:55.578754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c3b90984-9881-4487-bb80-376c26b1d16d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:55.616351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c3b90984-9881-4487-bb80-376c26b1d16d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:55.619497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c3b90984-9881-4487-bb80-376c26b1d16d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:55.621580 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c3b90984-9881-4487-bb80-376c26b1d16d tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1482 microversion: 2.25 time: 0.285525 Oct 04 21:13:55.653979 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1043/2122] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:55 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1482 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:55.754838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aec31dd2-df08-46ca-8ea4-16558e3425ca tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:55.756695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-aec31dd2-df08-46ca-8ea4-16558e3425ca tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:55.909545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-442a38b3-a943-4149-ac1e-c0d8938aac9a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:55.919213 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-442a38b3-a943-4149-ac1e-c0d8938aac9a tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1533 microversion: 2.1 time: 0.437766 Oct 04 21:13:55.943204 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1080/2123] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:55 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1533 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:55.956863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0c396066-8cd3-4515-a234-a1e5ab773e2e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:55.965587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-aec31dd2-df08-46ca-8ea4-16558e3425ca tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8630706184384900b96e774385ec420b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a3f169c94b49c097ef061ac48e52a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:55.980033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0c396066-8cd3-4515-a234-a1e5ab773e2e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:55.993017 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-aec31dd2-df08-46ca-8ea4-16558e3425ca tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 200 len: 1227 microversion: 2.1 time: 0.237707 Oct 04 21:13:55.993017 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1044/2124] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:55 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 1227 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:56.023102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c396066-8cd3-4515-a234-a1e5ab773e2e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:56.025605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c396066-8cd3-4515-a234-a1e5ab773e2e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:56.030055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c396066-8cd3-4515-a234-a1e5ab773e2e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:56.039844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c396066-8cd3-4515-a234-a1e5ab773e2e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:56.040602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c396066-8cd3-4515-a234-a1e5ab773e2e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:56.041404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c396066-8cd3-4515-a234-a1e5ab773e2e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:56.343967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0c396066-8cd3-4515-a234-a1e5ab773e2e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:56.354736 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0c396066-8cd3-4515-a234-a1e5ab773e2e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1" status: 200 len: 1260 microversion: 2.1 time: 0.409156 Oct 04 21:13:56.354736 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1081/2125] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:55 2022] GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 => generated 1260 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:56.660985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0bc892e7-7b49-40b5-8f5e-174f6a6eaacf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:56.660985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0bc892e7-7b49-40b5-8f5e-174f6a6eaacf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:56.665875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bc892e7-7b49-40b5-8f5e-174f6a6eaacf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:56.666959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bc892e7-7b49-40b5-8f5e-174f6a6eaacf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:56.667409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bc892e7-7b49-40b5-8f5e-174f6a6eaacf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:56.668121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bc892e7-7b49-40b5-8f5e-174f6a6eaacf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:56.668590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bc892e7-7b49-40b5-8f5e-174f6a6eaacf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:56.669021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bc892e7-7b49-40b5-8f5e-174f6a6eaacf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:56.955661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-67147346-7a67-4f9c-9939-d44af52b1515 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:56.956286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-67147346-7a67-4f9c-9939-d44af52b1515 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:56.978270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67147346-7a67-4f9c-9939-d44af52b1515 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:56.978834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67147346-7a67-4f9c-9939-d44af52b1515 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:56.979287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67147346-7a67-4f9c-9939-d44af52b1515 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:56.987536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67147346-7a67-4f9c-9939-d44af52b1515 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:56.988098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67147346-7a67-4f9c-9939-d44af52b1515 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:56.988530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67147346-7a67-4f9c-9939-d44af52b1515 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:57.995333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67147346-7a67-4f9c-9939-d44af52b1515 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:58.010417 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-67147346-7a67-4f9c-9939-d44af52b1515 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1491 microversion: 2.1 time: 1.058244 Oct 04 21:13:58.011238 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1082/2126] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:56 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1491 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:13:58.039594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-090081c9-9288-4617-b157-782c7b7d15f9 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:58.047908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-090081c9-9288-4617-b157-782c7b7d15f9 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:58.061170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-090081c9-9288-4617-b157-782c7b7d15f9 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:58.062034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-090081c9-9288-4617-b157-782c7b7d15f9 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:58.063586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-090081c9-9288-4617-b157-782c7b7d15f9 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:58.064558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-090081c9-9288-4617-b157-782c7b7d15f9 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:58.067939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-090081c9-9288-4617-b157-782c7b7d15f9 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:58.068656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-090081c9-9288-4617-b157-782c7b7d15f9 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:58.263816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-090081c9-9288-4617-b157-782c7b7d15f9 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8630706184384900b96e774385ec420b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a3f169c94b49c097ef061ac48e52a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:58.279393 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-090081c9-9288-4617-b157-782c7b7d15f9 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 200 len: 1287 microversion: 2.1 time: 0.259490 Oct 04 21:13:58.298989 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1083/2127] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:58 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 1287 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:58.304359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-653264bd-3ffd-42f2-8728-8d3c11738309 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:58.307113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-653264bd-3ffd-42f2-8728-8d3c11738309 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:58.325236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-653264bd-3ffd-42f2-8728-8d3c11738309 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:58.327777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-653264bd-3ffd-42f2-8728-8d3c11738309 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:58.328514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-653264bd-3ffd-42f2-8728-8d3c11738309 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:58.331249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-653264bd-3ffd-42f2-8728-8d3c11738309 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:58.331973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-653264bd-3ffd-42f2-8728-8d3c11738309 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:58.333887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-653264bd-3ffd-42f2-8728-8d3c11738309 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:58.361217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0bc892e7-7b49-40b5-8f5e-174f6a6eaacf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:58.372108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0bc892e7-7b49-40b5-8f5e-174f6a6eaacf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:58.383158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0bc892e7-7b49-40b5-8f5e-174f6a6eaacf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:58.388052 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0bc892e7-7b49-40b5-8f5e-174f6a6eaacf tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1482 microversion: 2.25 time: 1.734371 Oct 04 21:13:58.391596 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1045/2128] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:56 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1482 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:58.410437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-f2538906-6e11-499c-82b5-166e9432e667 req-bf0b676b-aada-4eeb-8872-99735f7a77dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a7d656-c2a8-46fa-88dc-6c6cb1919c3b", "name": "network-vif-deleted", "tag": "0f85098b-592d-4f47-9950-f46b2b886584"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:58.442483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f2538906-6e11-499c-82b5-166e9432e667 req-bf0b676b-aada-4eeb-8872-99735f7a77dd service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:58.450720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f2538906-6e11-499c-82b5-166e9432e667 req-bf0b676b-aada-4eeb-8872-99735f7a77dd service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:58.450720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f2538906-6e11-499c-82b5-166e9432e667 req-bf0b676b-aada-4eeb-8872-99735f7a77dd service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:58.461263 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-f2538906-6e11-499c-82b5-166e9432e667 req-bf0b676b-aada-4eeb-8872-99735f7a77dd service nova] Creating event network-vif-deleted:0f85098b-592d-4f47-9950-f46b2b886584 for instance 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b on n-h2-860282-1 Oct 04 21:13:58.469015 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-f2538906-6e11-499c-82b5-166e9432e667 req-bf0b676b-aada-4eeb-8872-99735f7a77dd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074559 Oct 04 21:13:58.470893 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1046/2129] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:58.556234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-653264bd-3ffd-42f2-8728-8d3c11738309 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:58.573957 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-653264bd-3ffd-42f2-8728-8d3c11738309 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1" status: 200 len: 1266 microversion: 2.1 time: 0.269528 Oct 04 21:13:58.581256 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1084/2130] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:58 2022] GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:58.581553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-461d1c9c-2578-4941-807e-76ebdeb81ed0 req-357bdacc-d545-43ce-9068-bc2787739570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c86d6b4-12a8-464a-84d7-2d6454aee597", "name": "network-vif-deleted", "tag": "9229c565-3c30-423f-9b59-78ca89772437"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:58.591895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-461d1c9c-2578-4941-807e-76ebdeb81ed0 req-357bdacc-d545-43ce-9068-bc2787739570 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:58.592749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-461d1c9c-2578-4941-807e-76ebdeb81ed0 req-357bdacc-d545-43ce-9068-bc2787739570 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:58.593354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-461d1c9c-2578-4941-807e-76ebdeb81ed0 req-357bdacc-d545-43ce-9068-bc2787739570 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:58.624219 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-461d1c9c-2578-4941-807e-76ebdeb81ed0 req-357bdacc-d545-43ce-9068-bc2787739570 service nova] Creating event network-vif-deleted:9229c565-3c30-423f-9b59-78ca89772437 for instance 4c86d6b4-12a8-464a-84d7-2d6454aee597 on n-h1-860282-1 Oct 04 21:13:58.631769 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-461d1c9c-2578-4941-807e-76ebdeb81ed0 req-357bdacc-d545-43ce-9068-bc2787739570 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063097 Oct 04 21:13:58.632681 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1047/2131] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:13:59.041690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fc71dd9b-4b65-4af0-a956-51f3ab2de5cb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:59.053889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fc71dd9b-4b65-4af0-a956-51f3ab2de5cb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:59.059907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc71dd9b-4b65-4af0-a956-51f3ab2de5cb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:59.060893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc71dd9b-4b65-4af0-a956-51f3ab2de5cb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:59.063834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc71dd9b-4b65-4af0-a956-51f3ab2de5cb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:59.064923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc71dd9b-4b65-4af0-a956-51f3ab2de5cb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:59.065618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc71dd9b-4b65-4af0-a956-51f3ab2de5cb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:59.070593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc71dd9b-4b65-4af0-a956-51f3ab2de5cb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:59.171386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc71dd9b-4b65-4af0-a956-51f3ab2de5cb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:59.174070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc71dd9b-4b65-4af0-a956-51f3ab2de5cb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:59.174728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc71dd9b-4b65-4af0-a956-51f3ab2de5cb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:59.183875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-fc71dd9b-4b65-4af0-a956-51f3ab2de5cb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lazy-loading 'fault' on Instance uuid 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:13:59.313014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d76e538a-0736-48ec-b6e3-041d0927740c tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:59.314242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d76e538a-0736-48ec-b6e3-041d0927740c tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:59.327734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d76e538a-0736-48ec-b6e3-041d0927740c tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:59.329325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d76e538a-0736-48ec-b6e3-041d0927740c tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:59.330707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d76e538a-0736-48ec-b6e3-041d0927740c tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:59.332484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d76e538a-0736-48ec-b6e3-041d0927740c tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:59.334218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d76e538a-0736-48ec-b6e3-041d0927740c tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:59.336251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d76e538a-0736-48ec-b6e3-041d0927740c tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:59.497048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fc71dd9b-4b65-4af0-a956-51f3ab2de5cb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:59.506384 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fc71dd9b-4b65-4af0-a956-51f3ab2de5cb tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 200 len: 1367 microversion: 2.1 time: 0.471536 Oct 04 21:13:59.526955 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1085/2132] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:59 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 1367 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:59.551788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7215035e-34fd-434b-9fbc-b63bc4ababd6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:59.552630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7215035e-34fd-434b-9fbc-b63bc4ababd6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:59.567797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7215035e-34fd-434b-9fbc-b63bc4ababd6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:59.579632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7215035e-34fd-434b-9fbc-b63bc4ababd6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:59.580297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7215035e-34fd-434b-9fbc-b63bc4ababd6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:59.581236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7215035e-34fd-434b-9fbc-b63bc4ababd6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:59.581975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7215035e-34fd-434b-9fbc-b63bc4ababd6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:59.582611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7215035e-34fd-434b-9fbc-b63bc4ababd6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:59.655014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d76e538a-0736-48ec-b6e3-041d0927740c tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8630706184384900b96e774385ec420b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a3f169c94b49c097ef061ac48e52a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:59.670280 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d76e538a-0736-48ec-b6e3-041d0927740c tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 200 len: 1285 microversion: 2.1 time: 0.366566 Oct 04 21:13:59.672557 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1048/2133] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:59 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 1285 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:59.700333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f2a847b8-48ba-488c-9bda-6d7b14d8a081 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:59.704529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f2a847b8-48ba-488c-9bda-6d7b14d8a081 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:59.722665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2a847b8-48ba-488c-9bda-6d7b14d8a081 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:59.723392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2a847b8-48ba-488c-9bda-6d7b14d8a081 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:59.724069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2a847b8-48ba-488c-9bda-6d7b14d8a081 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:59.725006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2a847b8-48ba-488c-9bda-6d7b14d8a081 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:59.725708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2a847b8-48ba-488c-9bda-6d7b14d8a081 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:59.726357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2a847b8-48ba-488c-9bda-6d7b14d8a081 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:59.791597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7215035e-34fd-434b-9fbc-b63bc4ababd6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:59.802295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7215035e-34fd-434b-9fbc-b63bc4ababd6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:59.803689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7215035e-34fd-434b-9fbc-b63bc4ababd6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:59.804943 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7215035e-34fd-434b-9fbc-b63bc4ababd6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1265 microversion: 2.25 time: 0.270635 Oct 04 21:13:59.805548 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1086/2134] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:59 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:14:00.127261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f2a847b8-48ba-488c-9bda-6d7b14d8a081 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:00.138954 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f2a847b8-48ba-488c-9bda-6d7b14d8a081 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1" status: 200 len: 1308 microversion: 2.1 time: 0.449426 Oct 04 21:14:00.142505 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1049/2135] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:59 2022] GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 => generated 1308 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:00.545366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f1ca8337-f854-450c-8ad1-d86fe0639839 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:00.546546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f1ca8337-f854-450c-8ad1-d86fe0639839 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:00.565947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1ca8337-f854-450c-8ad1-d86fe0639839 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:00.566320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1ca8337-f854-450c-8ad1-d86fe0639839 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:00.567652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1ca8337-f854-450c-8ad1-d86fe0639839 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:00.570175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1ca8337-f854-450c-8ad1-d86fe0639839 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:00.570901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1ca8337-f854-450c-8ad1-d86fe0639839 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:00.571466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1ca8337-f854-450c-8ad1-d86fe0639839 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:00.608516 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-f1ca8337-f854-450c-8ad1-d86fe0639839 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] HTTP exception thrown: Instance 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b could not be found. Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f1ca8337-f854-450c-8ad1-d86fe0639839 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Request method failure captured: Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b HTTP/1.1 Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKCf9yyiZcOfG9wQE0mXchm3gM3-BLdAV2E2Cw3KmIPseB95kyUMu6izjk2Fb9-RRhkDo6uP2yfcEbbrXpfB_CIjQnCxYhyIF4Yce2NxHKLTleC43S5lJT37GbbbePFy6Ka5tkxDhTA1nO10dZHm8WGVjoen21KqHv-DqAIkeAsxY6o Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: e11e3d4d14b240a3b934701459ada871 Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-MigrationsAdminTest-1715070443 Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e11e3d4d14b240a3b934701459ada871"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e11e3d4d14b240a3b934701459ada871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e11e3d4d14b240a3b934701459ada871"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e11e3d4d14b240a3b934701459ada871"}]}] Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-MigrationsAdminTest-1715070443 Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: e11e3d4d14b240a3b934701459ada871 Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-MigrationsAdminTest-1715070443 Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-MigrationsAdminTest-1715070443-project Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 150625a9472d43e0b0509ef044c58d34 Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-MigrationsAdminTest-1715070443-project Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b could not be found. Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '19a7d656-c2a8-46fa-88dc-6c6cb1919c3b'} Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b could not be found. Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b could not be found. Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:00.610442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:00.616456 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:00.616456 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:00.616456 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:00.616456 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:00.616456 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:00.616456 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b could not be found. Oct 04 21:14:00.616456 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:00.625185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f1ca8337-f854-450c-8ad1-d86fe0639839 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Returning 404 to user: Instance 19a7d656-c2a8-46fa-88dc-6c6cb1919c3b could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:00.626445 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f1ca8337-f854-450c-8ad1-d86fe0639839 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b" status: 404 len: 111 microversion: 2.1 time: 0.091691 Oct 04 21:14:00.627144 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1087/2136] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:00 2022] GET /compute/v2.1/servers/19a7d656-c2a8-46fa-88dc-6c6cb1919c3b => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:14:00.636841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b0578856-f559-4289-95b1-ecb02ced3eb2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '.version_select at 0x7f578ba623a0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:00.704380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4e25d22d-d27a-42a6-81a0-73d8c3800029 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:00.706018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4e25d22d-d27a-42a6-81a0-73d8c3800029 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:00.717871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e25d22d-d27a-42a6-81a0-73d8c3800029 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:00.724362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e25d22d-d27a-42a6-81a0-73d8c3800029 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:00.726156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e25d22d-d27a-42a6-81a0-73d8c3800029 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:00.727171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e25d22d-d27a-42a6-81a0-73d8c3800029 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:00.728279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e25d22d-d27a-42a6-81a0-73d8c3800029 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:00.731714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e25d22d-d27a-42a6-81a0-73d8c3800029 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:00.800494 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b0578856-f559-4289-95b1-ecb02ced3eb2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-872053037" status: 202 len: 0 microversion: 2.1 time: 0.167333 Oct 04 21:14:00.802531 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1050/2137] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Oct 4 21:14:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-872053037 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:14:00.836651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1fa3f444-e0e1-4b9e-be0d-b0831437df8f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:00.840945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1fa3f444-e0e1-4b9e-be0d-b0831437df8f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:00.881481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fa3f444-e0e1-4b9e-be0d-b0831437df8f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:00.884421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fa3f444-e0e1-4b9e-be0d-b0831437df8f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:00.888684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fa3f444-e0e1-4b9e-be0d-b0831437df8f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:00.893010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fa3f444-e0e1-4b9e-be0d-b0831437df8f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:00.898533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fa3f444-e0e1-4b9e-be0d-b0831437df8f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:00.899873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fa3f444-e0e1-4b9e-be0d-b0831437df8f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:01.001281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4e25d22d-d27a-42a6-81a0-73d8c3800029 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8630706184384900b96e774385ec420b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a3f169c94b49c097ef061ac48e52a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:01.007308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:01.021512 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4e25d22d-d27a-42a6-81a0-73d8c3800029 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 200 len: 1285 microversion: 2.1 time: 0.317610 Oct 04 21:14:01.022197 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1088/2138] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:00 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 1285 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:14:01.167259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-86167108-b438-440b-b6a1-0b1848409436 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:01.168037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-86167108-b438-440b-b6a1-0b1848409436 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:01.183944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86167108-b438-440b-b6a1-0b1848409436 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:01.184554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86167108-b438-440b-b6a1-0b1848409436 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:01.185005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86167108-b438-440b-b6a1-0b1848409436 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:01.186112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86167108-b438-440b-b6a1-0b1848409436 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:01.186899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86167108-b438-440b-b6a1-0b1848409436 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:01.189913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86167108-b438-440b-b6a1-0b1848409436 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:01.350650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1fa3f444-e0e1-4b9e-be0d-b0831437df8f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:01.364909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1fa3f444-e0e1-4b9e-be0d-b0831437df8f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:01.368917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1fa3f444-e0e1-4b9e-be0d-b0831437df8f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:01.374278 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1fa3f444-e0e1-4b9e-be0d-b0831437df8f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1265 microversion: 2.25 time: 0.546106 Oct 04 21:14:01.377887 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1051/2139] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:00 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1265 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:14:01.810385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-86167108-b438-440b-b6a1-0b1848409436 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:01.819214 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-86167108-b438-440b-b6a1-0b1848409436 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1" status: 200 len: 1308 microversion: 2.1 time: 0.657310 Oct 04 21:14:01.826000 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1089/2140] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:01 2022] GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 => generated 1308 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:02.048785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-44e511b7-f82e-47be-a1bf-5df91558b42f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:02.051887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-44e511b7-f82e-47be-a1bf-5df91558b42f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:02.080004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44e511b7-f82e-47be-a1bf-5df91558b42f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:02.080954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44e511b7-f82e-47be-a1bf-5df91558b42f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:02.082471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44e511b7-f82e-47be-a1bf-5df91558b42f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:02.085638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44e511b7-f82e-47be-a1bf-5df91558b42f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:02.087040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44e511b7-f82e-47be-a1bf-5df91558b42f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:02.089208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44e511b7-f82e-47be-a1bf-5df91558b42f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:02.408321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-77991e91-fa9c-4cec-8be9-e572fec35fe6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:02.409346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-77991e91-fa9c-4cec-8be9-e572fec35fe6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:02.434568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77991e91-fa9c-4cec-8be9-e572fec35fe6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:02.435889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77991e91-fa9c-4cec-8be9-e572fec35fe6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:02.436678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77991e91-fa9c-4cec-8be9-e572fec35fe6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:02.437710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77991e91-fa9c-4cec-8be9-e572fec35fe6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:02.439451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77991e91-fa9c-4cec-8be9-e572fec35fe6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:02.440087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77991e91-fa9c-4cec-8be9-e572fec35fe6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:02.680031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-77991e91-fa9c-4cec-8be9-e572fec35fe6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:02.734555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-77991e91-fa9c-4cec-8be9-e572fec35fe6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:02.736200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-77991e91-fa9c-4cec-8be9-e572fec35fe6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:02.737436 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-77991e91-fa9c-4cec-8be9-e572fec35fe6 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1265 microversion: 2.25 time: 0.334545 Oct 04 21:14:02.745537 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1090/2141] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:02 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1265 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:14:02.851371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e0a26664-4f0f-4395-8c06-0614a6c1ab24 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:02.852372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e0a26664-4f0f-4395-8c06-0614a6c1ab24 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:02.885705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0a26664-4f0f-4395-8c06-0614a6c1ab24 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:02.886464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0a26664-4f0f-4395-8c06-0614a6c1ab24 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:02.886930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0a26664-4f0f-4395-8c06-0614a6c1ab24 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:02.887695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0a26664-4f0f-4395-8c06-0614a6c1ab24 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:02.888161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0a26664-4f0f-4395-8c06-0614a6c1ab24 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:02.888594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0a26664-4f0f-4395-8c06-0614a6c1ab24 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:02.992592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-44e511b7-f82e-47be-a1bf-5df91558b42f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8630706184384900b96e774385ec420b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a3f169c94b49c097ef061ac48e52a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:03.006797 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-44e511b7-f82e-47be-a1bf-5df91558b42f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 200 len: 1327 microversion: 2.1 time: 0.962999 Oct 04 21:14:03.022463 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1052/2142] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:02 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 1327 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:03.558767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:03.577112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e0a26664-4f0f-4395-8c06-0614a6c1ab24 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:03.591034 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e0a26664-4f0f-4395-8c06-0614a6c1ab24 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1" status: 200 len: 1308 microversion: 2.1 time: 0.743105 Oct 04 21:14:03.592117 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1091/2143] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:02 2022] GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 => generated 1308 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:14:03.709141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-638b2a4a-e6db-43c7-941d-b333b66188f0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:03.709716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-638b2a4a-e6db-43c7-941d-b333b66188f0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:03.728492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-638b2a4a-e6db-43c7-941d-b333b66188f0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:03.729192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-638b2a4a-e6db-43c7-941d-b333b66188f0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:03.729753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-638b2a4a-e6db-43c7-941d-b333b66188f0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:03.730491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-638b2a4a-e6db-43c7-941d-b333b66188f0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:03.730953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-638b2a4a-e6db-43c7-941d-b333b66188f0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:03.731377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-638b2a4a-e6db-43c7-941d-b333b66188f0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:03.767161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-21f20ac6-31a8-4099-a7b3-e6a4cbc978fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:03.768443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-21f20ac6-31a8-4099-a7b3-e6a4cbc978fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:03.785003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21f20ac6-31a8-4099-a7b3-e6a4cbc978fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:03.785797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21f20ac6-31a8-4099-a7b3-e6a4cbc978fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:03.786566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21f20ac6-31a8-4099-a7b3-e6a4cbc978fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:03.787471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21f20ac6-31a8-4099-a7b3-e6a4cbc978fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:03.788133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21f20ac6-31a8-4099-a7b3-e6a4cbc978fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:03.788757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21f20ac6-31a8-4099-a7b3-e6a4cbc978fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:03.788967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-638b2a4a-e6db-43c7-941d-b333b66188f0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:14:03.977837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-21f20ac6-31a8-4099-a7b3-e6a4cbc978fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:03.988145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-21f20ac6-31a8-4099-a7b3-e6a4cbc978fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:03.989832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-21f20ac6-31a8-4099-a7b3-e6a4cbc978fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:03.991013 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-21f20ac6-31a8-4099-a7b3-e6a4cbc978fd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1265 microversion: 2.25 time: 0.227838 Oct 04 21:14:04.011858 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1092/2144] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:03 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:14:04.031476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-946656a3-7417-4c08-8b22-4f5e1fe6e495 req-05cd6642-90eb-41c6-9f95-7858f83f0104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c974866c-d0de-4595-85b6-7404f349c6f1", "tag": "363ea383-0f2b-4176-8e31-c2e9325ecb59"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:04.055982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-946656a3-7417-4c08-8b22-4f5e1fe6e495 req-05cd6642-90eb-41c6-9f95-7858f83f0104 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:04.058373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-946656a3-7417-4c08-8b22-4f5e1fe6e495 req-05cd6642-90eb-41c6-9f95-7858f83f0104 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:04.061604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-946656a3-7417-4c08-8b22-4f5e1fe6e495 req-05cd6642-90eb-41c6-9f95-7858f83f0104 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:04.127386 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-946656a3-7417-4c08-8b22-4f5e1fe6e495 req-05cd6642-90eb-41c6-9f95-7858f83f0104 service nova] Creating event network-changed:363ea383-0f2b-4176-8e31-c2e9325ecb59 for instance c974866c-d0de-4595-85b6-7404f349c6f1 on n-h2-860282-1 Oct 04 21:14:04.144357 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-946656a3-7417-4c08-8b22-4f5e1fe6e495 req-05cd6642-90eb-41c6-9f95-7858f83f0104 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128022 Oct 04 21:14:04.148994 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1093/2145] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:04.173261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9e0ec6ee-ab7c-47de-8880-877dd3b60297 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:04.175063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9e0ec6ee-ab7c-47de-8880-877dd3b60297 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:04.180290 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-638b2a4a-e6db-43c7-941d-b333b66188f0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 204 len: 0 microversion: 2.1 time: 0.474841 Oct 04 21:14:04.194541 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1053/2146] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:14:03 2022] DELETE /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:14:04.194541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a2770b6d-060f-4114-a419-477ec28caca0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:04.194541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a2770b6d-060f-4114-a419-477ec28caca0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:04.201532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e0ec6ee-ab7c-47de-8880-877dd3b60297 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:04.202092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e0ec6ee-ab7c-47de-8880-877dd3b60297 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:04.202547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e0ec6ee-ab7c-47de-8880-877dd3b60297 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:04.210413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2770b6d-060f-4114-a419-477ec28caca0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:04.210820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2770b6d-060f-4114-a419-477ec28caca0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:04.211390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2770b6d-060f-4114-a419-477ec28caca0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:04.211967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2770b6d-060f-4114-a419-477ec28caca0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:04.212400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2770b6d-060f-4114-a419-477ec28caca0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:04.212865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2770b6d-060f-4114-a419-477ec28caca0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:04.216928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e0ec6ee-ab7c-47de-8880-877dd3b60297 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:04.218236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e0ec6ee-ab7c-47de-8880-877dd3b60297 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:04.220349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e0ec6ee-ab7c-47de-8880-877dd3b60297 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:04.684135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9e0ec6ee-ab7c-47de-8880-877dd3b60297 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8630706184384900b96e774385ec420b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a3f169c94b49c097ef061ac48e52a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:04.697868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a2770b6d-060f-4114-a419-477ec28caca0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:04.714370 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a2770b6d-060f-4114-a419-477ec28caca0 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1468 microversion: 2.1 time: 0.526117 Oct 04 21:14:04.716062 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9e0ec6ee-ab7c-47de-8880-877dd3b60297 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 200 len: 1327 microversion: 2.1 time: 0.560357 Oct 04 21:14:04.717303 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1094/2147] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:04 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 1327 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:04.738190 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1054/2148] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:04 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1468 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:14:04.750176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6044cad6-5aff-460b-919b-1f45502d2108 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:04.754555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6044cad6-5aff-460b-919b-1f45502d2108 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:04.760178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:04.771395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6044cad6-5aff-460b-919b-1f45502d2108 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:04.771703 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6044cad6-5aff-460b-919b-1f45502d2108 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:04.772314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6044cad6-5aff-460b-919b-1f45502d2108 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:04.773199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6044cad6-5aff-460b-919b-1f45502d2108 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:04.774393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6044cad6-5aff-460b-919b-1f45502d2108 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:04.774998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6044cad6-5aff-460b-919b-1f45502d2108 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:05.023117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6520a042-191e-4b7a-b9ce-399f9c18500f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:05.023669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6520a042-191e-4b7a-b9ce-399f9c18500f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:05.028011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:05.047779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6520a042-191e-4b7a-b9ce-399f9c18500f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:05.048532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6520a042-191e-4b7a-b9ce-399f9c18500f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:05.049242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6520a042-191e-4b7a-b9ce-399f9c18500f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:05.052101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6520a042-191e-4b7a-b9ce-399f9c18500f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:05.052810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6520a042-191e-4b7a-b9ce-399f9c18500f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:05.055879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6520a042-191e-4b7a-b9ce-399f9c18500f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:05.550217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6520a042-191e-4b7a-b9ce-399f9c18500f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:05.584791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6520a042-191e-4b7a-b9ce-399f9c18500f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:05.586327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6520a042-191e-4b7a-b9ce-399f9c18500f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:05.592706 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6520a042-191e-4b7a-b9ce-399f9c18500f tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1265 microversion: 2.25 time: 0.576243 Oct 04 21:14:05.595373 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1055/2149] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:05 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1265 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:14:05.740471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bb198218-4612-47ed-a234-7de36b704533 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:05.742163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bb198218-4612-47ed-a234-7de36b704533 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:05.757236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb198218-4612-47ed-a234-7de36b704533 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:05.760641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb198218-4612-47ed-a234-7de36b704533 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:05.762115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb198218-4612-47ed-a234-7de36b704533 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:05.769236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb198218-4612-47ed-a234-7de36b704533 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:05.769981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb198218-4612-47ed-a234-7de36b704533 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:05.771170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb198218-4612-47ed-a234-7de36b704533 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:05.865968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6044cad6-5aff-460b-919b-1f45502d2108 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:05.874150 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6044cad6-5aff-460b-919b-1f45502d2108 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1" status: 200 len: 1308 microversion: 2.1 time: 1.141567 Oct 04 21:14:05.874744 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1095/2150] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:04 2022] GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 => generated 1308 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:05.896212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-025c5f1e-50ce-4e41-8185-b4fb63b5b2b2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:05.899016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-025c5f1e-50ce-4e41-8185-b4fb63b5b2b2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:05.908496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-025c5f1e-50ce-4e41-8185-b4fb63b5b2b2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:05.910710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-025c5f1e-50ce-4e41-8185-b4fb63b5b2b2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:05.911410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-025c5f1e-50ce-4e41-8185-b4fb63b5b2b2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:05.912361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-025c5f1e-50ce-4e41-8185-b4fb63b5b2b2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:05.913040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-025c5f1e-50ce-4e41-8185-b4fb63b5b2b2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:05.913708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-025c5f1e-50ce-4e41-8185-b4fb63b5b2b2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:05.919539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:05.976454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=10 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:06.486239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-025c5f1e-50ce-4e41-8185-b4fb63b5b2b2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:06.501849 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-025c5f1e-50ce-4e41-8185-b4fb63b5b2b2 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1468 microversion: 2.1 time: 0.625983 Oct 04 21:14:06.509098 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1096/2151] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:05 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1468 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:06.631346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1f79baa5-2012-4575-b7de-2a25d978ef3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:06.631962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1f79baa5-2012-4575-b7de-2a25d978ef3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:06.646079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f79baa5-2012-4575-b7de-2a25d978ef3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:06.646580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f79baa5-2012-4575-b7de-2a25d978ef3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:06.651992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f79baa5-2012-4575-b7de-2a25d978ef3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:06.652847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f79baa5-2012-4575-b7de-2a25d978ef3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:06.653316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f79baa5-2012-4575-b7de-2a25d978ef3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:06.653984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f79baa5-2012-4575-b7de-2a25d978ef3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:06.996917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1f79baa5-2012-4575-b7de-2a25d978ef3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:06.999681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bb198218-4612-47ed-a234-7de36b704533 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8630706184384900b96e774385ec420b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a3f169c94b49c097ef061ac48e52a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:07.039714 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bb198218-4612-47ed-a234-7de36b704533 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 200 len: 1327 microversion: 2.1 time: 1.303884 Oct 04 21:14:07.046312 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1056/2152] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:05 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 1327 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:07.048592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1f79baa5-2012-4575-b7de-2a25d978ef3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:07.064609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1f79baa5-2012-4575-b7de-2a25d978ef3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:07.073577 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1f79baa5-2012-4575-b7de-2a25d978ef3b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 200 len: 1265 microversion: 2.25 time: 0.442992 Oct 04 21:14:07.075932 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1097/2153] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:06 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 1265 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:14:07.080449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-94c9fd95-a474-48a9-af29-a6d52331c1d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:07.083804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-94c9fd95-a474-48a9-af29-a6d52331c1d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:07.100686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-b87f51be-8fac-43fc-b8d0-1912be998126 req-88833e59-274e-4451-8e97-0368a2e9b897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa44d77-6583-4a52-9bcc-b9af99d2bd9f", "tag": "e8e0b120-1d09-4f06-b791-627091bb7ecb"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:07.116184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94c9fd95-a474-48a9-af29-a6d52331c1d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:07.116731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94c9fd95-a474-48a9-af29-a6d52331c1d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:07.117186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94c9fd95-a474-48a9-af29-a6d52331c1d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:07.117950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94c9fd95-a474-48a9-af29-a6d52331c1d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:07.118417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94c9fd95-a474-48a9-af29-a6d52331c1d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:07.119377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94c9fd95-a474-48a9-af29-a6d52331c1d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:07.141676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b87f51be-8fac-43fc-b8d0-1912be998126 req-88833e59-274e-4451-8e97-0368a2e9b897 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:07.142465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b87f51be-8fac-43fc-b8d0-1912be998126 req-88833e59-274e-4451-8e97-0368a2e9b897 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:07.143096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b87f51be-8fac-43fc-b8d0-1912be998126 req-88833e59-274e-4451-8e97-0368a2e9b897 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:07.173514 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-b87f51be-8fac-43fc-b8d0-1912be998126 req-88833e59-274e-4451-8e97-0368a2e9b897 service nova] Creating event network-changed:e8e0b120-1d09-4f06-b791-627091bb7ecb for instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f on n-h2-860282-1 Oct 04 21:14:07.182225 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-b87f51be-8fac-43fc-b8d0-1912be998126 req-88833e59-274e-4451-8e97-0368a2e9b897 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102931 Oct 04 21:14:07.183869 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1098/2154] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:07.551328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cc8921af-9912-4396-9373-cb295d4a0b91 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:07.554068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cc8921af-9912-4396-9373-cb295d4a0b91 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:07.578397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc8921af-9912-4396-9373-cb295d4a0b91 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:07.581832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc8921af-9912-4396-9373-cb295d4a0b91 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:07.582568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc8921af-9912-4396-9373-cb295d4a0b91 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:07.583761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc8921af-9912-4396-9373-cb295d4a0b91 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:07.585905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc8921af-9912-4396-9373-cb295d4a0b91 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:07.586613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc8921af-9912-4396-9373-cb295d4a0b91 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:07.984234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cc8921af-9912-4396-9373-cb295d4a0b91 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:07.992153 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cc8921af-9912-4396-9373-cb295d4a0b91 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1468 microversion: 2.1 time: 0.456321 Oct 04 21:14:07.992727 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1099/2155] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:07 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1468 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:08.023292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-94c9fd95-a474-48a9-af29-a6d52331c1d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:08.041565 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-94c9fd95-a474-48a9-af29-a6d52331c1d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1" status: 200 len: 1308 microversion: 2.1 time: 0.988837 Oct 04 21:14:08.072892 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1057/2156] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:07 2022] GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 => generated 1308 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:08.091217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b323d67c-ddef-4a1d-a477-7355c3a3ff26 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:08.092264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b323d67c-ddef-4a1d-a477-7355c3a3ff26 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:08.100775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b323d67c-ddef-4a1d-a477-7355c3a3ff26 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:08.106123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b323d67c-ddef-4a1d-a477-7355c3a3ff26 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:08.106123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b323d67c-ddef-4a1d-a477-7355c3a3ff26 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:08.106123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b323d67c-ddef-4a1d-a477-7355c3a3ff26 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:08.107207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b323d67c-ddef-4a1d-a477-7355c3a3ff26 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:08.108739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b323d67c-ddef-4a1d-a477-7355c3a3ff26 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:08.348166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3d6fe97b-f9af-46b0-aa3f-754cc19be20f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1021345312", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "a1aa70e9-3daa-4749-bfb3-05caabbf7400"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:08.439978 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-3d6fe97b-f9af-46b0-aa3f-754cc19be20f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] validate_networks() for [('a1aa70e9-3daa-4749-bfb3-05caabbf7400', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:14:08.834485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b323d67c-ddef-4a1d-a477-7355c3a3ff26 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8630706184384900b96e774385ec420b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a3f169c94b49c097ef061ac48e52a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:08.846810 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b323d67c-ddef-4a1d-a477-7355c3a3ff26 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 200 len: 1327 microversion: 2.1 time: 0.772572 Oct 04 21:14:08.855112 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1058/2157] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:08 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 1327 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:08.874322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1c7d4502-c44b-4a24-b641-844cc876f905 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:08.879496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1c7d4502-c44b-4a24-b641-844cc876f905 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 4c86d6b4-12a8-464a-84d7-2d6454aee597] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:08.908260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c7d4502-c44b-4a24-b641-844cc876f905 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:08.911550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c7d4502-c44b-4a24-b641-844cc876f905 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:08.912346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c7d4502-c44b-4a24-b641-844cc876f905 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:08.913354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c7d4502-c44b-4a24-b641-844cc876f905 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:08.915325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c7d4502-c44b-4a24-b641-844cc876f905 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:08.916314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c7d4502-c44b-4a24-b641-844cc876f905 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:08.956987 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-1c7d4502-c44b-4a24-b641-844cc876f905 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] HTTP exception thrown: Instance 4c86d6b4-12a8-464a-84d7-2d6454aee597 could not be found. Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1c7d4502-c44b-4a24-b641-844cc876f905 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Request method failure captured: Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 HTTP/1.1 Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKBoglkS0qD8SmxZe3mirsDTnSE-aaQetnJDczd2syhpWxq0p15FnusWK_on0F377rdG9PVjJwVI0OpcTwAspbepOQF6jNZgjexGJEuHoo4cDL_yI4yGAt-USxC7jzHrRkF8TGmuEMTzBbdXXcBTleyLT_69wwQ76fiHG5HItf35yUA Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: d06810bbad6e4914aa53b43ef390f52e Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1744975960 Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d06810bbad6e4914aa53b43ef390f52e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d06810bbad6e4914aa53b43ef390f52e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d06810bbad6e4914aa53b43ef390f52e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d06810bbad6e4914aa53b43ef390f52e"}]}] Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1744975960 Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: d06810bbad6e4914aa53b43ef390f52e Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1744975960 Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-LiveAutoBlockMigrationV225Test-1744975960-project Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 95f0cc0f93b244cea8818c7bbdcfb90a Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1744975960-project Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 4c86d6b4-12a8-464a-84d7-2d6454aee597 could not be found. Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '4c86d6b4-12a8-464a-84d7-2d6454aee597'} Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c86d6b4-12a8-464a-84d7-2d6454aee597 could not be found. Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c86d6b4-12a8-464a-84d7-2d6454aee597 could not be found. Oct 04 21:14:08.960661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:08.968149 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:08.968149 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:08.968149 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:08.968149 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:08.968149 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:08.968149 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:08.968149 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:08.968149 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c86d6b4-12a8-464a-84d7-2d6454aee597 could not be found. Oct 04 21:14:08.968149 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:08.972227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1c7d4502-c44b-4a24-b641-844cc876f905 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Returning 404 to user: Instance 4c86d6b4-12a8-464a-84d7-2d6454aee597 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:08.975665 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1c7d4502-c44b-4a24-b641-844cc876f905 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597" status: 404 len: 111 microversion: 2.25 time: 0.115979 Oct 04 21:14:08.977127 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1059/2158] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:08 2022] GET /compute/v2.1/servers/4c86d6b4-12a8-464a-84d7-2d6454aee597 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:14:08.999301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-46641d9c-9874-47b1-a071-ca49c5dd9466 req-0023cc05-1d0b-478b-8b61-dd2b011b57d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d10b511-a8bd-46cc-bf96-0879899ac60b", "name": "network-vif-deleted", "tag": "cc7eeb3c-7c42-43b5-b169-cbc14e6a3436"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:09.019933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-46641d9c-9874-47b1-a071-ca49c5dd9466 req-0023cc05-1d0b-478b-8b61-dd2b011b57d1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:09.021552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-46641d9c-9874-47b1-a071-ca49c5dd9466 req-0023cc05-1d0b-478b-8b61-dd2b011b57d1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:09.023669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-46641d9c-9874-47b1-a071-ca49c5dd9466 req-0023cc05-1d0b-478b-8b61-dd2b011b57d1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:09.050880 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-46641d9c-9874-47b1-a071-ca49c5dd9466 req-0023cc05-1d0b-478b-8b61-dd2b011b57d1 service nova] Creating event network-vif-deleted:cc7eeb3c-7c42-43b5-b169-cbc14e6a3436 for instance 4d10b511-a8bd-46cc-bf96-0879899ac60b on n-h1-860282-1 Oct 04 21:14:09.059536 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-46641d9c-9874-47b1-a071-ca49c5dd9466 req-0023cc05-1d0b-478b-8b61-dd2b011b57d1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080813 Oct 04 21:14:09.060895 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1060/2159] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:09.066715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e0074df1-f5b6-4d13-861f-85e6f285045e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:09.067622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e0074df1-f5b6-4d13-861f-85e6f285045e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:09.076636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0074df1-f5b6-4d13-861f-85e6f285045e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:09.076636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0074df1-f5b6-4d13-861f-85e6f285045e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:09.076636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0074df1-f5b6-4d13-861f-85e6f285045e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:09.077668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0074df1-f5b6-4d13-861f-85e6f285045e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:09.078304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0074df1-f5b6-4d13-861f-85e6f285045e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:09.078957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0074df1-f5b6-4d13-861f-85e6f285045e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:09.340840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e0074df1-f5b6-4d13-861f-85e6f285045e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:09.359648 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e0074df1-f5b6-4d13-861f-85e6f285045e tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 200 len: 1298 microversion: 2.1 time: 0.297268 Oct 04 21:14:09.360256 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1061/2160] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:09 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 1298 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:09.386062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e20fa396-680c-4956-84ac-799c19663cd4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:09.387884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e20fa396-680c-4956-84ac-799c19663cd4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:09.410767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e20fa396-680c-4956-84ac-799c19663cd4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:09.413716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e20fa396-680c-4956-84ac-799c19663cd4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:09.413716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e20fa396-680c-4956-84ac-799c19663cd4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:09.420922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e20fa396-680c-4956-84ac-799c19663cd4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:09.421451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e20fa396-680c-4956-84ac-799c19663cd4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:09.425316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e20fa396-680c-4956-84ac-799c19663cd4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:10.196613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e20fa396-680c-4956-84ac-799c19663cd4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:10.200810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:10.206739 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e20fa396-680c-4956-84ac-799c19663cd4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1" status: 200 len: 1308 microversion: 2.1 time: 0.842685 Oct 04 21:14:10.212045 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1062/2161] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:09 2022] GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 => generated 1308 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:10.229921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-922991e0-e150-4235-8741-d0a9b9e0bd3f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:10.229921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-922991e0-e150-4235-8741-d0a9b9e0bd3f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:10.239597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-922991e0-e150-4235-8741-d0a9b9e0bd3f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:10.241412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-922991e0-e150-4235-8741-d0a9b9e0bd3f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:10.241995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-922991e0-e150-4235-8741-d0a9b9e0bd3f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:10.244479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-922991e0-e150-4235-8741-d0a9b9e0bd3f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:10.250749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-922991e0-e150-4235-8741-d0a9b9e0bd3f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:10.254771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-922991e0-e150-4235-8741-d0a9b9e0bd3f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:10.500855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3d6fe97b-f9af-46b0-aa3f-754cc19be20f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:14:10.501480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3d6fe97b-f9af-46b0-aa3f-754cc19be20f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:14:10.501977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3d6fe97b-f9af-46b0-aa3f-754cc19be20f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:14:10.502459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3d6fe97b-f9af-46b0-aa3f-754cc19be20f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:14:10.503069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3d6fe97b-f9af-46b0-aa3f-754cc19be20f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:14:10.522009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d6fe97b-f9af-46b0-aa3f-754cc19be20f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:10.522772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d6fe97b-f9af-46b0-aa3f-754cc19be20f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:10.524388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d6fe97b-f9af-46b0-aa3f-754cc19be20f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:10.526980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d6fe97b-f9af-46b0-aa3f-754cc19be20f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:10.527661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d6fe97b-f9af-46b0-aa3f-754cc19be20f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:10.528916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d6fe97b-f9af-46b0-aa3f-754cc19be20f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:10.624548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-3d6fe97b-f9af-46b0-aa3f-754cc19be20f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Getting quotas for project 4df42993975949899553deaeaffada73. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:14:10.648781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-3d6fe97b-f9af-46b0-aa3f-754cc19be20f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Getting quotas for user 4d401d8a2c8e4cee856badba313ed00a and project 4df42993975949899553deaeaffada73. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:14:10.687411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3d6fe97b-f9af-46b0-aa3f-754cc19be20f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:14:10.693477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3d6fe97b-f9af-46b0-aa3f-754cc19be20f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:14:10.769952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:10.986440 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3d6fe97b-f9af-46b0-aa3f-754cc19be20f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.976086 Oct 04 21:14:10.989402 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1100/2162] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:14:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:14:11.014397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cf705943-7109-4795-9195-4528cf3b2576 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:11.015651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cf705943-7109-4795-9195-4528cf3b2576 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 4d10b511-a8bd-46cc-bf96-0879899ac60b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:11.051538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf705943-7109-4795-9195-4528cf3b2576 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:11.054783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf705943-7109-4795-9195-4528cf3b2576 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:11.057888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf705943-7109-4795-9195-4528cf3b2576 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:11.061161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf705943-7109-4795-9195-4528cf3b2576 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:11.061903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf705943-7109-4795-9195-4528cf3b2576 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:11.064884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf705943-7109-4795-9195-4528cf3b2576 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:11.132978 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-cf705943-7109-4795-9195-4528cf3b2576 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] HTTP exception thrown: Instance 4d10b511-a8bd-46cc-bf96-0879899ac60b could not be found. Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cf705943-7109-4795-9195-4528cf3b2576 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Request method failure captured: Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b HTTP/1.1 Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKCf9yyiZcOfG9wQE0mXchm3gM3-BLdAV2E2Cw3KmIPseB95kyUMu6izjk2Fb9-RRhkDo6uP2yfcEbbrXpfB_CIjQnCxYhyIF4Yce2NxHKLTleC43S5lJT37GbbbePFy6Ka5tkxDhTA1nO10dZHm8WGVjoen21KqHv-DqAIkeAsxY6o Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: e11e3d4d14b240a3b934701459ada871 Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-MigrationsAdminTest-1715070443 Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e11e3d4d14b240a3b934701459ada871"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e11e3d4d14b240a3b934701459ada871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e11e3d4d14b240a3b934701459ada871"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e11e3d4d14b240a3b934701459ada871"}]}] Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-MigrationsAdminTest-1715070443 Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: e11e3d4d14b240a3b934701459ada871 Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-MigrationsAdminTest-1715070443 Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-MigrationsAdminTest-1715070443-project Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 150625a9472d43e0b0509ef044c58d34 Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-MigrationsAdminTest-1715070443-project Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 4d10b511-a8bd-46cc-bf96-0879899ac60b could not be found. Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '4d10b511-a8bd-46cc-bf96-0879899ac60b'} Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d10b511-a8bd-46cc-bf96-0879899ac60b could not be found. Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d10b511-a8bd-46cc-bf96-0879899ac60b could not be found. Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:11.138837 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:11.144442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:11.144442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:11.144442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:11.144442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:11.144442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:11.144442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d10b511-a8bd-46cc-bf96-0879899ac60b could not be found. Oct 04 21:14:11.144442 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:11.146184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cf705943-7109-4795-9195-4528cf3b2576 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Returning 404 to user: Instance 4d10b511-a8bd-46cc-bf96-0879899ac60b could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:11.148673 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cf705943-7109-4795-9195-4528cf3b2576 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b" status: 404 len: 111 microversion: 2.1 time: 0.149834 Oct 04 21:14:11.149785 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1101/2163] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:10 2022] GET /compute/v2.1/servers/4d10b511-a8bd-46cc-bf96-0879899ac60b => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:14:11.162946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c0072a4c-4611-4dc0-86f9-46d47ca02523 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:11.164048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c0072a4c-4611-4dc0-86f9-46d47ca02523 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:11.483537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c0072a4c-4611-4dc0-86f9-46d47ca02523 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:11.492946 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c0072a4c-4611-4dc0-86f9-46d47ca02523 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1225 microversion: 2.1 time: 0.341393 Oct 04 21:14:11.494946 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1102/2164] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:11 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1225 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:11.510473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7b710047-3bb2-4d5b-b4a2-26df51c7dcd6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:11.511930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7b710047-3bb2-4d5b-b4a2-26df51c7dcd6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:11.527344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b710047-3bb2-4d5b-b4a2-26df51c7dcd6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:11.530840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b710047-3bb2-4d5b-b4a2-26df51c7dcd6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:11.533147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b710047-3bb2-4d5b-b4a2-26df51c7dcd6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:11.537756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b710047-3bb2-4d5b-b4a2-26df51c7dcd6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:11.538604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b710047-3bb2-4d5b-b4a2-26df51c7dcd6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:11.539247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b710047-3bb2-4d5b-b4a2-26df51c7dcd6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:11.593246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-922991e0-e150-4235-8741-d0a9b9e0bd3f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8630706184384900b96e774385ec420b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a3f169c94b49c097ef061ac48e52a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:11.608178 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-922991e0-e150-4235-8741-d0a9b9e0bd3f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 200 len: 1327 microversion: 2.1 time: 1.394282 Oct 04 21:14:11.608797 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1063/2165] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:10 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 1327 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:11.623745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7b710047-3bb2-4d5b-b4a2-26df51c7dcd6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:14:11.650275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-04c90da1-ef76-4d19-a1b6-796ac0052d4c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:11.659844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-04c90da1-ef76-4d19-a1b6-796ac0052d4c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:11.677586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04c90da1-ef76-4d19-a1b6-796ac0052d4c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:11.683908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04c90da1-ef76-4d19-a1b6-796ac0052d4c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:11.684643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04c90da1-ef76-4d19-a1b6-796ac0052d4c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:11.685666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04c90da1-ef76-4d19-a1b6-796ac0052d4c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:11.688639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04c90da1-ef76-4d19-a1b6-796ac0052d4c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:11.689323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04c90da1-ef76-4d19-a1b6-796ac0052d4c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:12.106878 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7b710047-3bb2-4d5b-b4a2-26df51c7dcd6 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "DELETE /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 204 len: 0 microversion: 2.1 time: 0.607736 Oct 04 21:14:12.107686 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1103/2166] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:14:11 2022] DELETE /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:14:12.116459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c9b4847f-ec3e-4779-bbfe-eb1ce63a07c7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:12.117178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c9b4847f-ec3e-4779-bbfe-eb1ce63a07c7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:12.142923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c9b4847f-ec3e-4779-bbfe-eb1ce63a07c7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:12.142923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c9b4847f-ec3e-4779-bbfe-eb1ce63a07c7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:12.142923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c9b4847f-ec3e-4779-bbfe-eb1ce63a07c7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:12.142923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c9b4847f-ec3e-4779-bbfe-eb1ce63a07c7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:12.142923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c9b4847f-ec3e-4779-bbfe-eb1ce63a07c7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:12.142923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c9b4847f-ec3e-4779-bbfe-eb1ce63a07c7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:12.195572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-04c90da1-ef76-4d19-a1b6-796ac0052d4c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:12.213323 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-04c90da1-ef76-4d19-a1b6-796ac0052d4c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1" status: 200 len: 1308 microversion: 2.1 time: 0.576298 Oct 04 21:14:12.221510 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1064/2167] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:11 2022] GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 => generated 1308 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:12.522479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2fa8df4d-9333-4a80-a3de-f02c6703b9e4 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:12.523532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2fa8df4d-9333-4a80-a3de-f02c6703b9e4 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:12.648049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c9b4847f-ec3e-4779-bbfe-eb1ce63a07c7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:12.700721 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c9b4847f-ec3e-4779-bbfe-eb1ce63a07c7 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1468 microversion: 2.1 time: 0.549078 Oct 04 21:14:12.700721 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1104/2168] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:12 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1468 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:12.700721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-caf0cd8e-10c9-4eb1-b1a0-a61b1522fa32 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:12.700721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-caf0cd8e-10c9-4eb1-b1a0-a61b1522fa32 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:12.700721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-caf0cd8e-10c9-4eb1-b1a0-a61b1522fa32 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:12.700721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-caf0cd8e-10c9-4eb1-b1a0-a61b1522fa32 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:12.700721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-caf0cd8e-10c9-4eb1-b1a0-a61b1522fa32 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:12.700721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-caf0cd8e-10c9-4eb1-b1a0-a61b1522fa32 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:12.700721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-caf0cd8e-10c9-4eb1-b1a0-a61b1522fa32 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:12.700721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-caf0cd8e-10c9-4eb1-b1a0-a61b1522fa32 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:12.701678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2fa8df4d-9333-4a80-a3de-f02c6703b9e4 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:12.702394 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2fa8df4d-9333-4a80-a3de-f02c6703b9e4 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1225 microversion: 2.1 time: 0.184458 Oct 04 21:14:12.705405 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1065/2169] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:12 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1225 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:14:13.236407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5d3aa452-e75d-4a7a-8ec0-2573c0094d5f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:13.239626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5d3aa452-e75d-4a7a-8ec0-2573c0094d5f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:13.261094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d3aa452-e75d-4a7a-8ec0-2573c0094d5f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:13.279629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d3aa452-e75d-4a7a-8ec0-2573c0094d5f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:13.282624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d3aa452-e75d-4a7a-8ec0-2573c0094d5f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:13.286156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d3aa452-e75d-4a7a-8ec0-2573c0094d5f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:13.287038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d3aa452-e75d-4a7a-8ec0-2573c0094d5f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:13.287702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d3aa452-e75d-4a7a-8ec0-2573c0094d5f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:14.225556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5d3aa452-e75d-4a7a-8ec0-2573c0094d5f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:14.251373 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5d3aa452-e75d-4a7a-8ec0-2573c0094d5f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1" status: 200 len: 1308 microversion: 2.1 time: 1.008450 Oct 04 21:14:14.264907 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1066/2170] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:13 2022] GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 => generated 1308 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:14.284654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ff2df7a8-72e4-4dd8-8436-db461da9bb26 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:14.291282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ff2df7a8-72e4-4dd8-8436-db461da9bb26 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:14.301395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff2df7a8-72e4-4dd8-8436-db461da9bb26 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:14.303825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff2df7a8-72e4-4dd8-8436-db461da9bb26 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:14.304530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff2df7a8-72e4-4dd8-8436-db461da9bb26 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:14.305493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff2df7a8-72e4-4dd8-8436-db461da9bb26 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:14.308235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff2df7a8-72e4-4dd8-8436-db461da9bb26 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:14.308963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff2df7a8-72e4-4dd8-8436-db461da9bb26 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:14.654767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-caf0cd8e-10c9-4eb1-b1a0-a61b1522fa32 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8630706184384900b96e774385ec420b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a3f169c94b49c097ef061ac48e52a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:14.707440 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-caf0cd8e-10c9-4eb1-b1a0-a61b1522fa32 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 200 len: 1327 microversion: 2.1 time: 2.032672 Oct 04 21:14:14.708186 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1105/2171] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:12 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 1327 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:14.735779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0734b84b-2c23-48f8-9dde-0f58304cafff tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:14.759210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0734b84b-2c23-48f8-9dde-0f58304cafff tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:14.772731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0734b84b-2c23-48f8-9dde-0f58304cafff tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:14.773563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0734b84b-2c23-48f8-9dde-0f58304cafff tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:14.778327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0734b84b-2c23-48f8-9dde-0f58304cafff tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:14.793091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0734b84b-2c23-48f8-9dde-0f58304cafff tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:14.793989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0734b84b-2c23-48f8-9dde-0f58304cafff tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:14.798359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0734b84b-2c23-48f8-9dde-0f58304cafff tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:15.255079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0734b84b-2c23-48f8-9dde-0f58304cafff tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:15.270926 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0734b84b-2c23-48f8-9dde-0f58304cafff tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1285 microversion: 2.1 time: 0.560689 Oct 04 21:14:15.271945 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1106/2172] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:14 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1285 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:15.286563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-9a4a433f-33b1-4569-83e7-fef9f4abaab1 req-2a0011b0-0356-4303-86d8-758f4473cdf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c974866c-d0de-4595-85b6-7404f349c6f1", "name": "network-vif-plugged", "status": "completed", "tag": "363ea383-0f2b-4176-8e31-c2e9325ecb59"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:15.359912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9a4a433f-33b1-4569-83e7-fef9f4abaab1 req-2a0011b0-0356-4303-86d8-758f4473cdf4 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:15.360402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9a4a433f-33b1-4569-83e7-fef9f4abaab1 req-2a0011b0-0356-4303-86d8-758f4473cdf4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:15.360841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9a4a433f-33b1-4569-83e7-fef9f4abaab1 req-2a0011b0-0356-4303-86d8-758f4473cdf4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:15.392796 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-9a4a433f-33b1-4569-83e7-fef9f4abaab1 req-2a0011b0-0356-4303-86d8-758f4473cdf4 service nova] Creating event network-vif-plugged:363ea383-0f2b-4176-8e31-c2e9325ecb59 for instance c974866c-d0de-4595-85b6-7404f349c6f1 on n-h2-860282-1 Oct 04 21:14:15.433683 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-9a4a433f-33b1-4569-83e7-fef9f4abaab1 req-2a0011b0-0356-4303-86d8-758f4473cdf4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152501 Oct 04 21:14:15.434354 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1107/2173] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:15.449674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-bccb8f47-b046-431f-b4c3-12497a57767a req-c4381c17-4950-4c42-95d3-ae3ef4160d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41063621-009d-455a-a56d-9ffbae52f46c", "name": "network-vif-deleted", "tag": "165120d0-97d6-48bd-b2b4-6ab812848c0b"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:15.495992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-bccb8f47-b046-431f-b4c3-12497a57767a req-c4381c17-4950-4c42-95d3-ae3ef4160d15 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:15.496710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-bccb8f47-b046-431f-b4c3-12497a57767a req-c4381c17-4950-4c42-95d3-ae3ef4160d15 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:15.497607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-bccb8f47-b046-431f-b4c3-12497a57767a req-c4381c17-4950-4c42-95d3-ae3ef4160d15 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:15.521620 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-bccb8f47-b046-431f-b4c3-12497a57767a req-c4381c17-4950-4c42-95d3-ae3ef4160d15 service nova] Creating event network-vif-deleted:165120d0-97d6-48bd-b2b4-6ab812848c0b for instance 41063621-009d-455a-a56d-9ffbae52f46c on n-h2-860282-1 Oct 04 21:14:15.527907 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-bccb8f47-b046-431f-b4c3-12497a57767a req-c4381c17-4950-4c42-95d3-ae3ef4160d15 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091637 Oct 04 21:14:15.529121 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1108/2174] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:15.537452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-64b23ab1-8306-41fb-979c-3480d3c2f9da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:15.538452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-64b23ab1-8306-41fb-979c-3480d3c2f9da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:15.546911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64b23ab1-8306-41fb-979c-3480d3c2f9da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:15.547680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64b23ab1-8306-41fb-979c-3480d3c2f9da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:15.548296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64b23ab1-8306-41fb-979c-3480d3c2f9da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:15.551803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64b23ab1-8306-41fb-979c-3480d3c2f9da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:15.551803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64b23ab1-8306-41fb-979c-3480d3c2f9da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:15.551803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64b23ab1-8306-41fb-979c-3480d3c2f9da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:15.811130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ff2df7a8-72e4-4dd8-8436-db461da9bb26 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150625a9472d43e0b0509ef044c58d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e3d4d14b240a3b934701459ada871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:15.832421 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ff2df7a8-72e4-4dd8-8436-db461da9bb26 tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 200 len: 1468 microversion: 2.1 time: 1.565686 Oct 04 21:14:15.836387 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1067/2175] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:14 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 1468 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:15.854554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-57611ff2-0e78-40f2-9883-10eef38ad1a2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:15.855249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-57611ff2-0e78-40f2-9883-10eef38ad1a2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:15.873744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57611ff2-0e78-40f2-9883-10eef38ad1a2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:15.874246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57611ff2-0e78-40f2-9883-10eef38ad1a2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:15.874687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57611ff2-0e78-40f2-9883-10eef38ad1a2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:15.876247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57611ff2-0e78-40f2-9883-10eef38ad1a2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:15.876901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57611ff2-0e78-40f2-9883-10eef38ad1a2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:15.892298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57611ff2-0e78-40f2-9883-10eef38ad1a2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:16.697894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-57611ff2-0e78-40f2-9883-10eef38ad1a2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8630706184384900b96e774385ec420b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a3f169c94b49c097ef061ac48e52a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:16.714211 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-57611ff2-0e78-40f2-9883-10eef38ad1a2 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 200 len: 1327 microversion: 2.1 time: 0.874058 Oct 04 21:14:16.714472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-64b23ab1-8306-41fb-979c-3480d3c2f9da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:16.715191 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1068/2176] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:15 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 1327 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:16.729876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-00dce677-9e0a-4c3e-89bc-61c7b36bd4b5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:16.731511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-00dce677-9e0a-4c3e-89bc-61c7b36bd4b5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:16.740763 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-64b23ab1-8306-41fb-979c-3480d3c2f9da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1" status: 200 len: 1308 microversion: 2.1 time: 1.209897 Oct 04 21:14:16.748203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00dce677-9e0a-4c3e-89bc-61c7b36bd4b5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:16.748998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00dce677-9e0a-4c3e-89bc-61c7b36bd4b5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:16.750006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00dce677-9e0a-4c3e-89bc-61c7b36bd4b5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:16.750926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00dce677-9e0a-4c3e-89bc-61c7b36bd4b5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:16.755142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00dce677-9e0a-4c3e-89bc-61c7b36bd4b5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:16.755945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00dce677-9e0a-4c3e-89bc-61c7b36bd4b5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:16.758582 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1109/2177] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:15 2022] GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 => generated 1308 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:16.858440 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a29ebfb3-7201-4c68-9b07-577c39d07e8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:16.859202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a29ebfb3-7201-4c68-9b07-577c39d07e8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] [instance: 41063621-009d-455a-a56d-9ffbae52f46c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:16.876281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a29ebfb3-7201-4c68-9b07-577c39d07e8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:16.877096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a29ebfb3-7201-4c68-9b07-577c39d07e8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:16.877879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a29ebfb3-7201-4c68-9b07-577c39d07e8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:16.879954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a29ebfb3-7201-4c68-9b07-577c39d07e8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:16.885133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a29ebfb3-7201-4c68-9b07-577c39d07e8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:16.885133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a29ebfb3-7201-4c68-9b07-577c39d07e8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:16.921072 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-a29ebfb3-7201-4c68-9b07-577c39d07e8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] HTTP exception thrown: Instance 41063621-009d-455a-a56d-9ffbae52f46c could not be found. Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a29ebfb3-7201-4c68-9b07-577c39d07e8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Request method failure captured: Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c HTTP/1.1 Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKCf9yyiZcOfG9wQE0mXchm3gM3-BLdAV2E2Cw3KmIPseB95kyUMu6izjk2Fb9-RRhkDo6uP2yfcEbbrXpfB_CIjQnCxYhyIF4Yce2NxHKLTleC43S5lJT37GbbbePFy6Ka5tkxDhTA1nO10dZHm8WGVjoen21KqHv-DqAIkeAsxY6o Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: e11e3d4d14b240a3b934701459ada871 Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-MigrationsAdminTest-1715070443 Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e11e3d4d14b240a3b934701459ada871"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e11e3d4d14b240a3b934701459ada871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e11e3d4d14b240a3b934701459ada871"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e11e3d4d14b240a3b934701459ada871"}]}] Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-MigrationsAdminTest-1715070443 Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: e11e3d4d14b240a3b934701459ada871 Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-MigrationsAdminTest-1715070443 Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-MigrationsAdminTest-1715070443-project Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 150625a9472d43e0b0509ef044c58d34 Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-MigrationsAdminTest-1715070443-project Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 41063621-009d-455a-a56d-9ffbae52f46c could not be found. Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '41063621-009d-455a-a56d-9ffbae52f46c'} Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41063621-009d-455a-a56d-9ffbae52f46c could not be found. Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41063621-009d-455a-a56d-9ffbae52f46c could not be found. Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:16.927649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:16.933334 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:16.933334 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:16.933334 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:16.933334 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:16.933334 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:16.933334 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41063621-009d-455a-a56d-9ffbae52f46c could not be found. Oct 04 21:14:16.933334 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:16.939850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a29ebfb3-7201-4c68-9b07-577c39d07e8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] Returning 404 to user: Instance 41063621-009d-455a-a56d-9ffbae52f46c could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:16.939850 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a29ebfb3-7201-4c68-9b07-577c39d07e8d tempest-MigrationsAdminTest-1715070443 tempest-MigrationsAdminTest-1715070443-project] 10.222.0.30 "GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c" status: 404 len: 111 microversion: 2.1 time: 0.081253 Oct 04 21:14:16.939850 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1110/2178] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:16 2022] GET /compute/v2.1/servers/41063621-009d-455a-a56d-9ffbae52f46c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:14:16.962463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-00dce677-9e0a-4c3e-89bc-61c7b36bd4b5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:16.971702 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-00dce677-9e0a-4c3e-89bc-61c7b36bd4b5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1283 microversion: 2.1 time: 0.255380 Oct 04 21:14:16.977183 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1069/2179] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:16 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1283 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:17.277155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c3514c6f-36ec-4a18-a45d-32db2904ef84 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:17.278128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c3514c6f-36ec-4a18-a45d-32db2904ef84 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:17.288634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3514c6f-36ec-4a18-a45d-32db2904ef84 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:17.289594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3514c6f-36ec-4a18-a45d-32db2904ef84 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:17.290326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3514c6f-36ec-4a18-a45d-32db2904ef84 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:17.292332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3514c6f-36ec-4a18-a45d-32db2904ef84 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:17.294963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3514c6f-36ec-4a18-a45d-32db2904ef84 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:17.295736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3514c6f-36ec-4a18-a45d-32db2904ef84 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:17.374058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c3514c6f-36ec-4a18-a45d-32db2904ef84 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:14:17.738685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-096e8157-8033-435d-852e-1bda1a426687 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:17.739334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-096e8157-8033-435d-852e-1bda1a426687 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:17.751830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-096e8157-8033-435d-852e-1bda1a426687 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:17.752664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-096e8157-8033-435d-852e-1bda1a426687 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:17.761325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-096e8157-8033-435d-852e-1bda1a426687 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:17.762321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-096e8157-8033-435d-852e-1bda1a426687 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:17.763017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-096e8157-8033-435d-852e-1bda1a426687 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:17.763634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-096e8157-8033-435d-852e-1bda1a426687 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:17.865684 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c3514c6f-36ec-4a18-a45d-32db2904ef84 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "DELETE /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 204 len: 0 microversion: 2.25 time: 0.594279 Oct 04 21:14:17.867827 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1111/2180] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:14:17 2022] DELETE /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:14:17.873600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3223cdaf-fb8b-4d4f-9020-5b37efd65c30 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:17.874856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3223cdaf-fb8b-4d4f-9020-5b37efd65c30 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:17.901371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3223cdaf-fb8b-4d4f-9020-5b37efd65c30 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:17.904548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3223cdaf-fb8b-4d4f-9020-5b37efd65c30 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:17.905266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3223cdaf-fb8b-4d4f-9020-5b37efd65c30 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:17.908021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3223cdaf-fb8b-4d4f-9020-5b37efd65c30 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:17.908730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3223cdaf-fb8b-4d4f-9020-5b37efd65c30 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:17.909877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3223cdaf-fb8b-4d4f-9020-5b37efd65c30 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:18.887979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-096e8157-8033-435d-852e-1bda1a426687 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8630706184384900b96e774385ec420b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a3f169c94b49c097ef061ac48e52a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:18.899729 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-096e8157-8033-435d-852e-1bda1a426687 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 200 len: 1327 microversion: 2.1 time: 1.164917 Oct 04 21:14:18.902573 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1070/2181] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:17 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 1327 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:18.909171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-61d88753-4748-4862-be48-83142d0209dd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:18.910258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-61d88753-4748-4862-be48-83142d0209dd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:18.923228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61d88753-4748-4862-be48-83142d0209dd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:18.924522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61d88753-4748-4862-be48-83142d0209dd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:18.925376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61d88753-4748-4862-be48-83142d0209dd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:18.927044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61d88753-4748-4862-be48-83142d0209dd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:18.927723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61d88753-4748-4862-be48-83142d0209dd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:18.928348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61d88753-4748-4862-be48-83142d0209dd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:19.010384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3223cdaf-fb8b-4d4f-9020-5b37efd65c30 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:19.022837 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3223cdaf-fb8b-4d4f-9020-5b37efd65c30 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1" status: 200 len: 1488 microversion: 2.1 time: 1.153280 Oct 04 21:14:19.034842 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1112/2182] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:17 2022] GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 => generated 1488 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:19.048911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0980c514-7842-465d-8136-7ce34cd93ac3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:19.053342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0980c514-7842-465d-8136-7ce34cd93ac3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:19.067575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0980c514-7842-465d-8136-7ce34cd93ac3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:19.068371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0980c514-7842-465d-8136-7ce34cd93ac3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:19.069064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0980c514-7842-465d-8136-7ce34cd93ac3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:19.070086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0980c514-7842-465d-8136-7ce34cd93ac3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:19.070898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0980c514-7842-465d-8136-7ce34cd93ac3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:19.071543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0980c514-7842-465d-8136-7ce34cd93ac3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:19.793253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-61d88753-4748-4862-be48-83142d0209dd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:19.823459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-61d88753-4748-4862-be48-83142d0209dd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:19.828412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0980c514-7842-465d-8136-7ce34cd93ac3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:19.831467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-61d88753-4748-4862-be48-83142d0209dd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:19.835855 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-61d88753-4748-4862-be48-83142d0209dd tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1733 microversion: 2.25 time: 0.931873 Oct 04 21:14:19.839561 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1071/2183] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:18 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1733 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:14:19.847289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6770c41e-6b31-473b-bc97-8534373d4983 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:19.848917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6770c41e-6b31-473b-bc97-8534373d4983 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:19.857161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6770c41e-6b31-473b-bc97-8534373d4983 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:19.858378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6770c41e-6b31-473b-bc97-8534373d4983 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:19.859037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6770c41e-6b31-473b-bc97-8534373d4983 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:19.859987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6770c41e-6b31-473b-bc97-8534373d4983 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:19.876643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6770c41e-6b31-473b-bc97-8534373d4983 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:19.876643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6770c41e-6b31-473b-bc97-8534373d4983 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:19.893004 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0980c514-7842-465d-8136-7ce34cd93ac3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1325 microversion: 2.1 time: 0.853302 Oct 04 21:14:19.896412 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1113/2184] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:19 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1325 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:19.907965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-3b94956a-9485-4492-a6a8-89d689e62156 req-b773120b-e2be-48b1-b59a-f43759a65862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa44d77-6583-4a52-9bcc-b9af99d2bd9f", "name": "network-vif-plugged", "status": "completed", "tag": "e8e0b120-1d09-4f06-b791-627091bb7ecb"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:19.944850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3b94956a-9485-4492-a6a8-89d689e62156 req-b773120b-e2be-48b1-b59a-f43759a65862 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:19.945358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3b94956a-9485-4492-a6a8-89d689e62156 req-b773120b-e2be-48b1-b59a-f43759a65862 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:19.945821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3b94956a-9485-4492-a6a8-89d689e62156 req-b773120b-e2be-48b1-b59a-f43759a65862 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:19.954846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-6770c41e-6b31-473b-bc97-8534373d4983 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lazy-loading 'flavor' on Instance uuid c974866c-d0de-4595-85b6-7404f349c6f1 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:14:19.980166 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-3b94956a-9485-4492-a6a8-89d689e62156 req-b773120b-e2be-48b1-b59a-f43759a65862 service nova] Creating event network-vif-plugged:e8e0b120-1d09-4f06-b791-627091bb7ecb for instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f on n-h2-860282-1 Oct 04 21:14:20.000874 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-3b94956a-9485-4492-a6a8-89d689e62156 req-b773120b-e2be-48b1-b59a-f43759a65862 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096174 Oct 04 21:14:20.003929 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1114/2185] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:20.019929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-10b6ce89-839b-4ec5-850f-86de8cfe518f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:20.023225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-10b6ce89-839b-4ec5-850f-86de8cfe518f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:20.047491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-10b6ce89-839b-4ec5-850f-86de8cfe518f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:20.048276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-10b6ce89-839b-4ec5-850f-86de8cfe518f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:20.049657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-10b6ce89-839b-4ec5-850f-86de8cfe518f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:20.052332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-10b6ce89-839b-4ec5-850f-86de8cfe518f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:20.053035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-10b6ce89-839b-4ec5-850f-86de8cfe518f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:20.055186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-10b6ce89-839b-4ec5-850f-86de8cfe518f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:20.063034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:20.348977 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6770c41e-6b31-473b-bc97-8534373d4983 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "POST /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1/action" status: 202 len: 0 microversion: 2.1 time: 0.506855 Oct 04 21:14:20.350943 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1072/2186] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:14:19 2022] POST /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:14:20.373368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-49f37d7d-722c-4510-8793-9a3bd1b2c2ac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:20.374112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-49f37d7d-722c-4510-8793-9a3bd1b2c2ac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:20.399524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49f37d7d-722c-4510-8793-9a3bd1b2c2ac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:20.402654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49f37d7d-722c-4510-8793-9a3bd1b2c2ac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:20.406641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49f37d7d-722c-4510-8793-9a3bd1b2c2ac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:20.407701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49f37d7d-722c-4510-8793-9a3bd1b2c2ac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:20.408185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49f37d7d-722c-4510-8793-9a3bd1b2c2ac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:20.408657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49f37d7d-722c-4510-8793-9a3bd1b2c2ac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:20.576986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:20.653187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-10b6ce89-839b-4ec5-850f-86de8cfe518f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8630706184384900b96e774385ec420b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a3f169c94b49c097ef061ac48e52a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:20.668119 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-10b6ce89-839b-4ec5-850f-86de8cfe518f tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 200 len: 1327 microversion: 2.1 time: 0.660422 Oct 04 21:14:20.669805 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1115/2187] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:20 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 1327 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:20.868236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-71c7cc62-3ceb-42f1-b779-f9df758b24a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:20.868916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-71c7cc62-3ceb-42f1-b779-f9df758b24a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:20.887081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71c7cc62-3ceb-42f1-b779-f9df758b24a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:20.888679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71c7cc62-3ceb-42f1-b779-f9df758b24a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:20.892419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71c7cc62-3ceb-42f1-b779-f9df758b24a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:20.895369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71c7cc62-3ceb-42f1-b779-f9df758b24a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:20.897218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71c7cc62-3ceb-42f1-b779-f9df758b24a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:20.898188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71c7cc62-3ceb-42f1-b779-f9df758b24a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:21.189129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-71c7cc62-3ceb-42f1-b779-f9df758b24a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:21.200021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-49f37d7d-722c-4510-8793-9a3bd1b2c2ac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:21.208093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-71c7cc62-3ceb-42f1-b779-f9df758b24a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:21.210771 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-49f37d7d-722c-4510-8793-9a3bd1b2c2ac tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1" status: 200 len: 1496 microversion: 2.1 time: 0.848185 Oct 04 21:14:21.210971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-71c7cc62-3ceb-42f1-b779-f9df758b24a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:21.212131 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1073/2188] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:20 2022] GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 => generated 1496 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:21.218345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2c65cb98-e260-4d1d-b15f-9df122e2ddb4 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:21.219356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2c65cb98-e260-4d1d-b15f-9df122e2ddb4 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:21.226554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c65cb98-e260-4d1d-b15f-9df122e2ddb4 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:21.227283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c65cb98-e260-4d1d-b15f-9df122e2ddb4 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:21.227917 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-71c7cc62-3ceb-42f1-b779-f9df758b24a3 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 200 len: 1666 microversion: 2.25 time: 0.348999 Oct 04 21:14:21.228152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c65cb98-e260-4d1d-b15f-9df122e2ddb4 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:21.241444 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1116/2189] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:20 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 1666 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:14:21.241444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-b45f51b9-11d0-4959-9483-2024be386d9a req-d9c9db0f-96e0-4977-b34f-553a7cd5faf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "191d63c3-2de0-4d3a-85f1-c4be3d2f5432", "name": "network-vif-deleted", "tag": "816da828-8532-4f45-bd81-2b2098519c9f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:21.253721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b45f51b9-11d0-4959-9483-2024be386d9a req-d9c9db0f-96e0-4977-b34f-553a7cd5faf0 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:21.254220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b45f51b9-11d0-4959-9483-2024be386d9a req-d9c9db0f-96e0-4977-b34f-553a7cd5faf0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:21.254578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c65cb98-e260-4d1d-b15f-9df122e2ddb4 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:21.254745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b45f51b9-11d0-4959-9483-2024be386d9a req-d9c9db0f-96e0-4977-b34f-553a7cd5faf0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:21.255914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c65cb98-e260-4d1d-b15f-9df122e2ddb4 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:21.256877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c65cb98-e260-4d1d-b15f-9df122e2ddb4 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:21.275540 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-b45f51b9-11d0-4959-9483-2024be386d9a req-d9c9db0f-96e0-4977-b34f-553a7cd5faf0 service nova] Creating event network-vif-deleted:816da828-8532-4f45-bd81-2b2098519c9f for instance 191d63c3-2de0-4d3a-85f1-c4be3d2f5432 on n-h1-860282-1 Oct 04 21:14:21.281787 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-b45f51b9-11d0-4959-9483-2024be386d9a req-d9c9db0f-96e0-4977-b34f-553a7cd5faf0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047538 Oct 04 21:14:21.286689 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1117/2190] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:21.694215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:21.696330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2c65cb98-e260-4d1d-b15f-9df122e2ddb4 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:21.699948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2352d11d-b256-4004-b3bc-7e41ef00ce66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:21.701133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2352d11d-b256-4004-b3bc-7e41ef00ce66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:21.715078 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2c65cb98-e260-4d1d-b15f-9df122e2ddb4 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1325 microversion: 2.1 time: 0.490276 Oct 04 21:14:21.715078 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1074/2191] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:21 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1325 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:21.725679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2352d11d-b256-4004-b3bc-7e41ef00ce66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:21.726187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2352d11d-b256-4004-b3bc-7e41ef00ce66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:21.752758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2352d11d-b256-4004-b3bc-7e41ef00ce66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:21.757784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2352d11d-b256-4004-b3bc-7e41ef00ce66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:21.758391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2352d11d-b256-4004-b3bc-7e41ef00ce66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:21.758856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2352d11d-b256-4004-b3bc-7e41ef00ce66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:22.246689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ad86059a-c7f6-4f92-a8e3-2aa7b6905e8c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:22.247491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ad86059a-c7f6-4f92-a8e3-2aa7b6905e8c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:22.262191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad86059a-c7f6-4f92-a8e3-2aa7b6905e8c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:22.270025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad86059a-c7f6-4f92-a8e3-2aa7b6905e8c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:22.270485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad86059a-c7f6-4f92-a8e3-2aa7b6905e8c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:22.276888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad86059a-c7f6-4f92-a8e3-2aa7b6905e8c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:22.278899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad86059a-c7f6-4f92-a8e3-2aa7b6905e8c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:22.286102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad86059a-c7f6-4f92-a8e3-2aa7b6905e8c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:22.622506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2352d11d-b256-4004-b3bc-7e41ef00ce66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8630706184384900b96e774385ec420b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a3f169c94b49c097ef061ac48e52a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:22.633738 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2352d11d-b256-4004-b3bc-7e41ef00ce66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 200 len: 1327 microversion: 2.1 time: 0.938967 Oct 04 21:14:22.649457 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1118/2192] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:21 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 1327 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:22.651491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5e45c3b2-c844-4059-849b-e8383cf96d8b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:22.652201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5e45c3b2-c844-4059-849b-e8383cf96d8b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 191d63c3-2de0-4d3a-85f1-c4be3d2f5432] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:22.685644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e45c3b2-c844-4059-849b-e8383cf96d8b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:22.685644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e45c3b2-c844-4059-849b-e8383cf96d8b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:22.685644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e45c3b2-c844-4059-849b-e8383cf96d8b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:22.685644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e45c3b2-c844-4059-849b-e8383cf96d8b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:22.685644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e45c3b2-c844-4059-849b-e8383cf96d8b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:22.685644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e45c3b2-c844-4059-849b-e8383cf96d8b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:22.701738 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-5e45c3b2-c844-4059-849b-e8383cf96d8b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] HTTP exception thrown: Instance 191d63c3-2de0-4d3a-85f1-c4be3d2f5432 could not be found. Oct 04 21:14:22.702004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5e45c3b2-c844-4059-849b-e8383cf96d8b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Request method failure captured: Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 HTTP/1.1 Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKBoglkS0qD8SmxZe3mirsDTnSE-aaQetnJDczd2syhpWxq0p15FnusWK_on0F377rdG9PVjJwVI0OpcTwAspbepOQF6jNZgjexGJEuHoo4cDL_yI4yGAt-USxC7jzHrRkF8TGmuEMTzBbdXXcBTleyLT_69wwQ76fiHG5HItf35yUA Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: d06810bbad6e4914aa53b43ef390f52e Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1744975960 Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d06810bbad6e4914aa53b43ef390f52e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d06810bbad6e4914aa53b43ef390f52e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d06810bbad6e4914aa53b43ef390f52e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d06810bbad6e4914aa53b43ef390f52e"}]}] Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1744975960 Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: d06810bbad6e4914aa53b43ef390f52e Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1744975960 Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-LiveAutoBlockMigrationV225Test-1744975960-project Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 95f0cc0f93b244cea8818c7bbdcfb90a Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1744975960-project Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 191d63c3-2de0-4d3a-85f1-c4be3d2f5432 could not be found. Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '191d63c3-2de0-4d3a-85f1-c4be3d2f5432'} Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 191d63c3-2de0-4d3a-85f1-c4be3d2f5432 could not be found. Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 191d63c3-2de0-4d3a-85f1-c4be3d2f5432 could not be found. Oct 04 21:14:22.704088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:22.716866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:22.716866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:22.716866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:22.716866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:22.716866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:22.716866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:22.716866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:22.716866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 191d63c3-2de0-4d3a-85f1-c4be3d2f5432 could not be found. Oct 04 21:14:22.716866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:22.716866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5e45c3b2-c844-4059-849b-e8383cf96d8b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Returning 404 to user: Instance 191d63c3-2de0-4d3a-85f1-c4be3d2f5432 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:22.716866 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5e45c3b2-c844-4059-849b-e8383cf96d8b tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432" status: 404 len: 111 microversion: 2.25 time: 0.073140 Oct 04 21:14:22.716866 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1119/2193] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:22 2022] GET /compute/v2.1/servers/191d63c3-2de0-4d3a-85f1-c4be3d2f5432 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:14:22.725652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b34e2708-2605-4a69-8898-e3bd07e7ccf1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '.version_select at 0x7f578beca3a0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:22.757777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ad86059a-c7f6-4f92-a8e3-2aa7b6905e8c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:22.767623 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ad86059a-c7f6-4f92-a8e3-2aa7b6905e8c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1" status: 200 len: 1479 microversion: 2.1 time: 0.530904 Oct 04 21:14:22.774897 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1075/2194] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:22 2022] GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 => generated 1479 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:22.781167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-67cff0ec-33d4-4eb2-9972-80288713e354 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:22.782100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-67cff0ec-33d4-4eb2-9972-80288713e354 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:22.791883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67cff0ec-33d4-4eb2-9972-80288713e354 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:22.792975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67cff0ec-33d4-4eb2-9972-80288713e354 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:22.795215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67cff0ec-33d4-4eb2-9972-80288713e354 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:22.797657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67cff0ec-33d4-4eb2-9972-80288713e354 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:22.799506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67cff0ec-33d4-4eb2-9972-80288713e354 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:22.801686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67cff0ec-33d4-4eb2-9972-80288713e354 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:22.829254 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b34e2708-2605-4a69-8898-e3bd07e7ccf1 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1793215724" status: 204 len: 0 microversion: 2.25 time: 0.108546 Oct 04 21:14:22.833062 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1120/2195] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Oct 4 21:14:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1793215724 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:14:22.838285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5ac34396-bf4f-4c64-b711-a03f654e6f41 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2005766074"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:22.840593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5ac34396-bf4f-4c64-b711-a03f654e6f41 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:22.860574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ac34396-bf4f-4c64-b711-a03f654e6f41 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:22.861058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ac34396-bf4f-4c64-b711-a03f654e6f41 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:22.861700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ac34396-bf4f-4c64-b711-a03f654e6f41 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:22.862598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ac34396-bf4f-4c64-b711-a03f654e6f41 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:22.863112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ac34396-bf4f-4c64-b711-a03f654e6f41 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:22.863720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ac34396-bf4f-4c64-b711-a03f654e6f41 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:23.222559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-67cff0ec-33d4-4eb2-9972-80288713e354 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:23.235749 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-67cff0ec-33d4-4eb2-9972-80288713e354 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1325 microversion: 2.1 time: 0.459220 Oct 04 21:14:23.240157 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1076/2196] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:22 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1325 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:23.417614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-93e79b60-7eb4-4057-b490-251504aafa01 req-b824c10a-c88c-4895-ae97-51c6edb1048b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05f65528-e8a7-4637-a1bf-1baf79b315eb", "tag": "1e00c2db-7a7f-4cda-bc8c-64d2291e2563"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:23.444882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-93e79b60-7eb4-4057-b490-251504aafa01 req-b824c10a-c88c-4895-ae97-51c6edb1048b service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:23.449392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-93e79b60-7eb4-4057-b490-251504aafa01 req-b824c10a-c88c-4895-ae97-51c6edb1048b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:23.449392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-93e79b60-7eb4-4057-b490-251504aafa01 req-b824c10a-c88c-4895-ae97-51c6edb1048b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:23.465440 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-93e79b60-7eb4-4057-b490-251504aafa01 req-b824c10a-c88c-4895-ae97-51c6edb1048b service nova] Creating event network-changed:1e00c2db-7a7f-4cda-bc8c-64d2291e2563 for instance 05f65528-e8a7-4637-a1bf-1baf79b315eb on n-h1-860282-1 Oct 04 21:14:23.487627 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-93e79b60-7eb4-4057-b490-251504aafa01 req-b824c10a-c88c-4895-ae97-51c6edb1048b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070306 Oct 04 21:14:23.487627 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1077/2197] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:23.600550 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5ac34396-bf4f-4c64-b711-a03f654e6f41 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "POST /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1/action" status: 202 len: 0 microversion: 2.1 time: 0.765961 Oct 04 21:14:23.608953 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1121/2198] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:14:22 2022] POST /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1/action => generated 0 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 21:14:23.618262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0ec18683-c91e-44b9-8fd7-2ae60a83edc3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f578baad5e0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:23.663836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa50866a-db41-46ee-84fc-6a52e226b2ed tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:23.664554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aa50866a-db41-46ee-84fc-6a52e226b2ed tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:23.690478 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0ec18683-c91e-44b9-8fd7-2ae60a83edc3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3" status: 200 len: 1440 microversion: 2.1 time: 0.082365 Oct 04 21:14:23.691069 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1078/2199] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:14:23 2022] GET /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3 => generated 1440 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:14:23.692950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa50866a-db41-46ee-84fc-6a52e226b2ed tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:23.693575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa50866a-db41-46ee-84fc-6a52e226b2ed tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:23.693913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa50866a-db41-46ee-84fc-6a52e226b2ed tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:23.697633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa50866a-db41-46ee-84fc-6a52e226b2ed tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:23.700000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa50866a-db41-46ee-84fc-6a52e226b2ed tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:23.703551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa50866a-db41-46ee-84fc-6a52e226b2ed tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:24.041699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aa50866a-db41-46ee-84fc-6a52e226b2ed tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8630706184384900b96e774385ec420b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a3f169c94b49c097ef061ac48e52a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:24.052492 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aa50866a-db41-46ee-84fc-6a52e226b2ed tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 200 len: 1526 microversion: 2.1 time: 0.392866 Oct 04 21:14:24.080669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-24832950-38a6-490d-887c-14cc5c2df5cc tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:24.081413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-24832950-38a6-490d-887c-14cc5c2df5cc tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:24.087416 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1122/2200] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:23 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 1526 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:24.091185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24832950-38a6-490d-887c-14cc5c2df5cc tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:24.091910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24832950-38a6-490d-887c-14cc5c2df5cc tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:24.092556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24832950-38a6-490d-887c-14cc5c2df5cc tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:24.093479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24832950-38a6-490d-887c-14cc5c2df5cc tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:24.094112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24832950-38a6-490d-887c-14cc5c2df5cc tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:24.094715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24832950-38a6-490d-887c-14cc5c2df5cc tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:24.271326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3426e357-e1c7-4738-a406-77d21f6ec1e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:24.276956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3426e357-e1c7-4738-a406-77d21f6ec1e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:24.285944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3426e357-e1c7-4738-a406-77d21f6ec1e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:24.286731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3426e357-e1c7-4738-a406-77d21f6ec1e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:24.287421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3426e357-e1c7-4738-a406-77d21f6ec1e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:24.288332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3426e357-e1c7-4738-a406-77d21f6ec1e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:24.288964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3426e357-e1c7-4738-a406-77d21f6ec1e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:24.289733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3426e357-e1c7-4738-a406-77d21f6ec1e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:24.631602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-24832950-38a6-490d-887c-14cc5c2df5cc tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8630706184384900b96e774385ec420b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a3f169c94b49c097ef061ac48e52a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:24.644466 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-24832950-38a6-490d-887c-14cc5c2df5cc tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 200 len: 1526 microversion: 2.1 time: 0.567772 Oct 04 21:14:24.645257 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1079/2201] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:24 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 1526 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:24.858568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3426e357-e1c7-4738-a406-77d21f6ec1e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:24.874261 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3426e357-e1c7-4738-a406-77d21f6ec1e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1325 microversion: 2.1 time: 0.608066 Oct 04 21:14:24.885628 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1123/2202] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:24 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1325 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:14:25.011367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ac90301a-61cb-4f2a-8d92-dbf51d05ab42 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Action: 'update', calling method: .version_select at 0x7f578ba95280>, body: {"quota_set": {"ram": "5120"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:25.204288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-27576cd1-009f-4699-a361-314a59a0fc52 tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:25.204814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-27576cd1-009f-4699-a361-314a59a0fc52 tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:25.214984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27576cd1-009f-4699-a361-314a59a0fc52 tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:25.215493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27576cd1-009f-4699-a361-314a59a0fc52 tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:25.215945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27576cd1-009f-4699-a361-314a59a0fc52 tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:25.216670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27576cd1-009f-4699-a361-314a59a0fc52 tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:25.220822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27576cd1-009f-4699-a361-314a59a0fc52 tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:25.224747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27576cd1-009f-4699-a361-314a59a0fc52 tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:25.256431 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-27576cd1-009f-4699-a361-314a59a0fc52 tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] HTTP exception thrown: Instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f could not be found. Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-27576cd1-009f-4699-a361-314a59a0fc52 tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] Request method failure captured: Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f HTTP/1.1 Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKINMcVrh4kf8L6Z6bS81yHrcIFnOQ-77MLlvsxJk3z-_WZbuxbDa5Ip1O0dDts-Trryof34f67nmwVvQHKueNwbmGGGlwGle0q4fRKJSZfbvwEYBItUXQ7LC0ue3aNls4-LwZh25ogTUDihZe_JIz2rEeZxVOievoC-OnpUl1XelsQ Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 98633d48fa78497ebb873c4be2fa3b9a Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-880794068 Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/98633d48fa78497ebb873c4be2fa3b9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_98633d48fa78497ebb873c4be2fa3b9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/98633d48fa78497ebb873c4be2fa3b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/98633d48fa78497ebb873c4be2fa3b9a"}]}] Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-880794068 Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 98633d48fa78497ebb873c4be2fa3b9a Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-880794068 Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestMultiTenantJSON-880794068-project Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 09c7067a2e1046a4930fe3c0adf2c6e9 Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-880794068-project Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f could not be found. Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'aaa44d77-6583-4a52-9bcc-b9af99d2bd9f'} Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f could not be found. Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:14:25.259890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:14:25.266875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f could not be found. Oct 04 21:14:25.266875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:25.266875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:25.266875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:25.266875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:25.266875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:25.266875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:25.266875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:25.266875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:25.266875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f could not be found. Oct 04 21:14:25.266875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:25.266875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-27576cd1-009f-4699-a361-314a59a0fc52 tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] Returning 404 to user: Instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:25.266875 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-27576cd1-009f-4699-a361-314a59a0fc52 tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 404 len: 111 microversion: 2.1 time: 0.383866 Oct 04 21:14:25.266875 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1124/2203] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:14:24 2022] DELETE /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 111 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:14:25.276961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2b7f576f-a9fe-4694-a077-0e69ac435fda tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f578becac10>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:25.356462 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2b7f576f-a9fe-4694-a077-0e69ac435fda tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3" status: 200 len: 1440 microversion: 2.1 time: 0.091870 Oct 04 21:14:25.366901 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1125/2204] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:14:25 2022] GET /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3 => generated 1440 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:25.370762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1b71f52d-182a-40e4-9a98-366a423f0d66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:25.372918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1b71f52d-182a-40e4-9a98-366a423f0d66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:25.397555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b71f52d-182a-40e4-9a98-366a423f0d66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:25.398459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b71f52d-182a-40e4-9a98-366a423f0d66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:25.401368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b71f52d-182a-40e4-9a98-366a423f0d66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:25.402761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b71f52d-182a-40e4-9a98-366a423f0d66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:25.410896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b71f52d-182a-40e4-9a98-366a423f0d66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:25.419222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b71f52d-182a-40e4-9a98-366a423f0d66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:25.469802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac90301a-61cb-4f2a-8d92-dbf51d05ab42 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:25.470357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac90301a-61cb-4f2a-8d92-dbf51d05ab42 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:25.470805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac90301a-61cb-4f2a-8d92-dbf51d05ab42 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:25.471660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac90301a-61cb-4f2a-8d92-dbf51d05ab42 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:25.472130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac90301a-61cb-4f2a-8d92-dbf51d05ab42 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:25.472565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac90301a-61cb-4f2a-8d92-dbf51d05ab42 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:25.608574 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ac90301a-61cb-4f2a-8d92-dbf51d05ab42 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/ade228e20519401e90f700128cd0f4ff" status: 200 len: 148 microversion: 2.57 time: 0.940835 Oct 04 21:14:25.610361 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1080/2205] 10.222.0.30 () {62 vars in 1303 bytes} [Tue Oct 4 21:14:24 2022] PUT /compute/v2.1/os-quota-sets/ade228e20519401e90f700128cd0f4ff => generated 148 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:14:25.623598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-084ebdb7-df6d-4310-8a07-9281e9aba58a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:25.623598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-084ebdb7-df6d-4310-8a07-9281e9aba58a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:25.638532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-084ebdb7-df6d-4310-8a07-9281e9aba58a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:25.640851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-084ebdb7-df6d-4310-8a07-9281e9aba58a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:25.641331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-084ebdb7-df6d-4310-8a07-9281e9aba58a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:25.642113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-084ebdb7-df6d-4310-8a07-9281e9aba58a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:25.642597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-084ebdb7-df6d-4310-8a07-9281e9aba58a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:25.645282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-084ebdb7-df6d-4310-8a07-9281e9aba58a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:25.656195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:25.661123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1b71f52d-182a-40e4-9a98-366a423f0d66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8630706184384900b96e774385ec420b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a3f169c94b49c097ef061ac48e52a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:25.678156 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1b71f52d-182a-40e4-9a98-366a423f0d66 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 200 len: 1526 microversion: 2.1 time: 0.313681 Oct 04 21:14:25.682784 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1126/2206] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:25 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 1526 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:25.701483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f5cdea91-1f4a-4451-af86-2311c37db3ba tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Calling method '.version_select at 0x7f57945638b0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:25.709462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-084ebdb7-df6d-4310-8a07-9281e9aba58a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:14:26.080320 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-084ebdb7-df6d-4310-8a07-9281e9aba58a tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 204 len: 0 microversion: 2.25 time: 0.464509 Oct 04 21:14:26.085402 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1081/2207] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:14:25 2022] DELETE /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:14:26.097124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ed9bddd5-35ff-4327-9a2c-a8da0e2e0b2f tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] Action: 'update', calling method: >, body: {"server": {"name": "aaa44d77-6583-4a52-9bcc-b9af99d2bd9f_new"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:26.103424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ed9bddd5-35ff-4327-9a2c-a8da0e2e0b2f tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:26.122442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed9bddd5-35ff-4327-9a2c-a8da0e2e0b2f tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:26.123050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed9bddd5-35ff-4327-9a2c-a8da0e2e0b2f tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:26.123495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed9bddd5-35ff-4327-9a2c-a8da0e2e0b2f tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:26.124251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed9bddd5-35ff-4327-9a2c-a8da0e2e0b2f tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:26.124711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed9bddd5-35ff-4327-9a2c-a8da0e2e0b2f tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:26.125138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed9bddd5-35ff-4327-9a2c-a8da0e2e0b2f tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:26.163733 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-ed9bddd5-35ff-4327-9a2c-a8da0e2e0b2f tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] HTTP exception thrown: Instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f could not be found. Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ed9bddd5-35ff-4327-9a2c-a8da0e2e0b2f tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] Request method failure captured: Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: request: PUT /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f HTTP/1.1 Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 64 Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKINMcVrh4kf8L6Z6bS81yHrcIFnOQ-77MLlvsxJk3z-_WZbuxbDa5Ip1O0dDts-Trryof34f67nmwVvQHKueNwbmGGGlwGle0q4fRKJSZfbvwEYBItUXQ7LC0ue3aNls4-LwZh25ogTUDihZe_JIz2rEeZxVOievoC-OnpUl1XelsQ Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 98633d48fa78497ebb873c4be2fa3b9a Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-880794068 Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/98633d48fa78497ebb873c4be2fa3b9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_98633d48fa78497ebb873c4be2fa3b9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/98633d48fa78497ebb873c4be2fa3b9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/98633d48fa78497ebb873c4be2fa3b9a"}]}] Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-880794068 Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 98633d48fa78497ebb873c4be2fa3b9a Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-880794068 Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestMultiTenantJSON-880794068-project Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 09c7067a2e1046a4930fe3c0adf2c6e9 Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-880794068-project Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: {"server": {"name": "aaa44d77-6583-4a52-9bcc-b9af99d2bd9f_new"}} Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f could not be found. Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'aaa44d77-6583-4a52-9bcc-b9af99d2bd9f', 'body': {'server': {'name': 'aaa44d77-6583-4a52-9bcc-b9af99d2bd9f_new'}}} Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f could not be found. Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:14:26.170762 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 21:14:26.176526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 21:14:26.176526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 21:14:26.176526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:14:26.176526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:14:26.176526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:14:26.176526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:14:26.176526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f could not be found. Oct 04 21:14:26.176526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:26.176526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:26.176526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:26.176526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:26.176526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:26.176526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:26.176526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:26.176526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:26.176526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f could not be found. Oct 04 21:14:26.176526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:26.176526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ed9bddd5-35ff-4327-9a2c-a8da0e2e0b2f tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] Returning 404 to user: Instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:26.180708 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ed9bddd5-35ff-4327-9a2c-a8da0e2e0b2f tempest-ServersNegativeTestMultiTenantJSON-880794068 tempest-ServersNegativeTestMultiTenantJSON-880794068-project] 10.222.0.30 "PUT /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 404 len: 111 microversion: 2.1 time: 0.083658 Oct 04 21:14:26.182979 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1082/2208] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Oct 4 21:14:26 2022] PUT /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:14:26.195810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3b135a84-cfa1-49be-8b76-5ab3999efbbd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:26.201481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3b135a84-cfa1-49be-8b76-5ab3999efbbd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:26.208248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b135a84-cfa1-49be-8b76-5ab3999efbbd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:26.208745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b135a84-cfa1-49be-8b76-5ab3999efbbd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:26.209188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b135a84-cfa1-49be-8b76-5ab3999efbbd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:26.209935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b135a84-cfa1-49be-8b76-5ab3999efbbd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:26.210388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b135a84-cfa1-49be-8b76-5ab3999efbbd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:26.211175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b135a84-cfa1-49be-8b76-5ab3999efbbd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:26.261022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5cdea91-1f4a-4451-af86-2311c37db3ba tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:26.265502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5cdea91-1f4a-4451-af86-2311c37db3ba tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:26.266276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5cdea91-1f4a-4451-af86-2311c37db3ba tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:26.267517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5cdea91-1f4a-4451-af86-2311c37db3ba tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:26.268922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5cdea91-1f4a-4451-af86-2311c37db3ba tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:26.269947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5cdea91-1f4a-4451-af86-2311c37db3ba tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:26.352254 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f5cdea91-1f4a-4451-af86-2311c37db3ba tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/ade228e20519401e90f700128cd0f4ff/detail" status: 200 len: 463 microversion: 2.57 time: 0.671260 Oct 04 21:14:26.354390 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1127/2209] 10.222.0.30 () {60 vars in 1304 bytes} [Tue Oct 4 21:14:25 2022] GET /compute/v2.1/os-quota-sets/ade228e20519401e90f700128cd0f4ff/detail => generated 463 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:14:26.683247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3b135a84-cfa1-49be-8b76-5ab3999efbbd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:26.692596 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3b135a84-cfa1-49be-8b76-5ab3999efbbd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1325 microversion: 2.1 time: 0.504559 Oct 04 21:14:26.696343 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1083/2210] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:26 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1325 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:26.737401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-964d5064-3791-4fad-bebb-6582e4ced3f8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:26.739054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-964d5064-3791-4fad-bebb-6582e4ced3f8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:26.771257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-964d5064-3791-4fad-bebb-6582e4ced3f8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:26.771873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-964d5064-3791-4fad-bebb-6582e4ced3f8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:26.773520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-964d5064-3791-4fad-bebb-6582e4ced3f8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:26.775120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-964d5064-3791-4fad-bebb-6582e4ced3f8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:26.779417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-964d5064-3791-4fad-bebb-6582e4ced3f8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:26.779890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-964d5064-3791-4fad-bebb-6582e4ced3f8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:26.873047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b90a204b-78ca-405b-9d12-d66e717b4970 tempest-SecurityGroupsTestAdminJSON-1016092140 tempest-SecurityGroupsTestAdminJSON-1016092140-project] Action: 'create', calling method: .version_select at 0x7f5791ac0550>, body: {"security_group": {"name": "tempest-securitygroup-206899906", "description": "tempest-description-1297442383"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:27.747170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-964d5064-3791-4fad-bebb-6582e4ced3f8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:27.757486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-964d5064-3791-4fad-bebb-6582e4ced3f8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:27.761064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-964d5064-3791-4fad-bebb-6582e4ced3f8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:27.771089 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-964d5064-3791-4fad-bebb-6582e4ced3f8 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 200 len: 1549 microversion: 2.25 time: 1.064936 Oct 04 21:14:27.775795 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1084/2211] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:26 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 1549 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:14:27.803880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-26e3f8a2-77f7-48e6-a2cd-36fc045c8281 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:27.804605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-26e3f8a2-77f7-48e6-a2cd-36fc045c8281 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:27.824754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26e3f8a2-77f7-48e6-a2cd-36fc045c8281 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:27.835008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26e3f8a2-77f7-48e6-a2cd-36fc045c8281 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:27.835752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26e3f8a2-77f7-48e6-a2cd-36fc045c8281 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:27.837332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26e3f8a2-77f7-48e6-a2cd-36fc045c8281 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:27.844250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26e3f8a2-77f7-48e6-a2cd-36fc045c8281 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:27.845716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26e3f8a2-77f7-48e6-a2cd-36fc045c8281 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:27.921613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-26e3f8a2-77f7-48e6-a2cd-36fc045c8281 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:14:28.392319 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-26e3f8a2-77f7-48e6-a2cd-36fc045c8281 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 204 len: 0 microversion: 2.1 time: 0.614602 Oct 04 21:14:28.393196 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1085/2212] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:14:27 2022] DELETE /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:14:28.401174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-303a3929-0282-4b6a-8e05-d3428eb375ea tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f578ba9a670>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:28.487688 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-303a3929-0282-4b6a-8e05-d3428eb375ea tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3" status: 200 len: 1440 microversion: 2.1 time: 0.092473 Oct 04 21:14:28.502872 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1086/2213] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:14:28 2022] GET /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3 => generated 1440 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:28.515598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5369739a-c144-4780-aa71-f0975d1d73c6 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Action: 'update', calling method: .version_select at 0x7f578ba10f70>, body: {"quota_set": {"ram": "2048"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:28.667687 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b90a204b-78ca-405b-9d12-d66e717b4970 tempest-SecurityGroupsTestAdminJSON-1016092140 tempest-SecurityGroupsTestAdminJSON-1016092140-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.311969 Oct 04 21:14:28.673820 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1128/2214] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:14:26 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:28.674916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-26d93c6c-4e54-4b14-8782-8591031d466b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:28.675648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-26d93c6c-4e54-4b14-8782-8591031d466b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:28.689633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26d93c6c-4e54-4b14-8782-8591031d466b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:28.691845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26d93c6c-4e54-4b14-8782-8591031d466b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:28.692307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26d93c6c-4e54-4b14-8782-8591031d466b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:28.692466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5369739a-c144-4780-aa71-f0975d1d73c6 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:28.692937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5369739a-c144-4780-aa71-f0975d1d73c6 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:28.693073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26d93c6c-4e54-4b14-8782-8591031d466b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:28.693377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5369739a-c144-4780-aa71-f0975d1d73c6 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:28.694164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5369739a-c144-4780-aa71-f0975d1d73c6 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:28.694620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5369739a-c144-4780-aa71-f0975d1d73c6 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:28.695043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5369739a-c144-4780-aa71-f0975d1d73c6 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:28.695674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26d93c6c-4e54-4b14-8782-8591031d466b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:28.697090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26d93c6c-4e54-4b14-8782-8591031d466b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:28.898341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5369739a-c144-4780-aa71-f0975d1d73c6 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:28.898836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5369739a-c144-4780-aa71-f0975d1d73c6 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:28.899273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5369739a-c144-4780-aa71-f0975d1d73c6 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:28.900594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5369739a-c144-4780-aa71-f0975d1d73c6 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:28.901053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5369739a-c144-4780-aa71-f0975d1d73c6 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:28.901587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5369739a-c144-4780-aa71-f0975d1d73c6 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:29.045939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-26d93c6c-4e54-4b14-8782-8591031d466b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:29.052559 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-26d93c6c-4e54-4b14-8782-8591031d466b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1325 microversion: 2.1 time: 0.382672 Oct 04 21:14:29.054259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:29.070216 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1129/2215] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:28 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1325 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:29.184539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2ec60c38-153c-4e98-a4c0-fc041b024b9c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2082869570", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:29.264742 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5369739a-c144-4780-aa71-f0975d1d73c6 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/ade228e20519401e90f700128cd0f4ff?user_id=8cf853f4069246549896681da42391ef" status: 200 len: 148 microversion: 2.57 time: 0.760296 Oct 04 21:14:29.271641 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1087/2216] 10.222.0.30 () {62 vars in 1384 bytes} [Tue Oct 4 21:14:28 2022] PUT /compute/v2.1/os-quota-sets/ade228e20519401e90f700128cd0f4ff?user_id=8cf853f4069246549896681da42391ef => generated 148 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:14:29.303511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-3f90e408-cb99-47d1-82d9-048cd594f4bc req-d5d24dd0-5667-4874-a05b-116345938b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6aaef31-56eb-458f-a142-992790ebe523", "name": "network-vif-deleted", "tag": "894b83eb-5706-418c-bd1d-c3b0a4308370"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:29.358762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3f90e408-cb99-47d1-82d9-048cd594f4bc req-d5d24dd0-5667-4874-a05b-116345938b5d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:29.359783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3f90e408-cb99-47d1-82d9-048cd594f4bc req-d5d24dd0-5667-4874-a05b-116345938b5d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:29.361345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3f90e408-cb99-47d1-82d9-048cd594f4bc req-d5d24dd0-5667-4874-a05b-116345938b5d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:29.399168 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-3f90e408-cb99-47d1-82d9-048cd594f4bc req-d5d24dd0-5667-4874-a05b-116345938b5d service nova] Creating event network-vif-deleted:894b83eb-5706-418c-bd1d-c3b0a4308370 for instance b6aaef31-56eb-458f-a142-992790ebe523 on n-h1-860282-1 Oct 04 21:14:29.423616 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-3f90e408-cb99-47d1-82d9-048cd594f4bc req-d5d24dd0-5667-4874-a05b-116345938b5d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155253 Oct 04 21:14:29.424561 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1088/2217] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:29.448529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-16fdcbd3-2da3-4813-a65c-72058e148331 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:29.450296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-16fdcbd3-2da3-4813-a65c-72058e148331 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:29.486768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16fdcbd3-2da3-4813-a65c-72058e148331 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:29.487600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16fdcbd3-2da3-4813-a65c-72058e148331 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:29.488258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16fdcbd3-2da3-4813-a65c-72058e148331 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:29.489158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16fdcbd3-2da3-4813-a65c-72058e148331 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:29.489856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16fdcbd3-2da3-4813-a65c-72058e148331 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:29.491153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16fdcbd3-2da3-4813-a65c-72058e148331 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:29.997952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-16fdcbd3-2da3-4813-a65c-72058e148331 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8630706184384900b96e774385ec420b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a3f169c94b49c097ef061ac48e52a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:30.007648 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-16fdcbd3-2da3-4813-a65c-72058e148331 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 200 len: 1532 microversion: 2.1 time: 0.581858 Oct 04 21:14:30.039194 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1089/2218] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:29 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 1532 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:30.050889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-48277c7d-9a7b-42ba-a348-58885b3558de tempest-SecurityGroupsTestAdminJSON-1016092140 tempest-SecurityGroupsTestAdminJSON-1016092140-project] Action: 'create', calling method: .version_select at 0x7f5794408670>, body: {"security_group": {"name": "tempest-securitygroup-941361508", "description": "tempest-description-1406670119"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:31.089308 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-48277c7d-9a7b-42ba-a348-58885b3558de tempest-SecurityGroupsTestAdminJSON-1016092140 tempest-SecurityGroupsTestAdminJSON-1016092140-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.048658 Oct 04 21:14:31.099134 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1090/2219] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:14:30 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:31.109138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-026ca30d-f00d-412b-8c86-5c281faca129 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:31.111361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-026ca30d-f00d-412b-8c86-5c281faca129 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: b6aaef31-56eb-458f-a142-992790ebe523] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:31.126899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-026ca30d-f00d-412b-8c86-5c281faca129 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:31.130521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-026ca30d-f00d-412b-8c86-5c281faca129 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:31.132104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-026ca30d-f00d-412b-8c86-5c281faca129 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:31.134318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-026ca30d-f00d-412b-8c86-5c281faca129 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:31.137227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-026ca30d-f00d-412b-8c86-5c281faca129 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:31.139596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-026ca30d-f00d-412b-8c86-5c281faca129 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:31.185621 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-026ca30d-f00d-412b-8c86-5c281faca129 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] HTTP exception thrown: Instance b6aaef31-56eb-458f-a142-992790ebe523 could not be found. Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-026ca30d-f00d-412b-8c86-5c281faca129 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Request method failure captured: Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 HTTP/1.1 Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKBoglkS0qD8SmxZe3mirsDTnSE-aaQetnJDczd2syhpWxq0p15FnusWK_on0F377rdG9PVjJwVI0OpcTwAspbepOQF6jNZgjexGJEuHoo4cDL_yI4yGAt-USxC7jzHrRkF8TGmuEMTzBbdXXcBTleyLT_69wwQ76fiHG5HItf35yUA Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: d06810bbad6e4914aa53b43ef390f52e Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1744975960 Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d06810bbad6e4914aa53b43ef390f52e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d06810bbad6e4914aa53b43ef390f52e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d06810bbad6e4914aa53b43ef390f52e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d06810bbad6e4914aa53b43ef390f52e"}]}] Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1744975960 Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: d06810bbad6e4914aa53b43ef390f52e Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1744975960 Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-LiveAutoBlockMigrationV225Test-1744975960-project Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 95f0cc0f93b244cea8818c7bbdcfb90a Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1744975960-project Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance b6aaef31-56eb-458f-a142-992790ebe523 could not be found. Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'b6aaef31-56eb-458f-a142-992790ebe523'} Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6aaef31-56eb-458f-a142-992790ebe523 could not be found. Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6aaef31-56eb-458f-a142-992790ebe523 could not be found. Oct 04 21:14:31.188396 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:31.195051 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:31.195051 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:31.195051 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:31.195051 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:31.195051 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:31.195051 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:31.195051 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:31.195051 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6aaef31-56eb-458f-a142-992790ebe523 could not be found. Oct 04 21:14:31.195051 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:31.195051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-026ca30d-f00d-412b-8c86-5c281faca129 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Returning 404 to user: Instance b6aaef31-56eb-458f-a142-992790ebe523 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:31.195051 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-026ca30d-f00d-412b-8c86-5c281faca129 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523" status: 404 len: 111 microversion: 2.25 time: 0.089553 Oct 04 21:14:31.199294 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1091/2220] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:31 2022] GET /compute/v2.1/servers/b6aaef31-56eb-458f-a142-992790ebe523 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:14:31.206016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ea7bcf81-1f5f-4418-b7b5-3541beb6b4c5 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] Calling method '.version_select at 0x7f579441dca0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:31.349797 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ea7bcf81-1f5f-4418-b7b5-3541beb6b4c5 tempest-QuotasAdminTestV257-1287736096 tempest-QuotasAdminTestV257-1287736096-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/ade228e20519401e90f700128cd0f4ff?user_id=8cf853f4069246549896681da42391ef" status: 200 len: 190 microversion: 2.57 time: 0.148813 Oct 04 21:14:31.352661 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1092/2221] 10.222.0.30 () {60 vars in 1364 bytes} [Tue Oct 4 21:14:31 2022] GET /compute/v2.1/os-quota-sets/ade228e20519401e90f700128cd0f4ff?user_id=8cf853f4069246549896681da42391ef => generated 190 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:14:31.383365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1609793b-2e26-4b20-b986-6d936b49968c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f5794408670>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:33.515738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-2ec60c38-153c-4e98-a4c0-fc041b024b9c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] validate_networks() for [('3fd75fd9-7dbd-4798-b6a4-9139b39b491f', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:14:33.523663 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1609793b-2e26-4b20-b986-6d936b49968c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3" status: 200 len: 1440 microversion: 2.1 time: 2.114005 Oct 04 21:14:33.523663 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1093/2222] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:14:31 2022] GET /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3 => generated 1440 bytes in 2116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:33.523663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-12cfb667-e3ba-4065-8cce-8db4976be9f1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:33.523663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-12cfb667-e3ba-4065-8cce-8db4976be9f1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:33.523663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12cfb667-e3ba-4065-8cce-8db4976be9f1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:33.523663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12cfb667-e3ba-4065-8cce-8db4976be9f1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:33.523663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12cfb667-e3ba-4065-8cce-8db4976be9f1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:33.523663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12cfb667-e3ba-4065-8cce-8db4976be9f1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:33.523663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12cfb667-e3ba-4065-8cce-8db4976be9f1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:33.523663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12cfb667-e3ba-4065-8cce-8db4976be9f1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:34.042169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-12cfb667-e3ba-4065-8cce-8db4976be9f1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:34.054665 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-12cfb667-e3ba-4065-8cce-8db4976be9f1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1325 microversion: 2.1 time: 0.583160 Oct 04 21:14:34.056668 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1094/2223] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:33 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1325 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:34.069208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-4b9eae65-3ce7-4734-9503-0a77d84597e6 req-4395b833-bc4d-4585-829d-76d0ac3ba444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa44d77-6583-4a52-9bcc-b9af99d2bd9f", "name": "network-vif-deleted", "tag": "e8e0b120-1d09-4f06-b791-627091bb7ecb"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:34.094659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4b9eae65-3ce7-4734-9503-0a77d84597e6 req-4395b833-bc4d-4585-829d-76d0ac3ba444 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:34.095539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4b9eae65-3ce7-4734-9503-0a77d84597e6 req-4395b833-bc4d-4585-829d-76d0ac3ba444 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:34.096190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4b9eae65-3ce7-4734-9503-0a77d84597e6 req-4395b833-bc4d-4585-829d-76d0ac3ba444 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:34.112485 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-4b9eae65-3ce7-4734-9503-0a77d84597e6 req-4395b833-bc4d-4585-829d-76d0ac3ba444 service nova] Creating event network-vif-deleted:e8e0b120-1d09-4f06-b791-627091bb7ecb for instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f on n-h2-860282-1 Oct 04 21:14:34.119244 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-4b9eae65-3ce7-4734-9503-0a77d84597e6 req-4395b833-bc4d-4585-829d-76d0ac3ba444 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056636 Oct 04 21:14:34.125398 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1095/2224] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:34.131957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-632d17fc-1c4e-40a5-a7c8-e4a39f7a0df7 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:34.132855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-632d17fc-1c4e-40a5-a7c8-e4a39f7a0df7 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] [instance: aaa44d77-6583-4a52-9bcc-b9af99d2bd9f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:34.143607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-632d17fc-1c4e-40a5-a7c8-e4a39f7a0df7 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:34.144103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-632d17fc-1c4e-40a5-a7c8-e4a39f7a0df7 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:34.144712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-632d17fc-1c4e-40a5-a7c8-e4a39f7a0df7 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:34.163877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-632d17fc-1c4e-40a5-a7c8-e4a39f7a0df7 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:34.164678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-632d17fc-1c4e-40a5-a7c8-e4a39f7a0df7 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:34.165693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-632d17fc-1c4e-40a5-a7c8-e4a39f7a0df7 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:34.218531 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-632d17fc-1c4e-40a5-a7c8-e4a39f7a0df7 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] HTTP exception thrown: Instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f could not be found. Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-632d17fc-1c4e-40a5-a7c8-e4a39f7a0df7 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Request method failure captured: Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f HTTP/1.1 Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKH7YMTxvSzouCnJPd_8-oPsYvAsZs9_pGTAH1ToZ10NOEjZynkZIctUfCRfyfwnBh-kJ0PtExix0swhokHuupU0GnSQwPHUZGUzKtbRhsecm0sdG9k9V3Z2Njz3m0R30lQiEoDe5-g-dpjN30x80e5Fh9SaMTMTz336FuQQ-SpggMM Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: b2a3f169c94b49c097ef061ac48e52a7 Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1570941564 Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b2a3f169c94b49c097ef061ac48e52a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b2a3f169c94b49c097ef061ac48e52a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b2a3f169c94b49c097ef061ac48e52a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b2a3f169c94b49c097ef061ac48e52a7"}]}] Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1570941564 Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: b2a3f169c94b49c097ef061ac48e52a7 Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1570941564 Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1570941564-project Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 8630706184384900b96e774385ec420b Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1570941564-project Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f could not be found. Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'aaa44d77-6583-4a52-9bcc-b9af99d2bd9f'} Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f could not be found. Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f could not be found. Oct 04 21:14:34.220463 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:34.223671 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:34.223671 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:34.223671 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:34.223671 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:34.223671 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:34.223671 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:34.223671 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:34.223671 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f could not be found. Oct 04 21:14:34.223671 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:34.224966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-632d17fc-1c4e-40a5-a7c8-e4a39f7a0df7 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] Returning 404 to user: Instance aaa44d77-6583-4a52-9bcc-b9af99d2bd9f could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:34.226010 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-632d17fc-1c4e-40a5-a7c8-e4a39f7a0df7 tempest-ServersNegativeTestMultiTenantJSON-1570941564 tempest-ServersNegativeTestMultiTenantJSON-1570941564-project] 10.222.0.30 "GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f" status: 404 len: 111 microversion: 2.1 time: 0.099172 Oct 04 21:14:34.229379 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1096/2225] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:34 2022] GET /compute/v2.1/servers/aaa44d77-6583-4a52-9bcc-b9af99d2bd9f => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:14:34.722648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d6542578-3ea6-4ba0-ae8f-00f57df24f48 tempest-SecurityGroupsTestAdminJSON-248877601 tempest-SecurityGroupsTestAdminJSON-248877601-project-admin] Action: 'create', calling method: .version_select at 0x7f578ba10550>, body: {"security_group": {"name": "tempest-securitygroup-1310506482", "description": "tempest-description-876139222"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:34.850287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2ec60c38-153c-4e98-a4c0-fc041b024b9c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:14:34.851413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2ec60c38-153c-4e98-a4c0-fc041b024b9c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:14:34.852305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2ec60c38-153c-4e98-a4c0-fc041b024b9c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:14:34.853654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2ec60c38-153c-4e98-a4c0-fc041b024b9c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:14:34.854285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2ec60c38-153c-4e98-a4c0-fc041b024b9c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:14:34.872617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ec60c38-153c-4e98-a4c0-fc041b024b9c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:34.874161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ec60c38-153c-4e98-a4c0-fc041b024b9c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:34.875329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ec60c38-153c-4e98-a4c0-fc041b024b9c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:34.876276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ec60c38-153c-4e98-a4c0-fc041b024b9c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:34.879014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ec60c38-153c-4e98-a4c0-fc041b024b9c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:34.880154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ec60c38-153c-4e98-a4c0-fc041b024b9c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:34.933730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-2ec60c38-153c-4e98-a4c0-fc041b024b9c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Getting quotas for project 047ff2c9b6414ce8b98364678cbfeb53. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:14:34.947136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-2ec60c38-153c-4e98-a4c0-fc041b024b9c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Getting quotas for user abb3ac58c2ea4e2da8b9e765eda5f333 and project 047ff2c9b6414ce8b98364678cbfeb53. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:14:35.006490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2ec60c38-153c-4e98-a4c0-fc041b024b9c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:14:35.020540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2ec60c38-153c-4e98-a4c0-fc041b024b9c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:14:35.311330 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2ec60c38-153c-4e98-a4c0-fc041b024b9c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.238015 Oct 04 21:14:35.312018 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1130/2226] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:14:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 6241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:14:35.363251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-035d2eeb-be75-45d8-b3a8-8a87164e98cb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:35.363678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-035d2eeb-be75-45d8-b3a8-8a87164e98cb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:35.412878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-035d2eeb-be75-45d8-b3a8-8a87164e98cb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:35.413455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-035d2eeb-be75-45d8-b3a8-8a87164e98cb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:35.421953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-035d2eeb-be75-45d8-b3a8-8a87164e98cb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:35.421953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-035d2eeb-be75-45d8-b3a8-8a87164e98cb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:35.424053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-035d2eeb-be75-45d8-b3a8-8a87164e98cb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:35.428042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-035d2eeb-be75-45d8-b3a8-8a87164e98cb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:35.522511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-035d2eeb-be75-45d8-b3a8-8a87164e98cb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:14:36.018792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:36.116929 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-035d2eeb-be75-45d8-b3a8-8a87164e98cb tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "DELETE /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 204 len: 0 microversion: 2.25 time: 0.787501 Oct 04 21:14:36.117641 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1131/2227] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:14:35 2022] DELETE /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:14:36.129858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-a8940806-3295-4f06-bcae-226959057f37 req-d5832589-3aa8-486a-b2ce-e2542f51313e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f65528-e8a7-4637-a1bf-1baf79b315eb", "name": "network-vif-plugged", "status": "completed", "tag": "1e00c2db-7a7f-4cda-bc8c-64d2291e2563"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:36.194212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a8940806-3295-4f06-bcae-226959057f37 req-d5832589-3aa8-486a-b2ce-e2542f51313e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:36.199276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a8940806-3295-4f06-bcae-226959057f37 req-d5832589-3aa8-486a-b2ce-e2542f51313e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:36.203888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a8940806-3295-4f06-bcae-226959057f37 req-d5832589-3aa8-486a-b2ce-e2542f51313e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:36.304573 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-a8940806-3295-4f06-bcae-226959057f37 req-d5832589-3aa8-486a-b2ce-e2542f51313e service nova] Creating event network-vif-plugged:1e00c2db-7a7f-4cda-bc8c-64d2291e2563 for instance 05f65528-e8a7-4637-a1bf-1baf79b315eb on n-h1-860282-1 Oct 04 21:14:36.333592 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-a8940806-3295-4f06-bcae-226959057f37 req-d5832589-3aa8-486a-b2ce-e2542f51313e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207800 Oct 04 21:14:36.336088 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1132/2228] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:36.396999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-95da3484-7d54-45f3-8dd3-16b739a7f263 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f578be9d700>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:36.569529 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-95da3484-7d54-45f3-8dd3-16b739a7f263 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3" status: 200 len: 1440 microversion: 2.1 time: 0.203909 Oct 04 21:14:36.570808 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1133/2229] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:14:36 2022] GET /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3 => generated 1440 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:36.592848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3b140971-9b64-4650-93b0-a709ca4246f5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:36.594048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3b140971-9b64-4650-93b0-a709ca4246f5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:36.611098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3b140971-9b64-4650-93b0-a709ca4246f5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:36.615586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3b140971-9b64-4650-93b0-a709ca4246f5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:36.620764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3b140971-9b64-4650-93b0-a709ca4246f5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:36.621715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3b140971-9b64-4650-93b0-a709ca4246f5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:36.624426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3b140971-9b64-4650-93b0-a709ca4246f5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:36.624956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3b140971-9b64-4650-93b0-a709ca4246f5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:37.064038 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d6542578-3ea6-4ba0-ae8f-00f57df24f48 tempest-SecurityGroupsTestAdminJSON-248877601 tempest-SecurityGroupsTestAdminJSON-248877601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.833260 Oct 04 21:14:37.065327 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1097/2230] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:14:34 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:37.076955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-73451473-f5e4-4fb0-a0c2-ee359f0edb15 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:37.079472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-73451473-f5e4-4fb0-a0c2-ee359f0edb15 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:37.440974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-73451473-f5e4-4fb0-a0c2-ee359f0edb15 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:37.449805 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-73451473-f5e4-4fb0-a0c2-ee359f0edb15 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1222 microversion: 2.1 time: 0.383029 Oct 04 21:14:37.453581 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1098/2231] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:37 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1222 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:37.469174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d9122d06-8afd-49df-a6eb-b466ce9d07ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:37.472722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d9122d06-8afd-49df-a6eb-b466ce9d07ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:37.509588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9122d06-8afd-49df-a6eb-b466ce9d07ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:37.516550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9122d06-8afd-49df-a6eb-b466ce9d07ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:37.526734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9122d06-8afd-49df-a6eb-b466ce9d07ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:37.555217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9122d06-8afd-49df-a6eb-b466ce9d07ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:37.556356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9122d06-8afd-49df-a6eb-b466ce9d07ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:37.559577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9122d06-8afd-49df-a6eb-b466ce9d07ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:37.687472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3b140971-9b64-4650-93b0-a709ca4246f5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:37.706713 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3b140971-9b64-4650-93b0-a709ca4246f5 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1325 microversion: 2.1 time: 1.125218 Oct 04 21:14:37.728891 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1134/2232] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:36 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1325 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:37.757344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d1934944-da10-4146-b10b-69adb9362c8c tempest-SecurityGroupsTestAdminJSON-248877601 tempest-SecurityGroupsTestAdminJSON-248877601-project-admin] Action: 'create', calling method: .version_select at 0x7f579461d670>, body: {"security_group": {"name": "tempest-securitygroup-643187352", "description": "tempest-description-362312143"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:38.398595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d9122d06-8afd-49df-a6eb-b466ce9d07ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:38.452809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d9122d06-8afd-49df-a6eb-b466ce9d07ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:38.458774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d9122d06-8afd-49df-a6eb-b466ce9d07ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f0cc0f93b244cea8818c7bbdcfb90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06810bbad6e4914aa53b43ef390f52e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:38.463094 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d9122d06-8afd-49df-a6eb-b466ce9d07ab tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 200 len: 1565 microversion: 2.25 time: 1.006020 Oct 04 21:14:38.480580 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1099/2233] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:37 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 1565 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:14:38.504020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9cbf4e78-795d-4e14-8a1d-b07fe896596a tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f578ba62310>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:38.611545 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9cbf4e78-795d-4e14-8a1d-b07fe896596a tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3" status: 200 len: 1440 microversion: 2.1 time: 0.128658 Oct 04 21:14:38.612605 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1100/2234] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:14:38 2022] GET /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3 => generated 1440 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:38.626294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-258a4204-0be8-4878-990b-f9f38e7ca9e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2030519804", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:38.752173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-258a4204-0be8-4878-990b-f9f38e7ca9e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] validate_networks() for [('3fd75fd9-7dbd-4798-b6a4-9139b39b491f', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:14:38.969347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=7 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:39.479591 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d1934944-da10-4146-b10b-69adb9362c8c tempest-SecurityGroupsTestAdminJSON-248877601 tempest-SecurityGroupsTestAdminJSON-248877601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.748515 Oct 04 21:14:39.480316 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1135/2235] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:14:37 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:39.486406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-9007be6b-dec9-4760-b70d-093819527ebe req-ed05898f-3513-4b25-88e2-ab7f11d6335a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c974866c-d0de-4595-85b6-7404f349c6f1", "name": "network-vif-plugged", "status": "completed", "tag": "363ea383-0f2b-4176-8e31-c2e9325ecb59"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:39.591220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9007be6b-dec9-4760-b70d-093819527ebe req-ed05898f-3513-4b25-88e2-ab7f11d6335a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:39.603805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9007be6b-dec9-4760-b70d-093819527ebe req-ed05898f-3513-4b25-88e2-ab7f11d6335a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:39.607662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9007be6b-dec9-4760-b70d-093819527ebe req-ed05898f-3513-4b25-88e2-ab7f11d6335a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:39.716358 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-9007be6b-dec9-4760-b70d-093819527ebe req-ed05898f-3513-4b25-88e2-ab7f11d6335a service nova] Creating event network-vif-plugged:363ea383-0f2b-4176-8e31-c2e9325ecb59 for instance c974866c-d0de-4595-85b6-7404f349c6f1 on n-h2-860282-1 Oct 04 21:14:39.745139 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-9007be6b-dec9-4760-b70d-093819527ebe req-ed05898f-3513-4b25-88e2-ab7f11d6335a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.262450 Oct 04 21:14:39.748150 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1136/2236] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:39.767351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-189d5525-3848-427f-8e0c-1ebc22e79f90 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:39.768613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-189d5525-3848-427f-8e0c-1ebc22e79f90 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:39.801533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-189d5525-3848-427f-8e0c-1ebc22e79f90 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:39.804518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-189d5525-3848-427f-8e0c-1ebc22e79f90 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:39.806376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-189d5525-3848-427f-8e0c-1ebc22e79f90 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:39.810565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-189d5525-3848-427f-8e0c-1ebc22e79f90 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:39.812847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-189d5525-3848-427f-8e0c-1ebc22e79f90 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:39.814396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-189d5525-3848-427f-8e0c-1ebc22e79f90 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:42.237888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-189d5525-3848-427f-8e0c-1ebc22e79f90 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:42.251931 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-189d5525-3848-427f-8e0c-1ebc22e79f90 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1522 microversion: 2.1 time: 2.502043 Oct 04 21:14:42.255333 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1137/2237] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:39 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1522 bytes in 2506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:42.264405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-71bb30cf-5842-4a08-af4c-068e274e1ad4 tempest-SecurityGroupsTestAdminJSON-248877601 tempest-SecurityGroupsTestAdminJSON-248877601-project-admin] Calling method '.version_select at 0x7f57945f9940>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:42.982333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-258a4204-0be8-4878-990b-f9f38e7ca9e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:14:42.987248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-258a4204-0be8-4878-990b-f9f38e7ca9e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:14:42.987248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-258a4204-0be8-4878-990b-f9f38e7ca9e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:14:42.987248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-258a4204-0be8-4878-990b-f9f38e7ca9e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:14:42.987248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-258a4204-0be8-4878-990b-f9f38e7ca9e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:14:43.005923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-258a4204-0be8-4878-990b-f9f38e7ca9e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:43.007589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-258a4204-0be8-4878-990b-f9f38e7ca9e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:43.010756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-258a4204-0be8-4878-990b-f9f38e7ca9e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:43.013595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-258a4204-0be8-4878-990b-f9f38e7ca9e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:43.014982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-258a4204-0be8-4878-990b-f9f38e7ca9e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:43.021365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-258a4204-0be8-4878-990b-f9f38e7ca9e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:43.057791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-258a4204-0be8-4878-990b-f9f38e7ca9e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Getting quotas for project 047ff2c9b6414ce8b98364678cbfeb53. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:14:43.064501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-258a4204-0be8-4878-990b-f9f38e7ca9e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Getting quotas for user abb3ac58c2ea4e2da8b9e765eda5f333 and project 047ff2c9b6414ce8b98364678cbfeb53. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:14:43.098567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-258a4204-0be8-4878-990b-f9f38e7ca9e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:14:43.105221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-258a4204-0be8-4878-990b-f9f38e7ca9e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:14:43.357630 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-258a4204-0be8-4878-990b-f9f38e7ca9e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.743691 Oct 04 21:14:43.358802 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1101/2238] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:14:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 4745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:14:43.365655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9cba5b60-036e-45b2-bf6f-52cb0cbe2708 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:43.367217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9cba5b60-036e-45b2-bf6f-52cb0cbe2708 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] [instance: 392b3ca2-cc0a-44ae-b791-b8d6043f54e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:43.378664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9cba5b60-036e-45b2-bf6f-52cb0cbe2708 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:43.379660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9cba5b60-036e-45b2-bf6f-52cb0cbe2708 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:43.381523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9cba5b60-036e-45b2-bf6f-52cb0cbe2708 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:43.382475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9cba5b60-036e-45b2-bf6f-52cb0cbe2708 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:43.383012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9cba5b60-036e-45b2-bf6f-52cb0cbe2708 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:43.383553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9cba5b60-036e-45b2-bf6f-52cb0cbe2708 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:43.435564 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-9cba5b60-036e-45b2-bf6f-52cb0cbe2708 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] HTTP exception thrown: Instance 392b3ca2-cc0a-44ae-b791-b8d6043f54e8 could not be found. Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9cba5b60-036e-45b2-bf6f-52cb0cbe2708 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Request method failure captured: Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 HTTP/1.1 Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKBoglkS0qD8SmxZe3mirsDTnSE-aaQetnJDczd2syhpWxq0p15FnusWK_on0F377rdG9PVjJwVI0OpcTwAspbepOQF6jNZgjexGJEuHoo4cDL_yI4yGAt-USxC7jzHrRkF8TGmuEMTzBbdXXcBTleyLT_69wwQ76fiHG5HItf35yUA Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: d06810bbad6e4914aa53b43ef390f52e Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1744975960 Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d06810bbad6e4914aa53b43ef390f52e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d06810bbad6e4914aa53b43ef390f52e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d06810bbad6e4914aa53b43ef390f52e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d06810bbad6e4914aa53b43ef390f52e"}]}] Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1744975960 Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: d06810bbad6e4914aa53b43ef390f52e Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1744975960 Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-LiveAutoBlockMigrationV225Test-1744975960-project Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 95f0cc0f93b244cea8818c7bbdcfb90a Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1744975960-project Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 392b3ca2-cc0a-44ae-b791-b8d6043f54e8 could not be found. Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '392b3ca2-cc0a-44ae-b791-b8d6043f54e8'} Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 392b3ca2-cc0a-44ae-b791-b8d6043f54e8 could not be found. Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 392b3ca2-cc0a-44ae-b791-b8d6043f54e8 could not be found. Oct 04 21:14:43.439579 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:43.442935 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:43.442935 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:43.442935 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:43.442935 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:43.442935 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:43.442935 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:43.442935 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:43.442935 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 392b3ca2-cc0a-44ae-b791-b8d6043f54e8 could not be found. Oct 04 21:14:43.442935 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:43.445996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9cba5b60-036e-45b2-bf6f-52cb0cbe2708 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] Returning 404 to user: Instance 392b3ca2-cc0a-44ae-b791-b8d6043f54e8 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:43.449337 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9cba5b60-036e-45b2-bf6f-52cb0cbe2708 tempest-LiveAutoBlockMigrationV225Test-1744975960 tempest-LiveAutoBlockMigrationV225Test-1744975960-project] 10.222.0.30 "GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8" status: 404 len: 111 microversion: 2.25 time: 0.087484 Oct 04 21:14:43.467316 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1102/2239] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:43 2022] GET /compute/v2.1/servers/392b3ca2-cc0a-44ae-b791-b8d6043f54e8 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:14:43.482750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-72945c00-9c43-492f-a6b6-821225ac9450 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f578ba10b80>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:44.907592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:44.975166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:46.478559 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-71bb30cf-5842-4a08-af4c-068e274e1ad4 tempest-SecurityGroupsTestAdminJSON-248877601 tempest-SecurityGroupsTestAdminJSON-248877601-project-admin] 10.222.0.30 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10432 microversion: 2.1 time: 4.221211 Oct 04 21:14:46.480028 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1138/2240] 10.222.0.30 () {58 vars in 1191 bytes} [Tue Oct 4 21:14:42 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10432 bytes in 4223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:14:46.487963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-7b86c74b-d105-44ef-b714-acf1f7f596f1 req-0c7c8c80-0534-4451-bb44-e8db79e3b206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392b3ca2-cc0a-44ae-b791-b8d6043f54e8", "name": "network-vif-deleted", "tag": "a1c5c085-0f1e-46fd-868c-bc3dc886b2fa"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:46.523736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-7b86c74b-d105-44ef-b714-acf1f7f596f1 req-0c7c8c80-0534-4451-bb44-e8db79e3b206 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:46.524250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-7b86c74b-d105-44ef-b714-acf1f7f596f1 req-0c7c8c80-0534-4451-bb44-e8db79e3b206 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:46.546544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-7b86c74b-d105-44ef-b714-acf1f7f596f1 req-0c7c8c80-0534-4451-bb44-e8db79e3b206 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:46.591070 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-7b86c74b-d105-44ef-b714-acf1f7f596f1 req-0c7c8c80-0534-4451-bb44-e8db79e3b206 service nova] Creating event network-vif-deleted:a1c5c085-0f1e-46fd-868c-bc3dc886b2fa for instance 392b3ca2-cc0a-44ae-b791-b8d6043f54e8 on n-h1-860282-1 Oct 04 21:14:46.604853 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-7b86c74b-d105-44ef-b714-acf1f7f596f1 req-0c7c8c80-0534-4451-bb44-e8db79e3b206 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122596 Oct 04 21:14:46.610294 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1139/2241] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:46.615947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ae186218-a3f1-4482-82f6-967d2c31937b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:46.619291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ae186218-a3f1-4482-82f6-967d2c31937b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:46.631068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae186218-a3f1-4482-82f6-967d2c31937b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:46.631898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae186218-a3f1-4482-82f6-967d2c31937b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:46.632487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae186218-a3f1-4482-82f6-967d2c31937b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:46.633670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae186218-a3f1-4482-82f6-967d2c31937b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:46.635241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae186218-a3f1-4482-82f6-967d2c31937b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:46.636060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae186218-a3f1-4482-82f6-967d2c31937b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:46.672012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:47.138073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ae186218-a3f1-4482-82f6-967d2c31937b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:47.205239 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ae186218-a3f1-4482-82f6-967d2c31937b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1522 microversion: 2.1 time: 0.593301 Oct 04 21:14:47.206093 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1140/2242] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:46 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1522 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:47.421989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bcd993c1-288a-4990-93f7-475e8662233e tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Action: 'create', calling method: .version_select at 0x7f579453e790>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjt3LFnA/HucXkC+IaS4A41AS3N3dOHiY1eLvfj6UhUcOjAZTa3qOpxWbTRPbLu0H+RqwC6m3UsTH9mPUNBw9UcnVL4RpDsLIxBi6VsyqyuOezjSGj2HGoVNJY2dbA/Bw=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bcd993c1-288a-4990-93f7-475e8662233e tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Request method failure captured: Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 257 Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKJC7i5lkl_CKa_FC7nzXEeClevGmQfoG4L5uzhxS_0TyJeyvh9hFG5SRL9xGPVFvz9mTM_T7GXyRJSQQlaUnXWmGrt7tKVGaR9_nm2Zxpy13WSy23O6Hi4sk0x58hT7NG7_rUTRBPtUTocumm_-SlyEbA0VFgLAWItOvK6L4FpDsqE Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7960ad3f5f154f5f84b6e241e20f412d Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7960ad3f5f154f5f84b6e241e20f412d"}]}] Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7960ad3f5f154f5f84b6e241e20f412d Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-KeyPairsNegativeTestJSON-620886437-project Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 52819577b025430f8840f01248a4be39 Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-KeyPairsNegativeTestJSON-620886437-project Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjt3LFnA/HucXkC+IaS4A41AS3N3dOHiY1eLvfj6UhUcOjAZTa3qOpxWbTRPbLu0H+RqwC6m3UsTH9mPUNBw9UcnVL4RpDsLIxBi6VsyqyuOezjSGj2HGoVNJY2dbA/Bw=="}} Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjt3LFnA/HucXkC+IaS4A41AS3N3dOHiY1eLvfj6UhUcOjAZTa3qOpxWbTRPbLu0H+RqwC6m3UsTH9mPUNBw9UcnVL4RpDsLIxBi6VsyqyuOezjSGj2HGoVNJY2dbA/Bw=='}}} Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 04 21:14:47.427239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bcd993c1-288a-4990-93f7-475e8662233e tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:47.433635 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bcd993c1-288a-4990-93f7-475e8662233e tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.221676 Oct 04 21:14:47.437414 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1141/2243] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:14:47 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 230 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:14:47.442700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7700f11c-d020-4953-8931-5a3f48c1f8c8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:47.443540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7700f11c-d020-4953-8931-5a3f48c1f8c8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:47.452041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7700f11c-d020-4953-8931-5a3f48c1f8c8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:47.452554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7700f11c-d020-4953-8931-5a3f48c1f8c8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:47.452996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7700f11c-d020-4953-8931-5a3f48c1f8c8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:47.453741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7700f11c-d020-4953-8931-5a3f48c1f8c8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:47.454357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7700f11c-d020-4953-8931-5a3f48c1f8c8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:47.454785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7700f11c-d020-4953-8931-5a3f48c1f8c8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:47.538797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7700f11c-d020-4953-8931-5a3f48c1f8c8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:47.552768 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7700f11c-d020-4953-8931-5a3f48c1f8c8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1292 microversion: 2.1 time: 0.112032 Oct 04 21:14:47.558427 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1142/2244] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:47 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1292 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:47.573624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-27248bd9-4ae9-4283-83a2-6586b7c2e761 tempest-SecurityGroupsTestAdminJSON-1016092140 tempest-SecurityGroupsTestAdminJSON-1016092140-project] Calling method '.version_select at 0x7f579457d790>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:48.147432 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-27248bd9-4ae9-4283-83a2-6586b7c2e761 tempest-SecurityGroupsTestAdminJSON-1016092140 tempest-SecurityGroupsTestAdminJSON-1016092140-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.587173 Oct 04 21:14:48.148945 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1143/2245] 10.222.0.30 () {58 vars in 1191 bytes} [Tue Oct 4 21:14:47 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:48.165257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-67556c45-4672-4d62-a303-d6995fabdf02 req-b38cfa04-40ae-49c4-99eb-7e459eb90c32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a86ffd-75a1-460b-ae59-24969ece95ad", "tag": "ebbb3376-2554-4ae5-be99-ef246a2637f5"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:48.189960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-67556c45-4672-4d62-a303-d6995fabdf02 req-b38cfa04-40ae-49c4-99eb-7e459eb90c32 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:48.192954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-67556c45-4672-4d62-a303-d6995fabdf02 req-b38cfa04-40ae-49c4-99eb-7e459eb90c32 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:48.194959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-67556c45-4672-4d62-a303-d6995fabdf02 req-b38cfa04-40ae-49c4-99eb-7e459eb90c32 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:48.233005 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-67556c45-4672-4d62-a303-d6995fabdf02 req-b38cfa04-40ae-49c4-99eb-7e459eb90c32 service nova] Creating event network-changed:ebbb3376-2554-4ae5-be99-ef246a2637f5 for instance 89a86ffd-75a1-460b-ae59-24969ece95ad on n-h2-860282-1 Oct 04 21:14:48.255116 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-67556c45-4672-4d62-a303-d6995fabdf02 req-b38cfa04-40ae-49c4-99eb-7e459eb90c32 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103247 Oct 04 21:14:48.257604 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1144/2246] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:48.272891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1d1f778c-7535-4dbd-9197-cd27a573ca8d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1377103380", "metadata": {"": ""}}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1d1f778c-7535-4dbd-9197-cd27a573ca8d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Request method failure captured: Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb/action HTTP/1.1 Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 107 Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKIfr0EKjh9lIGpSMallYOOhbfjlmceWYXhhzEhZtKG-K5Qftah8sJPPQwARLxF148gLNgWQ6TQI3CtHtfXOURD85vgsMSrUAP7uSOEzn9FGu8hya9wg7xCbpv6yrgC_TH3BeALF5PS38pqVs3tUVO2zaGck0ZnqjmCZGgWvxK0EmDc Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 4df42993975949899553deaeaffada73 Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4df42993975949899553deaeaffada73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4df42993975949899553deaeaffada73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}] Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 4df42993975949899553deaeaffada73 Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 4d401d8a2c8e4cee856badba313ed00a Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1377103380", "metadata": {"": ""}}} Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '05f65528-e8a7-4637-a1bf-1baf79b315eb', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1377103380', 'metadata': {'': ''}}}} Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'': ''} Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:14:48.291745 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:14:48.295127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:14:48.295127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:14:48.295127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:14:48.295127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:14:48.295127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:14:48.295127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:14:48.295127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:48.295127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:48.295127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:48.295127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:48.295127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:48.295127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:48.295127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:14:48.295127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:14:48.295127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:14:48.295127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:48.307757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1d1f778c-7535-4dbd-9197-cd27a573ca8d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:48.311927 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1d1f778c-7535-4dbd-9197-cd27a573ca8d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "POST /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb/action" status: 400 len: 170 microversion: 2.1 time: 0.050494 Oct 04 21:14:48.318135 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1145/2247] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Oct 4 21:14:48 2022] POST /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb/action => generated 170 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:14:48.342945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c4173945-735c-45e9-a624-8daeafaecfab tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Action: 'create', calling method: .version_select at 0x7f579457d940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1025304551", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:48.386894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-c4173945-735c-45e9-a624-8daeafaecfab tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Getting quotas for project 7960ad3f5f154f5f84b6e241e20f412d. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:14:48.408936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-c4173945-735c-45e9-a624-8daeafaecfab tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Getting quotas for user 52819577b025430f8840f01248a4be39 and project 7960ad3f5f154f5f84b6e241e20f412d. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:14:48.456512 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-c4173945-735c-45e9-a624-8daeafaecfab tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c4173945-735c-45e9-a624-8daeafaecfab tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Request method failure captured: Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 2167 Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKJC7i5lkl_CKa_FC7nzXEeClevGmQfoG4L5uzhxS_0TyJeyvh9hFG5SRL9xGPVFvz9mTM_T7GXyRJSQQlaUnXWmGrt7tKVGaR9_nm2Zxpy13WSy23O6Hi4sk0x58hT7NG7_rUTRBPtUTocumm_-SlyEbA0VFgLAWItOvK6L4FpDsqE Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7960ad3f5f154f5f84b6e241e20f412d Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7960ad3f5f154f5f84b6e241e20f412d"}]}] Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7960ad3f5f154f5f84b6e241e20f412d Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-KeyPairsNegativeTestJSON-620886437-project Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 52819577b025430f8840f01248a4be39 Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-KeyPairsNegativeTestJSON-620886437-project Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1025304551", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:14:48.480037 n-d-860282-1 devstack@n-api.service[122758]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1025304551', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:48.481908 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c4173945-735c-45e9-a624-8daeafaecfab tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:48.484062 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c4173945-735c-45e9-a624-8daeafaecfab tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.163795 Oct 04 21:14:48.485230 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1146/2248] 10.222.0.30 () {60 vars in 1160 bytes} [Tue Oct 4 21:14:48 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 165 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:14:48.495490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2074a704-f6ba-45db-91b7-7939c183c44d tempest-SecurityGroupsTestAdminJSON-248877601 tempest-SecurityGroupsTestAdminJSON-248877601-project-admin] Calling method '.version_select at 0x7f578be9de50>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:49.023072 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2074a704-f6ba-45db-91b7-7939c183c44d tempest-SecurityGroupsTestAdminJSON-248877601 tempest-SecurityGroupsTestAdminJSON-248877601-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/ae540e02-30ac-4af0-9420-0c32ea933de2" status: 202 len: 0 microversion: 2.1 time: 0.497209 Oct 04 21:14:49.023072 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1147/2249] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:14:48 2022] DELETE /compute/v2.1/os-security-groups/ae540e02-30ac-4af0-9420-0c32ea933de2 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:14:49.023072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0dabb1ae-22b1-44f9-8182-693f0fa52141 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:49.023072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0dabb1ae-22b1-44f9-8182-693f0fa52141 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:49.023072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dabb1ae-22b1-44f9-8182-693f0fa52141 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:49.023072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dabb1ae-22b1-44f9-8182-693f0fa52141 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:49.023072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dabb1ae-22b1-44f9-8182-693f0fa52141 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:49.023072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dabb1ae-22b1-44f9-8182-693f0fa52141 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:49.023072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dabb1ae-22b1-44f9-8182-693f0fa52141 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:49.023072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dabb1ae-22b1-44f9-8182-693f0fa52141 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:49.188263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0dabb1ae-22b1-44f9-8182-693f0fa52141 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:49.201223 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0dabb1ae-22b1-44f9-8182-693f0fa52141 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1522 microversion: 2.1 time: 0.214538 Oct 04 21:14:49.201223 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1148/2250] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:48 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:49.209173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-208ed05f-c2f3-4852-b463-dbff036ddef0 tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Action: 'create', calling method: .version_select at 0x7f57944e7160>, body: {"keypair": {"name": "tempest-keypair-1758773578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyfJ/Lwl7Y5n3rEJm1LynPFhUp5tH9E2PXr4jrnksJqsJ16zJPusnF2uKm1MY6FMFcQ55VmFPHnHtu8QbeocmvSjVjIcqpDUExmMUB21npfzof05hWeQ4cScOQXEbPZdw=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:49.234429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-208ed05f-c2f3-4852-b463-dbff036ddef0 tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Getting quotas for project 7960ad3f5f154f5f84b6e241e20f412d. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:14:49.244251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-208ed05f-c2f3-4852-b463-dbff036ddef0 tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Getting quotas for user 52819577b025430f8840f01248a4be39 and project 7960ad3f5f154f5f84b6e241e20f412d. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:14:49.389345 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-208ed05f-c2f3-4852-b463-dbff036ddef0 tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.184465 Oct 04 21:14:49.389345 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1149/2251] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:14:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:49.395361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-383e1d83-5250-46dd-b5b3-21100b0f158b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:49.396241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-383e1d83-5250-46dd-b5b3-21100b0f158b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:49.410278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-383e1d83-5250-46dd-b5b3-21100b0f158b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:49.419503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-383e1d83-5250-46dd-b5b3-21100b0f158b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:49.419503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-383e1d83-5250-46dd-b5b3-21100b0f158b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:49.419503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-383e1d83-5250-46dd-b5b3-21100b0f158b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:49.419503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-383e1d83-5250-46dd-b5b3-21100b0f158b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:49.419503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-383e1d83-5250-46dd-b5b3-21100b0f158b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:49.899689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-383e1d83-5250-46dd-b5b3-21100b0f158b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:49.916371 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-383e1d83-5250-46dd-b5b3-21100b0f158b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1322 microversion: 2.1 time: 0.527593 Oct 04 21:14:49.917591 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1150/2252] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:49 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1322 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:49.932884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ee114058-6ab2-4688-a4f1-0e9fc326cfec tempest-SecurityGroupsTestAdminJSON-248877601 tempest-SecurityGroupsTestAdminJSON-248877601-project-admin] Calling method '.version_select at 0x7f57944e7670>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:50.495325 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ee114058-6ab2-4688-a4f1-0e9fc326cfec tempest-SecurityGroupsTestAdminJSON-248877601 tempest-SecurityGroupsTestAdminJSON-248877601-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/0ae5f45d-ee4a-4c8d-8b7d-64b26fa969c7" status: 202 len: 0 microversion: 2.1 time: 0.576055 Oct 04 21:14:50.496372 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1151/2253] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:14:49 2022] DELETE /compute/v2.1/os-security-groups/0ae5f45d-ee4a-4c8d-8b7d-64b26fa969c7 => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:14:50.503679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-abb4ea4b-4275-4042-a8db-26d8860146fa tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:50.505181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-abb4ea4b-4275-4042-a8db-26d8860146fa tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:50.525081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abb4ea4b-4275-4042-a8db-26d8860146fa tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:50.525972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abb4ea4b-4275-4042-a8db-26d8860146fa tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:50.526551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abb4ea4b-4275-4042-a8db-26d8860146fa tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:50.533593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abb4ea4b-4275-4042-a8db-26d8860146fa tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:50.542184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abb4ea4b-4275-4042-a8db-26d8860146fa tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:50.544600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abb4ea4b-4275-4042-a8db-26d8860146fa tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:51.026888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-abb4ea4b-4275-4042-a8db-26d8860146fa tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:51.044893 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-abb4ea4b-4275-4042-a8db-26d8860146fa tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1522 microversion: 2.1 time: 0.537880 Oct 04 21:14:51.045952 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1152/2254] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:50 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1522 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:51.052609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-17bb6701-4b63-4149-b716-090202b249ba tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Action: 'create', calling method: .version_select at 0x7f578bf07790>, body: {"keypair": {"name": "tempest-keypair-1758773578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvl3wq8B2sLHYIuPdkeH3RTyLKqULi7q/tGdxNeYfEK5HLIu8NUYuFrJcMW2klKVJwFnXUZIRcDXmove1SCu+HsSLNLx6KFlDneyQzkhrEeCRuKtNm1St8T5BOVqjU+gg=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:51.117114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-17bb6701-4b63-4149-b716-090202b249ba tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Getting quotas for project 7960ad3f5f154f5f84b6e241e20f412d. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:14:51.141522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-17bb6701-4b63-4149-b716-090202b249ba tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Getting quotas for user 52819577b025430f8840f01248a4be39 and project 7960ad3f5f154f5f84b6e241e20f412d. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:14:51.275873 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-17bb6701-4b63-4149-b716-090202b249ba tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] HTTP exception thrown: Key pair 'tempest-keypair-1758773578' already exists. Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-17bb6701-4b63-4149-b716-090202b249ba tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Request method failure captured: Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 273 Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKJC7i5lkl_CKa_FC7nzXEeClevGmQfoG4L5uzhxS_0TyJeyvh9hFG5SRL9xGPVFvz9mTM_T7GXyRJSQQlaUnXWmGrt7tKVGaR9_nm2Zxpy13WSy23O6Hi4sk0x58hT7NG7_rUTRBPtUTocumm_-SlyEbA0VFgLAWItOvK6L4FpDsqE Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7960ad3f5f154f5f84b6e241e20f412d Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7960ad3f5f154f5f84b6e241e20f412d"}]}] Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7960ad3f5f154f5f84b6e241e20f412d Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-KeyPairsNegativeTestJSON-620886437-project Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 52819577b025430f8840f01248a4be39 Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-KeyPairsNegativeTestJSON-620886437-project Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: {"keypair": {"name": "tempest-keypair-1758773578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvl3wq8B2sLHYIuPdkeH3RTyLKqULi7q/tGdxNeYfEK5HLIu8NUYuFrJcMW2klKVJwFnXUZIRcDXmove1SCu+HsSLNLx6KFlDneyQzkhrEeCRuKtNm1St8T5BOVqjU+gg=="}} Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: exception: Key pair 'tempest-keypair-1758773578' already exists. Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1758773578', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvl3wq8B2sLHYIuPdkeH3RTyLKqULi7q/tGdxNeYfEK5HLIu8NUYuFrJcMW2klKVJwFnXUZIRcDXmove1SCu+HsSLNLx6KFlDneyQzkhrEeCRuKtNm1St8T5BOVqjU+gg=='}}} Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result.read() Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '52819577b025430f8840f01248a4be39-tempest-keypair-1758773578' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 21:14:51.286550 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result.read() Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 21:14:51.290227 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '52819577b025430f8840f01248a4be39-tempest-keypair-1758773578' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 21, 14, 51, 226172), 'updated_at': None, 'name': 'tempest-keypair-1758773578', 'user_id': '52819577b025430f8840f01248a4be39', 'fingerprint': '97:7f:40:a6:0b:ca:38:f1:7e:60:c2:81:37:19:c4:35', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvl3wq8B2sLHYIuPdkeH3RTyLKqULi7q/tGdxNeYfEK5HLIu8NUYuFrJcMW2klKVJwFnXUZIRcDXmove1SCu+HsSLNLx6KFlDneyQzkhrEeCRuKtNm1St8T5BOVqjU+gg==', 'type': 'ssh'}] Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi keypair.create() Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._create() Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1758773578' already exists. Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 04 21:14:51.293583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1758773578' already exists. Oct 04 21:14:51.296713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:51.296713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:51.296713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:51.296713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:51.296713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:51.296713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:51.296713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:51.296713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:51.296713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1758773578' already exists. Oct 04 21:14:51.296713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:51.298916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-17bb6701-4b63-4149-b716-090202b249ba tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Returning 409 to user: Key pair 'tempest-keypair-1758773578' already exists. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:51.300500 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-17bb6701-4b63-4149-b716-090202b249ba tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.253077 Oct 04 21:14:51.301390 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1153/2255] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:14:51 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 255 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:14:51.318823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-94f1137e-506e-4de9-9803-00491e98b59d tempest-SecurityGroupsTestAdminJSON-1016092140 tempest-SecurityGroupsTestAdminJSON-1016092140-project] Calling method '.version_select at 0x7f57902df0d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:51.996929 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-94f1137e-506e-4de9-9803-00491e98b59d tempest-SecurityGroupsTestAdminJSON-1016092140 tempest-SecurityGroupsTestAdminJSON-1016092140-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/2105f239-23ce-4a64-9ea5-8a4937b4e6b6" status: 202 len: 0 microversion: 2.1 time: 0.693765 Oct 04 21:14:51.998824 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1154/2256] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:14:51 2022] DELETE /compute/v2.1/os-security-groups/2105f239-23ce-4a64-9ea5-8a4937b4e6b6 => generated 0 bytes in 696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:14:52.004916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-87cfb34a-4ec7-4ac4-b085-51e95aa40d19 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:52.005887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-87cfb34a-4ec7-4ac4-b085-51e95aa40d19 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:52.034191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87cfb34a-4ec7-4ac4-b085-51e95aa40d19 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:52.035072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87cfb34a-4ec7-4ac4-b085-51e95aa40d19 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:52.037684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87cfb34a-4ec7-4ac4-b085-51e95aa40d19 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:52.043481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87cfb34a-4ec7-4ac4-b085-51e95aa40d19 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:52.046376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87cfb34a-4ec7-4ac4-b085-51e95aa40d19 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:52.047017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87cfb34a-4ec7-4ac4-b085-51e95aa40d19 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:52.676379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-87cfb34a-4ec7-4ac4-b085-51e95aa40d19 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:52.691132 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-87cfb34a-4ec7-4ac4-b085-51e95aa40d19 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1322 microversion: 2.1 time: 0.691122 Oct 04 21:14:52.705452 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1155/2257] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:51 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1322 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:52.705452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c79baad7-2f1f-496a-a3ea-0fb89704d022 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-332350816", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c79baad7-2f1f-496a-a3ea-0fb89704d022 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Request method failure captured: Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb/action HTTP/1.1 Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 618 Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKIfr0EKjh9lIGpSMallYOOhbfjlmceWYXhhzEhZtKG-K5Qftah8sJPPQwARLxF148gLNgWQ6TQI3CtHtfXOURD85vgsMSrUAP7uSOEzn9FGu8hya9wg7xCbpv6yrgC_TH3BeALF5PS38pqVs3tUVO2zaGck0ZnqjmCZGgWvxK0EmDc Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 4df42993975949899553deaeaffada73 Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4df42993975949899553deaeaffada73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4df42993975949899553deaeaffada73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}] Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 4df42993975949899553deaeaffada73 Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 4d401d8a2c8e4cee856badba313ed00a Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-332350816", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '05f65528-e8a7-4637-a1bf-1baf79b315eb', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-332350816', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:14:52.722236 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 21:14:52.729891 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:52.732229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c79baad7-2f1f-496a-a3ea-0fb89704d022 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:52.732229 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c79baad7-2f1f-496a-a3ea-0fb89704d022 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "POST /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb/action" status: 400 len: 938 microversion: 2.1 time: 0.029171 Oct 04 21:14:52.743537 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1156/2258] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Oct 4 21:14:52 2022] POST /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb/action => generated 938 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:14:52.752132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4b7a243b-2145-46ba-891d-4d46e4397487 tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Calling method '.version_select at 0x7f57900e2820>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:52.907328 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4b7a243b-2145-46ba-891d-4d46e4397487 tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758773578" status: 202 len: 0 microversion: 2.1 time: 0.162525 Oct 04 21:14:52.908821 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1157/2259] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Oct 4 21:14:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758773578 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:14:52.916787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3e7a6137-9113-47ca-a9ff-9a5901c00167 tempest-SecurityGroupsTestAdminJSON-1016092140 tempest-SecurityGroupsTestAdminJSON-1016092140-project] Calling method '.version_select at 0x7f57900e6ee0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:53.047659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:53.074360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=32 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:53.625490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:53.625490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:54.139306 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3e7a6137-9113-47ca-a9ff-9a5901c00167 tempest-SecurityGroupsTestAdminJSON-1016092140 tempest-SecurityGroupsTestAdminJSON-1016092140-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/e6f9c5da-d030-42ab-b5ea-3b9791b47392" status: 202 len: 0 microversion: 2.1 time: 1.229100 Oct 04 21:14:54.141150 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1158/2260] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:14:52 2022] DELETE /compute/v2.1/os-security-groups/e6f9c5da-d030-42ab-b5ea-3b9791b47392 => generated 0 bytes in 1232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:14:54.146191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-1545a365-4fd4-4669-b02d-1fcf70744774 req-5134c823-5c99-4c37-b67e-842167cce6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2", "tag": "36461af8-6eb7-46aa-8410-0ffceb576db9"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:54.194043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1545a365-4fd4-4669-b02d-1fcf70744774 req-5134c823-5c99-4c37-b67e-842167cce6d8 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:54.201406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1545a365-4fd4-4669-b02d-1fcf70744774 req-5134c823-5c99-4c37-b67e-842167cce6d8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:54.201894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1545a365-4fd4-4669-b02d-1fcf70744774 req-5134c823-5c99-4c37-b67e-842167cce6d8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:54.274970 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-1545a365-4fd4-4669-b02d-1fcf70744774 req-5134c823-5c99-4c37-b67e-842167cce6d8 service nova] Creating event network-changed:36461af8-6eb7-46aa-8410-0ffceb576db9 for instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 on n-h1-860282-1 Oct 04 21:14:54.296963 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-1545a365-4fd4-4669-b02d-1fcf70744774 req-5134c823-5c99-4c37-b67e-842167cce6d8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150389 Oct 04 21:14:54.303400 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1159/2261] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:54.323843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f21f6692-aad9-4f0c-89a3-5df432b9840a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:54.324582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f21f6692-aad9-4f0c-89a3-5df432b9840a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:54.345382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f21f6692-aad9-4f0c-89a3-5df432b9840a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:54.346180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f21f6692-aad9-4f0c-89a3-5df432b9840a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:54.347414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f21f6692-aad9-4f0c-89a3-5df432b9840a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:54.349571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f21f6692-aad9-4f0c-89a3-5df432b9840a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:54.350645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f21f6692-aad9-4f0c-89a3-5df432b9840a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:54.351593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f21f6692-aad9-4f0c-89a3-5df432b9840a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:54.827261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f21f6692-aad9-4f0c-89a3-5df432b9840a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:54.835977 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f21f6692-aad9-4f0c-89a3-5df432b9840a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1522 microversion: 2.1 time: 0.531245 Oct 04 21:14:54.842308 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1160/2262] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:54 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1522 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:54.861390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-40d8386c-e922-4954-9e30-6eaa303c5a7c tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Action: 'create', calling method: .version_select at 0x7f578bf1a940>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBYRaeb7f3DurNvo2+texQ17Qo5iT7ICZiLFNmZ7OYATNTZh0/gJXdy66yB/ufFOFSWdDu55p+agyxhzII9E3+45qIndhmHeiZUbrovTx7hPmcQJ7N+0WhhcUOAh0gRPw=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-40d8386c-e922-4954-9e30-6eaa303c5a7c tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Request method failure captured: Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 247 Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKJC7i5lkl_CKa_FC7nzXEeClevGmQfoG4L5uzhxS_0TyJeyvh9hFG5SRL9xGPVFvz9mTM_T7GXyRJSQQlaUnXWmGrt7tKVGaR9_nm2Zxpy13WSy23O6Hi4sk0x58hT7NG7_rUTRBPtUTocumm_-SlyEbA0VFgLAWItOvK6L4FpDsqE Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7960ad3f5f154f5f84b6e241e20f412d Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7960ad3f5f154f5f84b6e241e20f412d"}]}] Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7960ad3f5f154f5f84b6e241e20f412d Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-KeyPairsNegativeTestJSON-620886437-project Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 52819577b025430f8840f01248a4be39 Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-KeyPairsNegativeTestJSON-620886437-project Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBYRaeb7f3DurNvo2+texQ17Qo5iT7ICZiLFNmZ7OYATNTZh0/gJXdy66yB/ufFOFSWdDu55p+agyxhzII9E3+45qIndhmHeiZUbrovTx7hPmcQJ7N+0WhhcUOAh0gRPw=="}} Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBYRaeb7f3DurNvo2+texQ17Qo5iT7ICZiLFNmZ7OYATNTZh0/gJXdy66yB/ufFOFSWdDu55p+agyxhzII9E3+45qIndhmHeiZUbrovTx7hPmcQJ7N+0WhhcUOAh0gRPw=='}}} Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi '' Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:14:54.879018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:14:54.882705 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:14:54.882705 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:14:54.882705 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:14:54.882705 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:14:54.882705 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:14:54.882705 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:54.882705 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:54.882705 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:54.882705 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:54.882705 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:54.882705 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:54.882705 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:14:54.882705 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:14:54.882705 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:14:54.882705 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:54.888094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-40d8386c-e922-4954-9e30-6eaa303c5a7c tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:54.895921 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-40d8386c-e922-4954-9e30-6eaa303c5a7c tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.046260 Oct 04 21:14:54.897234 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1161/2263] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:14:54 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:14:54.903370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5d4a7f53-21b9-4d4d-869d-271af82512d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:54.906894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5d4a7f53-21b9-4d4d-869d-271af82512d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:54.920951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d4a7f53-21b9-4d4d-869d-271af82512d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:54.922274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d4a7f53-21b9-4d4d-869d-271af82512d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:54.922905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d4a7f53-21b9-4d4d-869d-271af82512d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:54.924297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d4a7f53-21b9-4d4d-869d-271af82512d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:54.925230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d4a7f53-21b9-4d4d-869d-271af82512d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:54.925884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d4a7f53-21b9-4d4d-869d-271af82512d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:55.820744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5d4a7f53-21b9-4d4d-869d-271af82512d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:55.834194 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5d4a7f53-21b9-4d4d-869d-271af82512d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1322 microversion: 2.1 time: 0.935109 Oct 04 21:14:55.857602 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1162/2264] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:54 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1322 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:55.876877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-adbaf977-90cb-465b-86a6-3005c85ad19c req-712cc6d3-5f5c-4933-af9b-58837fd1ebdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a86ffd-75a1-460b-ae59-24969ece95ad", "name": "network-vif-plugged", "status": "completed", "tag": "ebbb3376-2554-4ae5-be99-ef246a2637f5"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:55.929330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-adbaf977-90cb-465b-86a6-3005c85ad19c req-712cc6d3-5f5c-4933-af9b-58837fd1ebdf service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:55.929901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-adbaf977-90cb-465b-86a6-3005c85ad19c req-712cc6d3-5f5c-4933-af9b-58837fd1ebdf service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:55.930970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-adbaf977-90cb-465b-86a6-3005c85ad19c req-712cc6d3-5f5c-4933-af9b-58837fd1ebdf service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:55.965444 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-adbaf977-90cb-465b-86a6-3005c85ad19c req-712cc6d3-5f5c-4933-af9b-58837fd1ebdf service nova] Creating event network-vif-plugged:ebbb3376-2554-4ae5-be99-ef246a2637f5 for instance 89a86ffd-75a1-460b-ae59-24969ece95ad on n-h2-860282-1 Oct 04 21:14:55.970511 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-adbaf977-90cb-465b-86a6-3005c85ad19c req-712cc6d3-5f5c-4933-af9b-58837fd1ebdf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111616 Oct 04 21:14:55.974196 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1163/2265] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:55.993819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-62c7f95d-52b5-462f-b22b-b71b0906b492 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:55.995350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-62c7f95d-52b5-462f-b22b-b71b0906b492 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:56.015722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62c7f95d-52b5-462f-b22b-b71b0906b492 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:56.016574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62c7f95d-52b5-462f-b22b-b71b0906b492 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:56.019764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62c7f95d-52b5-462f-b22b-b71b0906b492 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:56.020841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62c7f95d-52b5-462f-b22b-b71b0906b492 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:56.022831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62c7f95d-52b5-462f-b22b-b71b0906b492 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:56.026586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62c7f95d-52b5-462f-b22b-b71b0906b492 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:56.207270 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-72945c00-9c43-492f-a6b6-821225ac9450 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3" status: 200 len: 1449 microversion: 2.1 time: 12.738266 Oct 04 21:14:56.208599 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1103/2266] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:14:43 2022] GET /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3 => generated 1449 bytes in 12740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:56.217998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-988dfe0b-45ea-4939-b4fe-aae73fc17e6e tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Action: 'create', calling method: .version_select at 0x7f578ba18f70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1156551840", "public_key": " "}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:56.247691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-988dfe0b-45ea-4939-b4fe-aae73fc17e6e tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Getting quotas for project 7960ad3f5f154f5f84b6e241e20f412d. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:14:56.256073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-988dfe0b-45ea-4939-b4fe-aae73fc17e6e tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Getting quotas for user 52819577b025430f8840f01248a4be39 and project 7960ad3f5f154f5f84b6e241e20f412d. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:14:56.290853 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-988dfe0b-45ea-4939-b4fe-aae73fc17e6e tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-988dfe0b-45ea-4939-b4fe-aae73fc17e6e tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Request method failure captured: Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 95 Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKJC7i5lkl_CKa_FC7nzXEeClevGmQfoG4L5uzhxS_0TyJeyvh9hFG5SRL9xGPVFvz9mTM_T7GXyRJSQQlaUnXWmGrt7tKVGaR9_nm2Zxpy13WSy23O6Hi4sk0x58hT7NG7_rUTRBPtUTocumm_-SlyEbA0VFgLAWItOvK6L4FpDsqE Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 7960ad3f5f154f5f84b6e241e20f412d Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7960ad3f5f154f5f84b6e241e20f412d"}]}] Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 7960ad3f5f154f5f84b6e241e20f412d Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-KeyPairsNegativeTestJSON-620886437-project Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 52819577b025430f8840f01248a4be39 Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-KeyPairsNegativeTestJSON-620886437-project Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1156551840", "public_key": " "}} Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1156551840', 'public_key': ' '}}} Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:56.294864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 21:14:56.298226 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.302878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-988dfe0b-45ea-4939-b4fe-aae73fc17e6e tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:56.304599 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-988dfe0b-45ea-4939-b4fe-aae73fc17e6e tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.093261 Oct 04 21:14:56.306392 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1104/2267] 10.222.0.30 () {60 vars in 1158 bytes} [Tue Oct 4 21:14:56 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:14:56.315971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4c324729-ac1b-422f-93f1-95484b00e062 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f578ba1d0d0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:56.472096 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4c324729-ac1b-422f-93f1-95484b00e062 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3" status: 200 len: 1449 microversion: 2.1 time: 0.163987 Oct 04 21:14:56.472844 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1105/2268] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:14:56 2022] GET /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3 => generated 1449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:56.482613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b44b9c5e-e288-44ba-9111-3d99b8b3312f tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Action: 'create', calling method: .version_select at 0x7f578ba32b80>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaJQU+2MYpzYXrMh2CiJCBUbIRWDshpsid7DcQPDtG8HTjqpq3GIQmfzkghzxXxm5E0ocn62sColDlTJvqXzQjIB5FbPmasy3JJCwyxREQ8QZHZCxGWC+gbya/2X+rNwA=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b44b9c5e-e288-44ba-9111-3d99b8b3312f tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Request method failure captured: Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 507 Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKJC7i5lkl_CKa_FC7nzXEeClevGmQfoG4L5uzhxS_0TyJeyvh9hFG5SRL9xGPVFvz9mTM_T7GXyRJSQQlaUnXWmGrt7tKVGaR9_nm2Zxpy13WSy23O6Hi4sk0x58hT7NG7_rUTRBPtUTocumm_-SlyEbA0VFgLAWItOvK6L4FpDsqE Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 7960ad3f5f154f5f84b6e241e20f412d Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7960ad3f5f154f5f84b6e241e20f412d"}]}] Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 7960ad3f5f154f5f84b6e241e20f412d Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-KeyPairsNegativeTestJSON-620886437-project Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 52819577b025430f8840f01248a4be39 Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-KeyPairsNegativeTestJSON-620886437-project Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaJQU+2MYpzYXrMh2CiJCBUbIRWDshpsid7DcQPDtG8HTjqpq3GIQmfzkghzxXxm5E0ocn62sColDlTJvqXzQjIB5FbPmasy3JJCwyxREQ8QZHZCxGWC+gbya/2X+rNwA=="}} Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaJQU+2MYpzYXrMh2CiJCBUbIRWDshpsid7DcQPDtG8HTjqpq3GIQmfzkghzxXxm5E0ocn62sColDlTJvqXzQjIB5FbPmasy3JJCwyxREQ8QZHZCxGWC+gbya/2X+rNwA=='}}} Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 21:14:56.490357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 21:14:56.493615 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.499681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b44b9c5e-e288-44ba-9111-3d99b8b3312f tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:56.501084 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b44b9c5e-e288-44ba-9111-3d99b8b3312f tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.026819 Oct 04 21:14:56.507985 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1106/2269] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:14:56 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:14:56.540113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-14322c83-5d07-4747-b8a8-8b9a5cf87a82 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f578ba95670>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:56.636330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-62c7f95d-52b5-462f-b22b-b71b0906b492 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:56.648616 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-62c7f95d-52b5-462f-b22b-b71b0906b492 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1522 microversion: 2.1 time: 0.672034 Oct 04 21:14:56.654236 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1164/2270] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:55 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1522 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:56.667046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ad544c75-39c3-4395-b5ed-ba5f3f04546b tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Action: 'create', calling method: .version_select at 0x7f578bf07430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-442352282", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:56.716467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ad544c75-39c3-4395-b5ed-ba5f3f04546b tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Getting quotas for project 7960ad3f5f154f5f84b6e241e20f412d. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:14:56.731261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ad544c75-39c3-4395-b5ed-ba5f3f04546b tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Getting quotas for user 52819577b025430f8840f01248a4be39 and project 7960ad3f5f154f5f84b6e241e20f412d. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:14:56.779573 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-ad544c75-39c3-4395-b5ed-ba5f3f04546b tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ad544c75-39c3-4395-b5ed-ba5f3f04546b tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Request method failure captured: Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 117 Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKJC7i5lkl_CKa_FC7nzXEeClevGmQfoG4L5uzhxS_0TyJeyvh9hFG5SRL9xGPVFvz9mTM_T7GXyRJSQQlaUnXWmGrt7tKVGaR9_nm2Zxpy13WSy23O6Hi4sk0x58hT7NG7_rUTRBPtUTocumm_-SlyEbA0VFgLAWItOvK6L4FpDsqE Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7960ad3f5f154f5f84b6e241e20f412d Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7960ad3f5f154f5f84b6e241e20f412d"}]}] Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7960ad3f5f154f5f84b6e241e20f412d Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-KeyPairsNegativeTestJSON-620886437-project Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 52819577b025430f8840f01248a4be39 Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-KeyPairsNegativeTestJSON-620886437-project Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-442352282", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-442352282', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 21:14:56.789127 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ad544c75-39c3-4395-b5ed-ba5f3f04546b tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ad544c75-39c3-4395-b5ed-ba5f3f04546b tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.132883 Oct 04 21:14:56.797445 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1165/2271] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:14:56 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:14:56.808270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b9bc8846-f452-43b3-a784-3d6cbeb7cf8f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b9bc8846-f452-43b3-a784-3d6cbeb7cf8f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Request method failure captured: Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb/action HTTP/1.1 Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 285 Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKIfr0EKjh9lIGpSMallYOOhbfjlmceWYXhhzEhZtKG-K5Qftah8sJPPQwARLxF148gLNgWQ6TQI3CtHtfXOURD85vgsMSrUAP7uSOEzn9FGu8hya9wg7xCbpv6yrgC_TH3BeALF5PS38pqVs3tUVO2zaGck0ZnqjmCZGgWvxK0EmDc Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 4df42993975949899553deaeaffada73 Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4df42993975949899553deaeaffada73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4df42993975949899553deaeaffada73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}] Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 4df42993975949899553deaeaffada73 Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 4d401d8a2c8e4cee856badba313ed00a Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '05f65528-e8a7-4637-a1bf-1baf79b315eb', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:56.823713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b9bc8846-f452-43b3-a784-3d6cbeb7cf8f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:56.834309 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b9bc8846-f452-43b3-a784-3d6cbeb7cf8f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "POST /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb/action" status: 400 len: 619 microversion: 2.1 time: 0.043799 Oct 04 21:14:56.837773 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1166/2272] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Oct 4 21:14:56 2022] POST /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb/action => generated 619 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:14:56.847019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4989d8a5-5548-4fa5-ae04-da9bba9ee7eb tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Calling method '.version_select at 0x7f578bf07670>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:56.895464 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-4989d8a5-5548-4fa5-ae04-da9bba9ee7eb tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-321217788 not found for user 52819577b025430f8840f01248a4be39 Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4989d8a5-5548-4fa5-ae04-da9bba9ee7eb tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Request method failure captured: Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-321217788 HTTP/1.1 Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKJC7i5lkl_CKa_FC7nzXEeClevGmQfoG4L5uzhxS_0TyJeyvh9hFG5SRL9xGPVFvz9mTM_T7GXyRJSQQlaUnXWmGrt7tKVGaR9_nm2Zxpy13WSy23O6Hi4sk0x58hT7NG7_rUTRBPtUTocumm_-SlyEbA0VFgLAWItOvK6L4FpDsqE Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7960ad3f5f154f5f84b6e241e20f412d Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7960ad3f5f154f5f84b6e241e20f412d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7960ad3f5f154f5f84b6e241e20f412d"}]}] Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7960ad3f5f154f5f84b6e241e20f412d Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-620886437 Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-KeyPairsNegativeTestJSON-620886437-project Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 52819577b025430f8840f01248a4be39 Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-KeyPairsNegativeTestJSON-620886437-project Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: exception: Keypair tempest-keypair-non-existent-321217788 not found for user 52819577b025430f8840f01248a4be39 Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'tempest-keypair-non-existent-321217788'} Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-321217788 not found for user 52819577b025430f8840f01248a4be39 Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.897388 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-321217788 not found for user 52819577b025430f8840f01248a4be39 Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-321217788 not found for user 52819577b025430f8840f01248a4be39 Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4989d8a5-5548-4fa5-ae04-da9bba9ee7eb tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] Returning 404 to user: Keypair tempest-keypair-non-existent-321217788 not found for user 52819577b025430f8840f01248a4be39 {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:56.903671 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4989d8a5-5548-4fa5-ae04-da9bba9ee7eb tempest-KeyPairsNegativeTestJSON-620886437 tempest-KeyPairsNegativeTestJSON-620886437-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-321217788" status: 404 len: 144 microversion: 2.1 time: 0.063684 Oct 04 21:14:56.914199 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1167/2273] 10.222.0.30 () {58 vars in 1257 bytes} [Tue Oct 4 21:14:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-321217788 => generated 144 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:14:56.926935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e76d4681-b93f-4716-abd8-0270095d7731 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:56.927738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e76d4681-b93f-4716-abd8-0270095d7731 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:56.936640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e76d4681-b93f-4716-abd8-0270095d7731 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:56.937502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e76d4681-b93f-4716-abd8-0270095d7731 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:56.938153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e76d4681-b93f-4716-abd8-0270095d7731 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:56.939269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e76d4681-b93f-4716-abd8-0270095d7731 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:56.939838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e76d4681-b93f-4716-abd8-0270095d7731 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:56.940359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e76d4681-b93f-4716-abd8-0270095d7731 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:57.291168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e76d4681-b93f-4716-abd8-0270095d7731 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:57.303460 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e76d4681-b93f-4716-abd8-0270095d7731 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1522 microversion: 2.1 time: 0.385959 Oct 04 21:14:57.307652 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1168/2274] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:56 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:57.340208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2a0a0e31-080d-4745-b0a8-732d00174c12 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:57.340967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2a0a0e31-080d-4745-b0a8-732d00174c12 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:57.361601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a0a0e31-080d-4745-b0a8-732d00174c12 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:57.361601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a0a0e31-080d-4745-b0a8-732d00174c12 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:57.361601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a0a0e31-080d-4745-b0a8-732d00174c12 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:57.361601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a0a0e31-080d-4745-b0a8-732d00174c12 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:57.361601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a0a0e31-080d-4745-b0a8-732d00174c12 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:57.361601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a0a0e31-080d-4745-b0a8-732d00174c12 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:57.623946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2a0a0e31-080d-4745-b0a8-732d00174c12 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:57.643443 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2a0a0e31-080d-4745-b0a8-732d00174c12 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1322 microversion: 2.1 time: 0.327244 Oct 04 21:14:57.650231 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1169/2275] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:57 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:57.657156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f384cb91-7d0d-4cf8-bd8a-51e4f0002862 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:57.659307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f384cb91-7d0d-4cf8-bd8a-51e4f0002862 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:57.672205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f384cb91-7d0d-4cf8-bd8a-51e4f0002862 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:57.672938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f384cb91-7d0d-4cf8-bd8a-51e4f0002862 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:57.673615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f384cb91-7d0d-4cf8-bd8a-51e4f0002862 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:57.674507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f384cb91-7d0d-4cf8-bd8a-51e4f0002862 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:57.675692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f384cb91-7d0d-4cf8-bd8a-51e4f0002862 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:57.676269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f384cb91-7d0d-4cf8-bd8a-51e4f0002862 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:57.951245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f384cb91-7d0d-4cf8-bd8a-51e4f0002862 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:57.978159 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f384cb91-7d0d-4cf8-bd8a-51e4f0002862 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1522 microversion: 2.1 time: 0.326707 Oct 04 21:14:57.979474 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1170/2276] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:57 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:58.028384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f16fa9f2-65b9-41e9-b4c6-e1568c92b660 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1374152760"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:58.033489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f16fa9f2-65b9-41e9-b4c6-e1568c92b660 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:58.062455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f16fa9f2-65b9-41e9-b4c6-e1568c92b660 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:58.064006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f16fa9f2-65b9-41e9-b4c6-e1568c92b660 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:58.065448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f16fa9f2-65b9-41e9-b4c6-e1568c92b660 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:58.067217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f16fa9f2-65b9-41e9-b4c6-e1568c92b660 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:58.068826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f16fa9f2-65b9-41e9-b4c6-e1568c92b660 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:58.071975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f16fa9f2-65b9-41e9-b4c6-e1568c92b660 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:59.213111 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-14322c83-5d07-4747-b8a8-8b9a5cf87a82 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "DELETE /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3" status: 204 len: 0 microversion: 2.1 time: 2.688202 Oct 04 21:14:59.214281 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1107/2277] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:56 2022] DELETE /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3 => generated 0 bytes in 2706 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:14:59.223110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-81e2b65f-1245-494b-9015-8ff93bc891fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:59.223926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-81e2b65f-1245-494b-9015-8ff93bc891fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:59.238657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81e2b65f-1245-494b-9015-8ff93bc891fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:59.240220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81e2b65f-1245-494b-9015-8ff93bc891fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:59.243411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81e2b65f-1245-494b-9015-8ff93bc891fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:59.244465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81e2b65f-1245-494b-9015-8ff93bc891fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:59.245185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81e2b65f-1245-494b-9015-8ff93bc891fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:59.245843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81e2b65f-1245-494b-9015-8ff93bc891fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:59.564671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-81e2b65f-1245-494b-9015-8ff93bc891fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:59.578237 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-81e2b65f-1245-494b-9015-8ff93bc891fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1322 microversion: 2.1 time: 0.357195 Oct 04 21:14:59.581573 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1108/2278] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:59 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:59.601825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4fd8362d-bffc-411b-8966-5139a9baaef0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:59.603184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4fd8362d-bffc-411b-8966-5139a9baaef0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:59.630515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fd8362d-bffc-411b-8966-5139a9baaef0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:59.633005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fd8362d-bffc-411b-8966-5139a9baaef0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:59.634723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fd8362d-bffc-411b-8966-5139a9baaef0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:59.635664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fd8362d-bffc-411b-8966-5139a9baaef0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:59.639016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fd8362d-bffc-411b-8966-5139a9baaef0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:59.640975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fd8362d-bffc-411b-8966-5139a9baaef0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:59.742737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4fd8362d-bffc-411b-8966-5139a9baaef0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:14:59.901041 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f16fa9f2-65b9-41e9-b4c6-e1568c92b660 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "POST /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb/action" status: 202 len: 0 microversion: 2.1 time: 1.878251 Oct 04 21:14:59.906578 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1171/2279] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:14:58 2022] POST /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb/action => generated 0 bytes in 1885 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 21:14:59.928542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d90344db-5609-46a9-b028-51196da2fc8d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-272174626"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:59.935441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d90344db-5609-46a9-b028-51196da2fc8d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:59.944223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d90344db-5609-46a9-b028-51196da2fc8d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:59.945047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d90344db-5609-46a9-b028-51196da2fc8d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:59.945765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d90344db-5609-46a9-b028-51196da2fc8d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:59.947132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d90344db-5609-46a9-b028-51196da2fc8d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:59.948048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d90344db-5609-46a9-b028-51196da2fc8d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:59.948687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d90344db-5609-46a9-b028-51196da2fc8d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:00.010844 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-d90344db-5609-46a9-b028-51196da2fc8d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] HTTP exception thrown: Cannot 'createImage' instance 05f65528-e8a7-4637-a1bf-1baf79b315eb while it is in task_state image_snapshot_pending Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d90344db-5609-46a9-b028-51196da2fc8d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Request method failure captured: Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb/action HTTP/1.1 Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 84 Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKIfr0EKjh9lIGpSMallYOOhbfjlmceWYXhhzEhZtKG-K5Qftah8sJPPQwARLxF148gLNgWQ6TQI3CtHtfXOURD85vgsMSrUAP7uSOEzn9FGu8hya9wg7xCbpv6yrgC_TH3BeALF5PS38pqVs3tUVO2zaGck0ZnqjmCZGgWvxK0EmDc Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 4df42993975949899553deaeaffada73 Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4df42993975949899553deaeaffada73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4df42993975949899553deaeaffada73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}] Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 4df42993975949899553deaeaffada73 Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 4d401d8a2c8e4cee856badba313ed00a Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-272174626"}} Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: exception: Cannot 'createImage' instance 05f65528-e8a7-4637-a1bf-1baf79b315eb while it is in task_state image_snapshot_pending Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '05f65528-e8a7-4637-a1bf-1baf79b315eb', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-272174626'}}} Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 05f65528-e8a7-4637-a1bf-1baf79b315eb in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:15:00.014888 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:15:00.018275 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 05f65528-e8a7-4637-a1bf-1baf79b315eb while it is in task_state image_snapshot_pending Oct 04 21:15:00.018275 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:00.018275 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:00.018275 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:00.018275 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:00.018275 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:00.018275 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:00.018275 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:00.018275 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:00.018275 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 05f65528-e8a7-4637-a1bf-1baf79b315eb while it is in task_state image_snapshot_pending Oct 04 21:15:00.018275 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:00.022354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d90344db-5609-46a9-b028-51196da2fc8d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Returning 409 to user: Cannot 'createImage' instance 05f65528-e8a7-4637-a1bf-1baf79b315eb while it is in task_state image_snapshot_pending {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:00.023176 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d90344db-5609-46a9-b028-51196da2fc8d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "POST /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb/action" status: 409 len: 167 microversion: 2.1 time: 0.106602 Oct 04 21:15:00.023769 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1172/2280] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:14:59 2022] POST /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb/action => generated 167 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:15:00.057767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-c6936b83-1d22-4857-8685-c4fd3081cf6b req-7d6a9efc-e714-4c32-803c-0a70c1fddb9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c974866c-d0de-4595-85b6-7404f349c6f1", "name": "network-vif-unplugged", "status": "completed", "tag": "363ea383-0f2b-4176-8e31-c2e9325ecb59"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:00.082767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c6936b83-1d22-4857-8685-c4fd3081cf6b req-7d6a9efc-e714-4c32-803c-0a70c1fddb9d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:00.096894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c6936b83-1d22-4857-8685-c4fd3081cf6b req-7d6a9efc-e714-4c32-803c-0a70c1fddb9d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:00.097341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c6936b83-1d22-4857-8685-c4fd3081cf6b req-7d6a9efc-e714-4c32-803c-0a70c1fddb9d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:00.161253 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-c6936b83-1d22-4857-8685-c4fd3081cf6b req-7d6a9efc-e714-4c32-803c-0a70c1fddb9d service nova] Creating event network-vif-unplugged:363ea383-0f2b-4176-8e31-c2e9325ecb59 for instance c974866c-d0de-4595-85b6-7404f349c6f1 on n-h2-860282-1 Oct 04 21:15:00.177397 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-c6936b83-1d22-4857-8685-c4fd3081cf6b req-7d6a9efc-e714-4c32-803c-0a70c1fddb9d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140627 Oct 04 21:15:00.180641 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1173/2281] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:00.191062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ca18b512-11a6-4a23-9baf-58c71d0b9a9d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '.version_select at 0x7f578bf073a0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:00.311120 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4fd8362d-bffc-411b-8966-5139a9baaef0 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1" status: 204 len: 0 microversion: 2.1 time: 0.726942 Oct 04 21:15:00.312586 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1109/2282] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:14:59 2022] DELETE /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:15:00.607777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b02d5cee-79f3-4ce0-bd16-a3c611fb531e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:00.609384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b02d5cee-79f3-4ce0-bd16-a3c611fb531e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:00.629510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b02d5cee-79f3-4ce0-bd16-a3c611fb531e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:00.630971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b02d5cee-79f3-4ce0-bd16-a3c611fb531e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:00.631642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b02d5cee-79f3-4ce0-bd16-a3c611fb531e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:00.632552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b02d5cee-79f3-4ce0-bd16-a3c611fb531e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:00.633193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b02d5cee-79f3-4ce0-bd16-a3c611fb531e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:00.633860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b02d5cee-79f3-4ce0-bd16-a3c611fb531e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:00.760143 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ca18b512-11a6-4a23-9baf-58c71d0b9a9d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "DELETE /compute/v2.1/images/47a19102-4fa8-4a3f-b0fc-7fb92622f944" status: 204 len: 0 microversion: 2.1 time: 0.574855 Oct 04 21:15:00.760143 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1174/2283] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:00 2022] DELETE /compute/v2.1/images/47a19102-4fa8-4a3f-b0fc-7fb92622f944 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:15:00.768157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0a81d692-6f15-48b4-9ef9-0d38b298bad3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1443138464", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "355d2dfa-09cc-435f-842a-7fc0ed5ae634"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:00.874905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-0a81d692-6f15-48b4-9ef9-0d38b298bad3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] validate_networks() for [('355d2dfa-09cc-435f-842a-7fc0ed5ae634', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:15:00.945733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b02d5cee-79f3-4ce0-bd16-a3c611fb531e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:00.957113 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b02d5cee-79f3-4ce0-bd16-a3c611fb531e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1322 microversion: 2.1 time: 0.353543 Oct 04 21:15:00.963395 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1110/2284] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:00 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:00.975488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2997fcac-b8ff-495c-81be-da12e408e46b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:00.976128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2997fcac-b8ff-495c-81be-da12e408e46b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:01.004217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2997fcac-b8ff-495c-81be-da12e408e46b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:01.004725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2997fcac-b8ff-495c-81be-da12e408e46b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:01.005175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2997fcac-b8ff-495c-81be-da12e408e46b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:01.014091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2997fcac-b8ff-495c-81be-da12e408e46b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:01.014517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2997fcac-b8ff-495c-81be-da12e408e46b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:01.014969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2997fcac-b8ff-495c-81be-da12e408e46b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:01.448426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2997fcac-b8ff-495c-81be-da12e408e46b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:01.472656 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2997fcac-b8ff-495c-81be-da12e408e46b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1534 microversion: 2.1 time: 0.496333 Oct 04 21:15:01.472656 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1111/2285] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:00 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1534 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:01.980100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f37a752f-3000-4b4f-a4b2-031c8d4f3094 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:01.981105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f37a752f-3000-4b4f-a4b2-031c8d4f3094 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:01.990629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f37a752f-3000-4b4f-a4b2-031c8d4f3094 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:01.991461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f37a752f-3000-4b4f-a4b2-031c8d4f3094 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:01.992176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f37a752f-3000-4b4f-a4b2-031c8d4f3094 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:01.994120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f37a752f-3000-4b4f-a4b2-031c8d4f3094 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:01.997236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f37a752f-3000-4b4f-a4b2-031c8d4f3094 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:02.000429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f37a752f-3000-4b4f-a4b2-031c8d4f3094 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:02.050357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-0a81d692-6f15-48b4-9ef9-0d38b298bad3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:15:02.051321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-0a81d692-6f15-48b4-9ef9-0d38b298bad3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:15:02.051947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-0a81d692-6f15-48b4-9ef9-0d38b298bad3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:15:02.061253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-0a81d692-6f15-48b4-9ef9-0d38b298bad3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:15:02.061253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-0a81d692-6f15-48b4-9ef9-0d38b298bad3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:15:02.062620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:02.076980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a81d692-6f15-48b4-9ef9-0d38b298bad3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:02.077817 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a81d692-6f15-48b4-9ef9-0d38b298bad3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:02.078481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a81d692-6f15-48b4-9ef9-0d38b298bad3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:02.079397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a81d692-6f15-48b4-9ef9-0d38b298bad3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:02.080022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a81d692-6f15-48b4-9ef9-0d38b298bad3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:02.080647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a81d692-6f15-48b4-9ef9-0d38b298bad3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:02.094178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:02.132170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-0a81d692-6f15-48b4-9ef9-0d38b298bad3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Getting quotas for project 7462c68015654227a11892e2a2659ecb. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:02.150848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-0a81d692-6f15-48b4-9ef9-0d38b298bad3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Getting quotas for user c199a13dceec4ae9bd873529c864146e and project 7462c68015654227a11892e2a2659ecb. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:02.181843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0a81d692-6f15-48b4-9ef9-0d38b298bad3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:15:02.189162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0a81d692-6f15-48b4-9ef9-0d38b298bad3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:15:02.390690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f37a752f-3000-4b4f-a4b2-031c8d4f3094 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:02.405528 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f37a752f-3000-4b4f-a4b2-031c8d4f3094 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1322 microversion: 2.1 time: 0.426582 Oct 04 21:15:02.405528 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1112/2286] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:01 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1322 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:02.428781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-599d47d0-cd34-4f61-91b3-efeb2b4ea785 req-6222e638-ff37-4904-9c90-7bebc33f224c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2", "name": "network-vif-plugged", "status": "completed", "tag": "36461af8-6eb7-46aa-8410-0ffceb576db9"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:02.447984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-599d47d0-cd34-4f61-91b3-efeb2b4ea785 req-6222e638-ff37-4904-9c90-7bebc33f224c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:02.450142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-599d47d0-cd34-4f61-91b3-efeb2b4ea785 req-6222e638-ff37-4904-9c90-7bebc33f224c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:02.451250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-599d47d0-cd34-4f61-91b3-efeb2b4ea785 req-6222e638-ff37-4904-9c90-7bebc33f224c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:02.467990 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-599d47d0-cd34-4f61-91b3-efeb2b4ea785 req-6222e638-ff37-4904-9c90-7bebc33f224c service nova] Creating event network-vif-plugged:36461af8-6eb7-46aa-8410-0ffceb576db9 for instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 on n-h1-860282-1 Oct 04 21:15:02.474148 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-599d47d0-cd34-4f61-91b3-efeb2b4ea785 req-6222e638-ff37-4904-9c90-7bebc33f224c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068729 Oct 04 21:15:02.475070 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1113/2287] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:02.651530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cb4826d8-cdc8-45bc-b8c0-63a17d73ff3c tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1992926509", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:02.710480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-cb4826d8-cdc8-45bc-b8c0-63a17d73ff3c tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] validate_networks() for None {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:15:02.934790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-cb4826d8-cdc8-45bc-b8c0-63a17d73ff3c tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:15:02.935227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-cb4826d8-cdc8-45bc-b8c0-63a17d73ff3c tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:15:02.935882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-cb4826d8-cdc8-45bc-b8c0-63a17d73ff3c tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:15:02.936302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-cb4826d8-cdc8-45bc-b8c0-63a17d73ff3c tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:15:02.936736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-cb4826d8-cdc8-45bc-b8c0-63a17d73ff3c tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:15:02.946849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb4826d8-cdc8-45bc-b8c0-63a17d73ff3c tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:02.947346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb4826d8-cdc8-45bc-b8c0-63a17d73ff3c tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:02.948332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb4826d8-cdc8-45bc-b8c0-63a17d73ff3c tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:02.948609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb4826d8-cdc8-45bc-b8c0-63a17d73ff3c tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:02.949264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb4826d8-cdc8-45bc-b8c0-63a17d73ff3c tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:02.949645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb4826d8-cdc8-45bc-b8c0-63a17d73ff3c tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:02.969926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-cb4826d8-cdc8-45bc-b8c0-63a17d73ff3c tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Getting quotas for project 7b630636b36647f5837eda19552ddf1b. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:02.975246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-cb4826d8-cdc8-45bc-b8c0-63a17d73ff3c tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Getting quotas for user 4bb68f8fb49d492e8bfc6e37336d3801 and project 7b630636b36647f5837eda19552ddf1b. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:02.978121 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0a81d692-6f15-48b4-9ef9-0d38b298bad3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.218186 Oct 04 21:15:02.985279 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1175/2288] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:15:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:15:02.988449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cb4826d8-cdc8-45bc-b8c0-63a17d73ff3c tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:15:02.990540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-acb43ec4-0755-42a2-96ca-d3f8c8d1d68e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:02.990896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cb4826d8-cdc8-45bc-b8c0-63a17d73ff3c tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:15:02.991227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-acb43ec4-0755-42a2-96ca-d3f8c8d1d68e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:02.999090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acb43ec4-0755-42a2-96ca-d3f8c8d1d68e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:02.999790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acb43ec4-0755-42a2-96ca-d3f8c8d1d68e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:03.000684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acb43ec4-0755-42a2-96ca-d3f8c8d1d68e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:03.001665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acb43ec4-0755-42a2-96ca-d3f8c8d1d68e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:03.002440 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acb43ec4-0755-42a2-96ca-d3f8c8d1d68e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:03.003058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acb43ec4-0755-42a2-96ca-d3f8c8d1d68e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:03.164379 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cb4826d8-cdc8-45bc-b8c0-63a17d73ff3c tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687981 Oct 04 21:15:03.168561 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1114/2289] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:15:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:15:03.188931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2b5bebfc-1b53-4b49-b11b-db6e6fec1581 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:03.192079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2b5bebfc-1b53-4b49-b11b-db6e6fec1581 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:03.461932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2b5bebfc-1b53-4b49-b11b-db6e6fec1581 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:03.477729 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2b5bebfc-1b53-4b49-b11b-db6e6fec1581 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1208 microversion: 2.1 time: 0.292850 Oct 04 21:15:03.481613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-acb43ec4-0755-42a2-96ca-d3f8c8d1d68e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:03.497004 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-acb43ec4-0755-42a2-96ca-d3f8c8d1d68e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1540 microversion: 2.1 time: 0.508872 Oct 04 21:15:03.499684 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1176/2290] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:02 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1540 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:03.513967 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1115/2291] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:03 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1208 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:03.518068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a8f1f53-1841-4bd8-adc8-453acb004e11 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:03.519425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7a8f1f53-1841-4bd8-adc8-453acb004e11 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:03.527583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-298f6ecb-f449-45d0-b138-36237a1e8653 req-a988cb67-ebce-4147-a707-151b4c41ba6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c974866c-d0de-4595-85b6-7404f349c6f1", "name": "network-vif-deleted", "tag": "363ea383-0f2b-4176-8e31-c2e9325ecb59"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:03.541845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-298f6ecb-f449-45d0-b138-36237a1e8653 req-a988cb67-ebce-4147-a707-151b4c41ba6f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:03.546891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-298f6ecb-f449-45d0-b138-36237a1e8653 req-a988cb67-ebce-4147-a707-151b4c41ba6f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:03.547904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-298f6ecb-f449-45d0-b138-36237a1e8653 req-a988cb67-ebce-4147-a707-151b4c41ba6f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:03.569989 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-298f6ecb-f449-45d0-b138-36237a1e8653 req-a988cb67-ebce-4147-a707-151b4c41ba6f service nova] Creating event network-vif-deleted:363ea383-0f2b-4176-8e31-c2e9325ecb59 for instance c974866c-d0de-4595-85b6-7404f349c6f1 on n-h2-860282-1 Oct 04 21:15:03.586981 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-298f6ecb-f449-45d0-b138-36237a1e8653 req-a988cb67-ebce-4147-a707-151b4c41ba6f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069883 Oct 04 21:15:03.590824 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1116/2292] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:03.602569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-66f829b6-d04b-4518-bc91-19c08a19e414 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:03.604948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-66f829b6-d04b-4518-bc91-19c08a19e414 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:03.622896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66f829b6-d04b-4518-bc91-19c08a19e414 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:03.623420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66f829b6-d04b-4518-bc91-19c08a19e414 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:03.623867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66f829b6-d04b-4518-bc91-19c08a19e414 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:03.624835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66f829b6-d04b-4518-bc91-19c08a19e414 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:03.625191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66f829b6-d04b-4518-bc91-19c08a19e414 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:03.626648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66f829b6-d04b-4518-bc91-19c08a19e414 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:03.639835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7a8f1f53-1841-4bd8-adc8-453acb004e11 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb68f8fb49d492e8bfc6e37336d3801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b630636b36647f5837eda19552ddf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:03.651558 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7a8f1f53-1841-4bd8-adc8-453acb004e11 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 200 len: 1223 microversion: 2.1 time: 0.147316 Oct 04 21:15:03.654385 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1177/2293] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:03 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 1223 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:03.862936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-66f829b6-d04b-4518-bc91-19c08a19e414 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:03.871880 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-66f829b6-d04b-4518-bc91-19c08a19e414 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1322 microversion: 2.1 time: 0.281178 Oct 04 21:15:03.872732 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1117/2294] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:03 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:04.521217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-500776a8-280e-4fdd-aa61-b873271dff8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:04.525487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-03ad52bb-0803-4ed4-a029-3bc7f8f93057 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:04.526169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-03ad52bb-0803-4ed4-a029-3bc7f8f93057 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:04.542314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-500776a8-280e-4fdd-aa61-b873271dff8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:04.559772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03ad52bb-0803-4ed4-a029-3bc7f8f93057 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:04.560274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03ad52bb-0803-4ed4-a029-3bc7f8f93057 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:04.560721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03ad52bb-0803-4ed4-a029-3bc7f8f93057 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:04.561462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03ad52bb-0803-4ed4-a029-3bc7f8f93057 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:04.561929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03ad52bb-0803-4ed4-a029-3bc7f8f93057 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:04.562362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03ad52bb-0803-4ed4-a029-3bc7f8f93057 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:04.632995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-500776a8-280e-4fdd-aa61-b873271dff8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:04.641060 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-500776a8-280e-4fdd-aa61-b873271dff8b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1208 microversion: 2.1 time: 0.136017 Oct 04 21:15:04.642218 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1178/2295] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:04 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1208 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:04.680662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d704385a-7be8-4243-87c8-099e259d034e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:04.681296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d704385a-7be8-4243-87c8-099e259d034e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:04.805453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d704385a-7be8-4243-87c8-099e259d034e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb68f8fb49d492e8bfc6e37336d3801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b630636b36647f5837eda19552ddf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:04.818310 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d704385a-7be8-4243-87c8-099e259d034e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 200 len: 1223 microversion: 2.1 time: 0.146360 Oct 04 21:15:04.834096 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1179/2296] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:04 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 1223 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:04.834846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-03ad52bb-0803-4ed4-a029-3bc7f8f93057 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:04.852818 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-03ad52bb-0803-4ed4-a029-3bc7f8f93057 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1535 microversion: 2.1 time: 0.335790 Oct 04 21:15:04.856276 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1118/2297] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:04 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1535 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:04.903201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5e6c25b8-cfc3-443d-86f3-604125f9f7c4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:04.904583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5e6c25b8-cfc3-443d-86f3-604125f9f7c4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:04.922534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e6c25b8-cfc3-443d-86f3-604125f9f7c4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:04.923798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e6c25b8-cfc3-443d-86f3-604125f9f7c4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:04.925234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e6c25b8-cfc3-443d-86f3-604125f9f7c4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:04.927340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e6c25b8-cfc3-443d-86f3-604125f9f7c4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:04.927909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e6c25b8-cfc3-443d-86f3-604125f9f7c4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:04.929066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e6c25b8-cfc3-443d-86f3-604125f9f7c4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:05.203217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5e6c25b8-cfc3-443d-86f3-604125f9f7c4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:05.215687 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5e6c25b8-cfc3-443d-86f3-604125f9f7c4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1516 microversion: 2.1 time: 0.321395 Oct 04 21:15:05.216673 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1180/2298] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:04 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1516 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:05.240372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dac3c2ed-2e26-48af-a410-bd2da5c7aee4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:05.243409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dac3c2ed-2e26-48af-a410-bd2da5c7aee4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:05.259543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dac3c2ed-2e26-48af-a410-bd2da5c7aee4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:05.260824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dac3c2ed-2e26-48af-a410-bd2da5c7aee4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:05.267536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dac3c2ed-2e26-48af-a410-bd2da5c7aee4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:05.278981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dac3c2ed-2e26-48af-a410-bd2da5c7aee4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:05.279649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dac3c2ed-2e26-48af-a410-bd2da5c7aee4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:05.281271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dac3c2ed-2e26-48af-a410-bd2da5c7aee4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:05.329932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-dac3c2ed-2e26-48af-a410-bd2da5c7aee4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lazy-loading 'flavor' on Instance uuid e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:15:05.508729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a1407821-0b3a-4189-a601-746736067d24 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Action: 'create', calling method: .version_select at 0x7f578ba299d0>, body: {"keypair": {"name": "tempest-keypair-63496420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKH7n5H+iLkL/iyuGEGVPGo2agCLfdi61jb1p2hf/+u59OBlHKenjKde1C8KNd99xHhn6vshGiKFIp7Ub+LbRi7E0H7+YOcH977raVbVNVxbsV/fEpOmKTk1zJcVeYxMDw=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:05.572633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-a1407821-0b3a-4189-a601-746736067d24 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Getting quotas for project 2aec0d41371749e7b47226ace53ffe86. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:05.580541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-a1407821-0b3a-4189-a601-746736067d24 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Getting quotas for user 9762c7ce00fb40798f03212a6c3d4c08 and project 2aec0d41371749e7b47226ace53ffe86. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:05.766610 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a1407821-0b3a-4189-a601-746736067d24 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.664841 Oct 04 21:15:05.767244 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1119/2299] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:15:05 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:15:05.772066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-74f37fd2-ad64-4176-bb95-21ef31373502 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:05.772429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-74f37fd2-ad64-4176-bb95-21ef31373502 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:05.783665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74f37fd2-ad64-4176-bb95-21ef31373502 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:05.784260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74f37fd2-ad64-4176-bb95-21ef31373502 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:05.784932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74f37fd2-ad64-4176-bb95-21ef31373502 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:05.785873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74f37fd2-ad64-4176-bb95-21ef31373502 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:05.786531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74f37fd2-ad64-4176-bb95-21ef31373502 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:05.787178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74f37fd2-ad64-4176-bb95-21ef31373502 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:05.918103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-74f37fd2-ad64-4176-bb95-21ef31373502 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:05.933093 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-74f37fd2-ad64-4176-bb95-21ef31373502 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1204 microversion: 2.1 time: 0.162472 Oct 04 21:15:05.934062 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1120/2300] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:05 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1204 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:05.939539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d0524361-a85c-4f83-a03e-27fe0bbe7245 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:05.944732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d0524361-a85c-4f83-a03e-27fe0bbe7245 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:05.950251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0524361-a85c-4f83-a03e-27fe0bbe7245 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:05.950969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0524361-a85c-4f83-a03e-27fe0bbe7245 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:05.951659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0524361-a85c-4f83-a03e-27fe0bbe7245 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:05.952859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0524361-a85c-4f83-a03e-27fe0bbe7245 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:05.953791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0524361-a85c-4f83-a03e-27fe0bbe7245 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:05.954736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0524361-a85c-4f83-a03e-27fe0bbe7245 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:05.982035 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dac3c2ed-2e26-48af-a410-bd2da5c7aee4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "POST /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2/action" status: 200 len: 32 microversion: 2.1 time: 0.746882 Oct 04 21:15:05.982673 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1181/2301] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:15:05 2022] POST /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2/action => generated 32 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:15:05.999959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-153c025c-e722-4039-92ec-918d8f7ed128 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:06.003547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-153c025c-e722-4039-92ec-918d8f7ed128 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:06.023107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-153c025c-e722-4039-92ec-918d8f7ed128 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:06.023917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-153c025c-e722-4039-92ec-918d8f7ed128 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:06.025323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-153c025c-e722-4039-92ec-918d8f7ed128 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:06.029763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-153c025c-e722-4039-92ec-918d8f7ed128 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:06.031331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-153c025c-e722-4039-92ec-918d8f7ed128 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:06.033380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-153c025c-e722-4039-92ec-918d8f7ed128 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:06.132285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d0524361-a85c-4f83-a03e-27fe0bbe7245 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb68f8fb49d492e8bfc6e37336d3801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b630636b36647f5837eda19552ddf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:06.141382 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d0524361-a85c-4f83-a03e-27fe0bbe7245 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 200 len: 1227 microversion: 2.1 time: 0.205972 Oct 04 21:15:06.141939 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1121/2302] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:05 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 1227 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:06.149611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-28dd34c8-ae8b-4a8a-98f4-cdbc1ec27b8a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:06.150505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-28dd34c8-ae8b-4a8a-98f4-cdbc1ec27b8a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:06.157226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28dd34c8-ae8b-4a8a-98f4-cdbc1ec27b8a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:06.157972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28dd34c8-ae8b-4a8a-98f4-cdbc1ec27b8a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:06.158717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28dd34c8-ae8b-4a8a-98f4-cdbc1ec27b8a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:06.159742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28dd34c8-ae8b-4a8a-98f4-cdbc1ec27b8a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:06.160440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28dd34c8-ae8b-4a8a-98f4-cdbc1ec27b8a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:06.161262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28dd34c8-ae8b-4a8a-98f4-cdbc1ec27b8a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:06.592302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-153c025c-e722-4039-92ec-918d8f7ed128 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:06.608790 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-153c025c-e722-4039-92ec-918d8f7ed128 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1522 microversion: 2.1 time: 0.621560 Oct 04 21:15:06.613351 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1182/2303] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:05 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1522 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:06.616126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-28dd34c8-ae8b-4a8a-98f4-cdbc1ec27b8a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:06.626445 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-28dd34c8-ae8b-4a8a-98f4-cdbc1ec27b8a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.483194 Oct 04 21:15:06.627036 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1122/2304] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:06 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:06.655278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-19f9ebbc-5fdd-47e2-8c5b-3f309a907ed6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:06.655685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-19f9ebbc-5fdd-47e2-8c5b-3f309a907ed6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:06.673932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19f9ebbc-5fdd-47e2-8c5b-3f309a907ed6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:06.674461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19f9ebbc-5fdd-47e2-8c5b-3f309a907ed6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:06.674970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19f9ebbc-5fdd-47e2-8c5b-3f309a907ed6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:06.676129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19f9ebbc-5fdd-47e2-8c5b-3f309a907ed6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:06.676581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19f9ebbc-5fdd-47e2-8c5b-3f309a907ed6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:06.677015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19f9ebbc-5fdd-47e2-8c5b-3f309a907ed6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:06.745336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-19f9ebbc-5fdd-47e2-8c5b-3f309a907ed6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:15:07.153675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1c552b3b-ae1e-4d5f-8fa6-9dd85a45d899 tempest-QuotasTestJSON-1103989904 tempest-QuotasTestJSON-1103989904-project] Calling method '.version_select at 0x7f578ba32430>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:07.300068 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-19f9ebbc-5fdd-47e2-8c5b-3f309a907ed6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "DELETE /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 204 len: 0 microversion: 2.1 time: 0.668142 Oct 04 21:15:07.301097 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1183/2305] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:15:06 2022] DELETE /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 0 bytes in 671 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:15:07.307535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9ca7e75-6b38-4b04-9096-c91631b40b7b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:07.308219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d9ca7e75-6b38-4b04-9096-c91631b40b7b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:07.324656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9ca7e75-6b38-4b04-9096-c91631b40b7b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:07.327329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9ca7e75-6b38-4b04-9096-c91631b40b7b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:07.328019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9ca7e75-6b38-4b04-9096-c91631b40b7b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:07.329218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9ca7e75-6b38-4b04-9096-c91631b40b7b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:07.330423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9ca7e75-6b38-4b04-9096-c91631b40b7b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:07.331905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9ca7e75-6b38-4b04-9096-c91631b40b7b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:07.335684 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1c552b3b-ae1e-4d5f-8fa6-9dd85a45d899 tempest-QuotasTestJSON-1103989904 tempest-QuotasTestJSON-1103989904-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/c83e15435bbf4c52890515c357803f18/defaults" status: 200 len: 371 microversion: 2.1 time: 0.517924 Oct 04 21:15:07.337153 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1123/2306] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Oct 4 21:15:06 2022] GET /compute/v2.1/os-quota-sets/c83e15435bbf4c52890515c357803f18/defaults => generated 371 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:07.363534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4527f2b3-1656-491a-bc47-9a3454b6c990 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:07.364214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4527f2b3-1656-491a-bc47-9a3454b6c990 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:07.386892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4527f2b3-1656-491a-bc47-9a3454b6c990 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:07.387478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4527f2b3-1656-491a-bc47-9a3454b6c990 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:07.390419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4527f2b3-1656-491a-bc47-9a3454b6c990 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:07.391393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4527f2b3-1656-491a-bc47-9a3454b6c990 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:07.393319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4527f2b3-1656-491a-bc47-9a3454b6c990 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:07.396587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4527f2b3-1656-491a-bc47-9a3454b6c990 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:07.465045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d9ca7e75-6b38-4b04-9096-c91631b40b7b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:07.487912 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d9ca7e75-6b38-4b04-9096-c91631b40b7b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1268 microversion: 2.1 time: 0.182449 Oct 04 21:15:07.509511 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1184/2307] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:07 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1268 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:07.569346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0d3d2656-6649-47d0-af9e-bd81cb03fdcd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:07.570125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0d3d2656-6649-47d0-af9e-bd81cb03fdcd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:07.592207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d3d2656-6649-47d0-af9e-bd81cb03fdcd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:07.593525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d3d2656-6649-47d0-af9e-bd81cb03fdcd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:07.594101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d3d2656-6649-47d0-af9e-bd81cb03fdcd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:07.594888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d3d2656-6649-47d0-af9e-bd81cb03fdcd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:07.595555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d3d2656-6649-47d0-af9e-bd81cb03fdcd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:07.598930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d3d2656-6649-47d0-af9e-bd81cb03fdcd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:07.631643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4527f2b3-1656-491a-bc47-9a3454b6c990 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb68f8fb49d492e8bfc6e37336d3801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b630636b36647f5837eda19552ddf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:07.643469 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4527f2b3-1656-491a-bc47-9a3454b6c990 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 200 len: 1275 microversion: 2.1 time: 0.289629 Oct 04 21:15:07.644719 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1124/2308] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:07 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 1275 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:07.650741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3c060924-f6b1-4664-adcc-49c89f413275 tempest-QuotasTestJSON-1103989904 tempest-QuotasTestJSON-1103989904-project] Calling method '.version_select at 0x7f578ba29ee0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:07.770474 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3c060924-f6b1-4664-adcc-49c89f413275 tempest-QuotasTestJSON-1103989904 tempest-QuotasTestJSON-1103989904-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/c83e15435bbf4c52890515c357803f18" status: 200 len: 371 microversion: 2.1 time: 0.124212 Oct 04 21:15:07.771012 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1125/2309] 10.222.0.30 () {58 vars in 1242 bytes} [Tue Oct 4 21:15:07 2022] GET /compute/v2.1/os-quota-sets/c83e15435bbf4c52890515c357803f18 => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:07.776108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5c8a06e8-2bc1-4c3f-921a-6f9281bf65e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:07.776954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5c8a06e8-2bc1-4c3f-921a-6f9281bf65e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:07.783455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c8a06e8-2bc1-4c3f-921a-6f9281bf65e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:07.784036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c8a06e8-2bc1-4c3f-921a-6f9281bf65e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:07.784477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c8a06e8-2bc1-4c3f-921a-6f9281bf65e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:07.791718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c8a06e8-2bc1-4c3f-921a-6f9281bf65e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:07.791718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c8a06e8-2bc1-4c3f-921a-6f9281bf65e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:07.791718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c8a06e8-2bc1-4c3f-921a-6f9281bf65e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:08.017692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0d3d2656-6649-47d0-af9e-bd81cb03fdcd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:08.030117 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0d3d2656-6649-47d0-af9e-bd81cb03fdcd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1528 microversion: 2.1 time: 0.517979 Oct 04 21:15:08.046888 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1185/2310] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:07 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1528 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:08.064061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4221472a-2e90-4edd-a809-176047b681c5 tempest-QuotasTestJSON-1103989904 tempest-QuotasTestJSON-1103989904-project] Calling method '.version_select at 0x7f57944e7820>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:08.104791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5c8a06e8-2bc1-4c3f-921a-6f9281bf65e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:08.109745 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5c8a06e8-2bc1-4c3f-921a-6f9281bf65e0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.337217 Oct 04 21:15:08.110422 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1126/2311] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:07 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:08.175032 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4221472a-2e90-4edd-a809-176047b681c5 tempest-QuotasTestJSON-1103989904 tempest-QuotasTestJSON-1103989904-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/c83e15435bbf4c52890515c357803f18/defaults" status: 200 len: 371 microversion: 2.1 time: 0.125986 Oct 04 21:15:08.176151 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1186/2312] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Oct 4 21:15:08 2022] GET /compute/v2.1/os-quota-sets/c83e15435bbf4c52890515c357803f18/defaults => generated 371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:08.198829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-73a94f85-1c93-4d7d-a459-44b24db850c9 tempest-QuotasTestJSON-1103989904 tempest-QuotasTestJSON-1103989904-project] Calling method '.version_select at 0x7f578ba29280>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:08.478682 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-73a94f85-1c93-4d7d-a459-44b24db850c9 tempest-QuotasTestJSON-1103989904 tempest-QuotasTestJSON-1103989904-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/c83e15435bbf4c52890515c357803f18" status: 200 len: 371 microversion: 2.1 time: 0.284770 Oct 04 21:15:08.482572 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1127/2313] 10.222.0.30 () {58 vars in 1242 bytes} [Tue Oct 4 21:15:08 2022] GET /compute/v2.1/os-quota-sets/c83e15435bbf4c52890515c357803f18 => generated 371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:08.500446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ee13431c-e52e-498a-a85e-adfec52e9c52 tempest-QuotasTestJSON-1103989904 tempest-QuotasTestJSON-1103989904-project] Calling method '.version_select at 0x7f57944e7f70>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:08.525880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0cb719f4-4d23-465f-8d58-d088f647253b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:08.527353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0cb719f4-4d23-465f-8d58-d088f647253b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:08.543034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cb719f4-4d23-465f-8d58-d088f647253b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:08.561552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cb719f4-4d23-465f-8d58-d088f647253b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:08.566471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cb719f4-4d23-465f-8d58-d088f647253b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:08.568052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cb719f4-4d23-465f-8d58-d088f647253b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:08.569117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cb719f4-4d23-465f-8d58-d088f647253b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:08.569988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cb719f4-4d23-465f-8d58-d088f647253b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:08.661368 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ee13431c-e52e-498a-a85e-adfec52e9c52 tempest-QuotasTestJSON-1103989904 tempest-QuotasTestJSON-1103989904-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/c83e15435bbf4c52890515c357803f18?user_id=d29699a0534a473db9b869a511cf5a55" status: 200 len: 371 microversion: 2.1 time: 0.169006 Oct 04 21:15:08.671181 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1187/2314] 10.222.0.30 () {58 vars in 1323 bytes} [Tue Oct 4 21:15:08 2022] GET /compute/v2.1/os-quota-sets/c83e15435bbf4c52890515c357803f18?user_id=d29699a0534a473db9b869a511cf5a55 => generated 371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:08.698834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a97d2492-be1c-453a-b00a-96c47f4f1e19 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:08.699695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a97d2492-be1c-453a-b00a-96c47f4f1e19 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:08.708348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a97d2492-be1c-453a-b00a-96c47f4f1e19 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:08.709129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a97d2492-be1c-453a-b00a-96c47f4f1e19 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:08.711557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a97d2492-be1c-453a-b00a-96c47f4f1e19 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:08.714418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a97d2492-be1c-453a-b00a-96c47f4f1e19 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:08.715160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a97d2492-be1c-453a-b00a-96c47f4f1e19 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:08.715822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a97d2492-be1c-453a-b00a-96c47f4f1e19 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:09.024038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a97d2492-be1c-453a-b00a-96c47f4f1e19 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb68f8fb49d492e8bfc6e37336d3801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b630636b36647f5837eda19552ddf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:09.046012 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a97d2492-be1c-453a-b00a-96c47f4f1e19 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 200 len: 1293 microversion: 2.1 time: 0.364087 Oct 04 21:15:09.049829 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1188/2315] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:08 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 1293 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:09.058770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0cb719f4-4d23-465f-8d58-d088f647253b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:09.071575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1037a176-f78f-48c4-b255-7fa7a916f9cd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:09.077580 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0cb719f4-4d23-465f-8d58-d088f647253b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1266 microversion: 2.1 time: 0.557284 Oct 04 21:15:09.078242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1037a176-f78f-48c4-b255-7fa7a916f9cd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:09.086069 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1128/2316] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:08 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1266 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:09.110328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1037a176-f78f-48c4-b255-7fa7a916f9cd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:09.110828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1037a176-f78f-48c4-b255-7fa7a916f9cd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:09.111278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1037a176-f78f-48c4-b255-7fa7a916f9cd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:09.112004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1037a176-f78f-48c4-b255-7fa7a916f9cd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:09.112470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1037a176-f78f-48c4-b255-7fa7a916f9cd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:09.112902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1037a176-f78f-48c4-b255-7fa7a916f9cd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:09.135418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5a8d9fa7-1269-4e83-840a-d8931b798220 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:09.137312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5a8d9fa7-1269-4e83-840a-d8931b798220 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:09.150524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a8d9fa7-1269-4e83-840a-d8931b798220 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:09.152663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a8d9fa7-1269-4e83-840a-d8931b798220 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:09.157624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a8d9fa7-1269-4e83-840a-d8931b798220 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:09.157624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a8d9fa7-1269-4e83-840a-d8931b798220 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:09.157624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a8d9fa7-1269-4e83-840a-d8931b798220 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:09.157624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a8d9fa7-1269-4e83-840a-d8931b798220 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:09.656135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1037a176-f78f-48c4-b255-7fa7a916f9cd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:09.666592 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1037a176-f78f-48c4-b255-7fa7a916f9cd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1528 microversion: 2.1 time: 0.600414 Oct 04 21:15:09.669473 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1189/2317] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:09 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1528 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:09.831980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5a8d9fa7-1269-4e83-840a-d8931b798220 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:09.838378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:09.843747 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5a8d9fa7-1269-4e83-840a-d8931b798220 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.713949 Oct 04 21:15:09.860117 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1129/2318] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:09 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:10.081235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0d5e98a7-fe30-419f-bab3-ae11d8309275 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:10.082254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0d5e98a7-fe30-419f-bab3-ae11d8309275 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:10.089969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d5e98a7-fe30-419f-bab3-ae11d8309275 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:10.090851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d5e98a7-fe30-419f-bab3-ae11d8309275 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:10.091276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d5e98a7-fe30-419f-bab3-ae11d8309275 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:10.092415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d5e98a7-fe30-419f-bab3-ae11d8309275 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:10.093006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d5e98a7-fe30-419f-bab3-ae11d8309275 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:10.093549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d5e98a7-fe30-419f-bab3-ae11d8309275 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:10.114355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c5aa4738-e778-4605-b752-8f9354d10dfd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:10.115093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c5aa4738-e778-4605-b752-8f9354d10dfd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:10.123681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5aa4738-e778-4605-b752-8f9354d10dfd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:10.124465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5aa4738-e778-4605-b752-8f9354d10dfd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:10.124978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5aa4738-e778-4605-b752-8f9354d10dfd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:10.125979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5aa4738-e778-4605-b752-8f9354d10dfd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:10.126582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5aa4738-e778-4605-b752-8f9354d10dfd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:10.127081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5aa4738-e778-4605-b752-8f9354d10dfd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:10.200674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0d5e98a7-fe30-419f-bab3-ae11d8309275 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb68f8fb49d492e8bfc6e37336d3801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b630636b36647f5837eda19552ddf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:10.212406 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0d5e98a7-fe30-419f-bab3-ae11d8309275 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 200 len: 1281 microversion: 2.1 time: 0.135226 Oct 04 21:15:10.213020 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1190/2319] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:10 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 1281 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:10.377304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c5aa4738-e778-4605-b752-8f9354d10dfd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:10.397736 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c5aa4738-e778-4605-b752-8f9354d10dfd tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1308 microversion: 2.1 time: 0.289288 Oct 04 21:15:10.404353 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1130/2320] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:10 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1308 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:10.690950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b5ece322-7668-4fab-b48c-1586b5a8d06f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:10.691574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b5ece322-7668-4fab-b48c-1586b5a8d06f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:10.695514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-484b94ed-5f75-4f7f-a291-d4715c372eb5 req-d329f85d-8e14-46a1-9748-2d512e62100f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f65528-e8a7-4637-a1bf-1baf79b315eb", "name": "network-vif-deleted", "tag": "1e00c2db-7a7f-4cda-bc8c-64d2291e2563"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:10.699594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5ece322-7668-4fab-b48c-1586b5a8d06f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:10.700090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5ece322-7668-4fab-b48c-1586b5a8d06f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:10.700644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5ece322-7668-4fab-b48c-1586b5a8d06f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:10.701211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5ece322-7668-4fab-b48c-1586b5a8d06f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:10.705958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5ece322-7668-4fab-b48c-1586b5a8d06f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:10.707859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5ece322-7668-4fab-b48c-1586b5a8d06f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:10.728628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-484b94ed-5f75-4f7f-a291-d4715c372eb5 req-d329f85d-8e14-46a1-9748-2d512e62100f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:10.728628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-484b94ed-5f75-4f7f-a291-d4715c372eb5 req-d329f85d-8e14-46a1-9748-2d512e62100f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:10.728628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-484b94ed-5f75-4f7f-a291-d4715c372eb5 req-d329f85d-8e14-46a1-9748-2d512e62100f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:10.761346 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-484b94ed-5f75-4f7f-a291-d4715c372eb5 req-d329f85d-8e14-46a1-9748-2d512e62100f service nova] Creating event network-vif-deleted:1e00c2db-7a7f-4cda-bc8c-64d2291e2563 for instance 05f65528-e8a7-4637-a1bf-1baf79b315eb on n-h1-860282-1 Oct 04 21:15:10.774524 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-484b94ed-5f75-4f7f-a291-d4715c372eb5 req-d329f85d-8e14-46a1-9748-2d512e62100f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076963 Oct 04 21:15:10.774524 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1131/2321] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:10.777097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b5ece322-7668-4fab-b48c-1586b5a8d06f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:10.794386 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b5ece322-7668-4fab-b48c-1586b5a8d06f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 200 len: 1486 microversion: 2.1 time: 0.107702 Oct 04 21:15:10.796532 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1191/2322] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:10 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 1486 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:10.869093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a9e1d438-8312-4d6a-acd9-dc2f36d7bd9b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:10.869897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a9e1d438-8312-4d6a-acd9-dc2f36d7bd9b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:10.877440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9e1d438-8312-4d6a-acd9-dc2f36d7bd9b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:10.878001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9e1d438-8312-4d6a-acd9-dc2f36d7bd9b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:10.878549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9e1d438-8312-4d6a-acd9-dc2f36d7bd9b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:10.879440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9e1d438-8312-4d6a-acd9-dc2f36d7bd9b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:10.879981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9e1d438-8312-4d6a-acd9-dc2f36d7bd9b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:10.880512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9e1d438-8312-4d6a-acd9-dc2f36d7bd9b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:11.244602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0daf4727-94f3-4852-b27c-5c52d5db008e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:11.244602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0daf4727-94f3-4852-b27c-5c52d5db008e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:11.255271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0daf4727-94f3-4852-b27c-5c52d5db008e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:11.255934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0daf4727-94f3-4852-b27c-5c52d5db008e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:11.256587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0daf4727-94f3-4852-b27c-5c52d5db008e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:11.261675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0daf4727-94f3-4852-b27c-5c52d5db008e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:11.264070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0daf4727-94f3-4852-b27c-5c52d5db008e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:11.265560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0daf4727-94f3-4852-b27c-5c52d5db008e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:11.522161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a9e1d438-8312-4d6a-acd9-dc2f36d7bd9b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:11.537694 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a9e1d438-8312-4d6a-acd9-dc2f36d7bd9b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.673616 Oct 04 21:15:11.538857 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1132/2323] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:10 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:11.545814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e7c9e5f7-45a2-42ff-9487-da62b19bdb1f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:11.546773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e7c9e5f7-45a2-42ff-9487-da62b19bdb1f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:11.557895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7c9e5f7-45a2-42ff-9487-da62b19bdb1f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:11.559353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7c9e5f7-45a2-42ff-9487-da62b19bdb1f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:11.563787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7c9e5f7-45a2-42ff-9487-da62b19bdb1f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:11.563787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7c9e5f7-45a2-42ff-9487-da62b19bdb1f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:11.567451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7c9e5f7-45a2-42ff-9487-da62b19bdb1f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:11.568234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7c9e5f7-45a2-42ff-9487-da62b19bdb1f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:12.094381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:12.551351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0daf4727-94f3-4852-b27c-5c52d5db008e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb68f8fb49d492e8bfc6e37336d3801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b630636b36647f5837eda19552ddf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:12.565061 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0daf4727-94f3-4852-b27c-5c52d5db008e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 200 len: 1323 microversion: 2.1 time: 1.331890 Oct 04 21:15:12.579225 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1192/2324] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:11 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 1323 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:12.590217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e8235a05-0c92-40a4-8344-f0e8dab56d0e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:12.590985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e8235a05-0c92-40a4-8344-f0e8dab56d0e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:12.600476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8235a05-0c92-40a4-8344-f0e8dab56d0e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:12.601711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8235a05-0c92-40a4-8344-f0e8dab56d0e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:12.602282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8235a05-0c92-40a4-8344-f0e8dab56d0e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:12.603548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8235a05-0c92-40a4-8344-f0e8dab56d0e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:12.604121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8235a05-0c92-40a4-8344-f0e8dab56d0e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:12.604656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8235a05-0c92-40a4-8344-f0e8dab56d0e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:12.620862 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-e8235a05-0c92-40a4-8344-f0e8dab56d0e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] HTTP exception thrown: Instance 05f65528-e8a7-4637-a1bf-1baf79b315eb could not be found. Oct 04 21:15:12.624049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e7c9e5f7-45a2-42ff-9487-da62b19bdb1f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e8235a05-0c92-40a4-8344-f0e8dab56d0e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Request method failure captured: Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb HTTP/1.1 Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKIfr0EKjh9lIGpSMallYOOhbfjlmceWYXhhzEhZtKG-K5Qftah8sJPPQwARLxF148gLNgWQ6TQI3CtHtfXOURD85vgsMSrUAP7uSOEzn9FGu8hya9wg7xCbpv6yrgC_TH3BeALF5PS38pqVs3tUVO2zaGck0ZnqjmCZGgWvxK0EmDc Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 4df42993975949899553deaeaffada73 Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4df42993975949899553deaeaffada73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4df42993975949899553deaeaffada73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}] Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 4df42993975949899553deaeaffada73 Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 4d401d8a2c8e4cee856badba313ed00a Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 05f65528-e8a7-4637-a1bf-1baf79b315eb could not be found. Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '05f65528-e8a7-4637-a1bf-1baf79b315eb'} Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05f65528-e8a7-4637-a1bf-1baf79b315eb could not be found. Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05f65528-e8a7-4637-a1bf-1baf79b315eb could not be found. Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:12.631513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:12.641080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:12.641080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:12.641080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:12.641080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:12.641080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:12.641080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:12.641080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05f65528-e8a7-4637-a1bf-1baf79b315eb could not be found. Oct 04 21:15:12.641080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:12.641080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e8235a05-0c92-40a4-8344-f0e8dab56d0e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Returning 404 to user: Instance 05f65528-e8a7-4637-a1bf-1baf79b315eb could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:12.641779 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e7c9e5f7-45a2-42ff-9487-da62b19bdb1f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1308 microversion: 2.1 time: 1.092421 Oct 04 21:15:12.641779 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1133/2325] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:11 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1308 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:12.641779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ad58a0a3-463a-407d-93f7-1f75f4138914 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:12.641779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ad58a0a3-463a-407d-93f7-1f75f4138914 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:12.644211 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e8235a05-0c92-40a4-8344-f0e8dab56d0e tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 404 len: 111 microversion: 2.1 time: 0.053811 Oct 04 21:15:12.645019 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1193/2326] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:12 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:15:12.655746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:12.658906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1ec75a53-d062-4ebb-bee8-f0c7f539ab73 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Action: 'create', calling method: .version_select at 0x7f578be9de50>, body: {"keypair": {"name": "tempest-keypair-1637100204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAKdrvt/wLek3y+TZSn6O5sIILdCV3yaNo028jUQWttYCzT5DDaE1F7NHYPSO5BnmnXduUu5seiq+8VXcKnaGhF0Xv+ssMAZkjXCRxIqCFvbHadH5+MyW50/ewySjTfMw=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:12.659410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad58a0a3-463a-407d-93f7-1f75f4138914 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:12.659919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad58a0a3-463a-407d-93f7-1f75f4138914 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:12.660365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad58a0a3-463a-407d-93f7-1f75f4138914 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:12.661082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad58a0a3-463a-407d-93f7-1f75f4138914 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:12.661733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad58a0a3-463a-407d-93f7-1f75f4138914 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:12.662499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad58a0a3-463a-407d-93f7-1f75f4138914 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:12.707164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-1ec75a53-d062-4ebb-bee8-f0c7f539ab73 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Getting quotas for project 4df42993975949899553deaeaffada73. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:12.727491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-1ec75a53-d062-4ebb-bee8-f0c7f539ab73 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Getting quotas for user 4d401d8a2c8e4cee856badba313ed00a and project 4df42993975949899553deaeaffada73. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:12.839550 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1ec75a53-d062-4ebb-bee8-f0c7f539ab73 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.184273 Oct 04 21:15:12.839550 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1194/2327] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:15:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:12.844236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-ef7fcba0-b66d-479a-95df-507d4affcc84 req-c50c8067-d3bf-4d21-92c4-4f2732c47425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93744ae-9a79-417e-9de4-8b0b1ae0e574", "tag": "128b6b0b-4e8b-49bc-9933-9e6bd6e543e8"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:12.856654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ef7fcba0-b66d-479a-95df-507d4affcc84 req-c50c8067-d3bf-4d21-92c4-4f2732c47425 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:12.858441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ef7fcba0-b66d-479a-95df-507d4affcc84 req-c50c8067-d3bf-4d21-92c4-4f2732c47425 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:12.858909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ef7fcba0-b66d-479a-95df-507d4affcc84 req-c50c8067-d3bf-4d21-92c4-4f2732c47425 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:12.873415 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-ef7fcba0-b66d-479a-95df-507d4affcc84 req-c50c8067-d3bf-4d21-92c4-4f2732c47425 service nova] Creating event network-changed:128b6b0b-4e8b-49bc-9933-9e6bd6e543e8 for instance d93744ae-9a79-417e-9de4-8b0b1ae0e574 on n-h2-860282-1 Oct 04 21:15:12.879225 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-ef7fcba0-b66d-479a-95df-507d4affcc84 req-c50c8067-d3bf-4d21-92c4-4f2732c47425 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039226 Oct 04 21:15:12.883728 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1195/2328] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:12.961004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:13.140813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ad58a0a3-463a-407d-93f7-1f75f4138914 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:13.150056 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ad58a0a3-463a-407d-93f7-1f75f4138914 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.514590 Oct 04 21:15:13.150665 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1134/2329] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:12 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:13.505288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f2adbed5-604f-40ca-9613-26ac20bc7cd7 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-552607515", "imageRef": "683118e4-30da-4c5c-8224-bb8648cc45a5", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "1ae8843a-0c91-42b5-b7b8-454036899db2"}], "security_groups": [{"name": "tempest-securitygroup--1995903297"}], "key_name": "tempest-keypair-63496420", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:13.595775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e6ac465a-0218-4a02-b862-bfd67b1d4f54 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:13.596920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e6ac465a-0218-4a02-b862-bfd67b1d4f54 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:13.620073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e6ac465a-0218-4a02-b862-bfd67b1d4f54 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:13.620585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e6ac465a-0218-4a02-b862-bfd67b1d4f54 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:13.621036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e6ac465a-0218-4a02-b862-bfd67b1d4f54 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:13.621831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e6ac465a-0218-4a02-b862-bfd67b1d4f54 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:13.622300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e6ac465a-0218-4a02-b862-bfd67b1d4f54 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:13.622732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e6ac465a-0218-4a02-b862-bfd67b1d4f54 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:13.755092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-f2adbed5-604f-40ca-9613-26ac20bc7cd7 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] validate_networks() for [('1ae8843a-0c91-42b5-b7b8-454036899db2', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:15:14.139794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e6ac465a-0218-4a02-b862-bfd67b1d4f54 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb68f8fb49d492e8bfc6e37336d3801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b630636b36647f5837eda19552ddf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:14.150811 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e6ac465a-0218-4a02-b862-bfd67b1d4f54 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 200 len: 1323 microversion: 2.1 time: 0.560704 Oct 04 21:15:14.155406 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1135/2330] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:13 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 1323 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:14.167830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-130ff3c9-afd3-4469-ac6c-2d4bc68c2f6e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:14.170511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-130ff3c9-afd3-4469-ac6c-2d4bc68c2f6e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:14.186030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-130ff3c9-afd3-4469-ac6c-2d4bc68c2f6e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:14.186530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-130ff3c9-afd3-4469-ac6c-2d4bc68c2f6e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:14.186973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-130ff3c9-afd3-4469-ac6c-2d4bc68c2f6e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:14.191660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-130ff3c9-afd3-4469-ac6c-2d4bc68c2f6e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:14.192214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-130ff3c9-afd3-4469-ac6c-2d4bc68c2f6e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:14.192877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-130ff3c9-afd3-4469-ac6c-2d4bc68c2f6e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:14.536532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-130ff3c9-afd3-4469-ac6c-2d4bc68c2f6e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:14.547399 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-130ff3c9-afd3-4469-ac6c-2d4bc68c2f6e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1308 microversion: 2.1 time: 0.390615 Oct 04 21:15:14.548005 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1136/2331] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:14 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1308 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:14.750835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1fad3188-4917-49b4-a81e-8bebd8c4b1be tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Action: 'update', calling method: .version_select at 0x7f578ba1d9d0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:14.755889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fad3188-4917-49b4-a81e-8bebd8c4b1be tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:14.756392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fad3188-4917-49b4-a81e-8bebd8c4b1be tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:14.756839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fad3188-4917-49b4-a81e-8bebd8c4b1be tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:14.775138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fad3188-4917-49b4-a81e-8bebd8c4b1be tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:14.776328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fad3188-4917-49b4-a81e-8bebd8c4b1be tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:14.776842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fad3188-4917-49b4-a81e-8bebd8c4b1be tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:14.795071 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-1fad3188-4917-49b4-a81e-8bebd8c4b1be tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] HTTP exception thrown: Service 08d217d4-e1fd-4f44-84c6-b680a84f8c4c could not be found. Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1fad3188-4917-49b4-a81e-8bebd8c4b1be tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Request method failure captured: Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: request: PUT /compute/v2.1/os-services/08d217d4-e1fd-4f44-84c6-b680a84f8c4c HTTP/1.1 Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 56 Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKJhw6_Eqlz6rty7VcG4pmnyN8oF1SUq8wNL1YDQ9hAbKfY6IRSpLF1WO_lpCTCjPdmxCV8AmyYdvZtRx0LQ9n_3KTuMwSi-hN-4dOjREe-uS4tU1FY5C1MHATx-PYa3kX_zye64l_Ne9oU2jzM-zYODHVR-1sIlKms_Jx6waDh7yAo Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 3d65932ae25f41d3a7cbf225f7f86549 Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-661849733 Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d65932ae25f41d3a7cbf225f7f86549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3d65932ae25f41d3a7cbf225f7f86549"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3d65932ae25f41d3a7cbf225f7f86549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d65932ae25f41d3a7cbf225f7f86549"}]}] Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-661849733 Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 3d65932ae25f41d3a7cbf225f7f86549 Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-661849733 Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 0280dc53d3414be592a0b5ada43c4cfd Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: exception: Service 08d217d4-e1fd-4f44-84c6-b680a84f8c4c could not be found. Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '08d217d4-e1fd-4f44-84c6-b680a84f8c4c', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 08d217d4-e1fd-4f44-84c6-b680a84f8c4c could not be found. Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:15:14.797654 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:15:14.801875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 21:15:14.801875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:15:14.801875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 08d217d4-e1fd-4f44-84c6-b680a84f8c4c could not be found. Oct 04 21:15:14.801875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:14.801875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:14.801875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:14.801875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:14.801875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:14.801875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:14.801875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:14.801875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:14.801875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 08d217d4-e1fd-4f44-84c6-b680a84f8c4c could not be found. Oct 04 21:15:14.801875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:14.801875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1fad3188-4917-49b4-a81e-8bebd8c4b1be tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Returning 404 to user: Service 08d217d4-e1fd-4f44-84c6-b680a84f8c4c could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:14.801875 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1fad3188-4917-49b4-a81e-8bebd8c4b1be tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/08d217d4-e1fd-4f44-84c6-b680a84f8c4c" status: 404 len: 110 microversion: 2.53 time: 0.250165 Oct 04 21:15:14.801875 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1137/2332] 10.222.0.30 () {62 vars in 1309 bytes} [Tue Oct 4 21:15:14 2022] PUT /compute/v2.1/os-services/08d217d4-e1fd-4f44-84c6-b680a84f8c4c => generated 110 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:15:14.806021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f2adbed5-604f-40ca-9613-26ac20bc7cd7 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:15:14.806751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c6699da8-d165-410a-a268-7cbf8112d6fa tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:14.806909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f2adbed5-604f-40ca-9613-26ac20bc7cd7 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:15:14.807155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c6699da8-d165-410a-a268-7cbf8112d6fa tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:14.807580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f2adbed5-604f-40ca-9613-26ac20bc7cd7 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:15:14.808141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f2adbed5-604f-40ca-9613-26ac20bc7cd7 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:15:14.808660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f2adbed5-604f-40ca-9613-26ac20bc7cd7 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:15:14.816481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6699da8-d165-410a-a268-7cbf8112d6fa tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:14.817223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6699da8-d165-410a-a268-7cbf8112d6fa tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:14.817977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6699da8-d165-410a-a268-7cbf8112d6fa tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:14.818824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6699da8-d165-410a-a268-7cbf8112d6fa tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:14.819284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6699da8-d165-410a-a268-7cbf8112d6fa tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:14.819878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6699da8-d165-410a-a268-7cbf8112d6fa tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:14.824864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2adbed5-604f-40ca-9613-26ac20bc7cd7 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:14.825693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2adbed5-604f-40ca-9613-26ac20bc7cd7 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:14.826338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2adbed5-604f-40ca-9613-26ac20bc7cd7 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:14.829596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2adbed5-604f-40ca-9613-26ac20bc7cd7 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:14.831164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2adbed5-604f-40ca-9613-26ac20bc7cd7 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:14.831807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2adbed5-604f-40ca-9613-26ac20bc7cd7 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:14.861871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:14.878443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-f2adbed5-604f-40ca-9613-26ac20bc7cd7 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Getting quotas for project 2aec0d41371749e7b47226ace53ffe86. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:14.887049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-f2adbed5-604f-40ca-9613-26ac20bc7cd7 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Getting quotas for user 9762c7ce00fb40798f03212a6c3d4c08 and project 2aec0d41371749e7b47226ace53ffe86. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:14.906741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f2adbed5-604f-40ca-9613-26ac20bc7cd7 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:15:14.909998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f2adbed5-604f-40ca-9613-26ac20bc7cd7 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='683118e4-30da-4c5c-8224-bb8648cc45a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:15:15.052488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c6699da8-d165-410a-a268-7cbf8112d6fa tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:15.076830 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c6699da8-d165-410a-a268-7cbf8112d6fa tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.266497 Oct 04 21:15:15.076830 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1138/2333] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:14 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:15.078983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6edd7a1f-6368-4d0a-ba4a-79d0b77aa4b0 tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Action: 'update', calling method: .version_select at 0x7f5794408670>, body: {"status": "disabled"} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:15.090470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6edd7a1f-6368-4d0a-ba4a-79d0b77aa4b0 tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:15.090987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6edd7a1f-6368-4d0a-ba4a-79d0b77aa4b0 tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:15.093507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6edd7a1f-6368-4d0a-ba4a-79d0b77aa4b0 tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:15.110392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6edd7a1f-6368-4d0a-ba4a-79d0b77aa4b0 tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:15.111879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6edd7a1f-6368-4d0a-ba4a-79d0b77aa4b0 tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:15.112528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6edd7a1f-6368-4d0a-ba4a-79d0b77aa4b0 tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:15.121570 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-6edd7a1f-6368-4d0a-ba4a-79d0b77aa4b0 tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] HTTP exception thrown: Service 08d217d4-e1fd-4f44-84c6-b680a84f8c4c could not be found. Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6edd7a1f-6368-4d0a-ba4a-79d0b77aa4b0 tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Request method failure captured: Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: request: PUT /compute/v2.1/os-services/08d217d4-e1fd-4f44-84c6-b680a84f8c4c HTTP/1.1 Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 22 Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKJhw6_Eqlz6rty7VcG4pmnyN8oF1SUq8wNL1YDQ9hAbKfY6IRSpLF1WO_lpCTCjPdmxCV8AmyYdvZtRx0LQ9n_3KTuMwSi-hN-4dOjREe-uS4tU1FY5C1MHATx-PYa3kX_zye64l_Ne9oU2jzM-zYODHVR-1sIlKms_Jx6waDh7yAo Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 3d65932ae25f41d3a7cbf225f7f86549 Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-661849733 Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d65932ae25f41d3a7cbf225f7f86549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3d65932ae25f41d3a7cbf225f7f86549"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3d65932ae25f41d3a7cbf225f7f86549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d65932ae25f41d3a7cbf225f7f86549"}]}] Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-661849733 Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 3d65932ae25f41d3a7cbf225f7f86549 Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-661849733 Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 0280dc53d3414be592a0b5ada43c4cfd Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: {"status": "disabled"} Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: exception: Service 08d217d4-e1fd-4f44-84c6-b680a84f8c4c could not be found. Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '08d217d4-e1fd-4f44-84c6-b680a84f8c4c', 'body': {'status': 'disabled'}} Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 08d217d4-e1fd-4f44-84c6-b680a84f8c4c could not be found. Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:15:15.124079 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:15:15.128439 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 21:15:15.128439 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:15:15.128439 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 08d217d4-e1fd-4f44-84c6-b680a84f8c4c could not be found. Oct 04 21:15:15.128439 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:15.128439 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:15.128439 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:15.128439 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:15.128439 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:15.128439 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:15.128439 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:15.128439 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:15.128439 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 08d217d4-e1fd-4f44-84c6-b680a84f8c4c could not be found. Oct 04 21:15:15.128439 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:15.131195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6edd7a1f-6368-4d0a-ba4a-79d0b77aa4b0 tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Returning 404 to user: Service 08d217d4-e1fd-4f44-84c6-b680a84f8c4c could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:15.136451 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6edd7a1f-6368-4d0a-ba4a-79d0b77aa4b0 tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/08d217d4-e1fd-4f44-84c6-b680a84f8c4c" status: 404 len: 110 microversion: 2.53 time: 0.059966 Oct 04 21:15:15.137080 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1139/2334] 10.222.0.30 () {62 vars in 1309 bytes} [Tue Oct 4 21:15:15 2022] PUT /compute/v2.1/os-services/08d217d4-e1fd-4f44-84c6-b680a84f8c4c => generated 110 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:15:15.149911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-104909f9-aa5e-4f5e-8411-441db239498e req-4305e493-4b24-41e4-8f21-f7b3888f2ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e8895bf-11ae-42d3-9af7-c934522d7341", "tag": "6a0d5822-3dd3-4808-99c8-03da86151a0a"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:15.155770 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f2adbed5-604f-40ca-9613-26ac20bc7cd7 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.655202 Oct 04 21:15:15.157232 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1196/2335] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:15:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:15:15.176144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-104909f9-aa5e-4f5e-8411-441db239498e req-4305e493-4b24-41e4-8f21-f7b3888f2ff3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:15.176144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-104909f9-aa5e-4f5e-8411-441db239498e req-4305e493-4b24-41e4-8f21-f7b3888f2ff3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:15.176144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-104909f9-aa5e-4f5e-8411-441db239498e req-4305e493-4b24-41e4-8f21-f7b3888f2ff3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:15.194120 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-104909f9-aa5e-4f5e-8411-441db239498e req-4305e493-4b24-41e4-8f21-f7b3888f2ff3 service nova] Creating event network-changed:6a0d5822-3dd3-4808-99c8-03da86151a0a for instance 4e8895bf-11ae-42d3-9af7-c934522d7341 on n-h2-860282-1 Oct 04 21:15:15.221593 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-104909f9-aa5e-4f5e-8411-441db239498e req-4305e493-4b24-41e4-8f21-f7b3888f2ff3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083034 Oct 04 21:15:15.225231 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1140/2336] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:15.247336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-38cc8a9a-2d5b-4971-90fa-64a81682f1ab tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Action: 'update', calling method: .version_select at 0x7f578ba32040>, body: {"status": "enabled"} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:15.247625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38cc8a9a-2d5b-4971-90fa-64a81682f1ab tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:15.264791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6c6aaa98-1682-48d9-950e-dc5ac3233344 tempest-ComputeTenantNetworksTest-66089408 tempest-ComputeTenantNetworksTest-66089408-project] Calling method '.version_select at 0x7f578be9d280>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:15.270461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38cc8a9a-2d5b-4971-90fa-64a81682f1ab tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:15.271544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38cc8a9a-2d5b-4971-90fa-64a81682f1ab tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:15.286899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38cc8a9a-2d5b-4971-90fa-64a81682f1ab tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:15.293862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38cc8a9a-2d5b-4971-90fa-64a81682f1ab tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:15.294562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38cc8a9a-2d5b-4971-90fa-64a81682f1ab tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:15.300615 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-38cc8a9a-2d5b-4971-90fa-64a81682f1ab tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] HTTP exception thrown: Service 08d217d4-e1fd-4f44-84c6-b680a84f8c4c could not be found. Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-38cc8a9a-2d5b-4971-90fa-64a81682f1ab tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Request method failure captured: Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: request: PUT /compute/v2.1/os-services/08d217d4-e1fd-4f44-84c6-b680a84f8c4c HTTP/1.1 Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 21 Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKJhw6_Eqlz6rty7VcG4pmnyN8oF1SUq8wNL1YDQ9hAbKfY6IRSpLF1WO_lpCTCjPdmxCV8AmyYdvZtRx0LQ9n_3KTuMwSi-hN-4dOjREe-uS4tU1FY5C1MHATx-PYa3kX_zye64l_Ne9oU2jzM-zYODHVR-1sIlKms_Jx6waDh7yAo Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 3d65932ae25f41d3a7cbf225f7f86549 Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-661849733 Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d65932ae25f41d3a7cbf225f7f86549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3d65932ae25f41d3a7cbf225f7f86549"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3d65932ae25f41d3a7cbf225f7f86549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d65932ae25f41d3a7cbf225f7f86549"}]}] Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-661849733 Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 3d65932ae25f41d3a7cbf225f7f86549 Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-661849733 Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 0280dc53d3414be592a0b5ada43c4cfd Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: {"status": "enabled"} Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: exception: Service 08d217d4-e1fd-4f44-84c6-b680a84f8c4c could not be found. Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '08d217d4-e1fd-4f44-84c6-b680a84f8c4c', 'body': {'status': 'enabled'}} Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 08d217d4-e1fd-4f44-84c6-b680a84f8c4c could not be found. Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:15:15.303304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:15:15.309139 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 21:15:15.309139 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:15:15.309139 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 08d217d4-e1fd-4f44-84c6-b680a84f8c4c could not be found. Oct 04 21:15:15.309139 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:15.309139 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:15.309139 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:15.309139 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:15.309139 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:15.309139 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:15.309139 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:15.309139 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:15.309139 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 08d217d4-e1fd-4f44-84c6-b680a84f8c4c could not be found. Oct 04 21:15:15.309139 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:15.316957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-38cc8a9a-2d5b-4971-90fa-64a81682f1ab tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Returning 404 to user: Service 08d217d4-e1fd-4f44-84c6-b680a84f8c4c could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:15.316957 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-38cc8a9a-2d5b-4971-90fa-64a81682f1ab tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/08d217d4-e1fd-4f44-84c6-b680a84f8c4c" status: 404 len: 110 microversion: 2.53 time: 0.085679 Oct 04 21:15:15.316957 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1141/2337] 10.222.0.30 () {62 vars in 1309 bytes} [Tue Oct 4 21:15:15 2022] PUT /compute/v2.1/os-services/08d217d4-e1fd-4f44-84c6-b680a84f8c4c => generated 110 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:15:15.326229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c98c941b-572c-4c37-bed0-47efb3573957 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:15.327269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c98c941b-572c-4c37-bed0-47efb3573957 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:15.514930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c98c941b-572c-4c37-bed0-47efb3573957 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:15.526247 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c98c941b-572c-4c37-bed0-47efb3573957 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1243 microversion: 2.1 time: 0.211646 Oct 04 21:15:15.527654 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1142/2338] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:15 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1243 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:15.536521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-22df059f-1469-41bb-9ee8-cb9772b71ea0 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:15.539953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-22df059f-1469-41bb-9ee8-cb9772b71ea0 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:15.560825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22df059f-1469-41bb-9ee8-cb9772b71ea0 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:15.561710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22df059f-1469-41bb-9ee8-cb9772b71ea0 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:15.569303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22df059f-1469-41bb-9ee8-cb9772b71ea0 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:15.569303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22df059f-1469-41bb-9ee8-cb9772b71ea0 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:15.569303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22df059f-1469-41bb-9ee8-cb9772b71ea0 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:15.569303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22df059f-1469-41bb-9ee8-cb9772b71ea0 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:15.791393 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6c6aaa98-1682-48d9-950e-dc5ac3233344 tempest-ComputeTenantNetworksTest-66089408 tempest-ComputeTenantNetworksTest-66089408-project] 10.222.0.30 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.633029 Oct 04 21:15:15.791985 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1197/2339] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Oct 4 21:15:15 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:15.797382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-38dc6327-b2cc-4a80-8c0d-1a34e450d7be tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:15.807148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38dc6327-b2cc-4a80-8c0d-1a34e450d7be tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:15.807148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38dc6327-b2cc-4a80-8c0d-1a34e450d7be tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:15.807148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38dc6327-b2cc-4a80-8c0d-1a34e450d7be tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:15.807889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38dc6327-b2cc-4a80-8c0d-1a34e450d7be tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:15.811638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38dc6327-b2cc-4a80-8c0d-1a34e450d7be tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:15.812199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38dc6327-b2cc-4a80-8c0d-1a34e450d7be tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:15.827042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:15.843772 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-38dc6327-b2cc-4a80-8c0d-1a34e450d7be tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.044638 Oct 04 21:15:15.843772 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1198/2340] 10.222.0.30 () {60 vars in 1178 bytes} [Tue Oct 4 21:15:15 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:15:15.843772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7df63ec3-b85e-4ad9-a58c-cd982adba663 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:15.843772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7df63ec3-b85e-4ad9-a58c-cd982adba663 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:15.850466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7df63ec3-b85e-4ad9-a58c-cd982adba663 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:15.850956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7df63ec3-b85e-4ad9-a58c-cd982adba663 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:15.852932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7df63ec3-b85e-4ad9-a58c-cd982adba663 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:15.854342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7df63ec3-b85e-4ad9-a58c-cd982adba663 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:15.854342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7df63ec3-b85e-4ad9-a58c-cd982adba663 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:15.854694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7df63ec3-b85e-4ad9-a58c-cd982adba663 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:16.089967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-22df059f-1469-41bb-9ee8-cb9772b71ea0 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb68f8fb49d492e8bfc6e37336d3801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b630636b36647f5837eda19552ddf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:16.100239 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-22df059f-1469-41bb-9ee8-cb9772b71ea0 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 200 len: 1323 microversion: 2.1 time: 0.570010 Oct 04 21:15:16.100239 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1143/2341] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:15 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 1323 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:16.117172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7463d3e3-7d84-49e6-86c9-b36dff1a806c tempest-ComputeTenantNetworksTest-66089408 tempest-ComputeTenantNetworksTest-66089408-project] Calling method '.version_select at 0x7f578ba321f0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:16.311546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7df63ec3-b85e-4ad9-a58c-cd982adba663 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:16.319566 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7df63ec3-b85e-4ad9-a58c-cd982adba663 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1308 microversion: 2.1 time: 0.480149 Oct 04 21:15:16.320141 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1199/2342] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:15 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1308 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:16.325043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-568aab07-8e5b-4a86-b42a-72468c45197e tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:16.328568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-568aab07-8e5b-4a86-b42a-72468c45197e tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:16.329048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-568aab07-8e5b-4a86-b42a-72468c45197e tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:16.329511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-568aab07-8e5b-4a86-b42a-72468c45197e tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:16.330537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-568aab07-8e5b-4a86-b42a-72468c45197e tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:16.330996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-568aab07-8e5b-4a86-b42a-72468c45197e tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:16.331413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-568aab07-8e5b-4a86-b42a-72468c45197e tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:16.339555 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7463d3e3-7d84-49e6-86c9-b36dff1a806c tempest-ComputeTenantNetworksTest-66089408 tempest-ComputeTenantNetworksTest-66089408-project] 10.222.0.30 "GET /compute/v2.1/os-tenant-networks/f62fb399-c6b8-4ebe-bac7-01162a763c1e" status: 200 len: 140 microversion: 2.1 time: 0.237819 Oct 04 21:15:16.347158 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1144/2343] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Oct 4 21:15:16 2022] GET /compute/v2.1/os-tenant-networks/f62fb399-c6b8-4ebe-bac7-01162a763c1e => generated 140 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:16.353581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bea20e5a-3dc3-41ff-9699-db0428f5f694 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:16.356248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bea20e5a-3dc3-41ff-9699-db0428f5f694 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:16.367145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bea20e5a-3dc3-41ff-9699-db0428f5f694 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:16.368189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bea20e5a-3dc3-41ff-9699-db0428f5f694 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:16.368798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bea20e5a-3dc3-41ff-9699-db0428f5f694 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:16.369541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bea20e5a-3dc3-41ff-9699-db0428f5f694 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:16.369999 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bea20e5a-3dc3-41ff-9699-db0428f5f694 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:16.370592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bea20e5a-3dc3-41ff-9699-db0428f5f694 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:16.446838 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-568aab07-8e5b-4a86-b42a-72468c45197e tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.125072 Oct 04 21:15:16.468547 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1200/2344] 10.222.0.30 () {60 vars in 1211 bytes} [Tue Oct 4 21:15:16 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:15:16.474293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-db14d67e-1f5e-4594-bcc5-0cd38848308b tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:16.479488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db14d67e-1f5e-4594-bcc5-0cd38848308b tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:16.479985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db14d67e-1f5e-4594-bcc5-0cd38848308b tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:16.480457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db14d67e-1f5e-4594-bcc5-0cd38848308b tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:16.481253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db14d67e-1f5e-4594-bcc5-0cd38848308b tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:16.486679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db14d67e-1f5e-4594-bcc5-0cd38848308b tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:16.493477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db14d67e-1f5e-4594-bcc5-0cd38848308b tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:16.547572 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-db14d67e-1f5e-4594-bcc5-0cd38848308b tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.077372 Oct 04 21:15:16.548203 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1201/2345] 10.222.0.30 () {60 vars in 1178 bytes} [Tue Oct 4 21:15:16 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:15:16.564395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-73dc8ced-cd94-4d7b-aa51-3481ea22f915 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:16.565300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-73dc8ced-cd94-4d7b-aa51-3481ea22f915 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:16.691579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-73dc8ced-cd94-4d7b-aa51-3481ea22f915 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:16.698501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=43 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:16.700287 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-73dc8ced-cd94-4d7b-aa51-3481ea22f915 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1243 microversion: 2.1 time: 0.139844 Oct 04 21:15:16.700881 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1202/2346] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:16 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1243 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:16.716842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ee819f6a-e14c-41c3-a597-9f36fae9226e tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:16.731091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ee819f6a-e14c-41c3-a597-9f36fae9226e tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:16.731592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ee819f6a-e14c-41c3-a597-9f36fae9226e tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:16.732035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ee819f6a-e14c-41c3-a597-9f36fae9226e tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:16.732773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ee819f6a-e14c-41c3-a597-9f36fae9226e tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:16.733231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ee819f6a-e14c-41c3-a597-9f36fae9226e tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:16.733689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ee819f6a-e14c-41c3-a597-9f36fae9226e tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:16.800438 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ee819f6a-e14c-41c3-a597-9f36fae9226e tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=n-d-860282-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.090565 Oct 04 21:15:16.804162 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1203/2347] 10.222.0.30 () {60 vars in 1235 bytes} [Tue Oct 4 21:15:16 2022] GET /compute/v2.1/os-services?host=n-d-860282-1&binary=xxx => generated 16 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:16.879332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c6bbd733-e92b-4f48-a9ec-652a7989598f tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Action: 'create', calling method: .version_select at 0x7f579453ee50>, body: {"keypair": {"name": "tempest-keypair-2005495584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFglqL01DoAWADbwPUyWPIIwUunglCRxB9zUPQP4RhqnCFcClyS+UL/SHW/umjhkO40ifXbiJvNELZeuYARucgAJ0x0TCU756M95s818cfh8jJJmSeOe1GAYDmGMb6aTXQ=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:16.899228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-c6bbd733-e92b-4f48-a9ec-652a7989598f tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Getting quotas for project ec3f8d2a788d4d61a4b8e1d3087cd57f. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:16.903794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-c6bbd733-e92b-4f48-a9ec-652a7989598f tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Getting quotas for user 4164bd60495b4dcead6a5bdf435ca069 and project ec3f8d2a788d4d61a4b8e1d3087cd57f. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:16.966452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bea20e5a-3dc3-41ff-9699-db0428f5f694 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:16.977782 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bea20e5a-3dc3-41ff-9699-db0428f5f694 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.633125 Oct 04 21:15:16.978567 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1145/2348] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:16 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:16.996864 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c6bbd733-e92b-4f48-a9ec-652a7989598f tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.188316 Oct 04 21:15:17.000645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-49030d5e-44dd-4a1a-b35b-93520e37364b tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:17.002406 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1204/2349] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:15:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:17.008876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49030d5e-44dd-4a1a-b35b-93520e37364b tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:17.008876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49030d5e-44dd-4a1a-b35b-93520e37364b tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:17.008876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49030d5e-44dd-4a1a-b35b-93520e37364b tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:17.008876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49030d5e-44dd-4a1a-b35b-93520e37364b tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:17.009906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49030d5e-44dd-4a1a-b35b-93520e37364b tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:17.010502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49030d5e-44dd-4a1a-b35b-93520e37364b tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:17.042226 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-49030d5e-44dd-4a1a-b35b-93520e37364b tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.045346 Oct 04 21:15:17.050568 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1146/2350] 10.222.0.30 () {60 vars in 1178 bytes} [Tue Oct 4 21:15:16 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:15:17.055809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-142a374f-c32b-45c0-b65d-1122b8f5f663 tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:17.059819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-142a374f-c32b-45c0-b65d-1122b8f5f663 tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:17.060341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-142a374f-c32b-45c0-b65d-1122b8f5f663 tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:17.060760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-142a374f-c32b-45c0-b65d-1122b8f5f663 tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:17.061517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-142a374f-c32b-45c0-b65d-1122b8f5f663 tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:17.070988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-142a374f-c32b-45c0-b65d-1122b8f5f663 tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:17.071684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-142a374f-c32b-45c0-b65d-1122b8f5f663 tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:17.114171 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-142a374f-c32b-45c0-b65d-1122b8f5f663 tempest-ServicesAdminNegativeV253TestJSON-661849733 tempest-ServicesAdminNegativeV253TestJSON-661849733-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.062352 Oct 04 21:15:17.115586 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1205/2351] 10.222.0.30 () {60 vars in 1239 bytes} [Tue Oct 4 21:15:17 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:17.130455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fd97fec3-ef27-4c36-a9ec-4381d6c651c6 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:17.132540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fd97fec3-ef27-4c36-a9ec-4381d6c651c6 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:17.142235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd97fec3-ef27-4c36-a9ec-4381d6c651c6 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:17.142707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd97fec3-ef27-4c36-a9ec-4381d6c651c6 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:17.143146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd97fec3-ef27-4c36-a9ec-4381d6c651c6 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:17.143849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd97fec3-ef27-4c36-a9ec-4381d6c651c6 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:17.144790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd97fec3-ef27-4c36-a9ec-4381d6c651c6 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:17.145226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd97fec3-ef27-4c36-a9ec-4381d6c651c6 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:17.291420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bc1c2ac1-5b1a-4abf-a377-941bae404eb4 tempest-ServicesAdminNegativeV253TestJSON-237890527 tempest-ServicesAdminNegativeV253TestJSON-237890527-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:17.295453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bc1c2ac1-5b1a-4abf-a377-941bae404eb4 tempest-ServicesAdminNegativeV253TestJSON-237890527 tempest-ServicesAdminNegativeV253TestJSON-237890527-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'fa03d06fd0ac44368b88ff7fb07dd1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231cebcab08643d1a9f716d4231b659c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bc1c2ac1-5b1a-4abf-a377-941bae404eb4 tempest-ServicesAdminNegativeV253TestJSON-237890527 tempest-ServicesAdminNegativeV253TestJSON-237890527-project] Request method failure captured: Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKJgoBuGZ9mr9VWxGqDHZb5wGQBgIoyWEAbH1ayF_VC8ic0xGHe5OF8f_42PVGSJ44nrO5dV8vJs9rZ-X2SlhH0YYfnSQQYTh5sRK4ke_tpSrAVsMeW6m6LL8d1OY528bJ2sVtI8neUx_ya-oIUK50YdNymkVdlG2fIhp0m8oQP8lbI Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 231cebcab08643d1a9f716d4231b659c Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-237890527 Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/231cebcab08643d1a9f716d4231b659c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_231cebcab08643d1a9f716d4231b659c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/231cebcab08643d1a9f716d4231b659c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/231cebcab08643d1a9f716d4231b659c"}]}] Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-237890527 Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 231cebcab08643d1a9f716d4231b659c Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-237890527 Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServicesAdminNegativeV253TestJSON-237890527-project Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: fa03d06fd0ac44368b88ff7fb07dd1d8 Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-237890527-project Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: action_args: {} Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:15:17.301936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 21:15:17.306139 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:17.306139 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:17.306139 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:17.306139 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:17.306139 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:17.306139 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:17.306139 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:15:17.306139 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:15:17.306139 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 21:15:17.306139 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:17.306139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bc1c2ac1-5b1a-4abf-a377-941bae404eb4 tempest-ServicesAdminNegativeV253TestJSON-237890527 tempest-ServicesAdminNegativeV253TestJSON-237890527-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:17.307060 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bc1c2ac1-5b1a-4abf-a377-941bae404eb4 tempest-ServicesAdminNegativeV253TestJSON-237890527 tempest-ServicesAdminNegativeV253TestJSON-237890527-project] 10.222.0.30 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.180086 Oct 04 21:15:17.307594 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1206/2352] 10.222.0.30 () {60 vars in 1178 bytes} [Tue Oct 4 21:15:17 2022] GET /compute/v2.1/os-services => generated 112 bytes in 183 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:15:17.349322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bc08a344-dbae-43d7-9c3e-ae0c1408057a tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:17.351100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bc08a344-dbae-43d7-9c3e-ae0c1408057a tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:17.358406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc08a344-dbae-43d7-9c3e-ae0c1408057a tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:17.365141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc08a344-dbae-43d7-9c3e-ae0c1408057a tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:17.369997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc08a344-dbae-43d7-9c3e-ae0c1408057a tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:17.371374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc08a344-dbae-43d7-9c3e-ae0c1408057a tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:17.372229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc08a344-dbae-43d7-9c3e-ae0c1408057a tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:17.372833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc08a344-dbae-43d7-9c3e-ae0c1408057a tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:17.517260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fd97fec3-ef27-4c36-a9ec-4381d6c651c6 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb68f8fb49d492e8bfc6e37336d3801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b630636b36647f5837eda19552ddf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:17.558832 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fd97fec3-ef27-4c36-a9ec-4381d6c651c6 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 200 len: 1323 microversion: 2.1 time: 0.428533 Oct 04 21:15:17.560068 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1147/2353] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:17 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 1323 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:17.729529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bb2c7ea2-5e6e-4a27-8ad8-c29a77a21baa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:17.730889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bb2c7ea2-5e6e-4a27-8ad8-c29a77a21baa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:17.749253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb2c7ea2-5e6e-4a27-8ad8-c29a77a21baa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:17.751584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb2c7ea2-5e6e-4a27-8ad8-c29a77a21baa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:17.754775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb2c7ea2-5e6e-4a27-8ad8-c29a77a21baa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:17.759535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb2c7ea2-5e6e-4a27-8ad8-c29a77a21baa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:17.762019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb2c7ea2-5e6e-4a27-8ad8-c29a77a21baa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:17.765503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb2c7ea2-5e6e-4a27-8ad8-c29a77a21baa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:18.246224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bb2c7ea2-5e6e-4a27-8ad8-c29a77a21baa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:18.265012 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bb2c7ea2-5e6e-4a27-8ad8-c29a77a21baa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1239 microversion: 2.1 time: 0.543258 Oct 04 21:15:18.266603 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1148/2354] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:17 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1239 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:18.269901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bc08a344-dbae-43d7-9c3e-ae0c1408057a tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:18.272351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab515f32-f375-4549-8948-6b3c24e065a2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:18.272984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ab515f32-f375-4549-8948-6b3c24e065a2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:18.277905 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bc08a344-dbae-43d7-9c3e-ae0c1408057a tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1308 microversion: 2.1 time: 0.934178 Oct 04 21:15:18.278486 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1207/2355] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:17 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1308 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:18.281533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab515f32-f375-4549-8948-6b3c24e065a2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:18.282198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab515f32-f375-4549-8948-6b3c24e065a2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:18.282823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab515f32-f375-4549-8948-6b3c24e065a2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:18.283989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab515f32-f375-4549-8948-6b3c24e065a2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:18.284606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab515f32-f375-4549-8948-6b3c24e065a2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:18.285218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab515f32-f375-4549-8948-6b3c24e065a2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:18.493619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ab515f32-f375-4549-8948-6b3c24e065a2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:18.502110 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ab515f32-f375-4549-8948-6b3c24e065a2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.234339 Oct 04 21:15:18.513488 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1149/2356] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:18 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:18.582870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-64f99ecb-5d06-4bcd-af75-87b5c2df9e63 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:18.583487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-64f99ecb-5d06-4bcd-af75-87b5c2df9e63 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:18.590039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64f99ecb-5d06-4bcd-af75-87b5c2df9e63 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:18.590531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64f99ecb-5d06-4bcd-af75-87b5c2df9e63 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:18.590970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64f99ecb-5d06-4bcd-af75-87b5c2df9e63 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:18.591666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64f99ecb-5d06-4bcd-af75-87b5c2df9e63 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:18.592126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64f99ecb-5d06-4bcd-af75-87b5c2df9e63 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:18.592558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64f99ecb-5d06-4bcd-af75-87b5c2df9e63 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:18.880093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-64f99ecb-5d06-4bcd-af75-87b5c2df9e63 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb68f8fb49d492e8bfc6e37336d3801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b630636b36647f5837eda19552ddf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:18.890554 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-64f99ecb-5d06-4bcd-af75-87b5c2df9e63 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 200 len: 1323 microversion: 2.1 time: 0.311474 Oct 04 21:15:18.891725 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1208/2357] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:18 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 1323 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:19.093807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1fef55d5-bddc-4b97-9a25-0130747c4848 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-891610694", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:19.192706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-1fef55d5-bddc-4b97-9a25-0130747c4848 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] validate_networks() for [('a1aa70e9-3daa-4749-bfb3-05caabbf7400', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:15:19.305998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5c9d6099-8e59-4819-bc20-b789c65de60f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:19.307455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5c9d6099-8e59-4819-bc20-b789c65de60f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:19.313771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c9d6099-8e59-4819-bc20-b789c65de60f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:19.314523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c9d6099-8e59-4819-bc20-b789c65de60f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:19.315112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c9d6099-8e59-4819-bc20-b789c65de60f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:19.316360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c9d6099-8e59-4819-bc20-b789c65de60f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:19.317597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c9d6099-8e59-4819-bc20-b789c65de60f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:19.318040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c9d6099-8e59-4819-bc20-b789c65de60f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:19.603239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5c9d6099-8e59-4819-bc20-b789c65de60f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:19.615394 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5c9d6099-8e59-4819-bc20-b789c65de60f tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1308 microversion: 2.1 time: 0.316093 Oct 04 21:15:19.631667 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1209/2358] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:19 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1308 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:19.637690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9af9948-f812-4b47-b17e-1eeb9e0aeaee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:19.639914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d9af9948-f812-4b47-b17e-1eeb9e0aeaee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:19.646849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9af9948-f812-4b47-b17e-1eeb9e0aeaee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:19.647615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9af9948-f812-4b47-b17e-1eeb9e0aeaee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:19.648204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9af9948-f812-4b47-b17e-1eeb9e0aeaee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:19.649919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9af9948-f812-4b47-b17e-1eeb9e0aeaee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:19.651029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9af9948-f812-4b47-b17e-1eeb9e0aeaee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:19.651758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9af9948-f812-4b47-b17e-1eeb9e0aeaee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:19.798839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d9af9948-f812-4b47-b17e-1eeb9e0aeaee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:19.811121 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d9af9948-f812-4b47-b17e-1eeb9e0aeaee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1301 microversion: 2.1 time: 0.178198 Oct 04 21:15:19.814882 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1210/2359] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:19 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1301 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:19.825867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0256760d-110b-4677-9762-39d67a57441e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:19.826753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0256760d-110b-4677-9762-39d67a57441e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:19.844668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0256760d-110b-4677-9762-39d67a57441e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:19.848722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0256760d-110b-4677-9762-39d67a57441e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:19.850721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0256760d-110b-4677-9762-39d67a57441e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:19.851599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0256760d-110b-4677-9762-39d67a57441e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:19.855441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0256760d-110b-4677-9762-39d67a57441e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:19.856092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0256760d-110b-4677-9762-39d67a57441e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:19.924753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-1fef55d5-bddc-4b97-9a25-0130747c4848 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:15:19.925596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-1fef55d5-bddc-4b97-9a25-0130747c4848 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:15:19.927014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-1fef55d5-bddc-4b97-9a25-0130747c4848 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:15:19.927654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-1fef55d5-bddc-4b97-9a25-0130747c4848 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:15:19.928096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-1fef55d5-bddc-4b97-9a25-0130747c4848 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:15:19.950527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fef55d5-bddc-4b97-9a25-0130747c4848 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:19.953636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fef55d5-bddc-4b97-9a25-0130747c4848 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:19.954214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fef55d5-bddc-4b97-9a25-0130747c4848 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:19.955215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fef55d5-bddc-4b97-9a25-0130747c4848 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:19.957367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fef55d5-bddc-4b97-9a25-0130747c4848 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:19.957999 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fef55d5-bddc-4b97-9a25-0130747c4848 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:20.012883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-1fef55d5-bddc-4b97-9a25-0130747c4848 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Getting quotas for project 4df42993975949899553deaeaffada73. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:20.030336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-1fef55d5-bddc-4b97-9a25-0130747c4848 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Getting quotas for user 4d401d8a2c8e4cee856badba313ed00a and project 4df42993975949899553deaeaffada73. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:20.062864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1fef55d5-bddc-4b97-9a25-0130747c4848 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:15:20.068766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1fef55d5-bddc-4b97-9a25-0130747c4848 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:15:20.154633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0256760d-110b-4677-9762-39d67a57441e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:20.163462 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0256760d-110b-4677-9762-39d67a57441e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.347295 Oct 04 21:15:20.177648 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1211/2360] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:19 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:20.177648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8a282eae-88c8-488c-9000-0f7ce771958d tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:20.177648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8a282eae-88c8-488c-9000-0f7ce771958d tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:20.185222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a282eae-88c8-488c-9000-0f7ce771958d tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:20.185858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a282eae-88c8-488c-9000-0f7ce771958d tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:20.188444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a282eae-88c8-488c-9000-0f7ce771958d tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:20.193739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a282eae-88c8-488c-9000-0f7ce771958d tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:20.206289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a282eae-88c8-488c-9000-0f7ce771958d tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:20.207063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a282eae-88c8-488c-9000-0f7ce771958d tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:20.305560 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1fef55d5-bddc-4b97-9a25-0130747c4848 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.215678 Oct 04 21:15:20.310632 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1150/2361] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:15:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 1222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:15:20.335530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-80c0b52c-11f7-4af6-a54e-15828f482c46 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:20.339158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-80c0b52c-11f7-4af6-a54e-15828f482c46 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:20.488016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8a282eae-88c8-488c-9000-0f7ce771958d tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb68f8fb49d492e8bfc6e37336d3801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b630636b36647f5837eda19552ddf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:20.497273 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8a282eae-88c8-488c-9000-0f7ce771958d tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 200 len: 1323 microversion: 2.1 time: 0.331089 Oct 04 21:15:20.519991 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1212/2362] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:20 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 1323 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:20.545677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-80c0b52c-11f7-4af6-a54e-15828f482c46 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:20.553552 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-80c0b52c-11f7-4af6-a54e-15828f482c46 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1224 microversion: 2.1 time: 0.233873 Oct 04 21:15:20.558910 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1151/2363] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:20 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1224 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:20.595559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-4b5aad4b-577a-4961-86f5-cbc8620f9065 req-6dfdc5ad-b8c8-402b-b2bd-030166a305cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93744ae-9a79-417e-9de4-8b0b1ae0e574", "name": "network-vif-plugged", "status": "completed", "tag": "128b6b0b-4e8b-49bc-9933-9e6bd6e543e8"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:20.626268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4b5aad4b-577a-4961-86f5-cbc8620f9065 req-6dfdc5ad-b8c8-402b-b2bd-030166a305cf service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:20.627773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4b5aad4b-577a-4961-86f5-cbc8620f9065 req-6dfdc5ad-b8c8-402b-b2bd-030166a305cf service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:20.628686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4b5aad4b-577a-4961-86f5-cbc8620f9065 req-6dfdc5ad-b8c8-402b-b2bd-030166a305cf service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:20.639695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a19f2fcc-168f-4856-9c1c-b11eb2765f64 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:20.640476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a19f2fcc-168f-4856-9c1c-b11eb2765f64 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:20.661861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a19f2fcc-168f-4856-9c1c-b11eb2765f64 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:20.662802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a19f2fcc-168f-4856-9c1c-b11eb2765f64 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:20.663492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a19f2fcc-168f-4856-9c1c-b11eb2765f64 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:20.693046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a19f2fcc-168f-4856-9c1c-b11eb2765f64 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:20.697530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a19f2fcc-168f-4856-9c1c-b11eb2765f64 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:20.698826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a19f2fcc-168f-4856-9c1c-b11eb2765f64 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:20.714227 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-4b5aad4b-577a-4961-86f5-cbc8620f9065 req-6dfdc5ad-b8c8-402b-b2bd-030166a305cf service nova] Creating event network-vif-plugged:128b6b0b-4e8b-49bc-9933-9e6bd6e543e8 for instance d93744ae-9a79-417e-9de4-8b0b1ae0e574 on n-h2-860282-1 Oct 04 21:15:20.730882 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-4b5aad4b-577a-4961-86f5-cbc8620f9065 req-6dfdc5ad-b8c8-402b-b2bd-030166a305cf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138927 Oct 04 21:15:20.737349 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1213/2364] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:20.839345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3d322325-7347-4a4b-b57f-75d55f7f63a5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:20.840660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3d322325-7347-4a4b-b57f-75d55f7f63a5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:20.858848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d322325-7347-4a4b-b57f-75d55f7f63a5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:20.860459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d322325-7347-4a4b-b57f-75d55f7f63a5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:20.860459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d322325-7347-4a4b-b57f-75d55f7f63a5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:20.870736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d322325-7347-4a4b-b57f-75d55f7f63a5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:20.871382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d322325-7347-4a4b-b57f-75d55f7f63a5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:20.875400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d322325-7347-4a4b-b57f-75d55f7f63a5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:21.589180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a19f2fcc-168f-4856-9c1c-b11eb2765f64 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:21.605709 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a19f2fcc-168f-4856-9c1c-b11eb2765f64 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1308 microversion: 2.1 time: 0.969890 Oct 04 21:15:21.607771 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1152/2365] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:20 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1308 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:21.609131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a19f2fcc-168f-4856-9c1c-b11eb2765f64 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:21.610319 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a19f2fcc-168f-4856-9c1c-b11eb2765f64 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001500 Oct 04 21:15:21.611410 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1153/2366] 10.222.0.30 () {56 vars in 886 bytes} [Tue Oct 4 21:15:21 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 21:15:21.617787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-070b3089-d3c0-437e-889d-3f4510c0a869 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:21.618897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-070b3089-d3c0-437e-889d-3f4510c0a869 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:21.637079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-070b3089-d3c0-437e-889d-3f4510c0a869 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:21.638152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-070b3089-d3c0-437e-889d-3f4510c0a869 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:21.638784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-070b3089-d3c0-437e-889d-3f4510c0a869 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:21.640356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-070b3089-d3c0-437e-889d-3f4510c0a869 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:21.641009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-070b3089-d3c0-437e-889d-3f4510c0a869 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:21.641822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-070b3089-d3c0-437e-889d-3f4510c0a869 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:21.703158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3d322325-7347-4a4b-b57f-75d55f7f63a5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:21.715438 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3d322325-7347-4a4b-b57f-75d55f7f63a5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1369 microversion: 2.1 time: 0.884018 Oct 04 21:15:21.716270 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1214/2367] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:20 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1369 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:21.737608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-746f327a-59b1-4b18-8bf3-506f935f5594 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:21.738504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-746f327a-59b1-4b18-8bf3-506f935f5594 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:21.751813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-746f327a-59b1-4b18-8bf3-506f935f5594 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:21.753312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-746f327a-59b1-4b18-8bf3-506f935f5594 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:21.754247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-746f327a-59b1-4b18-8bf3-506f935f5594 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:21.755001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-746f327a-59b1-4b18-8bf3-506f935f5594 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:21.755659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-746f327a-59b1-4b18-8bf3-506f935f5594 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:21.756263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-746f327a-59b1-4b18-8bf3-506f935f5594 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:22.111420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-746f327a-59b1-4b18-8bf3-506f935f5594 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb68f8fb49d492e8bfc6e37336d3801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b630636b36647f5837eda19552ddf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:22.114316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-070b3089-d3c0-437e-889d-3f4510c0a869 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:22.125615 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-070b3089-d3c0-437e-889d-3f4510c0a869 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.512974 Oct 04 21:15:22.126832 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1154/2368] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:21 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:22.127269 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-746f327a-59b1-4b18-8bf3-506f935f5594 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 200 len: 1323 microversion: 2.1 time: 0.394634 Oct 04 21:15:22.129158 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1215/2369] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:21 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 1323 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:22.131891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-746f327a-59b1-4b18-8bf3-506f935f5594 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:22.135952 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-746f327a-59b1-4b18-8bf3-506f935f5594 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.004431 Oct 04 21:15:22.137235 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1216/2370] 10.222.0.30 () {54 vars in 1035 bytes} [Tue Oct 4 21:15:22 2022] GET /compute/v2/ => generated 379 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 04 21:15:22.151038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b962d13f-e73c-4193-ad08-25915bf299fa tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:22.151894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-746f327a-59b1-4b18-8bf3-506f935f5594 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:22.153169 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-746f327a-59b1-4b18-8bf3-506f935f5594 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002503 Oct 04 21:15:22.154233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b962d13f-e73c-4193-ad08-25915bf299fa tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:22.162376 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1217/2371] 10.222.0.30 () {54 vars in 1041 bytes} [Tue Oct 4 21:15:22 2022] GET /compute/v2.1/ => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:22.165187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-746f327a-59b1-4b18-8bf3-506f935f5594 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:22.169628 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-746f327a-59b1-4b18-8bf3-506f935f5594 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005016 Oct 04 21:15:22.170351 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1218/2372] 10.222.0.30 () {56 vars in 886 bytes} [Tue Oct 4 21:15:22 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 21:15:22.337462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b962d13f-e73c-4193-ad08-25915bf299fa tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:22.348375 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b962d13f-e73c-4193-ad08-25915bf299fa tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1224 microversion: 2.1 time: 0.218470 Oct 04 21:15:22.351059 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1155/2373] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:22 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1224 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:22.648716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e66a66b2-7f62-402f-b1e1-b568d1070678 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:22.650371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e66a66b2-7f62-402f-b1e1-b568d1070678 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:22.686992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e66a66b2-7f62-402f-b1e1-b568d1070678 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:22.688391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e66a66b2-7f62-402f-b1e1-b568d1070678 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:22.690412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e66a66b2-7f62-402f-b1e1-b568d1070678 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:22.694165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e66a66b2-7f62-402f-b1e1-b568d1070678 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:22.694910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e66a66b2-7f62-402f-b1e1-b568d1070678 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:22.698622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e66a66b2-7f62-402f-b1e1-b568d1070678 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:22.744540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d99f6dce-9e00-4785-9df2-7b51ae8a5fff tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:22.745736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d99f6dce-9e00-4785-9df2-7b51ae8a5fff tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:22.754259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d99f6dce-9e00-4785-9df2-7b51ae8a5fff tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:22.754946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d99f6dce-9e00-4785-9df2-7b51ae8a5fff tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:22.755640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d99f6dce-9e00-4785-9df2-7b51ae8a5fff tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:22.756688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d99f6dce-9e00-4785-9df2-7b51ae8a5fff tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:22.757306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d99f6dce-9e00-4785-9df2-7b51ae8a5fff tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:22.758636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d99f6dce-9e00-4785-9df2-7b51ae8a5fff tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:22.764197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:22.927300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e66a66b2-7f62-402f-b1e1-b568d1070678 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:22.937998 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e66a66b2-7f62-402f-b1e1-b568d1070678 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1308 microversion: 2.1 time: 0.306324 Oct 04 21:15:22.958469 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1219/2374] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:22 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1308 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:22.967865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-9e37ed6b-6324-47bb-8345-30ccba0d5213 req-a04742ea-a1f6-4a21-9091-cedc9f6e5efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8895bf-11ae-42d3-9af7-c934522d7341", "name": "network-vif-plugged", "status": "completed", "tag": "6a0d5822-3dd3-4808-99c8-03da86151a0a"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:22.990978 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9e37ed6b-6324-47bb-8345-30ccba0d5213 req-a04742ea-a1f6-4a21-9091-cedc9f6e5efd service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:22.998187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9e37ed6b-6324-47bb-8345-30ccba0d5213 req-a04742ea-a1f6-4a21-9091-cedc9f6e5efd service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:22.999289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9e37ed6b-6324-47bb-8345-30ccba0d5213 req-a04742ea-a1f6-4a21-9091-cedc9f6e5efd service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:23.018710 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-9e37ed6b-6324-47bb-8345-30ccba0d5213 req-a04742ea-a1f6-4a21-9091-cedc9f6e5efd service nova] Creating event network-vif-plugged:6a0d5822-3dd3-4808-99c8-03da86151a0a for instance 4e8895bf-11ae-42d3-9af7-c934522d7341 on n-h2-860282-1 Oct 04 21:15:23.033614 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-9e37ed6b-6324-47bb-8345-30ccba0d5213 req-a04742ea-a1f6-4a21-9091-cedc9f6e5efd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073570 Oct 04 21:15:23.045946 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1220/2375] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:23.083475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d99f6dce-9e00-4785-9df2-7b51ae8a5fff tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:23.101151 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d99f6dce-9e00-4785-9df2-7b51ae8a5fff tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1369 microversion: 2.1 time: 0.352824 Oct 04 21:15:23.106576 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1156/2376] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:22 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1369 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:23.154468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e4344451-a7bd-4de9-b114-60dc341f0d00 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:23.155951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e4344451-a7bd-4de9-b114-60dc341f0d00 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:23.184634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4134b123-0161-4365-96e6-32cdd4c250fe tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:23.184932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4344451-a7bd-4de9-b114-60dc341f0d00 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:23.185753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4344451-a7bd-4de9-b114-60dc341f0d00 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:23.185898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4134b123-0161-4365-96e6-32cdd4c250fe tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:23.186662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4344451-a7bd-4de9-b114-60dc341f0d00 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:23.187576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4344451-a7bd-4de9-b114-60dc341f0d00 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:23.188208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4344451-a7bd-4de9-b114-60dc341f0d00 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:23.188812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4344451-a7bd-4de9-b114-60dc341f0d00 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:23.205552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4134b123-0161-4365-96e6-32cdd4c250fe tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:23.207068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4134b123-0161-4365-96e6-32cdd4c250fe tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:23.208204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4134b123-0161-4365-96e6-32cdd4c250fe tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:23.210570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4134b123-0161-4365-96e6-32cdd4c250fe tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:23.214851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4134b123-0161-4365-96e6-32cdd4c250fe tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:23.215688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4134b123-0161-4365-96e6-32cdd4c250fe tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:23.585769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4134b123-0161-4365-96e6-32cdd4c250fe tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb68f8fb49d492e8bfc6e37336d3801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b630636b36647f5837eda19552ddf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:23.595112 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4134b123-0161-4365-96e6-32cdd4c250fe tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 200 len: 1323 microversion: 2.1 time: 0.430999 Oct 04 21:15:23.595717 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1157/2377] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:23 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 1323 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:23.610536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e4344451-a7bd-4de9-b114-60dc341f0d00 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:23.623945 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e4344451-a7bd-4de9-b114-60dc341f0d00 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.474945 Oct 04 21:15:23.624746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1779294168", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8ab60079-f9a0-497f-af18-d86586d47f2d"}], "security_groups": [{"name": "tempest-securitygroup--1582704953"}], "key_name": "tempest-keypair-2005495584", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:23.641312 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1221/2378] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:23 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:23.641312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2ce97a5c-6f0f-4f0a-a81c-c56e9cec2435 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:23.641312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2ce97a5c-6f0f-4f0a-a81c-c56e9cec2435 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:23.655850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ce97a5c-6f0f-4f0a-a81c-c56e9cec2435 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:23.656359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ce97a5c-6f0f-4f0a-a81c-c56e9cec2435 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:23.659360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ce97a5c-6f0f-4f0a-a81c-c56e9cec2435 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:23.660123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ce97a5c-6f0f-4f0a-a81c-c56e9cec2435 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:23.663294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ce97a5c-6f0f-4f0a-a81c-c56e9cec2435 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:23.664089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ce97a5c-6f0f-4f0a-a81c-c56e9cec2435 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:23.805387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2ce97a5c-6f0f-4f0a-a81c-c56e9cec2435 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:23.815521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] validate_networks() for [('8ab60079-f9a0-497f-af18-d86586d47f2d', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:15:23.822838 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2ce97a5c-6f0f-4f0a-a81c-c56e9cec2435 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1276 microversion: 2.1 time: 0.188514 Oct 04 21:15:23.824754 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1222/2379] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:23 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1276 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:23.971965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-619a6c01-1507-4077-8a9d-9a0216cf93d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:23.973316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-619a6c01-1507-4077-8a9d-9a0216cf93d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:23.985848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-619a6c01-1507-4077-8a9d-9a0216cf93d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:23.986710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-619a6c01-1507-4077-8a9d-9a0216cf93d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:23.987216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-619a6c01-1507-4077-8a9d-9a0216cf93d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:23.988138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-619a6c01-1507-4077-8a9d-9a0216cf93d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:23.988815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-619a6c01-1507-4077-8a9d-9a0216cf93d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:23.989488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-619a6c01-1507-4077-8a9d-9a0216cf93d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:24.299192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-619a6c01-1507-4077-8a9d-9a0216cf93d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:24.318900 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-619a6c01-1507-4077-8a9d-9a0216cf93d3 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1489 microversion: 2.1 time: 0.351457 Oct 04 21:15:24.319503 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1223/2380] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:23 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1489 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:24.343174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-489c6b75-9b18-43b4-8b2b-461e438f17dd req-0764febd-bbbc-4a4a-810f-6a636fd69d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0250fa-4053-4bec-81bb-b5f857310687", "tag": "9965e6e8-265e-42f4-906a-f53b455b8c28"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:24.354306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-489c6b75-9b18-43b4-8b2b-461e438f17dd req-0764febd-bbbc-4a4a-810f-6a636fd69d65 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:24.354798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-489c6b75-9b18-43b4-8b2b-461e438f17dd req-0764febd-bbbc-4a4a-810f-6a636fd69d65 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:24.355452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-489c6b75-9b18-43b4-8b2b-461e438f17dd req-0764febd-bbbc-4a4a-810f-6a636fd69d65 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:24.366920 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-489c6b75-9b18-43b4-8b2b-461e438f17dd req-0764febd-bbbc-4a4a-810f-6a636fd69d65 service nova] Creating event network-changed:9965e6e8-265e-42f4-906a-f53b455b8c28 for instance 0f0250fa-4053-4bec-81bb-b5f857310687 on n-h1-860282-1 Oct 04 21:15:24.374116 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-489c6b75-9b18-43b4-8b2b-461e438f17dd req-0764febd-bbbc-4a4a-810f-6a636fd69d65 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038788 Oct 04 21:15:24.375694 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1224/2381] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:24.381203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-30b82275-4543-4b9e-bf50-d43956f49f99 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:24.381949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-30b82275-4543-4b9e-bf50-d43956f49f99 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:24.388843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30b82275-4543-4b9e-bf50-d43956f49f99 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:24.389580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30b82275-4543-4b9e-bf50-d43956f49f99 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:24.390204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30b82275-4543-4b9e-bf50-d43956f49f99 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:24.391072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30b82275-4543-4b9e-bf50-d43956f49f99 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:24.391685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30b82275-4543-4b9e-bf50-d43956f49f99 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:24.392267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30b82275-4543-4b9e-bf50-d43956f49f99 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:24.603428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=33 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:24.614636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Getting quotas for project ec3f8d2a788d4d61a4b8e1d3087cd57f. Resources: dict_keys(['metadata_items']) {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:24.624203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Getting quotas for user 4164bd60495b4dcead6a5bdf435ca069 and project ec3f8d2a788d4d61a4b8e1d3087cd57f. Resources: dict_keys(['metadata_items']) {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:24.640846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:15:24.641935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:15:24.642437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:15:24.642862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:15:24.646633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:15:24.672182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:24.690146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:24.703995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:24.706523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:24.707402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:24.708863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:24.754440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Getting quotas for project ec3f8d2a788d4d61a4b8e1d3087cd57f. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:24.763948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Getting quotas for user 4164bd60495b4dcead6a5bdf435ca069 and project ec3f8d2a788d4d61a4b8e1d3087cd57f. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:24.818220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-30b82275-4543-4b9e-bf50-d43956f49f99 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:24.833670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:15:24.836807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:15:24.840378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:24.843779 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-30b82275-4543-4b9e-bf50-d43956f49f99 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1369 microversion: 2.1 time: 0.466746 Oct 04 21:15:24.844373 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1225/2382] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:24 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1369 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:24.850516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-94753e61-e0b8-41b8-98df-eb2eb57dc93c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1312197080"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:24.853347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-94753e61-e0b8-41b8-98df-eb2eb57dc93c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:24.878608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94753e61-e0b8-41b8-98df-eb2eb57dc93c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:24.879041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94753e61-e0b8-41b8-98df-eb2eb57dc93c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:24.879488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94753e61-e0b8-41b8-98df-eb2eb57dc93c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:24.880202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94753e61-e0b8-41b8-98df-eb2eb57dc93c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:24.880666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94753e61-e0b8-41b8-98df-eb2eb57dc93c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:24.881101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94753e61-e0b8-41b8-98df-eb2eb57dc93c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:25.114061 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-21c9eb76-9d67-4d5e-a14a-67fdc8415708 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.506534 Oct 04 21:15:25.119635 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1158/2383] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:15:23 2022] POST /compute/v2.1/servers => generated 407 bytes in 1523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:15:25.165655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4a0be8a3-c1bf-4e40-937c-cddf9046da71 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:25.175029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4a0be8a3-c1bf-4e40-937c-cddf9046da71 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:25.190558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a0be8a3-c1bf-4e40-937c-cddf9046da71 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:25.191314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a0be8a3-c1bf-4e40-937c-cddf9046da71 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:25.191961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a0be8a3-c1bf-4e40-937c-cddf9046da71 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:25.193219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a0be8a3-c1bf-4e40-937c-cddf9046da71 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:25.194243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a0be8a3-c1bf-4e40-937c-cddf9046da71 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:25.194840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a0be8a3-c1bf-4e40-937c-cddf9046da71 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:25.574240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4a0be8a3-c1bf-4e40-937c-cddf9046da71 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb68f8fb49d492e8bfc6e37336d3801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b630636b36647f5837eda19552ddf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:25.596118 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4a0be8a3-c1bf-4e40-937c-cddf9046da71 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 200 len: 1473 microversion: 2.1 time: 0.473015 Oct 04 21:15:25.609559 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1159/2384] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:25 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 1473 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:25.609712 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-94753e61-e0b8-41b8-98df-eb2eb57dc93c tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "POST /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574/action" status: 202 len: 0 microversion: 2.1 time: 0.751087 Oct 04 21:15:25.609712 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1226/2385] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:15:24 2022] POST /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574/action => generated 0 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 21:15:25.610990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f2cb0506-7756-480e-84ce-0d76fba2afca tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:25.614772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f2cb0506-7756-480e-84ce-0d76fba2afca tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:25.630425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fb3b1fc2-54a5-45b5-8ff8-fd2db33c5b3d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:25.630425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fb3b1fc2-54a5-45b5-8ff8-fd2db33c5b3d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:25.636534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2cb0506-7756-480e-84ce-0d76fba2afca tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:25.638561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2cb0506-7756-480e-84ce-0d76fba2afca tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:25.639836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2cb0506-7756-480e-84ce-0d76fba2afca tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:25.642035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2cb0506-7756-480e-84ce-0d76fba2afca tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:25.642586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2cb0506-7756-480e-84ce-0d76fba2afca tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:25.643079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb3b1fc2-54a5-45b5-8ff8-fd2db33c5b3d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:25.644175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2cb0506-7756-480e-84ce-0d76fba2afca tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:25.646330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb3b1fc2-54a5-45b5-8ff8-fd2db33c5b3d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:25.647167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb3b1fc2-54a5-45b5-8ff8-fd2db33c5b3d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:25.649483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb3b1fc2-54a5-45b5-8ff8-fd2db33c5b3d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:25.650142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb3b1fc2-54a5-45b5-8ff8-fd2db33c5b3d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:25.651878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb3b1fc2-54a5-45b5-8ff8-fd2db33c5b3d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:25.869882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f2cb0506-7756-480e-84ce-0d76fba2afca tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:25.890507 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f2cb0506-7756-480e-84ce-0d76fba2afca tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1294 microversion: 2.1 time: 0.288950 Oct 04 21:15:25.891180 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1227/2386] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:25 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1294 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:25.899269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-28e157ad-92eb-417d-a526-ee5e0fb7fd0e tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:25.899269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-28e157ad-92eb-417d-a526-ee5e0fb7fd0e tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:26.073597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-28e157ad-92eb-417d-a526-ee5e0fb7fd0e tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:26.076847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fb3b1fc2-54a5-45b5-8ff8-fd2db33c5b3d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:26.088886 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-28e157ad-92eb-417d-a526-ee5e0fb7fd0e tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189" status: 200 len: 1270 microversion: 2.1 time: 0.192991 Oct 04 21:15:26.089092 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fb3b1fc2-54a5-45b5-8ff8-fd2db33c5b3d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.475177 Oct 04 21:15:26.089449 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1228/2387] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:25 2022] GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 => generated 1270 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:26.096333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-762ceab9-092e-4e52-a90f-9724feddd880 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f579443b0d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:26.102699 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1160/2388] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:25 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:26.121319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-83a9bd7f-8fe4-44bf-bd6e-9cb79c923a98 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:26.122022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-83a9bd7f-8fe4-44bf-bd6e-9cb79c923a98 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:26.139198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83a9bd7f-8fe4-44bf-bd6e-9cb79c923a98 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:26.139777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83a9bd7f-8fe4-44bf-bd6e-9cb79c923a98 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:26.140253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83a9bd7f-8fe4-44bf-bd6e-9cb79c923a98 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:26.141086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83a9bd7f-8fe4-44bf-bd6e-9cb79c923a98 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:26.142934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83a9bd7f-8fe4-44bf-bd6e-9cb79c923a98 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:26.143438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83a9bd7f-8fe4-44bf-bd6e-9cb79c923a98 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:26.196923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-83a9bd7f-8fe4-44bf-bd6e-9cb79c923a98 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '4bb68f8fb49d492e8bfc6e37336d3801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b630636b36647f5837eda19552ddf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-83a9bd7f-8fe4-44bf-bd6e-9cb79c923a98 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Request method failure captured: Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341/diagnostics HTTP/1.1 Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKJU5I0LkISQM2NnPSlhJ-ywke-xCeRYcvIPuOPHLsec3HNxnttWEt0H3gouBFHEPFQc6Dp3meQV46ooxPV_xGVBY1GxTolFjosAetLz7v48E9OtTdaLxmzvsqMmogRok0VeY-nWePDmHB2xQgHWtfxa8j-shkPqoz5QVH9ryEBB8e8 Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 7b630636b36647f5837eda19552ddf1b Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1269283838 Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b630636b36647f5837eda19552ddf1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7b630636b36647f5837eda19552ddf1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7b630636b36647f5837eda19552ddf1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b630636b36647f5837eda19552ddf1b"}]}] Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1269283838 Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 7b630636b36647f5837eda19552ddf1b Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1269283838 Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerDiagnosticsNegativeTest-1269283838-project Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 4bb68f8fb49d492e8bfc6e37336d3801 Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1269283838-project Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'server_id': '4e8895bf-11ae-42d3-9af7-c934522d7341'} Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:26.209379 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:26.214570 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:26.214570 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:26.214570 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:15:26.214570 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:15:26.214570 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 21:15:26.214570 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:26.215760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-83a9bd7f-8fe4-44bf-bd6e-9cb79c923a98 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:26.216802 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-83a9bd7f-8fe4-44bf-bd6e-9cb79c923a98 tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.112834 Oct 04 21:15:26.217878 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1161/2389] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:15:26 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341/diagnostics => generated 117 bytes in 114 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:15:26.219142 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-762ceab9-092e-4e52-a90f-9724feddd880 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/ea6a4983-fb38-4966-89bb-24ae4b2888a2" status: 200 len: 1414 microversion: 2.1 time: 0.127620 Oct 04 21:15:26.219723 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1229/2390] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:15:26 2022] GET /compute/v2.1/images/ea6a4983-fb38-4966-89bb-24ae4b2888a2 => generated 1414 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:26.231013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-10320d92-c0c3-430c-a237-9f6954b62e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:26.231264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f000a3f7-57bc-4f7e-a3ad-5db11c81b2aa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:26.240238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f000a3f7-57bc-4f7e-a3ad-5db11c81b2aa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:26.247339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-10320d92-c0c3-430c-a237-9f6954b62e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:26.251106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f000a3f7-57bc-4f7e-a3ad-5db11c81b2aa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:26.251614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f000a3f7-57bc-4f7e-a3ad-5db11c81b2aa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:26.252077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f000a3f7-57bc-4f7e-a3ad-5db11c81b2aa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:26.252796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f000a3f7-57bc-4f7e-a3ad-5db11c81b2aa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:26.253260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f000a3f7-57bc-4f7e-a3ad-5db11c81b2aa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:26.253725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f000a3f7-57bc-4f7e-a3ad-5db11c81b2aa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:26.262584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-10320d92-c0c3-430c-a237-9f6954b62e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:26.270152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-10320d92-c0c3-430c-a237-9f6954b62e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:26.270152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-10320d92-c0c3-430c-a237-9f6954b62e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:26.270152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-10320d92-c0c3-430c-a237-9f6954b62e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:26.270152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-10320d92-c0c3-430c-a237-9f6954b62e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:26.270152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-10320d92-c0c3-430c-a237-9f6954b62e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:26.355868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-10320d92-c0c3-430c-a237-9f6954b62e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:15:26.584987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f000a3f7-57bc-4f7e-a3ad-5db11c81b2aa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:26.604192 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f000a3f7-57bc-4f7e-a3ad-5db11c81b2aa tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1369 microversion: 2.1 time: 0.384802 Oct 04 21:15:26.614564 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1162/2391] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:26 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1369 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:26.622019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7703ce04-da63-453a-9007-97c571ab5078 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f57943e8dc0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:26.724444 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7703ce04-da63-453a-9007-97c571ab5078 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/ea6a4983-fb38-4966-89bb-24ae4b2888a2" status: 200 len: 1414 microversion: 2.1 time: 0.108654 Oct 04 21:15:26.727006 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1163/2392] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:15:26 2022] GET /compute/v2.1/images/ea6a4983-fb38-4966-89bb-24ae4b2888a2 => generated 1414 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:26.914763 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-10320d92-c0c3-430c-a237-9f6954b62e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 204 len: 0 microversion: 2.1 time: 0.690136 Oct 04 21:15:26.926868 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1230/2393] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:15:26 2022] DELETE /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:15:26.928160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6b976897-6abf-4590-8e70-d98bad0b885e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f578be9daf0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:27.082732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=12 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:27.231871 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1a890260-221e-4d6d-b71a-9d8edd85cb72 tempest-TenantUsagesNegativeTestJSON-830668619 tempest-TenantUsagesNegativeTestJSON-830668619-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T21%3A15%3A26.682961&end=2022-10-05T21%3A15%3A26.682961" status: 404 len: 112 microversion: - time: 0.503454 Oct 04 21:15:27.233459 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1164/2394] 10.222.0.30 () {58 vars in 1316 bytes} [Tue Oct 4 21:15:26 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T21%3A15%3A26.682961&end=2022-10-05T21%3A15%3A26.682961 => generated 112 bytes in 506 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 21:15:27.241032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f5b079fd-22ab-444e-964a-4fdfa6287c38 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:27.247921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f5b079fd-22ab-444e-964a-4fdfa6287c38 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:27.261883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5b079fd-22ab-444e-964a-4fdfa6287c38 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:27.264632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5b079fd-22ab-444e-964a-4fdfa6287c38 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:27.277191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5b079fd-22ab-444e-964a-4fdfa6287c38 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:27.279818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5b079fd-22ab-444e-964a-4fdfa6287c38 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:27.279818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5b079fd-22ab-444e-964a-4fdfa6287c38 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:27.279818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5b079fd-22ab-444e-964a-4fdfa6287c38 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:27.420928 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6b976897-6abf-4590-8e70-d98bad0b885e tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "DELETE /compute/v2.1/images/ea6a4983-fb38-4966-89bb-24ae4b2888a2" status: 204 len: 0 microversion: 2.1 time: 0.503294 Oct 04 21:15:27.421529 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1231/2395] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:26 2022] DELETE /compute/v2.1/images/ea6a4983-fb38-4966-89bb-24ae4b2888a2 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:15:27.428713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-602e6544-82b8-4819-91b1-ab427efcad1f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:27.430368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-602e6544-82b8-4819-91b1-ab427efcad1f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:27.441472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-602e6544-82b8-4819-91b1-ab427efcad1f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:27.442405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-602e6544-82b8-4819-91b1-ab427efcad1f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:27.443461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-602e6544-82b8-4819-91b1-ab427efcad1f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:27.445971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-602e6544-82b8-4819-91b1-ab427efcad1f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:27.446645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-602e6544-82b8-4819-91b1-ab427efcad1f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:27.448322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-602e6544-82b8-4819-91b1-ab427efcad1f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:27.811593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f5b079fd-22ab-444e-964a-4fdfa6287c38 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:27.836369 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f5b079fd-22ab-444e-964a-4fdfa6287c38 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1324 microversion: 2.1 time: 0.593940 Oct 04 21:15:27.841717 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1165/2396] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:27 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1324 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:27.842397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-602e6544-82b8-4819-91b1-ab427efcad1f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb68f8fb49d492e8bfc6e37336d3801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b630636b36647f5837eda19552ddf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:27.843459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8fb97c50-699f-457c-a486-b8d99a5c648a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:27.844321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8fb97c50-699f-457c-a486-b8d99a5c648a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:27.850792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fb97c50-699f-457c-a486-b8d99a5c648a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:27.853358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fb97c50-699f-457c-a486-b8d99a5c648a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:27.855078 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-602e6544-82b8-4819-91b1-ab427efcad1f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 200 len: 1479 microversion: 2.1 time: 0.430567 Oct 04 21:15:27.857691 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1232/2397] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:27 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 1479 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:27.869359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-960646c2-c201-4873-99dc-585d89067f7c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:27.872005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-960646c2-c201-4873-99dc-585d89067f7c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:27.886184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-960646c2-c201-4873-99dc-585d89067f7c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:27.887953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-960646c2-c201-4873-99dc-585d89067f7c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:27.889939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-960646c2-c201-4873-99dc-585d89067f7c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:27.891240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-960646c2-c201-4873-99dc-585d89067f7c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:27.893515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-960646c2-c201-4873-99dc-585d89067f7c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:27.894855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-960646c2-c201-4873-99dc-585d89067f7c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:27.896417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fb97c50-699f-457c-a486-b8d99a5c648a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:27.897614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fb97c50-699f-457c-a486-b8d99a5c648a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:27.898965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fb97c50-699f-457c-a486-b8d99a5c648a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:27.901809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fb97c50-699f-457c-a486-b8d99a5c648a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:28.027476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-960646c2-c201-4873-99dc-585d89067f7c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:28.050978 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-960646c2-c201-4873-99dc-585d89067f7c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189" status: 200 len: 1274 microversion: 2.1 time: 0.189810 Oct 04 21:15:28.075714 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1233/2398] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:27 2022] GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 => generated 1274 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:28.083574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-da42e8b2-1c3f-4561-a3a1-9da49a3364a9 tempest-TenantUsagesNegativeTestJSON-830668619 tempest-TenantUsagesNegativeTestJSON-830668619-project-admin] Calling method '.version_select at 0x7f579457d700>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:28.090022 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-da42e8b2-1c3f-4561-a3a1-9da49a3364a9 tempest-TenantUsagesNegativeTestJSON-830668619 tempest-TenantUsagesNegativeTestJSON-830668619-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-da42e8b2-1c3f-4561-a3a1-9da49a3364a9 tempest-TenantUsagesNegativeTestJSON-830668619 tempest-TenantUsagesNegativeTestJSON-830668619-project-admin] Request method failure captured: Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-simple-tenant-usage/54bbe493ba9a4b6d867f8147f89561a1?start=2022-10-05T21%3A15%3A26.682961&end=2022-10-03T21%3A15%3A26.682961 HTTP/1.1 Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKJu7rEQjO5enmvO6xJyVb0DeNlSh9Sz3_0CqWcNjCy9Adaxh6R3lz6MpRKv0cCQXrUdv8uL-CNaY-YOBaRTqTWUEoX4MBEeB_JOvyDDPhDcnoLY3L_vG0_mJmlLopwrQmW6lo1nYaiLAjq56YICyZlk0kDYLbTc3GF9N0OYmLRHgss Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 55e255d430a344a28f8a4699d460528b Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-830668619 Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/55e255d430a344a28f8a4699d460528b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_55e255d430a344a28f8a4699d460528b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/55e255d430a344a28f8a4699d460528b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/55e255d430a344a28f8a4699d460528b"}]}] Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-830668619 Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 55e255d430a344a28f8a4699d460528b Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-830668619 Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TenantUsagesNegativeTestJSON-830668619-project-admin Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 7c53cfe54e0049179302db78da42b7b4 Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-830668619-project-admin Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid start time. The start time cannot occur after the end time. Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '54bbe493ba9a4b6d867f8147f89561a1'} Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 04 21:15:28.093488 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:28.098455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-da42e8b2-1c3f-4561-a3a1-9da49a3364a9 tempest-TenantUsagesNegativeTestJSON-830668619 tempest-TenantUsagesNegativeTestJSON-830668619-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:28.099492 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-da42e8b2-1c3f-4561-a3a1-9da49a3364a9 tempest-TenantUsagesNegativeTestJSON-830668619 tempest-TenantUsagesNegativeTestJSON-830668619-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/54bbe493ba9a4b6d867f8147f89561a1?start=2022-10-05T21%3A15%3A26.682961&end=2022-10-03T21%3A15%3A26.682961" status: 400 len: 111 microversion: 2.1 time: 0.022538 Oct 04 21:15:28.100235 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1234/2399] 10.222.0.30 () {58 vars in 1412 bytes} [Tue Oct 4 21:15:28 2022] GET /compute/v2.1/os-simple-tenant-usage/54bbe493ba9a4b6d867f8147f89561a1?start=2022-10-05T21%3A15%3A26.682961&end=2022-10-03T21%3A15%3A26.682961 => generated 111 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:15:28.113018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d67bfde2-6c8d-460d-8ebb-eea527d133c6 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f579444f940>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:28.150020 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-d67bfde2-6c8d-460d-8ebb-eea527d133c6 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] HTTP exception thrown: Image not found. Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d67bfde2-6c8d-460d-8ebb-eea527d133c6 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Request method failure captured: Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/images/ea6a4983-fb38-4966-89bb-24ae4b2888a2 HTTP/1.1 Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKFgIyEQCYxIE9SbF4xAACLsL_6kGzFdT0vP7AbAasqEePUmWKbUB9Q6-ErQ_Uxl9JQZmQcaZ1u2Bsa6SGB7QheXEhLwE8_6fP4EBpZz3RlmhZO_1_qXs10p7zeevKqiqBFBcSv1bZpCzKRHmhCvQV29kkHX9qWZ8_ayD8ygb8Hzw1I Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7462c68015654227a11892e2a2659ecb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7462c68015654227a11892e2a2659ecb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}] Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c199a13dceec4ae9bd873529c864146e Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: exception: Image not found. Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'ea6a4983-fb38-4966-89bb-24ae4b2888a2'} Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ea6a4983-fb38-4966-89bb-24ae4b2888a2 Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 21:15:28.186600 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ea6a4983-fb38-4966-89bb-24ae4b2888a2 could not be found. Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d67bfde2-6c8d-460d-8ebb-eea527d133c6 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Returning 404 to user: Image not found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:28.192875 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d67bfde2-6c8d-460d-8ebb-eea527d133c6 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/images/ea6a4983-fb38-4966-89bb-24ae4b2888a2" status: 404 len: 62 microversion: 2.1 time: 0.081280 Oct 04 21:15:28.199633 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1235/2400] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:15:28 2022] GET /compute/v2.1/images/ea6a4983-fb38-4966-89bb-24ae4b2888a2 => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:15:28.202925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bd747ae6-8ef1-468c-ace5-4c85abddf7ba tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:28.225140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bd747ae6-8ef1-468c-ace5-4c85abddf7ba tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:28.238117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd747ae6-8ef1-468c-ace5-4c85abddf7ba tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:28.238620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd747ae6-8ef1-468c-ace5-4c85abddf7ba tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:28.249909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd747ae6-8ef1-468c-ace5-4c85abddf7ba tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:28.255185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd747ae6-8ef1-468c-ace5-4c85abddf7ba tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:28.258178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd747ae6-8ef1-468c-ace5-4c85abddf7ba tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:28.265391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd747ae6-8ef1-468c-ace5-4c85abddf7ba tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:28.271807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8fb97c50-699f-457c-a486-b8d99a5c648a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:28.296333 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8fb97c50-699f-457c-a486-b8d99a5c648a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.455993 Oct 04 21:15:28.305668 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1166/2401] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:27 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:28.648930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bd747ae6-8ef1-468c-ace5-4c85abddf7ba tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:28.661695 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bd747ae6-8ef1-468c-ace5-4c85abddf7ba tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1369 microversion: 2.1 time: 0.461707 Oct 04 21:15:28.662624 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1236/2402] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:28 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1369 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:28.668663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-05d66691-0708-4a28-9e76-e38a920e5b36 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:28.669552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-05d66691-0708-4a28-9e76-e38a920e5b36 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:28.684775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05d66691-0708-4a28-9e76-e38a920e5b36 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:28.685271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05d66691-0708-4a28-9e76-e38a920e5b36 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:28.685733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05d66691-0708-4a28-9e76-e38a920e5b36 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:28.687784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05d66691-0708-4a28-9e76-e38a920e5b36 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:28.689856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05d66691-0708-4a28-9e76-e38a920e5b36 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:28.691286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05d66691-0708-4a28-9e76-e38a920e5b36 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:28.752815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-34033956-2c1f-403c-8f78-74b19671587d tempest-TenantUsagesNegativeTestJSON-38119078 tempest-TenantUsagesNegativeTestJSON-38119078-project] Calling method '.version_select at 0x7f57943b5af0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:28.760100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-34033956-2c1f-403c-8f78-74b19671587d tempest-TenantUsagesNegativeTestJSON-38119078 tempest-TenantUsagesNegativeTestJSON-38119078-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'd9a918c2fd7f461780b2323ccf950f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54bbe493ba9a4b6d867f8147f89561a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-34033956-2c1f-403c-8f78-74b19671587d tempest-TenantUsagesNegativeTestJSON-38119078 tempest-TenantUsagesNegativeTestJSON-38119078-project] Request method failure captured: Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T21%3A15%3A26.682961&end=2022-10-05T21%3A15%3A26.682961&detailed=1 HTTP/1.1 Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKJsVvzWnb5-UYUReZlUaZeytYCe5PylyqtmIzTF3Sf3X2uaWGDBOrxtqg48sCOtpJNU7nZ91_WBo6sNUF9TqpGTMcATSkl6oPXhcwYtdTFCnS4aw77HRYE23mI6-i5TtSuJFnHxkU8OmGzP-5_3rVCfwvXuc-ansfdoUIg4O6vnKTY Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 54bbe493ba9a4b6d867f8147f89561a1 Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-38119078 Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/54bbe493ba9a4b6d867f8147f89561a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_54bbe493ba9a4b6d867f8147f89561a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/54bbe493ba9a4b6d867f8147f89561a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/54bbe493ba9a4b6d867f8147f89561a1"}]}] Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-38119078 Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 54bbe493ba9a4b6d867f8147f89561a1 Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-38119078 Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TenantUsagesNegativeTestJSON-38119078-project Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: d9a918c2fd7f461780b2323ccf950f2e Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-38119078-project Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: action_args: {} Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 21:15:28.769745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 21:15:28.783433 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 21:15:28.783433 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:28.783433 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:28.783433 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:28.783433 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:28.783433 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:28.783433 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:28.783433 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 21:15:28.783433 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 21:15:28.783433 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 21:15:28.783433 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:28.783433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-34033956-2c1f-403c-8f78-74b19671587d tempest-TenantUsagesNegativeTestJSON-38119078 tempest-TenantUsagesNegativeTestJSON-38119078-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:28.783433 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-34033956-2c1f-403c-8f78-74b19671587d tempest-TenantUsagesNegativeTestJSON-38119078 tempest-TenantUsagesNegativeTestJSON-38119078-project] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T21%3A15%3A26.682961&end=2022-10-05T21%3A15%3A26.682961&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.473285 Oct 04 21:15:28.783433 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1167/2403] 10.222.0.30 () {58 vars in 1335 bytes} [Tue Oct 4 21:15:28 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T21%3A15%3A26.682961&end=2022-10-05T21%3A15%3A26.682961&detailed=1 => generated 123 bytes in 479 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:15:28.860647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-46df1c37-3dad-4b85-ab3a-3172be5e51e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:28.861367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-46df1c37-3dad-4b85-ab3a-3172be5e51e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:28.871542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46df1c37-3dad-4b85-ab3a-3172be5e51e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:28.872047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46df1c37-3dad-4b85-ab3a-3172be5e51e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:28.874057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46df1c37-3dad-4b85-ab3a-3172be5e51e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:28.878307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46df1c37-3dad-4b85-ab3a-3172be5e51e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:28.889969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46df1c37-3dad-4b85-ab3a-3172be5e51e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:28.890787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46df1c37-3dad-4b85-ab3a-3172be5e51e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:29.295392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-05d66691-0708-4a28-9e76-e38a920e5b36 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:29.316773 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-05d66691-0708-4a28-9e76-e38a920e5b36 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1507 microversion: 2.1 time: 0.651917 Oct 04 21:15:29.323245 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1237/2404] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:28 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1507 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:29.354610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fc82616f-ff28-4cda-8d74-534906cabc4e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:29.354610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fc82616f-ff28-4cda-8d74-534906cabc4e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:29.368585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc82616f-ff28-4cda-8d74-534906cabc4e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:29.369258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc82616f-ff28-4cda-8d74-534906cabc4e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:29.369662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc82616f-ff28-4cda-8d74-534906cabc4e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:29.375296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc82616f-ff28-4cda-8d74-534906cabc4e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:29.379693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc82616f-ff28-4cda-8d74-534906cabc4e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:29.380227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc82616f-ff28-4cda-8d74-534906cabc4e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:29.437114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-46df1c37-3dad-4b85-ab3a-3172be5e51e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:29.448272 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-46df1c37-3dad-4b85-ab3a-3172be5e51e8 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1324 microversion: 2.1 time: 0.588997 Oct 04 21:15:29.462444 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1168/2405] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:28 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1324 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:29.467368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ed9cf778-73f5-4312-a980-a208cdac6e9b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:29.468182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ed9cf778-73f5-4312-a980-a208cdac6e9b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:29.485764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:29.490760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed9cf778-73f5-4312-a980-a208cdac6e9b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:29.491541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed9cf778-73f5-4312-a980-a208cdac6e9b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:29.498442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed9cf778-73f5-4312-a980-a208cdac6e9b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:29.499709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed9cf778-73f5-4312-a980-a208cdac6e9b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:29.500609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed9cf778-73f5-4312-a980-a208cdac6e9b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:29.501238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed9cf778-73f5-4312-a980-a208cdac6e9b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:29.609255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fc82616f-ff28-4cda-8d74-534906cabc4e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb68f8fb49d492e8bfc6e37336d3801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b630636b36647f5837eda19552ddf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:29.618818 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fc82616f-ff28-4cda-8d74-534906cabc4e tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 200 len: 1437 microversion: 2.1 time: 0.293710 Oct 04 21:15:29.639860 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1238/2406] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:29 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 1437 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:29.655172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d3835996-84ac-4818-a149-c37ef8bb6fa9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:29.656036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d3835996-84ac-4818-a149-c37ef8bb6fa9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:29.666346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3835996-84ac-4818-a149-c37ef8bb6fa9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:29.667144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3835996-84ac-4818-a149-c37ef8bb6fa9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:29.670036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3835996-84ac-4818-a149-c37ef8bb6fa9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:29.670971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3835996-84ac-4818-a149-c37ef8bb6fa9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:29.671682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3835996-84ac-4818-a149-c37ef8bb6fa9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:29.672323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3835996-84ac-4818-a149-c37ef8bb6fa9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:29.777669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ed9cf778-73f5-4312-a980-a208cdac6e9b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:29.787365 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ed9cf778-73f5-4312-a980-a208cdac6e9b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189" status: 200 len: 1322 microversion: 2.1 time: 0.336577 Oct 04 21:15:29.793030 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1169/2407] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:29 2022] GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:29.798564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-ebe476fd-c643-4594-9db7-65324f82bd6a req-86e22a58-fe43-4e34-a211-984f941e7be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8895bf-11ae-42d3-9af7-c934522d7341", "name": "network-vif-deleted", "tag": "6a0d5822-3dd3-4808-99c8-03da86151a0a"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:29.834112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ebe476fd-c643-4594-9db7-65324f82bd6a req-86e22a58-fe43-4e34-a211-984f941e7be1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:29.838093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ebe476fd-c643-4594-9db7-65324f82bd6a req-86e22a58-fe43-4e34-a211-984f941e7be1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:29.838831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ebe476fd-c643-4594-9db7-65324f82bd6a req-86e22a58-fe43-4e34-a211-984f941e7be1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:29.860317 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-ebe476fd-c643-4594-9db7-65324f82bd6a req-86e22a58-fe43-4e34-a211-984f941e7be1 service nova] Creating event network-vif-deleted:6a0d5822-3dd3-4808-99c8-03da86151a0a for instance 4e8895bf-11ae-42d3-9af7-c934522d7341 on n-h2-860282-1 Oct 04 21:15:29.866289 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-ebe476fd-c643-4594-9db7-65324f82bd6a req-86e22a58-fe43-4e34-a211-984f941e7be1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071284 Oct 04 21:15:29.867320 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1170/2408] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:29.879836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-259b13cc-69bc-4a6c-a43e-fff30e4c9c5c tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:29.881056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-259b13cc-69bc-4a6c-a43e-fff30e4c9c5c tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:29.889556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-259b13cc-69bc-4a6c-a43e-fff30e4c9c5c tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:29.890357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-259b13cc-69bc-4a6c-a43e-fff30e4c9c5c tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:29.891125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-259b13cc-69bc-4a6c-a43e-fff30e4c9c5c tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:29.892209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-259b13cc-69bc-4a6c-a43e-fff30e4c9c5c tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:29.893014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-259b13cc-69bc-4a6c-a43e-fff30e4c9c5c tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:29.893761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-259b13cc-69bc-4a6c-a43e-fff30e4c9c5c tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:30.389047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d3835996-84ac-4818-a149-c37ef8bb6fa9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:30.399078 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d3835996-84ac-4818-a149-c37ef8bb6fa9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.757739 Oct 04 21:15:30.415092 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1239/2409] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:29 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:30.423116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-17de9636-b91b-4bb5-9716-2ba159e66094 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:30.424798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-17de9636-b91b-4bb5-9716-2ba159e66094 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:30.439288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17de9636-b91b-4bb5-9716-2ba159e66094 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:30.447949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17de9636-b91b-4bb5-9716-2ba159e66094 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:30.450198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17de9636-b91b-4bb5-9716-2ba159e66094 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:30.450985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17de9636-b91b-4bb5-9716-2ba159e66094 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:30.451448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17de9636-b91b-4bb5-9716-2ba159e66094 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:30.451957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17de9636-b91b-4bb5-9716-2ba159e66094 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:30.577463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-259b13cc-69bc-4a6c-a43e-fff30e4c9c5c tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:30.585874 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-259b13cc-69bc-4a6c-a43e-fff30e4c9c5c tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1369 microversion: 2.1 time: 0.716775 Oct 04 21:15:30.606769 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1171/2410] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:29 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1369 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:30.613652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-67b605ee-987d-4fd4-a8d0-d2119d579f13 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:30.615117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-67b605ee-987d-4fd4-a8d0-d2119d579f13 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:30.625078 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67b605ee-987d-4fd4-a8d0-d2119d579f13 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:30.626004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67b605ee-987d-4fd4-a8d0-d2119d579f13 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:30.629984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67b605ee-987d-4fd4-a8d0-d2119d579f13 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:30.631113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67b605ee-987d-4fd4-a8d0-d2119d579f13 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:30.631876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67b605ee-987d-4fd4-a8d0-d2119d579f13 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:30.633987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67b605ee-987d-4fd4-a8d0-d2119d579f13 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:31.033116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-67b605ee-987d-4fd4-a8d0-d2119d579f13 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:31.033745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-17de9636-b91b-4bb5-9716-2ba159e66094 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:31.053137 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-17de9636-b91b-4bb5-9716-2ba159e66094 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1502 microversion: 2.1 time: 0.641321 Oct 04 21:15:31.055102 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1240/2411] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:30 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1502 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:31.062053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cc8b6807-7a68-4e88-a186-0c597ba3f01f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:31.062942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cc8b6807-7a68-4e88-a186-0c597ba3f01f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:31.069905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc8b6807-7a68-4e88-a186-0c597ba3f01f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:31.071199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc8b6807-7a68-4e88-a186-0c597ba3f01f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:31.071401 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-67b605ee-987d-4fd4-a8d0-d2119d579f13 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1324 microversion: 2.1 time: 0.462855 Oct 04 21:15:31.072008 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1172/2412] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:30 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1324 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:31.085316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc8b6807-7a68-4e88-a186-0c597ba3f01f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:31.094407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1d484b0b-bf04-43a1-a596-445ba5419a98 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:31.098051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc8b6807-7a68-4e88-a186-0c597ba3f01f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:31.098901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1d484b0b-bf04-43a1-a596-445ba5419a98 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:31.106841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc8b6807-7a68-4e88-a186-0c597ba3f01f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:31.106841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc8b6807-7a68-4e88-a186-0c597ba3f01f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:31.123304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d484b0b-bf04-43a1-a596-445ba5419a98 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:31.126929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d484b0b-bf04-43a1-a596-445ba5419a98 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:31.135345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d484b0b-bf04-43a1-a596-445ba5419a98 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:31.135345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d484b0b-bf04-43a1-a596-445ba5419a98 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:31.135345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d484b0b-bf04-43a1-a596-445ba5419a98 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:31.135345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d484b0b-bf04-43a1-a596-445ba5419a98 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:31.171334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:31.187290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc8b6807-7a68-4e88-a186-0c597ba3f01f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:31.187290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc8b6807-7a68-4e88-a186-0c597ba3f01f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:31.187290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc8b6807-7a68-4e88-a186-0c597ba3f01f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:31.187290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-cc8b6807-7a68-4e88-a186-0c597ba3f01f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lazy-loading 'fault' on Instance uuid 4e8895bf-11ae-42d3-9af7-c934522d7341 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:15:31.389444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cc8b6807-7a68-4e88-a186-0c597ba3f01f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb68f8fb49d492e8bfc6e37336d3801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b630636b36647f5837eda19552ddf1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:31.392718 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cc8b6807-7a68-4e88-a186-0c597ba3f01f tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 200 len: 1313 microversion: 2.1 time: 0.335411 Oct 04 21:15:31.404740 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1241/2413] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:31 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:31.410233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-b6ddff8c-dcdc-4440-a8d3-3d0d04682e8b req-b67b832d-f33b-44bb-a57e-afb42c9c20ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e99ebe26-2264-4e7c-ac4e-6f8e0435b98d", "tag": "50ba1a2d-1433-4efe-9099-65de8ac34177"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:31.410985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1d484b0b-bf04-43a1-a596-445ba5419a98 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:31.421065 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1d484b0b-bf04-43a1-a596-445ba5419a98 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189" status: 200 len: 1328 microversion: 2.1 time: 0.346087 Oct 04 21:15:31.434674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b6ddff8c-dcdc-4440-a8d3-3d0d04682e8b req-b67b832d-f33b-44bb-a57e-afb42c9c20ad service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:31.438903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b6ddff8c-dcdc-4440-a8d3-3d0d04682e8b req-b67b832d-f33b-44bb-a57e-afb42c9c20ad service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:31.439379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b6ddff8c-dcdc-4440-a8d3-3d0d04682e8b req-b67b832d-f33b-44bb-a57e-afb42c9c20ad service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:31.449772 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1173/2414] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:31 2022] GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 => generated 1328 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:31.449772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bb149b59-5fe1-4f10-a4c7-d8b138a612ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:31.449772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bb149b59-5fe1-4f10-a4c7-d8b138a612ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:31.461874 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-b6ddff8c-dcdc-4440-a8d3-3d0d04682e8b req-b67b832d-f33b-44bb-a57e-afb42c9c20ad service nova] Creating event network-changed:50ba1a2d-1433-4efe-9099-65de8ac34177 for instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d on n-h1-860282-1 Oct 04 21:15:31.471822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb149b59-5fe1-4f10-a4c7-d8b138a612ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:31.472400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb149b59-5fe1-4f10-a4c7-d8b138a612ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:31.472879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb149b59-5fe1-4f10-a4c7-d8b138a612ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:31.473720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb149b59-5fe1-4f10-a4c7-d8b138a612ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:31.474253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb149b59-5fe1-4f10-a4c7-d8b138a612ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:31.474808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb149b59-5fe1-4f10-a4c7-d8b138a612ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:31.480735 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-b6ddff8c-dcdc-4440-a8d3-3d0d04682e8b req-b67b832d-f33b-44bb-a57e-afb42c9c20ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082935 Oct 04 21:15:31.482026 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1242/2415] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:31.628453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-47196b08-9df0-4064-b2e0-d4f6d77664ae tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:31.630110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-47196b08-9df0-4064-b2e0-d4f6d77664ae tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:31.640826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47196b08-9df0-4064-b2e0-d4f6d77664ae tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:31.655755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47196b08-9df0-4064-b2e0-d4f6d77664ae tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:31.655755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47196b08-9df0-4064-b2e0-d4f6d77664ae tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:31.655755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47196b08-9df0-4064-b2e0-d4f6d77664ae tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:31.655755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47196b08-9df0-4064-b2e0-d4f6d77664ae tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:31.655755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47196b08-9df0-4064-b2e0-d4f6d77664ae tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:31.948811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bb149b59-5fe1-4f10-a4c7-d8b138a612ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:31.962155 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bb149b59-5fe1-4f10-a4c7-d8b138a612ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.514995 Oct 04 21:15:31.966110 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1174/2416] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:31 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:32.083303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-da716bc4-df9e-4c3c-8536-946149c83785 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:32.084279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-da716bc4-df9e-4c3c-8536-946149c83785 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:32.115711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da716bc4-df9e-4c3c-8536-946149c83785 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:32.118351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da716bc4-df9e-4c3c-8536-946149c83785 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:32.122818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da716bc4-df9e-4c3c-8536-946149c83785 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:32.124922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da716bc4-df9e-4c3c-8536-946149c83785 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:32.127857 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da716bc4-df9e-4c3c-8536-946149c83785 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:32.128853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da716bc4-df9e-4c3c-8536-946149c83785 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:32.144706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-47196b08-9df0-4064-b2e0-d4f6d77664ae tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:32.162850 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-47196b08-9df0-4064-b2e0-d4f6d77664ae tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1369 microversion: 2.1 time: 0.540449 Oct 04 21:15:32.164273 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1243/2417] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:31 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1369 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:32.186952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-04b61268-5575-4fb5-a12d-90c62945c0d7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:32.186952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-04b61268-5575-4fb5-a12d-90c62945c0d7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:32.199688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04b61268-5575-4fb5-a12d-90c62945c0d7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:32.200203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04b61268-5575-4fb5-a12d-90c62945c0d7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:32.200651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04b61268-5575-4fb5-a12d-90c62945c0d7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:32.201654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04b61268-5575-4fb5-a12d-90c62945c0d7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:32.201851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04b61268-5575-4fb5-a12d-90c62945c0d7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:32.202279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04b61268-5575-4fb5-a12d-90c62945c0d7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:32.595563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-da716bc4-df9e-4c3c-8536-946149c83785 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:32.611657 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-da716bc4-df9e-4c3c-8536-946149c83785 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1489 microversion: 2.1 time: 0.530543 Oct 04 21:15:32.612941 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1175/2418] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:32 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1489 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:32.623967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8528b179-3c1f-4ddb-92ce-da2eca6a5e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:32.624973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8528b179-3c1f-4ddb-92ce-da2eca6a5e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] [instance: 4e8895bf-11ae-42d3-9af7-c934522d7341] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:32.643677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8528b179-3c1f-4ddb-92ce-da2eca6a5e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:32.644738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8528b179-3c1f-4ddb-92ce-da2eca6a5e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:32.645564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8528b179-3c1f-4ddb-92ce-da2eca6a5e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:32.646496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8528b179-3c1f-4ddb-92ce-da2eca6a5e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:32.648994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8528b179-3c1f-4ddb-92ce-da2eca6a5e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:32.649732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8528b179-3c1f-4ddb-92ce-da2eca6a5e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:32.671000 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-8528b179-3c1f-4ddb-92ce-da2eca6a5e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] HTTP exception thrown: Instance 4e8895bf-11ae-42d3-9af7-c934522d7341 could not be found. Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8528b179-3c1f-4ddb-92ce-da2eca6a5e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Request method failure captured: Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 HTTP/1.1 Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKJU5I0LkISQM2NnPSlhJ-ywke-xCeRYcvIPuOPHLsec3HNxnttWEt0H3gouBFHEPFQc6Dp3meQV46ooxPV_xGVBY1GxTolFjosAetLz7v48E9OtTdaLxmzvsqMmogRok0VeY-nWePDmHB2xQgHWtfxa8j-shkPqoz5QVH9ryEBB8e8 Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 7b630636b36647f5837eda19552ddf1b Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1269283838 Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b630636b36647f5837eda19552ddf1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7b630636b36647f5837eda19552ddf1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7b630636b36647f5837eda19552ddf1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b630636b36647f5837eda19552ddf1b"}]}] Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1269283838 Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 7b630636b36647f5837eda19552ddf1b Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1269283838 Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerDiagnosticsNegativeTest-1269283838-project Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 4bb68f8fb49d492e8bfc6e37336d3801 Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1269283838-project Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 4e8895bf-11ae-42d3-9af7-c934522d7341 could not be found. Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '4e8895bf-11ae-42d3-9af7-c934522d7341'} Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e8895bf-11ae-42d3-9af7-c934522d7341 could not be found. Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8895bf-11ae-42d3-9af7-c934522d7341 could not be found. Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:32.673336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:32.677838 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:32.677838 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:32.677838 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:32.677838 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:32.677838 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:32.677838 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:32.677838 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8895bf-11ae-42d3-9af7-c934522d7341 could not be found. Oct 04 21:15:32.677838 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:32.680269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8528b179-3c1f-4ddb-92ce-da2eca6a5e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] Returning 404 to user: Instance 4e8895bf-11ae-42d3-9af7-c934522d7341 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:32.682853 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8528b179-3c1f-4ddb-92ce-da2eca6a5e9a tempest-ServerDiagnosticsNegativeTest-1269283838 tempest-ServerDiagnosticsNegativeTest-1269283838-project] 10.222.0.30 "GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341" status: 404 len: 111 microversion: 2.1 time: 0.068231 Oct 04 21:15:32.683587 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1176/2419] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:32 2022] GET /compute/v2.1/servers/4e8895bf-11ae-42d3-9af7-c934522d7341 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:15:32.695575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-84c363ba-a9d1-4a88-ae99-ad1d3fec0d65 req-86055404-0c5d-4fa9-bc22-e8a4067dac14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93744ae-9a79-417e-9de4-8b0b1ae0e574", "name": "network-vif-plugged", "status": "completed", "tag": "128b6b0b-4e8b-49bc-9933-9e6bd6e543e8"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:32.696570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-04b61268-5575-4fb5-a12d-90c62945c0d7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:32.703115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-84c363ba-a9d1-4a88-ae99-ad1d3fec0d65 req-86055404-0c5d-4fa9-bc22-e8a4067dac14 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:32.703286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:32.704306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-84c363ba-a9d1-4a88-ae99-ad1d3fec0d65 req-86055404-0c5d-4fa9-bc22-e8a4067dac14 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:32.704986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-84c363ba-a9d1-4a88-ae99-ad1d3fec0d65 req-86055404-0c5d-4fa9-bc22-e8a4067dac14 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:32.706378 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-04b61268-5575-4fb5-a12d-90c62945c0d7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1324 microversion: 2.1 time: 0.539317 Oct 04 21:15:32.707301 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1244/2420] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:32 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1324 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:32.714111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e9dc13b0-8369-4b77-bc6f-dbc1541e6e89 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:32.714735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e9dc13b0-8369-4b77-bc6f-dbc1541e6e89 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:32.720457 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-84c363ba-a9d1-4a88-ae99-ad1d3fec0d65 req-86055404-0c5d-4fa9-bc22-e8a4067dac14 service nova] Creating event network-vif-plugged:128b6b0b-4e8b-49bc-9933-9e6bd6e543e8 for instance d93744ae-9a79-417e-9de4-8b0b1ae0e574 on n-h2-860282-1 Oct 04 21:15:32.727251 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-84c363ba-a9d1-4a88-ae99-ad1d3fec0d65 req-86055404-0c5d-4fa9-bc22-e8a4067dac14 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041283 Oct 04 21:15:32.728176 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1177/2421] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:32.731620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9dc13b0-8369-4b77-bc6f-dbc1541e6e89 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:32.732146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9dc13b0-8369-4b77-bc6f-dbc1541e6e89 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:32.732589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9dc13b0-8369-4b77-bc6f-dbc1541e6e89 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:32.734691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ca973047-1467-4f4a-a2dc-be9a48f5d777 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:32.735282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ca973047-1467-4f4a-a2dc-be9a48f5d777 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:32.735618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9dc13b0-8369-4b77-bc6f-dbc1541e6e89 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:32.736143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9dc13b0-8369-4b77-bc6f-dbc1541e6e89 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:32.736592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9dc13b0-8369-4b77-bc6f-dbc1541e6e89 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:32.743614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ca973047-1467-4f4a-a2dc-be9a48f5d777 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:32.744233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ca973047-1467-4f4a-a2dc-be9a48f5d777 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:32.744787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ca973047-1467-4f4a-a2dc-be9a48f5d777 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:32.745530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ca973047-1467-4f4a-a2dc-be9a48f5d777 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:32.746185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ca973047-1467-4f4a-a2dc-be9a48f5d777 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:32.746844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ca973047-1467-4f4a-a2dc-be9a48f5d777 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:32.797124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ca973047-1467-4f4a-a2dc-be9a48f5d777 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:15:32.801610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:32.965411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e9dc13b0-8369-4b77-bc6f-dbc1541e6e89 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:32.973711 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e9dc13b0-8369-4b77-bc6f-dbc1541e6e89 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189" status: 200 len: 1396 microversion: 2.1 time: 0.265245 Oct 04 21:15:32.974404 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1245/2422] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:32 2022] GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 => generated 1396 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:32.990516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-92ded129-ca22-405c-883e-9c03e14d2f3c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:32.991408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-92ded129-ca22-405c-883e-9c03e14d2f3c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:32.998566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92ded129-ca22-405c-883e-9c03e14d2f3c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:32.999061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92ded129-ca22-405c-883e-9c03e14d2f3c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:32.999551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92ded129-ca22-405c-883e-9c03e14d2f3c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:33.000281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92ded129-ca22-405c-883e-9c03e14d2f3c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:33.000722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92ded129-ca22-405c-883e-9c03e14d2f3c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:33.001155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92ded129-ca22-405c-883e-9c03e14d2f3c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:33.145656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-92ded129-ca22-405c-883e-9c03e14d2f3c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:33.154123 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-92ded129-ca22-405c-883e-9c03e14d2f3c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.167514 Oct 04 21:15:33.154948 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1246/2423] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:32 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:33.197489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a4e049db-f48f-48d2-9283-8e0e8e0195f8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:33.198232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a4e049db-f48f-48d2-9283-8e0e8e0195f8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:33.206094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4e049db-f48f-48d2-9283-8e0e8e0195f8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:33.206638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4e049db-f48f-48d2-9283-8e0e8e0195f8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:33.207118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4e049db-f48f-48d2-9283-8e0e8e0195f8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:33.211887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4e049db-f48f-48d2-9283-8e0e8e0195f8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:33.213077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4e049db-f48f-48d2-9283-8e0e8e0195f8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:33.213554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4e049db-f48f-48d2-9283-8e0e8e0195f8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:33.272980 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ca973047-1467-4f4a-a2dc-be9a48f5d777 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 204 len: 0 microversion: 2.1 time: 0.543300 Oct 04 21:15:33.274802 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1178/2424] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:15:32 2022] DELETE /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:15:33.286608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0054a46d-b5b6-426f-b70a-2a73f0f6099b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f578b9c4820>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:33.373140 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-0054a46d-b5b6-426f-b70a-2a73f0f6099b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] HTTP exception thrown: Image not found. Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0054a46d-b5b6-426f-b70a-2a73f0f6099b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Request method failure captured: Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/images/ea6a4983-fb38-4966-89bb-24ae4b2888a2 HTTP/1.1 Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKFgIyEQCYxIE9SbF4xAACLsL_6kGzFdT0vP7AbAasqEePUmWKbUB9Q6-ErQ_Uxl9JQZmQcaZ1u2Bsa6SGB7QheXEhLwE8_6fP4EBpZz3RlmhZO_1_qXs10p7zeevKqiqBFBcSv1bZpCzKRHmhCvQV29kkHX9qWZ8_ayD8ygb8Hzw1I Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7462c68015654227a11892e2a2659ecb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7462c68015654227a11892e2a2659ecb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}] Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c199a13dceec4ae9bd873529c864146e Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: exception: Image not found. Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'ea6a4983-fb38-4966-89bb-24ae4b2888a2'} Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ea6a4983-fb38-4966-89bb-24ae4b2888a2 to delete Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ea6a4983-fb38-4966-89bb-24ae4b2888a2 could not be found. Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:33.378745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0054a46d-b5b6-426f-b70a-2a73f0f6099b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Returning 404 to user: Image not found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:33.389557 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0054a46d-b5b6-426f-b70a-2a73f0f6099b tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "DELETE /compute/v2.1/images/ea6a4983-fb38-4966-89bb-24ae4b2888a2" status: 404 len: 62 microversion: 2.1 time: 0.098505 Oct 04 21:15:33.393781 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1179/2425] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:33 2022] DELETE /compute/v2.1/images/ea6a4983-fb38-4966-89bb-24ae4b2888a2 => generated 62 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 21:15:33.401637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b1bb9da1-06e7-485c-8e06-024ccfa7aee8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:33.408647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b1bb9da1-06e7-485c-8e06-024ccfa7aee8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:33.424265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1bb9da1-06e7-485c-8e06-024ccfa7aee8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:33.424776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1bb9da1-06e7-485c-8e06-024ccfa7aee8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:33.427193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1bb9da1-06e7-485c-8e06-024ccfa7aee8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:33.427992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1bb9da1-06e7-485c-8e06-024ccfa7aee8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:33.428511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1bb9da1-06e7-485c-8e06-024ccfa7aee8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:33.428945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1bb9da1-06e7-485c-8e06-024ccfa7aee8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:33.502602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b1bb9da1-06e7-485c-8e06-024ccfa7aee8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:15:33.619084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a4e049db-f48f-48d2-9283-8e0e8e0195f8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:33.637939 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a4e049db-f48f-48d2-9283-8e0e8e0195f8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1369 microversion: 2.1 time: 0.447064 Oct 04 21:15:33.639924 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1247/2426] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:33 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1369 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:33.692063 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.compute.api [None req-b1bb9da1-06e7-485c-8e06-024ccfa7aee8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Instance is already in deleting state, ignoring this request Oct 04 21:15:33.694285 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b1bb9da1-06e7-485c-8e06-024ccfa7aee8 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 204 len: 0 microversion: 2.1 time: 0.299007 Oct 04 21:15:33.699660 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1180/2427] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:15:33 2022] DELETE /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:15:33.704455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2153b754-e6c2-4c10-bef8-7c160cf4ba55 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:33.705228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2153b754-e6c2-4c10-bef8-7c160cf4ba55 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:33.716744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2153b754-e6c2-4c10-bef8-7c160cf4ba55 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:33.721010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2153b754-e6c2-4c10-bef8-7c160cf4ba55 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:33.721601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2153b754-e6c2-4c10-bef8-7c160cf4ba55 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:33.722429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2153b754-e6c2-4c10-bef8-7c160cf4ba55 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:33.722980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2153b754-e6c2-4c10-bef8-7c160cf4ba55 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:33.723474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2153b754-e6c2-4c10-bef8-7c160cf4ba55 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:33.732994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8d529c7a-a60e-46f6-846c-106c1fd7d0af tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:33.733751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8d529c7a-a60e-46f6-846c-106c1fd7d0af tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:33.743906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d529c7a-a60e-46f6-846c-106c1fd7d0af tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:33.744797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d529c7a-a60e-46f6-846c-106c1fd7d0af tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:33.745470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d529c7a-a60e-46f6-846c-106c1fd7d0af tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:33.746740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d529c7a-a60e-46f6-846c-106c1fd7d0af tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:33.747411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d529c7a-a60e-46f6-846c-106c1fd7d0af tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:33.748177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d529c7a-a60e-46f6-846c-106c1fd7d0af tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:34.301661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8d529c7a-a60e-46f6-846c-106c1fd7d0af tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:34.313401 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8d529c7a-a60e-46f6-846c-106c1fd7d0af tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1324 microversion: 2.1 time: 0.584669 Oct 04 21:15:34.314551 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1181/2428] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:33 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1324 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:34.319797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2153b754-e6c2-4c10-bef8-7c160cf4ba55 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:34.321725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ff89af40-b7de-4a68-ac9b-ecc5afa73cce tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:34.322602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ff89af40-b7de-4a68-ac9b-ecc5afa73cce tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:34.331419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff89af40-b7de-4a68-ac9b-ecc5afa73cce tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:34.331638 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2153b754-e6c2-4c10-bef8-7c160cf4ba55 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1495 microversion: 2.1 time: 0.630806 Oct 04 21:15:34.332192 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1248/2429] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:33 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1495 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:34.332712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff89af40-b7de-4a68-ac9b-ecc5afa73cce tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:34.333349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff89af40-b7de-4a68-ac9b-ecc5afa73cce tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:34.334222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff89af40-b7de-4a68-ac9b-ecc5afa73cce tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:34.334790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff89af40-b7de-4a68-ac9b-ecc5afa73cce tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:34.335321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff89af40-b7de-4a68-ac9b-ecc5afa73cce tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:34.339472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fc076731-2b61-490b-9fd9-efa3bf52ad8e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:34.340763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fc076731-2b61-490b-9fd9-efa3bf52ad8e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:34.347694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc076731-2b61-490b-9fd9-efa3bf52ad8e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:34.348463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc076731-2b61-490b-9fd9-efa3bf52ad8e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:34.349256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc076731-2b61-490b-9fd9-efa3bf52ad8e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:34.350185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc076731-2b61-490b-9fd9-efa3bf52ad8e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:34.350645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc076731-2b61-490b-9fd9-efa3bf52ad8e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:34.351075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc076731-2b61-490b-9fd9-efa3bf52ad8e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:34.741200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=12 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:35.020479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ff89af40-b7de-4a68-ac9b-ecc5afa73cce tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:35.035688 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ff89af40-b7de-4a68-ac9b-ecc5afa73cce tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189" status: 200 len: 1396 microversion: 2.1 time: 0.717168 Oct 04 21:15:35.036785 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1182/2430] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:34 2022] GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 => generated 1396 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:35.050358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fc076731-2b61-490b-9fd9-efa3bf52ad8e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:35.060106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5518405a-297d-42df-830e-38553fa8bbca tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:35.060645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5518405a-297d-42df-830e-38553fa8bbca tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:35.064451 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fc076731-2b61-490b-9fd9-efa3bf52ad8e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.730757 Oct 04 21:15:35.070731 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1249/2431] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:34 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:35.099485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-4785eec0-ad1f-46f4-8acc-e7561bdc4a91 req-cc04501b-d416-4238-b7af-56dd0b9ec2bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93744ae-9a79-417e-9de4-8b0b1ae0e574", "name": "network-vif-unplugged", "status": "completed", "tag": "128b6b0b-4e8b-49bc-9933-9e6bd6e543e8"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:35.100233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5518405a-297d-42df-830e-38553fa8bbca tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:35.100745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5518405a-297d-42df-830e-38553fa8bbca tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:35.101191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5518405a-297d-42df-830e-38553fa8bbca tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:35.102313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5518405a-297d-42df-830e-38553fa8bbca tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:35.102820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5518405a-297d-42df-830e-38553fa8bbca tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:35.109695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5518405a-297d-42df-830e-38553fa8bbca tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:35.119655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4785eec0-ad1f-46f4-8acc-e7561bdc4a91 req-cc04501b-d416-4238-b7af-56dd0b9ec2bc service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:35.122648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4785eec0-ad1f-46f4-8acc-e7561bdc4a91 req-cc04501b-d416-4238-b7af-56dd0b9ec2bc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:35.124113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4785eec0-ad1f-46f4-8acc-e7561bdc4a91 req-cc04501b-d416-4238-b7af-56dd0b9ec2bc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:35.155452 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-4785eec0-ad1f-46f4-8acc-e7561bdc4a91 req-cc04501b-d416-4238-b7af-56dd0b9ec2bc service nova] Creating event network-vif-unplugged:128b6b0b-4e8b-49bc-9933-9e6bd6e543e8 for instance d93744ae-9a79-417e-9de4-8b0b1ae0e574 on n-h2-860282-1 Oct 04 21:15:35.167715 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-4785eec0-ad1f-46f4-8acc-e7561bdc4a91 req-cc04501b-d416-4238-b7af-56dd0b9ec2bc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098921 Oct 04 21:15:35.168330 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1250/2432] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:35.326435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=9 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:35.346167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-f459a1ca-6b10-483f-a296-f4cc1ac9c73a req-4245f03d-fad9-4fe4-981a-fca0ddf10ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7141667-2475-4be1-9296-ad67dbd94189", "tag": "a62cebb4-a5f0-4b37-aa2d-9adf1cdf2efb"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:35.365079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f459a1ca-6b10-483f-a296-f4cc1ac9c73a req-4245f03d-fad9-4fe4-981a-fca0ddf10ce7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:35.365836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f459a1ca-6b10-483f-a296-f4cc1ac9c73a req-4245f03d-fad9-4fe4-981a-fca0ddf10ce7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:35.366634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f459a1ca-6b10-483f-a296-f4cc1ac9c73a req-4245f03d-fad9-4fe4-981a-fca0ddf10ce7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:35.384532 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-f459a1ca-6b10-483f-a296-f4cc1ac9c73a req-4245f03d-fad9-4fe4-981a-fca0ddf10ce7 service nova] Creating event network-changed:a62cebb4-a5f0-4b37-aa2d-9adf1cdf2efb for instance e7141667-2475-4be1-9296-ad67dbd94189 on n-h2-860282-1 Oct 04 21:15:35.407779 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-f459a1ca-6b10-483f-a296-f4cc1ac9c73a req-4245f03d-fad9-4fe4-981a-fca0ddf10ce7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071683 Oct 04 21:15:35.408413 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1251/2433] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:35.429545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f6f3bfe6-4472-4f66-8587-fbf998daf9ec tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:35.430278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f6f3bfe6-4472-4f66-8587-fbf998daf9ec tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:35.473611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6f3bfe6-4472-4f66-8587-fbf998daf9ec tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:35.475234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6f3bfe6-4472-4f66-8587-fbf998daf9ec tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:35.475494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5518405a-297d-42df-830e-38553fa8bbca tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:35.478203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6f3bfe6-4472-4f66-8587-fbf998daf9ec tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:35.479286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6f3bfe6-4472-4f66-8587-fbf998daf9ec tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:35.481807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6f3bfe6-4472-4f66-8587-fbf998daf9ec tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:35.484037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6f3bfe6-4472-4f66-8587-fbf998daf9ec tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:35.485929 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5518405a-297d-42df-830e-38553fa8bbca tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1369 microversion: 2.1 time: 0.448128 Oct 04 21:15:35.486576 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1183/2434] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:35 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1369 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:35.499724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-951b8afb-5b7f-4f2b-b9d9-1d4725b6abf2 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:35.504227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-951b8afb-5b7f-4f2b-b9d9-1d4725b6abf2 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:35.517027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-951b8afb-5b7f-4f2b-b9d9-1d4725b6abf2 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:35.517818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-951b8afb-5b7f-4f2b-b9d9-1d4725b6abf2 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:35.518480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-951b8afb-5b7f-4f2b-b9d9-1d4725b6abf2 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:35.519447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-951b8afb-5b7f-4f2b-b9d9-1d4725b6abf2 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:35.520053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-951b8afb-5b7f-4f2b-b9d9-1d4725b6abf2 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:35.520627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-951b8afb-5b7f-4f2b-b9d9-1d4725b6abf2 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:35.883438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-951b8afb-5b7f-4f2b-b9d9-1d4725b6abf2 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:35.893089 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-951b8afb-5b7f-4f2b-b9d9-1d4725b6abf2 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1495 microversion: 2.1 time: 0.402769 Oct 04 21:15:35.894086 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1184/2435] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:35 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1495 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:35.968281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f6f3bfe6-4472-4f66-8587-fbf998daf9ec tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:35.976070 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f6f3bfe6-4472-4f66-8587-fbf998daf9ec tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1324 microversion: 2.1 time: 0.566472 Oct 04 21:15:35.977035 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1252/2436] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:35 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1324 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:36.063128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bb09791e-75bc-41ae-a6a4-90540cadbf79 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:36.065953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bb09791e-75bc-41ae-a6a4-90540cadbf79 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:36.075749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb09791e-75bc-41ae-a6a4-90540cadbf79 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:36.077726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb09791e-75bc-41ae-a6a4-90540cadbf79 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:36.078293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb09791e-75bc-41ae-a6a4-90540cadbf79 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:36.081768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb09791e-75bc-41ae-a6a4-90540cadbf79 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:36.082397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb09791e-75bc-41ae-a6a4-90540cadbf79 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:36.082949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb09791e-75bc-41ae-a6a4-90540cadbf79 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:36.098928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8a3a64ec-217e-4884-986d-891037d8ff0d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:36.099628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8a3a64ec-217e-4884-986d-891037d8ff0d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:36.112249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=7 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:36.122390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a3a64ec-217e-4884-986d-891037d8ff0d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:36.123596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a3a64ec-217e-4884-986d-891037d8ff0d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:36.124186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a3a64ec-217e-4884-986d-891037d8ff0d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:36.130859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a3a64ec-217e-4884-986d-891037d8ff0d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:36.134138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a3a64ec-217e-4884-986d-891037d8ff0d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:36.136843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a3a64ec-217e-4884-986d-891037d8ff0d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:36.739721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bb09791e-75bc-41ae-a6a4-90540cadbf79 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:36.748163 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bb09791e-75bc-41ae-a6a4-90540cadbf79 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189" status: 200 len: 1396 microversion: 2.1 time: 0.689445 Oct 04 21:15:36.748734 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1185/2437] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:36 2022] GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 => generated 1396 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:36.753448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3382a953-ca2f-4137-911f-a3c5de262144 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:36.754247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3382a953-ca2f-4137-911f-a3c5de262144 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:36.762997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3382a953-ca2f-4137-911f-a3c5de262144 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:36.763714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8a3a64ec-217e-4884-986d-891037d8ff0d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:36.763896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3382a953-ca2f-4137-911f-a3c5de262144 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:36.764462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3382a953-ca2f-4137-911f-a3c5de262144 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:36.765326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3382a953-ca2f-4137-911f-a3c5de262144 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:36.765953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3382a953-ca2f-4137-911f-a3c5de262144 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:36.766379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3382a953-ca2f-4137-911f-a3c5de262144 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:36.776689 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8a3a64ec-217e-4884-986d-891037d8ff0d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.682930 Oct 04 21:15:36.777412 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1253/2438] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:36 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:36.923661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f2497036-02ad-4db2-a970-63450d5f6b28 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:36.924280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f2497036-02ad-4db2-a970-63450d5f6b28 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:36.931014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2497036-02ad-4db2-a970-63450d5f6b28 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:36.931962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2497036-02ad-4db2-a970-63450d5f6b28 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:36.932394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2497036-02ad-4db2-a970-63450d5f6b28 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:36.933251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2497036-02ad-4db2-a970-63450d5f6b28 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:36.933871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2497036-02ad-4db2-a970-63450d5f6b28 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:36.934442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2497036-02ad-4db2-a970-63450d5f6b28 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:37.026764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3382a953-ca2f-4137-911f-a3c5de262144 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:37.037191 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3382a953-ca2f-4137-911f-a3c5de262144 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1369 microversion: 2.1 time: 0.285338 Oct 04 21:15:37.037191 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1186/2439] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:36 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1369 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:37.047315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d9b78250-f71b-4dee-bbbe-ce9560ad6a91 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:37.048478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d9b78250-f71b-4dee-bbbe-ce9560ad6a91 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:37.056049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9b78250-f71b-4dee-bbbe-ce9560ad6a91 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:37.056807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9b78250-f71b-4dee-bbbe-ce9560ad6a91 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:37.057284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9b78250-f71b-4dee-bbbe-ce9560ad6a91 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:37.058040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9b78250-f71b-4dee-bbbe-ce9560ad6a91 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:37.058798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9b78250-f71b-4dee-bbbe-ce9560ad6a91 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:37.059244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9b78250-f71b-4dee-bbbe-ce9560ad6a91 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:37.074518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f2497036-02ad-4db2-a970-63450d5f6b28 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:37.089604 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f2497036-02ad-4db2-a970-63450d5f6b28 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1293 microversion: 2.1 time: 0.169638 Oct 04 21:15:37.097806 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1254/2440] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:36 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1293 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:37.330921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d9b78250-f71b-4dee-bbbe-ce9560ad6a91 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:37.346744 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d9b78250-f71b-4dee-bbbe-ce9560ad6a91 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1324 microversion: 2.1 time: 0.309449 Oct 04 21:15:37.348586 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1187/2441] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:37 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1324 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:37.432998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-167ba236-1efd-4e87-bcbd-5371175ca2ae req-46b3f225-b13f-4f07-b440-35b71d6b9098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93744ae-9a79-417e-9de4-8b0b1ae0e574", "name": "network-vif-deleted", "tag": "128b6b0b-4e8b-49bc-9933-9e6bd6e543e8"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:37.446634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-167ba236-1efd-4e87-bcbd-5371175ca2ae req-46b3f225-b13f-4f07-b440-35b71d6b9098 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:37.450445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-167ba236-1efd-4e87-bcbd-5371175ca2ae req-46b3f225-b13f-4f07-b440-35b71d6b9098 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:37.450445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-167ba236-1efd-4e87-bcbd-5371175ca2ae req-46b3f225-b13f-4f07-b440-35b71d6b9098 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:37.462348 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-167ba236-1efd-4e87-bcbd-5371175ca2ae req-46b3f225-b13f-4f07-b440-35b71d6b9098 service nova] Creating event network-vif-deleted:128b6b0b-4e8b-49bc-9933-9e6bd6e543e8 for instance d93744ae-9a79-417e-9de4-8b0b1ae0e574 on n-h2-860282-1 Oct 04 21:15:37.467253 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-167ba236-1efd-4e87-bcbd-5371175ca2ae req-46b3f225-b13f-4f07-b440-35b71d6b9098 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040056 Oct 04 21:15:37.467890 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1255/2442] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:37.773083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-171b1738-9c4b-46bd-981a-4e23cecc61c4 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:37.773959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-171b1738-9c4b-46bd-981a-4e23cecc61c4 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:37.780992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-171b1738-9c4b-46bd-981a-4e23cecc61c4 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:37.781992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-171b1738-9c4b-46bd-981a-4e23cecc61c4 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:37.782784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-171b1738-9c4b-46bd-981a-4e23cecc61c4 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:37.783757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-171b1738-9c4b-46bd-981a-4e23cecc61c4 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:37.784352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-171b1738-9c4b-46bd-981a-4e23cecc61c4 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:37.784857 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-171b1738-9c4b-46bd-981a-4e23cecc61c4 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:37.801601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-73dd0acf-e991-461f-9902-a818e13c0e11 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:37.802274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-73dd0acf-e991-461f-9902-a818e13c0e11 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:37.811552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73dd0acf-e991-461f-9902-a818e13c0e11 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:37.812281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73dd0acf-e991-461f-9902-a818e13c0e11 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:37.812908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73dd0acf-e991-461f-9902-a818e13c0e11 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:37.813821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73dd0acf-e991-461f-9902-a818e13c0e11 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:37.814280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73dd0acf-e991-461f-9902-a818e13c0e11 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:37.814710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73dd0acf-e991-461f-9902-a818e13c0e11 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:37.999737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-171b1738-9c4b-46bd-981a-4e23cecc61c4 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:38.003853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-73dd0acf-e991-461f-9902-a818e13c0e11 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:38.008947 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-171b1738-9c4b-46bd-981a-4e23cecc61c4 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189" status: 200 len: 1396 microversion: 2.1 time: 0.239695 Oct 04 21:15:38.011024 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1188/2443] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:37 2022] GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 => generated 1396 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:38.012100 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-73dd0acf-e991-461f-9902-a818e13c0e11 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.216813 Oct 04 21:15:38.012676 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1256/2444] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:37 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:38.062891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0dc9dd4c-e42c-4f87-9dc3-a004430db88a tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:38.064012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0dc9dd4c-e42c-4f87-9dc3-a004430db88a tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:38.071670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0dc9dd4c-e42c-4f87-9dc3-a004430db88a tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:38.072497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0dc9dd4c-e42c-4f87-9dc3-a004430db88a tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:38.073109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0dc9dd4c-e42c-4f87-9dc3-a004430db88a tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:38.074003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0dc9dd4c-e42c-4f87-9dc3-a004430db88a tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:38.074628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0dc9dd4c-e42c-4f87-9dc3-a004430db88a tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:38.075379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0dc9dd4c-e42c-4f87-9dc3-a004430db88a tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:38.095202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-10115753-32c0-4f18-8964-1ad4f914b477 req-07eb337c-598b-4e8c-952e-d7e2d688e5ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e99ebe26-2264-4e7c-ac4e-6f8e0435b98d", "name": "network-vif-plugged", "status": "completed", "tag": "50ba1a2d-1433-4efe-9099-65de8ac34177"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:38.110762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-10115753-32c0-4f18-8964-1ad4f914b477 req-07eb337c-598b-4e8c-952e-d7e2d688e5ee service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:38.112192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-10115753-32c0-4f18-8964-1ad4f914b477 req-07eb337c-598b-4e8c-952e-d7e2d688e5ee service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:38.112644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-10115753-32c0-4f18-8964-1ad4f914b477 req-07eb337c-598b-4e8c-952e-d7e2d688e5ee service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:38.127388 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-10115753-32c0-4f18-8964-1ad4f914b477 req-07eb337c-598b-4e8c-952e-d7e2d688e5ee service nova] Creating event network-vif-plugged:50ba1a2d-1433-4efe-9099-65de8ac34177 for instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d on n-h1-860282-1 Oct 04 21:15:38.135287 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-10115753-32c0-4f18-8964-1ad4f914b477 req-07eb337c-598b-4e8c-952e-d7e2d688e5ee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044937 Oct 04 21:15:38.137072 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1257/2445] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:15:38.143015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5eb5060c-759f-4941-8a71-81e9d600b590 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:38.143806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5eb5060c-759f-4941-8a71-81e9d600b590 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:38.152979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5eb5060c-759f-4941-8a71-81e9d600b590 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:38.154385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5eb5060c-759f-4941-8a71-81e9d600b590 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:38.154832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5eb5060c-759f-4941-8a71-81e9d600b590 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:38.155757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5eb5060c-759f-4941-8a71-81e9d600b590 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:38.156368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5eb5060c-759f-4941-8a71-81e9d600b590 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:38.157078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5eb5060c-759f-4941-8a71-81e9d600b590 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:38.207510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5eb5060c-759f-4941-8a71-81e9d600b590 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:38.208823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5eb5060c-759f-4941-8a71-81e9d600b590 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:38.209081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5eb5060c-759f-4941-8a71-81e9d600b590 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:38.210248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-5eb5060c-759f-4941-8a71-81e9d600b590 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lazy-loading 'fault' on Instance uuid d93744ae-9a79-417e-9de4-8b0b1ae0e574 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:15:38.289372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5eb5060c-759f-4941-8a71-81e9d600b590 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c199a13dceec4ae9bd873529c864146e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7462c68015654227a11892e2a2659ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:38.299542 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5eb5060c-759f-4941-8a71-81e9d600b590 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 200 len: 1298 microversion: 2.1 time: 0.161158 Oct 04 21:15:38.300951 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1258/2446] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:38 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 1298 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:38.329800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0dc9dd4c-e42c-4f87-9dc3-a004430db88a tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:38.340880 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0dc9dd4c-e42c-4f87-9dc3-a004430db88a tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1369 microversion: 2.1 time: 0.284498 Oct 04 21:15:38.342922 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1189/2447] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:38 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1369 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:38.373855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-526b2244-2112-4f93-9f2a-e684116a9cf0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:38.374762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-526b2244-2112-4f93-9f2a-e684116a9cf0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:38.383413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-526b2244-2112-4f93-9f2a-e684116a9cf0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:38.383911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-526b2244-2112-4f93-9f2a-e684116a9cf0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:38.384358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-526b2244-2112-4f93-9f2a-e684116a9cf0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:38.385061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-526b2244-2112-4f93-9f2a-e684116a9cf0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:38.385722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-526b2244-2112-4f93-9f2a-e684116a9cf0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:38.386307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-526b2244-2112-4f93-9f2a-e684116a9cf0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:38.546448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-526b2244-2112-4f93-9f2a-e684116a9cf0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:38.555619 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-526b2244-2112-4f93-9f2a-e684116a9cf0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1324 microversion: 2.1 time: 0.186205 Oct 04 21:15:38.556527 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1259/2448] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:38 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1324 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:39.039523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b4415604-2e0b-4fe1-bcfc-ef69b80d1f83 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.042531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-398cb74c-14a0-44b3-b513-cc936e822051 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.043149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-398cb74c-14a0-44b3-b513-cc936e822051 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:39.044917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b4415604-2e0b-4fe1-bcfc-ef69b80d1f83 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:39.057027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b4415604-2e0b-4fe1-bcfc-ef69b80d1f83 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.059332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b4415604-2e0b-4fe1-bcfc-ef69b80d1f83 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.059332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b4415604-2e0b-4fe1-bcfc-ef69b80d1f83 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.059825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-398cb74c-14a0-44b3-b513-cc936e822051 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.060322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-398cb74c-14a0-44b3-b513-cc936e822051 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.060762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-398cb74c-14a0-44b3-b513-cc936e822051 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.061926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-398cb74c-14a0-44b3-b513-cc936e822051 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.062058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b4415604-2e0b-4fe1-bcfc-ef69b80d1f83 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.062476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b4415604-2e0b-4fe1-bcfc-ef69b80d1f83 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.062909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b4415604-2e0b-4fe1-bcfc-ef69b80d1f83 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.065161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-398cb74c-14a0-44b3-b513-cc936e822051 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.071368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-398cb74c-14a0-44b3-b513-cc936e822051 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.306372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-398cb74c-14a0-44b3-b513-cc936e822051 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:39.322074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b4415604-2e0b-4fe1-bcfc-ef69b80d1f83 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:39.326098 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-398cb74c-14a0-44b3-b513-cc936e822051 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.287835 Oct 04 21:15:39.331199 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b4415604-2e0b-4fe1-bcfc-ef69b80d1f83 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189" status: 200 len: 1396 microversion: 2.1 time: 0.299664 Oct 04 21:15:39.342721 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1260/2449] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:39 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:39.345909 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1190/2450] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:39 2022] GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 => generated 1396 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:39.349362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-904b56c5-381c-4e99-b9d2-3c7effb8b232 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.357336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-904b56c5-381c-4e99-b9d2-3c7effb8b232 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: d93744ae-9a79-417e-9de4-8b0b1ae0e574] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:39.363715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-904b56c5-381c-4e99-b9d2-3c7effb8b232 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.364213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-904b56c5-381c-4e99-b9d2-3c7effb8b232 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.364661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-904b56c5-381c-4e99-b9d2-3c7effb8b232 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.365297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8f03921e-c616-4df8-b856-6953c01f6622 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.365437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-904b56c5-381c-4e99-b9d2-3c7effb8b232 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.365840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-904b56c5-381c-4e99-b9d2-3c7effb8b232 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.366226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8f03921e-c616-4df8-b856-6953c01f6622 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:39.366347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-904b56c5-381c-4e99-b9d2-3c7effb8b232 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.373917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f03921e-c616-4df8-b856-6953c01f6622 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.374383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f03921e-c616-4df8-b856-6953c01f6622 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.374837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f03921e-c616-4df8-b856-6953c01f6622 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.376224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f03921e-c616-4df8-b856-6953c01f6622 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.376854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f03921e-c616-4df8-b856-6953c01f6622 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.377449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f03921e-c616-4df8-b856-6953c01f6622 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.400733 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-904b56c5-381c-4e99-b9d2-3c7effb8b232 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] HTTP exception thrown: Instance d93744ae-9a79-417e-9de4-8b0b1ae0e574 could not be found. Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-904b56c5-381c-4e99-b9d2-3c7effb8b232 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Request method failure captured: Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 HTTP/1.1 Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKFgIyEQCYxIE9SbF4xAACLsL_6kGzFdT0vP7AbAasqEePUmWKbUB9Q6-ErQ_Uxl9JQZmQcaZ1u2Bsa6SGB7QheXEhLwE8_6fP4EBpZz3RlmhZO_1_qXs10p7zeevKqiqBFBcSv1bZpCzKRHmhCvQV29kkHX9qWZ8_ayD8ygb8Hzw1I Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7462c68015654227a11892e2a2659ecb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7462c68015654227a11892e2a2659ecb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}] Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c199a13dceec4ae9bd873529c864146e Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance d93744ae-9a79-417e-9de4-8b0b1ae0e574 could not be found. Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'd93744ae-9a79-417e-9de4-8b0b1ae0e574'} Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93744ae-9a79-417e-9de4-8b0b1ae0e574 could not be found. Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93744ae-9a79-417e-9de4-8b0b1ae0e574 could not be found. Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.402513 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.406857 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.406857 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.406857 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:39.406857 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:39.406857 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93744ae-9a79-417e-9de4-8b0b1ae0e574 could not be found. Oct 04 21:15:39.406857 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.406857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-904b56c5-381c-4e99-b9d2-3c7effb8b232 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Returning 404 to user: Instance d93744ae-9a79-417e-9de4-8b0b1ae0e574 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:39.406857 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-904b56c5-381c-4e99-b9d2-3c7effb8b232 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574" status: 404 len: 111 microversion: 2.1 time: 0.060176 Oct 04 21:15:39.406857 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1261/2451] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:39 2022] GET /compute/v2.1/servers/d93744ae-9a79-417e-9de4-8b0b1ae0e574 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:15:39.412898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-33df0e03-50d3-4863-9262-4345c821e586 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f57944a3310>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.440571 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-33df0e03-50d3-4863-9262-4345c821e586 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] HTTP exception thrown: Image not found. Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-33df0e03-50d3-4863-9262-4345c821e586 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Request method failure captured: Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3 HTTP/1.1 Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKFgIyEQCYxIE9SbF4xAACLsL_6kGzFdT0vP7AbAasqEePUmWKbUB9Q6-ErQ_Uxl9JQZmQcaZ1u2Bsa6SGB7QheXEhLwE8_6fP4EBpZz3RlmhZO_1_qXs10p7zeevKqiqBFBcSv1bZpCzKRHmhCvQV29kkHX9qWZ8_ayD8ygb8Hzw1I Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7462c68015654227a11892e2a2659ecb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7462c68015654227a11892e2a2659ecb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}] Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c199a13dceec4ae9bd873529c864146e Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: exception: Image not found. Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '3803792a-eb96-4ccf-9461-7ffc697248b3'} Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3803792a-eb96-4ccf-9461-7ffc697248b3 to delete Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3803792a-eb96-4ccf-9461-7ffc697248b3 could not be found. Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.441183 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:15:39.444811 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.449665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-33df0e03-50d3-4863-9262-4345c821e586 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Returning 404 to user: Image not found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:39.451164 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-33df0e03-50d3-4863-9262-4345c821e586 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "DELETE /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3" status: 404 len: 62 microversion: 2.1 time: 0.042577 Oct 04 21:15:39.452283 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1262/2452] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:39 2022] DELETE /compute/v2.1/images/3803792a-eb96-4ccf-9461-7ffc697248b3 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 21:15:39.462392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5e6eabee-efe2-430e-91d6-b3cc1f2824fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.463247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5e6eabee-efe2-430e-91d6-b3cc1f2824fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:39.471012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e6eabee-efe2-430e-91d6-b3cc1f2824fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.471886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e6eabee-efe2-430e-91d6-b3cc1f2824fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.477496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e6eabee-efe2-430e-91d6-b3cc1f2824fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.477496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e6eabee-efe2-430e-91d6-b3cc1f2824fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.477496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e6eabee-efe2-430e-91d6-b3cc1f2824fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.477496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e6eabee-efe2-430e-91d6-b3cc1f2824fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.492078 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-5e6eabee-efe2-430e-91d6-b3cc1f2824fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] HTTP exception thrown: Instance c974866c-d0de-4595-85b6-7404f349c6f1 could not be found. Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5e6eabee-efe2-430e-91d6-b3cc1f2824fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Request method failure captured: Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 HTTP/1.1 Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKFgIyEQCYxIE9SbF4xAACLsL_6kGzFdT0vP7AbAasqEePUmWKbUB9Q6-ErQ_Uxl9JQZmQcaZ1u2Bsa6SGB7QheXEhLwE8_6fP4EBpZz3RlmhZO_1_qXs10p7zeevKqiqBFBcSv1bZpCzKRHmhCvQV29kkHX9qWZ8_ayD8ygb8Hzw1I Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7462c68015654227a11892e2a2659ecb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7462c68015654227a11892e2a2659ecb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}] Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c199a13dceec4ae9bd873529c864146e Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance c974866c-d0de-4595-85b6-7404f349c6f1 could not be found. Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'c974866c-d0de-4595-85b6-7404f349c6f1'} Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c974866c-d0de-4595-85b6-7404f349c6f1 could not be found. Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:15:39.494356 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c974866c-d0de-4595-85b6-7404f349c6f1 could not be found. Oct 04 21:15:39.497798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.497798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.497798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.497798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.497798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.497798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.497798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:39.497798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:39.497798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c974866c-d0de-4595-85b6-7404f349c6f1 could not be found. Oct 04 21:15:39.497798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.500412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5e6eabee-efe2-430e-91d6-b3cc1f2824fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Returning 404 to user: Instance c974866c-d0de-4595-85b6-7404f349c6f1 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:39.502197 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5e6eabee-efe2-430e-91d6-b3cc1f2824fe tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1" status: 404 len: 111 microversion: 2.1 time: 0.044344 Oct 04 21:15:39.503439 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1263/2453] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:15:39 2022] DELETE /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:15:39.512788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4166cff5-6ec1-44c0-9399-f5d72d99d35d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.514033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4166cff5-6ec1-44c0-9399-f5d72d99d35d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: c974866c-d0de-4595-85b6-7404f349c6f1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:39.521192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4166cff5-6ec1-44c0-9399-f5d72d99d35d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.522053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4166cff5-6ec1-44c0-9399-f5d72d99d35d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.522641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4166cff5-6ec1-44c0-9399-f5d72d99d35d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.524814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4166cff5-6ec1-44c0-9399-f5d72d99d35d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.525459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4166cff5-6ec1-44c0-9399-f5d72d99d35d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.526122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4166cff5-6ec1-44c0-9399-f5d72d99d35d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.556616 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-4166cff5-6ec1-44c0-9399-f5d72d99d35d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] HTTP exception thrown: Instance c974866c-d0de-4595-85b6-7404f349c6f1 could not be found. Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4166cff5-6ec1-44c0-9399-f5d72d99d35d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Request method failure captured: Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 HTTP/1.1 Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKFgIyEQCYxIE9SbF4xAACLsL_6kGzFdT0vP7AbAasqEePUmWKbUB9Q6-ErQ_Uxl9JQZmQcaZ1u2Bsa6SGB7QheXEhLwE8_6fP4EBpZz3RlmhZO_1_qXs10p7zeevKqiqBFBcSv1bZpCzKRHmhCvQV29kkHX9qWZ8_ayD8ygb8Hzw1I Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7462c68015654227a11892e2a2659ecb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7462c68015654227a11892e2a2659ecb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}] Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c199a13dceec4ae9bd873529c864146e Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance c974866c-d0de-4595-85b6-7404f349c6f1 could not be found. Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'c974866c-d0de-4595-85b6-7404f349c6f1'} Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c974866c-d0de-4595-85b6-7404f349c6f1 could not be found. Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c974866c-d0de-4595-85b6-7404f349c6f1 could not be found. Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.558193 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.561976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.561976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.561976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:39.561976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:39.561976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c974866c-d0de-4595-85b6-7404f349c6f1 could not be found. Oct 04 21:15:39.561976 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.561976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4166cff5-6ec1-44c0-9399-f5d72d99d35d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Returning 404 to user: Instance c974866c-d0de-4595-85b6-7404f349c6f1 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:39.561976 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4166cff5-6ec1-44c0-9399-f5d72d99d35d tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1" status: 404 len: 111 microversion: 2.1 time: 0.052493 Oct 04 21:15:39.564932 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1264/2454] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:39 2022] GET /compute/v2.1/servers/c974866c-d0de-4595-85b6-7404f349c6f1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:15:39.572597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d3f144c8-1ad5-462f-900d-b3027cbfaa57 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f57943bb940>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.581031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8f03921e-c616-4df8-b856-6953c01f6622 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:39.592962 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8f03921e-c616-4df8-b856-6953c01f6622 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1369 microversion: 2.1 time: 0.232388 Oct 04 21:15:39.593773 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1191/2455] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:39 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1369 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:39.599047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3851056e-a840-48c6-a8bf-dfaf1db734bd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.599833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3851056e-a840-48c6-a8bf-dfaf1db734bd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:39.606896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3851056e-a840-48c6-a8bf-dfaf1db734bd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.607796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3851056e-a840-48c6-a8bf-dfaf1db734bd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.608602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3851056e-a840-48c6-a8bf-dfaf1db734bd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.609508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3851056e-a840-48c6-a8bf-dfaf1db734bd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.610095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3851056e-a840-48c6-a8bf-dfaf1db734bd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.610529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3851056e-a840-48c6-a8bf-dfaf1db734bd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.621387 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-d3f144c8-1ad5-462f-900d-b3027cbfaa57 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] HTTP exception thrown: Image not found. Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d3f144c8-1ad5-462f-900d-b3027cbfaa57 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Request method failure captured: Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 HTTP/1.1 Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKFgIyEQCYxIE9SbF4xAACLsL_6kGzFdT0vP7AbAasqEePUmWKbUB9Q6-ErQ_Uxl9JQZmQcaZ1u2Bsa6SGB7QheXEhLwE8_6fP4EBpZz3RlmhZO_1_qXs10p7zeevKqiqBFBcSv1bZpCzKRHmhCvQV29kkHX9qWZ8_ayD8ygb8Hzw1I Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7462c68015654227a11892e2a2659ecb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7462c68015654227a11892e2a2659ecb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}] Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c199a13dceec4ae9bd873529c864146e Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: exception: Image not found. Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '5c3b7c5e-708b-44ce-9c6e-75ce287805f3'} Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5c3b7c5e-708b-44ce-9c6e-75ce287805f3 to delete Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5c3b7c5e-708b-44ce-9c6e-75ce287805f3 could not be found. Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.624714 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d3f144c8-1ad5-462f-900d-b3027cbfaa57 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Returning 404 to user: Image not found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:39.628452 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d3f144c8-1ad5-462f-900d-b3027cbfaa57 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "DELETE /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3" status: 404 len: 62 microversion: 2.1 time: 0.060517 Oct 04 21:15:39.630916 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1265/2456] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:39 2022] DELETE /compute/v2.1/images/5c3b7c5e-708b-44ce-9c6e-75ce287805f3 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:15:39.636771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ab44556d-56e4-47bd-89c1-56002e40c1da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.637275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ab44556d-56e4-47bd-89c1-56002e40c1da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:39.644341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab44556d-56e4-47bd-89c1-56002e40c1da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.645005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab44556d-56e4-47bd-89c1-56002e40c1da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.645536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab44556d-56e4-47bd-89c1-56002e40c1da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.646651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab44556d-56e4-47bd-89c1-56002e40c1da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.647272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab44556d-56e4-47bd-89c1-56002e40c1da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.647918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab44556d-56e4-47bd-89c1-56002e40c1da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.662398 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-ab44556d-56e4-47bd-89c1-56002e40c1da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] HTTP exception thrown: Instance 2babc3b5-0147-43b1-8f42-8a536a46ddce could not be found. Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ab44556d-56e4-47bd-89c1-56002e40c1da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Request method failure captured: Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce HTTP/1.1 Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKFgIyEQCYxIE9SbF4xAACLsL_6kGzFdT0vP7AbAasqEePUmWKbUB9Q6-ErQ_Uxl9JQZmQcaZ1u2Bsa6SGB7QheXEhLwE8_6fP4EBpZz3RlmhZO_1_qXs10p7zeevKqiqBFBcSv1bZpCzKRHmhCvQV29kkHX9qWZ8_ayD8ygb8Hzw1I Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7462c68015654227a11892e2a2659ecb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7462c68015654227a11892e2a2659ecb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}] Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c199a13dceec4ae9bd873529c864146e Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 2babc3b5-0147-43b1-8f42-8a536a46ddce could not be found. Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '2babc3b5-0147-43b1-8f42-8a536a46ddce'} Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2babc3b5-0147-43b1-8f42-8a536a46ddce could not be found. Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:15:39.664118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2babc3b5-0147-43b1-8f42-8a536a46ddce could not be found. Oct 04 21:15:39.668328 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.668328 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.668328 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.668328 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.668328 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.668328 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.668328 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:39.668328 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:39.668328 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2babc3b5-0147-43b1-8f42-8a536a46ddce could not be found. Oct 04 21:15:39.668328 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.668328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ab44556d-56e4-47bd-89c1-56002e40c1da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Returning 404 to user: Instance 2babc3b5-0147-43b1-8f42-8a536a46ddce could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:39.668328 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ab44556d-56e4-47bd-89c1-56002e40c1da tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 404 len: 111 microversion: 2.1 time: 0.033747 Oct 04 21:15:39.668328 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1266/2457] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:15:39 2022] DELETE /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:15:39.674363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e9a037fb-2f39-4bee-9ebb-d56abfabc7ec tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.674845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e9a037fb-2f39-4bee-9ebb-d56abfabc7ec tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: 2babc3b5-0147-43b1-8f42-8a536a46ddce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:39.681294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9a037fb-2f39-4bee-9ebb-d56abfabc7ec tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.681809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9a037fb-2f39-4bee-9ebb-d56abfabc7ec tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.687424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9a037fb-2f39-4bee-9ebb-d56abfabc7ec tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.687424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9a037fb-2f39-4bee-9ebb-d56abfabc7ec tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.687424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9a037fb-2f39-4bee-9ebb-d56abfabc7ec tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.687424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9a037fb-2f39-4bee-9ebb-d56abfabc7ec tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.699480 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-e9a037fb-2f39-4bee-9ebb-d56abfabc7ec tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] HTTP exception thrown: Instance 2babc3b5-0147-43b1-8f42-8a536a46ddce could not be found. Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e9a037fb-2f39-4bee-9ebb-d56abfabc7ec tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Request method failure captured: Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce HTTP/1.1 Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKFgIyEQCYxIE9SbF4xAACLsL_6kGzFdT0vP7AbAasqEePUmWKbUB9Q6-ErQ_Uxl9JQZmQcaZ1u2Bsa6SGB7QheXEhLwE8_6fP4EBpZz3RlmhZO_1_qXs10p7zeevKqiqBFBcSv1bZpCzKRHmhCvQV29kkHX9qWZ8_ayD8ygb8Hzw1I Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7462c68015654227a11892e2a2659ecb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7462c68015654227a11892e2a2659ecb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}] Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c199a13dceec4ae9bd873529c864146e Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 2babc3b5-0147-43b1-8f42-8a536a46ddce could not be found. Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '2babc3b5-0147-43b1-8f42-8a536a46ddce'} Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2babc3b5-0147-43b1-8f42-8a536a46ddce could not be found. Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2babc3b5-0147-43b1-8f42-8a536a46ddce could not be found. Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.701026 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.705467 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.705467 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.705467 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:39.705467 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:39.705467 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2babc3b5-0147-43b1-8f42-8a536a46ddce could not be found. Oct 04 21:15:39.705467 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.705467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e9a037fb-2f39-4bee-9ebb-d56abfabc7ec tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Returning 404 to user: Instance 2babc3b5-0147-43b1-8f42-8a536a46ddce could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:39.705467 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e9a037fb-2f39-4bee-9ebb-d56abfabc7ec tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce" status: 404 len: 111 microversion: 2.1 time: 0.032014 Oct 04 21:15:39.706511 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1267/2458] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:39 2022] GET /compute/v2.1/servers/2babc3b5-0147-43b1-8f42-8a536a46ddce => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:15:39.712150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2f8a4cef-61f1-484f-9dc8-5e6ae0ee7bd4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '.version_select at 0x7f579444f3a0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.741699 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-2f8a4cef-61f1-484f-9dc8-5e6ae0ee7bd4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] HTTP exception thrown: Image not found. Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2f8a4cef-61f1-484f-9dc8-5e6ae0ee7bd4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Request method failure captured: Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b HTTP/1.1 Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKFgIyEQCYxIE9SbF4xAACLsL_6kGzFdT0vP7AbAasqEePUmWKbUB9Q6-ErQ_Uxl9JQZmQcaZ1u2Bsa6SGB7QheXEhLwE8_6fP4EBpZz3RlmhZO_1_qXs10p7zeevKqiqBFBcSv1bZpCzKRHmhCvQV29kkHX9qWZ8_ayD8ygb8Hzw1I Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7462c68015654227a11892e2a2659ecb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7462c68015654227a11892e2a2659ecb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}] Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c199a13dceec4ae9bd873529c864146e Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: exception: Image not found. Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'a8e0ec29-24d6-4416-9fd4-69d5ca77140b'} Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a8e0ec29-24d6-4416-9fd4-69d5ca77140b to delete Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a8e0ec29-24d6-4416-9fd4-69d5ca77140b could not be found. Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.744269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2f8a4cef-61f1-484f-9dc8-5e6ae0ee7bd4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Returning 404 to user: Image not found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2f8a4cef-61f1-484f-9dc8-5e6ae0ee7bd4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "DELETE /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b" status: 404 len: 62 microversion: 2.1 time: 0.037764 Oct 04 21:15:39.748757 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1268/2459] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:39 2022] DELETE /compute/v2.1/images/a8e0ec29-24d6-4416-9fd4-69d5ca77140b => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:15:39.769543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a44e8e97-e2c8-4aab-bd84-3c12c306e2e4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.770202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a44e8e97-e2c8-4aab-bd84-3c12c306e2e4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:39.793626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a44e8e97-e2c8-4aab-bd84-3c12c306e2e4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.794441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a44e8e97-e2c8-4aab-bd84-3c12c306e2e4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.796322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a44e8e97-e2c8-4aab-bd84-3c12c306e2e4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.797818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a44e8e97-e2c8-4aab-bd84-3c12c306e2e4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.799569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a44e8e97-e2c8-4aab-bd84-3c12c306e2e4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.800820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a44e8e97-e2c8-4aab-bd84-3c12c306e2e4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.817499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3851056e-a840-48c6-a8bf-dfaf1db734bd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:39.828900 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3851056e-a840-48c6-a8bf-dfaf1db734bd tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1324 microversion: 2.1 time: 0.231587 Oct 04 21:15:39.832686 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1192/2460] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:39 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1324 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:39.840020 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-a44e8e97-e2c8-4aab-bd84-3c12c306e2e4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] HTTP exception thrown: Instance fd2cb6e2-2e03-406a-96ae-8be64d9af891 could not be found. Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a44e8e97-e2c8-4aab-bd84-3c12c306e2e4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Request method failure captured: Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 HTTP/1.1 Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKFgIyEQCYxIE9SbF4xAACLsL_6kGzFdT0vP7AbAasqEePUmWKbUB9Q6-ErQ_Uxl9JQZmQcaZ1u2Bsa6SGB7QheXEhLwE8_6fP4EBpZz3RlmhZO_1_qXs10p7zeevKqiqBFBcSv1bZpCzKRHmhCvQV29kkHX9qWZ8_ayD8ygb8Hzw1I Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7462c68015654227a11892e2a2659ecb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7462c68015654227a11892e2a2659ecb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}] Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c199a13dceec4ae9bd873529c864146e Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance fd2cb6e2-2e03-406a-96ae-8be64d9af891 could not be found. Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'fd2cb6e2-2e03-406a-96ae-8be64d9af891'} Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd2cb6e2-2e03-406a-96ae-8be64d9af891 could not be found. Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:15:39.843271 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd2cb6e2-2e03-406a-96ae-8be64d9af891 could not be found. Oct 04 21:15:39.847783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.847783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.847783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.847783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.847783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.847783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.847783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:39.847783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:39.847783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd2cb6e2-2e03-406a-96ae-8be64d9af891 could not be found. Oct 04 21:15:39.847783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.847783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a44e8e97-e2c8-4aab-bd84-3c12c306e2e4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Returning 404 to user: Instance fd2cb6e2-2e03-406a-96ae-8be64d9af891 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:39.847783 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a44e8e97-e2c8-4aab-bd84-3c12c306e2e4 tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 404 len: 111 microversion: 2.1 time: 0.086112 Oct 04 21:15:39.848650 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1269/2461] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:15:39 2022] DELETE /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:15:39.854868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4a32dda2-7044-4381-835a-3799239718eb tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.863795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4a32dda2-7044-4381-835a-3799239718eb tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] [instance: fd2cb6e2-2e03-406a-96ae-8be64d9af891] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:39.877083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a32dda2-7044-4381-835a-3799239718eb tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.881721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a32dda2-7044-4381-835a-3799239718eb tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.883344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a32dda2-7044-4381-835a-3799239718eb tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.887058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a32dda2-7044-4381-835a-3799239718eb tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.887765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a32dda2-7044-4381-835a-3799239718eb tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.888378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a32dda2-7044-4381-835a-3799239718eb tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.911884 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-4a32dda2-7044-4381-835a-3799239718eb tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] HTTP exception thrown: Instance fd2cb6e2-2e03-406a-96ae-8be64d9af891 could not be found. Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4a32dda2-7044-4381-835a-3799239718eb tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Request method failure captured: Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 HTTP/1.1 Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKFgIyEQCYxIE9SbF4xAACLsL_6kGzFdT0vP7AbAasqEePUmWKbUB9Q6-ErQ_Uxl9JQZmQcaZ1u2Bsa6SGB7QheXEhLwE8_6fP4EBpZz3RlmhZO_1_qXs10p7zeevKqiqBFBcSv1bZpCzKRHmhCvQV29kkHX9qWZ8_ayD8ygb8Hzw1I Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7462c68015654227a11892e2a2659ecb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7462c68015654227a11892e2a2659ecb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7462c68015654227a11892e2a2659ecb"}]}] Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 7462c68015654227a11892e2a2659ecb Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ImagesTestJSON-2020247354 Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c199a13dceec4ae9bd873529c864146e Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ImagesTestJSON-2020247354-project Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance fd2cb6e2-2e03-406a-96ae-8be64d9af891 could not be found. Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'fd2cb6e2-2e03-406a-96ae-8be64d9af891'} Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd2cb6e2-2e03-406a-96ae-8be64d9af891 could not be found. Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd2cb6e2-2e03-406a-96ae-8be64d9af891 could not be found. Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.914384 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:39.918623 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:39.918623 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:39.918623 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:39.918623 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:39.918623 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd2cb6e2-2e03-406a-96ae-8be64d9af891 could not be found. Oct 04 21:15:39.918623 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:39.920944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4a32dda2-7044-4381-835a-3799239718eb tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] Returning 404 to user: Instance fd2cb6e2-2e03-406a-96ae-8be64d9af891 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:39.922032 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4a32dda2-7044-4381-835a-3799239718eb tempest-ImagesTestJSON-2020247354 tempest-ImagesTestJSON-2020247354-project] 10.222.0.30 "GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891" status: 404 len: 111 microversion: 2.1 time: 0.071119 Oct 04 21:15:39.923596 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1193/2462] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:39 2022] GET /compute/v2.1/servers/fd2cb6e2-2e03-406a-96ae-8be64d9af891 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:15:40.165393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-f2294fe9-cc42-4819-8c8e-43acae345a31 req-9ba35221-cd69-4256-9c35-c7dd4c5ca40f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0250fa-4053-4bec-81bb-b5f857310687", "name": "network-vif-plugged", "status": "completed", "tag": "9965e6e8-265e-42f4-906a-f53b455b8c28"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:40.188060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f2294fe9-cc42-4819-8c8e-43acae345a31 req-9ba35221-cd69-4256-9c35-c7dd4c5ca40f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:40.189107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f2294fe9-cc42-4819-8c8e-43acae345a31 req-9ba35221-cd69-4256-9c35-c7dd4c5ca40f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:40.189658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f2294fe9-cc42-4819-8c8e-43acae345a31 req-9ba35221-cd69-4256-9c35-c7dd4c5ca40f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:40.206576 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-f2294fe9-cc42-4819-8c8e-43acae345a31 req-9ba35221-cd69-4256-9c35-c7dd4c5ca40f service nova] Creating event network-vif-plugged:9965e6e8-265e-42f4-906a-f53b455b8c28 for instance 0f0250fa-4053-4bec-81bb-b5f857310687 on n-h1-860282-1 Oct 04 21:15:40.221088 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-f2294fe9-cc42-4819-8c8e-43acae345a31 req-9ba35221-cd69-4256-9c35-c7dd4c5ca40f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066664 Oct 04 21:15:40.222024 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1270/2463] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:40.350793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fe949fae-33fc-43d6-ad65-6e5b6eb88fbc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:40.352897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fe949fae-33fc-43d6-ad65-6e5b6eb88fbc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:40.359073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cfd7a559-3d0b-4519-bf71-f6a0e973a16c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:40.359782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cfd7a559-3d0b-4519-bf71-f6a0e973a16c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:40.361263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe949fae-33fc-43d6-ad65-6e5b6eb88fbc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:40.363346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe949fae-33fc-43d6-ad65-6e5b6eb88fbc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:40.363823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe949fae-33fc-43d6-ad65-6e5b6eb88fbc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:40.366318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe949fae-33fc-43d6-ad65-6e5b6eb88fbc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:40.366876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe949fae-33fc-43d6-ad65-6e5b6eb88fbc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:40.367391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe949fae-33fc-43d6-ad65-6e5b6eb88fbc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:40.370175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfd7a559-3d0b-4519-bf71-f6a0e973a16c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:40.370671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfd7a559-3d0b-4519-bf71-f6a0e973a16c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:40.371108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfd7a559-3d0b-4519-bf71-f6a0e973a16c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:40.374514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfd7a559-3d0b-4519-bf71-f6a0e973a16c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:40.374999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfd7a559-3d0b-4519-bf71-f6a0e973a16c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:40.375442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfd7a559-3d0b-4519-bf71-f6a0e973a16c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:40.427981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:40.436133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:41.256737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cfd7a559-3d0b-4519-bf71-f6a0e973a16c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:41.271739 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cfd7a559-3d0b-4519-bf71-f6a0e973a16c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189" status: 200 len: 1396 microversion: 2.1 time: 0.916958 Oct 04 21:15:41.272848 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1271/2464] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:40 2022] GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 => generated 1396 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:41.277236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fe949fae-33fc-43d6-ad65-6e5b6eb88fbc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:41.287516 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fe949fae-33fc-43d6-ad65-6e5b6eb88fbc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.941740 Oct 04 21:15:41.288296 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1194/2465] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:40 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:41.290637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dbec21dc-93e5-4c0a-bd23-727d640763d2 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:41.291500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dbec21dc-93e5-4c0a-bd23-727d640763d2 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:41.294539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1a1157d2-c8b6-43fc-ba09-e92607da7d71 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:41.295390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1a1157d2-c8b6-43fc-ba09-e92607da7d71 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:41.299722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbec21dc-93e5-4c0a-bd23-727d640763d2 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:41.300224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbec21dc-93e5-4c0a-bd23-727d640763d2 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:41.301849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbec21dc-93e5-4c0a-bd23-727d640763d2 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:41.302732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbec21dc-93e5-4c0a-bd23-727d640763d2 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:41.303251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a1157d2-c8b6-43fc-ba09-e92607da7d71 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:41.303565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbec21dc-93e5-4c0a-bd23-727d640763d2 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:41.303921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a1157d2-c8b6-43fc-ba09-e92607da7d71 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:41.304903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a1157d2-c8b6-43fc-ba09-e92607da7d71 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:41.305275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbec21dc-93e5-4c0a-bd23-727d640763d2 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:41.306251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a1157d2-c8b6-43fc-ba09-e92607da7d71 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:41.306873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a1157d2-c8b6-43fc-ba09-e92607da7d71 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:41.307461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a1157d2-c8b6-43fc-ba09-e92607da7d71 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:41.861106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dbec21dc-93e5-4c0a-bd23-727d640763d2 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:41.870713 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dbec21dc-93e5-4c0a-bd23-727d640763d2 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1369 microversion: 2.1 time: 0.594950 Oct 04 21:15:41.871286 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1272/2466] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:41 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1369 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:41.897651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1a1157d2-c8b6-43fc-ba09-e92607da7d71 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:41.905578 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1a1157d2-c8b6-43fc-ba09-e92607da7d71 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1521 microversion: 2.1 time: 0.615779 Oct 04 21:15:41.906164 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1195/2467] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:41 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1521 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:41.938980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-313b62ec-bdc7-45ef-bb6a-9e4282f74326 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:41.939599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-313b62ec-bdc7-45ef-bb6a-9e4282f74326 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:41.946681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-313b62ec-bdc7-45ef-bb6a-9e4282f74326 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:41.949825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-313b62ec-bdc7-45ef-bb6a-9e4282f74326 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:41.949825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-313b62ec-bdc7-45ef-bb6a-9e4282f74326 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:41.949825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-313b62ec-bdc7-45ef-bb6a-9e4282f74326 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:41.949825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-313b62ec-bdc7-45ef-bb6a-9e4282f74326 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:41.949825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-313b62ec-bdc7-45ef-bb6a-9e4282f74326 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:42.307086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8b672476-7327-427c-9c36-7fadc40f1c1b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:42.312765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8b672476-7327-427c-9c36-7fadc40f1c1b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:42.317896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-313b62ec-bdc7-45ef-bb6a-9e4282f74326 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:42.326439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b672476-7327-427c-9c36-7fadc40f1c1b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:42.328120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b672476-7327-427c-9c36-7fadc40f1c1b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:42.328799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b672476-7327-427c-9c36-7fadc40f1c1b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:42.330395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b672476-7327-427c-9c36-7fadc40f1c1b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:42.331287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b672476-7327-427c-9c36-7fadc40f1c1b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:42.331945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b672476-7327-427c-9c36-7fadc40f1c1b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:42.339562 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-313b62ec-bdc7-45ef-bb6a-9e4282f74326 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1521 microversion: 2.1 time: 0.404585 Oct 04 21:15:42.350481 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1273/2468] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:41 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:42.379329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-83c8e6ba-5fcf-4e88-8237-bf61d7cfab2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:42.380016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-83c8e6ba-5fcf-4e88-8237-bf61d7cfab2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:42.393193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83c8e6ba-5fcf-4e88-8237-bf61d7cfab2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:42.394330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83c8e6ba-5fcf-4e88-8237-bf61d7cfab2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:42.394969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83c8e6ba-5fcf-4e88-8237-bf61d7cfab2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:42.395724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83c8e6ba-5fcf-4e88-8237-bf61d7cfab2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:42.396194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83c8e6ba-5fcf-4e88-8237-bf61d7cfab2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:42.396630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83c8e6ba-5fcf-4e88-8237-bf61d7cfab2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:43.097440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8b672476-7327-427c-9c36-7fadc40f1c1b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:43.123949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-83c8e6ba-5fcf-4e88-8237-bf61d7cfab2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:43.124669 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8b672476-7327-427c-9c36-7fadc40f1c1b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189" status: 200 len: 1396 microversion: 2.1 time: 0.823669 Oct 04 21:15:43.136237 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1196/2469] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:42 2022] GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 => generated 1396 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:43.140765 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-83c8e6ba-5fcf-4e88-8237-bf61d7cfab2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1522 microversion: 2.1 time: 0.788911 Oct 04 21:15:43.149686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b7389014-3ae4-4f11-ae6e-7a33e2ab2f0f req-5ce982ff-9527-4dee-87d4-e68d133a09b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7141667-2475-4be1-9296-ad67dbd94189", "name": "network-vif-plugged", "status": "completed", "tag": "a62cebb4-a5f0-4b37-aa2d-9adf1cdf2efb"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:43.156883 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1274/2470] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:42 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1522 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:43.162150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dac6f886-614f-488c-a192-79d7b0230f0b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-66342165"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:43.165507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dac6f886-614f-488c-a192-79d7b0230f0b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:43.175006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dac6f886-614f-488c-a192-79d7b0230f0b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:43.175782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dac6f886-614f-488c-a192-79d7b0230f0b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:43.176384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dac6f886-614f-488c-a192-79d7b0230f0b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:43.177077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b7389014-3ae4-4f11-ae6e-7a33e2ab2f0f req-5ce982ff-9527-4dee-87d4-e68d133a09b8 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:43.177446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dac6f886-614f-488c-a192-79d7b0230f0b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:43.177593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b7389014-3ae4-4f11-ae6e-7a33e2ab2f0f req-5ce982ff-9527-4dee-87d4-e68d133a09b8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:43.178033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b7389014-3ae4-4f11-ae6e-7a33e2ab2f0f req-5ce982ff-9527-4dee-87d4-e68d133a09b8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:43.178413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dac6f886-614f-488c-a192-79d7b0230f0b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:43.179080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dac6f886-614f-488c-a192-79d7b0230f0b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:43.207530 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b7389014-3ae4-4f11-ae6e-7a33e2ab2f0f req-5ce982ff-9527-4dee-87d4-e68d133a09b8 service nova] Creating event network-vif-plugged:a62cebb4-a5f0-4b37-aa2d-9adf1cdf2efb for instance e7141667-2475-4be1-9296-ad67dbd94189 on n-h2-860282-1 Oct 04 21:15:43.225746 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b7389014-3ae4-4f11-ae6e-7a33e2ab2f0f req-5ce982ff-9527-4dee-87d4-e68d133a09b8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087937 Oct 04 21:15:43.233268 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1197/2471] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:43.238848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b3cb5529-1286-443c-a0cc-030a77ac6c81 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:43.239714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b3cb5529-1286-443c-a0cc-030a77ac6c81 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:43.259919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3cb5529-1286-443c-a0cc-030a77ac6c81 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:43.260492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3cb5529-1286-443c-a0cc-030a77ac6c81 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:43.260877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3cb5529-1286-443c-a0cc-030a77ac6c81 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:43.264685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3cb5529-1286-443c-a0cc-030a77ac6c81 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:43.265181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3cb5529-1286-443c-a0cc-030a77ac6c81 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:43.267254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3cb5529-1286-443c-a0cc-030a77ac6c81 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:43.602111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b3cb5529-1286-443c-a0cc-030a77ac6c81 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:43.610867 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b3cb5529-1286-443c-a0cc-030a77ac6c81 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1555 microversion: 2.1 time: 0.376106 Oct 04 21:15:43.618712 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1198/2472] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:43 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1555 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:43.640080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0e7b9ca8-4f28-409c-87ba-6c7c146403f2 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:43.640960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0e7b9ca8-4f28-409c-87ba-6c7c146403f2 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:43.652564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e7b9ca8-4f28-409c-87ba-6c7c146403f2 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:43.653455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e7b9ca8-4f28-409c-87ba-6c7c146403f2 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:43.654200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e7b9ca8-4f28-409c-87ba-6c7c146403f2 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:43.656875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e7b9ca8-4f28-409c-87ba-6c7c146403f2 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:43.657613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e7b9ca8-4f28-409c-87ba-6c7c146403f2 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:43.658850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e7b9ca8-4f28-409c-87ba-6c7c146403f2 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:43.789856 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dac6f886-614f-488c-a192-79d7b0230f0b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "POST /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d/action" status: 202 len: 0 microversion: 2.1 time: 0.631200 Oct 04 21:15:43.791145 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1275/2473] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:15:43 2022] POST /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 21:15:43.803101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-41740821-16ab-41b2-8fde-990a9057b7ef tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '.version_select at 0x7f579444f3a0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:43.909933 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0e7b9ca8-4f28-409c-87ba-6c7c146403f2 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.273739 Oct 04 21:15:43.918332 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1199/2474] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:15:43 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687/os-interface => generated 285 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:44.157788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cab31c5d-a148-459a-9038-153a97a2b6f8 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:44.159253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cab31c5d-a148-459a-9038-153a97a2b6f8 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:44.187088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cab31c5d-a148-459a-9038-153a97a2b6f8 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:44.189916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cab31c5d-a148-459a-9038-153a97a2b6f8 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:44.194212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cab31c5d-a148-459a-9038-153a97a2b6f8 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:44.195134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cab31c5d-a148-459a-9038-153a97a2b6f8 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:44.195634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cab31c5d-a148-459a-9038-153a97a2b6f8 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:44.196077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cab31c5d-a148-459a-9038-153a97a2b6f8 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:44.220202 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-41740821-16ab-41b2-8fde-990a9057b7ef tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "DELETE /compute/v2.1/images/66723ea1-9ee4-4600-a0fd-6cc7be3a5cf5" status: 204 len: 0 microversion: 2.1 time: 0.421907 Oct 04 21:15:44.220886 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1276/2475] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:43 2022] DELETE /compute/v2.1/images/66723ea1-9ee4-4600-a0fd-6cc7be3a5cf5 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:15:44.231137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-12ab443e-f238-482c-9d90-ff6b9ab58ab4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:44.232464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-12ab443e-f238-482c-9d90-ff6b9ab58ab4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:44.262250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12ab443e-f238-482c-9d90-ff6b9ab58ab4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:44.262766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12ab443e-f238-482c-9d90-ff6b9ab58ab4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:44.269841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12ab443e-f238-482c-9d90-ff6b9ab58ab4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:44.271375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12ab443e-f238-482c-9d90-ff6b9ab58ab4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:44.272072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12ab443e-f238-482c-9d90-ff6b9ab58ab4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:44.274640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12ab443e-f238-482c-9d90-ff6b9ab58ab4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:44.917240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cab31c5d-a148-459a-9038-153a97a2b6f8 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:44.928003 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cab31c5d-a148-459a-9038-153a97a2b6f8 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189" status: 200 len: 1396 microversion: 2.1 time: 0.779484 Oct 04 21:15:44.931561 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1200/2476] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:44 2022] GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 => generated 1396 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:44.946541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d86ec28e-8240-406d-9c46-d49351d936b2 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '.version_select at 0x7f578ba109d0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:44.995899 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-d86ec28e-8240-406d-9c46-d49351d936b2 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] HTTP exception thrown: Image not found. Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d86ec28e-8240-406d-9c46-d49351d936b2 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Request method failure captured: Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/images/66723ea1-9ee4-4600-a0fd-6cc7be3a5cf5 HTTP/1.1 Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKIfr0EKjh9lIGpSMallYOOhbfjlmceWYXhhzEhZtKG-K5Qftah8sJPPQwARLxF148gLNgWQ6TQI3CtHtfXOURD85vgsMSrUAP7uSOEzn9FGu8hya9wg7xCbpv6yrgC_TH3BeALF5PS38pqVs3tUVO2zaGck0ZnqjmCZGgWvxK0EmDc Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 4df42993975949899553deaeaffada73 Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4df42993975949899553deaeaffada73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4df42993975949899553deaeaffada73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}] Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 4df42993975949899553deaeaffada73 Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 4d401d8a2c8e4cee856badba313ed00a Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: exception: Image not found. Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '66723ea1-9ee4-4600-a0fd-6cc7be3a5cf5'} Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 66723ea1-9ee4-4600-a0fd-6cc7be3a5cf5 Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 21:15:45.003731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 66723ea1-9ee4-4600-a0fd-6cc7be3a5cf5 could not be found. Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d86ec28e-8240-406d-9c46-d49351d936b2 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Returning 404 to user: Image not found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d86ec28e-8240-406d-9c46-d49351d936b2 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/images/66723ea1-9ee4-4600-a0fd-6cc7be3a5cf5" status: 404 len: 62 microversion: 2.1 time: 0.065642 Oct 04 21:15:45.007119 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1201/2477] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:15:44 2022] GET /compute/v2.1/images/66723ea1-9ee4-4600-a0fd-6cc7be3a5cf5 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:15:45.017793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6e0b0044-b47c-4ad7-b855-cacd8493103c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:45.017793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6e0b0044-b47c-4ad7-b855-cacd8493103c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:45.029218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e0b0044-b47c-4ad7-b855-cacd8493103c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:45.029750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e0b0044-b47c-4ad7-b855-cacd8493103c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:45.042843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e0b0044-b47c-4ad7-b855-cacd8493103c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:45.042843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e0b0044-b47c-4ad7-b855-cacd8493103c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:45.042843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e0b0044-b47c-4ad7-b855-cacd8493103c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:45.042843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e0b0044-b47c-4ad7-b855-cacd8493103c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:45.051984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-12ab443e-f238-482c-9d90-ff6b9ab58ab4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:45.069308 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-12ab443e-f238-482c-9d90-ff6b9ab58ab4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1502 microversion: 2.1 time: 0.842646 Oct 04 21:15:45.080496 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1277/2478] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:44 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1502 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:45.101162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-698cec01-f60c-483f-8e6c-fb8af5e46eae tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:45.101897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-698cec01-f60c-483f-8e6c-fb8af5e46eae tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:45.111139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-698cec01-f60c-483f-8e6c-fb8af5e46eae tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:45.111914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-698cec01-f60c-483f-8e6c-fb8af5e46eae tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:45.112420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-698cec01-f60c-483f-8e6c-fb8af5e46eae tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:45.113198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-698cec01-f60c-483f-8e6c-fb8af5e46eae tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:45.113767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-698cec01-f60c-483f-8e6c-fb8af5e46eae tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:45.114356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-698cec01-f60c-483f-8e6c-fb8af5e46eae tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:46.031862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-698cec01-f60c-483f-8e6c-fb8af5e46eae tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:46.049869 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-698cec01-f60c-483f-8e6c-fb8af5e46eae tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1517 microversion: 2.1 time: 0.952481 Oct 04 21:15:46.050785 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1278/2479] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:45 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1517 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:46.060881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f9449a40-618c-4b29-997b-5428b9b42f22 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:46.064058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f9449a40-618c-4b29-997b-5428b9b42f22 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:46.068475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9449a40-618c-4b29-997b-5428b9b42f22 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:46.069268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9449a40-618c-4b29-997b-5428b9b42f22 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:46.071089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9449a40-618c-4b29-997b-5428b9b42f22 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:46.071814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9449a40-618c-4b29-997b-5428b9b42f22 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:46.072270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9449a40-618c-4b29-997b-5428b9b42f22 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:46.072729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9449a40-618c-4b29-997b-5428b9b42f22 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:46.236151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6e0b0044-b47c-4ad7-b855-cacd8493103c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:46.247834 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6e0b0044-b47c-4ad7-b855-cacd8493103c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1533 microversion: 2.1 time: 1.242072 Oct 04 21:15:46.248423 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1202/2480] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:45 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1533 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:46.263335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3c95b520-fb69-4155-8c5c-26cbf69b5945 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:46.267895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3c95b520-fb69-4155-8c5c-26cbf69b5945 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: acab5068-ab5d-422a-907e-3a51448e1440] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:46.273916 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-3c95b520-fb69-4155-8c5c-26cbf69b5945 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] HTTP exception thrown: Instance acab5068-ab5d-422a-907e-3a51448e1440 could not be found. Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3c95b520-fb69-4155-8c5c-26cbf69b5945 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Request method failure captured: Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/acab5068-ab5d-422a-907e-3a51448e1440/action HTTP/1.1 Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 14 Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKIzNXd_CmvP-6Usf8igAzY3dlzgDYn--v5mxvj-LpxllWzzbFyJF08JoJ1PYfhtDQRJAhrGh_znPsymYAfveamBdA6vz1Y-oh2GJa7UDnV-tTkHC5ZL-7fb_GflotkDarrlFSqHRvs9b0CJFd3T0swEf2S9AMDAGMNIk353xt2G0b4 Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 047ff2c9b6414ce8b98364678cbfeb53 Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/047ff2c9b6414ce8b98364678cbfeb53"}]}] Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 047ff2c9b6414ce8b98364678cbfeb53 Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerRescueNegativeTestJSON-548947322-project Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: abb3ac58c2ea4e2da8b9e765eda5f333 Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerRescueNegativeTestJSON-548947322-project Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: {"rescue": {}} Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance acab5068-ab5d-422a-907e-3a51448e1440 could not be found. Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'acab5068-ab5d-422a-907e-3a51448e1440', 'body': {'rescue': {}}} Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acab5068-ab5d-422a-907e-3a51448e1440 could not be found. Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acab5068-ab5d-422a-907e-3a51448e1440 could not be found. Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:46.287303 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:46.293736 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:46.293736 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:46.293736 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:46.293736 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:46.293736 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acab5068-ab5d-422a-907e-3a51448e1440 could not be found. Oct 04 21:15:46.293736 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:46.295611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3c95b520-fb69-4155-8c5c-26cbf69b5945 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Returning 404 to user: Instance acab5068-ab5d-422a-907e-3a51448e1440 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:46.298620 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3c95b520-fb69-4155-8c5c-26cbf69b5945 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "POST /compute/v2.1/servers/acab5068-ab5d-422a-907e-3a51448e1440/action" status: 404 len: 111 microversion: 2.1 time: 0.045125 Oct 04 21:15:46.299636 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1203/2481] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:15:46 2022] POST /compute/v2.1/servers/acab5068-ab5d-422a-907e-3a51448e1440/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:15:46.317459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-514916fa-d20e-46ad-9d11-41e4ea88427d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:46.318367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-514916fa-d20e-46ad-9d11-41e4ea88427d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:46.333010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-514916fa-d20e-46ad-9d11-41e4ea88427d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:46.337847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-514916fa-d20e-46ad-9d11-41e4ea88427d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:46.339966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-514916fa-d20e-46ad-9d11-41e4ea88427d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:46.343412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-514916fa-d20e-46ad-9d11-41e4ea88427d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:46.344090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-514916fa-d20e-46ad-9d11-41e4ea88427d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:46.344871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-514916fa-d20e-46ad-9d11-41e4ea88427d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:46.670987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f9449a40-618c-4b29-997b-5428b9b42f22 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:46.680704 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f9449a40-618c-4b29-997b-5428b9b42f22 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189" status: 200 len: 1577 microversion: 2.1 time: 0.627726 Oct 04 21:15:46.687952 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1279/2482] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:46 2022] GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 => generated 1577 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:46.716898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f1cbacfa-30c9-4a86-95a0-c04ca8c62448 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:46.725318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f1cbacfa-30c9-4a86-95a0-c04ca8c62448 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:46.733094 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-514916fa-d20e-46ad-9d11-41e4ea88427d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "POST /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad/action" status: 202 len: 0 microversion: 2.1 time: 0.425944 Oct 04 21:15:46.736170 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1204/2483] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:15:46 2022] POST /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:15:46.740341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1cbacfa-30c9-4a86-95a0-c04ca8c62448 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:46.741004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1cbacfa-30c9-4a86-95a0-c04ca8c62448 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:46.744087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1cbacfa-30c9-4a86-95a0-c04ca8c62448 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:46.744956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1cbacfa-30c9-4a86-95a0-c04ca8c62448 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:46.748813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1cbacfa-30c9-4a86-95a0-c04ca8c62448 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:46.749561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1cbacfa-30c9-4a86-95a0-c04ca8c62448 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:46.756855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c6b64290-2470-4c74-8118-ce498e96b12a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:46.756855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c6b64290-2470-4c74-8118-ce498e96b12a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:46.781661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6b64290-2470-4c74-8118-ce498e96b12a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:46.784068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6b64290-2470-4c74-8118-ce498e96b12a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:46.784738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6b64290-2470-4c74-8118-ce498e96b12a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:46.787051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6b64290-2470-4c74-8118-ce498e96b12a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:46.794842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6b64290-2470-4c74-8118-ce498e96b12a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:46.797374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6b64290-2470-4c74-8118-ce498e96b12a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:47.171421 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f1cbacfa-30c9-4a86-95a0-c04ca8c62448 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.464807 Oct 04 21:15:47.180102 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1280/2484] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:15:46 2022] GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189/os-interface => generated 285 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:47.273915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-001d486d-86f5-4105-9775-bb0b34cfdede tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:47.275267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-001d486d-86f5-4105-9775-bb0b34cfdede tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:47.288152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-001d486d-86f5-4105-9775-bb0b34cfdede tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:47.288985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-001d486d-86f5-4105-9775-bb0b34cfdede tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:47.291948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-001d486d-86f5-4105-9775-bb0b34cfdede tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:47.296755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-001d486d-86f5-4105-9775-bb0b34cfdede tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:47.296755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-001d486d-86f5-4105-9775-bb0b34cfdede tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:47.296755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-001d486d-86f5-4105-9775-bb0b34cfdede tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:47.369827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c6b64290-2470-4c74-8118-ce498e96b12a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:47.386432 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c6b64290-2470-4c74-8118-ce498e96b12a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1522 microversion: 2.1 time: 0.642964 Oct 04 21:15:47.386894 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1205/2485] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:46 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1522 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:47.938300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-001d486d-86f5-4105-9775-bb0b34cfdede tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:47.946565 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-001d486d-86f5-4105-9775-bb0b34cfdede tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1534 microversion: 2.1 time: 0.678453 Oct 04 21:15:47.947984 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1281/2486] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:47 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1534 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:48.410764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b72235ea-f306-4e22-b40b-41ef5d49e016 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:48.412414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b72235ea-f306-4e22-b40b-41ef5d49e016 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:48.426574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b72235ea-f306-4e22-b40b-41ef5d49e016 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:48.431606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b72235ea-f306-4e22-b40b-41ef5d49e016 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:48.432382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b72235ea-f306-4e22-b40b-41ef5d49e016 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:48.433510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b72235ea-f306-4e22-b40b-41ef5d49e016 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:48.434781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b72235ea-f306-4e22-b40b-41ef5d49e016 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:48.438003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b72235ea-f306-4e22-b40b-41ef5d49e016 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:48.814000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-cfd10989-9f8f-4936-9d59-1a8ad0abaa43 req-5caab5e9-c9e0-4e2b-8577-a43081528053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0250fa-4053-4bec-81bb-b5f857310687", "tag": "9965e6e8-265e-42f4-906a-f53b455b8c28"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:48.842001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-cfd10989-9f8f-4936-9d59-1a8ad0abaa43 req-5caab5e9-c9e0-4e2b-8577-a43081528053 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:48.842494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-cfd10989-9f8f-4936-9d59-1a8ad0abaa43 req-5caab5e9-c9e0-4e2b-8577-a43081528053 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:48.842933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-cfd10989-9f8f-4936-9d59-1a8ad0abaa43 req-5caab5e9-c9e0-4e2b-8577-a43081528053 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:48.883132 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-cfd10989-9f8f-4936-9d59-1a8ad0abaa43 req-5caab5e9-c9e0-4e2b-8577-a43081528053 service nova] Creating event network-changed:9965e6e8-265e-42f4-906a-f53b455b8c28 for instance 0f0250fa-4053-4bec-81bb-b5f857310687 on n-h1-860282-1 Oct 04 21:15:48.892564 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-cfd10989-9f8f-4936-9d59-1a8ad0abaa43 req-5caab5e9-c9e0-4e2b-8577-a43081528053 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082437 Oct 04 21:15:48.893966 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1282/2487] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:15:48.975517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a958a44d-03ff-4406-bd65-ff0de5095dab tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:48.977432 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a958a44d-03ff-4406-bd65-ff0de5095dab tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:48.986183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a958a44d-03ff-4406-bd65-ff0de5095dab tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:48.987036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a958a44d-03ff-4406-bd65-ff0de5095dab tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:48.987738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a958a44d-03ff-4406-bd65-ff0de5095dab tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:48.989589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a958a44d-03ff-4406-bd65-ff0de5095dab tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:48.993872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a958a44d-03ff-4406-bd65-ff0de5095dab tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:48.993872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a958a44d-03ff-4406-bd65-ff0de5095dab tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:49.078641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b72235ea-f306-4e22-b40b-41ef5d49e016 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:49.097062 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b72235ea-f306-4e22-b40b-41ef5d49e016 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1502 microversion: 2.1 time: 0.689773 Oct 04 21:15:49.098109 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1206/2488] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:48 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1502 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:49.124973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fb7e2d15-1e74-4f74-af93-56e2193f87d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:49.128322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fb7e2d15-1e74-4f74-af93-56e2193f87d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:49.144523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb7e2d15-1e74-4f74-af93-56e2193f87d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:49.146598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb7e2d15-1e74-4f74-af93-56e2193f87d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:49.147450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb7e2d15-1e74-4f74-af93-56e2193f87d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:49.149067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb7e2d15-1e74-4f74-af93-56e2193f87d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:49.151997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb7e2d15-1e74-4f74-af93-56e2193f87d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:49.154299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb7e2d15-1e74-4f74-af93-56e2193f87d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:49.222785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-fb7e2d15-1e74-4f74-af93-56e2193f87d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lazy-loading 'flavor' on Instance uuid 89a86ffd-75a1-460b-ae59-24969ece95ad {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:15:49.261291 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-fb7e2d15-1e74-4f74-af93-56e2193f87d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] HTTP exception thrown: Cannot 'rescue' instance 89a86ffd-75a1-460b-ae59-24969ece95ad while it is in vm_state paused Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fb7e2d15-1e74-4f74-af93-56e2193f87d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Request method failure captured: Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad/action HTTP/1.1 Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 14 Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKIzNXd_CmvP-6Usf8igAzY3dlzgDYn--v5mxvj-LpxllWzzbFyJF08JoJ1PYfhtDQRJAhrGh_znPsymYAfveamBdA6vz1Y-oh2GJa7UDnV-tTkHC5ZL-7fb_GflotkDarrlFSqHRvs9b0CJFd3T0swEf2S9AMDAGMNIk353xt2G0b4 Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 047ff2c9b6414ce8b98364678cbfeb53 Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/047ff2c9b6414ce8b98364678cbfeb53"}]}] Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 047ff2c9b6414ce8b98364678cbfeb53 Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerRescueNegativeTestJSON-548947322-project Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: abb3ac58c2ea4e2da8b9e765eda5f333 Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerRescueNegativeTestJSON-548947322-project Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: {"rescue": {}} Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: exception: Cannot 'rescue' instance 89a86ffd-75a1-460b-ae59-24969ece95ad while it is in vm_state paused Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '89a86ffd-75a1-460b-ae59-24969ece95ad', 'body': {'rescue': {}}} Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 89a86ffd-75a1-460b-ae59-24969ece95ad in vm_state paused. Cannot rescue while the instance is in this state. Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 89a86ffd-75a1-460b-ae59-24969ece95ad while it is in vm_state paused Oct 04 21:15:49.267955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:49.271878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:49.271878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:49.271878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:49.271878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:49.271878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:49.271878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:49.271878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:49.271878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 89a86ffd-75a1-460b-ae59-24969ece95ad while it is in vm_state paused Oct 04 21:15:49.271878 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:49.274610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fb7e2d15-1e74-4f74-af93-56e2193f87d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Returning 409 to user: Cannot 'rescue' instance 89a86ffd-75a1-460b-ae59-24969ece95ad while it is in vm_state paused {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:49.275917 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fb7e2d15-1e74-4f74-af93-56e2193f87d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "POST /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad/action" status: 409 len: 144 microversion: 2.1 time: 0.156191 Oct 04 21:15:49.280651 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1207/2489] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:15:49 2022] POST /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad/action => generated 144 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 21:15:49.287875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f8542d77-2eee-4ff7-a275-13340b89785e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:49.289433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f8542d77-2eee-4ff7-a275-13340b89785e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:49.297940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8542d77-2eee-4ff7-a275-13340b89785e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:49.298722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8542d77-2eee-4ff7-a275-13340b89785e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:49.299369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8542d77-2eee-4ff7-a275-13340b89785e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:49.300238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8542d77-2eee-4ff7-a275-13340b89785e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:49.300988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8542d77-2eee-4ff7-a275-13340b89785e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:49.301617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8542d77-2eee-4ff7-a275-13340b89785e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:49.532896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a958a44d-03ff-4406-bd65-ff0de5095dab tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:49.540443 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a958a44d-03ff-4406-bd65-ff0de5095dab tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1521 microversion: 2.1 time: 0.572153 Oct 04 21:15:49.544751 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1283/2490] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:48 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1521 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:49.575201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-53c4b39f-2291-43f8-9e6e-a03105cd87f7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:49.575957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-53c4b39f-2291-43f8-9e6e-a03105cd87f7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:49.583360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53c4b39f-2291-43f8-9e6e-a03105cd87f7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:49.586004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53c4b39f-2291-43f8-9e6e-a03105cd87f7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:49.586516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53c4b39f-2291-43f8-9e6e-a03105cd87f7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:49.587240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53c4b39f-2291-43f8-9e6e-a03105cd87f7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:49.590364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53c4b39f-2291-43f8-9e6e-a03105cd87f7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:49.590865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53c4b39f-2291-43f8-9e6e-a03105cd87f7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:49.641133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-53c4b39f-2291-43f8-9e6e-a03105cd87f7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:15:49.698407 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f8542d77-2eee-4ff7-a275-13340b89785e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "POST /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad/action" status: 202 len: 0 microversion: 2.1 time: 0.414726 Oct 04 21:15:49.700806 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1208/2491] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:15:49 2022] POST /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:15:49.713709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-064286af-fd8b-4d2b-b6a3-9a3ed7ac7633 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:49.718310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-064286af-fd8b-4d2b-b6a3-9a3ed7ac7633 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:49.734172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-064286af-fd8b-4d2b-b6a3-9a3ed7ac7633 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:49.735389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-064286af-fd8b-4d2b-b6a3-9a3ed7ac7633 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:49.736931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-064286af-fd8b-4d2b-b6a3-9a3ed7ac7633 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:49.749499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-064286af-fd8b-4d2b-b6a3-9a3ed7ac7633 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:49.754617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-064286af-fd8b-4d2b-b6a3-9a3ed7ac7633 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:49.755601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-064286af-fd8b-4d2b-b6a3-9a3ed7ac7633 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:50.086523 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-53c4b39f-2291-43f8-9e6e-a03105cd87f7 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 204 len: 0 microversion: 2.1 time: 0.513297 Oct 04 21:15:50.089952 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1284/2492] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:15:49 2022] DELETE /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:15:50.102125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-82f5c952-4e8f-450b-8af6-55c6b91f4114 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:50.104769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-82f5c952-4e8f-450b-8af6-55c6b91f4114 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:50.125566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82f5c952-4e8f-450b-8af6-55c6b91f4114 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:50.126312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82f5c952-4e8f-450b-8af6-55c6b91f4114 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:50.128161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82f5c952-4e8f-450b-8af6-55c6b91f4114 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:50.130899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82f5c952-4e8f-450b-8af6-55c6b91f4114 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:50.137483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82f5c952-4e8f-450b-8af6-55c6b91f4114 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:50.141139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82f5c952-4e8f-450b-8af6-55c6b91f4114 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:50.566628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-064286af-fd8b-4d2b-b6a3-9a3ed7ac7633 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:50.576583 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-064286af-fd8b-4d2b-b6a3-9a3ed7ac7633 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1509 microversion: 2.1 time: 0.870667 Oct 04 21:15:50.577790 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1209/2493] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:49 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1509 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:50.818864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-82f5c952-4e8f-450b-8af6-55c6b91f4114 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:50.837613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-3a0b8bba-8253-4302-a7c0-f2dbcdf60e7e req-af3e7252-9ee6-47c4-9672-b4097579bb4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e99ebe26-2264-4e7c-ac4e-6f8e0435b98d", "name": "network-vif-plugged", "status": "completed", "tag": "50ba1a2d-1433-4efe-9099-65de8ac34177"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:50.845272 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-82f5c952-4e8f-450b-8af6-55c6b91f4114 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1527 microversion: 2.1 time: 0.746477 Oct 04 21:15:50.858214 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1285/2494] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:50 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1527 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:50.874923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3a0b8bba-8253-4302-a7c0-f2dbcdf60e7e req-af3e7252-9ee6-47c4-9672-b4097579bb4f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:50.878628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3a0b8bba-8253-4302-a7c0-f2dbcdf60e7e req-af3e7252-9ee6-47c4-9672-b4097579bb4f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:50.878628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3a0b8bba-8253-4302-a7c0-f2dbcdf60e7e req-af3e7252-9ee6-47c4-9672-b4097579bb4f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:50.897532 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-3a0b8bba-8253-4302-a7c0-f2dbcdf60e7e req-af3e7252-9ee6-47c4-9672-b4097579bb4f service nova] Creating event network-vif-plugged:50ba1a2d-1433-4efe-9099-65de8ac34177 for instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d on n-h1-860282-1 Oct 04 21:15:50.904475 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-3a0b8bba-8253-4302-a7c0-f2dbcdf60e7e req-af3e7252-9ee6-47c4-9672-b4097579bb4f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073575 Oct 04 21:15:50.905577 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1210/2495] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:51.614707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-962288cc-d963-413a-b85a-15ad4e5ec2b9 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:51.616296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-35bbca3a-7a3c-40f9-8415-f9dc70abb099 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:51.618236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-35bbca3a-7a3c-40f9-8415-f9dc70abb099 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:51.618797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-962288cc-d963-413a-b85a-15ad4e5ec2b9 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:51.648639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35bbca3a-7a3c-40f9-8415-f9dc70abb099 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:51.650635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-962288cc-d963-413a-b85a-15ad4e5ec2b9 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:51.651147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-962288cc-d963-413a-b85a-15ad4e5ec2b9 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:51.652495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35bbca3a-7a3c-40f9-8415-f9dc70abb099 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:51.652962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35bbca3a-7a3c-40f9-8415-f9dc70abb099 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:51.653751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35bbca3a-7a3c-40f9-8415-f9dc70abb099 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:51.654219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35bbca3a-7a3c-40f9-8415-f9dc70abb099 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:51.654844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35bbca3a-7a3c-40f9-8415-f9dc70abb099 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:51.655124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-962288cc-d963-413a-b85a-15ad4e5ec2b9 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:51.655950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-962288cc-d963-413a-b85a-15ad4e5ec2b9 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:51.656424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-962288cc-d963-413a-b85a-15ad4e5ec2b9 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:51.661184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-962288cc-d963-413a-b85a-15ad4e5ec2b9 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:53.114884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-962288cc-d963-413a-b85a-15ad4e5ec2b9 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:53.129270 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-962288cc-d963-413a-b85a-15ad4e5ec2b9 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189" status: 200 len: 1577 microversion: 2.1 time: 1.524647 Oct 04 21:15:53.133113 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1211/2496] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:51 2022] GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 => generated 1577 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:53.150946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5dcbc72a-695d-4e07-bae3-7ea5b6017c9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:53.159053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5dcbc72a-695d-4e07-bae3-7ea5b6017c9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:53.176023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5dcbc72a-695d-4e07-bae3-7ea5b6017c9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:53.177401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5dcbc72a-695d-4e07-bae3-7ea5b6017c9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:53.181069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5dcbc72a-695d-4e07-bae3-7ea5b6017c9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:53.183213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5dcbc72a-695d-4e07-bae3-7ea5b6017c9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:53.183645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5dcbc72a-695d-4e07-bae3-7ea5b6017c9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:53.185690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5dcbc72a-695d-4e07-bae3-7ea5b6017c9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:53.237360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:53.725355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-35bbca3a-7a3c-40f9-8415-f9dc70abb099 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:53.747560 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-35bbca3a-7a3c-40f9-8415-f9dc70abb099 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1517 microversion: 2.1 time: 2.141963 Oct 04 21:15:53.747835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5dcbc72a-695d-4e07-bae3-7ea5b6017c9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:53.766508 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1286/2497] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:51 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1517 bytes in 2157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:53.768061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-1c6afcf1-009a-4e43-91dc-60077bdd4a44 req-808fc2b1-1d0e-4209-a41e-157dd65ca836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7141667-2475-4be1-9296-ad67dbd94189", "tag": "a62cebb4-a5f0-4b37-aa2d-9adf1cdf2efb"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:53.825129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1c6afcf1-009a-4e43-91dc-60077bdd4a44 req-808fc2b1-1d0e-4209-a41e-157dd65ca836 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:53.826327 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5dcbc72a-695d-4e07-bae3-7ea5b6017c9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1527 microversion: 2.1 time: 0.683342 Oct 04 21:15:53.826977 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1212/2498] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:53 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1527 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:53.835325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1c6afcf1-009a-4e43-91dc-60077bdd4a44 req-808fc2b1-1d0e-4209-a41e-157dd65ca836 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:53.836298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1c6afcf1-009a-4e43-91dc-60077bdd4a44 req-808fc2b1-1d0e-4209-a41e-157dd65ca836 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:53.855765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-67bf8304-b097-4963-bde7-98f019b6b015 req-370ecdd4-ffb3-46ef-84b5-f5ec61014f85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e99ebe26-2264-4e7c-ac4e-6f8e0435b98d", "name": "network-vif-unplugged", "status": "completed", "tag": "50ba1a2d-1433-4efe-9099-65de8ac34177"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:53.871515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:53.883986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-67bf8304-b097-4963-bde7-98f019b6b015 req-370ecdd4-ffb3-46ef-84b5-f5ec61014f85 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:53.884742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-67bf8304-b097-4963-bde7-98f019b6b015 req-370ecdd4-ffb3-46ef-84b5-f5ec61014f85 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:53.885337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-67bf8304-b097-4963-bde7-98f019b6b015 req-370ecdd4-ffb3-46ef-84b5-f5ec61014f85 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:53.891647 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-1c6afcf1-009a-4e43-91dc-60077bdd4a44 req-808fc2b1-1d0e-4209-a41e-157dd65ca836 service nova] Creating event network-changed:a62cebb4-a5f0-4b37-aa2d-9adf1cdf2efb for instance e7141667-2475-4be1-9296-ad67dbd94189 on n-h2-860282-1 Oct 04 21:15:53.895831 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-1c6afcf1-009a-4e43-91dc-60077bdd4a44 req-808fc2b1-1d0e-4209-a41e-157dd65ca836 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139133 Oct 04 21:15:53.897387 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1287/2499] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:53.904524 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-67bf8304-b097-4963-bde7-98f019b6b015 req-370ecdd4-ffb3-46ef-84b5-f5ec61014f85 service nova] Creating event network-vif-unplugged:50ba1a2d-1433-4efe-9099-65de8ac34177 for instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d on n-h1-860282-1 Oct 04 21:15:53.911836 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-67bf8304-b097-4963-bde7-98f019b6b015 req-370ecdd4-ffb3-46ef-84b5-f5ec61014f85 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076030 Oct 04 21:15:53.917809 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1213/2500] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:54.855238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-30e04621-1703-437d-a74e-62f6a091a043 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:54.856092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-30e04621-1703-437d-a74e-62f6a091a043 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:54.868788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30e04621-1703-437d-a74e-62f6a091a043 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:54.868788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30e04621-1703-437d-a74e-62f6a091a043 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:54.868788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30e04621-1703-437d-a74e-62f6a091a043 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:54.874963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30e04621-1703-437d-a74e-62f6a091a043 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:54.875651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30e04621-1703-437d-a74e-62f6a091a043 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:54.876192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30e04621-1703-437d-a74e-62f6a091a043 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:55.002430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-30e04621-1703-437d-a74e-62f6a091a043 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:55.015689 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-30e04621-1703-437d-a74e-62f6a091a043 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1485 microversion: 2.1 time: 0.165967 Oct 04 21:15:55.023793 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1214/2501] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:54 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1485 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:55.623591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2796bb0a-8635-4cc1-901c-de43d1acc67f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-2089600486", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "5705269e-a277-4ae4-8dba-51564dfd8922"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:55.759278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-2796bb0a-8635-4cc1-901c-de43d1acc67f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] validate_networks() for [('5705269e-a277-4ae4-8dba-51564dfd8922', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:15:55.938575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b077219a-9299-4e99-9378-520f666362e8 req-4368ddc8-1691-464c-ab04-3e74adf2a87d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e99ebe26-2264-4e7c-ac4e-6f8e0435b98d", "name": "network-vif-deleted", "tag": "50ba1a2d-1433-4efe-9099-65de8ac34177"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:55.962814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b077219a-9299-4e99-9378-520f666362e8 req-4368ddc8-1691-464c-ab04-3e74adf2a87d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:55.969154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b077219a-9299-4e99-9378-520f666362e8 req-4368ddc8-1691-464c-ab04-3e74adf2a87d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:55.972874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b077219a-9299-4e99-9378-520f666362e8 req-4368ddc8-1691-464c-ab04-3e74adf2a87d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:56.027211 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b077219a-9299-4e99-9378-520f666362e8 req-4368ddc8-1691-464c-ab04-3e74adf2a87d service nova] Creating event network-vif-deleted:50ba1a2d-1433-4efe-9099-65de8ac34177 for instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d on n-h1-860282-1 Oct 04 21:15:56.049876 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b077219a-9299-4e99-9378-520f666362e8 req-4368ddc8-1691-464c-ab04-3e74adf2a87d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115593 Oct 04 21:15:56.055743 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1215/2502] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:56.070570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8787c222-b33d-423e-a79d-cba302f840c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:56.071414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8787c222-b33d-423e-a79d-cba302f840c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:56.080702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8787c222-b33d-423e-a79d-cba302f840c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:56.087932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8787c222-b33d-423e-a79d-cba302f840c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:56.088512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8787c222-b33d-423e-a79d-cba302f840c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:56.089331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8787c222-b33d-423e-a79d-cba302f840c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:56.089922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8787c222-b33d-423e-a79d-cba302f840c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:56.090575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8787c222-b33d-423e-a79d-cba302f840c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:56.140132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8787c222-b33d-423e-a79d-cba302f840c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:56.142870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8787c222-b33d-423e-a79d-cba302f840c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:56.142870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8787c222-b33d-423e-a79d-cba302f840c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:56.142870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-8787c222-b33d-423e-a79d-cba302f840c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lazy-loading 'fault' on Instance uuid e99ebe26-2264-4e7c-ac4e-6f8e0435b98d {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:15:56.245057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8787c222-b33d-423e-a79d-cba302f840c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:56.260692 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8787c222-b33d-423e-a79d-cba302f840c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 200 len: 1314 microversion: 2.1 time: 0.194907 Oct 04 21:15:56.263152 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1216/2503] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:56 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:56.604827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2796bb0a-8635-4cc1-901c-de43d1acc67f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:15:56.606016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2796bb0a-8635-4cc1-901c-de43d1acc67f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:15:56.606016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2796bb0a-8635-4cc1-901c-de43d1acc67f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:15:56.606280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2796bb0a-8635-4cc1-901c-de43d1acc67f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:15:56.607306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2796bb0a-8635-4cc1-901c-de43d1acc67f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:15:56.642437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2796bb0a-8635-4cc1-901c-de43d1acc67f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:56.644960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2796bb0a-8635-4cc1-901c-de43d1acc67f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:56.646908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2796bb0a-8635-4cc1-901c-de43d1acc67f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:56.650798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2796bb0a-8635-4cc1-901c-de43d1acc67f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:56.656411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2796bb0a-8635-4cc1-901c-de43d1acc67f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:56.657260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2796bb0a-8635-4cc1-901c-de43d1acc67f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:56.700958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-2796bb0a-8635-4cc1-901c-de43d1acc67f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Getting quotas for project b2ea0a3effb846858c46355590f437cf. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:56.711119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:56.714298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-2796bb0a-8635-4cc1-901c-de43d1acc67f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Getting quotas for user e46858a6edfa435bb7c68cdc13c05539 and project b2ea0a3effb846858c46355590f437cf. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:56.758669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2796bb0a-8635-4cc1-901c-de43d1acc67f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:15:56.762715 n-d-860282-1 devstack@n-api.service[122758]: WARNING nova.utils [None req-2796bb0a-8635-4cc1-901c-de43d1acc67f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-2089600486 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-208960048 Oct 04 21:15:56.764078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2796bb0a-8635-4cc1-901c-de43d1acc67f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:15:56.935407 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2796bb0a-8635-4cc1-901c-de43d1acc67f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.286686 Oct 04 21:15:56.942484 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1288/2504] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:15:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:15:56.950128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-86e4b286-35b1-4200-a351-d048de5b2a75 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:56.951307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-86e4b286-35b1-4200-a351-d048de5b2a75 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:56.959210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:57.066218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-86e4b286-35b1-4200-a351-d048de5b2a75 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:57.076408 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-86e4b286-35b1-4200-a351-d048de5b2a75 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1232 microversion: 2.1 time: 0.132869 Oct 04 21:15:57.076997 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1217/2505] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:56 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1232 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:57.160011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-48198b4c-d9dc-4128-b5a8-8cecd68bd853 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:57.162524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-48198b4c-d9dc-4128-b5a8-8cecd68bd853 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:57.170320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48198b4c-d9dc-4128-b5a8-8cecd68bd853 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:57.170817 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48198b4c-d9dc-4128-b5a8-8cecd68bd853 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:57.171597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48198b4c-d9dc-4128-b5a8-8cecd68bd853 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:57.172976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48198b4c-d9dc-4128-b5a8-8cecd68bd853 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:57.180328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48198b4c-d9dc-4128-b5a8-8cecd68bd853 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:57.180328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48198b4c-d9dc-4128-b5a8-8cecd68bd853 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:57.213787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-48198b4c-d9dc-4128-b5a8-8cecd68bd853 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lazy-loading 'flavor' on Instance uuid 89a86ffd-75a1-460b-ae59-24969ece95ad {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:15:57.290202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e4eb9b72-6d83-4815-9c62-10d2cf8e7bbb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:57.291216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e4eb9b72-6d83-4815-9c62-10d2cf8e7bbb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:57.299014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4eb9b72-6d83-4815-9c62-10d2cf8e7bbb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:57.307915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4eb9b72-6d83-4815-9c62-10d2cf8e7bbb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:57.312310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4eb9b72-6d83-4815-9c62-10d2cf8e7bbb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:57.314035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4eb9b72-6d83-4815-9c62-10d2cf8e7bbb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:57.315530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4eb9b72-6d83-4815-9c62-10d2cf8e7bbb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:57.316178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4eb9b72-6d83-4815-9c62-10d2cf8e7bbb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:57.341204 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-e4eb9b72-6d83-4815-9c62-10d2cf8e7bbb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] HTTP exception thrown: Instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d could not be found. Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e4eb9b72-6d83-4815-9c62-10d2cf8e7bbb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Request method failure captured: Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d HTTP/1.1 Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKIfr0EKjh9lIGpSMallYOOhbfjlmceWYXhhzEhZtKG-K5Qftah8sJPPQwARLxF148gLNgWQ6TQI3CtHtfXOURD85vgsMSrUAP7uSOEzn9FGu8hya9wg7xCbpv6yrgC_TH3BeALF5PS38pqVs3tUVO2zaGck0ZnqjmCZGgWvxK0EmDc Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 4df42993975949899553deaeaffada73 Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4df42993975949899553deaeaffada73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4df42993975949899553deaeaffada73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}] Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 4df42993975949899553deaeaffada73 Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 4d401d8a2c8e4cee856badba313ed00a Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d could not be found. Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'e99ebe26-2264-4e7c-ac4e-6f8e0435b98d'} Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d could not be found. Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d could not be found. Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:57.343543 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:57.349789 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:57.349789 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:57.349789 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:57.349789 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:57.349789 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:57.349789 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:57.349789 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d could not be found. Oct 04 21:15:57.349789 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:15:57.349789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e4eb9b72-6d83-4815-9c62-10d2cf8e7bbb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Returning 404 to user: Instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:57.349789 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e4eb9b72-6d83-4815-9c62-10d2cf8e7bbb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 404 len: 111 microversion: 2.1 time: 0.060559 Oct 04 21:15:57.354909 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1218/2506] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:57 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:15:57.632169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-afa1fbc7-77d5-43b5-a43c-c6883879fb2b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1564381382", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:57.704583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-afa1fbc7-77d5-43b5-a43c-c6883879fb2b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] validate_networks() for [('a1aa70e9-3daa-4749-bfb3-05caabbf7400', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:15:57.762154 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-48198b4c-d9dc-4128-b5a8-8cecd68bd853 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "POST /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad/action" status: 200 len: 32 microversion: 2.1 time: 0.606146 Oct 04 21:15:57.762154 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1289/2507] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:15:57 2022] POST /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad/action => generated 32 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:15:57.773718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b8f400c3-cb3c-4f40-973b-1a85b658cd4e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:57.775421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b8f400c3-cb3c-4f40-973b-1a85b658cd4e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:57.789336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8f400c3-cb3c-4f40-973b-1a85b658cd4e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:57.792751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8f400c3-cb3c-4f40-973b-1a85b658cd4e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:57.794607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8f400c3-cb3c-4f40-973b-1a85b658cd4e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:57.795689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8f400c3-cb3c-4f40-973b-1a85b658cd4e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:57.797485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8f400c3-cb3c-4f40-973b-1a85b658cd4e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:57.799900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8f400c3-cb3c-4f40-973b-1a85b658cd4e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:58.395957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b8f400c3-cb3c-4f40-973b-1a85b658cd4e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:58.406991 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b8f400c3-cb3c-4f40-973b-1a85b658cd4e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1523 microversion: 2.1 time: 0.639110 Oct 04 21:15:58.409538 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1290/2508] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:57 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1523 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:58.424716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-77ecf362-0443-4728-b3e8-42d38e4a3198 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:58.427633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-77ecf362-0443-4728-b3e8-42d38e4a3198 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:58.656986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-77ecf362-0443-4728-b3e8-42d38e4a3198 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:58.671297 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-77ecf362-0443-4728-b3e8-42d38e4a3198 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1232 microversion: 2.1 time: 0.255478 Oct 04 21:15:58.674730 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1291/2509] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:58 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1232 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:59.189759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-afa1fbc7-77d5-43b5-a43c-c6883879fb2b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:15:59.191748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-afa1fbc7-77d5-43b5-a43c-c6883879fb2b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:15:59.192535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-afa1fbc7-77d5-43b5-a43c-c6883879fb2b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:15:59.193136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-afa1fbc7-77d5-43b5-a43c-c6883879fb2b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:15:59.193789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-afa1fbc7-77d5-43b5-a43c-c6883879fb2b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:15:59.220978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afa1fbc7-77d5-43b5-a43c-c6883879fb2b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:59.221942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afa1fbc7-77d5-43b5-a43c-c6883879fb2b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:59.223780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afa1fbc7-77d5-43b5-a43c-c6883879fb2b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:59.228674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afa1fbc7-77d5-43b5-a43c-c6883879fb2b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:59.229360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afa1fbc7-77d5-43b5-a43c-c6883879fb2b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:59.231085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afa1fbc7-77d5-43b5-a43c-c6883879fb2b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:59.270398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-afa1fbc7-77d5-43b5-a43c-c6883879fb2b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Getting quotas for project 4df42993975949899553deaeaffada73. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:59.284539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-afa1fbc7-77d5-43b5-a43c-c6883879fb2b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Getting quotas for user 4d401d8a2c8e4cee856badba313ed00a and project 4df42993975949899553deaeaffada73. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:59.332475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-afa1fbc7-77d5-43b5-a43c-c6883879fb2b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:15:59.341830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-afa1fbc7-77d5-43b5-a43c-c6883879fb2b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:15:59.445650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-849aca49-55bd-4cec-8885-bf860b7098ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:59.446918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-849aca49-55bd-4cec-8885-bf860b7098ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:59.459482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-849aca49-55bd-4cec-8885-bf860b7098ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:59.461820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-849aca49-55bd-4cec-8885-bf860b7098ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:59.466155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-849aca49-55bd-4cec-8885-bf860b7098ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:59.471613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-849aca49-55bd-4cec-8885-bf860b7098ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:59.472193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-849aca49-55bd-4cec-8885-bf860b7098ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:59.472635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-849aca49-55bd-4cec-8885-bf860b7098ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:59.543012 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-afa1fbc7-77d5-43b5-a43c-c6883879fb2b tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.915185 Oct 04 21:15:59.543661 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1219/2510] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:15:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:15:59.565712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-158373e6-1091-44b3-ba10-94509ada5095 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:59.581885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-158373e6-1091-44b3-ba10-94509ada5095 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:59.676288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-158373e6-1091-44b3-ba10-94509ada5095 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:59.688154 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-158373e6-1091-44b3-ba10-94509ada5095 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1" status: 200 len: 1225 microversion: 2.1 time: 0.128493 Oct 04 21:15:59.688597 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1220/2511] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:59 2022] GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:59.707928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1b24f570-72af-493c-9c97-24b1be391e20 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:59.708998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1b24f570-72af-493c-9c97-24b1be391e20 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:59.721274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1b24f570-72af-493c-9c97-24b1be391e20 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:59.723836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1b24f570-72af-493c-9c97-24b1be391e20 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:59.724489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1b24f570-72af-493c-9c97-24b1be391e20 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:59.725565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1b24f570-72af-493c-9c97-24b1be391e20 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:59.729617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1b24f570-72af-493c-9c97-24b1be391e20 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:59.734888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1b24f570-72af-493c-9c97-24b1be391e20 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:59.861901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-849aca49-55bd-4cec-8885-bf860b7098ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:59.873087 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-849aca49-55bd-4cec-8885-bf860b7098ad tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1523 microversion: 2.1 time: 0.440944 Oct 04 21:15:59.895096 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1292/2512] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:59 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1523 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:59.933244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1b24f570-72af-493c-9c97-24b1be391e20 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:59.944654 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1b24f570-72af-493c-9c97-24b1be391e20 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1284 microversion: 2.1 time: 0.250501 Oct 04 21:15:59.945909 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1221/2513] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:59 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1284 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:00.718108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3cb60524-b4f7-4da4-87b7-307d8b096cdc tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:00.718885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3cb60524-b4f7-4da4-87b7-307d8b096cdc tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:00.823150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3cb60524-b4f7-4da4-87b7-307d8b096cdc tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:00.843094 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3cb60524-b4f7-4da4-87b7-307d8b096cdc tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1" status: 200 len: 1225 microversion: 2.1 time: 0.129293 Oct 04 21:16:00.845753 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1293/2514] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:00 2022] GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 => generated 1225 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:00.902694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-44850931-502b-4627-9f85-248bad44adde tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:00.904138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-44850931-502b-4627-9f85-248bad44adde tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:00.916134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44850931-502b-4627-9f85-248bad44adde tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:00.917820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44850931-502b-4627-9f85-248bad44adde tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:00.918532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44850931-502b-4627-9f85-248bad44adde tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:00.919613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44850931-502b-4627-9f85-248bad44adde tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:00.920397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44850931-502b-4627-9f85-248bad44adde tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:00.921019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44850931-502b-4627-9f85-248bad44adde tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:00.984106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9775f4ac-deb7-420c-855a-d9dbbc0a8886 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:00.988311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9775f4ac-deb7-420c-855a-d9dbbc0a8886 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:01.002720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9775f4ac-deb7-420c-855a-d9dbbc0a8886 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:01.003234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9775f4ac-deb7-420c-855a-d9dbbc0a8886 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:01.003675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9775f4ac-deb7-420c-855a-d9dbbc0a8886 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:01.004380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9775f4ac-deb7-420c-855a-d9dbbc0a8886 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:01.004836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9775f4ac-deb7-420c-855a-d9dbbc0a8886 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:01.010670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9775f4ac-deb7-420c-855a-d9dbbc0a8886 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:01.173385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9775f4ac-deb7-420c-855a-d9dbbc0a8886 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:01.184238 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9775f4ac-deb7-420c-855a-d9dbbc0a8886 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1302 microversion: 2.1 time: 0.216594 Oct 04 21:16:01.186812 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1294/2515] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:00 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1302 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:01.390823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-44850931-502b-4627-9f85-248bad44adde tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:01.403378 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-44850931-502b-4627-9f85-248bad44adde tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1523 microversion: 2.1 time: 0.504092 Oct 04 21:16:01.407793 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1222/2516] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:00 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1523 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:01.871460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e439bc9c-c555-4360-b184-c94d0364ffa6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:01.872120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e439bc9c-c555-4360-b184-c94d0364ffa6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:01.880841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e439bc9c-c555-4360-b184-c94d0364ffa6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:01.881339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e439bc9c-c555-4360-b184-c94d0364ffa6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:01.881971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e439bc9c-c555-4360-b184-c94d0364ffa6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:01.888697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e439bc9c-c555-4360-b184-c94d0364ffa6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:01.888697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e439bc9c-c555-4360-b184-c94d0364ffa6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:01.888941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e439bc9c-c555-4360-b184-c94d0364ffa6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:02.068537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e439bc9c-c555-4360-b184-c94d0364ffa6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:02.095522 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e439bc9c-c555-4360-b184-c94d0364ffa6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1" status: 200 len: 1221 microversion: 2.1 time: 0.227602 Oct 04 21:16:02.099622 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1295/2517] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:01 2022] GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 => generated 1221 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:02.208064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8d6ca528-a2e1-4daf-aadb-296347b3e8b2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:02.209348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8d6ca528-a2e1-4daf-aadb-296347b3e8b2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:02.218933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d6ca528-a2e1-4daf-aadb-296347b3e8b2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:02.222810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d6ca528-a2e1-4daf-aadb-296347b3e8b2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:02.223517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d6ca528-a2e1-4daf-aadb-296347b3e8b2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:02.226252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d6ca528-a2e1-4daf-aadb-296347b3e8b2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:02.228913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d6ca528-a2e1-4daf-aadb-296347b3e8b2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:02.230082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d6ca528-a2e1-4daf-aadb-296347b3e8b2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:02.427430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f24ec31f-8599-4bfa-8deb-6a0ed43644fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:02.428039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f24ec31f-8599-4bfa-8deb-6a0ed43644fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:02.441033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f24ec31f-8599-4bfa-8deb-6a0ed43644fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:02.441551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f24ec31f-8599-4bfa-8deb-6a0ed43644fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:02.445180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f24ec31f-8599-4bfa-8deb-6a0ed43644fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:02.450467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f24ec31f-8599-4bfa-8deb-6a0ed43644fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:02.456059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f24ec31f-8599-4bfa-8deb-6a0ed43644fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:02.460609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f24ec31f-8599-4bfa-8deb-6a0ed43644fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:03.037775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f24ec31f-8599-4bfa-8deb-6a0ed43644fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:03.048998 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f24ec31f-8599-4bfa-8deb-6a0ed43644fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1523 microversion: 2.1 time: 0.618834 Oct 04 21:16:03.049902 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1296/2518] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:02 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1523 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:03.124361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-35a0d18f-b3a8-45f7-b944-a55836e8fdae tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:03.125044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-35a0d18f-b3a8-45f7-b944-a55836e8fdae tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:03.141729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35a0d18f-b3a8-45f7-b944-a55836e8fdae tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:03.141729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35a0d18f-b3a8-45f7-b944-a55836e8fdae tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:03.141729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35a0d18f-b3a8-45f7-b944-a55836e8fdae tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:03.141729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35a0d18f-b3a8-45f7-b944-a55836e8fdae tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:03.141729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35a0d18f-b3a8-45f7-b944-a55836e8fdae tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:03.141729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35a0d18f-b3a8-45f7-b944-a55836e8fdae tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:03.213098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8d6ca528-a2e1-4daf-aadb-296347b3e8b2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:03.244686 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8d6ca528-a2e1-4daf-aadb-296347b3e8b2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1332 microversion: 2.1 time: 1.040260 Oct 04 21:16:03.255037 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1223/2519] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:02 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1332 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:03.358939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-35a0d18f-b3a8-45f7-b944-a55836e8fdae tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:03.403908 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-35a0d18f-b3a8-45f7-b944-a55836e8fdae tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1" status: 200 len: 1285 microversion: 2.1 time: 0.283354 Oct 04 21:16:03.439534 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1297/2520] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:03 2022] GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 => generated 1285 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:04.081147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e52707a9-436c-49b4-916b-781a500e2319 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:04.082534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e52707a9-436c-49b4-916b-781a500e2319 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:04.096876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e52707a9-436c-49b4-916b-781a500e2319 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:04.097924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e52707a9-436c-49b4-916b-781a500e2319 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:04.101628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e52707a9-436c-49b4-916b-781a500e2319 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:04.102500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e52707a9-436c-49b4-916b-781a500e2319 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:04.103997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e52707a9-436c-49b4-916b-781a500e2319 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:04.108154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e52707a9-436c-49b4-916b-781a500e2319 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:04.276762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-43300760-a54e-4183-baa2-e0d24790a9af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:04.277410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-43300760-a54e-4183-baa2-e0d24790a9af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:04.287129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43300760-a54e-4183-baa2-e0d24790a9af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:04.287430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43300760-a54e-4183-baa2-e0d24790a9af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:04.287873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43300760-a54e-4183-baa2-e0d24790a9af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:04.288623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43300760-a54e-4183-baa2-e0d24790a9af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:04.289164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43300760-a54e-4183-baa2-e0d24790a9af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:04.289810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43300760-a54e-4183-baa2-e0d24790a9af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:04.880848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e52707a9-436c-49b4-916b-781a500e2319 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:04.895601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-43300760-a54e-4183-baa2-e0d24790a9af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:04.898671 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e52707a9-436c-49b4-916b-781a500e2319 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1523 microversion: 2.1 time: 0.823641 Oct 04 21:16:04.900375 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1224/2521] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:04 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1523 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:04.926991 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-43300760-a54e-4183-baa2-e0d24790a9af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1332 microversion: 2.1 time: 0.654593 Oct 04 21:16:04.928109 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1298/2522] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:04 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1332 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:04.931488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d875fd00-a2b3-4267-975e-8461eab7e02d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:04.934281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d875fd00-a2b3-4267-975e-8461eab7e02d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:04.955863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d875fd00-a2b3-4267-975e-8461eab7e02d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:04.956541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d875fd00-a2b3-4267-975e-8461eab7e02d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:04.957150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d875fd00-a2b3-4267-975e-8461eab7e02d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:04.958171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d875fd00-a2b3-4267-975e-8461eab7e02d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:04.958784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d875fd00-a2b3-4267-975e-8461eab7e02d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:04.959366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d875fd00-a2b3-4267-975e-8461eab7e02d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:05.164654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d875fd00-a2b3-4267-975e-8461eab7e02d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:05.195872 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d875fd00-a2b3-4267-975e-8461eab7e02d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1" status: 200 len: 1283 microversion: 2.1 time: 0.290945 Oct 04 21:16:05.197323 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1225/2523] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:04 2022] GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 => generated 1283 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:05.926766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c5e579d4-19d7-4df9-b71f-e6344f994b75 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:05.927397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c5e579d4-19d7-4df9-b71f-e6344f994b75 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:05.949542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5e579d4-19d7-4df9-b71f-e6344f994b75 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:05.949542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5e579d4-19d7-4df9-b71f-e6344f994b75 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:05.950090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5e579d4-19d7-4df9-b71f-e6344f994b75 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:05.951541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5e579d4-19d7-4df9-b71f-e6344f994b75 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:05.952344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5e579d4-19d7-4df9-b71f-e6344f994b75 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:05.952861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dbf16447-929d-4496-8fdd-e8a8ca20b979 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:05.953362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5e579d4-19d7-4df9-b71f-e6344f994b75 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:05.955518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dbf16447-929d-4496-8fdd-e8a8ca20b979 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:05.981614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbf16447-929d-4496-8fdd-e8a8ca20b979 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:05.983741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbf16447-929d-4496-8fdd-e8a8ca20b979 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:05.983741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbf16447-929d-4496-8fdd-e8a8ca20b979 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:05.985942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbf16447-929d-4496-8fdd-e8a8ca20b979 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:05.988884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbf16447-929d-4496-8fdd-e8a8ca20b979 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:05.990795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dbf16447-929d-4496-8fdd-e8a8ca20b979 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:06.378059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dbf16447-929d-4496-8fdd-e8a8ca20b979 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:06.394079 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dbf16447-929d-4496-8fdd-e8a8ca20b979 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1332 microversion: 2.1 time: 0.446102 Oct 04 21:16:06.400406 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1226/2524] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:05 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1332 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:06.411153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-a510b546-e908-4dcf-bce7-e46cb7ebf305 req-991c70b3-6ed2-485e-8b37-1d06a332181a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a1a3ee-1603-44d6-a94b-062f492cf8b1", "tag": "5d5701df-ff17-499d-996e-479664d1c9d5"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:06.443024 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a510b546-e908-4dcf-bce7-e46cb7ebf305 req-991c70b3-6ed2-485e-8b37-1d06a332181a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:06.445935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a510b546-e908-4dcf-bce7-e46cb7ebf305 req-991c70b3-6ed2-485e-8b37-1d06a332181a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:06.447014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a510b546-e908-4dcf-bce7-e46cb7ebf305 req-991c70b3-6ed2-485e-8b37-1d06a332181a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:06.472083 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-a510b546-e908-4dcf-bce7-e46cb7ebf305 req-991c70b3-6ed2-485e-8b37-1d06a332181a service nova] Creating event network-changed:5d5701df-ff17-499d-996e-479664d1c9d5 for instance d9a1a3ee-1603-44d6-a94b-062f492cf8b1 on n-h2-860282-1 Oct 04 21:16:06.478022 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-a510b546-e908-4dcf-bce7-e46cb7ebf305 req-991c70b3-6ed2-485e-8b37-1d06a332181a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075956 Oct 04 21:16:06.478984 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1227/2525] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:06.487683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-293cb01f-aa15-4c8a-8410-720c30800f9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:06.487683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-293cb01f-aa15-4c8a-8410-720c30800f9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:06.496522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c5e579d4-19d7-4df9-b71f-e6344f994b75 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:06.506529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-293cb01f-aa15-4c8a-8410-720c30800f9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:06.510394 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c5e579d4-19d7-4df9-b71f-e6344f994b75 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1523 microversion: 2.1 time: 0.588074 Oct 04 21:16:06.511330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-293cb01f-aa15-4c8a-8410-720c30800f9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:06.512030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-293cb01f-aa15-4c8a-8410-720c30800f9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:06.512879 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1299/2526] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:05 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1523 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:06.513912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-293cb01f-aa15-4c8a-8410-720c30800f9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:06.514705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-293cb01f-aa15-4c8a-8410-720c30800f9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:06.520144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-293cb01f-aa15-4c8a-8410-720c30800f9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:06.766696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-293cb01f-aa15-4c8a-8410-720c30800f9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:06.776331 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-293cb01f-aa15-4c8a-8410-720c30800f9a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1" status: 200 len: 1325 microversion: 2.1 time: 0.295794 Oct 04 21:16:06.777329 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1228/2527] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:06 2022] GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 => generated 1325 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:07.433555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1b38e5dc-5462-400a-89fd-2709ccadaa1b tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:07.438386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1b38e5dc-5462-400a-89fd-2709ccadaa1b tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:07.455070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:07.459864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b38e5dc-5462-400a-89fd-2709ccadaa1b tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:07.462020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b38e5dc-5462-400a-89fd-2709ccadaa1b tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:07.463166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b38e5dc-5462-400a-89fd-2709ccadaa1b tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:07.464188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b38e5dc-5462-400a-89fd-2709ccadaa1b tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:07.464764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b38e5dc-5462-400a-89fd-2709ccadaa1b tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:07.465320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b38e5dc-5462-400a-89fd-2709ccadaa1b tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:07.542318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-81060a84-26ce-4336-862a-010d312e06b6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:07.543028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-81060a84-26ce-4336-862a-010d312e06b6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:07.550696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81060a84-26ce-4336-862a-010d312e06b6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:07.551282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81060a84-26ce-4336-862a-010d312e06b6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:07.551802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81060a84-26ce-4336-862a-010d312e06b6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:07.552516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81060a84-26ce-4336-862a-010d312e06b6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:07.552979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81060a84-26ce-4336-862a-010d312e06b6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:07.553412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81060a84-26ce-4336-862a-010d312e06b6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:08.187510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1b38e5dc-5462-400a-89fd-2709ccadaa1b tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:08.197381 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1b38e5dc-5462-400a-89fd-2709ccadaa1b tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1332 microversion: 2.1 time: 0.772467 Oct 04 21:16:08.203465 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1300/2528] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:07 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1332 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:08.204579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-12f8aaf4-1f51-4f26-bd6c-492b736355c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:08.205359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-12f8aaf4-1f51-4f26-bd6c-492b736355c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:08.212686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12f8aaf4-1f51-4f26-bd6c-492b736355c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:08.213588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12f8aaf4-1f51-4f26-bd6c-492b736355c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:08.214234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12f8aaf4-1f51-4f26-bd6c-492b736355c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:08.215284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12f8aaf4-1f51-4f26-bd6c-492b736355c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:08.215891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12f8aaf4-1f51-4f26-bd6c-492b736355c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:08.216459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12f8aaf4-1f51-4f26-bd6c-492b736355c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:08.292615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-81060a84-26ce-4336-862a-010d312e06b6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:08.302688 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-81060a84-26ce-4336-862a-010d312e06b6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1523 microversion: 2.1 time: 0.766368 Oct 04 21:16:08.304675 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1229/2529] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:07 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1523 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:08.530162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-12f8aaf4-1f51-4f26-bd6c-492b736355c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:08.568759 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-12f8aaf4-1f51-4f26-bd6c-492b736355c0 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1" status: 200 len: 1325 microversion: 2.1 time: 0.350546 Oct 04 21:16:08.573968 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1301/2530] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:08 2022] GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 => generated 1325 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:08.597493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b476de09-bd38-4fc5-b6c8-25ad8d456c4d req-cca5d78e-37f7-4a60-9407-82ca67115683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1", "tag": "70d55979-79c2-4cab-a831-1fbe7f705cc0"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:08.609990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b476de09-bd38-4fc5-b6c8-25ad8d456c4d req-cca5d78e-37f7-4a60-9407-82ca67115683 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:08.610704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b476de09-bd38-4fc5-b6c8-25ad8d456c4d req-cca5d78e-37f7-4a60-9407-82ca67115683 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:08.611296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b476de09-bd38-4fc5-b6c8-25ad8d456c4d req-cca5d78e-37f7-4a60-9407-82ca67115683 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:08.623084 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b476de09-bd38-4fc5-b6c8-25ad8d456c4d req-cca5d78e-37f7-4a60-9407-82ca67115683 service nova] Creating event network-changed:70d55979-79c2-4cab-a831-1fbe7f705cc0 for instance 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 on n-h1-860282-1 Oct 04 21:16:08.629594 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b476de09-bd38-4fc5-b6c8-25ad8d456c4d req-cca5d78e-37f7-4a60-9407-82ca67115683 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036474 Oct 04 21:16:08.629865 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1230/2531] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:08.991599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1205d4b5-8b3f-483f-9361-77162c8fb109 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Action: 'create', calling method: .version_select at 0x7f57945f9700>, body: {"keypair": {"name": "tempest-keypair-253484164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInpXoab2hX/xtll6iG+klyR24/W/yGw6uOgLXNa1UGRnQGJZh55ygP5Rp8Xn9fDMOSo3XqmR8UgGC8ON5hX2Ez44+B8uCqhD0weRSGmBaVOYFAOckTMkU5/vv00/hNxsg=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:09.032675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-1205d4b5-8b3f-483f-9361-77162c8fb109 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Getting quotas for project 188383bbf07f4ad5b2d4d4ec4380fad7. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:16:09.057879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-1205d4b5-8b3f-483f-9361-77162c8fb109 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Getting quotas for user f6389e7e01d042678fed8cdf6d8b8625 and project 188383bbf07f4ad5b2d4d4ec4380fad7. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:16:09.235121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-611dc6b2-4026-4327-94b7-fc5a96fa5b9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:09.237275 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1205d4b5-8b3f-483f-9361-77162c8fb109 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.534778 Oct 04 21:16:09.237984 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1302/2532] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:16:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:09.247808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-611dc6b2-4026-4327-94b7-fc5a96fa5b9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:09.265142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:09.279576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-611dc6b2-4026-4327-94b7-fc5a96fa5b9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:09.281261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-611dc6b2-4026-4327-94b7-fc5a96fa5b9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:09.281755 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-611dc6b2-4026-4327-94b7-fc5a96fa5b9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:09.289406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-611dc6b2-4026-4327-94b7-fc5a96fa5b9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:09.289406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-611dc6b2-4026-4327-94b7-fc5a96fa5b9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:09.289406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-611dc6b2-4026-4327-94b7-fc5a96fa5b9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:09.331938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-503de9db-36a3-4485-be66-ac660e9c882e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:09.332564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-503de9db-36a3-4485-be66-ac660e9c882e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:09.356642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-503de9db-36a3-4485-be66-ac660e9c882e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:09.357574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-503de9db-36a3-4485-be66-ac660e9c882e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:09.358307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-503de9db-36a3-4485-be66-ac660e9c882e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:09.359558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-503de9db-36a3-4485-be66-ac660e9c882e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:09.360269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-503de9db-36a3-4485-be66-ac660e9c882e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:09.361020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-503de9db-36a3-4485-be66-ac660e9c882e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:09.681477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=10 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:09.738103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-611dc6b2-4026-4327-94b7-fc5a96fa5b9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:09.755045 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-611dc6b2-4026-4327-94b7-fc5a96fa5b9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1332 microversion: 2.1 time: 0.527736 Oct 04 21:16:09.757740 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1231/2533] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:09 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1332 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:09.763707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5de76956-2a87-4b79-9972-e82020533cf1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:09.764548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5de76956-2a87-4b79-9972-e82020533cf1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:09.770757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5de76956-2a87-4b79-9972-e82020533cf1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:09.771261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5de76956-2a87-4b79-9972-e82020533cf1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:09.771695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5de76956-2a87-4b79-9972-e82020533cf1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:09.772963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5de76956-2a87-4b79-9972-e82020533cf1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:09.773446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5de76956-2a87-4b79-9972-e82020533cf1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:09.774063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5de76956-2a87-4b79-9972-e82020533cf1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:09.873899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-503de9db-36a3-4485-be66-ac660e9c882e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:09.885379 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-503de9db-36a3-4485-be66-ac660e9c882e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1523 microversion: 2.1 time: 0.557350 Oct 04 21:16:09.905513 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1303/2534] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:09 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1523 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:10.170269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5de76956-2a87-4b79-9972-e82020533cf1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:10.185258 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5de76956-2a87-4b79-9972-e82020533cf1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1" status: 200 len: 1325 microversion: 2.1 time: 0.426256 Oct 04 21:16:10.195144 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1232/2535] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:09 2022] GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 => generated 1325 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:10.783822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aba168bc-48e8-410c-9cea-6ec6f6450c9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:10.786578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aba168bc-48e8-410c-9cea-6ec6f6450c9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:10.796091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aba168bc-48e8-410c-9cea-6ec6f6450c9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:10.796622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aba168bc-48e8-410c-9cea-6ec6f6450c9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:10.796998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aba168bc-48e8-410c-9cea-6ec6f6450c9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:10.798226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aba168bc-48e8-410c-9cea-6ec6f6450c9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:10.798849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aba168bc-48e8-410c-9cea-6ec6f6450c9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:10.800145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aba168bc-48e8-410c-9cea-6ec6f6450c9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:10.915122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-53866740-2c57-46a0-9cab-ff19dd51f496 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:10.917518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-53866740-2c57-46a0-9cab-ff19dd51f496 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:10.929114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53866740-2c57-46a0-9cab-ff19dd51f496 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:10.930961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53866740-2c57-46a0-9cab-ff19dd51f496 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:10.931558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53866740-2c57-46a0-9cab-ff19dd51f496 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:10.932470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53866740-2c57-46a0-9cab-ff19dd51f496 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:10.933346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53866740-2c57-46a0-9cab-ff19dd51f496 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:10.934144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53866740-2c57-46a0-9cab-ff19dd51f496 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:11.233522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aba168bc-48e8-410c-9cea-6ec6f6450c9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:11.255342 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aba168bc-48e8-410c-9cea-6ec6f6450c9f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1332 microversion: 2.1 time: 0.478512 Oct 04 21:16:11.265995 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1304/2536] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:10 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1332 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:11.273396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3ab51411-965c-4bd3-8a2b-734a76262b0c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:11.278188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3ab51411-965c-4bd3-8a2b-734a76262b0c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:11.308826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ab51411-965c-4bd3-8a2b-734a76262b0c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:11.309841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ab51411-965c-4bd3-8a2b-734a76262b0c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:11.316859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ab51411-965c-4bd3-8a2b-734a76262b0c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:11.319451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ab51411-965c-4bd3-8a2b-734a76262b0c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:11.321200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ab51411-965c-4bd3-8a2b-734a76262b0c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:11.323243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ab51411-965c-4bd3-8a2b-734a76262b0c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:11.452115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-53866740-2c57-46a0-9cab-ff19dd51f496 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:11.466839 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-53866740-2c57-46a0-9cab-ff19dd51f496 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1523 microversion: 2.1 time: 0.557602 Oct 04 21:16:11.467843 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1233/2537] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:10 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1523 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:11.629163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3ab51411-965c-4bd3-8a2b-734a76262b0c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:11.637640 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3ab51411-965c-4bd3-8a2b-734a76262b0c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1" status: 200 len: 1325 microversion: 2.1 time: 0.372257 Oct 04 21:16:11.643515 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1305/2538] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:11 2022] GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 => generated 1325 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:12.287954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6f7a4dc0-cb15-422e-9cab-70aa814b47c6 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:12.289907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6f7a4dc0-cb15-422e-9cab-70aa814b47c6 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:12.297884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6f7a4dc0-cb15-422e-9cab-70aa814b47c6 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:12.298371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6f7a4dc0-cb15-422e-9cab-70aa814b47c6 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:12.299001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6f7a4dc0-cb15-422e-9cab-70aa814b47c6 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:12.299699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6f7a4dc0-cb15-422e-9cab-70aa814b47c6 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:12.300150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6f7a4dc0-cb15-422e-9cab-70aa814b47c6 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:12.300835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6f7a4dc0-cb15-422e-9cab-70aa814b47c6 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:12.496277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6f7a4dc0-cb15-422e-9cab-70aa814b47c6 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:12.504624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:12.512938 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6f7a4dc0-cb15-422e-9cab-70aa814b47c6 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1332 microversion: 2.1 time: 0.229306 Oct 04 21:16:12.515179 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1234/2539] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:12 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1332 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:12.522102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2c2761c5-1ebc-40ca-9f04-0912c84f6025 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:12.523704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2c2761c5-1ebc-40ca-9f04-0912c84f6025 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:12.532731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c2761c5-1ebc-40ca-9f04-0912c84f6025 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:12.533548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c2761c5-1ebc-40ca-9f04-0912c84f6025 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:12.534191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c2761c5-1ebc-40ca-9f04-0912c84f6025 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:12.535099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c2761c5-1ebc-40ca-9f04-0912c84f6025 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:12.536630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c2761c5-1ebc-40ca-9f04-0912c84f6025 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:12.537772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c2761c5-1ebc-40ca-9f04-0912c84f6025 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:12.757934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b42af197-c17d-459b-b5a5-35b6238df9b5 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Action: 'create', calling method: .version_select at 0x7f57945f95e0>, body: {"keypair": {"name": "tempest-keypair-807112061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmNNtKsaH6xoIPuLOP0XPjAlN3g6xAeFjcwYNuEikjEQm96v2d5NGiss6Nmq8Ud6dLCKexhffVKXOpdoRbCW6XVP9FxXpZeq5wKbLwCAjgg6sTmrdkS+Pu8Hgbz+pCGqQ=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:12.771024 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2c2761c5-1ebc-40ca-9f04-0912c84f6025 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:12.780734 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2c2761c5-1ebc-40ca-9f04-0912c84f6025 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1523 microversion: 2.1 time: 0.264285 Oct 04 21:16:12.781411 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1235/2540] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:12 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:12.786410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-b42af197-c17d-459b-b5a5-35b6238df9b5 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Getting quotas for project 5be18e35977441e8abe699f77e2b74c5. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:16:12.786908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b633c523-a5ae-4c58-9c3e-673af3977267 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:12.787736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b633c523-a5ae-4c58-9c3e-673af3977267 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:12.795868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b633c523-a5ae-4c58-9c3e-673af3977267 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:12.797141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b633c523-a5ae-4c58-9c3e-673af3977267 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:12.798450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b633c523-a5ae-4c58-9c3e-673af3977267 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:12.798925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-b42af197-c17d-459b-b5a5-35b6238df9b5 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Getting quotas for user 51d45dc825004ad4916d457f34eb0559 and project 5be18e35977441e8abe699f77e2b74c5. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:16:12.799566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b633c523-a5ae-4c58-9c3e-673af3977267 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:12.800198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b633c523-a5ae-4c58-9c3e-673af3977267 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:12.800641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b633c523-a5ae-4c58-9c3e-673af3977267 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:12.982477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b633c523-a5ae-4c58-9c3e-673af3977267 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:12.992128 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b633c523-a5ae-4c58-9c3e-673af3977267 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1" status: 200 len: 1325 microversion: 2.1 time: 0.208722 Oct 04 21:16:12.992916 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1236/2541] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:12 2022] GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 => generated 1325 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:13.025683 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b42af197-c17d-459b-b5a5-35b6238df9b5 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.655212 Oct 04 21:16:13.026666 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1306/2542] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:16:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:13.498232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-114b0a5f-844d-47be-8178-e1975a67578e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-832126667", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "7bf21f08-6329-49e2-9638-9e60de3b3b2e"}], "security_groups": [{"name": "tempest-securitygroup--1307306876"}], "key_name": "tempest-keypair-253484164", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:13.541121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-29061e92-8e25-4460-baab-462211beab68 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:13.541797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-29061e92-8e25-4460-baab-462211beab68 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:13.551981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29061e92-8e25-4460-baab-462211beab68 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:13.552766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29061e92-8e25-4460-baab-462211beab68 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:13.553372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29061e92-8e25-4460-baab-462211beab68 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:13.555021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29061e92-8e25-4460-baab-462211beab68 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:13.555729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29061e92-8e25-4460-baab-462211beab68 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:13.556384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29061e92-8e25-4460-baab-462211beab68 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:13.591230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:13.679723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-114b0a5f-844d-47be-8178-e1975a67578e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] validate_networks() for [('7bf21f08-6329-49e2-9638-9e60de3b3b2e', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:16:13.872365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-29061e92-8e25-4460-baab-462211beab68 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:13.884006 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-29061e92-8e25-4460-baab-462211beab68 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1332 microversion: 2.1 time: 0.348859 Oct 04 21:16:13.905973 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1307/2543] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:13 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1332 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:13.915976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0f0f21a5-be74-42ea-8c8d-972b53a8e184 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:13.921517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0f0f21a5-be74-42ea-8c8d-972b53a8e184 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:13.923767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f0f21a5-be74-42ea-8c8d-972b53a8e184 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:13.924217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f0f21a5-be74-42ea-8c8d-972b53a8e184 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:13.924672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f0f21a5-be74-42ea-8c8d-972b53a8e184 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:13.925920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f0f21a5-be74-42ea-8c8d-972b53a8e184 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:13.926448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f0f21a5-be74-42ea-8c8d-972b53a8e184 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:13.930848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f0f21a5-be74-42ea-8c8d-972b53a8e184 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:14.265878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0f0f21a5-be74-42ea-8c8d-972b53a8e184 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:14.279011 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0f0f21a5-be74-42ea-8c8d-972b53a8e184 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1523 microversion: 2.1 time: 0.371202 Oct 04 21:16:14.279729 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1308/2544] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:13 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1523 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:14.287251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cbe278fa-8d61-4e03-8b9a-b4e7307a485d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:14.287904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cbe278fa-8d61-4e03-8b9a-b4e7307a485d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:14.295408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cbe278fa-8d61-4e03-8b9a-b4e7307a485d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:14.296016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cbe278fa-8d61-4e03-8b9a-b4e7307a485d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:14.296629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cbe278fa-8d61-4e03-8b9a-b4e7307a485d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:14.297338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cbe278fa-8d61-4e03-8b9a-b4e7307a485d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:14.297829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cbe278fa-8d61-4e03-8b9a-b4e7307a485d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:14.298568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cbe278fa-8d61-4e03-8b9a-b4e7307a485d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:14.499871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cbe278fa-8d61-4e03-8b9a-b4e7307a485d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:14.503201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-114b0a5f-844d-47be-8178-e1975a67578e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:16:14.522797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-114b0a5f-844d-47be-8178-e1975a67578e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:16:14.522797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-114b0a5f-844d-47be-8178-e1975a67578e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:16:14.522797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-114b0a5f-844d-47be-8178-e1975a67578e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:16:14.522797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-114b0a5f-844d-47be-8178-e1975a67578e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:16:14.523264 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cbe278fa-8d61-4e03-8b9a-b4e7307a485d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1" status: 200 len: 1325 microversion: 2.1 time: 0.232960 Oct 04 21:16:14.523498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-114b0a5f-844d-47be-8178-e1975a67578e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:14.523498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-114b0a5f-844d-47be-8178-e1975a67578e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:14.523498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-114b0a5f-844d-47be-8178-e1975a67578e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:14.523498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-114b0a5f-844d-47be-8178-e1975a67578e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:14.523498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-114b0a5f-844d-47be-8178-e1975a67578e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:14.523498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-114b0a5f-844d-47be-8178-e1975a67578e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:14.532020 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1309/2545] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:14 2022] GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 => generated 1325 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:14.550850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-114b0a5f-844d-47be-8178-e1975a67578e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Getting quotas for project 188383bbf07f4ad5b2d4d4ec4380fad7. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:16:14.559147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-114b0a5f-844d-47be-8178-e1975a67578e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Getting quotas for user f6389e7e01d042678fed8cdf6d8b8625 and project 188383bbf07f4ad5b2d4d4ec4380fad7. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:16:14.590150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-114b0a5f-844d-47be-8178-e1975a67578e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:16:14.593179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-114b0a5f-844d-47be-8178-e1975a67578e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:16:14.909839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c5aed6cd-4b98-433f-abd8-0931c42141ce tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:14.910465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c5aed6cd-4b98-433f-abd8-0931c42141ce tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:14.917882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5aed6cd-4b98-433f-abd8-0931c42141ce tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:14.918368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5aed6cd-4b98-433f-abd8-0931c42141ce tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:14.918803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5aed6cd-4b98-433f-abd8-0931c42141ce tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:14.919497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5aed6cd-4b98-433f-abd8-0931c42141ce tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:14.919954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5aed6cd-4b98-433f-abd8-0931c42141ce tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:14.920375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5aed6cd-4b98-433f-abd8-0931c42141ce tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:15.069891 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-114b0a5f-844d-47be-8178-e1975a67578e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.575265 Oct 04 21:16:15.079393 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1237/2546] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:16:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:16:15.086282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-aafef3be-2bb6-416c-8ab7-b4dbe00f9c44 req-02a38582-b71c-4ab0-a573-a4e975f41611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1", "name": "network-vif-plugged", "status": "completed", "tag": "70d55979-79c2-4cab-a831-1fbe7f705cc0"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:15.105573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-aafef3be-2bb6-416c-8ab7-b4dbe00f9c44 req-02a38582-b71c-4ab0-a573-a4e975f41611 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:15.106519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-aafef3be-2bb6-416c-8ab7-b4dbe00f9c44 req-02a38582-b71c-4ab0-a573-a4e975f41611 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:15.112729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-aafef3be-2bb6-416c-8ab7-b4dbe00f9c44 req-02a38582-b71c-4ab0-a573-a4e975f41611 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:15.122755 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-aafef3be-2bb6-416c-8ab7-b4dbe00f9c44 req-02a38582-b71c-4ab0-a573-a4e975f41611 service nova] Creating event network-vif-plugged:70d55979-79c2-4cab-a831-1fbe7f705cc0 for instance 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 on n-h1-860282-1 Oct 04 21:16:15.125092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c5aed6cd-4b98-433f-abd8-0931c42141ce tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:15.131738 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-aafef3be-2bb6-416c-8ab7-b4dbe00f9c44 req-02a38582-b71c-4ab0-a573-a4e975f41611 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050857 Oct 04 21:16:15.134657 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c5aed6cd-4b98-433f-abd8-0931c42141ce tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1332 microversion: 2.1 time: 0.228927 Oct 04 21:16:15.135234 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1310/2548] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:14 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1332 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:15.150317 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1238/2548] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:15.150317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-55d026a8-5ce9-4d51-82f6-95c797704d75 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:15.150317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-55d026a8-5ce9-4d51-82f6-95c797704d75 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:15.242406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-55d026a8-5ce9-4d51-82f6-95c797704d75 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:15.254325 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-55d026a8-5ce9-4d51-82f6-95c797704d75 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031" status: 200 len: 1240 microversion: 2.1 time: 0.117392 Oct 04 21:16:15.255904 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1239/2549] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:15 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 => generated 1240 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:15.303958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-37a9df16-f15f-48fb-8a52-d9f710d3eaea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:15.304597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-37a9df16-f15f-48fb-8a52-d9f710d3eaea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:15.318461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37a9df16-f15f-48fb-8a52-d9f710d3eaea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:15.318967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37a9df16-f15f-48fb-8a52-d9f710d3eaea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:15.319458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37a9df16-f15f-48fb-8a52-d9f710d3eaea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:15.320188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37a9df16-f15f-48fb-8a52-d9f710d3eaea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:15.320625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37a9df16-f15f-48fb-8a52-d9f710d3eaea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:15.321252 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37a9df16-f15f-48fb-8a52-d9f710d3eaea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:15.538798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-35e443ec-a5d9-4544-822a-88743146dfa1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:15.540449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-35e443ec-a5d9-4544-822a-88743146dfa1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:15.553186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35e443ec-a5d9-4544-822a-88743146dfa1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:15.556905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35e443ec-a5d9-4544-822a-88743146dfa1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:15.557568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35e443ec-a5d9-4544-822a-88743146dfa1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:15.558562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35e443ec-a5d9-4544-822a-88743146dfa1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:15.560600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35e443ec-a5d9-4544-822a-88743146dfa1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:15.574650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35e443ec-a5d9-4544-822a-88743146dfa1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:15.581262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-37a9df16-f15f-48fb-8a52-d9f710d3eaea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:15.591825 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-37a9df16-f15f-48fb-8a52-d9f710d3eaea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1523 microversion: 2.1 time: 0.292263 Oct 04 21:16:15.592402 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1311/2550] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:15 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1523 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:16.162785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a62cf582-ceaf-41a4-b2c4-1c29ec22c354 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:16.166917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a62cf582-ceaf-41a4-b2c4-1c29ec22c354 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:16.190080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a62cf582-ceaf-41a4-b2c4-1c29ec22c354 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:16.191282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a62cf582-ceaf-41a4-b2c4-1c29ec22c354 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:16.193255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a62cf582-ceaf-41a4-b2c4-1c29ec22c354 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:16.193255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a62cf582-ceaf-41a4-b2c4-1c29ec22c354 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:16.193800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a62cf582-ceaf-41a4-b2c4-1c29ec22c354 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:16.195001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a62cf582-ceaf-41a4-b2c4-1c29ec22c354 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:16.440527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-35e443ec-a5d9-4544-822a-88743146dfa1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:16.452466 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-35e443ec-a5d9-4544-822a-88743146dfa1 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1" status: 200 len: 1325 microversion: 2.1 time: 0.918935 Oct 04 21:16:16.453069 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1240/2551] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:15 2022] GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 => generated 1325 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:16.465205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-88bb7ed2-5a52-458e-b034-f13dce38c5d2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:16.468858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-88bb7ed2-5a52-458e-b034-f13dce38c5d2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:16.520683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a62cf582-ceaf-41a4-b2c4-1c29ec22c354 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:16.549163 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a62cf582-ceaf-41a4-b2c4-1c29ec22c354 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1332 microversion: 2.1 time: 0.390766 Oct 04 21:16:16.552610 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1312/2552] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:16 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1332 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:16.619306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-88bb7ed2-5a52-458e-b034-f13dce38c5d2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:16.628167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ac3eeedd-0ecc-46d9-ad89-c76c8b4eba92 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:16.628167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ac3eeedd-0ecc-46d9-ad89-c76c8b4eba92 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:16.628383 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-88bb7ed2-5a52-458e-b034-f13dce38c5d2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031" status: 200 len: 1240 microversion: 2.1 time: 0.167203 Oct 04 21:16:16.628383 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1241/2553] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:16 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 => generated 1240 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:16.645392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac3eeedd-0ecc-46d9-ad89-c76c8b4eba92 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:16.646574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac3eeedd-0ecc-46d9-ad89-c76c8b4eba92 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:16.647037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac3eeedd-0ecc-46d9-ad89-c76c8b4eba92 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:16.650375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac3eeedd-0ecc-46d9-ad89-c76c8b4eba92 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:16.650853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac3eeedd-0ecc-46d9-ad89-c76c8b4eba92 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:16.651292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac3eeedd-0ecc-46d9-ad89-c76c8b4eba92 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:16.845510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ac3eeedd-0ecc-46d9-ad89-c76c8b4eba92 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:16.854750 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ac3eeedd-0ecc-46d9-ad89-c76c8b4eba92 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1523 microversion: 2.1 time: 0.237749 Oct 04 21:16:16.855339 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1313/2554] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:16 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:17.213995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5c23a805-a3e1-4e39-828a-9dac47388a73 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "5e038546-3497-41fd-b19d-c08941b95ffc"}], "security_groups": [{"name": "tempest-securitygroup--1693329658"}], "key_name": "tempest-keypair-807112061", "user_data": "}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:17.371290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-5c23a805-a3e1-4e39-828a-9dac47388a73 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] validate_networks() for [('5e038546-3497-41fd-b19d-c08941b95ffc', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:16:17.507678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-1cb52c7c-4887-479c-91ab-bea6859771bf req-4e6cb26c-1917-4417-9f40-8ee2c2a2f0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a1a3ee-1603-44d6-a94b-062f492cf8b1", "name": "network-vif-plugged", "status": "completed", "tag": "5d5701df-ff17-499d-996e-479664d1c9d5"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:17.527020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1cb52c7c-4887-479c-91ab-bea6859771bf req-4e6cb26c-1917-4417-9f40-8ee2c2a2f0ac service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:17.527578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1cb52c7c-4887-479c-91ab-bea6859771bf req-4e6cb26c-1917-4417-9f40-8ee2c2a2f0ac service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:17.528200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1cb52c7c-4887-479c-91ab-bea6859771bf req-4e6cb26c-1917-4417-9f40-8ee2c2a2f0ac service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:17.549959 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-1cb52c7c-4887-479c-91ab-bea6859771bf req-4e6cb26c-1917-4417-9f40-8ee2c2a2f0ac service nova] Creating event network-vif-plugged:5d5701df-ff17-499d-996e-479664d1c9d5 for instance d9a1a3ee-1603-44d6-a94b-062f492cf8b1 on n-h2-860282-1 Oct 04 21:16:17.557183 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-1cb52c7c-4887-479c-91ab-bea6859771bf req-4e6cb26c-1917-4417-9f40-8ee2c2a2f0ac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.373048 Oct 04 21:16:17.558204 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1242/2555] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:16:17.563598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-998f18da-4d7c-438d-a991-9cfe53a8fed3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:17.564377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-998f18da-4d7c-438d-a991-9cfe53a8fed3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:17.571626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-998f18da-4d7c-438d-a991-9cfe53a8fed3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:17.572391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-998f18da-4d7c-438d-a991-9cfe53a8fed3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:17.572987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-998f18da-4d7c-438d-a991-9cfe53a8fed3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:17.584939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-998f18da-4d7c-438d-a991-9cfe53a8fed3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:17.584939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-998f18da-4d7c-438d-a991-9cfe53a8fed3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:17.584939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-998f18da-4d7c-438d-a991-9cfe53a8fed3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:17.865438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-998f18da-4d7c-438d-a991-9cfe53a8fed3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:17.874688 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-998f18da-4d7c-438d-a991-9cfe53a8fed3 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1" status: 200 len: 1521 microversion: 2.1 time: 0.315068 Oct 04 21:16:17.875280 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1243/2556] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:17 2022] GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:17.880738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d02d7320-2039-461f-8042-3af930d1d518 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:17.881584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d02d7320-2039-461f-8042-3af930d1d518 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:17.888744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d02d7320-2039-461f-8042-3af930d1d518 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:17.889486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d02d7320-2039-461f-8042-3af930d1d518 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:17.890127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d02d7320-2039-461f-8042-3af930d1d518 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:17.891010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d02d7320-2039-461f-8042-3af930d1d518 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:17.891694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d02d7320-2039-461f-8042-3af930d1d518 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:17.892285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d02d7320-2039-461f-8042-3af930d1d518 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:17.996699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-5c23a805-a3e1-4e39-828a-9dac47388a73 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:16:17.997369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-5c23a805-a3e1-4e39-828a-9dac47388a73 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:16:17.998115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-5c23a805-a3e1-4e39-828a-9dac47388a73 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:16:17.998750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-5c23a805-a3e1-4e39-828a-9dac47388a73 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:16:17.999264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-5c23a805-a3e1-4e39-828a-9dac47388a73 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:16:18.009364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=19 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:18.011053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c23a805-a3e1-4e39-828a-9dac47388a73 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.011643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c23a805-a3e1-4e39-828a-9dac47388a73 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.012183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c23a805-a3e1-4e39-828a-9dac47388a73 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.013302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c23a805-a3e1-4e39-828a-9dac47388a73 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.013902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c23a805-a3e1-4e39-828a-9dac47388a73 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.014506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c23a805-a3e1-4e39-828a-9dac47388a73 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.046058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-5c23a805-a3e1-4e39-828a-9dac47388a73 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Getting quotas for project 5be18e35977441e8abe699f77e2b74c5. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:16:18.060777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-5c23a805-a3e1-4e39-828a-9dac47388a73 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Getting quotas for user 51d45dc825004ad4916d457f34eb0559 and project 5be18e35977441e8abe699f77e2b74c5. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:16:18.087813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5c23a805-a3e1-4e39-828a-9dac47388a73 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:16:18.090664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5c23a805-a3e1-4e39-828a-9dac47388a73 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:16:18.091192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d02d7320-2039-461f-8042-3af930d1d518 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:18.099952 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d02d7320-2039-461f-8042-3af930d1d518 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1332 microversion: 2.1 time: 0.223457 Oct 04 21:16:18.101037 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1244/2557] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:17 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1332 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:18.105879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-409bc257-ae95-4917-92f9-a18254b05862 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:18.106901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-409bc257-ae95-4917-92f9-a18254b05862 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:18.113155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-409bc257-ae95-4917-92f9-a18254b05862 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.113841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-409bc257-ae95-4917-92f9-a18254b05862 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.114379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-409bc257-ae95-4917-92f9-a18254b05862 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.115252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-409bc257-ae95-4917-92f9-a18254b05862 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.116476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-409bc257-ae95-4917-92f9-a18254b05862 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.117250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-409bc257-ae95-4917-92f9-a18254b05862 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.127551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:18.189081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-409bc257-ae95-4917-92f9-a18254b05862 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:18.198176 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-409bc257-ae95-4917-92f9-a18254b05862 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031" status: 200 len: 1236 microversion: 2.1 time: 0.095918 Oct 04 21:16:18.213549 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1245/2558] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:18 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 => generated 1236 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:18.213549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-037bf02e-764a-4732-b273-1524487d68f4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:18.213549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-037bf02e-764a-4732-b273-1524487d68f4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:18.213549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-037bf02e-764a-4732-b273-1524487d68f4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.213549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-037bf02e-764a-4732-b273-1524487d68f4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.213549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-037bf02e-764a-4732-b273-1524487d68f4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.213549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-037bf02e-764a-4732-b273-1524487d68f4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.213549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-037bf02e-764a-4732-b273-1524487d68f4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.213549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-037bf02e-764a-4732-b273-1524487d68f4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.242186 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5c23a805-a3e1-4e39-828a-9dac47388a73 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.032492 Oct 04 21:16:18.243574 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1314/2559] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:16:17 2022] POST /compute/v2.1/servers => generated 409 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:16:18.248436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-42eba428-1d78-4964-a8c3-f6b320fcef9d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:18.248938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-42eba428-1d78-4964-a8c3-f6b320fcef9d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:18.255514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42eba428-1d78-4964-a8c3-f6b320fcef9d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.256222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42eba428-1d78-4964-a8c3-f6b320fcef9d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.257388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42eba428-1d78-4964-a8c3-f6b320fcef9d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.258337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42eba428-1d78-4964-a8c3-f6b320fcef9d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.258803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42eba428-1d78-4964-a8c3-f6b320fcef9d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.259398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42eba428-1d78-4964-a8c3-f6b320fcef9d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.287050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-42eba428-1d78-4964-a8c3-f6b320fcef9d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:16:18.367517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-037bf02e-764a-4732-b273-1524487d68f4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:18.377407 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-037bf02e-764a-4732-b273-1524487d68f4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1503 microversion: 2.1 time: 0.177607 Oct 04 21:16:18.390900 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1246/2560] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:18 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:18.403696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-752c847e-de50-4d35-9a34-2a13ba6dab01 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:18.409257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-752c847e-de50-4d35-9a34-2a13ba6dab01 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:18.415801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:18.466890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-752c847e-de50-4d35-9a34-2a13ba6dab01 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d45dc825004ad4916d457f34eb0559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be18e35977441e8abe699f77e2b74c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:18.475931 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-752c847e-de50-4d35-9a34-2a13ba6dab01 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 200 len: 1225 microversion: 2.1 time: 0.082855 Oct 04 21:16:18.476518 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1247/2561] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:18 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:18.481461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-137cbc80-e57e-498c-9580-bb13af384f93 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0d826f8-4e56-4e9b-8299-2770ce60a0f0"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:18.483913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-137cbc80-e57e-498c-9580-bb13af384f93 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:18.490462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-137cbc80-e57e-498c-9580-bb13af384f93 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.491759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-137cbc80-e57e-498c-9580-bb13af384f93 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.492213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-137cbc80-e57e-498c-9580-bb13af384f93 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.492909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-137cbc80-e57e-498c-9580-bb13af384f93 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.493378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-137cbc80-e57e-498c-9580-bb13af384f93 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.493848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-137cbc80-e57e-498c-9580-bb13af384f93 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.535126 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-137cbc80-e57e-498c-9580-bb13af384f93 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] HTTP exception thrown: Cannot 'attach_volume' instance 89a86ffd-75a1-460b-ae59-24969ece95ad while it is in vm_state rescued Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-137cbc80-e57e-498c-9580-bb13af384f93 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Request method failure captured: Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad/os-volume_attachments HTTP/1.1 Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 74 Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKIzNXd_CmvP-6Usf8igAzY3dlzgDYn--v5mxvj-LpxllWzzbFyJF08JoJ1PYfhtDQRJAhrGh_znPsymYAfveamBdA6vz1Y-oh2GJa7UDnV-tTkHC5ZL-7fb_GflotkDarrlFSqHRvs9b0CJFd3T0swEf2S9AMDAGMNIk353xt2G0b4 Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 047ff2c9b6414ce8b98364678cbfeb53 Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/047ff2c9b6414ce8b98364678cbfeb53"}]}] Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 047ff2c9b6414ce8b98364678cbfeb53 Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerRescueNegativeTestJSON-548947322-project Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: abb3ac58c2ea4e2da8b9e765eda5f333 Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerRescueNegativeTestJSON-548947322-project Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: {"volumeAttachment": {"volumeId": "f0d826f8-4e56-4e9b-8299-2770ce60a0f0"}} Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: exception: Cannot 'attach_volume' instance 89a86ffd-75a1-460b-ae59-24969ece95ad while it is in vm_state rescued Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'server_id': '89a86ffd-75a1-460b-ae59-24969ece95ad', 'body': {'volumeAttachment': {'volumeId': 'f0d826f8-4e56-4e9b-8299-2770ce60a0f0'}}} Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 89a86ffd-75a1-460b-ae59-24969ece95ad in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 04 21:16:18.545131 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:16:18.549831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:16:18.549831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:16:18.549831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 89a86ffd-75a1-460b-ae59-24969ece95ad while it is in vm_state rescued Oct 04 21:16:18.549831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:18.549831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:18.549831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:18.549831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:18.549831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:18.549831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:18.549831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:18.549831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:18.549831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 89a86ffd-75a1-460b-ae59-24969ece95ad while it is in vm_state rescued Oct 04 21:16:18.549831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:18.552496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-137cbc80-e57e-498c-9580-bb13af384f93 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Returning 409 to user: Cannot 'attach_volume' instance 89a86ffd-75a1-460b-ae59-24969ece95ad while it is in vm_state rescued {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:18.555335 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-137cbc80-e57e-498c-9580-bb13af384f93 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "POST /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.076011 Oct 04 21:16:18.556606 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1248/2562] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 21:16:18 2022] POST /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad/os-volume_attachments => generated 152 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:16:18.567062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-96cd2950-1432-4794-8d31-41c5543ef250 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:18.567607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-96cd2950-1432-4794-8d31-41c5543ef250 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:18.573856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96cd2950-1432-4794-8d31-41c5543ef250 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.574501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96cd2950-1432-4794-8d31-41c5543ef250 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.575111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96cd2950-1432-4794-8d31-41c5543ef250 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.575970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96cd2950-1432-4794-8d31-41c5543ef250 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.576727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96cd2950-1432-4794-8d31-41c5543ef250 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.576945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96cd2950-1432-4794-8d31-41c5543ef250 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.645347 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-42eba428-1d78-4964-a8c3-f6b320fcef9d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1" status: 204 len: 0 microversion: 2.1 time: 0.397607 Oct 04 21:16:18.646472 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1315/2563] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:16:18 2022] DELETE /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:16:18.655405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bbbb517e-7a5e-4628-8967-babffd8d011d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:18.656265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bbbb517e-7a5e-4628-8967-babffd8d011d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:18.663873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbbb517e-7a5e-4628-8967-babffd8d011d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.664712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbbb517e-7a5e-4628-8967-babffd8d011d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.665359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbbb517e-7a5e-4628-8967-babffd8d011d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.666305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbbb517e-7a5e-4628-8967-babffd8d011d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.667145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbbb517e-7a5e-4628-8967-babffd8d011d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.667783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbbb517e-7a5e-4628-8967-babffd8d011d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.816260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bbbb517e-7a5e-4628-8967-babffd8d011d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:18.824705 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bbbb517e-7a5e-4628-8967-babffd8d011d tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1" status: 200 len: 1527 microversion: 2.1 time: 0.173507 Oct 04 21:16:18.825299 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1316/2564] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:18 2022] GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 => generated 1527 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:18.846684 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-96cd2950-1432-4794-8d31-41c5543ef250 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "POST /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad/action" status: 202 len: 0 microversion: 2.1 time: 0.283838 Oct 04 21:16:18.847329 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1249/2565] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:16:18 2022] POST /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:16:18.862578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5633c899-fd4e-4448-976d-0a6f62691d2a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:18.863193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5633c899-fd4e-4448-976d-0a6f62691d2a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:18.869272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5633c899-fd4e-4448-976d-0a6f62691d2a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.869802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5633c899-fd4e-4448-976d-0a6f62691d2a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.870244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5633c899-fd4e-4448-976d-0a6f62691d2a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.870934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5633c899-fd4e-4448-976d-0a6f62691d2a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.871397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5633c899-fd4e-4448-976d-0a6f62691d2a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.871824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5633c899-fd4e-4448-976d-0a6f62691d2a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:19.016257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5633c899-fd4e-4448-976d-0a6f62691d2a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:19.024846 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5633c899-fd4e-4448-976d-0a6f62691d2a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1511 microversion: 2.1 time: 0.166173 Oct 04 21:16:19.025413 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1317/2566] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:18 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:19.129709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d822bd9f-b8a1-49c1-aff0-b35a587bde31 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:19.130671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d822bd9f-b8a1-49c1-aff0-b35a587bde31 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:19.144348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d822bd9f-b8a1-49c1-aff0-b35a587bde31 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:19.145045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d822bd9f-b8a1-49c1-aff0-b35a587bde31 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:19.145523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d822bd9f-b8a1-49c1-aff0-b35a587bde31 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:19.146232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d822bd9f-b8a1-49c1-aff0-b35a587bde31 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:19.146868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d822bd9f-b8a1-49c1-aff0-b35a587bde31 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:19.148106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d822bd9f-b8a1-49c1-aff0-b35a587bde31 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:19.225264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8f6834a3-a52e-49ad-9837-2b015b9c545f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:19.226270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8f6834a3-a52e-49ad-9837-2b015b9c545f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:19.236917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f6834a3-a52e-49ad-9837-2b015b9c545f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:19.237737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f6834a3-a52e-49ad-9837-2b015b9c545f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:19.238472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f6834a3-a52e-49ad-9837-2b015b9c545f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:19.239705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f6834a3-a52e-49ad-9837-2b015b9c545f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:19.240470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f6834a3-a52e-49ad-9837-2b015b9c545f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:19.241144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f6834a3-a52e-49ad-9837-2b015b9c545f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:19.338213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8f6834a3-a52e-49ad-9837-2b015b9c545f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:19.350939 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8f6834a3-a52e-49ad-9837-2b015b9c545f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031" status: 200 len: 1292 microversion: 2.1 time: 0.127233 Oct 04 21:16:19.355452 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1318/2567] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:19 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 => generated 1292 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:19.376487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d822bd9f-b8a1-49c1-aff0-b35a587bde31 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:19.385318 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d822bd9f-b8a1-49c1-aff0-b35a587bde31 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1332 microversion: 2.1 time: 0.265178 Oct 04 21:16:19.386132 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1250/2568] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:19 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1332 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:19.499923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3d0440ca-cd41-4031-976d-5cebfea6ee6a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:19.500822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3d0440ca-cd41-4031-976d-5cebfea6ee6a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:19.571514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3d0440ca-cd41-4031-976d-5cebfea6ee6a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d45dc825004ad4916d457f34eb0559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be18e35977441e8abe699f77e2b74c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:19.580667 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3d0440ca-cd41-4031-976d-5cebfea6ee6a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 200 len: 1225 microversion: 2.1 time: 0.084833 Oct 04 21:16:19.593482 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1319/2569] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:19 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:19.848334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a7dd82c6-7025-477a-b4a5-cf0bf6db3c27 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:19.849312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a7dd82c6-7025-477a-b4a5-cf0bf6db3c27 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:19.857043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7dd82c6-7025-477a-b4a5-cf0bf6db3c27 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:19.857818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7dd82c6-7025-477a-b4a5-cf0bf6db3c27 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:19.858269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7dd82c6-7025-477a-b4a5-cf0bf6db3c27 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:19.859018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7dd82c6-7025-477a-b4a5-cf0bf6db3c27 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:19.859480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7dd82c6-7025-477a-b4a5-cf0bf6db3c27 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:19.859910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7dd82c6-7025-477a-b4a5-cf0bf6db3c27 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:20.016118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a7dd82c6-7025-477a-b4a5-cf0bf6db3c27 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:20.025692 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a7dd82c6-7025-477a-b4a5-cf0bf6db3c27 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1" status: 200 len: 1527 microversion: 2.1 time: 0.181273 Oct 04 21:16:20.026307 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1251/2570] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:19 2022] GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 => generated 1527 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:20.048522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-82fce638-e05d-4620-921f-4572aa12919b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:20.049138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-82fce638-e05d-4620-921f-4572aa12919b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:20.056595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82fce638-e05d-4620-921f-4572aa12919b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:20.057087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82fce638-e05d-4620-921f-4572aa12919b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:20.057555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82fce638-e05d-4620-921f-4572aa12919b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:20.058261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82fce638-e05d-4620-921f-4572aa12919b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:20.058715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82fce638-e05d-4620-921f-4572aa12919b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:20.059142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82fce638-e05d-4620-921f-4572aa12919b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:20.253992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-82fce638-e05d-4620-921f-4572aa12919b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:20.266030 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-82fce638-e05d-4620-921f-4572aa12919b tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1511 microversion: 2.1 time: 0.221358 Oct 04 21:16:20.268164 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1320/2571] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:20 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1511 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:20.380208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-08751c74-8d83-4e0d-b3f6-0f0c5427b798 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:20.380832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-08751c74-8d83-4e0d-b3f6-0f0c5427b798 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:20.389621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08751c74-8d83-4e0d-b3f6-0f0c5427b798 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:20.390351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08751c74-8d83-4e0d-b3f6-0f0c5427b798 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:20.390783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08751c74-8d83-4e0d-b3f6-0f0c5427b798 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:20.391713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08751c74-8d83-4e0d-b3f6-0f0c5427b798 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:20.392311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08751c74-8d83-4e0d-b3f6-0f0c5427b798 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:20.393087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08751c74-8d83-4e0d-b3f6-0f0c5427b798 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:20.409678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0c2d06ea-497b-4693-b27e-c22f82f429a2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:20.410335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0c2d06ea-497b-4693-b27e-c22f82f429a2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:20.421463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c2d06ea-497b-4693-b27e-c22f82f429a2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:20.422116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c2d06ea-497b-4693-b27e-c22f82f429a2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:20.422664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c2d06ea-497b-4693-b27e-c22f82f429a2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:20.423482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c2d06ea-497b-4693-b27e-c22f82f429a2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:20.424169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c2d06ea-497b-4693-b27e-c22f82f429a2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:20.424743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c2d06ea-497b-4693-b27e-c22f82f429a2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:20.478017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-08751c74-8d83-4e0d-b3f6-0f0c5427b798 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:20.487021 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-08751c74-8d83-4e0d-b3f6-0f0c5427b798 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031" status: 200 len: 1298 microversion: 2.1 time: 0.111242 Oct 04 21:16:20.497655 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1252/2572] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:20 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 => generated 1298 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:20.606160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-65c3f0e2-ee44-41f3-8833-d69879438842 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:20.607260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-65c3f0e2-ee44-41f3-8833-d69879438842 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:20.615003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65c3f0e2-ee44-41f3-8833-d69879438842 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:20.615003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65c3f0e2-ee44-41f3-8833-d69879438842 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:20.615605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65c3f0e2-ee44-41f3-8833-d69879438842 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:20.617214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65c3f0e2-ee44-41f3-8833-d69879438842 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:20.617897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65c3f0e2-ee44-41f3-8833-d69879438842 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:20.618489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65c3f0e2-ee44-41f3-8833-d69879438842 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:20.629960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0c2d06ea-497b-4693-b27e-c22f82f429a2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:20.639457 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0c2d06ea-497b-4693-b27e-c22f82f429a2 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1536 microversion: 2.1 time: 0.233463 Oct 04 21:16:20.640418 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1321/2573] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:20 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1536 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:20.662306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-63a38dbc-ed5f-422c-a845-e8b29fbe9a2f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Action: 'create', calling method: .version_select at 0x7f57943e25e0>, body: {"pool": "ebedf1d9-7fee-45d5-b9f8-18ec236ab757"} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:20.707057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-65c3f0e2-ee44-41f3-8833-d69879438842 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d45dc825004ad4916d457f34eb0559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be18e35977441e8abe699f77e2b74c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:20.715211 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-65c3f0e2-ee44-41f3-8833-d69879438842 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 200 len: 1221 microversion: 2.1 time: 0.113889 Oct 04 21:16:20.715802 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1253/2574] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:20 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 1221 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:21.050870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-acfeb6f7-1e59-4d1a-a5ab-2c8f3d724a62 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:21.051518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-acfeb6f7-1e59-4d1a-a5ab-2c8f3d724a62 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:21.062600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-acfeb6f7-1e59-4d1a-a5ab-2c8f3d724a62 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.062600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-acfeb6f7-1e59-4d1a-a5ab-2c8f3d724a62 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.062600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-acfeb6f7-1e59-4d1a-a5ab-2c8f3d724a62 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:21.062600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-acfeb6f7-1e59-4d1a-a5ab-2c8f3d724a62 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.063558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-acfeb6f7-1e59-4d1a-a5ab-2c8f3d724a62 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.064206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-acfeb6f7-1e59-4d1a-a5ab-2c8f3d724a62 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:21.156284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-acfeb6f7-1e59-4d1a-a5ab-2c8f3d724a62 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:21.171860 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-acfeb6f7-1e59-4d1a-a5ab-2c8f3d724a62 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1" status: 200 len: 1485 microversion: 2.1 time: 0.126041 Oct 04 21:16:21.173993 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1254/2575] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:21 2022] GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 => generated 1485 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:21.184632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-6600e0de-5449-4cdc-b15f-ab70c6e36763 req-73bce8af-a67b-4345-9fe0-4eb55f04ff17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1", "name": "network-vif-deleted", "tag": "70d55979-79c2-4cab-a831-1fbe7f705cc0"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:21.203096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6600e0de-5449-4cdc-b15f-ab70c6e36763 req-73bce8af-a67b-4345-9fe0-4eb55f04ff17 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.203894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6600e0de-5449-4cdc-b15f-ab70c6e36763 req-73bce8af-a67b-4345-9fe0-4eb55f04ff17 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.204526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6600e0de-5449-4cdc-b15f-ab70c6e36763 req-73bce8af-a67b-4345-9fe0-4eb55f04ff17 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:21.222450 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-6600e0de-5449-4cdc-b15f-ab70c6e36763 req-73bce8af-a67b-4345-9fe0-4eb55f04ff17 service nova] Creating event network-vif-deleted:70d55979-79c2-4cab-a831-1fbe7f705cc0 for instance 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 on n-h1-860282-1 Oct 04 21:16:21.233355 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-6600e0de-5449-4cdc-b15f-ab70c6e36763 req-73bce8af-a67b-4345-9fe0-4eb55f04ff17 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057929 Oct 04 21:16:21.234010 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1255/2576] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:21.295420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-36dd3759-2c0e-4aed-9b7d-d7365f60eb3a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:21.296073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-36dd3759-2c0e-4aed-9b7d-d7365f60eb3a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:21.302300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36dd3759-2c0e-4aed-9b7d-d7365f60eb3a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.302796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36dd3759-2c0e-4aed-9b7d-d7365f60eb3a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.303268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36dd3759-2c0e-4aed-9b7d-d7365f60eb3a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:21.304449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36dd3759-2c0e-4aed-9b7d-d7365f60eb3a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.304930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36dd3759-2c0e-4aed-9b7d-d7365f60eb3a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.305838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36dd3759-2c0e-4aed-9b7d-d7365f60eb3a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:21.326374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:21.561700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-36dd3759-2c0e-4aed-9b7d-d7365f60eb3a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:21.571403 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-36dd3759-2c0e-4aed-9b7d-d7365f60eb3a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1511 microversion: 2.1 time: 0.281261 Oct 04 21:16:21.587413 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1256/2577] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:21 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1511 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:21.592802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7800c1b4-cb8e-450c-8720-0b346895cd98 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:21.593461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7800c1b4-cb8e-450c-8720-0b346895cd98 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:21.599526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7800c1b4-cb8e-450c-8720-0b346895cd98 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.600026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7800c1b4-cb8e-450c-8720-0b346895cd98 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.601039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7800c1b4-cb8e-450c-8720-0b346895cd98 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:21.601936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7800c1b4-cb8e-450c-8720-0b346895cd98 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.602468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7800c1b4-cb8e-450c-8720-0b346895cd98 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.605747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7800c1b4-cb8e-450c-8720-0b346895cd98 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:21.900126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7800c1b4-cb8e-450c-8720-0b346895cd98 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:21.922573 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7800c1b4-cb8e-450c-8720-0b346895cd98 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031" status: 200 len: 1366 microversion: 2.1 time: 0.332783 Oct 04 21:16:21.923798 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1257/2578] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:21 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:21.939580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8979c1f3-10c8-4f1e-adbc-9bad615d3c80 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:21.941339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8979c1f3-10c8-4f1e-adbc-9bad615d3c80 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:21.954181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8979c1f3-10c8-4f1e-adbc-9bad615d3c80 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.954710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8979c1f3-10c8-4f1e-adbc-9bad615d3c80 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.955325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8979c1f3-10c8-4f1e-adbc-9bad615d3c80 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:21.972119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8979c1f3-10c8-4f1e-adbc-9bad615d3c80 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.976380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8979c1f3-10c8-4f1e-adbc-9bad615d3c80 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.978855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8979c1f3-10c8-4f1e-adbc-9bad615d3c80 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:22.062793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8979c1f3-10c8-4f1e-adbc-9bad615d3c80 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d45dc825004ad4916d457f34eb0559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be18e35977441e8abe699f77e2b74c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:22.076773 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8979c1f3-10c8-4f1e-adbc-9bad615d3c80 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 200 len: 1277 microversion: 2.1 time: 0.150373 Oct 04 21:16:22.080407 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1258/2579] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:21 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:22.202557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-437a82a6-eb65-4f00-979f-2ca21e2fa11f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:22.203179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-437a82a6-eb65-4f00-979f-2ca21e2fa11f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:22.209760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-437a82a6-eb65-4f00-979f-2ca21e2fa11f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:22.210508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-437a82a6-eb65-4f00-979f-2ca21e2fa11f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:22.210959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-437a82a6-eb65-4f00-979f-2ca21e2fa11f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:22.211679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-437a82a6-eb65-4f00-979f-2ca21e2fa11f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:22.212144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-437a82a6-eb65-4f00-979f-2ca21e2fa11f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:22.212574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-437a82a6-eb65-4f00-979f-2ca21e2fa11f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:22.246220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-437a82a6-eb65-4f00-979f-2ca21e2fa11f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:22.246813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-437a82a6-eb65-4f00-979f-2ca21e2fa11f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:22.247344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-437a82a6-eb65-4f00-979f-2ca21e2fa11f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:22.247870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-437a82a6-eb65-4f00-979f-2ca21e2fa11f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lazy-loading 'fault' on Instance uuid 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:16:22.302723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-437a82a6-eb65-4f00-979f-2ca21e2fa11f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d401d8a2c8e4cee856badba313ed00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df42993975949899553deaeaffada73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:22.315462 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-437a82a6-eb65-4f00-979f-2ca21e2fa11f tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1" status: 200 len: 1315 microversion: 2.1 time: 0.117118 Oct 04 21:16:22.317517 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1259/2580] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:22 2022] GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 => generated 1315 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:22.595179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-98ba63a0-70d0-456e-a4c5-74d5108230e5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:22.596577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-98ba63a0-70d0-456e-a4c5-74d5108230e5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:22.607216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98ba63a0-70d0-456e-a4c5-74d5108230e5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:22.608220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98ba63a0-70d0-456e-a4c5-74d5108230e5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:22.609989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98ba63a0-70d0-456e-a4c5-74d5108230e5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:22.611088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98ba63a0-70d0-456e-a4c5-74d5108230e5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:22.611802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98ba63a0-70d0-456e-a4c5-74d5108230e5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:22.612468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98ba63a0-70d0-456e-a4c5-74d5108230e5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:22.792916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-98ba63a0-70d0-456e-a4c5-74d5108230e5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:22.821224 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-98ba63a0-70d0-456e-a4c5-74d5108230e5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1517 microversion: 2.1 time: 0.230156 Oct 04 21:16:22.821856 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1260/2581] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:22 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1517 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:22.949746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-152f814a-eb1f-4be4-84a6-206d8b3f6bf2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:22.950381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-152f814a-eb1f-4be4-84a6-206d8b3f6bf2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:22.964610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-152f814a-eb1f-4be4-84a6-206d8b3f6bf2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:22.967782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-152f814a-eb1f-4be4-84a6-206d8b3f6bf2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:22.968273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-152f814a-eb1f-4be4-84a6-206d8b3f6bf2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:22.969099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-152f814a-eb1f-4be4-84a6-206d8b3f6bf2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:22.969614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-152f814a-eb1f-4be4-84a6-206d8b3f6bf2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:22.970056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-152f814a-eb1f-4be4-84a6-206d8b3f6bf2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:23.198253 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-63a38dbc-ed5f-422c-a845-e8b29fbe9a2f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.539800 Oct 04 21:16:23.199193 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1322/2582] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Oct 4 21:16:20 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:16:23.203890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1de11e8e-d37b-4a39-b118-0015a3c213a3 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:23.204512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1de11e8e-d37b-4a39-b118-0015a3c213a3 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:23.218390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1de11e8e-d37b-4a39-b118-0015a3c213a3 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:23.220033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1de11e8e-d37b-4a39-b118-0015a3c213a3 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:23.221908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1de11e8e-d37b-4a39-b118-0015a3c213a3 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:23.223377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1de11e8e-d37b-4a39-b118-0015a3c213a3 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:23.224265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1de11e8e-d37b-4a39-b118-0015a3c213a3 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:23.224854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1de11e8e-d37b-4a39-b118-0015a3c213a3 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:23.234756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-152f814a-eb1f-4be4-84a6-206d8b3f6bf2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:23.248145 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-152f814a-eb1f-4be4-84a6-206d8b3f6bf2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031" status: 200 len: 1366 microversion: 2.1 time: 0.303886 Oct 04 21:16:23.249332 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1261/2583] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:22 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:23.257008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b6093916-4f45-4261-9886-6519553dd0af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Action: 'action', calling method: .version_select at 0x7f5791effd30>, body: {"addFloatingIp": {"address": "172.25.8.243"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:23.262430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b6093916-4f45-4261-9886-6519553dd0af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:23.270547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6093916-4f45-4261-9886-6519553dd0af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:23.274623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6093916-4f45-4261-9886-6519553dd0af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:23.274623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6093916-4f45-4261-9886-6519553dd0af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:23.274623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6093916-4f45-4261-9886-6519553dd0af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:23.274623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6093916-4f45-4261-9886-6519553dd0af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:23.274623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6093916-4f45-4261-9886-6519553dd0af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:23.342079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1de11e8e-d37b-4a39-b118-0015a3c213a3 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d45dc825004ad4916d457f34eb0559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be18e35977441e8abe699f77e2b74c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:23.355286 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1de11e8e-d37b-4a39-b118-0015a3c213a3 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 200 len: 1295 microversion: 2.1 time: 0.151505 Oct 04 21:16:23.355286 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1323/2584] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:23 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 1295 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:23.357218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-f5325e0c-4762-4557-ada2-4b275ea800de req-0aa6d9cc-28fb-4a13-b226-69766d647031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a399223-e902-4114-9172-784bf7c1e031", "tag": "f60715f1-b4ee-4879-a807-ae0bd265e328"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:23.369923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f5325e0c-4762-4557-ada2-4b275ea800de req-0aa6d9cc-28fb-4a13-b226-69766d647031 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:23.371668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f5325e0c-4762-4557-ada2-4b275ea800de req-0aa6d9cc-28fb-4a13-b226-69766d647031 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:23.384882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f5325e0c-4762-4557-ada2-4b275ea800de req-0aa6d9cc-28fb-4a13-b226-69766d647031 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:23.402107 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-f5325e0c-4762-4557-ada2-4b275ea800de req-0aa6d9cc-28fb-4a13-b226-69766d647031 service nova] Creating event network-changed:f60715f1-b4ee-4879-a807-ae0bd265e328 for instance 3a399223-e902-4114-9172-784bf7c1e031 on n-h2-860282-1 Oct 04 21:16:23.408253 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-f5325e0c-4762-4557-ada2-4b275ea800de req-0aa6d9cc-28fb-4a13-b226-69766d647031 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054434 Oct 04 21:16:23.409690 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1324/2585] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:23.415064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6093916-4f45-4261-9886-6519553dd0af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "refresh_cache-d9a1a3ee-1603-44d6-a94b-062f492cf8b1" {{(pid=122757) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:16:23.415447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6093916-4f45-4261-9886-6519553dd0af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquired lock "refresh_cache-d9a1a3ee-1603-44d6-a94b-062f492cf8b1" {{(pid=122757) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:16:23.417828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-168d315e-f547-4ccf-a269-22f952ad6dfb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:23.418665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-168d315e-f547-4ccf-a269-22f952ad6dfb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:23.425789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-168d315e-f547-4ccf-a269-22f952ad6dfb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:23.426583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-168d315e-f547-4ccf-a269-22f952ad6dfb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:23.427303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-168d315e-f547-4ccf-a269-22f952ad6dfb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:23.428269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-168d315e-f547-4ccf-a269-22f952ad6dfb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:23.429284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-168d315e-f547-4ccf-a269-22f952ad6dfb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:23.430012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-168d315e-f547-4ccf-a269-22f952ad6dfb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:23.446208 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-168d315e-f547-4ccf-a269-22f952ad6dfb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] HTTP exception thrown: Instance 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 could not be found. Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-168d315e-f547-4ccf-a269-22f952ad6dfb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Request method failure captured: Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 HTTP/1.1 Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKIfr0EKjh9lIGpSMallYOOhbfjlmceWYXhhzEhZtKG-K5Qftah8sJPPQwARLxF148gLNgWQ6TQI3CtHtfXOURD85vgsMSrUAP7uSOEzn9FGu8hya9wg7xCbpv6yrgC_TH3BeALF5PS38pqVs3tUVO2zaGck0ZnqjmCZGgWvxK0EmDc Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 4df42993975949899553deaeaffada73 Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4df42993975949899553deaeaffada73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4df42993975949899553deaeaffada73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}] Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 4df42993975949899553deaeaffada73 Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 4d401d8a2c8e4cee856badba313ed00a Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 could not be found. Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1'} Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 could not be found. Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 could not be found. Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.448901 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:23.452598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.452598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:23.452598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:23.452598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:23.452598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:23.452598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:23.452598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 could not be found. Oct 04 21:16:23.452598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.455650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-168d315e-f547-4ccf-a269-22f952ad6dfb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Returning 404 to user: Instance 1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:23.456763 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-168d315e-f547-4ccf-a269-22f952ad6dfb tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1" status: 404 len: 111 microversion: 2.1 time: 0.045726 Oct 04 21:16:23.463265 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1325/2586] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:23 2022] GET /compute/v2.1/servers/1ee6b7c0-edf0-4ad3-b6d6-c4429c750fa1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:23.466859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2293c1c4-5fa1-4d93-a3eb-9241a8b7d977 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '.version_select at 0x7f578b68a700>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:23.504497 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-2293c1c4-5fa1-4d93-a3eb-9241a8b7d977 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] HTTP exception thrown: Image not found. Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2293c1c4-5fa1-4d93-a3eb-9241a8b7d977 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Request method failure captured: Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/images/66723ea1-9ee4-4600-a0fd-6cc7be3a5cf5 HTTP/1.1 Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKIfr0EKjh9lIGpSMallYOOhbfjlmceWYXhhzEhZtKG-K5Qftah8sJPPQwARLxF148gLNgWQ6TQI3CtHtfXOURD85vgsMSrUAP7uSOEzn9FGu8hya9wg7xCbpv6yrgC_TH3BeALF5PS38pqVs3tUVO2zaGck0ZnqjmCZGgWvxK0EmDc Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 4df42993975949899553deaeaffada73 Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4df42993975949899553deaeaffada73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4df42993975949899553deaeaffada73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}] Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 4df42993975949899553deaeaffada73 Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 4d401d8a2c8e4cee856badba313ed00a Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: exception: Image not found. Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '66723ea1-9ee4-4600-a0fd-6cc7be3a5cf5'} Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 66723ea1-9ee4-4600-a0fd-6cc7be3a5cf5 to delete Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 66723ea1-9ee4-4600-a0fd-6cc7be3a5cf5 could not be found. Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:23.509159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.513732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2293c1c4-5fa1-4d93-a3eb-9241a8b7d977 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Returning 404 to user: Image not found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:23.517561 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2293c1c4-5fa1-4d93-a3eb-9241a8b7d977 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "DELETE /compute/v2.1/images/66723ea1-9ee4-4600-a0fd-6cc7be3a5cf5" status: 404 len: 62 microversion: 2.1 time: 0.051116 Oct 04 21:16:23.521886 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1326/2587] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:23 2022] DELETE /compute/v2.1/images/66723ea1-9ee4-4600-a0fd-6cc7be3a5cf5 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:16:23.529404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-912a1548-d526-4ef2-a41e-7dba9da6c497 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:23.536618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-912a1548-d526-4ef2-a41e-7dba9da6c497 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:23.540325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-912a1548-d526-4ef2-a41e-7dba9da6c497 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:23.541349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-912a1548-d526-4ef2-a41e-7dba9da6c497 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:23.542048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-912a1548-d526-4ef2-a41e-7dba9da6c497 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:23.543216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-912a1548-d526-4ef2-a41e-7dba9da6c497 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:23.543900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-912a1548-d526-4ef2-a41e-7dba9da6c497 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:23.544564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-912a1548-d526-4ef2-a41e-7dba9da6c497 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:23.564209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:23.578606 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-912a1548-d526-4ef2-a41e-7dba9da6c497 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] HTTP exception thrown: Instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d could not be found. Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-912a1548-d526-4ef2-a41e-7dba9da6c497 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Request method failure captured: Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d HTTP/1.1 Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKIfr0EKjh9lIGpSMallYOOhbfjlmceWYXhhzEhZtKG-K5Qftah8sJPPQwARLxF148gLNgWQ6TQI3CtHtfXOURD85vgsMSrUAP7uSOEzn9FGu8hya9wg7xCbpv6yrgC_TH3BeALF5PS38pqVs3tUVO2zaGck0ZnqjmCZGgWvxK0EmDc Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 4df42993975949899553deaeaffada73 Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4df42993975949899553deaeaffada73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4df42993975949899553deaeaffada73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}] Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 4df42993975949899553deaeaffada73 Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 4d401d8a2c8e4cee856badba313ed00a Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d could not be found. Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'e99ebe26-2264-4e7c-ac4e-6f8e0435b98d'} Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d could not be found. Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:16:23.582461 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:23.588159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d could not be found. Oct 04 21:16:23.588159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.588159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:23.588159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.588159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:23.588159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:23.588159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:23.588159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:23.588159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:23.588159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d could not be found. Oct 04 21:16:23.588159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.590267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-912a1548-d526-4ef2-a41e-7dba9da6c497 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Returning 404 to user: Instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:23.591712 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-912a1548-d526-4ef2-a41e-7dba9da6c497 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 404 len: 111 microversion: 2.1 time: 0.067799 Oct 04 21:16:23.592607 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1327/2588] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:16:23 2022] DELETE /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:23.603462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ab8afcd6-8561-476d-82b0-f79a72a1387a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:23.604408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ab8afcd6-8561-476d-82b0-f79a72a1387a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: e99ebe26-2264-4e7c-ac4e-6f8e0435b98d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:23.612467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab8afcd6-8561-476d-82b0-f79a72a1387a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:23.613372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab8afcd6-8561-476d-82b0-f79a72a1387a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:23.614116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab8afcd6-8561-476d-82b0-f79a72a1387a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:23.615008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab8afcd6-8561-476d-82b0-f79a72a1387a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:23.615950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab8afcd6-8561-476d-82b0-f79a72a1387a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:23.617031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab8afcd6-8561-476d-82b0-f79a72a1387a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:23.635630 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-ab8afcd6-8561-476d-82b0-f79a72a1387a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] HTTP exception thrown: Instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d could not be found. Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ab8afcd6-8561-476d-82b0-f79a72a1387a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Request method failure captured: Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d HTTP/1.1 Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKIfr0EKjh9lIGpSMallYOOhbfjlmceWYXhhzEhZtKG-K5Qftah8sJPPQwARLxF148gLNgWQ6TQI3CtHtfXOURD85vgsMSrUAP7uSOEzn9FGu8hya9wg7xCbpv6yrgC_TH3BeALF5PS38pqVs3tUVO2zaGck0ZnqjmCZGgWvxK0EmDc Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 4df42993975949899553deaeaffada73 Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4df42993975949899553deaeaffada73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4df42993975949899553deaeaffada73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}] Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 4df42993975949899553deaeaffada73 Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 4d401d8a2c8e4cee856badba313ed00a Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d could not be found. Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'e99ebe26-2264-4e7c-ac4e-6f8e0435b98d'} Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d could not be found. Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d could not be found. Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.638394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:23.642148 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.642148 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:23.642148 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:23.642148 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:23.642148 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:23.642148 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:23.642148 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d could not be found. Oct 04 21:16:23.642148 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:23.645512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ab8afcd6-8561-476d-82b0-f79a72a1387a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Returning 404 to user: Instance e99ebe26-2264-4e7c-ac4e-6f8e0435b98d could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:23.648541 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ab8afcd6-8561-476d-82b0-f79a72a1387a tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d" status: 404 len: 111 microversion: 2.1 time: 0.050605 Oct 04 21:16:23.652903 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1328/2589] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:23 2022] GET /compute/v2.1/servers/e99ebe26-2264-4e7c-ac4e-6f8e0435b98d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:23.663508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fe55b9e9-350a-40e8-bf9f-704c7bb6fe17 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '.version_select at 0x7f578b68a040>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:23.839269 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fe55b9e9-350a-40e8-bf9f-704c7bb6fe17 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1637100204" status: 202 len: 0 microversion: 2.1 time: 0.183194 Oct 04 21:16:23.840061 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1329/2590] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Oct 4 21:16:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1637100204 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:16:24.277545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3119ac72-7e01-4130-9238-494523df8396 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:24.278328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3119ac72-7e01-4130-9238-494523df8396 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:24.311516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3119ac72-7e01-4130-9238-494523df8396 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:24.312336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3119ac72-7e01-4130-9238-494523df8396 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:24.313035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3119ac72-7e01-4130-9238-494523df8396 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:24.314051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3119ac72-7e01-4130-9238-494523df8396 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:24.315124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3119ac72-7e01-4130-9238-494523df8396 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:24.315855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3119ac72-7e01-4130-9238-494523df8396 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:24.534244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:24.806834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3119ac72-7e01-4130-9238-494523df8396 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:24.820561 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3119ac72-7e01-4130-9238-494523df8396 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031" status: 200 len: 1366 microversion: 2.1 time: 0.547275 Oct 04 21:16:24.822657 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1330/2591] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:24 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 => generated 1366 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:24.835827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-09e8873c-43c4-4599-8182-d258c8f02283 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:24.836517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-09e8873c-43c4-4599-8182-d258c8f02283 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:24.853095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-09e8873c-43c4-4599-8182-d258c8f02283 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:24.854998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-09e8873c-43c4-4599-8182-d258c8f02283 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:24.855570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-09e8873c-43c4-4599-8182-d258c8f02283 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:24.856916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-09e8873c-43c4-4599-8182-d258c8f02283 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:24.862659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-09e8873c-43c4-4599-8182-d258c8f02283 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:24.863198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-09e8873c-43c4-4599-8182-d258c8f02283 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:25.112287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-09e8873c-43c4-4599-8182-d258c8f02283 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d45dc825004ad4916d457f34eb0559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be18e35977441e8abe699f77e2b74c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:25.120816 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-09e8873c-43c4-4599-8182-d258c8f02283 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 200 len: 1351 microversion: 2.1 time: 0.297101 Oct 04 21:16:25.121511 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1331/2592] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:24 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 1351 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:25.126566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-99126501-d372-4e37-93b9-216455b0b6be tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b1550e6-c874-4b79-b119-479817a08986"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:25.129142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-99126501-d372-4e37-93b9-216455b0b6be tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:25.135351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99126501-d372-4e37-93b9-216455b0b6be tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:25.135840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99126501-d372-4e37-93b9-216455b0b6be tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:25.141922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99126501-d372-4e37-93b9-216455b0b6be tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:25.141922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99126501-d372-4e37-93b9-216455b0b6be tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:25.141922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99126501-d372-4e37-93b9-216455b0b6be tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:25.141922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99126501-d372-4e37-93b9-216455b0b6be tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:25.867375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-b6093916-4f45-4261-9886-6519553dd0af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Building network info cache for instance {{(pid=122757) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 21:16:26.057511 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-99126501-d372-4e37-93b9-216455b0b6be tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "POST /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.933873 Oct 04 21:16:26.059479 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1332/2593] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 21:16:25 2022] POST /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687/os-volume_attachments => generated 194 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:26.091247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bd35e977-8bf3-4ccd-8e5f-956f6f21465e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:26.096353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bd35e977-8bf3-4ccd-8e5f-956f6f21465e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:26.115290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd35e977-8bf3-4ccd-8e5f-956f6f21465e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:26.117016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd35e977-8bf3-4ccd-8e5f-956f6f21465e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:26.120895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd35e977-8bf3-4ccd-8e5f-956f6f21465e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:26.122359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd35e977-8bf3-4ccd-8e5f-956f6f21465e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:26.123823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd35e977-8bf3-4ccd-8e5f-956f6f21465e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:26.125060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd35e977-8bf3-4ccd-8e5f-956f6f21465e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:26.671479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bd35e977-8bf3-4ccd-8e5f-956f6f21465e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:26.681018 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bd35e977-8bf3-4ccd-8e5f-956f6f21465e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031" status: 200 len: 1366 microversion: 2.1 time: 0.619473 Oct 04 21:16:26.686871 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1333/2594] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:26 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 => generated 1366 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:26.968009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-b90125ef-86a1-4ca6-a741-ea4f39649c7c req-b1604de1-38c9-4093-a72b-480ec75d9d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a1a3ee-1603-44d6-a94b-062f492cf8b1", "tag": "5d5701df-ff17-499d-996e-479664d1c9d5"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:26.969671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-b6093916-4f45-4261-9886-6519553dd0af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Updating instance_info_cache with network_info: [{"id": "5d5701df-ff17-499d-996e-479664d1c9d5", "address": "fa:16:3e:ec:a4:12", "network": {"id": "5705269e-a277-4ae4-8dba-51564dfd8922", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1300302163-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b2ea0a3effb846858c46355590f437cf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5d5701df-ff", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122757) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:16:26.984525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b90125ef-86a1-4ca6-a741-ea4f39649c7c req-b1604de1-38c9-4093-a72b-480ec75d9d9e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:26.986537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b90125ef-86a1-4ca6-a741-ea4f39649c7c req-b1604de1-38c9-4093-a72b-480ec75d9d9e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:26.987246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b90125ef-86a1-4ca6-a741-ea4f39649c7c req-b1604de1-38c9-4093-a72b-480ec75d9d9e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:27.042404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6093916-4f45-4261-9886-6519553dd0af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Releasing lock "refresh_cache-d9a1a3ee-1603-44d6-a94b-062f492cf8b1" {{(pid=122757) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:16:27.043752 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b6093916-4f45-4261-9886-6519553dd0af tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "POST /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1/action" status: 202 len: 0 microversion: 2.1 time: 3.792586 Oct 04 21:16:27.044362 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-b90125ef-86a1-4ca6-a741-ea4f39649c7c req-b1604de1-38c9-4093-a72b-480ec75d9d9e service nova] Creating event network-changed:5d5701df-ff17-499d-996e-479664d1c9d5 for instance d9a1a3ee-1603-44d6-a94b-062f492cf8b1 on n-h2-860282-1 Oct 04 21:16:27.052597 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1262/2595] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:16:23 2022] POST /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1/action => generated 0 bytes in 3798 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 21:16:27.054370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2462c134-36f2-462d-b741-e930a4caa367 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Action: 'create', calling method: .version_select at 0x7f57945631f0>, body: {"keypair": {"name": "tempest-keypair-485431192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHObAqgH12UKdDAFJ0Sw5k/KVcdD3DCD1X2Af3j7N9nFWGpo6O/YMLjwRB0i3uzdufSM9x/eDYb9em8qUvK22dU8AWFuHoNfjVem7yda+50yYrR5X/7CjAQFGEwFLcXCQ=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:27.057822 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-b90125ef-86a1-4ca6-a741-ea4f39649c7c req-b1604de1-38c9-4093-a72b-480ec75d9d9e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.368933 Oct 04 21:16:27.059954 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1334/2596] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:27.074203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-e283fee0-fdfa-48cb-a545-7a7ccebaa325 req-034b5c61-1b12-4394-91c9-adb9644888ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c94d29d0-adc3-4d49-bf41-31e631622656", "tag": "a89fa5c2-db37-4da6-9d30-28a28cd733d2"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:27.090875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e283fee0-fdfa-48cb-a545-7a7ccebaa325 req-034b5c61-1b12-4394-91c9-adb9644888ca service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:27.091125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-2462c134-36f2-462d-b741-e930a4caa367 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Getting quotas for project 047ff2c9b6414ce8b98364678cbfeb53. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:16:27.092512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e283fee0-fdfa-48cb-a545-7a7ccebaa325 req-034b5c61-1b12-4394-91c9-adb9644888ca service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:27.098854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e283fee0-fdfa-48cb-a545-7a7ccebaa325 req-034b5c61-1b12-4394-91c9-adb9644888ca service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:27.115469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-2462c134-36f2-462d-b741-e930a4caa367 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Getting quotas for user abb3ac58c2ea4e2da8b9e765eda5f333 and project 047ff2c9b6414ce8b98364678cbfeb53. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:16:27.120676 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-e283fee0-fdfa-48cb-a545-7a7ccebaa325 req-034b5c61-1b12-4394-91c9-adb9644888ca service nova] Creating event network-changed:a89fa5c2-db37-4da6-9d30-28a28cd733d2 for instance c94d29d0-adc3-4d49-bf41-31e631622656 on n-h2-860282-1 Oct 04 21:16:27.142574 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-e283fee0-fdfa-48cb-a545-7a7ccebaa325 req-034b5c61-1b12-4394-91c9-adb9644888ca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076958 Oct 04 21:16:27.143190 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1335/2597] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:27.149328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c1df6fe0-dc36-4668-8001-0f7e0244dd64 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:27.157074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c1df6fe0-dc36-4668-8001-0f7e0244dd64 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:27.168783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1df6fe0-dc36-4668-8001-0f7e0244dd64 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:27.169638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1df6fe0-dc36-4668-8001-0f7e0244dd64 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:27.170267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1df6fe0-dc36-4668-8001-0f7e0244dd64 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:27.171187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1df6fe0-dc36-4668-8001-0f7e0244dd64 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:27.172216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1df6fe0-dc36-4668-8001-0f7e0244dd64 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:27.172862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1df6fe0-dc36-4668-8001-0f7e0244dd64 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:27.242496 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2462c134-36f2-462d-b741-e930a4caa367 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.192901 Oct 04 21:16:27.243173 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1263/2598] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:16:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:27.249245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f929e4a4-9f66-47f1-a310-a6b397b84e91 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '.version_select at 0x7f579459adc0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:27.297836 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-f929e4a4-9f66-47f1-a310-a6b397b84e91 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] HTTP exception thrown: Image not found. Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f929e4a4-9f66-47f1-a310-a6b397b84e91 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Request method failure captured: Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/images/47a19102-4fa8-4a3f-b0fc-7fb92622f944 HTTP/1.1 Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKIfr0EKjh9lIGpSMallYOOhbfjlmceWYXhhzEhZtKG-K5Qftah8sJPPQwARLxF148gLNgWQ6TQI3CtHtfXOURD85vgsMSrUAP7uSOEzn9FGu8hya9wg7xCbpv6yrgC_TH3BeALF5PS38pqVs3tUVO2zaGck0ZnqjmCZGgWvxK0EmDc Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 4df42993975949899553deaeaffada73 Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4df42993975949899553deaeaffada73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4df42993975949899553deaeaffada73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}] Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 4df42993975949899553deaeaffada73 Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 4d401d8a2c8e4cee856badba313ed00a Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: exception: Image not found. Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '47a19102-4fa8-4a3f-b0fc-7fb92622f944'} Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 47a19102-4fa8-4a3f-b0fc-7fb92622f944 to delete Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 47a19102-4fa8-4a3f-b0fc-7fb92622f944 could not be found. Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:27.300425 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:16:27.304872 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:27.309473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f929e4a4-9f66-47f1-a310-a6b397b84e91 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Returning 404 to user: Image not found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:27.309473 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f929e4a4-9f66-47f1-a310-a6b397b84e91 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "DELETE /compute/v2.1/images/47a19102-4fa8-4a3f-b0fc-7fb92622f944" status: 404 len: 62 microversion: 2.1 time: 0.064002 Oct 04 21:16:27.309473 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1264/2599] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:27 2022] DELETE /compute/v2.1/images/47a19102-4fa8-4a3f-b0fc-7fb92622f944 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:16:27.315850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6e1cca1e-0128-4b63-b003-d12f8b050a08 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Action: 'create', calling method: .version_select at 0x7f57907193a0>, body: {"pool": "ebedf1d9-7fee-45d5-b9f8-18ec236ab757"} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:27.492706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c1df6fe0-dc36-4668-8001-0f7e0244dd64 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d45dc825004ad4916d457f34eb0559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be18e35977441e8abe699f77e2b74c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:27.502339 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c1df6fe0-dc36-4668-8001-0f7e0244dd64 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 200 len: 1351 microversion: 2.1 time: 0.357755 Oct 04 21:16:27.512451 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1336/2600] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:27 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 1351 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:27.527935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9821c81d-8f55-4250-a43d-6abff1e187b6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:27.528706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9821c81d-8f55-4250-a43d-6abff1e187b6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:27.541680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9821c81d-8f55-4250-a43d-6abff1e187b6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:27.544918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9821c81d-8f55-4250-a43d-6abff1e187b6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:27.545640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9821c81d-8f55-4250-a43d-6abff1e187b6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:27.548063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9821c81d-8f55-4250-a43d-6abff1e187b6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:27.549323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9821c81d-8f55-4250-a43d-6abff1e187b6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:27.551121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9821c81d-8f55-4250-a43d-6abff1e187b6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:27.590667 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-9821c81d-8f55-4250-a43d-6abff1e187b6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] HTTP exception thrown: Instance 05f65528-e8a7-4637-a1bf-1baf79b315eb could not be found. Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9821c81d-8f55-4250-a43d-6abff1e187b6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Request method failure captured: Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb HTTP/1.1 Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKIfr0EKjh9lIGpSMallYOOhbfjlmceWYXhhzEhZtKG-K5Qftah8sJPPQwARLxF148gLNgWQ6TQI3CtHtfXOURD85vgsMSrUAP7uSOEzn9FGu8hya9wg7xCbpv6yrgC_TH3BeALF5PS38pqVs3tUVO2zaGck0ZnqjmCZGgWvxK0EmDc Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 4df42993975949899553deaeaffada73 Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4df42993975949899553deaeaffada73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4df42993975949899553deaeaffada73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}] Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 4df42993975949899553deaeaffada73 Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 4d401d8a2c8e4cee856badba313ed00a Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 05f65528-e8a7-4637-a1bf-1baf79b315eb could not be found. Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '05f65528-e8a7-4637-a1bf-1baf79b315eb'} Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05f65528-e8a7-4637-a1bf-1baf79b315eb could not be found. Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:16:27.593015 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:27.597112 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05f65528-e8a7-4637-a1bf-1baf79b315eb could not be found. Oct 04 21:16:27.597112 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:27.597112 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:27.597112 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:27.597112 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:27.597112 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:27.597112 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:27.597112 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:27.597112 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:27.597112 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05f65528-e8a7-4637-a1bf-1baf79b315eb could not be found. Oct 04 21:16:27.597112 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:27.597112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9821c81d-8f55-4250-a43d-6abff1e187b6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Returning 404 to user: Instance 05f65528-e8a7-4637-a1bf-1baf79b315eb could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:27.597112 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9821c81d-8f55-4250-a43d-6abff1e187b6 tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "DELETE /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 404 len: 111 microversion: 2.1 time: 0.080205 Oct 04 21:16:27.598378 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1337/2601] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:16:27 2022] DELETE /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:27.612834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c0c5baf7-bb0b-4589-8821-767afccea506 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:27.630265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c0c5baf7-bb0b-4589-8821-767afccea506 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:27.631953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c0c5baf7-bb0b-4589-8821-767afccea506 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Searching by: {'deleted': False, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:16:27.642100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0c5baf7-bb0b-4589-8821-767afccea506 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:27.642835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0c5baf7-bb0b-4589-8821-767afccea506 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:27.648568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0c5baf7-bb0b-4589-8821-767afccea506 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:27.649363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0c5baf7-bb0b-4589-8821-767afccea506 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:27.650039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0c5baf7-bb0b-4589-8821-767afccea506 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:27.650483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0c5baf7-bb0b-4589-8821-767afccea506 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:27.685258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.multi_cell_list [None req-c0c5baf7-bb0b-4589-8821-767afccea506 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:16:27.722031 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c0c5baf7-bb0b-4589-8821-767afccea506 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.122366 Oct 04 21:16:27.722645 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1338/2602] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Oct 4 21:16:27 2022] GET /compute/v2.1/servers => generated 334 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:27.727427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fa2d20c1-1f9d-4b73-bfda-e74097d3234c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:27.728031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fa2d20c1-1f9d-4b73-bfda-e74097d3234c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] [instance: 05f65528-e8a7-4637-a1bf-1baf79b315eb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:27.734264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa2d20c1-1f9d-4b73-bfda-e74097d3234c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:27.734744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa2d20c1-1f9d-4b73-bfda-e74097d3234c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:27.735181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa2d20c1-1f9d-4b73-bfda-e74097d3234c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:27.737443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa2d20c1-1f9d-4b73-bfda-e74097d3234c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:27.737443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa2d20c1-1f9d-4b73-bfda-e74097d3234c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:27.737443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa2d20c1-1f9d-4b73-bfda-e74097d3234c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:27.750833 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-fa2d20c1-1f9d-4b73-bfda-e74097d3234c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] HTTP exception thrown: Instance 05f65528-e8a7-4637-a1bf-1baf79b315eb could not be found. Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fa2d20c1-1f9d-4b73-bfda-e74097d3234c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Request method failure captured: Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb HTTP/1.1 Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKIfr0EKjh9lIGpSMallYOOhbfjlmceWYXhhzEhZtKG-K5Qftah8sJPPQwARLxF148gLNgWQ6TQI3CtHtfXOURD85vgsMSrUAP7uSOEzn9FGu8hya9wg7xCbpv6yrgC_TH3BeALF5PS38pqVs3tUVO2zaGck0ZnqjmCZGgWvxK0EmDc Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 4df42993975949899553deaeaffada73 Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4df42993975949899553deaeaffada73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4df42993975949899553deaeaffada73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4df42993975949899553deaeaffada73"}]}] Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 4df42993975949899553deaeaffada73 Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797 Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 4d401d8a2c8e4cee856badba313ed00a Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1595052797-project Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 05f65528-e8a7-4637-a1bf-1baf79b315eb could not be found. Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '05f65528-e8a7-4637-a1bf-1baf79b315eb'} Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05f65528-e8a7-4637-a1bf-1baf79b315eb could not be found. Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05f65528-e8a7-4637-a1bf-1baf79b315eb could not be found. Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:27.752366 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:27.757059 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:27.757059 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:27.757059 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:27.757059 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:27.757059 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:27.757059 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:27.757059 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05f65528-e8a7-4637-a1bf-1baf79b315eb could not be found. Oct 04 21:16:27.757059 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:27.757059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fa2d20c1-1f9d-4b73-bfda-e74097d3234c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] Returning 404 to user: Instance 05f65528-e8a7-4637-a1bf-1baf79b315eb could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:27.757059 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fa2d20c1-1f9d-4b73-bfda-e74097d3234c tempest-ImagesOneServerNegativeTestJSON-1595052797 tempest-ImagesOneServerNegativeTestJSON-1595052797-project] 10.222.0.30 "GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb" status: 404 len: 111 microversion: 2.1 time: 0.030182 Oct 04 21:16:27.757059 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1339/2603] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:27 2022] GET /compute/v2.1/servers/05f65528-e8a7-4637-a1bf-1baf79b315eb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:27.765589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-053affc7-0de5-4f02-a042-ed5ae3320338 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:27.766425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-053affc7-0de5-4f02-a042-ed5ae3320338 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:27.775012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-053affc7-0de5-4f02-a042-ed5ae3320338 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:27.775756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-053affc7-0de5-4f02-a042-ed5ae3320338 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:27.777164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-053affc7-0de5-4f02-a042-ed5ae3320338 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:27.778069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-053affc7-0de5-4f02-a042-ed5ae3320338 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:27.778700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-053affc7-0de5-4f02-a042-ed5ae3320338 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:27.780254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-053affc7-0de5-4f02-a042-ed5ae3320338 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:28.061858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-053affc7-0de5-4f02-a042-ed5ae3320338 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:28.074274 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-053affc7-0de5-4f02-a042-ed5ae3320338 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031" status: 200 len: 1366 microversion: 2.1 time: 0.313710 Oct 04 21:16:28.080800 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1340/2604] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:27 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:28.102990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3fe21f26-6037-4562-ac49-846f99c6283f tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:28.110617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3fe21f26-6037-4562-ac49-846f99c6283f tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:28.111851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3fe21f26-6037-4562-ac49-846f99c6283f tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Searching by: {'deleted': False, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:16:28.119130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fe21f26-6037-4562-ac49-846f99c6283f tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:28.119968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fe21f26-6037-4562-ac49-846f99c6283f tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:28.121256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fe21f26-6037-4562-ac49-846f99c6283f tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:28.122353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fe21f26-6037-4562-ac49-846f99c6283f tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:28.123033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fe21f26-6037-4562-ac49-846f99c6283f tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:28.123679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fe21f26-6037-4562-ac49-846f99c6283f tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:28.157393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.multi_cell_list [None req-3fe21f26-6037-4562-ac49-846f99c6283f tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:16:28.212933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3fe21f26-6037-4562-ac49-846f99c6283f tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:28.223394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fe21f26-6037-4562-ac49-846f99c6283f tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:28.224316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fe21f26-6037-4562-ac49-846f99c6283f tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:28.225643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fe21f26-6037-4562-ac49-846f99c6283f tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:28.564168 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3fe21f26-6037-4562-ac49-846f99c6283f tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.479649 Oct 04 21:16:28.564758 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1341/2605] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:16:28 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:28.600666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8a02b847-a73d-4acb-a3cf-7b0ebd9048be tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:28.602684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8a02b847-a73d-4acb-a3cf-7b0ebd9048be tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:28.616946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a02b847-a73d-4acb-a3cf-7b0ebd9048be tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:28.618051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a02b847-a73d-4acb-a3cf-7b0ebd9048be tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:28.618648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a02b847-a73d-4acb-a3cf-7b0ebd9048be tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:28.619590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a02b847-a73d-4acb-a3cf-7b0ebd9048be tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:28.623033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a02b847-a73d-4acb-a3cf-7b0ebd9048be tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:28.623816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a02b847-a73d-4acb-a3cf-7b0ebd9048be tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:28.853591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8a02b847-a73d-4acb-a3cf-7b0ebd9048be tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d45dc825004ad4916d457f34eb0559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be18e35977441e8abe699f77e2b74c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:28.864857 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8a02b847-a73d-4acb-a3cf-7b0ebd9048be tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 200 len: 1351 microversion: 2.1 time: 0.283631 Oct 04 21:16:28.866379 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1342/2606] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:28 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 1351 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:28.879250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-59372c5b-a7f3-4b54-94dc-8378acb4d049 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:28.893732 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-59372c5b-a7f3-4b54-94dc-8378acb4d049 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025743 Oct 04 21:16:28.895075 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1343/2607] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:16:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:29.107277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-56255901-84a3-4204-9584-b1c1a5bb1e1d tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:29.108661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-56255901-84a3-4204-9584-b1c1a5bb1e1d tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:29.118021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56255901-84a3-4204-9584-b1c1a5bb1e1d tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:29.118949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56255901-84a3-4204-9584-b1c1a5bb1e1d tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:29.119500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56255901-84a3-4204-9584-b1c1a5bb1e1d tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:29.120356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56255901-84a3-4204-9584-b1c1a5bb1e1d tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:29.120922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56255901-84a3-4204-9584-b1c1a5bb1e1d tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:29.121760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56255901-84a3-4204-9584-b1c1a5bb1e1d tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:29.470108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-56255901-84a3-4204-9584-b1c1a5bb1e1d tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:29.480126 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-56255901-84a3-4204-9584-b1c1a5bb1e1d tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031" status: 200 len: 1366 microversion: 2.1 time: 0.376968 Oct 04 21:16:29.482519 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1344/2608] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:29 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:29.489917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c2cbe676-2f86-4dfb-9fb9-df85dd38a269 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:29.491156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c2cbe676-2f86-4dfb-9fb9-df85dd38a269 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:29.505661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2cbe676-2f86-4dfb-9fb9-df85dd38a269 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:29.507041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2cbe676-2f86-4dfb-9fb9-df85dd38a269 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:29.508159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2cbe676-2f86-4dfb-9fb9-df85dd38a269 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:29.509049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2cbe676-2f86-4dfb-9fb9-df85dd38a269 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:29.509708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2cbe676-2f86-4dfb-9fb9-df85dd38a269 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:29.510303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2cbe676-2f86-4dfb-9fb9-df85dd38a269 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:29.558398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c2cbe676-2f86-4dfb-9fb9-df85dd38a269 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:16:29.704116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:29.769363 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6e1cca1e-0128-4b63-b003-d12f8b050a08 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.458571 Oct 04 21:16:29.770104 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1265/2609] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Oct 4 21:16:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:29.783529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-17096168-3f9c-4c50-90e7-ff7f748acea4 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.107"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:29.786892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-17096168-3f9c-4c50-90e7-ff7f748acea4 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:29.803441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17096168-3f9c-4c50-90e7-ff7f748acea4 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:29.806998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17096168-3f9c-4c50-90e7-ff7f748acea4 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:29.807541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17096168-3f9c-4c50-90e7-ff7f748acea4 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:29.808766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17096168-3f9c-4c50-90e7-ff7f748acea4 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:29.810148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17096168-3f9c-4c50-90e7-ff7f748acea4 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:29.812622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17096168-3f9c-4c50-90e7-ff7f748acea4 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:29.876387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17096168-3f9c-4c50-90e7-ff7f748acea4 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "refresh_cache-d9a1a3ee-1603-44d6-a94b-062f492cf8b1" {{(pid=122757) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:16:29.877200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17096168-3f9c-4c50-90e7-ff7f748acea4 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquired lock "refresh_cache-d9a1a3ee-1603-44d6-a94b-062f492cf8b1" {{(pid=122757) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:16:29.907689 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c2cbe676-2f86-4dfb-9fb9-df85dd38a269 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189" status: 204 len: 0 microversion: 2.1 time: 0.423245 Oct 04 21:16:29.907928 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1345/2610] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:16:29 2022] DELETE /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:16:29.917840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5dcf3359-858b-49a6-97c8-959249e62b9e tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:29.917840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5dcf3359-858b-49a6-97c8-959249e62b9e tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:29.941393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5dcf3359-858b-49a6-97c8-959249e62b9e tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:29.946119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5dcf3359-858b-49a6-97c8-959249e62b9e tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:29.946811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5dcf3359-858b-49a6-97c8-959249e62b9e tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:29.948648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5dcf3359-858b-49a6-97c8-959249e62b9e tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:29.951103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5dcf3359-858b-49a6-97c8-959249e62b9e tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:29.951764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5dcf3359-858b-49a6-97c8-959249e62b9e tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:30.292394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5dcf3359-858b-49a6-97c8-959249e62b9e tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d45dc825004ad4916d457f34eb0559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be18e35977441e8abe699f77e2b74c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:30.302609 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5dcf3359-858b-49a6-97c8-959249e62b9e tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 200 len: 1351 microversion: 2.1 time: 0.391854 Oct 04 21:16:30.303343 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1346/2611] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:29 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 1351 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:30.325413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e662b3e3-975f-4b45-9b10-f1e76949394c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:30.326136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e662b3e3-975f-4b45-9b10-f1e76949394c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:30.351157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e662b3e3-975f-4b45-9b10-f1e76949394c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:30.352116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e662b3e3-975f-4b45-9b10-f1e76949394c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:30.352720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e662b3e3-975f-4b45-9b10-f1e76949394c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:30.353647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e662b3e3-975f-4b45-9b10-f1e76949394c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:30.354311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e662b3e3-975f-4b45-9b10-f1e76949394c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:30.354912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e662b3e3-975f-4b45-9b10-f1e76949394c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:30.550130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG neutronclient.v2_0.client [None req-17096168-3f9c-4c50-90e7-ff7f748acea4 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.8.107 (15ad8681-0470-4aa3-8133-6052e5f9d5a1) with port 5d5701df-ff17-499d-996e-479664d1c9d5 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network ebedf1d9-7fee-45d5-b9f8-18ec236ab757.", "detail": ""}} {{(pid=122757) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:16:30.550726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17096168-3f9c-4c50-90e7-ff7f748acea4 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Releasing lock "refresh_cache-d9a1a3ee-1603-44d6-a94b-062f492cf8b1" {{(pid=122757) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:16:30.551522 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-17096168-3f9c-4c50-90e7-ff7f748acea4 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] HTTP exception thrown: Cannot associate floating IP 172.25.8.107 (15ad8681-0470-4aa3-8133-6052e5f9d5a1) with port 5d5701df-ff17-499d-996e-479664d1c9d5 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network ebedf1d9-7fee-45d5-b9f8-18ec236ab757. Oct 04 21:16:30.551522 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-a251ce86-d48f-4239-9e38-17cc84bceebe'] Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-17096168-3f9c-4c50-90e7-ff7f748acea4 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Request method failure captured: Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1/action HTTP/1.1 Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 46 Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKKKtIVfVjPBDFolAE7228ylrVmF3ywkC19muVdtW4uFG1jT_p2Ytq3JV3cDIH7n4fJoqF6dLiBYg9Pb_PRcKhYlRQs4x9CBQ1V4Y3EosDdYkoSiGcfOYpXDUa9Qj9AeX244rU5ocygT_eErkici6aD_hYAUOwVSTMkXSpXyQyg_wGQ Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: b2ea0a3effb846858c46355590f437cf Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906066682 Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b2ea0a3effb846858c46355590f437cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b2ea0a3effb846858c46355590f437cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b2ea0a3effb846858c46355590f437cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b2ea0a3effb846858c46355590f437cf"}]}] Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-906066682 Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: b2ea0a3effb846858c46355590f437cf Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906066682 Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: e46858a6edfa435bb7c68cdc13c05539 Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: {"addFloatingIp": {"address": "172.25.8.107"}} Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: exception: Cannot associate floating IP 172.25.8.107 (15ad8681-0470-4aa3-8133-6052e5f9d5a1) with port 5d5701df-ff17-499d-996e-479664d1c9d5 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network ebedf1d9-7fee-45d5-b9f8-18ec236ab757. Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-a251ce86-d48f-4239-9e38-17cc84bceebe'] Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'd9a1a3ee-1603-44d6-a94b-062f492cf8b1', 'body': {'addFloatingIp': {'address': '172.25.8.107'}}} Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:16:30.553907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.8.107 (15ad8681-0470-4aa3-8133-6052e5f9d5a1) with port 5d5701df-ff17-499d-996e-479664d1c9d5 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network ebedf1d9-7fee-45d5-b9f8-18ec236ab757. Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a251ce86-d48f-4239-9e38-17cc84bceebe'] Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.8.107 (15ad8681-0470-4aa3-8133-6052e5f9d5a1) with port 5d5701df-ff17-499d-996e-479664d1c9d5 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network ebedf1d9-7fee-45d5-b9f8-18ec236ab757. Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a251ce86-d48f-4239-9e38-17cc84bceebe'] Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.8.107 (15ad8681-0470-4aa3-8133-6052e5f9d5a1) with port 5d5701df-ff17-499d-996e-479664d1c9d5 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network ebedf1d9-7fee-45d5-b9f8-18ec236ab757. Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a251ce86-d48f-4239-9e38-17cc84bceebe'] Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.8.107 (15ad8681-0470-4aa3-8133-6052e5f9d5a1) with port 5d5701df-ff17-499d-996e-479664d1c9d5 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network ebedf1d9-7fee-45d5-b9f8-18ec236ab757. Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a251ce86-d48f-4239-9e38-17cc84bceebe'] Oct 04 21:16:30.559357 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:30.564609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-17096168-3f9c-4c50-90e7-ff7f748acea4 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Returning 400 to user: Cannot associate floating IP 172.25.8.107 (15ad8681-0470-4aa3-8133-6052e5f9d5a1) with port 5d5701df-ff17-499d-996e-479664d1c9d5 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network ebedf1d9-7fee-45d5-b9f8-18ec236ab757. Oct 04 21:16:30.564609 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-a251ce86-d48f-4239-9e38-17cc84bceebe'] {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:30.565807 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-17096168-3f9c-4c50-90e7-ff7f748acea4 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "POST /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1/action" status: 400 len: 381 microversion: 2.1 time: 0.786718 Oct 04 21:16:30.570630 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1266/2612] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:16:29 2022] POST /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1/action => generated 381 bytes in 792 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:16:30.606990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0c9a8f94-d827-4cf6-8b40-03ef1e19abcc tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:30.608809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0c9a8f94-d827-4cf6-8b40-03ef1e19abcc tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:30.624902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c9a8f94-d827-4cf6-8b40-03ef1e19abcc tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:30.632888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c9a8f94-d827-4cf6-8b40-03ef1e19abcc tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:30.633602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c9a8f94-d827-4cf6-8b40-03ef1e19abcc tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:30.634647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c9a8f94-d827-4cf6-8b40-03ef1e19abcc tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:30.638723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c9a8f94-d827-4cf6-8b40-03ef1e19abcc tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:30.641498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c9a8f94-d827-4cf6-8b40-03ef1e19abcc tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:30.819262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e662b3e3-975f-4b45-9b10-f1e76949394c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:30.832169 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e662b3e3-975f-4b45-9b10-f1e76949394c tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189" status: 200 len: 1701 microversion: 2.1 time: 0.509446 Oct 04 21:16:30.836193 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1347/2613] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:30 2022] GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 => generated 1701 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:30.854031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4509386b-3503-4249-a73a-f966bda80906 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '.version_select at 0x7f578b6675e0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:31.059012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0c9a8f94-d827-4cf6-8b40-03ef1e19abcc tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:31.070041 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0c9a8f94-d827-4cf6-8b40-03ef1e19abcc tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031" status: 200 len: 1366 microversion: 2.1 time: 0.496384 Oct 04 21:16:31.072456 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1267/2614] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:30 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 => generated 1366 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:31.078804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-d50a221a-dbc1-4c06-8fbd-d18d6cceb54c req-276f6570-cf14-45e4-9e60-9a32e693320e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a399223-e902-4114-9172-784bf7c1e031", "name": "network-vif-plugged", "status": "completed", "tag": "f60715f1-b4ee-4879-a807-ae0bd265e328"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:31.108660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d50a221a-dbc1-4c06-8fbd-d18d6cceb54c req-276f6570-cf14-45e4-9e60-9a32e693320e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:31.109480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d50a221a-dbc1-4c06-8fbd-d18d6cceb54c req-276f6570-cf14-45e4-9e60-9a32e693320e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:31.110092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d50a221a-dbc1-4c06-8fbd-d18d6cceb54c req-276f6570-cf14-45e4-9e60-9a32e693320e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:31.133981 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-d50a221a-dbc1-4c06-8fbd-d18d6cceb54c req-276f6570-cf14-45e4-9e60-9a32e693320e service nova] Creating event network-vif-plugged:f60715f1-b4ee-4879-a807-ae0bd265e328 for instance 3a399223-e902-4114-9172-784bf7c1e031 on n-h2-860282-1 Oct 04 21:16:31.141797 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-d50a221a-dbc1-4c06-8fbd-d18d6cceb54c req-276f6570-cf14-45e4-9e60-9a32e693320e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067173 Oct 04 21:16:31.144771 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1268/2615] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:31.332205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e9df1201-c381-4094-8468-6fc8a3bd2fec tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:31.333658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e9df1201-c381-4094-8468-6fc8a3bd2fec tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:31.345750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9df1201-c381-4094-8468-6fc8a3bd2fec tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:31.346480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9df1201-c381-4094-8468-6fc8a3bd2fec tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:31.347248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9df1201-c381-4094-8468-6fc8a3bd2fec tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:31.348123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9df1201-c381-4094-8468-6fc8a3bd2fec tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:31.351117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9df1201-c381-4094-8468-6fc8a3bd2fec tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:31.352286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9df1201-c381-4094-8468-6fc8a3bd2fec tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:32.200335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e9df1201-c381-4094-8468-6fc8a3bd2fec tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d45dc825004ad4916d457f34eb0559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be18e35977441e8abe699f77e2b74c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:32.212814 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e9df1201-c381-4094-8468-6fc8a3bd2fec tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 200 len: 1351 microversion: 2.1 time: 0.885834 Oct 04 21:16:32.214773 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1269/2616] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:31 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 1351 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:32.220258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-553380a6-3911-456e-b6a7-75e2315d57fa tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:32.221125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-553380a6-3911-456e-b6a7-75e2315d57fa tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:32.229729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-553380a6-3911-456e-b6a7-75e2315d57fa tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:32.230435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-553380a6-3911-456e-b6a7-75e2315d57fa tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:32.231030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-553380a6-3911-456e-b6a7-75e2315d57fa tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:32.231896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-553380a6-3911-456e-b6a7-75e2315d57fa tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:32.232514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-553380a6-3911-456e-b6a7-75e2315d57fa tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:32.233136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-553380a6-3911-456e-b6a7-75e2315d57fa tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:32.562639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-553380a6-3911-456e-b6a7-75e2315d57fa tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:32.575894 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-553380a6-3911-456e-b6a7-75e2315d57fa tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189" status: 200 len: 1701 microversion: 2.1 time: 0.359709 Oct 04 21:16:32.576693 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1270/2617] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:32 2022] GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 => generated 1701 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:32.583629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7af2def6-75df-42af-9e0b-06586c626736 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:32.588954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7af2def6-75df-42af-9e0b-06586c626736 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:32.598150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7af2def6-75df-42af-9e0b-06586c626736 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:32.598929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7af2def6-75df-42af-9e0b-06586c626736 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:32.599508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7af2def6-75df-42af-9e0b-06586c626736 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:32.605594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7af2def6-75df-42af-9e0b-06586c626736 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:32.605594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7af2def6-75df-42af-9e0b-06586c626736 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:32.605594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7af2def6-75df-42af-9e0b-06586c626736 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:33.018835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7af2def6-75df-42af-9e0b-06586c626736 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:33.025220 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4509386b-3503-4249-a73a-f966bda80906 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/15ad8681-0470-4aa3-8133-6052e5f9d5a1" status: 202 len: 0 microversion: 2.1 time: 2.179711 Oct 04 21:16:33.025881 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1348/2618] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Oct 4 21:16:30 2022] DELETE /compute/v2.1/os-floating-ips/15ad8681-0470-4aa3-8133-6052e5f9d5a1 => generated 0 bytes in 2189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:16:33.031722 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7af2def6-75df-42af-9e0b-06586c626736 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031" status: 200 len: 1366 microversion: 2.1 time: 0.453765 Oct 04 21:16:33.032856 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1271/2619] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:32 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 => generated 1366 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:33.040405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f6b20811-ba85-478c-9375-51386435b059 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Action: 'action', calling method: .version_select at 0x7f5791effca0>, body: {"removeFloatingIp": {"address": "172.25.8.243"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:33.042862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3301d138-9c52-41a4-af2c-a8b536a09942 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1868494672", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fd75fd9-7dbd-4798-b6a4-9139b39b491f"}], "security_groups": [{"name": "tempest-securitygroup--1811815944"}], "key_name": "tempest-keypair-485431192", "user_data": "}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:33.340589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-3301d138-9c52-41a4-af2c-a8b536a09942 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] validate_networks() for [('3fd75fd9-7dbd-4798-b6a4-9139b39b491f', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:16:33.365828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f6b20811-ba85-478c-9375-51386435b059 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:33.372902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6b20811-ba85-478c-9375-51386435b059 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:33.373738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6b20811-ba85-478c-9375-51386435b059 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:33.374605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6b20811-ba85-478c-9375-51386435b059 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:33.384670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6b20811-ba85-478c-9375-51386435b059 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:33.385578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6b20811-ba85-478c-9375-51386435b059 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:33.386200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6b20811-ba85-478c-9375-51386435b059 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:33.853662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6b20811-ba85-478c-9375-51386435b059 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "refresh_cache-d9a1a3ee-1603-44d6-a94b-062f492cf8b1" {{(pid=122757) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:16:33.854135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6b20811-ba85-478c-9375-51386435b059 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquired lock "refresh_cache-d9a1a3ee-1603-44d6-a94b-062f492cf8b1" {{(pid=122757) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:16:34.211342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3301d138-9c52-41a4-af2c-a8b536a09942 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:16:34.211795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3301d138-9c52-41a4-af2c-a8b536a09942 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:16:34.212403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3301d138-9c52-41a4-af2c-a8b536a09942 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:16:34.212934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3301d138-9c52-41a4-af2c-a8b536a09942 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:16:34.213411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-3301d138-9c52-41a4-af2c-a8b536a09942 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:16:34.229360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3301d138-9c52-41a4-af2c-a8b536a09942 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:34.232812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3301d138-9c52-41a4-af2c-a8b536a09942 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:34.233378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3301d138-9c52-41a4-af2c-a8b536a09942 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:34.234299 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3301d138-9c52-41a4-af2c-a8b536a09942 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:34.236737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3301d138-9c52-41a4-af2c-a8b536a09942 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:34.237295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3301d138-9c52-41a4-af2c-a8b536a09942 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:34.278057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-3301d138-9c52-41a4-af2c-a8b536a09942 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Getting quotas for project 047ff2c9b6414ce8b98364678cbfeb53. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:16:34.289467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-3301d138-9c52-41a4-af2c-a8b536a09942 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Getting quotas for user abb3ac58c2ea4e2da8b9e765eda5f333 and project 047ff2c9b6414ce8b98364678cbfeb53. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:16:34.348731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3301d138-9c52-41a4-af2c-a8b536a09942 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:16:34.360211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3301d138-9c52-41a4-af2c-a8b536a09942 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:16:34.513268 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3301d138-9c52-41a4-af2c-a8b536a09942 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.486168 Oct 04 21:16:34.514587 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1349/2620] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:16:33 2022] POST /compute/v2.1/servers => generated 409 bytes in 1488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:16:34.549333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-96744ca2-a69d-4933-81a3-bf5bdba111fb req-271a5a90-1480-4e72-bc73-51684fbe59cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c94d29d0-adc3-4d49-bf41-31e631622656", "name": "network-vif-plugged", "status": "completed", "tag": "a89fa5c2-db37-4da6-9d30-28a28cd733d2"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:34.587566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:34.601149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-96744ca2-a69d-4933-81a3-bf5bdba111fb req-271a5a90-1480-4e72-bc73-51684fbe59cc service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:34.603020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-96744ca2-a69d-4933-81a3-bf5bdba111fb req-271a5a90-1480-4e72-bc73-51684fbe59cc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:34.603687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-96744ca2-a69d-4933-81a3-bf5bdba111fb req-271a5a90-1480-4e72-bc73-51684fbe59cc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:34.640351 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-96744ca2-a69d-4933-81a3-bf5bdba111fb req-271a5a90-1480-4e72-bc73-51684fbe59cc service nova] Creating event network-vif-plugged:a89fa5c2-db37-4da6-9d30-28a28cd733d2 for instance c94d29d0-adc3-4d49-bf41-31e631622656 on n-h2-860282-1 Oct 04 21:16:34.652931 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-96744ca2-a69d-4933-81a3-bf5bdba111fb req-271a5a90-1480-4e72-bc73-51684fbe59cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134511 Oct 04 21:16:34.657698 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1350/2621] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:34.664962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9656ff8-d009-4c0f-b20f-f0bab4fe0169 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:34.665881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d9656ff8-d009-4c0f-b20f-f0bab4fe0169 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:34.677745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9656ff8-d009-4c0f-b20f-f0bab4fe0169 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:34.691993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9656ff8-d009-4c0f-b20f-f0bab4fe0169 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:34.695842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9656ff8-d009-4c0f-b20f-f0bab4fe0169 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:34.698467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9656ff8-d009-4c0f-b20f-f0bab4fe0169 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:34.699010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9656ff8-d009-4c0f-b20f-f0bab4fe0169 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:34.699679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9656ff8-d009-4c0f-b20f-f0bab4fe0169 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:35.145087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d9656ff8-d009-4c0f-b20f-f0bab4fe0169 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d45dc825004ad4916d457f34eb0559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be18e35977441e8abe699f77e2b74c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:35.176994 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d9656ff8-d009-4c0f-b20f-f0bab4fe0169 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 200 len: 1351 microversion: 2.1 time: 0.517275 Oct 04 21:16:35.178789 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1351/2622] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:34 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 1351 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:35.185270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bed6d9d1-a0e7-4c07-ab2d-d5aeb761b6ad tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:35.186155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bed6d9d1-a0e7-4c07-ab2d-d5aeb761b6ad tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:35.196639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bed6d9d1-a0e7-4c07-ab2d-d5aeb761b6ad tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:35.197792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bed6d9d1-a0e7-4c07-ab2d-d5aeb761b6ad tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:35.198699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bed6d9d1-a0e7-4c07-ab2d-d5aeb761b6ad tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:35.199808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bed6d9d1-a0e7-4c07-ab2d-d5aeb761b6ad tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:35.201163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bed6d9d1-a0e7-4c07-ab2d-d5aeb761b6ad tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:35.201621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bed6d9d1-a0e7-4c07-ab2d-d5aeb761b6ad tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:35.325188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-f6b20811-ba85-478c-9375-51386435b059 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Building network info cache for instance {{(pid=122757) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 21:16:35.373196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bed6d9d1-a0e7-4c07-ab2d-d5aeb761b6ad tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:35.373932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bed6d9d1-a0e7-4c07-ab2d-d5aeb761b6ad tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:35.374441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bed6d9d1-a0e7-4c07-ab2d-d5aeb761b6ad tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:35.376771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-bed6d9d1-a0e7-4c07-ab2d-d5aeb761b6ad tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lazy-loading 'fault' on Instance uuid e7141667-2475-4be1-9296-ad67dbd94189 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:16:35.582286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bed6d9d1-a0e7-4c07-ab2d-d5aeb761b6ad tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4164bd60495b4dcead6a5bdf435ca069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3f8d2a788d4d61a4b8e1d3087cd57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:35.593612 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bed6d9d1-a0e7-4c07-ab2d-d5aeb761b6ad tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189" status: 200 len: 1360 microversion: 2.1 time: 0.413064 Oct 04 21:16:35.603375 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1352/2623] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:35 2022] GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 => generated 1360 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:35.831974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-d5b2ba7c-31fc-4dec-a626-1078a8c91b72 req-eb879bb4-3961-44cb-9ca6-845807c078c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7141667-2475-4be1-9296-ad67dbd94189", "name": "network-vif-deleted", "tag": "a62cebb4-a5f0-4b37-aa2d-9adf1cdf2efb"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:35.854698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d5b2ba7c-31fc-4dec-a626-1078a8c91b72 req-eb879bb4-3961-44cb-9ca6-845807c078c2 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:35.858152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d5b2ba7c-31fc-4dec-a626-1078a8c91b72 req-eb879bb4-3961-44cb-9ca6-845807c078c2 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:35.859072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d5b2ba7c-31fc-4dec-a626-1078a8c91b72 req-eb879bb4-3961-44cb-9ca6-845807c078c2 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:35.902908 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-d5b2ba7c-31fc-4dec-a626-1078a8c91b72 req-eb879bb4-3961-44cb-9ca6-845807c078c2 service nova] Creating event network-vif-deleted:a62cebb4-a5f0-4b37-aa2d-9adf1cdf2efb for instance e7141667-2475-4be1-9296-ad67dbd94189 on n-h2-860282-1 Oct 04 21:16:35.927183 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-d5b2ba7c-31fc-4dec-a626-1078a8c91b72 req-eb879bb4-3961-44cb-9ca6-845807c078c2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.322132 Oct 04 21:16:35.927956 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1353/2624] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:35.949013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fd699283-4bfa-4fce-8979-93311256f441 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:35.950526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fd699283-4bfa-4fce-8979-93311256f441 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:35.963262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd699283-4bfa-4fce-8979-93311256f441 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:35.963796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd699283-4bfa-4fce-8979-93311256f441 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:35.964365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd699283-4bfa-4fce-8979-93311256f441 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:35.965229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd699283-4bfa-4fce-8979-93311256f441 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:35.965909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd699283-4bfa-4fce-8979-93311256f441 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:35.966820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd699283-4bfa-4fce-8979-93311256f441 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:36.359800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fd699283-4bfa-4fce-8979-93311256f441 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:36.368746 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fd699283-4bfa-4fce-8979-93311256f441 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031" status: 200 len: 1555 microversion: 2.1 time: 0.438512 Oct 04 21:16:36.392621 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1354/2625] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:35 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 => generated 1555 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:36.399367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0f3c42d1-99c6-4e4f-bc80-3ede61bc9d17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:36.400219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0f3c42d1-99c6-4e4f-bc80-3ede61bc9d17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:36.406635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f3c42d1-99c6-4e4f-bc80-3ede61bc9d17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:36.407449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f3c42d1-99c6-4e4f-bc80-3ede61bc9d17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:36.408139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f3c42d1-99c6-4e4f-bc80-3ede61bc9d17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:36.409108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f3c42d1-99c6-4e4f-bc80-3ede61bc9d17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:36.409802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f3c42d1-99c6-4e4f-bc80-3ede61bc9d17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:36.410453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f3c42d1-99c6-4e4f-bc80-3ede61bc9d17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:36.552489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0f3c42d1-99c6-4e4f-bc80-3ede61bc9d17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:36.562560 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0f3c42d1-99c6-4e4f-bc80-3ede61bc9d17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1249 microversion: 2.1 time: 0.167933 Oct 04 21:16:36.563804 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1355/2626] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:36 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1249 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:36.585294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-c6b7c0e7-e294-4498-bb62-2e96720f0f7d req-8cdc7ced-690e-48d5-a05e-e931aaaf65a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a1a3ee-1603-44d6-a94b-062f492cf8b1", "tag": "5d5701df-ff17-499d-996e-479664d1c9d5"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:36.605147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c6b7c0e7-e294-4498-bb62-2e96720f0f7d req-8cdc7ced-690e-48d5-a05e-e931aaaf65a6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:36.605964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c6b7c0e7-e294-4498-bb62-2e96720f0f7d req-8cdc7ced-690e-48d5-a05e-e931aaaf65a6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:36.606615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c6b7c0e7-e294-4498-bb62-2e96720f0f7d req-8cdc7ced-690e-48d5-a05e-e931aaaf65a6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:36.629157 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-c6b7c0e7-e294-4498-bb62-2e96720f0f7d req-8cdc7ced-690e-48d5-a05e-e931aaaf65a6 service nova] Creating event network-changed:5d5701df-ff17-499d-996e-479664d1c9d5 for instance d9a1a3ee-1603-44d6-a94b-062f492cf8b1 on n-h2-860282-1 Oct 04 21:16:36.636014 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-c6b7c0e7-e294-4498-bb62-2e96720f0f7d req-8cdc7ced-690e-48d5-a05e-e931aaaf65a6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070681 Oct 04 21:16:36.670682 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1356/2627] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:36.670682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b7dbe95a-3d46-47b2-b51a-372e0bcd2306 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:36.670682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b7dbe95a-3d46-47b2-b51a-372e0bcd2306 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:36.670682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7dbe95a-3d46-47b2-b51a-372e0bcd2306 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:36.670682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7dbe95a-3d46-47b2-b51a-372e0bcd2306 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:36.670682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7dbe95a-3d46-47b2-b51a-372e0bcd2306 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:36.670682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7dbe95a-3d46-47b2-b51a-372e0bcd2306 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:36.670682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7dbe95a-3d46-47b2-b51a-372e0bcd2306 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:36.670682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7dbe95a-3d46-47b2-b51a-372e0bcd2306 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:37.046767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b7dbe95a-3d46-47b2-b51a-372e0bcd2306 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d45dc825004ad4916d457f34eb0559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be18e35977441e8abe699f77e2b74c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:37.060472 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b7dbe95a-3d46-47b2-b51a-372e0bcd2306 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 200 len: 1351 microversion: 2.1 time: 0.422293 Oct 04 21:16:37.067564 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1357/2628] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:36 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 1351 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:37.072157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-f6b20811-ba85-478c-9375-51386435b059 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Updating instance_info_cache with network_info: [{"id": "5d5701df-ff17-499d-996e-479664d1c9d5", "address": "fa:16:3e:ec:a4:12", "network": {"id": "5705269e-a277-4ae4-8dba-51564dfd8922", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1300302163-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b2ea0a3effb846858c46355590f437cf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5d5701df-ff", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122757) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:16:37.103669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b37cfcd0-e31a-4ef4-a6d1-b828a07b5678 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:37.107549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b37cfcd0-e31a-4ef4-a6d1-b828a07b5678 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:37.130203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=16 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:37.133055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b37cfcd0-e31a-4ef4-a6d1-b828a07b5678 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:37.133873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b37cfcd0-e31a-4ef4-a6d1-b828a07b5678 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:37.134525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b37cfcd0-e31a-4ef4-a6d1-b828a07b5678 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:37.136403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b37cfcd0-e31a-4ef4-a6d1-b828a07b5678 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:37.137710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b37cfcd0-e31a-4ef4-a6d1-b828a07b5678 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:37.138363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b37cfcd0-e31a-4ef4-a6d1-b828a07b5678 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:37.174384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6b20811-ba85-478c-9375-51386435b059 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Releasing lock "refresh_cache-d9a1a3ee-1603-44d6-a94b-062f492cf8b1" {{(pid=122757) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:16:37.174384 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f6b20811-ba85-478c-9375-51386435b059 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "POST /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1/action" status: 202 len: 0 microversion: 2.1 time: 4.137695 Oct 04 21:16:37.174384 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1272/2629] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:16:33 2022] POST /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1/action => generated 0 bytes in 4140 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 21:16:37.181053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c39fa0f9-7f0b-497a-9690-d3469c2bb793 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:37.182153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c39fa0f9-7f0b-497a-9690-d3469c2bb793 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] [instance: e7141667-2475-4be1-9296-ad67dbd94189] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:37.202632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c39fa0f9-7f0b-497a-9690-d3469c2bb793 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:37.203137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c39fa0f9-7f0b-497a-9690-d3469c2bb793 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:37.206888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c39fa0f9-7f0b-497a-9690-d3469c2bb793 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:37.207803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c39fa0f9-7f0b-497a-9690-d3469c2bb793 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:37.208245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c39fa0f9-7f0b-497a-9690-d3469c2bb793 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:37.208689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c39fa0f9-7f0b-497a-9690-d3469c2bb793 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:37.264779 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-c39fa0f9-7f0b-497a-9690-d3469c2bb793 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] HTTP exception thrown: Instance e7141667-2475-4be1-9296-ad67dbd94189 could not be found. Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c39fa0f9-7f0b-497a-9690-d3469c2bb793 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Request method failure captured: Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 HTTP/1.1 Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKJkFvFhd0SVsBFcAKuF1uEefwACZxo4VpypdS6voacglGLwD810OxkSa3h4l85wVhYFmR5laFwjq0Z7j3_gM7pBpYR7yU4SpQLgJfDbXq_y2r2h8W3fsc8lbwk32oaGz4uUsIt3IfjXGfO3Plwd80TEH8NCw-8M9VGZUf1EbVy5mm8 Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: ec3f8d2a788d4d61a4b8e1d3087cd57f Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestJSON-881836657 Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ec3f8d2a788d4d61a4b8e1d3087cd57f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ec3f8d2a788d4d61a4b8e1d3087cd57f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ec3f8d2a788d4d61a4b8e1d3087cd57f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ec3f8d2a788d4d61a4b8e1d3087cd57f"}]}] Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestJSON-881836657 Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: ec3f8d2a788d4d61a4b8e1d3087cd57f Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestJSON-881836657 Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestJSON-881836657-project Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 4164bd60495b4dcead6a5bdf435ca069 Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestJSON-881836657-project Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance e7141667-2475-4be1-9296-ad67dbd94189 could not be found. Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'e7141667-2475-4be1-9296-ad67dbd94189'} Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7141667-2475-4be1-9296-ad67dbd94189 could not be found. Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7141667-2475-4be1-9296-ad67dbd94189 could not be found. Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:37.267908 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:37.273004 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:37.273004 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:37.273004 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:37.273004 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:37.273004 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7141667-2475-4be1-9296-ad67dbd94189 could not be found. Oct 04 21:16:37.273004 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:37.277669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c39fa0f9-7f0b-497a-9690-d3469c2bb793 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Returning 404 to user: Instance e7141667-2475-4be1-9296-ad67dbd94189 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:37.282692 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c39fa0f9-7f0b-497a-9690-d3469c2bb793 tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189" status: 404 len: 111 microversion: 2.1 time: 0.105218 Oct 04 21:16:37.285831 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1273/2630] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:37 2022] GET /compute/v2.1/servers/e7141667-2475-4be1-9296-ad67dbd94189 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:37.308746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f4b894c8-3fdb-4ab9-9462-4033ee0ce16a tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '.version_select at 0x7f579455cdc0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:37.733737 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b37cfcd0-e31a-4ef4-a6d1-b828a07b5678 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.666841 Oct 04 21:16:37.743422 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1358/2631] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:16:37 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-interface => generated 284 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:37.750994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9b62df59-773c-4b02-9e12-bfdad5bb137b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] Calling method '.version_select at 0x7f578b608dc0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:37.847446 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9b62df59-773c-4b02-9e12-bfdad5bb137b tempest-ServersTestJSON-881836657 tempest-ServersTestJSON-881836657-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2005495584" status: 202 len: 0 microversion: 2.1 time: 0.102381 Oct 04 21:16:37.849586 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1359/2632] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Oct 4 21:16:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2005495584 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:16:37.858773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-70819dfc-cf39-45de-9662-df2d2db0d356 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:37.859639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-70819dfc-cf39-45de-9662-df2d2db0d356 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:37.867114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70819dfc-cf39-45de-9662-df2d2db0d356 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:37.867865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70819dfc-cf39-45de-9662-df2d2db0d356 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:37.868479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70819dfc-cf39-45de-9662-df2d2db0d356 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:37.869919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70819dfc-cf39-45de-9662-df2d2db0d356 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:37.870627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70819dfc-cf39-45de-9662-df2d2db0d356 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:37.871320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70819dfc-cf39-45de-9662-df2d2db0d356 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:38.072641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-70819dfc-cf39-45de-9662-df2d2db0d356 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:38.083056 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-70819dfc-cf39-45de-9662-df2d2db0d356 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1305 microversion: 2.1 time: 0.230923 Oct 04 21:16:38.088314 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1360/2633] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:37 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1305 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:38.097314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-02b29c8e-6431-4296-8800-4616bd561538 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:38.097906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-02b29c8e-6431-4296-8800-4616bd561538 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:38.118615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02b29c8e-6431-4296-8800-4616bd561538 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:38.118615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02b29c8e-6431-4296-8800-4616bd561538 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:38.118615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02b29c8e-6431-4296-8800-4616bd561538 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:38.118615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02b29c8e-6431-4296-8800-4616bd561538 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:38.118615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02b29c8e-6431-4296-8800-4616bd561538 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:38.118615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02b29c8e-6431-4296-8800-4616bd561538 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:38.659604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-02b29c8e-6431-4296-8800-4616bd561538 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d45dc825004ad4916d457f34eb0559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be18e35977441e8abe699f77e2b74c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:38.670442 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-02b29c8e-6431-4296-8800-4616bd561538 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 200 len: 1541 microversion: 2.1 time: 0.581039 Oct 04 21:16:38.671040 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1361/2634] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:38 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 1541 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:38.700984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a252e41b-3f17-4229-a807-2e54ea3d630c tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:38.701626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a252e41b-3f17-4229-a807-2e54ea3d630c tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:38.715197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a252e41b-3f17-4229-a807-2e54ea3d630c tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:38.715696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a252e41b-3f17-4229-a807-2e54ea3d630c tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:38.716141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a252e41b-3f17-4229-a807-2e54ea3d630c tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:38.716989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a252e41b-3f17-4229-a807-2e54ea3d630c tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:38.721856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a252e41b-3f17-4229-a807-2e54ea3d630c tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:38.722365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a252e41b-3f17-4229-a807-2e54ea3d630c tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:39.157855 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a252e41b-3f17-4229-a807-2e54ea3d630c tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.461223 Oct 04 21:16:39.170787 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1362/2635] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:16:38 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656/os-interface => generated 285 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:39.170787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3ddfe665-a6c8-4a40-b808-6dd99c1a28fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:39.170787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3ddfe665-a6c8-4a40-b808-6dd99c1a28fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:39.181538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ddfe665-a6c8-4a40-b808-6dd99c1a28fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:39.182044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ddfe665-a6c8-4a40-b808-6dd99c1a28fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:39.182527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ddfe665-a6c8-4a40-b808-6dd99c1a28fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:39.183234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ddfe665-a6c8-4a40-b808-6dd99c1a28fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:39.183751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ddfe665-a6c8-4a40-b808-6dd99c1a28fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:39.184102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ddfe665-a6c8-4a40-b808-6dd99c1a28fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:39.308365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3ddfe665-a6c8-4a40-b808-6dd99c1a28fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:39.333180 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3ddfe665-a6c8-4a40-b808-6dd99c1a28fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1303 microversion: 2.1 time: 0.173134 Oct 04 21:16:39.337737 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1363/2636] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:39 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1303 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:39.602186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9be7983c-2ca2-49bf-84f9-d2a627b55e86 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:39.604468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9be7983c-2ca2-49bf-84f9-d2a627b55e86 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:39.611691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9be7983c-2ca2-49bf-84f9-d2a627b55e86 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:39.612408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9be7983c-2ca2-49bf-84f9-d2a627b55e86 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:39.613060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9be7983c-2ca2-49bf-84f9-d2a627b55e86 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:39.614398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9be7983c-2ca2-49bf-84f9-d2a627b55e86 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:39.614849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9be7983c-2ca2-49bf-84f9-d2a627b55e86 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:39.615637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9be7983c-2ca2-49bf-84f9-d2a627b55e86 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:39.660279 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9be7983c-2ca2-49bf-84f9-d2a627b55e86 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061947 Oct 04 21:16:39.670284 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1364/2637] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:16:39 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:16:39.677238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-202d4794-4358-48df-b711-4236cacc9fa9 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:39.679891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-202d4794-4358-48df-b711-4236cacc9fa9 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:39.688374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-202d4794-4358-48df-b711-4236cacc9fa9 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:39.692600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-202d4794-4358-48df-b711-4236cacc9fa9 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:39.692600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-202d4794-4358-48df-b711-4236cacc9fa9 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:39.692600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-202d4794-4358-48df-b711-4236cacc9fa9 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:39.692600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-202d4794-4358-48df-b711-4236cacc9fa9 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:39.692600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-202d4794-4358-48df-b711-4236cacc9fa9 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:39.876660 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f4b894c8-3fdb-4ab9-9462-4033ee0ce16a tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/29df7ec7-8128-4f45-9839-30078ab1c2f8" status: 202 len: 0 microversion: 2.1 time: 2.580396 Oct 04 21:16:39.891152 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1274/2638] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Oct 4 21:16:37 2022] DELETE /compute/v2.1/os-floating-ips/29df7ec7-8128-4f45-9839-30078ab1c2f8 => generated 0 bytes in 2601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:16:39.904270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-90cc9321-f891-4aa8-9f0b-a26fad0a99ae tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-90cc9321-f891-4aa8-9f0b-a26fad0a99ae tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Request method failure captured: Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1/action HTTP/1.1 Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 34 Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKKKtIVfVjPBDFolAE7228ylrVmF3ywkC19muVdtW4uFG1jT_p2Ytq3JV3cDIH7n4fJoqF6dLiBYg9Pb_PRcKhYlRQs4x9CBQ1V4Y3EosDdYkoSiGcfOYpXDUa9Qj9AeX244rU5ocygT_eErkici6aD_hYAUOwVSTMkXSpXyQyg_wGQ Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: b2ea0a3effb846858c46355590f437cf Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906066682 Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b2ea0a3effb846858c46355590f437cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b2ea0a3effb846858c46355590f437cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b2ea0a3effb846858c46355590f437cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b2ea0a3effb846858c46355590f437cf"}]}] Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-906066682 Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: b2ea0a3effb846858c46355590f437cf Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906066682 Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: e46858a6edfa435bb7c68cdc13c05539 Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: {"addFloatingIp": {"address": ""}} Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'd9a1a3ee-1603-44d6-a94b-062f492cf8b1', 'body': {'addFloatingIp': {'address': ''}}} Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi '' Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:16:39.911844 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:16:39.916182 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:16:39.916182 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 21:16:39.916182 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:39.916182 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:39.916182 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:39.916182 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:39.916182 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:39.916182 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:39.916182 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:16:39.916182 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:16:39.916182 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 21:16:39.916182 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:39.921152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-90cc9321-f891-4aa8-9f0b-a26fad0a99ae tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:39.923300 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-90cc9321-f891-4aa8-9f0b-a26fad0a99ae tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "POST /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1/action" status: 400 len: 142 microversion: 2.1 time: 0.030643 Oct 04 21:16:39.925228 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1275/2639] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:16:39 2022] POST /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1/action => generated 142 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:16:39.960849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2766d365-c661-400d-9ca0-a48f2baa5052 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:39.965973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2766d365-c661-400d-9ca0-a48f2baa5052 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:39.966986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-202d4794-4358-48df-b711-4236cacc9fa9 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lazy-loading 'services' on Instance uuid 0f0250fa-4053-4bec-81bb-b5f857310687 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:16:39.974832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2766d365-c661-400d-9ca0-a48f2baa5052 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:39.975614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2766d365-c661-400d-9ca0-a48f2baa5052 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:39.980148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2766d365-c661-400d-9ca0-a48f2baa5052 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:39.980148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2766d365-c661-400d-9ca0-a48f2baa5052 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:39.980148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2766d365-c661-400d-9ca0-a48f2baa5052 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:39.980148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2766d365-c661-400d-9ca0-a48f2baa5052 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:40.008688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2766d365-c661-400d-9ca0-a48f2baa5052 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "refresh_cache-d9a1a3ee-1603-44d6-a94b-062f492cf8b1" {{(pid=122757) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:16:40.009560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2766d365-c661-400d-9ca0-a48f2baa5052 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquired lock "refresh_cache-d9a1a3ee-1603-44d6-a94b-062f492cf8b1" {{(pid=122757) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:16:40.291430 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-202d4794-4358-48df-b711-4236cacc9fa9 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687/os-volume_attachments/9b1550e6-c874-4b79-b119-479817a08986" status: 202 len: 0 microversion: 2.1 time: 0.614682 Oct 04 21:16:40.291430 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1365/2640] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 21:16:39 2022] DELETE /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687/os-volume_attachments/9b1550e6-c874-4b79-b119-479817a08986 => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:16:40.357892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2766d365-c661-400d-9ca0-a48f2baa5052 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Releasing lock "refresh_cache-d9a1a3ee-1603-44d6-a94b-062f492cf8b1" {{(pid=122757) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:16:40.358843 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-2766d365-c661-400d-9ca0-a48f2baa5052 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] HTTP exception thrown: floating IP not found Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2766d365-c661-400d-9ca0-a48f2baa5052 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Request method failure captured: Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1/action HTTP/1.1 Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 41 Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKKKtIVfVjPBDFolAE7228ylrVmF3ywkC19muVdtW4uFG1jT_p2Ytq3JV3cDIH7n4fJoqF6dLiBYg9Pb_PRcKhYlRQs4x9CBQ1V4Y3EosDdYkoSiGcfOYpXDUa9Qj9AeX244rU5ocygT_eErkici6aD_hYAUOwVSTMkXSpXyQyg_wGQ Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: b2ea0a3effb846858c46355590f437cf Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906066682 Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b2ea0a3effb846858c46355590f437cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b2ea0a3effb846858c46355590f437cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b2ea0a3effb846858c46355590f437cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b2ea0a3effb846858c46355590f437cf"}]}] Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-906066682 Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: b2ea0a3effb846858c46355590f437cf Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906066682 Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: e46858a6edfa435bb7c68cdc13c05539 Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: exception: floating IP not found Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'd9a1a3ee-1603-44d6-a94b-062f492cf8b1', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 04 21:16:40.360754 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:40.364591 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:40.364591 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:40.364591 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:40.364591 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:40.364591 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:40.364591 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:40.364591 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:40.364591 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 04 21:16:40.364591 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:40.366763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ce037cc2-7596-48b1-a431-18c327d3977a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:40.366763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ce037cc2-7596-48b1-a431-18c327d3977a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:40.375691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2766d365-c661-400d-9ca0-a48f2baa5052 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Returning 404 to user: floating IP not found {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:40.383070 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2766d365-c661-400d-9ca0-a48f2baa5052 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "POST /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1/action" status: 404 len: 67 microversion: 2.1 time: 0.446173 Oct 04 21:16:40.385505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce037cc2-7596-48b1-a431-18c327d3977a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:40.385633 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1276/2641] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:16:39 2022] POST /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1/action => generated 67 bytes in 450 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 21:16:40.385767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce037cc2-7596-48b1-a431-18c327d3977a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:40.391122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce037cc2-7596-48b1-a431-18c327d3977a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:40.392699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce037cc2-7596-48b1-a431-18c327d3977a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:40.393363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce037cc2-7596-48b1-a431-18c327d3977a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:40.393996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b73f2877-c617-4123-9194-6eeacc95901f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:40.394358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce037cc2-7596-48b1-a431-18c327d3977a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:40.894067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ce037cc2-7596-48b1-a431-18c327d3977a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:40.897935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:40.903793 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ce037cc2-7596-48b1-a431-18c327d3977a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1303 microversion: 2.1 time: 0.544046 Oct 04 21:16:40.921907 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1366/2642] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:40 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1303 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:40.939814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-cc9f9d2d-e2c3-448b-aeb7-8df0531110d8 req-4d4af351-2620-477a-bbd4-076a1337a767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a399223-e902-4114-9172-784bf7c1e031", "tag": "f60715f1-b4ee-4879-a807-ae0bd265e328"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:40.945609 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-b73f2877-c617-4123-9194-6eeacc95901f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b73f2877-c617-4123-9194-6eeacc95901f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Request method failure captured: Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1/action HTTP/1.1 Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 44 Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKKKtIVfVjPBDFolAE7228ylrVmF3ywkC19muVdtW4uFG1jT_p2Ytq3JV3cDIH7n4fJoqF6dLiBYg9Pb_PRcKhYlRQs4x9CBQ1V4Y3EosDdYkoSiGcfOYpXDUa9Qj9AeX244rU5ocygT_eErkici6aD_hYAUOwVSTMkXSpXyQyg_wGQ Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: b2ea0a3effb846858c46355590f437cf Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906066682 Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b2ea0a3effb846858c46355590f437cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b2ea0a3effb846858c46355590f437cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b2ea0a3effb846858c46355590f437cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b2ea0a3effb846858c46355590f437cf"}]}] Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-906066682 Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: b2ea0a3effb846858c46355590f437cf Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906066682 Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: e46858a6edfa435bb7c68cdc13c05539 Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: exception: Floating IP not found for address 0.0.0.0. Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'd9a1a3ee-1603-44d6-a94b-062f492cf8b1', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 04 21:16:40.947757 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 04 21:16:40.952122 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 04 21:16:40.952122 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:40.952122 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:40.952122 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:40.952122 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:40.952122 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:40.952122 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:40.952122 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:40.952122 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:40.952122 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 04 21:16:40.952122 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:40.954853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b73f2877-c617-4123-9194-6eeacc95901f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:40.956289 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b73f2877-c617-4123-9194-6eeacc95901f tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "POST /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1/action" status: 404 len: 88 microversion: 2.1 time: 0.568965 Oct 04 21:16:40.957315 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1277/2643] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:16:40 2022] POST /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1/action => generated 88 bytes in 571 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:16:40.968856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1ef4e92a-5114-4977-80b2-a4fcfe0bb575 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:40.977850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1ef4e92a-5114-4977-80b2-a4fcfe0bb575 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:40.983246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-cc9f9d2d-e2c3-448b-aeb7-8df0531110d8 req-4d4af351-2620-477a-bbd4-076a1337a767 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:40.993526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ef4e92a-5114-4977-80b2-a4fcfe0bb575 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:40.994259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-cc9f9d2d-e2c3-448b-aeb7-8df0531110d8 req-4d4af351-2620-477a-bbd4-076a1337a767 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:40.994862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-cc9f9d2d-e2c3-448b-aeb7-8df0531110d8 req-4d4af351-2620-477a-bbd4-076a1337a767 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:41.005173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ef4e92a-5114-4977-80b2-a4fcfe0bb575 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:41.007298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ef4e92a-5114-4977-80b2-a4fcfe0bb575 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:41.013899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ef4e92a-5114-4977-80b2-a4fcfe0bb575 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:41.014494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ef4e92a-5114-4977-80b2-a4fcfe0bb575 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:41.015047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ef4e92a-5114-4977-80b2-a4fcfe0bb575 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:41.024371 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-cc9f9d2d-e2c3-448b-aeb7-8df0531110d8 req-4d4af351-2620-477a-bbd4-076a1337a767 service nova] Creating event network-changed:f60715f1-b4ee-4879-a807-ae0bd265e328 for instance 3a399223-e902-4114-9172-784bf7c1e031 on n-h2-860282-1 Oct 04 21:16:41.059170 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-cc9f9d2d-e2c3-448b-aeb7-8df0531110d8 req-4d4af351-2620-477a-bbd4-076a1337a767 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135847 Oct 04 21:16:41.065170 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1367/2644] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:41.078355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1ef4e92a-5114-4977-80b2-a4fcfe0bb575 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:16:41.114287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:41.576711 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1ef4e92a-5114-4977-80b2-a4fcfe0bb575 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 204 len: 0 microversion: 2.1 time: 0.612718 Oct 04 21:16:41.580564 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1278/2645] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:16:40 2022] DELETE /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:16:41.594113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3979e2ac-e723-4938-bfb6-8966ea7b8019 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:41.596516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3979e2ac-e723-4938-bfb6-8966ea7b8019 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:41.612125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3979e2ac-e723-4938-bfb6-8966ea7b8019 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:41.612612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3979e2ac-e723-4938-bfb6-8966ea7b8019 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:41.613598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3979e2ac-e723-4938-bfb6-8966ea7b8019 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:41.616898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3979e2ac-e723-4938-bfb6-8966ea7b8019 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:41.616898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3979e2ac-e723-4938-bfb6-8966ea7b8019 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:41.616898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3979e2ac-e723-4938-bfb6-8966ea7b8019 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:41.937668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8f2a7f0a-5364-48a3-9108-c4358f4ffcc1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:41.938376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8f2a7f0a-5364-48a3-9108-c4358f4ffcc1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:41.945690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f2a7f0a-5364-48a3-9108-c4358f4ffcc1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:41.947139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f2a7f0a-5364-48a3-9108-c4358f4ffcc1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:41.950169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f2a7f0a-5364-48a3-9108-c4358f4ffcc1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:41.951181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f2a7f0a-5364-48a3-9108-c4358f4ffcc1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:41.951866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f2a7f0a-5364-48a3-9108-c4358f4ffcc1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:41.952575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f2a7f0a-5364-48a3-9108-c4358f4ffcc1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:42.093177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3979e2ac-e723-4938-bfb6-8966ea7b8019 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:42.101954 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3979e2ac-e723-4938-bfb6-8966ea7b8019 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1542 microversion: 2.1 time: 0.516555 Oct 04 21:16:42.104866 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1368/2646] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:41 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1542 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:42.497066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8f2a7f0a-5364-48a3-9108-c4358f4ffcc1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:42.504110 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8f2a7f0a-5364-48a3-9108-c4358f4ffcc1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1371 microversion: 2.1 time: 0.570644 Oct 04 21:16:42.522290 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1279/2647] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:41 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1371 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:43.031862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-0dbe9664-8723-4120-80db-08cfa5661efb req-d4e4a199-d8cf-4050-82af-fe24e0095fdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c94d29d0-adc3-4d49-bf41-31e631622656", "tag": "a89fa5c2-db37-4da6-9d30-28a28cd733d2"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:43.050365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0dbe9664-8723-4120-80db-08cfa5661efb req-d4e4a199-d8cf-4050-82af-fe24e0095fdc service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:43.050816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0dbe9664-8723-4120-80db-08cfa5661efb req-d4e4a199-d8cf-4050-82af-fe24e0095fdc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:43.051253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0dbe9664-8723-4120-80db-08cfa5661efb req-d4e4a199-d8cf-4050-82af-fe24e0095fdc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:43.096375 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-0dbe9664-8723-4120-80db-08cfa5661efb req-d4e4a199-d8cf-4050-82af-fe24e0095fdc service nova] Creating event network-changed:a89fa5c2-db37-4da6-9d30-28a28cd733d2 for instance c94d29d0-adc3-4d49-bf41-31e631622656 on n-h2-860282-1 Oct 04 21:16:43.110864 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-0dbe9664-8723-4120-80db-08cfa5661efb req-d4e4a199-d8cf-4050-82af-fe24e0095fdc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082672 Oct 04 21:16:43.121743 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1369/2648] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:43.133695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-76f6465a-4513-4863-b5d6-f91ef35c4242 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:43.135230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-76f6465a-4513-4863-b5d6-f91ef35c4242 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:43.155446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76f6465a-4513-4863-b5d6-f91ef35c4242 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:43.155446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76f6465a-4513-4863-b5d6-f91ef35c4242 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:43.155446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76f6465a-4513-4863-b5d6-f91ef35c4242 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:43.169131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76f6465a-4513-4863-b5d6-f91ef35c4242 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:43.170621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76f6465a-4513-4863-b5d6-f91ef35c4242 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:43.171255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76f6465a-4513-4863-b5d6-f91ef35c4242 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:43.554525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e9bc54bd-6a1b-48f9-8aa1-47a123f4171c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:43.555883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e9bc54bd-6a1b-48f9-8aa1-47a123f4171c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:43.574264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9bc54bd-6a1b-48f9-8aa1-47a123f4171c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:43.575259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9bc54bd-6a1b-48f9-8aa1-47a123f4171c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:43.578785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9bc54bd-6a1b-48f9-8aa1-47a123f4171c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:43.580462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9bc54bd-6a1b-48f9-8aa1-47a123f4171c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:43.581393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9bc54bd-6a1b-48f9-8aa1-47a123f4171c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:43.582092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9bc54bd-6a1b-48f9-8aa1-47a123f4171c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:44.090151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-76f6465a-4513-4863-b5d6-f91ef35c4242 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:44.104150 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-76f6465a-4513-4863-b5d6-f91ef35c4242 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1542 microversion: 2.1 time: 0.975454 Oct 04 21:16:44.120193 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1280/2649] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:43 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1542 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:44.265208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:44.333369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=15 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:44.935718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e9bc54bd-6a1b-48f9-8aa1-47a123f4171c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:44.946193 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e9bc54bd-6a1b-48f9-8aa1-47a123f4171c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1371 microversion: 2.1 time: 1.404495 Oct 04 21:16:44.947596 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1370/2650] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:43 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1371 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:45.132411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1fef33f8-5414-4b08-acc9-7cc8e6d83e08 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:45.132942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1fef33f8-5414-4b08-acc9-7cc8e6d83e08 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:45.139818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fef33f8-5414-4b08-acc9-7cc8e6d83e08 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:45.140613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fef33f8-5414-4b08-acc9-7cc8e6d83e08 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:45.141238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fef33f8-5414-4b08-acc9-7cc8e6d83e08 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:45.142157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fef33f8-5414-4b08-acc9-7cc8e6d83e08 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:45.142791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fef33f8-5414-4b08-acc9-7cc8e6d83e08 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:45.143391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fef33f8-5414-4b08-acc9-7cc8e6d83e08 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:45.158904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-9ee45569-eb3f-4395-b95d-5c97b00da57e req-332bac2a-43ce-4df7-8fb9-d5521bae82a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a1a3ee-1603-44d6-a94b-062f492cf8b1", "name": "network-vif-deleted", "tag": "5d5701df-ff17-499d-996e-479664d1c9d5"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:45.180841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9ee45569-eb3f-4395-b95d-5c97b00da57e req-332bac2a-43ce-4df7-8fb9-d5521bae82a3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:45.181332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9ee45569-eb3f-4395-b95d-5c97b00da57e req-332bac2a-43ce-4df7-8fb9-d5521bae82a3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:45.182283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9ee45569-eb3f-4395-b95d-5c97b00da57e req-332bac2a-43ce-4df7-8fb9-d5521bae82a3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:45.204343 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-9ee45569-eb3f-4395-b95d-5c97b00da57e req-332bac2a-43ce-4df7-8fb9-d5521bae82a3 service nova] Creating event network-vif-deleted:5d5701df-ff17-499d-996e-479664d1c9d5 for instance d9a1a3ee-1603-44d6-a94b-062f492cf8b1 on n-h2-860282-1 Oct 04 21:16:45.221829 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-9ee45569-eb3f-4395-b95d-5c97b00da57e req-332bac2a-43ce-4df7-8fb9-d5521bae82a3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066522 Oct 04 21:16:45.222455 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1371/2651] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:45.308753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1fef33f8-5414-4b08-acc9-7cc8e6d83e08 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:45.331297 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1fef33f8-5414-4b08-acc9-7cc8e6d83e08 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1317 microversion: 2.1 time: 0.202591 Oct 04 21:16:45.355252 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1281/2652] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:45 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:45.971824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e97c96cb-9864-438f-abd1-689eedddd632 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:45.973105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e97c96cb-9864-438f-abd1-689eedddd632 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:45.993477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e97c96cb-9864-438f-abd1-689eedddd632 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:45.995368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e97c96cb-9864-438f-abd1-689eedddd632 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:45.995850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e97c96cb-9864-438f-abd1-689eedddd632 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:45.996599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e97c96cb-9864-438f-abd1-689eedddd632 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:45.997070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e97c96cb-9864-438f-abd1-689eedddd632 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:45.997537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e97c96cb-9864-438f-abd1-689eedddd632 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:46.361821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0ff82c8e-dafc-455b-b5f2-80963cf54721 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:46.362612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0ff82c8e-dafc-455b-b5f2-80963cf54721 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:46.383493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ff82c8e-dafc-455b-b5f2-80963cf54721 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:46.384039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ff82c8e-dafc-455b-b5f2-80963cf54721 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:46.384504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ff82c8e-dafc-455b-b5f2-80963cf54721 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:46.385251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ff82c8e-dafc-455b-b5f2-80963cf54721 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:46.385742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ff82c8e-dafc-455b-b5f2-80963cf54721 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:46.386171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ff82c8e-dafc-455b-b5f2-80963cf54721 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:46.472939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ff82c8e-dafc-455b-b5f2-80963cf54721 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:46.473454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ff82c8e-dafc-455b-b5f2-80963cf54721 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:46.473920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ff82c8e-dafc-455b-b5f2-80963cf54721 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:46.474375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-0ff82c8e-dafc-455b-b5f2-80963cf54721 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lazy-loading 'fault' on Instance uuid d9a1a3ee-1603-44d6-a94b-062f492cf8b1 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:16:46.712150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0ff82c8e-dafc-455b-b5f2-80963cf54721 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e46858a6edfa435bb7c68cdc13c05539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea0a3effb846858c46355590f437cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:46.719840 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0ff82c8e-dafc-455b-b5f2-80963cf54721 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 200 len: 1322 microversion: 2.1 time: 0.363008 Oct 04 21:16:46.720667 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1282/2653] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:46 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 1322 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:46.753987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e97c96cb-9864-438f-abd1-689eedddd632 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:46.772782 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e97c96cb-9864-438f-abd1-689eedddd632 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1371 microversion: 2.1 time: 0.805071 Oct 04 21:16:46.774644 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1372/2654] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:45 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1371 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:47.259725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-07abed92-16af-49a1-a2de-bb8dca83c379 req-fb70b92b-a064-4023-abc2-c0e4c52e2506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3", "tag": "4c39a316-efc6-4f59-97f7-911c7414ee28"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:47.283807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-07abed92-16af-49a1-a2de-bb8dca83c379 req-fb70b92b-a064-4023-abc2-c0e4c52e2506 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:47.284294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-07abed92-16af-49a1-a2de-bb8dca83c379 req-fb70b92b-a064-4023-abc2-c0e4c52e2506 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:47.284730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-07abed92-16af-49a1-a2de-bb8dca83c379 req-fb70b92b-a064-4023-abc2-c0e4c52e2506 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:47.324811 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-07abed92-16af-49a1-a2de-bb8dca83c379 req-fb70b92b-a064-4023-abc2-c0e4c52e2506 service nova] Creating event network-changed:4c39a316-efc6-4f59-97f7-911c7414ee28 for instance 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 on n-h1-860282-1 Oct 04 21:16:47.348659 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-07abed92-16af-49a1-a2de-bb8dca83c379 req-fb70b92b-a064-4023-abc2-c0e4c52e2506 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094377 Oct 04 21:16:47.351261 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1283/2655] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:47.747441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-384230f4-ceb8-4f83-b155-dce73c1531c1 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:47.748064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-384230f4-ceb8-4f83-b155-dce73c1531c1 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] [instance: d9a1a3ee-1603-44d6-a94b-062f492cf8b1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:47.755039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-384230f4-ceb8-4f83-b155-dce73c1531c1 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:47.755534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-384230f4-ceb8-4f83-b155-dce73c1531c1 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:47.756012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-384230f4-ceb8-4f83-b155-dce73c1531c1 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:47.758203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-384230f4-ceb8-4f83-b155-dce73c1531c1 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:47.758919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-384230f4-ceb8-4f83-b155-dce73c1531c1 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:47.759505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-384230f4-ceb8-4f83-b155-dce73c1531c1 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:47.780658 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-384230f4-ceb8-4f83-b155-dce73c1531c1 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] HTTP exception thrown: Instance d9a1a3ee-1603-44d6-a94b-062f492cf8b1 could not be found. Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-384230f4-ceb8-4f83-b155-dce73c1531c1 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Request method failure captured: Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 HTTP/1.1 Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKKKtIVfVjPBDFolAE7228ylrVmF3ywkC19muVdtW4uFG1jT_p2Ytq3JV3cDIH7n4fJoqF6dLiBYg9Pb_PRcKhYlRQs4x9CBQ1V4Y3EosDdYkoSiGcfOYpXDUa9Qj9AeX244rU5ocygT_eErkici6aD_hYAUOwVSTMkXSpXyQyg_wGQ Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: b2ea0a3effb846858c46355590f437cf Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906066682 Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b2ea0a3effb846858c46355590f437cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b2ea0a3effb846858c46355590f437cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b2ea0a3effb846858c46355590f437cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b2ea0a3effb846858c46355590f437cf"}]}] Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-906066682 Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: b2ea0a3effb846858c46355590f437cf Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906066682 Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: e46858a6edfa435bb7c68cdc13c05539 Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance d9a1a3ee-1603-44d6-a94b-062f492cf8b1 could not be found. Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'd9a1a3ee-1603-44d6-a94b-062f492cf8b1'} Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9a1a3ee-1603-44d6-a94b-062f492cf8b1 could not be found. Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9a1a3ee-1603-44d6-a94b-062f492cf8b1 could not be found. Oct 04 21:16:47.782792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:47.786899 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:47.786899 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:47.786899 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:47.786899 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:47.786899 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:47.786899 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:47.786899 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:47.786899 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9a1a3ee-1603-44d6-a94b-062f492cf8b1 could not be found. Oct 04 21:16:47.786899 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:47.788950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-384230f4-ceb8-4f83-b155-dce73c1531c1 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] Returning 404 to user: Instance d9a1a3ee-1603-44d6-a94b-062f492cf8b1 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:47.790007 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-384230f4-ceb8-4f83-b155-dce73c1531c1 tempest-FloatingIPsAssociationNegativeTestJSON-906066682 tempest-FloatingIPsAssociationNegativeTestJSON-906066682-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1" status: 404 len: 111 microversion: 2.1 time: 0.046454 Oct 04 21:16:47.791074 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1373/2656] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:47 2022] GET /compute/v2.1/servers/d9a1a3ee-1603-44d6-a94b-062f492cf8b1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:47.800131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4d3002bf-a255-4a67-a7bb-8b23064b5a62 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:47.800961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4d3002bf-a255-4a67-a7bb-8b23064b5a62 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:47.817788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d3002bf-a255-4a67-a7bb-8b23064b5a62 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:47.818889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d3002bf-a255-4a67-a7bb-8b23064b5a62 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:47.822108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d3002bf-a255-4a67-a7bb-8b23064b5a62 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:47.823094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d3002bf-a255-4a67-a7bb-8b23064b5a62 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:47.823747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d3002bf-a255-4a67-a7bb-8b23064b5a62 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:47.824382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d3002bf-a255-4a67-a7bb-8b23064b5a62 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:48.150524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4d3002bf-a255-4a67-a7bb-8b23064b5a62 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:48.161674 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4d3002bf-a255-4a67-a7bb-8b23064b5a62 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1371 microversion: 2.1 time: 0.366652 Oct 04 21:16:48.165349 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1284/2657] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:47 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1371 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:48.225415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e70f3f46-d4bf-4207-9450-486d67b14d47 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:48.230992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e70f3f46-d4bf-4207-9450-486d67b14d47 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:48.244256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e70f3f46-d4bf-4207-9450-486d67b14d47 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:48.245122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e70f3f46-d4bf-4207-9450-486d67b14d47 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:48.245732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e70f3f46-d4bf-4207-9450-486d67b14d47 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:48.246669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e70f3f46-d4bf-4207-9450-486d67b14d47 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:48.247428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e70f3f46-d4bf-4207-9450-486d67b14d47 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:48.247870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e70f3f46-d4bf-4207-9450-486d67b14d47 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:48.299652 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e70f3f46-d4bf-4207-9450-486d67b14d47 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077138 Oct 04 21:16:48.299652 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1374/2658] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:16:48 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:16:48.380650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fc9d5aa7-805c-47e4-b8ab-81b5a284ddbe tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:48.389044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fc9d5aa7-805c-47e4-b8ab-81b5a284ddbe tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:48.395241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc9d5aa7-805c-47e4-b8ab-81b5a284ddbe tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:48.395964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc9d5aa7-805c-47e4-b8ab-81b5a284ddbe tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:48.396740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc9d5aa7-805c-47e4-b8ab-81b5a284ddbe tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:48.397740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc9d5aa7-805c-47e4-b8ab-81b5a284ddbe tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:48.398357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc9d5aa7-805c-47e4-b8ab-81b5a284ddbe tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:48.399208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc9d5aa7-805c-47e4-b8ab-81b5a284ddbe tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:48.439457 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fc9d5aa7-805c-47e4-b8ab-81b5a284ddbe tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064074 Oct 04 21:16:48.446596 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1285/2659] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:16:48 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:16:48.538721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-720caac0-d121-4469-b4e0-934def9251ee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:48.539742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-720caac0-d121-4469-b4e0-934def9251ee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:48.547726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-720caac0-d121-4469-b4e0-934def9251ee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:48.548220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-720caac0-d121-4469-b4e0-934def9251ee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:48.548657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-720caac0-d121-4469-b4e0-934def9251ee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:48.549489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-720caac0-d121-4469-b4e0-934def9251ee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:48.550555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-720caac0-d121-4469-b4e0-934def9251ee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:48.550555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-720caac0-d121-4469-b4e0-934def9251ee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:48.586049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-720caac0-d121-4469-b4e0-934def9251ee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:16:48.963603 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-720caac0-d121-4469-b4e0-934def9251ee tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 204 len: 0 microversion: 2.1 time: 0.428901 Oct 04 21:16:48.966577 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1375/2660] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:16:48 2022] DELETE /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:16:48.985256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fd565cc6-634f-4d45-9354-2758a54c69e4 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:48.985941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fd565cc6-634f-4d45-9354-2758a54c69e4 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:49.005485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd565cc6-634f-4d45-9354-2758a54c69e4 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:49.019432 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd565cc6-634f-4d45-9354-2758a54c69e4 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:49.019816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd565cc6-634f-4d45-9354-2758a54c69e4 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:49.020576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd565cc6-634f-4d45-9354-2758a54c69e4 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:49.021063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd565cc6-634f-4d45-9354-2758a54c69e4 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:49.022076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd565cc6-634f-4d45-9354-2758a54c69e4 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:49.194919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-520cc553-f81e-46b1-b66e-bf216c6ae1dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:49.202268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-520cc553-f81e-46b1-b66e-bf216c6ae1dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:49.205672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-520cc553-f81e-46b1-b66e-bf216c6ae1dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:49.206368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-520cc553-f81e-46b1-b66e-bf216c6ae1dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:49.207418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-520cc553-f81e-46b1-b66e-bf216c6ae1dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:49.208412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-520cc553-f81e-46b1-b66e-bf216c6ae1dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:49.209973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-520cc553-f81e-46b1-b66e-bf216c6ae1dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:49.210885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-520cc553-f81e-46b1-b66e-bf216c6ae1dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:49.370253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fd565cc6-634f-4d45-9354-2758a54c69e4 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:49.387990 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fd565cc6-634f-4d45-9354-2758a54c69e4 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1679 microversion: 2.1 time: 0.406479 Oct 04 21:16:49.392471 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1286/2661] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:48 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1679 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:49.529770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-520cc553-f81e-46b1-b66e-bf216c6ae1dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:49.551916 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-520cc553-f81e-46b1-b66e-bf216c6ae1dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1371 microversion: 2.1 time: 0.363206 Oct 04 21:16:49.554327 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1376/2662] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:49 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1371 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:50.415715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7544cb27-665a-4d8d-843b-ddb224679560 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:50.416496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7544cb27-665a-4d8d-843b-ddb224679560 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:50.429875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7544cb27-665a-4d8d-843b-ddb224679560 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:50.430647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7544cb27-665a-4d8d-843b-ddb224679560 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:50.431092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7544cb27-665a-4d8d-843b-ddb224679560 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:50.436646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7544cb27-665a-4d8d-843b-ddb224679560 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:50.436646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7544cb27-665a-4d8d-843b-ddb224679560 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:50.437557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7544cb27-665a-4d8d-843b-ddb224679560 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:50.578600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-acb2c451-bb60-41f8-8b61-054ce00ab859 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:50.579224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-acb2c451-bb60-41f8-8b61-054ce00ab859 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:50.592112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acb2c451-bb60-41f8-8b61-054ce00ab859 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:50.593802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acb2c451-bb60-41f8-8b61-054ce00ab859 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:50.594285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acb2c451-bb60-41f8-8b61-054ce00ab859 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:50.599660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acb2c451-bb60-41f8-8b61-054ce00ab859 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:50.599660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acb2c451-bb60-41f8-8b61-054ce00ab859 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:50.599660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acb2c451-bb60-41f8-8b61-054ce00ab859 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:51.024292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7544cb27-665a-4d8d-843b-ddb224679560 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:51.065453 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7544cb27-665a-4d8d-843b-ddb224679560 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1679 microversion: 2.1 time: 0.653440 Oct 04 21:16:51.090356 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1287/2663] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:50 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1679 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:51.151081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-acb2c451-bb60-41f8-8b61-054ce00ab859 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:51.167097 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-acb2c451-bb60-41f8-8b61-054ce00ab859 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1371 microversion: 2.1 time: 0.589371 Oct 04 21:16:51.167744 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1377/2664] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:50 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1371 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:52.110448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e3ee3bb8-8f07-4de8-89f7-3d01a2d751c8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:52.113488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e3ee3bb8-8f07-4de8-89f7-3d01a2d751c8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:52.116864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:52.141161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3ee3bb8-8f07-4de8-89f7-3d01a2d751c8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:52.148616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3ee3bb8-8f07-4de8-89f7-3d01a2d751c8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:52.153595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3ee3bb8-8f07-4de8-89f7-3d01a2d751c8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:52.156547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3ee3bb8-8f07-4de8-89f7-3d01a2d751c8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:52.157349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3ee3bb8-8f07-4de8-89f7-3d01a2d751c8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:52.158053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3ee3bb8-8f07-4de8-89f7-3d01a2d751c8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:52.203265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d5d5fc7f-99b7-4917-b7b3-de697345770a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:52.203898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d5d5fc7f-99b7-4917-b7b3-de697345770a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:52.225885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5d5fc7f-99b7-4917-b7b3-de697345770a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:52.239275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5d5fc7f-99b7-4917-b7b3-de697345770a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:52.239275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5d5fc7f-99b7-4917-b7b3-de697345770a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:52.255415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5d5fc7f-99b7-4917-b7b3-de697345770a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:52.261311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5d5fc7f-99b7-4917-b7b3-de697345770a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:52.262017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d5d5fc7f-99b7-4917-b7b3-de697345770a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:52.493635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e3ee3bb8-8f07-4de8-89f7-3d01a2d751c8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:52.517190 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e3ee3bb8-8f07-4de8-89f7-3d01a2d751c8 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1611 microversion: 2.1 time: 0.406679 Oct 04 21:16:52.517190 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1288/2665] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:52 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1611 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:52.710146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d5d5fc7f-99b7-4917-b7b3-de697345770a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:52.727408 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d5d5fc7f-99b7-4917-b7b3-de697345770a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1371 microversion: 2.1 time: 0.529685 Oct 04 21:16:52.732270 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1378/2666] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:52 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1371 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:53.346088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-3eb3e273-cf6b-4ecb-a4da-45ea69cd3b2f req-1c70a0ac-bf80-4891-8fe0-56a44c295fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3", "name": "network-vif-plugged", "status": "completed", "tag": "4c39a316-efc6-4f59-97f7-911c7414ee28"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:53.377861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3eb3e273-cf6b-4ecb-a4da-45ea69cd3b2f req-1c70a0ac-bf80-4891-8fe0-56a44c295fae service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:53.378824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3eb3e273-cf6b-4ecb-a4da-45ea69cd3b2f req-1c70a0ac-bf80-4891-8fe0-56a44c295fae service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:53.381375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3eb3e273-cf6b-4ecb-a4da-45ea69cd3b2f req-1c70a0ac-bf80-4891-8fe0-56a44c295fae service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:53.400820 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-3eb3e273-cf6b-4ecb-a4da-45ea69cd3b2f req-1c70a0ac-bf80-4891-8fe0-56a44c295fae service nova] Creating event network-vif-plugged:4c39a316-efc6-4f59-97f7-911c7414ee28 for instance 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 on n-h1-860282-1 Oct 04 21:16:53.409173 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-3eb3e273-cf6b-4ecb-a4da-45ea69cd3b2f req-1c70a0ac-bf80-4891-8fe0-56a44c295fae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066779 Oct 04 21:16:53.415519 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1289/2667] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:53.555806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1f6bd6ad-51c4-43ed-823c-4ae60226db59 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:53.557294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1f6bd6ad-51c4-43ed-823c-4ae60226db59 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:53.565976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f6bd6ad-51c4-43ed-823c-4ae60226db59 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:53.568205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f6bd6ad-51c4-43ed-823c-4ae60226db59 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:53.568205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f6bd6ad-51c4-43ed-823c-4ae60226db59 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:53.570480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f6bd6ad-51c4-43ed-823c-4ae60226db59 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:53.571423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f6bd6ad-51c4-43ed-823c-4ae60226db59 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:53.571871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f6bd6ad-51c4-43ed-823c-4ae60226db59 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:53.759309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-27eaae71-7a33-4b85-8b33-7f0d62d5800d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:53.762739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-27eaae71-7a33-4b85-8b33-7f0d62d5800d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:53.782832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27eaae71-7a33-4b85-8b33-7f0d62d5800d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:53.783310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27eaae71-7a33-4b85-8b33-7f0d62d5800d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:53.783757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27eaae71-7a33-4b85-8b33-7f0d62d5800d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:53.784473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27eaae71-7a33-4b85-8b33-7f0d62d5800d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:53.790770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27eaae71-7a33-4b85-8b33-7f0d62d5800d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:53.791547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27eaae71-7a33-4b85-8b33-7f0d62d5800d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:53.887382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1f6bd6ad-51c4-43ed-823c-4ae60226db59 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:53.905041 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1f6bd6ad-51c4-43ed-823c-4ae60226db59 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1611 microversion: 2.1 time: 0.357325 Oct 04 21:16:53.908031 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1379/2668] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:53 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1611 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:53.918838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-8dbea1f2-863b-4938-a552-593389f05883 req-104a48d5-5d09-43fc-99fd-d656a27764f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0250fa-4053-4bec-81bb-b5f857310687", "name": "network-vif-deleted", "tag": "9965e6e8-265e-42f4-906a-f53b455b8c28"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:53.945549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8dbea1f2-863b-4938-a552-593389f05883 req-104a48d5-5d09-43fc-99fd-d656a27764f1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:53.949107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8dbea1f2-863b-4938-a552-593389f05883 req-104a48d5-5d09-43fc-99fd-d656a27764f1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:53.951435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8dbea1f2-863b-4938-a552-593389f05883 req-104a48d5-5d09-43fc-99fd-d656a27764f1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:53.972640 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-8dbea1f2-863b-4938-a552-593389f05883 req-104a48d5-5d09-43fc-99fd-d656a27764f1 service nova] Creating event network-vif-deleted:9965e6e8-265e-42f4-906a-f53b455b8c28 for instance 0f0250fa-4053-4bec-81bb-b5f857310687 on n-h1-860282-1 Oct 04 21:16:53.979455 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-8dbea1f2-863b-4938-a552-593389f05883 req-104a48d5-5d09-43fc-99fd-d656a27764f1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068947 Oct 04 21:16:53.984191 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1380/2669] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:54.100830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-27eaae71-7a33-4b85-8b33-7f0d62d5800d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:54.112750 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-27eaae71-7a33-4b85-8b33-7f0d62d5800d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1371 microversion: 2.1 time: 0.358525 Oct 04 21:16:54.116373 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1290/2670] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:53 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1371 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:54.638010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-688f8b78-f1a5-49ba-af98-7e372550fc24 tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Calling method '.version_select at 0x7f578b6aaee0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:54.718453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG neutronclient.v2_0.client [None req-688f8b78-f1a5-49ba-af98-7e372550fc24 tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 79a5c93a-f963-47b0-8bd0-6ffa493c3031 does not exist", "detail": ""}} {{(pid=122758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:16:54.719078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.security_group_api [None req-688f8b78-f1a5-49ba-af98-7e372550fc24 tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Neutron security group 79a5c93a-f963-47b0-8bd0-6ffa493c3031 not found {{(pid=122758) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:16:54.720118 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-688f8b78-f1a5-49ba-af98-7e372550fc24 tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] HTTP exception thrown: Security group 79a5c93a-f963-47b0-8bd0-6ffa493c3031 does not exist Oct 04 21:16:54.720118 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-0d402554-1ed0-4e7c-aea6-1cf4db5a923b'] Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-688f8b78-f1a5-49ba-af98-7e372550fc24 tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Request method failure captured: Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/os-security-groups/79a5c93a-f963-47b0-8bd0-6ffa493c3031 HTTP/1.1 Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKLGw-jvaDPS5DhKBjRA4RrA0R6VrOnmjHvBcdRIcDxMsTQCUpU5P1dbelm6aDfmJxmK8VaUHGOsTHBFhBvE4X5jCDbnZKebNnl8imVio5RyuUU4GemQErwtaOF8gkF9uNpSpEpMeuK6ydBC54anEKKDSKlxixLzv1c6jRjNMLGcYrU Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 6c9a1c1ac5674dbbaaad1491e7ea9d37 Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2088366941 Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6c9a1c1ac5674dbbaaad1491e7ea9d37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6c9a1c1ac5674dbbaaad1491e7ea9d37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6c9a1c1ac5674dbbaaad1491e7ea9d37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6c9a1c1ac5674dbbaaad1491e7ea9d37"}]}] Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2088366941 Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 6c9a1c1ac5674dbbaaad1491e7ea9d37 Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2088366941 Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-SecurityGroupsNegativeTestJSON-2088366941-project Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3af5377f08204dabb02ecf1a31ab43cd Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2088366941-project Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: exception: Security group 79a5c93a-f963-47b0-8bd0-6ffa493c3031 does not exist Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-0d402554-1ed0-4e7c-aea6-1cf4db5a923b'] Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '79a5c93a-f963-47b0-8bd0-6ffa493c3031'} Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:16:54.743446 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 79a5c93a-f963-47b0-8bd0-6ffa493c3031 does not exist Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d402554-1ed0-4e7c-aea6-1cf4db5a923b'] Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 79a5c93a-f963-47b0-8bd0-6ffa493c3031 does not exist Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d402554-1ed0-4e7c-aea6-1cf4db5a923b'] Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 79a5c93a-f963-47b0-8bd0-6ffa493c3031 does not exist Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d402554-1ed0-4e7c-aea6-1cf4db5a923b'] Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 79a5c93a-f963-47b0-8bd0-6ffa493c3031 does not exist Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d402554-1ed0-4e7c-aea6-1cf4db5a923b'] Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-688f8b78-f1a5-49ba-af98-7e372550fc24 tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Returning 404 to user: Security group 79a5c93a-f963-47b0-8bd0-6ffa493c3031 does not exist Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-0d402554-1ed0-4e7c-aea6-1cf4db5a923b'] {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-688f8b78-f1a5-49ba-af98-7e372550fc24 tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/79a5c93a-f963-47b0-8bd0-6ffa493c3031" status: 404 len: 194 microversion: 2.1 time: 0.367813 Oct 04 21:16:54.748881 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1381/2671] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:16:54 2022] DELETE /compute/v2.1/os-security-groups/79a5c93a-f963-47b0-8bd0-6ffa493c3031 => generated 194 bytes in 369 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:54.759044 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d955ac1d-439e-4167-a2ce-31e0efe84f4d tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003876 Oct 04 21:16:54.759044 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1291/2672] 10.222.0.30 () {58 vars in 1164 bytes} [Tue Oct 4 21:16:54 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 21:16:54.766362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1da27854-a402-4d54-827c-fcbacfddb77f tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Calling method '.version_select at 0x7f57945f9ca0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:54.947269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d3b210da-fc53-42ca-9531-f273a3935486 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:54.948394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d3b210da-fc53-42ca-9531-f273a3935486 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:54.963908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3b210da-fc53-42ca-9531-f273a3935486 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:54.964808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3b210da-fc53-42ca-9531-f273a3935486 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:54.965499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3b210da-fc53-42ca-9531-f273a3935486 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:54.966495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3b210da-fc53-42ca-9531-f273a3935486 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:54.967188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3b210da-fc53-42ca-9531-f273a3935486 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:54.967959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3b210da-fc53-42ca-9531-f273a3935486 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:55.004830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3b210da-fc53-42ca-9531-f273a3935486 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:55.006330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3b210da-fc53-42ca-9531-f273a3935486 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:55.007225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3b210da-fc53-42ca-9531-f273a3935486 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:55.007868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-d3b210da-fc53-42ca-9531-f273a3935486 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lazy-loading 'fault' on Instance uuid 0f0250fa-4053-4bec-81bb-b5f857310687 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:16:55.130378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d3b210da-fc53-42ca-9531-f273a3935486 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9762c7ce00fb40798f03212a6c3d4c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aec0d41371749e7b47226ace53ffe86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:55.140915 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d3b210da-fc53-42ca-9531-f273a3935486 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 200 len: 1329 microversion: 2.1 time: 0.211412 Oct 04 21:16:55.153483 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1292/2673] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:54 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 1329 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:55.166871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e8b56dff-7886-4dd1-b727-89dfb7d371f8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:55.171746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e8b56dff-7886-4dd1-b727-89dfb7d371f8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:55.190749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8b56dff-7886-4dd1-b727-89dfb7d371f8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:55.191288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8b56dff-7886-4dd1-b727-89dfb7d371f8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:55.191733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8b56dff-7886-4dd1-b727-89dfb7d371f8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:55.197969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8b56dff-7886-4dd1-b727-89dfb7d371f8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:55.197969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8b56dff-7886-4dd1-b727-89dfb7d371f8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:55.197969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8b56dff-7886-4dd1-b727-89dfb7d371f8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:55.369609 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1da27854-a402-4d54-827c-fcbacfddb77f tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.607913 Oct 04 21:16:55.370713 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1382/2674] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Oct 4 21:16:54 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:55.389642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2abd5f06-c57c-4b7a-a58d-16ba8c999fba tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Calling method '.version_select at 0x7f57944a3940>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:55.504652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e8b56dff-7886-4dd1-b727-89dfb7d371f8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:55.513831 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e8b56dff-7886-4dd1-b727-89dfb7d371f8 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1371 microversion: 2.1 time: 0.362273 Oct 04 21:16:55.514408 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1293/2675] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:55 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1371 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:55.781457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG neutronclient.v2_0.client [None req-2abd5f06-c57c-4b7a-a58d-16ba8c999fba tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:16:55.783354 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-2abd5f06-c57c-4b7a-a58d-16ba8c999fba tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 04 21:16:55.783354 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-66841802-89af-47f3-ad98-d95013156450'] Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2abd5f06-c57c-4b7a-a58d-16ba8c999fba tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Request method failure captured: Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/os-security-groups/b2a9e1da-ac75-49f9-b9ce-78a5f1eac4ef HTTP/1.1 Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKLGw-jvaDPS5DhKBjRA4RrA0R6VrOnmjHvBcdRIcDxMsTQCUpU5P1dbelm6aDfmJxmK8VaUHGOsTHBFhBvE4X5jCDbnZKebNnl8imVio5RyuUU4GemQErwtaOF8gkF9uNpSpEpMeuK6ydBC54anEKKDSKlxixLzv1c6jRjNMLGcYrU Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 6c9a1c1ac5674dbbaaad1491e7ea9d37 Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2088366941 Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6c9a1c1ac5674dbbaaad1491e7ea9d37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6c9a1c1ac5674dbbaaad1491e7ea9d37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6c9a1c1ac5674dbbaaad1491e7ea9d37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6c9a1c1ac5674dbbaaad1491e7ea9d37"}]}] Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2088366941 Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 6c9a1c1ac5674dbbaaad1491e7ea9d37 Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2088366941 Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-SecurityGroupsNegativeTestJSON-2088366941-project Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3af5377f08204dabb02ecf1a31ab43cd Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2088366941-project Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: exception: Insufficient rights for removing default security group. Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-66841802-89af-47f3-ad98-d95013156450'] Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'b2a9e1da-ac75-49f9-b9ce-78a5f1eac4ef'} Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:16:55.785873 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66841802-89af-47f3-ad98-d95013156450'] Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66841802-89af-47f3-ad98-d95013156450'] Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66841802-89af-47f3-ad98-d95013156450'] Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66841802-89af-47f3-ad98-d95013156450'] Oct 04 21:16:55.790301 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:55.794482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2abd5f06-c57c-4b7a-a58d-16ba8c999fba tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 04 21:16:55.794482 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-66841802-89af-47f3-ad98-d95013156450'] {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:55.798588 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2abd5f06-c57c-4b7a-a58d-16ba8c999fba tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/b2a9e1da-ac75-49f9-b9ce-78a5f1eac4ef" status: 400 len: 182 microversion: 2.1 time: 0.414166 Oct 04 21:16:55.798588 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1383/2676] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:16:55 2022] DELETE /compute/v2.1/os-security-groups/b2a9e1da-ac75-49f9-b9ce-78a5f1eac4ef => generated 182 bytes in 416 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:16:55.812043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1b24b068-5953-455f-9a5b-32c1bb0fe0c0 tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Calling method '.version_select at 0x7f579459a310>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:55.841692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG neutronclient.v2_0.client [None req-1b24b068-5953-455f-9a5b-32c1bb0fe0c0 tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3adfde7b-a483-4cb8-b427-692acc2cbf97 does not exist", "detail": ""}} {{(pid=122757) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:16:55.842313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.security_group_api [None req-1b24b068-5953-455f-9a5b-32c1bb0fe0c0 tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Neutron security group 3adfde7b-a483-4cb8-b427-692acc2cbf97 not found {{(pid=122757) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:16:55.842847 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-1b24b068-5953-455f-9a5b-32c1bb0fe0c0 tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] HTTP exception thrown: Security group 3adfde7b-a483-4cb8-b427-692acc2cbf97 does not exist Oct 04 21:16:55.842847 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-2517ae4b-9381-4ec6-bacd-8f8170845622'] Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1b24b068-5953-455f-9a5b-32c1bb0fe0c0 tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Request method failure captured: Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-security-groups/3adfde7b-a483-4cb8-b427-692acc2cbf97 HTTP/1.1 Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKLGw-jvaDPS5DhKBjRA4RrA0R6VrOnmjHvBcdRIcDxMsTQCUpU5P1dbelm6aDfmJxmK8VaUHGOsTHBFhBvE4X5jCDbnZKebNnl8imVio5RyuUU4GemQErwtaOF8gkF9uNpSpEpMeuK6ydBC54anEKKDSKlxixLzv1c6jRjNMLGcYrU Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 6c9a1c1ac5674dbbaaad1491e7ea9d37 Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2088366941 Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6c9a1c1ac5674dbbaaad1491e7ea9d37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6c9a1c1ac5674dbbaaad1491e7ea9d37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6c9a1c1ac5674dbbaaad1491e7ea9d37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6c9a1c1ac5674dbbaaad1491e7ea9d37"}]}] Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2088366941 Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 6c9a1c1ac5674dbbaaad1491e7ea9d37 Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2088366941 Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-SecurityGroupsNegativeTestJSON-2088366941-project Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3af5377f08204dabb02ecf1a31ab43cd Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2088366941-project Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: exception: Security group 3adfde7b-a483-4cb8-b427-692acc2cbf97 does not exist Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-2517ae4b-9381-4ec6-bacd-8f8170845622'] Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '3adfde7b-a483-4cb8-b427-692acc2cbf97'} Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:16:55.846046 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3adfde7b-a483-4cb8-b427-692acc2cbf97 does not exist Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2517ae4b-9381-4ec6-bacd-8f8170845622'] Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3adfde7b-a483-4cb8-b427-692acc2cbf97 does not exist Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2517ae4b-9381-4ec6-bacd-8f8170845622'] Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3adfde7b-a483-4cb8-b427-692acc2cbf97 does not exist Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2517ae4b-9381-4ec6-bacd-8f8170845622'] Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3adfde7b-a483-4cb8-b427-692acc2cbf97 does not exist Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2517ae4b-9381-4ec6-bacd-8f8170845622'] Oct 04 21:16:55.850588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:55.853940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1b24b068-5953-455f-9a5b-32c1bb0fe0c0 tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Returning 404 to user: Security group 3adfde7b-a483-4cb8-b427-692acc2cbf97 does not exist Oct 04 21:16:55.853940 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-2517ae4b-9381-4ec6-bacd-8f8170845622'] {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:55.855012 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1b24b068-5953-455f-9a5b-32c1bb0fe0c0 tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/3adfde7b-a483-4cb8-b427-692acc2cbf97" status: 404 len: 194 microversion: 2.1 time: 0.047192 Oct 04 21:16:55.855766 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1294/2677] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Oct 4 21:16:55 2022] GET /compute/v2.1/os-security-groups/3adfde7b-a483-4cb8-b427-692acc2cbf97 => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:16:55.868406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-acdbb24d-6452-4b24-b6f0-87dc9ffcfc7e tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Action: 'update', calling method: .version_select at 0x7f57943bbd30>, body: {"security_group": {"name": "tempest-sg-1866251488", "description": "tempest-description-661021142"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:56.005229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG neutronclient.v2_0.client [None req-acdbb24d-6452-4b24-b6f0-87dc9ffcfc7e tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5b09f87d-9dd1-4c21-b78f-934add80cc46 does not exist", "detail": ""}} {{(pid=122758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:16:56.006015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.security_group_api [None req-acdbb24d-6452-4b24-b6f0-87dc9ffcfc7e tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Neutron security group 5b09f87d-9dd1-4c21-b78f-934add80cc46 not found {{(pid=122758) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:16:56.006750 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-acdbb24d-6452-4b24-b6f0-87dc9ffcfc7e tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] HTTP exception thrown: Security group 5b09f87d-9dd1-4c21-b78f-934add80cc46 does not exist Oct 04 21:16:56.006750 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-efc53210-e8f8-4c14-94e1-8736fa7510ad'] Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-acdbb24d-6452-4b24-b6f0-87dc9ffcfc7e tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Request method failure captured: Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: request: PUT /compute/v2.1/os-security-groups/5b09f87d-9dd1-4c21-b78f-934add80cc46 HTTP/1.1 Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 101 Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKLGw-jvaDPS5DhKBjRA4RrA0R6VrOnmjHvBcdRIcDxMsTQCUpU5P1dbelm6aDfmJxmK8VaUHGOsTHBFhBvE4X5jCDbnZKebNnl8imVio5RyuUU4GemQErwtaOF8gkF9uNpSpEpMeuK6ydBC54anEKKDSKlxixLzv1c6jRjNMLGcYrU Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 6c9a1c1ac5674dbbaaad1491e7ea9d37 Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2088366941 Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6c9a1c1ac5674dbbaaad1491e7ea9d37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6c9a1c1ac5674dbbaaad1491e7ea9d37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6c9a1c1ac5674dbbaaad1491e7ea9d37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6c9a1c1ac5674dbbaaad1491e7ea9d37"}]}] Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2088366941 Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 6c9a1c1ac5674dbbaaad1491e7ea9d37 Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2088366941 Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-SecurityGroupsNegativeTestJSON-2088366941-project Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3af5377f08204dabb02ecf1a31ab43cd Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2088366941-project Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: {"security_group": {"name": "tempest-sg-1866251488", "description": "tempest-description-661021142"}} Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: exception: Security group 5b09f87d-9dd1-4c21-b78f-934add80cc46 does not exist Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-efc53210-e8f8-4c14-94e1-8736fa7510ad'] Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '5b09f87d-9dd1-4c21-b78f-934add80cc46', 'body': {'security_group': {'name': 'tempest-sg-1866251488', 'description': 'tempest-description-661021142'}}} Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:16:56.008900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5b09f87d-9dd1-4c21-b78f-934add80cc46 does not exist Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efc53210-e8f8-4c14-94e1-8736fa7510ad'] Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5b09f87d-9dd1-4c21-b78f-934add80cc46 does not exist Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efc53210-e8f8-4c14-94e1-8736fa7510ad'] Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5b09f87d-9dd1-4c21-b78f-934add80cc46 does not exist Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efc53210-e8f8-4c14-94e1-8736fa7510ad'] Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5b09f87d-9dd1-4c21-b78f-934add80cc46 does not exist Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efc53210-e8f8-4c14-94e1-8736fa7510ad'] Oct 04 21:16:56.012933 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:16:56.023857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-acdbb24d-6452-4b24-b6f0-87dc9ffcfc7e tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] Returning 404 to user: Security group 5b09f87d-9dd1-4c21-b78f-934add80cc46 does not exist Oct 04 21:16:56.023857 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-efc53210-e8f8-4c14-94e1-8736fa7510ad'] {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:56.023857 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-acdbb24d-6452-4b24-b6f0-87dc9ffcfc7e tempest-SecurityGroupsNegativeTestJSON-2088366941 tempest-SecurityGroupsNegativeTestJSON-2088366941-project] 10.222.0.30 "PUT /compute/v2.1/os-security-groups/5b09f87d-9dd1-4c21-b78f-934add80cc46" status: 404 len: 194 microversion: 2.1 time: 0.155749 Oct 04 21:16:56.023857 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1384/2678] 10.222.0.30 () {60 vars in 1290 bytes} [Tue Oct 4 21:16:55 2022] PUT /compute/v2.1/os-security-groups/5b09f87d-9dd1-4c21-b78f-934add80cc46 => generated 194 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:56.181267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c71c9c49-145e-42ef-b5d1-9af4a4b32ef5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:56.182015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c71c9c49-145e-42ef-b5d1-9af4a4b32ef5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:56.206544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c71c9c49-145e-42ef-b5d1-9af4a4b32ef5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:56.211133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c71c9c49-145e-42ef-b5d1-9af4a4b32ef5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:56.211957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c71c9c49-145e-42ef-b5d1-9af4a4b32ef5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:56.212927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c71c9c49-145e-42ef-b5d1-9af4a4b32ef5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:56.213621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c71c9c49-145e-42ef-b5d1-9af4a4b32ef5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:56.214228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c71c9c49-145e-42ef-b5d1-9af4a4b32ef5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:56.256102 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-c71c9c49-145e-42ef-b5d1-9af4a4b32ef5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] HTTP exception thrown: Instance 0f0250fa-4053-4bec-81bb-b5f857310687 could not be found. Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c71c9c49-145e-42ef-b5d1-9af4a4b32ef5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Request method failure captured: Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 HTTP/1.1 Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKIdJZlR3S6XYa65WcTmhYhW75dtnKoNDyvUYY5SRzq_hwDRz0snEdE4FT_JiqfCorWii0Scq1_JjQjTGyxEbtw7dZm5iLaIeqegoBVuyTeadWZBt3X3kXuauI2p13jFHX5CK1ShJGOHswoLS8h0zGvWfh9QDeWhQoap8fHrf63Hrzc Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 2aec0d41371749e7b47226ace53ffe86 Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-453031309 Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2aec0d41371749e7b47226ace53ffe86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2aec0d41371749e7b47226ace53ffe86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2aec0d41371749e7b47226ace53ffe86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2aec0d41371749e7b47226ace53ffe86"}]}] Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-453031309 Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 2aec0d41371749e7b47226ace53ffe86 Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-453031309 Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AttachSCSIVolumeTestJSON-453031309-project Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 9762c7ce00fb40798f03212a6c3d4c08 Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-453031309-project Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 0f0250fa-4053-4bec-81bb-b5f857310687 could not be found. Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '0f0250fa-4053-4bec-81bb-b5f857310687'} Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0250fa-4053-4bec-81bb-b5f857310687 could not be found. Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0250fa-4053-4bec-81bb-b5f857310687 could not be found. Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:56.257890 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:56.262502 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:56.262502 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:56.262502 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:56.262502 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:56.262502 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:56.262502 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0250fa-4053-4bec-81bb-b5f857310687 could not be found. Oct 04 21:16:56.262502 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:16:56.262502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c71c9c49-145e-42ef-b5d1-9af4a4b32ef5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Returning 404 to user: Instance 0f0250fa-4053-4bec-81bb-b5f857310687 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:56.264303 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c71c9c49-145e-42ef-b5d1-9af4a4b32ef5 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 404 len: 111 microversion: 2.1 time: 0.089398 Oct 04 21:16:56.265285 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1295/2679] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:56 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:56.275701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-814398f1-a1a2-4814-b917-bedce6b247d9 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '.version_select at 0x7f57944e7a60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:56.395091 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-814398f1-a1a2-4814-b917-bedce6b247d9 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-63496420" status: 202 len: 0 microversion: 2.1 time: 0.125033 Oct 04 21:16:56.396000 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1385/2680] 10.222.0.30 () {58 vars in 1215 bytes} [Tue Oct 4 21:16:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-63496420 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:16:56.539326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dafc59ae-9fad-49ae-8e13-2be5e086e56a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:56.540289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dafc59ae-9fad-49ae-8e13-2be5e086e56a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:56.547282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dafc59ae-9fad-49ae-8e13-2be5e086e56a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:56.547790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dafc59ae-9fad-49ae-8e13-2be5e086e56a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:56.548296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dafc59ae-9fad-49ae-8e13-2be5e086e56a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:56.549065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dafc59ae-9fad-49ae-8e13-2be5e086e56a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:56.549732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dafc59ae-9fad-49ae-8e13-2be5e086e56a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:56.550337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dafc59ae-9fad-49ae-8e13-2be5e086e56a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:57.044899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dafc59ae-9fad-49ae-8e13-2be5e086e56a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:57.070960 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dafc59ae-9fad-49ae-8e13-2be5e086e56a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1566 microversion: 2.1 time: 0.534848 Oct 04 21:16:57.074268 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1296/2681] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:56 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1566 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:57.100963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1631368a-9dbd-4e3b-85e5-806ad6862981 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:57.101646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1631368a-9dbd-4e3b-85e5-806ad6862981 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:57.111780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1631368a-9dbd-4e3b-85e5-806ad6862981 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:57.113222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1631368a-9dbd-4e3b-85e5-806ad6862981 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:57.113959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1631368a-9dbd-4e3b-85e5-806ad6862981 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:57.115513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1631368a-9dbd-4e3b-85e5-806ad6862981 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:57.116729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1631368a-9dbd-4e3b-85e5-806ad6862981 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:57.117469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1631368a-9dbd-4e3b-85e5-806ad6862981 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:57.434258 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1631368a-9dbd-4e3b-85e5-806ad6862981 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.341001 Oct 04 21:16:57.447170 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1386/2682] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:16:57 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-interface => generated 285 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:00.027280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a482711c-44b0-4696-bae0-ed3d22c83749 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] Calling method '.version_select at 0x7f578baadaf0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:00.206376 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-a482711c-44b0-4696-bae0-ed3d22c83749 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] HTTP exception thrown: Image not found. Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a482711c-44b0-4696-bae0-ed3d22c83749 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] Request method failure captured: Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/images/6f6739d9-4ff3-411b-8816-6c16e95e62cd/metadata/os_distro HTTP/1.1 Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKLLc7BcIwSqCVtpAZgWV6vEMsZ9ilT2XGcqhfIvbGZiQyC3Pcj7-kYQQ7MH-3uv2iDN-qW2VpzlH7jXdq9i7HGZk871PCqgxcxM5wuwM1NIqD4kKvQ1qQAQCQoz_LKTs_T4p0eQ7b0DKm-SU8roNsYnLjRRO6norBjdjiiOmtTfK9c Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 759d4403b99e406a878cdf7a4b7fbba4 Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1005536498 Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/759d4403b99e406a878cdf7a4b7fbba4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_759d4403b99e406a878cdf7a4b7fbba4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/759d4403b99e406a878cdf7a4b7fbba4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/759d4403b99e406a878cdf7a4b7fbba4"}]}] Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1005536498 Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 759d4403b99e406a878cdf7a4b7fbba4 Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1005536498 Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ImagesMetadataNegativeTestJSON-1005536498-project Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 9d116d5db90c43de8555fbb1fbdbb37d Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1005536498-project Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: exception: Image not found. Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'image_id': '6f6739d9-4ff3-411b-8816-6c16e95e62cd', 'id': 'os_distro'} Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6f6739d9-4ff3-411b-8816-6c16e95e62cd Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 21:17:00.213592 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6f6739d9-4ff3-411b-8816-6c16e95e62cd could not be found. Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a482711c-44b0-4696-bae0-ed3d22c83749 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] Returning 404 to user: Image not found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a482711c-44b0-4696-bae0-ed3d22c83749 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] 10.222.0.30 "DELETE /compute/v2.1/images/6f6739d9-4ff3-411b-8816-6c16e95e62cd/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.449462 Oct 04 21:17:00.225036 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1297/2683] 10.222.0.30 () {58 vars in 1293 bytes} [Tue Oct 4 21:16:59 2022] DELETE /compute/v2.1/images/6f6739d9-4ff3-411b-8816-6c16e95e62cd/metadata/os_distro => generated 62 bytes in 451 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:17:00.229577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e15794bc-1eec-4f79-9570-f41102fe0380 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] Calling method '.version_select at 0x7f578b608820>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:00.301508 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-e15794bc-1eec-4f79-9570-f41102fe0380 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] HTTP exception thrown: Image not found. Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e15794bc-1eec-4f79-9570-f41102fe0380 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] Request method failure captured: Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/images/a7f8ba66-fffc-44a8-965f-546357b72f13/metadata/os_version HTTP/1.1 Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKLLc7BcIwSqCVtpAZgWV6vEMsZ9ilT2XGcqhfIvbGZiQyC3Pcj7-kYQQ7MH-3uv2iDN-qW2VpzlH7jXdq9i7HGZk871PCqgxcxM5wuwM1NIqD4kKvQ1qQAQCQoz_LKTs_T4p0eQ7b0DKm-SU8roNsYnLjRRO6norBjdjiiOmtTfK9c Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 759d4403b99e406a878cdf7a4b7fbba4 Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1005536498 Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/759d4403b99e406a878cdf7a4b7fbba4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_759d4403b99e406a878cdf7a4b7fbba4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/759d4403b99e406a878cdf7a4b7fbba4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/759d4403b99e406a878cdf7a4b7fbba4"}]}] Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1005536498 Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 759d4403b99e406a878cdf7a4b7fbba4 Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1005536498 Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesMetadataNegativeTestJSON-1005536498-project Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 9d116d5db90c43de8555fbb1fbdbb37d Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1005536498-project Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: exception: Image not found. Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'image_id': 'a7f8ba66-fffc-44a8-965f-546357b72f13', 'id': 'os_version'} Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a7f8ba66-fffc-44a8-965f-546357b72f13 Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 21:17:00.305968 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a7f8ba66-fffc-44a8-965f-546357b72f13 could not be found. Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e15794bc-1eec-4f79-9570-f41102fe0380 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] Returning 404 to user: Image not found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e15794bc-1eec-4f79-9570-f41102fe0380 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] 10.222.0.30 "GET /compute/v2.1/images/a7f8ba66-fffc-44a8-965f-546357b72f13/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.083963 Oct 04 21:17:00.311096 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1387/2684] 10.222.0.30 () {58 vars in 1293 bytes} [Tue Oct 4 21:17:00 2022] GET /compute/v2.1/images/a7f8ba66-fffc-44a8-965f-546357b72f13/metadata/os_version => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:17:00.320351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d3ae3f23-8fa3-4cb7-b1ab-259f14fe84c3 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] Calling method '.version_select at 0x7f578bfd4670>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:00.449791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-b463f7ae-9066-4da1-a2ca-501746c18b7e req-4d3818b3-14e4-4e67-810a-97e8fb90e6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3", "tag": "4c39a316-efc6-4f59-97f7-911c7414ee28"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:00.467212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b463f7ae-9066-4da1-a2ca-501746c18b7e req-4d3818b3-14e4-4e67-810a-97e8fb90e6f1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:00.467699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b463f7ae-9066-4da1-a2ca-501746c18b7e req-4d3818b3-14e4-4e67-810a-97e8fb90e6f1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:00.469820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b463f7ae-9066-4da1-a2ca-501746c18b7e req-4d3818b3-14e4-4e67-810a-97e8fb90e6f1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:00.498460 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-b463f7ae-9066-4da1-a2ca-501746c18b7e req-4d3818b3-14e4-4e67-810a-97e8fb90e6f1 service nova] Creating event network-changed:4c39a316-efc6-4f59-97f7-911c7414ee28 for instance 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 on n-h1-860282-1 Oct 04 21:17:00.527966 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-b463f7ae-9066-4da1-a2ca-501746c18b7e req-4d3818b3-14e4-4e67-810a-97e8fb90e6f1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083410 Oct 04 21:17:00.542349 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1388/2685] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:00.673474 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-d3ae3f23-8fa3-4cb7-b1ab-259f14fe84c3 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] HTTP exception thrown: Image not found. Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d3ae3f23-8fa3-4cb7-b1ab-259f14fe84c3 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] Request method failure captured: Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/images/27b50c2a-25af-43c7-8b6e-f711b11c3cad/metadata HTTP/1.1 Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKLLc7BcIwSqCVtpAZgWV6vEMsZ9ilT2XGcqhfIvbGZiQyC3Pcj7-kYQQ7MH-3uv2iDN-qW2VpzlH7jXdq9i7HGZk871PCqgxcxM5wuwM1NIqD4kKvQ1qQAQCQoz_LKTs_T4p0eQ7b0DKm-SU8roNsYnLjRRO6norBjdjiiOmtTfK9c Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 759d4403b99e406a878cdf7a4b7fbba4 Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1005536498 Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/759d4403b99e406a878cdf7a4b7fbba4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_759d4403b99e406a878cdf7a4b7fbba4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/759d4403b99e406a878cdf7a4b7fbba4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/759d4403b99e406a878cdf7a4b7fbba4"}]}] Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1005536498 Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 759d4403b99e406a878cdf7a4b7fbba4 Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1005536498 Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ImagesMetadataNegativeTestJSON-1005536498-project Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 9d116d5db90c43de8555fbb1fbdbb37d Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1005536498-project Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: exception: Image not found. Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'image_id': '27b50c2a-25af-43c7-8b6e-f711b11c3cad'} Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 27b50c2a-25af-43c7-8b6e-f711b11c3cad Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 21:17:00.676042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 27b50c2a-25af-43c7-8b6e-f711b11c3cad could not be found. Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:17:00.681544 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.686639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d3ae3f23-8fa3-4cb7-b1ab-259f14fe84c3 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] Returning 404 to user: Image not found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:00.688960 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d3ae3f23-8fa3-4cb7-b1ab-259f14fe84c3 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] 10.222.0.30 "GET /compute/v2.1/images/27b50c2a-25af-43c7-8b6e-f711b11c3cad/metadata" status: 404 len: 62 microversion: 2.1 time: 0.372078 Oct 04 21:17:00.689807 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1298/2686] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Oct 4 21:17:00 2022] GET /compute/v2.1/images/27b50c2a-25af-43c7-8b6e-f711b11c3cad/metadata => generated 62 bytes in 375 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:17:00.703304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aecde482-b3aa-4084-b4ce-3a0feeeab0bd tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] Action: 'update_all', calling method: .version_select at 0x7f57943c8160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:00.751415 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-aecde482-b3aa-4084-b4ce-3a0feeeab0bd tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] HTTP exception thrown: Image not found. Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aecde482-b3aa-4084-b4ce-3a0feeeab0bd tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] Request method failure captured: Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: request: PUT /compute/v2.1/images/fcc5cb60-ee29-4f05-ad4f-908db23142d5/metadata HTTP/1.1 Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 57 Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKLLc7BcIwSqCVtpAZgWV6vEMsZ9ilT2XGcqhfIvbGZiQyC3Pcj7-kYQQ7MH-3uv2iDN-qW2VpzlH7jXdq9i7HGZk871PCqgxcxM5wuwM1NIqD4kKvQ1qQAQCQoz_LKTs_T4p0eQ7b0DKm-SU8roNsYnLjRRO6norBjdjiiOmtTfK9c Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 759d4403b99e406a878cdf7a4b7fbba4 Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1005536498 Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/759d4403b99e406a878cdf7a4b7fbba4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_759d4403b99e406a878cdf7a4b7fbba4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/759d4403b99e406a878cdf7a4b7fbba4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/759d4403b99e406a878cdf7a4b7fbba4"}]}] Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1005536498 Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 759d4403b99e406a878cdf7a4b7fbba4 Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1005536498 Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesMetadataNegativeTestJSON-1005536498-project Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 9d116d5db90c43de8555fbb1fbdbb37d Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1005536498-project Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: exception: Image not found. Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'image_id': 'fcc5cb60-ee29-4f05-ad4f-908db23142d5', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fcc5cb60-ee29-4f05-ad4f-908db23142d5 Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 21:17:00.753838 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fcc5cb60-ee29-4f05-ad4f-908db23142d5 could not be found. Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aecde482-b3aa-4084-b4ce-3a0feeeab0bd tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] Returning 404 to user: Image not found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aecde482-b3aa-4084-b4ce-3a0feeeab0bd tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] 10.222.0.30 "PUT /compute/v2.1/images/fcc5cb60-ee29-4f05-ad4f-908db23142d5/metadata" status: 404 len: 62 microversion: 2.1 time: 0.056668 Oct 04 21:17:00.763173 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1389/2687] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:17:00 2022] PUT /compute/v2.1/images/fcc5cb60-ee29-4f05-ad4f-908db23142d5/metadata => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:17:00.771684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7ef537c4-526a-454e-82df-d61b7804abf2 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] Action: 'update', calling method: .version_select at 0x7f57945631f0>, body: {"meta": {"os_distro": "alt"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:00.829771 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-7ef537c4-526a-454e-82df-d61b7804abf2 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] HTTP exception thrown: Image not found. Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7ef537c4-526a-454e-82df-d61b7804abf2 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] Request method failure captured: Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: request: PUT /compute/v2.1/images/db33c1f8-f8e7-4211-8ab7-8afb6d48d106/metadata/os_distro HTTP/1.1 Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 30 Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKLLc7BcIwSqCVtpAZgWV6vEMsZ9ilT2XGcqhfIvbGZiQyC3Pcj7-kYQQ7MH-3uv2iDN-qW2VpzlH7jXdq9i7HGZk871PCqgxcxM5wuwM1NIqD4kKvQ1qQAQCQoz_LKTs_T4p0eQ7b0DKm-SU8roNsYnLjRRO6norBjdjiiOmtTfK9c Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 759d4403b99e406a878cdf7a4b7fbba4 Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1005536498 Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/759d4403b99e406a878cdf7a4b7fbba4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_759d4403b99e406a878cdf7a4b7fbba4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/759d4403b99e406a878cdf7a4b7fbba4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/759d4403b99e406a878cdf7a4b7fbba4"}]}] Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1005536498 Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 759d4403b99e406a878cdf7a4b7fbba4 Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1005536498 Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ImagesMetadataNegativeTestJSON-1005536498-project Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 9d116d5db90c43de8555fbb1fbdbb37d Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1005536498-project Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: {"meta": {"os_distro": "alt"}} Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: exception: Image not found. Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'image_id': 'db33c1f8-f8e7-4211-8ab7-8afb6d48d106', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID db33c1f8-f8e7-4211-8ab7-8afb6d48d106 Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 21:17:00.832141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image db33c1f8-f8e7-4211-8ab7-8afb6d48d106 could not be found. Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:17:00.837712 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.843996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7ef537c4-526a-454e-82df-d61b7804abf2 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] Returning 404 to user: Image not found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:00.843996 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7ef537c4-526a-454e-82df-d61b7804abf2 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] 10.222.0.30 "PUT /compute/v2.1/images/db33c1f8-f8e7-4211-8ab7-8afb6d48d106/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.081504 Oct 04 21:17:00.843996 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1299/2688] 10.222.0.30 () {60 vars in 1310 bytes} [Tue Oct 4 21:17:00 2022] PUT /compute/v2.1/images/db33c1f8-f8e7-4211-8ab7-8afb6d48d106/metadata/os_distro => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:17:00.854157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-941e1946-764f-474e-aaca-3bdc8646e904 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] Action: 'create', calling method: .version_select at 0x7f579457d940>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:00.932886 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-941e1946-764f-474e-aaca-3bdc8646e904 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] HTTP exception thrown: Image not found. Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-941e1946-764f-474e-aaca-3bdc8646e904 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] Request method failure captured: Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/images/133251b8-4640-4105-b3a0-389c3049b2a1/metadata HTTP/1.1 Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 57 Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKLLc7BcIwSqCVtpAZgWV6vEMsZ9ilT2XGcqhfIvbGZiQyC3Pcj7-kYQQ7MH-3uv2iDN-qW2VpzlH7jXdq9i7HGZk871PCqgxcxM5wuwM1NIqD4kKvQ1qQAQCQoz_LKTs_T4p0eQ7b0DKm-SU8roNsYnLjRRO6norBjdjiiOmtTfK9c Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 759d4403b99e406a878cdf7a4b7fbba4 Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1005536498 Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/759d4403b99e406a878cdf7a4b7fbba4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_759d4403b99e406a878cdf7a4b7fbba4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/759d4403b99e406a878cdf7a4b7fbba4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/759d4403b99e406a878cdf7a4b7fbba4"}]}] Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1005536498 Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 759d4403b99e406a878cdf7a4b7fbba4 Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1005536498 Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesMetadataNegativeTestJSON-1005536498-project Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 9d116d5db90c43de8555fbb1fbdbb37d Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1005536498-project Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: exception: Image not found. Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'image_id': '133251b8-4640-4105-b3a0-389c3049b2a1', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 133251b8-4640-4105-b3a0-389c3049b2a1 Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 21:17:00.936484 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 133251b8-4640-4105-b3a0-389c3049b2a1 could not be found. Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-941e1946-764f-474e-aaca-3bdc8646e904 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] Returning 404 to user: Image not found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-941e1946-764f-474e-aaca-3bdc8646e904 tempest-ImagesMetadataNegativeTestJSON-1005536498 tempest-ImagesMetadataNegativeTestJSON-1005536498-project] 10.222.0.30 "POST /compute/v2.1/images/133251b8-4640-4105-b3a0-389c3049b2a1/metadata" status: 404 len: 62 microversion: 2.1 time: 0.088501 Oct 04 21:17:00.940784 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1390/2689] 10.222.0.30 () {60 vars in 1281 bytes} [Tue Oct 4 21:17:00 2022] POST /compute/v2.1/images/133251b8-4640-4105-b3a0-389c3049b2a1/metadata => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:17:05.689807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1aab76d0-f896-4eb1-9164-a5f49a570454 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:05.690479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1aab76d0-f896-4eb1-9164-a5f49a570454 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:05.707547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1aab76d0-f896-4eb1-9164-a5f49a570454 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:05.708046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1aab76d0-f896-4eb1-9164-a5f49a570454 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:05.715131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1aab76d0-f896-4eb1-9164-a5f49a570454 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:05.716160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1aab76d0-f896-4eb1-9164-a5f49a570454 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:05.717080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1aab76d0-f896-4eb1-9164-a5f49a570454 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:05.718505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1aab76d0-f896-4eb1-9164-a5f49a570454 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:05.744293 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-1aab76d0-f896-4eb1-9164-a5f49a570454 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] HTTP exception thrown: Instance 0f0250fa-4053-4bec-81bb-b5f857310687 could not be found. Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1aab76d0-f896-4eb1-9164-a5f49a570454 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Request method failure captured: Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 HTTP/1.1 Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKIdJZlR3S6XYa65WcTmhYhW75dtnKoNDyvUYY5SRzq_hwDRz0snEdE4FT_JiqfCorWii0Scq1_JjQjTGyxEbtw7dZm5iLaIeqegoBVuyTeadWZBt3X3kXuauI2p13jFHX5CK1ShJGOHswoLS8h0zGvWfh9QDeWhQoap8fHrf63Hrzc Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 2aec0d41371749e7b47226ace53ffe86 Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-453031309 Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2aec0d41371749e7b47226ace53ffe86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2aec0d41371749e7b47226ace53ffe86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2aec0d41371749e7b47226ace53ffe86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2aec0d41371749e7b47226ace53ffe86"}]}] Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-453031309 Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 2aec0d41371749e7b47226ace53ffe86 Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-453031309 Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AttachSCSIVolumeTestJSON-453031309-project Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 9762c7ce00fb40798f03212a6c3d4c08 Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-453031309-project Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 0f0250fa-4053-4bec-81bb-b5f857310687 could not be found. Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '0f0250fa-4053-4bec-81bb-b5f857310687'} Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0250fa-4053-4bec-81bb-b5f857310687 could not be found. Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:17:05.747561 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:17:05.752251 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0250fa-4053-4bec-81bb-b5f857310687 could not be found. Oct 04 21:17:05.752251 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:05.752251 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:05.752251 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:05.752251 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:05.752251 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:05.752251 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:05.752251 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:05.752251 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:05.752251 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0250fa-4053-4bec-81bb-b5f857310687 could not be found. Oct 04 21:17:05.752251 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:05.773661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1aab76d0-f896-4eb1-9164-a5f49a570454 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Returning 404 to user: Instance 0f0250fa-4053-4bec-81bb-b5f857310687 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:05.776171 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1aab76d0-f896-4eb1-9164-a5f49a570454 tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 404 len: 111 microversion: 2.1 time: 0.091522 Oct 04 21:17:05.777848 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1391/2690] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:17:05 2022] DELETE /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:17:05.789145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d83b4aa5-ee3c-49d1-8144-681c0941e9ea tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:05.789805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d83b4aa5-ee3c-49d1-8144-681c0941e9ea tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] [instance: 0f0250fa-4053-4bec-81bb-b5f857310687] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:05.804025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d83b4aa5-ee3c-49d1-8144-681c0941e9ea tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:05.805553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d83b4aa5-ee3c-49d1-8144-681c0941e9ea tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:05.809937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d83b4aa5-ee3c-49d1-8144-681c0941e9ea tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:05.809937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d83b4aa5-ee3c-49d1-8144-681c0941e9ea tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:05.809937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d83b4aa5-ee3c-49d1-8144-681c0941e9ea tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:05.809937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d83b4aa5-ee3c-49d1-8144-681c0941e9ea tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:05.863803 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-d83b4aa5-ee3c-49d1-8144-681c0941e9ea tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] HTTP exception thrown: Instance 0f0250fa-4053-4bec-81bb-b5f857310687 could not be found. Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d83b4aa5-ee3c-49d1-8144-681c0941e9ea tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Request method failure captured: Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 HTTP/1.1 Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKIdJZlR3S6XYa65WcTmhYhW75dtnKoNDyvUYY5SRzq_hwDRz0snEdE4FT_JiqfCorWii0Scq1_JjQjTGyxEbtw7dZm5iLaIeqegoBVuyTeadWZBt3X3kXuauI2p13jFHX5CK1ShJGOHswoLS8h0zGvWfh9QDeWhQoap8fHrf63Hrzc Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 2aec0d41371749e7b47226ace53ffe86 Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-453031309 Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2aec0d41371749e7b47226ace53ffe86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2aec0d41371749e7b47226ace53ffe86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2aec0d41371749e7b47226ace53ffe86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2aec0d41371749e7b47226ace53ffe86"}]}] Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-453031309 Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 2aec0d41371749e7b47226ace53ffe86 Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-453031309 Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AttachSCSIVolumeTestJSON-453031309-project Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 9762c7ce00fb40798f03212a6c3d4c08 Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-453031309-project Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 0f0250fa-4053-4bec-81bb-b5f857310687 could not be found. Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '0f0250fa-4053-4bec-81bb-b5f857310687'} Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0250fa-4053-4bec-81bb-b5f857310687 could not be found. Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0250fa-4053-4bec-81bb-b5f857310687 could not be found. Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:05.865697 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:05.869541 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:05.869541 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:05.869541 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:05.869541 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:05.869541 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:05.869541 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0250fa-4053-4bec-81bb-b5f857310687 could not be found. Oct 04 21:17:05.869541 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:05.869541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d83b4aa5-ee3c-49d1-8144-681c0941e9ea tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] Returning 404 to user: Instance 0f0250fa-4053-4bec-81bb-b5f857310687 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:05.869541 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d83b4aa5-ee3c-49d1-8144-681c0941e9ea tempest-AttachSCSIVolumeTestJSON-453031309 tempest-AttachSCSIVolumeTestJSON-453031309-project] 10.222.0.30 "GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687" status: 404 len: 111 microversion: 2.1 time: 0.084781 Oct 04 21:17:05.877476 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1392/2691] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:05 2022] GET /compute/v2.1/servers/0f0250fa-4053-4bec-81bb-b5f857310687 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:17:06.173019 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4c8df8d5-c589-4a94-aaa4-ed441d8a41e8 tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] 10.222.0.30 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.522645 Oct 04 21:17:06.174439 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1300/2692] 10.222.0.30 () {58 vars in 1128 bytes} [Tue Oct 4 21:17:05 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 525 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 21:17:06.185365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5d818105-8f9c-41ea-99ff-87fdcb5cf1ae tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] Calling method '.version_select at 0x7f57945f2550>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:06.213370 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-5d818105-8f9c-41ea-99ff-87fdcb5cf1ae tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] HTTP exception thrown: Image not found. Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5d818105-8f9c-41ea-99ff-87fdcb5cf1ae tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] Request method failure captured: Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKLR9n3MHMP8oHhLe-_A6WT64oB7-Dr6tYu6m4vsMXvOhyGwxP0uTlKP_p-TE4OXyjqE3e3sH1a6kuks51dAP86FH2UdsSYf4PuzE3cPqy0iB1dCQAN6oOt-ARJwXySlMnO4nlAARAxnf6BrWAOguzqVepceClmQ_Kqeuc4Elb7aRoQ Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 11f2577a46c641ff9ad677651905fc84 Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1513729229 Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11f2577a46c641ff9ad677651905fc84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_11f2577a46c641ff9ad677651905fc84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/11f2577a46c641ff9ad677651905fc84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11f2577a46c641ff9ad677651905fc84"}]}] Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1513729229 Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 11f2577a46c641ff9ad677651905fc84 Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1513729229 Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesDeleteNegativeTestJSON-1513729229-project Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: e4e0519da75f4fc78af6416ecd6b4edc Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1513729229-project Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: exception: Image not found. Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '-1'} Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.215841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5d818105-8f9c-41ea-99ff-87fdcb5cf1ae tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] Returning 404 to user: Image not found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:06.227080 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5d818105-8f9c-41ea-99ff-87fdcb5cf1ae tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] 10.222.0.30 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.036617 Oct 04 21:17:06.228830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cf273a0b-7fd2-4857-b22c-e0e82ee46051 tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] Calling method '.version_select at 0x7f578bfd4ee0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:06.229363 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1393/2693] 10.222.0.30 () {58 vars in 1134 bytes} [Tue Oct 4 21:17:06 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:17:06.260276 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-cf273a0b-7fd2-4857-b22c-e0e82ee46051 tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] HTTP exception thrown: Image not found. Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cf273a0b-7fd2-4857-b22c-e0e82ee46051 tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] Request method failure captured: Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/images/fdb641b8-9c51-4bd2-9c55-b9f10b951baj HTTP/1.1 Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKLR9n3MHMP8oHhLe-_A6WT64oB7-Dr6tYu6m4vsMXvOhyGwxP0uTlKP_p-TE4OXyjqE3e3sH1a6kuks51dAP86FH2UdsSYf4PuzE3cPqy0iB1dCQAN6oOt-ARJwXySlMnO4nlAARAxnf6BrWAOguzqVepceClmQ_Kqeuc4Elb7aRoQ Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 11f2577a46c641ff9ad677651905fc84 Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1513729229 Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11f2577a46c641ff9ad677651905fc84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_11f2577a46c641ff9ad677651905fc84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/11f2577a46c641ff9ad677651905fc84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11f2577a46c641ff9ad677651905fc84"}]}] Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1513729229 Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 11f2577a46c641ff9ad677651905fc84 Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1513729229 Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ImagesDeleteNegativeTestJSON-1513729229-project Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: e4e0519da75f4fc78af6416ecd6b4edc Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1513729229-project Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: exception: Image not found. Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'fdb641b8-9c51-4bd2-9c55-b9f10b951baj'} Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fdb641b8-9c51-4bd2-9c55-b9f10b951baj to delete Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fdb641b8-9c51-4bd2-9c55-b9f10b951baj could not be found. Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:06.263153 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cf273a0b-7fd2-4857-b22c-e0e82ee46051 tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] Returning 404 to user: Image not found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:06.267179 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cf273a0b-7fd2-4857-b22c-e0e82ee46051 tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] 10.222.0.30 "DELETE /compute/v2.1/images/fdb641b8-9c51-4bd2-9c55-b9f10b951baj" status: 404 len: 62 microversion: 2.1 time: 0.041281 Oct 04 21:17:06.271823 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1301/2694] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:06 2022] DELETE /compute/v2.1/images/fdb641b8-9c51-4bd2-9c55-b9f10b951baj => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:17:06.275859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5597250a-0fb9-4fbd-bf23-f785f66c13cd tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] Calling method '.version_select at 0x7f579457d9d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:06.306923 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-5597250a-0fb9-4fbd-bf23-f785f66c13cd tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] HTTP exception thrown: Image not found. Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5597250a-0fb9-4fbd-bf23-f785f66c13cd tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] Request method failure captured: Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/images/c1f5fe6d-4877-4806-a886-af4d6820d9a71 HTTP/1.1 Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKLR9n3MHMP8oHhLe-_A6WT64oB7-Dr6tYu6m4vsMXvOhyGwxP0uTlKP_p-TE4OXyjqE3e3sH1a6kuks51dAP86FH2UdsSYf4PuzE3cPqy0iB1dCQAN6oOt-ARJwXySlMnO4nlAARAxnf6BrWAOguzqVepceClmQ_Kqeuc4Elb7aRoQ Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 11f2577a46c641ff9ad677651905fc84 Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1513729229 Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11f2577a46c641ff9ad677651905fc84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_11f2577a46c641ff9ad677651905fc84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/11f2577a46c641ff9ad677651905fc84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11f2577a46c641ff9ad677651905fc84"}]}] Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1513729229 Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 11f2577a46c641ff9ad677651905fc84 Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1513729229 Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesDeleteNegativeTestJSON-1513729229-project Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: e4e0519da75f4fc78af6416ecd6b4edc Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1513729229-project Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: exception: Image not found. Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'c1f5fe6d-4877-4806-a886-af4d6820d9a71'} Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c1f5fe6d-4877-4806-a886-af4d6820d9a71 to delete Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c1f5fe6d-4877-4806-a886-af4d6820d9a71 could not be found. Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:06.310142 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:17:06.314111 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.317181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5597250a-0fb9-4fbd-bf23-f785f66c13cd tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] Returning 404 to user: Image not found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:06.318864 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5597250a-0fb9-4fbd-bf23-f785f66c13cd tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] 10.222.0.30 "DELETE /compute/v2.1/images/c1f5fe6d-4877-4806-a886-af4d6820d9a71" status: 404 len: 62 microversion: 2.1 time: 0.047087 Oct 04 21:17:06.321474 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1394/2695] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:17:06 2022] DELETE /compute/v2.1/images/c1f5fe6d-4877-4806-a886-af4d6820d9a71 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:17:06.332783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-85bde2d8-9e75-438a-9e6a-21cf25d18732 tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] Calling method '.version_select at 0x7f57943b54c0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:06.358442 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-85bde2d8-9e75-438a-9e6a-21cf25d18732 tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] HTTP exception thrown: Image not found. Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-85bde2d8-9e75-438a-9e6a-21cf25d18732 tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] Request method failure captured: Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/images/tempest-invalid-1465193644 HTTP/1.1 Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKLR9n3MHMP8oHhLe-_A6WT64oB7-Dr6tYu6m4vsMXvOhyGwxP0uTlKP_p-TE4OXyjqE3e3sH1a6kuks51dAP86FH2UdsSYf4PuzE3cPqy0iB1dCQAN6oOt-ARJwXySlMnO4nlAARAxnf6BrWAOguzqVepceClmQ_Kqeuc4Elb7aRoQ Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 11f2577a46c641ff9ad677651905fc84 Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1513729229 Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11f2577a46c641ff9ad677651905fc84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_11f2577a46c641ff9ad677651905fc84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/11f2577a46c641ff9ad677651905fc84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11f2577a46c641ff9ad677651905fc84"}]}] Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1513729229 Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 11f2577a46c641ff9ad677651905fc84 Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1513729229 Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ImagesDeleteNegativeTestJSON-1513729229-project Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: e4e0519da75f4fc78af6416ecd6b4edc Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1513729229-project Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: exception: Image not found. Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'tempest-invalid-1465193644'} Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1465193644 to delete Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1465193644 could not be found. Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.360564 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:17:06.364486 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.368712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-85bde2d8-9e75-438a-9e6a-21cf25d18732 tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] Returning 404 to user: Image not found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:06.371152 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-85bde2d8-9e75-438a-9e6a-21cf25d18732 tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] 10.222.0.30 "DELETE /compute/v2.1/images/tempest-invalid-1465193644" status: 404 len: 62 microversion: 2.1 time: 0.042851 Oct 04 21:17:06.378884 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1302/2696] 10.222.0.30 () {58 vars in 1206 bytes} [Tue Oct 4 21:17:06 2022] DELETE /compute/v2.1/images/tempest-invalid-1465193644 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:17:06.383676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2aa86c25-3bbb-4170-9a04-069ee13f740b tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] Calling method '.version_select at 0x7f578bf07ca0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:06.422285 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-2aa86c25-3bbb-4170-9a04-069ee13f740b tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] HTTP exception thrown: Image not found. Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2aa86c25-3bbb-4170-9a04-069ee13f740b tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] Request method failure captured: Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/images/0a9c7ea1-34fc-4961-a5c1-8c728abaf7d8 HTTP/1.1 Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKLR9n3MHMP8oHhLe-_A6WT64oB7-Dr6tYu6m4vsMXvOhyGwxP0uTlKP_p-TE4OXyjqE3e3sH1a6kuks51dAP86FH2UdsSYf4PuzE3cPqy0iB1dCQAN6oOt-ARJwXySlMnO4nlAARAxnf6BrWAOguzqVepceClmQ_Kqeuc4Elb7aRoQ Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 11f2577a46c641ff9ad677651905fc84 Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1513729229 Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11f2577a46c641ff9ad677651905fc84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_11f2577a46c641ff9ad677651905fc84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/11f2577a46c641ff9ad677651905fc84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11f2577a46c641ff9ad677651905fc84"}]}] Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1513729229 Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 11f2577a46c641ff9ad677651905fc84 Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1513729229 Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesDeleteNegativeTestJSON-1513729229-project Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: e4e0519da75f4fc78af6416ecd6b4edc Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1513729229-project Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: exception: Image not found. Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '0a9c7ea1-34fc-4961-a5c1-8c728abaf7d8'} Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0a9c7ea1-34fc-4961-a5c1-8c728abaf7d8 to delete Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0a9c7ea1-34fc-4961-a5c1-8c728abaf7d8 could not be found. Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:06.432107 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2aa86c25-3bbb-4170-9a04-069ee13f740b tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] Returning 404 to user: Image not found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2aa86c25-3bbb-4170-9a04-069ee13f740b tempest-ImagesDeleteNegativeTestJSON-1513729229 tempest-ImagesDeleteNegativeTestJSON-1513729229-project] 10.222.0.30 "DELETE /compute/v2.1/images/0a9c7ea1-34fc-4961-a5c1-8c728abaf7d8" status: 404 len: 62 microversion: 2.1 time: 0.057392 Oct 04 21:17:06.442867 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1395/2697] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:06 2022] DELETE /compute/v2.1/images/0a9c7ea1-34fc-4961-a5c1-8c728abaf7d8 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:17:14.246974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=15 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:14.248637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:14.256902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fa94e13f-0ac9-4bde-97ef-9734a8151757 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57908f09d0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:14.326461 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fa94e13f-0ac9-4bde-97ef-9734a8151757 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/53005761-2cf9-4d5e-b84c-599c173bd699" status: 200 len: 661 microversion: 2.1 time: 0.080195 Oct 04 21:17:14.327435 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1303/2698] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:17:14 2022] GET /compute/v2.1/images/53005761-2cf9-4d5e-b84c-599c173bd699 => generated 661 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:14.346376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a682bafa-1783-4a3a-9956-555a4177620b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57902df820>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:14.445467 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a682bafa-1783-4a3a-9956-555a4177620b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/53005761-2cf9-4d5e-b84c-599c173bd699" status: 200 len: 661 microversion: 2.1 time: 0.107147 Oct 04 21:17:14.456049 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1396/2699] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:17:14 2022] GET /compute/v2.1/images/53005761-2cf9-4d5e-b84c-599c173bd699 => generated 661 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:16.777726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c572f656-119f-4081-b8c1-815495e09107 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57907c99d0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:16.867022 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c572f656-119f-4081-b8c1-815495e09107 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4f26fbcc-aeb2-4ce6-a000-f1e17969b520" status: 200 len: 662 microversion: 2.1 time: 0.094478 Oct 04 21:17:16.867612 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1304/2700] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:17:16 2022] GET /compute/v2.1/images/4f26fbcc-aeb2-4ce6-a000-f1e17969b520 => generated 662 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:16.882390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-575f8f71-9557-435c-b3d8-319f563a8431 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578bf07af0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:16.889856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:16.897034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:16.981376 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-575f8f71-9557-435c-b3d8-319f563a8431 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4f26fbcc-aeb2-4ce6-a000-f1e17969b520" status: 200 len: 662 microversion: 2.1 time: 0.103692 Oct 04 21:17:16.982307 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1397/2701] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:17:16 2022] GET /compute/v2.1/images/4f26fbcc-aeb2-4ce6-a000-f1e17969b520 => generated 662 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:17.207837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a9c5b957-1bb6-4e65-ab98-0e0185fbf310 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f3dd34c-0ba6-4b5e-b410-780b0a16efc7"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:17.217469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a9c5b957-1bb6-4e65-ab98-0e0185fbf310 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:17.236876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9c5b957-1bb6-4e65-ab98-0e0185fbf310 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:17.237328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9c5b957-1bb6-4e65-ab98-0e0185fbf310 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:17.241818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9c5b957-1bb6-4e65-ab98-0e0185fbf310 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:17.242591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9c5b957-1bb6-4e65-ab98-0e0185fbf310 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:17.247228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9c5b957-1bb6-4e65-ab98-0e0185fbf310 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:17.251668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9c5b957-1bb6-4e65-ab98-0e0185fbf310 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:18.243689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ffa9d9c2-46da-49db-8fe3-ddbc1735b2e6 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:18.244228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ffa9d9c2-46da-49db-8fe3-ddbc1735b2e6 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:18.254185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffa9d9c2-46da-49db-8fe3-ddbc1735b2e6 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:18.266035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffa9d9c2-46da-49db-8fe3-ddbc1735b2e6 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:18.266702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffa9d9c2-46da-49db-8fe3-ddbc1735b2e6 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:18.267695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffa9d9c2-46da-49db-8fe3-ddbc1735b2e6 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:18.268169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffa9d9c2-46da-49db-8fe3-ddbc1735b2e6 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:18.268595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffa9d9c2-46da-49db-8fe3-ddbc1735b2e6 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:18.305939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ffa9d9c2-46da-49db-8fe3-ddbc1735b2e6 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:17:18.313277 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a9c5b957-1bb6-4e65-ab98-0e0185fbf310 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "POST /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.116199 Oct 04 21:17:18.322056 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1305/2702] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 21:17:17 2022] POST /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-volume_attachments => generated 194 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:18.797317 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ffa9d9c2-46da-49db-8fe3-ddbc1735b2e6 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 204 len: 0 microversion: 2.1 time: 0.559792 Oct 04 21:17:18.798246 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1398/2703] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:17:18 2022] DELETE /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:17:18.813287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-66ae0baa-9797-4897-a579-92e38280907a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:18.814635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-66ae0baa-9797-4897-a579-92e38280907a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:18.845720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66ae0baa-9797-4897-a579-92e38280907a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:18.852773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66ae0baa-9797-4897-a579-92e38280907a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:18.854356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66ae0baa-9797-4897-a579-92e38280907a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:18.856850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66ae0baa-9797-4897-a579-92e38280907a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:18.857620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66ae0baa-9797-4897-a579-92e38280907a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:18.860211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66ae0baa-9797-4897-a579-92e38280907a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:19.049777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-528c3182-a497-4319-8f70-60a3004affe8 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578bf078b0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:19.134398 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-528c3182-a497-4319-8f70-60a3004affe8 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/a2ed38a8-233f-4109-bda3-ec7e6a668bfb" status: 200 len: 662 microversion: 2.1 time: 0.079223 Oct 04 21:17:19.134398 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1399/2704] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:17:19 2022] GET /compute/v2.1/images/a2ed38a8-233f-4109-bda3-ec7e6a668bfb => generated 662 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:19.137146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-30bed8ca-c949-44f9-b9ef-ebd71c7c1446 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57945f2b80>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:19.246487 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-30bed8ca-c949-44f9-b9ef-ebd71c7c1446 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/a2ed38a8-233f-4109-bda3-ec7e6a668bfb" status: 200 len: 662 microversion: 2.1 time: 0.114118 Oct 04 21:17:19.247173 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1400/2705] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:17:19 2022] GET /compute/v2.1/images/a2ed38a8-233f-4109-bda3-ec7e6a668bfb => generated 662 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:19.276713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-66ae0baa-9797-4897-a579-92e38280907a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d45dc825004ad4916d457f34eb0559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be18e35977441e8abe699f77e2b74c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:19.287626 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-66ae0baa-9797-4897-a579-92e38280907a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 200 len: 1665 microversion: 2.1 time: 0.483779 Oct 04 21:17:19.288821 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1306/2706] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:18 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 1665 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:19.343058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6627ed19-739a-4934-9c64-e0d2b980075a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1049361858", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:19.439621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-6627ed19-739a-4934-9c64-e0d2b980075a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:17:20.067985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6627ed19-739a-4934-9c64-e0d2b980075a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:17:20.069138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6627ed19-739a-4934-9c64-e0d2b980075a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:17:20.069690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6627ed19-739a-4934-9c64-e0d2b980075a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:17:20.070111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6627ed19-739a-4934-9c64-e0d2b980075a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:17:20.070536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6627ed19-739a-4934-9c64-e0d2b980075a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:17:20.084533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6627ed19-739a-4934-9c64-e0d2b980075a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:20.085197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6627ed19-739a-4934-9c64-e0d2b980075a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:20.091704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6627ed19-739a-4934-9c64-e0d2b980075a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:20.095500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6627ed19-739a-4934-9c64-e0d2b980075a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:20.095500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6627ed19-739a-4934-9c64-e0d2b980075a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:20.095500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6627ed19-739a-4934-9c64-e0d2b980075a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:20.140848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-6627ed19-739a-4934-9c64-e0d2b980075a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Getting quotas for project d842ce8242b749d6b95ede68c12185ff. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:17:20.147956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-6627ed19-739a-4934-9c64-e0d2b980075a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Getting quotas for user 9eac8933397749519514b18d174a2f0f and project d842ce8242b749d6b95ede68c12185ff. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:17:20.167753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6627ed19-739a-4934-9c64-e0d2b980075a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:17:20.171349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6627ed19-739a-4934-9c64-e0d2b980075a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 142c6da5-e828-4e2b-bfef-0cf163f0c97c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:17:20.318302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-28181d10-b53d-4d97-bb41-184178a8a21a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:20.318929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-28181d10-b53d-4d97-bb41-184178a8a21a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:20.331655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28181d10-b53d-4d97-bb41-184178a8a21a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:20.335875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28181d10-b53d-4d97-bb41-184178a8a21a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:20.336215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28181d10-b53d-4d97-bb41-184178a8a21a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:20.337271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28181d10-b53d-4d97-bb41-184178a8a21a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:20.339513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28181d10-b53d-4d97-bb41-184178a8a21a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:20.340076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28181d10-b53d-4d97-bb41-184178a8a21a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:20.386712 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6627ed19-739a-4934-9c64-e0d2b980075a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.048043 Oct 04 21:17:20.389518 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1401/2707] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:17:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:17:20.566794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4ccbc59e-3dcd-4099-ad2b-3190883a96e7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-661593404", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:20.675993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-4ccbc59e-3dcd-4099-ad2b-3190883a96e7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:17:21.588002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-28181d10-b53d-4d97-bb41-184178a8a21a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d45dc825004ad4916d457f34eb0559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be18e35977441e8abe699f77e2b74c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:21.609904 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-28181d10-b53d-4d97-bb41-184178a8a21a tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 200 len: 1665 microversion: 2.1 time: 1.283774 Oct 04 21:17:21.613084 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1307/2708] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:20 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 1665 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:21.834120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-4ccbc59e-3dcd-4099-ad2b-3190883a96e7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:17:21.834850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-4ccbc59e-3dcd-4099-ad2b-3190883a96e7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:17:21.835411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-4ccbc59e-3dcd-4099-ad2b-3190883a96e7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:17:21.836029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-4ccbc59e-3dcd-4099-ad2b-3190883a96e7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:17:21.836509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-4ccbc59e-3dcd-4099-ad2b-3190883a96e7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:17:21.857477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ccbc59e-3dcd-4099-ad2b-3190883a96e7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:21.859642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ccbc59e-3dcd-4099-ad2b-3190883a96e7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:21.859803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ccbc59e-3dcd-4099-ad2b-3190883a96e7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:21.861144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ccbc59e-3dcd-4099-ad2b-3190883a96e7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:21.862061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ccbc59e-3dcd-4099-ad2b-3190883a96e7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:21.863489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ccbc59e-3dcd-4099-ad2b-3190883a96e7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:21.920665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-4ccbc59e-3dcd-4099-ad2b-3190883a96e7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Getting quotas for project d842ce8242b749d6b95ede68c12185ff. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:17:21.934546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-4ccbc59e-3dcd-4099-ad2b-3190883a96e7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Getting quotas for user 9eac8933397749519514b18d174a2f0f and project d842ce8242b749d6b95ede68c12185ff. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:17:21.984683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4ccbc59e-3dcd-4099-ad2b-3190883a96e7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:17:21.990819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4ccbc59e-3dcd-4099-ad2b-3190883a96e7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:17:22.357327 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4ccbc59e-3dcd-4099-ad2b-3190883a96e7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.796243 Oct 04 21:17:22.360232 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1402/2709] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:17:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:17:22.378073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-700e1d59-a1e1-414e-90d0-c4fd9008b613 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:22.378073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-700e1d59-a1e1-414e-90d0-c4fd9008b613 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:22.662619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f2b7ba13-9f08-4f6d-ad2d-079e8d41ddb5 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:22.662619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f2b7ba13-9f08-4f6d-ad2d-079e8d41ddb5 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:22.690553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2b7ba13-9f08-4f6d-ad2d-079e8d41ddb5 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:22.695208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2b7ba13-9f08-4f6d-ad2d-079e8d41ddb5 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:22.695747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2b7ba13-9f08-4f6d-ad2d-079e8d41ddb5 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:22.699285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2b7ba13-9f08-4f6d-ad2d-079e8d41ddb5 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:22.699778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2b7ba13-9f08-4f6d-ad2d-079e8d41ddb5 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:22.700221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2b7ba13-9f08-4f6d-ad2d-079e8d41ddb5 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:23.257236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f2b7ba13-9f08-4f6d-ad2d-079e8d41ddb5 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d45dc825004ad4916d457f34eb0559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be18e35977441e8abe699f77e2b74c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:23.264558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-700e1d59-a1e1-414e-90d0-c4fd9008b613 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:23.271145 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f2b7ba13-9f08-4f6d-ad2d-079e8d41ddb5 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 200 len: 1597 microversion: 2.1 time: 0.619429 Oct 04 21:17:23.274371 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-700e1d59-a1e1-414e-90d0-c4fd9008b613 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1217 microversion: 2.1 time: 0.901308 Oct 04 21:17:23.274371 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1308/2710] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:22 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1217 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:17:23.290069 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1403/2711] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:22 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 1597 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:24.130522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-dc4415c6-cbd0-43e6-8c52-3a7168104360 req-799e7cc6-f530-426b-9d1c-b2739e855f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c94d29d0-adc3-4d49-bf41-31e631622656", "name": "network-vif-deleted", "tag": "a89fa5c2-db37-4da6-9d30-28a28cd733d2"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:24.153176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-dc4415c6-cbd0-43e6-8c52-3a7168104360 req-799e7cc6-f530-426b-9d1c-b2739e855f8d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:24.153876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-dc4415c6-cbd0-43e6-8c52-3a7168104360 req-799e7cc6-f530-426b-9d1c-b2739e855f8d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:24.158132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-dc4415c6-cbd0-43e6-8c52-3a7168104360 req-799e7cc6-f530-426b-9d1c-b2739e855f8d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:24.196656 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-dc4415c6-cbd0-43e6-8c52-3a7168104360 req-799e7cc6-f530-426b-9d1c-b2739e855f8d service nova] Creating event network-vif-deleted:a89fa5c2-db37-4da6-9d30-28a28cd733d2 for instance c94d29d0-adc3-4d49-bf41-31e631622656 on n-h2-860282-1 Oct 04 21:17:24.213241 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-dc4415c6-cbd0-43e6-8c52-3a7168104360 req-799e7cc6-f530-426b-9d1c-b2739e855f8d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087533 Oct 04 21:17:24.214465 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1309/2712] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:24.304974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-41b12ab7-e7df-469c-931d-85e0473b9641 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:24.306237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-41b12ab7-e7df-469c-931d-85e0473b9641 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:24.322595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41b12ab7-e7df-469c-931d-85e0473b9641 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:24.329399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41b12ab7-e7df-469c-931d-85e0473b9641 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:24.331268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41b12ab7-e7df-469c-931d-85e0473b9641 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:24.334827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41b12ab7-e7df-469c-931d-85e0473b9641 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:24.335631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41b12ab7-e7df-469c-931d-85e0473b9641 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:24.337912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8af21b74-b5bf-4f94-a046-28d30cadf130 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:24.338685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41b12ab7-e7df-469c-931d-85e0473b9641 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:24.339797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8af21b74-b5bf-4f94-a046-28d30cadf130 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:24.356161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8af21b74-b5bf-4f94-a046-28d30cadf130 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:24.360028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8af21b74-b5bf-4f94-a046-28d30cadf130 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:24.360028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8af21b74-b5bf-4f94-a046-28d30cadf130 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:24.360028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8af21b74-b5bf-4f94-a046-28d30cadf130 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:24.360028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8af21b74-b5bf-4f94-a046-28d30cadf130 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:24.363541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8af21b74-b5bf-4f94-a046-28d30cadf130 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:24.668335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-41b12ab7-e7df-469c-931d-85e0473b9641 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d45dc825004ad4916d457f34eb0559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be18e35977441e8abe699f77e2b74c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:24.694878 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-41b12ab7-e7df-469c-931d-85e0473b9641 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 200 len: 1310 microversion: 2.1 time: 0.379410 Oct 04 21:17:24.695944 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1404/2713] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:24 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 1310 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:24.700396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8af21b74-b5bf-4f94-a046-28d30cadf130 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:24.740821 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8af21b74-b5bf-4f94-a046-28d30cadf130 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1221 microversion: 2.1 time: 0.423230 Oct 04 21:17:24.753552 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1310/2714] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:24 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1221 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:25.726823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-68401e10-ec92-426a-85e1-91cddc40f408 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:25.727559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-68401e10-ec92-426a-85e1-91cddc40f408 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:25.746738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68401e10-ec92-426a-85e1-91cddc40f408 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:25.747487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68401e10-ec92-426a-85e1-91cddc40f408 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:25.748084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68401e10-ec92-426a-85e1-91cddc40f408 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:25.750361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68401e10-ec92-426a-85e1-91cddc40f408 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:25.750361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68401e10-ec92-426a-85e1-91cddc40f408 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:25.752839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68401e10-ec92-426a-85e1-91cddc40f408 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:25.777034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b58f9b82-ef15-443f-9315-211db1070a04 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:25.786590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b58f9b82-ef15-443f-9315-211db1070a04 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:25.794679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b58f9b82-ef15-443f-9315-211db1070a04 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:25.798775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b58f9b82-ef15-443f-9315-211db1070a04 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:25.800602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b58f9b82-ef15-443f-9315-211db1070a04 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:25.803202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b58f9b82-ef15-443f-9315-211db1070a04 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:25.810195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b58f9b82-ef15-443f-9315-211db1070a04 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:25.812404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b58f9b82-ef15-443f-9315-211db1070a04 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:25.885370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68401e10-ec92-426a-85e1-91cddc40f408 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:25.886285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68401e10-ec92-426a-85e1-91cddc40f408 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:25.886916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68401e10-ec92-426a-85e1-91cddc40f408 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:25.893841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-68401e10-ec92-426a-85e1-91cddc40f408 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lazy-loading 'fault' on Instance uuid c94d29d0-adc3-4d49-bf41-31e631622656 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:17:26.235902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-68401e10-ec92-426a-85e1-91cddc40f408 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d45dc825004ad4916d457f34eb0559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be18e35977441e8abe699f77e2b74c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:26.245331 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-68401e10-ec92-426a-85e1-91cddc40f408 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 200 len: 1315 microversion: 2.1 time: 0.530904 Oct 04 21:17:26.246021 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1405/2715] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:25 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:26.263797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f2f48ccb-628c-4b64-bade-7101a5af1c21 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1316150848", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "444a0134-956c-463c-be2b-766070da5bce"}, {"uuid": "9e22d7bc-d368-4b77-aaf0-d27bf7634efb"}, {"uuid": "444a0134-956c-463c-be2b-766070da5bce"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:26.340743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b58f9b82-ef15-443f-9315-211db1070a04 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:26.368573 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b58f9b82-ef15-443f-9315-211db1070a04 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1269 microversion: 2.1 time: 0.591027 Oct 04 21:17:26.370907 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1311/2716] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:25 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1269 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:26.437238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-f2f48ccb-628c-4b64-bade-7101a5af1c21 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] validate_networks() for [('444a0134-956c-463c-be2b-766070da5bce', None, None, None, None, None), ('9e22d7bc-d368-4b77-aaf0-d27bf7634efb', None, None, None, None, None), ('444a0134-956c-463c-be2b-766070da5bce', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:17:27.289830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a9ac6a49-4090-49a3-84bc-c1f90b6be89b tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:27.289830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a9ac6a49-4090-49a3-84bc-c1f90b6be89b tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] [instance: c94d29d0-adc3-4d49-bf41-31e631622656] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:27.297582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9ac6a49-4090-49a3-84bc-c1f90b6be89b tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:27.298402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9ac6a49-4090-49a3-84bc-c1f90b6be89b tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:27.301113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9ac6a49-4090-49a3-84bc-c1f90b6be89b tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:27.302689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9ac6a49-4090-49a3-84bc-c1f90b6be89b tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:27.306078 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9ac6a49-4090-49a3-84bc-c1f90b6be89b tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:27.306743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9ac6a49-4090-49a3-84bc-c1f90b6be89b tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-a9ac6a49-4090-49a3-84bc-c1f90b6be89b tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] HTTP exception thrown: Instance c94d29d0-adc3-4d49-bf41-31e631622656 could not be found. Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a9ac6a49-4090-49a3-84bc-c1f90b6be89b tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Request method failure captured: Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 HTTP/1.1 Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKKcavEObUrS9XVIKkDkd4QP0WxCNCrNNWRCdBbPKczVa81XsijrCkja6SgF9OJsyXLTWan8P78-lZANRyU6nPtYSGap2Zho8fXh5gNlwsa8x19a4k8KcZwTYSlZ5KE8zTuFsnaG3jm8qAmuWYMQYJvK_gtGiwZbLpV0bqANj8uO6vU Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 5be18e35977441e8abe699f77e2b74c5 Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestFqdnHostnames-587730454 Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5be18e35977441e8abe699f77e2b74c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5be18e35977441e8abe699f77e2b74c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5be18e35977441e8abe699f77e2b74c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5be18e35977441e8abe699f77e2b74c5"}]}] Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestFqdnHostnames-587730454 Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 5be18e35977441e8abe699f77e2b74c5 Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-587730454 Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestFqdnHostnames-587730454-project Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 51d45dc825004ad4916d457f34eb0559 Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestFqdnHostnames-587730454-project Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance c94d29d0-adc3-4d49-bf41-31e631622656 could not be found. Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'c94d29d0-adc3-4d49-bf41-31e631622656'} Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c94d29d0-adc3-4d49-bf41-31e631622656 could not be found. Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:17:27.359023 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:17:27.363802 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c94d29d0-adc3-4d49-bf41-31e631622656 could not be found. Oct 04 21:17:27.363802 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:27.363802 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:27.363802 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:27.363802 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:27.363802 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:27.363802 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:27.363802 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:27.363802 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:27.363802 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c94d29d0-adc3-4d49-bf41-31e631622656 could not be found. Oct 04 21:17:27.363802 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:27.363802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a9ac6a49-4090-49a3-84bc-c1f90b6be89b tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Returning 404 to user: Instance c94d29d0-adc3-4d49-bf41-31e631622656 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:27.363802 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a9ac6a49-4090-49a3-84bc-c1f90b6be89b tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656" status: 404 len: 111 microversion: 2.1 time: 0.070278 Oct 04 21:17:27.363802 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1312/2717] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:27 2022] GET /compute/v2.1/servers/c94d29d0-adc3-4d49-bf41-31e631622656 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:17:27.371862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-99509c94-bd4e-47eb-8e24-437c9dd22723 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] Calling method '.version_select at 0x7f57908f01f0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:27.551617 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-99509c94-bd4e-47eb-8e24-437c9dd22723 tempest-ServersTestFqdnHostnames-587730454 tempest-ServersTestFqdnHostnames-587730454-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-807112061" status: 202 len: 0 microversion: 2.1 time: 0.189399 Oct 04 21:17:27.552527 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1313/2718] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Oct 4 21:17:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-807112061 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:17:27.558313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6883fe52-956e-4ae9-ad1b-bdecab91c369 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:27.559098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6883fe52-956e-4ae9-ad1b-bdecab91c369 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:27.582185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6883fe52-956e-4ae9-ad1b-bdecab91c369 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:27.582185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6883fe52-956e-4ae9-ad1b-bdecab91c369 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:27.582185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6883fe52-956e-4ae9-ad1b-bdecab91c369 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:27.582185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6883fe52-956e-4ae9-ad1b-bdecab91c369 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:27.582185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6883fe52-956e-4ae9-ad1b-bdecab91c369 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:27.582185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6883fe52-956e-4ae9-ad1b-bdecab91c369 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:27.929835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6883fe52-956e-4ae9-ad1b-bdecab91c369 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:27.939399 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6883fe52-956e-4ae9-ad1b-bdecab91c369 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1275 microversion: 2.1 time: 0.385597 Oct 04 21:17:27.946994 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1314/2719] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:27 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1275 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:27.969605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fce5ebd3-6f47-48a1-9e37-b00d87516e5e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50200069-1862-4da1-96ff-3d771d5f66fb"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:27.974349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fce5ebd3-6f47-48a1-9e37-b00d87516e5e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:27.982058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fce5ebd3-6f47-48a1-9e37-b00d87516e5e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:27.982981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fce5ebd3-6f47-48a1-9e37-b00d87516e5e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:27.983686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fce5ebd3-6f47-48a1-9e37-b00d87516e5e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:27.984664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fce5ebd3-6f47-48a1-9e37-b00d87516e5e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:27.986005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fce5ebd3-6f47-48a1-9e37-b00d87516e5e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:27.986679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fce5ebd3-6f47-48a1-9e37-b00d87516e5e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:28.959845 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fce5ebd3-6f47-48a1-9e37-b00d87516e5e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "POST /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.998280 Oct 04 21:17:28.961615 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1315/2720] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 21:17:27 2022] POST /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments => generated 194 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:28.979273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bcf30948-03f6-417d-b66d-c7dfea134520 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:28.982749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bcf30948-03f6-417d-b66d-c7dfea134520 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:29.001742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bcf30948-03f6-417d-b66d-c7dfea134520 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:29.005589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bcf30948-03f6-417d-b66d-c7dfea134520 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:29.006951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bcf30948-03f6-417d-b66d-c7dfea134520 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:29.018531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bcf30948-03f6-417d-b66d-c7dfea134520 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:29.022977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bcf30948-03f6-417d-b66d-c7dfea134520 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:29.023661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bcf30948-03f6-417d-b66d-c7dfea134520 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:29.717773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bcf30948-03f6-417d-b66d-c7dfea134520 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:29.727889 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bcf30948-03f6-417d-b66d-c7dfea134520 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1275 microversion: 2.1 time: 0.758893 Oct 04 21:17:29.733788 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1316/2721] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:28 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1275 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:30.314658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f2f48ccb-628c-4b64-bade-7101a5af1c21 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:17:30.315220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f2f48ccb-628c-4b64-bade-7101a5af1c21 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:17:30.315556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f2f48ccb-628c-4b64-bade-7101a5af1c21 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:17:30.315976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f2f48ccb-628c-4b64-bade-7101a5af1c21 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:17:30.316438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f2f48ccb-628c-4b64-bade-7101a5af1c21 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:17:30.330199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2f48ccb-628c-4b64-bade-7101a5af1c21 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:30.331175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2f48ccb-628c-4b64-bade-7101a5af1c21 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:30.332548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2f48ccb-628c-4b64-bade-7101a5af1c21 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:30.339583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2f48ccb-628c-4b64-bade-7101a5af1c21 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:30.340421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2f48ccb-628c-4b64-bade-7101a5af1c21 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:30.345048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2f48ccb-628c-4b64-bade-7101a5af1c21 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:30.401146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-f2f48ccb-628c-4b64-bade-7101a5af1c21 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Getting quotas for project 74ce0d9253774aca92d405f137285093. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:17:30.413562 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-f2f48ccb-628c-4b64-bade-7101a5af1c21 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Getting quotas for user 3603c26fffba42e5805fd595f33d5c62 and project 74ce0d9253774aca92d405f137285093. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:17:30.445299 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f2f48ccb-628c-4b64-bade-7101a5af1c21 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:17:30.452583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f2f48ccb-628c-4b64-bade-7101a5af1c21 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:17:30.674310 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f2f48ccb-628c-4b64-bade-7101a5af1c21 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.423582 Oct 04 21:17:30.682612 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1406/2722] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:17:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 4432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:17:30.705577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e4520409-a38a-4e15-ac3a-4dde013cf582 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:30.715786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e4520409-a38a-4e15-ac3a-4dde013cf582 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:30.769929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0f13e7e0-90ee-469d-98cb-cacaea14e2f3 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:30.773286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0f13e7e0-90ee-469d-98cb-cacaea14e2f3 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:30.797558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f13e7e0-90ee-469d-98cb-cacaea14e2f3 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:30.803187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f13e7e0-90ee-469d-98cb-cacaea14e2f3 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:30.805108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f13e7e0-90ee-469d-98cb-cacaea14e2f3 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:30.810565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f13e7e0-90ee-469d-98cb-cacaea14e2f3 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:30.811203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f13e7e0-90ee-469d-98cb-cacaea14e2f3 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:30.813078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f13e7e0-90ee-469d-98cb-cacaea14e2f3 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:31.002363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e4520409-a38a-4e15-ac3a-4dde013cf582 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:31.033084 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e4520409-a38a-4e15-ac3a-4dde013cf582 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1213 microversion: 2.1 time: 0.319372 Oct 04 21:17:31.059971 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1317/2723] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:30 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1213 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:31.463003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0f13e7e0-90ee-469d-98cb-cacaea14e2f3 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:31.471765 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0f13e7e0-90ee-469d-98cb-cacaea14e2f3 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1317 microversion: 2.1 time: 0.718652 Oct 04 21:17:31.472922 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1407/2724] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:30 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1317 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:32.089826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b8129a34-fbf3-4e35-8126-d184f3daff52 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:32.091353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b8129a34-fbf3-4e35-8126-d184f3daff52 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:32.216715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b8129a34-fbf3-4e35-8126-d184f3daff52 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:32.239850 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b8129a34-fbf3-4e35-8126-d184f3daff52 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1213 microversion: 2.1 time: 0.145020 Oct 04 21:17:32.267221 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1318/2725] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:32 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1213 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:32.496689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1338880a-a64f-4ef4-9388-57a8df6ac893 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:32.498078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1338880a-a64f-4ef4-9388-57a8df6ac893 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:32.513968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1338880a-a64f-4ef4-9388-57a8df6ac893 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:32.514645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1338880a-a64f-4ef4-9388-57a8df6ac893 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:32.519412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1338880a-a64f-4ef4-9388-57a8df6ac893 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:32.525675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1338880a-a64f-4ef4-9388-57a8df6ac893 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:32.528163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1338880a-a64f-4ef4-9388-57a8df6ac893 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:32.528796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1338880a-a64f-4ef4-9388-57a8df6ac893 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:33.009281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1338880a-a64f-4ef4-9388-57a8df6ac893 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:33.018455 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1338880a-a64f-4ef4-9388-57a8df6ac893 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1317 microversion: 2.1 time: 0.525980 Oct 04 21:17:33.029472 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1408/2726] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:32 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1317 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:33.279574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-47c1c1eb-a421-400e-9da5-5bab698e8db8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:33.280904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-47c1c1eb-a421-400e-9da5-5bab698e8db8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:33.298058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47c1c1eb-a421-400e-9da5-5bab698e8db8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:33.299162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47c1c1eb-a421-400e-9da5-5bab698e8db8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:33.302327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47c1c1eb-a421-400e-9da5-5bab698e8db8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:33.303880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47c1c1eb-a421-400e-9da5-5bab698e8db8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:33.305015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47c1c1eb-a421-400e-9da5-5bab698e8db8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:33.307468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47c1c1eb-a421-400e-9da5-5bab698e8db8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:33.396932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-5543ccc5-5bf1-4855-98b0-989f38c366a5 req-e97856bf-4cd4-4add-a1f3-67dfb66a78e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc", "tag": "7b5a9c4b-694b-4147-95a1-a4e92206db0b"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:33.417560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5543ccc5-5bf1-4855-98b0-989f38c366a5 req-e97856bf-4cd4-4add-a1f3-67dfb66a78e0 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:33.425325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5543ccc5-5bf1-4855-98b0-989f38c366a5 req-e97856bf-4cd4-4add-a1f3-67dfb66a78e0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:33.428707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5543ccc5-5bf1-4855-98b0-989f38c366a5 req-e97856bf-4cd4-4add-a1f3-67dfb66a78e0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:33.459245 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-5543ccc5-5bf1-4855-98b0-989f38c366a5 req-e97856bf-4cd4-4add-a1f3-67dfb66a78e0 service nova] Creating event network-changed:7b5a9c4b-694b-4147-95a1-a4e92206db0b for instance 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc on n-h1-860282-1 Oct 04 21:17:33.475479 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-5543ccc5-5bf1-4855-98b0-989f38c366a5 req-e97856bf-4cd4-4add-a1f3-67dfb66a78e0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080636 Oct 04 21:17:33.477568 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1409/2727] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:33.491153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-8d244986-7d8d-4cae-970f-cbf5d55f6f24 req-a7380da5-61c4-4f82-b54c-b920e94be2ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "142c6da5-e828-4e2b-bfef-0cf163f0c97c", "tag": "35ab7e07-58e9-4ae2-bb54-f90bc14398d7"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:33.546647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8d244986-7d8d-4cae-970f-cbf5d55f6f24 req-a7380da5-61c4-4f82-b54c-b920e94be2ae service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:33.547239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8d244986-7d8d-4cae-970f-cbf5d55f6f24 req-a7380da5-61c4-4f82-b54c-b920e94be2ae service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:33.547725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8d244986-7d8d-4cae-970f-cbf5d55f6f24 req-a7380da5-61c4-4f82-b54c-b920e94be2ae service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:33.571542 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-8d244986-7d8d-4cae-970f-cbf5d55f6f24 req-a7380da5-61c4-4f82-b54c-b920e94be2ae service nova] Creating event network-changed:35ab7e07-58e9-4ae2-bb54-f90bc14398d7 for instance 142c6da5-e828-4e2b-bfef-0cf163f0c97c on n-h1-860282-1 Oct 04 21:17:33.590046 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-8d244986-7d8d-4cae-970f-cbf5d55f6f24 req-a7380da5-61c4-4f82-b54c-b920e94be2ae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110645 Oct 04 21:17:33.590943 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1410/2728] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:33.776552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-47c1c1eb-a421-400e-9da5-5bab698e8db8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:33.804802 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-47c1c1eb-a421-400e-9da5-5bab698e8db8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1209 microversion: 2.1 time: 0.533271 Oct 04 21:17:33.805484 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1319/2729] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:33 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1209 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:34.052800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0a654b6d-6527-45a2-a357-d37d136f2302 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:34.056047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0a654b6d-6527-45a2-a357-d37d136f2302 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:34.072706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a654b6d-6527-45a2-a357-d37d136f2302 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:34.073251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a654b6d-6527-45a2-a357-d37d136f2302 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:34.073992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a654b6d-6527-45a2-a357-d37d136f2302 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:34.074907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a654b6d-6527-45a2-a357-d37d136f2302 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:34.081043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a654b6d-6527-45a2-a357-d37d136f2302 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:34.082000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a654b6d-6527-45a2-a357-d37d136f2302 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:34.716282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0a654b6d-6527-45a2-a357-d37d136f2302 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:34.745390 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0a654b6d-6527-45a2-a357-d37d136f2302 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1317 microversion: 2.1 time: 0.696944 Oct 04 21:17:34.755686 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1411/2730] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:34 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1317 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:34.833396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5938d2ee-c877-499f-8140-979bb8177b46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:34.834128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5938d2ee-c877-499f-8140-979bb8177b46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:34.863359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5938d2ee-c877-499f-8140-979bb8177b46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:34.872370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5938d2ee-c877-499f-8140-979bb8177b46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:34.873050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5938d2ee-c877-499f-8140-979bb8177b46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:34.873888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5938d2ee-c877-499f-8140-979bb8177b46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:34.874372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5938d2ee-c877-499f-8140-979bb8177b46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:34.874808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5938d2ee-c877-499f-8140-979bb8177b46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:35.378168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5938d2ee-c877-499f-8140-979bb8177b46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:35.394065 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5938d2ee-c877-499f-8140-979bb8177b46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1273 microversion: 2.1 time: 0.563027 Oct 04 21:17:35.401599 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1320/2731] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:34 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1273 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:35.776947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5d81762b-49b9-4483-b728-e0e4b3ca3b28 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:35.778177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5d81762b-49b9-4483-b728-e0e4b3ca3b28 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:35.803852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d81762b-49b9-4483-b728-e0e4b3ca3b28 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:35.806576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d81762b-49b9-4483-b728-e0e4b3ca3b28 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:35.810088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d81762b-49b9-4483-b728-e0e4b3ca3b28 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:35.810088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d81762b-49b9-4483-b728-e0e4b3ca3b28 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:35.810088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d81762b-49b9-4483-b728-e0e4b3ca3b28 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:35.811096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d81762b-49b9-4483-b728-e0e4b3ca3b28 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:36.432817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7514fb1e-c2b4-4555-ac89-62f287888eed tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:36.434229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7514fb1e-c2b4-4555-ac89-62f287888eed tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:36.460761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7514fb1e-c2b4-4555-ac89-62f287888eed tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:36.462666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7514fb1e-c2b4-4555-ac89-62f287888eed tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:36.464921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7514fb1e-c2b4-4555-ac89-62f287888eed tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:36.467250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7514fb1e-c2b4-4555-ac89-62f287888eed tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:36.468602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7514fb1e-c2b4-4555-ac89-62f287888eed tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:36.470128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7514fb1e-c2b4-4555-ac89-62f287888eed tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:37.268998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7514fb1e-c2b4-4555-ac89-62f287888eed tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:37.294460 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7514fb1e-c2b4-4555-ac89-62f287888eed tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1271 microversion: 2.1 time: 0.867910 Oct 04 21:17:37.299444 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1321/2732] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:36 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1271 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:37.885945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5d81762b-49b9-4483-b728-e0e4b3ca3b28 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:37.898068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-80e4a046-d97a-45cd-87c0-281c0677bb6e tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "1f6f1d19-f2b0-4fea-95c0-df9d2fcf34d2"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:37.901897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-80e4a046-d97a-45cd-87c0-281c0677bb6e tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:37.902941 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5d81762b-49b9-4483-b728-e0e4b3ca3b28 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1317 microversion: 2.1 time: 2.129889 Oct 04 21:17:37.905560 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1412/2733] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:35 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1317 bytes in 2133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:37.940947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80e4a046-d97a-45cd-87c0-281c0677bb6e tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:37.942735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80e4a046-d97a-45cd-87c0-281c0677bb6e tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:37.943449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80e4a046-d97a-45cd-87c0-281c0677bb6e tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:37.945698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80e4a046-d97a-45cd-87c0-281c0677bb6e tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:37.950945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80e4a046-d97a-45cd-87c0-281c0677bb6e tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:37.955159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80e4a046-d97a-45cd-87c0-281c0677bb6e tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:38.335536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-abf29e63-cc12-4d46-b814-e93cf1f3f300 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:38.336227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-abf29e63-cc12-4d46-b814-e93cf1f3f300 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:38.348483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abf29e63-cc12-4d46-b814-e93cf1f3f300 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:38.349286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abf29e63-cc12-4d46-b814-e93cf1f3f300 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:38.351993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abf29e63-cc12-4d46-b814-e93cf1f3f300 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:38.352689 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-80e4a046-d97a-45cd-87c0-281c0677bb6e tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] HTTP exception thrown: Volume 1f6f1d19-f2b0-4fea-95c0-df9d2fcf34d2 could not be found. Oct 04 21:17:38.364992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abf29e63-cc12-4d46-b814-e93cf1f3f300 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:38.369394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abf29e63-cc12-4d46-b814-e93cf1f3f300 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:38.374902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abf29e63-cc12-4d46-b814-e93cf1f3f300 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-80e4a046-d97a-45cd-87c0-281c0677bb6e tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] Request method failure captured: Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: request: PUT /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-volume_attachments/5f3dd34c-0ba6-4b5e-b410-780b0a16efc7 HTTP/1.1 Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 74 Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKKYE3Mr8SBIW9zfvbv0r0bWHiaOclfQ_35au1q1LFWEaUzWD9yQiqH2XmfGapPiJMfrf7pLjFyrBmT094QG0OcYcU3mQx7YRWEqtPIl_-QrC4WgYwhq--0SvEpJ4NJdVOOvEgsh1q5oXfBNUJjyJGcACC83Xcub2xapU4D0IfDtiTk Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 36ef8c1595df44799f54892b243fe667 Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-VolumesAdminNegativeTest-1697638891 Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/36ef8c1595df44799f54892b243fe667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_36ef8c1595df44799f54892b243fe667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/36ef8c1595df44799f54892b243fe667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/36ef8c1595df44799f54892b243fe667"}]}] Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-VolumesAdminNegativeTest-1697638891 Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 36ef8c1595df44799f54892b243fe667 Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1697638891 Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-VolumesAdminNegativeTest-1697638891-project-admin Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: f46f502b213b4b169efd2809496a7323 Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-VolumesAdminNegativeTest-1697638891-project-admin Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: {"volumeAttachment": {"volumeId": "1f6f1d19-f2b0-4fea-95c0-df9d2fcf34d2"}} Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: exception: Volume 1f6f1d19-f2b0-4fea-95c0-df9d2fcf34d2 could not be found. Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'server_id': '3a399223-e902-4114-9172-784bf7c1e031', 'id': '5f3dd34c-0ba6-4b5e-b410-780b0a16efc7', 'body': {'volumeAttachment': {'volumeId': '1f6f1d19-f2b0-4fea-95c0-df9d2fcf34d2'}}} Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f6f1d19-f2b0-4fea-95c0-df9d2fcf34d2 could not be found. (HTTP 404) (Request-ID: req-0609ec60-982b-42a8-a5ad-f265a2808dde) Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:17:38.381958 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f6f1d19-f2b0-4fea-95c0-df9d2fcf34d2 could not be found. Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 1f6f1d19-f2b0-4fea-95c0-df9d2fcf34d2 could not be found. Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f6f1d19-f2b0-4fea-95c0-df9d2fcf34d2 could not be found. Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-80e4a046-d97a-45cd-87c0-281c0677bb6e tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] Returning 400 to user: Volume 1f6f1d19-f2b0-4fea-95c0-df9d2fcf34d2 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-80e4a046-d97a-45cd-87c0-281c0677bb6e tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] 10.222.0.30 "PUT /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-volume_attachments/5f3dd34c-0ba6-4b5e-b410-780b0a16efc7" status: 400 len: 107 microversion: 2.1 time: 1.081256 Oct 04 21:17:38.390993 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1322/2734] 10.222.0.30 () {60 vars in 1433 bytes} [Tue Oct 4 21:17:37 2022] PUT /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-volume_attachments/5f3dd34c-0ba6-4b5e-b410-780b0a16efc7 => generated 107 bytes in 1086 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:17:38.600175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f28c5900-c184-4507-a4ce-dd13d22c2d80 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:38.600743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f28c5900-c184-4507-a4ce-dd13d22c2d80 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:38.637994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-abf29e63-cc12-4d46-b814-e93cf1f3f300 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:38.638583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f28c5900-c184-4507-a4ce-dd13d22c2d80 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:38.639089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f28c5900-c184-4507-a4ce-dd13d22c2d80 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:38.650225 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-abf29e63-cc12-4d46-b814-e93cf1f3f300 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1271 microversion: 2.1 time: 0.321870 Oct 04 21:17:38.650877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f28c5900-c184-4507-a4ce-dd13d22c2d80 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:38.653202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f28c5900-c184-4507-a4ce-dd13d22c2d80 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:38.653967 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1413/2735] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:38 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1271 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:38.654897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f28c5900-c184-4507-a4ce-dd13d22c2d80 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:38.657708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f28c5900-c184-4507-a4ce-dd13d22c2d80 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:38.904971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-f28c5900-c184-4507-a4ce-dd13d22c2d80 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lazy-loading 'services' on Instance uuid 3a399223-e902-4114-9172-784bf7c1e031 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:17:38.932542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b32225d6-3030-40a9-8fc3-76fc6b3044e0 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:38.945074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b32225d6-3030-40a9-8fc3-76fc6b3044e0 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:38.945074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b32225d6-3030-40a9-8fc3-76fc6b3044e0 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:38.945074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b32225d6-3030-40a9-8fc3-76fc6b3044e0 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:38.945074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b32225d6-3030-40a9-8fc3-76fc6b3044e0 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:38.958347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b32225d6-3030-40a9-8fc3-76fc6b3044e0 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:38.962111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b32225d6-3030-40a9-8fc3-76fc6b3044e0 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:38.966979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b32225d6-3030-40a9-8fc3-76fc6b3044e0 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:39.179780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:39.289390 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f28c5900-c184-4507-a4ce-dd13d22c2d80 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-volume_attachments/5f3dd34c-0ba6-4b5e-b410-780b0a16efc7" status: 202 len: 0 microversion: 2.1 time: 0.695935 Oct 04 21:17:39.294986 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1323/2736] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 21:17:38 2022] DELETE /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-volume_attachments/5f3dd34c-0ba6-4b5e-b410-780b0a16efc7 => generated 0 bytes in 703 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:17:39.308538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f565e7c7-c639-492a-816e-f754b736db6e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:39.313918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f565e7c7-c639-492a-816e-f754b736db6e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:39.327650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f565e7c7-c639-492a-816e-f754b736db6e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:39.329808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f565e7c7-c639-492a-816e-f754b736db6e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:39.330736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f565e7c7-c639-492a-816e-f754b736db6e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:39.331977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f565e7c7-c639-492a-816e-f754b736db6e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:39.333843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f565e7c7-c639-492a-816e-f754b736db6e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:39.334586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f565e7c7-c639-492a-816e-f754b736db6e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:39.389466 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f565e7c7-c639-492a-816e-f754b736db6e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092219 Oct 04 21:17:39.396583 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1324/2737] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:17:39 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:39.695550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e842d85e-7200-4464-9474-dd0deb588420 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:39.697255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e842d85e-7200-4464-9474-dd0deb588420 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:39.724450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e842d85e-7200-4464-9474-dd0deb588420 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:39.725451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e842d85e-7200-4464-9474-dd0deb588420 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:39.728331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e842d85e-7200-4464-9474-dd0deb588420 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:39.731730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e842d85e-7200-4464-9474-dd0deb588420 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:39.733770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e842d85e-7200-4464-9474-dd0deb588420 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:39.741232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e842d85e-7200-4464-9474-dd0deb588420 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:40.356543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:40.437843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=18 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:40.636286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b32225d6-3030-40a9-8fc3-76fc6b3044e0 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:40.654014 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b32225d6-3030-40a9-8fc3-76fc6b3044e0 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1317 microversion: 2.1 time: 1.725946 Oct 04 21:17:40.659884 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1414/2738] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:38 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1317 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:17:40.679844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4b984e82-7e2a-4640-874f-2c68f07cd594 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:40.688716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4b984e82-7e2a-4640-874f-2c68f07cd594 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:40.704983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b984e82-7e2a-4640-874f-2c68f07cd594 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:40.707276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b984e82-7e2a-4640-874f-2c68f07cd594 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:40.714439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b984e82-7e2a-4640-874f-2c68f07cd594 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:40.715377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b984e82-7e2a-4640-874f-2c68f07cd594 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:40.716238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b984e82-7e2a-4640-874f-2c68f07cd594 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:40.716788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b984e82-7e2a-4640-874f-2c68f07cd594 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:40.763181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e842d85e-7200-4464-9474-dd0deb588420 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:40.774018 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e842d85e-7200-4464-9474-dd0deb588420 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1313 microversion: 2.1 time: 1.092074 Oct 04 21:17:40.789216 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1325/2739] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:39 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1313 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:40.792426 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4b984e82-7e2a-4640-874f-2c68f07cd594 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128212 Oct 04 21:17:40.800543 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1415/2740] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:17:40 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:41.684924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-69ce2dfe-150c-4d45-8e49-fc01cafcd6c6 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:41.685774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-69ce2dfe-150c-4d45-8e49-fc01cafcd6c6 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:41.709474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69ce2dfe-150c-4d45-8e49-fc01cafcd6c6 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:41.710193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69ce2dfe-150c-4d45-8e49-fc01cafcd6c6 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:41.712247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69ce2dfe-150c-4d45-8e49-fc01cafcd6c6 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:41.714099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69ce2dfe-150c-4d45-8e49-fc01cafcd6c6 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:41.715392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69ce2dfe-150c-4d45-8e49-fc01cafcd6c6 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:41.716316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69ce2dfe-150c-4d45-8e49-fc01cafcd6c6 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:41.811762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bee8ef4c-0e63-42e0-8bd9-943d97e6b1ec tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:41.815547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bee8ef4c-0e63-42e0-8bd9-943d97e6b1ec tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:41.870656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bee8ef4c-0e63-42e0-8bd9-943d97e6b1ec tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:41.874301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bee8ef4c-0e63-42e0-8bd9-943d97e6b1ec tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:41.877412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bee8ef4c-0e63-42e0-8bd9-943d97e6b1ec tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:41.878574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bee8ef4c-0e63-42e0-8bd9-943d97e6b1ec tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:41.881540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bee8ef4c-0e63-42e0-8bd9-943d97e6b1ec tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:41.884820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bee8ef4c-0e63-42e0-8bd9-943d97e6b1ec tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:42.223800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:43.351487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bee8ef4c-0e63-42e0-8bd9-943d97e6b1ec tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:43.369058 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bee8ef4c-0e63-42e0-8bd9-943d97e6b1ec tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1313 microversion: 2.1 time: 1.576083 Oct 04 21:17:43.393460 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1416/2741] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:41 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1313 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:17:43.406200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-69ce2dfe-150c-4d45-8e49-fc01cafcd6c6 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:43.414059 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-69ce2dfe-150c-4d45-8e49-fc01cafcd6c6 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1317 microversion: 2.1 time: 1.734692 Oct 04 21:17:43.415365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7327868d-480f-4ab0-a158-e15fcf3b6732 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:43.421029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7327868d-480f-4ab0-a158-e15fcf3b6732 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:43.434945 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1326/2742] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:41 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1317 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:43.446926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7327868d-480f-4ab0-a158-e15fcf3b6732 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:43.448310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-d86fc144-92ba-4316-b245-3684fb622692 req-b0e2aab8-8a4c-4119-866e-eaf52bc9badd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "142c6da5-e828-4e2b-bfef-0cf163f0c97c", "name": "network-vif-plugged", "status": "completed", "tag": "35ab7e07-58e9-4ae2-bb54-f90bc14398d7"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:43.449102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7327868d-480f-4ab0-a158-e15fcf3b6732 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:43.450447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7327868d-480f-4ab0-a158-e15fcf3b6732 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:43.453806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7327868d-480f-4ab0-a158-e15fcf3b6732 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:43.453806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7327868d-480f-4ab0-a158-e15fcf3b6732 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:43.453806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7327868d-480f-4ab0-a158-e15fcf3b6732 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:43.473338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d86fc144-92ba-4316-b245-3684fb622692 req-b0e2aab8-8a4c-4119-866e-eaf52bc9badd service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:43.475584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d86fc144-92ba-4316-b245-3684fb622692 req-b0e2aab8-8a4c-4119-866e-eaf52bc9badd service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:43.482560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d86fc144-92ba-4316-b245-3684fb622692 req-b0e2aab8-8a4c-4119-866e-eaf52bc9badd service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:43.504220 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-d86fc144-92ba-4316-b245-3684fb622692 req-b0e2aab8-8a4c-4119-866e-eaf52bc9badd service nova] Creating event network-vif-plugged:35ab7e07-58e9-4ae2-bb54-f90bc14398d7 for instance 142c6da5-e828-4e2b-bfef-0cf163f0c97c on n-h1-860282-1 Oct 04 21:17:43.521040 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-d86fc144-92ba-4316-b245-3684fb622692 req-b0e2aab8-8a4c-4119-866e-eaf52bc9badd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080433 Oct 04 21:17:43.522272 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1327/2743] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:43.574304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:43.591994 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7327868d-480f-4ab0-a158-e15fcf3b6732 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197250 Oct 04 21:17:43.597136 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1417/2744] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:17:43 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:44.396923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-da4a04ee-a486-4f84-b377-40e5522f0563 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:44.398124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-da4a04ee-a486-4f84-b377-40e5522f0563 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:44.410187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da4a04ee-a486-4f84-b377-40e5522f0563 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:44.419366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da4a04ee-a486-4f84-b377-40e5522f0563 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:44.430281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da4a04ee-a486-4f84-b377-40e5522f0563 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:44.430281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da4a04ee-a486-4f84-b377-40e5522f0563 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:44.430281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da4a04ee-a486-4f84-b377-40e5522f0563 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:44.430281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da4a04ee-a486-4f84-b377-40e5522f0563 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:44.450966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-268ef5ef-650b-4589-8a4d-2d8723cea158 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:44.452701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-268ef5ef-650b-4589-8a4d-2d8723cea158 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:44.472586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-268ef5ef-650b-4589-8a4d-2d8723cea158 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:44.475273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-268ef5ef-650b-4589-8a4d-2d8723cea158 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:44.476257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-268ef5ef-650b-4589-8a4d-2d8723cea158 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:44.478664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-268ef5ef-650b-4589-8a4d-2d8723cea158 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:44.481013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-268ef5ef-650b-4589-8a4d-2d8723cea158 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:44.481906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-268ef5ef-650b-4589-8a4d-2d8723cea158 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:45.089090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-da4a04ee-a486-4f84-b377-40e5522f0563 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:45.102012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-268ef5ef-650b-4589-8a4d-2d8723cea158 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:45.114962 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-268ef5ef-650b-4589-8a4d-2d8723cea158 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1317 microversion: 2.1 time: 0.676308 Oct 04 21:17:45.118797 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-da4a04ee-a486-4f84-b377-40e5522f0563 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1334 microversion: 2.1 time: 0.724116 Oct 04 21:17:45.118968 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1418/2745] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:44 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1317 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:17:45.120719 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1328/2746] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:44 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1334 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:17:45.129915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-88cb03c1-50e8-4aa3-b1f3-e0c549da321b tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:45.132138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-88cb03c1-50e8-4aa3-b1f3-e0c549da321b tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:45.141213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88cb03c1-50e8-4aa3-b1f3-e0c549da321b tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:45.142234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88cb03c1-50e8-4aa3-b1f3-e0c549da321b tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:45.142843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88cb03c1-50e8-4aa3-b1f3-e0c549da321b tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:45.143715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88cb03c1-50e8-4aa3-b1f3-e0c549da321b tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:45.147221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88cb03c1-50e8-4aa3-b1f3-e0c549da321b tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:45.148204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88cb03c1-50e8-4aa3-b1f3-e0c549da321b tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:45.211285 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-88cb03c1-50e8-4aa3-b1f3-e0c549da321b tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088443 Oct 04 21:17:45.211890 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1419/2747] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:17:45 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:45.567822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-93427b36-62ec-4c13-8851-13e005bf7357 req-4b94cdbc-bc0e-40f8-a7e0-b383a94385aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc", "name": "network-vif-plugged", "status": "completed", "tag": "7b5a9c4b-694b-4147-95a1-a4e92206db0b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:45.587985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-93427b36-62ec-4c13-8851-13e005bf7357 req-4b94cdbc-bc0e-40f8-a7e0-b383a94385aa service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:45.589501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-93427b36-62ec-4c13-8851-13e005bf7357 req-4b94cdbc-bc0e-40f8-a7e0-b383a94385aa service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:45.590392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-93427b36-62ec-4c13-8851-13e005bf7357 req-4b94cdbc-bc0e-40f8-a7e0-b383a94385aa service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:45.624035 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-93427b36-62ec-4c13-8851-13e005bf7357 req-4b94cdbc-bc0e-40f8-a7e0-b383a94385aa service nova] Creating event network-vif-plugged:7b5a9c4b-694b-4147-95a1-a4e92206db0b for instance 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc on n-h1-860282-1 Oct 04 21:17:45.636188 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-93427b36-62ec-4c13-8851-13e005bf7357 req-4b94cdbc-bc0e-40f8-a7e0-b383a94385aa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073779 Oct 04 21:17:45.640306 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1329/2748] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:17:46.161567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8307303e-de92-42c2-97f4-d4856f61a312 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:46.162202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8307303e-de92-42c2-97f4-d4856f61a312 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:46.167064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-900f7079-13ec-4e14-99b3-35454a78972c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:46.168532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-900f7079-13ec-4e14-99b3-35454a78972c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:46.182870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-900f7079-13ec-4e14-99b3-35454a78972c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:46.183719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-900f7079-13ec-4e14-99b3-35454a78972c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:46.184717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-900f7079-13ec-4e14-99b3-35454a78972c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:46.189219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-900f7079-13ec-4e14-99b3-35454a78972c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:46.189219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-900f7079-13ec-4e14-99b3-35454a78972c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:46.189219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-900f7079-13ec-4e14-99b3-35454a78972c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:46.203326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8307303e-de92-42c2-97f4-d4856f61a312 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:46.203848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8307303e-de92-42c2-97f4-d4856f61a312 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:46.204285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8307303e-de92-42c2-97f4-d4856f61a312 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:46.205012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8307303e-de92-42c2-97f4-d4856f61a312 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:46.214052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8307303e-de92-42c2-97f4-d4856f61a312 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:46.221796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8307303e-de92-42c2-97f4-d4856f61a312 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:46.852639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-900f7079-13ec-4e14-99b3-35454a78972c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:46.867568 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-900f7079-13ec-4e14-99b3-35454a78972c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1317 microversion: 2.1 time: 0.708490 Oct 04 21:17:46.869792 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1330/2749] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:46 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1317 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:46.882717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8307303e-de92-42c2-97f4-d4856f61a312 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:46.882973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9f3f86f2-dc1a-4365-ade0-d3e7b98392c3 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:46.885355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9f3f86f2-dc1a-4365-ade0-d3e7b98392c3 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:46.890781 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8307303e-de92-42c2-97f4-d4856f61a312 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1355 microversion: 2.1 time: 0.736120 Oct 04 21:17:46.891989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:46.896454 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1420/2750] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:46 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1355 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:46.906937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f3f86f2-dc1a-4365-ade0-d3e7b98392c3 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:46.907696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f3f86f2-dc1a-4365-ade0-d3e7b98392c3 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:46.908339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f3f86f2-dc1a-4365-ade0-d3e7b98392c3 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:46.912714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f3f86f2-dc1a-4365-ade0-d3e7b98392c3 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:46.918137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f3f86f2-dc1a-4365-ade0-d3e7b98392c3 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:46.918838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f3f86f2-dc1a-4365-ade0-d3e7b98392c3 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:47.019701 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9f3f86f2-dc1a-4365-ade0-d3e7b98392c3 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147712 Oct 04 21:17:47.021144 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1331/2751] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:17:46 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:47.904748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-58c1a0b6-50b0-42f3-b4e0-846c64627d08 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:47.907199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-58c1a0b6-50b0-42f3-b4e0-846c64627d08 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:47.925393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58c1a0b6-50b0-42f3-b4e0-846c64627d08 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:47.926990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a73199e3-c064-40e5-8bde-274fd39b3750 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:47.927693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a73199e3-c064-40e5-8bde-274fd39b3750 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:47.930320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58c1a0b6-50b0-42f3-b4e0-846c64627d08 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:47.931006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58c1a0b6-50b0-42f3-b4e0-846c64627d08 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:47.932273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58c1a0b6-50b0-42f3-b4e0-846c64627d08 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:47.933754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58c1a0b6-50b0-42f3-b4e0-846c64627d08 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:47.934204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58c1a0b6-50b0-42f3-b4e0-846c64627d08 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:47.942793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a73199e3-c064-40e5-8bde-274fd39b3750 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:47.944333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a73199e3-c064-40e5-8bde-274fd39b3750 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:47.945102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a73199e3-c064-40e5-8bde-274fd39b3750 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:47.946406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a73199e3-c064-40e5-8bde-274fd39b3750 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:47.948893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a73199e3-c064-40e5-8bde-274fd39b3750 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:47.950431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a73199e3-c064-40e5-8bde-274fd39b3750 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:48.738095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-58c1a0b6-50b0-42f3-b4e0-846c64627d08 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:48.751475 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-58c1a0b6-50b0-42f3-b4e0-846c64627d08 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1317 microversion: 2.1 time: 0.854714 Oct 04 21:17:48.769814 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1421/2752] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:47 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1317 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:48.769814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5bf993ea-9626-4952-bdff-6324a697e33d tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:48.771977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5bf993ea-9626-4952-bdff-6324a697e33d tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:48.791552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a73199e3-c064-40e5-8bde-274fd39b3750 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:48.800359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bf993ea-9626-4952-bdff-6324a697e33d tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:48.800867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bf993ea-9626-4952-bdff-6324a697e33d tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:48.801914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bf993ea-9626-4952-bdff-6324a697e33d tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:48.802640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bf993ea-9626-4952-bdff-6324a697e33d tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:48.803105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bf993ea-9626-4952-bdff-6324a697e33d tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:48.803543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bf993ea-9626-4952-bdff-6324a697e33d tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:48.805012 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a73199e3-c064-40e5-8bde-274fd39b3750 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1355 microversion: 2.1 time: 0.882688 Oct 04 21:17:48.809683 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1332/2753] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:47 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1355 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:17:48.904703 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5bf993ea-9626-4952-bdff-6324a697e33d tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.149283 Oct 04 21:17:48.904703 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1422/2754] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:17:48 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031/os-volume_attachments => generated 25 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:17:48.919318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-e2b87e64-97c3-4b90-a3d4-d1a794ec397c req-21b30c11-680e-4428-bc64-a7b1b14070b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "482e4179-2301-47d7-87dd-4deec4941c5e", "tag": "16ca2f59-07cc-44f9-b717-987aa1fe45be"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:48.933955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e2b87e64-97c3-4b90-a3d4-d1a794ec397c req-21b30c11-680e-4428-bc64-a7b1b14070b1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:48.935368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e2b87e64-97c3-4b90-a3d4-d1a794ec397c req-21b30c11-680e-4428-bc64-a7b1b14070b1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:48.935998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e2b87e64-97c3-4b90-a3d4-d1a794ec397c req-21b30c11-680e-4428-bc64-a7b1b14070b1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:48.950546 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-e2b87e64-97c3-4b90-a3d4-d1a794ec397c req-21b30c11-680e-4428-bc64-a7b1b14070b1 service nova] Creating event network-changed:16ca2f59-07cc-44f9-b717-987aa1fe45be for instance 482e4179-2301-47d7-87dd-4deec4941c5e on n-h2-860282-1 Oct 04 21:17:48.958217 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-e2b87e64-97c3-4b90-a3d4-d1a794ec397c req-21b30c11-680e-4428-bc64-a7b1b14070b1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042926 Oct 04 21:17:48.959127 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1333/2755] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:49.220947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6b83cc7a-477f-4675-a46a-b688927f82c7 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1683198521", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "7bf21f08-6329-49e2-9638-9e60de3b3b2e"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:49.277837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-87268e72-b8d6-4d5a-9309-5c0c93538975 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:49.284059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-87268e72-b8d6-4d5a-9309-5c0c93538975 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:49.297897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-87268e72-b8d6-4d5a-9309-5c0c93538975 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:49.302281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-87268e72-b8d6-4d5a-9309-5c0c93538975 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:49.303012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-87268e72-b8d6-4d5a-9309-5c0c93538975 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:49.304222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-87268e72-b8d6-4d5a-9309-5c0c93538975 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:49.305716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-87268e72-b8d6-4d5a-9309-5c0c93538975 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:49.307385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-87268e72-b8d6-4d5a-9309-5c0c93538975 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:49.367129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-6b83cc7a-477f-4675-a46a-b688927f82c7 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] validate_networks() for [('7bf21f08-6329-49e2-9638-9e60de3b3b2e', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:17:49.367307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-87268e72-b8d6-4d5a-9309-5c0c93538975 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lazy-loading 'flavor' on Instance uuid 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:17:49.967756 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-87268e72-b8d6-4d5a-9309-5c0c93538975 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "POST /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/action" status: 200 len: 32 microversion: 2.1 time: 0.694205 Oct 04 21:17:49.968478 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1334/2756] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:17:49 2022] POST /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/action => generated 32 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:17:49.987831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ff4f2782-8e1d-499b-8f49-4ab14238cf40 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:49.992305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ff4f2782-8e1d-499b-8f49-4ab14238cf40 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:50.014454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff4f2782-8e1d-499b-8f49-4ab14238cf40 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:50.018662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff4f2782-8e1d-499b-8f49-4ab14238cf40 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:50.020569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff4f2782-8e1d-499b-8f49-4ab14238cf40 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:50.033258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff4f2782-8e1d-499b-8f49-4ab14238cf40 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:50.034673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff4f2782-8e1d-499b-8f49-4ab14238cf40 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:50.035704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff4f2782-8e1d-499b-8f49-4ab14238cf40 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:50.776392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ff4f2782-8e1d-499b-8f49-4ab14238cf40 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:50.792946 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ff4f2782-8e1d-499b-8f49-4ab14238cf40 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1467 microversion: 2.1 time: 0.819222 Oct 04 21:17:50.796516 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1335/2757] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:49 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1467 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:50.803531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-88c32013-f9a6-4b6a-b621-aca0918a95d1 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:50.804608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-88c32013-f9a6-4b6a-b621-aca0918a95d1 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:50.813775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88c32013-f9a6-4b6a-b621-aca0918a95d1 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:50.814505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88c32013-f9a6-4b6a-b621-aca0918a95d1 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:50.815998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88c32013-f9a6-4b6a-b621-aca0918a95d1 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:50.819170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88c32013-f9a6-4b6a-b621-aca0918a95d1 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:50.823115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88c32013-f9a6-4b6a-b621-aca0918a95d1 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:50.831849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88c32013-f9a6-4b6a-b621-aca0918a95d1 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:50.979973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6b83cc7a-477f-4675-a46a-b688927f82c7 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:17:50.981049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6b83cc7a-477f-4675-a46a-b688927f82c7 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:17:50.981732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6b83cc7a-477f-4675-a46a-b688927f82c7 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:17:50.982327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6b83cc7a-477f-4675-a46a-b688927f82c7 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:17:50.983169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6b83cc7a-477f-4675-a46a-b688927f82c7 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:17:50.987793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:51.007391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b83cc7a-477f-4675-a46a-b688927f82c7 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:51.007904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b83cc7a-477f-4675-a46a-b688927f82c7 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:51.008361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b83cc7a-477f-4675-a46a-b688927f82c7 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:51.009097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b83cc7a-477f-4675-a46a-b688927f82c7 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:51.009612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b83cc7a-477f-4675-a46a-b688927f82c7 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:51.010059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b83cc7a-477f-4675-a46a-b688927f82c7 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:51.053734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-6b83cc7a-477f-4675-a46a-b688927f82c7 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Getting quotas for project 188383bbf07f4ad5b2d4d4ec4380fad7. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:17:51.060327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-6b83cc7a-477f-4675-a46a-b688927f82c7 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Getting quotas for user f6389e7e01d042678fed8cdf6d8b8625 and project 188383bbf07f4ad5b2d4d4ec4380fad7. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:17:51.123950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6b83cc7a-477f-4675-a46a-b688927f82c7 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:17:51.126805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6b83cc7a-477f-4675-a46a-b688927f82c7 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:17:51.268064 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6b83cc7a-477f-4675-a46a-b688927f82c7 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.051392 Oct 04 21:17:51.268743 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1423/2758] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:17:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:17:51.279589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8fa89297-5681-47ae-8217-c786800c056d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:51.280770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8fa89297-5681-47ae-8217-c786800c056d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:51.292408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8fa89297-5681-47ae-8217-c786800c056d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:51.293210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8fa89297-5681-47ae-8217-c786800c056d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:51.293880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8fa89297-5681-47ae-8217-c786800c056d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:51.294771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8fa89297-5681-47ae-8217-c786800c056d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:51.295415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8fa89297-5681-47ae-8217-c786800c056d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:51.296931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8fa89297-5681-47ae-8217-c786800c056d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:51.303140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-88c32013-f9a6-4b6a-b621-aca0918a95d1 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:51.319560 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-88c32013-f9a6-4b6a-b621-aca0918a95d1 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1355 microversion: 2.1 time: 0.520944 Oct 04 21:17:51.332895 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1336/2759] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:50 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1355 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:51.347783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-777ac059-c90c-4eac-8f7b-b36a19500634 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:51.352388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-777ac059-c90c-4eac-8f7b-b36a19500634 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 142c6da5-e828-4e2b-bfef-0cf163f0c97c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:51.370052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-777ac059-c90c-4eac-8f7b-b36a19500634 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:51.372468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-777ac059-c90c-4eac-8f7b-b36a19500634 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:51.373096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-777ac059-c90c-4eac-8f7b-b36a19500634 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:51.375732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-777ac059-c90c-4eac-8f7b-b36a19500634 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:51.376372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-777ac059-c90c-4eac-8f7b-b36a19500634 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:51.376980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-777ac059-c90c-4eac-8f7b-b36a19500634 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:51.863387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-777ac059-c90c-4eac-8f7b-b36a19500634 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:51.874126 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-777ac059-c90c-4eac-8f7b-b36a19500634 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c" status: 200 len: 1468 microversion: 2.1 time: 0.539741 Oct 04 21:17:51.897537 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1337/2760] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:51 2022] GET /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c => generated 1468 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:51.897537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eb2f3447-b675-4e43-880d-8ddc00ad158c tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:51.897537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eb2f3447-b675-4e43-880d-8ddc00ad158c tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:51.984936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8fa89297-5681-47ae-8217-c786800c056d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:51.996330 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8fa89297-5681-47ae-8217-c786800c056d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1737 microversion: 2.1 time: 0.726326 Oct 04 21:17:52.003819 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1424/2761] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:51 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1737 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:52.011865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-21613b4c-b6eb-4988-91e2-a74c08b2f80d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-389025074"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:52.016182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-21613b4c-b6eb-4988-91e2-a74c08b2f80d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 142c6da5-e828-4e2b-bfef-0cf163f0c97c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:52.028425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eb2f3447-b675-4e43-880d-8ddc00ad158c tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:52.034290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21613b4c-b6eb-4988-91e2-a74c08b2f80d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:52.034290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21613b4c-b6eb-4988-91e2-a74c08b2f80d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:52.034523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21613b4c-b6eb-4988-91e2-a74c08b2f80d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:52.035243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21613b4c-b6eb-4988-91e2-a74c08b2f80d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:52.035715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21613b4c-b6eb-4988-91e2-a74c08b2f80d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:52.036363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21613b4c-b6eb-4988-91e2-a74c08b2f80d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:52.037261 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eb2f3447-b675-4e43-880d-8ddc00ad158c tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1" status: 200 len: 1218 microversion: 2.1 time: 0.152152 Oct 04 21:17:52.045799 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1338/2762] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:51 2022] GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1 => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:52.345314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c0f4a906-d20a-48b3-91bc-061f9c648108 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:52.346643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c0f4a906-d20a-48b3-91bc-061f9c648108 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:52.365785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0f4a906-d20a-48b3-91bc-061f9c648108 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:52.366292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0f4a906-d20a-48b3-91bc-061f9c648108 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:52.370896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0f4a906-d20a-48b3-91bc-061f9c648108 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:52.372445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0f4a906-d20a-48b3-91bc-061f9c648108 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:52.372932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0f4a906-d20a-48b3-91bc-061f9c648108 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:52.374349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0f4a906-d20a-48b3-91bc-061f9c648108 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:52.556437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c0f4a906-d20a-48b3-91bc-061f9c648108 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:52.564937 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c0f4a906-d20a-48b3-91bc-061f9c648108 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1355 microversion: 2.1 time: 0.223826 Oct 04 21:17:52.565560 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1339/2763] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:52 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1355 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:52.641554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-7369b482-81d9-4e85-8576-3d9774b8ddba req-6ecde9ba-4fb5-4c77-a206-c0a42d56c3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "482e4179-2301-47d7-87dd-4deec4941c5e", "tag": "c945153b-4121-409e-8626-dde6cbf57cff"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:52.653250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7369b482-81d9-4e85-8576-3d9774b8ddba req-6ecde9ba-4fb5-4c77-a206-c0a42d56c3b2 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:52.653250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7369b482-81d9-4e85-8576-3d9774b8ddba req-6ecde9ba-4fb5-4c77-a206-c0a42d56c3b2 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:52.653644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7369b482-81d9-4e85-8576-3d9774b8ddba req-6ecde9ba-4fb5-4c77-a206-c0a42d56c3b2 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:52.670359 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-7369b482-81d9-4e85-8576-3d9774b8ddba req-6ecde9ba-4fb5-4c77-a206-c0a42d56c3b2 service nova] Creating event network-changed:c945153b-4121-409e-8626-dde6cbf57cff for instance 482e4179-2301-47d7-87dd-4deec4941c5e on n-h2-860282-1 Oct 04 21:17:52.676482 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-7369b482-81d9-4e85-8576-3d9774b8ddba req-6ecde9ba-4fb5-4c77-a206-c0a42d56c3b2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039119 Oct 04 21:17:52.680742 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1340/2764] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:17:53.029802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9e2b5069-6b54-493d-b54f-9c1492f2366e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:53.030529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9e2b5069-6b54-493d-b54f-9c1492f2366e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:53.040063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e2b5069-6b54-493d-b54f-9c1492f2366e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:53.040710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e2b5069-6b54-493d-b54f-9c1492f2366e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:53.041162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e2b5069-6b54-493d-b54f-9c1492f2366e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:53.042133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e2b5069-6b54-493d-b54f-9c1492f2366e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:53.042752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e2b5069-6b54-493d-b54f-9c1492f2366e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:53.043368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e2b5069-6b54-493d-b54f-9c1492f2366e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:53.088314 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-21613b4c-b6eb-4988-91e2-a74c08b2f80d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "POST /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c/action" status: 202 len: 0 microversion: 2.1 time: 1.079549 Oct 04 21:17:53.092549 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1425/2765] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:17:52 2022] POST /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c/action => generated 0 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 21:17:53.105567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-01f59164-063d-45ea-8359-b81a064200e8 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:53.112886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-01f59164-063d-45ea-8359-b81a064200e8 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:53.521650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-01f59164-063d-45ea-8359-b81a064200e8 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:53.536104 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-01f59164-063d-45ea-8359-b81a064200e8 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1" status: 200 len: 1218 microversion: 2.1 time: 0.439341 Oct 04 21:17:53.543358 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1426/2766] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:53 2022] GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1 => generated 1218 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:53.563720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b579371b-f9b6-4a39-83da-32403cf199e8 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57945f9280>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:53.680691 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b579371b-f9b6-4a39-83da-32403cf199e8 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.121874 Oct 04 21:17:53.681332 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1427/2767] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:17:53 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:53.697832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8be814e9-e5b7-4f9c-b7c7-c32da0d94849 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:53.698845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8be814e9-e5b7-4f9c-b7c7-c32da0d94849 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:53.711884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8be814e9-e5b7-4f9c-b7c7-c32da0d94849 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:53.712738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8be814e9-e5b7-4f9c-b7c7-c32da0d94849 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:53.713389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8be814e9-e5b7-4f9c-b7c7-c32da0d94849 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:53.714377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8be814e9-e5b7-4f9c-b7c7-c32da0d94849 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:53.715041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8be814e9-e5b7-4f9c-b7c7-c32da0d94849 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:53.715715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8be814e9-e5b7-4f9c-b7c7-c32da0d94849 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:53.875878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9e2b5069-6b54-493d-b54f-9c1492f2366e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:53.890349 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9e2b5069-6b54-493d-b54f-9c1492f2366e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1737 microversion: 2.1 time: 0.864130 Oct 04 21:17:53.906663 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1341/2768] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:53 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1737 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:17:53.954549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8be814e9-e5b7-4f9c-b7c7-c32da0d94849 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:53.954549 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8be814e9-e5b7-4f9c-b7c7-c32da0d94849 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1355 microversion: 2.1 time: 0.258161 Oct 04 21:17:53.954549 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1428/2769] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:53 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1355 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:54.562505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-4c7ad4dc-5e50-4c0d-98c4-6acbe13a44b2 req-e032cb73-a61b-4d07-b0a3-e2080f6f8a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "482e4179-2301-47d7-87dd-4deec4941c5e", "tag": "85c8e826-4719-4a5a-8acb-5453352e3a57"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:54.568956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c4a8cc28-a744-4a73-99f4-63847bfe8420 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:54.569608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c4a8cc28-a744-4a73-99f4-63847bfe8420 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:54.579964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4c7ad4dc-5e50-4c0d-98c4-6acbe13a44b2 req-e032cb73-a61b-4d07-b0a3-e2080f6f8a3b service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:54.580827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4c7ad4dc-5e50-4c0d-98c4-6acbe13a44b2 req-e032cb73-a61b-4d07-b0a3-e2080f6f8a3b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:54.580958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4c7ad4dc-5e50-4c0d-98c4-6acbe13a44b2 req-e032cb73-a61b-4d07-b0a3-e2080f6f8a3b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:54.585407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4a8cc28-a744-4a73-99f4-63847bfe8420 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:54.586008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4a8cc28-a744-4a73-99f4-63847bfe8420 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:54.586439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4a8cc28-a744-4a73-99f4-63847bfe8420 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:54.591126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:54.591509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4a8cc28-a744-4a73-99f4-63847bfe8420 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:54.592111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4a8cc28-a744-4a73-99f4-63847bfe8420 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:54.592696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4a8cc28-a744-4a73-99f4-63847bfe8420 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:54.598670 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-4c7ad4dc-5e50-4c0d-98c4-6acbe13a44b2 req-e032cb73-a61b-4d07-b0a3-e2080f6f8a3b service nova] Creating event network-changed:85c8e826-4719-4a5a-8acb-5453352e3a57 for instance 482e4179-2301-47d7-87dd-4deec4941c5e on n-h2-860282-1 Oct 04 21:17:54.622059 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-4c7ad4dc-5e50-4c0d-98c4-6acbe13a44b2 req-e032cb73-a61b-4d07-b0a3-e2080f6f8a3b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060217 Oct 04 21:17:54.622242 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1342/2770] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:54.700447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-88ade4e0-8fc9-4adc-839e-41a3368a063b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f579072e790>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:54.778692 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-88ade4e0-8fc9-4adc-839e-41a3368a063b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.083937 Oct 04 21:17:54.789510 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1343/2771] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:17:54 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:17:54.923435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9008beaf-be31-4174-a721-5a6f28c03302 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:54.924534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9008beaf-be31-4174-a721-5a6f28c03302 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:54.939038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9008beaf-be31-4174-a721-5a6f28c03302 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:54.945393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9008beaf-be31-4174-a721-5a6f28c03302 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:54.948810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9008beaf-be31-4174-a721-5a6f28c03302 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:54.950951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9008beaf-be31-4174-a721-5a6f28c03302 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:54.957348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c4a8cc28-a744-4a73-99f4-63847bfe8420 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:54.961944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9008beaf-be31-4174-a721-5a6f28c03302 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:54.966126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9008beaf-be31-4174-a721-5a6f28c03302 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:54.990739 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c4a8cc28-a744-4a73-99f4-63847bfe8420 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1" status: 200 len: 1270 microversion: 2.1 time: 0.414974 Oct 04 21:17:54.993758 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1429/2772] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:54 2022] GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1 => generated 1270 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:55.009069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5bca1006-a732-4090-ac91-746341bae776 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:55.012680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5bca1006-a732-4090-ac91-746341bae776 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:55.047166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bca1006-a732-4090-ac91-746341bae776 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:55.048258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bca1006-a732-4090-ac91-746341bae776 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:55.055260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bca1006-a732-4090-ac91-746341bae776 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:55.059535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bca1006-a732-4090-ac91-746341bae776 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:55.064419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bca1006-a732-4090-ac91-746341bae776 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:55.070567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bca1006-a732-4090-ac91-746341bae776 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:55.959428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9008beaf-be31-4174-a721-5a6f28c03302 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:55.976365 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9008beaf-be31-4174-a721-5a6f28c03302 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1737 microversion: 2.1 time: 1.061309 Oct 04 21:17:55.983762 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1344/2773] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:54 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1737 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:55.984047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5bca1006-a732-4090-ac91-746341bae776 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:55.991297 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5bca1006-a732-4090-ac91-746341bae776 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1355 microversion: 2.1 time: 0.995911 Oct 04 21:17:56.022674 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1430/2774] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:54 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1355 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:56.027955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b2d68ff3-6211-45cf-91b1-a7eeeba511c3 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57945f2af0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:56.091860 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b2d68ff3-6211-45cf-91b1-a7eeeba511c3 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.066838 Oct 04 21:17:56.105043 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1431/2775] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:17:56 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:56.111929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e86522a8-d56c-418e-8d30-5df6e84bfe0e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:56.112561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e86522a8-d56c-418e-8d30-5df6e84bfe0e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:56.136909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e86522a8-d56c-418e-8d30-5df6e84bfe0e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:56.137965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e86522a8-d56c-418e-8d30-5df6e84bfe0e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:56.138599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e86522a8-d56c-418e-8d30-5df6e84bfe0e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:56.139841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e86522a8-d56c-418e-8d30-5df6e84bfe0e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:56.150492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e86522a8-d56c-418e-8d30-5df6e84bfe0e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:56.151314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e86522a8-d56c-418e-8d30-5df6e84bfe0e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:56.289341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7f717bce-f3cf-4ce4-b0fc-c35a638998b1 tempest-FloatingIPsNegativeTestJSON-572597077 tempest-FloatingIPsNegativeTestJSON-572597077-project] Calling method '.version_select at 0x7f579072ee50>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:56.507210 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7f717bce-f3cf-4ce4-b0fc-c35a638998b1 tempest-FloatingIPsNegativeTestJSON-572597077 tempest-FloatingIPsNegativeTestJSON-572597077-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.527979 Oct 04 21:17:56.508411 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1345/2776] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Oct 4 21:17:55 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:17:56.526123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2d5aedf7-848b-4575-8cab-40485735a253 tempest-FloatingIPsNegativeTestJSON-572597077 tempest-FloatingIPsNegativeTestJSON-572597077-project] Action: 'create', calling method: .version_select at 0x7f5790604af0>, body: {"pool": "non_exist_pool"} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:56.561285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e86522a8-d56c-418e-8d30-5df6e84bfe0e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:56.604369 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e86522a8-d56c-418e-8d30-5df6e84bfe0e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1" status: 200 len: 1288 microversion: 2.1 time: 0.502778 Oct 04 21:17:56.605381 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1432/2777] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:56 2022] GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1 => generated 1288 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:56.726302 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-2d5aedf7-848b-4575-8cab-40485735a253 tempest-FloatingIPsNegativeTestJSON-572597077 tempest-FloatingIPsNegativeTestJSON-572597077-project] HTTP exception thrown: Floating IP pool not found. Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2d5aedf7-848b-4575-8cab-40485735a253 tempest-FloatingIPsNegativeTestJSON-572597077 tempest-FloatingIPsNegativeTestJSON-572597077-project] Request method failure captured: Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 26 Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKMDbqhosj1Cwqa3V44DIkX4GjuPPU7nsFxmA2ZsZ69shYNKkeIsKG0L82g2gtTGo0tZ8wo9yV8oF1bPihfgBpMNK-ubNeDhmB3wy8ARJfDGIoF7pDXYCgqSsBHIJU4NhzjOJ7-oWfftRH_X90OyMEDtIU-cgGxk7WF_ids69P7QW6g Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: e080e436c68f436fa70019d276110317 Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-572597077 Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e080e436c68f436fa70019d276110317"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e080e436c68f436fa70019d276110317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e080e436c68f436fa70019d276110317"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e080e436c68f436fa70019d276110317"}]}] Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-572597077 Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: e080e436c68f436fa70019d276110317 Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-572597077 Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-FloatingIPsNegativeTestJSON-572597077-project Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: ed6b581914654de0bc765bebfee8c92c Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-572597077-project Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: {"pool": "non_exist_pool"} Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: exception: Floating IP pool not found. Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:56.728287 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:56.733801 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 04 21:17:56.733801 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:17:56.733801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2d5aedf7-848b-4575-8cab-40485735a253 tempest-FloatingIPsNegativeTestJSON-572597077 tempest-FloatingIPsNegativeTestJSON-572597077-project] Returning 404 to user: Floating IP pool not found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:56.735407 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2d5aedf7-848b-4575-8cab-40485735a253 tempest-FloatingIPsNegativeTestJSON-572597077 tempest-FloatingIPsNegativeTestJSON-572597077-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.217125 Oct 04 21:17:56.736462 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1346/2778] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Oct 4 21:17:56 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:17:56.774450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e86f46e2-a427-4050-980a-fe2bb50ec16b tempest-FloatingIPsNegativeTestJSON-572597077 tempest-FloatingIPsNegativeTestJSON-572597077-project] Calling method '.version_select at 0x7f57944e7310>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:56.896950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG neutronclient.v2_0.client [None req-e86f46e2-a427-4050-980a-fe2bb50ec16b tempest-FloatingIPsNegativeTestJSON-572597077 tempest-FloatingIPsNegativeTestJSON-572597077-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5db44cf0-cd24-400c-9fba-9fa759c50cf2 could not be found", "detail": ""}} {{(pid=122758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:17:56.898445 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-e86f46e2-a427-4050-980a-fe2bb50ec16b tempest-FloatingIPsNegativeTestJSON-572597077 tempest-FloatingIPsNegativeTestJSON-572597077-project] HTTP exception thrown: Floating IP not found for ID 5db44cf0-cd24-400c-9fba-9fa759c50cf2 Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e86f46e2-a427-4050-980a-fe2bb50ec16b tempest-FloatingIPsNegativeTestJSON-572597077 tempest-FloatingIPsNegativeTestJSON-572597077-project] Request method failure captured: Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/os-floating-ips/5db44cf0-cd24-400c-9fba-9fa759c50cf2 HTTP/1.1 Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKMDbqhosj1Cwqa3V44DIkX4GjuPPU7nsFxmA2ZsZ69shYNKkeIsKG0L82g2gtTGo0tZ8wo9yV8oF1bPihfgBpMNK-ubNeDhmB3wy8ARJfDGIoF7pDXYCgqSsBHIJU4NhzjOJ7-oWfftRH_X90OyMEDtIU-cgGxk7WF_ids69P7QW6g Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: e080e436c68f436fa70019d276110317 Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-572597077 Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e080e436c68f436fa70019d276110317"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e080e436c68f436fa70019d276110317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e080e436c68f436fa70019d276110317"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e080e436c68f436fa70019d276110317"}]}] Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-572597077 Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: e080e436c68f436fa70019d276110317 Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-572597077 Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-FloatingIPsNegativeTestJSON-572597077-project Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: ed6b581914654de0bc765bebfee8c92c Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-572597077-project Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: exception: Floating IP not found for ID 5db44cf0-cd24-400c-9fba-9fa759c50cf2 Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '5db44cf0-cd24-400c-9fba-9fa759c50cf2'} Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5db44cf0-cd24-400c-9fba-9fa759c50cf2 could not be found Oct 04 21:17:56.903946 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e8cdb48-9395-4b80-b2d6-f0a4f1a86e74'] Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5db44cf0-cd24-400c-9fba-9fa759c50cf2. Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5db44cf0-cd24-400c-9fba-9fa759c50cf2 Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5db44cf0-cd24-400c-9fba-9fa759c50cf2 Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e86f46e2-a427-4050-980a-fe2bb50ec16b tempest-FloatingIPsNegativeTestJSON-572597077 tempest-FloatingIPsNegativeTestJSON-572597077-project] Returning 404 to user: Floating IP not found for ID 5db44cf0-cd24-400c-9fba-9fa759c50cf2 {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e86f46e2-a427-4050-980a-fe2bb50ec16b tempest-FloatingIPsNegativeTestJSON-572597077 tempest-FloatingIPsNegativeTestJSON-572597077-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/5db44cf0-cd24-400c-9fba-9fa759c50cf2" status: 404 len: 111 microversion: 2.1 time: 0.163383 Oct 04 21:17:56.920141 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1433/2779] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Oct 4 21:17:56 2022] DELETE /compute/v2.1/os-floating-ips/5db44cf0-cd24-400c-9fba-9fa759c50cf2 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:17:57.009496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-381fbb4c-c709-491b-a93c-53e7d1f289a9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:57.033221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d1fa040e-2e54-4422-9757-d17e4489ebab tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:57.045392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-381fbb4c-c709-491b-a93c-53e7d1f289a9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:57.054601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d1fa040e-2e54-4422-9757-d17e4489ebab tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:57.091913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-381fbb4c-c709-491b-a93c-53e7d1f289a9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:57.095307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1fa040e-2e54-4422-9757-d17e4489ebab tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:57.096637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-381fbb4c-c709-491b-a93c-53e7d1f289a9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:57.098630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-381fbb4c-c709-491b-a93c-53e7d1f289a9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:57.104919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-381fbb4c-c709-491b-a93c-53e7d1f289a9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:57.106324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1fa040e-2e54-4422-9757-d17e4489ebab tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:57.111317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-381fbb4c-c709-491b-a93c-53e7d1f289a9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:57.112438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1fa040e-2e54-4422-9757-d17e4489ebab tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:57.114025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-381fbb4c-c709-491b-a93c-53e7d1f289a9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:57.115726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1fa040e-2e54-4422-9757-d17e4489ebab tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:57.116767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1fa040e-2e54-4422-9757-d17e4489ebab tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:57.122389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1fa040e-2e54-4422-9757-d17e4489ebab tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:57.867515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-381fbb4c-c709-491b-a93c-53e7d1f289a9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:57.887937 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-381fbb4c-c709-491b-a93c-53e7d1f289a9 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1737 microversion: 2.1 time: 0.887531 Oct 04 21:17:57.913698 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1347/2780] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:56 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1737 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:57.918675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0dd1f2ef-edf7-4d47-83d4-b8d6cb61277a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57908ea700>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:57.921273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d1fa040e-2e54-4422-9757-d17e4489ebab tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:57.957387 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d1fa040e-2e54-4422-9757-d17e4489ebab tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1355 microversion: 2.1 time: 0.939965 Oct 04 21:17:57.958003 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1434/2781] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:57 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1355 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:17:57.991718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f3c140ff-eddc-4827-8a8a-79a11ccc2c8f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:58.003030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f3c140ff-eddc-4827-8a8a-79a11ccc2c8f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:58.028011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3c140ff-eddc-4827-8a8a-79a11ccc2c8f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:58.028011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3c140ff-eddc-4827-8a8a-79a11ccc2c8f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:58.028011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3c140ff-eddc-4827-8a8a-79a11ccc2c8f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:58.028011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3c140ff-eddc-4827-8a8a-79a11ccc2c8f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:58.028011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3c140ff-eddc-4827-8a8a-79a11ccc2c8f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:58.028011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3c140ff-eddc-4827-8a8a-79a11ccc2c8f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:58.052675 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0dd1f2ef-edf7-4d47-83d4-b8d6cb61277a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.137690 Oct 04 21:17:58.056432 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1348/2782] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:17:57 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:58.652873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f3c140ff-eddc-4827-8a8a-79a11ccc2c8f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:58.668363 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f3c140ff-eddc-4827-8a8a-79a11ccc2c8f tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1" status: 200 len: 1318 microversion: 2.1 time: 0.700154 Oct 04 21:17:58.669265 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1435/2783] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:57 2022] GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1 => generated 1318 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:58.925070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b3a91026-be32-4c3e-8198-a6c67b9191e7 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:58.925070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b3a91026-be32-4c3e-8198-a6c67b9191e7 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:58.943938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3a91026-be32-4c3e-8198-a6c67b9191e7 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:58.946460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3a91026-be32-4c3e-8198-a6c67b9191e7 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:58.947901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3a91026-be32-4c3e-8198-a6c67b9191e7 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:58.953702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3a91026-be32-4c3e-8198-a6c67b9191e7 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:58.955016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3a91026-be32-4c3e-8198-a6c67b9191e7 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:58.955222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3a91026-be32-4c3e-8198-a6c67b9191e7 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:58.983063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c3f2e82e-aeb9-45e8-ae35-4c8e7fabf983 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:58.983881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c3f2e82e-aeb9-45e8-ae35-4c8e7fabf983 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:59.000698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3f2e82e-aeb9-45e8-ae35-4c8e7fabf983 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:59.001222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3f2e82e-aeb9-45e8-ae35-4c8e7fabf983 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:59.002543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3f2e82e-aeb9-45e8-ae35-4c8e7fabf983 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:59.003492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3f2e82e-aeb9-45e8-ae35-4c8e7fabf983 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:59.004808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3f2e82e-aeb9-45e8-ae35-4c8e7fabf983 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:59.006427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3f2e82e-aeb9-45e8-ae35-4c8e7fabf983 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:00.274100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b3a91026-be32-4c3e-8198-a6c67b9191e7 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:00.309366 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b3a91026-be32-4c3e-8198-a6c67b9191e7 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1737 microversion: 2.1 time: 1.396959 Oct 04 21:18:00.335309 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1349/2784] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:58 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1737 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:00.356910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ef6949ab-2a02-4547-a82e-1772c72965e2 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790604dc0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:00.469814 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ef6949ab-2a02-4547-a82e-1772c72965e2 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.132710 Oct 04 21:18:00.470414 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1350/2785] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:00 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:00.496990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-27fde73b-6ed1-4e35-a1bb-2b0f72392a03 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:00.497596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-27fde73b-6ed1-4e35-a1bb-2b0f72392a03 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:00.556432 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27fde73b-6ed1-4e35-a1bb-2b0f72392a03 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:00.556948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27fde73b-6ed1-4e35-a1bb-2b0f72392a03 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:00.557402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27fde73b-6ed1-4e35-a1bb-2b0f72392a03 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:00.558404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27fde73b-6ed1-4e35-a1bb-2b0f72392a03 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:00.559274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27fde73b-6ed1-4e35-a1bb-2b0f72392a03 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:00.559860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27fde73b-6ed1-4e35-a1bb-2b0f72392a03 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:00.929685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c3f2e82e-aeb9-45e8-ae35-4c8e7fabf983 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:00.946653 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c3f2e82e-aeb9-45e8-ae35-4c8e7fabf983 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1355 microversion: 2.1 time: 1.963776 Oct 04 21:18:00.963745 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1436/2786] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:58 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1355 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:00.980746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-eb8372c8-df52-4f01-8849-dde21a7a4f36 req-7c7d3783-e294-4e6a-98ff-6dff9dc94c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2998012-afa9-4e41-a256-724e7dafffd1", "tag": "5d810375-1682-40cb-b5e9-507e068e95c9"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:01.005959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-eb8372c8-df52-4f01-8849-dde21a7a4f36 req-7c7d3783-e294-4e6a-98ff-6dff9dc94c04 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:01.005959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-eb8372c8-df52-4f01-8849-dde21a7a4f36 req-7c7d3783-e294-4e6a-98ff-6dff9dc94c04 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:01.005959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-eb8372c8-df52-4f01-8849-dde21a7a4f36 req-7c7d3783-e294-4e6a-98ff-6dff9dc94c04 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:01.032409 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-eb8372c8-df52-4f01-8849-dde21a7a4f36 req-7c7d3783-e294-4e6a-98ff-6dff9dc94c04 service nova] Creating event network-changed:5d810375-1682-40cb-b5e9-507e068e95c9 for instance d2998012-afa9-4e41-a256-724e7dafffd1 on n-h2-860282-1 Oct 04 21:18:01.041188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:01.050643 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-eb8372c8-df52-4f01-8849-dde21a7a4f36 req-7c7d3783-e294-4e6a-98ff-6dff9dc94c04 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085472 Oct 04 21:18:01.051911 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1437/2787] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:01.059235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-6c6e63d2-6075-4c42-a647-ce16ef5fe1fb req-8939d538-e665-44a4-9f30-b109053724a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "142c6da5-e828-4e2b-bfef-0cf163f0c97c", "name": "network-vif-plugged", "status": "completed", "tag": "35ab7e07-58e9-4ae2-bb54-f90bc14398d7"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:01.084632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6c6e63d2-6075-4c42-a647-ce16ef5fe1fb req-8939d538-e665-44a4-9f30-b109053724a5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:01.088997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6c6e63d2-6075-4c42-a647-ce16ef5fe1fb req-8939d538-e665-44a4-9f30-b109053724a5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:01.089680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6c6e63d2-6075-4c42-a647-ce16ef5fe1fb req-8939d538-e665-44a4-9f30-b109053724a5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:01.114681 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-6c6e63d2-6075-4c42-a647-ce16ef5fe1fb req-8939d538-e665-44a4-9f30-b109053724a5 service nova] Creating event network-vif-plugged:35ab7e07-58e9-4ae2-bb54-f90bc14398d7 for instance 142c6da5-e828-4e2b-bfef-0cf163f0c97c on n-h1-860282-1 Oct 04 21:18:01.131311 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-6c6e63d2-6075-4c42-a647-ce16ef5fe1fb req-8939d538-e665-44a4-9f30-b109053724a5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077024 Oct 04 21:18:01.132540 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1438/2788] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:01.352027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0bfc83c4-62a9-4e1a-8722-e269fa594347 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:01.352027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0bfc83c4-62a9-4e1a-8722-e269fa594347 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:01.355559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0bfc83c4-62a9-4e1a-8722-e269fa594347 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:01.356063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0bfc83c4-62a9-4e1a-8722-e269fa594347 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:01.356503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0bfc83c4-62a9-4e1a-8722-e269fa594347 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:01.357217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0bfc83c4-62a9-4e1a-8722-e269fa594347 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:01.357705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0bfc83c4-62a9-4e1a-8722-e269fa594347 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:01.363638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0bfc83c4-62a9-4e1a-8722-e269fa594347 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:01.456840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:02.033883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:02.683767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-27fde73b-6ed1-4e35-a1bb-2b0f72392a03 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:02.701834 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-27fde73b-6ed1-4e35-a1bb-2b0f72392a03 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1" status: 200 len: 1318 microversion: 2.1 time: 2.228878 Oct 04 21:18:02.723215 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1351/2789] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:00 2022] GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1 => generated 1318 bytes in 2252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:02.729451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b5470079-630c-4ac9-b5b4-113bbb5b9ba4 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57903a8430>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:02.865312 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b5470079-630c-4ac9-b5b4-113bbb5b9ba4 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.140276 Oct 04 21:18:02.877532 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1352/2790] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:02 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:02.889321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7daf1b68-9077-42f1-acc0-bc1ded7031f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:02.890330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7daf1b68-9077-42f1-acc0-bc1ded7031f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:02.903214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7daf1b68-9077-42f1-acc0-bc1ded7031f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:02.905849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7daf1b68-9077-42f1-acc0-bc1ded7031f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:02.906548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7daf1b68-9077-42f1-acc0-bc1ded7031f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:02.910620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7daf1b68-9077-42f1-acc0-bc1ded7031f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:02.911360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7daf1b68-9077-42f1-acc0-bc1ded7031f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:02.914220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7daf1b68-9077-42f1-acc0-bc1ded7031f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:03.527835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:03.815464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0bfc83c4-62a9-4e1a-8722-e269fa594347 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:03.837458 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0bfc83c4-62a9-4e1a-8722-e269fa594347 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1737 microversion: 2.1 time: 2.502266 Oct 04 21:18:03.841581 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1439/2791] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:01 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1737 bytes in 2508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:03.846956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-038cd086-0d50-430c-bf0a-d0952ffbd1ce tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:03.848530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-038cd086-0d50-430c-bf0a-d0952ffbd1ce tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:03.852006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7daf1b68-9077-42f1-acc0-bc1ded7031f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:03.857265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-038cd086-0d50-430c-bf0a-d0952ffbd1ce tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:03.861598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-038cd086-0d50-430c-bf0a-d0952ffbd1ce tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:03.861598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-038cd086-0d50-430c-bf0a-d0952ffbd1ce tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:03.861598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-038cd086-0d50-430c-bf0a-d0952ffbd1ce tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:03.861598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-038cd086-0d50-430c-bf0a-d0952ffbd1ce tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:03.861598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-038cd086-0d50-430c-bf0a-d0952ffbd1ce tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:03.864710 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7daf1b68-9077-42f1-acc0-bc1ded7031f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1355 microversion: 2.1 time: 0.985613 Oct 04 21:18:03.872179 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1353/2792] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:02 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1355 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:03.885930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d3b70769-fc2c-4e03-bd61-8a9b688b0964 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790035550>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:04.013818 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d3b70769-fc2c-4e03-bd61-8a9b688b0964 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.133139 Oct 04 21:18:04.017774 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1354/2793] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:03 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:04.339369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-038cd086-0d50-430c-bf0a-d0952ffbd1ce tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:04.357582 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-038cd086-0d50-430c-bf0a-d0952ffbd1ce tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1" status: 200 len: 1318 microversion: 2.1 time: 0.514560 Oct 04 21:18:04.373847 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1440/2794] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:03 2022] GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1 => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:04.865752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c316b0ae-1e38-44f6-a2a1-b4087efdca51 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:04.866380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c316b0ae-1e38-44f6-a2a1-b4087efdca51 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:04.883429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c316b0ae-1e38-44f6-a2a1-b4087efdca51 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:04.892884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c316b0ae-1e38-44f6-a2a1-b4087efdca51 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:04.892884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c316b0ae-1e38-44f6-a2a1-b4087efdca51 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:04.892884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c316b0ae-1e38-44f6-a2a1-b4087efdca51 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:04.893623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c316b0ae-1e38-44f6-a2a1-b4087efdca51 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:04.894220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c316b0ae-1e38-44f6-a2a1-b4087efdca51 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:04.894435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c8cd6c8d-f886-4bb6-84af-01246f72c436 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:04.896071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c8cd6c8d-f886-4bb6-84af-01246f72c436 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:04.908352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8cd6c8d-f886-4bb6-84af-01246f72c436 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:04.911677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8cd6c8d-f886-4bb6-84af-01246f72c436 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:04.914425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8cd6c8d-f886-4bb6-84af-01246f72c436 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:04.915613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8cd6c8d-f886-4bb6-84af-01246f72c436 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:04.917370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8cd6c8d-f886-4bb6-84af-01246f72c436 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:04.919816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8cd6c8d-f886-4bb6-84af-01246f72c436 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:05.498438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c316b0ae-1e38-44f6-a2a1-b4087efdca51 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:05.508704 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c316b0ae-1e38-44f6-a2a1-b4087efdca51 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1737 microversion: 2.1 time: 0.647361 Oct 04 21:18:05.513085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c8cd6c8d-f886-4bb6-84af-01246f72c436 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:05.518219 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1355/2795] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:04 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1737 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:05.523934 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c8cd6c8d-f886-4bb6-84af-01246f72c436 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1355 microversion: 2.1 time: 0.635432 Oct 04 21:18:05.527088 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1441/2796] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:04 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1355 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:05.541316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3ef2d7b3-d5a0-40f2-8650-b49a03edcfe9 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:05.542236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3ef2d7b3-d5a0-40f2-8650-b49a03edcfe9 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:05.559231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ef2d7b3-d5a0-40f2-8650-b49a03edcfe9 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:05.559925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ef2d7b3-d5a0-40f2-8650-b49a03edcfe9 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:05.560701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ef2d7b3-d5a0-40f2-8650-b49a03edcfe9 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:05.561625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ef2d7b3-d5a0-40f2-8650-b49a03edcfe9 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:05.562269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ef2d7b3-d5a0-40f2-8650-b49a03edcfe9 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:05.562613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-db6b390f-bdea-4c4a-a8c9-f452e6ffcff8 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578baadaf0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:05.563022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ef2d7b3-d5a0-40f2-8650-b49a03edcfe9 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:05.688331 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-db6b390f-bdea-4c4a-a8c9-f452e6ffcff8 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.168782 Oct 04 21:18:05.698087 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1356/2797] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:05 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:06.029266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3ef2d7b3-d5a0-40f2-8650-b49a03edcfe9 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:06.052215 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3ef2d7b3-d5a0-40f2-8650-b49a03edcfe9 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1" status: 200 len: 1318 microversion: 2.1 time: 0.523645 Oct 04 21:18:06.065998 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1442/2798] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:05 2022] GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1 => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:06.566880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fd19c3eb-40bd-4fe0-8282-2d1715cdf059 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:06.567108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cbb45b56-1b02-403e-9236-b86b1f2ec94d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:06.567716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fd19c3eb-40bd-4fe0-8282-2d1715cdf059 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:06.567897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cbb45b56-1b02-403e-9236-b86b1f2ec94d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:06.574440 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd19c3eb-40bd-4fe0-8282-2d1715cdf059 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:06.575021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd19c3eb-40bd-4fe0-8282-2d1715cdf059 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:06.575519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd19c3eb-40bd-4fe0-8282-2d1715cdf059 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:06.576270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd19c3eb-40bd-4fe0-8282-2d1715cdf059 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:06.576931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd19c3eb-40bd-4fe0-8282-2d1715cdf059 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:06.577625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd19c3eb-40bd-4fe0-8282-2d1715cdf059 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:06.589192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cbb45b56-1b02-403e-9236-b86b1f2ec94d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:06.591261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cbb45b56-1b02-403e-9236-b86b1f2ec94d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:06.594834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cbb45b56-1b02-403e-9236-b86b1f2ec94d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:06.600427 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cbb45b56-1b02-403e-9236-b86b1f2ec94d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:06.601085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cbb45b56-1b02-403e-9236-b86b1f2ec94d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:06.604409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cbb45b56-1b02-403e-9236-b86b1f2ec94d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:07.102901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cbb45b56-1b02-403e-9236-b86b1f2ec94d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:07.119970 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cbb45b56-1b02-403e-9236-b86b1f2ec94d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1737 microversion: 2.1 time: 0.561157 Oct 04 21:18:07.125885 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1357/2799] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:06 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1737 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:07.161818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5422cce3-5091-482e-8035-6c2067b3343b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790014790>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:07.291937 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5422cce3-5091-482e-8035-6c2067b3343b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.160009 Oct 04 21:18:07.292527 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1358/2800] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:07 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:07.434612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fd19c3eb-40bd-4fe0-8282-2d1715cdf059 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:07.444785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7123f326-adfe-45ed-8591-47715d3f0a77 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'create', calling method: .version_select at 0x7f579072e790>, body: {"keypair": {"name": "tempest-keypair-1626876242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpi2ePEiY7R6vQ1ML2oiSIaV7XIiqqVW24YRzeLwHtjcRZ7xqIgqceG86n8nXRZMk4VrN1rsnFK9aXAYeReY0oeVSHdTkHaNXcdeogfq4gWC5KgTE1rWSAboct1HkjRDA=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:07.452034 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fd19c3eb-40bd-4fe0-8282-2d1715cdf059 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1355 microversion: 2.1 time: 0.887872 Oct 04 21:18:07.454322 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1443/2801] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:06 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1355 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:07.460182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-80081160-f775-4bb6-b32d-39f42ffa17b2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:07.460883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-80081160-f775-4bb6-b32d-39f42ffa17b2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:07.468502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80081160-f775-4bb6-b32d-39f42ffa17b2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:07.468992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80081160-f775-4bb6-b32d-39f42ffa17b2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:07.469722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80081160-f775-4bb6-b32d-39f42ffa17b2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:07.470355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80081160-f775-4bb6-b32d-39f42ffa17b2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:07.470819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80081160-f775-4bb6-b32d-39f42ffa17b2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:07.471310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80081160-f775-4bb6-b32d-39f42ffa17b2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:07.503606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-7123f326-adfe-45ed-8591-47715d3f0a77 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Getting quotas for project 0f62474e9d474aa28ac754b712e68652. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:18:07.518169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-7123f326-adfe-45ed-8591-47715d3f0a77 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Getting quotas for user 8ef7d2991dce46278486e0ee963d4cf3 and project 0f62474e9d474aa28ac754b712e68652. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:18:07.698141 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7123f326-adfe-45ed-8591-47715d3f0a77 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.392186 Oct 04 21:18:07.698141 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1359/2802] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:18:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:07.750192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-80081160-f775-4bb6-b32d-39f42ffa17b2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:07.774609 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-80081160-f775-4bb6-b32d-39f42ffa17b2 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1" status: 200 len: 1318 microversion: 2.1 time: 0.306427 Oct 04 21:18:07.774609 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1444/2803] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:07 2022] GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:08.150822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-593d4541-fbe7-4cf0-9a14-050cbc031725 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:08.151404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-593d4541-fbe7-4cf0-9a14-050cbc031725 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:08.175006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-593d4541-fbe7-4cf0-9a14-050cbc031725 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:08.180360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-593d4541-fbe7-4cf0-9a14-050cbc031725 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:08.181743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-593d4541-fbe7-4cf0-9a14-050cbc031725 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:08.182732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-593d4541-fbe7-4cf0-9a14-050cbc031725 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:08.183361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-593d4541-fbe7-4cf0-9a14-050cbc031725 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:08.188523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-593d4541-fbe7-4cf0-9a14-050cbc031725 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:08.308009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-77bd604c-7d60-4921-a28b-8563f3951e16 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f579443b940>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:08.361830 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-77bd604c-7d60-4921-a28b-8563f3951e16 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.057697 Oct 04 21:18:08.362625 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1445/2804] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:08 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:08.433016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-593d4541-fbe7-4cf0-9a14-050cbc031725 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:08.457609 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-593d4541-fbe7-4cf0-9a14-050cbc031725 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1737 microversion: 2.1 time: 0.304729 Oct 04 21:18:08.457609 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1360/2805] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:08 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1737 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:08.483445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-74e33b3f-381a-43bc-aa67-0c218689985b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:08.485272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-74e33b3f-381a-43bc-aa67-0c218689985b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:08.508110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74e33b3f-381a-43bc-aa67-0c218689985b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:08.508110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74e33b3f-381a-43bc-aa67-0c218689985b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:08.508674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74e33b3f-381a-43bc-aa67-0c218689985b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:08.509529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74e33b3f-381a-43bc-aa67-0c218689985b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:08.510191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74e33b3f-381a-43bc-aa67-0c218689985b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:08.510810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74e33b3f-381a-43bc-aa67-0c218689985b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:08.791006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-57098e07-983f-47e4-9ce8-4a6af04bcc27 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:08.793129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-57098e07-983f-47e4-9ce8-4a6af04bcc27 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:08.804336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57098e07-983f-47e4-9ce8-4a6af04bcc27 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:08.807424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57098e07-983f-47e4-9ce8-4a6af04bcc27 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:08.808770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57098e07-983f-47e4-9ce8-4a6af04bcc27 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:08.809793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57098e07-983f-47e4-9ce8-4a6af04bcc27 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:08.810434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57098e07-983f-47e4-9ce8-4a6af04bcc27 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:08.811068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57098e07-983f-47e4-9ce8-4a6af04bcc27 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:09.664574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-74e33b3f-381a-43bc-aa67-0c218689985b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:09.678409 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-74e33b3f-381a-43bc-aa67-0c218689985b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1355 microversion: 2.1 time: 1.196416 Oct 04 21:18:09.680709 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1446/2806] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:08 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1355 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:09.705241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f8d91aa0-3525-43b5-b863-d0c1098031aa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57943c8e50>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:09.782848 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f8d91aa0-3525-43b5-b863-d0c1098031aa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.093601 Oct 04 21:18:09.783696 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1447/2807] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:09 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:09.792088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6351b458-f534-4791-b505-b347275c17dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:09.801380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6351b458-f534-4791-b505-b347275c17dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:09.801380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6351b458-f534-4791-b505-b347275c17dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:09.801380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6351b458-f534-4791-b505-b347275c17dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:09.801380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6351b458-f534-4791-b505-b347275c17dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:09.809199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6351b458-f534-4791-b505-b347275c17dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:09.810086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6351b458-f534-4791-b505-b347275c17dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:09.810805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6351b458-f534-4791-b505-b347275c17dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:09.880432 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-57098e07-983f-47e4-9ce8-4a6af04bcc27 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:09.896713 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-57098e07-983f-47e4-9ce8-4a6af04bcc27 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1" status: 200 len: 1318 microversion: 2.1 time: 1.111164 Oct 04 21:18:09.938777 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1361/2808] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:08 2022] GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1 => generated 1318 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:10.218260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6351b458-f534-4791-b505-b347275c17dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:10.229812 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6351b458-f534-4791-b505-b347275c17dc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1737 microversion: 2.1 time: 0.443570 Oct 04 21:18:10.241377 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1448/2809] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:09 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1737 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:10.707800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a69f6c4a-b86f-4b68-b1f1-7865672bb567 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:10.708675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a69f6c4a-b86f-4b68-b1f1-7865672bb567 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:10.724517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a69f6c4a-b86f-4b68-b1f1-7865672bb567 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:10.727096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a69f6c4a-b86f-4b68-b1f1-7865672bb567 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:10.727548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a69f6c4a-b86f-4b68-b1f1-7865672bb567 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:10.731559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a69f6c4a-b86f-4b68-b1f1-7865672bb567 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:10.732293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a69f6c4a-b86f-4b68-b1f1-7865672bb567 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:10.732899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a69f6c4a-b86f-4b68-b1f1-7865672bb567 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:10.803068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-eb796dc3-fcdd-4cbe-b53b-2b055dd7da02 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578bf2e5e0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:10.899005 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-eb796dc3-fcdd-4cbe-b53b-2b055dd7da02 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.101870 Oct 04 21:18:10.899659 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1449/2810] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:10 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:10.954926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9f270cff-c530-4d24-8e67-72510cac0982 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:10.959434 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9f270cff-c530-4d24-8e67-72510cac0982 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:11.008116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f270cff-c530-4d24-8e67-72510cac0982 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.011282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f270cff-c530-4d24-8e67-72510cac0982 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.015921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f270cff-c530-4d24-8e67-72510cac0982 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:11.019205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f270cff-c530-4d24-8e67-72510cac0982 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.029799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f270cff-c530-4d24-8e67-72510cac0982 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.030981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f270cff-c530-4d24-8e67-72510cac0982 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:11.441167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a69f6c4a-b86f-4b68-b1f1-7865672bb567 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:11.446122 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a69f6c4a-b86f-4b68-b1f1-7865672bb567 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1355 microversion: 2.1 time: 0.742807 Oct 04 21:18:11.453557 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1362/2811] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:10 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1355 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:11.473631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-67e4ddf1-5fcd-439c-b483-a6ce380f15ff tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:11.473631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-67e4ddf1-5fcd-439c-b483-a6ce380f15ff tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:11.496434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67e4ddf1-5fcd-439c-b483-a6ce380f15ff tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.496434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67e4ddf1-5fcd-439c-b483-a6ce380f15ff tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.496434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67e4ddf1-5fcd-439c-b483-a6ce380f15ff tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:11.496434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67e4ddf1-5fcd-439c-b483-a6ce380f15ff tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.496434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67e4ddf1-5fcd-439c-b483-a6ce380f15ff tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.496434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67e4ddf1-5fcd-439c-b483-a6ce380f15ff tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:11.560646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9f270cff-c530-4d24-8e67-72510cac0982 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:11.573366 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9f270cff-c530-4d24-8e67-72510cac0982 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1" status: 200 len: 1318 microversion: 2.1 time: 0.633326 Oct 04 21:18:11.599474 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1450/2812] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:10 2022] GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1 => generated 1318 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:11.863317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-98ffeab9-4c34-47ae-8b67-60f9eb944be9 req-356d6e09-7570-46cf-b4a4-60a71ed4c7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2998012-afa9-4e41-a256-724e7dafffd1", "name": "network-vif-plugged", "status": "completed", "tag": "5d810375-1682-40cb-b5e9-507e068e95c9"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:11.884442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-98ffeab9-4c34-47ae-8b67-60f9eb944be9 req-356d6e09-7570-46cf-b4a4-60a71ed4c7c3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.887195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-98ffeab9-4c34-47ae-8b67-60f9eb944be9 req-356d6e09-7570-46cf-b4a4-60a71ed4c7c3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.891023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-98ffeab9-4c34-47ae-8b67-60f9eb944be9 req-356d6e09-7570-46cf-b4a4-60a71ed4c7c3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:11.942340 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-98ffeab9-4c34-47ae-8b67-60f9eb944be9 req-356d6e09-7570-46cf-b4a4-60a71ed4c7c3 service nova] Creating event network-vif-plugged:5d810375-1682-40cb-b5e9-507e068e95c9 for instance d2998012-afa9-4e41-a256-724e7dafffd1 on n-h2-860282-1 Oct 04 21:18:11.949739 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-98ffeab9-4c34-47ae-8b67-60f9eb944be9 req-356d6e09-7570-46cf-b4a4-60a71ed4c7c3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097240 Oct 04 21:18:11.951852 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1451/2813] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:11.964565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3a855774-7cf9-47fc-9369-2d6170bebaec tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578bf07550>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:12.046733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-67e4ddf1-5fcd-439c-b483-a6ce380f15ff tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:12.069137 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3a855774-7cf9-47fc-9369-2d6170bebaec tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.115820 Oct 04 21:18:12.069927 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1452/2814] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:11 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:12.082840 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-67e4ddf1-5fcd-439c-b483-a6ce380f15ff tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1737 microversion: 2.1 time: 0.627777 Oct 04 21:18:12.083456 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1363/2815] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:11 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1737 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:12.482264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a51eec07-915a-4aec-b56f-2aef0e94fdc0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:12.483786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a51eec07-915a-4aec-b56f-2aef0e94fdc0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:12.512984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a51eec07-915a-4aec-b56f-2aef0e94fdc0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:12.512984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a51eec07-915a-4aec-b56f-2aef0e94fdc0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:12.512984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a51eec07-915a-4aec-b56f-2aef0e94fdc0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:12.512984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a51eec07-915a-4aec-b56f-2aef0e94fdc0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:12.512984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a51eec07-915a-4aec-b56f-2aef0e94fdc0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:12.512984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a51eec07-915a-4aec-b56f-2aef0e94fdc0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:12.633801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ed40cd29-cab3-4af3-8b75-f875214c4da0 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:12.638059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ed40cd29-cab3-4af3-8b75-f875214c4da0 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:12.652154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed40cd29-cab3-4af3-8b75-f875214c4da0 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:12.652778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed40cd29-cab3-4af3-8b75-f875214c4da0 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:12.655022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed40cd29-cab3-4af3-8b75-f875214c4da0 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:12.656982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed40cd29-cab3-4af3-8b75-f875214c4da0 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:12.657563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed40cd29-cab3-4af3-8b75-f875214c4da0 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:12.661277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed40cd29-cab3-4af3-8b75-f875214c4da0 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:12.965797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a51eec07-915a-4aec-b56f-2aef0e94fdc0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:12.977923 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a51eec07-915a-4aec-b56f-2aef0e94fdc0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1355 microversion: 2.1 time: 0.500418 Oct 04 21:18:12.980550 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1453/2816] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:12 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1355 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:13.080612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ed40cd29-cab3-4af3-8b75-f875214c4da0 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:13.086616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5acc9eef-81cc-42a6-a6f8-cb346be790ac tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57900321f0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:13.103724 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ed40cd29-cab3-4af3-8b75-f875214c4da0 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1" status: 200 len: 1318 microversion: 2.1 time: 0.467975 Oct 04 21:18:13.113925 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1364/2817] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:12 2022] GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:13.127753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a822f007-e092-44ac-983a-1354c9f8a287 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:13.139075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a822f007-e092-44ac-983a-1354c9f8a287 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:13.162730 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5acc9eef-81cc-42a6-a6f8-cb346be790ac tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.080648 Oct 04 21:18:13.164322 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1454/2818] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:13 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:13.171852 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a822f007-e092-44ac-983a-1354c9f8a287 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:13.179732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a822f007-e092-44ac-983a-1354c9f8a287 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:13.179732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a822f007-e092-44ac-983a-1354c9f8a287 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:13.181244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a822f007-e092-44ac-983a-1354c9f8a287 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:13.184037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a822f007-e092-44ac-983a-1354c9f8a287 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:13.186032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a822f007-e092-44ac-983a-1354c9f8a287 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:13.440410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a822f007-e092-44ac-983a-1354c9f8a287 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:13.450884 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a822f007-e092-44ac-983a-1354c9f8a287 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1737 microversion: 2.1 time: 0.335367 Oct 04 21:18:13.451497 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1365/2819] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:13 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1737 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:14.002942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b39f312d-95b9-4afa-bec1-8b391a39eaf3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:14.003644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b39f312d-95b9-4afa-bec1-8b391a39eaf3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:14.007266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-218ff04b-0cf1-4641-b460-7b7d875fb0a4 req-23e3b68a-dc43-4f4a-bb3e-d995fa22f6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "482e4179-2301-47d7-87dd-4deec4941c5e", "name": "network-vif-plugged", "status": "completed", "tag": "16ca2f59-07cc-44f9-b717-987aa1fe45be"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:14.032829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b39f312d-95b9-4afa-bec1-8b391a39eaf3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:14.038205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b39f312d-95b9-4afa-bec1-8b391a39eaf3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:14.039153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b39f312d-95b9-4afa-bec1-8b391a39eaf3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:14.041741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b39f312d-95b9-4afa-bec1-8b391a39eaf3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:14.043588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b39f312d-95b9-4afa-bec1-8b391a39eaf3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:14.045633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b39f312d-95b9-4afa-bec1-8b391a39eaf3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:14.050194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-218ff04b-0cf1-4641-b460-7b7d875fb0a4 req-23e3b68a-dc43-4f4a-bb3e-d995fa22f6f6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:14.051649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-218ff04b-0cf1-4641-b460-7b7d875fb0a4 req-23e3b68a-dc43-4f4a-bb3e-d995fa22f6f6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:14.052311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-218ff04b-0cf1-4641-b460-7b7d875fb0a4 req-23e3b68a-dc43-4f4a-bb3e-d995fa22f6f6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:14.093803 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-218ff04b-0cf1-4641-b460-7b7d875fb0a4 req-23e3b68a-dc43-4f4a-bb3e-d995fa22f6f6 service nova] Creating event network-vif-plugged:16ca2f59-07cc-44f9-b717-987aa1fe45be for instance 482e4179-2301-47d7-87dd-4deec4941c5e on n-h2-860282-1 Oct 04 21:18:14.118707 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-218ff04b-0cf1-4641-b460-7b7d875fb0a4 req-23e3b68a-dc43-4f4a-bb3e-d995fa22f6f6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124311 Oct 04 21:18:14.123748 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1455/2820] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:14.137272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6f41392d-2761-4517-add6-3ad3b205d1fe tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:14.138385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6f41392d-2761-4517-add6-3ad3b205d1fe tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:14.159624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f41392d-2761-4517-add6-3ad3b205d1fe tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:14.161042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f41392d-2761-4517-add6-3ad3b205d1fe tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:14.161732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f41392d-2761-4517-add6-3ad3b205d1fe tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:14.162670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f41392d-2761-4517-add6-3ad3b205d1fe tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:14.172236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f41392d-2761-4517-add6-3ad3b205d1fe tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:14.172236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f41392d-2761-4517-add6-3ad3b205d1fe tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:14.407891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b39f312d-95b9-4afa-bec1-8b391a39eaf3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:14.417361 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b39f312d-95b9-4afa-bec1-8b391a39eaf3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1355 microversion: 2.1 time: 0.418125 Oct 04 21:18:14.424302 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1366/2821] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:13 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1355 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:14.430343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0466ea6c-6ae5-4f7b-a764-a6d97c54fc7c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b955ca0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:14.509069 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0466ea6c-6ae5-4f7b-a764-a6d97c54fc7c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.083314 Oct 04 21:18:14.509910 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1367/2822] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:14 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:14.514609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ac6dac6b-e696-42cb-b1eb-a0f8fe9c9703 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:14.516179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ac6dac6b-e696-42cb-b1eb-a0f8fe9c9703 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:14.525230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6f41392d-2761-4517-add6-3ad3b205d1fe tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:14.553142 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6f41392d-2761-4517-add6-3ad3b205d1fe tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1" status: 200 len: 1508 microversion: 2.1 time: 0.420099 Oct 04 21:18:14.556022 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1456/2823] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:14 2022] GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1 => generated 1508 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:14.566796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac6dac6b-e696-42cb-b1eb-a0f8fe9c9703 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:14.568578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac6dac6b-e696-42cb-b1eb-a0f8fe9c9703 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:14.569903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac6dac6b-e696-42cb-b1eb-a0f8fe9c9703 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:14.571218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac6dac6b-e696-42cb-b1eb-a0f8fe9c9703 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:14.572998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac6dac6b-e696-42cb-b1eb-a0f8fe9c9703 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:14.574636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac6dac6b-e696-42cb-b1eb-a0f8fe9c9703 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:14.664934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-11d5409c-1375-4f82-9291-af868b9cd639 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1380388821", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "734a8a85-50ab-4efa-9474-a014f1074a74"}], "security_groups": [{"name": "tempest-securitygroup--19120514"}], "key_name": "tempest-keypair-1626876242", "user_data": "}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:14.899292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ac6dac6b-e696-42cb-b1eb-a0f8fe9c9703 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:14.914705 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ac6dac6b-e696-42cb-b1eb-a0f8fe9c9703 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1737 microversion: 2.1 time: 0.400432 Oct 04 21:18:14.916165 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1368/2824] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:14 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1737 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:14.919503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-11d5409c-1375-4f82-9291-af868b9cd639 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] validate_networks() for [('734a8a85-50ab-4efa-9474-a014f1074a74', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:18:15.382259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-20c926f9-be22-4f13-865a-eea7203984d8 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Action: 'create', calling method: .version_select at 0x7f578b955e50>, body: {"keypair": {"name": "tempest-keypair-505571551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInin3aUdcAAFFqxpHyGOmv7E8HJgRfy/tcZshsdoyY2pxiCNArpfBdC/Y0nyO4goaJLoPAzGTxZtysjLOZvoXhPOE9iN3Erc5ZYiqsZp5PmwYJGe541er52zcysIawhjQ=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:15.406787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-20c926f9-be22-4f13-865a-eea7203984d8 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Getting quotas for project fd6672e131c9465e90831ae6bd6e6279. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:18:15.417628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-20c926f9-be22-4f13-865a-eea7203984d8 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Getting quotas for user f94a0902dc5e4264b7a9b0e724bed685 and project fd6672e131c9465e90831ae6bd6e6279. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:18:15.536539 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-20c926f9-be22-4f13-865a-eea7203984d8 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.336406 Oct 04 21:18:15.537642 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1369/2825] 10.222.0.30 () {62 vars in 1199 bytes} [Tue Oct 4 21:18:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 338 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 04 21:18:15.544968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f4c76881-d9c8-4673-a2f9-4ee0d2f53d9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:15.546030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f4c76881-d9c8-4673-a2f9-4ee0d2f53d9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:15.558494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4c76881-d9c8-4673-a2f9-4ee0d2f53d9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:15.559902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4c76881-d9c8-4673-a2f9-4ee0d2f53d9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:15.560743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4c76881-d9c8-4673-a2f9-4ee0d2f53d9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:15.561757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4c76881-d9c8-4673-a2f9-4ee0d2f53d9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:15.562453 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4c76881-d9c8-4673-a2f9-4ee0d2f53d9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:15.563130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4c76881-d9c8-4673-a2f9-4ee0d2f53d9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:15.701336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-11d5409c-1375-4f82-9291-af868b9cd639 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:18:15.701853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-11d5409c-1375-4f82-9291-af868b9cd639 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:18:15.702425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-11d5409c-1375-4f82-9291-af868b9cd639 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:18:15.702971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-11d5409c-1375-4f82-9291-af868b9cd639 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:18:15.703463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-11d5409c-1375-4f82-9291-af868b9cd639 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:18:15.719450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11d5409c-1375-4f82-9291-af868b9cd639 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:15.724153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11d5409c-1375-4f82-9291-af868b9cd639 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:15.724826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11d5409c-1375-4f82-9291-af868b9cd639 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:15.725740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11d5409c-1375-4f82-9291-af868b9cd639 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:15.726189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11d5409c-1375-4f82-9291-af868b9cd639 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:15.728546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11d5409c-1375-4f82-9291-af868b9cd639 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:15.798355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-11d5409c-1375-4f82-9291-af868b9cd639 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Getting quotas for project 0f62474e9d474aa28ac754b712e68652. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:18:15.833468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-11d5409c-1375-4f82-9291-af868b9cd639 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Getting quotas for user 8ef7d2991dce46278486e0ee963d4cf3 and project 0f62474e9d474aa28ac754b712e68652. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:18:15.869308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-11d5409c-1375-4f82-9291-af868b9cd639 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:18:15.873702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-11d5409c-1375-4f82-9291-af868b9cd639 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:18:15.986722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f4c76881-d9c8-4673-a2f9-4ee0d2f53d9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:15.998940 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f4c76881-d9c8-4673-a2f9-4ee0d2f53d9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1355 microversion: 2.1 time: 0.459960 Oct 04 21:18:15.999792 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1370/2826] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:15 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1355 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:16.038979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-54600aad-f734-490e-9e8a-57999fa71243 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57908d58b0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:16.098946 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-54600aad-f734-490e-9e8a-57999fa71243 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.070810 Oct 04 21:18:16.099591 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1371/2827] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:15 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:16.106135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-68f8fd73-9ab0-4828-a78d-1fd734b2e240 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Calling method '.version_select at 0x7f578b952820>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:16.116871 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-68f8fd73-9ab0-4828-a78d-1fd734b2e240 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-505571551" status: 200 len: 512 microversion: 2.2 time: 0.016217 Oct 04 21:18:16.130768 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1372/2828] 10.222.0.30 () {60 vars in 1255 bytes} [Tue Oct 4 21:18:16 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-505571551 => generated 512 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:16.130768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-42e509a0-185d-4684-af0d-6e234a611492 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:16.130768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-42e509a0-185d-4684-af0d-6e234a611492 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:16.141236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42e509a0-185d-4684-af0d-6e234a611492 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:16.141837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42e509a0-185d-4684-af0d-6e234a611492 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:16.142296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42e509a0-185d-4684-af0d-6e234a611492 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:16.143084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42e509a0-185d-4684-af0d-6e234a611492 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:16.143856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42e509a0-185d-4684-af0d-6e234a611492 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:16.144938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42e509a0-185d-4684-af0d-6e234a611492 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:16.152292 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-11d5409c-1375-4f82-9291-af868b9cd639 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.492311 Oct 04 21:18:16.155694 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1457/2829] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:18:14 2022] POST /compute/v2.1/servers => generated 407 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:18:16.163216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-786ce663-e6eb-468d-bfe9-7813c04d9282 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Calling method '.version_select at 0x7f579010fee0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:16.173216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:16.302523 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-786ce663-e6eb-468d-bfe9-7813c04d9282 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-505571551" status: 204 len: 0 microversion: 2.2 time: 0.145395 Oct 04 21:18:16.312843 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1458/2830] 10.222.0.30 () {60 vars in 1258 bytes} [Tue Oct 4 21:18:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-505571551 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:18:16.319748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-0845aec1-b4a7-4bd9-a880-3b8c99b14bb8 req-d20097ac-7653-4459-9885-ab7cfff061e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "482e4179-2301-47d7-87dd-4deec4941c5e", "name": "network-vif-plugged", "status": "completed", "tag": "85c8e826-4719-4a5a-8acb-5453352e3a57"}, {"server_uuid": "482e4179-2301-47d7-87dd-4deec4941c5e", "name": "network-vif-plugged", "status": "completed", "tag": "c945153b-4121-409e-8626-dde6cbf57cff"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:16.351712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0845aec1-b4a7-4bd9-a880-3b8c99b14bb8 req-d20097ac-7653-4459-9885-ab7cfff061e0 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:16.352512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0845aec1-b4a7-4bd9-a880-3b8c99b14bb8 req-d20097ac-7653-4459-9885-ab7cfff061e0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:16.353184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0845aec1-b4a7-4bd9-a880-3b8c99b14bb8 req-d20097ac-7653-4459-9885-ab7cfff061e0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:16.383949 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-0845aec1-b4a7-4bd9-a880-3b8c99b14bb8 req-d20097ac-7653-4459-9885-ab7cfff061e0 service nova] Creating event network-vif-plugged:85c8e826-4719-4a5a-8acb-5453352e3a57 for instance 482e4179-2301-47d7-87dd-4deec4941c5e on n-h2-860282-1 Oct 04 21:18:16.384637 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-0845aec1-b4a7-4bd9-a880-3b8c99b14bb8 req-d20097ac-7653-4459-9885-ab7cfff061e0 service nova] Creating event network-vif-plugged:c945153b-4121-409e-8626-dde6cbf57cff for instance 482e4179-2301-47d7-87dd-4deec4941c5e on n-h2-860282-1 Oct 04 21:18:16.395473 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-0845aec1-b4a7-4bd9-a880-3b8c99b14bb8 req-d20097ac-7653-4459-9885-ab7cfff061e0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.079340 Oct 04 21:18:16.396764 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1459/2831] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:16.405323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0971c4af-e816-4aed-9cb8-c8e972372e81 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:16.406379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0971c4af-e816-4aed-9cb8-c8e972372e81 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:16.510901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0971c4af-e816-4aed-9cb8-c8e972372e81 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:16.520615 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0971c4af-e816-4aed-9cb8-c8e972372e81 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1239 microversion: 2.1 time: 0.120717 Oct 04 21:18:16.527350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-42e509a0-185d-4684-af0d-6e234a611492 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:16.545701 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1460/2832] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:16 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1239 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:16.549329 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-42e509a0-185d-4684-af0d-6e234a611492 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1737 microversion: 2.1 time: 0.425212 Oct 04 21:18:16.555716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-50a987db-90ea-45f0-bf04-872268047ad5 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Action: 'create', calling method: .version_select at 0x7f578bf3a550>, body: {"keypair": {"name": "tempest-keypair-993275730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeqCTB7dYkUOtRv1lh/SBvqgPYUiv6sqpRPfgwiz7wRlJSm0+fnZr1mC2Xi9lGQIbfHqCgap5pmqR+gaMGccvufgLN5F8xXhcrafVnMm2wS+XASafnI4iMaOvo+ttyCOQ=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:16.556112 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1373/2833] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:16 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1737 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:16.582317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-50a987db-90ea-45f0-bf04-872268047ad5 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Getting quotas for project fd6672e131c9465e90831ae6bd6e6279. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:18:16.588058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-50a987db-90ea-45f0-bf04-872268047ad5 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Getting quotas for user f94a0902dc5e4264b7a9b0e724bed685 and project fd6672e131c9465e90831ae6bd6e6279. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:18:16.591493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:16.965602 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-50a987db-90ea-45f0-bf04-872268047ad5 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.412419 Oct 04 21:18:16.965602 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1461/2834] 10.222.0.30 () {62 vars in 1199 bytes} [Tue Oct 4 21:18:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 414 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 21:18:16.974573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-700c46e5-7e17-4b2c-8073-dbf852023d9c tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Calling method '.version_select at 0x7f57908d5550>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:17.023619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-369a3f9c-6bd0-4e54-b176-df6805be18f0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:17.024218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-369a3f9c-6bd0-4e54-b176-df6805be18f0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:17.030530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-369a3f9c-6bd0-4e54-b176-df6805be18f0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:17.031017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-369a3f9c-6bd0-4e54-b176-df6805be18f0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:17.031456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-369a3f9c-6bd0-4e54-b176-df6805be18f0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:17.032146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-369a3f9c-6bd0-4e54-b176-df6805be18f0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:17.032604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-369a3f9c-6bd0-4e54-b176-df6805be18f0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:17.033030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-369a3f9c-6bd0-4e54-b176-df6805be18f0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:17.185920 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-700c46e5-7e17-4b2c-8073-dbf852023d9c tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-993275730" status: 204 len: 0 microversion: 2.2 time: 0.215619 Oct 04 21:18:17.186631 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1374/2835] 10.222.0.30 () {60 vars in 1258 bytes} [Tue Oct 4 21:18:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-993275730 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:18:17.199481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e20c62c9-8cc6-4637-acfa-e6f76920446d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b952160>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:17.296682 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e20c62c9-8cc6-4637-acfa-e6f76920446d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.103310 Oct 04 21:18:17.297584 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1375/2836] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:17 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:17.308163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7400d01b-2e5f-47a0-96be-e5199445e970 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Action: 'create', calling method: .version_select at 0x7f578b955d30>, body: {"keypair": {"name": "tempest-keypair-615135787", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:17.345127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-7400d01b-2e5f-47a0-96be-e5199445e970 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Getting quotas for project fd6672e131c9465e90831ae6bd6e6279. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:18:17.351539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-369a3f9c-6bd0-4e54-b176-df6805be18f0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:17.352466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-7400d01b-2e5f-47a0-96be-e5199445e970 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Getting quotas for user f94a0902dc5e4264b7a9b0e724bed685 and project fd6672e131c9465e90831ae6bd6e6279. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:18:17.377062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:17.380265 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-369a3f9c-6bd0-4e54-b176-df6805be18f0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1355 microversion: 2.1 time: 0.361377 Oct 04 21:18:17.381044 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1462/2837] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:17 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1355 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:17.523525 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7400d01b-2e5f-47a0-96be-e5199445e970 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.224994 Oct 04 21:18:17.531393 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1376/2838] 10.222.0.30 () {62 vars in 1199 bytes} [Tue Oct 4 21:18:17 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 226 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 21:18:17.536716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a8af86c9-e792-4333-bba5-2b225cacd023 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Calling method '.version_select at 0x7f578bed5a60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:17.554861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f7b9f535-449e-4840-8696-ae001d91a449 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:17.555801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f7b9f535-449e-4840-8696-ae001d91a449 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:17.630955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f7b9f535-449e-4840-8696-ae001d91a449 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:17.638502 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f7b9f535-449e-4840-8696-ae001d91a449 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1239 microversion: 2.1 time: 0.097409 Oct 04 21:18:17.639284 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1377/2839] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:17 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1239 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:17.650075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a0a4c0de-4289-4a12-a0c8-d4ce0cf9bf7c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:17.651207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a0a4c0de-4289-4a12-a0c8-d4ce0cf9bf7c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:17.659013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0a4c0de-4289-4a12-a0c8-d4ce0cf9bf7c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:17.660158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0a4c0de-4289-4a12-a0c8-d4ce0cf9bf7c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:17.661043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0a4c0de-4289-4a12-a0c8-d4ce0cf9bf7c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:17.663720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0a4c0de-4289-4a12-a0c8-d4ce0cf9bf7c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:17.664389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0a4c0de-4289-4a12-a0c8-d4ce0cf9bf7c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:17.664848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0a4c0de-4289-4a12-a0c8-d4ce0cf9bf7c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:17.712132 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a8af86c9-e792-4333-bba5-2b225cacd023 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-615135787" status: 204 len: 0 microversion: 2.2 time: 0.180336 Oct 04 21:18:17.713065 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1463/2840] 10.222.0.30 () {60 vars in 1258 bytes} [Tue Oct 4 21:18:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-615135787 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:18:17.726532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0d3c15cc-7345-44e8-a47a-146dba28c8a4 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Action: 'create', calling method: .version_select at 0x7f579457d5e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1007291021", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxkZGUGYlo1dW3SR06PNMvtOfwIEa/qehluAdUsfaGKJoaYnSBN+fAuBv8InfhGtEg58Kc2ckOXadIAwIfqM90dn5Y8iGoTCXD6TeAooX0AP5gBJXLBAjgNfyDD6gIOLw=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:17.779599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-0d3c15cc-7345-44e8-a47a-146dba28c8a4 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Getting quotas for project fd6672e131c9465e90831ae6bd6e6279. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:18:17.782682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-0d3c15cc-7345-44e8-a47a-146dba28c8a4 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Getting quotas for user f94a0902dc5e4264b7a9b0e724bed685 and project fd6672e131c9465e90831ae6bd6e6279. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:18:17.886810 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0d3c15cc-7345-44e8-a47a-146dba28c8a4 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.163946 Oct 04 21:18:17.888092 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1464/2841] 10.222.0.30 () {62 vars in 1199 bytes} [Tue Oct 4 21:18:17 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 168 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 04 21:18:17.898484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b44a91d2-59c1-4267-8e09-818e3e56ac57 tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "f910f15b-9c04-40e9-aad2-60969eebaba4"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:17.912200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b44a91d2-59c1-4267-8e09-818e3e56ac57 tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:17.924436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b44a91d2-59c1-4267-8e09-818e3e56ac57 tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:17.924948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b44a91d2-59c1-4267-8e09-818e3e56ac57 tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:17.927203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b44a91d2-59c1-4267-8e09-818e3e56ac57 tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:17.927951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b44a91d2-59c1-4267-8e09-818e3e56ac57 tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:17.929971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b44a91d2-59c1-4267-8e09-818e3e56ac57 tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:17.930593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b44a91d2-59c1-4267-8e09-818e3e56ac57 tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:17.936975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a0a4c0de-4289-4a12-a0c8-d4ce0cf9bf7c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:17.948202 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a0a4c0de-4289-4a12-a0c8-d4ce0cf9bf7c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1737 microversion: 2.1 time: 0.307372 Oct 04 21:18:17.968287 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1378/2842] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:17 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1737 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:17.974489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-07ffece5-1d6f-4f98-86d5-adaca86a9c29 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Action: 'create', calling method: .version_select at 0x7f57908f0430>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1167657282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgJSemI0qY/ddtg4/CLJEi+C1OYx6Qk1HJdIK3v6EGr28W7b5mRMHthS/bzkrHbL1cyvQdZRG7DC7/BdUm1Hn3j98nkiKiDV/p6yx845ij+mrmpkt5byNK194e/t3s8YQ=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:17.994249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-07ffece5-1d6f-4f98-86d5-adaca86a9c29 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Getting quotas for project fd6672e131c9465e90831ae6bd6e6279. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:18:17.999497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-07ffece5-1d6f-4f98-86d5-adaca86a9c29 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Getting quotas for user f94a0902dc5e4264b7a9b0e724bed685 and project fd6672e131c9465e90831ae6bd6e6279. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:18:18.004590 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-b44a91d2-59c1-4267-8e09-818e3e56ac57 tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] HTTP exception thrown: Volume f9476ee8-1bc6-48e3-aab9-e7e6a6271064 could not be found. Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b44a91d2-59c1-4267-8e09-818e3e56ac57 tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] Request method failure captured: Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: request: PUT /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1/os-volume_attachments/f9476ee8-1bc6-48e3-aab9-e7e6a6271064 HTTP/1.1 Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 74 Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKKYE3Mr8SBIW9zfvbv0r0bWHiaOclfQ_35au1q1LFWEaUzWD9yQiqH2XmfGapPiJMfrf7pLjFyrBmT094QG0OcYcU3mQx7YRWEqtPIl_-QrC4WgYwhq--0SvEpJ4NJdVOOvEgsh1q5oXfBNUJjyJGcACC83Xcub2xapU4D0IfDtiTk Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 36ef8c1595df44799f54892b243fe667 Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-VolumesAdminNegativeTest-1697638891 Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/36ef8c1595df44799f54892b243fe667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_36ef8c1595df44799f54892b243fe667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/36ef8c1595df44799f54892b243fe667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/36ef8c1595df44799f54892b243fe667"}]}] Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-VolumesAdminNegativeTest-1697638891 Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 36ef8c1595df44799f54892b243fe667 Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1697638891 Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-VolumesAdminNegativeTest-1697638891-project-admin Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: f46f502b213b4b169efd2809496a7323 Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-VolumesAdminNegativeTest-1697638891-project-admin Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: {"volumeAttachment": {"volumeId": "f910f15b-9c04-40e9-aad2-60969eebaba4"}} Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: exception: Volume f9476ee8-1bc6-48e3-aab9-e7e6a6271064 could not be found. Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'server_id': 'd2998012-afa9-4e41-a256-724e7dafffd1', 'id': 'f9476ee8-1bc6-48e3-aab9-e7e6a6271064', 'body': {'volumeAttachment': {'volumeId': 'f910f15b-9c04-40e9-aad2-60969eebaba4'}}} Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f9476ee8-1bc6-48e3-aab9-e7e6a6271064 could not be found. (HTTP 404) (Request-ID: req-758cd73b-c923-4ed4-b633-2bf614bd7e2b) Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:18:18.009087 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f9476ee8-1bc6-48e3-aab9-e7e6a6271064 could not be found. Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f9476ee8-1bc6-48e3-aab9-e7e6a6271064 could not be found. Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f9476ee8-1bc6-48e3-aab9-e7e6a6271064 could not be found. Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b44a91d2-59c1-4267-8e09-818e3e56ac57 tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] Returning 404 to user: Volume f9476ee8-1bc6-48e3-aab9-e7e6a6271064 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:18.013822 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b44a91d2-59c1-4267-8e09-818e3e56ac57 tempest-VolumesAdminNegativeTest-1697638891 tempest-VolumesAdminNegativeTest-1697638891-project-admin] 10.222.0.30 "PUT /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1/os-volume_attachments/f9476ee8-1bc6-48e3-aab9-e7e6a6271064" status: 404 len: 109 microversion: 2.1 time: 0.122542 Oct 04 21:18:18.021001 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1465/2843] 10.222.0.30 () {60 vars in 1433 bytes} [Tue Oct 4 21:18:17 2022] PUT /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1/os-volume_attachments/f9476ee8-1bc6-48e3-aab9-e7e6a6271064 => generated 109 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:18.119046 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-07ffece5-1d6f-4f98-86d5-adaca86a9c29 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.149354 Oct 04 21:18:18.120815 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1379/2844] 10.222.0.30 () {62 vars in 1199 bytes} [Tue Oct 4 21:18:17 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 21:18:18.136981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9404104-08c6-41e2-a1e8-ee72316a3753 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Action: 'create', calling method: .version_select at 0x7f57900321f0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2131529502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYHGxiZXBo9G/kLKIl6Ga98hJtUXb4wfFv1Pb+S4MGW8yhZE3EnHNpjaWv5NzKgHOcYUpIzI5QPcIXU2Wwh11qQ27EEJx9v32rR8WCeN0SBvZ3es6SLsJyFR3RmNmHe4w=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:18.161864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-d9404104-08c6-41e2-a1e8-ee72316a3753 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Getting quotas for project fd6672e131c9465e90831ae6bd6e6279. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:18:18.176419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-d9404104-08c6-41e2-a1e8-ee72316a3753 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Getting quotas for user f94a0902dc5e4264b7a9b0e724bed685 and project fd6672e131c9465e90831ae6bd6e6279. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:18:18.305537 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d9404104-08c6-41e2-a1e8-ee72316a3753 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.173252 Oct 04 21:18:18.311457 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1466/2845] 10.222.0.30 () {62 vars in 1199 bytes} [Tue Oct 4 21:18:18 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 180 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 21:18:18.314793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-86a469a8-2a7b-448b-80f6-60bb8e66c56b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57908ea790>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:18.317311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fb8f0425-e836-487d-a210-841c2ccb4375 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Calling method '.version_select at 0x7f578bf3adc0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:18.321275 n-d-860282-1 devstack@n-api.service[122758]: WARNING oslo_db.sqlalchemy.utils [None req-fb8f0425-e836-487d-a210-841c2ccb4375 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 21:18:18.327199 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fb8f0425-e836-487d-a210-841c2ccb4375 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.014461 Oct 04 21:18:18.335682 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1467/2846] 10.222.0.30 () {60 vars in 1177 bytes} [Tue Oct 4 21:18:18 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:18.355688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3ea5cb31-c63a-492c-ad92-3423cb240da7 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Calling method '.version_select at 0x7f578bf2e430>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:18.367740 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-86a469a8-2a7b-448b-80f6-60bb8e66c56b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.057574 Oct 04 21:18:18.368659 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1380/2847] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:18 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:18.406059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-34b862b9-1896-4cef-93a0-28d6782dd15b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:18.406059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-34b862b9-1896-4cef-93a0-28d6782dd15b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:18.416512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34b862b9-1896-4cef-93a0-28d6782dd15b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:18.419091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34b862b9-1896-4cef-93a0-28d6782dd15b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:18.419808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34b862b9-1896-4cef-93a0-28d6782dd15b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:18.420735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34b862b9-1896-4cef-93a0-28d6782dd15b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:18.421580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34b862b9-1896-4cef-93a0-28d6782dd15b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:18.422303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34b862b9-1896-4cef-93a0-28d6782dd15b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:18.505184 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3ea5cb31-c63a-492c-ad92-3423cb240da7 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2131529502" status: 204 len: 0 microversion: 2.2 time: 0.168156 Oct 04 21:18:18.509608 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1468/2848] 10.222.0.30 () {60 vars in 1321 bytes} [Tue Oct 4 21:18:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2131529502 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:18:18.516572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ef88d6d7-086d-4ce9-87bf-455934d1e324 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Calling method '.version_select at 0x7f578bf6ea60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:18.679342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-34b862b9-1896-4cef-93a0-28d6782dd15b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:18.687743 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ef88d6d7-086d-4ce9-87bf-455934d1e324 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1167657282" status: 204 len: 0 microversion: 2.2 time: 0.176794 Oct 04 21:18:18.688641 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1469/2849] 10.222.0.30 () {60 vars in 1321 bytes} [Tue Oct 4 21:18:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1167657282 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:18:18.693322 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-34b862b9-1896-4cef-93a0-28d6782dd15b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1802 microversion: 2.1 time: 0.294357 Oct 04 21:18:18.701766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b053c37c-03b3-4866-b3d7-de6e3e7a1117 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:18.703516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b053c37c-03b3-4866-b3d7-de6e3e7a1117 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:18.708206 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1381/2850] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:18 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1802 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:18.720895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-72412a87-f6d3-4058-994b-d5e9d5373ca0 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Calling method '.version_select at 0x7f578ba9a4c0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:18.723195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b053c37c-03b3-4866-b3d7-de6e3e7a1117 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:18.727359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b053c37c-03b3-4866-b3d7-de6e3e7a1117 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:18.727933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b053c37c-03b3-4866-b3d7-de6e3e7a1117 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:18.728921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b053c37c-03b3-4866-b3d7-de6e3e7a1117 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:18.729672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b053c37c-03b3-4866-b3d7-de6e3e7a1117 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:18.730427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b053c37c-03b3-4866-b3d7-de6e3e7a1117 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:18.872821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b053c37c-03b3-4866-b3d7-de6e3e7a1117 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:18.886958 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b053c37c-03b3-4866-b3d7-de6e3e7a1117 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1235 microversion: 2.1 time: 0.196681 Oct 04 21:18:18.888559 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-72412a87-f6d3-4058-994b-d5e9d5373ca0 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1007291021" status: 204 len: 0 microversion: 2.2 time: 0.179797 Oct 04 21:18:18.900343 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1382/2851] 10.222.0.30 () {60 vars in 1321 bytes} [Tue Oct 4 21:18:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1007291021 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:18:18.911187 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1470/2852] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:18 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1235 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:18.921019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-90b6f4a3-5496-4812-8e00-37a6e2bbabe2 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Action: 'create', calling method: .version_select at 0x7f579443b3a0>, body: {"keypair": {"name": "tempest-keypair-771895749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEUpGyKbgXNoD7D30FLSjLMvIi1+C58Cw9zhTyZRZvNm4DxaGZfRT5SRwifVO5EatoQI4XWU4w3S8JmU4X+qXPk6AT3hhdD0XXgP5w7Ntz8DJkbnTG7KOXPWQgCfBZ/Jg=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:18.949574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0f64ed1a-3b25-4f78-80d0-1c13f9036932 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:18.957852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-90b6f4a3-5496-4812-8e00-37a6e2bbabe2 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Getting quotas for project fd6672e131c9465e90831ae6bd6e6279. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:18:18.958762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0f64ed1a-3b25-4f78-80d0-1c13f9036932 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:18.964254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-90b6f4a3-5496-4812-8e00-37a6e2bbabe2 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Getting quotas for user f94a0902dc5e4264b7a9b0e724bed685 and project fd6672e131c9465e90831ae6bd6e6279. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:18:19.004284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f64ed1a-3b25-4f78-80d0-1c13f9036932 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:19.004284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f64ed1a-3b25-4f78-80d0-1c13f9036932 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:19.009165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f64ed1a-3b25-4f78-80d0-1c13f9036932 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:19.013698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f64ed1a-3b25-4f78-80d0-1c13f9036932 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:19.014377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f64ed1a-3b25-4f78-80d0-1c13f9036932 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:19.014977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f64ed1a-3b25-4f78-80d0-1c13f9036932 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:19.070047 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0f64ed1a-3b25-4f78-80d0-1c13f9036932 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e/ips" status: 200 len: 215 microversion: 2.1 time: 0.168404 Oct 04 21:18:19.071454 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1383/2853] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Oct 4 21:18:18 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e/ips => generated 215 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:19.082087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-603b882d-5f9f-4fd1-b23c-56f4b7e6fe1a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:19.083094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-603b882d-5f9f-4fd1-b23c-56f4b7e6fe1a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:19.091329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-603b882d-5f9f-4fd1-b23c-56f4b7e6fe1a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:19.092113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-603b882d-5f9f-4fd1-b23c-56f4b7e6fe1a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:19.092635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-603b882d-5f9f-4fd1-b23c-56f4b7e6fe1a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:19.093491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-603b882d-5f9f-4fd1-b23c-56f4b7e6fe1a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:19.094043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-603b882d-5f9f-4fd1-b23c-56f4b7e6fe1a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:19.094548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-603b882d-5f9f-4fd1-b23c-56f4b7e6fe1a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:19.111518 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-90b6f4a3-5496-4812-8e00-37a6e2bbabe2 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.197062 Oct 04 21:18:19.132557 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1471/2854] 10.222.0.30 () {62 vars in 1199 bytes} [Tue Oct 4 21:18:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 211 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 21:18:19.163573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-39a749dd-f311-4da8-9686-818db5089f9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:19.164114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-39a749dd-f311-4da8-9686-818db5089f9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:19.194000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39a749dd-f311-4da8-9686-818db5089f9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:19.195054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39a749dd-f311-4da8-9686-818db5089f9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:19.195967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39a749dd-f311-4da8-9686-818db5089f9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:19.197276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39a749dd-f311-4da8-9686-818db5089f9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:19.197956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39a749dd-f311-4da8-9686-818db5089f9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:19.198396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39a749dd-f311-4da8-9686-818db5089f9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:19.272694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-39a749dd-f311-4da8-9686-818db5089f9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:18:19.386197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:19.403085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-603b882d-5f9f-4fd1-b23c-56f4b7e6fe1a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:19.417885 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-603b882d-5f9f-4fd1-b23c-56f4b7e6fe1a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1737 microversion: 2.1 time: 0.345059 Oct 04 21:18:19.434750 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1384/2855] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:19 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1737 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:19.434750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2fdcf98c-a3db-4482-9aae-f2fcce4070a2 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Calling method '.version_select at 0x7f57907c9d30>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:19.451080 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2fdcf98c-a3db-4482-9aae-f2fcce4070a2 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-771895749" status: 200 len: 512 microversion: 2.2 time: 0.029106 Oct 04 21:18:19.456244 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1385/2856] 10.222.0.30 () {60 vars in 1255 bytes} [Tue Oct 4 21:18:19 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-771895749 => generated 512 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:19.462547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2d92437f-ca61-4ee9-9e36-1c7a5f668162 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b952160>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:19.588558 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2d92437f-ca61-4ee9-9e36-1c7a5f668162 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.130492 Oct 04 21:18:19.596878 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1386/2857] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:19 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:19.596878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3efd79a5-97dd-4381-afd6-0c8eb47a80ae tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Calling method '.version_select at 0x7f57903a8430>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:19.598814 n-d-860282-1 devstack@n-api.service[122757]: WARNING oslo_db.sqlalchemy.utils [None req-3efd79a5-97dd-4381-afd6-0c8eb47a80ae tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 21:18:19.608452 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3efd79a5-97dd-4381-afd6-0c8eb47a80ae tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.018229 Oct 04 21:18:19.609448 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1387/2858] 10.222.0.30 () {60 vars in 1177 bytes} [Tue Oct 4 21:18:19 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:19.630780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-87b38086-7795-422f-beb5-6f667afd3c40 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Calling method '.version_select at 0x7f57908d5820>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:19.788323 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-87b38086-7795-422f-beb5-6f667afd3c40 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-771895749" status: 204 len: 0 microversion: 2.2 time: 0.171025 Oct 04 21:18:19.788965 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1388/2859] 10.222.0.30 () {60 vars in 1258 bytes} [Tue Oct 4 21:18:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-771895749 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:18:19.802516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d05d305a-a7b4-4850-a148-8dc9ccb09ab6 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Action: 'create', calling method: .version_select at 0x7f57908eaca0>, body: {"keypair": {"name": "tempest-keypair-1960163226", "type": "x509"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:19.829318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-d05d305a-a7b4-4850-a148-8dc9ccb09ab6 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Getting quotas for project fd6672e131c9465e90831ae6bd6e6279. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:18:19.848001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-d05d305a-a7b4-4850-a148-8dc9ccb09ab6 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Getting quotas for user f94a0902dc5e4264b7a9b0e724bed685 and project fd6672e131c9465e90831ae6bd6e6279. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:18:19.862875 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-39a749dd-f311-4da8-9686-818db5089f9c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "DELETE /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 204 len: 0 microversion: 2.1 time: 0.735402 Oct 04 21:18:19.867002 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1472/2860] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:18:19 2022] DELETE /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 0 bytes in 739 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:18:19.873073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4b48cd9f-aad8-4601-8fed-1673fcd1c87e tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:19.876854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4b48cd9f-aad8-4601-8fed-1673fcd1c87e tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:19.881027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.processutils [None req-d05d305a-a7b4-4850-a148-8dc9ccb09ab6 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp285vxuv_/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp285vxuv_/temp.key -subj /CN=f94a0902dc5e4264b7a9b0e724bed685 -extensions v3_req_client {{(pid=122757) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 21:18:19.888623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b48cd9f-aad8-4601-8fed-1673fcd1c87e tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:19.890500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b48cd9f-aad8-4601-8fed-1673fcd1c87e tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:19.891306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b48cd9f-aad8-4601-8fed-1673fcd1c87e tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:19.892198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b48cd9f-aad8-4601-8fed-1673fcd1c87e tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:19.898864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b48cd9f-aad8-4601-8fed-1673fcd1c87e tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:19.898864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b48cd9f-aad8-4601-8fed-1673fcd1c87e tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:20.312937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4b48cd9f-aad8-4601-8fed-1673fcd1c87e tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:20.316991 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4b48cd9f-aad8-4601-8fed-1673fcd1c87e tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1808 microversion: 2.1 time: 0.448336 Oct 04 21:18:20.317828 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1473/2861] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:19 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1808 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:20.319805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.processutils [None req-d05d305a-a7b4-4850-a148-8dc9ccb09ab6 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp285vxuv_/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp285vxuv_/temp.key -subj /CN=f94a0902dc5e4264b7a9b0e724bed685 -extensions v3_req_client" returned: 0 in 0.438s {{(pid=122757) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 21:18:20.322451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.processutils [None req-d05d305a-a7b4-4850-a148-8dc9ccb09ab6 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp285vxuv_/temp.key -password pass: {{(pid=122757) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 21:18:20.323278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fc597914-1354-48f8-9e6e-d54630ca57a5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:20.324259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fc597914-1354-48f8-9e6e-d54630ca57a5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:20.331136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc597914-1354-48f8-9e6e-d54630ca57a5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:20.332513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc597914-1354-48f8-9e6e-d54630ca57a5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:20.333126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc597914-1354-48f8-9e6e-d54630ca57a5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:20.334049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc597914-1354-48f8-9e6e-d54630ca57a5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:20.334738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc597914-1354-48f8-9e6e-d54630ca57a5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:20.335358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc597914-1354-48f8-9e6e-d54630ca57a5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:20.432364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.processutils [None req-d05d305a-a7b4-4850-a148-8dc9ccb09ab6 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp285vxuv_/temp.key -password pass:" returned: 0 in 0.109s {{(pid=122757) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 21:18:20.452014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fc597914-1354-48f8-9e6e-d54630ca57a5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:20.467444 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fc597914-1354-48f8-9e6e-d54630ca57a5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1291 microversion: 2.1 time: 0.148499 Oct 04 21:18:20.481448 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1474/2862] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:20 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1291 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:20.488456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0c11202c-3b0c-4b1f-adfe-904c707ad5c2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:20.490814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0c11202c-3b0c-4b1f-adfe-904c707ad5c2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:20.507673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c11202c-3b0c-4b1f-adfe-904c707ad5c2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:20.508183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c11202c-3b0c-4b1f-adfe-904c707ad5c2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:20.509723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c11202c-3b0c-4b1f-adfe-904c707ad5c2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:20.512585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c11202c-3b0c-4b1f-adfe-904c707ad5c2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:20.513973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c11202c-3b0c-4b1f-adfe-904c707ad5c2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:20.515104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c11202c-3b0c-4b1f-adfe-904c707ad5c2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:20.640164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-d05d305a-a7b4-4850-a148-8dc9ccb09ab6 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Getting quotas for project fd6672e131c9465e90831ae6bd6e6279. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:18:20.660091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-d05d305a-a7b4-4850-a148-8dc9ccb09ab6 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Getting quotas for user f94a0902dc5e4264b7a9b0e724bed685 and project fd6672e131c9465e90831ae6bd6e6279. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:18:20.712885 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d05d305a-a7b4-4850-a148-8dc9ccb09ab6 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.914186 Oct 04 21:18:20.721881 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1389/2863] 10.222.0.30 () {62 vars in 1198 bytes} [Tue Oct 4 21:18:19 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 924 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:18:20.734502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5439d89a-fbcd-4cb0-a5f9-a2a3d20ad292 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578ba9a9d0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:20.818010 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5439d89a-fbcd-4cb0-a5f9-a2a3d20ad292 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.092503 Oct 04 21:18:20.820910 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1390/2864] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:20 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:20.833233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-38ef0525-5bf1-4911-bf0e-30b87775a4b1 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Calling method '.version_select at 0x7f57905fc0d0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:20.845663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0c11202c-3b0c-4b1f-adfe-904c707ad5c2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:20.869684 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0c11202c-3b0c-4b1f-adfe-904c707ad5c2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1737 microversion: 2.1 time: 0.400099 Oct 04 21:18:20.878300 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-38ef0525-5bf1-4911-bf0e-30b87775a4b1 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-1960163226" status: 200 len: 1534 microversion: 2.2 time: 0.050560 Oct 04 21:18:20.878511 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1475/2865] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:20 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1737 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:20.880745 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1391/2866] 10.222.0.30 () {60 vars in 1258 bytes} [Tue Oct 4 21:18:20 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1960163226 => generated 1534 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:20.900706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1b8a195d-fdda-4d6e-a802-2ba0f83c0de2 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Calling method '.version_select at 0x7f578bf2e280>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:20.906719 n-d-860282-1 devstack@n-api.service[122758]: WARNING oslo_db.sqlalchemy.utils [None req-1b8a195d-fdda-4d6e-a802-2ba0f83c0de2 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 21:18:20.923902 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1b8a195d-fdda-4d6e-a802-2ba0f83c0de2 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.039629 Oct 04 21:18:20.924492 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1476/2867] 10.222.0.30 () {60 vars in 1177 bytes} [Tue Oct 4 21:18:20 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:20.938093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-af87e717-018a-4c6f-984a-9f6050991246 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] Calling method '.version_select at 0x7f57908d58b0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:21.102255 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-af87e717-018a-4c6f-984a-9f6050991246 tempest-KeyPairsV22TestJSON-1073701207 tempest-KeyPairsV22TestJSON-1073701207-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1960163226" status: 204 len: 0 microversion: 2.2 time: 0.168784 Oct 04 21:18:21.107177 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1392/2868] 10.222.0.30 () {60 vars in 1261 bytes} [Tue Oct 4 21:18:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1960163226 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:18:21.349519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1d31190a-10b6-4826-a744-a879aac99067 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:21.350167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1d31190a-10b6-4826-a744-a879aac99067 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:21.365269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d31190a-10b6-4826-a744-a879aac99067 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:21.365790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d31190a-10b6-4826-a744-a879aac99067 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:21.373652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d31190a-10b6-4826-a744-a879aac99067 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:21.374494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d31190a-10b6-4826-a744-a879aac99067 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:21.374971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d31190a-10b6-4826-a744-a879aac99067 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:21.375408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d31190a-10b6-4826-a744-a879aac99067 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:21.496582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6b632b17-4ed8-4584-a14a-a5049b5f7f66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:21.497784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6b632b17-4ed8-4584-a14a-a5049b5f7f66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:21.511644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b632b17-4ed8-4584-a14a-a5049b5f7f66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:21.515658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b632b17-4ed8-4584-a14a-a5049b5f7f66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:21.516094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b632b17-4ed8-4584-a14a-a5049b5f7f66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:21.516903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b632b17-4ed8-4584-a14a-a5049b5f7f66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:21.517364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b632b17-4ed8-4584-a14a-a5049b5f7f66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:21.522034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b632b17-4ed8-4584-a14a-a5049b5f7f66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:21.732536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6b632b17-4ed8-4584-a14a-a5049b5f7f66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:21.742553 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6b632b17-4ed8-4584-a14a-a5049b5f7f66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1291 microversion: 2.1 time: 0.250897 Oct 04 21:18:21.746139 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1393/2869] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:21 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1291 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:21.836613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cab0fbea-9c33-40c8-a514-bb64adbcc369 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57905fc3a0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:21.909311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1d31190a-10b6-4826-a744-a879aac99067 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:21.926292 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1d31190a-10b6-4826-a744-a879aac99067 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1808 microversion: 2.1 time: 0.580295 Oct 04 21:18:21.948048 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1477/2870] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:21 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1808 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:21.956859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0997746c-2817-48ad-9280-29cfa3bb7d2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:21.958042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0997746c-2817-48ad-9280-29cfa3bb7d2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:21.960444 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cab0fbea-9c33-40c8-a514-bb64adbcc369 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.128439 Oct 04 21:18:21.962381 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1394/2871] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:21 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:21.983977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0997746c-2817-48ad-9280-29cfa3bb7d2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:21.988989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0997746c-2817-48ad-9280-29cfa3bb7d2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:21.989755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0997746c-2817-48ad-9280-29cfa3bb7d2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:21.998432 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0997746c-2817-48ad-9280-29cfa3bb7d2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:22.002034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0997746c-2817-48ad-9280-29cfa3bb7d2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:22.002781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0997746c-2817-48ad-9280-29cfa3bb7d2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:22.513718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0997746c-2817-48ad-9280-29cfa3bb7d2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:22.527123 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0997746c-2817-48ad-9280-29cfa3bb7d2c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1717 microversion: 2.1 time: 0.577666 Oct 04 21:18:22.549627 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1478/2872] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:21 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1717 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:22.698482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7b8e997d-b0bf-4912-9b06-15be82374b32 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:22.699362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7b8e997d-b0bf-4912-9b06-15be82374b32 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:22.707163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b8e997d-b0bf-4912-9b06-15be82374b32 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:22.707964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b8e997d-b0bf-4912-9b06-15be82374b32 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:22.708606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b8e997d-b0bf-4912-9b06-15be82374b32 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:22.768543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b8e997d-b0bf-4912-9b06-15be82374b32 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:22.768543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b8e997d-b0bf-4912-9b06-15be82374b32 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:22.768543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b8e997d-b0bf-4912-9b06-15be82374b32 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:22.771927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e557a00b-41e6-4cd0-80a6-dc3870e57f92 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:22.772217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e557a00b-41e6-4cd0-80a6-dc3870e57f92 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:22.779050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e557a00b-41e6-4cd0-80a6-dc3870e57f92 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:22.779572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e557a00b-41e6-4cd0-80a6-dc3870e57f92 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:22.780018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e557a00b-41e6-4cd0-80a6-dc3870e57f92 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:22.780725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e557a00b-41e6-4cd0-80a6-dc3870e57f92 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:22.781190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e557a00b-41e6-4cd0-80a6-dc3870e57f92 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:22.781641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e557a00b-41e6-4cd0-80a6-dc3870e57f92 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:22.804509 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-7b8e997d-b0bf-4912-9b06-15be82374b32 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] HTTP exception thrown: Cannot 'detach_volume' instance 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 while it is in vm_state rescued Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7b8e997d-b0bf-4912-9b06-15be82374b32 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Request method failure captured: Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments/50200069-1862-4da1-96ff-3d771d5f66fb HTTP/1.1 Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKIzNXd_CmvP-6Usf8igAzY3dlzgDYn--v5mxvj-LpxllWzzbFyJF08JoJ1PYfhtDQRJAhrGh_znPsymYAfveamBdA6vz1Y-oh2GJa7UDnV-tTkHC5ZL-7fb_GflotkDarrlFSqHRvs9b0CJFd3T0swEf2S9AMDAGMNIk353xt2G0b4 Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 047ff2c9b6414ce8b98364678cbfeb53 Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/047ff2c9b6414ce8b98364678cbfeb53"}]}] Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 047ff2c9b6414ce8b98364678cbfeb53 Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerRescueNegativeTestJSON-548947322-project Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: abb3ac58c2ea4e2da8b9e765eda5f333 Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerRescueNegativeTestJSON-548947322-project Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: exception: Cannot 'detach_volume' instance 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 while it is in vm_state rescued Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'server_id': '2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3', 'id': '50200069-1862-4da1-96ff-3d771d5f66fb'} Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 while it is in vm_state rescued Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:18:22.806145 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:22.811637 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:22.811637 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:22.811637 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:22.811637 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:22.811637 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 while it is in vm_state rescued Oct 04 21:18:22.811637 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:18:22.811637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7b8e997d-b0bf-4912-9b06-15be82374b32 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Returning 409 to user: Cannot 'detach_volume' instance 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 while it is in vm_state rescued {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:22.812476 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7b8e997d-b0bf-4912-9b06-15be82374b32 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments/50200069-1862-4da1-96ff-3d771d5f66fb" status: 409 len: 152 microversion: 2.1 time: 0.118270 Oct 04 21:18:22.812476 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1395/2873] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 21:18:22 2022] DELETE /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments/50200069-1862-4da1-96ff-3d771d5f66fb => generated 152 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:18:22.818257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d20ef7dc-b144-4ece-8274-9b8ed6f839f3 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:22.818780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d20ef7dc-b144-4ece-8274-9b8ed6f839f3 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:22.826521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d20ef7dc-b144-4ece-8274-9b8ed6f839f3 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:22.827399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d20ef7dc-b144-4ece-8274-9b8ed6f839f3 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:22.828003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d20ef7dc-b144-4ece-8274-9b8ed6f839f3 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:22.828720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d20ef7dc-b144-4ece-8274-9b8ed6f839f3 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:22.829216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d20ef7dc-b144-4ece-8274-9b8ed6f839f3 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:22.829737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d20ef7dc-b144-4ece-8274-9b8ed6f839f3 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:22.860352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d20ef7dc-b144-4ece-8274-9b8ed6f839f3 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:18:22.868415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e557a00b-41e6-4cd0-80a6-dc3870e57f92 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:22.883884 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e557a00b-41e6-4cd0-80a6-dc3870e57f92 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1297 microversion: 2.1 time: 0.118131 Oct 04 21:18:22.889768 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1479/2874] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:22 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1297 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:22.894835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c551f8e3-fd3f-4c22-b2c8-e1cf0882d712 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:22.895375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c551f8e3-fd3f-4c22-b2c8-e1cf0882d712 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:22.930046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c551f8e3-fd3f-4c22-b2c8-e1cf0882d712 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:22.931547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c551f8e3-fd3f-4c22-b2c8-e1cf0882d712 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:22.938849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c551f8e3-fd3f-4c22-b2c8-e1cf0882d712 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:22.938849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c551f8e3-fd3f-4c22-b2c8-e1cf0882d712 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:22.938849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c551f8e3-fd3f-4c22-b2c8-e1cf0882d712 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:22.938849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c551f8e3-fd3f-4c22-b2c8-e1cf0882d712 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:23.294256 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c551f8e3-fd3f-4c22-b2c8-e1cf0882d712 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "POST /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/action" status: 202 len: 0 microversion: 2.1 time: 0.401171 Oct 04 21:18:23.298207 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1480/2875] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:18:22 2022] POST /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:18:23.318820 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d20ef7dc-b144-4ece-8274-9b8ed6f839f3 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1" status: 204 len: 0 microversion: 2.1 time: 0.505218 Oct 04 21:18:23.321546 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1396/2876] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:18:22 2022] DELETE /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:18:23.332748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3de0c21a-26b3-454f-8c56-1969ae357479 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57908d5b80>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:23.333410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8c34ad9a-1af0-4b24-92de-f6dea8190f47 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:23.338870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8c34ad9a-1af0-4b24-92de-f6dea8190f47 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:23.395282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c34ad9a-1af0-4b24-92de-f6dea8190f47 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:23.399859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c34ad9a-1af0-4b24-92de-f6dea8190f47 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:23.400713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c34ad9a-1af0-4b24-92de-f6dea8190f47 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:23.401666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c34ad9a-1af0-4b24-92de-f6dea8190f47 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:23.402316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c34ad9a-1af0-4b24-92de-f6dea8190f47 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:23.404013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c34ad9a-1af0-4b24-92de-f6dea8190f47 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:23.456091 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3de0c21a-26b3-454f-8c56-1969ae357479 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1454 microversion: 2.1 time: 0.134269 Oct 04 21:18:23.458434 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1397/2877] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:23 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:23.468603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-d5b701e6-c8a7-47a9-85fb-58fe2522b9f7 req-2b115741-ac9c-46f1-b76b-09be63a299a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "482e4179-2301-47d7-87dd-4deec4941c5e", "name": "network-vif-deleted", "tag": "85c8e826-4719-4a5a-8acb-5453352e3a57"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:23.495764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d5b701e6-c8a7-47a9-85fb-58fe2522b9f7 req-2b115741-ac9c-46f1-b76b-09be63a299a0 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:23.499562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d5b701e6-c8a7-47a9-85fb-58fe2522b9f7 req-2b115741-ac9c-46f1-b76b-09be63a299a0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:23.500381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d5b701e6-c8a7-47a9-85fb-58fe2522b9f7 req-2b115741-ac9c-46f1-b76b-09be63a299a0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:23.526935 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-d5b701e6-c8a7-47a9-85fb-58fe2522b9f7 req-2b115741-ac9c-46f1-b76b-09be63a299a0 service nova] Creating event network-vif-deleted:85c8e826-4719-4a5a-8acb-5453352e3a57 for instance 482e4179-2301-47d7-87dd-4deec4941c5e on n-h2-860282-1 Oct 04 21:18:23.537132 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-d5b701e6-c8a7-47a9-85fb-58fe2522b9f7 req-2b115741-ac9c-46f1-b76b-09be63a299a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076396 Oct 04 21:18:23.538963 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1398/2878] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:23.548110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a98c44e4-bb7d-4d54-8954-d11af5cc87fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:23.549193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a98c44e4-bb7d-4d54-8954-d11af5cc87fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:23.558609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a98c44e4-bb7d-4d54-8954-d11af5cc87fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:23.560335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a98c44e4-bb7d-4d54-8954-d11af5cc87fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:23.560956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a98c44e4-bb7d-4d54-8954-d11af5cc87fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:23.561929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a98c44e4-bb7d-4d54-8954-d11af5cc87fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:23.562608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a98c44e4-bb7d-4d54-8954-d11af5cc87fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:23.563264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a98c44e4-bb7d-4d54-8954-d11af5cc87fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:24.491819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8c34ad9a-1af0-4b24-92de-f6dea8190f47 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:24.491819 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8c34ad9a-1af0-4b24-92de-f6dea8190f47 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1787 microversion: 2.1 time: 1.097234 Oct 04 21:18:24.491819 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1481/2879] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:23 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1787 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:24.491819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1139da89-44aa-4420-90ee-3186ef4d8fb1 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:24.491819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1139da89-44aa-4420-90ee-3186ef4d8fb1 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:24.491819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1139da89-44aa-4420-90ee-3186ef4d8fb1 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:24.491819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1139da89-44aa-4420-90ee-3186ef4d8fb1 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:24.491819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1139da89-44aa-4420-90ee-3186ef4d8fb1 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:24.491819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1139da89-44aa-4420-90ee-3186ef4d8fb1 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:24.491819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1139da89-44aa-4420-90ee-3186ef4d8fb1 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:24.491819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1139da89-44aa-4420-90ee-3186ef4d8fb1 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:24.546471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a98c44e4-bb7d-4d54-8954-d11af5cc87fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:24.564452 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a98c44e4-bb7d-4d54-8954-d11af5cc87fd tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1725 microversion: 2.1 time: 1.024094 Oct 04 21:18:24.566250 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1399/2880] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:23 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1725 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:24.574119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0926c8f6-9d7c-44f0-8076-cc4e351628c3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:24.579100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0926c8f6-9d7c-44f0-8076-cc4e351628c3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:24.586304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0926c8f6-9d7c-44f0-8076-cc4e351628c3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:24.587323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0926c8f6-9d7c-44f0-8076-cc4e351628c3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:24.588258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0926c8f6-9d7c-44f0-8076-cc4e351628c3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:24.623882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0926c8f6-9d7c-44f0-8076-cc4e351628c3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:24.623882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0926c8f6-9d7c-44f0-8076-cc4e351628c3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:24.623882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0926c8f6-9d7c-44f0-8076-cc4e351628c3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:25.003082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1139da89-44aa-4420-90ee-3186ef4d8fb1 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:25.012070 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1139da89-44aa-4420-90ee-3186ef4d8fb1 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1" status: 200 len: 1514 microversion: 2.1 time: 0.611140 Oct 04 21:18:25.013107 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1482/2881] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:24 2022] GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1 => generated 1514 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:25.018014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0e9c4db3-1b62-4c3e-928f-63c6aca69a8b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578bf3aaf0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:25.071668 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0e9c4db3-1b62-4c3e-928f-63c6aca69a8b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1463 microversion: 2.1 time: 0.057002 Oct 04 21:18:25.072486 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1483/2882] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:25 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1463 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:25.088191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-561fe189-8ed7-4a75-95eb-267927d51df2 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57943bb1f0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:25.164265 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-561fe189-8ed7-4a75-95eb-267927d51df2 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 200 len: 1463 microversion: 2.1 time: 0.080182 Oct 04 21:18:25.166373 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1484/2883] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:25 2022] GET /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 1463 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:25.182150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3d3df7c9-b924-4a43-866b-bf8400722b30 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:25.183739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3d3df7c9-b924-4a43-866b-bf8400722b30 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 142c6da5-e828-4e2b-bfef-0cf163f0c97c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:25.201915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d3df7c9-b924-4a43-866b-bf8400722b30 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:25.205087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d3df7c9-b924-4a43-866b-bf8400722b30 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:25.205913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d3df7c9-b924-4a43-866b-bf8400722b30 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:25.211681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d3df7c9-b924-4a43-866b-bf8400722b30 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:25.212471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d3df7c9-b924-4a43-866b-bf8400722b30 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:25.213081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d3df7c9-b924-4a43-866b-bf8400722b30 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:25.618898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0926c8f6-9d7c-44f0-8076-cc4e351628c3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:25.633205 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0926c8f6-9d7c-44f0-8076-cc4e351628c3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1363 microversion: 2.1 time: 1.065417 Oct 04 21:18:25.637138 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1400/2884] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:24 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1363 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:25.647146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-48bf8b58-5549-4ff3-ae2d-5a900b434294 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:25.650249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-48bf8b58-5549-4ff3-ae2d-5a900b434294 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:25.663593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48bf8b58-5549-4ff3-ae2d-5a900b434294 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:25.664225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48bf8b58-5549-4ff3-ae2d-5a900b434294 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:25.664762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48bf8b58-5549-4ff3-ae2d-5a900b434294 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:25.665796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48bf8b58-5549-4ff3-ae2d-5a900b434294 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:25.667196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48bf8b58-5549-4ff3-ae2d-5a900b434294 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:25.667863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48bf8b58-5549-4ff3-ae2d-5a900b434294 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:25.749925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:25.905980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-48bf8b58-5549-4ff3-ae2d-5a900b434294 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:25.926214 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-48bf8b58-5549-4ff3-ae2d-5a900b434294 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1609 microversion: 2.1 time: 0.275774 Oct 04 21:18:25.926660 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1401/2885] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:25 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1609 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:25.938146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-02682f91-0246-4b7d-9eb1-dfad543ca526 req-f39ffc9c-c1b8-4cdc-8528-bfb71ae81f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "482e4179-2301-47d7-87dd-4deec4941c5e", "name": "network-vif-deleted", "tag": "16ca2f59-07cc-44f9-b717-987aa1fe45be"}, {"server_uuid": "482e4179-2301-47d7-87dd-4deec4941c5e", "name": "network-vif-deleted", "tag": "c945153b-4121-409e-8626-dde6cbf57cff"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:25.949200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-02682f91-0246-4b7d-9eb1-dfad543ca526 req-f39ffc9c-c1b8-4cdc-8528-bfb71ae81f71 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:25.949908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-02682f91-0246-4b7d-9eb1-dfad543ca526 req-f39ffc9c-c1b8-4cdc-8528-bfb71ae81f71 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:25.950581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-02682f91-0246-4b7d-9eb1-dfad543ca526 req-f39ffc9c-c1b8-4cdc-8528-bfb71ae81f71 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:25.963776 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-02682f91-0246-4b7d-9eb1-dfad543ca526 req-f39ffc9c-c1b8-4cdc-8528-bfb71ae81f71 service nova] Creating event network-vif-deleted:16ca2f59-07cc-44f9-b717-987aa1fe45be for instance 482e4179-2301-47d7-87dd-4deec4941c5e on n-h2-860282-1 Oct 04 21:18:25.964637 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-02682f91-0246-4b7d-9eb1-dfad543ca526 req-f39ffc9c-c1b8-4cdc-8528-bfb71ae81f71 service nova] Creating event network-vif-deleted:c945153b-4121-409e-8626-dde6cbf57cff for instance 482e4179-2301-47d7-87dd-4deec4941c5e on n-h2-860282-1 Oct 04 21:18:25.970032 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-02682f91-0246-4b7d-9eb1-dfad543ca526 req-f39ffc9c-c1b8-4cdc-8528-bfb71ae81f71 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041700 Oct 04 21:18:25.971126 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1402/2886] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:25.979233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-843cb408-e969-42f3-af51-8558e1b6f1c0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:25.980241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-843cb408-e969-42f3-af51-8558e1b6f1c0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:25.987166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-843cb408-e969-42f3-af51-8558e1b6f1c0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:25.988923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-843cb408-e969-42f3-af51-8558e1b6f1c0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:25.989651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-843cb408-e969-42f3-af51-8558e1b6f1c0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:25.990571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-843cb408-e969-42f3-af51-8558e1b6f1c0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:25.991206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-843cb408-e969-42f3-af51-8558e1b6f1c0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:25.991836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-843cb408-e969-42f3-af51-8558e1b6f1c0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:26.355937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3d3df7c9-b924-4a43-866b-bf8400722b30 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:26.403840 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3d3df7c9-b924-4a43-866b-bf8400722b30 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c" status: 200 len: 1481 microversion: 2.1 time: 1.225591 Oct 04 21:18:26.407141 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1485/2887] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:25 2022] GET /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c => generated 1481 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:26.426274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-c8a783b6-1e73-4552-9813-b3c9efc2f278 req-71343779-0946-4109-bf67-0f3e2bb7fe41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2998012-afa9-4e41-a256-724e7dafffd1", "name": "network-vif-unplugged", "status": "completed", "tag": "5d810375-1682-40cb-b5e9-507e068e95c9"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:26.459778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c8a783b6-1e73-4552-9813-b3c9efc2f278 req-71343779-0946-4109-bf67-0f3e2bb7fe41 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:26.460293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c8a783b6-1e73-4552-9813-b3c9efc2f278 req-71343779-0946-4109-bf67-0f3e2bb7fe41 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:26.460741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c8a783b6-1e73-4552-9813-b3c9efc2f278 req-71343779-0946-4109-bf67-0f3e2bb7fe41 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:26.465066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-843cb408-e969-42f3-af51-8558e1b6f1c0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:26.487819 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-843cb408-e969-42f3-af51-8558e1b6f1c0 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1725 microversion: 2.1 time: 0.514722 Oct 04 21:18:26.491160 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1403/2888] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:25 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1725 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:26.499557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-01265338-eb1f-4ce9-9610-7fdabc85a677 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:26.501061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-01265338-eb1f-4ce9-9610-7fdabc85a677 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:26.503109 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-c8a783b6-1e73-4552-9813-b3c9efc2f278 req-71343779-0946-4109-bf67-0f3e2bb7fe41 service nova] Creating event network-vif-unplugged:5d810375-1682-40cb-b5e9-507e068e95c9 for instance d2998012-afa9-4e41-a256-724e7dafffd1 on n-h2-860282-1 Oct 04 21:18:26.523571 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-c8a783b6-1e73-4552-9813-b3c9efc2f278 req-71343779-0946-4109-bf67-0f3e2bb7fe41 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111913 Oct 04 21:18:26.524079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01265338-eb1f-4ce9-9610-7fdabc85a677 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:26.524211 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1486/2889] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:26.526109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01265338-eb1f-4ce9-9610-7fdabc85a677 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:26.526663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01265338-eb1f-4ce9-9610-7fdabc85a677 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:26.529326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01265338-eb1f-4ce9-9610-7fdabc85a677 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:26.529933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01265338-eb1f-4ce9-9610-7fdabc85a677 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:26.530465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01265338-eb1f-4ce9-9610-7fdabc85a677 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:26.657841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d2aa77b3-a365-4e56-b862-1bd033be62d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:26.658578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d2aa77b3-a365-4e56-b862-1bd033be62d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:26.665741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2aa77b3-a365-4e56-b862-1bd033be62d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:26.666530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2aa77b3-a365-4e56-b862-1bd033be62d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:26.666979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2aa77b3-a365-4e56-b862-1bd033be62d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:26.667690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2aa77b3-a365-4e56-b862-1bd033be62d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:26.668154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2aa77b3-a365-4e56-b862-1bd033be62d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:26.669356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2aa77b3-a365-4e56-b862-1bd033be62d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:26.913094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-01265338-eb1f-4ce9-9610-7fdabc85a677 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:26.919772 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-01265338-eb1f-4ce9-9610-7fdabc85a677 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1" status: 200 len: 1514 microversion: 2.1 time: 0.426159 Oct 04 21:18:26.920377 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1404/2890] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:26 2022] GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1 => generated 1514 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:26.943875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3c424512-bfac-4289-9a7c-e7e783b02805 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:26.944503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3c424512-bfac-4289-9a7c-e7e783b02805 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:26.954190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c424512-bfac-4289-9a7c-e7e783b02805 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:26.955958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c424512-bfac-4289-9a7c-e7e783b02805 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:26.959132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c424512-bfac-4289-9a7c-e7e783b02805 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:26.959956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c424512-bfac-4289-9a7c-e7e783b02805 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:26.961589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c424512-bfac-4289-9a7c-e7e783b02805 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:26.969119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c424512-bfac-4289-9a7c-e7e783b02805 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:27.016000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c424512-bfac-4289-9a7c-e7e783b02805 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:27.017314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c424512-bfac-4289-9a7c-e7e783b02805 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:27.018007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c424512-bfac-4289-9a7c-e7e783b02805 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:27.018639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-3c424512-bfac-4289-9a7c-e7e783b02805 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lazy-loading 'fault' on Instance uuid 482e4179-2301-47d7-87dd-4deec4941c5e {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:18:27.110658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d2aa77b3-a365-4e56-b862-1bd033be62d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:27.130479 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d2aa77b3-a365-4e56-b862-1bd033be62d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1363 microversion: 2.1 time: 0.477741 Oct 04 21:18:27.135719 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1487/2891] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:26 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1363 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:27.151498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3c424512-bfac-4289-9a7c-e7e783b02805 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:27.164822 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3c424512-bfac-4289-9a7c-e7e783b02805 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 200 len: 1303 microversion: 2.1 time: 0.223576 Oct 04 21:18:27.167215 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1405/2892] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:26 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 1303 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:27.356988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-ecc10146-ce67-4478-805c-2f7bb563a2b6 req-308ec6a2-c912-4016-88d5-eb14d65980ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2998012-afa9-4e41-a256-724e7dafffd1", "name": "network-vif-deleted", "tag": "5d810375-1682-40cb-b5e9-507e068e95c9"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:27.381058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ecc10146-ce67-4478-805c-2f7bb563a2b6 req-308ec6a2-c912-4016-88d5-eb14d65980ee service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:27.381948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ecc10146-ce67-4478-805c-2f7bb563a2b6 req-308ec6a2-c912-4016-88d5-eb14d65980ee service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:27.382735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ecc10146-ce67-4478-805c-2f7bb563a2b6 req-308ec6a2-c912-4016-88d5-eb14d65980ee service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:27.408061 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-ecc10146-ce67-4478-805c-2f7bb563a2b6 req-308ec6a2-c912-4016-88d5-eb14d65980ee service nova] Creating event network-vif-deleted:5d810375-1682-40cb-b5e9-507e068e95c9 for instance d2998012-afa9-4e41-a256-724e7dafffd1 on n-h2-860282-1 Oct 04 21:18:27.417382 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-ecc10146-ce67-4478-805c-2f7bb563a2b6 req-308ec6a2-c912-4016-88d5-eb14d65980ee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065021 Oct 04 21:18:27.418578 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1406/2893] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:27.447126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-014c3723-9aed-4df6-b60a-0b0d8e087fc2 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:27.450356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-014c3723-9aed-4df6-b60a-0b0d8e087fc2 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 142c6da5-e828-4e2b-bfef-0cf163f0c97c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:27.495087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-014c3723-9aed-4df6-b60a-0b0d8e087fc2 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:27.495087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-014c3723-9aed-4df6-b60a-0b0d8e087fc2 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:27.495087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-014c3723-9aed-4df6-b60a-0b0d8e087fc2 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:27.497780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-014c3723-9aed-4df6-b60a-0b0d8e087fc2 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:27.498972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-014c3723-9aed-4df6-b60a-0b0d8e087fc2 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:27.501806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-014c3723-9aed-4df6-b60a-0b0d8e087fc2 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:27.554917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-94a0d837-d877-41f2-89d5-bff40487ef5c tempest-AbsoluteLimitsTestJSON-173949731 tempest-AbsoluteLimitsTestJSON-173949731-project] Calling method '.version_select at 0x7f57943bbaf0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:27.565951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:27.598766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94a0d837-d877-41f2-89d5-bff40487ef5c tempest-AbsoluteLimitsTestJSON-173949731 tempest-AbsoluteLimitsTestJSON-173949731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:27.601493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94a0d837-d877-41f2-89d5-bff40487ef5c tempest-AbsoluteLimitsTestJSON-173949731 tempest-AbsoluteLimitsTestJSON-173949731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:27.603770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94a0d837-d877-41f2-89d5-bff40487ef5c tempest-AbsoluteLimitsTestJSON-173949731 tempest-AbsoluteLimitsTestJSON-173949731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:27.605701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94a0d837-d877-41f2-89d5-bff40487ef5c tempest-AbsoluteLimitsTestJSON-173949731 tempest-AbsoluteLimitsTestJSON-173949731-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:27.612779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94a0d837-d877-41f2-89d5-bff40487ef5c tempest-AbsoluteLimitsTestJSON-173949731 tempest-AbsoluteLimitsTestJSON-173949731-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:27.612779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94a0d837-d877-41f2-89d5-bff40487ef5c tempest-AbsoluteLimitsTestJSON-173949731 tempest-AbsoluteLimitsTestJSON-173949731-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:27.656734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:27.663037 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-94a0d837-d877-41f2-89d5-bff40487ef5c tempest-AbsoluteLimitsTestJSON-173949731 tempest-AbsoluteLimitsTestJSON-173949731-project] 10.222.0.30 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.509521 Oct 04 21:18:27.665393 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1488/2894] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 21:18:27 2022] GET /compute/v2.1/limits => generated 511 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:27.688851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2243e876-8ee1-4184-9c4d-b654a785be17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:27.695133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2243e876-8ee1-4184-9c4d-b654a785be17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:27.718250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2243e876-8ee1-4184-9c4d-b654a785be17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:27.718770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2243e876-8ee1-4184-9c4d-b654a785be17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:27.719222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2243e876-8ee1-4184-9c4d-b654a785be17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:27.722382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2243e876-8ee1-4184-9c4d-b654a785be17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:27.722889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2243e876-8ee1-4184-9c4d-b654a785be17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:27.725066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2243e876-8ee1-4184-9c4d-b654a785be17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:28.086563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2243e876-8ee1-4184-9c4d-b654a785be17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:28.102533 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2243e876-8ee1-4184-9c4d-b654a785be17 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1725 microversion: 2.1 time: 0.435858 Oct 04 21:18:28.103496 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1489/2895] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:27 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1725 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:28.110948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-014c3723-9aed-4df6-b60a-0b0d8e087fc2 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:28.130565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-94083a32-2f2a-4ffb-ae22-8caca272f713 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:28.132004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-94083a32-2f2a-4ffb-ae22-8caca272f713 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:28.138043 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-014c3723-9aed-4df6-b60a-0b0d8e087fc2 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c" status: 200 len: 1468 microversion: 2.1 time: 0.706532 Oct 04 21:18:28.138861 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1407/2896] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:27 2022] GET /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c => generated 1468 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:28.146979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94083a32-2f2a-4ffb-ae22-8caca272f713 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:28.157797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-813b8ec2-b7af-46d0-84b3-6438a4d67e7c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:28.158849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-813b8ec2-b7af-46d0-84b3-6438a4d67e7c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:28.159280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94083a32-2f2a-4ffb-ae22-8caca272f713 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:28.160888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94083a32-2f2a-4ffb-ae22-8caca272f713 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:28.170115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94083a32-2f2a-4ffb-ae22-8caca272f713 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:28.170272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:28.170384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94083a32-2f2a-4ffb-ae22-8caca272f713 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:28.170718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94083a32-2f2a-4ffb-ae22-8caca272f713 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:28.193265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-813b8ec2-b7af-46d0-84b3-6438a4d67e7c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:28.198725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-813b8ec2-b7af-46d0-84b3-6438a4d67e7c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:28.198725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-813b8ec2-b7af-46d0-84b3-6438a4d67e7c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:28.198725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-813b8ec2-b7af-46d0-84b3-6438a4d67e7c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:28.198725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-813b8ec2-b7af-46d0-84b3-6438a4d67e7c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:28.198725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-813b8ec2-b7af-46d0-84b3-6438a4d67e7c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:28.257930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94083a32-2f2a-4ffb-ae22-8caca272f713 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:28.260984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94083a32-2f2a-4ffb-ae22-8caca272f713 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:28.261610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94083a32-2f2a-4ffb-ae22-8caca272f713 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:28.262173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-94083a32-2f2a-4ffb-ae22-8caca272f713 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lazy-loading 'fault' on Instance uuid d2998012-afa9-4e41-a256-724e7dafffd1 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:18:28.513301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-94083a32-2f2a-4ffb-ae22-8caca272f713 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:28.529808 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-94083a32-2f2a-4ffb-ae22-8caca272f713 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1" status: 200 len: 1308 microversion: 2.1 time: 0.422246 Oct 04 21:18:28.546610 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1490/2897] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:28 2022] GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1 => generated 1308 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:28.582664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4ca82d97-fbf5-4c51-ba23-96f9e9cb3ed9 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1649378278"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:28.589345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4ca82d97-fbf5-4c51-ba23-96f9e9cb3ed9 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:28.606209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ca82d97-fbf5-4c51-ba23-96f9e9cb3ed9 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:28.606702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ca82d97-fbf5-4c51-ba23-96f9e9cb3ed9 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:28.607337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ca82d97-fbf5-4c51-ba23-96f9e9cb3ed9 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:28.608056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ca82d97-fbf5-4c51-ba23-96f9e9cb3ed9 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:28.608513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ca82d97-fbf5-4c51-ba23-96f9e9cb3ed9 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:28.608929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ca82d97-fbf5-4c51-ba23-96f9e9cb3ed9 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:28.675209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:28.759798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-813b8ec2-b7af-46d0-84b3-6438a4d67e7c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:28.768193 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-813b8ec2-b7af-46d0-84b3-6438a4d67e7c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1363 microversion: 2.1 time: 0.614277 Oct 04 21:18:28.769411 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1408/2898] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:28 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1363 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:28.779518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-41211a21-4807-4983-8d41-443ae4373c46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:28.782287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-41211a21-4807-4983-8d41-443ae4373c46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:28.799585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41211a21-4807-4983-8d41-443ae4373c46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:28.799585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41211a21-4807-4983-8d41-443ae4373c46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:28.803079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41211a21-4807-4983-8d41-443ae4373c46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:28.805627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41211a21-4807-4983-8d41-443ae4373c46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:28.806188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41211a21-4807-4983-8d41-443ae4373c46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:28.806721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41211a21-4807-4983-8d41-443ae4373c46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:28.827398 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-41211a21-4807-4983-8d41-443ae4373c46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] HTTP exception thrown: Instance 482e4179-2301-47d7-87dd-4deec4941c5e could not be found. Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-41211a21-4807-4983-8d41-443ae4373c46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Request method failure captured: Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e HTTP/1.1 Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKLcwPJZ8BFTEuqDtMxAImJz3XsKs4gMFM2qCkQqFXYPHnNouRE7IwZhcL7USpsNi_8IGxPbhSD2vOll168UXaBcWFBjXWPesouh7toWqjfq5ybs5ua5t3Afq9PtCVYWEv8jx_Cu7ASHgX8-tqlJ3_yXGdYlcz_msLDc9B5_9PYP5D4 Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 74ce0d9253774aca92d405f137285093 Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestMultiNic-871972287 Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74ce0d9253774aca92d405f137285093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_74ce0d9253774aca92d405f137285093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/74ce0d9253774aca92d405f137285093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74ce0d9253774aca92d405f137285093"}]}] Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestMultiNic-871972287 Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 74ce0d9253774aca92d405f137285093 Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestMultiNic-871972287 Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestMultiNic-871972287-project Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3603c26fffba42e5805fd595f33d5c62 Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestMultiNic-871972287-project Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 482e4179-2301-47d7-87dd-4deec4941c5e could not be found. Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '482e4179-2301-47d7-87dd-4deec4941c5e'} Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 482e4179-2301-47d7-87dd-4deec4941c5e could not be found. Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 482e4179-2301-47d7-87dd-4deec4941c5e could not be found. Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:28.829333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:18:28.836293 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:28.836293 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:28.836293 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:28.836293 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:28.836293 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:28.836293 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 482e4179-2301-47d7-87dd-4deec4941c5e could not be found. Oct 04 21:18:28.836293 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:18:28.842371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-41211a21-4807-4983-8d41-443ae4373c46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Returning 404 to user: Instance 482e4179-2301-47d7-87dd-4deec4941c5e could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:28.845065 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-41211a21-4807-4983-8d41-443ae4373c46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 404 len: 111 microversion: 2.1 time: 0.070809 Oct 04 21:18:28.849338 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1409/2899] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:28 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:29.133599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e955169b-d8b1-46ab-a555-e041cb015395 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:29.134948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e955169b-d8b1-46ab-a555-e041cb015395 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:29.148649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e955169b-d8b1-46ab-a555-e041cb015395 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:29.149173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e955169b-d8b1-46ab-a555-e041cb015395 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:29.149670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e955169b-d8b1-46ab-a555-e041cb015395 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:29.150405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e955169b-d8b1-46ab-a555-e041cb015395 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:29.150869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e955169b-d8b1-46ab-a555-e041cb015395 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:29.151716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e955169b-d8b1-46ab-a555-e041cb015395 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:29.309635 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4ca82d97-fbf5-4c51-ba23-96f9e9cb3ed9 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "POST /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc/action" status: 202 len: 0 microversion: 2.1 time: 0.737003 Oct 04 21:18:29.313990 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1491/2900] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:18:28 2022] POST /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc/action => generated 0 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 21:18:29.327694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-4e6a7a6e-f0c0-48d6-8b22-d7812aae99ae req-f5e33b6d-c565-4211-90e4-e3897d435732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "142c6da5-e828-4e2b-bfef-0cf163f0c97c", "name": "network-vif-unplugged", "status": "completed", "tag": "35ab7e07-58e9-4ae2-bb54-f90bc14398d7"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:29.369103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4e6a7a6e-f0c0-48d6-8b22-d7812aae99ae req-f5e33b6d-c565-4211-90e4-e3897d435732 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:29.372498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4e6a7a6e-f0c0-48d6-8b22-d7812aae99ae req-f5e33b6d-c565-4211-90e4-e3897d435732 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:29.373170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4e6a7a6e-f0c0-48d6-8b22-d7812aae99ae req-f5e33b6d-c565-4211-90e4-e3897d435732 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:29.402553 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-4e6a7a6e-f0c0-48d6-8b22-d7812aae99ae req-f5e33b6d-c565-4211-90e4-e3897d435732 service nova] Creating event network-vif-unplugged:35ab7e07-58e9-4ae2-bb54-f90bc14398d7 for instance 142c6da5-e828-4e2b-bfef-0cf163f0c97c on n-h1-860282-1 Oct 04 21:18:29.417287 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-4e6a7a6e-f0c0-48d6-8b22-d7812aae99ae req-f5e33b6d-c565-4211-90e4-e3897d435732 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092759 Oct 04 21:18:29.417287 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1492/2901] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:29.417287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a32f7f13-cd48-41b9-935c-dc15504386f1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57943bbca0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:29.484628 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a32f7f13-cd48-41b9-935c-dc15504386f1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.073377 Oct 04 21:18:29.485991 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1493/2902] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:29 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:29.559468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8e62ff15-65bb-4c37-b7b4-df28b713ef4e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:29.560643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8e62ff15-65bb-4c37-b7b4-df28b713ef4e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: d2998012-afa9-4e41-a256-724e7dafffd1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:29.570990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e62ff15-65bb-4c37-b7b4-df28b713ef4e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:29.578336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e62ff15-65bb-4c37-b7b4-df28b713ef4e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:29.578336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e62ff15-65bb-4c37-b7b4-df28b713ef4e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:29.578336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e62ff15-65bb-4c37-b7b4-df28b713ef4e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:29.586257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e62ff15-65bb-4c37-b7b4-df28b713ef4e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:29.586983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e62ff15-65bb-4c37-b7b4-df28b713ef4e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:29.616793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e955169b-d8b1-46ab-a555-e041cb015395 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:29.618995 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-8e62ff15-65bb-4c37-b7b4-df28b713ef4e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] HTTP exception thrown: Instance d2998012-afa9-4e41-a256-724e7dafffd1 could not be found. Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8e62ff15-65bb-4c37-b7b4-df28b713ef4e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Request method failure captured: Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1 HTTP/1.1 Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKKKDoDXTUzwx1y3fvMpbjpNqOsO_K5Xu5-uEYQJSxdsD1ONLKOBTSa-GZpJFae7yFitIj7O6jwJfOwBuI6PVpv9m6Nnb2NcDVJhZM5dT3M5S1zH45Nwo2UFRq-z29DiFKQS7PzLKsFZxn96wJCrlUvVL3cSgI1NPM0A0Pop-nxX0kw Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 188383bbf07f4ad5b2d4d4ec4380fad7 Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-VolumesAdminNegativeTest-557242693 Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/188383bbf07f4ad5b2d4d4ec4380fad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_188383bbf07f4ad5b2d4d4ec4380fad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/188383bbf07f4ad5b2d4d4ec4380fad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/188383bbf07f4ad5b2d4d4ec4380fad7"}]}] Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-VolumesAdminNegativeTest-557242693 Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 188383bbf07f4ad5b2d4d4ec4380fad7 Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-557242693 Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-VolumesAdminNegativeTest-557242693-project Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: f6389e7e01d042678fed8cdf6d8b8625 Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-VolumesAdminNegativeTest-557242693-project Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance d2998012-afa9-4e41-a256-724e7dafffd1 could not be found. Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'd2998012-afa9-4e41-a256-724e7dafffd1'} Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2998012-afa9-4e41-a256-724e7dafffd1 could not be found. Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2998012-afa9-4e41-a256-724e7dafffd1 could not be found. Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:29.621162 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:18:29.625156 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:29.625156 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:29.625156 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:29.625156 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:29.625156 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:29.625156 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2998012-afa9-4e41-a256-724e7dafffd1 could not be found. Oct 04 21:18:29.625156 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:18:29.627427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8e62ff15-65bb-4c37-b7b4-df28b713ef4e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Returning 404 to user: Instance d2998012-afa9-4e41-a256-724e7dafffd1 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:29.634174 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8e62ff15-65bb-4c37-b7b4-df28b713ef4e tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1" status: 404 len: 111 microversion: 2.1 time: 0.076822 Oct 04 21:18:29.634977 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e955169b-d8b1-46ab-a555-e041cb015395 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1731 microversion: 2.1 time: 0.505774 Oct 04 21:18:29.637916 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1494/2903] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:29 2022] GET /compute/v2.1/servers/d2998012-afa9-4e41-a256-724e7dafffd1 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:18:29.638182 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1410/2904] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:29 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1731 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:29.647355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-a97ee0c2-47f0-4d16-818d-8102e5d4cb54 req-de1ce3dc-c9f8-4931-b8f6-3f5cdcbb6d38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba61f85c-a75d-451d-a5f7-f9533481c406", "tag": "34504880-4c91-4512-980a-45596f508743"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:29.675685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a97ee0c2-47f0-4d16-818d-8102e5d4cb54 req-de1ce3dc-c9f8-4931-b8f6-3f5cdcbb6d38 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:29.676114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5dc77fa3-fa98-48fe-b2d6-c9e6d3490dda tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:29.676309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5dc77fa3-fa98-48fe-b2d6-c9e6d3490dda tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:29.677990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a97ee0c2-47f0-4d16-818d-8102e5d4cb54 req-de1ce3dc-c9f8-4931-b8f6-3f5cdcbb6d38 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:29.679564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a97ee0c2-47f0-4d16-818d-8102e5d4cb54 req-de1ce3dc-c9f8-4931-b8f6-3f5cdcbb6d38 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:29.696768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5dc77fa3-fa98-48fe-b2d6-c9e6d3490dda tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:29.697274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5dc77fa3-fa98-48fe-b2d6-c9e6d3490dda tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:29.704200 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-a97ee0c2-47f0-4d16-818d-8102e5d4cb54 req-de1ce3dc-c9f8-4931-b8f6-3f5cdcbb6d38 service nova] Creating event network-changed:34504880-4c91-4512-980a-45596f508743 for instance ba61f85c-a75d-451d-a5f7-f9533481c406 on n-h2-860282-1 Oct 04 21:18:29.709897 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-a97ee0c2-47f0-4d16-818d-8102e5d4cb54 req-de1ce3dc-c9f8-4931-b8f6-3f5cdcbb6d38 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070356 Oct 04 21:18:29.710819 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1495/2905] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:29.712008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5dc77fa3-fa98-48fe-b2d6-c9e6d3490dda tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:29.714512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5dc77fa3-fa98-48fe-b2d6-c9e6d3490dda tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:29.715037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5dc77fa3-fa98-48fe-b2d6-c9e6d3490dda tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:29.715493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5dc77fa3-fa98-48fe-b2d6-c9e6d3490dda tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:29.798058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-05cf1837-b04a-465f-b6c3-83c7e4c8b81c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:29.799345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-05cf1837-b04a-465f-b6c3-83c7e4c8b81c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:29.816805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05cf1837-b04a-465f-b6c3-83c7e4c8b81c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:29.822658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05cf1837-b04a-465f-b6c3-83c7e4c8b81c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:29.824092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05cf1837-b04a-465f-b6c3-83c7e4c8b81c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:29.825254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05cf1837-b04a-465f-b6c3-83c7e4c8b81c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:29.825911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05cf1837-b04a-465f-b6c3-83c7e4c8b81c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:29.826707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05cf1837-b04a-465f-b6c3-83c7e4c8b81c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:30.083956 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5dc77fa3-fa98-48fe-b2d6-c9e6d3490dda tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.419156 Oct 04 21:18:30.084883 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1411/2906] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:18:29 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-interface => generated 285 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:30.502355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-70ee7ea5-25e7-45e5-b0a0-759471c1c49e tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790631940>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:30.580600 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-70ee7ea5-25e7-45e5-b0a0-759471c1c49e tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.082675 Oct 04 21:18:30.582131 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1412/2907] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:30 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:30.610102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-05cf1837-b04a-465f-b6c3-83c7e4c8b81c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:30.628768 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-05cf1837-b04a-465f-b6c3-83c7e4c8b81c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1363 microversion: 2.1 time: 0.834613 Oct 04 21:18:30.629482 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1496/2908] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:29 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1363 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:31.594347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=26 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:31.606998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7a1d8f2f-b8bd-485e-bec3-81384fdb447e tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57900b8430>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:31.657899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-30eec65b-599d-4071-9cd0-fc2240247851 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:31.659968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-30eec65b-599d-4071-9cd0-fc2240247851 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:31.680778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30eec65b-599d-4071-9cd0-fc2240247851 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:31.681526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30eec65b-599d-4071-9cd0-fc2240247851 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:31.682130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30eec65b-599d-4071-9cd0-fc2240247851 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:31.683450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30eec65b-599d-4071-9cd0-fc2240247851 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:31.684140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30eec65b-599d-4071-9cd0-fc2240247851 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:31.684812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30eec65b-599d-4071-9cd0-fc2240247851 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:31.696077 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7a1d8f2f-b8bd-485e-bec3-81384fdb447e tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.099956 Oct 04 21:18:31.698543 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1413/2909] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:31 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:31.726970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5e4067f2-43e3-4735-a315-b98cae023b2d tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Action: 'create', calling method: .version_select at 0x7f578b95faf0>, body: {"keypair": {"name": "tempest-keypair-1447739478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuQXscvNtC5CdARBsyGtCQvk0DbcuEWzGnNdr3/zxkZEVd8X68in5C/35SmgeoJoHWY12308D4/p20dAEOttNFGVjAss9TdJhzRQnGckfYVnBO3IyuIt/W6BWrwJsPF+w=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:31.788279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5e4067f2-43e3-4735-a315-b98cae023b2d tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Getting quotas for project b1bcb8b6a67e463d9cec9f0aa581c2e5. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:18:31.805091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5e4067f2-43e3-4735-a315-b98cae023b2d tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Getting quotas for user f7d792ce0a9f4f6da9406759dd9d665c and project b1bcb8b6a67e463d9cec9f0aa581c2e5. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:18:31.921642 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5e4067f2-43e3-4735-a315-b98cae023b2d tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.220835 Oct 04 21:18:31.922301 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1414/2910] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Oct 4 21:18:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 223 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:18:32.064839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-30eec65b-599d-4071-9cd0-fc2240247851 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:32.079053 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-30eec65b-599d-4071-9cd0-fc2240247851 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1363 microversion: 2.1 time: 0.425314 Oct 04 21:18:32.080175 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1497/2911] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:31 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1363 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:32.715634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2a2c05c0-36d4-4910-b512-9c2184388548 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b9048b0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:32.788127 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2a2c05c0-36d4-4910-b512-9c2184388548 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.077270 Oct 04 21:18:32.790362 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1415/2912] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:32 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:33.107509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-95f33fa6-0786-455c-9d40-5979da576e55 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:33.108272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-95f33fa6-0786-455c-9d40-5979da576e55 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:33.117517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95f33fa6-0786-455c-9d40-5979da576e55 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:33.118537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95f33fa6-0786-455c-9d40-5979da576e55 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:33.119228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95f33fa6-0786-455c-9d40-5979da576e55 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:33.120161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95f33fa6-0786-455c-9d40-5979da576e55 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:33.121067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95f33fa6-0786-455c-9d40-5979da576e55 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:33.121775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95f33fa6-0786-455c-9d40-5979da576e55 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:33.151883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b4070dd7-2f83-4fde-9c28-3c6266241fab req-88f0ceca-67cd-4190-be96-0d1ce3a8952f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3", "tag": "4c39a316-efc6-4f59-97f7-911c7414ee28"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:33.172051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b4070dd7-2f83-4fde-9c28-3c6266241fab req-88f0ceca-67cd-4190-be96-0d1ce3a8952f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:33.173769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b4070dd7-2f83-4fde-9c28-3c6266241fab req-88f0ceca-67cd-4190-be96-0d1ce3a8952f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:33.174517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b4070dd7-2f83-4fde-9c28-3c6266241fab req-88f0ceca-67cd-4190-be96-0d1ce3a8952f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:33.208516 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b4070dd7-2f83-4fde-9c28-3c6266241fab req-88f0ceca-67cd-4190-be96-0d1ce3a8952f service nova] Creating event network-changed:4c39a316-efc6-4f59-97f7-911c7414ee28 for instance 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 on n-h1-860282-1 Oct 04 21:18:33.218612 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b4070dd7-2f83-4fde-9c28-3c6266241fab req-88f0ceca-67cd-4190-be96-0d1ce3a8952f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071231 Oct 04 21:18:33.219947 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1416/2913] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:18:33.600973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-95f33fa6-0786-455c-9d40-5979da576e55 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:33.613695 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-95f33fa6-0786-455c-9d40-5979da576e55 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1363 microversion: 2.1 time: 0.510148 Oct 04 21:18:33.614547 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1498/2914] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:33 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1363 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:33.809886 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-94688d6f-3c5a-427a-a286-007b630c32dc tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b904d30>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:33.904981 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-94688d6f-3c5a-427a-a286-007b630c32dc tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.102704 Oct 04 21:18:33.906740 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1417/2915] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:33 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:34.667312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6008c0d7-5a91-4a96-bee8-f4828b45e3f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:34.668641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6008c0d7-5a91-4a96-bee8-f4828b45e3f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:34.678986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6008c0d7-5a91-4a96-bee8-f4828b45e3f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:34.679818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6008c0d7-5a91-4a96-bee8-f4828b45e3f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:34.680427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6008c0d7-5a91-4a96-bee8-f4828b45e3f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:34.682781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6008c0d7-5a91-4a96-bee8-f4828b45e3f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:34.683419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6008c0d7-5a91-4a96-bee8-f4828b45e3f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:34.684040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6008c0d7-5a91-4a96-bee8-f4828b45e3f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:34.921760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-10c1da84-5c92-489d-88db-2acb118bb100 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578ba9a4c0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:35.007614 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-10c1da84-5c92-489d-88db-2acb118bb100 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.090718 Oct 04 21:18:35.010513 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1418/2916] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:34 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:35.168640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6008c0d7-5a91-4a96-bee8-f4828b45e3f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:35.189780 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6008c0d7-5a91-4a96-bee8-f4828b45e3f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1363 microversion: 2.1 time: 0.544489 Oct 04 21:18:35.210568 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1499/2917] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:34 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1363 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:35.333941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-18680eea-5f4b-4f5c-a5fe-80e8c01523e6 req-e88109e6-de5d-4b8e-b2f1-d75054001f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3", "tag": "4c39a316-efc6-4f59-97f7-911c7414ee28"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:35.356738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-18680eea-5f4b-4f5c-a5fe-80e8c01523e6 req-e88109e6-de5d-4b8e-b2f1-d75054001f77 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:35.364891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-18680eea-5f4b-4f5c-a5fe-80e8c01523e6 req-e88109e6-de5d-4b8e-b2f1-d75054001f77 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:35.365677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-18680eea-5f4b-4f5c-a5fe-80e8c01523e6 req-e88109e6-de5d-4b8e-b2f1-d75054001f77 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:35.409078 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-18680eea-5f4b-4f5c-a5fe-80e8c01523e6 req-e88109e6-de5d-4b8e-b2f1-d75054001f77 service nova] Creating event network-changed:4c39a316-efc6-4f59-97f7-911c7414ee28 for instance 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 on n-h1-860282-1 Oct 04 21:18:35.430564 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-18680eea-5f4b-4f5c-a5fe-80e8c01523e6 req-e88109e6-de5d-4b8e-b2f1-d75054001f77 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101950 Oct 04 21:18:35.439266 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1419/2918] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:18:35.663625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-61df9bbf-7e94-4a96-8479-f030d7cbd91c tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:35.665509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-61df9bbf-7e94-4a96-8479-f030d7cbd91c tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:35.676394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61df9bbf-7e94-4a96-8479-f030d7cbd91c tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:35.682292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61df9bbf-7e94-4a96-8479-f030d7cbd91c tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:35.683504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61df9bbf-7e94-4a96-8479-f030d7cbd91c tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:35.685704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61df9bbf-7e94-4a96-8479-f030d7cbd91c tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:35.686400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61df9bbf-7e94-4a96-8479-f030d7cbd91c tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:35.687014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61df9bbf-7e94-4a96-8479-f030d7cbd91c tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:35.767620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-61df9bbf-7e94-4a96-8479-f030d7cbd91c tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:18:36.026563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b93ac05c-1dee-43b1-a9ec-98ff6ee05643 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b8ff700>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:36.117040 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b93ac05c-1dee-43b1-a9ec-98ff6ee05643 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.095416 Oct 04 21:18:36.117765 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1420/2919] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:36 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:36.247413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-46c2dd2c-515b-41a9-aa89-2d7ec5b42a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:36.248444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-46c2dd2c-515b-41a9-aa89-2d7ec5b42a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:36.276031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46c2dd2c-515b-41a9-aa89-2d7ec5b42a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:36.276788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46c2dd2c-515b-41a9-aa89-2d7ec5b42a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:36.276972 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-61df9bbf-7e94-4a96-8479-f030d7cbd91c tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031" status: 204 len: 0 microversion: 2.1 time: 0.617337 Oct 04 21:18:36.277693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46c2dd2c-515b-41a9-aa89-2d7ec5b42a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:36.278035 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1500/2920] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:18:35 2022] DELETE /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:18:36.278913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46c2dd2c-515b-41a9-aa89-2d7ec5b42a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:36.279570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46c2dd2c-515b-41a9-aa89-2d7ec5b42a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:36.280795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46c2dd2c-515b-41a9-aa89-2d7ec5b42a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:36.287820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-14313ad5-8a46-4825-bf23-a82a318398db tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:36.290174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-14313ad5-8a46-4825-bf23-a82a318398db tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:36.337214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14313ad5-8a46-4825-bf23-a82a318398db tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:36.337854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14313ad5-8a46-4825-bf23-a82a318398db tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:36.338321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14313ad5-8a46-4825-bf23-a82a318398db tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:36.339078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14313ad5-8a46-4825-bf23-a82a318398db tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:36.339546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14313ad5-8a46-4825-bf23-a82a318398db tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:36.350495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14313ad5-8a46-4825-bf23-a82a318398db tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:37.157762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-46c2dd2c-515b-41a9-aa89-2d7ec5b42a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:37.167529 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-46c2dd2c-515b-41a9-aa89-2d7ec5b42a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1363 microversion: 2.1 time: 0.934665 Oct 04 21:18:37.178479 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1421/2921] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:36 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1363 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:37.193906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5a185450-d047-411e-b69f-a8d48606d82b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b90c700>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:37.263008 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5a185450-d047-411e-b69f-a8d48606d82b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.082430 Oct 04 21:18:37.271669 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1422/2922] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:37 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:37.590920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=26 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:37.629571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:37.675193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-14313ad5-8a46-4825-bf23-a82a318398db tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:37.689227 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-14313ad5-8a46-4825-bf23-a82a318398db tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031" status: 200 len: 1680 microversion: 2.1 time: 1.402314 Oct 04 21:18:37.690536 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1501/2923] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:36 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 => generated 1680 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:37.724118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-64fa7f17-b461-4b04-b0b9-f56bb4e8dc04 req-0a906573-44b1-4b39-a638-9c1b162832b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc", "name": "network-vif-plugged", "status": "completed", "tag": "7b5a9c4b-694b-4147-95a1-a4e92206db0b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:37.765975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-64fa7f17-b461-4b04-b0b9-f56bb4e8dc04 req-0a906573-44b1-4b39-a638-9c1b162832b1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:37.766729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-64fa7f17-b461-4b04-b0b9-f56bb4e8dc04 req-0a906573-44b1-4b39-a638-9c1b162832b1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:37.767337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-64fa7f17-b461-4b04-b0b9-f56bb4e8dc04 req-0a906573-44b1-4b39-a638-9c1b162832b1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:37.808046 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-64fa7f17-b461-4b04-b0b9-f56bb4e8dc04 req-0a906573-44b1-4b39-a638-9c1b162832b1 service nova] Creating event network-vif-plugged:7b5a9c4b-694b-4147-95a1-a4e92206db0b for instance 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc on n-h1-860282-1 Oct 04 21:18:37.820878 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-64fa7f17-b461-4b04-b0b9-f56bb4e8dc04 req-0a906573-44b1-4b39-a638-9c1b162832b1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102603 Oct 04 21:18:37.826360 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1423/2924] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:38.206695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7839d02b-018d-49cf-a524-d68861adb573 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:38.207436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7839d02b-018d-49cf-a524-d68861adb573 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:38.227415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7839d02b-018d-49cf-a524-d68861adb573 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:38.227907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7839d02b-018d-49cf-a524-d68861adb573 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:38.230751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7839d02b-018d-49cf-a524-d68861adb573 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:38.233670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7839d02b-018d-49cf-a524-d68861adb573 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:38.234532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7839d02b-018d-49cf-a524-d68861adb573 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:38.236390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7839d02b-018d-49cf-a524-d68861adb573 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:38.292927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f7519f6e-63bb-4c5c-aaad-30c4c6fc5548 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b90c1f0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:38.415866 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f7519f6e-63bb-4c5c-aaad-30c4c6fc5548 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.140885 Oct 04 21:18:38.417945 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1424/2925] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:38 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:38.717841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fbcfd60b-3539-4a8f-8234-2618d7e1b178 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:38.718594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fbcfd60b-3539-4a8f-8234-2618d7e1b178 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:38.738907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fbcfd60b-3539-4a8f-8234-2618d7e1b178 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:38.742307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fbcfd60b-3539-4a8f-8234-2618d7e1b178 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:38.743648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fbcfd60b-3539-4a8f-8234-2618d7e1b178 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:38.746998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fbcfd60b-3539-4a8f-8234-2618d7e1b178 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:38.751129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fbcfd60b-3539-4a8f-8234-2618d7e1b178 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:38.759441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fbcfd60b-3539-4a8f-8234-2618d7e1b178 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:39.530938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7839d02b-018d-49cf-a524-d68861adb573 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:39.548032 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7839d02b-018d-49cf-a524-d68861adb573 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1363 microversion: 2.1 time: 1.343848 Oct 04 21:18:39.548972 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1502/2926] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:38 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1363 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:39.563172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b09a418f-58cf-4a03-a0a2-a7e18c13a187 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57900b81f0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:39.657232 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b09a418f-58cf-4a03-a0a2-a7e18c13a187 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.106843 Oct 04 21:18:39.658899 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1503/2927] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:39 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:39.920986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fbcfd60b-3539-4a8f-8234-2618d7e1b178 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:39.945165 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fbcfd60b-3539-4a8f-8234-2618d7e1b178 tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031" status: 200 len: 1680 microversion: 2.1 time: 1.226177 Oct 04 21:18:39.945165 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1425/2928] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:38 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 => generated 1680 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:39.949980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-90bb4295-c1d3-49f2-a083-a9dac511cc2f req-14e35852-7959-41cb-8d8f-e9de370f516e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba61f85c-a75d-451d-a5f7-f9533481c406", "name": "network-vif-plugged", "status": "completed", "tag": "34504880-4c91-4512-980a-45596f508743"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:39.977651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-90bb4295-c1d3-49f2-a083-a9dac511cc2f req-14e35852-7959-41cb-8d8f-e9de370f516e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:39.978136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-90bb4295-c1d3-49f2-a083-a9dac511cc2f req-14e35852-7959-41cb-8d8f-e9de370f516e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:39.978571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-90bb4295-c1d3-49f2-a083-a9dac511cc2f req-14e35852-7959-41cb-8d8f-e9de370f516e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:39.998772 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-90bb4295-c1d3-49f2-a083-a9dac511cc2f req-14e35852-7959-41cb-8d8f-e9de370f516e service nova] Creating event network-vif-plugged:34504880-4c91-4512-980a-45596f508743 for instance ba61f85c-a75d-451d-a5f7-f9533481c406 on n-h2-860282-1 Oct 04 21:18:40.022715 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-90bb4295-c1d3-49f2-a083-a9dac511cc2f req-14e35852-7959-41cb-8d8f-e9de370f516e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076689 Oct 04 21:18:40.028599 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1504/2929] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:40.504701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1970626624", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e31bd866-4752-489e-bd55-be7e86028b98"}, {"port": "39ddb102-5195-44fc-a97d-9cec4b059f51", "tag": "port-1"}, {"port": "a8c25e3b-fbff-43dd-a188-c7127b5919b0", "tag": "port-2"}, {"uuid": "49a0fcd3-1fab-4c12-a677-2814606a28c1", "tag": "net-1"}, {"uuid": "49a0fcd3-1fab-4c12-a677-2814606a28c1"}, {"uuid": "de7c2b60-4484-42c4-aec1-342fc6b6aab8", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "de7c2b60-4484-42c4-aec1-342fc6b6aab8", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "62e69620-0564-4304-9ee4-18e17f042fc6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "40c462bd-d3fc-4635-b77c-63bad1da4e55", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "9f663b09-0efe-4a6d-a975-b5bc2d94c9b5", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1618148324"}], "key_name": "tempest-keypair-1447739478", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:40.578831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6be44514-dbb5-4b7a-9642-b34031f60766 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:40.580249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6be44514-dbb5-4b7a-9642-b34031f60766 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:40.594758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6be44514-dbb5-4b7a-9642-b34031f60766 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:40.595749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6be44514-dbb5-4b7a-9642-b34031f60766 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:40.596216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6be44514-dbb5-4b7a-9642-b34031f60766 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:40.596985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6be44514-dbb5-4b7a-9642-b34031f60766 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:40.597539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6be44514-dbb5-4b7a-9642-b34031f60766 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:40.604954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6be44514-dbb5-4b7a-9642-b34031f60766 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:41.501884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] validate_networks() for [('e31bd866-4752-489e-bd55-be7e86028b98', None, None, None, None, None), (None, None, '39ddb102-5195-44fc-a97d-9cec4b059f51', None, None, None), (None, None, 'a8c25e3b-fbff-43dd-a188-c7127b5919b0', None, None, None), ('49a0fcd3-1fab-4c12-a677-2814606a28c1', None, None, None, None, None), ('49a0fcd3-1fab-4c12-a677-2814606a28c1', None, None, None, None, None), ('de7c2b60-4484-42c4-aec1-342fc6b6aab8', '10.2.2.100', None, None, None, None), ('de7c2b60-4484-42c4-aec1-342fc6b6aab8', '10.2.2.200', None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:18:41.513094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6be44514-dbb5-4b7a-9642-b34031f60766 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:41.521908 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6be44514-dbb5-4b7a-9642-b34031f60766 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1363 microversion: 2.1 time: 0.951086 Oct 04 21:18:41.525613 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1505/2930] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:40 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1363 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:41.533016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f85a19df-f300-482d-84b6-2f6753ee1bda tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790b3d5e0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:41.604242 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f85a19df-f300-482d-84b6-2f6753ee1bda tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.077443 Oct 04 21:18:41.610721 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1506/2931] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:41 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:41.617390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-77b2d4e2-ab92-4cda-95c2-7f99ee2cc1ee tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:41.618054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-77b2d4e2-ab92-4cda-95c2-7f99ee2cc1ee tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:41.640874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77b2d4e2-ab92-4cda-95c2-7f99ee2cc1ee tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:41.640874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77b2d4e2-ab92-4cda-95c2-7f99ee2cc1ee tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:41.640874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77b2d4e2-ab92-4cda-95c2-7f99ee2cc1ee tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:41.640874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77b2d4e2-ab92-4cda-95c2-7f99ee2cc1ee tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:41.640874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77b2d4e2-ab92-4cda-95c2-7f99ee2cc1ee tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:41.649783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77b2d4e2-ab92-4cda-95c2-7f99ee2cc1ee tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:42.152546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-77b2d4e2-ab92-4cda-95c2-7f99ee2cc1ee tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6389e7e01d042678fed8cdf6d8b8625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188383bbf07f4ad5b2d4d4ec4380fad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:42.166767 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-77b2d4e2-ab92-4cda-95c2-7f99ee2cc1ee tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031" status: 200 len: 1612 microversion: 2.1 time: 0.554497 Oct 04 21:18:42.171627 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1507/2932] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:41 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 => generated 1612 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:42.187503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6987080a-31c2-4b0b-984e-29a4a3648d20 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1348966561", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "4dc520ef-77c0-4b9d-b338-4904f775a51f"}, {"uuid": "0bb5cf5f-5a44-45fb-8ee9-62d00de303e5"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:42.355005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-6987080a-31c2-4b0b-984e-29a4a3648d20 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] validate_networks() for [('4dc520ef-77c0-4b9d-b338-4904f775a51f', None, None, None, None, None), ('0bb5cf5f-5a44-45fb-8ee9-62d00de303e5', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:18:42.724473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:46.103393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6987080a-31c2-4b0b-984e-29a4a3648d20 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:18:46.104474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6987080a-31c2-4b0b-984e-29a4a3648d20 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:18:46.105173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6987080a-31c2-4b0b-984e-29a4a3648d20 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:18:46.105450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6987080a-31c2-4b0b-984e-29a4a3648d20 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:18:46.105910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6987080a-31c2-4b0b-984e-29a4a3648d20 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:18:46.201523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6987080a-31c2-4b0b-984e-29a4a3648d20 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:46.207662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6987080a-31c2-4b0b-984e-29a4a3648d20 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:46.210443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6987080a-31c2-4b0b-984e-29a4a3648d20 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:46.211526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6987080a-31c2-4b0b-984e-29a4a3648d20 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:46.214452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6987080a-31c2-4b0b-984e-29a4a3648d20 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:46.215858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6987080a-31c2-4b0b-984e-29a4a3648d20 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:46.267955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-6987080a-31c2-4b0b-984e-29a4a3648d20 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Getting quotas for project 74ce0d9253774aca92d405f137285093. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:18:46.275241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-6987080a-31c2-4b0b-984e-29a4a3648d20 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Getting quotas for user 3603c26fffba42e5805fd595f33d5c62 and project 74ce0d9253774aca92d405f137285093. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:18:46.305463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6987080a-31c2-4b0b-984e-29a4a3648d20 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:18:46.305463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6987080a-31c2-4b0b-984e-29a4a3648d20 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:18:46.595373 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6987080a-31c2-4b0b-984e-29a4a3648d20 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.421413 Oct 04 21:18:46.600584 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1508/2933] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:18:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 4427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:18:46.616337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-712cb1e4-7426-4641-9155-8dff3e120128 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:46.618320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-712cb1e4-7426-4641-9155-8dff3e120128 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:46.664512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-712cb1e4-7426-4641-9155-8dff3e120128 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:46.665398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-712cb1e4-7426-4641-9155-8dff3e120128 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:46.667522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-712cb1e4-7426-4641-9155-8dff3e120128 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:46.668526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-712cb1e4-7426-4641-9155-8dff3e120128 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:46.669392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-712cb1e4-7426-4641-9155-8dff3e120128 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:46.673403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-712cb1e4-7426-4641-9155-8dff3e120128 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:47.095999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-712cb1e4-7426-4641-9155-8dff3e120128 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:47.120393 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-712cb1e4-7426-4641-9155-8dff3e120128 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1549 microversion: 2.1 time: 0.510497 Oct 04 21:18:47.138750 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1509/2934] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:46 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1549 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:47.147287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-934959ab-9d6f-4adf-8cdb-100b8c63e9ee tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578bf5e430>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:47.289198 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-934959ab-9d6f-4adf-8cdb-100b8c63e9ee tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.165524 Oct 04 21:18:47.301676 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1510/2935] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:47 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:47.339415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1bea2949-4bd6-4d36-8013-a944960d59ca tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:47.339415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1bea2949-4bd6-4d36-8013-a944960d59ca tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] [instance: 3a399223-e902-4114-9172-784bf7c1e031] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:47.354330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1bea2949-4bd6-4d36-8013-a944960d59ca tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:47.355239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1bea2949-4bd6-4d36-8013-a944960d59ca tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:47.358541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1bea2949-4bd6-4d36-8013-a944960d59ca tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:47.360565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1bea2949-4bd6-4d36-8013-a944960d59ca tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:47.363917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1bea2949-4bd6-4d36-8013-a944960d59ca tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:47.372783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1bea2949-4bd6-4d36-8013-a944960d59ca tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:47.434765 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-1bea2949-4bd6-4d36-8013-a944960d59ca tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] HTTP exception thrown: Instance 3a399223-e902-4114-9172-784bf7c1e031 could not be found. Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1bea2949-4bd6-4d36-8013-a944960d59ca tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Request method failure captured: Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 HTTP/1.1 Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKKKDoDXTUzwx1y3fvMpbjpNqOsO_K5Xu5-uEYQJSxdsD1ONLKOBTSa-GZpJFae7yFitIj7O6jwJfOwBuI6PVpv9m6Nnb2NcDVJhZM5dT3M5S1zH45Nwo2UFRq-z29DiFKQS7PzLKsFZxn96wJCrlUvVL3cSgI1NPM0A0Pop-nxX0kw Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 188383bbf07f4ad5b2d4d4ec4380fad7 Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-VolumesAdminNegativeTest-557242693 Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/188383bbf07f4ad5b2d4d4ec4380fad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_188383bbf07f4ad5b2d4d4ec4380fad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/188383bbf07f4ad5b2d4d4ec4380fad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/188383bbf07f4ad5b2d4d4ec4380fad7"}]}] Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-VolumesAdminNegativeTest-557242693 Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 188383bbf07f4ad5b2d4d4ec4380fad7 Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-557242693 Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-VolumesAdminNegativeTest-557242693-project Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: f6389e7e01d042678fed8cdf6d8b8625 Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-VolumesAdminNegativeTest-557242693-project Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 3a399223-e902-4114-9172-784bf7c1e031 could not be found. Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '3a399223-e902-4114-9172-784bf7c1e031'} Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a399223-e902-4114-9172-784bf7c1e031 could not be found. Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a399223-e902-4114-9172-784bf7c1e031 could not be found. Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:47.445640 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:18:47.451913 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:47.451913 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:47.451913 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:47.451913 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:47.451913 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:47.451913 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a399223-e902-4114-9172-784bf7c1e031 could not be found. Oct 04 21:18:47.451913 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:18:47.454850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1bea2949-4bd6-4d36-8013-a944960d59ca tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Returning 404 to user: Instance 3a399223-e902-4114-9172-784bf7c1e031 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:47.457128 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1bea2949-4bd6-4d36-8013-a944960d59ca tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031" status: 404 len: 111 microversion: 2.1 time: 0.152185 Oct 04 21:18:47.461371 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1511/2936] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:47 2022] GET /compute/v2.1/servers/3a399223-e902-4114-9172-784bf7c1e031 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:47.484849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-d33fafd3-d3cb-424f-9ed0-d200b480f1a1 req-baad9f2c-f6ab-4cd0-a7f2-85a85a88f8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a399223-e902-4114-9172-784bf7c1e031", "name": "network-vif-deleted", "tag": "f60715f1-b4ee-4879-a807-ae0bd265e328"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:47.542996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d33fafd3-d3cb-424f-9ed0-d200b480f1a1 req-baad9f2c-f6ab-4cd0-a7f2-85a85a88f8e8 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:47.568367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d33fafd3-d3cb-424f-9ed0-d200b480f1a1 req-baad9f2c-f6ab-4cd0-a7f2-85a85a88f8e8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:47.568367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d33fafd3-d3cb-424f-9ed0-d200b480f1a1 req-baad9f2c-f6ab-4cd0-a7f2-85a85a88f8e8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:47.616006 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-d33fafd3-d3cb-424f-9ed0-d200b480f1a1 req-baad9f2c-f6ab-4cd0-a7f2-85a85a88f8e8 service nova] Creating event network-vif-deleted:f60715f1-b4ee-4879-a807-ae0bd265e328 for instance 3a399223-e902-4114-9172-784bf7c1e031 on n-h2-860282-1 Oct 04 21:18:47.628719 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-d33fafd3-d3cb-424f-9ed0-d200b480f1a1 req-baad9f2c-f6ab-4cd0-a7f2-85a85a88f8e8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163854 Oct 04 21:18:47.636479 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1512/2937] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:47.642223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b633a9b5-6e0f-42a8-a29e-4c0e9a3283f0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:47.645862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b633a9b5-6e0f-42a8-a29e-4c0e9a3283f0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:47.942251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b633a9b5-6e0f-42a8-a29e-4c0e9a3283f0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:47.949434 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b633a9b5-6e0f-42a8-a29e-4c0e9a3283f0 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1213 microversion: 2.1 time: 0.311719 Oct 04 21:18:47.966067 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1513/2938] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:47 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1213 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:47.971969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-abc461fe-e63d-46bb-9658-3fad7692a13d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:47.974073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-abc461fe-e63d-46bb-9658-3fad7692a13d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:48.016212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abc461fe-e63d-46bb-9658-3fad7692a13d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:48.020544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abc461fe-e63d-46bb-9658-3fad7692a13d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:48.030288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abc461fe-e63d-46bb-9658-3fad7692a13d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:48.031607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abc461fe-e63d-46bb-9658-3fad7692a13d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:48.032333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abc461fe-e63d-46bb-9658-3fad7692a13d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:48.032971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abc461fe-e63d-46bb-9658-3fad7692a13d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:48.368254 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-abc461fe-e63d-46bb-9658-3fad7692a13d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.400933 Oct 04 21:18:48.369269 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1514/2939] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:18:47 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/os-interface => generated 284 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:48.374166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b847b2ff-058c-4a57-aa0d-abc7117d7bcb tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] Calling method '.version_select at 0x7f5790b3dc10>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:48.550953 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b847b2ff-058c-4a57-aa0d-abc7117d7bcb tempest-VolumesAdminNegativeTest-557242693 tempest-VolumesAdminNegativeTest-557242693-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-253484164" status: 202 len: 0 microversion: 2.1 time: 0.179076 Oct 04 21:18:48.552726 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1515/2940] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Oct 4 21:18:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-253484164 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:18:48.797900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2bfab464-12dc-4e9c-9289-8d857569b158 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Action: 'create', calling method: .version_select at 0x7f57900b8310>, body: {"keypair": {"name": "tempest-keypair-528649268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/t4oUssPkxLQPBPEJFIuQRSD2WYf8cogT4YDPffTK5UKhGRdIBkD5c49SMn6AOtQXnR7iw6mA03Yq5ymg2r6IhrgZiyS3/Lwf9P48zv7hFWuDWoPD1KTO4Up2OCGQVUw=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:48.817447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-2bfab464-12dc-4e9c-9289-8d857569b158 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Getting quotas for project 9e2872ff08634cefa086fcc132b3a6dc. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:18:48.824207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-2bfab464-12dc-4e9c-9289-8d857569b158 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Getting quotas for user 139e19408ca34ec8bcc8debc25e0c4bf and project 9e2872ff08634cefa086fcc132b3a6dc. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:18:48.933258 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2bfab464-12dc-4e9c-9289-8d857569b158 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.377890 Oct 04 21:18:48.936848 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1516/2941] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:18:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:48.943859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d16872ff-d22c-4f78-9b13-81fcfa218e9b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57900544c0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:49.044846 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d16872ff-d22c-4f78-9b13-81fcfa218e9b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.105747 Oct 04 21:18:49.045647 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1517/2942] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:48 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:49.059254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7932b75a-985a-467f-a5ae-0e96d337ebb8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:49.060851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7932b75a-985a-467f-a5ae-0e96d337ebb8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:49.077296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7932b75a-985a-467f-a5ae-0e96d337ebb8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:49.082745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7932b75a-985a-467f-a5ae-0e96d337ebb8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:49.084266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7932b75a-985a-467f-a5ae-0e96d337ebb8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:49.085253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7932b75a-985a-467f-a5ae-0e96d337ebb8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:49.085965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7932b75a-985a-467f-a5ae-0e96d337ebb8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:49.086623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7932b75a-985a-467f-a5ae-0e96d337ebb8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:49.129035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:49.266666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7932b75a-985a-467f-a5ae-0e96d337ebb8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:49.283216 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7932b75a-985a-467f-a5ae-0e96d337ebb8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1217 microversion: 2.1 time: 0.235466 Oct 04 21:18:49.294936 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1518/2943] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:49 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1217 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:49.935691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=38 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:50.061750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-61f46fa3-060b-40d8-89aa-43c076cd678a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790e244c0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:50.152299 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-61f46fa3-060b-40d8-89aa-43c076cd678a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.094839 Oct 04 21:18:50.153051 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1519/2944] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:50 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:50.323925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-18032906-5dcf-4d67-ac56-aab5062c7d96 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:50.326180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-18032906-5dcf-4d67-ac56-aab5062c7d96 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:50.345849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18032906-5dcf-4d67-ac56-aab5062c7d96 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:50.347547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18032906-5dcf-4d67-ac56-aab5062c7d96 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:50.348168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18032906-5dcf-4d67-ac56-aab5062c7d96 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:50.350934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18032906-5dcf-4d67-ac56-aab5062c7d96 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:50.351706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18032906-5dcf-4d67-ac56-aab5062c7d96 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:50.353648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18032906-5dcf-4d67-ac56-aab5062c7d96 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:50.494659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-18032906-5dcf-4d67-ac56-aab5062c7d96 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:50.523947 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-18032906-5dcf-4d67-ac56-aab5062c7d96 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1265 microversion: 2.1 time: 0.204612 Oct 04 21:18:50.529233 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1520/2945] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:50 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:50.621627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-846917f6-9358-4152-ab7e-c43b446c9b77 req-1d73fd47-9b4c-4103-8feb-173893f45bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba61f85c-a75d-451d-a5f7-f9533481c406", "tag": "34504880-4c91-4512-980a-45596f508743"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:50.648034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-846917f6-9358-4152-ab7e-c43b446c9b77 req-1d73fd47-9b4c-4103-8feb-173893f45bca service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:50.649030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-846917f6-9358-4152-ab7e-c43b446c9b77 req-1d73fd47-9b4c-4103-8feb-173893f45bca service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:50.649654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-846917f6-9358-4152-ab7e-c43b446c9b77 req-1d73fd47-9b4c-4103-8feb-173893f45bca service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:50.665282 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-846917f6-9358-4152-ab7e-c43b446c9b77 req-1d73fd47-9b4c-4103-8feb-173893f45bca service nova] Creating event network-changed:34504880-4c91-4512-980a-45596f508743 for instance ba61f85c-a75d-451d-a5f7-f9533481c406 on n-h2-860282-1 Oct 04 21:18:50.679511 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-846917f6-9358-4152-ab7e-c43b446c9b77 req-1d73fd47-9b4c-4103-8feb-173893f45bca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061313 Oct 04 21:18:50.681412 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1521/2946] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:18:51.173092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-05c05d30-88e7-4289-97b0-5b0df6e56fb5 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790054040>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:51.288623 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-05c05d30-88e7-4289-97b0-5b0df6e56fb5 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.121059 Oct 04 21:18:51.290669 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1522/2947] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:51 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:51.397920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:18:51.398473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:18:51.398820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:18:51.400062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:18:51.400656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:18:51.422552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:51.424983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:51.424983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:51.424983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:51.424983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:51.429118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:51.475040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Getting quotas for project b1bcb8b6a67e463d9cec9f0aa581c2e5. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:18:51.485537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Getting quotas for user f7d792ce0a9f4f6da9406759dd9d665c and project b1bcb8b6a67e463d9cec9f0aa581c2e5. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:18:51.557298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-89433d1f-eefe-4023-ab72-ce8c518a1815 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:51.558208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-89433d1f-eefe-4023-ab72-ce8c518a1815 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:51.571673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89433d1f-eefe-4023-ab72-ce8c518a1815 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:51.573807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89433d1f-eefe-4023-ab72-ce8c518a1815 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:51.574416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89433d1f-eefe-4023-ab72-ce8c518a1815 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:51.575262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89433d1f-eefe-4023-ab72-ce8c518a1815 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:51.577986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89433d1f-eefe-4023-ab72-ce8c518a1815 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:51.578647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89433d1f-eefe-4023-ab72-ce8c518a1815 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:51.833285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:18:51.837489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='62e69620-0564-4304-9ee4-18e17f042fc6',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='40c462bd-d3fc-4635-b77c-63bad1da4e55',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9f663b09-0efe-4a6d-a975-b5bc2d94c9b5',volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:18:52.438599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-89433d1f-eefe-4023-ab72-ce8c518a1815 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:52.456334 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-89433d1f-eefe-4023-ab72-ce8c518a1815 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1271 microversion: 2.1 time: 0.896456 Oct 04 21:18:52.460599 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1523/2948] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:51 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1271 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:52.483495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ce01c7eb-980e-4363-b533-b8aff2fa6300 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790a73940>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:52.692831 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ce01c7eb-980e-4363-b533-b8aff2fa6300 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.230546 Oct 04 21:18:52.714775 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1524/2949] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:52 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:53.482738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3c4c61e3-f8c6-4596-af47-55e907907216 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:53.484294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3c4c61e3-f8c6-4596-af47-55e907907216 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:53.493673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c4c61e3-f8c6-4596-af47-55e907907216 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:53.494657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c4c61e3-f8c6-4596-af47-55e907907216 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:53.495443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c4c61e3-f8c6-4596-af47-55e907907216 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:53.496471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c4c61e3-f8c6-4596-af47-55e907907216 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:53.496932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c4c61e3-f8c6-4596-af47-55e907907216 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:53.497693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c4c61e3-f8c6-4596-af47-55e907907216 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:53.641529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3c4c61e3-f8c6-4596-af47-55e907907216 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:53.656420 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3c4c61e3-f8c6-4596-af47-55e907907216 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1271 microversion: 2.1 time: 0.177520 Oct 04 21:18:53.665482 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1525/2950] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:53 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:53.724030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4b392185-e392-4ad3-854c-d94fc3bf8bf4 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578bf5e550>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:53.733080 n-d-860282-1 devstack@n-api.service[122757]: ERROR oslo.messaging._drivers.impl_rabbit [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [4ddc784a-55a5-4baa-9847-97a3eafa1d07] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:18:53.838645 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4b392185-e392-4ad3-854c-d94fc3bf8bf4 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.126321 Oct 04 21:18:53.840113 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1526/2951] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:53 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:54.465001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-447270383", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2f065118-fa43-4a5c-9681-a8c9f806fa39"}], "security_groups": [{"name": "tempest-securitygroup--593148452"}], "key_name": "tempest-keypair-528649268", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:54.741721 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [4ddc784a-55a5-4baa-9847-97a3eafa1d07] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43288. Oct 04 21:18:54.746275 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-051ef224-c094-4019-84b0-c1922a5f8aef tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 14.247612 Oct 04 21:18:54.754414 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1426/2952] 10.222.0.30 () {62 vars in 1189 bytes} [Tue Oct 4 21:18:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 14256 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:18:54.760870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c365d5ba-d089-4e01-9306-5fc80066c9b6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:54.761774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c365d5ba-d089-4e01-9306-5fc80066c9b6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:54.778288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c365d5ba-d089-4e01-9306-5fc80066c9b6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:54.781033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c365d5ba-d089-4e01-9306-5fc80066c9b6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:54.781942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c365d5ba-d089-4e01-9306-5fc80066c9b6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:54.783640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c365d5ba-d089-4e01-9306-5fc80066c9b6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:54.801550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c365d5ba-d089-4e01-9306-5fc80066c9b6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:54.802303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c365d5ba-d089-4e01-9306-5fc80066c9b6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:55.002073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] validate_networks() for [('2f065118-fa43-4a5c-9681-a8c9f806fa39', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:18:55.478040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c365d5ba-d089-4e01-9306-5fc80066c9b6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:55.490547 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c365d5ba-d089-4e01-9306-5fc80066c9b6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1313 microversion: 2.1 time: 0.734700 Oct 04 21:18:55.491467 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1427/2953] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:54 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1313 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:55.504410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ddbc837e-0ea5-426f-8bdb-9d7d1e32f73b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:55.505037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ddbc837e-0ea5-426f-8bdb-9d7d1e32f73b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:55.660951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ddbc837e-0ea5-426f-8bdb-9d7d1e32f73b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:55.671477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ddbc837e-0ea5-426f-8bdb-9d7d1e32f73b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:55.671477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ddbc837e-0ea5-426f-8bdb-9d7d1e32f73b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:55.672608 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ddbc837e-0ea5-426f-8bdb-9d7d1e32f73b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1286 microversion: 2.32 time: 0.180201 Oct 04 21:18:55.686452 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1428/2954] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:55 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1286 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:55.697840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a343931b-05f4-45fb-a44f-2e473458ddcd tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b9195e0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:55.772955 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a343931b-05f4-45fb-a44f-2e473458ddcd tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.085211 Oct 04 21:18:55.779010 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1429/2955] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:55 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:56.258567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:56.523384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c7cbb4e3-9ce3-44ed-8afe-f417ad9bc6a2 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:56.524053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c7cbb4e3-9ce3-44ed-8afe-f417ad9bc6a2 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:56.531511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7cbb4e3-9ce3-44ed-8afe-f417ad9bc6a2 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:56.532014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7cbb4e3-9ce3-44ed-8afe-f417ad9bc6a2 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:56.532665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7cbb4e3-9ce3-44ed-8afe-f417ad9bc6a2 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:56.533387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7cbb4e3-9ce3-44ed-8afe-f417ad9bc6a2 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:56.534677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7cbb4e3-9ce3-44ed-8afe-f417ad9bc6a2 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:56.535293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7cbb4e3-9ce3-44ed-8afe-f417ad9bc6a2 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:56.978135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:56.990563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Getting quotas for project 9e2872ff08634cefa086fcc132b3a6dc. Resources: dict_keys(['metadata_items']) {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:18:57.001510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Getting quotas for user 139e19408ca34ec8bcc8debc25e0c4bf and project 9e2872ff08634cefa086fcc132b3a6dc. Resources: dict_keys(['metadata_items']) {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:18:57.017657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:18:57.022107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:18:57.023172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:18:57.023845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:18:57.024655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:18:57.046047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:57.046790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:57.047469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:57.048557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:57.049864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:57.050544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:57.089449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Getting quotas for project 9e2872ff08634cefa086fcc132b3a6dc. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:18:57.091834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c7cbb4e3-9ce3-44ed-8afe-f417ad9bc6a2 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:57.095846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Getting quotas for user 139e19408ca34ec8bcc8debc25e0c4bf and project 9e2872ff08634cefa086fcc132b3a6dc. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:18:57.101765 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c7cbb4e3-9ce3-44ed-8afe-f417ad9bc6a2 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1313 microversion: 2.1 time: 0.586387 Oct 04 21:18:57.107099 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1430/2956] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:56 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1313 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:57.112523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-be9a2f97-26ce-436f-9689-6fcd37aafad2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:57.113311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:18:57.113484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-be9a2f97-26ce-436f-9689-6fcd37aafad2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:57.116107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:18:57.155836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be9a2f97-26ce-436f-9689-6fcd37aafad2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:57.163402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be9a2f97-26ce-436f-9689-6fcd37aafad2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:57.168264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be9a2f97-26ce-436f-9689-6fcd37aafad2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:57.168264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be9a2f97-26ce-436f-9689-6fcd37aafad2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:57.168264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be9a2f97-26ce-436f-9689-6fcd37aafad2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:57.168264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be9a2f97-26ce-436f-9689-6fcd37aafad2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:57.350895 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-df2b9ade-843d-4629-ba5e-e72afa3e7d13 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.890996 Oct 04 21:18:57.352891 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1527/2957] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:18:54 2022] POST /compute/v2.1/servers => generated 408 bytes in 2894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:18:57.364363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9b0e12a-9c5d-44b6-a7e6-89cec3c592be tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578bf5edc0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:57.483723 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d9b0e12a-9c5d-44b6-a7e6-89cec3c592be tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.126853 Oct 04 21:18:57.484428 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1528/2958] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:57 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:57.504952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2e7c1655-b9d5-486d-b7ce-31c4763e28d5 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:57.506158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2e7c1655-b9d5-486d-b7ce-31c4763e28d5 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:57.515742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-be9a2f97-26ce-436f-9689-6fcd37aafad2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:57.563625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-be9a2f97-26ce-436f-9689-6fcd37aafad2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:57.572093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-be9a2f97-26ce-436f-9689-6fcd37aafad2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:57.579306 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-be9a2f97-26ce-436f-9689-6fcd37aafad2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1528 microversion: 2.32 time: 0.471124 Oct 04 21:18:57.591228 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1431/2959] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:57 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1528 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:57.849778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2e7c1655-b9d5-486d-b7ce-31c4763e28d5 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:57.858779 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2e7c1655-b9d5-486d-b7ce-31c4763e28d5 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1276 microversion: 2.1 time: 0.371679 Oct 04 21:18:57.865375 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1529/2960] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:57 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1276 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:58.130002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-78f989db-6c20-4941-b81b-3b3f5ceec595 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:58.130689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-78f989db-6c20-4941-b81b-3b3f5ceec595 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:58.142584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78f989db-6c20-4941-b81b-3b3f5ceec595 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:58.143148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78f989db-6c20-4941-b81b-3b3f5ceec595 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:58.143760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78f989db-6c20-4941-b81b-3b3f5ceec595 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:58.144580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78f989db-6c20-4941-b81b-3b3f5ceec595 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:58.145051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78f989db-6c20-4941-b81b-3b3f5ceec595 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:58.152003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78f989db-6c20-4941-b81b-3b3f5ceec595 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:58.500534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-439c630c-6c05-4739-bc80-0d155d2a6172 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790054820>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:58.617530 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-439c630c-6c05-4739-bc80-0d155d2a6172 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.121130 Oct 04 21:18:58.628015 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1530/2961] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:58 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:58.637999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-771dc81b-3b60-4104-8d3c-3d89bdedc495 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:58.639096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-771dc81b-3b60-4104-8d3c-3d89bdedc495 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:58.672892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-771dc81b-3b60-4104-8d3c-3d89bdedc495 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:58.674902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-771dc81b-3b60-4104-8d3c-3d89bdedc495 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:58.675735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-771dc81b-3b60-4104-8d3c-3d89bdedc495 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:58.677077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-771dc81b-3b60-4104-8d3c-3d89bdedc495 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:58.680573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-771dc81b-3b60-4104-8d3c-3d89bdedc495 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:58.681247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-771dc81b-3b60-4104-8d3c-3d89bdedc495 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:58.813201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-78f989db-6c20-4941-b81b-3b3f5ceec595 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:58.860525 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-78f989db-6c20-4941-b81b-3b3f5ceec595 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1334 microversion: 2.1 time: 0.733380 Oct 04 21:18:58.864772 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1432/2962] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:58 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1334 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:58.889917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2ed5f5f2-ed39-41d6-b880-82e1a6de0843 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:58.892256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2ed5f5f2-ed39-41d6-b880-82e1a6de0843 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:59.103883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-771dc81b-3b60-4104-8d3c-3d89bdedc495 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:59.134893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-771dc81b-3b60-4104-8d3c-3d89bdedc495 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:59.137364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-771dc81b-3b60-4104-8d3c-3d89bdedc495 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:59.144646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2ed5f5f2-ed39-41d6-b880-82e1a6de0843 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:59.155485 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2ed5f5f2-ed39-41d6-b880-82e1a6de0843 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1276 microversion: 2.1 time: 0.269646 Oct 04 21:18:59.156631 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-771dc81b-3b60-4104-8d3c-3d89bdedc495 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1576 microversion: 2.32 time: 0.511327 Oct 04 21:18:59.157464 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1531/2963] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:58 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1576 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:59.160052 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1433/2964] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:58 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1276 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:59.634568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-286594fa-9773-46ca-930e-8ce7e2ae3c85 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790054040>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:59.693253 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-286594fa-9773-46ca-930e-8ce7e2ae3c85 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.059513 Oct 04 21:18:59.694865 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1532/2965] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:59 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:59.887247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-50857a05-0114-4a9c-971e-e4700f2e1e23 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:59.888127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-50857a05-0114-4a9c-971e-e4700f2e1e23 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:59.907484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50857a05-0114-4a9c-971e-e4700f2e1e23 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:59.927933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50857a05-0114-4a9c-971e-e4700f2e1e23 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:59.928409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50857a05-0114-4a9c-971e-e4700f2e1e23 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:59.929186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50857a05-0114-4a9c-971e-e4700f2e1e23 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:59.937774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50857a05-0114-4a9c-971e-e4700f2e1e23 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:59.940488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50857a05-0114-4a9c-971e-e4700f2e1e23 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:00.187230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0c2e9178-3dfc-4505-8542-7a122da2dabc tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:00.188760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0c2e9178-3dfc-4505-8542-7a122da2dabc tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:00.202075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c2e9178-3dfc-4505-8542-7a122da2dabc tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:00.207205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c2e9178-3dfc-4505-8542-7a122da2dabc tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:00.214411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c2e9178-3dfc-4505-8542-7a122da2dabc tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:00.215217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c2e9178-3dfc-4505-8542-7a122da2dabc tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:00.215654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c2e9178-3dfc-4505-8542-7a122da2dabc tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:00.216122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c2e9178-3dfc-4505-8542-7a122da2dabc tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:00.422727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-50857a05-0114-4a9c-971e-e4700f2e1e23 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:00.434822 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-50857a05-0114-4a9c-971e-e4700f2e1e23 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1334 microversion: 2.1 time: 0.551427 Oct 04 21:19:00.437983 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1434/2966] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:59 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1334 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:00.452317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0c2e9178-3dfc-4505-8542-7a122da2dabc tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:00.455019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cdfc859b-5788-4c09-9d2e-c756203820c5 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:00.456752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cdfc859b-5788-4c09-9d2e-c756203820c5 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:00.470357 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0c2e9178-3dfc-4505-8542-7a122da2dabc tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1272 microversion: 2.1 time: 0.289675 Oct 04 21:19:00.471527 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1533/2967] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:00 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1272 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:00.476887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cdfc859b-5788-4c09-9d2e-c756203820c5 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:00.476887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cdfc859b-5788-4c09-9d2e-c756203820c5 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:00.478615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cdfc859b-5788-4c09-9d2e-c756203820c5 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:00.479658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cdfc859b-5788-4c09-9d2e-c756203820c5 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:00.481009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cdfc859b-5788-4c09-9d2e-c756203820c5 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:00.483070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cdfc859b-5788-4c09-9d2e-c756203820c5 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:00.711745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5f968ea0-e0b3-42ce-9b9d-a9318cbac4cc tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790054040>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:00.775342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cdfc859b-5788-4c09-9d2e-c756203820c5 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:00.791939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cdfc859b-5788-4c09-9d2e-c756203820c5 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:00.804010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cdfc859b-5788-4c09-9d2e-c756203820c5 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:00.805682 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cdfc859b-5788-4c09-9d2e-c756203820c5 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1594 microversion: 2.32 time: 0.363302 Oct 04 21:19:00.811079 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1435/2968] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:00 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1594 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:00.943085 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5f968ea0-e0b3-42ce-9b9d-a9318cbac4cc tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.235359 Oct 04 21:19:00.944150 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1534/2969] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:00 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:01.468537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4dab1712-9af9-491b-88ee-4eabef8bca39 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:01.469945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4dab1712-9af9-491b-88ee-4eabef8bca39 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:01.473688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:01.493133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4dab1712-9af9-491b-88ee-4eabef8bca39 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:01.493876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4dab1712-9af9-491b-88ee-4eabef8bca39 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:01.494287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cb8d58af-608d-41ee-b157-5b50b08bce35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:01.494783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4dab1712-9af9-491b-88ee-4eabef8bca39 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:01.494902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cb8d58af-608d-41ee-b157-5b50b08bce35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:01.495846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4dab1712-9af9-491b-88ee-4eabef8bca39 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:01.496552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4dab1712-9af9-491b-88ee-4eabef8bca39 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:01.497237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4dab1712-9af9-491b-88ee-4eabef8bca39 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:01.509178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb8d58af-608d-41ee-b157-5b50b08bce35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:01.509727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb8d58af-608d-41ee-b157-5b50b08bce35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:01.510180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb8d58af-608d-41ee-b157-5b50b08bce35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:01.510916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb8d58af-608d-41ee-b157-5b50b08bce35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:01.511377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb8d58af-608d-41ee-b157-5b50b08bce35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:01.531589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb8d58af-608d-41ee-b157-5b50b08bce35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:02.043548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cb8d58af-608d-41ee-b157-5b50b08bce35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:02.059182 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cb8d58af-608d-41ee-b157-5b50b08bce35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1328 microversion: 2.1 time: 0.568980 Oct 04 21:19:02.064180 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1535/2970] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:01 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1328 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:02.076796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6fabcbba-7b01-4020-a119-3796f79ecb2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:02.077934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6fabcbba-7b01-4020-a119-3796f79ecb2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:02.101666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fabcbba-7b01-4020-a119-3796f79ecb2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:02.102420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fabcbba-7b01-4020-a119-3796f79ecb2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:02.103099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fabcbba-7b01-4020-a119-3796f79ecb2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:02.104061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fabcbba-7b01-4020-a119-3796f79ecb2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:02.112660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fabcbba-7b01-4020-a119-3796f79ecb2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:02.113389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fabcbba-7b01-4020-a119-3796f79ecb2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:02.559766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4dab1712-9af9-491b-88ee-4eabef8bca39 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:02.595069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6fabcbba-7b01-4020-a119-3796f79ecb2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:02.601382 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4dab1712-9af9-491b-88ee-4eabef8bca39 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1334 microversion: 2.1 time: 1.139096 Oct 04 21:19:02.607209 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1436/2971] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:01 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1334 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:02.619109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6fabcbba-7b01-4020-a119-3796f79ecb2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:02.621188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6fabcbba-7b01-4020-a119-3796f79ecb2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:02.626378 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6fabcbba-7b01-4020-a119-3796f79ecb2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1594 microversion: 2.32 time: 0.559825 Oct 04 21:19:02.634661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-678282de-e7dc-40f8-84b2-aa5199518088 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b8ff5e0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:02.647341 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1536/2972] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:02 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1594 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:02.662211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-88a48445-ae28-4226-a8d4-487189b9fed5 req-09dd8daa-1af7-42cc-a240-1fe23f8c38f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42a2921-02b6-42e2-bee6-8700cbb23832", "tag": "492cb8c5-a3fc-4a42-8a45-76af0767e9dc"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:02.684860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-88a48445-ae28-4226-a8d4-487189b9fed5 req-09dd8daa-1af7-42cc-a240-1fe23f8c38f5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:02.685850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-88a48445-ae28-4226-a8d4-487189b9fed5 req-09dd8daa-1af7-42cc-a240-1fe23f8c38f5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:02.686531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-88a48445-ae28-4226-a8d4-487189b9fed5 req-09dd8daa-1af7-42cc-a240-1fe23f8c38f5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:02.700274 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-678282de-e7dc-40f8-84b2-aa5199518088 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1455 microversion: 2.1 time: 0.090449 Oct 04 21:19:02.701539 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1437/2973] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:02 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:02.712564 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-88a48445-ae28-4226-a8d4-487189b9fed5 req-09dd8daa-1af7-42cc-a240-1fe23f8c38f5 service nova] Creating event network-changed:492cb8c5-a3fc-4a42-8a45-76af0767e9dc for instance e42a2921-02b6-42e2-bee6-8700cbb23832 on n-h1-860282-1 Oct 04 21:19:02.720264 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-88a48445-ae28-4226-a8d4-487189b9fed5 req-09dd8daa-1af7-42cc-a240-1fe23f8c38f5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071430 Oct 04 21:19:02.721349 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1537/2974] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:03.089366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-851edd3e-567d-40c2-893b-f311b928ac55 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:03.089926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-851edd3e-567d-40c2-893b-f311b928ac55 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:03.091905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:03.106247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-851edd3e-567d-40c2-893b-f311b928ac55 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:03.107338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-851edd3e-567d-40c2-893b-f311b928ac55 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:03.108207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-851edd3e-567d-40c2-893b-f311b928ac55 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:03.109813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-851edd3e-567d-40c2-893b-f311b928ac55 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:03.112212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-851edd3e-567d-40c2-893b-f311b928ac55 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:03.113125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-851edd3e-567d-40c2-893b-f311b928ac55 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:03.376941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1e0b8a57-e904-4dfd-9271-724a6e6d13ab tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:03.378209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1e0b8a57-e904-4dfd-9271-724a6e6d13ab tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:03.386467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e0b8a57-e904-4dfd-9271-724a6e6d13ab tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:03.386958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e0b8a57-e904-4dfd-9271-724a6e6d13ab tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:03.387458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e0b8a57-e904-4dfd-9271-724a6e6d13ab tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:03.388157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e0b8a57-e904-4dfd-9271-724a6e6d13ab tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:03.388664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e0b8a57-e904-4dfd-9271-724a6e6d13ab tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:03.389098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e0b8a57-e904-4dfd-9271-724a6e6d13ab tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:03.482111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-1e0b8a57-e904-4dfd-9271-724a6e6d13ab tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lazy-loading 'services' on Instance uuid 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:19:03.509388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-851edd3e-567d-40c2-893b-f311b928ac55 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:03.532000 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-851edd3e-567d-40c2-893b-f311b928ac55 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1334 microversion: 2.1 time: 0.443788 Oct 04 21:19:03.555072 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1438/2975] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:03 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1334 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:03.646769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f9065196-28af-4e0b-89c3-fc6da46f5ba5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:03.647328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f9065196-28af-4e0b-89c3-fc6da46f5ba5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:03.657681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9065196-28af-4e0b-89c3-fc6da46f5ba5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:03.662090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9065196-28af-4e0b-89c3-fc6da46f5ba5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:03.662752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9065196-28af-4e0b-89c3-fc6da46f5ba5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:03.664004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9065196-28af-4e0b-89c3-fc6da46f5ba5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:03.666964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9065196-28af-4e0b-89c3-fc6da46f5ba5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:03.669910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9065196-28af-4e0b-89c3-fc6da46f5ba5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:03.766243 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1e0b8a57-e904-4dfd-9271-724a6e6d13ab tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments/50200069-1862-4da1-96ff-3d771d5f66fb" status: 202 len: 0 microversion: 2.1 time: 0.395101 Oct 04 21:19:03.770653 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1538/2976] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 21:19:03 2022] DELETE /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments/50200069-1862-4da1-96ff-3d771d5f66fb => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:19:03.773661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1730eb7d-8423-47c9-8546-1ba2cb858c2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:03.774375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1730eb7d-8423-47c9-8546-1ba2cb858c2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:03.790890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1730eb7d-8423-47c9-8546-1ba2cb858c2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:03.793957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1730eb7d-8423-47c9-8546-1ba2cb858c2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:03.795052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1730eb7d-8423-47c9-8546-1ba2cb858c2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:03.795557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1730eb7d-8423-47c9-8546-1ba2cb858c2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:03.808700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1730eb7d-8423-47c9-8546-1ba2cb858c2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:03.808700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1730eb7d-8423-47c9-8546-1ba2cb858c2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:04.293870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f9065196-28af-4e0b-89c3-fc6da46f5ba5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:04.313207 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f9065196-28af-4e0b-89c3-fc6da46f5ba5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1334 microversion: 2.1 time: 0.672472 Oct 04 21:19:04.332916 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1439/2977] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:03 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1334 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:04.340122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-99d80504-989c-4fd1-8f8a-5dc81f4f76d9 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b919040>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:04.428302 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-99d80504-989c-4fd1-8f8a-5dc81f4f76d9 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1464 microversion: 2.1 time: 0.092088 Oct 04 21:19:04.442880 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1440/2978] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:04 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1464 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:04.449662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-99740f3b-22d2-4576-9426-35666b227947 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:04.452128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-99740f3b-22d2-4576-9426-35666b227947 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:04.461329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99740f3b-22d2-4576-9426-35666b227947 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:04.462224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99740f3b-22d2-4576-9426-35666b227947 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:04.463034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99740f3b-22d2-4576-9426-35666b227947 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:04.464013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99740f3b-22d2-4576-9426-35666b227947 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:04.464636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99740f3b-22d2-4576-9426-35666b227947 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:04.465234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99740f3b-22d2-4576-9426-35666b227947 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:04.545062 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-99740f3b-22d2-4576-9426-35666b227947 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100594 Oct 04 21:19:04.546192 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1441/2979] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:19:04 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:04.553763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1730eb7d-8423-47c9-8546-1ba2cb858c2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:04.560868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-72ff89b1-86cf-49d7-80cd-157e94c4056c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f579459adc0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:04.567432 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1730eb7d-8423-47c9-8546-1ba2cb858c2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:04.575165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1730eb7d-8423-47c9-8546-1ba2cb858c2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:04.576611 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1730eb7d-8423-47c9-8546-1ba2cb858c2c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1662 microversion: 2.32 time: 0.807464 Oct 04 21:19:04.577850 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1539/2980] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:03 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1662 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:04.583146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cceb2d7f-ddd9-42cd-b62d-d7aef01f7c35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:04.584022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cceb2d7f-ddd9-42cd-b62d-d7aef01f7c35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:04.591662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cceb2d7f-ddd9-42cd-b62d-d7aef01f7c35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:04.592383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cceb2d7f-ddd9-42cd-b62d-d7aef01f7c35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:04.593026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cceb2d7f-ddd9-42cd-b62d-d7aef01f7c35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:04.593999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cceb2d7f-ddd9-42cd-b62d-d7aef01f7c35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:04.594680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cceb2d7f-ddd9-42cd-b62d-d7aef01f7c35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:04.595312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cceb2d7f-ddd9-42cd-b62d-d7aef01f7c35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:04.650510 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-72ff89b1-86cf-49d7-80cd-157e94c4056c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 200 len: 1464 microversion: 2.1 time: 0.103129 Oct 04 21:19:04.656120 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1442/2981] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:04 2022] GET /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 1464 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:04.671776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1215be85-4562-4271-bf80-59bf37c02abc tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:04.677414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1215be85-4562-4271-bf80-59bf37c02abc tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:04.680376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1215be85-4562-4271-bf80-59bf37c02abc tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:04.681049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1215be85-4562-4271-bf80-59bf37c02abc tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:04.681681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1215be85-4562-4271-bf80-59bf37c02abc tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:04.682543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1215be85-4562-4271-bf80-59bf37c02abc tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:04.683188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1215be85-4562-4271-bf80-59bf37c02abc tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:04.683792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1215be85-4562-4271-bf80-59bf37c02abc tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:04.793059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cceb2d7f-ddd9-42cd-b62d-d7aef01f7c35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:04.804091 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cceb2d7f-ddd9-42cd-b62d-d7aef01f7c35 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1334 microversion: 2.1 time: 0.224934 Oct 04 21:19:04.817461 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1540/2982] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:04 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1334 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:05.152176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1215be85-4562-4271-bf80-59bf37c02abc tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:05.170606 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1215be85-4562-4271-bf80-59bf37c02abc tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1467 microversion: 2.1 time: 0.504071 Oct 04 21:19:05.185872 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1443/2983] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:04 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1467 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:05.198680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e1f772e9-1caa-4c28-9c1b-aae58a0b46f1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1060231160"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:05.201306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e1f772e9-1caa-4c28-9c1b-aae58a0b46f1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 142c6da5-e828-4e2b-bfef-0cf163f0c97c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:05.214834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1f772e9-1caa-4c28-9c1b-aae58a0b46f1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:05.215697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1f772e9-1caa-4c28-9c1b-aae58a0b46f1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:05.220016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1f772e9-1caa-4c28-9c1b-aae58a0b46f1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:05.220016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1f772e9-1caa-4c28-9c1b-aae58a0b46f1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:05.220016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1f772e9-1caa-4c28-9c1b-aae58a0b46f1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:05.220016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1f772e9-1caa-4c28-9c1b-aae58a0b46f1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:05.339456 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0714a926-0c5b-4da4-8d91-4ca16e805554 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:05.340496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0714a926-0c5b-4da4-8d91-4ca16e805554 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:05.352566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0714a926-0c5b-4da4-8d91-4ca16e805554 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:05.353336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0714a926-0c5b-4da4-8d91-4ca16e805554 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:05.354930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0714a926-0c5b-4da4-8d91-4ca16e805554 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:05.356103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0714a926-0c5b-4da4-8d91-4ca16e805554 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:05.356742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0714a926-0c5b-4da4-8d91-4ca16e805554 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:05.357411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0714a926-0c5b-4da4-8d91-4ca16e805554 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:05.777036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0714a926-0c5b-4da4-8d91-4ca16e805554 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:05.785854 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0714a926-0c5b-4da4-8d91-4ca16e805554 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1334 microversion: 2.1 time: 0.450462 Oct 04 21:19:05.805827 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1444/2984] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:05 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1334 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:05.811859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab03c362-a4e3-42f1-b97a-6e5b0646e0fc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:05.815947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ab03c362-a4e3-42f1-b97a-6e5b0646e0fc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:05.825826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab03c362-a4e3-42f1-b97a-6e5b0646e0fc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:05.826327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab03c362-a4e3-42f1-b97a-6e5b0646e0fc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:05.826823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab03c362-a4e3-42f1-b97a-6e5b0646e0fc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:05.827550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab03c362-a4e3-42f1-b97a-6e5b0646e0fc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:05.828013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab03c362-a4e3-42f1-b97a-6e5b0646e0fc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:05.829045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab03c362-a4e3-42f1-b97a-6e5b0646e0fc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:05.895711 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e1f772e9-1caa-4c28-9c1b-aae58a0b46f1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "POST /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c/action" status: 202 len: 0 microversion: 2.1 time: 0.698984 Oct 04 21:19:05.919201 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1541/2985] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:19:05 2022] POST /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 21:19:05.930574 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ab03c362-a4e3-42f1-b97a-6e5b0646e0fc tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119356 Oct 04 21:19:05.934950 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1445/2986] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:19:05 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:05.943549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5601a556-1192-41d4-8cd6-57dcc4ef0728 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:05.946076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4fd83864-9340-4663-b476-433badc984b3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:05.947224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5601a556-1192-41d4-8cd6-57dcc4ef0728 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:05.948168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4fd83864-9340-4663-b476-433badc984b3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:05.959632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5601a556-1192-41d4-8cd6-57dcc4ef0728 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:05.964321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5601a556-1192-41d4-8cd6-57dcc4ef0728 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:05.965399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5601a556-1192-41d4-8cd6-57dcc4ef0728 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:05.966288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5601a556-1192-41d4-8cd6-57dcc4ef0728 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:05.966963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5601a556-1192-41d4-8cd6-57dcc4ef0728 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:05.967505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5601a556-1192-41d4-8cd6-57dcc4ef0728 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:05.969347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fd83864-9340-4663-b476-433badc984b3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:05.972047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fd83864-9340-4663-b476-433badc984b3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:05.972939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fd83864-9340-4663-b476-433badc984b3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:05.974919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fd83864-9340-4663-b476-433badc984b3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:05.978445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fd83864-9340-4663-b476-433badc984b3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:05.979151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fd83864-9340-4663-b476-433badc984b3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:06.627979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4fd83864-9340-4663-b476-433badc984b3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:06.648525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4fd83864-9340-4663-b476-433badc984b3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:06.650180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4fd83864-9340-4663-b476-433badc984b3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:06.651515 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4fd83864-9340-4663-b476-433badc984b3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1709 microversion: 2.32 time: 0.728276 Oct 04 21:19:06.651956 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1542/2987] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:05 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1709 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:06.672688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa73f7a0-8b02-4b7f-a3da-ff9d75abdbd4 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57900e6280>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:06.730350 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aa73f7a0-8b02-4b7f-a3da-ff9d75abdbd4 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f" status: 200 len: 1455 microversion: 2.1 time: 0.061662 Oct 04 21:19:06.731535 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1543/2988] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:06 2022] GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:06.737188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-b50f7beb-8b2a-495d-9cfc-6f013416e9c4 req-391a1241-c338-47d3-a434-1e106d29e954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42a2921-02b6-42e2-bee6-8700cbb23832", "tag": "62c1d20e-0e34-4dfd-82f2-235f81bb16ed"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:06.751657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b50f7beb-8b2a-495d-9cfc-6f013416e9c4 req-391a1241-c338-47d3-a434-1e106d29e954 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:06.752386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b50f7beb-8b2a-495d-9cfc-6f013416e9c4 req-391a1241-c338-47d3-a434-1e106d29e954 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:06.753054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b50f7beb-8b2a-495d-9cfc-6f013416e9c4 req-391a1241-c338-47d3-a434-1e106d29e954 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:06.764761 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-b50f7beb-8b2a-495d-9cfc-6f013416e9c4 req-391a1241-c338-47d3-a434-1e106d29e954 service nova] Creating event network-changed:62c1d20e-0e34-4dfd-82f2-235f81bb16ed for instance e42a2921-02b6-42e2-bee6-8700cbb23832 on n-h1-860282-1 Oct 04 21:19:06.771856 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-b50f7beb-8b2a-495d-9cfc-6f013416e9c4 req-391a1241-c338-47d3-a434-1e106d29e954 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038402 Oct 04 21:19:06.774270 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1544/2989] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:06.791745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5601a556-1192-41d4-8cd6-57dcc4ef0728 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:06.809668 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5601a556-1192-41d4-8cd6-57dcc4ef0728 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1401 microversion: 2.1 time: 0.871466 Oct 04 21:19:06.811030 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1446/2990] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:05 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1401 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:06.816714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-625e8576-7e40-447a-8eb1-fd986861e9fe tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:06.817490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-625e8576-7e40-447a-8eb1-fd986861e9fe tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:06.831223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-625e8576-7e40-447a-8eb1-fd986861e9fe tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:06.831966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-625e8576-7e40-447a-8eb1-fd986861e9fe tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:06.832584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-625e8576-7e40-447a-8eb1-fd986861e9fe tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:06.833491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-625e8576-7e40-447a-8eb1-fd986861e9fe tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:06.835809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-625e8576-7e40-447a-8eb1-fd986861e9fe tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:06.836436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-625e8576-7e40-447a-8eb1-fd986861e9fe tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:06.944047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8afff64e-eeea-4dbd-bd99-c92589c7abde tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:06.947860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8afff64e-eeea-4dbd-bd99-c92589c7abde tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:06.956439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8afff64e-eeea-4dbd-bd99-c92589c7abde tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:06.957293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8afff64e-eeea-4dbd-bd99-c92589c7abde tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:06.958153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8afff64e-eeea-4dbd-bd99-c92589c7abde tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:06.959238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8afff64e-eeea-4dbd-bd99-c92589c7abde tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:06.959867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8afff64e-eeea-4dbd-bd99-c92589c7abde tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:06.965502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8afff64e-eeea-4dbd-bd99-c92589c7abde tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:07.014277 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8afff64e-eeea-4dbd-bd99-c92589c7abde tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075315 Oct 04 21:19:07.015491 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1447/2991] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:19:06 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:19:07.053834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-dcd5bc62-9f39-437f-8a6b-ce47bbcfa70a req-7b894a49-2bba-44bd-abc6-0eace19d0c7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc", "name": "network-vif-unplugged", "status": "completed", "tag": "7b5a9c4b-694b-4147-95a1-a4e92206db0b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:07.065323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-dcd5bc62-9f39-437f-8a6b-ce47bbcfa70a req-7b894a49-2bba-44bd-abc6-0eace19d0c7a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:07.066163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-dcd5bc62-9f39-437f-8a6b-ce47bbcfa70a req-7b894a49-2bba-44bd-abc6-0eace19d0c7a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:07.066888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-dcd5bc62-9f39-437f-8a6b-ce47bbcfa70a req-7b894a49-2bba-44bd-abc6-0eace19d0c7a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:07.079835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:07.081721 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-dcd5bc62-9f39-437f-8a6b-ce47bbcfa70a req-7b894a49-2bba-44bd-abc6-0eace19d0c7a service nova] Creating event network-vif-unplugged:7b5a9c4b-694b-4147-95a1-a4e92206db0b for instance 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc on n-h1-860282-1 Oct 04 21:19:07.091354 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-dcd5bc62-9f39-437f-8a6b-ce47bbcfa70a req-7b894a49-2bba-44bd-abc6-0eace19d0c7a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041975 Oct 04 21:19:07.092300 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1448/2992] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:07.406000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-625e8576-7e40-447a-8eb1-fd986861e9fe tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:07.410076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:07.415209 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-625e8576-7e40-447a-8eb1-fd986861e9fe tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1334 microversion: 2.1 time: 0.605417 Oct 04 21:19:07.418881 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1545/2993] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:06 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1334 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:07.689186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-83829fbe-747d-4bd1-99c9-8639c2ade749 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:07.690961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-83829fbe-747d-4bd1-99c9-8639c2ade749 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:07.702017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83829fbe-747d-4bd1-99c9-8639c2ade749 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:07.702717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83829fbe-747d-4bd1-99c9-8639c2ade749 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:07.703392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83829fbe-747d-4bd1-99c9-8639c2ade749 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:07.704386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83829fbe-747d-4bd1-99c9-8639c2ade749 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:07.705155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83829fbe-747d-4bd1-99c9-8639c2ade749 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:07.706122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83829fbe-747d-4bd1-99c9-8639c2ade749 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:07.750247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a3fbeced-f8f3-4d26-8f52-6da6d8cb8887 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578bf5e0d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:07.836783 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a3fbeced-f8f3-4d26-8f52-6da6d8cb8887 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f" status: 200 len: 1455 microversion: 2.1 time: 0.091608 Oct 04 21:19:07.842794 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1546/2994] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:07 2022] GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:07.843600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4cd0751d-fea2-42c6-a919-e7e9ed386f44 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:07.845143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4cd0751d-fea2-42c6-a919-e7e9ed386f44 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:07.858850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=24 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:07.862508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cd0751d-fea2-42c6-a919-e7e9ed386f44 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:07.864168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cd0751d-fea2-42c6-a919-e7e9ed386f44 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:07.865335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cd0751d-fea2-42c6-a919-e7e9ed386f44 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:07.866596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cd0751d-fea2-42c6-a919-e7e9ed386f44 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:07.867350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cd0751d-fea2-42c6-a919-e7e9ed386f44 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:07.868043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cd0751d-fea2-42c6-a919-e7e9ed386f44 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:08.593245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-83829fbe-747d-4bd1-99c9-8639c2ade749 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:08.604019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:08.609095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-83829fbe-747d-4bd1-99c9-8639c2ade749 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:08.610754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-83829fbe-747d-4bd1-99c9-8639c2ade749 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:08.616955 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-83829fbe-747d-4bd1-99c9-8639c2ade749 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1709 microversion: 2.32 time: 0.935593 Oct 04 21:19:08.617583 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1449/2995] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:07 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1709 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:08.631565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d59b1dfa-0146-4160-a21a-dd4812f649f6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:08.632973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d59b1dfa-0146-4160-a21a-dd4812f649f6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:08.660407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d59b1dfa-0146-4160-a21a-dd4812f649f6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:08.661042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d59b1dfa-0146-4160-a21a-dd4812f649f6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:08.661963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d59b1dfa-0146-4160-a21a-dd4812f649f6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:08.664995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d59b1dfa-0146-4160-a21a-dd4812f649f6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:08.665576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d59b1dfa-0146-4160-a21a-dd4812f649f6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:08.668450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d59b1dfa-0146-4160-a21a-dd4812f649f6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:08.755175 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d59b1dfa-0146-4160-a21a-dd4812f649f6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136428 Oct 04 21:19:08.758066 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1450/2996] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:19:08 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:08.767085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6a1dd3aa-7039-4eeb-ac2b-b3ad0f01541b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:08.774313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6a1dd3aa-7039-4eeb-ac2b-b3ad0f01541b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:08.780958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a1dd3aa-7039-4eeb-ac2b-b3ad0f01541b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:08.781473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a1dd3aa-7039-4eeb-ac2b-b3ad0f01541b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:08.781912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a1dd3aa-7039-4eeb-ac2b-b3ad0f01541b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:08.793608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a1dd3aa-7039-4eeb-ac2b-b3ad0f01541b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:08.794428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a1dd3aa-7039-4eeb-ac2b-b3ad0f01541b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:08.795063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a1dd3aa-7039-4eeb-ac2b-b3ad0f01541b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:08.797022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4cd0751d-fea2-42c6-a919-e7e9ed386f44 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:08.810185 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4cd0751d-fea2-42c6-a919-e7e9ed386f44 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1401 microversion: 2.1 time: 0.970976 Oct 04 21:19:08.811344 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1547/2997] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:07 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1401 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:08.857389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f8e8e296-0d4b-436d-af82-bd20d9cecc64 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f579443d9d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:08.942388 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f8e8e296-0d4b-436d-af82-bd20d9cecc64 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f" status: 200 len: 1455 microversion: 2.1 time: 0.094011 Oct 04 21:19:08.950256 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1548/2998] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:08 2022] GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:09.122633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6a1dd3aa-7039-4eeb-ac2b-b3ad0f01541b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:09.140490 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6a1dd3aa-7039-4eeb-ac2b-b3ad0f01541b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1334 microversion: 2.1 time: 0.379146 Oct 04 21:19:09.142814 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1451/2999] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:08 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1334 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:09.654617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-022140bc-df97-41f3-8433-3a35557742e2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:09.656407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-022140bc-df97-41f3-8433-3a35557742e2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:09.687876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-022140bc-df97-41f3-8433-3a35557742e2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:09.688711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-022140bc-df97-41f3-8433-3a35557742e2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:09.690873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-022140bc-df97-41f3-8433-3a35557742e2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:09.692101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-022140bc-df97-41f3-8433-3a35557742e2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:09.694544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-022140bc-df97-41f3-8433-3a35557742e2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:09.695332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-022140bc-df97-41f3-8433-3a35557742e2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:09.745832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-57eab8e8-a578-4fda-9f73-22a9021bd444 req-3c106917-f7a3-4fcb-9c72-55bc3d97ffbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd8a0d92-6584-4dc6-b2d1-b1227a77f314", "tag": "78a64cea-abc0-483b-8a8a-c375cb239a62"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:09.759056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=10 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:09.762529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-57eab8e8-a578-4fda-9f73-22a9021bd444 req-3c106917-f7a3-4fcb-9c72-55bc3d97ffbd service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:09.764951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-57eab8e8-a578-4fda-9f73-22a9021bd444 req-3c106917-f7a3-4fcb-9c72-55bc3d97ffbd service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:09.764951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-57eab8e8-a578-4fda-9f73-22a9021bd444 req-3c106917-f7a3-4fcb-9c72-55bc3d97ffbd service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:09.779809 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-57eab8e8-a578-4fda-9f73-22a9021bd444 req-3c106917-f7a3-4fcb-9c72-55bc3d97ffbd service nova] Creating event network-changed:78a64cea-abc0-483b-8a8a-c375cb239a62 for instance fd8a0d92-6584-4dc6-b2d1-b1227a77f314 on n-h2-860282-1 Oct 04 21:19:09.786577 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-57eab8e8-a578-4fda-9f73-22a9021bd444 req-3c106917-f7a3-4fcb-9c72-55bc3d97ffbd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044453 Oct 04 21:19:09.788598 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1452/3000] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:19:09.795253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-77a518fc-d980-4e5d-8218-5129ab9c6f4e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:09.797947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-77a518fc-d980-4e5d-8218-5129ab9c6f4e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:09.808130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77a518fc-d980-4e5d-8218-5129ab9c6f4e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:09.808868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77a518fc-d980-4e5d-8218-5129ab9c6f4e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:09.809632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77a518fc-d980-4e5d-8218-5129ab9c6f4e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:09.810654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77a518fc-d980-4e5d-8218-5129ab9c6f4e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:09.811288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77a518fc-d980-4e5d-8218-5129ab9c6f4e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:09.811848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77a518fc-d980-4e5d-8218-5129ab9c6f4e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:09.851924 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-77a518fc-d980-4e5d-8218-5129ab9c6f4e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061450 Oct 04 21:19:09.852827 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1453/3001] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:19:09 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:09.860082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-86a227b0-97e4-4287-83d9-35f9031eb8a4 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:09.861211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-86a227b0-97e4-4287-83d9-35f9031eb8a4 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:09.868683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86a227b0-97e4-4287-83d9-35f9031eb8a4 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:09.869439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86a227b0-97e4-4287-83d9-35f9031eb8a4 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:09.870828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86a227b0-97e4-4287-83d9-35f9031eb8a4 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:09.871714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86a227b0-97e4-4287-83d9-35f9031eb8a4 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:09.872353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86a227b0-97e4-4287-83d9-35f9031eb8a4 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:09.872947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86a227b0-97e4-4287-83d9-35f9031eb8a4 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:10.301222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-86a227b0-97e4-4287-83d9-35f9031eb8a4 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:10.318517 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-86a227b0-97e4-4287-83d9-35f9031eb8a4 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1401 microversion: 2.1 time: 0.464366 Oct 04 21:19:10.319407 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1454/3002] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:09 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1401 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:10.331629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8f4c9970-53e0-491f-b7db-c143872f0fa2 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790604160>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:10.404262 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8f4c9970-53e0-491f-b7db-c143872f0fa2 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f" status: 200 len: 1455 microversion: 2.1 time: 0.083449 Oct 04 21:19:10.405323 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1455/3003] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:10 2022] GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:10.415003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-022140bc-df97-41f3-8433-3a35557742e2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:10.419611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-371ce2a7-14f1-49ac-bf88-a143dd3c4d46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:10.420413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-371ce2a7-14f1-49ac-bf88-a143dd3c4d46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:10.428599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-371ce2a7-14f1-49ac-bf88-a143dd3c4d46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:10.429092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-371ce2a7-14f1-49ac-bf88-a143dd3c4d46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:10.429840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-371ce2a7-14f1-49ac-bf88-a143dd3c4d46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:10.430558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-371ce2a7-14f1-49ac-bf88-a143dd3c4d46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:10.431021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-371ce2a7-14f1-49ac-bf88-a143dd3c4d46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:10.431449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-371ce2a7-14f1-49ac-bf88-a143dd3c4d46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:10.431840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-022140bc-df97-41f3-8433-3a35557742e2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:10.434829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-022140bc-df97-41f3-8433-3a35557742e2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:10.441625 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-022140bc-df97-41f3-8433-3a35557742e2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1756 microversion: 2.32 time: 0.797654 Oct 04 21:19:10.442561 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1549/3004] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:09 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1756 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:10.801670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-371ce2a7-14f1-49ac-bf88-a143dd3c4d46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:10.816598 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-371ce2a7-14f1-49ac-bf88-a143dd3c4d46 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1334 microversion: 2.1 time: 0.409678 Oct 04 21:19:10.818026 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1456/3005] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:10 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1334 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:10.865560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-66845563-f800-4cb5-a4fc-10df4ddb110d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:10.867826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-66845563-f800-4cb5-a4fc-10df4ddb110d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:10.884364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66845563-f800-4cb5-a4fc-10df4ddb110d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:10.884364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66845563-f800-4cb5-a4fc-10df4ddb110d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:10.884364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66845563-f800-4cb5-a4fc-10df4ddb110d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:10.885056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66845563-f800-4cb5-a4fc-10df4ddb110d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:10.885539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66845563-f800-4cb5-a4fc-10df4ddb110d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:10.885966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66845563-f800-4cb5-a4fc-10df4ddb110d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:10.971466 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-66845563-f800-4cb5-a4fc-10df4ddb110d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109498 Oct 04 21:19:10.974135 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1550/3006] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:19:10 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:11.148295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-968ce5e8-d41e-48fa-9a44-282cc5823c0b req-9aa05fd3-6249-4f96-a31d-eaa492098971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "142c6da5-e828-4e2b-bfef-0cf163f0c97c", "name": "network-vif-plugged", "status": "completed", "tag": "35ab7e07-58e9-4ae2-bb54-f90bc14398d7"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:11.168001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-968ce5e8-d41e-48fa-9a44-282cc5823c0b req-9aa05fd3-6249-4f96-a31d-eaa492098971 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:11.168486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-968ce5e8-d41e-48fa-9a44-282cc5823c0b req-9aa05fd3-6249-4f96-a31d-eaa492098971 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:11.169122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-968ce5e8-d41e-48fa-9a44-282cc5823c0b req-9aa05fd3-6249-4f96-a31d-eaa492098971 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:11.205121 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-968ce5e8-d41e-48fa-9a44-282cc5823c0b req-9aa05fd3-6249-4f96-a31d-eaa492098971 service nova] Creating event network-vif-plugged:35ab7e07-58e9-4ae2-bb54-f90bc14398d7 for instance 142c6da5-e828-4e2b-bfef-0cf163f0c97c on n-h1-860282-1 Oct 04 21:19:11.216593 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-968ce5e8-d41e-48fa-9a44-282cc5823c0b req-9aa05fd3-6249-4f96-a31d-eaa492098971 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066195 Oct 04 21:19:11.216593 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1457/3007] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:11.341801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d3ebf66e-fea9-4056-8508-b095ced22996 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:11.342144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d3ebf66e-fea9-4056-8508-b095ced22996 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:11.359125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3ebf66e-fea9-4056-8508-b095ced22996 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:11.359625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3ebf66e-fea9-4056-8508-b095ced22996 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:11.360060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3ebf66e-fea9-4056-8508-b095ced22996 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:11.360768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3ebf66e-fea9-4056-8508-b095ced22996 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:11.361220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3ebf66e-fea9-4056-8508-b095ced22996 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:11.361692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3ebf66e-fea9-4056-8508-b095ced22996 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:11.421914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3960a353-555a-43d5-947a-bf5d7b0948a2 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578ba9adc0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:11.496508 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3960a353-555a-43d5-947a-bf5d7b0948a2 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f" status: 200 len: 1455 microversion: 2.1 time: 0.078655 Oct 04 21:19:11.497300 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1458/3008] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:11 2022] GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:11.513536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e2184f85-074c-44b6-8211-36702f6e75d1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:11.514062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e2184f85-074c-44b6-8211-36702f6e75d1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:11.523940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2184f85-074c-44b6-8211-36702f6e75d1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:11.524448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2184f85-074c-44b6-8211-36702f6e75d1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:11.524889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2184f85-074c-44b6-8211-36702f6e75d1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:11.525627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2184f85-074c-44b6-8211-36702f6e75d1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:11.526261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2184f85-074c-44b6-8211-36702f6e75d1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:11.526850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2184f85-074c-44b6-8211-36702f6e75d1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:12.652206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d3ebf66e-fea9-4056-8508-b095ced22996 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:12.664419 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d3ebf66e-fea9-4056-8508-b095ced22996 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1401 microversion: 2.1 time: 1.326675 Oct 04 21:19:12.666524 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1551/3009] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:11 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1401 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:12.679708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-29749699-cda1-40b5-8a32-76c5eaeca607 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:12.682681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-29749699-cda1-40b5-8a32-76c5eaeca607 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:12.696720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29749699-cda1-40b5-8a32-76c5eaeca607 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:12.699769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29749699-cda1-40b5-8a32-76c5eaeca607 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:12.700461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29749699-cda1-40b5-8a32-76c5eaeca607 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:12.701337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e2184f85-074c-44b6-8211-36702f6e75d1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:12.703227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29749699-cda1-40b5-8a32-76c5eaeca607 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:12.705053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29749699-cda1-40b5-8a32-76c5eaeca607 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:12.706788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29749699-cda1-40b5-8a32-76c5eaeca607 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:12.711775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e2184f85-074c-44b6-8211-36702f6e75d1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:12.714177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e2184f85-074c-44b6-8211-36702f6e75d1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:12.715378 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e2184f85-074c-44b6-8211-36702f6e75d1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1756 microversion: 2.32 time: 1.217116 Oct 04 21:19:12.725557 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1459/3010] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:11 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1756 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:12.735610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bd8718dd-124a-495e-90ac-85604100b686 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:12.744864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bd8718dd-124a-495e-90ac-85604100b686 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:12.762616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd8718dd-124a-495e-90ac-85604100b686 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:12.763023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd8718dd-124a-495e-90ac-85604100b686 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:12.763668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd8718dd-124a-495e-90ac-85604100b686 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:12.764538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd8718dd-124a-495e-90ac-85604100b686 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:12.765160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd8718dd-124a-495e-90ac-85604100b686 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:12.765791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd8718dd-124a-495e-90ac-85604100b686 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:12.838051 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bd8718dd-124a-495e-90ac-85604100b686 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110978 Oct 04 21:19:12.839262 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1460/3011] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:19:12 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:19:12.863278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f8107508-2fe4-4787-9799-d2ec33ca95dd tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b97caf0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:12.934770 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f8107508-2fe4-4787-9799-d2ec33ca95dd tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f" status: 200 len: 1455 microversion: 2.1 time: 0.094238 Oct 04 21:19:12.938516 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1461/3012] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:12 2022] GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:13.033132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-56adf808-3ba4-4255-987a-50f17c3424fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:13.036576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-56adf808-3ba4-4255-987a-50f17c3424fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:13.055505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56adf808-3ba4-4255-987a-50f17c3424fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:13.058449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56adf808-3ba4-4255-987a-50f17c3424fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:13.060602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56adf808-3ba4-4255-987a-50f17c3424fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:13.065233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56adf808-3ba4-4255-987a-50f17c3424fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:13.066556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56adf808-3ba4-4255-987a-50f17c3424fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:13.068539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56adf808-3ba4-4255-987a-50f17c3424fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:13.156708 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-56adf808-3ba4-4255-987a-50f17c3424fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] HTTP exception thrown: Cannot 'reboot' instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 while it is in vm_state rescued Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-56adf808-3ba4-4255-987a-50f17c3424fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Request method failure captured: Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2/action HTTP/1.1 Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 28 Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKIzNXd_CmvP-6Usf8igAzY3dlzgDYn--v5mxvj-LpxllWzzbFyJF08JoJ1PYfhtDQRJAhrGh_znPsymYAfveamBdA6vz1Y-oh2GJa7UDnV-tTkHC5ZL-7fb_GflotkDarrlFSqHRvs9b0CJFd3T0swEf2S9AMDAGMNIk353xt2G0b4 Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 047ff2c9b6414ce8b98364678cbfeb53 Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/047ff2c9b6414ce8b98364678cbfeb53"}]}] Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 047ff2c9b6414ce8b98364678cbfeb53 Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerRescueNegativeTestJSON-548947322-project Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: abb3ac58c2ea4e2da8b9e765eda5f333 Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerRescueNegativeTestJSON-548947322-project Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: {"reboot": {"type": "HARD"}} Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: exception: Cannot 'reboot' instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 while it is in vm_state rescued Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2', 'body': {'reboot': {'type': 'HARD'}}} Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:19:13.163316 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:19:13.169808 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 while it is in vm_state rescued Oct 04 21:19:13.169808 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:13.169808 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:13.169808 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:13.169808 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:13.169808 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:13.169808 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:13.169808 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:19:13.169808 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:19:13.169808 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 while it is in vm_state rescued Oct 04 21:19:13.169808 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:13.175919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-56adf808-3ba4-4255-987a-50f17c3424fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Returning 409 to user: Cannot 'reboot' instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 while it is in vm_state rescued {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:19:13.180354 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-56adf808-3ba4-4255-987a-50f17c3424fe tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "POST /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2/action" status: 409 len: 145 microversion: 2.1 time: 0.155422 Oct 04 21:19:13.191744 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1462/3013] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:19:13 2022] POST /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2/action => generated 145 bytes in 168 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 21:19:13.208335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2628a683-f5e0-4a98-9352-187cd476e833 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:13.217967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2628a683-f5e0-4a98-9352-187cd476e833 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:13.257659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2628a683-f5e0-4a98-9352-187cd476e833 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:13.258525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2628a683-f5e0-4a98-9352-187cd476e833 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:13.259412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2628a683-f5e0-4a98-9352-187cd476e833 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:13.261150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2628a683-f5e0-4a98-9352-187cd476e833 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:13.262055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2628a683-f5e0-4a98-9352-187cd476e833 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:13.264567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2628a683-f5e0-4a98-9352-187cd476e833 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:13.343707 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-2628a683-f5e0-4a98-9352-187cd476e833 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] HTTP exception thrown: Cannot 'rebuild' instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 while it is in vm_state rescued Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2628a683-f5e0-4a98-9352-187cd476e833 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Request method failure captured: Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2/action HTTP/1.1 Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 65 Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKIzNXd_CmvP-6Usf8igAzY3dlzgDYn--v5mxvj-LpxllWzzbFyJF08JoJ1PYfhtDQRJAhrGh_znPsymYAfveamBdA6vz1Y-oh2GJa7UDnV-tTkHC5ZL-7fb_GflotkDarrlFSqHRvs9b0CJFd3T0swEf2S9AMDAGMNIk353xt2G0b4 Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 047ff2c9b6414ce8b98364678cbfeb53 Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/047ff2c9b6414ce8b98364678cbfeb53"}]}] Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 047ff2c9b6414ce8b98364678cbfeb53 Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerRescueNegativeTestJSON-548947322-project Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: abb3ac58c2ea4e2da8b9e765eda5f333 Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerRescueNegativeTestJSON-548947322-project Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: {"rebuild": {"imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1"}} Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: exception: Cannot 'rebuild' instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 while it is in vm_state rescued Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2', 'body': {'rebuild': {'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1'}}} Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:19:13.352598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:19:13.357834 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:19:13.357834 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 21:19:13.357834 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 04 21:19:13.357834 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:19:13.357834 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:19:13.357834 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:19:13.357834 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 while it is in vm_state rescued Oct 04 21:19:13.357834 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:13.357834 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:13.357834 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:13.357834 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:13.357834 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:13.357834 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:13.357834 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:19:13.357834 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:19:13.357834 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 while it is in vm_state rescued Oct 04 21:19:13.357834 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:13.365415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2628a683-f5e0-4a98-9352-187cd476e833 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Returning 409 to user: Cannot 'rebuild' instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 while it is in vm_state rescued {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:19:13.373135 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2628a683-f5e0-4a98-9352-187cd476e833 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "POST /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2/action" status: 409 len: 146 microversion: 2.1 time: 0.178491 Oct 04 21:19:13.385568 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1463/3014] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:19:13 2022] POST /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2/action => generated 146 bytes in 184 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:19:13.401299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eeb66b2f-e47e-4190-ac68-d9082280aef3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:13.403087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eeb66b2f-e47e-4190-ac68-d9082280aef3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:13.414388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eeb66b2f-e47e-4190-ac68-d9082280aef3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:13.415098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eeb66b2f-e47e-4190-ac68-d9082280aef3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:13.415844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eeb66b2f-e47e-4190-ac68-d9082280aef3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:13.417034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eeb66b2f-e47e-4190-ac68-d9082280aef3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:13.417743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eeb66b2f-e47e-4190-ac68-d9082280aef3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:13.418819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eeb66b2f-e47e-4190-ac68-d9082280aef3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:13.463645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eeb66b2f-e47e-4190-ac68-d9082280aef3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:19:13.936572 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eeb66b2f-e47e-4190-ac68-d9082280aef3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 204 len: 0 microversion: 2.1 time: 0.546875 Oct 04 21:19:13.941767 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1464/3015] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:19:13 2022] DELETE /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:19:13.949199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ff3e0b1a-0662-4a44-bbff-51227132a820 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:13.949958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ff3e0b1a-0662-4a44-bbff-51227132a820 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:13.980600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff3e0b1a-0662-4a44-bbff-51227132a820 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:13.981118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff3e0b1a-0662-4a44-bbff-51227132a820 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:13.981637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff3e0b1a-0662-4a44-bbff-51227132a820 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:13.982361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff3e0b1a-0662-4a44-bbff-51227132a820 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:13.982828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff3e0b1a-0662-4a44-bbff-51227132a820 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:13.983264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff3e0b1a-0662-4a44-bbff-51227132a820 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:14.066445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-29749699-cda1-40b5-8a32-76c5eaeca607 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:14.104239 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-29749699-cda1-40b5-8a32-76c5eaeca607 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1334 microversion: 2.1 time: 1.436195 Oct 04 21:19:14.138264 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1552/3016] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:12 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1334 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:14.149708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ab80c18e-6dd5-45bb-8255-2b719e6df35a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:14.150349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ab80c18e-6dd5-45bb-8255-2b719e6df35a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:14.165631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab80c18e-6dd5-45bb-8255-2b719e6df35a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:14.168573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab80c18e-6dd5-45bb-8255-2b719e6df35a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:14.168573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab80c18e-6dd5-45bb-8255-2b719e6df35a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:14.168573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab80c18e-6dd5-45bb-8255-2b719e6df35a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:14.171113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab80c18e-6dd5-45bb-8255-2b719e6df35a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:14.171592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab80c18e-6dd5-45bb-8255-2b719e6df35a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:14.432592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ff3e0b1a-0662-4a44-bbff-51227132a820 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:14.445400 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ff3e0b1a-0662-4a44-bbff-51227132a820 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1401 microversion: 2.1 time: 0.502083 Oct 04 21:19:14.446870 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1465/3017] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:13 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1401 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:14.451797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ac13b950-11b5-40f3-aa69-434b8ceca532 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:14.466377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ac13b950-11b5-40f3-aa69-434b8ceca532 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:14.473138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac13b950-11b5-40f3-aa69-434b8ceca532 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:14.474050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac13b950-11b5-40f3-aa69-434b8ceca532 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:14.474749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac13b950-11b5-40f3-aa69-434b8ceca532 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:14.475716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac13b950-11b5-40f3-aa69-434b8ceca532 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:14.476408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac13b950-11b5-40f3-aa69-434b8ceca532 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:14.477070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac13b950-11b5-40f3-aa69-434b8ceca532 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:14.746996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ab80c18e-6dd5-45bb-8255-2b719e6df35a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:14.765716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ab80c18e-6dd5-45bb-8255-2b719e6df35a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:14.769812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ab80c18e-6dd5-45bb-8255-2b719e6df35a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:14.774744 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ab80c18e-6dd5-45bb-8255-2b719e6df35a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1803 microversion: 2.32 time: 0.633231 Oct 04 21:19:14.779189 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1553/3018] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:14 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1803 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:14.779961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ac13b950-11b5-40f3-aa69-434b8ceca532 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:14.787223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d90ef84b-d88d-458f-bb22-799577db50fb tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790b64a60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:14.806579 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ac13b950-11b5-40f3-aa69-434b8ceca532 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1691 microversion: 2.1 time: 0.358315 Oct 04 21:19:14.808271 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1466/3019] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:14 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1691 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:14.884439 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d90ef84b-d88d-458f-bb22-799577db50fb tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f" status: 200 len: 1455 microversion: 2.1 time: 0.103718 Oct 04 21:19:14.885029 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1554/3020] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:14 2022] GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:15.131948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-17f53979-dafd-4657-a771-8448f1c43049 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:15.133687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-17f53979-dafd-4657-a771-8448f1c43049 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:15.147720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f53979-dafd-4657-a771-8448f1c43049 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:15.148720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f53979-dafd-4657-a771-8448f1c43049 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:15.149593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f53979-dafd-4657-a771-8448f1c43049 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:15.152710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f53979-dafd-4657-a771-8448f1c43049 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:15.153356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f53979-dafd-4657-a771-8448f1c43049 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:15.153973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f53979-dafd-4657-a771-8448f1c43049 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:15.477001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c8d1329b-72ab-49e6-bc40-67754eb18692 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:15.478218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c8d1329b-72ab-49e6-bc40-67754eb18692 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:15.486916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8d1329b-72ab-49e6-bc40-67754eb18692 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:15.487599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8d1329b-72ab-49e6-bc40-67754eb18692 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:15.488245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8d1329b-72ab-49e6-bc40-67754eb18692 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:15.493368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8d1329b-72ab-49e6-bc40-67754eb18692 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:15.493368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8d1329b-72ab-49e6-bc40-67754eb18692 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:15.493368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8d1329b-72ab-49e6-bc40-67754eb18692 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:16.016640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-17f53979-dafd-4657-a771-8448f1c43049 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:16.026044 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-17f53979-dafd-4657-a771-8448f1c43049 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1334 microversion: 2.1 time: 0.898758 Oct 04 21:19:16.026645 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1467/3021] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:15 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1334 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:16.055446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ba717891-a7fe-41e6-b84a-76bb7ac5ccb8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:16.057690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ba717891-a7fe-41e6-b84a-76bb7ac5ccb8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:16.078438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba717891-a7fe-41e6-b84a-76bb7ac5ccb8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:16.080706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba717891-a7fe-41e6-b84a-76bb7ac5ccb8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:16.081171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba717891-a7fe-41e6-b84a-76bb7ac5ccb8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:16.081972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba717891-a7fe-41e6-b84a-76bb7ac5ccb8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:16.082430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba717891-a7fe-41e6-b84a-76bb7ac5ccb8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:16.085184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba717891-a7fe-41e6-b84a-76bb7ac5ccb8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:16.300431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c8d1329b-72ab-49e6-bc40-67754eb18692 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:16.327436 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c8d1329b-72ab-49e6-bc40-67754eb18692 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1401 microversion: 2.1 time: 0.851912 Oct 04 21:19:16.331076 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1555/3022] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:15 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1401 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:16.338077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-90506b6c-3f66-4b94-bae7-da59653a58d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:16.342010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-90506b6c-3f66-4b94-bae7-da59653a58d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:16.348065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90506b6c-3f66-4b94-bae7-da59653a58d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:16.348974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90506b6c-3f66-4b94-bae7-da59653a58d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:16.349718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90506b6c-3f66-4b94-bae7-da59653a58d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:16.350731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90506b6c-3f66-4b94-bae7-da59653a58d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:16.351693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90506b6c-3f66-4b94-bae7-da59653a58d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:16.352404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90506b6c-3f66-4b94-bae7-da59653a58d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:16.380135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ba717891-a7fe-41e6-b84a-76bb7ac5ccb8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:16.402721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ba717891-a7fe-41e6-b84a-76bb7ac5ccb8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:16.404183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ba717891-a7fe-41e6-b84a-76bb7ac5ccb8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:16.405377 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ba717891-a7fe-41e6-b84a-76bb7ac5ccb8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1803 microversion: 2.32 time: 0.366932 Oct 04 21:19:16.417788 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1468/3023] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:16 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1803 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:16.424561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c9506e49-0824-4d50-bb52-8da6f9c1dd7a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b8ddee0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:16.476906 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c9506e49-0824-4d50-bb52-8da6f9c1dd7a tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f" status: 200 len: 1455 microversion: 2.1 time: 0.057625 Oct 04 21:19:16.486090 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1469/3024] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:16 2022] GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f => generated 1455 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:16.769815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-90506b6c-3f66-4b94-bae7-da59653a58d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:16.789164 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-90506b6c-3f66-4b94-bae7-da59653a58d1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1691 microversion: 2.1 time: 0.448880 Oct 04 21:19:16.789164 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1556/3025] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:16 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1691 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:17.053133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-462d24e4-b5d0-4cb7-82c0-ee48ccc6fd01 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:17.053837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-462d24e4-b5d0-4cb7-82c0-ee48ccc6fd01 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:17.067186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-462d24e4-b5d0-4cb7-82c0-ee48ccc6fd01 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:17.071031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-462d24e4-b5d0-4cb7-82c0-ee48ccc6fd01 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:17.073828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-462d24e4-b5d0-4cb7-82c0-ee48ccc6fd01 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:17.075042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-462d24e4-b5d0-4cb7-82c0-ee48ccc6fd01 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:17.075764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-462d24e4-b5d0-4cb7-82c0-ee48ccc6fd01 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:17.077067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-462d24e4-b5d0-4cb7-82c0-ee48ccc6fd01 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:17.354936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d7f67e42-d6b6-48a7-8294-254a1e19ca3e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:17.356082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d7f67e42-d6b6-48a7-8294-254a1e19ca3e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:17.371821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7f67e42-d6b6-48a7-8294-254a1e19ca3e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:17.373601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7f67e42-d6b6-48a7-8294-254a1e19ca3e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:17.374063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7f67e42-d6b6-48a7-8294-254a1e19ca3e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:17.376635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7f67e42-d6b6-48a7-8294-254a1e19ca3e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:17.379385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7f67e42-d6b6-48a7-8294-254a1e19ca3e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:17.379871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7f67e42-d6b6-48a7-8294-254a1e19ca3e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:17.711872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-462d24e4-b5d0-4cb7-82c0-ee48ccc6fd01 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:17.764485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:17.781819 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-462d24e4-b5d0-4cb7-82c0-ee48ccc6fd01 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1334 microversion: 2.1 time: 0.732894 Oct 04 21:19:17.810478 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1470/3026] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:17 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1334 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:17.818971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0400fb39-7ff9-471e-a80f-f538588c3227 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:17.819617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0400fb39-7ff9-471e-a80f-f538588c3227 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:17.837845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0400fb39-7ff9-471e-a80f-f538588c3227 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:17.838353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0400fb39-7ff9-471e-a80f-f538588c3227 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:17.838804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0400fb39-7ff9-471e-a80f-f538588c3227 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:17.839534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0400fb39-7ff9-471e-a80f-f538588c3227 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:17.840019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0400fb39-7ff9-471e-a80f-f538588c3227 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:17.843343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0400fb39-7ff9-471e-a80f-f538588c3227 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:19.277071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d7f67e42-d6b6-48a7-8294-254a1e19ca3e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:19.290758 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d7f67e42-d6b6-48a7-8294-254a1e19ca3e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1401 microversion: 2.1 time: 1.940349 Oct 04 21:19:19.305452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0400fb39-7ff9-471e-a80f-f538588c3227 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:19.306147 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1557/3027] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:17 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1401 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:19.307648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0400fb39-7ff9-471e-a80f-f538588c3227 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:19.311760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0400fb39-7ff9-471e-a80f-f538588c3227 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:19.316618 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0400fb39-7ff9-471e-a80f-f538588c3227 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1850 microversion: 2.32 time: 1.503069 Oct 04 21:19:19.318554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-870542b3-25d3-46d1-b0b3-5c1ba845ac16 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790054dc0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:19.319042 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1471/3028] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:17 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1850 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:19.349763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-674aee25-f1b1-4a26-bf85-e81a9120cb65 req-1b3cd945-d845-4735-9e2d-f67bb8b3bf31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42a2921-02b6-42e2-bee6-8700cbb23832", "name": "network-vif-plugged", "status": "completed", "tag": "62c1d20e-0e34-4dfd-82f2-235f81bb16ed"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:19.373648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-674aee25-f1b1-4a26-bf85-e81a9120cb65 req-1b3cd945-d845-4735-9e2d-f67bb8b3bf31 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:19.374133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-674aee25-f1b1-4a26-bf85-e81a9120cb65 req-1b3cd945-d845-4735-9e2d-f67bb8b3bf31 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:19.374567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-674aee25-f1b1-4a26-bf85-e81a9120cb65 req-1b3cd945-d845-4735-9e2d-f67bb8b3bf31 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:19.412449 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-674aee25-f1b1-4a26-bf85-e81a9120cb65 req-1b3cd945-d845-4735-9e2d-f67bb8b3bf31 service nova] Creating event network-vif-plugged:62c1d20e-0e34-4dfd-82f2-235f81bb16ed for instance e42a2921-02b6-42e2-bee6-8700cbb23832 on n-h1-860282-1 Oct 04 21:19:19.425254 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-674aee25-f1b1-4a26-bf85-e81a9120cb65 req-1b3cd945-d845-4735-9e2d-f67bb8b3bf31 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103835 Oct 04 21:19:19.426179 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1472/3029] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:19.432796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8f8dc9b8-94da-4bec-b272-cc94b07fb46c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:19.433887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8f8dc9b8-94da-4bec-b272-cc94b07fb46c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:19.447751 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-870542b3-25d3-46d1-b0b3-5c1ba845ac16 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f" status: 200 len: 1455 microversion: 2.1 time: 0.143547 Oct 04 21:19:19.452532 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1558/3030] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:19 2022] GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:19.518394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f8dc9b8-94da-4bec-b272-cc94b07fb46c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:19.518394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f8dc9b8-94da-4bec-b272-cc94b07fb46c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:19.518594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5a1161a1-7e02-4168-a27b-2d47a58b2e17 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:19.518594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5a1161a1-7e02-4168-a27b-2d47a58b2e17 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:19.519965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f8dc9b8-94da-4bec-b272-cc94b07fb46c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:19.519965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f8dc9b8-94da-4bec-b272-cc94b07fb46c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:19.519965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f8dc9b8-94da-4bec-b272-cc94b07fb46c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:19.519965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f8dc9b8-94da-4bec-b272-cc94b07fb46c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:19.520322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a1161a1-7e02-4168-a27b-2d47a58b2e17 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:19.520322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a1161a1-7e02-4168-a27b-2d47a58b2e17 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:19.520322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a1161a1-7e02-4168-a27b-2d47a58b2e17 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:19.520322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a1161a1-7e02-4168-a27b-2d47a58b2e17 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:19.520322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a1161a1-7e02-4168-a27b-2d47a58b2e17 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:19.520322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a1161a1-7e02-4168-a27b-2d47a58b2e17 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:19.970060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8f8dc9b8-94da-4bec-b272-cc94b07fb46c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:19.979874 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8f8dc9b8-94da-4bec-b272-cc94b07fb46c tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1691 microversion: 2.1 time: 0.552257 Oct 04 21:19:19.987834 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1473/3031] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:19 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1691 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:19.997551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5a1161a1-7e02-4168-a27b-2d47a58b2e17 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:20.009240 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5a1161a1-7e02-4168-a27b-2d47a58b2e17 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1334 microversion: 2.1 time: 0.555260 Oct 04 21:19:20.009878 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1559/3032] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:19 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1334 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:20.320963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-645b20c5-702d-49c9-9397-d2442455f57a tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:20.322575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-645b20c5-702d-49c9-9397-d2442455f57a tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:20.324246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-916351c2-53a7-40d0-814c-fd7f42d9dc98 req-08f7a93b-73ca-4577-b229-8a188a9d66db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "tag": "59687d68-2ca3-4874-9671-aaaec5a44a09"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:20.355022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-916351c2-53a7-40d0-814c-fd7f42d9dc98 req-08f7a93b-73ca-4577-b229-8a188a9d66db service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:20.355022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-916351c2-53a7-40d0-814c-fd7f42d9dc98 req-08f7a93b-73ca-4577-b229-8a188a9d66db service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:20.355738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-645b20c5-702d-49c9-9397-d2442455f57a tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:20.356002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-916351c2-53a7-40d0-814c-fd7f42d9dc98 req-08f7a93b-73ca-4577-b229-8a188a9d66db service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:20.356110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-645b20c5-702d-49c9-9397-d2442455f57a tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:20.356839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-645b20c5-702d-49c9-9397-d2442455f57a tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:20.358889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-645b20c5-702d-49c9-9397-d2442455f57a tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:20.363346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-645b20c5-702d-49c9-9397-d2442455f57a tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:20.363939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-645b20c5-702d-49c9-9397-d2442455f57a tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:20.378992 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-916351c2-53a7-40d0-814c-fd7f42d9dc98 req-08f7a93b-73ca-4577-b229-8a188a9d66db service nova] Creating event network-changed:59687d68-2ca3-4874-9671-aaaec5a44a09 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:19:20.394632 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-916351c2-53a7-40d0-814c-fd7f42d9dc98 req-08f7a93b-73ca-4577-b229-8a188a9d66db service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070571 Oct 04 21:19:20.394632 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1560/3033] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:20.400523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-deab7aac-2a03-4941-9115-1da5a1f88751 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:20.402484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-deab7aac-2a03-4941-9115-1da5a1f88751 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:20.413205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-deab7aac-2a03-4941-9115-1da5a1f88751 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:20.421181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-deab7aac-2a03-4941-9115-1da5a1f88751 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:20.423286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-deab7aac-2a03-4941-9115-1da5a1f88751 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:20.426100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-deab7aac-2a03-4941-9115-1da5a1f88751 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:20.428259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-deab7aac-2a03-4941-9115-1da5a1f88751 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:20.430074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-deab7aac-2a03-4941-9115-1da5a1f88751 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:21.023032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-deab7aac-2a03-4941-9115-1da5a1f88751 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:21.048084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-deab7aac-2a03-4941-9115-1da5a1f88751 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:21.064042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-deab7aac-2a03-4941-9115-1da5a1f88751 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:21.066368 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-deab7aac-2a03-4941-9115-1da5a1f88751 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1850 microversion: 2.32 time: 0.673305 Oct 04 21:19:21.070384 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1561/3034] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:20 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1850 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:21.096632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cb72e93f-9e6c-4e67-acc4-073a11336c5f tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790b3d790>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:21.193906 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cb72e93f-9e6c-4e67-acc4-073a11336c5f tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f" status: 200 len: 1455 microversion: 2.1 time: 0.121728 Oct 04 21:19:21.209559 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1562/3035] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:21 2022] GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:21.218872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f7e4880b-2e99-4055-821e-edfed86ef3a5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:21.219665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f7e4880b-2e99-4055-821e-edfed86ef3a5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:21.240775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7e4880b-2e99-4055-821e-edfed86ef3a5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:21.248964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7e4880b-2e99-4055-821e-edfed86ef3a5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:21.249733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7e4880b-2e99-4055-821e-edfed86ef3a5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:21.250668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7e4880b-2e99-4055-821e-edfed86ef3a5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:21.251504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7e4880b-2e99-4055-821e-edfed86ef3a5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:21.252177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7e4880b-2e99-4055-821e-edfed86ef3a5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:21.384585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-645b20c5-702d-49c9-9397-d2442455f57a tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:21.412079 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-645b20c5-702d-49c9-9397-d2442455f57a tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1401 microversion: 2.1 time: 1.093963 Oct 04 21:19:21.415350 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1474/3036] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:20 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1401 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:21.424167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c1a2ea4a-52db-457b-8f3f-0a5407bd892a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:21.426017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c1a2ea4a-52db-457b-8f3f-0a5407bd892a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:21.437117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f7e4880b-2e99-4055-821e-edfed86ef3a5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:21.454640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1a2ea4a-52db-457b-8f3f-0a5407bd892a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:21.456048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1a2ea4a-52db-457b-8f3f-0a5407bd892a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:21.456665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1a2ea4a-52db-457b-8f3f-0a5407bd892a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:21.457636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1a2ea4a-52db-457b-8f3f-0a5407bd892a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:21.459027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1a2ea4a-52db-457b-8f3f-0a5407bd892a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:21.459648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1a2ea4a-52db-457b-8f3f-0a5407bd892a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:21.460453 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f7e4880b-2e99-4055-821e-edfed86ef3a5 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1623 microversion: 2.1 time: 0.261418 Oct 04 21:19:21.461208 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1563/3037] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:21 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1623 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:21.483772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-fc019ec1-2e8e-401f-a73d-962214cd67d3 req-961a2db3-29cc-4558-a450-f5986e6cd52c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd8a0d92-6584-4dc6-b2d1-b1227a77f314", "name": "network-vif-plugged", "status": "completed", "tag": "78a64cea-abc0-483b-8a8a-c375cb239a62"}, {"server_uuid": "e42a2921-02b6-42e2-bee6-8700cbb23832", "name": "network-vif-plugged", "status": "completed", "tag": "492cb8c5-a3fc-4a42-8a45-76af0767e9dc"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:21.516114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-fc019ec1-2e8e-401f-a73d-962214cd67d3 req-961a2db3-29cc-4558-a450-f5986e6cd52c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:21.516864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-fc019ec1-2e8e-401f-a73d-962214cd67d3 req-961a2db3-29cc-4558-a450-f5986e6cd52c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:21.518082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-fc019ec1-2e8e-401f-a73d-962214cd67d3 req-961a2db3-29cc-4558-a450-f5986e6cd52c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:21.547890 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-fc019ec1-2e8e-401f-a73d-962214cd67d3 req-961a2db3-29cc-4558-a450-f5986e6cd52c service nova] Creating event network-vif-plugged:78a64cea-abc0-483b-8a8a-c375cb239a62 for instance fd8a0d92-6584-4dc6-b2d1-b1227a77f314 on n-h2-860282-1 Oct 04 21:19:21.551194 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-fc019ec1-2e8e-401f-a73d-962214cd67d3 req-961a2db3-29cc-4558-a450-f5986e6cd52c service nova] Creating event network-vif-plugged:492cb8c5-a3fc-4a42-8a45-76af0767e9dc for instance e42a2921-02b6-42e2-bee6-8700cbb23832 on n-h1-860282-1 Oct 04 21:19:21.574941 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-fc019ec1-2e8e-401f-a73d-962214cd67d3 req-961a2db3-29cc-4558-a450-f5986e6cd52c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.110922 Oct 04 21:19:21.576206 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1564/3038] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:21.974263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c1a2ea4a-52db-457b-8f3f-0a5407bd892a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:21.988976 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c1a2ea4a-52db-457b-8f3f-0a5407bd892a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1334 microversion: 2.1 time: 0.572164 Oct 04 21:19:22.006057 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1475/3039] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:21 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1334 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:22.098602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5a8f49d6-130f-4ec9-bc4c-33bdf900531b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:22.108215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5a8f49d6-130f-4ec9-bc4c-33bdf900531b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:22.114962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a8f49d6-130f-4ec9-bc4c-33bdf900531b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:22.115462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a8f49d6-130f-4ec9-bc4c-33bdf900531b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:22.116077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a8f49d6-130f-4ec9-bc4c-33bdf900531b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:22.116805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a8f49d6-130f-4ec9-bc4c-33bdf900531b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:22.117269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a8f49d6-130f-4ec9-bc4c-33bdf900531b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:22.117741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a8f49d6-130f-4ec9-bc4c-33bdf900531b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:22.217150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-39b4ef8e-e776-44ba-bad4-c0a0c6fb9bb1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b90df70>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:22.303518 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-39b4ef8e-e776-44ba-bad4-c0a0c6fb9bb1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f" status: 200 len: 1455 microversion: 2.1 time: 0.089630 Oct 04 21:19:22.307711 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1476/3040] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:22 2022] GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:22.436938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d77ebf69-f99e-470d-bbca-8375b15992e9 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:22.450217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d77ebf69-f99e-470d-bbca-8375b15992e9 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:22.493293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d77ebf69-f99e-470d-bbca-8375b15992e9 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:22.495919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d77ebf69-f99e-470d-bbca-8375b15992e9 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:22.497829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d77ebf69-f99e-470d-bbca-8375b15992e9 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:22.503855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d77ebf69-f99e-470d-bbca-8375b15992e9 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:22.509974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d77ebf69-f99e-470d-bbca-8375b15992e9 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:22.510751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d77ebf69-f99e-470d-bbca-8375b15992e9 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:23.769236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5a8f49d6-130f-4ec9-bc4c-33bdf900531b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:23.795616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5a8f49d6-130f-4ec9-bc4c-33bdf900531b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:23.800699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5a8f49d6-130f-4ec9-bc4c-33bdf900531b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:23.808851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d77ebf69-f99e-470d-bbca-8375b15992e9 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:23.821970 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d77ebf69-f99e-470d-bbca-8375b15992e9 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1401 microversion: 2.1 time: 1.389471 Oct 04 21:19:23.823958 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5a8f49d6-130f-4ec9-bc4c-33bdf900531b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1871 microversion: 2.32 time: 1.707852 Oct 04 21:19:23.824947 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1477/3041] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:22 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1401 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:23.828812 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1565/3042] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:22 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1871 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:23.841614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b92322aa-0d75-41a2-9551-cc5a4f4e1f52 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:23.854827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-3c471df8-034f-486c-800e-697f98331cf7 req-98c2a8f5-f00a-4d23-a936-52daa3a4d65e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3", "name": "network-vif-deleted", "tag": "4c39a316-efc6-4f59-97f7-911c7414ee28"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:23.863699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b92322aa-0d75-41a2-9551-cc5a4f4e1f52 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:23.877306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3c471df8-034f-486c-800e-697f98331cf7 req-98c2a8f5-f00a-4d23-a936-52daa3a4d65e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:23.880814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3c471df8-034f-486c-800e-697f98331cf7 req-98c2a8f5-f00a-4d23-a936-52daa3a4d65e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:23.882042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3c471df8-034f-486c-800e-697f98331cf7 req-98c2a8f5-f00a-4d23-a936-52daa3a4d65e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:23.883720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b92322aa-0d75-41a2-9551-cc5a4f4e1f52 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:23.894250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b92322aa-0d75-41a2-9551-cc5a4f4e1f52 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:23.895217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b92322aa-0d75-41a2-9551-cc5a4f4e1f52 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:23.896368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b92322aa-0d75-41a2-9551-cc5a4f4e1f52 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:23.901936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b92322aa-0d75-41a2-9551-cc5a4f4e1f52 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:23.908128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b92322aa-0d75-41a2-9551-cc5a4f4e1f52 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:23.912733 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-3c471df8-034f-486c-800e-697f98331cf7 req-98c2a8f5-f00a-4d23-a936-52daa3a4d65e service nova] Creating event network-vif-deleted:4c39a316-efc6-4f59-97f7-911c7414ee28 for instance 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 on n-h1-860282-1 Oct 04 21:19:23.931108 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-3c471df8-034f-486c-800e-697f98331cf7 req-98c2a8f5-f00a-4d23-a936-52daa3a4d65e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099087 Oct 04 21:19:23.935726 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1478/3043] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:23.952506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-70bfcf8b-64f1-40de-8f38-13a4892e4a1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:23.953396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-70bfcf8b-64f1-40de-8f38-13a4892e4a1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:23.978335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70bfcf8b-64f1-40de-8f38-13a4892e4a1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:23.979389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70bfcf8b-64f1-40de-8f38-13a4892e4a1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:23.981389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70bfcf8b-64f1-40de-8f38-13a4892e4a1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:23.983369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b92322aa-0d75-41a2-9551-cc5a4f4e1f52 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:23.984275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70bfcf8b-64f1-40de-8f38-13a4892e4a1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:23.984625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b92322aa-0d75-41a2-9551-cc5a4f4e1f52 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:23.985491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70bfcf8b-64f1-40de-8f38-13a4892e4a1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:23.985638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b92322aa-0d75-41a2-9551-cc5a4f4e1f52 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:23.988121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-b92322aa-0d75-41a2-9551-cc5a4f4e1f52 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lazy-loading 'fault' on Instance uuid 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:19:23.988255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70bfcf8b-64f1-40de-8f38-13a4892e4a1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:24.277210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b92322aa-0d75-41a2-9551-cc5a4f4e1f52 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:24.303127 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b92322aa-0d75-41a2-9551-cc5a4f4e1f52 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 200 len: 1335 microversion: 2.1 time: 0.471983 Oct 04 21:19:24.309933 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1566/3044] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:23 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 1335 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:24.338848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-124e61f6-480a-4c09-bf27-c199175275f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:24.342343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-124e61f6-480a-4c09-bf27-c199175275f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:24.390865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-124e61f6-480a-4c09-bf27-c199175275f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:24.391401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-124e61f6-480a-4c09-bf27-c199175275f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:24.399517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-124e61f6-480a-4c09-bf27-c199175275f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:24.400611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-124e61f6-480a-4c09-bf27-c199175275f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:24.404458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-124e61f6-480a-4c09-bf27-c199175275f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:24.407653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-124e61f6-480a-4c09-bf27-c199175275f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:24.776073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-70bfcf8b-64f1-40de-8f38-13a4892e4a1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:24.786982 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-70bfcf8b-64f1-40de-8f38-13a4892e4a1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.847890 Oct 04 21:19:24.788616 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1479/3045] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:23 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:24.794106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-154234b4-87aa-4504-a0d0-4f35fbc4d568 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b97caf0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:24.864220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-124e61f6-480a-4c09-bf27-c199175275f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:24.879973 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-124e61f6-480a-4c09-bf27-c199175275f3 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1669 microversion: 2.1 time: 0.562909 Oct 04 21:19:24.880578 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1567/3046] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:24 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1669 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:24.901247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ad3269ba-82e2-4dae-9760-2811a1d1cd22 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:24.901247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ad3269ba-82e2-4dae-9760-2811a1d1cd22 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:24.911052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad3269ba-82e2-4dae-9760-2811a1d1cd22 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:24.911554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad3269ba-82e2-4dae-9760-2811a1d1cd22 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:24.912729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad3269ba-82e2-4dae-9760-2811a1d1cd22 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:24.913674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad3269ba-82e2-4dae-9760-2811a1d1cd22 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:24.914329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad3269ba-82e2-4dae-9760-2811a1d1cd22 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:24.914930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad3269ba-82e2-4dae-9760-2811a1d1cd22 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:24.940146 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-154234b4-87aa-4504-a0d0-4f35fbc4d568 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f" status: 200 len: 1455 microversion: 2.1 time: 0.149482 Oct 04 21:19:24.951001 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1480/3047] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:24 2022] GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f => generated 1455 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:24.959570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d21d91c0-d3f3-4bf8-b91d-a4d41f70fc98 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:24.959570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d21d91c0-d3f3-4bf8-b91d-a4d41f70fc98 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:24.971547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d21d91c0-d3f3-4bf8-b91d-a4d41f70fc98 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:24.971828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d21d91c0-d3f3-4bf8-b91d-a4d41f70fc98 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:24.972529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d21d91c0-d3f3-4bf8-b91d-a4d41f70fc98 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:24.973618 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d21d91c0-d3f3-4bf8-b91d-a4d41f70fc98 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:24.974315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d21d91c0-d3f3-4bf8-b91d-a4d41f70fc98 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:24.974915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d21d91c0-d3f3-4bf8-b91d-a4d41f70fc98 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:24.993931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:25.546188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ad3269ba-82e2-4dae-9760-2811a1d1cd22 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:25.567246 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ad3269ba-82e2-4dae-9760-2811a1d1cd22 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.683444 Oct 04 21:19:25.572747 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1568/3048] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:24 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:25.579403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-94dbde68-2628-4366-a346-363515ce7f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:25.580546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-94dbde68-2628-4366-a346-363515ce7f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:25.589114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94dbde68-2628-4366-a346-363515ce7f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:25.589886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94dbde68-2628-4366-a346-363515ce7f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:25.590512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94dbde68-2628-4366-a346-363515ce7f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:25.591643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94dbde68-2628-4366-a346-363515ce7f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:25.592422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94dbde68-2628-4366-a346-363515ce7f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:25.593207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94dbde68-2628-4366-a346-363515ce7f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:25.605170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d21d91c0-d3f3-4bf8-b91d-a4d41f70fc98 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:25.622915 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d21d91c0-d3f3-4bf8-b91d-a4d41f70fc98 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1589 microversion: 2.1 time: 0.669607 Oct 04 21:19:25.623518 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1481/3049] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:24 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1589 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:25.637021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4dac10fd-1f42-4d6e-903b-9f8c311ddc7b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:25.642327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4dac10fd-1f42-4d6e-903b-9f8c311ddc7b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:25.656878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4dac10fd-1f42-4d6e-903b-9f8c311ddc7b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:25.666980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4dac10fd-1f42-4d6e-903b-9f8c311ddc7b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:25.670028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4dac10fd-1f42-4d6e-903b-9f8c311ddc7b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:25.672894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4dac10fd-1f42-4d6e-903b-9f8c311ddc7b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:25.674120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4dac10fd-1f42-4d6e-903b-9f8c311ddc7b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:25.680094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4dac10fd-1f42-4d6e-903b-9f8c311ddc7b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:25.740633 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4dac10fd-1f42-4d6e-903b-9f8c311ddc7b tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832/ips" status: 200 len: 179 microversion: 2.1 time: 0.110431 Oct 04 21:19:25.741327 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1482/3050] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Oct 4 21:19:25 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832/ips => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:25.757240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab0fcabb-bcc7-4b39-ac82-f7005312bff2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:25.757803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ab0fcabb-bcc7-4b39-ac82-f7005312bff2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:25.776620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab0fcabb-bcc7-4b39-ac82-f7005312bff2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:25.777404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab0fcabb-bcc7-4b39-ac82-f7005312bff2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:25.778080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab0fcabb-bcc7-4b39-ac82-f7005312bff2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:25.779014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab0fcabb-bcc7-4b39-ac82-f7005312bff2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:25.779654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab0fcabb-bcc7-4b39-ac82-f7005312bff2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:25.785611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab0fcabb-bcc7-4b39-ac82-f7005312bff2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:25.802705 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-ab0fcabb-bcc7-4b39-ac82-f7005312bff2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] HTTP exception thrown: Instance 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 could not be found. Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab0fcabb-bcc7-4b39-ac82-f7005312bff2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Request method failure captured: Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 HTTP/1.1 Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKIzNXd_CmvP-6Usf8igAzY3dlzgDYn--v5mxvj-LpxllWzzbFyJF08JoJ1PYfhtDQRJAhrGh_znPsymYAfveamBdA6vz1Y-oh2GJa7UDnV-tTkHC5ZL-7fb_GflotkDarrlFSqHRvs9b0CJFd3T0swEf2S9AMDAGMNIk353xt2G0b4 Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 047ff2c9b6414ce8b98364678cbfeb53 Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/047ff2c9b6414ce8b98364678cbfeb53"}]}] Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 047ff2c9b6414ce8b98364678cbfeb53 Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerRescueNegativeTestJSON-548947322-project Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: abb3ac58c2ea4e2da8b9e765eda5f333 Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerRescueNegativeTestJSON-548947322-project Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 could not be found. Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3'} Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 could not be found. Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 could not be found. Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:25.804828 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:25.809083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:25.809083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:25.809083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:25.809083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:25.809083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:19:25.809083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:19:25.809083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 could not be found. Oct 04 21:19:25.809083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:25.811458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab0fcabb-bcc7-4b39-ac82-f7005312bff2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Returning 404 to user: Instance 2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:19:25.812730 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ab0fcabb-bcc7-4b39-ac82-f7005312bff2 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3" status: 404 len: 111 microversion: 2.1 time: 0.070536 Oct 04 21:19:25.813848 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1483/3051] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:25 2022] GET /compute/v2.1/servers/2daf4dce-b11b-4f66-8a6e-9a4c89bba0a3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:19:25.819595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e9a2e558-6337-4c69-b0d6-19f6a1d2493c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:25.820508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e9a2e558-6337-4c69-b0d6-19f6a1d2493c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:25.830214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9a2e558-6337-4c69-b0d6-19f6a1d2493c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:25.830943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9a2e558-6337-4c69-b0d6-19f6a1d2493c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:25.831612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9a2e558-6337-4c69-b0d6-19f6a1d2493c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:25.835599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9a2e558-6337-4c69-b0d6-19f6a1d2493c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:25.836457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9a2e558-6337-4c69-b0d6-19f6a1d2493c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:25.837108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9a2e558-6337-4c69-b0d6-19f6a1d2493c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:26.279029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-94dbde68-2628-4366-a346-363515ce7f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:26.304259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-94dbde68-2628-4366-a346-363515ce7f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:26.305822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-94dbde68-2628-4366-a346-363515ce7f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:26.307043 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-94dbde68-2628-4366-a346-363515ce7f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1871 microversion: 2.32 time: 0.731761 Oct 04 21:19:26.318711 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1569/3052] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:25 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1871 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:26.324070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-711a4c74-7fb0-46cc-b72c-d6acaa2c601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:26.327233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-711a4c74-7fb0-46cc-b72c-d6acaa2c601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:26.350682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-711a4c74-7fb0-46cc-b72c-d6acaa2c601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:26.351740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-711a4c74-7fb0-46cc-b72c-d6acaa2c601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:26.352658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-711a4c74-7fb0-46cc-b72c-d6acaa2c601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:26.353462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-711a4c74-7fb0-46cc-b72c-d6acaa2c601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:26.353968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-711a4c74-7fb0-46cc-b72c-d6acaa2c601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:26.354405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-711a4c74-7fb0-46cc-b72c-d6acaa2c601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:26.421524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e9a2e558-6337-4c69-b0d6-19f6a1d2493c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:26.440908 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e9a2e558-6337-4c69-b0d6-19f6a1d2493c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.625203 Oct 04 21:19:26.445354 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1484/3053] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:25 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:26.455050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c580e5d1-4604-4c1d-b5d8-0bcc9ad6f5cf tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:26.459916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c580e5d1-4604-4c1d-b5d8-0bcc9ad6f5cf tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:26.476292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c580e5d1-4604-4c1d-b5d8-0bcc9ad6f5cf tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:26.482878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c580e5d1-4604-4c1d-b5d8-0bcc9ad6f5cf tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:26.483494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c580e5d1-4604-4c1d-b5d8-0bcc9ad6f5cf tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:26.488660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c580e5d1-4604-4c1d-b5d8-0bcc9ad6f5cf tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:26.489335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c580e5d1-4604-4c1d-b5d8-0bcc9ad6f5cf tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:26.490035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c580e5d1-4604-4c1d-b5d8-0bcc9ad6f5cf tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:26.546400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c580e5d1-4604-4c1d-b5d8-0bcc9ad6f5cf tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:19:26.645271 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-711a4c74-7fb0-46cc-b72c-d6acaa2c601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.325150 Oct 04 21:19:26.645974 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1570/3054] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:19:26 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314/os-interface => generated 285 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:26.660562 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9fada3d6-8340-418d-adc2-b0f385ddbda1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '.version_select at 0x7f5790bbfdc0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:26.829736 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9fada3d6-8340-418d-adc2-b0f385ddbda1 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-485431192" status: 202 len: 0 microversion: 2.1 time: 0.174072 Oct 04 21:19:26.830803 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1571/3055] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Oct 4 21:19:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-485431192 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:19:26.840441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bc6a3634-5159-4011-81e2-330f1457ef12 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790925a60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:26.970205 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bc6a3634-5159-4011-81e2-330f1457ef12 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f" status: 200 len: 1455 microversion: 2.1 time: 0.135152 Oct 04 21:19:26.974284 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1572/3056] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:26 2022] GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:26.982366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-bdeb9cb5-9b2f-40b4-99d6-f7563a77253f req-95ffeb02-f7a6-411f-b375-05c7e2c83696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "tag": "39ddb102-5195-44fc-a97d-9cec4b059f51"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:26.992202 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c580e5d1-4604-4c1d-b5d8-0bcc9ad6f5cf tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 204 len: 0 microversion: 2.1 time: 0.541080 Oct 04 21:19:26.993205 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1485/3057] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:19:26 2022] DELETE /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:19:27.002294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0ea7720b-6852-4871-a54a-bf089981cb09 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-120312089"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:27.009089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0ea7720b-6852-4871-a54a-bf089981cb09 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:27.016929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-bdeb9cb5-9b2f-40b4-99d6-f7563a77253f req-95ffeb02-f7a6-411f-b375-05c7e2c83696 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:27.020895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-bdeb9cb5-9b2f-40b4-99d6-f7563a77253f req-95ffeb02-f7a6-411f-b375-05c7e2c83696 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:27.021686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-bdeb9cb5-9b2f-40b4-99d6-f7563a77253f req-95ffeb02-f7a6-411f-b375-05c7e2c83696 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:27.028868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ea7720b-6852-4871-a54a-bf089981cb09 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:27.029371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ea7720b-6852-4871-a54a-bf089981cb09 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:27.029842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ea7720b-6852-4871-a54a-bf089981cb09 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:27.041166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ea7720b-6852-4871-a54a-bf089981cb09 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:27.043940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ea7720b-6852-4871-a54a-bf089981cb09 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:27.045955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ea7720b-6852-4871-a54a-bf089981cb09 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:27.078612 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-bdeb9cb5-9b2f-40b4-99d6-f7563a77253f req-95ffeb02-f7a6-411f-b375-05c7e2c83696 service nova] Creating event network-changed:39ddb102-5195-44fc-a97d-9cec4b059f51 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:19:27.098462 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-bdeb9cb5-9b2f-40b4-99d6-f7563a77253f req-95ffeb02-f7a6-411f-b375-05c7e2c83696 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117085 Oct 04 21:19:27.102675 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1573/3058] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:27.126085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7f0b1f70-2a9a-4023-843d-2ef4022508e5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:27.128310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7f0b1f70-2a9a-4023-843d-2ef4022508e5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:27.155009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f0b1f70-2a9a-4023-843d-2ef4022508e5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:27.158506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f0b1f70-2a9a-4023-843d-2ef4022508e5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:27.162524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f0b1f70-2a9a-4023-843d-2ef4022508e5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:27.165270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f0b1f70-2a9a-4023-843d-2ef4022508e5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:27.165903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f0b1f70-2a9a-4023-843d-2ef4022508e5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:27.167791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f0b1f70-2a9a-4023-843d-2ef4022508e5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:27.655694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7f0b1f70-2a9a-4023-843d-2ef4022508e5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:27.672529 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7f0b1f70-2a9a-4023-843d-2ef4022508e5 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1675 microversion: 2.1 time: 0.566012 Oct 04 21:19:27.692198 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1574/3059] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:27 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1675 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:27.706003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-92610061-42fe-4398-a67b-b7d326e3af54 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:27.710419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-92610061-42fe-4398-a67b-b7d326e3af54 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:27.718341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:27.720051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92610061-42fe-4398-a67b-b7d326e3af54 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:27.720985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92610061-42fe-4398-a67b-b7d326e3af54 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:27.721774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92610061-42fe-4398-a67b-b7d326e3af54 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:27.722612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92610061-42fe-4398-a67b-b7d326e3af54 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:27.723342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92610061-42fe-4398-a67b-b7d326e3af54 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:27.723875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92610061-42fe-4398-a67b-b7d326e3af54 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:27.952854 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0ea7720b-6852-4871-a54a-bf089981cb09 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action" status: 202 len: 0 microversion: 2.1 time: 0.957768 Oct 04 21:19:27.955404 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1486/3060] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:19:26 2022] POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action => generated 0 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 21:19:27.991577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0e7c2b24-94f6-4cea-bcd5-792adbaded83 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b90d550>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:28.172382 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0e7c2b24-94f6-4cea-bcd5-792adbaded83 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f" status: 200 len: 1455 microversion: 2.1 time: 0.187354 Oct 04 21:19:28.172963 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1487/3061] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:27 2022] GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f => generated 1455 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:28.703638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-480b6c06-e549-4f1d-9363-bfd644f63f97 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:28.704751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-480b6c06-e549-4f1d-9363-bfd644f63f97 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:28.727983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480b6c06-e549-4f1d-9363-bfd644f63f97 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:28.728665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480b6c06-e549-4f1d-9363-bfd644f63f97 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:28.729229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480b6c06-e549-4f1d-9363-bfd644f63f97 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:28.730111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480b6c06-e549-4f1d-9363-bfd644f63f97 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:28.730819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480b6c06-e549-4f1d-9363-bfd644f63f97 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:28.731356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480b6c06-e549-4f1d-9363-bfd644f63f97 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:29.182782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-92610061-42fe-4398-a67b-b7d326e3af54 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:29.201598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-92610061-42fe-4398-a67b-b7d326e3af54 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:29.203358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-92610061-42fe-4398-a67b-b7d326e3af54 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:29.208318 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-92610061-42fe-4398-a67b-b7d326e3af54 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1892 microversion: 2.32 time: 1.514626 Oct 04 21:19:29.210775 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1575/3062] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:27 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1892 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:29.222382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f2e8ab96-fc2d-4fd5-8f86-2bb31011e48c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790925670>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:29.242851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-480b6c06-e549-4f1d-9363-bfd644f63f97 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:29.254419 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-480b6c06-e549-4f1d-9363-bfd644f63f97 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1675 microversion: 2.1 time: 0.560241 Oct 04 21:19:29.256121 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1488/3063] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:28 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1675 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:29.262768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-a36cc4d2-2291-42ed-87b7-d48073cba4de req-18e02731-dcd2-4159-8f8d-4d3649c4e739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "tag": "a8c25e3b-fbff-43dd-a188-c7127b5919b0"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:29.278000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a36cc4d2-2291-42ed-87b7-d48073cba4de req-18e02731-dcd2-4159-8f8d-4d3649c4e739 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:29.281176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a36cc4d2-2291-42ed-87b7-d48073cba4de req-18e02731-dcd2-4159-8f8d-4d3649c4e739 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:29.281176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a36cc4d2-2291-42ed-87b7-d48073cba4de req-18e02731-dcd2-4159-8f8d-4d3649c4e739 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:29.303499 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-a36cc4d2-2291-42ed-87b7-d48073cba4de req-18e02731-dcd2-4159-8f8d-4d3649c4e739 service nova] Creating event network-changed:a8c25e3b-fbff-43dd-a188-c7127b5919b0 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:19:29.336010 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-a36cc4d2-2291-42ed-87b7-d48073cba4de req-18e02731-dcd2-4159-8f8d-4d3649c4e739 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076834 Oct 04 21:19:29.343664 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f2e8ab96-fc2d-4fd5-8f86-2bb31011e48c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f" status: 200 len: 1455 microversion: 2.1 time: 0.131549 Oct 04 21:19:29.344031 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1489/3064] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:29.345133 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1576/3065] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:29 2022] GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:30.249439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9a75a2f4-6a56-4ab9-90bc-6ea9cce83b70 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:30.256547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9a75a2f4-6a56-4ab9-90bc-6ea9cce83b70 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:30.283866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e1aa10e0-b0c0-4a12-9d9f-1041b3106402 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:30.285018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e1aa10e0-b0c0-4a12-9d9f-1041b3106402 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:30.302999 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a75a2f4-6a56-4ab9-90bc-6ea9cce83b70 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:30.304055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a75a2f4-6a56-4ab9-90bc-6ea9cce83b70 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:30.304449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1aa10e0-b0c0-4a12-9d9f-1041b3106402 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:30.304957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1aa10e0-b0c0-4a12-9d9f-1041b3106402 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:30.305247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a75a2f4-6a56-4ab9-90bc-6ea9cce83b70 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:30.305451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1aa10e0-b0c0-4a12-9d9f-1041b3106402 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:30.306425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a75a2f4-6a56-4ab9-90bc-6ea9cce83b70 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:30.308593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1aa10e0-b0c0-4a12-9d9f-1041b3106402 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:30.310621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1aa10e0-b0c0-4a12-9d9f-1041b3106402 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:30.311446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a75a2f4-6a56-4ab9-90bc-6ea9cce83b70 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:30.312131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1aa10e0-b0c0-4a12-9d9f-1041b3106402 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:30.315664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a75a2f4-6a56-4ab9-90bc-6ea9cce83b70 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:30.409762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:31.016210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e1aa10e0-b0c0-4a12-9d9f-1041b3106402 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:31.046151 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e1aa10e0-b0c0-4a12-9d9f-1041b3106402 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1675 microversion: 2.1 time: 0.767194 Oct 04 21:19:31.046755 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1577/3066] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:30 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1675 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:31.088531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aadef9db-26d2-4d81-a777-d7946f52ac14 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790136550>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:31.117641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9a75a2f4-6a56-4ab9-90bc-6ea9cce83b70 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:31.137076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9a75a2f4-6a56-4ab9-90bc-6ea9cce83b70 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:31.143196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9a75a2f4-6a56-4ab9-90bc-6ea9cce83b70 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:31.148865 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9a75a2f4-6a56-4ab9-90bc-6ea9cce83b70 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1892 microversion: 2.32 time: 0.907335 Oct 04 21:19:31.150701 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1490/3067] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:30 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1892 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:31.337899 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aadef9db-26d2-4d81-a777-d7946f52ac14 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f" status: 200 len: 1455 microversion: 2.1 time: 0.280846 Oct 04 21:19:31.340444 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1578/3068] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:31 2022] GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f => generated 1455 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:31.760932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-64d7c562-9fcf-4faf-b250-6059daf9687f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:31.762491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-64d7c562-9fcf-4faf-b250-6059daf9687f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:31.777719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-602efad1-64e0-4cfd-a34d-45874b0caf5f req-7661903b-0e8e-4c02-b08e-404b026e2112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd8a0d92-6584-4dc6-b2d1-b1227a77f314", "tag": "78a64cea-abc0-483b-8a8a-c375cb239a62"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:31.784817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:31.806946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-602efad1-64e0-4cfd-a34d-45874b0caf5f req-7661903b-0e8e-4c02-b08e-404b026e2112 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:31.807449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-602efad1-64e0-4cfd-a34d-45874b0caf5f req-7661903b-0e8e-4c02-b08e-404b026e2112 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:31.807895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-602efad1-64e0-4cfd-a34d-45874b0caf5f req-7661903b-0e8e-4c02-b08e-404b026e2112 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:31.819393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64d7c562-9fcf-4faf-b250-6059daf9687f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:31.821842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64d7c562-9fcf-4faf-b250-6059daf9687f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:31.823792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64d7c562-9fcf-4faf-b250-6059daf9687f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:31.826302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64d7c562-9fcf-4faf-b250-6059daf9687f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:31.831469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64d7c562-9fcf-4faf-b250-6059daf9687f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:31.834672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64d7c562-9fcf-4faf-b250-6059daf9687f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:31.841385 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-602efad1-64e0-4cfd-a34d-45874b0caf5f req-7661903b-0e8e-4c02-b08e-404b026e2112 service nova] Creating event network-changed:78a64cea-abc0-483b-8a8a-c375cb239a62 for instance fd8a0d92-6584-4dc6-b2d1-b1227a77f314 on n-h2-860282-1 Oct 04 21:19:31.862438 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-602efad1-64e0-4cfd-a34d-45874b0caf5f req-7661903b-0e8e-4c02-b08e-404b026e2112 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088298 Oct 04 21:19:31.865743 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1579/3069] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:19:32.074756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d225da0f-f89b-4bd8-8b0f-2dfe2189cfd6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:32.075768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d225da0f-f89b-4bd8-8b0f-2dfe2189cfd6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:32.109859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d225da0f-f89b-4bd8-8b0f-2dfe2189cfd6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:32.111032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d225da0f-f89b-4bd8-8b0f-2dfe2189cfd6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:32.121781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d225da0f-f89b-4bd8-8b0f-2dfe2189cfd6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:32.124880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d225da0f-f89b-4bd8-8b0f-2dfe2189cfd6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:32.128092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d225da0f-f89b-4bd8-8b0f-2dfe2189cfd6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:32.130073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d225da0f-f89b-4bd8-8b0f-2dfe2189cfd6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:33.056488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d225da0f-f89b-4bd8-8b0f-2dfe2189cfd6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:33.065764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-64d7c562-9fcf-4faf-b250-6059daf9687f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:33.070129 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d225da0f-f89b-4bd8-8b0f-2dfe2189cfd6 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1654 microversion: 2.1 time: 0.999511 Oct 04 21:19:33.076594 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1580/3070] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:32 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1654 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:33.089683 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-64d7c562-9fcf-4faf-b250-6059daf9687f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1589 microversion: 2.1 time: 1.334980 Oct 04 21:19:33.090655 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1491/3071] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:31 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1589 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:33.096356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9fd00333-f3a4-41c4-9761-c2e31d663e3f tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:33.099013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9fd00333-f3a4-41c4-9761-c2e31d663e3f tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:33.113685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-81e6028d-d68e-4a40-b845-ef04f7ea4c22 req-a4851ece-51e6-451b-b3da-3da08b3d1ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42a2921-02b6-42e2-bee6-8700cbb23832", "name": "network-vif-unplugged", "status": "completed", "tag": "492cb8c5-a3fc-4a42-8a45-76af0767e9dc"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:33.124101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9fd00333-f3a4-41c4-9761-c2e31d663e3f tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:33.125796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9fd00333-f3a4-41c4-9761-c2e31d663e3f tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:33.127133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9fd00333-f3a4-41c4-9761-c2e31d663e3f tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:33.130191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9fd00333-f3a4-41c4-9761-c2e31d663e3f tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:33.132480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9fd00333-f3a4-41c4-9761-c2e31d663e3f tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:33.133207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9fd00333-f3a4-41c4-9761-c2e31d663e3f tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:33.138534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-81e6028d-d68e-4a40-b845-ef04f7ea4c22 req-a4851ece-51e6-451b-b3da-3da08b3d1ac5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:33.139031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-81e6028d-d68e-4a40-b845-ef04f7ea4c22 req-a4851ece-51e6-451b-b3da-3da08b3d1ac5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:33.139769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-81e6028d-d68e-4a40-b845-ef04f7ea4c22 req-a4851ece-51e6-451b-b3da-3da08b3d1ac5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:33.186252 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-81e6028d-d68e-4a40-b845-ef04f7ea4c22 req-a4851ece-51e6-451b-b3da-3da08b3d1ac5 service nova] Creating event network-vif-unplugged:492cb8c5-a3fc-4a42-8a45-76af0767e9dc for instance e42a2921-02b6-42e2-bee6-8700cbb23832 on n-h1-860282-1 Oct 04 21:19:33.223268 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-81e6028d-d68e-4a40-b845-ef04f7ea4c22 req-a4851ece-51e6-451b-b3da-3da08b3d1ac5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131162 Oct 04 21:19:33.229259 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1492/3072] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:33.235295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-89dbea46-e5e0-4c77-8bfb-38a05b034e3b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b90d820>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:35.702508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9fd00333-f3a4-41c4-9761-c2e31d663e3f tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:35.749721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9fd00333-f3a4-41c4-9761-c2e31d663e3f tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:35.772039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9fd00333-f3a4-41c4-9761-c2e31d663e3f tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:35.775211 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9fd00333-f3a4-41c4-9761-c2e31d663e3f tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1892 microversion: 2.32 time: 2.697478 Oct 04 21:19:35.790683 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1581/3073] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:33 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1892 bytes in 2713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:35.808368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-5e160c7b-8d9f-4692-ae75-b8e2e62cc5d0 req-7f06cd04-d774-404e-8a37-fcf1dee6d658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42a2921-02b6-42e2-bee6-8700cbb23832", "name": "network-vif-deleted", "tag": "62c1d20e-0e34-4dfd-82f2-235f81bb16ed"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:35.821213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5e160c7b-8d9f-4692-ae75-b8e2e62cc5d0 req-7f06cd04-d774-404e-8a37-fcf1dee6d658 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:35.822289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5e160c7b-8d9f-4692-ae75-b8e2e62cc5d0 req-7f06cd04-d774-404e-8a37-fcf1dee6d658 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:35.822916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5e160c7b-8d9f-4692-ae75-b8e2e62cc5d0 req-7f06cd04-d774-404e-8a37-fcf1dee6d658 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:35.849119 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-5e160c7b-8d9f-4692-ae75-b8e2e62cc5d0 req-7f06cd04-d774-404e-8a37-fcf1dee6d658 service nova] Creating event network-vif-deleted:62c1d20e-0e34-4dfd-82f2-235f81bb16ed for instance e42a2921-02b6-42e2-bee6-8700cbb23832 on n-h1-860282-1 Oct 04 21:19:35.859143 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-5e160c7b-8d9f-4692-ae75-b8e2e62cc5d0 req-7f06cd04-d774-404e-8a37-fcf1dee6d658 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066738 Oct 04 21:19:35.860361 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1582/3074] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:35.867224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-875a63fe-a9ff-4645-a096-699fd90c7166 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:35.868645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-875a63fe-a9ff-4645-a096-699fd90c7166 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:35.876773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-875a63fe-a9ff-4645-a096-699fd90c7166 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:35.879467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-875a63fe-a9ff-4645-a096-699fd90c7166 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:35.882900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-875a63fe-a9ff-4645-a096-699fd90c7166 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:35.885218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-875a63fe-a9ff-4645-a096-699fd90c7166 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:35.887652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-875a63fe-a9ff-4645-a096-699fd90c7166 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:35.890707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-875a63fe-a9ff-4645-a096-699fd90c7166 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:36.743416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-875a63fe-a9ff-4645-a096-699fd90c7166 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3603c26fffba42e5805fd595f33d5c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce0d9253774aca92d405f137285093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:36.786260 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-875a63fe-a9ff-4645-a096-699fd90c7166 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 200 len: 1612 microversion: 2.1 time: 0.923450 Oct 04 21:19:36.802240 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1583/3075] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:35 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 1612 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:37.257809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2a2245b2-0d10-4aad-93e0-675f59faa9b6 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-709877609", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "91b9f9a5-3b10-4582-a6c4-fb08af7ca69c"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:43.137098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:43.170558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=10 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:44.050373 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-89dbea46-e5e0-4c77-8bfb-38a05b034e3b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f" status: 200 len: 1464 microversion: 2.1 time: 10.819706 Oct 04 21:19:44.060044 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1493/3076] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:33 2022] GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f => generated 1464 bytes in 10824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:44.071140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-2a2245b2-0d10-4aad-93e0-675f59faa9b6 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] validate_networks() for [('91b9f9a5-3b10-4582-a6c4-fb08af7ca69c', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:19:44.087690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2addab21-c0ce-4592-8d94-cfdc7b885073 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:44.094588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2addab21-c0ce-4592-8d94-cfdc7b885073 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:44.122860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2addab21-c0ce-4592-8d94-cfdc7b885073 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:44.123383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2addab21-c0ce-4592-8d94-cfdc7b885073 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:44.123817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2addab21-c0ce-4592-8d94-cfdc7b885073 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:44.124532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2addab21-c0ce-4592-8d94-cfdc7b885073 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:44.124988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2addab21-c0ce-4592-8d94-cfdc7b885073 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:44.125441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2addab21-c0ce-4592-8d94-cfdc7b885073 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:45.205387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2addab21-c0ce-4592-8d94-cfdc7b885073 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:45.248132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2addab21-c0ce-4592-8d94-cfdc7b885073 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:45.257560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2addab21-c0ce-4592-8d94-cfdc7b885073 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:45.263303 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2addab21-c0ce-4592-8d94-cfdc7b885073 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 1.205724 Oct 04 21:19:45.268849 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1494/3077] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:44 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:45.283647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3681af3d-ca5b-4e8b-958f-fc5d570163f8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:45.284571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3681af3d-ca5b-4e8b-958f-fc5d570163f8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:45.294255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3681af3d-ca5b-4e8b-958f-fc5d570163f8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:45.295072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3681af3d-ca5b-4e8b-958f-fc5d570163f8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:45.295968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3681af3d-ca5b-4e8b-958f-fc5d570163f8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:45.296930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3681af3d-ca5b-4e8b-958f-fc5d570163f8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:45.299154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3681af3d-ca5b-4e8b-958f-fc5d570163f8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:45.299809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3681af3d-ca5b-4e8b-958f-fc5d570163f8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:45.332292 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-3681af3d-ca5b-4e8b-958f-fc5d570163f8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] HTTP exception thrown: Instance e42a2921-02b6-42e2-bee6-8700cbb23832 could not be found. Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3681af3d-ca5b-4e8b-958f-fc5d570163f8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Request method failure captured: Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 HTTP/1.1 Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKLcwPJZ8BFTEuqDtMxAImJz3XsKs4gMFM2qCkQqFXYPHnNouRE7IwZhcL7USpsNi_8IGxPbhSD2vOll168UXaBcWFBjXWPesouh7toWqjfq5ybs5ua5t3Afq9PtCVYWEv8jx_Cu7ASHgX8-tqlJ3_yXGdYlcz_msLDc9B5_9PYP5D4 Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 74ce0d9253774aca92d405f137285093 Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestMultiNic-871972287 Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74ce0d9253774aca92d405f137285093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_74ce0d9253774aca92d405f137285093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/74ce0d9253774aca92d405f137285093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74ce0d9253774aca92d405f137285093"}]}] Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestMultiNic-871972287 Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 74ce0d9253774aca92d405f137285093 Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestMultiNic-871972287 Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestMultiNic-871972287-project Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3603c26fffba42e5805fd595f33d5c62 Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestMultiNic-871972287-project Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance e42a2921-02b6-42e2-bee6-8700cbb23832 could not be found. Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'e42a2921-02b6-42e2-bee6-8700cbb23832'} Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e42a2921-02b6-42e2-bee6-8700cbb23832 could not be found. Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e42a2921-02b6-42e2-bee6-8700cbb23832 could not be found. Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:45.334606 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:45.340431 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:45.340431 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:45.340431 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:45.340431 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:19:45.340431 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:19:45.340431 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e42a2921-02b6-42e2-bee6-8700cbb23832 could not be found. Oct 04 21:19:45.340431 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:45.348078 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3681af3d-ca5b-4e8b-958f-fc5d570163f8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Returning 404 to user: Instance e42a2921-02b6-42e2-bee6-8700cbb23832 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:19:45.349504 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3681af3d-ca5b-4e8b-958f-fc5d570163f8 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 404 len: 111 microversion: 2.1 time: 0.078498 Oct 04 21:19:45.350409 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1495/3078] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:45 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:19:45.355959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-53f44eb0-ce82-4cb1-8674-e0d23034a815 req-108873c6-6d73-489a-b9f6-5c781c68f12a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "tag": "e340948f-c791-41cb-b34c-2658c4ccb363"}, {"server_uuid": "e42a2921-02b6-42e2-bee6-8700cbb23832", "name": "network-vif-deleted", "tag": "492cb8c5-a3fc-4a42-8a45-76af0767e9dc"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:45.373589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-53f44eb0-ce82-4cb1-8674-e0d23034a815 req-108873c6-6d73-489a-b9f6-5c781c68f12a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:45.373589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-53f44eb0-ce82-4cb1-8674-e0d23034a815 req-108873c6-6d73-489a-b9f6-5c781c68f12a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:45.373589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-53f44eb0-ce82-4cb1-8674-e0d23034a815 req-108873c6-6d73-489a-b9f6-5c781c68f12a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:45.391443 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-53f44eb0-ce82-4cb1-8674-e0d23034a815 req-108873c6-6d73-489a-b9f6-5c781c68f12a service nova] Creating event network-changed:e340948f-c791-41cb-b34c-2658c4ccb363 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:19:45.393504 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-53f44eb0-ce82-4cb1-8674-e0d23034a815 req-108873c6-6d73-489a-b9f6-5c781c68f12a service nova] Creating event network-vif-deleted:492cb8c5-a3fc-4a42-8a45-76af0767e9dc for instance e42a2921-02b6-42e2-bee6-8700cbb23832 on n-h1-860282-1 Oct 04 21:19:45.406310 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-53f44eb0-ce82-4cb1-8674-e0d23034a815 req-108873c6-6d73-489a-b9f6-5c781c68f12a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.054539 Oct 04 21:19:45.407232 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1496/3079] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:45.414540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-7f251411-e4eb-4a70-a930-649173856a89 req-5855e2b7-8331-457d-9d9e-26edfc1507e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba61f85c-a75d-451d-a5f7-f9533481c406", "name": "network-vif-plugged", "status": "completed", "tag": "34504880-4c91-4512-980a-45596f508743"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:45.426372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7f251411-e4eb-4a70-a930-649173856a89 req-5855e2b7-8331-457d-9d9e-26edfc1507e6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:45.427436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7f251411-e4eb-4a70-a930-649173856a89 req-5855e2b7-8331-457d-9d9e-26edfc1507e6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:45.428146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7f251411-e4eb-4a70-a930-649173856a89 req-5855e2b7-8331-457d-9d9e-26edfc1507e6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:45.445040 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-7f251411-e4eb-4a70-a930-649173856a89 req-5855e2b7-8331-457d-9d9e-26edfc1507e6 service nova] Creating event network-vif-plugged:34504880-4c91-4512-980a-45596f508743 for instance ba61f85c-a75d-451d-a5f7-f9533481c406 on n-h2-860282-1 Oct 04 21:19:45.452945 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-7f251411-e4eb-4a70-a930-649173856a89 req-5855e2b7-8331-457d-9d9e-26edfc1507e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042164 Oct 04 21:19:45.453852 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1497/3080] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:45.462595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5e723cbd-6206-44ec-b069-4b896c923375 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b8b4c10>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:45.545499 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5e723cbd-6206-44ec-b069-4b896c923375 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f" status: 200 len: 1464 microversion: 2.1 time: 0.087565 Oct 04 21:19:45.554922 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1498/3081] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:45 2022] GET /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f => generated 1464 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:45.565444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ac168c0a-4840-4eee-b482-712d4c40a27c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:45.566194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ac168c0a-4840-4eee-b482-712d4c40a27c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 142c6da5-e828-4e2b-bfef-0cf163f0c97c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:45.580529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac168c0a-4840-4eee-b482-712d4c40a27c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:45.584172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac168c0a-4840-4eee-b482-712d4c40a27c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:45.584659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac168c0a-4840-4eee-b482-712d4c40a27c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:45.585402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac168c0a-4840-4eee-b482-712d4c40a27c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:45.585891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac168c0a-4840-4eee-b482-712d4c40a27c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:45.586324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac168c0a-4840-4eee-b482-712d4c40a27c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:46.239943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2a2245b2-0d10-4aad-93e0-675f59faa9b6 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:19:46.240618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2a2245b2-0d10-4aad-93e0-675f59faa9b6 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:19:46.241648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2a2245b2-0d10-4aad-93e0-675f59faa9b6 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:19:46.242875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2a2245b2-0d10-4aad-93e0-675f59faa9b6 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:19:46.242875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2a2245b2-0d10-4aad-93e0-675f59faa9b6 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:19:46.267712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a2245b2-0d10-4aad-93e0-675f59faa9b6 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:46.268511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a2245b2-0d10-4aad-93e0-675f59faa9b6 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:46.269121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a2245b2-0d10-4aad-93e0-675f59faa9b6 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:46.272711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a2245b2-0d10-4aad-93e0-675f59faa9b6 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:46.273480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a2245b2-0d10-4aad-93e0-675f59faa9b6 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:46.274106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a2245b2-0d10-4aad-93e0-675f59faa9b6 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:46.333129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-2a2245b2-0d10-4aad-93e0-675f59faa9b6 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Getting quotas for project fbb2758d2dc64f70934d8161bf600f94. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:19:46.351473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-2a2245b2-0d10-4aad-93e0-675f59faa9b6 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Getting quotas for user 1b329e207cac4d459d25623d6554f444 and project fbb2758d2dc64f70934d8161bf600f94. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:19:46.385527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2a2245b2-0d10-4aad-93e0-675f59faa9b6 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:19:46.388180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2a2245b2-0d10-4aad-93e0-675f59faa9b6 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:19:46.490290 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2a2245b2-0d10-4aad-93e0-675f59faa9b6 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.686789 Oct 04 21:19:46.492876 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1584/3082] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:19:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 9690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:19:46.504041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1babccf4-3b23-40ff-9477-91b2f4bf5fa7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:46.505789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1babccf4-3b23-40ff-9477-91b2f4bf5fa7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:46.512673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ac168c0a-4840-4eee-b482-712d4c40a27c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:46.514103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1babccf4-3b23-40ff-9477-91b2f4bf5fa7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:46.514817 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1babccf4-3b23-40ff-9477-91b2f4bf5fa7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:46.515529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1babccf4-3b23-40ff-9477-91b2f4bf5fa7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:46.516391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1babccf4-3b23-40ff-9477-91b2f4bf5fa7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:46.517265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1babccf4-3b23-40ff-9477-91b2f4bf5fa7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:46.517897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1babccf4-3b23-40ff-9477-91b2f4bf5fa7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:46.526238 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ac168c0a-4840-4eee-b482-712d4c40a27c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c" status: 200 len: 1468 microversion: 2.1 time: 0.967118 Oct 04 21:19:46.530803 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1499/3083] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:45 2022] GET /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c => generated 1468 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:46.553333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a714344f-f546-421f-b01e-d56919d9eca5 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:46.558688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a714344f-f546-421f-b01e-d56919d9eca5 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:46.781219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a714344f-f546-421f-b01e-d56919d9eca5 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:46.793566 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a714344f-f546-421f-b01e-d56919d9eca5 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 200 len: 1223 microversion: 2.1 time: 0.260037 Oct 04 21:19:46.794501 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1500/3084] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:46 2022] GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 1223 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:46.800009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bf230657-57a0-49b6-8774-b388e555ca87 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b8b48b0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:47.073627 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bf230657-57a0-49b6-8774-b388e555ca87 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images?changes-since=2022-10-04T21%3A17%3A17Z" status: 200 len: 2376 microversion: 2.1 time: 0.277754 Oct 04 21:19:47.088955 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1501/3085] 10.222.0.30 () {58 vars in 1199 bytes} [Tue Oct 4 21:19:46 2022] GET /compute/v2.1/images?changes-since=2022-10-04T21%3A17%3A17Z => generated 2376 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:47.101391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3809842d-99da-46d0-b226-e90806616dd5 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b8b4430>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:47.260525 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3809842d-99da-46d0-b226-e90806616dd5 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-440362444" status: 200 len: 484 microversion: 2.1 time: 0.170158 Oct 04 21:19:47.264133 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1502/3086] 10.222.0.30 () {58 vars in 1229 bytes} [Tue Oct 4 21:19:47 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-440362444 => generated 484 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:47.272684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1babccf4-3b23-40ff-9477-91b2f4bf5fa7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:47.278490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cd2830f0-e973-4ec9-aa8f-6dfecf0a72a3 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b8bc1f0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:47.292743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1babccf4-3b23-40ff-9477-91b2f4bf5fa7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:47.294441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1babccf4-3b23-40ff-9477-91b2f4bf5fa7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:47.300261 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1babccf4-3b23-40ff-9477-91b2f4bf5fa7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.806146 Oct 04 21:19:47.305615 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1585/3087] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:46 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:47.518292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-7912c36e-da1d-4126-a3d3-34ed4936d883 req-014d0c5a-2339-496a-9a6d-319a954b2cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "tag": "98058dbf-2515-40f7-b898-38ee0332974c"}, {"name": "network-changed", "server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "tag": "a0d59a79-d95c-4b4b-b5be-713397dfdf42"}, {"name": "network-changed", "server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "tag": "c9f0995e-f8e2-4b1b-83e4-2688e418b233"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:47.537021 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cd2830f0-e973-4ec9-aa8f-6dfecf0a72a3 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images?server=142c6da5-e828-4e2b-bfef-0cf163f0c97c" status: 200 len: 957 microversion: 2.1 time: 0.262436 Oct 04 21:19:47.553403 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1503/3088] 10.222.0.30 () {58 vars in 1209 bytes} [Tue Oct 4 21:19:47 2022] GET /compute/v2.1/images?server=142c6da5-e828-4e2b-bfef-0cf163f0c97c => generated 957 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:47.569204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ea678854-ee99-4a9b-908b-182bb5f93a92 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f579075cd30>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:47.569437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-7912c36e-da1d-4126-a3d3-34ed4936d883 req-014d0c5a-2339-496a-9a6d-319a954b2cf8 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:47.570007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-7912c36e-da1d-4126-a3d3-34ed4936d883 req-014d0c5a-2339-496a-9a6d-319a954b2cf8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:47.570553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-7912c36e-da1d-4126-a3d3-34ed4936d883 req-014d0c5a-2339-496a-9a6d-319a954b2cf8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:47.604640 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-7912c36e-da1d-4126-a3d3-34ed4936d883 req-014d0c5a-2339-496a-9a6d-319a954b2cf8 service nova] Creating event network-changed:98058dbf-2515-40f7-b898-38ee0332974c for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:19:47.613891 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-7912c36e-da1d-4126-a3d3-34ed4936d883 req-014d0c5a-2339-496a-9a6d-319a954b2cf8 service nova] Creating event network-changed:a0d59a79-d95c-4b4b-b5be-713397dfdf42 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:19:47.619119 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-7912c36e-da1d-4126-a3d3-34ed4936d883 req-014d0c5a-2339-496a-9a6d-319a954b2cf8 service nova] Creating event network-changed:c9f0995e-f8e2-4b1b-83e4-2688e418b233 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:19:47.643486 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-7912c36e-da1d-4126-a3d3-34ed4936d883 req-014d0c5a-2339-496a-9a6d-319a954b2cf8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.129756 Oct 04 21:19:47.650397 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1586/3089] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:47.668291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-c1b30998-65c3-4356-948c-92068e0da2ef req-6e1ec339-e1b0-48ed-9f18-641af709c97a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "142c6da5-e828-4e2b-bfef-0cf163f0c97c", "name": "network-vif-unplugged", "status": "completed", "tag": "35ab7e07-58e9-4ae2-bb54-f90bc14398d7"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:47.708568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c1b30998-65c3-4356-948c-92068e0da2ef req-6e1ec339-e1b0-48ed-9f18-641af709c97a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:47.709053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c1b30998-65c3-4356-948c-92068e0da2ef req-6e1ec339-e1b0-48ed-9f18-641af709c97a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:47.709549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c1b30998-65c3-4356-948c-92068e0da2ef req-6e1ec339-e1b0-48ed-9f18-641af709c97a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:47.734978 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ea678854-ee99-4a9b-908b-182bb5f93a92 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 485 microversion: 2.1 time: 0.169139 Oct 04 21:19:47.737491 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1504/3090] 10.222.0.30 () {58 vars in 1317 bytes} [Tue Oct 4 21:19:47 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 485 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:47.755429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-53101740-5f55-4036-a6c8-fdccfc182373 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b91bdc0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:47.787025 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-c1b30998-65c3-4356-948c-92068e0da2ef req-6e1ec339-e1b0-48ed-9f18-641af709c97a service nova] Creating event network-vif-unplugged:35ab7e07-58e9-4ae2-bb54-f90bc14398d7 for instance 142c6da5-e828-4e2b-bfef-0cf163f0c97c on n-h1-860282-1 Oct 04 21:19:47.803909 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-c1b30998-65c3-4356-948c-92068e0da2ef req-6e1ec339-e1b0-48ed-9f18-641af709c97a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151901 Oct 04 21:19:47.804545 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1587/3091] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:47.819973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9e617b78-0ac8-4c5e-93e8-1618a9677082 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:47.820695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9e617b78-0ac8-4c5e-93e8-1618a9677082 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:47.850202 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-53101740-5f55-4036-a6c8-fdccfc182373 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 485 microversion: 2.1 time: 0.103725 Oct 04 21:19:47.851134 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1505/3092] 10.222.0.30 () {58 vars in 1303 bytes} [Tue Oct 4 21:19:47 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 485 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:47.870596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b9ba137b-79aa-4594-809f-e3641629d26e tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b8bcd30>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:48.123304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9e617b78-0ac8-4c5e-93e8-1618a9677082 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:48.136468 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9e617b78-0ac8-4c5e-93e8-1618a9677082 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 200 len: 1223 microversion: 2.1 time: 0.320639 Oct 04 21:19:48.166883 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1588/3093] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:47 2022] GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 1223 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:48.334635 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b9ba137b-79aa-4594-809f-e3641629d26e tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.472120 Oct 04 21:19:48.338793 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1506/3094] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Oct 4 21:19:47 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:48.339137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-afd86c7a-397f-4415-aa33-2ab3bb3cec7b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:48.340246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-afd86c7a-397f-4415-aa33-2ab3bb3cec7b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:48.364337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-13f5c90c-061a-46a8-9824-fc837c0cec35 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b8ff700>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:48.378493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afd86c7a-397f-4415-aa33-2ab3bb3cec7b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:48.380283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afd86c7a-397f-4415-aa33-2ab3bb3cec7b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:48.382537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afd86c7a-397f-4415-aa33-2ab3bb3cec7b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:48.385700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afd86c7a-397f-4415-aa33-2ab3bb3cec7b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:48.385700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afd86c7a-397f-4415-aa33-2ab3bb3cec7b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:48.385700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afd86c7a-397f-4415-aa33-2ab3bb3cec7b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:48.516080 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-13f5c90c-061a-46a8-9824-fc837c0cec35 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.161220 Oct 04 21:19:48.528275 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1507/3095] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Oct 4 21:19:48 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:48.546054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c66976a4-3be4-41df-9076-fb249f7fee94 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b8bc1f0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:48.745247 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c66976a4-3be4-41df-9076-fb249f7fee94 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.212316 Oct 04 21:19:48.746234 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1508/3096] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:19:48 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:48.760368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-700f37ef-7c2b-413b-8e8c-214a49a0ac6e tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57900b8430>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:48.918694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-afd86c7a-397f-4415-aa33-2ab3bb3cec7b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:48.946822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-afd86c7a-397f-4415-aa33-2ab3bb3cec7b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:48.949517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-afd86c7a-397f-4415-aa33-2ab3bb3cec7b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:48.950634 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-afd86c7a-397f-4415-aa33-2ab3bb3cec7b tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.618502 Oct 04 21:19:48.957147 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1589/3097] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:48 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:19:48.959300 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-700f37ef-7c2b-413b-8e8c-214a49a0ac6e tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/detail?changes-since=2022-10-04T21%3A17%3A12Z" status: 200 len: 6334 microversion: 2.1 time: 0.202931 Oct 04 21:19:48.960507 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1509/3098] 10.222.0.30 () {58 vars in 1220 bytes} [Tue Oct 4 21:19:48 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-04T21%3A17%3A12Z => generated 6334 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:48.991941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2cae82d9-0485-470f-a2d6-aac2db233e1f tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57907c5ca0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:49.067329 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2cae82d9-0485-470f-a2d6-aac2db233e1f tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-440362444" status: 200 len: 664 microversion: 2.1 time: 0.085674 Oct 04 21:19:49.080388 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1590/3099] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Oct 4 21:19:48 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-440362444 => generated 664 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:49.087726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b0a51623-8f14-49c0-8cfe-e0148f3998cf tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b8af670>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:49.160467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bd0bbc4c-785c-4cca-ab12-422582b398f5 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:49.161509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bd0bbc4c-785c-4cca-ab12-422582b398f5 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:49.177130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd0bbc4c-785c-4cca-ab12-422582b398f5 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:49.179614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd0bbc4c-785c-4cca-ab12-422582b398f5 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:49.180197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd0bbc4c-785c-4cca-ab12-422582b398f5 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:49.181685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd0bbc4c-785c-4cca-ab12-422582b398f5 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:49.184438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd0bbc4c-785c-4cca-ab12-422582b398f5 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:49.184979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd0bbc4c-785c-4cca-ab12-422582b398f5 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:49.260040 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b0a51623-8f14-49c0-8cfe-e0148f3998cf tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1467 microversion: 2.1 time: 0.177639 Oct 04 21:19:49.260657 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1510/3100] 10.222.0.30 () {58 vars in 1338 bytes} [Tue Oct 4 21:19:49 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1467 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:49.281566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a6eff0c8-9ccc-47f3-aa1e-fa07dcee1b52 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b898820>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:49.397725 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a6eff0c8-9ccc-47f3-aa1e-fa07dcee1b52 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1467 microversion: 2.1 time: 0.122062 Oct 04 21:19:49.398652 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1511/3101] 10.222.0.30 () {58 vars in 1324 bytes} [Tue Oct 4 21:19:49 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1467 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:49.408684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-36fd0046-b590-4ad0-9244-ebaaeaa904de tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:49.412157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-36fd0046-b590-4ad0-9244-ebaaeaa904de tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:49.429252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36fd0046-b590-4ad0-9244-ebaaeaa904de tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:49.429987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36fd0046-b590-4ad0-9244-ebaaeaa904de tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:49.430615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36fd0046-b590-4ad0-9244-ebaaeaa904de tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:49.435075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36fd0046-b590-4ad0-9244-ebaaeaa904de tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:49.435075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36fd0046-b590-4ad0-9244-ebaaeaa904de tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:49.435075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36fd0046-b590-4ad0-9244-ebaaeaa904de tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:49.492889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-36fd0046-b590-4ad0-9244-ebaaeaa904de tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:19:49.823561 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-36fd0046-b590-4ad0-9244-ebaaeaa904de tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 204 len: 0 microversion: 2.1 time: 0.423465 Oct 04 21:19:49.825864 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1512/3102] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:19:49 2022] DELETE /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:19:49.835498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ee488212-1bc8-48cf-a412-116d97eb9703 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57900b8430>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:50.005604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bd0bbc4c-785c-4cca-ab12-422582b398f5 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:50.014721 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bd0bbc4c-785c-4cca-ab12-422582b398f5 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 200 len: 1275 microversion: 2.1 time: 0.858935 Oct 04 21:19:50.017793 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1591/3103] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:49 2022] GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 1275 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:50.030841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7ba77be0-ccd8-4200-9759-307d8b5c440e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:50.031828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7ba77be0-ccd8-4200-9759-307d8b5c440e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:50.057217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ba77be0-ccd8-4200-9759-307d8b5c440e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:50.062431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ba77be0-ccd8-4200-9759-307d8b5c440e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:50.072374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ba77be0-ccd8-4200-9759-307d8b5c440e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:50.072374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ba77be0-ccd8-4200-9759-307d8b5c440e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:50.072558 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ee488212-1bc8-48cf-a412-116d97eb9703 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.245142 Oct 04 21:19:50.073271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ba77be0-ccd8-4200-9759-307d8b5c440e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:50.073816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ba77be0-ccd8-4200-9759-307d8b5c440e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:50.087312 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1513/3104] 10.222.0.30 () {58 vars in 1170 bytes} [Tue Oct 4 21:19:49 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:50.093780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-17a42c36-d01a-4580-aba1-faf0d858f058 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:50.093780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-17a42c36-d01a-4580-aba1-faf0d858f058 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:50.118784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17a42c36-d01a-4580-aba1-faf0d858f058 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:50.119294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17a42c36-d01a-4580-aba1-faf0d858f058 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:50.119733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17a42c36-d01a-4580-aba1-faf0d858f058 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:50.120467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17a42c36-d01a-4580-aba1-faf0d858f058 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:50.120915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17a42c36-d01a-4580-aba1-faf0d858f058 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:50.121347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17a42c36-d01a-4580-aba1-faf0d858f058 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:50.698843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7ba77be0-ccd8-4200-9759-307d8b5c440e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:50.710737 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7ba77be0-ccd8-4200-9759-307d8b5c440e tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1508 microversion: 2.1 time: 0.689934 Oct 04 21:19:50.711656 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1592/3105] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:50 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1508 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:50.721689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3ce5135a-0497-4c2f-bfcc-610ae6f607ea tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790b3d1f0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:50.755218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-17a42c36-d01a-4580-aba1-faf0d858f058 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:50.762805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-17a42c36-d01a-4580-aba1-faf0d858f058 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:50.770385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-17a42c36-d01a-4580-aba1-faf0d858f058 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:50.771838 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-17a42c36-d01a-4580-aba1-faf0d858f058 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.683474 Oct 04 21:19:50.797658 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1514/3106] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:50 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:50.854080 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3ce5135a-0497-4c2f-bfcc-610ae6f607ea tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.141116 Oct 04 21:19:50.854960 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1593/3107] 10.222.0.30 () {58 vars in 1170 bytes} [Tue Oct 4 21:19:50 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:50.895466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c1a11e13-e635-46ef-9155-05a62ff656e4 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578b90d3a0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:50.998002 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c1a11e13-e635-46ef-9155-05a62ff656e4 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/d55fbb2c-685c-4db7-a38c-ac6cf5459ad1" status: 200 len: 784 microversion: 2.1 time: 0.123833 Oct 04 21:19:50.998002 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1515/3108] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:19:50 2022] GET /compute/v2.1/images/d55fbb2c-685c-4db7-a38c-ac6cf5459ad1 => generated 784 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:51.015007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6b94f917-53bb-4fb4-bfb9-bc3872e0b786 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57909b9310>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:51.040190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-470ec757-bd24-4ff5-914c-61b071e15c50 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:51.041073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-470ec757-bd24-4ff5-914c-61b071e15c50 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:51.054325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-470ec757-bd24-4ff5-914c-61b071e15c50 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:51.055255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-470ec757-bd24-4ff5-914c-61b071e15c50 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:51.055909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-470ec757-bd24-4ff5-914c-61b071e15c50 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:51.058874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-470ec757-bd24-4ff5-914c-61b071e15c50 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:51.068911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-470ec757-bd24-4ff5-914c-61b071e15c50 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:51.077501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-470ec757-bd24-4ff5-914c-61b071e15c50 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:51.099925 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6b94f917-53bb-4fb4-bfb9-bc3872e0b786 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.088800 Oct 04 21:19:51.105831 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1594/3109] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Oct 4 21:19:51 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:51.131415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e4f15d6d-b8bd-4062-84ae-36035fed8dc4 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f579011f1f0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:51.503426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-470ec757-bd24-4ff5-914c-61b071e15c50 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:51.523315 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-470ec757-bd24-4ff5-914c-61b071e15c50 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 200 len: 1283 microversion: 2.1 time: 0.486909 Oct 04 21:19:51.526349 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1516/3110] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:51 2022] GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 1283 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:51.742878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f0d176e8-a10a-441a-b779-de9ed8d23c7d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:51.753887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f0d176e8-a10a-441a-b779-de9ed8d23c7d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:51.757725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0d176e8-a10a-441a-b779-de9ed8d23c7d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:51.758252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0d176e8-a10a-441a-b779-de9ed8d23c7d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:51.758717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0d176e8-a10a-441a-b779-de9ed8d23c7d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:51.759460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0d176e8-a10a-441a-b779-de9ed8d23c7d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:51.759938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0d176e8-a10a-441a-b779-de9ed8d23c7d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:51.763291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0d176e8-a10a-441a-b779-de9ed8d23c7d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:52.257938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f0d176e8-a10a-441a-b779-de9ed8d23c7d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:52.268398 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f0d176e8-a10a-441a-b779-de9ed8d23c7d tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1508 microversion: 2.1 time: 0.533338 Oct 04 21:19:52.271077 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1517/3111] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:51 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1508 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:52.276489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d04a92aa-b692-4735-8f8c-13f4c753f7fd tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:52.277554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d04a92aa-b692-4735-8f8c-13f4c753f7fd tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:52.285091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d04a92aa-b692-4735-8f8c-13f4c753f7fd tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:52.285963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d04a92aa-b692-4735-8f8c-13f4c753f7fd tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:52.286644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d04a92aa-b692-4735-8f8c-13f4c753f7fd tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:52.287603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d04a92aa-b692-4735-8f8c-13f4c753f7fd tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:52.288459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d04a92aa-b692-4735-8f8c-13f4c753f7fd tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:52.289547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d04a92aa-b692-4735-8f8c-13f4c753f7fd tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:52.612691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d04a92aa-b692-4735-8f8c-13f4c753f7fd tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:52.620995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d04a92aa-b692-4735-8f8c-13f4c753f7fd tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:52.623023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d04a92aa-b692-4735-8f8c-13f4c753f7fd tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:52.624485 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d04a92aa-b692-4735-8f8c-13f4c753f7fd tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.351988 Oct 04 21:19:52.625243 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1518/3112] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:52 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:52.654536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ecef8c31-51dd-4ab4-b91d-e1cfc1fd800a tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:52.654882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ecef8c31-51dd-4ab4-b91d-e1cfc1fd800a tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:52.664118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ecef8c31-51dd-4ab4-b91d-e1cfc1fd800a tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:52.664276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ecef8c31-51dd-4ab4-b91d-e1cfc1fd800a tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:52.664703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ecef8c31-51dd-4ab4-b91d-e1cfc1fd800a tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:52.665413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ecef8c31-51dd-4ab4-b91d-e1cfc1fd800a tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:52.665893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ecef8c31-51dd-4ab4-b91d-e1cfc1fd800a tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:52.667141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ecef8c31-51dd-4ab4-b91d-e1cfc1fd800a tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:52.816241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ecef8c31-51dd-4ab4-b91d-e1cfc1fd800a tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:52.847022 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ecef8c31-51dd-4ab4-b91d-e1cfc1fd800a tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 200 len: 1293 microversion: 2.1 time: 0.207180 Oct 04 21:19:52.847022 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1519/3113] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:52 2022] GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 1293 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:52.868095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7ab5065e-f228-4e8a-8e01-7c6c56876082 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:52.868606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7ab5065e-f228-4e8a-8e01-7c6c56876082 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:52.885730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ab5065e-f228-4e8a-8e01-7c6c56876082 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:52.886617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ab5065e-f228-4e8a-8e01-7c6c56876082 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:52.887288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ab5065e-f228-4e8a-8e01-7c6c56876082 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:52.888241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ab5065e-f228-4e8a-8e01-7c6c56876082 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:52.889479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ab5065e-f228-4e8a-8e01-7c6c56876082 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:52.890335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ab5065e-f228-4e8a-8e01-7c6c56876082 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:52.939501 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-7ab5065e-f228-4e8a-8e01-7c6c56876082 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] HTTP exception thrown: Instance e42a2921-02b6-42e2-bee6-8700cbb23832 could not be found. Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7ab5065e-f228-4e8a-8e01-7c6c56876082 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Request method failure captured: Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 HTTP/1.1 Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKLcwPJZ8BFTEuqDtMxAImJz3XsKs4gMFM2qCkQqFXYPHnNouRE7IwZhcL7USpsNi_8IGxPbhSD2vOll168UXaBcWFBjXWPesouh7toWqjfq5ybs5ua5t3Afq9PtCVYWEv8jx_Cu7ASHgX8-tqlJ3_yXGdYlcz_msLDc9B5_9PYP5D4 Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 74ce0d9253774aca92d405f137285093 Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestMultiNic-871972287 Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74ce0d9253774aca92d405f137285093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_74ce0d9253774aca92d405f137285093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/74ce0d9253774aca92d405f137285093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74ce0d9253774aca92d405f137285093"}]}] Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestMultiNic-871972287 Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 74ce0d9253774aca92d405f137285093 Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestMultiNic-871972287 Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestMultiNic-871972287-project Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3603c26fffba42e5805fd595f33d5c62 Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestMultiNic-871972287-project Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance e42a2921-02b6-42e2-bee6-8700cbb23832 could not be found. Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'e42a2921-02b6-42e2-bee6-8700cbb23832'} Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e42a2921-02b6-42e2-bee6-8700cbb23832 could not be found. Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:19:52.940877 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:19:52.950490 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e42a2921-02b6-42e2-bee6-8700cbb23832 could not be found. Oct 04 21:19:52.950490 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:52.950490 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:52.950490 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:52.950490 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:52.950490 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:52.950490 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:52.950490 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:19:52.950490 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:19:52.950490 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e42a2921-02b6-42e2-bee6-8700cbb23832 could not be found. Oct 04 21:19:52.950490 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:52.950490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7ab5065e-f228-4e8a-8e01-7c6c56876082 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Returning 404 to user: Instance e42a2921-02b6-42e2-bee6-8700cbb23832 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:19:52.960415 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7ab5065e-f228-4e8a-8e01-7c6c56876082 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 404 len: 111 microversion: 2.1 time: 0.099734 Oct 04 21:19:52.961195 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1520/3114] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:19:52 2022] DELETE /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:19:52.973980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-0854dac2-c0d3-49cd-bd1d-49e5fda97cbe req-82a2eb67-1854-4f52-9af7-80f995d7330e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2", "name": "network-vif-deleted", "tag": "36461af8-6eb7-46aa-8410-0ffceb576db9"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:52.990186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0854dac2-c0d3-49cd-bd1d-49e5fda97cbe req-82a2eb67-1854-4f52-9af7-80f995d7330e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:52.991385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0854dac2-c0d3-49cd-bd1d-49e5fda97cbe req-82a2eb67-1854-4f52-9af7-80f995d7330e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:52.992162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0854dac2-c0d3-49cd-bd1d-49e5fda97cbe req-82a2eb67-1854-4f52-9af7-80f995d7330e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:53.012285 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-0854dac2-c0d3-49cd-bd1d-49e5fda97cbe req-82a2eb67-1854-4f52-9af7-80f995d7330e service nova] Creating event network-vif-deleted:36461af8-6eb7-46aa-8410-0ffceb576db9 for instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 on n-h1-860282-1 Oct 04 21:19:53.021228 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-0854dac2-c0d3-49cd-bd1d-49e5fda97cbe req-82a2eb67-1854-4f52-9af7-80f995d7330e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058493 Oct 04 21:19:53.022478 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1521/3115] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:53.029954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-926f4cf5-52e5-4fc6-b0d5-1c3f4db3d265 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:53.030977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-926f4cf5-52e5-4fc6-b0d5-1c3f4db3d265 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: e42a2921-02b6-42e2-bee6-8700cbb23832] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:53.053744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-926f4cf5-52e5-4fc6-b0d5-1c3f4db3d265 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:53.054774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-926f4cf5-52e5-4fc6-b0d5-1c3f4db3d265 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:53.055631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-926f4cf5-52e5-4fc6-b0d5-1c3f4db3d265 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:53.056602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-926f4cf5-52e5-4fc6-b0d5-1c3f4db3d265 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:53.057284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-926f4cf5-52e5-4fc6-b0d5-1c3f4db3d265 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:53.071427 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-926f4cf5-52e5-4fc6-b0d5-1c3f4db3d265 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:53.134611 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-926f4cf5-52e5-4fc6-b0d5-1c3f4db3d265 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] HTTP exception thrown: Instance e42a2921-02b6-42e2-bee6-8700cbb23832 could not be found. Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-926f4cf5-52e5-4fc6-b0d5-1c3f4db3d265 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Request method failure captured: Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 HTTP/1.1 Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKLcwPJZ8BFTEuqDtMxAImJz3XsKs4gMFM2qCkQqFXYPHnNouRE7IwZhcL7USpsNi_8IGxPbhSD2vOll168UXaBcWFBjXWPesouh7toWqjfq5ybs5ua5t3Afq9PtCVYWEv8jx_Cu7ASHgX8-tqlJ3_yXGdYlcz_msLDc9B5_9PYP5D4 Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 74ce0d9253774aca92d405f137285093 Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestMultiNic-871972287 Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74ce0d9253774aca92d405f137285093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_74ce0d9253774aca92d405f137285093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/74ce0d9253774aca92d405f137285093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74ce0d9253774aca92d405f137285093"}]}] Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestMultiNic-871972287 Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 74ce0d9253774aca92d405f137285093 Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestMultiNic-871972287 Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestMultiNic-871972287-project Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3603c26fffba42e5805fd595f33d5c62 Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestMultiNic-871972287-project Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance e42a2921-02b6-42e2-bee6-8700cbb23832 could not be found. Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'e42a2921-02b6-42e2-bee6-8700cbb23832'} Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e42a2921-02b6-42e2-bee6-8700cbb23832 could not be found. Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e42a2921-02b6-42e2-bee6-8700cbb23832 could not be found. Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:53.138436 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:53.143997 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:53.143997 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:53.143997 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:53.143997 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:19:53.143997 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:19:53.143997 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e42a2921-02b6-42e2-bee6-8700cbb23832 could not be found. Oct 04 21:19:53.143997 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:53.154044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-926f4cf5-52e5-4fc6-b0d5-1c3f4db3d265 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Returning 404 to user: Instance e42a2921-02b6-42e2-bee6-8700cbb23832 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:19:53.155145 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-926f4cf5-52e5-4fc6-b0d5-1c3f4db3d265 tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832" status: 404 len: 111 microversion: 2.1 time: 0.130920 Oct 04 21:19:53.159912 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1522/3116] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:53 2022] GET /compute/v2.1/servers/e42a2921-02b6-42e2-bee6-8700cbb23832 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:19:53.169365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-86e8b28c-5f35-41a5-a30e-1fefeb467f9a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:53.176418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-86e8b28c-5f35-41a5-a30e-1fefeb467f9a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:53.215286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86e8b28c-5f35-41a5-a30e-1fefeb467f9a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:53.224947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86e8b28c-5f35-41a5-a30e-1fefeb467f9a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:53.228153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86e8b28c-5f35-41a5-a30e-1fefeb467f9a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:53.229709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86e8b28c-5f35-41a5-a30e-1fefeb467f9a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:53.232617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86e8b28c-5f35-41a5-a30e-1fefeb467f9a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:53.234889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86e8b28c-5f35-41a5-a30e-1fefeb467f9a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:53.303508 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-86e8b28c-5f35-41a5-a30e-1fefeb467f9a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] HTTP exception thrown: Instance 482e4179-2301-47d7-87dd-4deec4941c5e could not be found. Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-86e8b28c-5f35-41a5-a30e-1fefeb467f9a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Request method failure captured: Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e HTTP/1.1 Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKLcwPJZ8BFTEuqDtMxAImJz3XsKs4gMFM2qCkQqFXYPHnNouRE7IwZhcL7USpsNi_8IGxPbhSD2vOll168UXaBcWFBjXWPesouh7toWqjfq5ybs5ua5t3Afq9PtCVYWEv8jx_Cu7ASHgX8-tqlJ3_yXGdYlcz_msLDc9B5_9PYP5D4 Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 74ce0d9253774aca92d405f137285093 Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestMultiNic-871972287 Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74ce0d9253774aca92d405f137285093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_74ce0d9253774aca92d405f137285093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/74ce0d9253774aca92d405f137285093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74ce0d9253774aca92d405f137285093"}]}] Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestMultiNic-871972287 Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 74ce0d9253774aca92d405f137285093 Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestMultiNic-871972287 Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestMultiNic-871972287-project Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3603c26fffba42e5805fd595f33d5c62 Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestMultiNic-871972287-project Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 482e4179-2301-47d7-87dd-4deec4941c5e could not be found. Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '482e4179-2301-47d7-87dd-4deec4941c5e'} Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 482e4179-2301-47d7-87dd-4deec4941c5e could not be found. Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:19:53.307621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:19:53.312262 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 482e4179-2301-47d7-87dd-4deec4941c5e could not be found. Oct 04 21:19:53.312262 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:53.312262 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:53.312262 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:53.312262 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:53.312262 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:53.312262 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:53.312262 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:19:53.312262 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:19:53.312262 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 482e4179-2301-47d7-87dd-4deec4941c5e could not be found. Oct 04 21:19:53.312262 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:53.325841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-86e8b28c-5f35-41a5-a30e-1fefeb467f9a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Returning 404 to user: Instance 482e4179-2301-47d7-87dd-4deec4941c5e could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:19:53.328920 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-86e8b28c-5f35-41a5-a30e-1fefeb467f9a tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "DELETE /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 404 len: 111 microversion: 2.1 time: 0.167364 Oct 04 21:19:53.343810 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1523/3117] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:19:53 2022] DELETE /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:19:53.369786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d784b785-d67f-426c-98c2-0f31e2636e9a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:53.374703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d784b785-d67f-426c-98c2-0f31e2636e9a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:53.393411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d784b785-d67f-426c-98c2-0f31e2636e9a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:53.398343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d784b785-d67f-426c-98c2-0f31e2636e9a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:53.399483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d784b785-d67f-426c-98c2-0f31e2636e9a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:53.401683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d784b785-d67f-426c-98c2-0f31e2636e9a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:53.402391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d784b785-d67f-426c-98c2-0f31e2636e9a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:53.403076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d784b785-d67f-426c-98c2-0f31e2636e9a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:53.448764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d784b785-d67f-426c-98c2-0f31e2636e9a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:53.449616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d784b785-d67f-426c-98c2-0f31e2636e9a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:53.450295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d784b785-d67f-426c-98c2-0f31e2636e9a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:53.451397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-d784b785-d67f-426c-98c2-0f31e2636e9a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lazy-loading 'fault' on Instance uuid e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:19:53.661616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d784b785-d67f-426c-98c2-0f31e2636e9a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:53.679908 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e4f15d6d-b8bd-4062-84ae-36035fed8dc4 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "DELETE /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f" status: 204 len: 0 microversion: 2.1 time: 2.560576 Oct 04 21:19:53.680553 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1595/3118] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:51 2022] DELETE /compute/v2.1/images/86984828-438f-41d3-a373-5a6f1155aa1f => generated 0 bytes in 2562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:19:53.686830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-84cf37c2-f5b9-450f-9a3e-3cd366c7337c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:53.687898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-84cf37c2-f5b9-450f-9a3e-3cd366c7337c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] [instance: 482e4179-2301-47d7-87dd-4deec4941c5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:53.690926 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d784b785-d67f-426c-98c2-0f31e2636e9a tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 200 len: 1312 microversion: 2.1 time: 0.344928 Oct 04 21:19:53.694171 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1524/3119] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:53 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 1312 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:53.713825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7dc0f55e-c311-416e-be34-796525878f86 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:53.717636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7dc0f55e-c311-416e-be34-796525878f86 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:53.719161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84cf37c2-f5b9-450f-9a3e-3cd366c7337c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:53.719866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84cf37c2-f5b9-450f-9a3e-3cd366c7337c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:53.725354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84cf37c2-f5b9-450f-9a3e-3cd366c7337c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:53.726646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84cf37c2-f5b9-450f-9a3e-3cd366c7337c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:53.727166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84cf37c2-f5b9-450f-9a3e-3cd366c7337c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:53.727641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84cf37c2-f5b9-450f-9a3e-3cd366c7337c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:53.728161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7dc0f55e-c311-416e-be34-796525878f86 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:53.728918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7dc0f55e-c311-416e-be34-796525878f86 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:53.730587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7dc0f55e-c311-416e-be34-796525878f86 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:53.731984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7dc0f55e-c311-416e-be34-796525878f86 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:53.732687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7dc0f55e-c311-416e-be34-796525878f86 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:53.733410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7dc0f55e-c311-416e-be34-796525878f86 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:53.753441 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-84cf37c2-f5b9-450f-9a3e-3cd366c7337c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] HTTP exception thrown: Instance 482e4179-2301-47d7-87dd-4deec4941c5e could not be found. Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-84cf37c2-f5b9-450f-9a3e-3cd366c7337c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Request method failure captured: Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e HTTP/1.1 Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKLcwPJZ8BFTEuqDtMxAImJz3XsKs4gMFM2qCkQqFXYPHnNouRE7IwZhcL7USpsNi_8IGxPbhSD2vOll168UXaBcWFBjXWPesouh7toWqjfq5ybs5ua5t3Afq9PtCVYWEv8jx_Cu7ASHgX8-tqlJ3_yXGdYlcz_msLDc9B5_9PYP5D4 Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 74ce0d9253774aca92d405f137285093 Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersTestMultiNic-871972287 Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74ce0d9253774aca92d405f137285093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_74ce0d9253774aca92d405f137285093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/74ce0d9253774aca92d405f137285093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74ce0d9253774aca92d405f137285093"}]}] Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersTestMultiNic-871972287 Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 74ce0d9253774aca92d405f137285093 Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersTestMultiNic-871972287 Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersTestMultiNic-871972287-project Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3603c26fffba42e5805fd595f33d5c62 Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersTestMultiNic-871972287-project Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 482e4179-2301-47d7-87dd-4deec4941c5e could not be found. Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '482e4179-2301-47d7-87dd-4deec4941c5e'} Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 482e4179-2301-47d7-87dd-4deec4941c5e could not be found. Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 482e4179-2301-47d7-87dd-4deec4941c5e could not be found. Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:53.758601 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:19:53.767782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:53.767782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:53.767782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:53.767782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:19:53.767782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:19:53.767782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 482e4179-2301-47d7-87dd-4deec4941c5e could not be found. Oct 04 21:19:53.767782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:19:53.767782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-84cf37c2-f5b9-450f-9a3e-3cd366c7337c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] Returning 404 to user: Instance 482e4179-2301-47d7-87dd-4deec4941c5e could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:19:53.767782 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-84cf37c2-f5b9-450f-9a3e-3cd366c7337c tempest-ServersTestMultiNic-871972287 tempest-ServersTestMultiNic-871972287-project] 10.222.0.30 "GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e" status: 404 len: 111 microversion: 2.1 time: 0.076201 Oct 04 21:19:53.767782 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1596/3120] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:53 2022] GET /compute/v2.1/servers/482e4179-2301-47d7-87dd-4deec4941c5e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:19:53.771432 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-943d03e2-59de-42ec-a169-e1a649a8b7ee tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578bf5e9d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:54.685554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7dc0f55e-c311-416e-be34-796525878f86 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:54.707395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7dc0f55e-c311-416e-be34-796525878f86 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:54.717847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7dc0f55e-c311-416e-be34-796525878f86 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:54.719573 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7dc0f55e-c311-416e-be34-796525878f86 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 1.020405 Oct 04 21:19:54.725246 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1525/3121] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:53 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:54.752227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6d15befa-dca5-426f-b0b9-03f0ef65ad4f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:54.771563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6d15befa-dca5-426f-b0b9-03f0ef65ad4f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:54.792512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d15befa-dca5-426f-b0b9-03f0ef65ad4f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:54.793005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d15befa-dca5-426f-b0b9-03f0ef65ad4f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:54.793462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d15befa-dca5-426f-b0b9-03f0ef65ad4f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:54.800010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d15befa-dca5-426f-b0b9-03f0ef65ad4f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:54.804538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d15befa-dca5-426f-b0b9-03f0ef65ad4f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:54.805222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d15befa-dca5-426f-b0b9-03f0ef65ad4f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:55.221998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6d15befa-dca5-426f-b0b9-03f0ef65ad4f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:55.235842 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6d15befa-dca5-426f-b0b9-03f0ef65ad4f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 200 len: 1323 microversion: 2.1 time: 0.507570 Oct 04 21:19:55.239726 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1526/3122] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:54 2022] GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 1323 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:55.244606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5d750790-ad68-4cf5-87b4-09952315aea4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:55.254517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5d750790-ad68-4cf5-87b4-09952315aea4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:55.263453 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d750790-ad68-4cf5-87b4-09952315aea4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:55.265277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d750790-ad68-4cf5-87b4-09952315aea4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:55.266135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d750790-ad68-4cf5-87b4-09952315aea4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:55.270985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d750790-ad68-4cf5-87b4-09952315aea4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:55.270985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d750790-ad68-4cf5-87b4-09952315aea4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:55.270985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d750790-ad68-4cf5-87b4-09952315aea4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:55.287342 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-5d750790-ad68-4cf5-87b4-09952315aea4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] HTTP exception thrown: Instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 could not be found. Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5d750790-ad68-4cf5-87b4-09952315aea4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Request method failure captured: Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 HTTP/1.1 Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKIzNXd_CmvP-6Usf8igAzY3dlzgDYn--v5mxvj-LpxllWzzbFyJF08JoJ1PYfhtDQRJAhrGh_znPsymYAfveamBdA6vz1Y-oh2GJa7UDnV-tTkHC5ZL-7fb_GflotkDarrlFSqHRvs9b0CJFd3T0swEf2S9AMDAGMNIk353xt2G0b4 Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 047ff2c9b6414ce8b98364678cbfeb53 Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/047ff2c9b6414ce8b98364678cbfeb53"}]}] Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 047ff2c9b6414ce8b98364678cbfeb53 Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerRescueNegativeTestJSON-548947322-project Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: abb3ac58c2ea4e2da8b9e765eda5f333 Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerRescueNegativeTestJSON-548947322-project Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 could not be found. Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2'} Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 could not be found. Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 could not be found. Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:55.290662 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:55.296501 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:55.296501 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:55.296501 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:55.296501 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:55.296501 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:19:55.296501 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:19:55.296501 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 could not be found. Oct 04 21:19:55.296501 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:19:55.298315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5d750790-ad68-4cf5-87b4-09952315aea4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Returning 404 to user: Instance e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:19:55.299487 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5d750790-ad68-4cf5-87b4-09952315aea4 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2" status: 404 len: 111 microversion: 2.1 time: 0.058518 Oct 04 21:19:55.300370 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1527/3123] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:55 2022] GET /compute/v2.1/servers/e17dc9c1-b5f7-4cba-9e18-2c0c167d25f2 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:19:55.309518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d1193f0c-5677-45bb-928b-b63ba18961e3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:55.310289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d1193f0c-5677-45bb-928b-b63ba18961e3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:55.319325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1193f0c-5677-45bb-928b-b63ba18961e3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:55.321057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1193f0c-5677-45bb-928b-b63ba18961e3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:55.321780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1193f0c-5677-45bb-928b-b63ba18961e3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:55.322724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1193f0c-5677-45bb-928b-b63ba18961e3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:55.323431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1193f0c-5677-45bb-928b-b63ba18961e3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:55.324063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1193f0c-5677-45bb-928b-b63ba18961e3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:55.372655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d1193f0c-5677-45bb-928b-b63ba18961e3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:19:55.389031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:55.436811 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-943d03e2-59de-42ec-a169-e1a649a8b7ee tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "DELETE /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914" status: 204 len: 0 microversion: 2.1 time: 1.675534 Oct 04 21:19:55.437389 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1597/3124] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:53 2022] DELETE /compute/v2.1/images/4e28e72f-7dfa-40cf-b8fe-16815a962914 => generated 0 bytes in 1677 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:19:55.449647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9bbdecbb-f92c-4c20-b890-eac7c8f77bac tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57909535e0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:55.792094 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d1193f0c-5677-45bb-928b-b63ba18961e3 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 204 len: 0 microversion: 2.1 time: 0.486719 Oct 04 21:19:55.792725 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1528/3125] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:19:55 2022] DELETE /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:19:55.799789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8a02bca1-bbf2-48ea-a3df-723ed610d523 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:55.801076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8a02bca1-bbf2-48ea-a3df-723ed610d523 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:55.825278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a02bca1-bbf2-48ea-a3df-723ed610d523 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:55.826073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a02bca1-bbf2-48ea-a3df-723ed610d523 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:55.826703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a02bca1-bbf2-48ea-a3df-723ed610d523 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:55.827610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a02bca1-bbf2-48ea-a3df-723ed610d523 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:55.828231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a02bca1-bbf2-48ea-a3df-723ed610d523 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:55.828854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a02bca1-bbf2-48ea-a3df-723ed610d523 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:56.296027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:56.506104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8a02bca1-bbf2-48ea-a3df-723ed610d523 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:56.522612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8a02bca1-bbf2-48ea-a3df-723ed610d523 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:56.528860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8a02bca1-bbf2-48ea-a3df-723ed610d523 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:56.534972 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8a02bca1-bbf2-48ea-a3df-723ed610d523 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.740018 Oct 04 21:19:56.539204 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1529/3126] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:55 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:19:56.551911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5d99fd6c-3f05-40ae-bd53-de843b094a22 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:56.552544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5d99fd6c-3f05-40ae-bd53-de843b094a22 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:56.586310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d99fd6c-3f05-40ae-bd53-de843b094a22 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:56.589006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d99fd6c-3f05-40ae-bd53-de843b094a22 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:56.589985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d99fd6c-3f05-40ae-bd53-de843b094a22 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:56.590924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d99fd6c-3f05-40ae-bd53-de843b094a22 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:56.598714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d99fd6c-3f05-40ae-bd53-de843b094a22 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:56.600216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d99fd6c-3f05-40ae-bd53-de843b094a22 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:56.792966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:56.957452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5d99fd6c-3f05-40ae-bd53-de843b094a22 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:56.974539 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5d99fd6c-3f05-40ae-bd53-de843b094a22 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1523 microversion: 2.1 time: 0.433434 Oct 04 21:19:56.976498 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1530/3127] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:56 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1523 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:56.998454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-56911e9b-e7f2-4dca-8c9d-c1fb879e4a9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:57.001582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-56911e9b-e7f2-4dca-8c9d-c1fb879e4a9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:57.015978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56911e9b-e7f2-4dca-8c9d-c1fb879e4a9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:57.019391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56911e9b-e7f2-4dca-8c9d-c1fb879e4a9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:57.020571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56911e9b-e7f2-4dca-8c9d-c1fb879e4a9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:57.023369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56911e9b-e7f2-4dca-8c9d-c1fb879e4a9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:57.023802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56911e9b-e7f2-4dca-8c9d-c1fb879e4a9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:57.025224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56911e9b-e7f2-4dca-8c9d-c1fb879e4a9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:57.353657 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9bbdecbb-f92c-4c20-b890-eac7c8f77bac tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "DELETE /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a" status: 204 len: 0 microversion: 2.1 time: 1.907742 Oct 04 21:19:57.353657 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1598/3128] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:55 2022] DELETE /compute/v2.1/images/9d6220ac-834d-454f-9781-aaa88fc00a4a => generated 0 bytes in 1909 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:19:57.356399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-b2b39ae0-e911-4e77-a41d-42fbb1b62931 req-4e0a472f-1560-4193-9c7b-264dde44b4fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ccadfb7-f678-4ca9-9f01-7b268c2e1db6", "tag": "a6dd8a45-b585-411b-a35e-ee7bbc82f986"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:57.396799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b2b39ae0-e911-4e77-a41d-42fbb1b62931 req-4e0a472f-1560-4193-9c7b-264dde44b4fd service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:57.397533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b2b39ae0-e911-4e77-a41d-42fbb1b62931 req-4e0a472f-1560-4193-9c7b-264dde44b4fd service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:57.398061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b2b39ae0-e911-4e77-a41d-42fbb1b62931 req-4e0a472f-1560-4193-9c7b-264dde44b4fd service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:57.414363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=87 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:57.433849 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-b2b39ae0-e911-4e77-a41d-42fbb1b62931 req-4e0a472f-1560-4193-9c7b-264dde44b4fd service nova] Creating event network-changed:a6dd8a45-b585-411b-a35e-ee7bbc82f986 for instance 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 on n-h1-860282-1 Oct 04 21:19:57.479106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-56911e9b-e7f2-4dca-8c9d-c1fb879e4a9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:57.481633 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-b2b39ae0-e911-4e77-a41d-42fbb1b62931 req-4e0a472f-1560-4193-9c7b-264dde44b4fd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128227 Oct 04 21:19:57.483232 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1599/3129] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:57.487402 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-56911e9b-e7f2-4dca-8c9d-c1fb879e4a9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 200 len: 1323 microversion: 2.1 time: 0.509654 Oct 04 21:19:57.495901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-de976122-f38a-4559-a212-79389406c47d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:57.502779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-de976122-f38a-4559-a212-79389406c47d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:57.506827 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1531/3130] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:56 2022] GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 1323 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:57.515910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de976122-f38a-4559-a212-79389406c47d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:57.517903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de976122-f38a-4559-a212-79389406c47d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:57.518654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de976122-f38a-4559-a212-79389406c47d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:57.519606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de976122-f38a-4559-a212-79389406c47d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:57.520450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de976122-f38a-4559-a212-79389406c47d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:57.521097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de976122-f38a-4559-a212-79389406c47d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:57.565884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-545d6d5e-52f2-42c2-8e36-66f896114c53 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:57.566502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-545d6d5e-52f2-42c2-8e36-66f896114c53 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:57.575183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-545d6d5e-52f2-42c2-8e36-66f896114c53 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:57.578212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-de976122-f38a-4559-a212-79389406c47d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:19:57.581813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-545d6d5e-52f2-42c2-8e36-66f896114c53 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:57.582272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-545d6d5e-52f2-42c2-8e36-66f896114c53 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:57.583030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-545d6d5e-52f2-42c2-8e36-66f896114c53 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:57.583502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-545d6d5e-52f2-42c2-8e36-66f896114c53 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:57.583940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-545d6d5e-52f2-42c2-8e36-66f896114c53 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:57.955559 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-de976122-f38a-4559-a212-79389406c47d tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "DELETE /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 204 len: 0 microversion: 2.1 time: 0.469769 Oct 04 21:19:57.956944 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1600/3131] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:19:57 2022] DELETE /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:19:57.967231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d11ba9a7-88cf-4967-92d5-5fd8134b04f7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:57.968300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d11ba9a7-88cf-4967-92d5-5fd8134b04f7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:57.977450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d11ba9a7-88cf-4967-92d5-5fd8134b04f7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:57.977995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d11ba9a7-88cf-4967-92d5-5fd8134b04f7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:57.978451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d11ba9a7-88cf-4967-92d5-5fd8134b04f7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:57.979172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d11ba9a7-88cf-4967-92d5-5fd8134b04f7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:57.979634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d11ba9a7-88cf-4967-92d5-5fd8134b04f7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:57.980267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d11ba9a7-88cf-4967-92d5-5fd8134b04f7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:58.084408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-545d6d5e-52f2-42c2-8e36-66f896114c53 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:58.097211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-545d6d5e-52f2-42c2-8e36-66f896114c53 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:58.099834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-545d6d5e-52f2-42c2-8e36-66f896114c53 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:58.101490 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-545d6d5e-52f2-42c2-8e36-66f896114c53 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.540893 Oct 04 21:19:58.102916 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1532/3132] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:57 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:19:58.109891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2611a1dc-f424-484c-a7c1-575f88368a74 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:58.111160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2611a1dc-f424-484c-a7c1-575f88368a74 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:58.128008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:58.147581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2611a1dc-f424-484c-a7c1-575f88368a74 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:58.148364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2611a1dc-f424-484c-a7c1-575f88368a74 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:58.149140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2611a1dc-f424-484c-a7c1-575f88368a74 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:58.152305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2611a1dc-f424-484c-a7c1-575f88368a74 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:58.153014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2611a1dc-f424-484c-a7c1-575f88368a74 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:58.153502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2611a1dc-f424-484c-a7c1-575f88368a74 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:58.222164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d11ba9a7-88cf-4967-92d5-5fd8134b04f7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:58.233703 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d11ba9a7-88cf-4967-92d5-5fd8134b04f7 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1473 microversion: 2.1 time: 0.271788 Oct 04 21:19:58.234683 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1601/3133] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:57 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1473 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:58.383337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2611a1dc-f424-484c-a7c1-575f88368a74 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:58.392490 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2611a1dc-f424-484c-a7c1-575f88368a74 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1523 microversion: 2.1 time: 0.287863 Oct 04 21:19:58.393233 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1533/3134] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:58 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1523 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:58.514035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-53dcfb56-b056-46c6-adcc-24afb890d0fb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:58.514621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-53dcfb56-b056-46c6-adcc-24afb890d0fb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:58.521645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53dcfb56-b056-46c6-adcc-24afb890d0fb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:58.522149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53dcfb56-b056-46c6-adcc-24afb890d0fb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:58.522599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53dcfb56-b056-46c6-adcc-24afb890d0fb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:58.523328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53dcfb56-b056-46c6-adcc-24afb890d0fb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:58.523785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53dcfb56-b056-46c6-adcc-24afb890d0fb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:58.526196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53dcfb56-b056-46c6-adcc-24afb890d0fb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:58.842633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-53dcfb56-b056-46c6-adcc-24afb890d0fb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:58.852042 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-53dcfb56-b056-46c6-adcc-24afb890d0fb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 200 len: 1323 microversion: 2.1 time: 0.341972 Oct 04 21:19:58.862945 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1602/3135] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:58 2022] GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 1323 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:59.143850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a2bf0afb-6cdf-42b9-99b1-9e113f752aa8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:59.151306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a2bf0afb-6cdf-42b9-99b1-9e113f752aa8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:59.174440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2bf0afb-6cdf-42b9-99b1-9e113f752aa8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:59.174975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2bf0afb-6cdf-42b9-99b1-9e113f752aa8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:59.175426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2bf0afb-6cdf-42b9-99b1-9e113f752aa8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:59.176166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2bf0afb-6cdf-42b9-99b1-9e113f752aa8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:59.176883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2bf0afb-6cdf-42b9-99b1-9e113f752aa8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:59.177308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2bf0afb-6cdf-42b9-99b1-9e113f752aa8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:59.259675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e4f354a2-f96b-41da-9503-77c7f12e1d5b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:59.260300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e4f354a2-f96b-41da-9503-77c7f12e1d5b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:59.272693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:59.274447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4f354a2-f96b-41da-9503-77c7f12e1d5b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:59.275424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4f354a2-f96b-41da-9503-77c7f12e1d5b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:59.278412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4f354a2-f96b-41da-9503-77c7f12e1d5b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:59.279446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4f354a2-f96b-41da-9503-77c7f12e1d5b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:59.280090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4f354a2-f96b-41da-9503-77c7f12e1d5b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:59.281947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4f354a2-f96b-41da-9503-77c7f12e1d5b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:59.833162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e4f354a2-f96b-41da-9503-77c7f12e1d5b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:59.841884 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e4f354a2-f96b-41da-9503-77c7f12e1d5b tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1473 microversion: 2.1 time: 0.587734 Oct 04 21:19:59.842479 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1603/3136] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:59 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1473 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:59.862059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b0a77885-dee5-4552-8074-5430a1de0188 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:59.863520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b0a77885-dee5-4552-8074-5430a1de0188 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:59.881488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0a77885-dee5-4552-8074-5430a1de0188 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:59.882002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0a77885-dee5-4552-8074-5430a1de0188 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:59.882443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0a77885-dee5-4552-8074-5430a1de0188 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:59.883159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0a77885-dee5-4552-8074-5430a1de0188 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:59.883608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0a77885-dee5-4552-8074-5430a1de0188 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:59.889608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0a77885-dee5-4552-8074-5430a1de0188 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:59.965675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a2bf0afb-6cdf-42b9-99b1-9e113f752aa8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:59.981319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a2bf0afb-6cdf-42b9-99b1-9e113f752aa8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:59.984639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a2bf0afb-6cdf-42b9-99b1-9e113f752aa8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:59.984773 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a2bf0afb-6cdf-42b9-99b1-9e113f752aa8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.856608 Oct 04 21:20:00.007442 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1534/3137] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:59 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:00.012300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bc7489aa-6054-4f50-863e-884b63dd4ad9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:00.013152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bc7489aa-6054-4f50-863e-884b63dd4ad9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:00.046025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc7489aa-6054-4f50-863e-884b63dd4ad9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:00.051946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc7489aa-6054-4f50-863e-884b63dd4ad9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:00.062099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc7489aa-6054-4f50-863e-884b63dd4ad9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:00.063157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc7489aa-6054-4f50-863e-884b63dd4ad9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:00.064073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc7489aa-6054-4f50-863e-884b63dd4ad9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:00.064680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc7489aa-6054-4f50-863e-884b63dd4ad9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:00.363187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b0a77885-dee5-4552-8074-5430a1de0188 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:00.376514 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b0a77885-dee5-4552-8074-5430a1de0188 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1523 microversion: 2.1 time: 0.529196 Oct 04 21:20:00.377117 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1604/3138] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:59 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1523 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:00.519613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bc7489aa-6054-4f50-863e-884b63dd4ad9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:00.550824 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bc7489aa-6054-4f50-863e-884b63dd4ad9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 200 len: 1323 microversion: 2.1 time: 0.542099 Oct 04 21:20:00.566759 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1535/3139] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:00 2022] GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 1323 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:00.740623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-d661335b-16e9-400c-9ce8-48e33f558ea9 req-f70aad90-394b-406c-8e7e-885f6aed8eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a86ffd-75a1-460b-ae59-24969ece95ad", "name": "network-vif-deleted", "tag": "ebbb3376-2554-4ae5-be99-ef246a2637f5"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:00.767901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d661335b-16e9-400c-9ce8-48e33f558ea9 req-f70aad90-394b-406c-8e7e-885f6aed8eff service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:00.770356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d661335b-16e9-400c-9ce8-48e33f558ea9 req-f70aad90-394b-406c-8e7e-885f6aed8eff service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:00.773205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d661335b-16e9-400c-9ce8-48e33f558ea9 req-f70aad90-394b-406c-8e7e-885f6aed8eff service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:00.798986 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-d661335b-16e9-400c-9ce8-48e33f558ea9 req-f70aad90-394b-406c-8e7e-885f6aed8eff service nova] Creating event network-vif-deleted:ebbb3376-2554-4ae5-be99-ef246a2637f5 for instance 89a86ffd-75a1-460b-ae59-24969ece95ad on n-h2-860282-1 Oct 04 21:20:00.818916 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-d661335b-16e9-400c-9ce8-48e33f558ea9 req-f70aad90-394b-406c-8e7e-885f6aed8eff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077412 Oct 04 21:20:00.818916 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1605/3140] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:00.866815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a738dc97-3578-4e3e-be15-0639462aa0fa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:00.867854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a738dc97-3578-4e3e-be15-0639462aa0fa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:00.882776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a738dc97-3578-4e3e-be15-0639462aa0fa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:00.883704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a738dc97-3578-4e3e-be15-0639462aa0fa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:00.884468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a738dc97-3578-4e3e-be15-0639462aa0fa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:00.885620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a738dc97-3578-4e3e-be15-0639462aa0fa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:00.886548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a738dc97-3578-4e3e-be15-0639462aa0fa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:00.887253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a738dc97-3578-4e3e-be15-0639462aa0fa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:01.016026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ef609d1a-f160-413b-ba77-88b3b0eec674 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:01.017887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ef609d1a-f160-413b-ba77-88b3b0eec674 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:01.029605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef609d1a-f160-413b-ba77-88b3b0eec674 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:01.030099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef609d1a-f160-413b-ba77-88b3b0eec674 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:01.030541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef609d1a-f160-413b-ba77-88b3b0eec674 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:01.031250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef609d1a-f160-413b-ba77-88b3b0eec674 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:01.045861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef609d1a-f160-413b-ba77-88b3b0eec674 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:01.046615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef609d1a-f160-413b-ba77-88b3b0eec674 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:01.507473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a738dc97-3578-4e3e-be15-0639462aa0fa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:01.526849 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a738dc97-3578-4e3e-be15-0639462aa0fa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1473 microversion: 2.1 time: 0.664630 Oct 04 21:20:01.541915 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1536/3141] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:00 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1473 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:01.550436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-18db5098-8be8-40a3-901b-a8be947e8bea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:01.552560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-18db5098-8be8-40a3-901b-a8be947e8bea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:01.562571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18db5098-8be8-40a3-901b-a8be947e8bea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:01.564075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18db5098-8be8-40a3-901b-a8be947e8bea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:01.565904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18db5098-8be8-40a3-901b-a8be947e8bea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:01.566940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18db5098-8be8-40a3-901b-a8be947e8bea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:01.571575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18db5098-8be8-40a3-901b-a8be947e8bea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:01.571575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18db5098-8be8-40a3-901b-a8be947e8bea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:01.604845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18db5098-8be8-40a3-901b-a8be947e8bea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:01.605254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18db5098-8be8-40a3-901b-a8be947e8bea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:01.605732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18db5098-8be8-40a3-901b-a8be947e8bea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:01.606435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-18db5098-8be8-40a3-901b-a8be947e8bea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lazy-loading 'fault' on Instance uuid 89a86ffd-75a1-460b-ae59-24969ece95ad {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:20:01.710688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ef609d1a-f160-413b-ba77-88b3b0eec674 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:01.716389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-18db5098-8be8-40a3-901b-a8be947e8bea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb3ac58c2ea4e2da8b9e765eda5f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047ff2c9b6414ce8b98364678cbfeb53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:01.722148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ef609d1a-f160-413b-ba77-88b3b0eec674 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:01.723665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ef609d1a-f160-413b-ba77-88b3b0eec674 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:01.725218 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ef609d1a-f160-413b-ba77-88b3b0eec674 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.713928 Oct 04 21:20:01.732436 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1606/3142] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:01 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:20:01.732436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fcf67e38-7238-4cf1-be3a-594066aef065 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:01.732436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fcf67e38-7238-4cf1-be3a-594066aef065 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:01.740301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcf67e38-7238-4cf1-be3a-594066aef065 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:01.741143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcf67e38-7238-4cf1-be3a-594066aef065 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:01.741851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcf67e38-7238-4cf1-be3a-594066aef065 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:01.742829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcf67e38-7238-4cf1-be3a-594066aef065 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:01.743492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcf67e38-7238-4cf1-be3a-594066aef065 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:01.744139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcf67e38-7238-4cf1-be3a-594066aef065 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:01.760503 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-18db5098-8be8-40a3-901b-a8be947e8bea tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 200 len: 1312 microversion: 2.1 time: 0.216763 Oct 04 21:20:01.763366 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1537/3143] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:01 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 1312 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:01.788897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b6ac8cde-30bd-4dad-93a3-c0a8d19c3c03 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:01.791554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b6ac8cde-30bd-4dad-93a3-c0a8d19c3c03 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:01.804176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6ac8cde-30bd-4dad-93a3-c0a8d19c3c03 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:01.804696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6ac8cde-30bd-4dad-93a3-c0a8d19c3c03 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:01.808304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6ac8cde-30bd-4dad-93a3-c0a8d19c3c03 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:01.811948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6ac8cde-30bd-4dad-93a3-c0a8d19c3c03 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:01.812623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6ac8cde-30bd-4dad-93a3-c0a8d19c3c03 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:01.814158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6ac8cde-30bd-4dad-93a3-c0a8d19c3c03 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:02.413074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fcf67e38-7238-4cf1-be3a-594066aef065 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:02.421275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b6ac8cde-30bd-4dad-93a3-c0a8d19c3c03 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:02.432169 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fcf67e38-7238-4cf1-be3a-594066aef065 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 200 len: 1323 microversion: 2.1 time: 0.704586 Oct 04 21:20:02.433713 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1607/3144] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:01 2022] GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 1323 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:02.434867 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b6ac8cde-30bd-4dad-93a3-c0a8d19c3c03 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1681 microversion: 2.1 time: 0.664447 Oct 04 21:20:02.452142 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1538/3145] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:01 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1681 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:02.556774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-917faa55-7a22-4f2a-808f-70ade5b3e6b5 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:02.557936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-917faa55-7a22-4f2a-808f-70ade5b3e6b5 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:02.568453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-917faa55-7a22-4f2a-808f-70ade5b3e6b5 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:02.568955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-917faa55-7a22-4f2a-808f-70ade5b3e6b5 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:02.569397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-917faa55-7a22-4f2a-808f-70ade5b3e6b5 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:02.570132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-917faa55-7a22-4f2a-808f-70ade5b3e6b5 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:02.570589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-917faa55-7a22-4f2a-808f-70ade5b3e6b5 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:02.571019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-917faa55-7a22-4f2a-808f-70ade5b3e6b5 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:02.609242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-917faa55-7a22-4f2a-808f-70ade5b3e6b5 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:02.609746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-917faa55-7a22-4f2a-808f-70ade5b3e6b5 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:02.610960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-917faa55-7a22-4f2a-808f-70ade5b3e6b5 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:02.611571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-917faa55-7a22-4f2a-808f-70ade5b3e6b5 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lazy-loading 'fault' on Instance uuid 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:20:02.685313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-917faa55-7a22-4f2a-808f-70ade5b3e6b5 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:02.695688 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-917faa55-7a22-4f2a-808f-70ade5b3e6b5 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 200 len: 1307 microversion: 2.1 time: 0.142719 Oct 04 21:20:02.695688 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1608/3146] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:02 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 1307 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:02.758839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-84edbb02-f015-49d2-8355-9d7430d47cb3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:02.759794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-84edbb02-f015-49d2-8355-9d7430d47cb3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:02.766854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84edbb02-f015-49d2-8355-9d7430d47cb3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:02.767455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84edbb02-f015-49d2-8355-9d7430d47cb3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:02.768076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84edbb02-f015-49d2-8355-9d7430d47cb3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:02.769494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84edbb02-f015-49d2-8355-9d7430d47cb3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:02.770043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84edbb02-f015-49d2-8355-9d7430d47cb3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:02.770558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84edbb02-f015-49d2-8355-9d7430d47cb3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:02.795871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-571cd24f-f04f-43c8-b746-0582ce5dc9d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:02.796689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-571cd24f-f04f-43c8-b746-0582ce5dc9d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] [instance: 89a86ffd-75a1-460b-ae59-24969ece95ad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:02.805902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-571cd24f-f04f-43c8-b746-0582ce5dc9d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:02.807502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-571cd24f-f04f-43c8-b746-0582ce5dc9d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:02.807502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-571cd24f-f04f-43c8-b746-0582ce5dc9d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:02.810029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-571cd24f-f04f-43c8-b746-0582ce5dc9d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:02.810508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-571cd24f-f04f-43c8-b746-0582ce5dc9d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:02.811088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-571cd24f-f04f-43c8-b746-0582ce5dc9d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:02.833342 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-571cd24f-f04f-43c8-b746-0582ce5dc9d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] HTTP exception thrown: Instance 89a86ffd-75a1-460b-ae59-24969ece95ad could not be found. Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-571cd24f-f04f-43c8-b746-0582ce5dc9d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Request method failure captured: Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad HTTP/1.1 Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKIzNXd_CmvP-6Usf8igAzY3dlzgDYn--v5mxvj-LpxllWzzbFyJF08JoJ1PYfhtDQRJAhrGh_znPsymYAfveamBdA6vz1Y-oh2GJa7UDnV-tTkHC5ZL-7fb_GflotkDarrlFSqHRvs9b0CJFd3T0swEf2S9AMDAGMNIk353xt2G0b4 Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 047ff2c9b6414ce8b98364678cbfeb53 Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/047ff2c9b6414ce8b98364678cbfeb53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/047ff2c9b6414ce8b98364678cbfeb53"}]}] Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 047ff2c9b6414ce8b98364678cbfeb53 Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-548947322 Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerRescueNegativeTestJSON-548947322-project Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: abb3ac58c2ea4e2da8b9e765eda5f333 Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerRescueNegativeTestJSON-548947322-project Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 89a86ffd-75a1-460b-ae59-24969ece95ad could not be found. Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '89a86ffd-75a1-460b-ae59-24969ece95ad'} Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89a86ffd-75a1-460b-ae59-24969ece95ad could not be found. Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89a86ffd-75a1-460b-ae59-24969ece95ad could not be found. Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:20:02.835558 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:02.839611 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:20:02.839611 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:02.839611 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:02.839611 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:02.839611 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:20:02.839611 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:20:02.839611 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89a86ffd-75a1-460b-ae59-24969ece95ad could not be found. Oct 04 21:20:02.839611 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:20:02.839611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-571cd24f-f04f-43c8-b746-0582ce5dc9d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] Returning 404 to user: Instance 89a86ffd-75a1-460b-ae59-24969ece95ad could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:20:02.839611 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-571cd24f-f04f-43c8-b746-0582ce5dc9d6 tempest-ServerRescueNegativeTestJSON-548947322 tempest-ServerRescueNegativeTestJSON-548947322-project] 10.222.0.30 "GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad" status: 404 len: 111 microversion: 2.1 time: 0.049548 Oct 04 21:20:02.841768 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1609/3147] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:02 2022] GET /compute/v2.1/servers/89a86ffd-75a1-460b-ae59-24969ece95ad => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:20:02.848679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-110d6cbe-c870-4125-b8cb-f860811791b1 req-492e8284-c19c-4047-b7f2-6575e6f17b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc", "name": "network-vif-deleted", "tag": "7b5a9c4b-694b-4147-95a1-a4e92206db0b"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:02.862189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-110d6cbe-c870-4125-b8cb-f860811791b1 req-492e8284-c19c-4047-b7f2-6575e6f17b13 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:02.863420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-110d6cbe-c870-4125-b8cb-f860811791b1 req-492e8284-c19c-4047-b7f2-6575e6f17b13 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:02.864383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-110d6cbe-c870-4125-b8cb-f860811791b1 req-492e8284-c19c-4047-b7f2-6575e6f17b13 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:02.879658 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-110d6cbe-c870-4125-b8cb-f860811791b1 req-492e8284-c19c-4047-b7f2-6575e6f17b13 service nova] Creating event network-vif-deleted:7b5a9c4b-694b-4147-95a1-a4e92206db0b for instance 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc on n-h1-860282-1 Oct 04 21:20:02.888151 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-110d6cbe-c870-4125-b8cb-f860811791b1 req-492e8284-c19c-4047-b7f2-6575e6f17b13 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041997 Oct 04 21:20:02.888151 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1610/3148] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:03.108191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-84edbb02-f015-49d2-8355-9d7430d47cb3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:03.120021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-84edbb02-f015-49d2-8355-9d7430d47cb3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:03.121945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-84edbb02-f015-49d2-8355-9d7430d47cb3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:03.123326 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-84edbb02-f015-49d2-8355-9d7430d47cb3 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.369998 Oct 04 21:20:03.124091 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1539/3149] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:02 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:03.461164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5c239d7f-d535-4b27-8e58-83d5f7942e64 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:03.462144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-265700e7-8f00-421d-823e-02e68545208f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:03.462782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-265700e7-8f00-421d-823e-02e68545208f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:03.462986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5c239d7f-d535-4b27-8e58-83d5f7942e64 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:03.476496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-265700e7-8f00-421d-823e-02e68545208f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:03.477136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-265700e7-8f00-421d-823e-02e68545208f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:03.477379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c239d7f-d535-4b27-8e58-83d5f7942e64 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:03.477640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-265700e7-8f00-421d-823e-02e68545208f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:03.478278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c239d7f-d535-4b27-8e58-83d5f7942e64 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:03.478463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-265700e7-8f00-421d-823e-02e68545208f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:03.478935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-265700e7-8f00-421d-823e-02e68545208f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:03.479372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-265700e7-8f00-421d-823e-02e68545208f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:03.479970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c239d7f-d535-4b27-8e58-83d5f7942e64 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:03.483339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c239d7f-d535-4b27-8e58-83d5f7942e64 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:03.484045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c239d7f-d535-4b27-8e58-83d5f7942e64 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:03.485902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c239d7f-d535-4b27-8e58-83d5f7942e64 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:04.100010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5c239d7f-d535-4b27-8e58-83d5f7942e64 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:04.110878 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5c239d7f-d535-4b27-8e58-83d5f7942e64 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 200 len: 1323 microversion: 2.1 time: 0.656924 Oct 04 21:20:04.112079 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1611/3150] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:03 2022] GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 1323 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:04.118479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-a9450245-d60e-45d8-bda3-2be5efe9f510 req-ffe7f52f-29eb-4a9f-a1d7-d89a8233d562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ccadfb7-f678-4ca9-9f01-7b268c2e1db6", "name": "network-vif-plugged", "status": "completed", "tag": "a6dd8a45-b585-411b-a35e-ee7bbc82f986"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:04.133515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a9450245-d60e-45d8-bda3-2be5efe9f510 req-ffe7f52f-29eb-4a9f-a1d7-d89a8233d562 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:04.134559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a9450245-d60e-45d8-bda3-2be5efe9f510 req-ffe7f52f-29eb-4a9f-a1d7-d89a8233d562 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:04.135154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a9450245-d60e-45d8-bda3-2be5efe9f510 req-ffe7f52f-29eb-4a9f-a1d7-d89a8233d562 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:04.146032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-265700e7-8f00-421d-823e-02e68545208f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:04.162272 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-265700e7-8f00-421d-823e-02e68545208f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.704326 Oct 04 21:20:04.163426 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1540/3151] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:03 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:20:04.177828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dedb6304-5c6d-4675-8847-4ff86c2aeafa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:04.178751 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-a9450245-d60e-45d8-bda3-2be5efe9f510 req-ffe7f52f-29eb-4a9f-a1d7-d89a8233d562 service nova] Creating event network-vif-plugged:a6dd8a45-b585-411b-a35e-ee7bbc82f986 for instance 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 on n-h1-860282-1 Oct 04 21:20:04.182855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dedb6304-5c6d-4675-8847-4ff86c2aeafa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:04.187437 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-a9450245-d60e-45d8-bda3-2be5efe9f510 req-ffe7f52f-29eb-4a9f-a1d7-d89a8233d562 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073025 Oct 04 21:20:04.198245 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1612/3152] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:04.205399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6f5e1ea2-47be-48d6-a9d1-454e2a96807d tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:04.207172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dedb6304-5c6d-4675-8847-4ff86c2aeafa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:04.207675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dedb6304-5c6d-4675-8847-4ff86c2aeafa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:04.208184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dedb6304-5c6d-4675-8847-4ff86c2aeafa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:04.208869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dedb6304-5c6d-4675-8847-4ff86c2aeafa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:04.209326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dedb6304-5c6d-4675-8847-4ff86c2aeafa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:04.209806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dedb6304-5c6d-4675-8847-4ff86c2aeafa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:04.216387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6f5e1ea2-47be-48d6-a9d1-454e2a96807d tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:04.241610 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-dedb6304-5c6d-4675-8847-4ff86c2aeafa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] HTTP exception thrown: Instance 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc could not be found. Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dedb6304-5c6d-4675-8847-4ff86c2aeafa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Request method failure captured: Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc HTTP/1.1 Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKLXvl5O_TBOVn-Zk6OWE4vMdqrotl3SdwgRqY6lkLDo8h19tqsf-1zsYlTZ8w7CLefkdiEjVtdzVaMjy69OX538HcvWf-2HkRgRUe_dBnlYDokRKy_QZUHphZDaDIVq0Wcjeh08ZXcLdxE4KLHq0Tvq1oJidJxWDerPLFyYqdAo-wU Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: d842ce8242b749d6b95ede68c12185ff Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ListImageFiltersTestJSON-1871029503 Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d842ce8242b749d6b95ede68c12185ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d842ce8242b749d6b95ede68c12185ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d842ce8242b749d6b95ede68c12185ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d842ce8242b749d6b95ede68c12185ff"}]}] Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ListImageFiltersTestJSON-1871029503 Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: d842ce8242b749d6b95ede68c12185ff Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1871029503 Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ListImageFiltersTestJSON-1871029503-project Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 9eac8933397749519514b18d174a2f0f Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ListImageFiltersTestJSON-1871029503-project Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc could not be found. Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc'} Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc could not be found. Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc could not be found. Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:04.243288 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:20:04.248664 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:04.248664 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:04.248664 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:04.248664 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:20:04.248664 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:20:04.248664 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc could not be found. Oct 04 21:20:04.248664 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:20:04.248664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dedb6304-5c6d-4675-8847-4ff86c2aeafa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Returning 404 to user: Instance 459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:20:04.248664 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dedb6304-5c6d-4675-8847-4ff86c2aeafa tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc" status: 404 len: 111 microversion: 2.1 time: 0.080156 Oct 04 21:20:04.249818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f5e1ea2-47be-48d6-a9d1-454e2a96807d tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:04.249818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f5e1ea2-47be-48d6-a9d1-454e2a96807d tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:04.249818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f5e1ea2-47be-48d6-a9d1-454e2a96807d tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:04.249818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f5e1ea2-47be-48d6-a9d1-454e2a96807d tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:04.249818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f5e1ea2-47be-48d6-a9d1-454e2a96807d tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:04.249818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f5e1ea2-47be-48d6-a9d1-454e2a96807d tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:04.256137 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1541/3153] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:04 2022] GET /compute/v2.1/servers/459c7bf7-1ae2-42e0-ac71-c3edf42ff9bc => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:20:04.272998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-751ad5b6-9fc2-4f06-99ea-1488308a65d5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-562993938"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:04.275945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-751ad5b6-9fc2-4f06-99ea-1488308a65d5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:04.283039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-751ad5b6-9fc2-4f06-99ea-1488308a65d5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:04.283895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-751ad5b6-9fc2-4f06-99ea-1488308a65d5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:04.284567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-751ad5b6-9fc2-4f06-99ea-1488308a65d5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:04.285504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-751ad5b6-9fc2-4f06-99ea-1488308a65d5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:04.286163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-751ad5b6-9fc2-4f06-99ea-1488308a65d5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:04.286827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-751ad5b6-9fc2-4f06-99ea-1488308a65d5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:04.645566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6f5e1ea2-47be-48d6-a9d1-454e2a96807d tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:04.662572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6f5e1ea2-47be-48d6-a9d1-454e2a96807d tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:04.664743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6f5e1ea2-47be-48d6-a9d1-454e2a96807d tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:04.666294 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6f5e1ea2-47be-48d6-a9d1-454e2a96807d tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.465849 Oct 04 21:20:04.673771 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1613/3154] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:04 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:04.673771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6b1a4428-9cdf-4975-9808-eac9714171bb tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:04.673771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6b1a4428-9cdf-4975-9808-eac9714171bb tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 142c6da5-e828-4e2b-bfef-0cf163f0c97c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:04.691643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b1a4428-9cdf-4975-9808-eac9714171bb tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:04.692142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b1a4428-9cdf-4975-9808-eac9714171bb tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:04.692865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b1a4428-9cdf-4975-9808-eac9714171bb tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:04.693996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b1a4428-9cdf-4975-9808-eac9714171bb tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:04.694675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b1a4428-9cdf-4975-9808-eac9714171bb tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:04.695318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b1a4428-9cdf-4975-9808-eac9714171bb tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:04.737775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6b1a4428-9cdf-4975-9808-eac9714171bb tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 142c6da5-e828-4e2b-bfef-0cf163f0c97c] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:20:04.809966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:04.993010 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-751ad5b6-9fc2-4f06-99ea-1488308a65d5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action" status: 202 len: 0 microversion: 2.1 time: 0.736113 Oct 04 21:20:04.993640 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1542/3155] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:20:04 2022] POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action => generated 0 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 21:20:05.138380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4e9c0a05-77b5-4e63-abf2-14e96b4fdb1d tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:05.138380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4e9c0a05-77b5-4e63-abf2-14e96b4fdb1d tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:05.146075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e9c0a05-77b5-4e63-abf2-14e96b4fdb1d tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:05.146683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e9c0a05-77b5-4e63-abf2-14e96b4fdb1d tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:05.147098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e9c0a05-77b5-4e63-abf2-14e96b4fdb1d tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:05.147814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e9c0a05-77b5-4e63-abf2-14e96b4fdb1d tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:05.148279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e9c0a05-77b5-4e63-abf2-14e96b4fdb1d tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:05.148707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e9c0a05-77b5-4e63-abf2-14e96b4fdb1d tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:05.221040 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6b1a4428-9cdf-4975-9808-eac9714171bb tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "DELETE /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c" status: 204 len: 0 microversion: 2.1 time: 0.551399 Oct 04 21:20:05.221896 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1614/3156] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:20:04 2022] DELETE /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:20:05.235327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dcb98c93-3917-435b-b02e-06c5a7a059a1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:05.236332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dcb98c93-3917-435b-b02e-06c5a7a059a1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 142c6da5-e828-4e2b-bfef-0cf163f0c97c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:05.256912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dcb98c93-3917-435b-b02e-06c5a7a059a1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:05.257411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dcb98c93-3917-435b-b02e-06c5a7a059a1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:05.257882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dcb98c93-3917-435b-b02e-06c5a7a059a1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:05.269669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dcb98c93-3917-435b-b02e-06c5a7a059a1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:05.270460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dcb98c93-3917-435b-b02e-06c5a7a059a1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:05.273369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dcb98c93-3917-435b-b02e-06c5a7a059a1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:05.309159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:05.327697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4e9c0a05-77b5-4e63-abf2-14e96b4fdb1d tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:05.338650 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4e9c0a05-77b5-4e63-abf2-14e96b4fdb1d tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 200 len: 1323 microversion: 2.1 time: 0.206997 Oct 04 21:20:05.349466 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1543/3157] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:05 2022] GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 1323 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:20:05.460141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dcb98c93-3917-435b-b02e-06c5a7a059a1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:05.469234 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dcb98c93-3917-435b-b02e-06c5a7a059a1 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c" status: 200 len: 1474 microversion: 2.1 time: 0.238279 Oct 04 21:20:05.470210 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1615/3158] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:05 2022] GET /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c => generated 1474 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:20:05.694779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5263cdca-70da-4d10-9b82-758ebe544fa1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:05.695918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5263cdca-70da-4d10-9b82-758ebe544fa1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:05.703083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5263cdca-70da-4d10-9b82-758ebe544fa1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:05.703893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5263cdca-70da-4d10-9b82-758ebe544fa1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:05.704561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5263cdca-70da-4d10-9b82-758ebe544fa1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:05.706349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5263cdca-70da-4d10-9b82-758ebe544fa1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:05.706996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5263cdca-70da-4d10-9b82-758ebe544fa1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:05.707635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5263cdca-70da-4d10-9b82-758ebe544fa1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:06.058746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5263cdca-70da-4d10-9b82-758ebe544fa1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:06.073021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5263cdca-70da-4d10-9b82-758ebe544fa1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:06.074825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5263cdca-70da-4d10-9b82-758ebe544fa1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:06.076375 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5263cdca-70da-4d10-9b82-758ebe544fa1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.385740 Oct 04 21:20:06.077487 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1544/3159] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:05 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:06.217081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-c37f0171-7afb-4d3c-abd0-9454aaa1c6b2 req-5c58724e-345b-46bd-83fc-045602662c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba61f85c-a75d-451d-a5f7-f9533481c406", "name": "network-vif-unplugged", "status": "completed", "tag": "34504880-4c91-4512-980a-45596f508743"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:06.229444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c37f0171-7afb-4d3c-abd0-9454aaa1c6b2 req-5c58724e-345b-46bd-83fc-045602662c85 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:06.230056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c37f0171-7afb-4d3c-abd0-9454aaa1c6b2 req-5c58724e-345b-46bd-83fc-045602662c85 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:06.230541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c37f0171-7afb-4d3c-abd0-9454aaa1c6b2 req-5c58724e-345b-46bd-83fc-045602662c85 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:06.242695 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-c37f0171-7afb-4d3c-abd0-9454aaa1c6b2 req-5c58724e-345b-46bd-83fc-045602662c85 service nova] Creating event network-vif-unplugged:34504880-4c91-4512-980a-45596f508743 for instance ba61f85c-a75d-451d-a5f7-f9533481c406 on n-h2-860282-1 Oct 04 21:20:06.248360 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-c37f0171-7afb-4d3c-abd0-9454aaa1c6b2 req-5c58724e-345b-46bd-83fc-045602662c85 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035054 Oct 04 21:20:06.249253 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1616/3160] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:06.293231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4a202202-e8e7-4b3a-ab9f-4dfa41d3e102 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:06.298819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4a202202-e8e7-4b3a-ab9f-4dfa41d3e102 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:06.299625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4a202202-e8e7-4b3a-ab9f-4dfa41d3e102 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Searching by: {'deleted': False, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:20:06.305485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a202202-e8e7-4b3a-ab9f-4dfa41d3e102 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:06.305969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a202202-e8e7-4b3a-ab9f-4dfa41d3e102 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:06.306405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a202202-e8e7-4b3a-ab9f-4dfa41d3e102 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:06.307116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a202202-e8e7-4b3a-ab9f-4dfa41d3e102 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:06.307569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a202202-e8e7-4b3a-ab9f-4dfa41d3e102 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:06.307988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a202202-e8e7-4b3a-ab9f-4dfa41d3e102 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:06.335780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-4a202202-e8e7-4b3a-ab9f-4dfa41d3e102 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:20:06.364005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1abcdd9b-c4d2-412c-8dfe-9f515c3922b9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:06.364725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1abcdd9b-c4d2-412c-8dfe-9f515c3922b9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:06.367763 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4a202202-e8e7-4b3a-ab9f-4dfa41d3e102 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.078447 Oct 04 21:20:06.368573 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1545/3161] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Oct 4 21:20:06 2022] GET /compute/v2.1/servers => generated 339 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:06.377955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1abcdd9b-c4d2-412c-8dfe-9f515c3922b9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:06.378734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1abcdd9b-c4d2-412c-8dfe-9f515c3922b9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:06.379188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1abcdd9b-c4d2-412c-8dfe-9f515c3922b9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:06.380850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1abcdd9b-c4d2-412c-8dfe-9f515c3922b9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:06.381325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1abcdd9b-c4d2-412c-8dfe-9f515c3922b9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:06.381793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1abcdd9b-c4d2-412c-8dfe-9f515c3922b9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:06.382954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fb140faf-a63b-49eb-8c09-88024be1601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:06.388946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fb140faf-a63b-49eb-8c09-88024be1601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:06.390093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fb140faf-a63b-49eb-8c09-88024be1601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Searching by: {'deleted': False, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:20:06.396486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb140faf-a63b-49eb-8c09-88024be1601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:06.397286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb140faf-a63b-49eb-8c09-88024be1601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:06.398384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb140faf-a63b-49eb-8c09-88024be1601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:06.398708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb140faf-a63b-49eb-8c09-88024be1601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:06.399342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb140faf-a63b-49eb-8c09-88024be1601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:06.399779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb140faf-a63b-49eb-8c09-88024be1601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:06.503309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-fb140faf-a63b-49eb-8c09-88024be1601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:20:06.574593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1abcdd9b-c4d2-412c-8dfe-9f515c3922b9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:06.589996 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1abcdd9b-c4d2-412c-8dfe-9f515c3922b9 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 200 len: 1323 microversion: 2.1 time: 0.231503 Oct 04 21:20:06.592340 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1617/3162] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:06 2022] GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 1323 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:06.600640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-88fdc3e9-5000-41e1-84d2-154652004314 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:06.601413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-88fdc3e9-5000-41e1-84d2-154652004314 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 142c6da5-e828-4e2b-bfef-0cf163f0c97c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:06.617889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88fdc3e9-5000-41e1-84d2-154652004314 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:06.618634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88fdc3e9-5000-41e1-84d2-154652004314 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:06.619095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88fdc3e9-5000-41e1-84d2-154652004314 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:06.619826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88fdc3e9-5000-41e1-84d2-154652004314 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:06.620293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88fdc3e9-5000-41e1-84d2-154652004314 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:06.626183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88fdc3e9-5000-41e1-84d2-154652004314 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:06.630570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fb140faf-a63b-49eb-8c09-88024be1601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:06.642673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb140faf-a63b-49eb-8c09-88024be1601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:06.643364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb140faf-a63b-49eb-8c09-88024be1601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:06.643993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb140faf-a63b-49eb-8c09-88024be1601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:06.987335 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fb140faf-a63b-49eb-8c09-88024be1601f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 0.608823 Oct 04 21:20:06.990013 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1546/3163] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:20:06 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:06.996744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-88fdc3e9-5000-41e1-84d2-154652004314 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:07.001226 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-88fdc3e9-5000-41e1-84d2-154652004314 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c" status: 200 len: 1474 microversion: 2.1 time: 0.406498 Oct 04 21:20:07.002093 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1618/3164] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:06 2022] GET /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c => generated 1474 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:07.021085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-52c06f86-1c66-46df-9de4-bf3337db9c5b tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:07.025958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:07.032915 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-52c06f86-1c66-46df-9de4-bf3337db9c5b tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017154 Oct 04 21:20:07.058060 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1547/3165] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:20:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:07.112862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-251bbc77-3603-4504-a591-2c30a51e41ba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:07.113844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-251bbc77-3603-4504-a591-2c30a51e41ba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:07.121332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-251bbc77-3603-4504-a591-2c30a51e41ba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:07.122232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-251bbc77-3603-4504-a591-2c30a51e41ba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:07.122864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-251bbc77-3603-4504-a591-2c30a51e41ba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:07.123895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-251bbc77-3603-4504-a591-2c30a51e41ba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:07.128798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-251bbc77-3603-4504-a591-2c30a51e41ba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:07.128798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-251bbc77-3603-4504-a591-2c30a51e41ba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:07.558791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9c4cac74-3948-4c4c-9d9e-7d32b31ea733 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:07.559303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9c4cac74-3948-4c4c-9d9e-7d32b31ea733 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:07.580269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c4cac74-3948-4c4c-9d9e-7d32b31ea733 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:07.581020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c4cac74-3948-4c4c-9d9e-7d32b31ea733 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:07.581704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c4cac74-3948-4c4c-9d9e-7d32b31ea733 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:07.582614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c4cac74-3948-4c4c-9d9e-7d32b31ea733 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:07.583249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c4cac74-3948-4c4c-9d9e-7d32b31ea733 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:07.583921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c4cac74-3948-4c4c-9d9e-7d32b31ea733 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:07.643486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9c4cac74-3948-4c4c-9d9e-7d32b31ea733 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:20:07.813814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-251bbc77-3603-4504-a591-2c30a51e41ba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:07.830301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-251bbc77-3603-4504-a591-2c30a51e41ba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:07.833881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-251bbc77-3603-4504-a591-2c30a51e41ba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:07.841489 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-251bbc77-3603-4504-a591-2c30a51e41ba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.739178 Oct 04 21:20:07.842751 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1619/3166] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:07 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:07.855345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-04354580-7b4f-4d5d-be47-8c8c40561b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:07.856164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-04354580-7b4f-4d5d-be47-8c8c40561b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:07.885838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04354580-7b4f-4d5d-be47-8c8c40561b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:07.887053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04354580-7b4f-4d5d-be47-8c8c40561b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:07.888657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04354580-7b4f-4d5d-be47-8c8c40561b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:07.890470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04354580-7b4f-4d5d-be47-8c8c40561b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:07.891176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04354580-7b4f-4d5d-be47-8c8c40561b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:07.893233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04354580-7b4f-4d5d-be47-8c8c40561b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:08.055161 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9c4cac74-3948-4c4c-9d9e-7d32b31ea733 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 204 len: 0 microversion: 2.1 time: 0.500053 Oct 04 21:20:08.056360 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1548/3167] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:20:07 2022] DELETE /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:20:08.063192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e9fc718f-5a32-4d46-b729-33ef29f82012 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:08.064628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e9fc718f-5a32-4d46-b729-33ef29f82012 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 142c6da5-e828-4e2b-bfef-0cf163f0c97c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:08.080707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9fc718f-5a32-4d46-b729-33ef29f82012 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:08.081212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9fc718f-5a32-4d46-b729-33ef29f82012 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:08.083551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9fc718f-5a32-4d46-b729-33ef29f82012 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:08.084297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9fc718f-5a32-4d46-b729-33ef29f82012 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:08.084864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9fc718f-5a32-4d46-b729-33ef29f82012 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:08.088775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9fc718f-5a32-4d46-b729-33ef29f82012 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:08.584940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-04354580-7b4f-4d5d-be47-8c8c40561b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:08.602833 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-04354580-7b4f-4d5d-be47-8c8c40561b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 200 len: 1518 microversion: 2.1 time: 0.758709 Oct 04 21:20:08.629664 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1620/3168] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:07 2022] GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 1518 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:08.642206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6b45d238-cf14-4528-b287-10f91f2d3d1b tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:08.644610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6b45d238-cf14-4528-b287-10f91f2d3d1b tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:08.686353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b45d238-cf14-4528-b287-10f91f2d3d1b tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:08.687574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b45d238-cf14-4528-b287-10f91f2d3d1b tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:08.688654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b45d238-cf14-4528-b287-10f91f2d3d1b tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:08.695545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b45d238-cf14-4528-b287-10f91f2d3d1b tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:08.698093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b45d238-cf14-4528-b287-10f91f2d3d1b tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:08.699012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b45d238-cf14-4528-b287-10f91f2d3d1b tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:08.700438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e9fc718f-5a32-4d46-b729-33ef29f82012 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:08.712091 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e9fc718f-5a32-4d46-b729-33ef29f82012 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c" status: 200 len: 1474 microversion: 2.1 time: 0.652075 Oct 04 21:20:08.724145 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1549/3169] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:08 2022] GET /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c => generated 1474 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:08.729588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3a009cf3-d2c6-40d2-8b94-b174df7f810a tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Action: 'create', calling method: .version_select at 0x7f57905fce50>, body: {"pool": null} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:09.323757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6b45d238-cf14-4528-b287-10f91f2d3d1b tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:09.340201 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6b45d238-cf14-4528-b287-10f91f2d3d1b tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1712 microversion: 2.1 time: 0.708885 Oct 04 21:20:09.350296 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1621/3170] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:08 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1712 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:09.386812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-45eb4eaf-0275-44b6-ac7b-f2cc239ffea7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:09.387481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-45eb4eaf-0275-44b6-ac7b-f2cc239ffea7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:09.402876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45eb4eaf-0275-44b6-ac7b-f2cc239ffea7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:09.404627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45eb4eaf-0275-44b6-ac7b-f2cc239ffea7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:09.405085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45eb4eaf-0275-44b6-ac7b-f2cc239ffea7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:09.405850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45eb4eaf-0275-44b6-ac7b-f2cc239ffea7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:09.406309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45eb4eaf-0275-44b6-ac7b-f2cc239ffea7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:09.410573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45eb4eaf-0275-44b6-ac7b-f2cc239ffea7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:10.087655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-45eb4eaf-0275-44b6-ac7b-f2cc239ffea7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:10.133129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-45eb4eaf-0275-44b6-ac7b-f2cc239ffea7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:10.135075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-45eb4eaf-0275-44b6-ac7b-f2cc239ffea7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:10.144017 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-45eb4eaf-0275-44b6-ac7b-f2cc239ffea7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.773354 Oct 04 21:20:10.144791 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1622/3171] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:09 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:10.155583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-2de7d3c8-d999-4323-8668-d04370d23850 req-a0111040-2e2d-4317-a1f2-08466ac12e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "142c6da5-e828-4e2b-bfef-0cf163f0c97c", "name": "network-vif-deleted", "tag": "35ab7e07-58e9-4ae2-bb54-f90bc14398d7"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:10.176816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2de7d3c8-d999-4323-8668-d04370d23850 req-a0111040-2e2d-4317-a1f2-08466ac12e2c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:10.177303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2de7d3c8-d999-4323-8668-d04370d23850 req-a0111040-2e2d-4317-a1f2-08466ac12e2c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:10.177867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2de7d3c8-d999-4323-8668-d04370d23850 req-a0111040-2e2d-4317-a1f2-08466ac12e2c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:10.190803 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-2de7d3c8-d999-4323-8668-d04370d23850 req-a0111040-2e2d-4317-a1f2-08466ac12e2c service nova] Creating event network-vif-deleted:35ab7e07-58e9-4ae2-bb54-f90bc14398d7 for instance 142c6da5-e828-4e2b-bfef-0cf163f0c97c on n-h1-860282-1 Oct 04 21:20:10.198801 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-2de7d3c8-d999-4323-8668-d04370d23850 req-a0111040-2e2d-4317-a1f2-08466ac12e2c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052381 Oct 04 21:20:10.199691 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1623/3172] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:10.207685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2569f4aa-799d-45b2-a73c-c40c6065a321 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:10.209652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2569f4aa-799d-45b2-a73c-c40c6065a321 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 142c6da5-e828-4e2b-bfef-0cf163f0c97c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:10.217519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2569f4aa-799d-45b2-a73c-c40c6065a321 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:10.218357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2569f4aa-799d-45b2-a73c-c40c6065a321 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:10.221578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2569f4aa-799d-45b2-a73c-c40c6065a321 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:10.221578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2569f4aa-799d-45b2-a73c-c40c6065a321 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:10.221578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2569f4aa-799d-45b2-a73c-c40c6065a321 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:10.221578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2569f4aa-799d-45b2-a73c-c40c6065a321 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:10.268553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2569f4aa-799d-45b2-a73c-c40c6065a321 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:10.269498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2569f4aa-799d-45b2-a73c-c40c6065a321 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:10.270115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2569f4aa-799d-45b2-a73c-c40c6065a321 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:10.270907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-2569f4aa-799d-45b2-a73c-c40c6065a321 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lazy-loading 'fault' on Instance uuid 142c6da5-e828-4e2b-bfef-0cf163f0c97c {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:20:10.661898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2569f4aa-799d-45b2-a73c-c40c6065a321 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac8933397749519514b18d174a2f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd842ce8242b749d6b95ede68c12185ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:10.673042 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2569f4aa-799d-45b2-a73c-c40c6065a321 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c" status: 200 len: 1308 microversion: 2.1 time: 0.471438 Oct 04 21:20:10.683643 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1624/3173] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:10 2022] GET /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c => generated 1308 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:10.695088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-53f98a07-9106-4090-9c9b-8b6e4bde3c23 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:10.696567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-53f98a07-9106-4090-9c9b-8b6e4bde3c23 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:10.705943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53f98a07-9106-4090-9c9b-8b6e4bde3c23 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:10.706768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53f98a07-9106-4090-9c9b-8b6e4bde3c23 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:10.707468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53f98a07-9106-4090-9c9b-8b6e4bde3c23 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:10.708306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53f98a07-9106-4090-9c9b-8b6e4bde3c23 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:10.709322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53f98a07-9106-4090-9c9b-8b6e4bde3c23 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:10.709865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53f98a07-9106-4090-9c9b-8b6e4bde3c23 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:11.230449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-53f98a07-9106-4090-9c9b-8b6e4bde3c23 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:11.241641 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-53f98a07-9106-4090-9c9b-8b6e4bde3c23 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1712 microversion: 2.1 time: 0.556002 Oct 04 21:20:11.243089 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1625/3174] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:10 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1712 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:11.248509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-ebf0d898-bfa4-4d63-bd48-a58470e90fa3 req-a649e22c-1b1f-4163-b92f-2e7f59327ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba61f85c-a75d-451d-a5f7-f9533481c406", "name": "network-vif-plugged", "status": "completed", "tag": "34504880-4c91-4512-980a-45596f508743"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:11.261295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ebf0d898-bfa4-4d63-bd48-a58470e90fa3 req-a649e22c-1b1f-4163-b92f-2e7f59327ae5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:11.262961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ebf0d898-bfa4-4d63-bd48-a58470e90fa3 req-a649e22c-1b1f-4163-b92f-2e7f59327ae5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:11.262961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ebf0d898-bfa4-4d63-bd48-a58470e90fa3 req-a649e22c-1b1f-4163-b92f-2e7f59327ae5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:11.276586 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-ebf0d898-bfa4-4d63-bd48-a58470e90fa3 req-a649e22c-1b1f-4163-b92f-2e7f59327ae5 service nova] Creating event network-vif-plugged:34504880-4c91-4512-980a-45596f508743 for instance ba61f85c-a75d-451d-a5f7-f9533481c406 on n-h2-860282-1 Oct 04 21:20:11.282055 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-ebf0d898-bfa4-4d63-bd48-a58470e90fa3 req-a649e22c-1b1f-4163-b92f-2e7f59327ae5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037248 Oct 04 21:20:11.283232 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1626/3175] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:11.292667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-67b9f4eb-dcd6-486a-9aa1-4fdfde7ca9a9 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:11.293856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-67b9f4eb-dcd6-486a-9aa1-4fdfde7ca9a9 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:11.304997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67b9f4eb-dcd6-486a-9aa1-4fdfde7ca9a9 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:11.305993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67b9f4eb-dcd6-486a-9aa1-4fdfde7ca9a9 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:11.306594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67b9f4eb-dcd6-486a-9aa1-4fdfde7ca9a9 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:11.308596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67b9f4eb-dcd6-486a-9aa1-4fdfde7ca9a9 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:11.309076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67b9f4eb-dcd6-486a-9aa1-4fdfde7ca9a9 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:11.309653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67b9f4eb-dcd6-486a-9aa1-4fdfde7ca9a9 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:11.883345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67b9f4eb-dcd6-486a-9aa1-4fdfde7ca9a9 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:11.931963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67b9f4eb-dcd6-486a-9aa1-4fdfde7ca9a9 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:11.946384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67b9f4eb-dcd6-486a-9aa1-4fdfde7ca9a9 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:11.948490 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-67b9f4eb-dcd6-486a-9aa1-4fdfde7ca9a9 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.663862 Oct 04 21:20:11.953568 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1627/3176] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:11 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:11.967996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2ff2e4f8-2cab-4477-bab3-86c293ce722f tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:11.971125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2ff2e4f8-2cab-4477-bab3-86c293ce722f tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] [instance: 142c6da5-e828-4e2b-bfef-0cf163f0c97c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:12.014316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ff2e4f8-2cab-4477-bab3-86c293ce722f tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:12.021597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ff2e4f8-2cab-4477-bab3-86c293ce722f tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:12.021597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ff2e4f8-2cab-4477-bab3-86c293ce722f tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:12.021597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ff2e4f8-2cab-4477-bab3-86c293ce722f tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:12.023253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ff2e4f8-2cab-4477-bab3-86c293ce722f tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:12.023853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ff2e4f8-2cab-4477-bab3-86c293ce722f tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:12.065539 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-2ff2e4f8-2cab-4477-bab3-86c293ce722f tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] HTTP exception thrown: Instance 142c6da5-e828-4e2b-bfef-0cf163f0c97c could not be found. Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2ff2e4f8-2cab-4477-bab3-86c293ce722f tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Request method failure captured: Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c HTTP/1.1 Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKLXvl5O_TBOVn-Zk6OWE4vMdqrotl3SdwgRqY6lkLDo8h19tqsf-1zsYlTZ8w7CLefkdiEjVtdzVaMjy69OX538HcvWf-2HkRgRUe_dBnlYDokRKy_QZUHphZDaDIVq0Wcjeh08ZXcLdxE4KLHq0Tvq1oJidJxWDerPLFyYqdAo-wU Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: d842ce8242b749d6b95ede68c12185ff Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ListImageFiltersTestJSON-1871029503 Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d842ce8242b749d6b95ede68c12185ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d842ce8242b749d6b95ede68c12185ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d842ce8242b749d6b95ede68c12185ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d842ce8242b749d6b95ede68c12185ff"}]}] Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ListImageFiltersTestJSON-1871029503 Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: d842ce8242b749d6b95ede68c12185ff Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1871029503 Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ListImageFiltersTestJSON-1871029503-project Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 9eac8933397749519514b18d174a2f0f Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ListImageFiltersTestJSON-1871029503-project Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 142c6da5-e828-4e2b-bfef-0cf163f0c97c could not be found. Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '142c6da5-e828-4e2b-bfef-0cf163f0c97c'} Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 142c6da5-e828-4e2b-bfef-0cf163f0c97c could not be found. Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 142c6da5-e828-4e2b-bfef-0cf163f0c97c could not be found. Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:12.072792 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:20:12.079300 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:12.079300 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:12.079300 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:12.079300 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:20:12.079300 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:20:12.079300 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 142c6da5-e828-4e2b-bfef-0cf163f0c97c could not be found. Oct 04 21:20:12.079300 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:20:12.079300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2ff2e4f8-2cab-4477-bab3-86c293ce722f tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Returning 404 to user: Instance 142c6da5-e828-4e2b-bfef-0cf163f0c97c could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:20:12.079300 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2ff2e4f8-2cab-4477-bab3-86c293ce722f tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "GET /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c" status: 404 len: 111 microversion: 2.1 time: 0.117638 Oct 04 21:20:12.079300 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1628/3177] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:11 2022] GET /compute/v2.1/servers/142c6da5-e828-4e2b-bfef-0cf163f0c97c => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:20:12.088044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ff449d35-ade0-4ea7-a7c7-ec63906cf050 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f5790bbf3a0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:13.296319 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ff449d35-ade0-4ea7-a7c7-ec63906cf050 tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "DELETE /compute/v2.1/images/a2ed38a8-233f-4109-bda3-ec7e6a668bfb" status: 204 len: 0 microversion: 2.1 time: 1.212032 Oct 04 21:20:13.296953 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1629/3178] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:12 2022] DELETE /compute/v2.1/images/a2ed38a8-233f-4109-bda3-ec7e6a668bfb => generated 0 bytes in 1213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:20:13.318803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-25a21c09-1c72-45fb-a563-2d6a8afe3b0e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:13.319930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-25a21c09-1c72-45fb-a563-2d6a8afe3b0e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:13.370180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25a21c09-1c72-45fb-a563-2d6a8afe3b0e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:13.371827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25a21c09-1c72-45fb-a563-2d6a8afe3b0e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:13.373001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25a21c09-1c72-45fb-a563-2d6a8afe3b0e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:13.374785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25a21c09-1c72-45fb-a563-2d6a8afe3b0e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:13.376553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25a21c09-1c72-45fb-a563-2d6a8afe3b0e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:13.378680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25a21c09-1c72-45fb-a563-2d6a8afe3b0e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:13.592267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-25a21c09-1c72-45fb-a563-2d6a8afe3b0e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:13.611037 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-25a21c09-1c72-45fb-a563-2d6a8afe3b0e tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1645 microversion: 2.1 time: 0.309501 Oct 04 21:20:13.612495 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1630/3179] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:13 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1645 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:13.621105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-51608b00-0ee5-41ad-9bdf-063703941bcc tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:13.627742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-51608b00-0ee5-41ad-9bdf-063703941bcc tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:13.645112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51608b00-0ee5-41ad-9bdf-063703941bcc tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:13.669324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51608b00-0ee5-41ad-9bdf-063703941bcc tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:13.670744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51608b00-0ee5-41ad-9bdf-063703941bcc tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:13.679852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51608b00-0ee5-41ad-9bdf-063703941bcc tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:13.679852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51608b00-0ee5-41ad-9bdf-063703941bcc tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:13.679852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51608b00-0ee5-41ad-9bdf-063703941bcc tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:14.490683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-51608b00-0ee5-41ad-9bdf-063703941bcc tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:14.509584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-51608b00-0ee5-41ad-9bdf-063703941bcc tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:14.514500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-51608b00-0ee5-41ad-9bdf-063703941bcc tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:14.516185 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-51608b00-0ee5-41ad-9bdf-063703941bcc tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.902282 Oct 04 21:20:14.521586 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1631/3180] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:13 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:14.532871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-c59a8e82-27be-4c67-89e2-e8113f3d9292 req-adfd55c2-b512-4e27-b08d-19a5ff7e7f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd8a0d92-6584-4dc6-b2d1-b1227a77f314", "name": "network-vif-unplugged", "status": "completed", "tag": "78a64cea-abc0-483b-8a8a-c375cb239a62"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:14.551999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c59a8e82-27be-4c67-89e2-e8113f3d9292 req-adfd55c2-b512-4e27-b08d-19a5ff7e7f4d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:14.554084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c59a8e82-27be-4c67-89e2-e8113f3d9292 req-adfd55c2-b512-4e27-b08d-19a5ff7e7f4d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:14.555596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c59a8e82-27be-4c67-89e2-e8113f3d9292 req-adfd55c2-b512-4e27-b08d-19a5ff7e7f4d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:14.586349 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-c59a8e82-27be-4c67-89e2-e8113f3d9292 req-adfd55c2-b512-4e27-b08d-19a5ff7e7f4d service nova] Creating event network-vif-unplugged:78a64cea-abc0-483b-8a8a-c375cb239a62 for instance fd8a0d92-6584-4dc6-b2d1-b1227a77f314 on n-h2-860282-1 Oct 04 21:20:14.602292 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-c59a8e82-27be-4c67-89e2-e8113f3d9292 req-adfd55c2-b512-4e27-b08d-19a5ff7e7f4d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081095 Oct 04 21:20:14.603456 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1632/3181] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:14.613576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ed2bab48-52d9-44b7-b9f8-bfa0c6c7313c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f578bc5ba60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:14.769286 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3a009cf3-d2c6-40d2-8b94-b174df7f810a tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.043946 Oct 04 21:20:14.770525 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1550/3182] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Oct 4 21:20:08 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:14.795600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-872a335d-b8e6-498b-881b-825c8d4e2caa req-89f4c45a-e5cf-41ed-99e2-c8a08956c1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd8a0d92-6584-4dc6-b2d1-b1227a77f314", "name": "network-vif-deleted", "tag": "78a64cea-abc0-483b-8a8a-c375cb239a62"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:14.846044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-872a335d-b8e6-498b-881b-825c8d4e2caa req-89f4c45a-e5cf-41ed-99e2-c8a08956c1e9 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:14.848391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-872a335d-b8e6-498b-881b-825c8d4e2caa req-89f4c45a-e5cf-41ed-99e2-c8a08956c1e9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:14.849019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-872a335d-b8e6-498b-881b-825c8d4e2caa req-89f4c45a-e5cf-41ed-99e2-c8a08956c1e9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:14.891359 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-872a335d-b8e6-498b-881b-825c8d4e2caa req-89f4c45a-e5cf-41ed-99e2-c8a08956c1e9 service nova] Creating event network-vif-deleted:78a64cea-abc0-483b-8a8a-c375cb239a62 for instance fd8a0d92-6584-4dc6-b2d1-b1227a77f314 on n-h2-860282-1 Oct 04 21:20:14.918448 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-872a335d-b8e6-498b-881b-825c8d4e2caa req-89f4c45a-e5cf-41ed-99e2-c8a08956c1e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142163 Oct 04 21:20:14.925613 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1551/3183] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:14.943047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-482c9b2d-c431-45be-acb6-cf3993658ecb tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:14.948351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-482c9b2d-c431-45be-acb6-cf3993658ecb tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:14.964382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-482c9b2d-c431-45be-acb6-cf3993658ecb tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:14.965196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-482c9b2d-c431-45be-acb6-cf3993658ecb tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:14.965846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-482c9b2d-c431-45be-acb6-cf3993658ecb tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:14.967570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-482c9b2d-c431-45be-acb6-cf3993658ecb tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:14.969534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-482c9b2d-c431-45be-acb6-cf3993658ecb tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:14.975129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-482c9b2d-c431-45be-acb6-cf3993658ecb tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:15.077440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-482c9b2d-c431-45be-acb6-cf3993658ecb tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:15.082131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-482c9b2d-c431-45be-acb6-cf3993658ecb tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:15.082987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-482c9b2d-c431-45be-acb6-cf3993658ecb tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:15.083631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-482c9b2d-c431-45be-acb6-cf3993658ecb tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lazy-loading 'fault' on Instance uuid fd8a0d92-6584-4dc6-b2d1-b1227a77f314 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:20:15.149605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-482c9b2d-c431-45be-acb6-cf3993658ecb tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e19408ca34ec8bcc8debc25e0c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2872ff08634cefa086fcc132b3a6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:15.170641 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-482c9b2d-c431-45be-acb6-cf3993658ecb tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 200 len: 1366 microversion: 2.1 time: 0.244271 Oct 04 21:20:15.177076 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1552/3184] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:14 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:15.232111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c0bca1e1-15c7-4708-9312-8ba045e04f9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-55745569", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "91b9f9a5-3b10-4582-a6c4-fb08af7ca69c"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:15.955546 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ed2bab48-52d9-44b7-b9f8-bfa0c6c7313c tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "DELETE /compute/v2.1/images/4f26fbcc-aeb2-4ce6-a000-f1e17969b520" status: 204 len: 0 microversion: 2.1 time: 1.345927 Oct 04 21:20:15.955546 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1633/3185] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:14 2022] DELETE /compute/v2.1/images/4f26fbcc-aeb2-4ce6-a000-f1e17969b520 => generated 0 bytes in 1347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:20:15.968142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-867ab7bb-7089-4377-9f98-53e3a7995e05 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:15.968832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-867ab7bb-7089-4377-9f98-53e3a7995e05 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:15.999011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-867ab7bb-7089-4377-9f98-53e3a7995e05 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:15.999519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-867ab7bb-7089-4377-9f98-53e3a7995e05 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:16.002176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-867ab7bb-7089-4377-9f98-53e3a7995e05 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:16.003542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-867ab7bb-7089-4377-9f98-53e3a7995e05 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:16.004767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-867ab7bb-7089-4377-9f98-53e3a7995e05 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:16.005218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-867ab7bb-7089-4377-9f98-53e3a7995e05 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:16.090251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-c0bca1e1-15c7-4708-9312-8ba045e04f9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] validate_networks() for [('91b9f9a5-3b10-4582-a6c4-fb08af7ca69c', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:20:16.431663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:16.621876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:17.060749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-867ab7bb-7089-4377-9f98-53e3a7995e05 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:17.110234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-867ab7bb-7089-4377-9f98-53e3a7995e05 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:17.112946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-867ab7bb-7089-4377-9f98-53e3a7995e05 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:17.118102 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-867ab7bb-7089-4377-9f98-53e3a7995e05 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 1.163613 Oct 04 21:20:17.127974 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1634/3186] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:15 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:17.150401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-516432a2-c0de-4006-b5ba-a7d34942b0cb tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] Calling method '.version_select at 0x7f57909b95e0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:17.640313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-c0bca1e1-15c7-4708-9312-8ba045e04f9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:20:17.640906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-c0bca1e1-15c7-4708-9312-8ba045e04f9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:20:17.641554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-c0bca1e1-15c7-4708-9312-8ba045e04f9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:20:17.641982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-c0bca1e1-15c7-4708-9312-8ba045e04f9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:20:17.642403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-c0bca1e1-15c7-4708-9312-8ba045e04f9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:20:17.657096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0bca1e1-15c7-4708-9312-8ba045e04f9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:17.663591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0bca1e1-15c7-4708-9312-8ba045e04f9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:17.664220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0bca1e1-15c7-4708-9312-8ba045e04f9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:17.665242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0bca1e1-15c7-4708-9312-8ba045e04f9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:17.669694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0bca1e1-15c7-4708-9312-8ba045e04f9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:17.670500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0bca1e1-15c7-4708-9312-8ba045e04f9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:17.707039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-c0bca1e1-15c7-4708-9312-8ba045e04f9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Getting quotas for project fbb2758d2dc64f70934d8161bf600f94. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:17.716715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-c0bca1e1-15c7-4708-9312-8ba045e04f9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Getting quotas for user 1b329e207cac4d459d25623d6554f444 and project fbb2758d2dc64f70934d8161bf600f94. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:17.736555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c0bca1e1-15c7-4708-9312-8ba045e04f9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:20:17.742952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c0bca1e1-15c7-4708-9312-8ba045e04f9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:20:18.096444 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c0bca1e1-15c7-4708-9312-8ba045e04f9f tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.866559 Oct 04 21:20:18.106268 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1553/3187] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:20:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:20:18.111932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a8739e14-656a-4809-8382-8e09ad66af10 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:18.113505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a8739e14-656a-4809-8382-8e09ad66af10 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] [instance: fd8a0d92-6584-4dc6-b2d1-b1227a77f314] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:18.146642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8739e14-656a-4809-8382-8e09ad66af10 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:18.150079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8739e14-656a-4809-8382-8e09ad66af10 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:18.153229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8739e14-656a-4809-8382-8e09ad66af10 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:18.154205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8739e14-656a-4809-8382-8e09ad66af10 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:18.159467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8739e14-656a-4809-8382-8e09ad66af10 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:18.161755 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8739e14-656a-4809-8382-8e09ad66af10 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:18.212261 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-a8739e14-656a-4809-8382-8e09ad66af10 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] HTTP exception thrown: Instance fd8a0d92-6584-4dc6-b2d1-b1227a77f314 could not be found. Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a8739e14-656a-4809-8382-8e09ad66af10 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Request method failure captured: Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 HTTP/1.1 Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKM4fW8AR5Q3a2DyC_k9GNQ3c3sCF6tXcQrT6CfHAP5Clp-GBQY5EdmcovQ2RA6JZZ3VFJflc6U7-sSiGO2CdP3mKaPvJSRLFsewd7Ix4Goi70_zNen0c1tHQome4NJrOJp_crQsFUrDqQJefkM9F2DiHpVkXM5HjwbrTMu1gTzdvRk Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 9e2872ff08634cefa086fcc132b3a6dc Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestManualDisk-1638621022 Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9e2872ff08634cefa086fcc132b3a6dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9e2872ff08634cefa086fcc132b3a6dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9e2872ff08634cefa086fcc132b3a6dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9e2872ff08634cefa086fcc132b3a6dc"}]}] Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestManualDisk-1638621022 Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 9e2872ff08634cefa086fcc132b3a6dc Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestManualDisk-1638621022 Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestManualDisk-1638621022-project Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 139e19408ca34ec8bcc8debc25e0c4bf Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestManualDisk-1638621022-project Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance fd8a0d92-6584-4dc6-b2d1-b1227a77f314 could not be found. Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'fd8a0d92-6584-4dc6-b2d1-b1227a77f314'} Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd8a0d92-6584-4dc6-b2d1-b1227a77f314 could not be found. Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd8a0d92-6584-4dc6-b2d1-b1227a77f314 could not be found. Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:18.243402 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:20:18.248342 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:18.248342 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:18.248342 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:18.248342 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:20:18.248342 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:20:18.248342 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd8a0d92-6584-4dc6-b2d1-b1227a77f314 could not be found. Oct 04 21:20:18.248342 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:20:18.263135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a8739e14-656a-4809-8382-8e09ad66af10 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Returning 404 to user: Instance fd8a0d92-6584-4dc6-b2d1-b1227a77f314 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:20:18.267338 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a8739e14-656a-4809-8382-8e09ad66af10 tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314" status: 404 len: 111 microversion: 2.1 time: 0.159633 Oct 04 21:20:18.271025 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1554/3188] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:18 2022] GET /compute/v2.1/servers/fd8a0d92-6584-4dc6-b2d1-b1227a77f314 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:20:18.286443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8a1341a1-7646-4145-b5fd-2a4d9bfbd0b8 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:18.296306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8a1341a1-7646-4145-b5fd-2a4d9bfbd0b8 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:18.579747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8a1341a1-7646-4145-b5fd-2a4d9bfbd0b8 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:18.593731 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8a1341a1-7646-4145-b5fd-2a4d9bfbd0b8 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc" status: 200 len: 1222 microversion: 2.1 time: 0.319636 Oct 04 21:20:18.594764 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1555/3189] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:18 2022] GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc => generated 1222 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:18.619869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c94bca13-24c9-423f-b177-25617601bca4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:18.620890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c94bca13-24c9-423f-b177-25617601bca4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:18.647746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c94bca13-24c9-423f-b177-25617601bca4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:18.648325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c94bca13-24c9-423f-b177-25617601bca4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:18.658951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c94bca13-24c9-423f-b177-25617601bca4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:18.673346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c94bca13-24c9-423f-b177-25617601bca4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:18.673682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c94bca13-24c9-423f-b177-25617601bca4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:18.674052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c94bca13-24c9-423f-b177-25617601bca4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:19.314867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c94bca13-24c9-423f-b177-25617601bca4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:19.322401 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-516432a2-c0de-4006-b5ba-a7d34942b0cb tempest-ListImageFiltersTestJSON-1871029503 tempest-ListImageFiltersTestJSON-1871029503-project] 10.222.0.30 "DELETE /compute/v2.1/images/53005761-2cf9-4d5e-b84c-599c173bd699" status: 204 len: 0 microversion: 2.1 time: 2.193005 Oct 04 21:20:19.323488 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1635/3190] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:17 2022] DELETE /compute/v2.1/images/53005761-2cf9-4d5e-b84c-599c173bd699 => generated 0 bytes in 2195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:20:19.332329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9680e169-5237-4cc3-a165-7ab083b3124f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] Calling method '.version_select at 0x7f578bc540d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:19.336851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c94bca13-24c9-423f-b177-25617601bca4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:19.340288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c94bca13-24c9-423f-b177-25617601bca4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:19.342123 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c94bca13-24c9-423f-b177-25617601bca4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.746251 Oct 04 21:20:19.343389 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1556/3191] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:18 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:19.491894 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9680e169-5237-4cc3-a165-7ab083b3124f tempest-ServersTestManualDisk-1638621022 tempest-ServersTestManualDisk-1638621022-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-528649268" status: 202 len: 0 microversion: 2.1 time: 0.164394 Oct 04 21:20:19.495784 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1636/3192] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Oct 4 21:20:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-528649268 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:20:19.632878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b6485912-613c-45db-9ef3-90e315471b58 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:19.634621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b6485912-613c-45db-9ef3-90e315471b58 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:19.838365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b6485912-613c-45db-9ef3-90e315471b58 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:19.863470 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b6485912-613c-45db-9ef3-90e315471b58 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc" status: 200 len: 1222 microversion: 2.1 time: 0.239113 Oct 04 21:20:19.871695 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1557/3193] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:19 2022] GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc => generated 1222 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:20.387871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-689b9eee-9723-4db8-a3e4-bcd491a5854e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:20.390511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-689b9eee-9723-4db8-a3e4-bcd491a5854e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:20.416054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-689b9eee-9723-4db8-a3e4-bcd491a5854e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:20.416737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-689b9eee-9723-4db8-a3e4-bcd491a5854e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:20.417270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-689b9eee-9723-4db8-a3e4-bcd491a5854e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:20.421735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-689b9eee-9723-4db8-a3e4-bcd491a5854e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:20.435774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-689b9eee-9723-4db8-a3e4-bcd491a5854e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:20.436632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-689b9eee-9723-4db8-a3e4-bcd491a5854e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:20.803421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-689b9eee-9723-4db8-a3e4-bcd491a5854e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:20.814203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-689b9eee-9723-4db8-a3e4-bcd491a5854e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:20.815681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-689b9eee-9723-4db8-a3e4-bcd491a5854e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:20.816851 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-689b9eee-9723-4db8-a3e4-bcd491a5854e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.444642 Oct 04 21:20:20.829384 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1637/3194] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:20 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:20.895158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-345ed643-3fa5-47b9-9d9f-9c088132a5b1 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:20.895674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-345ed643-3fa5-47b9-9d9f-9c088132a5b1 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:20.905394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-345ed643-3fa5-47b9-9d9f-9c088132a5b1 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:20.907660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-345ed643-3fa5-47b9-9d9f-9c088132a5b1 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:20.907660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-345ed643-3fa5-47b9-9d9f-9c088132a5b1 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:20.907660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-345ed643-3fa5-47b9-9d9f-9c088132a5b1 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:20.907660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-345ed643-3fa5-47b9-9d9f-9c088132a5b1 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:20.908069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-345ed643-3fa5-47b9-9d9f-9c088132a5b1 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:21.052034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-345ed643-3fa5-47b9-9d9f-9c088132a5b1 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:21.064734 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-345ed643-3fa5-47b9-9d9f-9c088132a5b1 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc" status: 200 len: 1274 microversion: 2.1 time: 0.174505 Oct 04 21:20:21.067413 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1638/3195] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:20 2022] GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:21.489732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0b9f1ac7-9176-4bd9-bccc-7e3083577292 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1276313742", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "d15fff2f-396c-4815-a2df-1609fdfbf550"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:21.636550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-0b9f1ac7-9176-4bd9-bccc-7e3083577292 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] validate_networks() for [('d15fff2f-396c-4815-a2df-1609fdfbf550', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:20:21.858815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6114181d-f630-497d-b230-ed2bb5d18217 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:21.868841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6114181d-f630-497d-b230-ed2bb5d18217 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:21.930508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6114181d-f630-497d-b230-ed2bb5d18217 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:21.938804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6114181d-f630-497d-b230-ed2bb5d18217 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:21.940934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6114181d-f630-497d-b230-ed2bb5d18217 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:21.944241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6114181d-f630-497d-b230-ed2bb5d18217 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:21.951045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6114181d-f630-497d-b230-ed2bb5d18217 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:21.951813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6114181d-f630-497d-b230-ed2bb5d18217 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:21.976721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:23.078124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6114181d-f630-497d-b230-ed2bb5d18217 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:23.128141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-0b9f1ac7-9176-4bd9-bccc-7e3083577292 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:20:23.128636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-0b9f1ac7-9176-4bd9-bccc-7e3083577292 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:20:23.128995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-0b9f1ac7-9176-4bd9-bccc-7e3083577292 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:20:23.129687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-0b9f1ac7-9176-4bd9-bccc-7e3083577292 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:20:23.130159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-0b9f1ac7-9176-4bd9-bccc-7e3083577292 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:20:23.140145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6114181d-f630-497d-b230-ed2bb5d18217 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:23.148974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6114181d-f630-497d-b230-ed2bb5d18217 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:23.153701 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6114181d-f630-497d-b230-ed2bb5d18217 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 1.309824 Oct 04 21:20:23.178808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b9f1ac7-9176-4bd9-bccc-7e3083577292 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:23.188715 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1639/3196] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:21 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:23.188955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b9f1ac7-9176-4bd9-bccc-7e3083577292 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:23.188955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b9f1ac7-9176-4bd9-bccc-7e3083577292 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:23.193856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b9f1ac7-9176-4bd9-bccc-7e3083577292 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:23.196400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b9f1ac7-9176-4bd9-bccc-7e3083577292 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:23.197347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b9f1ac7-9176-4bd9-bccc-7e3083577292 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:23.211791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c81e55cf-6b36-47f4-8057-80c983218fdb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:23.212424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c81e55cf-6b36-47f4-8057-80c983218fdb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:23.236380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c81e55cf-6b36-47f4-8057-80c983218fdb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:23.236380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c81e55cf-6b36-47f4-8057-80c983218fdb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:23.236380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c81e55cf-6b36-47f4-8057-80c983218fdb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:23.236380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c81e55cf-6b36-47f4-8057-80c983218fdb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:23.236380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c81e55cf-6b36-47f4-8057-80c983218fdb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:23.236380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c81e55cf-6b36-47f4-8057-80c983218fdb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:23.324347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-0b9f1ac7-9176-4bd9-bccc-7e3083577292 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Getting quotas for project 7d413fae6433451282e98d0deff85928. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:23.347624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-0b9f1ac7-9176-4bd9-bccc-7e3083577292 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Getting quotas for user 860b8f63588a4096838b363d1c12dfc6 and project 7d413fae6433451282e98d0deff85928. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:23.389205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0b9f1ac7-9176-4bd9-bccc-7e3083577292 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:20:23.397054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c81e55cf-6b36-47f4-8057-80c983218fdb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:23.400150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0b9f1ac7-9176-4bd9-bccc-7e3083577292 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:20:23.408614 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c81e55cf-6b36-47f4-8057-80c983218fdb tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc" status: 200 len: 1280 microversion: 2.1 time: 0.222511 Oct 04 21:20:23.428875 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1640/3197] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:23 2022] GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc => generated 1280 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:23.441962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-65688ec2-da86-40e0-a96a-03bf445843fb req-8d2f54a7-51c6-4469-80db-207f1942522c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "name": "network-vif-plugged", "status": "completed", "tag": "39ddb102-5195-44fc-a97d-9cec4b059f51"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:23.471030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-65688ec2-da86-40e0-a96a-03bf445843fb req-8d2f54a7-51c6-4469-80db-207f1942522c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:23.471030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-65688ec2-da86-40e0-a96a-03bf445843fb req-8d2f54a7-51c6-4469-80db-207f1942522c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:23.471030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-65688ec2-da86-40e0-a96a-03bf445843fb req-8d2f54a7-51c6-4469-80db-207f1942522c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:23.493465 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-65688ec2-da86-40e0-a96a-03bf445843fb req-8d2f54a7-51c6-4469-80db-207f1942522c service nova] Creating event network-vif-plugged:39ddb102-5195-44fc-a97d-9cec4b059f51 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:20:23.503507 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-65688ec2-da86-40e0-a96a-03bf445843fb req-8d2f54a7-51c6-4469-80db-207f1942522c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064606 Oct 04 21:20:23.506582 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1641/3198] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:23.735857 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0b9f1ac7-9176-4bd9-bccc-7e3083577292 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.108321 Oct 04 21:20:23.743925 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1558/3199] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Oct 4 21:20:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3118 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:20:23.752581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9947ca4f-450c-45d7-a677-25a199e65eea tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:23.753313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9947ca4f-450c-45d7-a677-25a199e65eea tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:24.192645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4116d214-21af-4477-a7ee-c565ea525447 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:24.200076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4116d214-21af-4477-a7ee-c565ea525447 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:24.226233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4116d214-21af-4477-a7ee-c565ea525447 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:24.227711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4116d214-21af-4477-a7ee-c565ea525447 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:24.230301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4116d214-21af-4477-a7ee-c565ea525447 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:24.232389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4116d214-21af-4477-a7ee-c565ea525447 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:24.241907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4116d214-21af-4477-a7ee-c565ea525447 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:24.242789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4116d214-21af-4477-a7ee-c565ea525447 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:24.694417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9947ca4f-450c-45d7-a677-25a199e65eea tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:24.706550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9947ca4f-450c-45d7-a677-25a199e65eea tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:24.710223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9947ca4f-450c-45d7-a677-25a199e65eea tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:24.714425 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9947ca4f-450c-45d7-a677-25a199e65eea tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5" status: 200 len: 1259 microversion: 2.21 time: 0.970087 Oct 04 21:20:24.717808 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1642/3200] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:23 2022] GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 => generated 1259 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:20:24.738593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4f9aa358-47f9-4386-9ee2-63ad34e2037c tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:24.739435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4f9aa358-47f9-4386-9ee2-63ad34e2037c tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:24.749709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f9aa358-47f9-4386-9ee2-63ad34e2037c tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:24.749709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f9aa358-47f9-4386-9ee2-63ad34e2037c tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:24.749709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f9aa358-47f9-4386-9ee2-63ad34e2037c tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:24.754802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f9aa358-47f9-4386-9ee2-63ad34e2037c tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:24.755562 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f9aa358-47f9-4386-9ee2-63ad34e2037c tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:24.758027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f9aa358-47f9-4386-9ee2-63ad34e2037c tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:25.040369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4f9aa358-47f9-4386-9ee2-63ad34e2037c tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:25.056444 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4f9aa358-47f9-4386-9ee2-63ad34e2037c tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc" status: 200 len: 1280 microversion: 2.1 time: 0.337313 Oct 04 21:20:25.063025 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1643/3201] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:24 2022] GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc => generated 1280 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:25.094339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4116d214-21af-4477-a7ee-c565ea525447 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:25.110725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4116d214-21af-4477-a7ee-c565ea525447 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:25.112593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4116d214-21af-4477-a7ee-c565ea525447 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:25.115886 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4116d214-21af-4477-a7ee-c565ea525447 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.930010 Oct 04 21:20:25.120229 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1559/3202] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:24 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:25.612950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-eef00df3-4e19-4d82-85f2-cb7d33cc0701 req-2fa6972b-a750-4acf-a86d-46090210f91f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "name": "network-vif-plugged", "status": "completed", "tag": "59687d68-2ca3-4874-9671-aaaec5a44a09"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:25.653028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-eef00df3-4e19-4d82-85f2-cb7d33cc0701 req-2fa6972b-a750-4acf-a86d-46090210f91f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:25.657931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-eef00df3-4e19-4d82-85f2-cb7d33cc0701 req-2fa6972b-a750-4acf-a86d-46090210f91f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:25.658469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-eef00df3-4e19-4d82-85f2-cb7d33cc0701 req-2fa6972b-a750-4acf-a86d-46090210f91f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:25.713447 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-eef00df3-4e19-4d82-85f2-cb7d33cc0701 req-2fa6972b-a750-4acf-a86d-46090210f91f service nova] Creating event network-vif-plugged:59687d68-2ca3-4874-9671-aaaec5a44a09 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:20:25.744295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6563216d-3f82-46aa-892e-a554dfc41aac tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:25.744295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6563216d-3f82-46aa-892e-a554dfc41aac tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:25.775324 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-eef00df3-4e19-4d82-85f2-cb7d33cc0701 req-2fa6972b-a750-4acf-a86d-46090210f91f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166238 Oct 04 21:20:25.807056 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1644/3203] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:26.124269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6563216d-3f82-46aa-892e-a554dfc41aac tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:26.143211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6563216d-3f82-46aa-892e-a554dfc41aac tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:26.148348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6563216d-3f82-46aa-892e-a554dfc41aac tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:26.150125 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6563216d-3f82-46aa-892e-a554dfc41aac tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5" status: 200 len: 1259 microversion: 2.21 time: 0.411738 Oct 04 21:20:26.159516 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1560/3204] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:25 2022] GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 => generated 1259 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:20:26.217658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bb38190f-8178-4ae9-87b9-814af41c1aba tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:26.222240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bb38190f-8178-4ae9-87b9-814af41c1aba tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:26.239427 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb38190f-8178-4ae9-87b9-814af41c1aba tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:26.242362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb38190f-8178-4ae9-87b9-814af41c1aba tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:26.273439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb38190f-8178-4ae9-87b9-814af41c1aba tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:26.273439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb38190f-8178-4ae9-87b9-814af41c1aba tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:26.273439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb38190f-8178-4ae9-87b9-814af41c1aba tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:26.273439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb38190f-8178-4ae9-87b9-814af41c1aba tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:26.367741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0beb504c-80cc-4487-aa80-a3eb88821446 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Action: 'create', calling method: .version_select at 0x7f5790d953a0>, body: {"keypair": {"name": "tempest-keypair-1872513387", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPjhI+/iZTxYIMdlPNwXIoTbFcFwa10BA4lR+U7ZxY/Ia98lA4YSOVLYfTs36igmc7i7abtdTRl6Er5JqPunGPhLMIsamhYwYh4VEZNhmFoBNzzk0B20Tn9CMFP5lt11g=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:26.405458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-0beb504c-80cc-4487-aa80-a3eb88821446 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Getting quotas for project a95810b2ef85422f9f4003e2bffe3d22. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:26.427361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-0beb504c-80cc-4487-aa80-a3eb88821446 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Getting quotas for user 92e078970bc8426a868f5417ee728e95 and project a95810b2ef85422f9f4003e2bffe3d22. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:26.465208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:26.685454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bb38190f-8178-4ae9-87b9-814af41c1aba tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:26.701454 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bb38190f-8178-4ae9-87b9-814af41c1aba tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc" status: 200 len: 1322 microversion: 2.1 time: 0.540290 Oct 04 21:20:26.702425 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1561/3205] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:26 2022] GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc => generated 1322 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:26.708005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-79cf2598-af84-49f2-9f76-4f28189d0738 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:26.709061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-79cf2598-af84-49f2-9f76-4f28189d0738 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:26.716378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79cf2598-af84-49f2-9f76-4f28189d0738 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:26.716859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79cf2598-af84-49f2-9f76-4f28189d0738 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:26.718137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79cf2598-af84-49f2-9f76-4f28189d0738 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:26.731142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79cf2598-af84-49f2-9f76-4f28189d0738 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:26.731142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79cf2598-af84-49f2-9f76-4f28189d0738 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:26.731142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79cf2598-af84-49f2-9f76-4f28189d0738 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:26.760373 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0beb504c-80cc-4487-aa80-a3eb88821446 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.793080 Oct 04 21:20:26.762423 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1645/3206] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:20:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:26.782727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0a9fe74f-4db7-44ac-a49e-7e867451bcdf tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Calling method '.version_select at 0x7f578bc54c10>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:26.799949 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0a9fe74f-4db7-44ac-a49e-7e867451bcdf tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-1872513387" status: 200 len: 498 microversion: 2.1 time: 0.032746 Oct 04 21:20:26.800866 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1646/3207] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Oct 4 21:20:26 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1872513387 => generated 498 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:26.822952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0b43cbf4-074b-413e-b917-ddbb51825e11 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Calling method '.version_select at 0x7f57906ae040>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:26.953214 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0b43cbf4-074b-413e-b917-ddbb51825e11 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1872513387" status: 202 len: 0 microversion: 2.1 time: 0.135430 Oct 04 21:20:26.953214 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1647/3208] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Oct 4 21:20:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1872513387 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:20:26.964101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c2cf0f18-e4ac-4ad6-b611-e53dcb57c958 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Action: 'create', calling method: .version_select at 0x7f578beb33a0>, body: {"keypair": {"name": "tempest-keypair-941960110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIQOA0f+w7PAbUEBTQ6EzkqmXxME4eG29SSIjdcvNPsNtFudL831+vc0pzuT+L5+v6o+OzV8JPL1C/Lxg87d6lLXAG3tFWTTK3zsRft5yfyGEkSNH96uoKqUK36PGlr8Q=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:27.025314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-c2cf0f18-e4ac-4ad6-b611-e53dcb57c958 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Getting quotas for project a95810b2ef85422f9f4003e2bffe3d22. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:27.078491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-c2cf0f18-e4ac-4ad6-b611-e53dcb57c958 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Getting quotas for user 92e078970bc8426a868f5417ee728e95 and project a95810b2ef85422f9f4003e2bffe3d22. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:27.236824 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c2cf0f18-e4ac-4ad6-b611-e53dcb57c958 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.276277 Oct 04 21:20:27.237873 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1648/3209] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:20:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:27.245143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4f358328-901c-4042-811a-b01089ceedc2 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:27.249644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4f358328-901c-4042-811a-b01089ceedc2 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:27.263834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f358328-901c-4042-811a-b01089ceedc2 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:27.265187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f358328-901c-4042-811a-b01089ceedc2 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:27.269779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f358328-901c-4042-811a-b01089ceedc2 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:27.272196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f358328-901c-4042-811a-b01089ceedc2 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:27.274035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f358328-901c-4042-811a-b01089ceedc2 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:27.286476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f358328-901c-4042-811a-b01089ceedc2 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:27.495460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4f358328-901c-4042-811a-b01089ceedc2 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:27.512588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4f358328-901c-4042-811a-b01089ceedc2 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:27.512588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4f358328-901c-4042-811a-b01089ceedc2 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:27.512588 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4f358328-901c-4042-811a-b01089ceedc2 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5" status: 200 len: 1255 microversion: 2.21 time: 0.271766 Oct 04 21:20:27.512588 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1649/3210] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:27 2022] GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 => generated 1255 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:27.517090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0617efdb-1b5e-4fc9-a4d2-f4b56509604a tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Calling method '.version_select at 0x7f57907c5160>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:27.530143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-79cf2598-af84-49f2-9f76-4f28189d0738 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:27.556649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-79cf2598-af84-49f2-9f76-4f28189d0738 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:27.568124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-79cf2598-af84-49f2-9f76-4f28189d0738 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:27.570105 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-79cf2598-af84-49f2-9f76-4f28189d0738 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.866030 Oct 04 21:20:27.571067 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1562/3211] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:26 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:27.664296 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0617efdb-1b5e-4fc9-a4d2-f4b56509604a tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-941960110" status: 202 len: 0 microversion: 2.1 time: 0.151402 Oct 04 21:20:27.665258 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1650/3212] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Oct 4 21:20:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-941960110 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:20:27.675810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-70c094b2-44dd-4a5b-bdbb-5725dfa5e7dc tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Action: 'create', calling method: .version_select at 0x7f578b74bf70>, body: {"keypair": {"name": "tempest-keypair-398975184", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:27.725263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b0563808-495a-434b-a202-f8db1eafc6c3 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:27.726130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b0563808-495a-434b-a202-f8db1eafc6c3 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:27.736927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-70c094b2-44dd-4a5b-bdbb-5725dfa5e7dc tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Getting quotas for project a95810b2ef85422f9f4003e2bffe3d22. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:27.750340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0563808-495a-434b-a202-f8db1eafc6c3 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:27.759161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0563808-495a-434b-a202-f8db1eafc6c3 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:27.764535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0563808-495a-434b-a202-f8db1eafc6c3 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:27.768306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0563808-495a-434b-a202-f8db1eafc6c3 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:27.769744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-70c094b2-44dd-4a5b-bdbb-5725dfa5e7dc tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Getting quotas for user 92e078970bc8426a868f5417ee728e95 and project a95810b2ef85422f9f4003e2bffe3d22. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:27.771624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0563808-495a-434b-a202-f8db1eafc6c3 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:27.772430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0563808-495a-434b-a202-f8db1eafc6c3 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:27.943360 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-70c094b2-44dd-4a5b-bdbb-5725dfa5e7dc tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.272702 Oct 04 21:20:27.945589 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1563/3213] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:20:27 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:27.964856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-ffdbde10-739c-4d63-8ae6-98a9e5dd18ff req-4a9ba2dd-22f7-48b1-b16f-e2a0f8c652a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "name": "network-vif-plugged", "status": "completed", "tag": "a8c25e3b-fbff-43dd-a188-c7127b5919b0"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:28.033321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ffdbde10-739c-4d63-8ae6-98a9e5dd18ff req-4a9ba2dd-22f7-48b1-b16f-e2a0f8c652a5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:28.034568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ffdbde10-739c-4d63-8ae6-98a9e5dd18ff req-4a9ba2dd-22f7-48b1-b16f-e2a0f8c652a5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:28.034698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ffdbde10-739c-4d63-8ae6-98a9e5dd18ff req-4a9ba2dd-22f7-48b1-b16f-e2a0f8c652a5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:28.083043 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-ffdbde10-739c-4d63-8ae6-98a9e5dd18ff req-4a9ba2dd-22f7-48b1-b16f-e2a0f8c652a5 service nova] Creating event network-vif-plugged:a8c25e3b-fbff-43dd-a188-c7127b5919b0 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:20:28.098221 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-ffdbde10-739c-4d63-8ae6-98a9e5dd18ff req-4a9ba2dd-22f7-48b1-b16f-e2a0f8c652a5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151154 Oct 04 21:20:28.099719 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1564/3214] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:28.114862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b38df7e5-b57f-4c5e-9ec9-67dc828fceda tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Calling method '.version_select at 0x7f578b780820>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:28.305678 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b38df7e5-b57f-4c5e-9ec9-67dc828fceda tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-398975184" status: 202 len: 0 microversion: 2.1 time: 0.204447 Oct 04 21:20:28.314628 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1565/3215] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Oct 4 21:20:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-398975184 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:20:28.322944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7384ba45-1b79-47c8-be8d-8259c6b54823 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Action: 'create', calling method: .version_select at 0x7f578b7e9940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-130466126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4rXCYB2yFFLHdZRYYgEMoFJ05zTJEPOcPScj0OVkSeSPKI9sUWdCQghrNLoaFHjSbpsQbVT6xTLVR7OOpBRp+7Ues27zjZXISyAwMxzYMRX/fauzygf2MUgRDCnI/wgw=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:28.383085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b0563808-495a-434b-a202-f8db1eafc6c3 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:28.393353 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b0563808-495a-434b-a202-f8db1eafc6c3 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc" status: 200 len: 1322 microversion: 2.1 time: 0.672863 Oct 04 21:20:28.408925 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1651/3216] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:27 2022] GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc => generated 1322 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:28.427343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-7384ba45-1b79-47c8-be8d-8259c6b54823 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Getting quotas for project a95810b2ef85422f9f4003e2bffe3d22. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:28.453269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-7384ba45-1b79-47c8-be8d-8259c6b54823 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Getting quotas for user 92e078970bc8426a868f5417ee728e95 and project a95810b2ef85422f9f4003e2bffe3d22. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:28.506611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:28.539611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6912d185-d386-4ef7-baab-1d99cab8bd5f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:28.540678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6912d185-d386-4ef7-baab-1d99cab8bd5f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:28.589302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6912d185-d386-4ef7-baab-1d99cab8bd5f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:28.599059 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7384ba45-1b79-47c8-be8d-8259c6b54823 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.280481 Oct 04 21:20:28.602342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6912d185-d386-4ef7-baab-1d99cab8bd5f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:28.607120 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1566/3217] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:20:28 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:20:28.607266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6912d185-d386-4ef7-baab-1d99cab8bd5f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:28.610107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6912d185-d386-4ef7-baab-1d99cab8bd5f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:28.610847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6912d185-d386-4ef7-baab-1d99cab8bd5f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:28.616575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6912d185-d386-4ef7-baab-1d99cab8bd5f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:28.637063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dc867b2c-5c1a-4722-9f94-cb8b271fcdba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:28.639911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dc867b2c-5c1a-4722-9f94-cb8b271fcdba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:28.667992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc867b2c-5c1a-4722-9f94-cb8b271fcdba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:28.669736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc867b2c-5c1a-4722-9f94-cb8b271fcdba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:28.671520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc867b2c-5c1a-4722-9f94-cb8b271fcdba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:28.672746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc867b2c-5c1a-4722-9f94-cb8b271fcdba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:28.675491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc867b2c-5c1a-4722-9f94-cb8b271fcdba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:28.678015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc867b2c-5c1a-4722-9f94-cb8b271fcdba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:29.472217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6912d185-d386-4ef7-baab-1d99cab8bd5f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:29.496405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6912d185-d386-4ef7-baab-1d99cab8bd5f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:29.507175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6912d185-d386-4ef7-baab-1d99cab8bd5f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:29.509273 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6912d185-d386-4ef7-baab-1d99cab8bd5f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5" status: 200 len: 1319 microversion: 2.21 time: 0.975131 Oct 04 21:20:29.515006 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1652/3218] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:28 2022] GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 => generated 1319 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:20:29.521132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fb6ef947-a5cc-4ece-8da5-817769f82b2f tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Action: 'create', calling method: .version_select at 0x7f578bc5ba60>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-540057206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6cHIBF4I+LezMY171R9Yj8neNRAV00pmLeb943tLV9aITj6sCT+u2OEo3H8hi4SzQxdVegmoHnRfmGsLqfnS45yVjGnoenfEWGdHoXEiY+yrbXTDlotPPs22RAo/g4AQ=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:29.539938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-fb6ef947-a5cc-4ece-8da5-817769f82b2f tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Getting quotas for project a95810b2ef85422f9f4003e2bffe3d22. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:29.552741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-fb6ef947-a5cc-4ece-8da5-817769f82b2f tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Getting quotas for user 92e078970bc8426a868f5417ee728e95 and project a95810b2ef85422f9f4003e2bffe3d22. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:29.702348 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fb6ef947-a5cc-4ece-8da5-817769f82b2f tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.184362 Oct 04 21:20:29.703759 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1653/3219] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:20:29 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:29.710603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-41185257-8844-4909-a53e-b95839c1490e req-750929fd-11e5-4e6e-ae5b-3a9aa08a3200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "319803c6-077c-4267-84e2-cb90f261aedc", "tag": "44d57a4f-f68d-4e25-9d73-71f36d48763b"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:29.757176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-41185257-8844-4909-a53e-b95839c1490e req-750929fd-11e5-4e6e-ae5b-3a9aa08a3200 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:29.757829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-41185257-8844-4909-a53e-b95839c1490e req-750929fd-11e5-4e6e-ae5b-3a9aa08a3200 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:29.760094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-41185257-8844-4909-a53e-b95839c1490e req-750929fd-11e5-4e6e-ae5b-3a9aa08a3200 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:29.824391 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-41185257-8844-4909-a53e-b95839c1490e req-750929fd-11e5-4e6e-ae5b-3a9aa08a3200 service nova] Creating event network-changed:44d57a4f-f68d-4e25-9d73-71f36d48763b for instance 319803c6-077c-4267-84e2-cb90f261aedc on n-h1-860282-1 Oct 04 21:20:29.846433 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-41185257-8844-4909-a53e-b95839c1490e req-750929fd-11e5-4e6e-ae5b-3a9aa08a3200 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141221 Oct 04 21:20:29.863219 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1654/3220] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:29.887179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-19e4733c-bef4-4366-9ec4-937d7bb18a00 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:29.889535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-19e4733c-bef4-4366-9ec4-937d7bb18a00 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:29.910812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19e4733c-bef4-4366-9ec4-937d7bb18a00 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:29.911780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19e4733c-bef4-4366-9ec4-937d7bb18a00 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:29.912922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19e4733c-bef4-4366-9ec4-937d7bb18a00 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:29.916097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19e4733c-bef4-4366-9ec4-937d7bb18a00 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:29.918126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19e4733c-bef4-4366-9ec4-937d7bb18a00 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:29.919075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19e4733c-bef4-4366-9ec4-937d7bb18a00 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:30.415999 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dc867b2c-5c1a-4722-9f94-cb8b271fcdba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:30.426275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:30.438668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dc867b2c-5c1a-4722-9f94-cb8b271fcdba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:30.440361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dc867b2c-5c1a-4722-9f94-cb8b271fcdba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:30.446646 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dc867b2c-5c1a-4722-9f94-cb8b271fcdba tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 1.840691 Oct 04 21:20:30.470481 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1567/3221] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:28 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:30.476013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2036bbd1-5f19-4b4e-9b26-4768a9a5eebd tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Action: 'create', calling method: .version_select at 0x7f578b74bc10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-462509108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkzFSvvB7E8TQ1MjnvKm+B2jC9mVgoOatmh7l+vDdiPdOsIlRDLEKNnlEuijmtgOiFEgKmoUzI1XMOsgM3UaIFjiqtuurMBOlCtGDHF9FM8soeMirUDYBH7eejOV2RHeQ=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:30.540469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-2036bbd1-5f19-4b4e-9b26-4768a9a5eebd tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Getting quotas for project a95810b2ef85422f9f4003e2bffe3d22. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:30.562845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-2036bbd1-5f19-4b4e-9b26-4768a9a5eebd tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Getting quotas for user 92e078970bc8426a868f5417ee728e95 and project a95810b2ef85422f9f4003e2bffe3d22. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:30.683575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-19e4733c-bef4-4366-9ec4-937d7bb18a00 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:30.698163 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-19e4733c-bef4-4366-9ec4-937d7bb18a00 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc" status: 200 len: 1322 microversion: 2.1 time: 0.829197 Oct 04 21:20:30.710559 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1655/3222] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:29 2022] GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc => generated 1322 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:30.726202 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2036bbd1-5f19-4b4e-9b26-4768a9a5eebd tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.244670 Oct 04 21:20:30.726202 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1568/3223] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:20:30 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:30.728088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-c09cbba0-9d48-47b9-b8a8-699d373002cb req-434123ec-7ac2-4b1c-a99e-a5ff31aa3e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "name": "network-vif-plugged", "status": "completed", "tag": "e340948f-c791-41cb-b34c-2658c4ccb363"}, {"server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "name": "network-vif-plugged", "status": "completed", "tag": "98058dbf-2515-40f7-b898-38ee0332974c"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:30.732995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-31b254ea-eb28-46b7-b1e4-3376b386b17f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:30.736677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-31b254ea-eb28-46b7-b1e4-3376b386b17f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:30.747544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c09cbba0-9d48-47b9-b8a8-699d373002cb req-434123ec-7ac2-4b1c-a99e-a5ff31aa3e6a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:30.748404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c09cbba0-9d48-47b9-b8a8-699d373002cb req-434123ec-7ac2-4b1c-a99e-a5ff31aa3e6a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:30.749113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c09cbba0-9d48-47b9-b8a8-699d373002cb req-434123ec-7ac2-4b1c-a99e-a5ff31aa3e6a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:30.759289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31b254ea-eb28-46b7-b1e4-3376b386b17f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:30.761800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31b254ea-eb28-46b7-b1e4-3376b386b17f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:30.762933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31b254ea-eb28-46b7-b1e4-3376b386b17f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:30.763752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31b254ea-eb28-46b7-b1e4-3376b386b17f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:30.766869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31b254ea-eb28-46b7-b1e4-3376b386b17f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:30.767367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31b254ea-eb28-46b7-b1e4-3376b386b17f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:30.771006 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-c09cbba0-9d48-47b9-b8a8-699d373002cb req-434123ec-7ac2-4b1c-a99e-a5ff31aa3e6a service nova] Creating event network-vif-plugged:e340948f-c791-41cb-b34c-2658c4ccb363 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:20:30.771599 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-c09cbba0-9d48-47b9-b8a8-699d373002cb req-434123ec-7ac2-4b1c-a99e-a5ff31aa3e6a service nova] Creating event network-vif-plugged:98058dbf-2515-40f7-b898-38ee0332974c for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:20:30.777312 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-c09cbba0-9d48-47b9-b8a8-699d373002cb req-434123ec-7ac2-4b1c-a99e-a5ff31aa3e6a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059554 Oct 04 21:20:30.778757 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1656/3224] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:30.786545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7269d056-0d1c-44e2-b477-8b5f7237c5b7 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Calling method '.version_select at 0x7f578beb3700>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:30.790944 n-d-860282-1 devstack@n-api.service[122758]: WARNING oslo_db.sqlalchemy.utils [None req-7269d056-0d1c-44e2-b477-8b5f7237c5b7 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 21:20:30.812215 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7269d056-0d1c-44e2-b477-8b5f7237c5b7 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.031992 Oct 04 21:20:30.819772 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1657/3225] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:20:30 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:30.824717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-47910736-2fcf-4a01-9c35-88b79e7c3be9 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Calling method '.version_select at 0x7f578bc5bb80>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:30.935611 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-47910736-2fcf-4a01-9c35-88b79e7c3be9 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-462509108" status: 202 len: 0 microversion: 2.1 time: 0.114642 Oct 04 21:20:30.936383 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1658/3226] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:20:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-462509108 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:20:30.945174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-138a2e33-6777-4338-a541-5471e633079a tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Calling method '.version_select at 0x7f578bc2b310>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:31.051142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-31b254ea-eb28-46b7-b1e4-3376b386b17f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:31.063412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-31b254ea-eb28-46b7-b1e4-3376b386b17f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:31.073681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-31b254ea-eb28-46b7-b1e4-3376b386b17f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:31.076006 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-31b254ea-eb28-46b7-b1e4-3376b386b17f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5" status: 200 len: 1317 microversion: 2.21 time: 0.353925 Oct 04 21:20:31.091452 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-138a2e33-6777-4338-a541-5471e633079a tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-540057206" status: 202 len: 0 microversion: 2.1 time: 0.149797 Oct 04 21:20:31.092045 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1659/3227] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:20:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-540057206 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:20:31.110045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-026178e0-521a-4863-a54e-ecd8731f0937 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] Calling method '.version_select at 0x7f578bc5bd30>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:31.117155 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1569/3228] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:30 2022] GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:31.263715 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-026178e0-521a-4863-a54e-ecd8731f0937 tempest-KeyPairsV2TestJSON-609481445 tempest-KeyPairsV2TestJSON-609481445-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-130466126" status: 202 len: 0 microversion: 2.1 time: 0.166474 Oct 04 21:20:31.264572 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1660/3229] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:20:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-130466126 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:20:31.479130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-02a02516-971f-448f-a644-044c46c430b6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:31.480639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-02a02516-971f-448f-a644-044c46c430b6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:31.519798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02a02516-971f-448f-a644-044c46c430b6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:31.521287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02a02516-971f-448f-a644-044c46c430b6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:31.522650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02a02516-971f-448f-a644-044c46c430b6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:31.524728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02a02516-971f-448f-a644-044c46c430b6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:31.526172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02a02516-971f-448f-a644-044c46c430b6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:31.526872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02a02516-971f-448f-a644-044c46c430b6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:31.732923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f680591a-f984-4393-9594-38df27ced378 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:31.735446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f680591a-f984-4393-9594-38df27ced378 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:31.747178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f680591a-f984-4393-9594-38df27ced378 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:31.753745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f680591a-f984-4393-9594-38df27ced378 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:31.760070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f680591a-f984-4393-9594-38df27ced378 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:31.770309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f680591a-f984-4393-9594-38df27ced378 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:31.773077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f680591a-f984-4393-9594-38df27ced378 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:31.791554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f680591a-f984-4393-9594-38df27ced378 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:31.960512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-02a02516-971f-448f-a644-044c46c430b6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:31.972293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-02a02516-971f-448f-a644-044c46c430b6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:31.985932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-02a02516-971f-448f-a644-044c46c430b6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:31.987205 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-02a02516-971f-448f-a644-044c46c430b6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.512355 Oct 04 21:20:32.017616 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1570/3230] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:31 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:32.107330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-86756f10-d3fc-4b4e-a8c5-6b3e475c6833 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:32.108707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-86756f10-d3fc-4b4e-a8c5-6b3e475c6833 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:32.119602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86756f10-d3fc-4b4e-a8c5-6b3e475c6833 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:32.124496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86756f10-d3fc-4b4e-a8c5-6b3e475c6833 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:32.127861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86756f10-d3fc-4b4e-a8c5-6b3e475c6833 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:32.133201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86756f10-d3fc-4b4e-a8c5-6b3e475c6833 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:32.133201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86756f10-d3fc-4b4e-a8c5-6b3e475c6833 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:32.133201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86756f10-d3fc-4b4e-a8c5-6b3e475c6833 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:32.383408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f680591a-f984-4393-9594-38df27ced378 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:32.398147 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f680591a-f984-4393-9594-38df27ced378 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc" status: 200 len: 1322 microversion: 2.1 time: 0.677139 Oct 04 21:20:32.399063 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1661/3231] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:31 2022] GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc => generated 1322 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:32.579893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-86756f10-d3fc-4b4e-a8c5-6b3e475c6833 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:32.597766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-86756f10-d3fc-4b4e-a8c5-6b3e475c6833 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:32.605117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-86756f10-d3fc-4b4e-a8c5-6b3e475c6833 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:32.606399 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-86756f10-d3fc-4b4e-a8c5-6b3e475c6833 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5" status: 200 len: 1359 microversion: 2.21 time: 0.503084 Oct 04 21:20:32.607400 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1571/3232] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:32 2022] GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 => generated 1359 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:20:33.030844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1f491e2b-a4e5-48f5-a924-d0a08f64bf13 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:33.032817 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1f491e2b-a4e5-48f5-a924-d0a08f64bf13 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:33.050167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f491e2b-a4e5-48f5-a924-d0a08f64bf13 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:33.050676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f491e2b-a4e5-48f5-a924-d0a08f64bf13 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:33.058907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f491e2b-a4e5-48f5-a924-d0a08f64bf13 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:33.062707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f491e2b-a4e5-48f5-a924-d0a08f64bf13 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:33.063547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f491e2b-a4e5-48f5-a924-d0a08f64bf13 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:33.065527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f491e2b-a4e5-48f5-a924-d0a08f64bf13 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:33.118208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-0821e47f-9d11-415e-bbd9-13894fd7acf6 req-ced34b4d-3451-441f-8640-9c507d280d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "name": "network-vif-plugged", "status": "completed", "tag": "a0d59a79-d95c-4b4b-b5be-713397dfdf42"}, {"server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "name": "network-vif-plugged", "status": "completed", "tag": "c9f0995e-f8e2-4b1b-83e4-2688e418b233"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:33.147953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0821e47f-9d11-415e-bbd9-13894fd7acf6 req-ced34b4d-3451-441f-8640-9c507d280d1f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:33.149037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0821e47f-9d11-415e-bbd9-13894fd7acf6 req-ced34b4d-3451-441f-8640-9c507d280d1f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:33.149861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0821e47f-9d11-415e-bbd9-13894fd7acf6 req-ced34b4d-3451-441f-8640-9c507d280d1f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:33.165000 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-0821e47f-9d11-415e-bbd9-13894fd7acf6 req-ced34b4d-3451-441f-8640-9c507d280d1f service nova] Creating event network-vif-plugged:a0d59a79-d95c-4b4b-b5be-713397dfdf42 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:20:33.166841 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-0821e47f-9d11-415e-bbd9-13894fd7acf6 req-ced34b4d-3451-441f-8640-9c507d280d1f service nova] Creating event network-vif-plugged:c9f0995e-f8e2-4b1b-83e4-2688e418b233 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:20:33.174501 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-0821e47f-9d11-415e-bbd9-13894fd7acf6 req-ced34b4d-3451-441f-8640-9c507d280d1f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060404 Oct 04 21:20:33.176128 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1572/3233] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:20:33.424804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-97eb0bd0-bb2a-4397-82fd-24c1d2ef8824 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:33.426123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-97eb0bd0-bb2a-4397-82fd-24c1d2ef8824 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:33.429452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:33.480979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97eb0bd0-bb2a-4397-82fd-24c1d2ef8824 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:33.486081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97eb0bd0-bb2a-4397-82fd-24c1d2ef8824 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:33.490981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97eb0bd0-bb2a-4397-82fd-24c1d2ef8824 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:33.500755 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97eb0bd0-bb2a-4397-82fd-24c1d2ef8824 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:33.505892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97eb0bd0-bb2a-4397-82fd-24c1d2ef8824 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:33.505892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97eb0bd0-bb2a-4397-82fd-24c1d2ef8824 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:33.570506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1f491e2b-a4e5-48f5-a924-d0a08f64bf13 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:33.605220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1f491e2b-a4e5-48f5-a924-d0a08f64bf13 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:33.609951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1f491e2b-a4e5-48f5-a924-d0a08f64bf13 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:33.609951 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1f491e2b-a4e5-48f5-a924-d0a08f64bf13 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.581369 Oct 04 21:20:33.609951 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1662/3234] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:33 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:33.649467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7536764e-eeac-40e9-80dd-303337f9c193 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:33.650120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7536764e-eeac-40e9-80dd-303337f9c193 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:33.657608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7536764e-eeac-40e9-80dd-303337f9c193 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:33.658135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7536764e-eeac-40e9-80dd-303337f9c193 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:33.658593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7536764e-eeac-40e9-80dd-303337f9c193 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:33.659346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7536764e-eeac-40e9-80dd-303337f9c193 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:33.662172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7536764e-eeac-40e9-80dd-303337f9c193 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:33.662865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7536764e-eeac-40e9-80dd-303337f9c193 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:34.459752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-97eb0bd0-bb2a-4397-82fd-24c1d2ef8824 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:34.473297 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-97eb0bd0-bb2a-4397-82fd-24c1d2ef8824 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc" status: 200 len: 1322 microversion: 2.1 time: 1.051702 Oct 04 21:20:34.474272 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1573/3235] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:33 2022] GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc => generated 1322 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:20:34.521072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7536764e-eeac-40e9-80dd-303337f9c193 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:34.535201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7536764e-eeac-40e9-80dd-303337f9c193 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:34.542265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7536764e-eeac-40e9-80dd-303337f9c193 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:34.549053 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7536764e-eeac-40e9-80dd-303337f9c193 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5" status: 200 len: 1359 microversion: 2.21 time: 0.912074 Oct 04 21:20:34.559534 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1663/3236] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:33 2022] GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 => generated 1359 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:34.642156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-db6341e4-8194-4070-b0f3-acae62742231 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:34.643240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-db6341e4-8194-4070-b0f3-acae62742231 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:34.654172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db6341e4-8194-4070-b0f3-acae62742231 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:34.654988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db6341e4-8194-4070-b0f3-acae62742231 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:34.655628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db6341e4-8194-4070-b0f3-acae62742231 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:34.657399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db6341e4-8194-4070-b0f3-acae62742231 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:34.658091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db6341e4-8194-4070-b0f3-acae62742231 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:34.658679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db6341e4-8194-4070-b0f3-acae62742231 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:35.127442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-db6341e4-8194-4070-b0f3-acae62742231 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:35.145885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-db6341e4-8194-4070-b0f3-acae62742231 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:35.147497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-db6341e4-8194-4070-b0f3-acae62742231 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:35.148725 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-db6341e4-8194-4070-b0f3-acae62742231 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 0.512353 Oct 04 21:20:35.149296 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1574/3237] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:34 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:35.499992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-17d10fc1-7c7e-43df-b658-7f781d2cf6aa tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:35.500881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-17d10fc1-7c7e-43df-b658-7f781d2cf6aa tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:35.508296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17d10fc1-7c7e-43df-b658-7f781d2cf6aa tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:35.509109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17d10fc1-7c7e-43df-b658-7f781d2cf6aa tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:35.509822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17d10fc1-7c7e-43df-b658-7f781d2cf6aa tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:35.510756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17d10fc1-7c7e-43df-b658-7f781d2cf6aa tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:35.511412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17d10fc1-7c7e-43df-b658-7f781d2cf6aa tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:35.511897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17d10fc1-7c7e-43df-b658-7f781d2cf6aa tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:35.586189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a84ea15c-1160-4dce-9435-5c46d90ae432 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:35.586821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a84ea15c-1160-4dce-9435-5c46d90ae432 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:35.592993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a84ea15c-1160-4dce-9435-5c46d90ae432 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:35.594304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a84ea15c-1160-4dce-9435-5c46d90ae432 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:35.594921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a84ea15c-1160-4dce-9435-5c46d90ae432 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:35.595798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a84ea15c-1160-4dce-9435-5c46d90ae432 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:35.596487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a84ea15c-1160-4dce-9435-5c46d90ae432 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:35.597122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a84ea15c-1160-4dce-9435-5c46d90ae432 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:35.741719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-17d10fc1-7c7e-43df-b658-7f781d2cf6aa tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:35.751788 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-17d10fc1-7c7e-43df-b658-7f781d2cf6aa tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc" status: 200 len: 1322 microversion: 2.1 time: 0.255620 Oct 04 21:20:35.769339 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1664/3238] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:35 2022] GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:20:35.833347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-5359731e-7dd4-48f4-a4e4-d8d6bb2eb8c5 req-dc9651c9-f6b6-4325-9fb7-a49cfac7483b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5", "tag": "d5b12128-b8e8-4f19-8f49-046efdc188f3"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:35.853152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5359731e-7dd4-48f4-a4e4-d8d6bb2eb8c5 req-dc9651c9-f6b6-4325-9fb7-a49cfac7483b service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:35.853750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5359731e-7dd4-48f4-a4e4-d8d6bb2eb8c5 req-dc9651c9-f6b6-4325-9fb7-a49cfac7483b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:35.870053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a84ea15c-1160-4dce-9435-5c46d90ae432 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:35.889093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a84ea15c-1160-4dce-9435-5c46d90ae432 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:35.892268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5359731e-7dd4-48f4-a4e4-d8d6bb2eb8c5 req-dc9651c9-f6b6-4325-9fb7-a49cfac7483b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:35.894814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a84ea15c-1160-4dce-9435-5c46d90ae432 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:35.901824 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a84ea15c-1160-4dce-9435-5c46d90ae432 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5" status: 200 len: 1359 microversion: 2.21 time: 0.317293 Oct 04 21:20:35.904611 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1575/3239] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:35 2022] GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 => generated 1359 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:35.957514 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-5359731e-7dd4-48f4-a4e4-d8d6bb2eb8c5 req-dc9651c9-f6b6-4325-9fb7-a49cfac7483b service nova] Creating event network-changed:d5b12128-b8e8-4f19-8f49-046efdc188f3 for instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 on n-h2-860282-1 Oct 04 21:20:35.992220 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-5359731e-7dd4-48f4-a4e4-d8d6bb2eb8c5 req-dc9651c9-f6b6-4325-9fb7-a49cfac7483b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160591 Oct 04 21:20:35.994792 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1665/3240] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:36.180310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d36ac6bf-a821-498a-9bad-fc5d8a21d43a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:36.180934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d36ac6bf-a821-498a-9bad-fc5d8a21d43a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:36.194693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d36ac6bf-a821-498a-9bad-fc5d8a21d43a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:36.201509 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d36ac6bf-a821-498a-9bad-fc5d8a21d43a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:36.202087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d36ac6bf-a821-498a-9bad-fc5d8a21d43a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:36.203030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d36ac6bf-a821-498a-9bad-fc5d8a21d43a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:36.203545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d36ac6bf-a821-498a-9bad-fc5d8a21d43a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:36.220615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d36ac6bf-a821-498a-9bad-fc5d8a21d43a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:36.274404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-503b9fc3-1ea1-45d1-93b0-deacf107f8a8 req-06b77b4c-8d58-4fd0-9131-fae4e01413ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319803c6-077c-4267-84e2-cb90f261aedc", "name": "network-vif-plugged", "status": "completed", "tag": "44d57a4f-f68d-4e25-9d73-71f36d48763b"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:36.305797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-503b9fc3-1ea1-45d1-93b0-deacf107f8a8 req-06b77b4c-8d58-4fd0-9131-fae4e01413ec service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:36.306733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-503b9fc3-1ea1-45d1-93b0-deacf107f8a8 req-06b77b4c-8d58-4fd0-9131-fae4e01413ec service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:36.310850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-503b9fc3-1ea1-45d1-93b0-deacf107f8a8 req-06b77b4c-8d58-4fd0-9131-fae4e01413ec service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:36.342133 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-503b9fc3-1ea1-45d1-93b0-deacf107f8a8 req-06b77b4c-8d58-4fd0-9131-fae4e01413ec service nova] Creating event network-vif-plugged:44d57a4f-f68d-4e25-9d73-71f36d48763b for instance 319803c6-077c-4267-84e2-cb90f261aedc on n-h1-860282-1 Oct 04 21:20:36.352370 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-503b9fc3-1ea1-45d1-93b0-deacf107f8a8 req-06b77b4c-8d58-4fd0-9131-fae4e01413ec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085337 Oct 04 21:20:36.360503 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1666/3241] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:20:36.779777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fbd42978-da07-4ae0-b2ad-56c8dc529d48 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:36.781264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fbd42978-da07-4ae0-b2ad-56c8dc529d48 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:36.804627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fbd42978-da07-4ae0-b2ad-56c8dc529d48 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:36.808537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fbd42978-da07-4ae0-b2ad-56c8dc529d48 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:36.810709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fbd42978-da07-4ae0-b2ad-56c8dc529d48 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:36.815417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fbd42978-da07-4ae0-b2ad-56c8dc529d48 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:36.817699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fbd42978-da07-4ae0-b2ad-56c8dc529d48 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:36.818331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fbd42978-da07-4ae0-b2ad-56c8dc529d48 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:38.354499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d36ac6bf-a821-498a-9bad-fc5d8a21d43a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:38.368547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d36ac6bf-a821-498a-9bad-fc5d8a21d43a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:38.375129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d36ac6bf-a821-498a-9bad-fc5d8a21d43a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:38.380449 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d36ac6bf-a821-498a-9bad-fc5d8a21d43a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1880 microversion: 2.32 time: 2.205001 Oct 04 21:20:38.389729 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1576/3242] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:36 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1880 bytes in 2214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:38.408679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6874742d-bcbb-4bb8-8842-6cbd54cd6cf1 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:38.411373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6874742d-bcbb-4bb8-8842-6cbd54cd6cf1 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:38.445619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6874742d-bcbb-4bb8-8842-6cbd54cd6cf1 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:38.446359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6874742d-bcbb-4bb8-8842-6cbd54cd6cf1 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:38.447026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6874742d-bcbb-4bb8-8842-6cbd54cd6cf1 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:38.448098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6874742d-bcbb-4bb8-8842-6cbd54cd6cf1 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:38.450377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6874742d-bcbb-4bb8-8842-6cbd54cd6cf1 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:38.450905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6874742d-bcbb-4bb8-8842-6cbd54cd6cf1 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:38.481510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fbd42978-da07-4ae0-b2ad-56c8dc529d48 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:38.492075 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fbd42978-da07-4ae0-b2ad-56c8dc529d48 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc" status: 200 len: 1322 microversion: 2.1 time: 1.719752 Oct 04 21:20:38.495397 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1667/3243] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:36 2022] GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc => generated 1322 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:20:38.932739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6874742d-bcbb-4bb8-8842-6cbd54cd6cf1 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:39.004482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6874742d-bcbb-4bb8-8842-6cbd54cd6cf1 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:39.006245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6874742d-bcbb-4bb8-8842-6cbd54cd6cf1 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:39.007691 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6874742d-bcbb-4bb8-8842-6cbd54cd6cf1 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5" status: 200 len: 1359 microversion: 2.21 time: 0.614219 Oct 04 21:20:39.008754 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1577/3244] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:38 2022] GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 => generated 1359 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:39.412616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ac48a655-d481-48f9-85aa-4634be58791c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:39.413251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ac48a655-d481-48f9-85aa-4634be58791c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:39.420797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac48a655-d481-48f9-85aa-4634be58791c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:39.421340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac48a655-d481-48f9-85aa-4634be58791c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:39.426119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac48a655-d481-48f9-85aa-4634be58791c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:39.427038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac48a655-d481-48f9-85aa-4634be58791c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:39.427530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac48a655-d481-48f9-85aa-4634be58791c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:39.428328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac48a655-d481-48f9-85aa-4634be58791c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:39.521366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e26ab6a5-e776-452a-a877-e06eab632667 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:39.522985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e26ab6a5-e776-452a-a877-e06eab632667 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:39.538187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e26ab6a5-e776-452a-a877-e06eab632667 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:39.540170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e26ab6a5-e776-452a-a877-e06eab632667 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:39.547699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e26ab6a5-e776-452a-a877-e06eab632667 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:39.547699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e26ab6a5-e776-452a-a877-e06eab632667 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:39.547699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e26ab6a5-e776-452a-a877-e06eab632667 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:39.547699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e26ab6a5-e776-452a-a877-e06eab632667 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:39.575456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=14 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:39.810448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ac48a655-d481-48f9-85aa-4634be58791c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:39.826779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ac48a655-d481-48f9-85aa-4634be58791c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:39.831951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ac48a655-d481-48f9-85aa-4634be58791c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:39.835875 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ac48a655-d481-48f9-85aa-4634be58791c tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 2836 microversion: 2.32 time: 0.427533 Oct 04 21:20:39.845745 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1668/3245] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:39 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 2836 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:39.864398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-45e92cf1-7617-40f3-8941-d30aa008fdfe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:39.866064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-45e92cf1-7617-40f3-8941-d30aa008fdfe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:39.873105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45e92cf1-7617-40f3-8941-d30aa008fdfe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:39.873949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45e92cf1-7617-40f3-8941-d30aa008fdfe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:39.875188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45e92cf1-7617-40f3-8941-d30aa008fdfe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:39.876158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45e92cf1-7617-40f3-8941-d30aa008fdfe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:39.876749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45e92cf1-7617-40f3-8941-d30aa008fdfe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:39.877159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45e92cf1-7617-40f3-8941-d30aa008fdfe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:39.951947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e26ab6a5-e776-452a-a877-e06eab632667 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:39.956961 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e26ab6a5-e776-452a-a877-e06eab632667 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc" status: 200 len: 1322 microversion: 2.1 time: 0.439621 Oct 04 21:20:39.958028 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1578/3246] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:39 2022] GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc => generated 1322 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:39.964047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a16b9c08-a371-4eea-99d1-4ca276296e87 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:39.964887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a16b9c08-a371-4eea-99d1-4ca276296e87 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:39.971737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a16b9c08-a371-4eea-99d1-4ca276296e87 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:39.972320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a16b9c08-a371-4eea-99d1-4ca276296e87 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:39.972834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a16b9c08-a371-4eea-99d1-4ca276296e87 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:39.973652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a16b9c08-a371-4eea-99d1-4ca276296e87 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:39.974277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a16b9c08-a371-4eea-99d1-4ca276296e87 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:39.974983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a16b9c08-a371-4eea-99d1-4ca276296e87 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:40.220084 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a16b9c08-a371-4eea-99d1-4ca276296e87 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.260670 Oct 04 21:20:40.231364 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1579/3247] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Oct 4 21:20:39 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0/os-interface => generated 1833 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:40.236782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-047706e0-3040-467e-b1da-e45e81de4c7f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:40.237406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-047706e0-3040-467e-b1da-e45e81de4c7f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:40.239385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-45e92cf1-7617-40f3-8941-d30aa008fdfe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:40.243839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-047706e0-3040-467e-b1da-e45e81de4c7f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:40.244338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-047706e0-3040-467e-b1da-e45e81de4c7f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:40.244784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-047706e0-3040-467e-b1da-e45e81de4c7f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:40.245522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-047706e0-3040-467e-b1da-e45e81de4c7f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:40.245990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-047706e0-3040-467e-b1da-e45e81de4c7f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:40.246589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-047706e0-3040-467e-b1da-e45e81de4c7f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:40.283490 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-45e92cf1-7617-40f3-8941-d30aa008fdfe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1681 microversion: 2.1 time: 0.432298 Oct 04 21:20:40.284272 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1669/3248] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:39 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1681 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:40.583551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=30 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:40.982171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-42958d82-901a-401c-b331-a4d974b7468e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:40.986200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-42958d82-901a-401c-b331-a4d974b7468e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:40.992709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42958d82-901a-401c-b331-a4d974b7468e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:40.993451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42958d82-901a-401c-b331-a4d974b7468e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:40.994275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42958d82-901a-401c-b331-a4d974b7468e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:40.999157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-047706e0-3040-467e-b1da-e45e81de4c7f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:41.012756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42958d82-901a-401c-b331-a4d974b7468e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:41.013272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42958d82-901a-401c-b331-a4d974b7468e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:41.013756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42958d82-901a-401c-b331-a4d974b7468e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:41.033067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-047706e0-3040-467e-b1da-e45e81de4c7f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:41.035140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-047706e0-3040-467e-b1da-e45e81de4c7f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:41.041935 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-047706e0-3040-467e-b1da-e45e81de4c7f tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5" status: 200 len: 1359 microversion: 2.21 time: 0.806323 Oct 04 21:20:41.045381 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1580/3249] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:40 2022] GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 => generated 1359 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:41.310912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-325017d0-11bc-4614-b9b9-57467d57bcec tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:41.312539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-325017d0-11bc-4614-b9b9-57467d57bcec tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:41.319219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-325017d0-11bc-4614-b9b9-57467d57bcec tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:41.320503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-325017d0-11bc-4614-b9b9-57467d57bcec tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:41.321222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-325017d0-11bc-4614-b9b9-57467d57bcec tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:41.322231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-325017d0-11bc-4614-b9b9-57467d57bcec tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:41.322917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-325017d0-11bc-4614-b9b9-57467d57bcec tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:41.323804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-325017d0-11bc-4614-b9b9-57467d57bcec tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:41.520744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-42958d82-901a-401c-b331-a4d974b7468e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:41.523557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:41.534248 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-42958d82-901a-401c-b331-a4d974b7468e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc" status: 200 len: 1517 microversion: 2.1 time: 0.558128 Oct 04 21:20:41.537314 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1670/3250] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:40 2022] GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc => generated 1517 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:20:41.568858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-354521a9-e2fe-4261-b142-6fd07a014cec tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Action: 'action', calling method: .version_select at 0x7f5791effd30>, body: {"addFloatingIp": {"address": "172.25.8.231"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:41.578840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-354521a9-e2fe-4261-b142-6fd07a014cec tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:41.590723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-354521a9-e2fe-4261-b142-6fd07a014cec tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:41.591625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-354521a9-e2fe-4261-b142-6fd07a014cec tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:41.592303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-354521a9-e2fe-4261-b142-6fd07a014cec tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:41.594302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-354521a9-e2fe-4261-b142-6fd07a014cec tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:41.596204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-354521a9-e2fe-4261-b142-6fd07a014cec tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:41.598141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-354521a9-e2fe-4261-b142-6fd07a014cec tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:41.740870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-354521a9-e2fe-4261-b142-6fd07a014cec tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "refresh_cache-6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:20:41.741134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-354521a9-e2fe-4261-b142-6fd07a014cec tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquired lock "refresh_cache-6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:20:41.840580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-325017d0-11bc-4614-b9b9-57467d57bcec tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:41.857347 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-325017d0-11bc-4614-b9b9-57467d57bcec tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.550097 Oct 04 21:20:41.857893 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1581/3251] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:41 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:20:41.892121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-93a9290c-c5e2-4616-8e24-e50856cffa54 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-499545660"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:41.895070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-93a9290c-c5e2-4616-8e24-e50856cffa54 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:41.902161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93a9290c-c5e2-4616-8e24-e50856cffa54 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:41.902730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93a9290c-c5e2-4616-8e24-e50856cffa54 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:41.903400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93a9290c-c5e2-4616-8e24-e50856cffa54 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:41.904338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93a9290c-c5e2-4616-8e24-e50856cffa54 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:41.904993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93a9290c-c5e2-4616-8e24-e50856cffa54 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:41.906225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93a9290c-c5e2-4616-8e24-e50856cffa54 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:42.477137 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-93a9290c-c5e2-4616-8e24-e50856cffa54 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action" status: 202 len: 0 microversion: 2.1 time: 0.593775 Oct 04 21:20:42.494942 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1582/3252] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:20:41 2022] POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 21:20:42.523873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9d516313-35bb-4242-aa91-23975ccd6421 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:42.525489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9d516313-35bb-4242-aa91-23975ccd6421 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:42.536393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d516313-35bb-4242-aa91-23975ccd6421 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:42.537252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d516313-35bb-4242-aa91-23975ccd6421 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:42.539192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d516313-35bb-4242-aa91-23975ccd6421 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:42.548832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d516313-35bb-4242-aa91-23975ccd6421 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:42.551743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d516313-35bb-4242-aa91-23975ccd6421 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:42.552713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d516313-35bb-4242-aa91-23975ccd6421 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:43.705753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9d516313-35bb-4242-aa91-23975ccd6421 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:43.724403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9d516313-35bb-4242-aa91-23975ccd6421 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:43.733600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9d516313-35bb-4242-aa91-23975ccd6421 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:43.734859 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9d516313-35bb-4242-aa91-23975ccd6421 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5" status: 200 len: 1359 microversion: 2.21 time: 1.238243 Oct 04 21:20:43.735678 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1583/3253] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:42 2022] GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 => generated 1359 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:43.742410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-caa924d9-06b1-438a-b6c5-0a4398f32754 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:43.749029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-caa924d9-06b1-438a-b6c5-0a4398f32754 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:43.760675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-caa924d9-06b1-438a-b6c5-0a4398f32754 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:43.761978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-caa924d9-06b1-438a-b6c5-0a4398f32754 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:43.763765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-caa924d9-06b1-438a-b6c5-0a4398f32754 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:43.766767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-caa924d9-06b1-438a-b6c5-0a4398f32754 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:43.767513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-caa924d9-06b1-438a-b6c5-0a4398f32754 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:43.775524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-caa924d9-06b1-438a-b6c5-0a4398f32754 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:44.435841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-caa924d9-06b1-438a-b6c5-0a4398f32754 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:44.447756 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-caa924d9-06b1-438a-b6c5-0a4398f32754 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1678 microversion: 2.1 time: 0.705861 Oct 04 21:20:44.448464 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1584/3254] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:43 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1678 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:44.469139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-8db9bef5-63a9-4237-9f3a-2b4b3ef702a4 req-60b69b85-12ad-4610-8dbf-c78b841f88b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba61f85c-a75d-451d-a5f7-f9533481c406", "name": "network-vif-unplugged", "status": "completed", "tag": "34504880-4c91-4512-980a-45596f508743"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:44.502106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8db9bef5-63a9-4237-9f3a-2b4b3ef702a4 req-60b69b85-12ad-4610-8dbf-c78b841f88b5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:44.502869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8db9bef5-63a9-4237-9f3a-2b4b3ef702a4 req-60b69b85-12ad-4610-8dbf-c78b841f88b5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:44.503490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8db9bef5-63a9-4237-9f3a-2b4b3ef702a4 req-60b69b85-12ad-4610-8dbf-c78b841f88b5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:44.521297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:44.540124 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-8db9bef5-63a9-4237-9f3a-2b4b3ef702a4 req-60b69b85-12ad-4610-8dbf-c78b841f88b5 service nova] Creating event network-vif-unplugged:34504880-4c91-4512-980a-45596f508743 for instance ba61f85c-a75d-451d-a5f7-f9533481c406 on n-h2-860282-1 Oct 04 21:20:44.545560 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-8db9bef5-63a9-4237-9f3a-2b4b3ef702a4 req-60b69b85-12ad-4610-8dbf-c78b841f88b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086072 Oct 04 21:20:44.547630 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1585/3255] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:44.553931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-f8240da6-9cf4-4b1a-bade-8c487f3a1d70 req-5bd58bb1-5292-4be6-aa95-4043327a3059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "tag": "59687d68-2ca3-4874-9671-aaaec5a44a09"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:44.564535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f8240da6-9cf4-4b1a-bade-8c487f3a1d70 req-5bd58bb1-5292-4be6-aa95-4043327a3059 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:44.565273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f8240da6-9cf4-4b1a-bade-8c487f3a1d70 req-5bd58bb1-5292-4be6-aa95-4043327a3059 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:44.565954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f8240da6-9cf4-4b1a-bade-8c487f3a1d70 req-5bd58bb1-5292-4be6-aa95-4043327a3059 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:44.587461 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-f8240da6-9cf4-4b1a-bade-8c487f3a1d70 req-5bd58bb1-5292-4be6-aa95-4043327a3059 service nova] Creating event network-changed:59687d68-2ca3-4874-9671-aaaec5a44a09 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:20:44.603171 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-f8240da6-9cf4-4b1a-bade-8c487f3a1d70 req-5bd58bb1-5292-4be6-aa95-4043327a3059 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053900 Oct 04 21:20:44.606440 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1586/3256] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:44.764459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-22216dda-99db-45d3-bc0e-fa02bf62e5c3 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:44.765937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-22216dda-99db-45d3-bc0e-fa02bf62e5c3 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:44.783471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22216dda-99db-45d3-bc0e-fa02bf62e5c3 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:44.790113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22216dda-99db-45d3-bc0e-fa02bf62e5c3 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:44.790812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22216dda-99db-45d3-bc0e-fa02bf62e5c3 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:44.791731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22216dda-99db-45d3-bc0e-fa02bf62e5c3 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:44.793937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22216dda-99db-45d3-bc0e-fa02bf62e5c3 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:44.794584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22216dda-99db-45d3-bc0e-fa02bf62e5c3 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:45.688272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-22216dda-99db-45d3-bc0e-fa02bf62e5c3 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:45.696871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-22216dda-99db-45d3-bc0e-fa02bf62e5c3 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:45.703093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-22216dda-99db-45d3-bc0e-fa02bf62e5c3 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:45.708157 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-22216dda-99db-45d3-bc0e-fa02bf62e5c3 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5" status: 200 len: 1359 microversion: 2.21 time: 0.947887 Oct 04 21:20:45.709281 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1587/3257] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:44 2022] GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 => generated 1359 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:20:45.717252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b67298ac-78ba-4b7a-b6b0-c9acc1872567 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:45.721964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b67298ac-78ba-4b7a-b6b0-c9acc1872567 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:45.742526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b67298ac-78ba-4b7a-b6b0-c9acc1872567 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:45.744360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b67298ac-78ba-4b7a-b6b0-c9acc1872567 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:45.745749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b67298ac-78ba-4b7a-b6b0-c9acc1872567 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:45.752775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b67298ac-78ba-4b7a-b6b0-c9acc1872567 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:45.753475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b67298ac-78ba-4b7a-b6b0-c9acc1872567 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:45.754668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b67298ac-78ba-4b7a-b6b0-c9acc1872567 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:47.101594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b67298ac-78ba-4b7a-b6b0-c9acc1872567 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:47.153090 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b67298ac-78ba-4b7a-b6b0-c9acc1872567 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1686 microversion: 2.1 time: 1.441484 Oct 04 21:20:47.158183 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1588/3258] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:45 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1686 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:47.184037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0a449f9e-d6b7-4bf3-8833-607b8586a47c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:47.184673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0a449f9e-d6b7-4bf3-8833-607b8586a47c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:47.206284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a449f9e-d6b7-4bf3-8833-607b8586a47c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:47.206936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a449f9e-d6b7-4bf3-8833-607b8586a47c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:47.207590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a449f9e-d6b7-4bf3-8833-607b8586a47c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:47.208312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a449f9e-d6b7-4bf3-8833-607b8586a47c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:47.209551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a449f9e-d6b7-4bf3-8833-607b8586a47c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:47.210147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a449f9e-d6b7-4bf3-8833-607b8586a47c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:49.211753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0a449f9e-d6b7-4bf3-8833-607b8586a47c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:49.232331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0a449f9e-d6b7-4bf3-8833-607b8586a47c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:49.238339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0a449f9e-d6b7-4bf3-8833-607b8586a47c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:49.247921 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0a449f9e-d6b7-4bf3-8833-607b8586a47c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5" status: 200 len: 1359 microversion: 2.21 time: 2.084807 Oct 04 21:20:49.255196 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1589/3259] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:47 2022] GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 => generated 1359 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:49.278819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-81cb2a44-c317-400c-afac-e369c98cf7e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:49.281990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-81cb2a44-c317-400c-afac-e369c98cf7e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:49.320484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81cb2a44-c317-400c-afac-e369c98cf7e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:49.330732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81cb2a44-c317-400c-afac-e369c98cf7e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:49.331483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81cb2a44-c317-400c-afac-e369c98cf7e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:49.338204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81cb2a44-c317-400c-afac-e369c98cf7e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:49.340691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81cb2a44-c317-400c-afac-e369c98cf7e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:49.343723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81cb2a44-c317-400c-afac-e369c98cf7e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:49.823267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-354521a9-e2fe-4261-b142-6fd07a014cec tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Building network info cache for instance {{(pid=122758) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 21:20:50.151922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-81cb2a44-c317-400c-afac-e369c98cf7e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:50.174077 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-81cb2a44-c317-400c-afac-e369c98cf7e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1681 microversion: 2.1 time: 0.914536 Oct 04 21:20:50.174779 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1590/3260] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:49 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1681 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:50.199267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-778cb2ac-2aa4-4957-b3a0-64e9d48704d7 req-2cfdb866-488d-4b0a-ab4e-e9bbfc6ae76e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5", "name": "network-vif-plugged", "status": "completed", "tag": "d5b12128-b8e8-4f19-8f49-046efdc188f3"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:50.232670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-778cb2ac-2aa4-4957-b3a0-64e9d48704d7 req-2cfdb866-488d-4b0a-ab4e-e9bbfc6ae76e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:50.248498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-778cb2ac-2aa4-4957-b3a0-64e9d48704d7 req-2cfdb866-488d-4b0a-ab4e-e9bbfc6ae76e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:50.251497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-778cb2ac-2aa4-4957-b3a0-64e9d48704d7 req-2cfdb866-488d-4b0a-ab4e-e9bbfc6ae76e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:50.291871 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-778cb2ac-2aa4-4957-b3a0-64e9d48704d7 req-2cfdb866-488d-4b0a-ab4e-e9bbfc6ae76e service nova] Creating event network-vif-plugged:d5b12128-b8e8-4f19-8f49-046efdc188f3 for instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 on n-h2-860282-1 Oct 04 21:20:50.308919 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-778cb2ac-2aa4-4957-b3a0-64e9d48704d7 req-2cfdb866-488d-4b0a-ab4e-e9bbfc6ae76e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130760 Oct 04 21:20:50.319209 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1591/3261] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:50.329449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-764d3d6b-4421-4819-b9f6-aee6144a64d9 req-4162b5eb-4eb0-4507-ac7a-349ed611b639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ccadfb7-f678-4ca9-9f01-7b268c2e1db6", "tag": "a6dd8a45-b585-411b-a35e-ee7bbc82f986"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:50.380954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-764d3d6b-4421-4819-b9f6-aee6144a64d9 req-4162b5eb-4eb0-4507-ac7a-349ed611b639 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:50.394681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-764d3d6b-4421-4819-b9f6-aee6144a64d9 req-4162b5eb-4eb0-4507-ac7a-349ed611b639 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:50.396047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-764d3d6b-4421-4819-b9f6-aee6144a64d9 req-4162b5eb-4eb0-4507-ac7a-349ed611b639 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:50.447429 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-764d3d6b-4421-4819-b9f6-aee6144a64d9 req-4162b5eb-4eb0-4507-ac7a-349ed611b639 service nova] Creating event network-changed:a6dd8a45-b585-411b-a35e-ee7bbc82f986 for instance 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 on n-h1-860282-1 Oct 04 21:20:50.473447 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-764d3d6b-4421-4819-b9f6-aee6144a64d9 req-4162b5eb-4eb0-4507-ac7a-349ed611b639 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152695 Oct 04 21:20:50.503290 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1592/3262] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:50.988424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-feb138cc-2265-4f0f-95d2-b2db9907cec2 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Action: 'create', calling method: .version_select at 0x7f578b76f9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1056990425", "description": "tempest-description-1216605499"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:51.583779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:DELETE=5 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:52.911479 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-feb138cc-2265-4f0f-95d2-b2db9907cec2 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 2.406752 Oct 04 21:20:52.912084 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1593/3263] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:20:50 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 2408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:52.917116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3f2e38ff-d5a2-46ae-b78a-b3dba6979f97 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:52.917902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3f2e38ff-d5a2-46ae-b78a-b3dba6979f97 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:52.941180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f2e38ff-d5a2-46ae-b78a-b3dba6979f97 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:52.941830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f2e38ff-d5a2-46ae-b78a-b3dba6979f97 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:52.942289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f2e38ff-d5a2-46ae-b78a-b3dba6979f97 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:52.943209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f2e38ff-d5a2-46ae-b78a-b3dba6979f97 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:52.944029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f2e38ff-d5a2-46ae-b78a-b3dba6979f97 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:52.945278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f2e38ff-d5a2-46ae-b78a-b3dba6979f97 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:53.067783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-354521a9-e2fe-4261-b142-6fd07a014cec tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Updating instance_info_cache with network_info: [{"id": "a6dd8a45-b585-411b-a35e-ee7bbc82f986", "address": "fa:16:3e:d7:57:1b", "network": {"id": "91b9f9a5-3b10-4582-a6c4-fb08af7ca69c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-465349262-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fbb2758d2dc64f70934d8161bf600f94", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa6dd8a45-b5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122758) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:20:53.218594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-354521a9-e2fe-4261-b142-6fd07a014cec tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Releasing lock "refresh_cache-6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:20:53.219641 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-354521a9-e2fe-4261-b142-6fd07a014cec tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "POST /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6/action" status: 202 len: 0 microversion: 2.1 time: 11.661000 Oct 04 21:20:53.220645 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1671/3264] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:20:41 2022] POST /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6/action => generated 0 bytes in 11662 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 04 21:20:53.226196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-64b4ea71-a158-492c-bec5-6d4d05f2d79b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:53.227137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-64b4ea71-a158-492c-bec5-6d4d05f2d79b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:53.241843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64b4ea71-a158-492c-bec5-6d4d05f2d79b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:53.242388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64b4ea71-a158-492c-bec5-6d4d05f2d79b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:53.242893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64b4ea71-a158-492c-bec5-6d4d05f2d79b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:53.244999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64b4ea71-a158-492c-bec5-6d4d05f2d79b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:53.245772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64b4ea71-a158-492c-bec5-6d4d05f2d79b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:53.247661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64b4ea71-a158-492c-bec5-6d4d05f2d79b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:53.287345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3f2e38ff-d5a2-46ae-b78a-b3dba6979f97 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:53.305865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3f2e38ff-d5a2-46ae-b78a-b3dba6979f97 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:53.315991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3f2e38ff-d5a2-46ae-b78a-b3dba6979f97 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:53.320933 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3f2e38ff-d5a2-46ae-b78a-b3dba6979f97 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5" status: 200 len: 1553 microversion: 2.21 time: 0.405249 Oct 04 21:20:53.323455 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1594/3265] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:52 2022] GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 => generated 1553 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:53.882003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-629c8702-75d8-4d04-ac71-a16097ddd893 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Action: 'create', calling method: .version_select at 0x7f578b8b4dc0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-258934610", "policies": ["affinity"]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:53.935602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-629c8702-75d8-4d04-ac71-a16097ddd893 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:53.959551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-629c8702-75d8-4d04-ac71-a16097ddd893 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for user c382de4f98bd4839851ad103b3f56aa6 and project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:54.256812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-629c8702-75d8-4d04-ac71-a16097ddd893 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:54.266648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-629c8702-75d8-4d04-ac71-a16097ddd893 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for user c382de4f98bd4839851ad103b3f56aa6 and project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:54.289591 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-629c8702-75d8-4d04-ac71-a16097ddd893 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.964802 Oct 04 21:20:54.298681 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1595/3266] 10.222.0.30 () {60 vars in 1174 bytes} [Tue Oct 4 21:20:53 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:54.305712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b9e9fea3-2d75-4dd5-9366-b00e79c2e681 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Action: 'create', calling method: .version_select at 0x7f578b77bc10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-292740023", "description": "tempest-description-554528297"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:54.395218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-64b4ea71-a158-492c-bec5-6d4d05f2d79b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:54.403754 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-64b4ea71-a158-492c-bec5-6d4d05f2d79b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1681 microversion: 2.1 time: 1.181669 Oct 04 21:20:54.404338 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1672/3267] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:53 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1681 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:54.417495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f2925298-8a34-421b-9767-446a5bf61aab tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.231"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:54.428453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f2925298-8a34-421b-9767-446a5bf61aab tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:54.461157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2925298-8a34-421b-9767-446a5bf61aab tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:54.461157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2925298-8a34-421b-9767-446a5bf61aab tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:54.461157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2925298-8a34-421b-9767-446a5bf61aab tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:54.461157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2925298-8a34-421b-9767-446a5bf61aab tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:54.461157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2925298-8a34-421b-9767-446a5bf61aab tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:54.461157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2925298-8a34-421b-9767-446a5bf61aab tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:54.494839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2925298-8a34-421b-9767-446a5bf61aab tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "refresh_cache-319803c6-077c-4267-84e2-cb90f261aedc" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:20:54.495715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2925298-8a34-421b-9767-446a5bf61aab tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquired lock "refresh_cache-319803c6-077c-4267-84e2-cb90f261aedc" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:20:55.119293 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b9e9fea3-2d75-4dd5-9366-b00e79c2e681 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.819105 Oct 04 21:20:55.120591 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1596/3268] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:20:54 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:55.126365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a2ae4874-8f1e-409b-9cd9-06f6af400133 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:55.127358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a2ae4874-8f1e-409b-9cd9-06f6af400133 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:55.147018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2ae4874-8f1e-409b-9cd9-06f6af400133 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:55.147963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2ae4874-8f1e-409b-9cd9-06f6af400133 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:55.150354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2ae4874-8f1e-409b-9cd9-06f6af400133 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:55.151349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2ae4874-8f1e-409b-9cd9-06f6af400133 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:55.152032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2ae4874-8f1e-409b-9cd9-06f6af400133 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:55.156112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a2ae4874-8f1e-409b-9cd9-06f6af400133 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:55.230527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a2ae4874-8f1e-409b-9cd9-06f6af400133 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:20:55.699984 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a2ae4874-8f1e-409b-9cd9-06f6af400133 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5" status: 204 len: 0 microversion: 2.21 time: 0.577866 Oct 04 21:20:55.707688 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1597/3269] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:20:55 2022] DELETE /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:20:55.728981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-4777a765-5fe6-43ed-a640-1cb36d46c482 req-630e2140-d39d-4ecf-a100-ffccd7186497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba61f85c-a75d-451d-a5f7-f9533481c406", "name": "network-vif-plugged", "status": "completed", "tag": "34504880-4c91-4512-980a-45596f508743"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:55.743238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:55.756825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4777a765-5fe6-43ed-a640-1cb36d46c482 req-630e2140-d39d-4ecf-a100-ffccd7186497 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:55.756825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4777a765-5fe6-43ed-a640-1cb36d46c482 req-630e2140-d39d-4ecf-a100-ffccd7186497 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:55.756825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4777a765-5fe6-43ed-a640-1cb36d46c482 req-630e2140-d39d-4ecf-a100-ffccd7186497 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:55.774889 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-4777a765-5fe6-43ed-a640-1cb36d46c482 req-630e2140-d39d-4ecf-a100-ffccd7186497 service nova] Creating event network-vif-plugged:34504880-4c91-4512-980a-45596f508743 for instance ba61f85c-a75d-451d-a5f7-f9533481c406 on n-h2-860282-1 Oct 04 21:20:55.784140 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-4777a765-5fe6-43ed-a640-1cb36d46c482 req-630e2140-d39d-4ecf-a100-ffccd7186497 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069492 Oct 04 21:20:55.786239 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1598/3270] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:55.795070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b40948af-4079-4fd2-8d6e-b2db3a5592cc tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Action: 'create', calling method: .version_select at 0x7f578b76faf0>, body: {"server_group": {"name": "tempest-server-group-568688695", "policies": ["affinity"]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:55.849566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-b40948af-4079-4fd2-8d6e-b2db3a5592cc tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:55.861517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-b40948af-4079-4fd2-8d6e-b2db3a5592cc tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for user c382de4f98bd4839851ad103b3f56aa6 and project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:56.047357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-b40948af-4079-4fd2-8d6e-b2db3a5592cc tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:56.053765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-b40948af-4079-4fd2-8d6e-b2db3a5592cc tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for user c382de4f98bd4839851ad103b3f56aa6 and project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:56.071346 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b40948af-4079-4fd2-8d6e-b2db3a5592cc tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.283882 Oct 04 21:20:56.077577 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1599/3271] 10.222.0.30 () {60 vars in 1173 bytes} [Tue Oct 4 21:20:55 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:56.079311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0bdb4f31-14c8-475e-9c7f-caa59ed50f27 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-563971820", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "fb8201a2-cde9-4360-939e-588100b98ee9"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:56.177605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-0bdb4f31-14c8-475e-9c7f-caa59ed50f27 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] validate_networks() for [('fb8201a2-cde9-4360-939e-588100b98ee9', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:20:57.710211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-0bdb4f31-14c8-475e-9c7f-caa59ed50f27 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:20:57.710895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-0bdb4f31-14c8-475e-9c7f-caa59ed50f27 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:20:57.711330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-0bdb4f31-14c8-475e-9c7f-caa59ed50f27 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:20:57.711827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-0bdb4f31-14c8-475e-9c7f-caa59ed50f27 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:20:57.712326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-0bdb4f31-14c8-475e-9c7f-caa59ed50f27 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:20:57.731974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bdb4f31-14c8-475e-9c7f-caa59ed50f27 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:57.736515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bdb4f31-14c8-475e-9c7f-caa59ed50f27 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:57.737326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bdb4f31-14c8-475e-9c7f-caa59ed50f27 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:57.738555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bdb4f31-14c8-475e-9c7f-caa59ed50f27 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:57.739261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bdb4f31-14c8-475e-9c7f-caa59ed50f27 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:57.741870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bdb4f31-14c8-475e-9c7f-caa59ed50f27 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:57.793998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-0bdb4f31-14c8-475e-9c7f-caa59ed50f27 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Getting quotas for project f547dec3057448558ae4d6012037dac3. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:57.805114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-0bdb4f31-14c8-475e-9c7f-caa59ed50f27 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Getting quotas for user cdbb08401bf146068fc351915ede7675 and project f547dec3057448558ae4d6012037dac3. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:57.845833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0bdb4f31-14c8-475e-9c7f-caa59ed50f27 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:20:57.849083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0bdb4f31-14c8-475e-9c7f-caa59ed50f27 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: e6cb4528-b297-45b4-a0e3-d39236df0178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:20:58.269661 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0bdb4f31-14c8-475e-9c7f-caa59ed50f27 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.195087 Oct 04 21:20:58.270877 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1600/3272] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:20:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:20:58.286479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-971fea8c-5a4c-44dd-994a-202b4547dd21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:58.288223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-971fea8c-5a4c-44dd-994a-202b4547dd21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:58.322956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-971fea8c-5a4c-44dd-994a-202b4547dd21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:58.323980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-971fea8c-5a4c-44dd-994a-202b4547dd21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:58.324665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-971fea8c-5a4c-44dd-994a-202b4547dd21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:58.326016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-971fea8c-5a4c-44dd-994a-202b4547dd21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:58.326720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-971fea8c-5a4c-44dd-994a-202b4547dd21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:58.327949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-971fea8c-5a4c-44dd-994a-202b4547dd21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:58.392702 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.network.neutron [None req-f2925298-8a34-421b-9767-446a5bf61aab tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] re-assign floating IP 172.25.8.231 from instance 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 Oct 04 21:20:58.594026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-f2925298-8a34-421b-9767-446a5bf61aab tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Building network info cache for instance {{(pid=122758) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 21:20:58.786879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-971fea8c-5a4c-44dd-994a-202b4547dd21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:58.811504 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-971fea8c-5a4c-44dd-994a-202b4547dd21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1681 microversion: 2.1 time: 0.532001 Oct 04 21:20:58.813898 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1601/3273] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:58 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1681 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:58.820979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-93110a00-7d43-47b8-a1ad-9062fc529d99 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:58.833457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-93110a00-7d43-47b8-a1ad-9062fc529d99 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:58.850713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93110a00-7d43-47b8-a1ad-9062fc529d99 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:58.853338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93110a00-7d43-47b8-a1ad-9062fc529d99 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:58.853689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93110a00-7d43-47b8-a1ad-9062fc529d99 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:58.857730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93110a00-7d43-47b8-a1ad-9062fc529d99 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:58.859167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93110a00-7d43-47b8-a1ad-9062fc529d99 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:58.861774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93110a00-7d43-47b8-a1ad-9062fc529d99 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:59.267377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-93110a00-7d43-47b8-a1ad-9062fc529d99 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:59.292052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-93110a00-7d43-47b8-a1ad-9062fc529d99 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:59.293547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-93110a00-7d43-47b8-a1ad-9062fc529d99 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '860b8f63588a4096838b363d1c12dfc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d413fae6433451282e98d0deff85928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:59.311146 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-93110a00-7d43-47b8-a1ad-9062fc529d99 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5" status: 200 len: 1517 microversion: 2.21 time: 0.494259 Oct 04 21:20:59.312335 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1602/3274] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:58 2022] GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 => generated 1517 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:59.378740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-38bca97c-ea18-49ba-b476-18039b4c8553 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Action: 'create', calling method: .version_select at 0x7f578b730dc0>, body: {"server_group": {"name": "tempest-server-group-568688695", "policies": ["affinity"]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:59.462114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-38bca97c-ea18-49ba-b476-18039b4c8553 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:59.482930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-38bca97c-ea18-49ba-b476-18039b4c8553 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for user c382de4f98bd4839851ad103b3f56aa6 and project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:59.768132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-38bca97c-ea18-49ba-b476-18039b4c8553 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:59.794220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-38bca97c-ea18-49ba-b476-18039b4c8553 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for user c382de4f98bd4839851ad103b3f56aa6 and project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:59.891179 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-38bca97c-ea18-49ba-b476-18039b4c8553 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.548642 Oct 04 21:20:59.895826 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1603/3275] 10.222.0.30 () {60 vars in 1173 bytes} [Tue Oct 4 21:20:59 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:59.914252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-ceb33693-4d37-404b-8b4e-4aa6c4d7109a req-702e5dbf-f07a-4c41-a247-629e496ed172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ccadfb7-f678-4ca9-9f01-7b268c2e1db6", "tag": "a6dd8a45-b585-411b-a35e-ee7bbc82f986"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:59.928542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ceb33693-4d37-404b-8b4e-4aa6c4d7109a req-702e5dbf-f07a-4c41-a247-629e496ed172 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:59.929200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ceb33693-4d37-404b-8b4e-4aa6c4d7109a req-702e5dbf-f07a-4c41-a247-629e496ed172 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:59.929836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ceb33693-4d37-404b-8b4e-4aa6c4d7109a req-702e5dbf-f07a-4c41-a247-629e496ed172 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:59.949573 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-ceb33693-4d37-404b-8b4e-4aa6c4d7109a req-702e5dbf-f07a-4c41-a247-629e496ed172 service nova] Creating event network-changed:a6dd8a45-b585-411b-a35e-ee7bbc82f986 for instance 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 on n-h1-860282-1 Oct 04 21:20:59.960626 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-ceb33693-4d37-404b-8b4e-4aa6c4d7109a req-702e5dbf-f07a-4c41-a247-629e496ed172 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062740 Oct 04 21:20:59.961753 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1604/3276] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:59.976727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2b63652d-b7eb-4f76-be33-c049f71062e3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:59.977596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2b63652d-b7eb-4f76-be33-c049f71062e3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: e6cb4528-b297-45b4-a0e3-d39236df0178] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:00.014361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-f2925298-8a34-421b-9767-446a5bf61aab tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Updating instance_info_cache with network_info: [{"id": "a6dd8a45-b585-411b-a35e-ee7bbc82f986", "address": "fa:16:3e:d7:57:1b", "network": {"id": "91b9f9a5-3b10-4582-a6c4-fb08af7ca69c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-465349262-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fbb2758d2dc64f70934d8161bf600f94", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa6dd8a45-b5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122758) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:21:00.146988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-f2925298-8a34-421b-9767-446a5bf61aab tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Building network info cache for instance {{(pid=122758) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 21:21:00.160402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2b63652d-b7eb-4f76-be33-c049f71062e3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:00.200616 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2b63652d-b7eb-4f76-be33-c049f71062e3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178" status: 200 len: 1215 microversion: 2.1 time: 0.218187 Oct 04 21:21:00.202888 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1605/3277] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:59 2022] GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178 => generated 1215 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:00.225126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-9abedf34-b8b7-42c2-b896-1d9f2a076388 req-e32d780c-f35c-40c2-b715-fce08970a183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5", "name": "network-vif-deleted", "tag": "d5b12128-b8e8-4f19-8f49-046efdc188f3"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:00.276289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9abedf34-b8b7-42c2-b896-1d9f2a076388 req-e32d780c-f35c-40c2-b715-fce08970a183 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:00.279446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9abedf34-b8b7-42c2-b896-1d9f2a076388 req-e32d780c-f35c-40c2-b715-fce08970a183 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:00.281350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9abedf34-b8b7-42c2-b896-1d9f2a076388 req-e32d780c-f35c-40c2-b715-fce08970a183 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:00.323197 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-9abedf34-b8b7-42c2-b896-1d9f2a076388 req-e32d780c-f35c-40c2-b715-fce08970a183 service nova] Creating event network-vif-deleted:d5b12128-b8e8-4f19-8f49-046efdc188f3 for instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 on n-h2-860282-1 Oct 04 21:21:00.343440 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-9abedf34-b8b7-42c2-b896-1d9f2a076388 req-e32d780c-f35c-40c2-b715-fce08970a183 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138473 Oct 04 21:21:00.372022 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1606/3278] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:00.372022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c78e643e-c9bd-495d-aeb8-7d9790face65 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:00.377769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c78e643e-c9bd-495d-aeb8-7d9790face65 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:00.386498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c78e643e-c9bd-495d-aeb8-7d9790face65 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:00.404211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c78e643e-c9bd-495d-aeb8-7d9790face65 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:00.409605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c78e643e-c9bd-495d-aeb8-7d9790face65 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:00.409605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c78e643e-c9bd-495d-aeb8-7d9790face65 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:00.410581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c78e643e-c9bd-495d-aeb8-7d9790face65 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:00.420612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c78e643e-c9bd-495d-aeb8-7d9790face65 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:01.109066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c78e643e-c9bd-495d-aeb8-7d9790face65 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:01.130299 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c78e643e-c9bd-495d-aeb8-7d9790face65 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1681 microversion: 2.1 time: 0.776598 Oct 04 21:21:01.131124 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1607/3279] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:00 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1681 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:01.151177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1c128acf-eb9e-485d-8a39-a3aab4d5f570 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:01.292332 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1c128acf-eb9e-485d-8a39-a3aab4d5f570 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/37559ea2-543f-4e7b-8820-829b362a6716" status: 204 len: 0 microversion: 2.1 time: 0.159304 Oct 04 21:21:01.293128 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1608/3280] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Oct 4 21:21:01 2022] DELETE /compute/v2.1/os-server-groups/37559ea2-543f-4e7b-8820-829b362a6716 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:21:01.316952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4570201d-8537-4cfd-b681-d8019aa3f488 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:01.322648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4570201d-8537-4cfd-b681-d8019aa3f488 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:01.335320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4570201d-8537-4cfd-b681-d8019aa3f488 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:01.337554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4570201d-8537-4cfd-b681-d8019aa3f488 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:01.337554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4570201d-8537-4cfd-b681-d8019aa3f488 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:01.337554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4570201d-8537-4cfd-b681-d8019aa3f488 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:01.343249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4570201d-8537-4cfd-b681-d8019aa3f488 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:01.343786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4570201d-8537-4cfd-b681-d8019aa3f488 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:01.371595 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-4570201d-8537-4cfd-b681-d8019aa3f488 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] HTTP exception thrown: Instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 could not be found. Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4570201d-8537-4cfd-b681-d8019aa3f488 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Request method failure captured: Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 HTTP/1.1 Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKOTd87u0se1pGThYsfDrmBadl_2DANnNU7FWKgkQF5_w59Fzo3ED4EFLFB8gCIMeDeB1dApzyFN7ErLsZWZBkQKvz-FrOoygdtjKoI5S3PZJPz0EcHzbjLmNFFx6u7Yk2aeQf8ZnqfwaUqgxUVgpcYpmhMM6lzao2sHu0Fw4kZs-Q8 Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 7d413fae6433451282e98d0deff85928 Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1802608836 Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7d413fae6433451282e98d0deff85928"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7d413fae6433451282e98d0deff85928"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7d413fae6433451282e98d0deff85928"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7d413fae6433451282e98d0deff85928"}]}] Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-InstanceActionsV221TestJSON-1802608836 Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 7d413fae6433451282e98d0deff85928 Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1802608836 Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-InstanceActionsV221TestJSON-1802608836-project Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 860b8f63588a4096838b363d1c12dfc6 Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-InstanceActionsV221TestJSON-1802608836-project Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 could not be found. Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5'} Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 could not be found. Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 could not be found. Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:01.376393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:01.381833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:01.381833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:01.381833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:01.381833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:01.381833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:01.381833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:01.381833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 could not be found. Oct 04 21:21:01.381833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:01.388609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4570201d-8537-4cfd-b681-d8019aa3f488 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Returning 404 to user: Instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:01.390948 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4570201d-8537-4cfd-b681-d8019aa3f488 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5" status: 404 len: 111 microversion: 2.21 time: 0.076909 Oct 04 21:21:01.391796 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1609/3281] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:01 2022] GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:21:01.398990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-851d43f1-d969-41bf-9840-68c63023de32 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:01.400086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-851d43f1-d969-41bf-9840-68c63023de32 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: e6cb4528-b297-45b4-a0e3-d39236df0178] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:01.410189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-851d43f1-d969-41bf-9840-68c63023de32 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:01.410785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-851d43f1-d969-41bf-9840-68c63023de32 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:01.411894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-851d43f1-d969-41bf-9840-68c63023de32 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:01.414020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-851d43f1-d969-41bf-9840-68c63023de32 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:01.414623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-851d43f1-d969-41bf-9840-68c63023de32 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:01.415633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-851d43f1-d969-41bf-9840-68c63023de32 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:01.576019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-851d43f1-d969-41bf-9840-68c63023de32 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:01.602256 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-851d43f1-d969-41bf-9840-68c63023de32 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178" status: 200 len: 1267 microversion: 2.1 time: 0.208870 Oct 04 21:21:01.603362 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1610/3282] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:01 2022] GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178 => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:01.625682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d61546e9-2759-4c96-a626-e1ee47bd900a tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:01.651283 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d61546e9-2759-4c96-a626-e1ee47bd900a tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.045382 Oct 04 21:21:01.651875 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1611/3283] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:21:01 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:01.667270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8fb7b2a2-c99d-4aff-82a9-8441c7b10f45 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '.version_select at 0x7f578b76f430>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:01.668069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8fb7b2a2-c99d-4aff-82a9-8441c7b10f45 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:01.672897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:01.678040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fb7b2a2-c99d-4aff-82a9-8441c7b10f45 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:01.678774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fb7b2a2-c99d-4aff-82a9-8441c7b10f45 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:01.679680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fb7b2a2-c99d-4aff-82a9-8441c7b10f45 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:01.680587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fb7b2a2-c99d-4aff-82a9-8441c7b10f45 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:01.681210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fb7b2a2-c99d-4aff-82a9-8441c7b10f45 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:01.681935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fb7b2a2-c99d-4aff-82a9-8441c7b10f45 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:01.779186 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8fb7b2a2-c99d-4aff-82a9-8441c7b10f45 tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.116717 Oct 04 21:21:01.780247 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1612/3284] 10.222.0.30 () {60 vars in 1337 bytes} [Tue Oct 4 21:21:01 2022] GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5/os-instance-actions => generated 611 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:21:01.794559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9ecba1a3-988d-49ef-a0f0-fa8bcbe4123f tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:01.878849 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9ecba1a3-988d-49ef-a0f0-fa8bcbe4123f tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/d474a426-6c34-443a-aaa5-0ed462dcc12a" status: 204 len: 0 microversion: 2.1 time: 0.097363 Oct 04 21:21:01.883623 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1613/3285] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Oct 4 21:21:01 2022] DELETE /compute/v2.1/os-server-groups/d474a426-6c34-443a-aaa5-0ed462dcc12a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:21:01.888094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a5a0093f-6a78-4e61-8c3a-63aa82224b6d tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:01.888601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a5a0093f-6a78-4e61-8c3a-63aa82224b6d tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:01.941885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5a0093f-6a78-4e61-8c3a-63aa82224b6d tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:01.942399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5a0093f-6a78-4e61-8c3a-63aa82224b6d tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:01.946455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5a0093f-6a78-4e61-8c3a-63aa82224b6d tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:01.947262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5a0093f-6a78-4e61-8c3a-63aa82224b6d tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:01.947732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5a0093f-6a78-4e61-8c3a-63aa82224b6d tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:01.948944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5a0093f-6a78-4e61-8c3a-63aa82224b6d tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:01.983919 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-a5a0093f-6a78-4e61-8c3a-63aa82224b6d tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] HTTP exception thrown: Instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 could not be found. Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a5a0093f-6a78-4e61-8c3a-63aa82224b6d tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Request method failure captured: Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 HTTP/1.1 Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKOTd87u0se1pGThYsfDrmBadl_2DANnNU7FWKgkQF5_w59Fzo3ED4EFLFB8gCIMeDeB1dApzyFN7ErLsZWZBkQKvz-FrOoygdtjKoI5S3PZJPz0EcHzbjLmNFFx6u7Yk2aeQf8ZnqfwaUqgxUVgpcYpmhMM6lzao2sHu0Fw4kZs-Q8 Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 7d413fae6433451282e98d0deff85928 Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1802608836 Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7d413fae6433451282e98d0deff85928"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7d413fae6433451282e98d0deff85928"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7d413fae6433451282e98d0deff85928"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7d413fae6433451282e98d0deff85928"}]}] Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-InstanceActionsV221TestJSON-1802608836 Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 7d413fae6433451282e98d0deff85928 Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1802608836 Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-InstanceActionsV221TestJSON-1802608836-project Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 860b8f63588a4096838b363d1c12dfc6 Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-InstanceActionsV221TestJSON-1802608836-project Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 could not be found. Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5'} Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 could not be found. Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:21:01.985857 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:21:01.991315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 could not be found. Oct 04 21:21:01.991315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:01.991315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:01.991315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:01.991315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:01.991315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:01.991315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:01.991315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:01.991315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:01.991315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 could not be found. Oct 04 21:21:01.991315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:01.997518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a5a0093f-6a78-4e61-8c3a-63aa82224b6d tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Returning 404 to user: Instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:01.998635 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a5a0093f-6a78-4e61-8c3a-63aa82224b6d tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5" status: 404 len: 111 microversion: 2.21 time: 0.116359 Oct 04 21:21:02.001543 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1614/3286] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:21:01 2022] DELETE /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:21:02.014332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f1d35949-a982-4d23-b678-3c71b6dba74c tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:02.027424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-f2925298-8a34-421b-9767-446a5bf61aab tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Updating instance_info_cache with network_info: [{"id": "44d57a4f-f68d-4e25-9d73-71f36d48763b", "address": "fa:16:3e:f2:e8:06", "network": {"id": "91b9f9a5-3b10-4582-a6c4-fb08af7ca69c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-465349262-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fbb2758d2dc64f70934d8161bf600f94", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap44d57a4f-f6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122758) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:21:02.041176 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f1d35949-a982-4d23-b678-3c71b6dba74c tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.037530 Oct 04 21:21:02.041889 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1615/3287] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:21:02 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:02.054756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2d48699b-1db9-4fc4-b9c7-ae12d70d9b6c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:02.055917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2d48699b-1db9-4fc4-b9c7-ae12d70d9b6c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] [instance: 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:02.063677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d48699b-1db9-4fc4-b9c7-ae12d70d9b6c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:02.064638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d48699b-1db9-4fc4-b9c7-ae12d70d9b6c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:02.065328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d48699b-1db9-4fc4-b9c7-ae12d70d9b6c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:02.066305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d48699b-1db9-4fc4-b9c7-ae12d70d9b6c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:02.066982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d48699b-1db9-4fc4-b9c7-ae12d70d9b6c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:02.067633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d48699b-1db9-4fc4-b9c7-ae12d70d9b6c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:02.096108 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-2d48699b-1db9-4fc4-b9c7-ae12d70d9b6c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] HTTP exception thrown: Instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 could not be found. Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2d48699b-1db9-4fc4-b9c7-ae12d70d9b6c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Request method failure captured: Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 HTTP/1.1 Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKOTd87u0se1pGThYsfDrmBadl_2DANnNU7FWKgkQF5_w59Fzo3ED4EFLFB8gCIMeDeB1dApzyFN7ErLsZWZBkQKvz-FrOoygdtjKoI5S3PZJPz0EcHzbjLmNFFx6u7Yk2aeQf8ZnqfwaUqgxUVgpcYpmhMM6lzao2sHu0Fw4kZs-Q8 Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 7d413fae6433451282e98d0deff85928 Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1802608836 Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7d413fae6433451282e98d0deff85928"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7d413fae6433451282e98d0deff85928"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7d413fae6433451282e98d0deff85928"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7d413fae6433451282e98d0deff85928"}]}] Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-InstanceActionsV221TestJSON-1802608836 Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 7d413fae6433451282e98d0deff85928 Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1802608836 Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-InstanceActionsV221TestJSON-1802608836-project Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 860b8f63588a4096838b363d1c12dfc6 Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-InstanceActionsV221TestJSON-1802608836-project Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 could not be found. Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5'} Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 could not be found. Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 could not be found. Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:02.098061 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:02.104024 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:02.104024 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:02.104024 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:02.104024 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:02.104024 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:02.104024 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:02.104024 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 could not be found. Oct 04 21:21:02.104024 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:02.106880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2d48699b-1db9-4fc4-b9c7-ae12d70d9b6c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] Returning 404 to user: Instance 2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:02.107952 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2d48699b-1db9-4fc4-b9c7-ae12d70d9b6c tempest-InstanceActionsV221TestJSON-1802608836 tempest-InstanceActionsV221TestJSON-1802608836-project] 10.222.0.30 "GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5" status: 404 len: 111 microversion: 2.21 time: 0.063622 Oct 04 21:21:02.109140 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1616/3288] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:02 2022] GET /compute/v2.1/servers/2ec30c94-2bbb-4c6f-8432-2a2f8ae4a4a5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:21:02.131958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-be5d8256-3c2c-4270-83f2-0605022f8aee req-7bd1dfa4-1e0b-4627-b1f7-168c948a78c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "319803c6-077c-4267-84e2-cb90f261aedc", "tag": "44d57a4f-f68d-4e25-9d73-71f36d48763b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:02.146290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2925298-8a34-421b-9767-446a5bf61aab tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Releasing lock "refresh_cache-319803c6-077c-4267-84e2-cb90f261aedc" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:21:02.147630 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f2925298-8a34-421b-9767-446a5bf61aab tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "POST /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc/action" status: 202 len: 0 microversion: 2.1 time: 7.734055 Oct 04 21:21:02.148812 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1673/3289] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:20:54 2022] POST /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc/action => generated 0 bytes in 7736 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 21:21:02.154577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f64492fe-64b0-457a-b27b-ee41e9c31e4a tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Action: 'create', calling method: .version_select at 0x7f5790b3d1f0>, body: {"server_group": {"name": "tempest-server-group-952473659", "policies": ["affinity"]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:02.179592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-be5d8256-3c2c-4270-83f2-0605022f8aee req-7bd1dfa4-1e0b-4627-b1f7-168c948a78c9 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:02.188814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-be5d8256-3c2c-4270-83f2-0605022f8aee req-7bd1dfa4-1e0b-4627-b1f7-168c948a78c9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:02.190002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-be5d8256-3c2c-4270-83f2-0605022f8aee req-7bd1dfa4-1e0b-4627-b1f7-168c948a78c9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:02.221661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-f64492fe-64b0-457a-b27b-ee41e9c31e4a tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:21:02.224723 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-be5d8256-3c2c-4270-83f2-0605022f8aee req-7bd1dfa4-1e0b-4627-b1f7-168c948a78c9 service nova] Creating event network-changed:44d57a4f-f68d-4e25-9d73-71f36d48763b for instance 319803c6-077c-4267-84e2-cb90f261aedc on n-h1-860282-1 Oct 04 21:21:02.243030 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-be5d8256-3c2c-4270-83f2-0605022f8aee req-7bd1dfa4-1e0b-4627-b1f7-168c948a78c9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129876 Oct 04 21:21:02.244821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-f64492fe-64b0-457a-b27b-ee41e9c31e4a tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for user c382de4f98bd4839851ad103b3f56aa6 and project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:21:02.252257 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1617/3290] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:02.268870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9015d179-ec7f-43f7-be59-ad4b1933c4d5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:02.272656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9015d179-ec7f-43f7-be59-ad4b1933c4d5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:02.323176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9015d179-ec7f-43f7-be59-ad4b1933c4d5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:02.325005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9015d179-ec7f-43f7-be59-ad4b1933c4d5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:02.325874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9015d179-ec7f-43f7-be59-ad4b1933c4d5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:02.331409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9015d179-ec7f-43f7-be59-ad4b1933c4d5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:02.332294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9015d179-ec7f-43f7-be59-ad4b1933c4d5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:02.334036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9015d179-ec7f-43f7-be59-ad4b1933c4d5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:02.347260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:02.523592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-f64492fe-64b0-457a-b27b-ee41e9c31e4a tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:21:02.548937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-f64492fe-64b0-457a-b27b-ee41e9c31e4a tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for user c382de4f98bd4839851ad103b3f56aa6 and project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:21:02.568961 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f64492fe-64b0-457a-b27b-ee41e9c31e4a tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.418782 Oct 04 21:21:02.569812 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1674/3291] 10.222.0.30 () {60 vars in 1173 bytes} [Tue Oct 4 21:21:02 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:02.585183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7021bef3-e14d-4314-af41-075293e56331 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Action: 'action', calling method: .version_select at 0x7f5791effca0>, body: {"removeFloatingIp": {"address": "172.25.8.231"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:03.071037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9015d179-ec7f-43f7-be59-ad4b1933c4d5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:03.084485 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9015d179-ec7f-43f7-be59-ad4b1933c4d5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1681 microversion: 2.1 time: 0.827872 Oct 04 21:21:03.085942 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1618/3292] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:02 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1681 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:03.119318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d9f68546-6283-4335-a95a-1f06a72cf743 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:03.182744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7021bef3-e14d-4314-af41-075293e56331 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:03.193141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7021bef3-e14d-4314-af41-075293e56331 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:03.193141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7021bef3-e14d-4314-af41-075293e56331 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:03.193141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7021bef3-e14d-4314-af41-075293e56331 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:03.195203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7021bef3-e14d-4314-af41-075293e56331 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:03.198526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7021bef3-e14d-4314-af41-075293e56331 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:03.200725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7021bef3-e14d-4314-af41-075293e56331 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:03.316184 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d9f68546-6283-4335-a95a-1f06a72cf743 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/fbc950f8-1080-4488-baeb-830bb164f354" status: 204 len: 0 microversion: 2.1 time: 0.207935 Oct 04 21:21:03.321510 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1619/3293] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Oct 4 21:21:03 2022] DELETE /compute/v2.1/os-server-groups/fbc950f8-1080-4488-baeb-830bb164f354 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:21:03.326855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c1516e61-18d8-4de5-82c1-3b4e653cba14 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:03.328522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c1516e61-18d8-4de5-82c1-3b4e653cba14 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: e6cb4528-b297-45b4-a0e3-d39236df0178] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:03.366022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1516e61-18d8-4de5-82c1-3b4e653cba14 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:03.367296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1516e61-18d8-4de5-82c1-3b4e653cba14 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:03.372847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1516e61-18d8-4de5-82c1-3b4e653cba14 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:03.377451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1516e61-18d8-4de5-82c1-3b4e653cba14 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:03.381516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1516e61-18d8-4de5-82c1-3b4e653cba14 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:03.387698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1516e61-18d8-4de5-82c1-3b4e653cba14 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:03.699335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c1516e61-18d8-4de5-82c1-3b4e653cba14 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:03.729590 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c1516e61-18d8-4de5-82c1-3b4e653cba14 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178" status: 200 len: 1273 microversion: 2.1 time: 0.395840 Oct 04 21:21:03.729590 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1620/3294] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:03 2022] GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178 => generated 1273 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:03.729590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bf961a40-c993-44e9-9e41-8da8ab33bd76 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:03.791922 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bf961a40-c993-44e9-9e41-8da8ab33bd76 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.073597 Oct 04 21:21:03.791922 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1621/3295] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:21:03 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:03.815457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a2692852-6423-4748-b646-479515c00cb7 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Action: 'create', calling method: .version_select at 0x7f578b725790>, body: {"server_group": {"name": "tempest-server-group-688905666", "policies": ["anti-affinity"]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:03.885696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-a2692852-6423-4748-b646-479515c00cb7 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:21:03.908908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-a2692852-6423-4748-b646-479515c00cb7 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for user c382de4f98bd4839851ad103b3f56aa6 and project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:21:03.984059 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-7021bef3-e14d-4314-af41-075293e56331 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] HTTP exception thrown: Floating IP 172.25.8.231 is not associated with instance 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6. Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7021bef3-e14d-4314-af41-075293e56331 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Request method failure captured: Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6/action HTTP/1.1 Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 49 Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKNoLBxiQolSl6Nag98IU0LwILvMTA3F92QIJR7IF5rdTWFrQObO76q2Mrv_ICE6KyAVdr2bozpD-JyNZ7WXncDojo8WedfbbyO0dlDoqRDPy884vxb3lKIz7WcRmHihPKLPN_DxZH08CBiFvT0Cul3PvOBFLTrtut9dKF_j3VkSKQk Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: fbb2758d2dc64f70934d8161bf600f94 Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-683137430 Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb2758d2dc64f70934d8161bf600f94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbb2758d2dc64f70934d8161bf600f94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbb2758d2dc64f70934d8161bf600f94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb2758d2dc64f70934d8161bf600f94"}]}] Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-683137430 Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: fbb2758d2dc64f70934d8161bf600f94 Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-683137430 Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-FloatingIPsAssociationTestJSON-683137430-project Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 1b329e207cac4d459d25623d6554f444 Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-683137430-project Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: {"removeFloatingIp": {"address": "172.25.8.231"}} Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: exception: Floating IP 172.25.8.231 is not associated with instance 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6. Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '6ccadfb7-f678-4ca9-9f01-7b268c2e1db6', 'body': {'removeFloatingIp': {'address': '172.25.8.231'}}} Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.8.231 is not associated with instance 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6. Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.8.231 is not associated with instance 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6. Oct 04 21:21:03.985545 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:03.991289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7021bef3-e14d-4314-af41-075293e56331 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Returning 409 to user: Floating IP 172.25.8.231 is not associated with instance 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:03.992337 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7021bef3-e14d-4314-af41-075293e56331 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "POST /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6/action" status: 409 len: 146 microversion: 2.1 time: 1.421335 Oct 04 21:21:03.993103 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1675/3296] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:21:02 2022] POST /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6/action => generated 146 bytes in 1422 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:21:04.003255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9b908191-22fc-4929-8a7b-43df56f9a9ef tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.231"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:04.206148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-a2692852-6423-4748-b646-479515c00cb7 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:21:04.220780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-a2692852-6423-4748-b646-479515c00cb7 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for user c382de4f98bd4839851ad103b3f56aa6 and project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:21:04.251460 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a2692852-6423-4748-b646-479515c00cb7 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.445356 Oct 04 21:21:04.262379 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1622/3297] 10.222.0.30 () {60 vars in 1173 bytes} [Tue Oct 4 21:21:03 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:04.269156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0c49ab40-0e6b-4fc2-8be9-745fd70f1819 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:04.275581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0c49ab40-0e6b-4fc2-8be9-745fd70f1819 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:04.288417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c49ab40-0e6b-4fc2-8be9-745fd70f1819 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:04.289266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c49ab40-0e6b-4fc2-8be9-745fd70f1819 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:04.290067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c49ab40-0e6b-4fc2-8be9-745fd70f1819 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:04.291021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c49ab40-0e6b-4fc2-8be9-745fd70f1819 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:04.291643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c49ab40-0e6b-4fc2-8be9-745fd70f1819 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:04.292238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c49ab40-0e6b-4fc2-8be9-745fd70f1819 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:04.326034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9b908191-22fc-4929-8a7b-43df56f9a9ef tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:04.333391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b908191-22fc-4929-8a7b-43df56f9a9ef tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:04.334962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b908191-22fc-4929-8a7b-43df56f9a9ef tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:04.338077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b908191-22fc-4929-8a7b-43df56f9a9ef tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:04.340046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b908191-22fc-4929-8a7b-43df56f9a9ef tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:04.342353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b908191-22fc-4929-8a7b-43df56f9a9ef tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:04.366523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b908191-22fc-4929-8a7b-43df56f9a9ef tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:04.643935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0c49ab40-0e6b-4fc2-8be9-745fd70f1819 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:04.667357 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0c49ab40-0e6b-4fc2-8be9-745fd70f1819 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1681 microversion: 2.1 time: 0.403219 Oct 04 21:21:04.668851 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1623/3298] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:04 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1681 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:04.685157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-68e1531e-d500-4358-96aa-d0338ccb7a38 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:04.848951 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-68e1531e-d500-4358-96aa-d0338ccb7a38 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/c46db76b-b002-4489-805e-8f3cf774e1a8" status: 204 len: 0 microversion: 2.1 time: 0.178741 Oct 04 21:21:04.849573 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1624/3299] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Oct 4 21:21:04 2022] DELETE /compute/v2.1/os-server-groups/c46db76b-b002-4489-805e-8f3cf774e1a8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:21:04.861377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-31a0ac65-f6c7-4090-bb5b-87b0c4841c60 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:04.862082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-31a0ac65-f6c7-4090-bb5b-87b0c4841c60 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: e6cb4528-b297-45b4-a0e3-d39236df0178] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:04.897597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31a0ac65-f6c7-4090-bb5b-87b0c4841c60 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:04.900194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31a0ac65-f6c7-4090-bb5b-87b0c4841c60 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:04.900572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31a0ac65-f6c7-4090-bb5b-87b0c4841c60 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:04.901471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31a0ac65-f6c7-4090-bb5b-87b0c4841c60 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:04.906054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31a0ac65-f6c7-4090-bb5b-87b0c4841c60 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:04.906854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31a0ac65-f6c7-4090-bb5b-87b0c4841c60 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:05.784482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b908191-22fc-4929-8a7b-43df56f9a9ef tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "refresh_cache-319803c6-077c-4267-84e2-cb90f261aedc" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:21:05.786258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b908191-22fc-4929-8a7b-43df56f9a9ef tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquired lock "refresh_cache-319803c6-077c-4267-84e2-cb90f261aedc" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:21:05.987259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-31a0ac65-f6c7-4090-bb5b-87b0c4841c60 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:05.998361 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-31a0ac65-f6c7-4090-bb5b-87b0c4841c60 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178" status: 200 len: 1315 microversion: 2.1 time: 1.147130 Oct 04 21:21:06.002956 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1625/3300] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:04 2022] GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178 => generated 1315 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:06.021641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-edc9f6b3-25ab-44e1-955a-0ed27627222f tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:06.060905 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-edc9f6b3-25ab-44e1-955a-0ed27627222f tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.056416 Oct 04 21:21:06.064997 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1626/3301] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:21:06 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:06.095008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-64b6af2c-a437-46df-ad94-0a7d4c477ef5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:06.095634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-64b6af2c-a437-46df-ad94-0a7d4c477ef5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:06.106905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64b6af2c-a437-46df-ad94-0a7d4c477ef5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:06.111986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64b6af2c-a437-46df-ad94-0a7d4c477ef5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:06.113670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64b6af2c-a437-46df-ad94-0a7d4c477ef5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:06.117405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64b6af2c-a437-46df-ad94-0a7d4c477ef5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:06.118146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64b6af2c-a437-46df-ad94-0a7d4c477ef5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:06.118804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64b6af2c-a437-46df-ad94-0a7d4c477ef5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:06.593488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-64b6af2c-a437-46df-ad94-0a7d4c477ef5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:06.609578 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-64b6af2c-a437-46df-ad94-0a7d4c477ef5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1681 microversion: 2.1 time: 0.540827 Oct 04 21:21:06.610613 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1627/3302] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:06 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1681 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:06.617697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1704082658", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "0d0828bf-e873-4192-8a62-13021a7fc7d7"}]}, "os:scheduler_hints": {"group": "a8813a40-394a-495a-a359-6cc5764e6025"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:06.711273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] validate_networks() for [('0d0828bf-e873-4192-8a62-13021a7fc7d7', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:21:07.757081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:07.924846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:21:07.925818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:21:07.926773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:21:07.928541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:21:07.929217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:21:08.001862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:08.002368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:08.002817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:08.003561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:08.014364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:08.019017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:08.030585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-9b908191-22fc-4929-8a7b-43df56f9a9ef tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Building network info cache for instance {{(pid=122758) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 21:21:08.097838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for project 4e38e36770ed4a498dff7e336aa466af. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:21:08.105379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for user c382de4f98bd4839851ad103b3f56aa6 and project 4e38e36770ed4a498dff7e336aa466af. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:21:08.125151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:21:08.128264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:21:08.300514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122757) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 04 21:21:08.359284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_group_members'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:21:08.373735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=9,nova_api:INSERT=5 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:08.394780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for user c382de4f98bd4839851ad103b3f56aa6 and project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_group_members'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:21:08.667234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_group_members'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:21:08.699526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Getting quotas for user c382de4f98bd4839851ad103b3f56aa6 and project 4e38e36770ed4a498dff7e336aa466af. Resources: {'server_group_members'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:21:08.822299 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5af27b41-5ffc-4ff9-bf76-b749388c7618 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.210377 Oct 04 21:21:08.825745 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1628/3303] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:21:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:21:08.834723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fe7a53bc-8db3-40d1-a493-52688f9aa2d9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:08.835391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fe7a53bc-8db3-40d1-a493-52688f9aa2d9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: e6cb4528-b297-45b4-a0e3-d39236df0178] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:08.901056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe7a53bc-8db3-40d1-a493-52688f9aa2d9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:08.901596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe7a53bc-8db3-40d1-a493-52688f9aa2d9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:08.902045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe7a53bc-8db3-40d1-a493-52688f9aa2d9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:08.902774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe7a53bc-8db3-40d1-a493-52688f9aa2d9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:08.903233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe7a53bc-8db3-40d1-a493-52688f9aa2d9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:08.914434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe7a53bc-8db3-40d1-a493-52688f9aa2d9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:09.790987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fe7a53bc-8db3-40d1-a493-52688f9aa2d9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:09.807593 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fe7a53bc-8db3-40d1-a493-52688f9aa2d9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178" status: 200 len: 1315 microversion: 2.1 time: 0.977393 Oct 04 21:21:09.812412 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1629/3304] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:08 2022] GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178 => generated 1315 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:09.823409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5fa6a4db-057d-4288-9e3d-541f78b90993 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:09.826555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5fa6a4db-057d-4288-9e3d-541f78b90993 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:09.842608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fa6a4db-057d-4288-9e3d-541f78b90993 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:09.849565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fa6a4db-057d-4288-9e3d-541f78b90993 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:09.851012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fa6a4db-057d-4288-9e3d-541f78b90993 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:09.852860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fa6a4db-057d-4288-9e3d-541f78b90993 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:09.853816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fa6a4db-057d-4288-9e3d-541f78b90993 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:09.855017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fa6a4db-057d-4288-9e3d-541f78b90993 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:10.236396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5fa6a4db-057d-4288-9e3d-541f78b90993 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:10.253842 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5fa6a4db-057d-4288-9e3d-541f78b90993 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1681 microversion: 2.1 time: 0.439619 Oct 04 21:21:10.255145 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1630/3305] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:09 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1681 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:10.272983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-12c07849-a4df-4f43-b5dc-b96b34a0c027 req-77bf6b31-f205-4e6f-8077-c5d2f450f044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "319803c6-077c-4267-84e2-cb90f261aedc", "tag": "44d57a4f-f68d-4e25-9d73-71f36d48763b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:10.291314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-12c07849-a4df-4f43-b5dc-b96b34a0c027 req-77bf6b31-f205-4e6f-8077-c5d2f450f044 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:10.292067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-12c07849-a4df-4f43-b5dc-b96b34a0c027 req-77bf6b31-f205-4e6f-8077-c5d2f450f044 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:10.294530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-12c07849-a4df-4f43-b5dc-b96b34a0c027 req-77bf6b31-f205-4e6f-8077-c5d2f450f044 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:10.324297 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-12c07849-a4df-4f43-b5dc-b96b34a0c027 req-77bf6b31-f205-4e6f-8077-c5d2f450f044 service nova] Creating event network-changed:44d57a4f-f68d-4e25-9d73-71f36d48763b for instance 319803c6-077c-4267-84e2-cb90f261aedc on n-h1-860282-1 Oct 04 21:21:10.340761 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-12c07849-a4df-4f43-b5dc-b96b34a0c027 req-77bf6b31-f205-4e6f-8077-c5d2f450f044 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084208 Oct 04 21:21:10.341960 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1631/3306] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:10.348281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-3f6ac15d-ad93-4386-b20c-f36790051bd1 req-5f32d8cf-7673-4ec2-bcc0-02c3e6292953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6cb4528-b297-45b4-a0e3-d39236df0178", "tag": "c5f1452b-d3bc-4c8e-94d6-828e3670af57"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:10.369318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3f6ac15d-ad93-4386-b20c-f36790051bd1 req-5f32d8cf-7673-4ec2-bcc0-02c3e6292953 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:10.369318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3f6ac15d-ad93-4386-b20c-f36790051bd1 req-5f32d8cf-7673-4ec2-bcc0-02c3e6292953 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:10.369318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3f6ac15d-ad93-4386-b20c-f36790051bd1 req-5f32d8cf-7673-4ec2-bcc0-02c3e6292953 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:10.383486 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-3f6ac15d-ad93-4386-b20c-f36790051bd1 req-5f32d8cf-7673-4ec2-bcc0-02c3e6292953 service nova] Creating event network-changed:c5f1452b-d3bc-4c8e-94d6-828e3670af57 for instance e6cb4528-b297-45b4-a0e3-d39236df0178 on n-h1-860282-1 Oct 04 21:21:10.391753 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-3f6ac15d-ad93-4386-b20c-f36790051bd1 req-5f32d8cf-7673-4ec2-bcc0-02c3e6292953 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047201 Oct 04 21:21:10.396781 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1632/3307] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:10.402383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6575503d-ba7b-4d4e-adbf-edbd1fe342f4 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:10.405705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6575503d-ba7b-4d4e-adbf-edbd1fe342f4 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:10.493109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6575503d-ba7b-4d4e-adbf-edbd1fe342f4 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382de4f98bd4839851ad103b3f56aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e38e36770ed4a498dff7e336aa466af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:10.501092 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6575503d-ba7b-4d4e-adbf-edbd1fe342f4 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265" status: 200 len: 1213 microversion: 2.1 time: 0.103352 Oct 04 21:21:10.501696 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1633/3308] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:10 2022] GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:10.513542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-9b908191-22fc-4929-8a7b-43df56f9a9ef tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Updating instance_info_cache with network_info: [{"id": "44d57a4f-f68d-4e25-9d73-71f36d48763b", "address": "fa:16:3e:f2:e8:06", "network": {"id": "91b9f9a5-3b10-4582-a6c4-fb08af7ca69c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-465349262-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fbb2758d2dc64f70934d8161bf600f94", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap44d57a4f-f6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122758) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:21:10.680424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b908191-22fc-4929-8a7b-43df56f9a9ef tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Releasing lock "refresh_cache-319803c6-077c-4267-84e2-cb90f261aedc" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:21:10.680424 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9b908191-22fc-4929-8a7b-43df56f9a9ef tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "POST /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc/action" status: 202 len: 0 microversion: 2.1 time: 6.674703 Oct 04 21:21:10.680424 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1676/3309] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:21:03 2022] POST /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc/action => generated 0 bytes in 6678 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 21:21:10.690200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fa46829e-890d-4444-933f-185d417a3fe8 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:10.692241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fa46829e-890d-4444-933f-185d417a3fe8 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:10.727241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa46829e-890d-4444-933f-185d417a3fe8 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:10.727818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa46829e-890d-4444-933f-185d417a3fe8 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:10.728261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa46829e-890d-4444-933f-185d417a3fe8 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:10.729019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa46829e-890d-4444-933f-185d417a3fe8 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:10.729548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa46829e-890d-4444-933f-185d417a3fe8 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:10.729962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa46829e-890d-4444-933f-185d417a3fe8 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:10.812493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fa46829e-890d-4444-933f-185d417a3fe8 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:21:10.852532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-088efc83-edcc-4691-b31f-b7de71aa6db4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:10.854782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-088efc83-edcc-4691-b31f-b7de71aa6db4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: e6cb4528-b297-45b4-a0e3-d39236df0178] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:10.869496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-088efc83-edcc-4691-b31f-b7de71aa6db4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:10.870006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-088efc83-edcc-4691-b31f-b7de71aa6db4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:10.870452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-088efc83-edcc-4691-b31f-b7de71aa6db4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:10.875173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-088efc83-edcc-4691-b31f-b7de71aa6db4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:10.875672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-088efc83-edcc-4691-b31f-b7de71aa6db4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:10.876119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-088efc83-edcc-4691-b31f-b7de71aa6db4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:11.518313 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fa46829e-890d-4444-933f-185d417a3fe8 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "DELETE /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc" status: 204 len: 0 microversion: 2.1 time: 0.829309 Oct 04 21:21:11.518313 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1634/3310] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:21:10 2022] DELETE /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc => generated 0 bytes in 835 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:21:11.542341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cdac3e40-5e67-4363-99c1-f04711267d1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:11.578396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cdac3e40-5e67-4363-99c1-f04711267d1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:11.607303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cdac3e40-5e67-4363-99c1-f04711267d1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:11.612144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cdac3e40-5e67-4363-99c1-f04711267d1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:11.615320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cdac3e40-5e67-4363-99c1-f04711267d1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:11.631677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cdac3e40-5e67-4363-99c1-f04711267d1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:11.634291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cdac3e40-5e67-4363-99c1-f04711267d1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:11.636131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cdac3e40-5e67-4363-99c1-f04711267d1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:11.917875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-088efc83-edcc-4691-b31f-b7de71aa6db4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:11.947926 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-088efc83-edcc-4691-b31f-b7de71aa6db4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178" status: 200 len: 1315 microversion: 2.1 time: 1.100719 Oct 04 21:21:11.947926 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1677/3311] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:10 2022] GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178 => generated 1315 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:11.953370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8b76a2c2-fa1a-46f2-90b5-603ce4196229 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.231"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:11.957527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8b76a2c2-fa1a-46f2-90b5-603ce4196229 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:11.986301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b76a2c2-fa1a-46f2-90b5-603ce4196229 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:11.992315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b76a2c2-fa1a-46f2-90b5-603ce4196229 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:11.992777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b76a2c2-fa1a-46f2-90b5-603ce4196229 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:11.993578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b76a2c2-fa1a-46f2-90b5-603ce4196229 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:11.994047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b76a2c2-fa1a-46f2-90b5-603ce4196229 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:11.994479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b76a2c2-fa1a-46f2-90b5-603ce4196229 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:12.046495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b76a2c2-fa1a-46f2-90b5-603ce4196229 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "refresh_cache-6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:21:12.046940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b76a2c2-fa1a-46f2-90b5-603ce4196229 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquired lock "refresh_cache-6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:21:12.137235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cdac3e40-5e67-4363-99c1-f04711267d1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:12.148754 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cdac3e40-5e67-4363-99c1-f04711267d1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1681 microversion: 2.1 time: 0.628814 Oct 04 21:21:12.151842 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1635/3312] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:11 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1681 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:12.166788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1a5892bf-6839-4acc-8d77-9562f1dc21be tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:12.166788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1a5892bf-6839-4acc-8d77-9562f1dc21be tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:12.180144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a5892bf-6839-4acc-8d77-9562f1dc21be tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:12.180646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a5892bf-6839-4acc-8d77-9562f1dc21be tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:12.181089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a5892bf-6839-4acc-8d77-9562f1dc21be tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:12.181838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a5892bf-6839-4acc-8d77-9562f1dc21be tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:12.182302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a5892bf-6839-4acc-8d77-9562f1dc21be tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:12.182733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a5892bf-6839-4acc-8d77-9562f1dc21be tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:12.426179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1a5892bf-6839-4acc-8d77-9562f1dc21be tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382de4f98bd4839851ad103b3f56aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e38e36770ed4a498dff7e336aa466af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:12.446031 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1a5892bf-6839-4acc-8d77-9562f1dc21be tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265" status: 200 len: 1209 microversion: 2.1 time: 0.291084 Oct 04 21:21:12.446666 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1636/3313] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:12 2022] GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 => generated 1209 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:12.563659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:12.963192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-99e710ce-6cd8-4bc3-aef9-fb523763f7ce tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:12.963882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-99e710ce-6cd8-4bc3-aef9-fb523763f7ce tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: e6cb4528-b297-45b4-a0e3-d39236df0178] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:13.003550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99e710ce-6cd8-4bc3-aef9-fb523763f7ce tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:13.011956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99e710ce-6cd8-4bc3-aef9-fb523763f7ce tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:13.015725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99e710ce-6cd8-4bc3-aef9-fb523763f7ce tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:13.020668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99e710ce-6cd8-4bc3-aef9-fb523763f7ce tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:13.022567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99e710ce-6cd8-4bc3-aef9-fb523763f7ce tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:13.026743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99e710ce-6cd8-4bc3-aef9-fb523763f7ce tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:13.658255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-99e710ce-6cd8-4bc3-aef9-fb523763f7ce tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:13.671780 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-99e710ce-6cd8-4bc3-aef9-fb523763f7ce tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178" status: 200 len: 1315 microversion: 2.1 time: 0.713026 Oct 04 21:21:13.700717 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1637/3314] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:12 2022] GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178 => generated 1315 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:13.732965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-972170ca-e7e4-44fe-9e21-47eb9430c4fd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:13.738830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-972170ca-e7e4-44fe-9e21-47eb9430c4fd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:13.753338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-972170ca-e7e4-44fe-9e21-47eb9430c4fd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:13.755778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-972170ca-e7e4-44fe-9e21-47eb9430c4fd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:13.756509 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-972170ca-e7e4-44fe-9e21-47eb9430c4fd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:13.757660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-972170ca-e7e4-44fe-9e21-47eb9430c4fd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:13.758553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-972170ca-e7e4-44fe-9e21-47eb9430c4fd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:13.759235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-972170ca-e7e4-44fe-9e21-47eb9430c4fd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:14.677823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-972170ca-e7e4-44fe-9e21-47eb9430c4fd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:14.677823 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-972170ca-e7e4-44fe-9e21-47eb9430c4fd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1681 microversion: 2.1 time: 0.851516 Oct 04 21:21:14.677823 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1638/3315] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:13 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1681 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:14.677823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-15ba2d14-0b00-4ce1-93e7-fc77d3ea0156 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:14.677823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-15ba2d14-0b00-4ce1-93e7-fc77d3ea0156 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:14.677823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15ba2d14-0b00-4ce1-93e7-fc77d3ea0156 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:14.677823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15ba2d14-0b00-4ce1-93e7-fc77d3ea0156 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:14.677823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15ba2d14-0b00-4ce1-93e7-fc77d3ea0156 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:14.677823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15ba2d14-0b00-4ce1-93e7-fc77d3ea0156 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:14.677823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15ba2d14-0b00-4ce1-93e7-fc77d3ea0156 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:14.677823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15ba2d14-0b00-4ce1-93e7-fc77d3ea0156 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:14.707383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-15ba2d14-0b00-4ce1-93e7-fc77d3ea0156 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382de4f98bd4839851ad103b3f56aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e38e36770ed4a498dff7e336aa466af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:14.715972 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-15ba2d14-0b00-4ce1-93e7-fc77d3ea0156 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265" status: 200 len: 1271 microversion: 2.1 time: 0.140797 Oct 04 21:21:14.717879 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1639/3316] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:14 2022] GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 => generated 1271 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:14.731579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-061b3199-f914-458e-b921-9e611a7bc8e3 req-fa468ed2-a76f-49e8-b866-75e09e2eafe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6cb4528-b297-45b4-a0e3-d39236df0178", "name": "network-vif-plugged", "status": "completed", "tag": "c5f1452b-d3bc-4c8e-94d6-828e3670af57"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:14.743223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-061b3199-f914-458e-b921-9e611a7bc8e3 req-fa468ed2-a76f-49e8-b866-75e09e2eafe5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:14.743895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-061b3199-f914-458e-b921-9e611a7bc8e3 req-fa468ed2-a76f-49e8-b866-75e09e2eafe5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:14.744458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-061b3199-f914-458e-b921-9e611a7bc8e3 req-fa468ed2-a76f-49e8-b866-75e09e2eafe5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:14.762163 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-061b3199-f914-458e-b921-9e611a7bc8e3 req-fa468ed2-a76f-49e8-b866-75e09e2eafe5 service nova] Creating event network-vif-plugged:c5f1452b-d3bc-4c8e-94d6-828e3670af57 for instance e6cb4528-b297-45b4-a0e3-d39236df0178 on n-h1-860282-1 Oct 04 21:21:14.767535 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-061b3199-f914-458e-b921-9e611a7bc8e3 req-fa468ed2-a76f-49e8-b866-75e09e2eafe5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048046 Oct 04 21:21:14.768332 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1640/3317] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:14.787448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-25087b9d-2cd1-4aa2-bc54-c1a6a6274c93 req-356b1b59-1712-4f60-a8f6-66437de81d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319803c6-077c-4267-84e2-cb90f261aedc", "name": "network-vif-deleted", "tag": "44d57a4f-f68d-4e25-9d73-71f36d48763b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:14.801159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-25087b9d-2cd1-4aa2-bc54-c1a6a6274c93 req-356b1b59-1712-4f60-a8f6-66437de81d80 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:14.805810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-25087b9d-2cd1-4aa2-bc54-c1a6a6274c93 req-356b1b59-1712-4f60-a8f6-66437de81d80 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:14.806337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-25087b9d-2cd1-4aa2-bc54-c1a6a6274c93 req-356b1b59-1712-4f60-a8f6-66437de81d80 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:14.823768 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-25087b9d-2cd1-4aa2-bc54-c1a6a6274c93 req-356b1b59-1712-4f60-a8f6-66437de81d80 service nova] Creating event network-vif-deleted:44d57a4f-f68d-4e25-9d73-71f36d48763b for instance 319803c6-077c-4267-84e2-cb90f261aedc on n-h1-860282-1 Oct 04 21:21:14.826359 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-25087b9d-2cd1-4aa2-bc54-c1a6a6274c93 req-356b1b59-1712-4f60-a8f6-66437de81d80 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056274 Oct 04 21:21:14.827959 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1641/3318] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:14.834705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-093253f6-620f-42e2-82a4-52d5d8f8959d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:14.835793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-093253f6-620f-42e2-82a4-52d5d8f8959d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: e6cb4528-b297-45b4-a0e3-d39236df0178] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:14.844058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-093253f6-620f-42e2-82a4-52d5d8f8959d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:14.844832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-093253f6-620f-42e2-82a4-52d5d8f8959d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:14.846778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-093253f6-620f-42e2-82a4-52d5d8f8959d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:14.846778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-093253f6-620f-42e2-82a4-52d5d8f8959d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:14.846778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-093253f6-620f-42e2-82a4-52d5d8f8959d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:14.847663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-093253f6-620f-42e2-82a4-52d5d8f8959d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:14.882343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:15.319463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-093253f6-620f-42e2-82a4-52d5d8f8959d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:15.329227 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-093253f6-620f-42e2-82a4-52d5d8f8959d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178" status: 200 len: 1315 microversion: 2.1 time: 0.499807 Oct 04 21:21:15.329882 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1642/3319] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:14 2022] GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:15.704114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-75af66f7-eacc-4e84-a505-d3d3c60c8422 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:15.705629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-75af66f7-eacc-4e84-a505-d3d3c60c8422 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:15.717985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75af66f7-eacc-4e84-a505-d3d3c60c8422 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:15.718880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75af66f7-eacc-4e84-a505-d3d3c60c8422 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:15.719590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75af66f7-eacc-4e84-a505-d3d3c60c8422 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:15.723909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75af66f7-eacc-4e84-a505-d3d3c60c8422 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:15.724906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75af66f7-eacc-4e84-a505-d3d3c60c8422 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:15.726494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75af66f7-eacc-4e84-a505-d3d3c60c8422 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:16.131103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-75af66f7-eacc-4e84-a505-d3d3c60c8422 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:16.169602 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-75af66f7-eacc-4e84-a505-d3d3c60c8422 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1681 microversion: 2.1 time: 0.469092 Oct 04 21:21:16.172738 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1643/3320] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:15 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1681 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:16.215005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9f7f781e-1286-43a9-8dbe-416fbb977e61 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:16.216516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9f7f781e-1286-43a9-8dbe-416fbb977e61 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:16.228240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f7f781e-1286-43a9-8dbe-416fbb977e61 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:16.229267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f7f781e-1286-43a9-8dbe-416fbb977e61 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:16.231578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f7f781e-1286-43a9-8dbe-416fbb977e61 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:16.231578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f7f781e-1286-43a9-8dbe-416fbb977e61 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:16.232004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f7f781e-1286-43a9-8dbe-416fbb977e61 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:16.234274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f7f781e-1286-43a9-8dbe-416fbb977e61 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:16.643285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-8b76a2c2-fa1a-46f2-90b5-603ce4196229 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Building network info cache for instance {{(pid=122758) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 21:21:16.651844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=52,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=4,nova_cell1:RELEASE=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:16.835541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9f7f781e-1286-43a9-8dbe-416fbb977e61 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382de4f98bd4839851ad103b3f56aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e38e36770ed4a498dff7e336aa466af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:16.851700 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9f7f781e-1286-43a9-8dbe-416fbb977e61 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265" status: 200 len: 1313 microversion: 2.1 time: 0.677396 Oct 04 21:21:16.852641 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1644/3321] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:16 2022] GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 => generated 1313 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:16.865709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2066273d-80ad-42c1-9b02-d71761dc4d42 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:16.866564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2066273d-80ad-42c1-9b02-d71761dc4d42 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: e6cb4528-b297-45b4-a0e3-d39236df0178] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:16.881029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2066273d-80ad-42c1-9b02-d71761dc4d42 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:16.882055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2066273d-80ad-42c1-9b02-d71761dc4d42 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:16.882867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2066273d-80ad-42c1-9b02-d71761dc4d42 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:16.883975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2066273d-80ad-42c1-9b02-d71761dc4d42 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:16.884623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2066273d-80ad-42c1-9b02-d71761dc4d42 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:16.885221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2066273d-80ad-42c1-9b02-d71761dc4d42 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:17.693156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2066273d-80ad-42c1-9b02-d71761dc4d42 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:17.714813 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2066273d-80ad-42c1-9b02-d71761dc4d42 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178" status: 200 len: 1502 microversion: 2.1 time: 0.861009 Oct 04 21:21:17.715443 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1645/3322] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:16 2022] GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178 => generated 1502 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:17.739350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-22d4c3e5-fe9b-4f05-adf9-451684c4abba req-b3bd2865-927c-4649-9dbc-575b228ed065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ccadfb7-f678-4ca9-9f01-7b268c2e1db6", "tag": "a6dd8a45-b585-411b-a35e-ee7bbc82f986"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:17.750358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-22d4c3e5-fe9b-4f05-adf9-451684c4abba req-b3bd2865-927c-4649-9dbc-575b228ed065 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:17.751178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-22d4c3e5-fe9b-4f05-adf9-451684c4abba req-b3bd2865-927c-4649-9dbc-575b228ed065 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:17.751846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-22d4c3e5-fe9b-4f05-adf9-451684c4abba req-b3bd2865-927c-4649-9dbc-575b228ed065 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:17.770357 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-22d4c3e5-fe9b-4f05-adf9-451684c4abba req-b3bd2865-927c-4649-9dbc-575b228ed065 service nova] Creating event network-changed:a6dd8a45-b585-411b-a35e-ee7bbc82f986 for instance 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 on n-h1-860282-1 Oct 04 21:21:17.776099 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-22d4c3e5-fe9b-4f05-adf9-451684c4abba req-b3bd2865-927c-4649-9dbc-575b228ed065 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048661 Oct 04 21:21:17.777141 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1646/3323] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:17.783142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-282d2456-9ef1-4f86-a04d-6534a30501f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:17.784075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-282d2456-9ef1-4f86-a04d-6534a30501f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:17.792309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-282d2456-9ef1-4f86-a04d-6534a30501f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:17.793613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-282d2456-9ef1-4f86-a04d-6534a30501f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:17.794114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-282d2456-9ef1-4f86-a04d-6534a30501f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:17.794862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-282d2456-9ef1-4f86-a04d-6534a30501f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:17.795460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-282d2456-9ef1-4f86-a04d-6534a30501f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:17.795944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-282d2456-9ef1-4f86-a04d-6534a30501f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:18.298901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-282d2456-9ef1-4f86-a04d-6534a30501f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:18.308380 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-282d2456-9ef1-4f86-a04d-6534a30501f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1681 microversion: 2.1 time: 0.529773 Oct 04 21:21:18.309269 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1647/3324] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:17 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1681 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:18.316605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5f50cad7-3284-4616-aae4-79324b436396 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1056990425"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:18.317149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5f50cad7-3284-4616-aae4-79324b436396 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: e6cb4528-b297-45b4-a0e3-d39236df0178] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:18.323754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f50cad7-3284-4616-aae4-79324b436396 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:18.324505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f50cad7-3284-4616-aae4-79324b436396 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:18.325239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f50cad7-3284-4616-aae4-79324b436396 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:18.325977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f50cad7-3284-4616-aae4-79324b436396 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:18.326432 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f50cad7-3284-4616-aae4-79324b436396 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:18.326920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f50cad7-3284-4616-aae4-79324b436396 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:18.330097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-8b76a2c2-fa1a-46f2-90b5-603ce4196229 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Updating instance_info_cache with network_info: [{"id": "a6dd8a45-b585-411b-a35e-ee7bbc82f986", "address": "fa:16:3e:d7:57:1b", "network": {"id": "91b9f9a5-3b10-4582-a6c4-fb08af7ca69c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-465349262-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fbb2758d2dc64f70934d8161bf600f94", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa6dd8a45-b5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122758) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:21:18.471397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b76a2c2-fa1a-46f2-90b5-603ce4196229 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Releasing lock "refresh_cache-6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:21:18.472397 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8b76a2c2-fa1a-46f2-90b5-603ce4196229 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "POST /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6/action" status: 202 len: 0 microversion: 2.1 time: 6.534489 Oct 04 21:21:18.476414 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1678/3325] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:21:11 2022] POST /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6/action => generated 0 bytes in 6539 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 21:21:18.482288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a72823b0-e8ef-4205-b4f6-ca88e7c21d67 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:18.488267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a72823b0-e8ef-4205-b4f6-ca88e7c21d67 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:18.501004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a72823b0-e8ef-4205-b4f6-ca88e7c21d67 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:18.501459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a72823b0-e8ef-4205-b4f6-ca88e7c21d67 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:18.503622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a72823b0-e8ef-4205-b4f6-ca88e7c21d67 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:18.504766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a72823b0-e8ef-4205-b4f6-ca88e7c21d67 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:18.505971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a72823b0-e8ef-4205-b4f6-ca88e7c21d67 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:18.508024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a72823b0-e8ef-4205-b4f6-ca88e7c21d67 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:18.643330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:18.868557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a72823b0-e8ef-4205-b4f6-ca88e7c21d67 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382de4f98bd4839851ad103b3f56aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e38e36770ed4a498dff7e336aa466af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:18.898153 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a72823b0-e8ef-4205-b4f6-ca88e7c21d67 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265" status: 200 len: 1313 microversion: 2.1 time: 0.403258 Oct 04 21:21:18.898153 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1679/3326] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:18 2022] GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:18.898153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-12002ab4-d52a-40f3-8da8-7ed6364acb81 req-459d20c9-0b67-4121-89de-885a6ee4651e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb1bc733-1da6-4c7e-b99f-e491087c8265", "tag": "da2827e3-9a2a-40c3-b4b2-fd8a416b5f06"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:18.912565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-12002ab4-d52a-40f3-8da8-7ed6364acb81 req-459d20c9-0b67-4121-89de-885a6ee4651e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:18.913481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-12002ab4-d52a-40f3-8da8-7ed6364acb81 req-459d20c9-0b67-4121-89de-885a6ee4651e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:18.913616 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.network.security_group_api [None req-5f50cad7-3284-4616-aae4-79324b436396 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Adding security group 0e7f1461-ad94-4f1d-b820-a227d6b87e2a to port c5f1452b-d3bc-4c8e-94d6-828e3670af57 Oct 04 21:21:18.915043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-12002ab4-d52a-40f3-8da8-7ed6364acb81 req-459d20c9-0b67-4121-89de-885a6ee4651e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:18.941198 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-12002ab4-d52a-40f3-8da8-7ed6364acb81 req-459d20c9-0b67-4121-89de-885a6ee4651e service nova] Creating event network-changed:da2827e3-9a2a-40c3-b4b2-fd8a416b5f06 for instance fb1bc733-1da6-4c7e-b99f-e491087c8265 on n-h2-860282-1 Oct 04 21:21:18.946784 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-12002ab4-d52a-40f3-8da8-7ed6364acb81 req-459d20c9-0b67-4121-89de-885a6ee4651e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063901 Oct 04 21:21:18.948051 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1680/3327] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:18.953910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ee79fbd5-579f-4855-8767-234d8d8e4aed tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '.version_select at 0x7f578b6789d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:19.439579 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ee79fbd5-579f-4855-8767-234d8d8e4aed tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/7f43826f-88f2-45fe-a3f6-6bdd3c0cbb1f" status: 200 len: 184 microversion: 2.1 time: 0.489950 Oct 04 21:21:19.440409 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1681/3328] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Oct 4 21:21:18 2022] GET /compute/v2.1/os-floating-ips/7f43826f-88f2-45fe-a3f6-6bdd3c0cbb1f => generated 184 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:19.448765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa8c8fa6-7a9f-49ee-8a99-06ce2f8b6afa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:19.448765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aa8c8fa6-7a9f-49ee-8a99-06ce2f8b6afa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:19.454055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa8c8fa6-7a9f-49ee-8a99-06ce2f8b6afa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:19.454982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa8c8fa6-7a9f-49ee-8a99-06ce2f8b6afa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:19.455490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa8c8fa6-7a9f-49ee-8a99-06ce2f8b6afa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:19.456478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa8c8fa6-7a9f-49ee-8a99-06ce2f8b6afa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:19.456942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa8c8fa6-7a9f-49ee-8a99-06ce2f8b6afa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:19.457435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa8c8fa6-7a9f-49ee-8a99-06ce2f8b6afa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:19.697701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aa8c8fa6-7a9f-49ee-8a99-06ce2f8b6afa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:19.709844 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aa8c8fa6-7a9f-49ee-8a99-06ce2f8b6afa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.265339 Oct 04 21:21:19.709844 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1682/3329] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:19 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:19.720607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dd5e60a4-f23e-4c53-86d6-1ae251210610 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.231"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:20.017539 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5f50cad7-3284-4616-aae4-79324b436396 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "POST /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178/action" status: 202 len: 0 microversion: 2.1 time: 1.703469 Oct 04 21:21:20.017539 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1648/3330] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:21:18 2022] POST /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178/action => generated 0 bytes in 1705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:21:20.024319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-087eed1a-84d9-4573-bdec-6f7f8fa357fc tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:20.024894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-087eed1a-84d9-4573-bdec-6f7f8fa357fc tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:20.042099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-087eed1a-84d9-4573-bdec-6f7f8fa357fc tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:20.042609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-087eed1a-84d9-4573-bdec-6f7f8fa357fc tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:20.043062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-087eed1a-84d9-4573-bdec-6f7f8fa357fc tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:20.045005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-087eed1a-84d9-4573-bdec-6f7f8fa357fc tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:20.045560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-087eed1a-84d9-4573-bdec-6f7f8fa357fc tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:20.046127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-087eed1a-84d9-4573-bdec-6f7f8fa357fc tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:20.052280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dd5e60a4-f23e-4c53-86d6-1ae251210610 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:20.060668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd5e60a4-f23e-4c53-86d6-1ae251210610 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:20.063486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd5e60a4-f23e-4c53-86d6-1ae251210610 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:20.064382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd5e60a4-f23e-4c53-86d6-1ae251210610 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:20.074495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd5e60a4-f23e-4c53-86d6-1ae251210610 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:20.074495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd5e60a4-f23e-4c53-86d6-1ae251210610 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:20.074495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd5e60a4-f23e-4c53-86d6-1ae251210610 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:20.409331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-087eed1a-84d9-4573-bdec-6f7f8fa357fc tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382de4f98bd4839851ad103b3f56aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e38e36770ed4a498dff7e336aa466af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:20.422239 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-087eed1a-84d9-4573-bdec-6f7f8fa357fc tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265" status: 200 len: 1313 microversion: 2.1 time: 0.402246 Oct 04 21:21:20.423751 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1649/3331] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:20 2022] GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:20.429006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-051ec5fc-2a42-4f1f-b177-d2edae6d08d3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-292740023"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:20.429845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-051ec5fc-2a42-4f1f-b177-d2edae6d08d3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: e6cb4528-b297-45b4-a0e3-d39236df0178] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:20.436088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd5e60a4-f23e-4c53-86d6-1ae251210610 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "refresh_cache-6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:21:20.436510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd5e60a4-f23e-4c53-86d6-1ae251210610 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquired lock "refresh_cache-6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:21:20.436998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-051ec5fc-2a42-4f1f-b177-d2edae6d08d3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:20.437607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-051ec5fc-2a42-4f1f-b177-d2edae6d08d3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:20.438263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-051ec5fc-2a42-4f1f-b177-d2edae6d08d3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:20.439208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-051ec5fc-2a42-4f1f-b177-d2edae6d08d3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:20.439851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-051ec5fc-2a42-4f1f-b177-d2edae6d08d3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:20.440292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-051ec5fc-2a42-4f1f-b177-d2edae6d08d3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:20.497057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=56 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:20.680187 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.network.security_group_api [None req-051ec5fc-2a42-4f1f-b177-d2edae6d08d3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Adding security group 2213926a-2a81-47ac-9274-c8f3f2b9711d to port c5f1452b-d3bc-4c8e-94d6-828e3670af57 Oct 04 21:21:21.407823 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-051ec5fc-2a42-4f1f-b177-d2edae6d08d3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "POST /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178/action" status: 202 len: 0 microversion: 2.1 time: 0.975909 Oct 04 21:21:21.410220 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1650/3332] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:21:20 2022] POST /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178/action => generated 0 bytes in 985 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:21:21.415862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-8d50d53c-4bb3-4b6c-9bbd-39b5d7f91d49 req-152fe3df-3e0f-4094-ac2a-5af08b89acba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6cb4528-b297-45b4-a0e3-d39236df0178", "tag": "c5f1452b-d3bc-4c8e-94d6-828e3670af57"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:21.429568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8d50d53c-4bb3-4b6c-9bbd-39b5d7f91d49 req-152fe3df-3e0f-4094-ac2a-5af08b89acba service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:21.434319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8d50d53c-4bb3-4b6c-9bbd-39b5d7f91d49 req-152fe3df-3e0f-4094-ac2a-5af08b89acba service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:21.434319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8d50d53c-4bb3-4b6c-9bbd-39b5d7f91d49 req-152fe3df-3e0f-4094-ac2a-5af08b89acba service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:21.450982 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-8d50d53c-4bb3-4b6c-9bbd-39b5d7f91d49 req-152fe3df-3e0f-4094-ac2a-5af08b89acba service nova] Creating event network-changed:c5f1452b-d3bc-4c8e-94d6-828e3670af57 for instance e6cb4528-b297-45b4-a0e3-d39236df0178 on n-h1-860282-1 Oct 04 21:21:21.458085 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-8d50d53c-4bb3-4b6c-9bbd-39b5d7f91d49 req-152fe3df-3e0f-4094-ac2a-5af08b89acba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045774 Oct 04 21:21:21.463178 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1651/3333] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:21.711766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-dd5e60a4-f23e-4c53-86d6-1ae251210610 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Building network info cache for instance {{(pid=122758) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 21:21:21.746609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5a556266-a2fa-4c73-8ac2-738355f3589c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-139797935", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": "none"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:21.858443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5a556266-a2fa-4c73-8ac2-738355f3589c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:21:21.858870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5a556266-a2fa-4c73-8ac2-738355f3589c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:21:21.859349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5a556266-a2fa-4c73-8ac2-738355f3589c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:21:21.867381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5a556266-a2fa-4c73-8ac2-738355f3589c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:21:21.867710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5a556266-a2fa-4c73-8ac2-738355f3589c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:21:21.887320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a556266-a2fa-4c73-8ac2-738355f3589c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:21.891010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a556266-a2fa-4c73-8ac2-738355f3589c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:21.893961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a556266-a2fa-4c73-8ac2-738355f3589c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:21.896187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a556266-a2fa-4c73-8ac2-738355f3589c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:21.897262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a556266-a2fa-4c73-8ac2-738355f3589c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:21.898548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a556266-a2fa-4c73-8ac2-738355f3589c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:21.943045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5a556266-a2fa-4c73-8ac2-738355f3589c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Getting quotas for project d9b29055c3fc4b0587334b7f9b66c352. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:21:21.956379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5a556266-a2fa-4c73-8ac2-738355f3589c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Getting quotas for user 2e9ea6735f954af1a7a2c4c578e7f562 and project d9b29055c3fc4b0587334b7f9b66c352. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:21:21.997746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5a556266-a2fa-4c73-8ac2-738355f3589c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:21:22.000406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5a556266-a2fa-4c73-8ac2-738355f3589c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] [instance: 6ea0933b-1cae-4dbd-a526-b465064ff405] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:21:22.226694 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5a556266-a2fa-4c73-8ac2-738355f3589c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.753887 Oct 04 21:21:22.236989 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1652/3334] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Oct 4 21:21:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:21:22.258674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e8505d38-45f3-4bfe-a27c-efdb77fdeed9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:22.259636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e8505d38-45f3-4bfe-a27c-efdb77fdeed9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: e6cb4528-b297-45b4-a0e3-d39236df0178] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:22.282862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8505d38-45f3-4bfe-a27c-efdb77fdeed9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:22.284515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8505d38-45f3-4bfe-a27c-efdb77fdeed9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:22.287449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8505d38-45f3-4bfe-a27c-efdb77fdeed9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:22.292575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8505d38-45f3-4bfe-a27c-efdb77fdeed9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:22.292575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8505d38-45f3-4bfe-a27c-efdb77fdeed9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:22.292575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8505d38-45f3-4bfe-a27c-efdb77fdeed9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:23.158761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-dd5e60a4-f23e-4c53-86d6-1ae251210610 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Updating instance_info_cache with network_info: [{"id": "a6dd8a45-b585-411b-a35e-ee7bbc82f986", "address": "fa:16:3e:d7:57:1b", "network": {"id": "91b9f9a5-3b10-4582-a6c4-fb08af7ca69c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-465349262-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fbb2758d2dc64f70934d8161bf600f94", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa6dd8a45-b5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122758) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:21:23.187755 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e8505d38-45f3-4bfe-a27c-efdb77fdeed9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.949022 Oct 04 21:21:23.198205 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1653/3335] 10.222.0.30 () {58 vars in 1293 bytes} [Tue Oct 4 21:21:22 2022] GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178/os-security-groups => generated 1157 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:23.204182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c09b8321-a31f-47ee-964a-de75ea4cc45b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:23.207775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c09b8321-a31f-47ee-964a-de75ea4cc45b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:23.213632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c09b8321-a31f-47ee-964a-de75ea4cc45b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:23.214392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c09b8321-a31f-47ee-964a-de75ea4cc45b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:23.215092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c09b8321-a31f-47ee-964a-de75ea4cc45b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:23.216057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c09b8321-a31f-47ee-964a-de75ea4cc45b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:23.216627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c09b8321-a31f-47ee-964a-de75ea4cc45b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:23.217217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c09b8321-a31f-47ee-964a-de75ea4cc45b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:23.303436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd5e60a4-f23e-4c53-86d6-1ae251210610 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Releasing lock "refresh_cache-6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:21:23.310358 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dd5e60a4-f23e-4c53-86d6-1ae251210610 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "POST /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6/action" status: 202 len: 0 microversion: 2.1 time: 3.596043 Oct 04 21:21:23.310358 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1683/3336] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:21:19 2022] POST /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6/action => generated 0 bytes in 3597 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 21:21:23.316782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-215fe033-6d2e-4ffb-ab95-e21d913c61cf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:23.319065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-215fe033-6d2e-4ffb-ab95-e21d913c61cf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:23.332754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215fe033-6d2e-4ffb-ab95-e21d913c61cf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:23.334823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215fe033-6d2e-4ffb-ab95-e21d913c61cf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:23.336882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215fe033-6d2e-4ffb-ab95-e21d913c61cf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:23.343171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215fe033-6d2e-4ffb-ab95-e21d913c61cf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:23.343897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215fe033-6d2e-4ffb-ab95-e21d913c61cf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:23.346131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215fe033-6d2e-4ffb-ab95-e21d913c61cf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:23.384889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c09b8321-a31f-47ee-964a-de75ea4cc45b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382de4f98bd4839851ad103b3f56aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e38e36770ed4a498dff7e336aa466af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:23.395652 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c09b8321-a31f-47ee-964a-de75ea4cc45b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265" status: 200 len: 1313 microversion: 2.1 time: 0.205791 Oct 04 21:21:23.396985 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1654/3337] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:23 2022] GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:23.422688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9fa1ef03-2d30-408f-9dcf-db990f9dec2c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:23.423330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9fa1ef03-2d30-408f-9dcf-db990f9dec2c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] [instance: 6ea0933b-1cae-4dbd-a526-b465064ff405] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:23.559630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9fa1ef03-2d30-408f-9dcf-db990f9dec2c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:23.585122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9fa1ef03-2d30-408f-9dcf-db990f9dec2c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:23.593507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9fa1ef03-2d30-408f-9dcf-db990f9dec2c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:23.600459 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9fa1ef03-2d30-408f-9dcf-db990f9dec2c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] 10.222.0.30 "GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405" status: 200 len: 1280 microversion: 2.47 time: 0.182753 Oct 04 21:21:23.601981 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1655/3338] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:23 2022] GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405 => generated 1280 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:23.629727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-215fe033-6d2e-4ffb-ab95-e21d913c61cf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:23.639413 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-215fe033-6d2e-4ffb-ab95-e21d913c61cf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.329990 Oct 04 21:21:23.642643 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1684/3339] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:23 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:23.650046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3f796f66-fac0-4347-8b19-d79da909d28e tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Action: 'create', calling method: .version_select at 0x7f578bc5b160>, body: {"security_group": {"name": " tempest-securitygroup -1048483678 ", "description": "tempest-description-1768025467"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:23.832624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-4d7a4f03-07b4-4381-9234-806a426c5ea6 req-65980e2f-e8b5-4a6b-8785-bc3d2ebb57de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba61f85c-a75d-451d-a5f7-f9533481c406", "name": "network-vif-unplugged", "status": "completed", "tag": "34504880-4c91-4512-980a-45596f508743"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:23.856851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4d7a4f03-07b4-4381-9234-806a426c5ea6 req-65980e2f-e8b5-4a6b-8785-bc3d2ebb57de service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:23.857856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4d7a4f03-07b4-4381-9234-806a426c5ea6 req-65980e2f-e8b5-4a6b-8785-bc3d2ebb57de service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:23.858692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4d7a4f03-07b4-4381-9234-806a426c5ea6 req-65980e2f-e8b5-4a6b-8785-bc3d2ebb57de service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:23.879227 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-4d7a4f03-07b4-4381-9234-806a426c5ea6 req-65980e2f-e8b5-4a6b-8785-bc3d2ebb57de service nova] Creating event network-vif-unplugged:34504880-4c91-4512-980a-45596f508743 for instance ba61f85c-a75d-451d-a5f7-f9533481c406 on n-h2-860282-1 Oct 04 21:21:23.887813 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-4d7a4f03-07b4-4381-9234-806a426c5ea6 req-65980e2f-e8b5-4a6b-8785-bc3d2ebb57de service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.283501 Oct 04 21:21:23.890031 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1656/3340] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:23.897665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7eebcf47-f7bb-47d2-a8cc-e3f72bfb6a91 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:23.899405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7eebcf47-f7bb-47d2-a8cc-e3f72bfb6a91 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:23.907063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:23.910789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7eebcf47-f7bb-47d2-a8cc-e3f72bfb6a91 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:23.911786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7eebcf47-f7bb-47d2-a8cc-e3f72bfb6a91 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:23.913624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7eebcf47-f7bb-47d2-a8cc-e3f72bfb6a91 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:23.915679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7eebcf47-f7bb-47d2-a8cc-e3f72bfb6a91 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:23.916599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7eebcf47-f7bb-47d2-a8cc-e3f72bfb6a91 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:23.917291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7eebcf47-f7bb-47d2-a8cc-e3f72bfb6a91 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:23.947810 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-7eebcf47-f7bb-47d2-a8cc-e3f72bfb6a91 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] HTTP exception thrown: Instance 319803c6-077c-4267-84e2-cb90f261aedc could not be found. Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7eebcf47-f7bb-47d2-a8cc-e3f72bfb6a91 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Request method failure captured: Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc HTTP/1.1 Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKNoLBxiQolSl6Nag98IU0LwILvMTA3F92QIJR7IF5rdTWFrQObO76q2Mrv_ICE6KyAVdr2bozpD-JyNZ7WXncDojo8WedfbbyO0dlDoqRDPy884vxb3lKIz7WcRmHihPKLPN_DxZH08CBiFvT0Cul3PvOBFLTrtut9dKF_j3VkSKQk Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fbb2758d2dc64f70934d8161bf600f94 Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-683137430 Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb2758d2dc64f70934d8161bf600f94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbb2758d2dc64f70934d8161bf600f94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbb2758d2dc64f70934d8161bf600f94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb2758d2dc64f70934d8161bf600f94"}]}] Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-683137430 Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fbb2758d2dc64f70934d8161bf600f94 Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-683137430 Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-FloatingIPsAssociationTestJSON-683137430-project Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 1b329e207cac4d459d25623d6554f444 Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-683137430-project Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 319803c6-077c-4267-84e2-cb90f261aedc could not be found. Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '319803c6-077c-4267-84e2-cb90f261aedc'} Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319803c6-077c-4267-84e2-cb90f261aedc could not be found. Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:21:23.953610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:21:23.960660 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319803c6-077c-4267-84e2-cb90f261aedc could not be found. Oct 04 21:21:23.960660 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:23.960660 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:23.960660 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:23.960660 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:23.960660 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:23.960660 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:23.960660 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:23.960660 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:23.960660 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319803c6-077c-4267-84e2-cb90f261aedc could not be found. Oct 04 21:21:23.960660 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:23.963403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7eebcf47-f7bb-47d2-a8cc-e3f72bfb6a91 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Returning 404 to user: Instance 319803c6-077c-4267-84e2-cb90f261aedc could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:23.966403 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7eebcf47-f7bb-47d2-a8cc-e3f72bfb6a91 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "DELETE /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc" status: 404 len: 111 microversion: 2.1 time: 0.073575 Oct 04 21:21:23.970999 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1657/3341] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:21:23 2022] DELETE /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:21:23.984428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-f9acf94d-f46b-4260-bf4c-85cba932313d req-37ee5cad-e85b-4f55-9634-9998371d9a1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6cb4528-b297-45b4-a0e3-d39236df0178", "tag": "c5f1452b-d3bc-4c8e-94d6-828e3670af57"}, {"name": "network-changed", "server_uuid": "6ccadfb7-f678-4ca9-9f01-7b268c2e1db6", "tag": "a6dd8a45-b585-411b-a35e-ee7bbc82f986"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:24.025958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f9acf94d-f46b-4260-bf4c-85cba932313d req-37ee5cad-e85b-4f55-9634-9998371d9a1d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:24.025958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f9acf94d-f46b-4260-bf4c-85cba932313d req-37ee5cad-e85b-4f55-9634-9998371d9a1d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:24.025958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f9acf94d-f46b-4260-bf4c-85cba932313d req-37ee5cad-e85b-4f55-9634-9998371d9a1d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:24.045903 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-f9acf94d-f46b-4260-bf4c-85cba932313d req-37ee5cad-e85b-4f55-9634-9998371d9a1d service nova] Creating event network-changed:c5f1452b-d3bc-4c8e-94d6-828e3670af57 for instance e6cb4528-b297-45b4-a0e3-d39236df0178 on n-h1-860282-1 Oct 04 21:21:24.046966 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-f9acf94d-f46b-4260-bf4c-85cba932313d req-37ee5cad-e85b-4f55-9634-9998371d9a1d service nova] Creating event network-changed:a6dd8a45-b585-411b-a35e-ee7bbc82f986 for instance 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 on n-h1-860282-1 Oct 04 21:21:24.059956 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-f9acf94d-f46b-4260-bf4c-85cba932313d req-37ee5cad-e85b-4f55-9634-9998371d9a1d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.088677 Oct 04 21:21:24.065870 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1658/3342] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:24.075748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fd86b0f7-fa07-4ac2-b25d-18ddf74510ca tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:24.077791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fd86b0f7-fa07-4ac2-b25d-18ddf74510ca tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 319803c6-077c-4267-84e2-cb90f261aedc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:24.086128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd86b0f7-fa07-4ac2-b25d-18ddf74510ca tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:24.107052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd86b0f7-fa07-4ac2-b25d-18ddf74510ca tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:24.109837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd86b0f7-fa07-4ac2-b25d-18ddf74510ca tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:24.114235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd86b0f7-fa07-4ac2-b25d-18ddf74510ca tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:24.114750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd86b0f7-fa07-4ac2-b25d-18ddf74510ca tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:24.115215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd86b0f7-fa07-4ac2-b25d-18ddf74510ca tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:24.144252 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-fd86b0f7-fa07-4ac2-b25d-18ddf74510ca tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] HTTP exception thrown: Instance 319803c6-077c-4267-84e2-cb90f261aedc could not be found. Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fd86b0f7-fa07-4ac2-b25d-18ddf74510ca tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Request method failure captured: Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc HTTP/1.1 Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKNoLBxiQolSl6Nag98IU0LwILvMTA3F92QIJR7IF5rdTWFrQObO76q2Mrv_ICE6KyAVdr2bozpD-JyNZ7WXncDojo8WedfbbyO0dlDoqRDPy884vxb3lKIz7WcRmHihPKLPN_DxZH08CBiFvT0Cul3PvOBFLTrtut9dKF_j3VkSKQk Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fbb2758d2dc64f70934d8161bf600f94 Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-683137430 Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb2758d2dc64f70934d8161bf600f94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbb2758d2dc64f70934d8161bf600f94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbb2758d2dc64f70934d8161bf600f94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb2758d2dc64f70934d8161bf600f94"}]}] Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-683137430 Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fbb2758d2dc64f70934d8161bf600f94 Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-683137430 Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-FloatingIPsAssociationTestJSON-683137430-project Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 1b329e207cac4d459d25623d6554f444 Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-683137430-project Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 319803c6-077c-4267-84e2-cb90f261aedc could not be found. Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '319803c6-077c-4267-84e2-cb90f261aedc'} Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319803c6-077c-4267-84e2-cb90f261aedc could not be found. Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319803c6-077c-4267-84e2-cb90f261aedc could not be found. Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:24.146017 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:24.153338 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:24.153338 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:24.153338 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:24.153338 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:24.153338 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:24.153338 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:24.153338 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319803c6-077c-4267-84e2-cb90f261aedc could not be found. Oct 04 21:21:24.153338 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:24.153338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fd86b0f7-fa07-4ac2-b25d-18ddf74510ca tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Returning 404 to user: Instance 319803c6-077c-4267-84e2-cb90f261aedc could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:24.155145 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fd86b0f7-fa07-4ac2-b25d-18ddf74510ca tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc" status: 404 len: 111 microversion: 2.1 time: 0.081214 Oct 04 21:21:24.155843 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1659/3343] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:24 2022] GET /compute/v2.1/servers/319803c6-077c-4267-84e2-cb90f261aedc => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:21:24.167537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-131b4565-4e84-4b8d-8562-a07c973d8805 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '.version_select at 0x7f578b730c10>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:24.179360 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3f796f66-fac0-4347-8b19-d79da909d28e tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.534265 Oct 04 21:21:24.179962 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1685/3344] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:21:23 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:24.194101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e6c329be-af3c-4c42-8dea-e035961adda9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f5794561430>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:24.349302 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e6c329be-af3c-4c42-8dea-e035961adda9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/007b614a-159c-4012-95a3-99174b235345" status: 200 len: 224 microversion: 2.1 time: 0.159370 Oct 04 21:21:24.350008 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1686/3345] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Oct 4 21:21:24 2022] GET /compute/v2.1/os-security-groups/007b614a-159c-4012-95a3-99174b235345 => generated 224 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:21:24.363359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-deb5b7a1-7272-45a6-a45a-8e27583eeebe tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f578b678e50>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:25.135125 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-deb5b7a1-7272-45a6-a45a-8e27583eeebe tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/007b614a-159c-4012-95a3-99174b235345" status: 202 len: 0 microversion: 2.1 time: 0.775342 Oct 04 21:21:25.139153 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1687/3346] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:21:24 2022] DELETE /compute/v2.1/os-security-groups/007b614a-159c-4012-95a3-99174b235345 => generated 0 bytes in 777 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:21:25.141237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ef5391e9-9ac7-4d4f-b0e4-2d32642b43e6 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:25.142169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ef5391e9-9ac7-4d4f-b0e4-2d32642b43e6 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:25.145670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:25.152940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef5391e9-9ac7-4d4f-b0e4-2d32642b43e6 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:25.153326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef5391e9-9ac7-4d4f-b0e4-2d32642b43e6 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:25.153801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef5391e9-9ac7-4d4f-b0e4-2d32642b43e6 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:25.155208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef5391e9-9ac7-4d4f-b0e4-2d32642b43e6 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:25.155825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef5391e9-9ac7-4d4f-b0e4-2d32642b43e6 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:25.156434 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef5391e9-9ac7-4d4f-b0e4-2d32642b43e6 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:25.424521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ef5391e9-9ac7-4d4f-b0e4-2d32642b43e6 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382de4f98bd4839851ad103b3f56aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e38e36770ed4a498dff7e336aa466af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:25.435945 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ef5391e9-9ac7-4d4f-b0e4-2d32642b43e6 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265" status: 200 len: 1313 microversion: 2.1 time: 0.298959 Oct 04 21:21:25.436763 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1688/3347] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:25 2022] GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:25.450920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-33186346-89d3-4f17-8093-174ab31d0630 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:25.450920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-33186346-89d3-4f17-8093-174ab31d0630 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] [instance: 6ea0933b-1cae-4dbd-a526-b465064ff405] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:25.459512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33186346-89d3-4f17-8093-174ab31d0630 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:25.460014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33186346-89d3-4f17-8093-174ab31d0630 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:25.460462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33186346-89d3-4f17-8093-174ab31d0630 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:25.461247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33186346-89d3-4f17-8093-174ab31d0630 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:25.466860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33186346-89d3-4f17-8093-174ab31d0630 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:25.467877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33186346-89d3-4f17-8093-174ab31d0630 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:25.589908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-33186346-89d3-4f17-8093-174ab31d0630 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:25.605589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-33186346-89d3-4f17-8093-174ab31d0630 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:25.606977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-33186346-89d3-4f17-8093-174ab31d0630 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:25.608748 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-33186346-89d3-4f17-8093-174ab31d0630 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] 10.222.0.30 "GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405" status: 200 len: 1332 microversion: 2.47 time: 0.170845 Oct 04 21:21:25.609318 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1689/3348] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:25 2022] GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405 => generated 1332 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:25.616694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3db0c150-e707-44d1-8e41-62afba0b87b7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f578b6080d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:25.662775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG neutronclient.v2_0.client [None req-3db0c150-e707-44d1-8e41-62afba0b87b7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 007b614a-159c-4012-95a3-99174b235345 does not exist", "detail": ""}} {{(pid=122758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:21:25.666424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.security_group_api [None req-3db0c150-e707-44d1-8e41-62afba0b87b7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Neutron security group 007b614a-159c-4012-95a3-99174b235345 not found {{(pid=122758) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:21:25.668194 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-3db0c150-e707-44d1-8e41-62afba0b87b7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] HTTP exception thrown: Security group 007b614a-159c-4012-95a3-99174b235345 does not exist Oct 04 21:21:25.668194 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-551c29f8-7740-4712-b293-b413dd99c2fe'] Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3db0c150-e707-44d1-8e41-62afba0b87b7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Request method failure captured: Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-security-groups/007b614a-159c-4012-95a3-99174b235345 HTTP/1.1 Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKOxTfdccv0aEToOcfdr6OtMIo2CNlYhIlgqu92DBOatDQiWjzVvd5IEryG0QCNnKkdKZPQHitv07AkMUDT3qd6-ZcO30gWiCaxcQoOtheHE279h1an9qvnw6-w5GJGiha-QBcDfyNtCASPXAS_OZ9SmSwbX7jLR7-xMrA5rAkFWAyw Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f547dec3057448558ae4d6012037dac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f547dec3057448558ae4d6012037dac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}] Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: cdbb08401bf146068fc351915ede7675 Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: exception: Security group 007b614a-159c-4012-95a3-99174b235345 does not exist Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-551c29f8-7740-4712-b293-b413dd99c2fe'] Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '007b614a-159c-4012-95a3-99174b235345'} Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:21:25.672552 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 007b614a-159c-4012-95a3-99174b235345 does not exist Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-551c29f8-7740-4712-b293-b413dd99c2fe'] Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 007b614a-159c-4012-95a3-99174b235345 does not exist Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-551c29f8-7740-4712-b293-b413dd99c2fe'] Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 007b614a-159c-4012-95a3-99174b235345 does not exist Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-551c29f8-7740-4712-b293-b413dd99c2fe'] Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 007b614a-159c-4012-95a3-99174b235345 does not exist Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-551c29f8-7740-4712-b293-b413dd99c2fe'] Oct 04 21:21:25.678274 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:25.683436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3db0c150-e707-44d1-8e41-62afba0b87b7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Returning 404 to user: Security group 007b614a-159c-4012-95a3-99174b235345 does not exist Oct 04 21:21:25.683436 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-551c29f8-7740-4712-b293-b413dd99c2fe'] {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:25.684890 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3db0c150-e707-44d1-8e41-62afba0b87b7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/007b614a-159c-4012-95a3-99174b235345" status: 404 len: 194 microversion: 2.1 time: 0.074360 Oct 04 21:21:25.687840 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1690/3349] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Oct 4 21:21:25 2022] GET /compute/v2.1/os-security-groups/007b614a-159c-4012-95a3-99174b235345 => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:21:25.695574 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-131b4565-4e84-4b8d-8562-a07c973d8805 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/7f43826f-88f2-45fe-a3f6-6bdd3c0cbb1f" status: 202 len: 0 microversion: 2.1 time: 1.535055 Oct 04 21:21:25.699699 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1660/3350] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Oct 4 21:21:24 2022] DELETE /compute/v2.1/os-floating-ips/7f43826f-88f2-45fe-a3f6-6bdd3c0cbb1f => generated 0 bytes in 1540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:21:25.702205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-286e0f32-2266-4121-bac7-8b70c18a31a9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Action: 'create', calling method: .version_select at 0x7f578bc740d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-902349234", "description": "tempest-description-1449564306"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:25.704677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3c2e7e2b-71f8-44f3-a91e-ab71988c3fde tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:25.705184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3c2e7e2b-71f8-44f3-a91e-ab71988c3fde tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:25.713967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c2e7e2b-71f8-44f3-a91e-ab71988c3fde tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:25.714757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c2e7e2b-71f8-44f3-a91e-ab71988c3fde tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:25.715472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c2e7e2b-71f8-44f3-a91e-ab71988c3fde tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:25.716252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c2e7e2b-71f8-44f3-a91e-ab71988c3fde tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:25.717002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c2e7e2b-71f8-44f3-a91e-ab71988c3fde tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:25.717465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c2e7e2b-71f8-44f3-a91e-ab71988c3fde tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:25.759679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3c2e7e2b-71f8-44f3-a91e-ab71988c3fde tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:21:26.300712 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3c2e7e2b-71f8-44f3-a91e-ab71988c3fde tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 204 len: 0 microversion: 2.1 time: 0.598908 Oct 04 21:21:26.302302 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1661/3351] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:21:25 2022] DELETE /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:21:26.311218 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-286e0f32-2266-4121-bac7-8b70c18a31a9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.613645 Oct 04 21:21:26.311218 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1691/3352] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:21:25 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:21:26.313175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-bce05b29-3b31-43fb-817b-e2e70f84b637 req-0ac563d2-6841-409d-917a-59692130f0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb1bc733-1da6-4c7e-b99f-e491087c8265", "name": "network-vif-plugged", "status": "completed", "tag": "da2827e3-9a2a-40c3-b4b2-fd8a416b5f06"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:26.317752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-346ecf77-88d3-4197-a6dc-e317b8dadeb2 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:26.319024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-346ecf77-88d3-4197-a6dc-e317b8dadeb2 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:26.324804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bce05b29-3b31-43fb-817b-e2e70f84b637 req-0ac563d2-6841-409d-917a-59692130f0b1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:26.325198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bce05b29-3b31-43fb-817b-e2e70f84b637 req-0ac563d2-6841-409d-917a-59692130f0b1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:26.325867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bce05b29-3b31-43fb-817b-e2e70f84b637 req-0ac563d2-6841-409d-917a-59692130f0b1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:26.328867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-346ecf77-88d3-4197-a6dc-e317b8dadeb2 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:26.329379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-346ecf77-88d3-4197-a6dc-e317b8dadeb2 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:26.329892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-346ecf77-88d3-4197-a6dc-e317b8dadeb2 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:26.330552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-346ecf77-88d3-4197-a6dc-e317b8dadeb2 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:26.334659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-346ecf77-88d3-4197-a6dc-e317b8dadeb2 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:26.334659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-346ecf77-88d3-4197-a6dc-e317b8dadeb2 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:26.339454 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-bce05b29-3b31-43fb-817b-e2e70f84b637 req-0ac563d2-6841-409d-917a-59692130f0b1 service nova] Creating event network-vif-plugged:da2827e3-9a2a-40c3-b4b2-fd8a416b5f06 for instance fb1bc733-1da6-4c7e-b99f-e491087c8265 on n-h2-860282-1 Oct 04 21:21:26.345795 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-bce05b29-3b31-43fb-817b-e2e70f84b637 req-0ac563d2-6841-409d-917a-59692130f0b1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041489 Oct 04 21:21:26.346825 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1662/3353] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:26.352856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4c30db9f-fc1e-4069-bba1-ee56891a0cd0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Action: 'create', calling method: .version_select at 0x7f578b7301f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-785533170", "description": "tempest-description-1732563034"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:26.507233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-346ecf77-88d3-4197-a6dc-e317b8dadeb2 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:26.517403 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-346ecf77-88d3-4197-a6dc-e317b8dadeb2 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 200 len: 1524 microversion: 2.1 time: 0.206135 Oct 04 21:21:26.537028 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1692/3354] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:26 2022] GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 1524 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:26.544071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fdfd4f3e-7fd8-405b-b1c4-7e174874b75e tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:26.544910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fdfd4f3e-7fd8-405b-b1c4-7e174874b75e tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:26.553593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fdfd4f3e-7fd8-405b-b1c4-7e174874b75e tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:26.554119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fdfd4f3e-7fd8-405b-b1c4-7e174874b75e tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:26.554558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fdfd4f3e-7fd8-405b-b1c4-7e174874b75e tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:26.555260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fdfd4f3e-7fd8-405b-b1c4-7e174874b75e tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:26.555715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fdfd4f3e-7fd8-405b-b1c4-7e174874b75e tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:26.556142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fdfd4f3e-7fd8-405b-b1c4-7e174874b75e tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:26.745594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fdfd4f3e-7fd8-405b-b1c4-7e174874b75e tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382de4f98bd4839851ad103b3f56aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e38e36770ed4a498dff7e336aa466af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:26.757876 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fdfd4f3e-7fd8-405b-b1c4-7e174874b75e tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265" status: 200 len: 1313 microversion: 2.1 time: 0.219154 Oct 04 21:21:26.776192 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1693/3355] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:26 2022] GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:26.783600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-002a072d-c6d7-4e08-b0c1-617175a45b4b tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:26.786184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-002a072d-c6d7-4e08-b0c1-617175a45b4b tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] [instance: 6ea0933b-1cae-4dbd-a526-b465064ff405] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:26.794780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-002a072d-c6d7-4e08-b0c1-617175a45b4b tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:26.795466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-002a072d-c6d7-4e08-b0c1-617175a45b4b tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:26.795944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-002a072d-c6d7-4e08-b0c1-617175a45b4b tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:26.796761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-002a072d-c6d7-4e08-b0c1-617175a45b4b tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:26.797063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-002a072d-c6d7-4e08-b0c1-617175a45b4b tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:26.797516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-002a072d-c6d7-4e08-b0c1-617175a45b4b tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:26.883927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-002a072d-c6d7-4e08-b0c1-617175a45b4b tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:26.898708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-002a072d-c6d7-4e08-b0c1-617175a45b4b tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:26.900677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-002a072d-c6d7-4e08-b0c1-617175a45b4b tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:26.902311 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-002a072d-c6d7-4e08-b0c1-617175a45b4b tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] 10.222.0.30 "GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405" status: 200 len: 1340 microversion: 2.47 time: 0.125031 Oct 04 21:21:26.903363 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1694/3356] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:26 2022] GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405 => generated 1340 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:27.063962 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4c30db9f-fc1e-4069-bba1-ee56891a0cd0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.715249 Oct 04 21:21:27.064834 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1663/3357] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:21:26 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:27.079844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8a845541-5fd7-41fb-9dec-7a2376836a0b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Action: 'create', calling method: .version_select at 0x7f578bbf6b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-873072835", "description": "tempest-description-1829443270"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:27.549328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1579a8cc-7480-46c6-a0dc-2d57c7530b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:27.550578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1579a8cc-7480-46c6-a0dc-2d57c7530b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:27.557098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1579a8cc-7480-46c6-a0dc-2d57c7530b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:27.557635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1579a8cc-7480-46c6-a0dc-2d57c7530b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:27.558395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1579a8cc-7480-46c6-a0dc-2d57c7530b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:27.559171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1579a8cc-7480-46c6-a0dc-2d57c7530b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:27.559642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1579a8cc-7480-46c6-a0dc-2d57c7530b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:27.560105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1579a8cc-7480-46c6-a0dc-2d57c7530b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:27.676673 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8a845541-5fd7-41fb-9dec-7a2376836a0b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.602356 Oct 04 21:21:27.701666 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1695/3358] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:21:27 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:27.701666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8e6b974c-ab4d-45a7-a275-977b9b7cbfbc tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f57909f3700>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:27.766319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1579a8cc-7480-46c6-a0dc-2d57c7530b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:27.776109 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1579a8cc-7480-46c6-a0dc-2d57c7530b82 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 200 len: 1524 microversion: 2.1 time: 0.232887 Oct 04 21:21:27.804224 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1664/3359] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:27 2022] GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 1524 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:27.804224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ac0ff334-25e2-4115-b1f3-29aa281beb4c tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:27.804224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ac0ff334-25e2-4115-b1f3-29aa281beb4c tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:27.804224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac0ff334-25e2-4115-b1f3-29aa281beb4c tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:27.804224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac0ff334-25e2-4115-b1f3-29aa281beb4c tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:27.804224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac0ff334-25e2-4115-b1f3-29aa281beb4c tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:27.804224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac0ff334-25e2-4115-b1f3-29aa281beb4c tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:27.804224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac0ff334-25e2-4115-b1f3-29aa281beb4c tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:27.804224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac0ff334-25e2-4115-b1f3-29aa281beb4c tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:28.018207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ac0ff334-25e2-4115-b1f3-29aa281beb4c tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382de4f98bd4839851ad103b3f56aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e38e36770ed4a498dff7e336aa466af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:28.026947 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ac0ff334-25e2-4115-b1f3-29aa281beb4c tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265" status: 200 len: 1313 microversion: 2.1 time: 0.243868 Oct 04 21:21:28.027963 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1665/3360] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:27 2022] GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:28.049214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c39e519f-c50e-4d6c-b485-e7de4d37b7fc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:28.050127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c39e519f-c50e-4d6c-b485-e7de4d37b7fc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] [instance: 6ea0933b-1cae-4dbd-a526-b465064ff405] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:28.059313 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8e6b974c-ab4d-45a7-a275-977b9b7cbfbc tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.369521 Oct 04 21:21:28.059822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c39e519f-c50e-4d6c-b485-e7de4d37b7fc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:28.061512 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1696/3361] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Oct 4 21:21:27 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:28.062452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c39e519f-c50e-4d6c-b485-e7de4d37b7fc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:28.062959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c39e519f-c50e-4d6c-b485-e7de4d37b7fc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:28.063697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c39e519f-c50e-4d6c-b485-e7de4d37b7fc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:28.064164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c39e519f-c50e-4d6c-b485-e7de4d37b7fc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:28.064711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c39e519f-c50e-4d6c-b485-e7de4d37b7fc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:28.076757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f9b178f3-0b53-4672-8313-1351bf656588 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f578b678040>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:28.196119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c39e519f-c50e-4d6c-b485-e7de4d37b7fc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:28.208232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:28.211494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c39e519f-c50e-4d6c-b485-e7de4d37b7fc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:28.213842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c39e519f-c50e-4d6c-b485-e7de4d37b7fc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:28.216216 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c39e519f-c50e-4d6c-b485-e7de4d37b7fc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] 10.222.0.30 "GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405" status: 200 len: 1350 microversion: 2.47 time: 0.170686 Oct 04 21:21:28.217109 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1666/3362] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:28 2022] GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405 => generated 1350 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:28.450450 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f9b178f3-0b53-4672-8313-1351bf656588 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418" status: 202 len: 0 microversion: 2.1 time: 0.379470 Oct 04 21:21:28.452168 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1697/3363] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:21:28 2022] DELETE /compute/v2.1/os-security-groups/4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:21:28.453145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-7239db4f-cdd5-4956-926f-e53a50e370da req-4cb77768-f932-4fd8-9da9-2b7f33162612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ccadfb7-f678-4ca9-9f01-7b268c2e1db6", "name": "network-vif-deleted", "tag": "a6dd8a45-b585-411b-a35e-ee7bbc82f986"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:28.461638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dfd052ea-f7ae-4dc3-a8d0-a8c83ea67156 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f5794563700>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:28.471356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7239db4f-cdd5-4956-926f-e53a50e370da req-4cb77768-f932-4fd8-9da9-2b7f33162612 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:28.471356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7239db4f-cdd5-4956-926f-e53a50e370da req-4cb77768-f932-4fd8-9da9-2b7f33162612 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:28.471356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7239db4f-cdd5-4956-926f-e53a50e370da req-4cb77768-f932-4fd8-9da9-2b7f33162612 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:28.501300 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-7239db4f-cdd5-4956-926f-e53a50e370da req-4cb77768-f932-4fd8-9da9-2b7f33162612 service nova] Creating event network-vif-deleted:a6dd8a45-b585-411b-a35e-ee7bbc82f986 for instance 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 on n-h1-860282-1 Oct 04 21:21:28.506933 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-7239db4f-cdd5-4956-926f-e53a50e370da req-4cb77768-f932-4fd8-9da9-2b7f33162612 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058551 Oct 04 21:21:28.507926 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1667/3364] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:28.512787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG neutronclient.v2_0.client [None req-dfd052ea-f7ae-4dc3-a8d0-a8c83ea67156 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 does not exist", "detail": ""}} {{(pid=122758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:21:28.514035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.security_group_api [None req-dfd052ea-f7ae-4dc3-a8d0-a8c83ea67156 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Neutron security group 4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 not found {{(pid=122758) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:21:28.514794 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-dfd052ea-f7ae-4dc3-a8d0-a8c83ea67156 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] HTTP exception thrown: Security group 4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 does not exist Oct 04 21:21:28.514794 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-527c5d5e-cef9-48ce-b704-7e31baf32f83'] Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dfd052ea-f7ae-4dc3-a8d0-a8c83ea67156 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Request method failure captured: Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-security-groups/4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 HTTP/1.1 Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKOxTfdccv0aEToOcfdr6OtMIo2CNlYhIlgqu92DBOatDQiWjzVvd5IEryG0QCNnKkdKZPQHitv07AkMUDT3qd6-ZcO30gWiCaxcQoOtheHE279h1an9qvnw6-w5GJGiha-QBcDfyNtCASPXAS_OZ9SmSwbX7jLR7-xMrA5rAkFWAyw Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f547dec3057448558ae4d6012037dac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f547dec3057448558ae4d6012037dac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}] Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: cdbb08401bf146068fc351915ede7675 Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: exception: Security group 4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 does not exist Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-527c5d5e-cef9-48ce-b704-7e31baf32f83'] Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418'} Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:21:28.516823 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 does not exist Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-527c5d5e-cef9-48ce-b704-7e31baf32f83'] Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 does not exist Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-527c5d5e-cef9-48ce-b704-7e31baf32f83'] Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 does not exist Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-527c5d5e-cef9-48ce-b704-7e31baf32f83'] Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 does not exist Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-527c5d5e-cef9-48ce-b704-7e31baf32f83'] Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dfd052ea-f7ae-4dc3-a8d0-a8c83ea67156 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Returning 404 to user: Security group 4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 does not exist Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-527c5d5e-cef9-48ce-b704-7e31baf32f83'] {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dfd052ea-f7ae-4dc3-a8d0-a8c83ea67156 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418" status: 404 len: 194 microversion: 2.1 time: 0.062611 Oct 04 21:21:28.523098 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1698/3365] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Oct 4 21:21:28 2022] GET /compute/v2.1/os-security-groups/4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:21:28.536216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d537f5fe-710f-4d43-8453-344bdecd4e65 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f578b6a8af0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:28.635317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b65c7cd4-7d7b-46ad-a146-cf7add8d7ea8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:28.635932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b65c7cd4-7d7b-46ad-a146-cf7add8d7ea8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:28.646456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b65c7cd4-7d7b-46ad-a146-cf7add8d7ea8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:28.646997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b65c7cd4-7d7b-46ad-a146-cf7add8d7ea8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:28.647454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b65c7cd4-7d7b-46ad-a146-cf7add8d7ea8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:28.648366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b65c7cd4-7d7b-46ad-a146-cf7add8d7ea8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:28.649050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b65c7cd4-7d7b-46ad-a146-cf7add8d7ea8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:28.649674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b65c7cd4-7d7b-46ad-a146-cf7add8d7ea8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:28.830627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b65c7cd4-7d7b-46ad-a146-cf7add8d7ea8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:28.839076 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b65c7cd4-7d7b-46ad-a146-cf7add8d7ea8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.207696 Oct 04 21:21:28.840238 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1699/3366] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:28 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:28.845119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-018b2ed6-79bb-4495-af22-72c81bed9699 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:28.845799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-018b2ed6-79bb-4495-af22-72c81bed9699 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:28.858835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-018b2ed6-79bb-4495-af22-72c81bed9699 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:28.859313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-018b2ed6-79bb-4495-af22-72c81bed9699 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:28.859758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-018b2ed6-79bb-4495-af22-72c81bed9699 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:28.860469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-018b2ed6-79bb-4495-af22-72c81bed9699 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:28.861126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-018b2ed6-79bb-4495-af22-72c81bed9699 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:28.861760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-018b2ed6-79bb-4495-af22-72c81bed9699 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:28.888608 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d537f5fe-710f-4d43-8453-344bdecd4e65 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/bf1a2218-5d9a-48e8-af8e-9908f43332d8" status: 202 len: 0 microversion: 2.1 time: 0.364106 Oct 04 21:21:28.889557 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1668/3367] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:21:28 2022] DELETE /compute/v2.1/os-security-groups/bf1a2218-5d9a-48e8-af8e-9908f43332d8 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:21:28.895910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6fe81817-f3ed-435c-9024-bc3a732eabd4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:28.896671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6fe81817-f3ed-435c-9024-bc3a732eabd4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:28.908197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6fe81817-f3ed-435c-9024-bc3a732eabd4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:28.911598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6fe81817-f3ed-435c-9024-bc3a732eabd4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:28.911725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6fe81817-f3ed-435c-9024-bc3a732eabd4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:28.912466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6fe81817-f3ed-435c-9024-bc3a732eabd4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:28.913886 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6fe81817-f3ed-435c-9024-bc3a732eabd4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:28.915957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6fe81817-f3ed-435c-9024-bc3a732eabd4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:28.968279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-018b2ed6-79bb-4495-af22-72c81bed9699 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:28.981250 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-018b2ed6-79bb-4495-af22-72c81bed9699 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 200 len: 1482 microversion: 2.1 time: 0.139611 Oct 04 21:21:28.982118 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1700/3368] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:28 2022] GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 1482 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:29.005402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4b01c6cc-bf59-4247-aaa8-418c8853a2f3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f57900e6ee0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:29.056921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG neutronclient.v2_0.client [None req-4b01c6cc-bf59-4247-aaa8-418c8853a2f3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bf1a2218-5d9a-48e8-af8e-9908f43332d8 does not exist", "detail": ""}} {{(pid=122758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:21:29.058315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.security_group_api [None req-4b01c6cc-bf59-4247-aaa8-418c8853a2f3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Neutron security group bf1a2218-5d9a-48e8-af8e-9908f43332d8 not found {{(pid=122758) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:21:29.060457 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-4b01c6cc-bf59-4247-aaa8-418c8853a2f3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] HTTP exception thrown: Security group bf1a2218-5d9a-48e8-af8e-9908f43332d8 does not exist Oct 04 21:21:29.060457 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-138d8144-4b30-4d9a-a94b-9668ce308810'] Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4b01c6cc-bf59-4247-aaa8-418c8853a2f3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Request method failure captured: Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-security-groups/bf1a2218-5d9a-48e8-af8e-9908f43332d8 HTTP/1.1 Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKOxTfdccv0aEToOcfdr6OtMIo2CNlYhIlgqu92DBOatDQiWjzVvd5IEryG0QCNnKkdKZPQHitv07AkMUDT3qd6-ZcO30gWiCaxcQoOtheHE279h1an9qvnw6-w5GJGiha-QBcDfyNtCASPXAS_OZ9SmSwbX7jLR7-xMrA5rAkFWAyw Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f547dec3057448558ae4d6012037dac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f547dec3057448558ae4d6012037dac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}] Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: cdbb08401bf146068fc351915ede7675 Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: exception: Security group bf1a2218-5d9a-48e8-af8e-9908f43332d8 does not exist Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-138d8144-4b30-4d9a-a94b-9668ce308810'] Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'bf1a2218-5d9a-48e8-af8e-9908f43332d8'} Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:21:29.063207 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bf1a2218-5d9a-48e8-af8e-9908f43332d8 does not exist Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-138d8144-4b30-4d9a-a94b-9668ce308810'] Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bf1a2218-5d9a-48e8-af8e-9908f43332d8 does not exist Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-138d8144-4b30-4d9a-a94b-9668ce308810'] Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bf1a2218-5d9a-48e8-af8e-9908f43332d8 does not exist Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-138d8144-4b30-4d9a-a94b-9668ce308810'] Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bf1a2218-5d9a-48e8-af8e-9908f43332d8 does not exist Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-138d8144-4b30-4d9a-a94b-9668ce308810'] Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4b01c6cc-bf59-4247-aaa8-418c8853a2f3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Returning 404 to user: Security group bf1a2218-5d9a-48e8-af8e-9908f43332d8 does not exist Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-138d8144-4b30-4d9a-a94b-9668ce308810'] {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4b01c6cc-bf59-4247-aaa8-418c8853a2f3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/bf1a2218-5d9a-48e8-af8e-9908f43332d8" status: 404 len: 194 microversion: 2.1 time: 0.063752 Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1701/3369] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Oct 4 21:21:28 2022] GET /compute/v2.1/os-security-groups/bf1a2218-5d9a-48e8-af8e-9908f43332d8 => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a769547b-5df3-4a5d-bfaa-d96b7ef30750 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:29.071806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a769547b-5df3-4a5d-bfaa-d96b7ef30750 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:29.081167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a769547b-5df3-4a5d-bfaa-d96b7ef30750 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:29.089909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a769547b-5df3-4a5d-bfaa-d96b7ef30750 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:29.089909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a769547b-5df3-4a5d-bfaa-d96b7ef30750 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:29.089909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a769547b-5df3-4a5d-bfaa-d96b7ef30750 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:29.089909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a769547b-5df3-4a5d-bfaa-d96b7ef30750 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:29.089909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a769547b-5df3-4a5d-bfaa-d96b7ef30750 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:29.193534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6fe81817-f3ed-435c-9024-bc3a732eabd4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:29.202307 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6fe81817-f3ed-435c-9024-bc3a732eabd4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.311543 Oct 04 21:21:29.203000 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1669/3370] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:28 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:29.209746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-da929e6b-f01d-4d44-919b-ceddab17d4db tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f578b6a8550>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:29.287981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a769547b-5df3-4a5d-bfaa-d96b7ef30750 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382de4f98bd4839851ad103b3f56aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e38e36770ed4a498dff7e336aa466af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:29.296966 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a769547b-5df3-4a5d-bfaa-d96b7ef30750 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265" status: 200 len: 1497 microversion: 2.1 time: 0.229999 Oct 04 21:21:29.297575 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1702/3371] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:29 2022] GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 => generated 1497 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:29.306256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e291d639-c2e9-4b59-a397-4e1f159623e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:29.306256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e291d639-c2e9-4b59-a397-4e1f159623e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:29.309853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e291d639-c2e9-4b59-a397-4e1f159623e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:29.315593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e291d639-c2e9-4b59-a397-4e1f159623e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:29.315593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e291d639-c2e9-4b59-a397-4e1f159623e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:29.315593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e291d639-c2e9-4b59-a397-4e1f159623e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:29.315593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e291d639-c2e9-4b59-a397-4e1f159623e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:29.315593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e291d639-c2e9-4b59-a397-4e1f159623e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:29.500895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e291d639-c2e9-4b59-a397-4e1f159623e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:29.508691 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e291d639-c2e9-4b59-a397-4e1f159623e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.210078 Oct 04 21:21:29.509267 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1703/3372] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:29 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:29.513843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5f481b3a-0c4c-48b4-8ad1-595107f9597a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:29.516448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5f481b3a-0c4c-48b4-8ad1-595107f9597a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] [instance: 6ea0933b-1cae-4dbd-a526-b465064ff405] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:29.522345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f481b3a-0c4c-48b4-8ad1-595107f9597a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:29.522841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f481b3a-0c4c-48b4-8ad1-595107f9597a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:29.523287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f481b3a-0c4c-48b4-8ad1-595107f9597a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:29.523990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f481b3a-0c4c-48b4-8ad1-595107f9597a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:29.524451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f481b3a-0c4c-48b4-8ad1-595107f9597a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:29.524884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f481b3a-0c4c-48b4-8ad1-595107f9597a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:29.589690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5f481b3a-0c4c-48b4-8ad1-595107f9597a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:29.598339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5f481b3a-0c4c-48b4-8ad1-595107f9597a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:29.599814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5f481b3a-0c4c-48b4-8ad1-595107f9597a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:29.600953 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5f481b3a-0c4c-48b4-8ad1-595107f9597a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] 10.222.0.30 "GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405" status: 200 len: 1338 microversion: 2.47 time: 0.090693 Oct 04 21:21:29.601543 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1704/3373] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:29 2022] GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405 => generated 1338 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:29.605916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-55dcbf53-8d11-407b-a726-bed6ed64905d tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:29.619515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.compute.server_groups [None req-55dcbf53-8d11-407b-a726-bed6ed64905d tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Querying cell 016bade6-ba85-4482-99c1-a6ee7c8937c1(cell1) for 1 instances {{(pid=122758) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 21:21:29.620788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55dcbf53-8d11-407b-a726-bed6ed64905d tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:29.620788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55dcbf53-8d11-407b-a726-bed6ed64905d tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:29.621154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55dcbf53-8d11-407b-a726-bed6ed64905d tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:29.632377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:29.639193 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-55dcbf53-8d11-407b-a726-bed6ed64905d tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/a8813a40-394a-495a-a359-6cc5764e6025" status: 200 len: 221 microversion: 2.1 time: 0.036432 Oct 04 21:21:29.643678 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1705/3374] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Oct 4 21:21:29 2022] GET /compute/v2.1/os-server-groups/a8813a40-394a-495a-a359-6cc5764e6025 => generated 221 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:29.644357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d97c28b6-f913-4507-9968-745cf87c4887 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:29.646773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d97c28b6-f913-4507-9968-745cf87c4887 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:29.652905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d97c28b6-f913-4507-9968-745cf87c4887 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:29.653398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d97c28b6-f913-4507-9968-745cf87c4887 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:29.653872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d97c28b6-f913-4507-9968-745cf87c4887 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:29.655114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d97c28b6-f913-4507-9968-745cf87c4887 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:29.655577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d97c28b6-f913-4507-9968-745cf87c4887 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:29.656010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d97c28b6-f913-4507-9968-745cf87c4887 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:29.685875 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-da929e6b-f01d-4d44-919b-ceddab17d4db tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/32dd5657-efa0-40ee-8175-14297aaab75e" status: 202 len: 0 microversion: 2.1 time: 0.480887 Oct 04 21:21:29.687063 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1670/3375] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:21:29 2022] DELETE /compute/v2.1/os-security-groups/32dd5657-efa0-40ee-8175-14297aaab75e => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:21:29.696056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9b57d397-23eb-437c-b829-709756002a8b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:29.696876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9b57d397-23eb-437c-b829-709756002a8b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:29.703861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b57d397-23eb-437c-b829-709756002a8b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:29.704376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b57d397-23eb-437c-b829-709756002a8b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:29.704825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b57d397-23eb-437c-b829-709756002a8b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:29.705570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b57d397-23eb-437c-b829-709756002a8b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:29.706281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b57d397-23eb-437c-b829-709756002a8b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:29.706944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b57d397-23eb-437c-b829-709756002a8b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:29.736050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9b57d397-23eb-437c-b829-709756002a8b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:21:29.910850 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d97c28b6-f913-4507-9968-745cf87c4887 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action" status: 202 len: 0 microversion: 2.1 time: 0.269639 Oct 04 21:21:29.911841 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1706/3376] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:21:29 2022] POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:21:29.916846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9cc34304-80f3-4600-8166-3348339634fc tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f5790692820>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:29.945529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG neutronclient.v2_0.client [None req-9cc34304-80f3-4600-8166-3348339634fc tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 32dd5657-efa0-40ee-8175-14297aaab75e does not exist", "detail": ""}} {{(pid=122758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:21:29.946227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.security_group_api [None req-9cc34304-80f3-4600-8166-3348339634fc tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Neutron security group 32dd5657-efa0-40ee-8175-14297aaab75e not found {{(pid=122758) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:21:29.946822 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-9cc34304-80f3-4600-8166-3348339634fc tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] HTTP exception thrown: Security group 32dd5657-efa0-40ee-8175-14297aaab75e does not exist Oct 04 21:21:29.946822 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-11ce2423-5c2b-4aa6-8667-88d75c6eaeab'] Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9cc34304-80f3-4600-8166-3348339634fc tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Request method failure captured: Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-security-groups/32dd5657-efa0-40ee-8175-14297aaab75e HTTP/1.1 Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKOxTfdccv0aEToOcfdr6OtMIo2CNlYhIlgqu92DBOatDQiWjzVvd5IEryG0QCNnKkdKZPQHitv07AkMUDT3qd6-ZcO30gWiCaxcQoOtheHE279h1an9qvnw6-w5GJGiha-QBcDfyNtCASPXAS_OZ9SmSwbX7jLR7-xMrA5rAkFWAyw Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f547dec3057448558ae4d6012037dac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f547dec3057448558ae4d6012037dac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}] Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: cdbb08401bf146068fc351915ede7675 Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: exception: Security group 32dd5657-efa0-40ee-8175-14297aaab75e does not exist Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-11ce2423-5c2b-4aa6-8667-88d75c6eaeab'] Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '32dd5657-efa0-40ee-8175-14297aaab75e'} Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:21:29.948829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 32dd5657-efa0-40ee-8175-14297aaab75e does not exist Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11ce2423-5c2b-4aa6-8667-88d75c6eaeab'] Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 32dd5657-efa0-40ee-8175-14297aaab75e does not exist Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11ce2423-5c2b-4aa6-8667-88d75c6eaeab'] Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 32dd5657-efa0-40ee-8175-14297aaab75e does not exist Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11ce2423-5c2b-4aa6-8667-88d75c6eaeab'] Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 32dd5657-efa0-40ee-8175-14297aaab75e does not exist Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11ce2423-5c2b-4aa6-8667-88d75c6eaeab'] Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9cc34304-80f3-4600-8166-3348339634fc tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Returning 404 to user: Security group 32dd5657-efa0-40ee-8175-14297aaab75e does not exist Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-11ce2423-5c2b-4aa6-8667-88d75c6eaeab'] {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9cc34304-80f3-4600-8166-3348339634fc tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/32dd5657-efa0-40ee-8175-14297aaab75e" status: 404 len: 194 microversion: 2.1 time: 0.037632 Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1707/3377] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Oct 4 21:21:29 2022] GET /compute/v2.1/os-security-groups/32dd5657-efa0-40ee-8175-14297aaab75e => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:21:29.959509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5a218a08-30da-4c53-84f6-1536d2185085 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:29.964569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5a218a08-30da-4c53-84f6-1536d2185085 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:29.966617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a218a08-30da-4c53-84f6-1536d2185085 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:29.967287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a218a08-30da-4c53-84f6-1536d2185085 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:29.967733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a218a08-30da-4c53-84f6-1536d2185085 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:29.968557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a218a08-30da-4c53-84f6-1536d2185085 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:29.968997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a218a08-30da-4c53-84f6-1536d2185085 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:29.969472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a218a08-30da-4c53-84f6-1536d2185085 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:30.149511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5a218a08-30da-4c53-84f6-1536d2185085 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:30.157901 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5a218a08-30da-4c53-84f6-1536d2185085 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1670 microversion: 2.1 time: 0.204615 Oct 04 21:21:30.158712 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1708/3378] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:29 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1670 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:30.163182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-45fea559-60f5-4928-9379-d464558612cf tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f5790692d30>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:30.201741 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9b57d397-23eb-437c-b829-709756002a8b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265" status: 204 len: 0 microversion: 2.1 time: 0.512819 Oct 04 21:21:30.204445 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1671/3379] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:21:29 2022] DELETE /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:21:30.218304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d77451e2-d2db-454e-bea5-db274575d92e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:30.218304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d77451e2-d2db-454e-bea5-db274575d92e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:30.227193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d77451e2-d2db-454e-bea5-db274575d92e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:30.227881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d77451e2-d2db-454e-bea5-db274575d92e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:30.228434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d77451e2-d2db-454e-bea5-db274575d92e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:30.229629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d77451e2-d2db-454e-bea5-db274575d92e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:30.231088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d77451e2-d2db-454e-bea5-db274575d92e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:30.232968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d77451e2-d2db-454e-bea5-db274575d92e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:30.286927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d77451e2-d2db-454e-bea5-db274575d92e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:30.287417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d77451e2-d2db-454e-bea5-db274575d92e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:30.287867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d77451e2-d2db-454e-bea5-db274575d92e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:30.288327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-d77451e2-d2db-454e-bea5-db274575d92e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lazy-loading 'fault' on Instance uuid 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:21:30.344372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d77451e2-d2db-454e-bea5-db274575d92e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b329e207cac4d459d25623d6554f444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb2758d2dc64f70934d8161bf600f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:30.352424 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d77451e2-d2db-454e-bea5-db274575d92e tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 200 len: 1313 microversion: 2.1 time: 0.147811 Oct 04 21:21:30.353015 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1672/3380] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:30 2022] GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:30.377861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-68a3bbff-815b-41c1-a1b1-603d1d51e51d tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:30.378678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-68a3bbff-815b-41c1-a1b1-603d1d51e51d tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:30.385902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68a3bbff-815b-41c1-a1b1-603d1d51e51d tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:30.389034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68a3bbff-815b-41c1-a1b1-603d1d51e51d tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:30.389034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68a3bbff-815b-41c1-a1b1-603d1d51e51d tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:30.389034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68a3bbff-815b-41c1-a1b1-603d1d51e51d tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:30.389034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68a3bbff-815b-41c1-a1b1-603d1d51e51d tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:30.389034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68a3bbff-815b-41c1-a1b1-603d1d51e51d tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:30.441215 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-45fea559-60f5-4928-9379-d464558612cf tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.281402 Oct 04 21:21:30.442608 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1709/3381] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Oct 4 21:21:30 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:30.462656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9ef0fda-a048-4732-a546-a97fa9311431 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Action: 'create', calling method: .version_select at 0x7f5794563e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1668951259", "description": "tempest-description-1755443480"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:30.591155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-68a3bbff-815b-41c1-a1b1-603d1d51e51d tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382de4f98bd4839851ad103b3f56aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e38e36770ed4a498dff7e336aa466af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:30.600102 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-68a3bbff-815b-41c1-a1b1-603d1d51e51d tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265" status: 200 len: 1503 microversion: 2.1 time: 0.245776 Oct 04 21:21:30.600621 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1673/3382] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:30 2022] GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 => generated 1503 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:30.628520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9fc4e809-ac1d-4f71-876d-15519c5e70dc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:30.629145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9fc4e809-ac1d-4f71-876d-15519c5e70dc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] [instance: 6ea0933b-1cae-4dbd-a526-b465064ff405] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:30.635302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9fc4e809-ac1d-4f71-876d-15519c5e70dc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:30.635800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9fc4e809-ac1d-4f71-876d-15519c5e70dc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:30.636246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9fc4e809-ac1d-4f71-876d-15519c5e70dc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:30.636955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9fc4e809-ac1d-4f71-876d-15519c5e70dc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:30.637444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9fc4e809-ac1d-4f71-876d-15519c5e70dc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:30.637880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9fc4e809-ac1d-4f71-876d-15519c5e70dc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:30.721488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9fc4e809-ac1d-4f71-876d-15519c5e70dc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:30.730331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9fc4e809-ac1d-4f71-876d-15519c5e70dc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:30.731926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9fc4e809-ac1d-4f71-876d-15519c5e70dc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:30.734150 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9fc4e809-ac1d-4f71-876d-15519c5e70dc tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] 10.222.0.30 "GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405" status: 200 len: 1359 microversion: 2.47 time: 0.109431 Oct 04 21:21:30.734741 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1674/3383] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:30 2022] GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405 => generated 1359 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:21:30.758979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-84e25960-5870-4256-87fb-2db465964c7a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-907293195"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:30.761793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-84e25960-5870-4256-87fb-2db465964c7a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] [instance: 6ea0933b-1cae-4dbd-a526-b465064ff405] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:30.768799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84e25960-5870-4256-87fb-2db465964c7a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:30.769312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84e25960-5870-4256-87fb-2db465964c7a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:30.776607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84e25960-5870-4256-87fb-2db465964c7a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:30.776607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84e25960-5870-4256-87fb-2db465964c7a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:30.776607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84e25960-5870-4256-87fb-2db465964c7a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:30.776607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84e25960-5870-4256-87fb-2db465964c7a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:31.078574 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d9ef0fda-a048-4732-a546-a97fa9311431 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.623970 Oct 04 21:21:31.086742 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1710/3384] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:21:30 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:21:31.094762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cd8a2cac-9ff0-4077-abda-d6aa8082ca5a tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Action: 'create', calling method: .version_select at 0x7f578bc749d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-720083490", "description": "tempest-description-1825731191"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:31.418610 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-84e25960-5870-4256-87fb-2db465964c7a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] 10.222.0.30 "POST /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405/action" status: 202 len: 52 microversion: 2.47 time: 0.663241 Oct 04 21:21:31.419236 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1675/3385] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Oct 4 21:21:30 2022] POST /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405/action => generated 52 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Oct 04 21:21:31.425664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-007c2e47-5858-4f2e-89ca-9274149be8fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:31.425664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-007c2e47-5858-4f2e-89ca-9274149be8fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:31.432834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-007c2e47-5858-4f2e-89ca-9274149be8fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:31.433335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-007c2e47-5858-4f2e-89ca-9274149be8fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:31.433816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-007c2e47-5858-4f2e-89ca-9274149be8fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:31.434529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-007c2e47-5858-4f2e-89ca-9274149be8fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:31.434991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-007c2e47-5858-4f2e-89ca-9274149be8fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:31.435426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-007c2e47-5858-4f2e-89ca-9274149be8fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:31.648469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-007c2e47-5858-4f2e-89ca-9274149be8fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:31.668617 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-007c2e47-5858-4f2e-89ca-9274149be8fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1670 microversion: 2.1 time: 0.248089 Oct 04 21:21:31.669869 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1676/3386] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:31 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1670 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:31.686180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-edb720f7-9c17-4902-9fd8-c760e7a5a388 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:31.686854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-edb720f7-9c17-4902-9fd8-c760e7a5a388 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] [instance: 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:31.694904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-edb720f7-9c17-4902-9fd8-c760e7a5a388 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:31.702532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-edb720f7-9c17-4902-9fd8-c760e7a5a388 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:31.702532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-edb720f7-9c17-4902-9fd8-c760e7a5a388 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:31.702532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-edb720f7-9c17-4902-9fd8-c760e7a5a388 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:31.702532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-edb720f7-9c17-4902-9fd8-c760e7a5a388 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:31.702532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-edb720f7-9c17-4902-9fd8-c760e7a5a388 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:31.712675 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-edb720f7-9c17-4902-9fd8-c760e7a5a388 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] HTTP exception thrown: Instance 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 could not be found. Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-edb720f7-9c17-4902-9fd8-c760e7a5a388 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Request method failure captured: Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 HTTP/1.1 Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKNoLBxiQolSl6Nag98IU0LwILvMTA3F92QIJR7IF5rdTWFrQObO76q2Mrv_ICE6KyAVdr2bozpD-JyNZ7WXncDojo8WedfbbyO0dlDoqRDPy884vxb3lKIz7WcRmHihPKLPN_DxZH08CBiFvT0Cul3PvOBFLTrtut9dKF_j3VkSKQk Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fbb2758d2dc64f70934d8161bf600f94 Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-683137430 Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb2758d2dc64f70934d8161bf600f94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbb2758d2dc64f70934d8161bf600f94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbb2758d2dc64f70934d8161bf600f94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbb2758d2dc64f70934d8161bf600f94"}]}] Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-683137430 Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fbb2758d2dc64f70934d8161bf600f94 Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-683137430 Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-FloatingIPsAssociationTestJSON-683137430-project Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 1b329e207cac4d459d25623d6554f444 Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-683137430-project Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 could not be found. Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '6ccadfb7-f678-4ca9-9f01-7b268c2e1db6'} Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 could not be found. Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 could not be found. Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:31.714534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:31.721595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:31.721595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:31.721595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:31.721595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:31.721595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:31.721595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:31.721595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 could not be found. Oct 04 21:21:31.721595 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:31.721595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-edb720f7-9c17-4902-9fd8-c760e7a5a388 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] Returning 404 to user: Instance 6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:31.721595 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-edb720f7-9c17-4902-9fd8-c760e7a5a388 tempest-FloatingIPsAssociationTestJSON-683137430 tempest-FloatingIPsAssociationTestJSON-683137430-project] 10.222.0.30 "GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6" status: 404 len: 111 microversion: 2.1 time: 0.036751 Oct 04 21:21:31.721595 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1677/3387] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:31 2022] GET /compute/v2.1/servers/6ccadfb7-f678-4ca9-9f01-7b268c2e1db6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:21:31.725332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4ced8771-14f1-4e80-87cd-2c93a9dc5aa3 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:31.729974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4ced8771-14f1-4e80-87cd-2c93a9dc5aa3 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] [instance: 6ea0933b-1cae-4dbd-a526-b465064ff405] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:31.732098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ced8771-14f1-4e80-87cd-2c93a9dc5aa3 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:31.732849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ced8771-14f1-4e80-87cd-2c93a9dc5aa3 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:31.733612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ced8771-14f1-4e80-87cd-2c93a9dc5aa3 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:31.734549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ced8771-14f1-4e80-87cd-2c93a9dc5aa3 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:31.735078 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ced8771-14f1-4e80-87cd-2c93a9dc5aa3 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:31.735588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ced8771-14f1-4e80-87cd-2c93a9dc5aa3 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:31.766746 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cd8a2cac-9ff0-4077-abda-d6aa8082ca5a tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.676530 Oct 04 21:21:31.783820 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1711/3388] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:21:31 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:31.789680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-06ea9c8b-edfa-4be8-9d2f-c668b739b361 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:31.790733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-06ea9c8b-edfa-4be8-9d2f-c668b739b361 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:31.800191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06ea9c8b-edfa-4be8-9d2f-c668b739b361 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:31.800812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06ea9c8b-edfa-4be8-9d2f-c668b739b361 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:31.805890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06ea9c8b-edfa-4be8-9d2f-c668b739b361 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:31.805890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06ea9c8b-edfa-4be8-9d2f-c668b739b361 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:31.805890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06ea9c8b-edfa-4be8-9d2f-c668b739b361 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:31.805890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06ea9c8b-edfa-4be8-9d2f-c668b739b361 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:31.812070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4ced8771-14f1-4e80-87cd-2c93a9dc5aa3 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] [instance: 6ea0933b-1cae-4dbd-a526-b465064ff405] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:21:31.917561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:32.037953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-06ea9c8b-edfa-4be8-9d2f-c668b739b361 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382de4f98bd4839851ad103b3f56aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e38e36770ed4a498dff7e336aa466af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:32.050910 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-06ea9c8b-edfa-4be8-9d2f-c668b739b361 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265" status: 200 len: 1503 microversion: 2.1 time: 0.265338 Oct 04 21:21:32.052070 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1712/3389] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:31 2022] GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 => generated 1503 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:32.058997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0b9eaf8a-c2bd-4e7a-a563-9b3332286b99 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-168312115", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "fb8201a2-cde9-4360-939e-588100b98ee9"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:32.182651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-0b9eaf8a-c2bd-4e7a-a563-9b3332286b99 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] validate_networks() for [('fb8201a2-cde9-4360-939e-588100b98ee9', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:21:32.339881 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4ced8771-14f1-4e80-87cd-2c93a9dc5aa3 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405" status: 204 len: 0 microversion: 2.47 time: 0.621178 Oct 04 21:21:32.344608 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1678/3390] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:21:31 2022] DELETE /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:21:32.351033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8d229e3d-a725-4f03-beca-1efaf8b38417 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:32.352033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8d229e3d-a725-4f03-beca-1efaf8b38417 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] [instance: 6ea0933b-1cae-4dbd-a526-b465064ff405] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:32.359729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d229e3d-a725-4f03-beca-1efaf8b38417 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:32.360462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d229e3d-a725-4f03-beca-1efaf8b38417 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:32.361085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d229e3d-a725-4f03-beca-1efaf8b38417 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:32.362011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d229e3d-a725-4f03-beca-1efaf8b38417 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:32.362645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d229e3d-a725-4f03-beca-1efaf8b38417 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:32.363268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d229e3d-a725-4f03-beca-1efaf8b38417 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:32.598643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8d229e3d-a725-4f03-beca-1efaf8b38417 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:32.614674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8d229e3d-a725-4f03-beca-1efaf8b38417 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:32.619049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8d229e3d-a725-4f03-beca-1efaf8b38417 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:32.628851 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8d229e3d-a725-4f03-beca-1efaf8b38417 tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] 10.222.0.30 "GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405" status: 200 len: 1365 microversion: 2.47 time: 0.274975 Oct 04 21:21:32.637882 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1679/3391] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:32 2022] GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405 => generated 1365 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:32.693465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4ea59dc1-e063-4100-bfb6-e9bd52a57e33 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:32.695182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4ea59dc1-e063-4100-bfb6-e9bd52a57e33 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:32.705405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ea59dc1-e063-4100-bfb6-e9bd52a57e33 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:32.714249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ea59dc1-e063-4100-bfb6-e9bd52a57e33 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:32.714875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ea59dc1-e063-4100-bfb6-e9bd52a57e33 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:32.715661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ea59dc1-e063-4100-bfb6-e9bd52a57e33 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:32.716168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ea59dc1-e063-4100-bfb6-e9bd52a57e33 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:32.716584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ea59dc1-e063-4100-bfb6-e9bd52a57e33 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:33.020904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-0b9eaf8a-c2bd-4e7a-a563-9b3332286b99 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:21:33.021658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-0b9eaf8a-c2bd-4e7a-a563-9b3332286b99 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:21:33.023178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-0b9eaf8a-c2bd-4e7a-a563-9b3332286b99 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:21:33.023178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-0b9eaf8a-c2bd-4e7a-a563-9b3332286b99 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:21:33.023492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-0b9eaf8a-c2bd-4e7a-a563-9b3332286b99 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:21:33.037881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b9eaf8a-c2bd-4e7a-a563-9b3332286b99 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:33.039053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b9eaf8a-c2bd-4e7a-a563-9b3332286b99 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:33.040248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b9eaf8a-c2bd-4e7a-a563-9b3332286b99 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:33.041355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b9eaf8a-c2bd-4e7a-a563-9b3332286b99 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:33.042025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b9eaf8a-c2bd-4e7a-a563-9b3332286b99 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:33.042893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b9eaf8a-c2bd-4e7a-a563-9b3332286b99 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:33.070022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-0b9eaf8a-c2bd-4e7a-a563-9b3332286b99 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Getting quotas for project f547dec3057448558ae4d6012037dac3. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:21:33.079197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-0b9eaf8a-c2bd-4e7a-a563-9b3332286b99 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Getting quotas for user cdbb08401bf146068fc351915ede7675 and project f547dec3057448558ae4d6012037dac3. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:21:33.105142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0b9eaf8a-c2bd-4e7a-a563-9b3332286b99 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:21:33.108773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0b9eaf8a-c2bd-4e7a-a563-9b3332286b99 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:21:33.124239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4ea59dc1-e063-4100-bfb6-e9bd52a57e33 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:33.134976 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4ea59dc1-e063-4100-bfb6-e9bd52a57e33 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1675 microversion: 2.1 time: 0.446550 Oct 04 21:21:33.136098 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1680/3392] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:32 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1675 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:33.267986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-f112baab-b657-4ee0-af88-3cfe991781b8 req-5ce4ca29-1926-4786-bb4c-c6be5c8ca978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb1bc733-1da6-4c7e-b99f-e491087c8265", "name": "network-vif-deleted", "tag": "da2827e3-9a2a-40c3-b4b2-fd8a416b5f06"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:33.287585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f112baab-b657-4ee0-af88-3cfe991781b8 req-5ce4ca29-1926-4786-bb4c-c6be5c8ca978 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:33.288334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f112baab-b657-4ee0-af88-3cfe991781b8 req-5ce4ca29-1926-4786-bb4c-c6be5c8ca978 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:33.289112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f112baab-b657-4ee0-af88-3cfe991781b8 req-5ce4ca29-1926-4786-bb4c-c6be5c8ca978 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:33.295871 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0b9eaf8a-c2bd-4e7a-a563-9b3332286b99 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.241510 Oct 04 21:21:33.297026 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1713/3393] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:21:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:21:33.302795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6e61f414-82e5-4041-88b5-2f6ff9c07abb tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:33.303633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6e61f414-82e5-4041-88b5-2f6ff9c07abb tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:33.309189 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-f112baab-b657-4ee0-af88-3cfe991781b8 req-5ce4ca29-1926-4786-bb4c-c6be5c8ca978 service nova] Creating event network-vif-deleted:da2827e3-9a2a-40c3-b4b2-fd8a416b5f06 for instance fb1bc733-1da6-4c7e-b99f-e491087c8265 on n-h2-860282-1 Oct 04 21:21:33.313316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e61f414-82e5-4041-88b5-2f6ff9c07abb tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:33.314234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e61f414-82e5-4041-88b5-2f6ff9c07abb tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:33.314906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e61f414-82e5-4041-88b5-2f6ff9c07abb tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:33.315805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e61f414-82e5-4041-88b5-2f6ff9c07abb tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:33.316696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e61f414-82e5-4041-88b5-2f6ff9c07abb tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:33.318056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e61f414-82e5-4041-88b5-2f6ff9c07abb tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:33.322287 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-f112baab-b657-4ee0-af88-3cfe991781b8 req-5ce4ca29-1926-4786-bb4c-c6be5c8ca978 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184716 Oct 04 21:21:33.323098 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1681/3394] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:33.343661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-851020fe-364e-4e5d-8ed5-17a17aa5494c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:33.345901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-851020fe-364e-4e5d-8ed5-17a17aa5494c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:33.357976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e61f414-82e5-4041-88b5-2f6ff9c07abb tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:33.359033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e61f414-82e5-4041-88b5-2f6ff9c07abb tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:33.359717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e61f414-82e5-4041-88b5-2f6ff9c07abb tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:33.360375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-6e61f414-82e5-4041-88b5-2f6ff9c07abb tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lazy-loading 'fault' on Instance uuid fb1bc733-1da6-4c7e-b99f-e491087c8265 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:21:33.476182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6e61f414-82e5-4041-88b5-2f6ff9c07abb tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382de4f98bd4839851ad103b3f56aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e38e36770ed4a498dff7e336aa466af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:33.492825 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6e61f414-82e5-4041-88b5-2f6ff9c07abb tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265" status: 200 len: 1303 microversion: 2.1 time: 0.194165 Oct 04 21:21:33.493480 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1714/3395] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:33 2022] GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 => generated 1303 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:33.522515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-851020fe-364e-4e5d-8ed5-17a17aa5494c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:33.533224 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-851020fe-364e-4e5d-8ed5-17a17aa5494c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1215 microversion: 2.1 time: 0.209053 Oct 04 21:21:33.534121 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1682/3396] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:33 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1215 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:33.654926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-27e06b59-af36-43f5-86c7-d4764392da4a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:33.654926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-27e06b59-af36-43f5-86c7-d4764392da4a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] [instance: 6ea0933b-1cae-4dbd-a526-b465064ff405] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:33.660306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27e06b59-af36-43f5-86c7-d4764392da4a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:33.661046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27e06b59-af36-43f5-86c7-d4764392da4a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:33.661884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27e06b59-af36-43f5-86c7-d4764392da4a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:33.664847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27e06b59-af36-43f5-86c7-d4764392da4a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:33.665378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27e06b59-af36-43f5-86c7-d4764392da4a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:33.666199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27e06b59-af36-43f5-86c7-d4764392da4a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:33.769963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-27e06b59-af36-43f5-86c7-d4764392da4a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:33.778359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-27e06b59-af36-43f5-86c7-d4764392da4a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:33.780675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-27e06b59-af36-43f5-86c7-d4764392da4a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:33.781909 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-27e06b59-af36-43f5-86c7-d4764392da4a tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] 10.222.0.30 "GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405" status: 200 len: 1365 microversion: 2.47 time: 0.138297 Oct 04 21:21:33.782664 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1715/3397] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:33 2022] GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405 => generated 1365 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:34.161127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b324ba31-2ce6-4b30-86e1-d5c4436d9130 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:34.161863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b324ba31-2ce6-4b30-86e1-d5c4436d9130 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:34.189126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b324ba31-2ce6-4b30-86e1-d5c4436d9130 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.189680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b324ba31-2ce6-4b30-86e1-d5c4436d9130 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.190403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b324ba31-2ce6-4b30-86e1-d5c4436d9130 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:34.191143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b324ba31-2ce6-4b30-86e1-d5c4436d9130 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.191977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b324ba31-2ce6-4b30-86e1-d5c4436d9130 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.192417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b324ba31-2ce6-4b30-86e1-d5c4436d9130 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:34.218661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:34.407784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b324ba31-2ce6-4b30-86e1-d5c4436d9130 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:34.419099 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b324ba31-2ce6-4b30-86e1-d5c4436d9130 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.261856 Oct 04 21:21:34.419704 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1683/3398] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:34 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:34.443583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8a4c5033-47aa-4129-bc5c-3c3fa41668d3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:34.448466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8a4c5033-47aa-4129-bc5c-3c3fa41668d3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:34.462654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a4c5033-47aa-4129-bc5c-3c3fa41668d3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.465937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a4c5033-47aa-4129-bc5c-3c3fa41668d3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.466478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a4c5033-47aa-4129-bc5c-3c3fa41668d3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:34.467874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a4c5033-47aa-4129-bc5c-3c3fa41668d3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.468559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a4c5033-47aa-4129-bc5c-3c3fa41668d3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.468993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a4c5033-47aa-4129-bc5c-3c3fa41668d3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:34.522387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bdeb6ecc-00f7-474b-9b8e-13b3d31f5766 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:34.523076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bdeb6ecc-00f7-474b-9b8e-13b3d31f5766 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:34.535727 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8a4c5033-47aa-4129-bc5c-3c3fa41668d3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action" status: 200 len: 322 microversion: 2.1 time: 0.094483 Oct 04 21:21:34.538431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bdeb6ecc-00f7-474b-9b8e-13b3d31f5766 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.539368 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1716/3399] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:21:34 2022] POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action => generated 322 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:34.539865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bdeb6ecc-00f7-474b-9b8e-13b3d31f5766 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.540555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bdeb6ecc-00f7-474b-9b8e-13b3d31f5766 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:34.541659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bdeb6ecc-00f7-474b-9b8e-13b3d31f5766 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.542293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bdeb6ecc-00f7-474b-9b8e-13b3d31f5766 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.542973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bdeb6ecc-00f7-474b-9b8e-13b3d31f5766 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:34.558779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fc5d6646-08e5-43b6-9b12-88464b854f11 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:34.560182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fc5d6646-08e5-43b6-9b12-88464b854f11 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:34.568785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc5d6646-08e5-43b6-9b12-88464b854f11 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.570023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc5d6646-08e5-43b6-9b12-88464b854f11 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.570706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc5d6646-08e5-43b6-9b12-88464b854f11 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:34.571650 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-bdeb6ecc-00f7-474b-9b8e-13b3d31f5766 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] HTTP exception thrown: Instance fb1bc733-1da6-4c7e-b99f-e491087c8265 could not be found. Oct 04 21:21:34.572767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc5d6646-08e5-43b6-9b12-88464b854f11 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.573137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc5d6646-08e5-43b6-9b12-88464b854f11 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bdeb6ecc-00f7-474b-9b8e-13b3d31f5766 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Request method failure captured: Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 HTTP/1.1 Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKO0XkRy1kBT_uKl2rwcmHDUE31CSvcd1QmOz6QbGyRgZZcrp2PRYSWemu5zUdSPP3eq4ZJu5_X_FuhZGiMxtWhLY1Dusotg-yrsTXkWnmALd6Rj_lE3DSNPf-jWgX7qRCHyAFwF1EQK6ms3tz06jNSZbgTbH1GLzro0PFegYFUD5qM Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 4e38e36770ed4a498dff7e336aa466af Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4e38e36770ed4a498dff7e336aa466af"}]}] Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 4e38e36770ed4a498dff7e336aa466af Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerGroupTestJSON-1054859231-project Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c382de4f98bd4839851ad103b3f56aa6 Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerGroupTestJSON-1054859231-project Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance fb1bc733-1da6-4c7e-b99f-e491087c8265 could not be found. Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'fb1bc733-1da6-4c7e-b99f-e491087c8265'} Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb1bc733-1da6-4c7e-b99f-e491087c8265 could not be found. Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb1bc733-1da6-4c7e-b99f-e491087c8265 could not be found. Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:34.573708 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:34.590666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:34.590666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:34.590666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:34.590666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:34.590666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:34.590666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb1bc733-1da6-4c7e-b99f-e491087c8265 could not be found. Oct 04 21:21:34.590666 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:34.590666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bdeb6ecc-00f7-474b-9b8e-13b3d31f5766 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Returning 404 to user: Instance fb1bc733-1da6-4c7e-b99f-e491087c8265 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:34.590666 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bdeb6ecc-00f7-474b-9b8e-13b3d31f5766 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265" status: 404 len: 111 microversion: 2.1 time: 0.059886 Oct 04 21:21:34.590666 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1684/3400] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:34 2022] GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:21:34.590666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9b27e821-3b11-461f-88c7-389da7aeb55d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:34.590666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9b27e821-3b11-461f-88c7-389da7aeb55d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:34.592613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc5d6646-08e5-43b6-9b12-88464b854f11 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:34.650783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9b27e821-3b11-461f-88c7-389da7aeb55d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:34.659453 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9b27e821-3b11-461f-88c7-389da7aeb55d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1215 microversion: 2.1 time: 0.081299 Oct 04 21:21:34.669486 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1685/3401] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:34 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:34.669486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-44544bd5-0768-4148-a2ec-0f732cb54e80 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:34.689800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.compute.server_groups [None req-44544bd5-0768-4148-a2ec-0f732cb54e80 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Querying cell 016bade6-ba85-4482-99c1-a6ee7c8937c1(cell1) for 1 instances {{(pid=122757) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 21:21:34.690589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44544bd5-0768-4148-a2ec-0f732cb54e80 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.691081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44544bd5-0768-4148-a2ec-0f732cb54e80 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.691522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44544bd5-0768-4148-a2ec-0f732cb54e80 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:34.703862 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-44544bd5-0768-4148-a2ec-0f732cb54e80 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.042260 Oct 04 21:21:34.704790 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1686/3402] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:21:34 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:34.718348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-16c25109-486c-4042-88c9-67e1e773933b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:34.734842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.compute.server_groups [None req-16c25109-486c-4042-88c9-67e1e773933b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Querying cell 016bade6-ba85-4482-99c1-a6ee7c8937c1(cell1) for 1 instances {{(pid=122757) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 21:21:34.735567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16c25109-486c-4042-88c9-67e1e773933b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.736048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16c25109-486c-4042-88c9-67e1e773933b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.736568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16c25109-486c-4042-88c9-67e1e773933b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:34.748419 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-16c25109-486c-4042-88c9-67e1e773933b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/a8813a40-394a-495a-a359-6cc5764e6025" status: 200 len: 183 microversion: 2.1 time: 0.035506 Oct 04 21:21:34.749462 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1687/3403] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Oct 4 21:21:34 2022] GET /compute/v2.1/os-server-groups/a8813a40-394a-495a-a359-6cc5764e6025 => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:34.764820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bef024af-f309-4266-ab47-e60361944968 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:34.765043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bef024af-f309-4266-ab47-e60361944968 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:34.773498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bef024af-f309-4266-ab47-e60361944968 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.775012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bef024af-f309-4266-ab47-e60361944968 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.775778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bef024af-f309-4266-ab47-e60361944968 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:34.776809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bef024af-f309-4266-ab47-e60361944968 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.777665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bef024af-f309-4266-ab47-e60361944968 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.778341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bef024af-f309-4266-ab47-e60361944968 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:34.795630 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-bef024af-f309-4266-ab47-e60361944968 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] HTTP exception thrown: Instance fb1bc733-1da6-4c7e-b99f-e491087c8265 could not be found. Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bef024af-f309-4266-ab47-e60361944968 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Request method failure captured: Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 HTTP/1.1 Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKO0XkRy1kBT_uKl2rwcmHDUE31CSvcd1QmOz6QbGyRgZZcrp2PRYSWemu5zUdSPP3eq4ZJu5_X_FuhZGiMxtWhLY1Dusotg-yrsTXkWnmALd6Rj_lE3DSNPf-jWgX7qRCHyAFwF1EQK6ms3tz06jNSZbgTbH1GLzro0PFegYFUD5qM Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 4e38e36770ed4a498dff7e336aa466af Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4e38e36770ed4a498dff7e336aa466af"}]}] Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 4e38e36770ed4a498dff7e336aa466af Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerGroupTestJSON-1054859231-project Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c382de4f98bd4839851ad103b3f56aa6 Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerGroupTestJSON-1054859231-project Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance fb1bc733-1da6-4c7e-b99f-e491087c8265 could not be found. Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'fb1bc733-1da6-4c7e-b99f-e491087c8265'} Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb1bc733-1da6-4c7e-b99f-e491087c8265 could not be found. Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:21:34.797700 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:21:34.802524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb1bc733-1da6-4c7e-b99f-e491087c8265 could not be found. Oct 04 21:21:34.802524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:34.802524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:34.802524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:34.802524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:34.802524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:34.802524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:34.802524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:34.802524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:34.802524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb1bc733-1da6-4c7e-b99f-e491087c8265 could not be found. Oct 04 21:21:34.802524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:34.802524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bef024af-f309-4266-ab47-e60361944968 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Returning 404 to user: Instance fb1bc733-1da6-4c7e-b99f-e491087c8265 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:34.802524 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bef024af-f309-4266-ab47-e60361944968 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265" status: 404 len: 111 microversion: 2.1 time: 0.039860 Oct 04 21:21:34.802524 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1688/3404] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:21:34 2022] DELETE /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:21:34.809226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-05b32106-177d-42c8-ac7d-76d548e2986e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:34.810912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-05b32106-177d-42c8-ac7d-76d548e2986e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] [instance: 6ea0933b-1cae-4dbd-a526-b465064ff405] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:34.817713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05b32106-177d-42c8-ac7d-76d548e2986e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.819588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05b32106-177d-42c8-ac7d-76d548e2986e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.820120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05b32106-177d-42c8-ac7d-76d548e2986e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:34.821110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05b32106-177d-42c8-ac7d-76d548e2986e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.821865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05b32106-177d-42c8-ac7d-76d548e2986e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.822310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05b32106-177d-42c8-ac7d-76d548e2986e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:34.856950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fc5d6646-08e5-43b6-9b12-88464b854f11 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:34.873621 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fc5d6646-08e5-43b6-9b12-88464b854f11 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.326590 Oct 04 21:21:34.873621 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1717/3405] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:34 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:34.914023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-89a361c5-0c9d-417e-aa08-e61688564a1b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:34.914023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-89a361c5-0c9d-417e-aa08-e61688564a1b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] [instance: fb1bc733-1da6-4c7e-b99f-e491087c8265] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:34.920242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89a361c5-0c9d-417e-aa08-e61688564a1b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.920964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89a361c5-0c9d-417e-aa08-e61688564a1b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.921497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89a361c5-0c9d-417e-aa08-e61688564a1b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:34.922274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89a361c5-0c9d-417e-aa08-e61688564a1b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.922801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89a361c5-0c9d-417e-aa08-e61688564a1b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.923295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89a361c5-0c9d-417e-aa08-e61688564a1b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:34.939289 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-89a361c5-0c9d-417e-aa08-e61688564a1b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] HTTP exception thrown: Instance fb1bc733-1da6-4c7e-b99f-e491087c8265 could not be found. Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-89a361c5-0c9d-417e-aa08-e61688564a1b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Request method failure captured: Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 HTTP/1.1 Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKO0XkRy1kBT_uKl2rwcmHDUE31CSvcd1QmOz6QbGyRgZZcrp2PRYSWemu5zUdSPP3eq4ZJu5_X_FuhZGiMxtWhLY1Dusotg-yrsTXkWnmALd6Rj_lE3DSNPf-jWgX7qRCHyAFwF1EQK6ms3tz06jNSZbgTbH1GLzro0PFegYFUD5qM Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 4e38e36770ed4a498dff7e336aa466af Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4e38e36770ed4a498dff7e336aa466af"}]}] Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 4e38e36770ed4a498dff7e336aa466af Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerGroupTestJSON-1054859231-project Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c382de4f98bd4839851ad103b3f56aa6 Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerGroupTestJSON-1054859231-project Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance fb1bc733-1da6-4c7e-b99f-e491087c8265 could not be found. Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'fb1bc733-1da6-4c7e-b99f-e491087c8265'} Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb1bc733-1da6-4c7e-b99f-e491087c8265 could not be found. Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb1bc733-1da6-4c7e-b99f-e491087c8265 could not be found. Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:34.941150 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:34.952470 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:34.952470 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:34.952470 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:34.952470 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:34.952470 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:34.952470 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb1bc733-1da6-4c7e-b99f-e491087c8265 could not be found. Oct 04 21:21:34.952470 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:34.952470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-89a361c5-0c9d-417e-aa08-e61688564a1b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Returning 404 to user: Instance fb1bc733-1da6-4c7e-b99f-e491087c8265 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:34.952470 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-89a361c5-0c9d-417e-aa08-e61688564a1b tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265" status: 404 len: 111 microversion: 2.1 time: 0.054265 Oct 04 21:21:34.952470 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1718/3406] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:34 2022] GET /compute/v2.1/servers/fb1bc733-1da6-4c7e-b99f-e491087c8265 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:21:34.952470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8d7ababd-fefa-45ed-b7ec-5cfb134994ab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:34.952470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8d7ababd-fefa-45ed-b7ec-5cfb134994ab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:34.959740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d7ababd-fefa-45ed-b7ec-5cfb134994ab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.960582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d7ababd-fefa-45ed-b7ec-5cfb134994ab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.961236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d7ababd-fefa-45ed-b7ec-5cfb134994ab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:34.962212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d7ababd-fefa-45ed-b7ec-5cfb134994ab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.962918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d7ababd-fefa-45ed-b7ec-5cfb134994ab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.963621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d7ababd-fefa-45ed-b7ec-5cfb134994ab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:35.013582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-05b32106-177d-42c8-ac7d-76d548e2986e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:35.035152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-05b32106-177d-42c8-ac7d-76d548e2986e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:35.038352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-05b32106-177d-42c8-ac7d-76d548e2986e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:35.039777 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-05b32106-177d-42c8-ac7d-76d548e2986e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] 10.222.0.30 "GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405" status: 200 len: 1365 microversion: 2.47 time: 0.234707 Oct 04 21:21:35.053509 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1689/3407] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:34 2022] GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:21:35.053509 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5102ad32-ceea-40cd-ab89-3ddbdff712d2 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:35.054768 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-5102ad32-ceea-40cd-ab89-3ddbdff712d2 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] HTTP exception thrown: Instance group c46db76b-b002-4489-805e-8f3cf774e1a8 could not be found. Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5102ad32-ceea-40cd-ab89-3ddbdff712d2 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Request method failure captured: Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/os-server-groups/c46db76b-b002-4489-805e-8f3cf774e1a8 HTTP/1.1 Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKO0XkRy1kBT_uKl2rwcmHDUE31CSvcd1QmOz6QbGyRgZZcrp2PRYSWemu5zUdSPP3eq4ZJu5_X_FuhZGiMxtWhLY1Dusotg-yrsTXkWnmALd6Rj_lE3DSNPf-jWgX7qRCHyAFwF1EQK6ms3tz06jNSZbgTbH1GLzro0PFegYFUD5qM Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 4e38e36770ed4a498dff7e336aa466af Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4e38e36770ed4a498dff7e336aa466af"}]}] Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 4e38e36770ed4a498dff7e336aa466af Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerGroupTestJSON-1054859231-project Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c382de4f98bd4839851ad103b3f56aa6 Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerGroupTestJSON-1054859231-project Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance group c46db76b-b002-4489-805e-8f3cf774e1a8 could not be found. Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'c46db76b-b002-4489-805e-8f3cf774e1a8'} Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c46db76b-b002-4489-805e-8f3cf774e1a8 could not be found. Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c46db76b-b002-4489-805e-8f3cf774e1a8 could not be found. Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.063575 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:35.068663 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:35.068663 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:35.068663 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:35.068663 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:35.068663 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c46db76b-b002-4489-805e-8f3cf774e1a8 could not be found. Oct 04 21:21:35.068663 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.068663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5102ad32-ceea-40cd-ab89-3ddbdff712d2 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Returning 404 to user: Instance group c46db76b-b002-4489-805e-8f3cf774e1a8 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:35.070205 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5102ad32-ceea-40cd-ab89-3ddbdff712d2 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/c46db76b-b002-4489-805e-8f3cf774e1a8" status: 404 len: 117 microversion: 2.1 time: 0.027669 Oct 04 21:21:35.077657 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1690/3408] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Oct 4 21:21:35 2022] DELETE /compute/v2.1/os-server-groups/c46db76b-b002-4489-805e-8f3cf774e1a8 => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:21:35.092852 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ff97acde-a843-4d0c-bd66-26b35e937046 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:35.100831 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-ff97acde-a843-4d0c-bd66-26b35e937046 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] HTTP exception thrown: Instance group fbc950f8-1080-4488-baeb-830bb164f354 could not be found. Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ff97acde-a843-4d0c-bd66-26b35e937046 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Request method failure captured: Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/os-server-groups/fbc950f8-1080-4488-baeb-830bb164f354 HTTP/1.1 Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKO0XkRy1kBT_uKl2rwcmHDUE31CSvcd1QmOz6QbGyRgZZcrp2PRYSWemu5zUdSPP3eq4ZJu5_X_FuhZGiMxtWhLY1Dusotg-yrsTXkWnmALd6Rj_lE3DSNPf-jWgX7qRCHyAFwF1EQK6ms3tz06jNSZbgTbH1GLzro0PFegYFUD5qM Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 4e38e36770ed4a498dff7e336aa466af Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4e38e36770ed4a498dff7e336aa466af"}]}] Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 4e38e36770ed4a498dff7e336aa466af Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerGroupTestJSON-1054859231-project Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c382de4f98bd4839851ad103b3f56aa6 Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerGroupTestJSON-1054859231-project Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance group fbc950f8-1080-4488-baeb-830bb164f354 could not be found. Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'fbc950f8-1080-4488-baeb-830bb164f354'} Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fbc950f8-1080-4488-baeb-830bb164f354 could not be found. Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fbc950f8-1080-4488-baeb-830bb164f354 could not be found. Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.102961 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:35.117144 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:35.117144 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:35.117144 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:35.117144 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:35.117144 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fbc950f8-1080-4488-baeb-830bb164f354 could not be found. Oct 04 21:21:35.117144 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.117144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ff97acde-a843-4d0c-bd66-26b35e937046 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Returning 404 to user: Instance group fbc950f8-1080-4488-baeb-830bb164f354 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:35.117144 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ff97acde-a843-4d0c-bd66-26b35e937046 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/fbc950f8-1080-4488-baeb-830bb164f354" status: 404 len: 117 microversion: 2.1 time: 0.023571 Oct 04 21:21:35.117144 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1691/3409] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Oct 4 21:21:35 2022] DELETE /compute/v2.1/os-server-groups/fbc950f8-1080-4488-baeb-830bb164f354 => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:21:35.125330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bf1e6960-3271-4c49-ae0d-82f25faf132a tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:35.153453 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-bf1e6960-3271-4c49-ae0d-82f25faf132a tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] HTTP exception thrown: Instance group d474a426-6c34-443a-aaa5-0ed462dcc12a could not be found. Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bf1e6960-3271-4c49-ae0d-82f25faf132a tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Request method failure captured: Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/os-server-groups/d474a426-6c34-443a-aaa5-0ed462dcc12a HTTP/1.1 Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKO0XkRy1kBT_uKl2rwcmHDUE31CSvcd1QmOz6QbGyRgZZcrp2PRYSWemu5zUdSPP3eq4ZJu5_X_FuhZGiMxtWhLY1Dusotg-yrsTXkWnmALd6Rj_lE3DSNPf-jWgX7qRCHyAFwF1EQK6ms3tz06jNSZbgTbH1GLzro0PFegYFUD5qM Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 4e38e36770ed4a498dff7e336aa466af Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4e38e36770ed4a498dff7e336aa466af"}]}] Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 4e38e36770ed4a498dff7e336aa466af Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerGroupTestJSON-1054859231-project Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c382de4f98bd4839851ad103b3f56aa6 Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerGroupTestJSON-1054859231-project Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance group d474a426-6c34-443a-aaa5-0ed462dcc12a could not be found. Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'd474a426-6c34-443a-aaa5-0ed462dcc12a'} Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d474a426-6c34-443a-aaa5-0ed462dcc12a could not be found. Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d474a426-6c34-443a-aaa5-0ed462dcc12a could not be found. Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.154940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:35.160311 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:35.160311 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:35.160311 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:35.160311 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:35.160311 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d474a426-6c34-443a-aaa5-0ed462dcc12a could not be found. Oct 04 21:21:35.160311 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.160311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bf1e6960-3271-4c49-ae0d-82f25faf132a tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Returning 404 to user: Instance group d474a426-6c34-443a-aaa5-0ed462dcc12a could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:35.160311 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bf1e6960-3271-4c49-ae0d-82f25faf132a tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/d474a426-6c34-443a-aaa5-0ed462dcc12a" status: 404 len: 117 microversion: 2.1 time: 0.041240 Oct 04 21:21:35.163752 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1692/3410] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Oct 4 21:21:35 2022] DELETE /compute/v2.1/os-server-groups/d474a426-6c34-443a-aaa5-0ed462dcc12a => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:21:35.170245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-63c139c2-6761-4ccf-bc9b-9aa36672fdf5 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:35.178682 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-63c139c2-6761-4ccf-bc9b-9aa36672fdf5 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] HTTP exception thrown: Instance group 37559ea2-543f-4e7b-8820-829b362a6716 could not be found. Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-63c139c2-6761-4ccf-bc9b-9aa36672fdf5 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Request method failure captured: Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/os-server-groups/37559ea2-543f-4e7b-8820-829b362a6716 HTTP/1.1 Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKO0XkRy1kBT_uKl2rwcmHDUE31CSvcd1QmOz6QbGyRgZZcrp2PRYSWemu5zUdSPP3eq4ZJu5_X_FuhZGiMxtWhLY1Dusotg-yrsTXkWnmALd6Rj_lE3DSNPf-jWgX7qRCHyAFwF1EQK6ms3tz06jNSZbgTbH1GLzro0PFegYFUD5qM Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 4e38e36770ed4a498dff7e336aa466af Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4e38e36770ed4a498dff7e336aa466af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4e38e36770ed4a498dff7e336aa466af"}]}] Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 4e38e36770ed4a498dff7e336aa466af Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerGroupTestJSON-1054859231 Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerGroupTestJSON-1054859231-project Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c382de4f98bd4839851ad103b3f56aa6 Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerGroupTestJSON-1054859231-project Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance group 37559ea2-543f-4e7b-8820-829b362a6716 could not be found. Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '37559ea2-543f-4e7b-8820-829b362a6716'} Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 37559ea2-543f-4e7b-8820-829b362a6716 could not be found. Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 37559ea2-543f-4e7b-8820-829b362a6716 could not be found. Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.180397 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:35.186475 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:35.186475 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:35.186475 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:35.186475 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:35.186475 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 37559ea2-543f-4e7b-8820-829b362a6716 could not be found. Oct 04 21:21:35.186475 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:35.186475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-63c139c2-6761-4ccf-bc9b-9aa36672fdf5 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Returning 404 to user: Instance group 37559ea2-543f-4e7b-8820-829b362a6716 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:35.186475 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-63c139c2-6761-4ccf-bc9b-9aa36672fdf5 tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/37559ea2-543f-4e7b-8820-829b362a6716" status: 404 len: 117 microversion: 2.1 time: 0.016145 Oct 04 21:21:35.186475 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1693/3411] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Oct 4 21:21:35 2022] DELETE /compute/v2.1/os-server-groups/37559ea2-543f-4e7b-8820-829b362a6716 => generated 117 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:21:35.196546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2698d86f-5679-45ee-956c-baa61a0d3eff tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:35.219055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8d7ababd-fefa-45ed-b7ec-5cfb134994ab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:35.227689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:35.236848 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8d7ababd-fefa-45ed-b7ec-5cfb134994ab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.288969 Oct 04 21:21:35.237494 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1719/3412] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:34 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:35.259807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a111d2e2-c5e6-4fff-adb1-5af29f811b69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:35.260441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a111d2e2-c5e6-4fff-adb1-5af29f811b69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:35.268821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a111d2e2-c5e6-4fff-adb1-5af29f811b69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:35.269809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a111d2e2-c5e6-4fff-adb1-5af29f811b69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:35.270258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a111d2e2-c5e6-4fff-adb1-5af29f811b69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:35.271020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a111d2e2-c5e6-4fff-adb1-5af29f811b69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:35.271481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a111d2e2-c5e6-4fff-adb1-5af29f811b69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:35.272058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a111d2e2-c5e6-4fff-adb1-5af29f811b69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:35.360527 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2698d86f-5679-45ee-956c-baa61a0d3eff tempest-ServerGroupTestJSON-1054859231 tempest-ServerGroupTestJSON-1054859231-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/a8813a40-394a-495a-a359-6cc5764e6025" status: 204 len: 0 microversion: 2.1 time: 0.168918 Oct 04 21:21:35.360527 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1694/3413] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Oct 4 21:21:35 2022] DELETE /compute/v2.1/os-server-groups/a8813a40-394a-495a-a359-6cc5764e6025 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:21:35.567371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a111d2e2-c5e6-4fff-adb1-5af29f811b69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:35.578564 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a111d2e2-c5e6-4fff-adb1-5af29f811b69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.322611 Oct 04 21:21:35.599007 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1720/3414] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:35 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:35.624277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a02ed489-3c22-4e7e-b620-2a9594070d27 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:35.626217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a02ed489-3c22-4e7e-b620-2a9594070d27 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:35.633478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a02ed489-3c22-4e7e-b620-2a9594070d27 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:35.646309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a02ed489-3c22-4e7e-b620-2a9594070d27 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:35.647027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a02ed489-3c22-4e7e-b620-2a9594070d27 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:35.648970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a02ed489-3c22-4e7e-b620-2a9594070d27 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:35.652655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a02ed489-3c22-4e7e-b620-2a9594070d27 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:35.653317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a02ed489-3c22-4e7e-b620-2a9594070d27 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:35.687537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-935fe062-26af-435b-9b6c-1646ded6a7b4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:35.688152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-935fe062-26af-435b-9b6c-1646ded6a7b4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:35.724878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-935fe062-26af-435b-9b6c-1646ded6a7b4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:35.725810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-935fe062-26af-435b-9b6c-1646ded6a7b4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:35.726739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-935fe062-26af-435b-9b6c-1646ded6a7b4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:35.736041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-935fe062-26af-435b-9b6c-1646ded6a7b4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:35.736041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-935fe062-26af-435b-9b6c-1646ded6a7b4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:35.736041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-935fe062-26af-435b-9b6c-1646ded6a7b4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:36.117640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-935fe062-26af-435b-9b6c-1646ded6a7b4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:36.137817 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-935fe062-26af-435b-9b6c-1646ded6a7b4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1267 microversion: 2.1 time: 0.455054 Oct 04 21:21:36.139253 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1721/3415] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:35 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1267 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:36.159658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e05ee0d5-ed33-4097-98c0-4b99cbc7844c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:36.161162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e05ee0d5-ed33-4097-98c0-4b99cbc7844c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] [instance: 6ea0933b-1cae-4dbd-a526-b465064ff405] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:36.168944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e05ee0d5-ed33-4097-98c0-4b99cbc7844c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:36.170327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e05ee0d5-ed33-4097-98c0-4b99cbc7844c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:36.171048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e05ee0d5-ed33-4097-98c0-4b99cbc7844c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:36.172920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e05ee0d5-ed33-4097-98c0-4b99cbc7844c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:36.173620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e05ee0d5-ed33-4097-98c0-4b99cbc7844c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:36.174831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e05ee0d5-ed33-4097-98c0-4b99cbc7844c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:36.215439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e05ee0d5-ed33-4097-98c0-4b99cbc7844c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:36.216258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e05ee0d5-ed33-4097-98c0-4b99cbc7844c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:36.217587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e05ee0d5-ed33-4097-98c0-4b99cbc7844c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:36.218335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-e05ee0d5-ed33-4097-98c0-4b99cbc7844c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lazy-loading 'fault' on Instance uuid 6ea0933b-1cae-4dbd-a526-b465064ff405 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:21:36.624776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e05ee0d5-ed33-4097-98c0-4b99cbc7844c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:36.634915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e05ee0d5-ed33-4097-98c0-4b99cbc7844c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:36.645187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e05ee0d5-ed33-4097-98c0-4b99cbc7844c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ea6735f954af1a7a2c4c578e7f562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b29055c3fc4b0587334b7f9b66c352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:36.645187 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e05ee0d5-ed33-4097-98c0-4b99cbc7844c tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] 10.222.0.30 "GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405" status: 200 len: 1370 microversion: 2.47 time: 0.500309 Oct 04 21:21:36.645838 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1722/3416] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:36 2022] GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405 => generated 1370 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:36.652819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a02ed489-3c22-4e7e-b620-2a9594070d27 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:36.667104 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a02ed489-3c22-4e7e-b620-2a9594070d27 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 1.046053 Oct 04 21:21:36.670283 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1695/3417] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:35 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:36.914792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7d763e37-b06f-4f4b-a812-2519c12765f2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1840871447", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "734a8a85-50ab-4efa-9474-a014f1074a74"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:36.984303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-7d763e37-b06f-4f4b-a812-2519c12765f2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] validate_networks() for [('734a8a85-50ab-4efa-9474-a014f1074a74', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:21:37.166156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ed87149f-4362-43e6-b65a-d7ba0f150d96 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:37.166779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ed87149f-4362-43e6-b65a-d7ba0f150d96 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:37.178257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed87149f-4362-43e6-b65a-d7ba0f150d96 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:37.178754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed87149f-4362-43e6-b65a-d7ba0f150d96 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:37.179201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed87149f-4362-43e6-b65a-d7ba0f150d96 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:37.179913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed87149f-4362-43e6-b65a-d7ba0f150d96 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:37.189862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed87149f-4362-43e6-b65a-d7ba0f150d96 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:37.190453 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed87149f-4362-43e6-b65a-d7ba0f150d96 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:37.345391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ed87149f-4362-43e6-b65a-d7ba0f150d96 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:37.357826 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ed87149f-4362-43e6-b65a-d7ba0f150d96 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1275 microversion: 2.1 time: 0.195244 Oct 04 21:21:37.362525 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1696/3418] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:37 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1275 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:37.673573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-94f3bb4b-981c-4d42-adb1-99aa4856f80e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:37.674260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-94f3bb4b-981c-4d42-adb1-99aa4856f80e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] [instance: 6ea0933b-1cae-4dbd-a526-b465064ff405] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:37.689243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94f3bb4b-981c-4d42-adb1-99aa4856f80e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:37.694959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94f3bb4b-981c-4d42-adb1-99aa4856f80e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:37.697962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94f3bb4b-981c-4d42-adb1-99aa4856f80e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:37.699012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94f3bb4b-981c-4d42-adb1-99aa4856f80e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:37.700818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94f3bb4b-981c-4d42-adb1-99aa4856f80e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:37.702422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94f3bb4b-981c-4d42-adb1-99aa4856f80e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:37.741596 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-94f3bb4b-981c-4d42-adb1-99aa4856f80e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] HTTP exception thrown: Instance 6ea0933b-1cae-4dbd-a526-b465064ff405 could not be found. Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-94f3bb4b-981c-4d42-adb1-99aa4856f80e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Request method failure captured: Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405 HTTP/1.1 Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKPPS3cDGsHIApvCuS-2Wmn_74p5bLPNYUSr752FJx2W_ckzo3pZI6-PO3Ak0m4LnixgbGfvtA7zxhog1AzEHUTF5ZNficA81Pn5FHQGJ_LMA4rDW7TEXayeuW-e-9hFgoinJP3oFRmV1TNnrYOJdUtteJKaAstd9wcG54Tr32xejFQ Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: d9b29055c3fc4b0587334b7f9b66c352 Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersAaction247Test-1799258604 Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d9b29055c3fc4b0587334b7f9b66c352"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d9b29055c3fc4b0587334b7f9b66c352"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d9b29055c3fc4b0587334b7f9b66c352"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d9b29055c3fc4b0587334b7f9b66c352"}]}] Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersAaction247Test-1799258604 Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: d9b29055c3fc4b0587334b7f9b66c352 Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersAaction247Test-1799258604 Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersAaction247Test-1799258604-project Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 2e9ea6735f954af1a7a2c4c578e7f562 Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersAaction247Test-1799258604-project Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 6ea0933b-1cae-4dbd-a526-b465064ff405 could not be found. Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '6ea0933b-1cae-4dbd-a526-b465064ff405'} Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ea0933b-1cae-4dbd-a526-b465064ff405 could not be found. Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ea0933b-1cae-4dbd-a526-b465064ff405 could not be found. Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:37.748341 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:37.753897 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:37.753897 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:37.753897 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:37.753897 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:37.753897 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:37.753897 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:37.753897 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ea0933b-1cae-4dbd-a526-b465064ff405 could not be found. Oct 04 21:21:37.753897 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:21:37.753897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-94f3bb4b-981c-4d42-adb1-99aa4856f80e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] Returning 404 to user: Instance 6ea0933b-1cae-4dbd-a526-b465064ff405 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:37.753897 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-94f3bb4b-981c-4d42-adb1-99aa4856f80e tempest-ServersAaction247Test-1799258604 tempest-ServersAaction247Test-1799258604-project] 10.222.0.30 "GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405" status: 404 len: 111 microversion: 2.47 time: 0.082677 Oct 04 21:21:37.756733 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1697/3419] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:37 2022] GET /compute/v2.1/servers/6ea0933b-1cae-4dbd-a526-b465064ff405 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:21:38.260547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7d763e37-b06f-4f4b-a812-2519c12765f2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:21:38.261082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7d763e37-b06f-4f4b-a812-2519c12765f2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:21:38.261705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7d763e37-b06f-4f4b-a812-2519c12765f2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:21:38.262451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7d763e37-b06f-4f4b-a812-2519c12765f2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:21:38.263217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7d763e37-b06f-4f4b-a812-2519c12765f2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:21:38.287118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d763e37-b06f-4f4b-a812-2519c12765f2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:38.287828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d763e37-b06f-4f4b-a812-2519c12765f2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:38.288378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d763e37-b06f-4f4b-a812-2519c12765f2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:38.289386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d763e37-b06f-4f4b-a812-2519c12765f2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:38.289978 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d763e37-b06f-4f4b-a812-2519c12765f2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:38.290525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d763e37-b06f-4f4b-a812-2519c12765f2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:38.338533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7d763e37-b06f-4f4b-a812-2519c12765f2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Getting quotas for project 0f62474e9d474aa28ac754b712e68652. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:21:38.345525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7d763e37-b06f-4f4b-a812-2519c12765f2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Getting quotas for user 8ef7d2991dce46278486e0ee963d4cf3 and project 0f62474e9d474aa28ac754b712e68652. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:21:38.370979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7d763e37-b06f-4f4b-a812-2519c12765f2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:21:38.379576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7d763e37-b06f-4f4b-a812-2519c12765f2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:21:38.387162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-91dc5e75-4e98-4068-a02b-03e92a7d8405 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:38.399690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-91dc5e75-4e98-4068-a02b-03e92a7d8405 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:38.411648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91dc5e75-4e98-4068-a02b-03e92a7d8405 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:38.412233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91dc5e75-4e98-4068-a02b-03e92a7d8405 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:38.412695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91dc5e75-4e98-4068-a02b-03e92a7d8405 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:38.416030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91dc5e75-4e98-4068-a02b-03e92a7d8405 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:38.418685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91dc5e75-4e98-4068-a02b-03e92a7d8405 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:38.434918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91dc5e75-4e98-4068-a02b-03e92a7d8405 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:38.682071 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7d763e37-b06f-4f4b-a812-2519c12765f2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.774061 Oct 04 21:21:38.685195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-91dc5e75-4e98-4068-a02b-03e92a7d8405 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:38.687348 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1723/3420] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:21:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:21:38.694095 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-91dc5e75-4e98-4068-a02b-03e92a7d8405 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1273 microversion: 2.1 time: 0.309365 Oct 04 21:21:38.695607 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1698/3421] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:38 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1273 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:38.699726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-23207cf3-fd79-4789-9347-9218eb1545b1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:38.702733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-23207cf3-fd79-4789-9347-9218eb1545b1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:38.881783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-23207cf3-fd79-4789-9347-9218eb1545b1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:38.908170 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-23207cf3-fd79-4789-9347-9218eb1545b1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1215 microversion: 2.1 time: 0.214215 Oct 04 21:21:38.924059 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1724/3422] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:38 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1215 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:39.720218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b9b190fd-f4e6-4e5b-9ff7-d4d77bc3ccf8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:39.720849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b9b190fd-f4e6-4e5b-9ff7-d4d77bc3ccf8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:39.741948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9b190fd-f4e6-4e5b-9ff7-d4d77bc3ccf8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:39.743959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9b190fd-f4e6-4e5b-9ff7-d4d77bc3ccf8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:39.745671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9b190fd-f4e6-4e5b-9ff7-d4d77bc3ccf8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:39.746641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9b190fd-f4e6-4e5b-9ff7-d4d77bc3ccf8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:39.749236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9b190fd-f4e6-4e5b-9ff7-d4d77bc3ccf8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:39.751877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9b190fd-f4e6-4e5b-9ff7-d4d77bc3ccf8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:39.943165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dc68d282-3afc-43e6-b4cf-4b328f00fb44 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:39.944127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dc68d282-3afc-43e6-b4cf-4b328f00fb44 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:40.473730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dc68d282-3afc-43e6-b4cf-4b328f00fb44 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:40.486276 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dc68d282-3afc-43e6-b4cf-4b328f00fb44 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1215 microversion: 2.1 time: 0.556874 Oct 04 21:21:40.486869 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1725/3423] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:39 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1215 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:40.656481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b9b190fd-f4e6-4e5b-9ff7-d4d77bc3ccf8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:40.668998 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b9b190fd-f4e6-4e5b-9ff7-d4d77bc3ccf8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1315 microversion: 2.1 time: 0.953547 Oct 04 21:21:40.716999 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1699/3424] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:39 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1315 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:41.524183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-65065311-ca95-4956-915c-138cbe2d2f77 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:41.525772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-65065311-ca95-4956-915c-138cbe2d2f77 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:41.540241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65065311-ca95-4956-915c-138cbe2d2f77 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:41.541876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65065311-ca95-4956-915c-138cbe2d2f77 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:41.542627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65065311-ca95-4956-915c-138cbe2d2f77 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:41.545182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65065311-ca95-4956-915c-138cbe2d2f77 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:41.548717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65065311-ca95-4956-915c-138cbe2d2f77 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:41.548717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65065311-ca95-4956-915c-138cbe2d2f77 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:41.733600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e32496fa-1e91-48be-bce4-36d8259a98d0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:41.734601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e32496fa-1e91-48be-bce4-36d8259a98d0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:41.755333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-65065311-ca95-4956-915c-138cbe2d2f77 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:41.779103 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-65065311-ca95-4956-915c-138cbe2d2f77 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1267 microversion: 2.1 time: 0.267316 Oct 04 21:21:41.780188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e32496fa-1e91-48be-bce4-36d8259a98d0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:41.781362 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1726/3425] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:41 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1267 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:41.784271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e32496fa-1e91-48be-bce4-36d8259a98d0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:41.784982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e32496fa-1e91-48be-bce4-36d8259a98d0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:41.787956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e32496fa-1e91-48be-bce4-36d8259a98d0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:41.788706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e32496fa-1e91-48be-bce4-36d8259a98d0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:41.792482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e32496fa-1e91-48be-bce4-36d8259a98d0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:42.211552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e32496fa-1e91-48be-bce4-36d8259a98d0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:42.228361 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e32496fa-1e91-48be-bce4-36d8259a98d0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1315 microversion: 2.1 time: 0.507582 Oct 04 21:21:42.230168 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1700/3426] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:41 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:42.806296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4f99c273-cbde-49d5-b986-c05a23929f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:42.808134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4f99c273-cbde-49d5-b986-c05a23929f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:42.844681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f99c273-cbde-49d5-b986-c05a23929f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:42.845474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f99c273-cbde-49d5-b986-c05a23929f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:42.846374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f99c273-cbde-49d5-b986-c05a23929f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:42.847931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f99c273-cbde-49d5-b986-c05a23929f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:42.848765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f99c273-cbde-49d5-b986-c05a23929f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:42.849749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f99c273-cbde-49d5-b986-c05a23929f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:42.953505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a620484e-ec3c-4802-9fbf-84277a3f5a39 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-240885014", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:43.027430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-a620484e-ec3c-4802-9fbf-84277a3f5a39 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:21:43.464414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4f99c273-cbde-49d5-b986-c05a23929f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:43.482435 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4f99c273-cbde-49d5-b986-c05a23929f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1315 microversion: 2.1 time: 0.677308 Oct 04 21:21:43.484949 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1701/3427] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:42 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:43.501666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7b1a800b-c148-41f9-8357-a0387ad0a6e3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:43.503209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7b1a800b-c148-41f9-8357-a0387ad0a6e3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:43.526525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b1a800b-c148-41f9-8357-a0387ad0a6e3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:43.527056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b1a800b-c148-41f9-8357-a0387ad0a6e3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:43.527512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b1a800b-c148-41f9-8357-a0387ad0a6e3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:43.531927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b1a800b-c148-41f9-8357-a0387ad0a6e3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:43.533391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b1a800b-c148-41f9-8357-a0387ad0a6e3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:43.535186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b1a800b-c148-41f9-8357-a0387ad0a6e3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:43.692753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a620484e-ec3c-4802-9fbf-84277a3f5a39 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:21:43.694853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a620484e-ec3c-4802-9fbf-84277a3f5a39 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:21:43.695752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a620484e-ec3c-4802-9fbf-84277a3f5a39 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:21:43.696560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a620484e-ec3c-4802-9fbf-84277a3f5a39 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:21:43.697802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a620484e-ec3c-4802-9fbf-84277a3f5a39 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:21:43.724025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a620484e-ec3c-4802-9fbf-84277a3f5a39 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:43.726868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a620484e-ec3c-4802-9fbf-84277a3f5a39 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:43.729202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a620484e-ec3c-4802-9fbf-84277a3f5a39 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:43.734414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a620484e-ec3c-4802-9fbf-84277a3f5a39 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:43.734414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a620484e-ec3c-4802-9fbf-84277a3f5a39 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:43.736269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a620484e-ec3c-4802-9fbf-84277a3f5a39 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:43.771214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-a620484e-ec3c-4802-9fbf-84277a3f5a39 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Getting quotas for project 7d76b499bb9344a5b3cb93c4cbc0a51c. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:21:43.781496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:43.784794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-a620484e-ec3c-4802-9fbf-84277a3f5a39 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Getting quotas for user 700a67b5993d48a59a373e9535688793 and project 7d76b499bb9344a5b3cb93c4cbc0a51c. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:21:43.805834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a620484e-ec3c-4802-9fbf-84277a3f5a39 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:21:43.808394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a620484e-ec3c-4802-9fbf-84277a3f5a39 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:21:43.852159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7b1a800b-c148-41f9-8357-a0387ad0a6e3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:43.866129 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7b1a800b-c148-41f9-8357-a0387ad0a6e3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1315 microversion: 2.1 time: 0.377722 Oct 04 21:21:43.866759 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1702/3428] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:43 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:43.963079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-ecdda1f4-7b0a-44c0-a3e1-c20209adfc7d req-be862c5d-4499-4c63-b425-fe5a790544a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d94fb740-d887-4830-bb79-bc8a0bc8e2a2", "tag": "f60d702d-e280-4ab9-bcde-08a05cdbd3d9"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:43.983552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ecdda1f4-7b0a-44c0-a3e1-c20209adfc7d req-be862c5d-4499-4c63-b425-fe5a790544a3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:43.984051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ecdda1f4-7b0a-44c0-a3e1-c20209adfc7d req-be862c5d-4499-4c63-b425-fe5a790544a3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:43.992406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ecdda1f4-7b0a-44c0-a3e1-c20209adfc7d req-be862c5d-4499-4c63-b425-fe5a790544a3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:44.025284 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-ecdda1f4-7b0a-44c0-a3e1-c20209adfc7d req-be862c5d-4499-4c63-b425-fe5a790544a3 service nova] Creating event network-changed:f60d702d-e280-4ab9-bcde-08a05cdbd3d9 for instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 on n-h2-860282-1 Oct 04 21:21:44.041178 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-ecdda1f4-7b0a-44c0-a3e1-c20209adfc7d req-be862c5d-4499-4c63-b425-fe5a790544a3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082109 Oct 04 21:21:44.048058 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1703/3429] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:44.180110 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a620484e-ec3c-4802-9fbf-84277a3f5a39 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.709403 Oct 04 21:21:44.181208 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1727/3430] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:21:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:21:44.193680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-65925c97-32c3-467f-a2a3-99c0c0f60105 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:44.194391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-65925c97-32c3-467f-a2a3-99c0c0f60105 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:44.324478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-65925c97-32c3-467f-a2a3-99c0c0f60105 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:44.345562 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-65925c97-32c3-467f-a2a3-99c0c0f60105 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1216 microversion: 2.1 time: 0.156552 Oct 04 21:21:44.346777 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1704/3431] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:44 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:44.509202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-46a21f98-1893-4762-933b-1554b4bf5642 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:44.510321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-46a21f98-1893-4762-933b-1554b4bf5642 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:44.526140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46a21f98-1893-4762-933b-1554b4bf5642 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:44.528494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46a21f98-1893-4762-933b-1554b4bf5642 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:44.529616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46a21f98-1893-4762-933b-1554b4bf5642 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:44.534599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46a21f98-1893-4762-933b-1554b4bf5642 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:44.538616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46a21f98-1893-4762-933b-1554b4bf5642 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:44.545247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46a21f98-1893-4762-933b-1554b4bf5642 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:44.890877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ccc08f6f-1129-4db8-834f-a0829d45b2a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:44.891360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ccc08f6f-1129-4db8-834f-a0829d45b2a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:44.906632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccc08f6f-1129-4db8-834f-a0829d45b2a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:44.907418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccc08f6f-1129-4db8-834f-a0829d45b2a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:44.909567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccc08f6f-1129-4db8-834f-a0829d45b2a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:44.910560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccc08f6f-1129-4db8-834f-a0829d45b2a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:44.913285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccc08f6f-1129-4db8-834f-a0829d45b2a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:44.914316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccc08f6f-1129-4db8-834f-a0829d45b2a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:44.944799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-46a21f98-1893-4762-933b-1554b4bf5642 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:44.969635 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-46a21f98-1893-4762-933b-1554b4bf5642 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1315 microversion: 2.1 time: 0.465560 Oct 04 21:21:44.975337 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1728/3432] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:44 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:45.260411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-0348394a-466c-45f9-8615-9f84ba9a8d2f req-f2430eac-a02d-40f2-9111-230d487d4739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05443ed3-535e-4dc0-a5fc-e052c224df2d", "tag": "805ba44a-a1d1-4c81-bb46-975a050922ee"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:45.270989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0348394a-466c-45f9-8615-9f84ba9a8d2f req-f2430eac-a02d-40f2-9111-230d487d4739 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:45.271470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0348394a-466c-45f9-8615-9f84ba9a8d2f req-f2430eac-a02d-40f2-9111-230d487d4739 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:45.271904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0348394a-466c-45f9-8615-9f84ba9a8d2f req-f2430eac-a02d-40f2-9111-230d487d4739 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:45.304700 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-0348394a-466c-45f9-8615-9f84ba9a8d2f req-f2430eac-a02d-40f2-9111-230d487d4739 service nova] Creating event network-changed:805ba44a-a1d1-4c81-bb46-975a050922ee for instance 05443ed3-535e-4dc0-a5fc-e052c224df2d on n-h1-860282-1 Oct 04 21:21:45.313026 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-0348394a-466c-45f9-8615-9f84ba9a8d2f req-f2430eac-a02d-40f2-9111-230d487d4739 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.287135 Oct 04 21:21:45.314336 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1729/3433] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:45.362097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ccc08f6f-1129-4db8-834f-a0829d45b2a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:45.377772 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ccc08f6f-1129-4db8-834f-a0829d45b2a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1315 microversion: 2.1 time: 0.488809 Oct 04 21:21:45.380109 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1705/3434] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:44 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:45.385498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4a084d67-d554-4bd3-89d6-c9ae364ab331 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:45.386207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4a084d67-d554-4bd3-89d6-c9ae364ab331 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:45.488813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4a084d67-d554-4bd3-89d6-c9ae364ab331 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:45.496370 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4a084d67-d554-4bd3-89d6-c9ae364ab331 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1216 microversion: 2.1 time: 0.120202 Oct 04 21:21:45.503316 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1730/3435] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:45 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1216 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:45.997989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-648e35f1-427b-48cf-8760-e4acbb0e7841 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:45.997989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-648e35f1-427b-48cf-8760-e4acbb0e7841 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:46.011353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-648e35f1-427b-48cf-8760-e4acbb0e7841 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:46.011867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-648e35f1-427b-48cf-8760-e4acbb0e7841 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:46.012312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-648e35f1-427b-48cf-8760-e4acbb0e7841 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:46.013052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-648e35f1-427b-48cf-8760-e4acbb0e7841 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:46.014176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-648e35f1-427b-48cf-8760-e4acbb0e7841 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:46.014758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-648e35f1-427b-48cf-8760-e4acbb0e7841 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:46.407144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-347eac88-6788-4bab-b0a9-b524ecae58de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:46.408537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-347eac88-6788-4bab-b0a9-b524ecae58de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:46.417194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-648e35f1-427b-48cf-8760-e4acbb0e7841 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:46.438810 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-648e35f1-427b-48cf-8760-e4acbb0e7841 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1315 microversion: 2.1 time: 0.441897 Oct 04 21:21:46.439756 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1706/3436] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:45 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:46.443993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-347eac88-6788-4bab-b0a9-b524ecae58de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:46.444949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-347eac88-6788-4bab-b0a9-b524ecae58de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:46.445699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-347eac88-6788-4bab-b0a9-b524ecae58de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:46.448211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-347eac88-6788-4bab-b0a9-b524ecae58de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:46.449148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-347eac88-6788-4bab-b0a9-b524ecae58de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:46.449891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-347eac88-6788-4bab-b0a9-b524ecae58de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:46.480562 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:46.527831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3fce5cda-d342-4291-be16-6f2627671394 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:46.529404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3fce5cda-d342-4291-be16-6f2627671394 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:46.542930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fce5cda-d342-4291-be16-6f2627671394 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:46.543863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fce5cda-d342-4291-be16-6f2627671394 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:46.545939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fce5cda-d342-4291-be16-6f2627671394 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:46.547690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fce5cda-d342-4291-be16-6f2627671394 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:46.548490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fce5cda-d342-4291-be16-6f2627671394 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:46.554771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fce5cda-d342-4291-be16-6f2627671394 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:46.645267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3fce5cda-d342-4291-be16-6f2627671394 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:46.658174 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3fce5cda-d342-4291-be16-6f2627671394 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1220 microversion: 2.1 time: 0.134793 Oct 04 21:21:46.661348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-347eac88-6788-4bab-b0a9-b524ecae58de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:46.670207 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-347eac88-6788-4bab-b0a9-b524ecae58de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1315 microversion: 2.1 time: 0.269725 Oct 04 21:21:46.671536 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1731/3437] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:46 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:46.673740 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1707/3438] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:46 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1220 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:47.463247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-869dc16e-b6fd-44c9-a467-b3da56ac5592 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:47.463876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-869dc16e-b6fd-44c9-a467-b3da56ac5592 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:47.470658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-869dc16e-b6fd-44c9-a467-b3da56ac5592 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:47.471023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-869dc16e-b6fd-44c9-a467-b3da56ac5592 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:47.471463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-869dc16e-b6fd-44c9-a467-b3da56ac5592 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:47.472249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-869dc16e-b6fd-44c9-a467-b3da56ac5592 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:47.472634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-869dc16e-b6fd-44c9-a467-b3da56ac5592 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:47.473059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-869dc16e-b6fd-44c9-a467-b3da56ac5592 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:47.698318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-869dc16e-b6fd-44c9-a467-b3da56ac5592 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:47.708585 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-869dc16e-b6fd-44c9-a467-b3da56ac5592 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1315 microversion: 2.1 time: 0.249532 Oct 04 21:21:47.708831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bfe96272-cbda-4f9b-893d-df41d7b6747d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:47.711591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bfe96272-cbda-4f9b-893d-df41d7b6747d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:47.713947 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1732/3439] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:47 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:47.721214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfe96272-cbda-4f9b-893d-df41d7b6747d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:47.721903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfe96272-cbda-4f9b-893d-df41d7b6747d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:47.722468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfe96272-cbda-4f9b-893d-df41d7b6747d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:47.723277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfe96272-cbda-4f9b-893d-df41d7b6747d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:47.723836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfe96272-cbda-4f9b-893d-df41d7b6747d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:47.724365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfe96272-cbda-4f9b-893d-df41d7b6747d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:47.735458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-900f2fb7-dbf6-4b71-ac6f-6d78734f2459 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:47.736082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-900f2fb7-dbf6-4b71-ac6f-6d78734f2459 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:47.750754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-900f2fb7-dbf6-4b71-ac6f-6d78734f2459 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:47.754767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-900f2fb7-dbf6-4b71-ac6f-6d78734f2459 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:47.756060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-900f2fb7-dbf6-4b71-ac6f-6d78734f2459 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:47.756917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-900f2fb7-dbf6-4b71-ac6f-6d78734f2459 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:47.757650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-900f2fb7-dbf6-4b71-ac6f-6d78734f2459 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:47.757844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-900f2fb7-dbf6-4b71-ac6f-6d78734f2459 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:47.818730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bfe96272-cbda-4f9b-893d-df41d7b6747d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:47.831002 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bfe96272-cbda-4f9b-893d-df41d7b6747d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1220 microversion: 2.1 time: 0.128071 Oct 04 21:21:47.836218 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1708/3440] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:47 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1220 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:47.966138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-900f2fb7-dbf6-4b71-ac6f-6d78734f2459 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:47.976358 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-900f2fb7-dbf6-4b71-ac6f-6d78734f2459 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1315 microversion: 2.1 time: 0.262200 Oct 04 21:21:47.977032 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1733/3441] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:47 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:48.735028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e65b9125-c2be-4fcd-91c3-e01f742a32d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:48.736274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e65b9125-c2be-4fcd-91c3-e01f742a32d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:48.743832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e65b9125-c2be-4fcd-91c3-e01f742a32d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:48.744610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e65b9125-c2be-4fcd-91c3-e01f742a32d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:48.745218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e65b9125-c2be-4fcd-91c3-e01f742a32d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:48.746111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e65b9125-c2be-4fcd-91c3-e01f742a32d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:48.746728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e65b9125-c2be-4fcd-91c3-e01f742a32d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:48.747676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e65b9125-c2be-4fcd-91c3-e01f742a32d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:48.861517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-887a6978-1432-4ac7-acd3-d2f8f766b9d9 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:48.862832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-887a6978-1432-4ac7-acd3-d2f8f766b9d9 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:48.871226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-887a6978-1432-4ac7-acd3-d2f8f766b9d9 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:48.876204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-887a6978-1432-4ac7-acd3-d2f8f766b9d9 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:48.876852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-887a6978-1432-4ac7-acd3-d2f8f766b9d9 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:48.878112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-887a6978-1432-4ac7-acd3-d2f8f766b9d9 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:48.878760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-887a6978-1432-4ac7-acd3-d2f8f766b9d9 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:48.882623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-887a6978-1432-4ac7-acd3-d2f8f766b9d9 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:49.008130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-887a6978-1432-4ac7-acd3-d2f8f766b9d9 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:49.022849 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-887a6978-1432-4ac7-acd3-d2f8f766b9d9 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1268 microversion: 2.1 time: 0.169901 Oct 04 21:21:49.037959 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1734/3442] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:48 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1268 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:49.047624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9dda56f3-5991-4bb1-924c-fc80656da7d4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:49.048449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9dda56f3-5991-4bb1-924c-fc80656da7d4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:49.068215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dda56f3-5991-4bb1-924c-fc80656da7d4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:49.072087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e65b9125-c2be-4fcd-91c3-e01f742a32d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:49.081037 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e65b9125-c2be-4fcd-91c3-e01f742a32d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1315 microversion: 2.1 time: 0.350320 Oct 04 21:21:49.081591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dda56f3-5991-4bb1-924c-fc80656da7d4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:49.082335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dda56f3-5991-4bb1-924c-fc80656da7d4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:49.083264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dda56f3-5991-4bb1-924c-fc80656da7d4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:49.084451 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1709/3443] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:48 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:49.085507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dda56f3-5991-4bb1-924c-fc80656da7d4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:49.086449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dda56f3-5991-4bb1-924c-fc80656da7d4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:49.341058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9dda56f3-5991-4bb1-924c-fc80656da7d4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:49.353672 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9dda56f3-5991-4bb1-924c-fc80656da7d4 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1315 microversion: 2.1 time: 0.314106 Oct 04 21:21:49.354456 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1735/3444] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:49 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:49.893706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-94b6c820-9caa-40a9-b03c-7fc0f74c095e req-fae16701-d0be-4d40-a512-0e0becfb53a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05443ed3-535e-4dc0-a5fc-e052c224df2d", "name": "network-vif-plugged", "status": "completed", "tag": "805ba44a-a1d1-4c81-bb46-975a050922ee"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:49.905310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-94b6c820-9caa-40a9-b03c-7fc0f74c095e req-fae16701-d0be-4d40-a512-0e0becfb53a8 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:49.906185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-94b6c820-9caa-40a9-b03c-7fc0f74c095e req-fae16701-d0be-4d40-a512-0e0becfb53a8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:49.906840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-94b6c820-9caa-40a9-b03c-7fc0f74c095e req-fae16701-d0be-4d40-a512-0e0becfb53a8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:49.919425 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-94b6c820-9caa-40a9-b03c-7fc0f74c095e req-fae16701-d0be-4d40-a512-0e0becfb53a8 service nova] Creating event network-vif-plugged:805ba44a-a1d1-4c81-bb46-975a050922ee for instance 05443ed3-535e-4dc0-a5fc-e052c224df2d on n-h1-860282-1 Oct 04 21:21:49.925881 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-94b6c820-9caa-40a9-b03c-7fc0f74c095e req-fae16701-d0be-4d40-a512-0e0becfb53a8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035563 Oct 04 21:21:49.929604 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1736/3445] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:21:50.054034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-04cb595d-abc8-494f-b6c9-a60197dfdd56 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:50.055141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-04cb595d-abc8-494f-b6c9-a60197dfdd56 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:50.064729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04cb595d-abc8-494f-b6c9-a60197dfdd56 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:50.074901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04cb595d-abc8-494f-b6c9-a60197dfdd56 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:50.076216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04cb595d-abc8-494f-b6c9-a60197dfdd56 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:50.077220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04cb595d-abc8-494f-b6c9-a60197dfdd56 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:50.078073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04cb595d-abc8-494f-b6c9-a60197dfdd56 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:50.078700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04cb595d-abc8-494f-b6c9-a60197dfdd56 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:50.183113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-04cb595d-abc8-494f-b6c9-a60197dfdd56 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:50.202164 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-04cb595d-abc8-494f-b6c9-a60197dfdd56 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1276 microversion: 2.1 time: 0.150991 Oct 04 21:21:50.207016 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1737/3446] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:50 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1276 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:50.221032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2d9eba62-17bb-4676-a3d6-c6bf2301fd5c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:50.221755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2d9eba62-17bb-4676-a3d6-c6bf2301fd5c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:50.234952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2d9eba62-17bb-4676-a3d6-c6bf2301fd5c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:50.235472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2d9eba62-17bb-4676-a3d6-c6bf2301fd5c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:50.235921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2d9eba62-17bb-4676-a3d6-c6bf2301fd5c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:50.240893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2d9eba62-17bb-4676-a3d6-c6bf2301fd5c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:50.244706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2d9eba62-17bb-4676-a3d6-c6bf2301fd5c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:50.245393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2d9eba62-17bb-4676-a3d6-c6bf2301fd5c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:50.296252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-71bc45da-66ed-4acf-a171-ef0b94f877ab tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1102295545", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": "none"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:50.419033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-71bc45da-66ed-4acf-a171-ef0b94f877ab tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:21:50.420063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-71bc45da-66ed-4acf-a171-ef0b94f877ab tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:21:50.420557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-71bc45da-66ed-4acf-a171-ef0b94f877ab tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:21:50.420980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-71bc45da-66ed-4acf-a171-ef0b94f877ab tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:21:50.421405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-71bc45da-66ed-4acf-a171-ef0b94f877ab tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:21:50.450127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71bc45da-66ed-4acf-a171-ef0b94f877ab tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:50.451550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71bc45da-66ed-4acf-a171-ef0b94f877ab tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:50.452201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71bc45da-66ed-4acf-a171-ef0b94f877ab tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:50.452976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71bc45da-66ed-4acf-a171-ef0b94f877ab tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:50.455975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71bc45da-66ed-4acf-a171-ef0b94f877ab tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:50.456522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71bc45da-66ed-4acf-a171-ef0b94f877ab tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:50.483009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-71bc45da-66ed-4acf-a171-ef0b94f877ab tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Getting quotas for project e2a3ef6c17064c7ebba6e7a4b7040a56. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:21:50.489517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-71bc45da-66ed-4acf-a171-ef0b94f877ab tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Getting quotas for user 5aa3f444b0d3472f82a6aa4de7b33bf7 and project e2a3ef6c17064c7ebba6e7a4b7040a56. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:21:50.511074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-71bc45da-66ed-4acf-a171-ef0b94f877ab tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:21:50.515014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-71bc45da-66ed-4acf-a171-ef0b94f877ab tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:21:50.644561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2d9eba62-17bb-4676-a3d6-c6bf2301fd5c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:50.654894 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2d9eba62-17bb-4676-a3d6-c6bf2301fd5c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1315 microversion: 2.1 time: 0.445061 Oct 04 21:21:50.655473 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1738/3447] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:50 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:50.660059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-de246cdf-feff-45b6-91fe-adbf82ad0e1d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:50.660923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-de246cdf-feff-45b6-91fe-adbf82ad0e1d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:50.670381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de246cdf-feff-45b6-91fe-adbf82ad0e1d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:50.670872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de246cdf-feff-45b6-91fe-adbf82ad0e1d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:50.671431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de246cdf-feff-45b6-91fe-adbf82ad0e1d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:50.672169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de246cdf-feff-45b6-91fe-adbf82ad0e1d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:50.672626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de246cdf-feff-45b6-91fe-adbf82ad0e1d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:50.673048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de246cdf-feff-45b6-91fe-adbf82ad0e1d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:50.745168 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-71bc45da-66ed-4acf-a171-ef0b94f877ab tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.856921 Oct 04 21:21:50.746061 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1710/3448] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Oct 4 21:21:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:21:50.765515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f4f7ba2e-eeb3-4a79-8b11-cf534bb7abdd tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:50.766536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f4f7ba2e-eeb3-4a79-8b11-cf534bb7abdd tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:50.900165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f4f7ba2e-eeb3-4a79-8b11-cf534bb7abdd tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:50.927081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f4f7ba2e-eeb3-4a79-8b11-cf534bb7abdd tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:50.938364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f4f7ba2e-eeb3-4a79-8b11-cf534bb7abdd tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:50.938364 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f4f7ba2e-eeb3-4a79-8b11-cf534bb7abdd tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1278 microversion: 2.57 time: 0.175529 Oct 04 21:21:50.940043 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1711/3449] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:50 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:51.020027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-de246cdf-feff-45b6-91fe-adbf82ad0e1d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:51.027908 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-de246cdf-feff-45b6-91fe-adbf82ad0e1d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1315 microversion: 2.1 time: 0.371389 Oct 04 21:21:51.029467 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1739/3450] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:50 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:51.229618 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5f1f3bb2-d18c-428b-bf7f-5406c57fa006 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:51.230245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5f1f3bb2-d18c-428b-bf7f-5406c57fa006 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:51.237188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f1f3bb2-d18c-428b-bf7f-5406c57fa006 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:51.237720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f1f3bb2-d18c-428b-bf7f-5406c57fa006 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:51.243576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f1f3bb2-d18c-428b-bf7f-5406c57fa006 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:51.243576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f1f3bb2-d18c-428b-bf7f-5406c57fa006 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:51.243576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f1f3bb2-d18c-428b-bf7f-5406c57fa006 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:51.243576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f1f3bb2-d18c-428b-bf7f-5406c57fa006 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:51.321611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5f1f3bb2-d18c-428b-bf7f-5406c57fa006 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:51.326135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:51.330847 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5f1f3bb2-d18c-428b-bf7f-5406c57fa006 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1274 microversion: 2.1 time: 0.105165 Oct 04 21:21:51.339752 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1712/3451] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:51 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1274 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:51.681115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-22585b21-efaf-48fe-abe4-5f6078376943 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:51.683265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-22585b21-efaf-48fe-abe4-5f6078376943 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:51.700391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22585b21-efaf-48fe-abe4-5f6078376943 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:51.701526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22585b21-efaf-48fe-abe4-5f6078376943 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:51.702064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22585b21-efaf-48fe-abe4-5f6078376943 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:51.702802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22585b21-efaf-48fe-abe4-5f6078376943 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:51.708128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22585b21-efaf-48fe-abe4-5f6078376943 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:51.708657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22585b21-efaf-48fe-abe4-5f6078376943 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:51.902772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-22585b21-efaf-48fe-abe4-5f6078376943 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:51.911691 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-22585b21-efaf-48fe-abe4-5f6078376943 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1501 microversion: 2.1 time: 0.236687 Oct 04 21:21:51.912360 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1740/3452] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:51 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1501 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:51.936469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1c2e1c81-e7a6-49c1-86fd-5d427f991059 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:51.943330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c2e1c81-e7a6-49c1-86fd-5d427f991059 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:51.944108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c2e1c81-e7a6-49c1-86fd-5d427f991059 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:51.944546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c2e1c81-e7a6-49c1-86fd-5d427f991059 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:51.971840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-edb63444-164e-4d33-b710-b898bef98849 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:51.972454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-edb63444-164e-4d33-b710-b898bef98849 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:52.022855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1c2e1c81-e7a6-49c1-86fd-5d427f991059 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Going to try to stop instance {{(pid=122757) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:21:52.050442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-edb63444-164e-4d33-b710-b898bef98849 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:52.075369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-edb63444-164e-4d33-b710-b898bef98849 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:52.077003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-edb63444-164e-4d33-b710-b898bef98849 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:52.078178 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-edb63444-164e-4d33-b710-b898bef98849 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1278 microversion: 2.57 time: 0.110595 Oct 04 21:21:52.078969 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1741/3453] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:51 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1278 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:52.084268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-30979b3a-e8b1-4d1a-a520-9426c48dd641 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:52.085108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-30979b3a-e8b1-4d1a-a520-9426c48dd641 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:52.092713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30979b3a-e8b1-4d1a-a520-9426c48dd641 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:52.093917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30979b3a-e8b1-4d1a-a520-9426c48dd641 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:52.094557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30979b3a-e8b1-4d1a-a520-9426c48dd641 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:52.095864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30979b3a-e8b1-4d1a-a520-9426c48dd641 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:52.096838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30979b3a-e8b1-4d1a-a520-9426c48dd641 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:52.097640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30979b3a-e8b1-4d1a-a520-9426c48dd641 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:52.358980 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1c2e1c81-e7a6-49c1-86fd-5d427f991059 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d/action" status: 202 len: 0 microversion: 2.1 time: 0.426288 Oct 04 21:21:52.362171 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1713/3454] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:21:51 2022] POST /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:21:52.377571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-6731f5a9-783e-47a9-be74-4ae7a0b09154 req-2dd6b672-1cc0-4edf-8b06-d9753b52e217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d94fb740-d887-4830-bb79-bc8a0bc8e2a2", "name": "network-vif-plugged", "status": "completed", "tag": "f60d702d-e280-4ab9-bcde-08a05cdbd3d9"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:52.406750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-30979b3a-e8b1-4d1a-a520-9426c48dd641 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:52.407500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6731f5a9-783e-47a9-be74-4ae7a0b09154 req-2dd6b672-1cc0-4edf-8b06-d9753b52e217 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:52.409840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6731f5a9-783e-47a9-be74-4ae7a0b09154 req-2dd6b672-1cc0-4edf-8b06-d9753b52e217 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:52.411387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6731f5a9-783e-47a9-be74-4ae7a0b09154 req-2dd6b672-1cc0-4edf-8b06-d9753b52e217 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:52.419399 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-30979b3a-e8b1-4d1a-a520-9426c48dd641 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1315 microversion: 2.1 time: 0.338794 Oct 04 21:21:52.438894 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1742/3455] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:52 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:52.443561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7e83685a-f298-44bc-9a6c-106bd8c6edaf tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:52.445257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7e83685a-f298-44bc-9a6c-106bd8c6edaf tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:52.446201 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-6731f5a9-783e-47a9-be74-4ae7a0b09154 req-2dd6b672-1cc0-4edf-8b06-d9753b52e217 service nova] Creating event network-vif-plugged:f60d702d-e280-4ab9-bcde-08a05cdbd3d9 for instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 on n-h2-860282-1 Oct 04 21:21:52.461055 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-6731f5a9-783e-47a9-be74-4ae7a0b09154 req-2dd6b672-1cc0-4edf-8b06-d9753b52e217 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094444 Oct 04 21:21:52.467447 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1714/3456] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:52.470576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e83685a-f298-44bc-9a6c-106bd8c6edaf tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:52.473589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e83685a-f298-44bc-9a6c-106bd8c6edaf tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:52.474804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e83685a-f298-44bc-9a6c-106bd8c6edaf tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:52.482802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1a4c4cef-43e4-41ee-ad88-34dff9f45f19 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:52.485956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e83685a-f298-44bc-9a6c-106bd8c6edaf tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:52.487366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1a4c4cef-43e4-41ee-ad88-34dff9f45f19 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:52.488578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e83685a-f298-44bc-9a6c-106bd8c6edaf tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:52.489126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e83685a-f298-44bc-9a6c-106bd8c6edaf tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:52.501888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a4c4cef-43e4-41ee-ad88-34dff9f45f19 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:52.502404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a4c4cef-43e4-41ee-ad88-34dff9f45f19 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:52.502856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a4c4cef-43e4-41ee-ad88-34dff9f45f19 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:52.503579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a4c4cef-43e4-41ee-ad88-34dff9f45f19 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:52.504046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a4c4cef-43e4-41ee-ad88-34dff9f45f19 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:52.504489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a4c4cef-43e4-41ee-ad88-34dff9f45f19 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:52.979249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7e83685a-f298-44bc-9a6c-106bd8c6edaf tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:52.992902 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7e83685a-f298-44bc-9a6c-106bd8c6edaf tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1316 microversion: 2.1 time: 0.560633 Oct 04 21:21:53.000611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1a4c4cef-43e4-41ee-ad88-34dff9f45f19 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:53.008853 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1743/3457] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:52 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1316 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:53.015861 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1a4c4cef-43e4-41ee-ad88-34dff9f45f19 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1511 microversion: 2.1 time: 0.547019 Oct 04 21:21:53.016761 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1715/3458] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:52 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1511 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:53.114823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-444c631d-8134-4e8e-be71-e59759b629a5 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:53.115998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-444c631d-8134-4e8e-be71-e59759b629a5 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:53.133457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-444c631d-8134-4e8e-be71-e59759b629a5 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:53.134207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-444c631d-8134-4e8e-be71-e59759b629a5 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:53.136288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-444c631d-8134-4e8e-be71-e59759b629a5 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:53.137287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-444c631d-8134-4e8e-be71-e59759b629a5 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:53.138531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-444c631d-8134-4e8e-be71-e59759b629a5 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:53.139503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-444c631d-8134-4e8e-be71-e59759b629a5 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:53.308653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-444c631d-8134-4e8e-be71-e59759b629a5 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:53.324934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-444c631d-8134-4e8e-be71-e59759b629a5 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:53.327133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-444c631d-8134-4e8e-be71-e59759b629a5 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:53.328617 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-444c631d-8134-4e8e-be71-e59759b629a5 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1282 microversion: 2.57 time: 0.225324 Oct 04 21:21:53.329364 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1744/3459] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:53 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1282 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:53.458315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0ee1904e-3c88-4610-b3b9-a61a0faf9151 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:53.458315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0ee1904e-3c88-4610-b3b9-a61a0faf9151 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:53.458315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ee1904e-3c88-4610-b3b9-a61a0faf9151 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:53.458966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ee1904e-3c88-4610-b3b9-a61a0faf9151 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:53.459100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ee1904e-3c88-4610-b3b9-a61a0faf9151 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:53.459832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ee1904e-3c88-4610-b3b9-a61a0faf9151 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:53.460288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ee1904e-3c88-4610-b3b9-a61a0faf9151 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:53.460716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0ee1904e-3c88-4610-b3b9-a61a0faf9151 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:53.856835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0ee1904e-3c88-4610-b3b9-a61a0faf9151 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:53.871725 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0ee1904e-3c88-4610-b3b9-a61a0faf9151 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1315 microversion: 2.1 time: 0.425141 Oct 04 21:21:53.890388 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1716/3460] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:53 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:54.015983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:54.022402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-64ec85ff-7bba-4c7f-b1f7-b0055df9df24 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:54.023357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-64ec85ff-7bba-4c7f-b1f7-b0055df9df24 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:54.037126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64ec85ff-7bba-4c7f-b1f7-b0055df9df24 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:54.038507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64ec85ff-7bba-4c7f-b1f7-b0055df9df24 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:54.039990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64ec85ff-7bba-4c7f-b1f7-b0055df9df24 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:54.042269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64ec85ff-7bba-4c7f-b1f7-b0055df9df24 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:54.043138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64ec85ff-7bba-4c7f-b1f7-b0055df9df24 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:54.045347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3ba40b6e-0f3c-43df-92f0-3bdc79155d36 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:54.046165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3ba40b6e-0f3c-43df-92f0-3bdc79155d36 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:54.057530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64ec85ff-7bba-4c7f-b1f7-b0055df9df24 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:54.067935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ba40b6e-0f3c-43df-92f0-3bdc79155d36 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:54.068780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ba40b6e-0f3c-43df-92f0-3bdc79155d36 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:54.069390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ba40b6e-0f3c-43df-92f0-3bdc79155d36 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:54.070296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ba40b6e-0f3c-43df-92f0-3bdc79155d36 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:54.071890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ba40b6e-0f3c-43df-92f0-3bdc79155d36 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:54.072632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ba40b6e-0f3c-43df-92f0-3bdc79155d36 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:54.583593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3ba40b6e-0f3c-43df-92f0-3bdc79155d36 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:54.598398 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3ba40b6e-0f3c-43df-92f0-3bdc79155d36 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1511 microversion: 2.1 time: 0.562265 Oct 04 21:21:54.599090 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1717/3461] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:54 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1511 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:54.605476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-64ec85ff-7bba-4c7f-b1f7-b0055df9df24 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:54.615698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e19624c4-5e93-4067-8623-58e328758a77 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:54.616731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e19624c4-5e93-4067-8623-58e328758a77 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:54.617119 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-64ec85ff-7bba-4c7f-b1f7-b0055df9df24 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1316 microversion: 2.1 time: 0.600785 Oct 04 21:21:54.618346 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1745/3462] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:54 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1316 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:54.641648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e19624c4-5e93-4067-8623-58e328758a77 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:54.642306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e19624c4-5e93-4067-8623-58e328758a77 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:54.642864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e19624c4-5e93-4067-8623-58e328758a77 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:54.644075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e19624c4-5e93-4067-8623-58e328758a77 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:54.644744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e19624c4-5e93-4067-8623-58e328758a77 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:54.645494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e19624c4-5e93-4067-8623-58e328758a77 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:54.720207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-5fff149a-cc83-44a6-bbd3-4a633f012a32 req-d743d96a-e485-4df1-9911-15a269b7cb0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4947dfca-605d-4a8f-8ad0-362c13680ab4", "tag": "980665fd-e5bf-42ba-85c6-645ed80a8b3b"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:54.749869 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5fff149a-cc83-44a6-bbd3-4a633f012a32 req-d743d96a-e485-4df1-9911-15a269b7cb0e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:54.750719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5fff149a-cc83-44a6-bbd3-4a633f012a32 req-d743d96a-e485-4df1-9911-15a269b7cb0e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:54.753186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5fff149a-cc83-44a6-bbd3-4a633f012a32 req-d743d96a-e485-4df1-9911-15a269b7cb0e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:54.773149 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-5fff149a-cc83-44a6-bbd3-4a633f012a32 req-d743d96a-e485-4df1-9911-15a269b7cb0e service nova] Creating event network-changed:980665fd-e5bf-42ba-85c6-645ed80a8b3b for instance 4947dfca-605d-4a8f-8ad0-362c13680ab4 on n-h2-860282-1 Oct 04 21:21:54.779602 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-5fff149a-cc83-44a6-bbd3-4a633f012a32 req-d743d96a-e485-4df1-9911-15a269b7cb0e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070809 Oct 04 21:21:54.780506 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1746/3463] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:54.789512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e19624c4-5e93-4067-8623-58e328758a77 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:54.799652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e19624c4-5e93-4067-8623-58e328758a77 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:54.803593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e19624c4-5e93-4067-8623-58e328758a77 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:54.805187 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e19624c4-5e93-4067-8623-58e328758a77 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1330 microversion: 2.57 time: 0.204937 Oct 04 21:21:54.806467 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1718/3464] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:54 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1330 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:54.912424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3f6102cc-c551-4afa-b3f7-69a6bc474e3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:54.913043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3f6102cc-c551-4afa-b3f7-69a6bc474e3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:54.919838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f6102cc-c551-4afa-b3f7-69a6bc474e3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:54.920663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f6102cc-c551-4afa-b3f7-69a6bc474e3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:54.921315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f6102cc-c551-4afa-b3f7-69a6bc474e3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:54.922271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f6102cc-c551-4afa-b3f7-69a6bc474e3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:54.922816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f6102cc-c551-4afa-b3f7-69a6bc474e3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:54.923322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f6102cc-c551-4afa-b3f7-69a6bc474e3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:55.138837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-89361261-ca2f-4bd2-9ae2-13ea7f3ffe7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1537631709", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:55.157641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3f6102cc-c551-4afa-b3f7-69a6bc474e3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:55.167655 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3f6102cc-c551-4afa-b3f7-69a6bc474e3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1502 microversion: 2.1 time: 0.258985 Oct 04 21:21:55.168275 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1719/3465] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:54 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1502 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:55.194359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f0d3c4ea-09b9-4794-81cc-be8e51ee3041 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1668951259"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:55.198238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f0d3c4ea-09b9-4794-81cc-be8e51ee3041 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:55.206753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0d3c4ea-09b9-4794-81cc-be8e51ee3041 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:55.207728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0d3c4ea-09b9-4794-81cc-be8e51ee3041 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:55.207933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-89361261-ca2f-4bd2-9ae2-13ea7f3ffe7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] validate_networks() for [('fa89d970-8853-4fbd-b730-b6a566314680', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:21:55.208413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0d3c4ea-09b9-4794-81cc-be8e51ee3041 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:55.209240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0d3c4ea-09b9-4794-81cc-be8e51ee3041 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:55.210473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0d3c4ea-09b9-4794-81cc-be8e51ee3041 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:55.210992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0d3c4ea-09b9-4794-81cc-be8e51ee3041 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:55.584520 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.network.security_group_api [None req-f0d3c4ea-09b9-4794-81cc-be8e51ee3041 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Adding security group d9cf9df0-419d-4077-af85-7eb473b5ba35 to port f60d702d-e280-4ab9-bcde-08a05cdbd3d9 Oct 04 21:21:56.515725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-89361261-ca2f-4bd2-9ae2-13ea7f3ffe7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:21:56.516382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-89361261-ca2f-4bd2-9ae2-13ea7f3ffe7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:21:56.516598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-89361261-ca2f-4bd2-9ae2-13ea7f3ffe7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:21:56.517013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-89361261-ca2f-4bd2-9ae2-13ea7f3ffe7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:21:56.517455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-89361261-ca2f-4bd2-9ae2-13ea7f3ffe7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:21:56.525446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=27 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:56.533621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89361261-ca2f-4bd2-9ae2-13ea7f3ffe7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:56.533621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89361261-ca2f-4bd2-9ae2-13ea7f3ffe7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:56.533621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89361261-ca2f-4bd2-9ae2-13ea7f3ffe7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:56.533621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89361261-ca2f-4bd2-9ae2-13ea7f3ffe7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:56.533621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89361261-ca2f-4bd2-9ae2-13ea7f3ffe7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:56.533621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89361261-ca2f-4bd2-9ae2-13ea7f3ffe7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:56.553105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-89361261-ca2f-4bd2-9ae2-13ea7f3ffe7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Getting quotas for project f331cff7b8e2496bb677f8f875a36968. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:21:56.558877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-89361261-ca2f-4bd2-9ae2-13ea7f3ffe7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Getting quotas for user 738661b84c8c4465bf8dcde0a182af6d and project f331cff7b8e2496bb677f8f875a36968. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:21:56.572661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-89361261-ca2f-4bd2-9ae2-13ea7f3ffe7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:21:56.575156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-89361261-ca2f-4bd2-9ae2-13ea7f3ffe7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:21:56.907997 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-89361261-ca2f-4bd2-9ae2-13ea7f3ffe7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.125060 Oct 04 21:21:56.909156 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1747/3466] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:21:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 2128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:21:56.913780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1d14b2db-b5f3-4a94-91ab-cc0e36c43a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:56.914446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1d14b2db-b5f3-4a94-91ab-cc0e36c43a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:56.923114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d14b2db-b5f3-4a94-91ab-cc0e36c43a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:56.923913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d14b2db-b5f3-4a94-91ab-cc0e36c43a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:56.924804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d14b2db-b5f3-4a94-91ab-cc0e36c43a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:56.925536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d14b2db-b5f3-4a94-91ab-cc0e36c43a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:56.926016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d14b2db-b5f3-4a94-91ab-cc0e36c43a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:56.926471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d14b2db-b5f3-4a94-91ab-cc0e36c43a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:56.966571 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f0d3c4ea-09b9-4794-81cc-be8e51ee3041 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "POST /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2/action" status: 202 len: 0 microversion: 2.1 time: 1.776428 Oct 04 21:21:56.967730 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1720/3467] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:21:55 2022] POST /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2/action => generated 0 bytes in 1778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:21:56.973501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-947a7942-1e28-44fa-975a-63073d27041d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:56.974516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-947a7942-1e28-44fa-975a-63073d27041d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:56.992952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-947a7942-1e28-44fa-975a-63073d27041d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:56.999817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-947a7942-1e28-44fa-975a-63073d27041d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:57.000754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-947a7942-1e28-44fa-975a-63073d27041d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:57.003318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-947a7942-1e28-44fa-975a-63073d27041d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:57.004027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-947a7942-1e28-44fa-975a-63073d27041d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:57.005406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-947a7942-1e28-44fa-975a-63073d27041d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:57.354465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-947a7942-1e28-44fa-975a-63073d27041d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:57.362584 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-947a7942-1e28-44fa-975a-63073d27041d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1316 microversion: 2.1 time: 0.393486 Oct 04 21:21:57.366023 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1721/3468] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:56 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1316 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:57.395958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-20f111aa-36bd-49eb-874e-db627821b409 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:57.396859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-20f111aa-36bd-49eb-874e-db627821b409 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:57.397298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1d14b2db-b5f3-4a94-91ab-cc0e36c43a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:57.404779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20f111aa-36bd-49eb-874e-db627821b409 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:57.405563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20f111aa-36bd-49eb-874e-db627821b409 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:57.406598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20f111aa-36bd-49eb-874e-db627821b409 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:57.408167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20f111aa-36bd-49eb-874e-db627821b409 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:57.408638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20f111aa-36bd-49eb-874e-db627821b409 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:57.409108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20f111aa-36bd-49eb-874e-db627821b409 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:57.410447 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1d14b2db-b5f3-4a94-91ab-cc0e36c43a38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1511 microversion: 2.1 time: 0.500206 Oct 04 21:21:57.414003 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1748/3469] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:56 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1511 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:57.426098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-25d2d92c-a2ef-48ad-9968-e77edee29e7e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:57.427974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-25d2d92c-a2ef-48ad-9968-e77edee29e7e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:57.502229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-25d2d92c-a2ef-48ad-9968-e77edee29e7e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:57.513764 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-25d2d92c-a2ef-48ad-9968-e77edee29e7e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1214 microversion: 2.1 time: 0.095815 Oct 04 21:21:57.521055 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1749/3470] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:57 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:57.540822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8a9acea5-033f-4d7a-981c-60429ca05235 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f578b61fb80>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:57.551862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-20f111aa-36bd-49eb-874e-db627821b409 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:57.562593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-20f111aa-36bd-49eb-874e-db627821b409 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:57.564308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-20f111aa-36bd-49eb-874e-db627821b409 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:57.565911 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-20f111aa-36bd-49eb-874e-db627821b409 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1336 microversion: 2.57 time: 0.198379 Oct 04 21:21:57.566889 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1722/3471] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:57 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1336 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:57.572005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-e22c089f-f95d-4b40-a235-26102150d86c req-9aa80d33-d92b-419d-882c-3c1f9b64c0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d94fb740-d887-4830-bb79-bc8a0bc8e2a2", "tag": "f60d702d-e280-4ab9-bcde-08a05cdbd3d9"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:57.610372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e22c089f-f95d-4b40-a235-26102150d86c req-9aa80d33-d92b-419d-882c-3c1f9b64c0c7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:57.616962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e22c089f-f95d-4b40-a235-26102150d86c req-9aa80d33-d92b-419d-882c-3c1f9b64c0c7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:57.617678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e22c089f-f95d-4b40-a235-26102150d86c req-9aa80d33-d92b-419d-882c-3c1f9b64c0c7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:57.640834 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-e22c089f-f95d-4b40-a235-26102150d86c req-9aa80d33-d92b-419d-882c-3c1f9b64c0c7 service nova] Creating event network-changed:f60d702d-e280-4ab9-bcde-08a05cdbd3d9 for instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 on n-h2-860282-1 Oct 04 21:21:57.646596 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-e22c089f-f95d-4b40-a235-26102150d86c req-9aa80d33-d92b-419d-882c-3c1f9b64c0c7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078250 Oct 04 21:21:57.651295 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1723/3472] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:57.695724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG neutronclient.v2_0.client [None req-8a9acea5-033f-4d7a-981c-60429ca05235 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group d9cf9df0-419d-4077-af85-7eb473b5ba35 in use.", "detail": ""}} {{(pid=122758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:21:57.695724 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-8a9acea5-033f-4d7a-981c-60429ca05235 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] HTTP exception thrown: Security Group d9cf9df0-419d-4077-af85-7eb473b5ba35 in use. Oct 04 21:21:57.695724 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-f06dda8c-ab00-432b-a3c6-1865cc363293'] Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8a9acea5-033f-4d7a-981c-60429ca05235 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Request method failure captured: Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/os-security-groups/d9cf9df0-419d-4077-af85-7eb473b5ba35 HTTP/1.1 Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKOxTfdccv0aEToOcfdr6OtMIo2CNlYhIlgqu92DBOatDQiWjzVvd5IEryG0QCNnKkdKZPQHitv07AkMUDT3qd6-ZcO30gWiCaxcQoOtheHE279h1an9qvnw6-w5GJGiha-QBcDfyNtCASPXAS_OZ9SmSwbX7jLR7-xMrA5rAkFWAyw Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f547dec3057448558ae4d6012037dac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f547dec3057448558ae4d6012037dac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}] Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: cdbb08401bf146068fc351915ede7675 Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: exception: Security Group d9cf9df0-419d-4077-af85-7eb473b5ba35 in use. Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-f06dda8c-ab00-432b-a3c6-1865cc363293'] Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'd9cf9df0-419d-4077-af85-7eb473b5ba35'} Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:21:57.696639 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group d9cf9df0-419d-4077-af85-7eb473b5ba35 in use. Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f06dda8c-ab00-432b-a3c6-1865cc363293'] Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group d9cf9df0-419d-4077-af85-7eb473b5ba35 in use. Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f06dda8c-ab00-432b-a3c6-1865cc363293'] Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group d9cf9df0-419d-4077-af85-7eb473b5ba35 in use. Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f06dda8c-ab00-432b-a3c6-1865cc363293'] Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group d9cf9df0-419d-4077-af85-7eb473b5ba35 in use. Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f06dda8c-ab00-432b-a3c6-1865cc363293'] Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8a9acea5-033f-4d7a-981c-60429ca05235 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Returning 400 to user: Security Group d9cf9df0-419d-4077-af85-7eb473b5ba35 in use. Oct 04 21:21:57.702092 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-f06dda8c-ab00-432b-a3c6-1865cc363293'] {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:57.707961 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8a9acea5-033f-4d7a-981c-60429ca05235 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/d9cf9df0-419d-4077-af85-7eb473b5ba35" status: 400 len: 185 microversion: 2.1 time: 0.171326 Oct 04 21:21:57.712277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-45e1565b-2757-4675-95c1-8612c2ff94c0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:57.718184 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1750/3473] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:21:57 2022] DELETE /compute/v2.1/os-security-groups/d9cf9df0-419d-4077-af85-7eb473b5ba35 => generated 185 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:21:57.718345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-45e1565b-2757-4675-95c1-8612c2ff94c0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:57.730049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45e1565b-2757-4675-95c1-8612c2ff94c0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:57.730709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45e1565b-2757-4675-95c1-8612c2ff94c0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:57.731167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45e1565b-2757-4675-95c1-8612c2ff94c0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:57.732615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45e1565b-2757-4675-95c1-8612c2ff94c0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:57.733088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45e1565b-2757-4675-95c1-8612c2ff94c0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:57.736722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45e1565b-2757-4675-95c1-8612c2ff94c0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:58.139782 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-45e1565b-2757-4675-95c1-8612c2ff94c0 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "POST /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2/action" status: 202 len: 0 microversion: 2.1 time: 0.426574 Oct 04 21:21:58.139782 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1724/3474] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:21:57 2022] POST /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:21:58.147537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-77b32d24-5a87-466b-be91-89c579565be9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:58.148631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-77b32d24-5a87-466b-be91-89c579565be9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:58.157344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77b32d24-5a87-466b-be91-89c579565be9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:58.157974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77b32d24-5a87-466b-be91-89c579565be9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:58.158571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77b32d24-5a87-466b-be91-89c579565be9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:58.159300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77b32d24-5a87-466b-be91-89c579565be9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:58.159789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77b32d24-5a87-466b-be91-89c579565be9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:58.160432 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77b32d24-5a87-466b-be91-89c579565be9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:58.389093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dc4c46cd-2c8b-482c-ae7d-7d7f8ad26bcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:58.389855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dc4c46cd-2c8b-482c-ae7d-7d7f8ad26bcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:58.405053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc4c46cd-2c8b-482c-ae7d-7d7f8ad26bcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:58.407994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc4c46cd-2c8b-482c-ae7d-7d7f8ad26bcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:58.407994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc4c46cd-2c8b-482c-ae7d-7d7f8ad26bcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:58.407994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc4c46cd-2c8b-482c-ae7d-7d7f8ad26bcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:58.407994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc4c46cd-2c8b-482c-ae7d-7d7f8ad26bcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:58.408437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc4c46cd-2c8b-482c-ae7d-7d7f8ad26bcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:58.512589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-77b32d24-5a87-466b-be91-89c579565be9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:58.521717 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-77b32d24-5a87-466b-be91-89c579565be9 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1573 microversion: 2.1 time: 0.380561 Oct 04 21:21:58.522393 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1751/3475] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:58 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1573 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:58.527120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-85c58d64-6eec-42e0-a5e6-86f2d3953509 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:58.528154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-85c58d64-6eec-42e0-a5e6-86f2d3953509 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:58.543497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85c58d64-6eec-42e0-a5e6-86f2d3953509 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:58.544588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85c58d64-6eec-42e0-a5e6-86f2d3953509 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:58.552187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85c58d64-6eec-42e0-a5e6-86f2d3953509 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:58.555376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85c58d64-6eec-42e0-a5e6-86f2d3953509 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:58.558591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85c58d64-6eec-42e0-a5e6-86f2d3953509 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:58.559056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85c58d64-6eec-42e0-a5e6-86f2d3953509 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:58.677720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dc4c46cd-2c8b-482c-ae7d-7d7f8ad26bcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:58.680725 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dc4c46cd-2c8b-482c-ae7d-7d7f8ad26bcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1316 microversion: 2.1 time: 0.296618 Oct 04 21:21:58.681321 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1725/3476] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:58 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1316 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:58.702397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-887e15b8-5d9f-42fe-936d-5d0a6bedf1c8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:58.703504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-887e15b8-5d9f-42fe-936d-5d0a6bedf1c8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:58.785359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-887e15b8-5d9f-42fe-936d-5d0a6bedf1c8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:58.787822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=23 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:58.796796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-85c58d64-6eec-42e0-a5e6-86f2d3953509 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:58.804495 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-887e15b8-5d9f-42fe-936d-5d0a6bedf1c8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1214 microversion: 2.1 time: 0.121401 Oct 04 21:21:58.805284 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1726/3477] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:58 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:58.807721 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-85c58d64-6eec-42e0-a5e6-86f2d3953509 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1511 microversion: 2.1 time: 0.284160 Oct 04 21:21:58.850513 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1752/3478] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:58 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1511 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:58.851697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eb50fe62-b05e-4906-8afa-a7abcf7838ee tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:58.851697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eb50fe62-b05e-4906-8afa-a7abcf7838ee tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:58.851697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb50fe62-b05e-4906-8afa-a7abcf7838ee tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:58.851697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb50fe62-b05e-4906-8afa-a7abcf7838ee tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:58.851697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb50fe62-b05e-4906-8afa-a7abcf7838ee tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:58.851697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb50fe62-b05e-4906-8afa-a7abcf7838ee tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:58.851697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb50fe62-b05e-4906-8afa-a7abcf7838ee tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:58.851697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb50fe62-b05e-4906-8afa-a7abcf7838ee tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:58.908893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eb50fe62-b05e-4906-8afa-a7abcf7838ee tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:58.917730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eb50fe62-b05e-4906-8afa-a7abcf7838ee tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:58.920060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eb50fe62-b05e-4906-8afa-a7abcf7838ee tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:58.921458 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eb50fe62-b05e-4906-8afa-a7abcf7838ee tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1357 microversion: 2.57 time: 0.099449 Oct 04 21:21:58.922061 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1727/3479] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:58 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1357 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:58.950460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:58.953659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:58.969986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:58.969986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:58.969986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:58.969986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:58.969986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:58.969986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:58.988998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:59.074267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:21:59.074688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:21:59.075160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:21:59.075676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:21:59.076083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:21:59.418033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:59.428448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:59.429099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:59.429809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:59.430709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:59.431265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:59.431790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:59.485363 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c10cb893-3d88-476d-a9da-0f80235427ff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "POST /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb/action" status: 202 len: 1138 microversion: 2.57 time: 0.538983 Oct 04 21:21:59.486529 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1753/3480] 10.222.0.30 () {62 vars in 1320 bytes} [Tue Oct 4 21:21:58 2022] POST /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb/action => generated 1138 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 21:21:59.509603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cd617cd9-8a9e-45cf-8228-6961cdba1154 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:59.515166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cd617cd9-8a9e-45cf-8228-6961cdba1154 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:59.522670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd617cd9-8a9e-45cf-8228-6961cdba1154 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:59.523560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd617cd9-8a9e-45cf-8228-6961cdba1154 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:59.524438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd617cd9-8a9e-45cf-8228-6961cdba1154 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:59.525375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd617cd9-8a9e-45cf-8228-6961cdba1154 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:59.526068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd617cd9-8a9e-45cf-8228-6961cdba1154 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:59.526723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd617cd9-8a9e-45cf-8228-6961cdba1154 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:59.552431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-32da4f06-1eef-4fd3-9990-8a8701e9b728 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:59.555065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-32da4f06-1eef-4fd3-9990-8a8701e9b728 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:59.563763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-32da4f06-1eef-4fd3-9990-8a8701e9b728 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:59.564399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-32da4f06-1eef-4fd3-9990-8a8701e9b728 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:59.564835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-32da4f06-1eef-4fd3-9990-8a8701e9b728 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:59.565563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-32da4f06-1eef-4fd3-9990-8a8701e9b728 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:59.566075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-32da4f06-1eef-4fd3-9990-8a8701e9b728 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:59.566517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-32da4f06-1eef-4fd3-9990-8a8701e9b728 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:59.624446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cd617cd9-8a9e-45cf-8228-6961cdba1154 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:59.636303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cd617cd9-8a9e-45cf-8228-6961cdba1154 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:59.638354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cd617cd9-8a9e-45cf-8228-6961cdba1154 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:59.640105 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cd617cd9-8a9e-45cf-8228-6961cdba1154 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.135231 Oct 04 21:21:59.655363 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1728/3481] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:59 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:59.708692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6d3c143a-8223-4b1c-bb7d-31ff3f21329d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:59.709580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6d3c143a-8223-4b1c-bb7d-31ff3f21329d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:59.721742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d3c143a-8223-4b1c-bb7d-31ff3f21329d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:59.722534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d3c143a-8223-4b1c-bb7d-31ff3f21329d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:59.723382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d3c143a-8223-4b1c-bb7d-31ff3f21329d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:59.724299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d3c143a-8223-4b1c-bb7d-31ff3f21329d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:59.724943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d3c143a-8223-4b1c-bb7d-31ff3f21329d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:59.726176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d3c143a-8223-4b1c-bb7d-31ff3f21329d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:59.891845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-32da4f06-1eef-4fd3-9990-8a8701e9b728 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:59.917016 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-32da4f06-1eef-4fd3-9990-8a8701e9b728 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1573 microversion: 2.1 time: 0.371677 Oct 04 21:21:59.938437 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1754/3482] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:59 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1573 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:59.946035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0b514568-97c7-4988-abcd-435429322b1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:59.946962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0b514568-97c7-4988-abcd-435429322b1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:59.958046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b514568-97c7-4988-abcd-435429322b1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:59.958970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b514568-97c7-4988-abcd-435429322b1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:59.959686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b514568-97c7-4988-abcd-435429322b1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:59.962492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b514568-97c7-4988-abcd-435429322b1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:59.964227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b514568-97c7-4988-abcd-435429322b1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:59.965116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b514568-97c7-4988-abcd-435429322b1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:59.992097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6d3c143a-8223-4b1c-bb7d-31ff3f21329d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:00.001733 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6d3c143a-8223-4b1c-bb7d-31ff3f21329d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1316 microversion: 2.1 time: 0.298393 Oct 04 21:22:00.023534 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1729/3483] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:59 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:00.030874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a71aa3af-e7b1-4260-9658-e278f332d289 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:00.039400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a71aa3af-e7b1-4260-9658-e278f332d289 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:00.058987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a71aa3af-e7b1-4260-9658-e278f332d289 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:00.059496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a71aa3af-e7b1-4260-9658-e278f332d289 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:00.059973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a71aa3af-e7b1-4260-9658-e278f332d289 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:00.061033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a71aa3af-e7b1-4260-9658-e278f332d289 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:00.064300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a71aa3af-e7b1-4260-9658-e278f332d289 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:00.065040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a71aa3af-e7b1-4260-9658-e278f332d289 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:00.087914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:00.135419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0b514568-97c7-4988-abcd-435429322b1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:00.153030 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0b514568-97c7-4988-abcd-435429322b1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1210 microversion: 2.1 time: 0.211588 Oct 04 21:22:00.166147 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1755/3484] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:59 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1210 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:00.279796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a71aa3af-e7b1-4260-9658-e278f332d289 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:00.307755 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a71aa3af-e7b1-4260-9658-e278f332d289 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1511 microversion: 2.1 time: 0.283002 Oct 04 21:22:00.308945 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1730/3485] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:00 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1511 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:00.669749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9f6cfa1e-bbd6-47f2-b055-15a83a2b0e27 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:00.673753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9f6cfa1e-bbd6-47f2-b055-15a83a2b0e27 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:00.679022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f6cfa1e-bbd6-47f2-b055-15a83a2b0e27 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:00.679521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f6cfa1e-bbd6-47f2-b055-15a83a2b0e27 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:00.679952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f6cfa1e-bbd6-47f2-b055-15a83a2b0e27 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:00.680846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f6cfa1e-bbd6-47f2-b055-15a83a2b0e27 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:00.681479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f6cfa1e-bbd6-47f2-b055-15a83a2b0e27 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:00.682069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f6cfa1e-bbd6-47f2-b055-15a83a2b0e27 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:00.763667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9f6cfa1e-bbd6-47f2-b055-15a83a2b0e27 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:00.772589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9f6cfa1e-bbd6-47f2-b055-15a83a2b0e27 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:00.774068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9f6cfa1e-bbd6-47f2-b055-15a83a2b0e27 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:00.776965 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9f6cfa1e-bbd6-47f2-b055-15a83a2b0e27 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.110717 Oct 04 21:22:00.776965 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1756/3486] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:00 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:22:00.945900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fa600581-d43b-414e-a239-93a0510babef tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:00.946944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fa600581-d43b-414e-a239-93a0510babef tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:00.949339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:00.956570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa600581-d43b-414e-a239-93a0510babef tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:00.957076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa600581-d43b-414e-a239-93a0510babef tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:00.957651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa600581-d43b-414e-a239-93a0510babef tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:00.958886 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa600581-d43b-414e-a239-93a0510babef tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:00.959351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa600581-d43b-414e-a239-93a0510babef tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:00.959788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa600581-d43b-414e-a239-93a0510babef tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:01.029558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9176493e-fa48-4271-a772-18d81672e848 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:01.033453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9176493e-fa48-4271-a772-18d81672e848 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:01.040738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9176493e-fa48-4271-a772-18d81672e848 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:01.041812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9176493e-fa48-4271-a772-18d81672e848 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:01.042732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9176493e-fa48-4271-a772-18d81672e848 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:01.044263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9176493e-fa48-4271-a772-18d81672e848 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:01.045563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9176493e-fa48-4271-a772-18d81672e848 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:01.047140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9176493e-fa48-4271-a772-18d81672e848 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:01.215586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fa600581-d43b-414e-a239-93a0510babef tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:01.225736 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fa600581-d43b-414e-a239-93a0510babef tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1571 microversion: 2.1 time: 0.283345 Oct 04 21:22:01.227181 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1731/3487] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:00 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1571 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:01.232705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d2e45353-98d9-47c5-9044-f3355acfc5da tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:01.233318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d2e45353-98d9-47c5-9044-f3355acfc5da tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:01.239896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2e45353-98d9-47c5-9044-f3355acfc5da tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:01.240391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2e45353-98d9-47c5-9044-f3355acfc5da tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:01.240833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2e45353-98d9-47c5-9044-f3355acfc5da tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:01.241579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2e45353-98d9-47c5-9044-f3355acfc5da tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:01.242264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2e45353-98d9-47c5-9044-f3355acfc5da tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:01.242860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2e45353-98d9-47c5-9044-f3355acfc5da tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:01.286194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9176493e-fa48-4271-a772-18d81672e848 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:01.305915 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9176493e-fa48-4271-a772-18d81672e848 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1316 microversion: 2.1 time: 0.280977 Oct 04 21:22:01.307102 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1757/3488] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:01 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:01.312257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d26f1ed6-c2ab-4055-b338-4bdec6b240ba tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-720083490"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:01.312988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d26f1ed6-c2ab-4055-b338-4bdec6b240ba tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:01.319260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d26f1ed6-c2ab-4055-b338-4bdec6b240ba tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:01.319977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d26f1ed6-c2ab-4055-b338-4bdec6b240ba tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:01.320574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d26f1ed6-c2ab-4055-b338-4bdec6b240ba tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:01.321485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d26f1ed6-c2ab-4055-b338-4bdec6b240ba tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:01.322105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d26f1ed6-c2ab-4055-b338-4bdec6b240ba tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:01.322969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d26f1ed6-c2ab-4055-b338-4bdec6b240ba tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:01.335169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d2e45353-98d9-47c5-9044-f3355acfc5da tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:01.373934 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d2e45353-98d9-47c5-9044-f3355acfc5da tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1274 microversion: 2.1 time: 0.131134 Oct 04 21:22:01.373934 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1732/3489] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:01 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:01.397150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9cb3368c-5390-4f59-ac99-699c1c110ed8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:01.397968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9cb3368c-5390-4f59-ac99-699c1c110ed8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:01.412635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9cb3368c-5390-4f59-ac99-699c1c110ed8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:01.416174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9cb3368c-5390-4f59-ac99-699c1c110ed8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:01.416174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9cb3368c-5390-4f59-ac99-699c1c110ed8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:01.416174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9cb3368c-5390-4f59-ac99-699c1c110ed8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:01.416174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9cb3368c-5390-4f59-ac99-699c1c110ed8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:01.418332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9cb3368c-5390-4f59-ac99-699c1c110ed8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:01.561180 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.network.security_group_api [None req-d26f1ed6-c2ab-4055-b338-4bdec6b240ba tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Adding security group 7f237387-af7a-4c69-8e25-9970fddc7727 to port f60d702d-e280-4ab9-bcde-08a05cdbd3d9 Oct 04 21:22:01.665642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9cb3368c-5390-4f59-ac99-699c1c110ed8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:01.678867 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9cb3368c-5390-4f59-ac99-699c1c110ed8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1511 microversion: 2.1 time: 0.313658 Oct 04 21:22:01.678867 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1733/3490] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:01 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1511 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:01.803010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-426e9714-504f-4656-9be9-06b0542ffba6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:01.803732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-426e9714-504f-4656-9be9-06b0542ffba6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:01.806967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:01.812507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-426e9714-504f-4656-9be9-06b0542ffba6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:01.813578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-426e9714-504f-4656-9be9-06b0542ffba6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:01.813994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-426e9714-504f-4656-9be9-06b0542ffba6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:01.814696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-426e9714-504f-4656-9be9-06b0542ffba6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:01.815601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-426e9714-504f-4656-9be9-06b0542ffba6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:01.816208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-426e9714-504f-4656-9be9-06b0542ffba6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:01.944019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-426e9714-504f-4656-9be9-06b0542ffba6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:01.960416 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-426e9714-504f-4656-9be9-06b0542ffba6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:01.962090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-426e9714-504f-4656-9be9-06b0542ffba6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:01.966139 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-426e9714-504f-4656-9be9-06b0542ffba6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.167409 Oct 04 21:22:01.966712 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1734/3491] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:01 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:22:02.047067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-ea410ac3-e5a9-4141-9ec5-f19d73490589 req-9bc13450-c9e4-4b53-a8f7-88bd41906fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4947dfca-605d-4a8f-8ad0-362c13680ab4", "name": "network-vif-plugged", "status": "completed", "tag": "980665fd-e5bf-42ba-85c6-645ed80a8b3b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:02.086067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ea410ac3-e5a9-4141-9ec5-f19d73490589 req-9bc13450-c9e4-4b53-a8f7-88bd41906fa3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:02.089699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ea410ac3-e5a9-4141-9ec5-f19d73490589 req-9bc13450-c9e4-4b53-a8f7-88bd41906fa3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:02.094093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ea410ac3-e5a9-4141-9ec5-f19d73490589 req-9bc13450-c9e4-4b53-a8f7-88bd41906fa3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:02.114364 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-ea410ac3-e5a9-4141-9ec5-f19d73490589 req-9bc13450-c9e4-4b53-a8f7-88bd41906fa3 service nova] Creating event network-vif-plugged:980665fd-e5bf-42ba-85c6-645ed80a8b3b for instance 4947dfca-605d-4a8f-8ad0-362c13680ab4 on n-h2-860282-1 Oct 04 21:22:02.119952 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-ea410ac3-e5a9-4141-9ec5-f19d73490589 req-9bc13450-c9e4-4b53-a8f7-88bd41906fa3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078307 Oct 04 21:22:02.126443 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1735/3492] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:22:02.246965 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d26f1ed6-c2ab-4055-b338-4bdec6b240ba tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "POST /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2/action" status: 202 len: 0 microversion: 2.1 time: 0.938607 Oct 04 21:22:02.248378 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1758/3493] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:22:01 2022] POST /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2/action => generated 0 bytes in 941 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:22:02.261663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d2f0e56f-28e1-4417-bd34-a22856ebab8d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f578b8b4dc0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:02.266432 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-ff92811d-33cc-4b22-b856-25dae962c348 req-d9bea648-aecc-40c3-9df0-95b9c6213853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d94fb740-d887-4830-bb79-bc8a0bc8e2a2", "tag": "f60d702d-e280-4ab9-bcde-08a05cdbd3d9"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:02.276189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ff92811d-33cc-4b22-b856-25dae962c348 req-d9bea648-aecc-40c3-9df0-95b9c6213853 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:02.276953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ff92811d-33cc-4b22-b856-25dae962c348 req-d9bea648-aecc-40c3-9df0-95b9c6213853 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:02.277616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ff92811d-33cc-4b22-b856-25dae962c348 req-d9bea648-aecc-40c3-9df0-95b9c6213853 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:02.290259 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-ff92811d-33cc-4b22-b856-25dae962c348 req-d9bea648-aecc-40c3-9df0-95b9c6213853 service nova] Creating event network-changed:f60d702d-e280-4ab9-bcde-08a05cdbd3d9 for instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 on n-h2-860282-1 Oct 04 21:22:02.296535 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-ff92811d-33cc-4b22-b856-25dae962c348 req-d9bea648-aecc-40c3-9df0-95b9c6213853 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034543 Oct 04 21:22:02.297815 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1759/3494] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:22:02.335990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1afa05d8-135e-45b2-acd5-1b842554b662 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:02.335990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1afa05d8-135e-45b2-acd5-1b842554b662 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:02.342999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1afa05d8-135e-45b2-acd5-1b842554b662 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:02.343772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1afa05d8-135e-45b2-acd5-1b842554b662 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:02.344384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1afa05d8-135e-45b2-acd5-1b842554b662 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:02.345366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1afa05d8-135e-45b2-acd5-1b842554b662 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:02.346859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1afa05d8-135e-45b2-acd5-1b842554b662 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:02.347641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1afa05d8-135e-45b2-acd5-1b842554b662 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:02.714398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1afa05d8-135e-45b2-acd5-1b842554b662 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:02.726969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG neutronclient.v2_0.client [None req-d2f0e56f-28e1-4417-bd34-a22856ebab8d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 7f237387-af7a-4c69-8e25-9970fddc7727 in use.", "detail": ""}} {{(pid=122757) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:22:02.727912 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-d2f0e56f-28e1-4417-bd34-a22856ebab8d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] HTTP exception thrown: Security Group 7f237387-af7a-4c69-8e25-9970fddc7727 in use. Oct 04 21:22:02.727912 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-07371a15-6562-455a-8502-20b1f5f8f8d3'] Oct 04 21:22:02.728579 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1afa05d8-135e-45b2-acd5-1b842554b662 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1316 microversion: 2.1 time: 0.404057 Oct 04 21:22:02.729621 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1760/3495] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:02 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1316 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:02.735069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2b036711-cf52-4108-aaca-14aded916ffc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:02.735678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2b036711-cf52-4108-aaca-14aded916ffc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d2f0e56f-28e1-4417-bd34-a22856ebab8d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Request method failure captured: Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/os-security-groups/7f237387-af7a-4c69-8e25-9970fddc7727 HTTP/1.1 Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKOxTfdccv0aEToOcfdr6OtMIo2CNlYhIlgqu92DBOatDQiWjzVvd5IEryG0QCNnKkdKZPQHitv07AkMUDT3qd6-ZcO30gWiCaxcQoOtheHE279h1an9qvnw6-w5GJGiha-QBcDfyNtCASPXAS_OZ9SmSwbX7jLR7-xMrA5rAkFWAyw Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f547dec3057448558ae4d6012037dac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f547dec3057448558ae4d6012037dac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}] Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: cdbb08401bf146068fc351915ede7675 Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: exception: Security Group 7f237387-af7a-4c69-8e25-9970fddc7727 in use. Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-07371a15-6562-455a-8502-20b1f5f8f8d3'] Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '7f237387-af7a-4c69-8e25-9970fddc7727'} Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:22:02.746305 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 7f237387-af7a-4c69-8e25-9970fddc7727 in use. Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07371a15-6562-455a-8502-20b1f5f8f8d3'] Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 7f237387-af7a-4c69-8e25-9970fddc7727 in use. Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07371a15-6562-455a-8502-20b1f5f8f8d3'] Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 7f237387-af7a-4c69-8e25-9970fddc7727 in use. Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07371a15-6562-455a-8502-20b1f5f8f8d3'] Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 7f237387-af7a-4c69-8e25-9970fddc7727 in use. Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07371a15-6562-455a-8502-20b1f5f8f8d3'] Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d2f0e56f-28e1-4417-bd34-a22856ebab8d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Returning 400 to user: Security Group 7f237387-af7a-4c69-8e25-9970fddc7727 in use. Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-07371a15-6562-455a-8502-20b1f5f8f8d3'] {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d2f0e56f-28e1-4417-bd34-a22856ebab8d tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/7f237387-af7a-4c69-8e25-9970fddc7727" status: 400 len: 185 microversion: 2.1 time: 0.487872 Oct 04 21:22:02.752405 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1736/3496] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:22:02 2022] DELETE /compute/v2.1/os-security-groups/7f237387-af7a-4c69-8e25-9970fddc7727 => generated 185 bytes in 489 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:22:02.758855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b036711-cf52-4108-aaca-14aded916ffc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:02.759014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-25fca58b-2e92-42d2-b21a-02d986258e39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:02.759164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b036711-cf52-4108-aaca-14aded916ffc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:02.759164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b036711-cf52-4108-aaca-14aded916ffc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:02.759164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b036711-cf52-4108-aaca-14aded916ffc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:02.759164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b036711-cf52-4108-aaca-14aded916ffc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:02.759164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b036711-cf52-4108-aaca-14aded916ffc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:02.761606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-25fca58b-2e92-42d2-b21a-02d986258e39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:02.774470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25fca58b-2e92-42d2-b21a-02d986258e39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:02.779143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25fca58b-2e92-42d2-b21a-02d986258e39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:02.779143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25fca58b-2e92-42d2-b21a-02d986258e39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:02.782328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25fca58b-2e92-42d2-b21a-02d986258e39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:02.782946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25fca58b-2e92-42d2-b21a-02d986258e39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:02.783403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25fca58b-2e92-42d2-b21a-02d986258e39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:03.139699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-25fca58b-2e92-42d2-b21a-02d986258e39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:03.152234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2b036711-cf52-4108-aaca-14aded916ffc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:03.156728 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-25fca58b-2e92-42d2-b21a-02d986258e39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1511 microversion: 2.1 time: 0.407166 Oct 04 21:22:03.161447 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1737/3497] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:02 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1511 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:03.167558 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2b036711-cf52-4108-aaca-14aded916ffc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1314 microversion: 2.1 time: 0.436478 Oct 04 21:22:03.168154 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1761/3498] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:02 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:03.173305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-95a3d49d-c4b9-4752-89b7-87f00cf96ad3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:03.174484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-95a3d49d-c4b9-4752-89b7-87f00cf96ad3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:03.198719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c1784c3a-3173-4e2a-b1da-6117e3cdcc31 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:03.201835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c1784c3a-3173-4e2a-b1da-6117e3cdcc31 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:03.208121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95a3d49d-c4b9-4752-89b7-87f00cf96ad3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:03.209817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95a3d49d-c4b9-4752-89b7-87f00cf96ad3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:03.211796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95a3d49d-c4b9-4752-89b7-87f00cf96ad3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:03.215957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95a3d49d-c4b9-4752-89b7-87f00cf96ad3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:03.218885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:03.221749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1784c3a-3173-4e2a-b1da-6117e3cdcc31 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:03.223698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1784c3a-3173-4e2a-b1da-6117e3cdcc31 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:03.224713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95a3d49d-c4b9-4752-89b7-87f00cf96ad3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:03.225356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1784c3a-3173-4e2a-b1da-6117e3cdcc31 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:03.228065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1784c3a-3173-4e2a-b1da-6117e3cdcc31 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:03.228969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1784c3a-3173-4e2a-b1da-6117e3cdcc31 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:03.229633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1784c3a-3173-4e2a-b1da-6117e3cdcc31 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:03.230231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95a3d49d-c4b9-4752-89b7-87f00cf96ad3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:03.343045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-95a3d49d-c4b9-4752-89b7-87f00cf96ad3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:22:03.383392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c1784c3a-3173-4e2a-b1da-6117e3cdcc31 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:03.393622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c1784c3a-3173-4e2a-b1da-6117e3cdcc31 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:03.404953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c1784c3a-3173-4e2a-b1da-6117e3cdcc31 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:03.404953 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c1784c3a-3173-4e2a-b1da-6117e3cdcc31 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.207104 Oct 04 21:22:03.404953 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1762/3499] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:03 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:03.756034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-11cf44eb-c5ed-4831-bb14-c4fd30609303 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:03.756574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-11cf44eb-c5ed-4831-bb14-c4fd30609303 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:03.763525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11cf44eb-c5ed-4831-bb14-c4fd30609303 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:03.764258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11cf44eb-c5ed-4831-bb14-c4fd30609303 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:03.764871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11cf44eb-c5ed-4831-bb14-c4fd30609303 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:03.765598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11cf44eb-c5ed-4831-bb14-c4fd30609303 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:03.766223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11cf44eb-c5ed-4831-bb14-c4fd30609303 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:03.766639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11cf44eb-c5ed-4831-bb14-c4fd30609303 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:03.828994 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-95a3d49d-c4b9-4752-89b7-87f00cf96ad3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 204 len: 0 microversion: 2.1 time: 0.665045 Oct 04 21:22:03.830169 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1738/3500] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:22:03 2022] DELETE /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:22:03.844862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a8311895-f811-46bc-be5e-a14936af8b3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:03.845793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a8311895-f811-46bc-be5e-a14936af8b3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:03.858031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8311895-f811-46bc-be5e-a14936af8b3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:03.859189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8311895-f811-46bc-be5e-a14936af8b3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:03.859837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8311895-f811-46bc-be5e-a14936af8b3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:03.860989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8311895-f811-46bc-be5e-a14936af8b3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:03.861788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8311895-f811-46bc-be5e-a14936af8b3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:03.863099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8311895-f811-46bc-be5e-a14936af8b3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:04.067532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-11cf44eb-c5ed-4831-bb14-c4fd30609303 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:04.076536 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-11cf44eb-c5ed-4831-bb14-c4fd30609303 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1316 microversion: 2.1 time: 0.324330 Oct 04 21:22:04.079210 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1763/3501] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:03 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:04.128937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a8311895-f811-46bc-be5e-a14936af8b3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:04.137594 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a8311895-f811-46bc-be5e-a14936af8b3c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1645 microversion: 2.1 time: 0.301341 Oct 04 21:22:04.138707 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1739/3502] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:03 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1645 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:04.192292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d237b684-a23e-4f68-9718-cea8e3774104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:04.197322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d237b684-a23e-4f68-9718-cea8e3774104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:04.197493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dd46aa4f-17fe-4fde-9a07-27a9db69536b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:04.197493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dd46aa4f-17fe-4fde-9a07-27a9db69536b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:04.204465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d237b684-a23e-4f68-9718-cea8e3774104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:04.205281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d237b684-a23e-4f68-9718-cea8e3774104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:04.205973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d237b684-a23e-4f68-9718-cea8e3774104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:04.206891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d237b684-a23e-4f68-9718-cea8e3774104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:04.207436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd46aa4f-17fe-4fde-9a07-27a9db69536b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:04.207777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d237b684-a23e-4f68-9718-cea8e3774104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:04.207941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd46aa4f-17fe-4fde-9a07-27a9db69536b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:04.208470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d237b684-a23e-4f68-9718-cea8e3774104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:04.208809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd46aa4f-17fe-4fde-9a07-27a9db69536b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:04.210429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd46aa4f-17fe-4fde-9a07-27a9db69536b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:04.211080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd46aa4f-17fe-4fde-9a07-27a9db69536b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:04.211691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd46aa4f-17fe-4fde-9a07-27a9db69536b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:04.452672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dd46aa4f-17fe-4fde-9a07-27a9db69536b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:04.462800 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dd46aa4f-17fe-4fde-9a07-27a9db69536b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1314 microversion: 2.1 time: 0.270307 Oct 04 21:22:04.470278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d237b684-a23e-4f68-9718-cea8e3774104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:04.477473 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d237b684-a23e-4f68-9718-cea8e3774104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1511 microversion: 2.1 time: 0.290495 Oct 04 21:22:04.478261 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1764/3504] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:04 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1511 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:04.478613 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1740/3504] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:04 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:04.483812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-21505d51-1d8e-4172-acb7-21fd5bfe9136 req-c2d9f6df-cc19-4e3d-8be0-b8173ce47c90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dca035d4-24b1-4e5a-80f8-8fb43893712c", "tag": "b3b642a3-c1cf-4b14-a833-12c2e4b93594"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:04.491570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c6ac8467-b5b0-4d1e-80e9-688f85f08933 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:04.492218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c6ac8467-b5b0-4d1e-80e9-688f85f08933 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:04.493272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-21505d51-1d8e-4172-acb7-21fd5bfe9136 req-c2d9f6df-cc19-4e3d-8be0-b8173ce47c90 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:04.493797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-21505d51-1d8e-4172-acb7-21fd5bfe9136 req-c2d9f6df-cc19-4e3d-8be0-b8173ce47c90 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:04.494236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-21505d51-1d8e-4172-acb7-21fd5bfe9136 req-c2d9f6df-cc19-4e3d-8be0-b8173ce47c90 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:04.503867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6ac8467-b5b0-4d1e-80e9-688f85f08933 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:04.507495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6ac8467-b5b0-4d1e-80e9-688f85f08933 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:04.507495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6ac8467-b5b0-4d1e-80e9-688f85f08933 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:04.507757 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-21505d51-1d8e-4172-acb7-21fd5bfe9136 req-c2d9f6df-cc19-4e3d-8be0-b8173ce47c90 service nova] Creating event network-changed:b3b642a3-c1cf-4b14-a833-12c2e4b93594 for instance dca035d4-24b1-4e5a-80f8-8fb43893712c on n-h1-860282-1 Oct 04 21:22:04.507882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6ac8467-b5b0-4d1e-80e9-688f85f08933 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:04.507882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6ac8467-b5b0-4d1e-80e9-688f85f08933 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:04.507882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6ac8467-b5b0-4d1e-80e9-688f85f08933 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:04.512212 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-21505d51-1d8e-4172-acb7-21fd5bfe9136 req-c2d9f6df-cc19-4e3d-8be0-b8173ce47c90 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032373 Oct 04 21:22:04.512861 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1765/3505] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:04.600481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c6ac8467-b5b0-4d1e-80e9-688f85f08933 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:04.610238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c6ac8467-b5b0-4d1e-80e9-688f85f08933 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:04.612217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c6ac8467-b5b0-4d1e-80e9-688f85f08933 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:04.613665 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c6ac8467-b5b0-4d1e-80e9-688f85f08933 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.133866 Oct 04 21:22:04.615318 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1741/3506] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:04 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:05.101933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a7e905ed-8013-4a4f-ae8a-98e5e3708f98 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:05.102989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a7e905ed-8013-4a4f-ae8a-98e5e3708f98 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:05.110994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7e905ed-8013-4a4f-ae8a-98e5e3708f98 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:05.111738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7e905ed-8013-4a4f-ae8a-98e5e3708f98 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:05.112410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7e905ed-8013-4a4f-ae8a-98e5e3708f98 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:05.113225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7e905ed-8013-4a4f-ae8a-98e5e3708f98 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:05.113776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7e905ed-8013-4a4f-ae8a-98e5e3708f98 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:05.114270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7e905ed-8013-4a4f-ae8a-98e5e3708f98 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:05.167146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-46801617-7422-4746-ada0-ea8701a5732b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:05.168318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-46801617-7422-4746-ada0-ea8701a5732b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:05.182119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46801617-7422-4746-ada0-ea8701a5732b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:05.183003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46801617-7422-4746-ada0-ea8701a5732b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:05.183648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46801617-7422-4746-ada0-ea8701a5732b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:05.185254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46801617-7422-4746-ada0-ea8701a5732b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:05.185951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46801617-7422-4746-ada0-ea8701a5732b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:05.186387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46801617-7422-4746-ada0-ea8701a5732b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:05.342483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a7e905ed-8013-4a4f-ae8a-98e5e3708f98 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:05.365604 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a7e905ed-8013-4a4f-ae8a-98e5e3708f98 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1466 microversion: 2.1 time: 0.253551 Oct 04 21:22:05.365604 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1766/3507] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:05 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1466 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:05.386137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3bfc4a9b-711b-4d74-b1fe-d24cba89d9d3 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-592180601", "metadata": {"image_type": "test"}}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:05.390133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3bfc4a9b-711b-4d74-b1fe-d24cba89d9d3 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:05.396324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bfc4a9b-711b-4d74-b1fe-d24cba89d9d3 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:05.397066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bfc4a9b-711b-4d74-b1fe-d24cba89d9d3 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:05.398122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bfc4a9b-711b-4d74-b1fe-d24cba89d9d3 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:05.398478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bfc4a9b-711b-4d74-b1fe-d24cba89d9d3 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:05.399148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bfc4a9b-711b-4d74-b1fe-d24cba89d9d3 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:05.399789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bfc4a9b-711b-4d74-b1fe-d24cba89d9d3 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:05.421378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-46801617-7422-4746-ada0-ea8701a5732b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:05.431457 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-46801617-7422-4746-ada0-ea8701a5732b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1645 microversion: 2.1 time: 0.268623 Oct 04 21:22:05.445455 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1742/3508] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:05 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1645 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:05.445827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-3bfc4a9b-711b-4d74-b1fe-d24cba89d9d3 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Getting quotas for project 7d76b499bb9344a5b3cb93c4cbc0a51c. Resources: dict_keys(['metadata_items']) {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:22:05.445827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-3bfc4a9b-711b-4d74-b1fe-d24cba89d9d3 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Getting quotas for user 700a67b5993d48a59a373e9535688793 and project 7d76b499bb9344a5b3cb93c4cbc0a51c. Resources: dict_keys(['metadata_items']) {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:22:05.488080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cc967a52-8add-4995-b86c-b636ac9d42dd tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:05.488080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cc967a52-8add-4995-b86c-b636ac9d42dd tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:05.493722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc967a52-8add-4995-b86c-b636ac9d42dd tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:05.494517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc967a52-8add-4995-b86c-b636ac9d42dd tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:05.494973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc967a52-8add-4995-b86c-b636ac9d42dd tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:05.498021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc967a52-8add-4995-b86c-b636ac9d42dd tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:05.498505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc967a52-8add-4995-b86c-b636ac9d42dd tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:05.499336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc967a52-8add-4995-b86c-b636ac9d42dd tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:05.664252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cc967a52-8add-4995-b86c-b636ac9d42dd tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:05.677630 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cc967a52-8add-4995-b86c-b636ac9d42dd tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1314 microversion: 2.1 time: 0.195109 Oct 04 21:22:05.684339 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1743/3509] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:05 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:05.685802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a5bfc4e0-dfc1-44a8-b61f-74bd5d203b53 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:05.686433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a5bfc4e0-dfc1-44a8-b61f-74bd5d203b53 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:05.693121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5bfc4e0-dfc1-44a8-b61f-74bd5d203b53 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:05.693668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5bfc4e0-dfc1-44a8-b61f-74bd5d203b53 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:05.694290 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5bfc4e0-dfc1-44a8-b61f-74bd5d203b53 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:05.695295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5bfc4e0-dfc1-44a8-b61f-74bd5d203b53 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:05.696027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5bfc4e0-dfc1-44a8-b61f-74bd5d203b53 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:05.696843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5bfc4e0-dfc1-44a8-b61f-74bd5d203b53 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:05.795185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:05.875967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a5bfc4e0-dfc1-44a8-b61f-74bd5d203b53 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:05.886292 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a5bfc4e0-dfc1-44a8-b61f-74bd5d203b53 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1511 microversion: 2.1 time: 0.205371 Oct 04 21:22:05.886927 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1744/3510] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:05 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:05.892674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cd6b3ec8-5b27-4526-8052-762572ebaedf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:05.893289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cd6b3ec8-5b27-4526-8052-762572ebaedf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:05.903526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd6b3ec8-5b27-4526-8052-762572ebaedf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:05.903526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd6b3ec8-5b27-4526-8052-762572ebaedf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:05.903526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd6b3ec8-5b27-4526-8052-762572ebaedf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:05.903526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd6b3ec8-5b27-4526-8052-762572ebaedf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:05.903526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd6b3ec8-5b27-4526-8052-762572ebaedf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:05.903526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd6b3ec8-5b27-4526-8052-762572ebaedf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:05.986434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cd6b3ec8-5b27-4526-8052-762572ebaedf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:05.997652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cd6b3ec8-5b27-4526-8052-762572ebaedf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:05.999694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cd6b3ec8-5b27-4526-8052-762572ebaedf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:06.004920 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cd6b3ec8-5b27-4526-8052-762572ebaedf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.112067 Oct 04 21:22:06.004920 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1745/3511] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:05 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:06.007857 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3bfc4a9b-711b-4d74-b1fe-d24cba89d9d3 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "POST /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4/action" status: 202 len: 0 microversion: 2.1 time: 0.625910 Oct 04 21:22:06.015363 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1767/3512] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:22:05 2022] POST /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 21:22:06.022729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9918390c-72be-4d41-9ce1-1722d105a211 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b95f550>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:06.076190 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9918390c-72be-4d41-9ce1-1722d105a211 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf" status: 200 len: 1421 microversion: 2.1 time: 0.059463 Oct 04 21:22:06.077278 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1746/3513] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:06 2022] GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf => generated 1421 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:06.462070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1e056c1e-fac3-44e2-9689-f1525a254cea tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:06.462785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1e056c1e-fac3-44e2-9689-f1525a254cea tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:06.473752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e056c1e-fac3-44e2-9689-f1525a254cea tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:06.474527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e056c1e-fac3-44e2-9689-f1525a254cea tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:06.475157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e056c1e-fac3-44e2-9689-f1525a254cea tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:06.476041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e056c1e-fac3-44e2-9689-f1525a254cea tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:06.476679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e056c1e-fac3-44e2-9689-f1525a254cea tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:06.477108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e056c1e-fac3-44e2-9689-f1525a254cea tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:06.539371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-57bfdb57-f447-4eaa-906e-a2c9ec2139fc req-b73802fc-ecf4-435a-8ba8-9c837d10061d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d94fb740-d887-4830-bb79-bc8a0bc8e2a2", "name": "network-vif-deleted", "tag": "f60d702d-e280-4ab9-bcde-08a05cdbd3d9"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:06.545658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:06.555567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-57bfdb57-f447-4eaa-906e-a2c9ec2139fc req-b73802fc-ecf4-435a-8ba8-9c837d10061d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:06.555764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1e056c1e-fac3-44e2-9689-f1525a254cea tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:06.556432 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-57bfdb57-f447-4eaa-906e-a2c9ec2139fc req-b73802fc-ecf4-435a-8ba8-9c837d10061d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:06.557059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-57bfdb57-f447-4eaa-906e-a2c9ec2139fc req-b73802fc-ecf4-435a-8ba8-9c837d10061d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:06.571471 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1e056c1e-fac3-44e2-9689-f1525a254cea tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1300 microversion: 2.1 time: 0.114571 Oct 04 21:22:06.571850 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-57bfdb57-f447-4eaa-906e-a2c9ec2139fc req-b73802fc-ecf4-435a-8ba8-9c837d10061d service nova] Creating event network-vif-deleted:f60d702d-e280-4ab9-bcde-08a05cdbd3d9 for instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 on n-h2-860282-1 Oct 04 21:22:06.572516 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1768/3514] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:06 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1300 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:06.577477 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-57bfdb57-f447-4eaa-906e-a2c9ec2139fc req-b73802fc-ecf4-435a-8ba8-9c837d10061d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050906 Oct 04 21:22:06.578312 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1747/3515] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:22:06.708442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a746d895-ae2d-4e34-933c-9415eea4ef4f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:06.709090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a746d895-ae2d-4e34-933c-9415eea4ef4f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:06.715345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a746d895-ae2d-4e34-933c-9415eea4ef4f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:06.716476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a746d895-ae2d-4e34-933c-9415eea4ef4f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:06.716927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a746d895-ae2d-4e34-933c-9415eea4ef4f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:06.717653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a746d895-ae2d-4e34-933c-9415eea4ef4f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:06.718112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a746d895-ae2d-4e34-933c-9415eea4ef4f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:06.718541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a746d895-ae2d-4e34-933c-9415eea4ef4f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:06.879511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a746d895-ae2d-4e34-933c-9415eea4ef4f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:06.891268 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a746d895-ae2d-4e34-933c-9415eea4ef4f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1314 microversion: 2.1 time: 0.186773 Oct 04 21:22:06.892562 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1769/3516] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:06 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:06.911401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-69923f49-07d3-4c23-a21d-f5ac4dbf68a3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:06.912213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-69923f49-07d3-4c23-a21d-f5ac4dbf68a3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:06.919251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69923f49-07d3-4c23-a21d-f5ac4dbf68a3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:06.919867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69923f49-07d3-4c23-a21d-f5ac4dbf68a3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:06.920404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69923f49-07d3-4c23-a21d-f5ac4dbf68a3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:06.921196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69923f49-07d3-4c23-a21d-f5ac4dbf68a3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:06.921762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69923f49-07d3-4c23-a21d-f5ac4dbf68a3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:06.922269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69923f49-07d3-4c23-a21d-f5ac4dbf68a3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:06.944248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:07.029546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-30e34885-91d7-48d9-954a-3c3932420144 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:07.030536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-30e34885-91d7-48d9-954a-3c3932420144 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:07.041969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30e34885-91d7-48d9-954a-3c3932420144 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:07.042755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30e34885-91d7-48d9-954a-3c3932420144 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:07.043400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30e34885-91d7-48d9-954a-3c3932420144 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:07.044519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30e34885-91d7-48d9-954a-3c3932420144 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:07.045311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30e34885-91d7-48d9-954a-3c3932420144 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:07.045976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-30e34885-91d7-48d9-954a-3c3932420144 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:07.104113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-69923f49-07d3-4c23-a21d-f5ac4dbf68a3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:07.112779 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-69923f49-07d3-4c23-a21d-f5ac4dbf68a3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1511 microversion: 2.1 time: 0.205996 Oct 04 21:22:07.122052 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1748/3517] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:06 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:07.122052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-db013872-0511-4dcc-bd0e-304c2f277957 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b95fee0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:07.127884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-30e34885-91d7-48d9-954a-3c3932420144 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:07.139309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-30e34885-91d7-48d9-954a-3c3932420144 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:07.139452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-30e34885-91d7-48d9-954a-3c3932420144 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:07.140638 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-30e34885-91d7-48d9-954a-3c3932420144 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.115771 Oct 04 21:22:07.141203 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1770/3518] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:07 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:22:07.200990 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-db013872-0511-4dcc-bd0e-304c2f277957 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf" status: 200 len: 1421 microversion: 2.1 time: 0.083587 Oct 04 21:22:07.201870 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1749/3519] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:07 2022] GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf => generated 1421 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:07.597994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-52a845cb-9444-4f65-aed1-a44ce4a0129b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:07.598612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-52a845cb-9444-4f65-aed1-a44ce4a0129b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:07.605461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52a845cb-9444-4f65-aed1-a44ce4a0129b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:07.612796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52a845cb-9444-4f65-aed1-a44ce4a0129b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:07.612796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52a845cb-9444-4f65-aed1-a44ce4a0129b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:07.612796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52a845cb-9444-4f65-aed1-a44ce4a0129b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:07.612796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52a845cb-9444-4f65-aed1-a44ce4a0129b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:07.612796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52a845cb-9444-4f65-aed1-a44ce4a0129b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:07.647199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52a845cb-9444-4f65-aed1-a44ce4a0129b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:07.647926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52a845cb-9444-4f65-aed1-a44ce4a0129b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:07.653253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52a845cb-9444-4f65-aed1-a44ce4a0129b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:07.653253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-52a845cb-9444-4f65-aed1-a44ce4a0129b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lazy-loading 'fault' on Instance uuid d94fb740-d887-4830-bb79-bc8a0bc8e2a2 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:22:07.698803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-52a845cb-9444-4f65-aed1-a44ce4a0129b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:07.710155 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-52a845cb-9444-4f65-aed1-a44ce4a0129b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 200 len: 1305 microversion: 2.1 time: 0.115719 Oct 04 21:22:07.711226 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1771/3520] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:07 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 1305 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:07.916845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f5425fba-db5a-465c-b7b6-47122db88b7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:07.917512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f5425fba-db5a-465c-b7b6-47122db88b7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:07.926637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5425fba-db5a-465c-b7b6-47122db88b7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:07.927135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5425fba-db5a-465c-b7b6-47122db88b7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:07.927583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5425fba-db5a-465c-b7b6-47122db88b7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:07.928291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5425fba-db5a-465c-b7b6-47122db88b7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:07.928759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5425fba-db5a-465c-b7b6-47122db88b7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:07.929197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5425fba-db5a-465c-b7b6-47122db88b7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:08.105120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f5425fba-db5a-465c-b7b6-47122db88b7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:08.117909 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f5425fba-db5a-465c-b7b6-47122db88b7f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1314 microversion: 2.1 time: 0.205974 Oct 04 21:22:08.118515 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1750/3521] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:07 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:08.139405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-15af9981-76d6-46b9-a89a-044306c9598b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:08.140097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-15af9981-76d6-46b9-a89a-044306c9598b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:08.146468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15af9981-76d6-46b9-a89a-044306c9598b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:08.147040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15af9981-76d6-46b9-a89a-044306c9598b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:08.147483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15af9981-76d6-46b9-a89a-044306c9598b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:08.148380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15af9981-76d6-46b9-a89a-044306c9598b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:08.149016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15af9981-76d6-46b9-a89a-044306c9598b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:08.150012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15af9981-76d6-46b9-a89a-044306c9598b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:08.167912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4b3dd8cc-4f6c-4fda-b54b-976f9f8e6869 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:08.169491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4b3dd8cc-4f6c-4fda-b54b-976f9f8e6869 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:08.176634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b3dd8cc-4f6c-4fda-b54b-976f9f8e6869 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:08.180254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b3dd8cc-4f6c-4fda-b54b-976f9f8e6869 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:08.180254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b3dd8cc-4f6c-4fda-b54b-976f9f8e6869 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:08.180254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b3dd8cc-4f6c-4fda-b54b-976f9f8e6869 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:08.180254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b3dd8cc-4f6c-4fda-b54b-976f9f8e6869 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:08.180254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b3dd8cc-4f6c-4fda-b54b-976f9f8e6869 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:08.282930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4b3dd8cc-4f6c-4fda-b54b-976f9f8e6869 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:08.294847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4b3dd8cc-4f6c-4fda-b54b-976f9f8e6869 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:08.295370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4b3dd8cc-4f6c-4fda-b54b-976f9f8e6869 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:08.296928 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4b3dd8cc-4f6c-4fda-b54b-976f9f8e6869 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.133249 Oct 04 21:22:08.297740 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1751/3522] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:08 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:08.313771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-009dcf0c-b272-42ae-b8d5-685717afcf40 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b972790>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:08.362396 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-009dcf0c-b272-42ae-b8d5-685717afcf40 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf" status: 200 len: 1421 microversion: 2.1 time: 0.063306 Oct 04 21:22:08.362863 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1752/3523] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:08 2022] GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf => generated 1421 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:08.412113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-15af9981-76d6-46b9-a89a-044306c9598b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:08.420610 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-15af9981-76d6-46b9-a89a-044306c9598b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1511 microversion: 2.1 time: 0.288332 Oct 04 21:22:08.421654 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1772/3524] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:08 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:08.736005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2a63ceff-7c2f-4699-adc2-dd2e5ab9fa41 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:08.736654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2a63ceff-7c2f-4699-adc2-dd2e5ab9fa41 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:08.743257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a63ceff-7c2f-4699-adc2-dd2e5ab9fa41 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:08.743776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a63ceff-7c2f-4699-adc2-dd2e5ab9fa41 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:08.744229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a63ceff-7c2f-4699-adc2-dd2e5ab9fa41 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:08.744963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a63ceff-7c2f-4699-adc2-dd2e5ab9fa41 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:08.745462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a63ceff-7c2f-4699-adc2-dd2e5ab9fa41 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:08.746537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a63ceff-7c2f-4699-adc2-dd2e5ab9fa41 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:08.764179 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-2a63ceff-7c2f-4699-adc2-dd2e5ab9fa41 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] HTTP exception thrown: Instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 could not be found. Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2a63ceff-7c2f-4699-adc2-dd2e5ab9fa41 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Request method failure captured: Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 HTTP/1.1 Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKOxTfdccv0aEToOcfdr6OtMIo2CNlYhIlgqu92DBOatDQiWjzVvd5IEryG0QCNnKkdKZPQHitv07AkMUDT3qd6-ZcO30gWiCaxcQoOtheHE279h1an9qvnw6-w5GJGiha-QBcDfyNtCASPXAS_OZ9SmSwbX7jLR7-xMrA5rAkFWAyw Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f547dec3057448558ae4d6012037dac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f547dec3057448558ae4d6012037dac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}] Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: cdbb08401bf146068fc351915ede7675 Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 could not be found. Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'd94fb740-d887-4830-bb79-bc8a0bc8e2a2'} Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 could not be found. Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 could not be found. Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:08.766013 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:08.772209 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:08.772209 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:08.772209 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:08.772209 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:08.772209 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:08.772209 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 could not be found. Oct 04 21:22:08.772209 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:08.772209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2a63ceff-7c2f-4699-adc2-dd2e5ab9fa41 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Returning 404 to user: Instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:08.772209 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2a63ceff-7c2f-4699-adc2-dd2e5ab9fa41 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 404 len: 111 microversion: 2.1 time: 0.036160 Oct 04 21:22:08.772209 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1753/3525] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:08 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:22:08.779293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-16cce5aa-6c88-4b36-943f-088804d3c495 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f578b4ad430>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:09.142049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b3f69dec-2db3-4953-b311-d632fc9eb594 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:09.145144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b3f69dec-2db3-4953-b311-d632fc9eb594 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:09.152670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3f69dec-2db3-4953-b311-d632fc9eb594 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:09.153217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3f69dec-2db3-4953-b311-d632fc9eb594 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:09.154431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3f69dec-2db3-4953-b311-d632fc9eb594 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:09.154569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3f69dec-2db3-4953-b311-d632fc9eb594 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:09.155066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3f69dec-2db3-4953-b311-d632fc9eb594 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:09.155505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3f69dec-2db3-4953-b311-d632fc9eb594 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:09.296215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b3f69dec-2db3-4953-b311-d632fc9eb594 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:09.305093 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b3f69dec-2db3-4953-b311-d632fc9eb594 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1314 microversion: 2.1 time: 0.167587 Oct 04 21:22:09.305888 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1754/3526] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:09 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:09.330584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3186eeff-e80d-4502-ae39-a20becb4edff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:09.331202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3186eeff-e80d-4502-ae39-a20becb4edff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:09.337607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3186eeff-e80d-4502-ae39-a20becb4edff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:09.338108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3186eeff-e80d-4502-ae39-a20becb4edff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:09.338560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3186eeff-e80d-4502-ae39-a20becb4edff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:09.339268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3186eeff-e80d-4502-ae39-a20becb4edff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:09.339735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3186eeff-e80d-4502-ae39-a20becb4edff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:09.340174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3186eeff-e80d-4502-ae39-a20becb4edff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:09.345773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=7 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:09.413960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3186eeff-e80d-4502-ae39-a20becb4edff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:09.422842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3186eeff-e80d-4502-ae39-a20becb4edff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:09.424612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3186eeff-e80d-4502-ae39-a20becb4edff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:09.425921 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3186eeff-e80d-4502-ae39-a20becb4edff tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.099247 Oct 04 21:22:09.426488 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1755/3527] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:09 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:22:09.430952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a63ac622-e2fa-4b79-8389-01cea044601d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578ba9a4c0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:09.480648 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a63ac622-e2fa-4b79-8389-01cea044601d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf" status: 200 len: 1421 microversion: 2.1 time: 0.053100 Oct 04 21:22:09.481656 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1756/3528] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:09 2022] GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf => generated 1421 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:09.487096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ac2e9580-b335-4de4-a15c-49895732e187 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:09.487724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ac2e9580-b335-4de4-a15c-49895732e187 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:09.495983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac2e9580-b335-4de4-a15c-49895732e187 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:09.497539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac2e9580-b335-4de4-a15c-49895732e187 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:09.498056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac2e9580-b335-4de4-a15c-49895732e187 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:09.498971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac2e9580-b335-4de4-a15c-49895732e187 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:09.499480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac2e9580-b335-4de4-a15c-49895732e187 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:09.501929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac2e9580-b335-4de4-a15c-49895732e187 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:09.620398 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-16cce5aa-6c88-4b36-943f-088804d3c495 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/d9cf9df0-419d-4077-af85-7eb473b5ba35" status: 202 len: 0 microversion: 2.1 time: 0.844896 Oct 04 21:22:09.621273 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1773/3529] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:22:08 2022] DELETE /compute/v2.1/os-security-groups/d9cf9df0-419d-4077-af85-7eb473b5ba35 => generated 0 bytes in 847 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:22:09.630922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a96fc8d4-0745-4589-a21b-11eb5acc5efd tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f57945a7700>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:09.805793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ac2e9580-b335-4de4-a15c-49895732e187 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:09.831638 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ac2e9580-b335-4de4-a15c-49895732e187 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1511 microversion: 2.1 time: 0.349049 Oct 04 21:22:09.836957 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1757/3530] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:09 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1511 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:10.164926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-735f6b27-0a23-484a-9f57-6f3d4b2401d3 req-61dc555e-7b38-44c4-8b8f-ad1fd5f016e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca035d4-24b1-4e5a-80f8-8fb43893712c", "name": "network-vif-plugged", "status": "completed", "tag": "b3b642a3-c1cf-4b14-a833-12c2e4b93594"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:10.178359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-735f6b27-0a23-484a-9f57-6f3d4b2401d3 req-61dc555e-7b38-44c4-8b8f-ad1fd5f016e4 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:10.179120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-735f6b27-0a23-484a-9f57-6f3d4b2401d3 req-61dc555e-7b38-44c4-8b8f-ad1fd5f016e4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:10.179836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-735f6b27-0a23-484a-9f57-6f3d4b2401d3 req-61dc555e-7b38-44c4-8b8f-ad1fd5f016e4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:10.203014 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-735f6b27-0a23-484a-9f57-6f3d4b2401d3 req-61dc555e-7b38-44c4-8b8f-ad1fd5f016e4 service nova] Creating event network-vif-plugged:b3b642a3-c1cf-4b14-a833-12c2e4b93594 for instance dca035d4-24b1-4e5a-80f8-8fb43893712c on n-h1-860282-1 Oct 04 21:22:10.208477 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-735f6b27-0a23-484a-9f57-6f3d4b2401d3 req-61dc555e-7b38-44c4-8b8f-ad1fd5f016e4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048374 Oct 04 21:22:10.209045 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1758/3531] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:10.270136 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a96fc8d4-0745-4589-a21b-11eb5acc5efd tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/7f237387-af7a-4c69-8e25-9970fddc7727" status: 202 len: 0 microversion: 2.1 time: 0.643759 Oct 04 21:22:10.272375 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1774/3532] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:22:09 2022] DELETE /compute/v2.1/os-security-groups/7f237387-af7a-4c69-8e25-9970fddc7727 => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:22:10.289842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2250169a-a7bf-4309-9e3b-42fe1468ddb7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Action: 'create', calling method: .version_select at 0x7f578b7308b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-916955410", "description": "tempest-description-1151235180"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:10.328896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5d706fdc-7813-43fa-88f9-2b90f0e87d74 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:10.329556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5d706fdc-7813-43fa-88f9-2b90f0e87d74 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:10.336967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d706fdc-7813-43fa-88f9-2b90f0e87d74 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:10.337529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d706fdc-7813-43fa-88f9-2b90f0e87d74 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:10.338191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d706fdc-7813-43fa-88f9-2b90f0e87d74 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:10.339863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d706fdc-7813-43fa-88f9-2b90f0e87d74 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:10.340508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d706fdc-7813-43fa-88f9-2b90f0e87d74 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:10.341681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d706fdc-7813-43fa-88f9-2b90f0e87d74 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:10.523729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5d706fdc-7813-43fa-88f9-2b90f0e87d74 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:10.536629 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5d706fdc-7813-43fa-88f9-2b90f0e87d74 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1314 microversion: 2.1 time: 0.212281 Oct 04 21:22:10.562590 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1775/3533] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:10 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:10.569561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-78d781e4-0b94-437e-a820-067ecd40775a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:10.577071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-78d781e4-0b94-437e-a820-067ecd40775a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:10.603054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78d781e4-0b94-437e-a820-067ecd40775a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:10.603567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78d781e4-0b94-437e-a820-067ecd40775a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:10.611891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78d781e4-0b94-437e-a820-067ecd40775a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:10.611891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78d781e4-0b94-437e-a820-067ecd40775a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:10.615260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78d781e4-0b94-437e-a820-067ecd40775a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:10.615736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78d781e4-0b94-437e-a820-067ecd40775a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:10.739805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-78d781e4-0b94-437e-a820-067ecd40775a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:10.750981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-78d781e4-0b94-437e-a820-067ecd40775a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:10.754265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-78d781e4-0b94-437e-a820-067ecd40775a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:10.755600 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-78d781e4-0b94-437e-a820-067ecd40775a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.191806 Oct 04 21:22:10.756272 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1776/3534] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:10 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:10.763058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1bde6dcb-a709-48dc-aad4-16a79b55c859 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b4ab160>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:10.949324 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2250169a-a7bf-4309-9e3b-42fe1468ddb7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.665961 Oct 04 21:22:10.950019 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1759/3535] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:22:10 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:10.955016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0442fc9e-c54d-4630-9d3a-a2d890d40e8a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:10.959119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0442fc9e-c54d-4630-9d3a-a2d890d40e8a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:10.959119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:10.963787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0442fc9e-c54d-4630-9d3a-a2d890d40e8a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:10.964337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0442fc9e-c54d-4630-9d3a-a2d890d40e8a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:10.964776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0442fc9e-c54d-4630-9d3a-a2d890d40e8a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:10.966076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0442fc9e-c54d-4630-9d3a-a2d890d40e8a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:10.966802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0442fc9e-c54d-4630-9d3a-a2d890d40e8a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:10.967230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0442fc9e-c54d-4630-9d3a-a2d890d40e8a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:11.145305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0442fc9e-c54d-4630-9d3a-a2d890d40e8a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:11.156951 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0442fc9e-c54d-4630-9d3a-a2d890d40e8a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1511 microversion: 2.1 time: 0.205848 Oct 04 21:22:11.158061 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1760/3536] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:10 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1511 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:11.162730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d267cb30-3025-4230-9e7e-d3a8b0a06314 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Action: 'update', calling method: .version_select at 0x7f578b95f8b0>, body: {"security_group": {"name": "tempest-sg-hth-333256554", "description": "tempest-description-hth-208141864"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:11.874347 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d267cb30-3025-4230-9e7e-d3a8b0a06314 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "PUT /compute/v2.1/os-security-groups/281f19d2-7c89-41da-aca7-944c2765f60e" status: 200 len: 216 microversion: 2.1 time: 0.715152 Oct 04 21:22:11.875636 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1761/3537] 10.222.0.30 () {60 vars in 1290 bytes} [Tue Oct 4 21:22:11 2022] PUT /compute/v2.1/os-security-groups/281f19d2-7c89-41da-aca7-944c2765f60e => generated 216 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:11.881282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1c053119-9412-4e18-8377-f9d3f35dbec9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:11.882587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1c053119-9412-4e18-8377-f9d3f35dbec9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:11.907018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c053119-9412-4e18-8377-f9d3f35dbec9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:11.908423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c053119-9412-4e18-8377-f9d3f35dbec9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:11.911607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c053119-9412-4e18-8377-f9d3f35dbec9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:11.919843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c053119-9412-4e18-8377-f9d3f35dbec9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:11.919843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c053119-9412-4e18-8377-f9d3f35dbec9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:11.919843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c053119-9412-4e18-8377-f9d3f35dbec9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:12.307676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1c053119-9412-4e18-8377-f9d3f35dbec9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:12.319133 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1c053119-9412-4e18-8377-f9d3f35dbec9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1314 microversion: 2.1 time: 0.441938 Oct 04 21:22:12.321846 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1762/3538] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:11 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:12.329901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a98dc0ad-053e-4b70-a6b3-23fc0fecfa14 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:12.330732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a98dc0ad-053e-4b70-a6b3-23fc0fecfa14 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:12.338374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a98dc0ad-053e-4b70-a6b3-23fc0fecfa14 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:12.348517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a98dc0ad-053e-4b70-a6b3-23fc0fecfa14 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:12.348517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a98dc0ad-053e-4b70-a6b3-23fc0fecfa14 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:12.348517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a98dc0ad-053e-4b70-a6b3-23fc0fecfa14 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:12.348517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a98dc0ad-053e-4b70-a6b3-23fc0fecfa14 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:12.348517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a98dc0ad-053e-4b70-a6b3-23fc0fecfa14 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:12.441028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a98dc0ad-053e-4b70-a6b3-23fc0fecfa14 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:12.451809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a98dc0ad-053e-4b70-a6b3-23fc0fecfa14 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:12.455069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a98dc0ad-053e-4b70-a6b3-23fc0fecfa14 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:12.462092 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a98dc0ad-053e-4b70-a6b3-23fc0fecfa14 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.138047 Oct 04 21:22:12.469002 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1763/3539] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:12 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:12.469394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1553dba9-d99f-40be-a7b6-4782a4b57084 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f578b9528b0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:12.535548 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1553dba9-d99f-40be-a7b6-4782a4b57084 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/281f19d2-7c89-41da-aca7-944c2765f60e" status: 200 len: 216 microversion: 2.1 time: 0.070579 Oct 04 21:22:12.536610 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1764/3540] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Oct 4 21:22:12 2022] GET /compute/v2.1/os-security-groups/281f19d2-7c89-41da-aca7-944c2765f60e => generated 216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:12.542929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2823740f-7ace-4003-b0a3-f4ceb6434202 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:12.544467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2823740f-7ace-4003-b0a3-f4ceb6434202 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:12.552615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2823740f-7ace-4003-b0a3-f4ceb6434202 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:12.553974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2823740f-7ace-4003-b0a3-f4ceb6434202 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:12.554675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2823740f-7ace-4003-b0a3-f4ceb6434202 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:12.555455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2823740f-7ace-4003-b0a3-f4ceb6434202 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:12.564210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2823740f-7ace-4003-b0a3-f4ceb6434202 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:12.564819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2823740f-7ace-4003-b0a3-f4ceb6434202 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:12.747762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2823740f-7ace-4003-b0a3-f4ceb6434202 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:12.757248 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2823740f-7ace-4003-b0a3-f4ceb6434202 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1511 microversion: 2.1 time: 0.218115 Oct 04 21:22:12.760383 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1765/3541] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:12 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1511 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:12.774039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b2b47eeb-1069-4687-8405-4d2ed5097278 req-b8802e3c-8879-4ed9-a3e9-e5e1122bc286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4947dfca-605d-4a8f-8ad0-362c13680ab4", "name": "network-vif-plugged", "status": "completed", "tag": "980665fd-e5bf-42ba-85c6-645ed80a8b3b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:12.785366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b2b47eeb-1069-4687-8405-4d2ed5097278 req-b8802e3c-8879-4ed9-a3e9-e5e1122bc286 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:12.785996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b2b47eeb-1069-4687-8405-4d2ed5097278 req-b8802e3c-8879-4ed9-a3e9-e5e1122bc286 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:12.786443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b2b47eeb-1069-4687-8405-4d2ed5097278 req-b8802e3c-8879-4ed9-a3e9-e5e1122bc286 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:12.804827 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b2b47eeb-1069-4687-8405-4d2ed5097278 req-b8802e3c-8879-4ed9-a3e9-e5e1122bc286 service nova] Creating event network-vif-plugged:980665fd-e5bf-42ba-85c6-645ed80a8b3b for instance 4947dfca-605d-4a8f-8ad0-362c13680ab4 on n-h2-860282-1 Oct 04 21:22:12.815095 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b2b47eeb-1069-4687-8405-4d2ed5097278 req-b8802e3c-8879-4ed9-a3e9-e5e1122bc286 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054453 Oct 04 21:22:12.815710 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1766/3542] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:12.830020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f8adfb5d-930f-430b-8eb3-bdcc73b3400c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f578b952af0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:13.275421 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f8adfb5d-930f-430b-8eb3-bdcc73b3400c tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/281f19d2-7c89-41da-aca7-944c2765f60e" status: 202 len: 0 microversion: 2.1 time: 0.451939 Oct 04 21:22:13.275421 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1767/3543] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:22:12 2022] DELETE /compute/v2.1/os-security-groups/281f19d2-7c89-41da-aca7-944c2765f60e => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:22:13.284987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-16ae4572-a030-4d47-a633-3e7bf12d4830 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:13.286175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-16ae4572-a030-4d47-a633-3e7bf12d4830 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:13.327161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16ae4572-a030-4d47-a633-3e7bf12d4830 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:13.327161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16ae4572-a030-4d47-a633-3e7bf12d4830 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:13.327161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16ae4572-a030-4d47-a633-3e7bf12d4830 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:13.327161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16ae4572-a030-4d47-a633-3e7bf12d4830 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:13.327161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16ae4572-a030-4d47-a633-3e7bf12d4830 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:13.327987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16ae4572-a030-4d47-a633-3e7bf12d4830 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:13.345472 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-16ae4572-a030-4d47-a633-3e7bf12d4830 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] HTTP exception thrown: Instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 could not be found. Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-16ae4572-a030-4d47-a633-3e7bf12d4830 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Request method failure captured: Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 HTTP/1.1 Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKOxTfdccv0aEToOcfdr6OtMIo2CNlYhIlgqu92DBOatDQiWjzVvd5IEryG0QCNnKkdKZPQHitv07AkMUDT3qd6-ZcO30gWiCaxcQoOtheHE279h1an9qvnw6-w5GJGiha-QBcDfyNtCASPXAS_OZ9SmSwbX7jLR7-xMrA5rAkFWAyw Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f547dec3057448558ae4d6012037dac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f547dec3057448558ae4d6012037dac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}] Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: cdbb08401bf146068fc351915ede7675 Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 could not be found. Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'd94fb740-d887-4830-bb79-bc8a0bc8e2a2'} Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 could not be found. Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:22:13.347468 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:22:13.352320 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 could not be found. Oct 04 21:22:13.352320 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:13.352320 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:13.352320 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:13.352320 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:13.352320 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:13.352320 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:13.352320 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:13.352320 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:13.352320 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 could not be found. Oct 04 21:22:13.352320 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:13.352320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-16ae4572-a030-4d47-a633-3e7bf12d4830 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Returning 404 to user: Instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:13.352320 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-16ae4572-a030-4d47-a633-3e7bf12d4830 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 404 len: 111 microversion: 2.1 time: 0.068361 Oct 04 21:22:13.352320 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1768/3544] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:22:13 2022] DELETE /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:22:13.360377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f1f50d05-e61d-4abf-aaad-361549198c64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:13.361111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f1f50d05-e61d-4abf-aaad-361549198c64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:13.367721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1f50d05-e61d-4abf-aaad-361549198c64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:13.368485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1f50d05-e61d-4abf-aaad-361549198c64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:13.369900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1f50d05-e61d-4abf-aaad-361549198c64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:13.370812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1f50d05-e61d-4abf-aaad-361549198c64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:13.371670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1f50d05-e61d-4abf-aaad-361549198c64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:13.373023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1f50d05-e61d-4abf-aaad-361549198c64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:13.567384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f1f50d05-e61d-4abf-aaad-361549198c64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:13.576935 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f1f50d05-e61d-4abf-aaad-361549198c64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1500 microversion: 2.1 time: 0.224607 Oct 04 21:22:13.578289 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1769/3545] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:13 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1500 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:13.583433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-39c7ce7f-d4ce-43b9-a5f6-623ed547f2a7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:13.584395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-39c7ce7f-d4ce-43b9-a5f6-623ed547f2a7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: d94fb740-d887-4830-bb79-bc8a0bc8e2a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:13.592678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c7ce7f-d4ce-43b9-a5f6-623ed547f2a7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:13.593456 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c7ce7f-d4ce-43b9-a5f6-623ed547f2a7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:13.594285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c7ce7f-d4ce-43b9-a5f6-623ed547f2a7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:13.595167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c7ce7f-d4ce-43b9-a5f6-623ed547f2a7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:13.596164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c7ce7f-d4ce-43b9-a5f6-623ed547f2a7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:13.596901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c7ce7f-d4ce-43b9-a5f6-623ed547f2a7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:13.629173 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-39c7ce7f-d4ce-43b9-a5f6-623ed547f2a7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] HTTP exception thrown: Instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 could not be found. Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-39c7ce7f-d4ce-43b9-a5f6-623ed547f2a7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Request method failure captured: Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 HTTP/1.1 Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKOxTfdccv0aEToOcfdr6OtMIo2CNlYhIlgqu92DBOatDQiWjzVvd5IEryG0QCNnKkdKZPQHitv07AkMUDT3qd6-ZcO30gWiCaxcQoOtheHE279h1an9qvnw6-w5GJGiha-QBcDfyNtCASPXAS_OZ9SmSwbX7jLR7-xMrA5rAkFWAyw Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f547dec3057448558ae4d6012037dac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f547dec3057448558ae4d6012037dac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}] Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: cdbb08401bf146068fc351915ede7675 Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 could not be found. Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'd94fb740-d887-4830-bb79-bc8a0bc8e2a2'} Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 could not be found. Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 could not be found. Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:13.631448 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:13.637185 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:13.637185 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:13.637185 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:13.637185 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:13.637185 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:13.637185 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 could not be found. Oct 04 21:22:13.637185 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:13.637185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-39c7ce7f-d4ce-43b9-a5f6-623ed547f2a7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Returning 404 to user: Instance d94fb740-d887-4830-bb79-bc8a0bc8e2a2 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:13.637185 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-39c7ce7f-d4ce-43b9-a5f6-623ed547f2a7 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2" status: 404 len: 111 microversion: 2.1 time: 0.053375 Oct 04 21:22:13.637185 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1770/3546] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:13 2022] GET /compute/v2.1/servers/d94fb740-d887-4830-bb79-bc8a0bc8e2a2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:22:13.639669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5d600e29-f823-4ac7-af82-7bf1c33e16c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:13.640538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5d600e29-f823-4ac7-af82-7bf1c33e16c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:13.648318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d600e29-f823-4ac7-af82-7bf1c33e16c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:13.648828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d600e29-f823-4ac7-af82-7bf1c33e16c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:13.649274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d600e29-f823-4ac7-af82-7bf1c33e16c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:13.650249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d600e29-f823-4ac7-af82-7bf1c33e16c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:13.650720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d600e29-f823-4ac7-af82-7bf1c33e16c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:13.651363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d600e29-f823-4ac7-af82-7bf1c33e16c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:13.755900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5d600e29-f823-4ac7-af82-7bf1c33e16c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:13.849348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5d600e29-f823-4ac7-af82-7bf1c33e16c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:13.850788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5d600e29-f823-4ac7-af82-7bf1c33e16c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:13.851996 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5d600e29-f823-4ac7-af82-7bf1c33e16c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.217129 Oct 04 21:22:13.854181 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1771/3547] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:13 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:13.872712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e3416321-5a4a-4cd8-9c62-0f8d3ec8bd64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:13.876506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e3416321-5a4a-4cd8-9c62-0f8d3ec8bd64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:13.882925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3416321-5a4a-4cd8-9c62-0f8d3ec8bd64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:13.883423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3416321-5a4a-4cd8-9c62-0f8d3ec8bd64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:13.884021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3416321-5a4a-4cd8-9c62-0f8d3ec8bd64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:13.884875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3416321-5a4a-4cd8-9c62-0f8d3ec8bd64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:13.885467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3416321-5a4a-4cd8-9c62-0f8d3ec8bd64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:13.893148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3416321-5a4a-4cd8-9c62-0f8d3ec8bd64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:13.924335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-e3416321-5a4a-4cd8-9c62-0f8d3ec8bd64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lazy-loading 'flavor' on Instance uuid dca035d4-24b1-4e5a-80f8-8fb43893712c {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:22:15.174205 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e3416321-5a4a-4cd8-9c62-0f8d3ec8bd64 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "POST /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c/action" status: 200 len: 32 microversion: 2.1 time: 1.318148 Oct 04 21:22:15.174959 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1772/3548] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:22:13 2022] POST /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c/action => generated 32 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:22:15.184837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7590e904-15de-4c98-8b92-7dc30dfa7b34 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f578b952a60>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:15.211309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG neutronclient.v2_0.client [None req-7590e904-15de-4c98-8b92-7dc30dfa7b34 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7f237387-af7a-4c69-8e25-9970fddc7727 does not exist", "detail": ""}} {{(pid=122757) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:22:15.211952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.security_group_api [None req-7590e904-15de-4c98-8b92-7dc30dfa7b34 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Neutron security group 7f237387-af7a-4c69-8e25-9970fddc7727 not found {{(pid=122757) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:22:15.212500 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-7590e904-15de-4c98-8b92-7dc30dfa7b34 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] HTTP exception thrown: Security group 7f237387-af7a-4c69-8e25-9970fddc7727 does not exist Oct 04 21:22:15.212500 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-18d50b91-f7e3-4179-83e4-9b35aa4d5d1d'] Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7590e904-15de-4c98-8b92-7dc30dfa7b34 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Request method failure captured: Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/os-security-groups/7f237387-af7a-4c69-8e25-9970fddc7727 HTTP/1.1 Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKOxTfdccv0aEToOcfdr6OtMIo2CNlYhIlgqu92DBOatDQiWjzVvd5IEryG0QCNnKkdKZPQHitv07AkMUDT3qd6-ZcO30gWiCaxcQoOtheHE279h1an9qvnw6-w5GJGiha-QBcDfyNtCASPXAS_OZ9SmSwbX7jLR7-xMrA5rAkFWAyw Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f547dec3057448558ae4d6012037dac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f547dec3057448558ae4d6012037dac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}] Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: cdbb08401bf146068fc351915ede7675 Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: exception: Security group 7f237387-af7a-4c69-8e25-9970fddc7727 does not exist Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-18d50b91-f7e3-4179-83e4-9b35aa4d5d1d'] Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '7f237387-af7a-4c69-8e25-9970fddc7727'} Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:22:15.214788 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7f237387-af7a-4c69-8e25-9970fddc7727 does not exist Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18d50b91-f7e3-4179-83e4-9b35aa4d5d1d'] Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7f237387-af7a-4c69-8e25-9970fddc7727 does not exist Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18d50b91-f7e3-4179-83e4-9b35aa4d5d1d'] Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7f237387-af7a-4c69-8e25-9970fddc7727 does not exist Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18d50b91-f7e3-4179-83e4-9b35aa4d5d1d'] Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7f237387-af7a-4c69-8e25-9970fddc7727 does not exist Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18d50b91-f7e3-4179-83e4-9b35aa4d5d1d'] Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7590e904-15de-4c98-8b92-7dc30dfa7b34 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Returning 404 to user: Security group 7f237387-af7a-4c69-8e25-9970fddc7727 does not exist Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-18d50b91-f7e3-4179-83e4-9b35aa4d5d1d'] {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7590e904-15de-4c98-8b92-7dc30dfa7b34 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/7f237387-af7a-4c69-8e25-9970fddc7727" status: 404 len: 194 microversion: 2.1 time: 0.041459 Oct 04 21:22:15.223261 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1773/3549] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:22:15 2022] DELETE /compute/v2.1/os-security-groups/7f237387-af7a-4c69-8e25-9970fddc7727 => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:22:15.228914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9b9f322d-7502-45c6-952d-1daf56735659 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:15.234509 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9b9f322d-7502-45c6-952d-1daf56735659 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:15.237778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b9f322d-7502-45c6-952d-1daf56735659 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:15.238289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b9f322d-7502-45c6-952d-1daf56735659 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:15.238741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b9f322d-7502-45c6-952d-1daf56735659 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:15.239573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b9f322d-7502-45c6-952d-1daf56735659 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:15.240137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b9f322d-7502-45c6-952d-1daf56735659 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:15.240474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b9f322d-7502-45c6-952d-1daf56735659 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:15.260636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:15.429111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9b9f322d-7502-45c6-952d-1daf56735659 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:15.439181 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9b9f322d-7502-45c6-952d-1daf56735659 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1511 microversion: 2.1 time: 0.219512 Oct 04 21:22:15.440141 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1774/3550] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:15 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:15.446028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-14148326-623e-410a-9fe1-2eccbbdf5ec6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:15.447104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-14148326-623e-410a-9fe1-2eccbbdf5ec6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:15.454379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14148326-623e-410a-9fe1-2eccbbdf5ec6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:15.455529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14148326-623e-410a-9fe1-2eccbbdf5ec6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:15.456229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14148326-623e-410a-9fe1-2eccbbdf5ec6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:15.457146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14148326-623e-410a-9fe1-2eccbbdf5ec6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:15.457904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14148326-623e-410a-9fe1-2eccbbdf5ec6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:15.458533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-14148326-623e-410a-9fe1-2eccbbdf5ec6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:15.586292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-14148326-623e-410a-9fe1-2eccbbdf5ec6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:15.599706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-14148326-623e-410a-9fe1-2eccbbdf5ec6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:15.601165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-14148326-623e-410a-9fe1-2eccbbdf5ec6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:15.602393 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-14148326-623e-410a-9fe1-2eccbbdf5ec6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.160793 Oct 04 21:22:15.621480 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1775/3551] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:15 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:15.629803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-12a30a87-9370-4329-9139-dd129a0147fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:15.629803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-12a30a87-9370-4329-9139-dd129a0147fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:15.641160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12a30a87-9370-4329-9139-dd129a0147fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:15.641702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12a30a87-9370-4329-9139-dd129a0147fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:15.642151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12a30a87-9370-4329-9139-dd129a0147fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:15.642877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12a30a87-9370-4329-9139-dd129a0147fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:15.643345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12a30a87-9370-4329-9139-dd129a0147fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:15.649262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12a30a87-9370-4329-9139-dd129a0147fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:15.880018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-12a30a87-9370-4329-9139-dd129a0147fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:15.890706 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-12a30a87-9370-4329-9139-dd129a0147fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.279133 Oct 04 21:22:15.893251 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1776/3552] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:15 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:15.898120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aaefa726-2e1e-43ee-b89f-ea97195d27ef tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f578b972dc0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:15.938286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG neutronclient.v2_0.client [None req-aaefa726-2e1e-43ee-b89f-ea97195d27ef tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d9cf9df0-419d-4077-af85-7eb473b5ba35 does not exist", "detail": ""}} {{(pid=122757) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:22:15.938965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.security_group_api [None req-aaefa726-2e1e-43ee-b89f-ea97195d27ef tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Neutron security group d9cf9df0-419d-4077-af85-7eb473b5ba35 not found {{(pid=122757) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:22:15.939498 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-aaefa726-2e1e-43ee-b89f-ea97195d27ef tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] HTTP exception thrown: Security group d9cf9df0-419d-4077-af85-7eb473b5ba35 does not exist Oct 04 21:22:15.939498 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-044e0e4d-2113-4881-9a40-8654a34ac6b8'] Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aaefa726-2e1e-43ee-b89f-ea97195d27ef tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Request method failure captured: Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/os-security-groups/d9cf9df0-419d-4077-af85-7eb473b5ba35 HTTP/1.1 Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKOxTfdccv0aEToOcfdr6OtMIo2CNlYhIlgqu92DBOatDQiWjzVvd5IEryG0QCNnKkdKZPQHitv07AkMUDT3qd6-ZcO30gWiCaxcQoOtheHE279h1an9qvnw6-w5GJGiha-QBcDfyNtCASPXAS_OZ9SmSwbX7jLR7-xMrA5rAkFWAyw Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f547dec3057448558ae4d6012037dac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f547dec3057448558ae4d6012037dac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}] Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: cdbb08401bf146068fc351915ede7675 Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: exception: Security group d9cf9df0-419d-4077-af85-7eb473b5ba35 does not exist Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-044e0e4d-2113-4881-9a40-8654a34ac6b8'] Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'd9cf9df0-419d-4077-af85-7eb473b5ba35'} Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:22:15.942643 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d9cf9df0-419d-4077-af85-7eb473b5ba35 does not exist Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-044e0e4d-2113-4881-9a40-8654a34ac6b8'] Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d9cf9df0-419d-4077-af85-7eb473b5ba35 does not exist Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-044e0e4d-2113-4881-9a40-8654a34ac6b8'] Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d9cf9df0-419d-4077-af85-7eb473b5ba35 does not exist Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-044e0e4d-2113-4881-9a40-8654a34ac6b8'] Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d9cf9df0-419d-4077-af85-7eb473b5ba35 does not exist Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-044e0e4d-2113-4881-9a40-8654a34ac6b8'] Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aaefa726-2e1e-43ee-b89f-ea97195d27ef tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Returning 404 to user: Security group d9cf9df0-419d-4077-af85-7eb473b5ba35 does not exist Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-044e0e4d-2113-4881-9a40-8654a34ac6b8'] {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-aaefa726-2e1e-43ee-b89f-ea97195d27ef tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/d9cf9df0-419d-4077-af85-7eb473b5ba35" status: 404 len: 194 microversion: 2.1 time: 0.049368 Oct 04 21:22:15.949258 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1777/3553] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:22:15 2022] DELETE /compute/v2.1/os-security-groups/d9cf9df0-419d-4077-af85-7eb473b5ba35 => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:22:15.969091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-45138c7a-a763-4272-87c3-8c93f8dc98e6 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f57900b8b80>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:16.015919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG neutronclient.v2_0.client [None req-45138c7a-a763-4272-87c3-8c93f8dc98e6 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 32dd5657-efa0-40ee-8175-14297aaab75e does not exist", "detail": ""}} {{(pid=122757) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:22:16.016578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.security_group_api [None req-45138c7a-a763-4272-87c3-8c93f8dc98e6 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Neutron security group 32dd5657-efa0-40ee-8175-14297aaab75e not found {{(pid=122757) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:22:16.017119 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-45138c7a-a763-4272-87c3-8c93f8dc98e6 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] HTTP exception thrown: Security group 32dd5657-efa0-40ee-8175-14297aaab75e does not exist Oct 04 21:22:16.017119 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-799bee7b-4ead-4271-a481-1c7828258500'] Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-45138c7a-a763-4272-87c3-8c93f8dc98e6 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Request method failure captured: Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/os-security-groups/32dd5657-efa0-40ee-8175-14297aaab75e HTTP/1.1 Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKOxTfdccv0aEToOcfdr6OtMIo2CNlYhIlgqu92DBOatDQiWjzVvd5IEryG0QCNnKkdKZPQHitv07AkMUDT3qd6-ZcO30gWiCaxcQoOtheHE279h1an9qvnw6-w5GJGiha-QBcDfyNtCASPXAS_OZ9SmSwbX7jLR7-xMrA5rAkFWAyw Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f547dec3057448558ae4d6012037dac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f547dec3057448558ae4d6012037dac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}] Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: cdbb08401bf146068fc351915ede7675 Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: exception: Security group 32dd5657-efa0-40ee-8175-14297aaab75e does not exist Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-799bee7b-4ead-4271-a481-1c7828258500'] Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '32dd5657-efa0-40ee-8175-14297aaab75e'} Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:22:16.022135 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 32dd5657-efa0-40ee-8175-14297aaab75e does not exist Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-799bee7b-4ead-4271-a481-1c7828258500'] Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 32dd5657-efa0-40ee-8175-14297aaab75e does not exist Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-799bee7b-4ead-4271-a481-1c7828258500'] Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 32dd5657-efa0-40ee-8175-14297aaab75e does not exist Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-799bee7b-4ead-4271-a481-1c7828258500'] Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 32dd5657-efa0-40ee-8175-14297aaab75e does not exist Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-799bee7b-4ead-4271-a481-1c7828258500'] Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-45138c7a-a763-4272-87c3-8c93f8dc98e6 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Returning 404 to user: Security group 32dd5657-efa0-40ee-8175-14297aaab75e does not exist Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-799bee7b-4ead-4271-a481-1c7828258500'] {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-45138c7a-a763-4272-87c3-8c93f8dc98e6 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/32dd5657-efa0-40ee-8175-14297aaab75e" status: 404 len: 194 microversion: 2.1 time: 0.075573 Oct 04 21:22:16.029170 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1778/3554] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:22:15 2022] DELETE /compute/v2.1/os-security-groups/32dd5657-efa0-40ee-8175-14297aaab75e => generated 194 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:22:16.039923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e2f4785d-d1c5-4b0d-818f-19107ff89667 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f578b95f040>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:16.089934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG neutronclient.v2_0.client [None req-e2f4785d-d1c5-4b0d-818f-19107ff89667 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bf1a2218-5d9a-48e8-af8e-9908f43332d8 does not exist", "detail": ""}} {{(pid=122757) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:22:16.092389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.security_group_api [None req-e2f4785d-d1c5-4b0d-818f-19107ff89667 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Neutron security group bf1a2218-5d9a-48e8-af8e-9908f43332d8 not found {{(pid=122757) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:22:16.095134 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-e2f4785d-d1c5-4b0d-818f-19107ff89667 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] HTTP exception thrown: Security group bf1a2218-5d9a-48e8-af8e-9908f43332d8 does not exist Oct 04 21:22:16.095134 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-e74febf1-bef8-4ac1-8fe6-1b2628b0fb9a'] Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e2f4785d-d1c5-4b0d-818f-19107ff89667 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Request method failure captured: Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/os-security-groups/bf1a2218-5d9a-48e8-af8e-9908f43332d8 HTTP/1.1 Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKOxTfdccv0aEToOcfdr6OtMIo2CNlYhIlgqu92DBOatDQiWjzVvd5IEryG0QCNnKkdKZPQHitv07AkMUDT3qd6-ZcO30gWiCaxcQoOtheHE279h1an9qvnw6-w5GJGiha-QBcDfyNtCASPXAS_OZ9SmSwbX7jLR7-xMrA5rAkFWAyw Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f547dec3057448558ae4d6012037dac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f547dec3057448558ae4d6012037dac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}] Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: cdbb08401bf146068fc351915ede7675 Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: exception: Security group bf1a2218-5d9a-48e8-af8e-9908f43332d8 does not exist Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-e74febf1-bef8-4ac1-8fe6-1b2628b0fb9a'] Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'bf1a2218-5d9a-48e8-af8e-9908f43332d8'} Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:22:16.098590 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bf1a2218-5d9a-48e8-af8e-9908f43332d8 does not exist Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e74febf1-bef8-4ac1-8fe6-1b2628b0fb9a'] Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bf1a2218-5d9a-48e8-af8e-9908f43332d8 does not exist Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e74febf1-bef8-4ac1-8fe6-1b2628b0fb9a'] Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bf1a2218-5d9a-48e8-af8e-9908f43332d8 does not exist Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e74febf1-bef8-4ac1-8fe6-1b2628b0fb9a'] Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bf1a2218-5d9a-48e8-af8e-9908f43332d8 does not exist Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e74febf1-bef8-4ac1-8fe6-1b2628b0fb9a'] Oct 04 21:22:16.106142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.122932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e2f4785d-d1c5-4b0d-818f-19107ff89667 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Returning 404 to user: Security group bf1a2218-5d9a-48e8-af8e-9908f43332d8 does not exist Oct 04 21:22:16.122932 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-e74febf1-bef8-4ac1-8fe6-1b2628b0fb9a'] {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:16.122932 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e2f4785d-d1c5-4b0d-818f-19107ff89667 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/bf1a2218-5d9a-48e8-af8e-9908f43332d8" status: 404 len: 194 microversion: 2.1 time: 0.079160 Oct 04 21:22:16.122932 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1779/3555] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:22:16 2022] DELETE /compute/v2.1/os-security-groups/bf1a2218-5d9a-48e8-af8e-9908f43332d8 => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:22:16.140462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5f0f1728-143f-48c1-bb1b-0d7976f3d5c3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f578b9725e0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:16.188753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG neutronclient.v2_0.client [None req-5f0f1728-143f-48c1-bb1b-0d7976f3d5c3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 does not exist", "detail": ""}} {{(pid=122757) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:22:16.191854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.security_group_api [None req-5f0f1728-143f-48c1-bb1b-0d7976f3d5c3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Neutron security group 4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 not found {{(pid=122757) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:22:16.192808 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-5f0f1728-143f-48c1-bb1b-0d7976f3d5c3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] HTTP exception thrown: Security group 4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 does not exist Oct 04 21:22:16.192808 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-24e5cca4-a1b8-4bc9-833c-2d65a024d370'] Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5f0f1728-143f-48c1-bb1b-0d7976f3d5c3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Request method failure captured: Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/os-security-groups/4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 HTTP/1.1 Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKOxTfdccv0aEToOcfdr6OtMIo2CNlYhIlgqu92DBOatDQiWjzVvd5IEryG0QCNnKkdKZPQHitv07AkMUDT3qd6-ZcO30gWiCaxcQoOtheHE279h1an9qvnw6-w5GJGiha-QBcDfyNtCASPXAS_OZ9SmSwbX7jLR7-xMrA5rAkFWAyw Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f547dec3057448558ae4d6012037dac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f547dec3057448558ae4d6012037dac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}] Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: cdbb08401bf146068fc351915ede7675 Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: exception: Security group 4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 does not exist Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-24e5cca4-a1b8-4bc9-833c-2d65a024d370'] Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418'} Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:22:16.196558 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 does not exist Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24e5cca4-a1b8-4bc9-833c-2d65a024d370'] Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 does not exist Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24e5cca4-a1b8-4bc9-833c-2d65a024d370'] Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 does not exist Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24e5cca4-a1b8-4bc9-833c-2d65a024d370'] Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 does not exist Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24e5cca4-a1b8-4bc9-833c-2d65a024d370'] Oct 04 21:22:16.204367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.209899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5f0f1728-143f-48c1-bb1b-0d7976f3d5c3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Returning 404 to user: Security group 4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 does not exist Oct 04 21:22:16.209899 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-24e5cca4-a1b8-4bc9-833c-2d65a024d370'] {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:16.213205 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5f0f1728-143f-48c1-bb1b-0d7976f3d5c3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418" status: 404 len: 194 microversion: 2.1 time: 0.081046 Oct 04 21:22:16.214531 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1780/3556] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:22:16 2022] DELETE /compute/v2.1/os-security-groups/4cb1e465-8cfc-4b3a-9ce8-696fd5d8a418 => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:22:16.226507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e4588011-a4d4-4a48-8272-e136576ff060 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f578b972ee0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:16.263931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG neutronclient.v2_0.client [None req-e4588011-a4d4-4a48-8272-e136576ff060 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 007b614a-159c-4012-95a3-99174b235345 does not exist", "detail": ""}} {{(pid=122757) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:22:16.264580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.security_group_api [None req-e4588011-a4d4-4a48-8272-e136576ff060 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Neutron security group 007b614a-159c-4012-95a3-99174b235345 not found {{(pid=122757) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:22:16.265093 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-e4588011-a4d4-4a48-8272-e136576ff060 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] HTTP exception thrown: Security group 007b614a-159c-4012-95a3-99174b235345 does not exist Oct 04 21:22:16.265093 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-62d0dc4e-833a-4e10-8aa1-3d186231ff16'] Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e4588011-a4d4-4a48-8272-e136576ff060 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Request method failure captured: Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/os-security-groups/007b614a-159c-4012-95a3-99174b235345 HTTP/1.1 Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKOxTfdccv0aEToOcfdr6OtMIo2CNlYhIlgqu92DBOatDQiWjzVvd5IEryG0QCNnKkdKZPQHitv07AkMUDT3qd6-ZcO30gWiCaxcQoOtheHE279h1an9qvnw6-w5GJGiha-QBcDfyNtCASPXAS_OZ9SmSwbX7jLR7-xMrA5rAkFWAyw Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f547dec3057448558ae4d6012037dac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f547dec3057448558ae4d6012037dac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}] Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: cdbb08401bf146068fc351915ede7675 Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: exception: Security group 007b614a-159c-4012-95a3-99174b235345 does not exist Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-62d0dc4e-833a-4e10-8aa1-3d186231ff16'] Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '007b614a-159c-4012-95a3-99174b235345'} Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:22:16.267093 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 007b614a-159c-4012-95a3-99174b235345 does not exist Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62d0dc4e-833a-4e10-8aa1-3d186231ff16'] Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 007b614a-159c-4012-95a3-99174b235345 does not exist Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62d0dc4e-833a-4e10-8aa1-3d186231ff16'] Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 007b614a-159c-4012-95a3-99174b235345 does not exist Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62d0dc4e-833a-4e10-8aa1-3d186231ff16'] Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 007b614a-159c-4012-95a3-99174b235345 does not exist Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62d0dc4e-833a-4e10-8aa1-3d186231ff16'] Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e4588011-a4d4-4a48-8272-e136576ff060 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Returning 404 to user: Security group 007b614a-159c-4012-95a3-99174b235345 does not exist Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-62d0dc4e-833a-4e10-8aa1-3d186231ff16'] {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e4588011-a4d4-4a48-8272-e136576ff060 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/007b614a-159c-4012-95a3-99174b235345" status: 404 len: 194 microversion: 2.1 time: 0.049648 Oct 04 21:22:16.275875 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1781/3557] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:22:16 2022] DELETE /compute/v2.1/os-security-groups/007b614a-159c-4012-95a3-99174b235345 => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:22:16.283543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b6d08b44-b5ec-464d-99ff-cce8d2c588a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:16.283543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b6d08b44-b5ec-464d-99ff-cce8d2c588a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: e6cb4528-b297-45b4-a0e3-d39236df0178] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:16.287727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6d08b44-b5ec-464d-99ff-cce8d2c588a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:16.288231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6d08b44-b5ec-464d-99ff-cce8d2c588a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:16.288676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6d08b44-b5ec-464d-99ff-cce8d2c588a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:16.289383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6d08b44-b5ec-464d-99ff-cce8d2c588a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:16.293469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6d08b44-b5ec-464d-99ff-cce8d2c588a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:16.293469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6d08b44-b5ec-464d-99ff-cce8d2c588a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:16.323298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b6d08b44-b5ec-464d-99ff-cce8d2c588a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: e6cb4528-b297-45b4-a0e3-d39236df0178] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:22:16.724539 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1bde6dcb-a709-48dc-aad4-16a79b55c859 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf" status: 200 len: 1421 microversion: 2.1 time: 5.966061 Oct 04 21:22:16.726958 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1777/3558] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:10 2022] GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf => generated 1421 bytes in 5970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:16.747038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d6244d9e-03e5-43aa-a7d6-8f35e3aa3243 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:16.747732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d6244d9e-03e5-43aa-a7d6-8f35e3aa3243 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:16.768540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6244d9e-03e5-43aa-a7d6-8f35e3aa3243 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:16.771323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6244d9e-03e5-43aa-a7d6-8f35e3aa3243 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:16.772927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6244d9e-03e5-43aa-a7d6-8f35e3aa3243 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:16.772927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6244d9e-03e5-43aa-a7d6-8f35e3aa3243 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:16.773549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6244d9e-03e5-43aa-a7d6-8f35e3aa3243 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:16.776900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6244d9e-03e5-43aa-a7d6-8f35e3aa3243 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:16.935932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d6244d9e-03e5-43aa-a7d6-8f35e3aa3243 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:16.946985 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d6244d9e-03e5-43aa-a7d6-8f35e3aa3243 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1511 microversion: 2.1 time: 0.218895 Oct 04 21:22:16.947949 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1778/3559] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:16 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1511 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:16.954332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-096d2591-af14-46f6-8568-45c857263192 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:16.955068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-096d2591-af14-46f6-8568-45c857263192 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:16.961937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-096d2591-af14-46f6-8568-45c857263192 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:16.962734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-096d2591-af14-46f6-8568-45c857263192 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:16.963402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-096d2591-af14-46f6-8568-45c857263192 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:16.964497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-096d2591-af14-46f6-8568-45c857263192 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:16.965186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-096d2591-af14-46f6-8568-45c857263192 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:16.966349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-096d2591-af14-46f6-8568-45c857263192 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:17.064072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-096d2591-af14-46f6-8568-45c857263192 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:17.070874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-096d2591-af14-46f6-8568-45c857263192 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:17.072337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-096d2591-af14-46f6-8568-45c857263192 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:17.073592 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-096d2591-af14-46f6-8568-45c857263192 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.124446 Oct 04 21:22:17.074164 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1779/3560] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:16 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:17.080915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7247a465-b96e-4040-bd85-f82519245291 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:17.085808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7247a465-b96e-4040-bd85-f82519245291 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:17.096646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7247a465-b96e-4040-bd85-f82519245291 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:17.097160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7247a465-b96e-4040-bd85-f82519245291 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:17.097643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7247a465-b96e-4040-bd85-f82519245291 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:17.098368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7247a465-b96e-4040-bd85-f82519245291 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:17.101343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7247a465-b96e-4040-bd85-f82519245291 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:17.102893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7247a465-b96e-4040-bd85-f82519245291 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:17.129610 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b6d08b44-b5ec-464d-99ff-cce8d2c588a3 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178" status: 204 len: 0 microversion: 2.1 time: 0.854107 Oct 04 21:22:17.129610 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1782/3561] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:22:16 2022] DELETE /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178 => generated 0 bytes in 856 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:22:17.137329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a1f5e693-c980-4aaf-af23-84dbcd30270a tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:17.138123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a1f5e693-c980-4aaf-af23-84dbcd30270a tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: e6cb4528-b297-45b4-a0e3-d39236df0178] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:17.150846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1f5e693-c980-4aaf-af23-84dbcd30270a tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:17.151353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1f5e693-c980-4aaf-af23-84dbcd30270a tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:17.151800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1f5e693-c980-4aaf-af23-84dbcd30270a tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:17.158542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1f5e693-c980-4aaf-af23-84dbcd30270a tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:17.159124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1f5e693-c980-4aaf-af23-84dbcd30270a tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:17.160338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1f5e693-c980-4aaf-af23-84dbcd30270a tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:17.339354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7247a465-b96e-4040-bd85-f82519245291 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:17.355680 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7247a465-b96e-4040-bd85-f82519245291 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.279947 Oct 04 21:22:17.357035 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1780/3562] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:17 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:17.416765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a1f5e693-c980-4aaf-af23-84dbcd30270a tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:17.425890 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a1f5e693-c980-4aaf-af23-84dbcd30270a tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178" status: 200 len: 1645 microversion: 2.1 time: 0.292836 Oct 04 21:22:17.429960 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1783/3563] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:17 2022] GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178 => generated 1645 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:17.743887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fb15780b-2036-4688-abb5-5d6414fec3d6 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b4ad790>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:17.975880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ea6fd737-9469-4750-bbc9-f8c914f498b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:17.976482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ea6fd737-9469-4750-bbc9-f8c914f498b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:17.990653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea6fd737-9469-4750-bbc9-f8c914f498b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:17.991156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea6fd737-9469-4750-bbc9-f8c914f498b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:17.991685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea6fd737-9469-4750-bbc9-f8c914f498b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:17.992399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea6fd737-9469-4750-bbc9-f8c914f498b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:17.992866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea6fd737-9469-4750-bbc9-f8c914f498b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:17.993299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea6fd737-9469-4750-bbc9-f8c914f498b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:18.175773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ea6fd737-9469-4750-bbc9-f8c914f498b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:18.190390 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ea6fd737-9469-4750-bbc9-f8c914f498b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1511 microversion: 2.1 time: 0.219478 Oct 04 21:22:18.194270 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1784/3564] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:17 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:18.198435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-645cbf57-0534-4bc1-a0db-7643885714cf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:18.199066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-645cbf57-0534-4bc1-a0db-7643885714cf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:18.207273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-645cbf57-0534-4bc1-a0db-7643885714cf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:18.208354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-645cbf57-0534-4bc1-a0db-7643885714cf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:18.208808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-645cbf57-0534-4bc1-a0db-7643885714cf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:18.209554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-645cbf57-0534-4bc1-a0db-7643885714cf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:18.210021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-645cbf57-0534-4bc1-a0db-7643885714cf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:18.210469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-645cbf57-0534-4bc1-a0db-7643885714cf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:18.291298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-645cbf57-0534-4bc1-a0db-7643885714cf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:18.301706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-645cbf57-0534-4bc1-a0db-7643885714cf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:18.303499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-645cbf57-0534-4bc1-a0db-7643885714cf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:18.305128 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-645cbf57-0534-4bc1-a0db-7643885714cf tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.110601 Oct 04 21:22:18.314541 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1785/3565] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:18 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:18.383641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c8324d82-b4f4-41b6-9cec-83162cc873cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:18.423868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c8324d82-b4f4-41b6-9cec-83162cc873cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:18.423868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8324d82-b4f4-41b6-9cec-83162cc873cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:18.423868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8324d82-b4f4-41b6-9cec-83162cc873cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:18.423868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8324d82-b4f4-41b6-9cec-83162cc873cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:18.423868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8324d82-b4f4-41b6-9cec-83162cc873cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:18.423868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8324d82-b4f4-41b6-9cec-83162cc873cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:18.423868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8324d82-b4f4-41b6-9cec-83162cc873cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:18.657921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c8324d82-b4f4-41b6-9cec-83162cc873cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:18.666614 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c8324d82-b4f4-41b6-9cec-83162cc873cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.287152 Oct 04 21:22:18.667780 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1786/3566] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:18 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:18.678926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d2b45a46-f691-43c6-a04d-116e434945b8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:18.679824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d2b45a46-f691-43c6-a04d-116e434945b8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: e6cb4528-b297-45b4-a0e3-d39236df0178] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:18.688952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2b45a46-f691-43c6-a04d-116e434945b8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:18.689578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2b45a46-f691-43c6-a04d-116e434945b8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:18.690028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2b45a46-f691-43c6-a04d-116e434945b8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:18.690767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2b45a46-f691-43c6-a04d-116e434945b8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:18.691351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2b45a46-f691-43c6-a04d-116e434945b8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:18.691894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2b45a46-f691-43c6-a04d-116e434945b8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:18.877903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d2b45a46-f691-43c6-a04d-116e434945b8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:18.885869 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d2b45a46-f691-43c6-a04d-116e434945b8 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178" status: 200 len: 1645 microversion: 2.1 time: 0.216939 Oct 04 21:22:18.886460 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1787/3567] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:18 2022] GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178 => generated 1645 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:19.079097 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fb15780b-2036-4688-abb5-5d6414fec3d6 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf" status: 200 len: 1421 microversion: 2.1 time: 1.330053 Oct 04 21:22:19.079097 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1781/3568] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:17 2022] GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf => generated 1421 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:19.221300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b2555691-b1bd-4b42-a773-51752584692b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:19.221961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b2555691-b1bd-4b42-a773-51752584692b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:19.241152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2555691-b1bd-4b42-a773-51752584692b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:19.241692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2555691-b1bd-4b42-a773-51752584692b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:19.242144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2555691-b1bd-4b42-a773-51752584692b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:19.242866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2555691-b1bd-4b42-a773-51752584692b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:19.243333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2555691-b1bd-4b42-a773-51752584692b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:19.243771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2555691-b1bd-4b42-a773-51752584692b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:19.342793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d57c9055-341a-4bd0-9280-4ec6aab39cbc tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:19.343748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d57c9055-341a-4bd0-9280-4ec6aab39cbc tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:19.356671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d57c9055-341a-4bd0-9280-4ec6aab39cbc tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:19.361135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d57c9055-341a-4bd0-9280-4ec6aab39cbc tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:19.362341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d57c9055-341a-4bd0-9280-4ec6aab39cbc tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:19.365016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d57c9055-341a-4bd0-9280-4ec6aab39cbc tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:19.367787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d57c9055-341a-4bd0-9280-4ec6aab39cbc tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:19.369240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d57c9055-341a-4bd0-9280-4ec6aab39cbc tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:19.480827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d57c9055-341a-4bd0-9280-4ec6aab39cbc tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:19.496000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d57c9055-341a-4bd0-9280-4ec6aab39cbc tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:19.499330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d57c9055-341a-4bd0-9280-4ec6aab39cbc tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:19.499580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b2555691-b1bd-4b42-a773-51752584692b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:19.501386 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d57c9055-341a-4bd0-9280-4ec6aab39cbc tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.166600 Oct 04 21:22:19.502744 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1782/3569] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:19 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:22:19.513309 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b2555691-b1bd-4b42-a773-51752584692b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1488 microversion: 2.1 time: 0.295970 Oct 04 21:22:19.515153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-1b94a4fc-e213-465e-8fbc-80653e723d1c req-c6d8f3b5-e643-4c39-b836-f100e6704577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6cb4528-b297-45b4-a0e3-d39236df0178", "name": "network-vif-deleted", "tag": "c5f1452b-d3bc-4c8e-94d6-828e3670af57"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:19.520133 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1788/3570] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:19 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1488 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:19.527370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1b94a4fc-e213-465e-8fbc-80653e723d1c req-c6d8f3b5-e643-4c39-b836-f100e6704577 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:19.528095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1b94a4fc-e213-465e-8fbc-80653e723d1c req-c6d8f3b5-e643-4c39-b836-f100e6704577 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:19.528698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1b94a4fc-e213-465e-8fbc-80653e723d1c req-c6d8f3b5-e643-4c39-b836-f100e6704577 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:19.542770 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-1b94a4fc-e213-465e-8fbc-80653e723d1c req-c6d8f3b5-e643-4c39-b836-f100e6704577 service nova] Creating event network-vif-deleted:c5f1452b-d3bc-4c8e-94d6-828e3670af57 for instance e6cb4528-b297-45b4-a0e3-d39236df0178 on n-h1-860282-1 Oct 04 21:22:19.550061 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-1b94a4fc-e213-465e-8fbc-80653e723d1c req-c6d8f3b5-e643-4c39-b836-f100e6704577 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045571 Oct 04 21:22:19.551008 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1783/3571] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:19.554293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2bc5e1c9-78b6-43bb-95e0-6d73cc76e870 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:19.569345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2bc5e1c9-78b6-43bb-95e0-6d73cc76e870 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:19.575976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2bc5e1c9-78b6-43bb-95e0-6d73cc76e870 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:19.576479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2bc5e1c9-78b6-43bb-95e0-6d73cc76e870 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:19.576928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2bc5e1c9-78b6-43bb-95e0-6d73cc76e870 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:19.577975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2bc5e1c9-78b6-43bb-95e0-6d73cc76e870 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:19.578450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2bc5e1c9-78b6-43bb-95e0-6d73cc76e870 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:19.578889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2bc5e1c9-78b6-43bb-95e0-6d73cc76e870 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:19.647800 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2bc5e1c9-78b6-43bb-95e0-6d73cc76e870 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action" status: 200 len: 178 microversion: 2.1 time: 0.098756 Oct 04 21:22:19.654189 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1789/3572] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:22:19 2022] POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action => generated 178 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:19.663114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-148e48ab-bf9b-4529-808e-7b2b43aba457 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:19.664673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-148e48ab-bf9b-4529-808e-7b2b43aba457 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:19.696497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-148e48ab-bf9b-4529-808e-7b2b43aba457 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:19.696497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-148e48ab-bf9b-4529-808e-7b2b43aba457 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:19.696497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-148e48ab-bf9b-4529-808e-7b2b43aba457 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:19.696497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-148e48ab-bf9b-4529-808e-7b2b43aba457 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:19.696497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-148e48ab-bf9b-4529-808e-7b2b43aba457 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:19.696497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-148e48ab-bf9b-4529-808e-7b2b43aba457 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:19.713586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1db160db-892d-4d93-b2be-2cc129e80ef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:19.715076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1db160db-892d-4d93-b2be-2cc129e80ef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:19.724723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1db160db-892d-4d93-b2be-2cc129e80ef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:19.725577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1db160db-892d-4d93-b2be-2cc129e80ef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:19.726344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1db160db-892d-4d93-b2be-2cc129e80ef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:19.727651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1db160db-892d-4d93-b2be-2cc129e80ef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:19.728430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1db160db-892d-4d93-b2be-2cc129e80ef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:19.732010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1db160db-892d-4d93-b2be-2cc129e80ef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:20.032851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-148e48ab-bf9b-4529-808e-7b2b43aba457 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:20.047221 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-148e48ab-bf9b-4529-808e-7b2b43aba457 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.390682 Oct 04 21:22:20.055748 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1784/3573] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:19 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:20.064171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8813e8a5-ddaa-4682-a2ca-99a83c04be12 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:20.073292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8813e8a5-ddaa-4682-a2ca-99a83c04be12 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: e6cb4528-b297-45b4-a0e3-d39236df0178] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:20.080170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8813e8a5-ddaa-4682-a2ca-99a83c04be12 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:20.081322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8813e8a5-ddaa-4682-a2ca-99a83c04be12 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:20.082022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8813e8a5-ddaa-4682-a2ca-99a83c04be12 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:20.083141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8813e8a5-ddaa-4682-a2ca-99a83c04be12 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:20.083918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8813e8a5-ddaa-4682-a2ca-99a83c04be12 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:20.084610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8813e8a5-ddaa-4682-a2ca-99a83c04be12 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:20.099726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1db160db-892d-4d93-b2be-2cc129e80ef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:20.113307 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1db160db-892d-4d93-b2be-2cc129e80ef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.414268 Oct 04 21:22:20.115073 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1790/3574] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:19 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:20.121639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bcebd547-6dfa-4c20-95e2-9d5f60c5511f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:20.122993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bcebd547-6dfa-4c20-95e2-9d5f60c5511f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:20.130041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bcebd547-6dfa-4c20-95e2-9d5f60c5511f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:20.130819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bcebd547-6dfa-4c20-95e2-9d5f60c5511f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:20.131444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bcebd547-6dfa-4c20-95e2-9d5f60c5511f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:20.133246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bcebd547-6dfa-4c20-95e2-9d5f60c5511f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:20.133909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bcebd547-6dfa-4c20-95e2-9d5f60c5511f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:20.134512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bcebd547-6dfa-4c20-95e2-9d5f60c5511f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:20.162400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8813e8a5-ddaa-4682-a2ca-99a83c04be12 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:20.162907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8813e8a5-ddaa-4682-a2ca-99a83c04be12 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:20.163392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8813e8a5-ddaa-4682-a2ca-99a83c04be12 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:20.164313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-8813e8a5-ddaa-4682-a2ca-99a83c04be12 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lazy-loading 'fault' on Instance uuid e6cb4528-b297-45b4-a0e3-d39236df0178 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:22:20.258149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8813e8a5-ddaa-4682-a2ca-99a83c04be12 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbb08401bf146068fc351915ede7675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f547dec3057448558ae4d6012037dac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:20.271826 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8813e8a5-ddaa-4682-a2ca-99a83c04be12 tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178" status: 200 len: 1305 microversion: 2.1 time: 0.210973 Oct 04 21:22:20.273072 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1785/3575] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:20 2022] GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178 => generated 1305 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:20.292371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4a18adfc-0694-472b-8a7c-9d79c1e76712 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b485af0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:20.339351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bcebd547-6dfa-4c20-95e2-9d5f60c5511f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:20.351015 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bcebd547-6dfa-4c20-95e2-9d5f60c5511f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.232301 Oct 04 21:22:20.351015 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1791/3576] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:20 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:20.373689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d94266b8-d8db-4b75-8a5c-b252c984dfea tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:20.374433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d94266b8-d8db-4b75-8a5c-b252c984dfea tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:20.381172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d94266b8-d8db-4b75-8a5c-b252c984dfea tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:20.388331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d94266b8-d8db-4b75-8a5c-b252c984dfea tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:20.388331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d94266b8-d8db-4b75-8a5c-b252c984dfea tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:20.388331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d94266b8-d8db-4b75-8a5c-b252c984dfea tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:20.388331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d94266b8-d8db-4b75-8a5c-b252c984dfea tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:20.388331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d94266b8-d8db-4b75-8a5c-b252c984dfea tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:20.563659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d94266b8-d8db-4b75-8a5c-b252c984dfea tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:20.579982 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d94266b8-d8db-4b75-8a5c-b252c984dfea tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.211267 Oct 04 21:22:20.580896 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1792/3577] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:20 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:20.589342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-94d2da04-b653-4171-ae27-34a8b8fc1c4a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:20.589998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-94d2da04-b653-4171-ae27-34a8b8fc1c4a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:20.599314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:20.600726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94d2da04-b653-4171-ae27-34a8b8fc1c4a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:20.601260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94d2da04-b653-4171-ae27-34a8b8fc1c4a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:20.604039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94d2da04-b653-4171-ae27-34a8b8fc1c4a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:20.604039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94d2da04-b653-4171-ae27-34a8b8fc1c4a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:20.604039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94d2da04-b653-4171-ae27-34a8b8fc1c4a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:20.604039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94d2da04-b653-4171-ae27-34a8b8fc1c4a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:20.683548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-94d2da04-b653-4171-ae27-34a8b8fc1c4a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:20.697596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-94d2da04-b653-4171-ae27-34a8b8fc1c4a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:20.699598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-94d2da04-b653-4171-ae27-34a8b8fc1c4a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:20.701923 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-94d2da04-b653-4171-ae27-34a8b8fc1c4a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.119434 Oct 04 21:22:20.702872 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1793/3578] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:20 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:20.709623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9e1336fa-ddb0-4ca5-879b-e7288a78c273 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:20.710568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9e1336fa-ddb0-4ca5-879b-e7288a78c273 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:20.718522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e1336fa-ddb0-4ca5-879b-e7288a78c273 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:20.719142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e1336fa-ddb0-4ca5-879b-e7288a78c273 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:20.719693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e1336fa-ddb0-4ca5-879b-e7288a78c273 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:20.720774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e1336fa-ddb0-4ca5-879b-e7288a78c273 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:20.721595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e1336fa-ddb0-4ca5-879b-e7288a78c273 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:20.722317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e1336fa-ddb0-4ca5-879b-e7288a78c273 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:20.942918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9e1336fa-ddb0-4ca5-879b-e7288a78c273 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:20.956072 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9e1336fa-ddb0-4ca5-879b-e7288a78c273 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.251433 Oct 04 21:22:20.975862 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1794/3579] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:20 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:21.115205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fbe323cb-f0e3-4467-b953-bbac4d2c24e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-266469680", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "734a8a85-50ab-4efa-9474-a014f1074a74"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:21.401857 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4a18adfc-0694-472b-8a7c-9d79c1e76712 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf" status: 200 len: 1421 microversion: 2.1 time: 1.127537 Oct 04 21:22:21.405994 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1786/3580] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:20 2022] GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf => generated 1421 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:21.419203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-142df9f0-0390-45b9-9117-0ed48cea34f6 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:21.424442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-142df9f0-0390-45b9-9117-0ed48cea34f6 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:21.437001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-142df9f0-0390-45b9-9117-0ed48cea34f6 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:21.437947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-142df9f0-0390-45b9-9117-0ed48cea34f6 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:21.439986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-142df9f0-0390-45b9-9117-0ed48cea34f6 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:21.440967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-142df9f0-0390-45b9-9117-0ed48cea34f6 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:21.441677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-142df9f0-0390-45b9-9117-0ed48cea34f6 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:21.442292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-142df9f0-0390-45b9-9117-0ed48cea34f6 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:21.584210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:21.677620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-142df9f0-0390-45b9-9117-0ed48cea34f6 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:21.688172 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-142df9f0-0390-45b9-9117-0ed48cea34f6 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.280932 Oct 04 21:22:21.704342 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1787/3581] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:21 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:21.708875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e194e9d5-10e9-49c7-8834-aee1b93d70de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:21.709695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e194e9d5-10e9-49c7-8834-aee1b93d70de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] [instance: e6cb4528-b297-45b4-a0e3-d39236df0178] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:21.728997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e194e9d5-10e9-49c7-8834-aee1b93d70de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:21.728997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e194e9d5-10e9-49c7-8834-aee1b93d70de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:21.728997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e194e9d5-10e9-49c7-8834-aee1b93d70de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:21.728997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e194e9d5-10e9-49c7-8834-aee1b93d70de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:21.728997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e194e9d5-10e9-49c7-8834-aee1b93d70de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:21.728997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e194e9d5-10e9-49c7-8834-aee1b93d70de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:21.742320 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-e194e9d5-10e9-49c7-8834-aee1b93d70de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] HTTP exception thrown: Instance e6cb4528-b297-45b4-a0e3-d39236df0178 could not be found. Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e194e9d5-10e9-49c7-8834-aee1b93d70de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Request method failure captured: Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178 HTTP/1.1 Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKOxTfdccv0aEToOcfdr6OtMIo2CNlYhIlgqu92DBOatDQiWjzVvd5IEryG0QCNnKkdKZPQHitv07AkMUDT3qd6-ZcO30gWiCaxcQoOtheHE279h1an9qvnw6-w5GJGiha-QBcDfyNtCASPXAS_OZ9SmSwbX7jLR7-xMrA5rAkFWAyw Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f547dec3057448558ae4d6012037dac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f547dec3057448558ae4d6012037dac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f547dec3057448558ae4d6012037dac3"}]}] Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f547dec3057448558ae4d6012037dac3 Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1455676096 Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: cdbb08401bf146068fc351915ede7675 Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-SecurityGroupsTestJSON-1455676096-project Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance e6cb4528-b297-45b4-a0e3-d39236df0178 could not be found. Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'e6cb4528-b297-45b4-a0e3-d39236df0178'} Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6cb4528-b297-45b4-a0e3-d39236df0178 could not be found. Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6cb4528-b297-45b4-a0e3-d39236df0178 could not be found. Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:21.744019 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:21.750515 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:21.750515 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:21.750515 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:21.750515 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:21.750515 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:21.750515 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6cb4528-b297-45b4-a0e3-d39236df0178 could not be found. Oct 04 21:22:21.750515 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:21.750515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e194e9d5-10e9-49c7-8834-aee1b93d70de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Returning 404 to user: Instance e6cb4528-b297-45b4-a0e3-d39236df0178 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:21.750515 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e194e9d5-10e9-49c7-8834-aee1b93d70de tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178" status: 404 len: 111 microversion: 2.1 time: 0.041839 Oct 04 21:22:21.750515 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1788/3582] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:21 2022] GET /compute/v2.1/servers/e6cb4528-b297-45b4-a0e3-d39236df0178 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:22:21.764052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b16d7ea9-1f44-4043-9f3b-c15728bb16d6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:21.765154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b16d7ea9-1f44-4043-9f3b-c15728bb16d6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:21.775128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b16d7ea9-1f44-4043-9f3b-c15728bb16d6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:21.775906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b16d7ea9-1f44-4043-9f3b-c15728bb16d6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:21.776536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b16d7ea9-1f44-4043-9f3b-c15728bb16d6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:21.777523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b16d7ea9-1f44-4043-9f3b-c15728bb16d6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:21.778198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b16d7ea9-1f44-4043-9f3b-c15728bb16d6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:21.778829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b16d7ea9-1f44-4043-9f3b-c15728bb16d6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:21.900873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b16d7ea9-1f44-4043-9f3b-c15728bb16d6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:21.907054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:21.917385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b16d7ea9-1f44-4043-9f3b-c15728bb16d6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:21.919833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b16d7ea9-1f44-4043-9f3b-c15728bb16d6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:21.921298 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b16d7ea9-1f44-4043-9f3b-c15728bb16d6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.169765 Oct 04 21:22:21.922061 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1789/3583] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:21 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:21.927236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-30d35472-374c-4ab8-b68b-3edc8418cf7b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f578b4ed670>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:22.016655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-fbe323cb-f0e3-4467-b953-bbac4d2c24e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] validate_networks() for [('734a8a85-50ab-4efa-9474-a014f1074a74', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:22:22.439085 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-30d35472-374c-4ab8-b68b-3edc8418cf7b tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/2213926a-2a81-47ac-9274-c8f3f2b9711d" status: 202 len: 0 microversion: 2.1 time: 0.509038 Oct 04 21:22:22.439085 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1790/3584] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:22:21 2022] DELETE /compute/v2.1/os-security-groups/2213926a-2a81-47ac-9274-c8f3f2b9711d => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:22:22.442975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c05a3c44-5040-4d98-86dd-21686a23a8d6 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f5794556790>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:22.611484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-fbe323cb-f0e3-4467-b953-bbac4d2c24e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:22:22.612288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-fbe323cb-f0e3-4467-b953-bbac4d2c24e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:22:22.612715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-fbe323cb-f0e3-4467-b953-bbac4d2c24e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:22:22.613144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-fbe323cb-f0e3-4467-b953-bbac4d2c24e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:22:22.613598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-fbe323cb-f0e3-4467-b953-bbac4d2c24e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:22:22.624743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fbe323cb-f0e3-4467-b953-bbac4d2c24e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:22.625235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fbe323cb-f0e3-4467-b953-bbac4d2c24e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:22.625772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fbe323cb-f0e3-4467-b953-bbac4d2c24e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:22.626539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fbe323cb-f0e3-4467-b953-bbac4d2c24e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:22.626994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fbe323cb-f0e3-4467-b953-bbac4d2c24e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:22.627420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fbe323cb-f0e3-4467-b953-bbac4d2c24e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:22.647811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-fbe323cb-f0e3-4467-b953-bbac4d2c24e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Getting quotas for project 0f62474e9d474aa28ac754b712e68652. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:22:22.653904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-fbe323cb-f0e3-4467-b953-bbac4d2c24e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Getting quotas for user 8ef7d2991dce46278486e0ee963d4cf3 and project 0f62474e9d474aa28ac754b712e68652. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:22:22.669391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fbe323cb-f0e3-4467-b953-bbac4d2c24e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:22:22.669660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fbe323cb-f0e3-4467-b953-bbac4d2c24e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:22:22.800806 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fbe323cb-f0e3-4467-b953-bbac4d2c24e9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.693523 Oct 04 21:22:22.805581 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1795/3585] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:22:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:22:22.807495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8b506ef6-c325-44cb-8e9b-ea48a887efcf tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] Calling method '.version_select at 0x7f57900354c0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:23.159295 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8b506ef6-c325-44cb-8e9b-ea48a887efcf tempest-SecurityGroupsTestJSON-1455676096 tempest-SecurityGroupsTestJSON-1455676096-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/0e7f1461-ad94-4f1d-b820-a227d6b87e2a" status: 202 len: 0 microversion: 2.1 time: 0.356171 Oct 04 21:22:23.163520 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1796/3586] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:22:22 2022] DELETE /compute/v2.1/os-security-groups/0e7f1461-ad94-4f1d-b820-a227d6b87e2a => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:22:23.168138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-72dffa6f-8e97-4313-919f-1719bd59f6fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:23.168138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-72dffa6f-8e97-4313-919f-1719bd59f6fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:23.176990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72dffa6f-8e97-4313-919f-1719bd59f6fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:23.179567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72dffa6f-8e97-4313-919f-1719bd59f6fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:23.180131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72dffa6f-8e97-4313-919f-1719bd59f6fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:23.181018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72dffa6f-8e97-4313-919f-1719bd59f6fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:23.181760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72dffa6f-8e97-4313-919f-1719bd59f6fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:23.182273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72dffa6f-8e97-4313-919f-1719bd59f6fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:23.366202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-72dffa6f-8e97-4313-919f-1719bd59f6fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:23.378648 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-72dffa6f-8e97-4313-919f-1719bd59f6fe tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.216003 Oct 04 21:22:23.386046 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1797/3587] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:23 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:23.386046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-678fd4a6-3931-400c-8bee-a4186913b76f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:23.386046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-678fd4a6-3931-400c-8bee-a4186913b76f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:23.461811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-678fd4a6-3931-400c-8bee-a4186913b76f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:23.461811 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-678fd4a6-3931-400c-8bee-a4186913b76f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1214 microversion: 2.1 time: 0.079337 Oct 04 21:22:23.461811 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1798/3588] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:23 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:23.466304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0bb6f47d-b495-4d09-9075-868626f804ea tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:23.466949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0bb6f47d-b495-4d09-9075-868626f804ea tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:23.473151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bb6f47d-b495-4d09-9075-868626f804ea tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:23.473660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bb6f47d-b495-4d09-9075-868626f804ea tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:23.474200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bb6f47d-b495-4d09-9075-868626f804ea tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:23.474868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bb6f47d-b495-4d09-9075-868626f804ea tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:23.475340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bb6f47d-b495-4d09-9075-868626f804ea tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:23.475773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bb6f47d-b495-4d09-9075-868626f804ea tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:23.551094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0bb6f47d-b495-4d09-9075-868626f804ea tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:23.559855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0bb6f47d-b495-4d09-9075-868626f804ea tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:23.561480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0bb6f47d-b495-4d09-9075-868626f804ea tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:23.562893 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0bb6f47d-b495-4d09-9075-868626f804ea tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.101600 Oct 04 21:22:23.563467 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1799/3589] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:23 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:24.404812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3d4d7523-2746-4706-82fa-8bb57eb6f060 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:24.405570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3d4d7523-2746-4706-82fa-8bb57eb6f060 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:24.414972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d4d7523-2746-4706-82fa-8bb57eb6f060 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:24.415788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d4d7523-2746-4706-82fa-8bb57eb6f060 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:24.416419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d4d7523-2746-4706-82fa-8bb57eb6f060 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:24.417589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d4d7523-2746-4706-82fa-8bb57eb6f060 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:24.418025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d4d7523-2746-4706-82fa-8bb57eb6f060 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:24.418547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d4d7523-2746-4706-82fa-8bb57eb6f060 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:24.589377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3d4d7523-2746-4706-82fa-8bb57eb6f060 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:24.598799 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c05a3c44-5040-4d98-86dd-21686a23a8d6 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf" status: 200 len: 1421 microversion: 2.1 time: 2.162738 Oct 04 21:22:24.608271 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1791/3590] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:22 2022] GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf => generated 1421 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:24.608271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1849f9ce-4fc8-415e-bc5b-14b5de36a715 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:24.608271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1849f9ce-4fc8-415e-bc5b-14b5de36a715 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:24.611623 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3d4d7523-2746-4706-82fa-8bb57eb6f060 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.208446 Oct 04 21:22:24.611623 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1800/3591] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:24 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:24.620230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1849f9ce-4fc8-415e-bc5b-14b5de36a715 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:24.620904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1849f9ce-4fc8-415e-bc5b-14b5de36a715 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:24.622217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1849f9ce-4fc8-415e-bc5b-14b5de36a715 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:24.623365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1849f9ce-4fc8-415e-bc5b-14b5de36a715 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:24.623505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7770fec3-110a-48f0-8043-78559c22622a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:24.624021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1849f9ce-4fc8-415e-bc5b-14b5de36a715 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:24.624176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7770fec3-110a-48f0-8043-78559c22622a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:24.624987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1849f9ce-4fc8-415e-bc5b-14b5de36a715 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:24.649586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7770fec3-110a-48f0-8043-78559c22622a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:24.650099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7770fec3-110a-48f0-8043-78559c22622a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:24.650556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7770fec3-110a-48f0-8043-78559c22622a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:24.654410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7770fec3-110a-48f0-8043-78559c22622a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:24.655127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7770fec3-110a-48f0-8043-78559c22622a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:24.655699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7770fec3-110a-48f0-8043-78559c22622a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:24.719848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1849f9ce-4fc8-415e-bc5b-14b5de36a715 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:24.727850 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1849f9ce-4fc8-415e-bc5b-14b5de36a715 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1218 microversion: 2.1 time: 0.127113 Oct 04 21:22:24.730640 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1792/3592] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:24 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:24.751048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7770fec3-110a-48f0-8043-78559c22622a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:24.767988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7770fec3-110a-48f0-8043-78559c22622a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:24.769780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7770fec3-110a-48f0-8043-78559c22622a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:24.775642 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7770fec3-110a-48f0-8043-78559c22622a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.160359 Oct 04 21:22:24.775642 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1801/3593] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:24 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:25.615792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-29a44ff0-bea6-4ddc-85eb-589cfb5b9a59 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b4ad9d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:25.634220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dd0efda8-14a7-4ad4-8a36-c2b9d37823d5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:25.635208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dd0efda8-14a7-4ad4-8a36-c2b9d37823d5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:25.645285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd0efda8-14a7-4ad4-8a36-c2b9d37823d5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:25.648682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd0efda8-14a7-4ad4-8a36-c2b9d37823d5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:25.648682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd0efda8-14a7-4ad4-8a36-c2b9d37823d5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:25.648682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd0efda8-14a7-4ad4-8a36-c2b9d37823d5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:25.648682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd0efda8-14a7-4ad4-8a36-c2b9d37823d5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:25.648682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd0efda8-14a7-4ad4-8a36-c2b9d37823d5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:25.685671 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-29a44ff0-bea6-4ddc-85eb-589cfb5b9a59 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf" status: 200 len: 1430 microversion: 2.1 time: 0.074127 Oct 04 21:22:25.689511 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1793/3594] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:25 2022] GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf => generated 1430 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:25.702845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3fda8a3d-b2fe-48c4-b087-e7b2feac6c7e tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b4553a0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:25.782860 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3fda8a3d-b2fe-48c4-b087-e7b2feac6c7e tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf" status: 200 len: 1430 microversion: 2.1 time: 0.084727 Oct 04 21:22:25.783609 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1794/3595] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:25 2022] GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf => generated 1430 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:25.788939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-80acef28-3950-49e7-a3e8-68149b85ce72 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:25.789923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-80acef28-3950-49e7-a3e8-68149b85ce72 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:25.797621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80acef28-3950-49e7-a3e8-68149b85ce72 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:25.798292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80acef28-3950-49e7-a3e8-68149b85ce72 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:25.799264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80acef28-3950-49e7-a3e8-68149b85ce72 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:25.800243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80acef28-3950-49e7-a3e8-68149b85ce72 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:25.800935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80acef28-3950-49e7-a3e8-68149b85ce72 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:25.801491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80acef28-3950-49e7-a3e8-68149b85ce72 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:26.271668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-80acef28-3950-49e7-a3e8-68149b85ce72 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:26.284045 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-80acef28-3950-49e7-a3e8-68149b85ce72 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1266 microversion: 2.1 time: 0.498868 Oct 04 21:22:26.285083 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1795/3596] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:25 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1266 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:26.289587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a3fa987-07b9-414b-877e-3f28cca9066b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:26.301540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7a3fa987-07b9-414b-877e-3f28cca9066b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:26.317236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a3fa987-07b9-414b-877e-3f28cca9066b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:26.317781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a3fa987-07b9-414b-877e-3f28cca9066b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:26.318228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a3fa987-07b9-414b-877e-3f28cca9066b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:26.318935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a3fa987-07b9-414b-877e-3f28cca9066b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:26.322918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a3fa987-07b9-414b-877e-3f28cca9066b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:26.323391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a3fa987-07b9-414b-877e-3f28cca9066b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:26.383928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dd0efda8-14a7-4ad4-8a36-c2b9d37823d5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:26.392334 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dd0efda8-14a7-4ad4-8a36-c2b9d37823d5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.763689 Oct 04 21:22:26.393148 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1802/3597] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:25 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:26.398724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-de93205c-b9fe-4cd0-838e-82f70022d031 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:26.399608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-de93205c-b9fe-4cd0-838e-82f70022d031 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:26.407326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de93205c-b9fe-4cd0-838e-82f70022d031 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:26.408203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de93205c-b9fe-4cd0-838e-82f70022d031 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:26.408818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de93205c-b9fe-4cd0-838e-82f70022d031 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:26.409813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de93205c-b9fe-4cd0-838e-82f70022d031 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:26.410501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de93205c-b9fe-4cd0-838e-82f70022d031 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:26.410942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de93205c-b9fe-4cd0-838e-82f70022d031 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:26.559530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7a3fa987-07b9-414b-877e-3f28cca9066b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:26.567005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-de93205c-b9fe-4cd0-838e-82f70022d031 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:26.569113 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7a3fa987-07b9-414b-877e-3f28cca9066b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1466 microversion: 2.1 time: 0.282764 Oct 04 21:22:26.570522 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1796/3598] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:26 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1466 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:26.603146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-de93205c-b9fe-4cd0-838e-82f70022d031 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:26.604721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-de93205c-b9fe-4cd0-838e-82f70022d031 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:26.607448 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-de93205c-b9fe-4cd0-838e-82f70022d031 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1366 microversion: 2.57 time: 0.211776 Oct 04 21:22:26.616691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-09c2e0ce-53b3-40a8-9240-1372ba40b770 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578be9d0d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:26.631926 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1803/3599] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:26 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:26.696967 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-09c2e0ce-53b3-40a8-9240-1372ba40b770 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/d55fbb2c-685c-4db7-a38c-ac6cf5459ad1" status: 200 len: 784 microversion: 2.1 time: 0.105005 Oct 04 21:22:26.697920 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1797/3600] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:26 2022] GET /compute/v2.1/images/d55fbb2c-685c-4db7-a38c-ac6cf5459ad1 => generated 784 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:26.712677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d96d2610-d068-4016-83bf-8b994ba5022b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:26.721816 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d96d2610-d068-4016-83bf-8b994ba5022b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012900 Oct 04 21:22:26.722822 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1804/3601] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:22:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:26.735579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-671600bd-2b94-47df-b9cb-cc53d2dc5062 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b4d7550>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:27.311865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c146b0c8-981d-4557-a284-7f10e318b96f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:27.312914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c146b0c8-981d-4557-a284-7f10e318b96f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:27.327044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c146b0c8-981d-4557-a284-7f10e318b96f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:27.327901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c146b0c8-981d-4557-a284-7f10e318b96f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:27.329334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c146b0c8-981d-4557-a284-7f10e318b96f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:27.336286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c146b0c8-981d-4557-a284-7f10e318b96f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:27.337286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c146b0c8-981d-4557-a284-7f10e318b96f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:27.337937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c146b0c8-981d-4557-a284-7f10e318b96f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:27.455181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c146b0c8-981d-4557-a284-7f10e318b96f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:27.463392 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c146b0c8-981d-4557-a284-7f10e318b96f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1272 microversion: 2.1 time: 0.156399 Oct 04 21:22:27.464437 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1805/3602] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:27 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:27.469860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cc57e12f-213c-4138-9df1-ac1f03aad4ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:27.470621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cc57e12f-213c-4138-9df1-ac1f03aad4ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:27.477853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc57e12f-213c-4138-9df1-ac1f03aad4ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:27.478691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc57e12f-213c-4138-9df1-ac1f03aad4ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:27.479373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc57e12f-213c-4138-9df1-ac1f03aad4ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:27.480337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc57e12f-213c-4138-9df1-ac1f03aad4ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:27.481764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc57e12f-213c-4138-9df1-ac1f03aad4ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:27.482593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc57e12f-213c-4138-9df1-ac1f03aad4ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:27.872902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cc57e12f-213c-4138-9df1-ac1f03aad4ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:27.881807 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cc57e12f-213c-4138-9df1-ac1f03aad4ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.416174 Oct 04 21:22:27.882476 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1806/3603] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:27 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:27.917455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1922b53c-25f4-42f8-ba27-3ab39d8eab3e tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:27.924198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1922b53c-25f4-42f8-ba27-3ab39d8eab3e tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:27.938052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1922b53c-25f4-42f8-ba27-3ab39d8eab3e tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:27.941444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1922b53c-25f4-42f8-ba27-3ab39d8eab3e tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:27.942066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1922b53c-25f4-42f8-ba27-3ab39d8eab3e tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:27.942713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1922b53c-25f4-42f8-ba27-3ab39d8eab3e tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:27.943183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1922b53c-25f4-42f8-ba27-3ab39d8eab3e tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:27.952775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1922b53c-25f4-42f8-ba27-3ab39d8eab3e tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:28.193317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1922b53c-25f4-42f8-ba27-3ab39d8eab3e tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:28.208454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1922b53c-25f4-42f8-ba27-3ab39d8eab3e tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:28.229581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1922b53c-25f4-42f8-ba27-3ab39d8eab3e tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:28.229581 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1922b53c-25f4-42f8-ba27-3ab39d8eab3e tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1372 microversion: 2.57 time: 0.316282 Oct 04 21:22:28.229581 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1807/3604] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:27 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1372 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:28.244506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-90fbadcb-0bda-488e-b82b-8818cb37f4bc req-a7b41ad6-7727-4d25-a35e-3651b2bb356a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4947dfca-605d-4a8f-8ad0-362c13680ab4", "name": "network-vif-unplugged", "status": "completed", "tag": "980665fd-e5bf-42ba-85c6-645ed80a8b3b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:28.294030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-90fbadcb-0bda-488e-b82b-8818cb37f4bc req-a7b41ad6-7727-4d25-a35e-3651b2bb356a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:28.294030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-90fbadcb-0bda-488e-b82b-8818cb37f4bc req-a7b41ad6-7727-4d25-a35e-3651b2bb356a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:28.294030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-90fbadcb-0bda-488e-b82b-8818cb37f4bc req-a7b41ad6-7727-4d25-a35e-3651b2bb356a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:28.304047 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-90fbadcb-0bda-488e-b82b-8818cb37f4bc req-a7b41ad6-7727-4d25-a35e-3651b2bb356a service nova] Creating event network-vif-unplugged:980665fd-e5bf-42ba-85c6-645ed80a8b3b for instance 4947dfca-605d-4a8f-8ad0-362c13680ab4 on n-h2-860282-1 Oct 04 21:22:28.309399 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-90fbadcb-0bda-488e-b82b-8818cb37f4bc req-a7b41ad6-7727-4d25-a35e-3651b2bb356a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071137 Oct 04 21:22:28.310111 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1808/3605] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:28.498593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5330320f-85ce-4b8e-a39d-32b844cd83ca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:28.501752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5330320f-85ce-4b8e-a39d-32b844cd83ca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:28.521049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5330320f-85ce-4b8e-a39d-32b844cd83ca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:28.521801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5330320f-85ce-4b8e-a39d-32b844cd83ca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:28.522313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5330320f-85ce-4b8e-a39d-32b844cd83ca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:28.523095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5330320f-85ce-4b8e-a39d-32b844cd83ca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:28.523729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5330320f-85ce-4b8e-a39d-32b844cd83ca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:28.524499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5330320f-85ce-4b8e-a39d-32b844cd83ca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:28.583286 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-671600bd-2b94-47df-b9cb-cc53d2dc5062 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "DELETE /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf" status: 204 len: 0 microversion: 2.1 time: 1.851653 Oct 04 21:22:28.589651 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1798/3606] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:26 2022] DELETE /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf => generated 0 bytes in 1854 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:22:28.600200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-40fa8f8d-4edb-4923-a9d6-2244f877fb43 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b454f70>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:28.642089 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-40fa8f8d-4edb-4923-a9d6-2244f877fb43 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] HTTP exception thrown: Image not found. Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-40fa8f8d-4edb-4923-a9d6-2244f877fb43 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Request method failure captured: Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf HTTP/1.1 Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKPmY9oNTaMMPwARH5HODxiuXjPlgpComWqPIzNp4YpQK-Z4gqyZkdmxkCD3DPa1-2jd8Drvfl6qeW296PaW0_u4A2dsZfCXBgkfMKlvC8p3W_vepwNtoC0HY-0mPqMaZA1XWJ2EDUh5LfJAbH_L6lo9JytnYylA6ptLW26b9ncUXvU Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7d76b499bb9344a5b3cb93c4cbc0a51c Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesOneServerTestJSON-156626631 Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7d76b499bb9344a5b3cb93c4cbc0a51c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7d76b499bb9344a5b3cb93c4cbc0a51c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7d76b499bb9344a5b3cb93c4cbc0a51c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7d76b499bb9344a5b3cb93c4cbc0a51c"}]}] Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesOneServerTestJSON-156626631 Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7d76b499bb9344a5b3cb93c4cbc0a51c Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-156626631 Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesOneServerTestJSON-156626631-project Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 700a67b5993d48a59a373e9535688793 Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesOneServerTestJSON-156626631-project Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: exception: Image not found. Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '079699b7-b6ad-4f83-942f-bdc208d953bf'} Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 079699b7-b6ad-4f83-942f-bdc208d953bf Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 21:22:28.644247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 079699b7-b6ad-4f83-942f-bdc208d953bf could not be found. Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-40fa8f8d-4edb-4923-a9d6-2244f877fb43 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Returning 404 to user: Image not found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:28.655632 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-40fa8f8d-4edb-4923-a9d6-2244f877fb43 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf" status: 404 len: 62 microversion: 2.1 time: 0.054314 Oct 04 21:22:28.667759 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1799/3607] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:28 2022] GET /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:22:28.674399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9e9ed51d-6fc5-479e-bd08-d83ecfd7d21b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-650841004"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:28.677245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9e9ed51d-6fc5-479e-bd08-d83ecfd7d21b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:28.684824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e9ed51d-6fc5-479e-bd08-d83ecfd7d21b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:28.685328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e9ed51d-6fc5-479e-bd08-d83ecfd7d21b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:28.685867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e9ed51d-6fc5-479e-bd08-d83ecfd7d21b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:28.686878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e9ed51d-6fc5-479e-bd08-d83ecfd7d21b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:28.687769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e9ed51d-6fc5-479e-bd08-d83ecfd7d21b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:28.688349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e9ed51d-6fc5-479e-bd08-d83ecfd7d21b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:29.015164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5330320f-85ce-4b8e-a39d-32b844cd83ca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:29.023854 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5330320f-85ce-4b8e-a39d-32b844cd83ca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1314 microversion: 2.1 time: 0.534567 Oct 04 21:22:29.024696 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1809/3608] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:28 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:29.031589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5d2eae8f-4655-4093-90b6-e79dd3ba9670 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:29.038500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5d2eae8f-4655-4093-90b6-e79dd3ba9670 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:29.038500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d2eae8f-4655-4093-90b6-e79dd3ba9670 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:29.039237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d2eae8f-4655-4093-90b6-e79dd3ba9670 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:29.039330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d2eae8f-4655-4093-90b6-e79dd3ba9670 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:29.040033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d2eae8f-4655-4093-90b6-e79dd3ba9670 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:29.040489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d2eae8f-4655-4093-90b6-e79dd3ba9670 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:29.040933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d2eae8f-4655-4093-90b6-e79dd3ba9670 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:29.207337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5d2eae8f-4655-4093-90b6-e79dd3ba9670 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:29.215413 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5d2eae8f-4655-4093-90b6-e79dd3ba9670 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.189238 Oct 04 21:22:29.217444 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1810/3609] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:29 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:29.252022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d4efb415-2301-4bab-9a51-fc974db27897 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:29.252656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d4efb415-2301-4bab-9a51-fc974db27897 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:29.261177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4efb415-2301-4bab-9a51-fc974db27897 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:29.261682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4efb415-2301-4bab-9a51-fc974db27897 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:29.262130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4efb415-2301-4bab-9a51-fc974db27897 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:29.263842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4efb415-2301-4bab-9a51-fc974db27897 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:29.264600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4efb415-2301-4bab-9a51-fc974db27897 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:29.265122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4efb415-2301-4bab-9a51-fc974db27897 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:29.349195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d4efb415-2301-4bab-9a51-fc974db27897 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:29.359728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d4efb415-2301-4bab-9a51-fc974db27897 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:29.361197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d4efb415-2301-4bab-9a51-fc974db27897 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:29.362443 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d4efb415-2301-4bab-9a51-fc974db27897 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1372 microversion: 2.57 time: 0.114289 Oct 04 21:22:29.363025 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1811/3610] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:29 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1372 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:29.380543 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9e9ed51d-6fc5-479e-bd08-d83ecfd7d21b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "POST /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4/action" status: 202 len: 0 microversion: 2.1 time: 0.715842 Oct 04 21:22:29.381550 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1800/3611] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:22:28 2022] POST /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4/action => generated 0 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 21:22:29.398384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-138f7948-4c6f-423d-af7e-7aa690e5e364 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f5790604550>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:29.453896 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-138f7948-4c6f-423d-af7e-7aa690e5e364 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.059398 Oct 04 21:22:29.454741 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1812/3612] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:29 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:29.768249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-01438c28-800a-482e-9a3e-4569b2067a7d req-44bb196e-4bec-4608-871c-7461c396fad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5168fa4-3950-4c8b-8950-903b3231b79e", "tag": "a40fc885-ec8e-417f-9a36-6776760c4c02"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:29.789256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-01438c28-800a-482e-9a3e-4569b2067a7d req-44bb196e-4bec-4608-871c-7461c396fad1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:29.789985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-01438c28-800a-482e-9a3e-4569b2067a7d req-44bb196e-4bec-4608-871c-7461c396fad1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:29.790872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-01438c28-800a-482e-9a3e-4569b2067a7d req-44bb196e-4bec-4608-871c-7461c396fad1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:29.813838 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-01438c28-800a-482e-9a3e-4569b2067a7d req-44bb196e-4bec-4608-871c-7461c396fad1 service nova] Creating event network-changed:a40fc885-ec8e-417f-9a36-6776760c4c02 for instance d5168fa4-3950-4c8b-8950-903b3231b79e on n-h2-860282-1 Oct 04 21:22:29.822030 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-01438c28-800a-482e-9a3e-4569b2067a7d req-44bb196e-4bec-4608-871c-7461c396fad1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063192 Oct 04 21:22:29.826018 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1801/3613] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:30.050529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-16f1ff1c-fdcc-435f-9cd1-9d6e816f529e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:30.051288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-16f1ff1c-fdcc-435f-9cd1-9d6e816f529e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:30.062242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16f1ff1c-fdcc-435f-9cd1-9d6e816f529e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:30.062853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16f1ff1c-fdcc-435f-9cd1-9d6e816f529e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:30.063397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16f1ff1c-fdcc-435f-9cd1-9d6e816f529e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:30.064221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16f1ff1c-fdcc-435f-9cd1-9d6e816f529e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:30.064782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16f1ff1c-fdcc-435f-9cd1-9d6e816f529e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:30.065263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16f1ff1c-fdcc-435f-9cd1-9d6e816f529e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:30.247335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ed8223ad-816a-4050-9157-c3f0cbebd159 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:30.248288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ed8223ad-816a-4050-9157-c3f0cbebd159 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:30.248591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-16f1ff1c-fdcc-435f-9cd1-9d6e816f529e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:30.254574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed8223ad-816a-4050-9157-c3f0cbebd159 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:30.255065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed8223ad-816a-4050-9157-c3f0cbebd159 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:30.255503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed8223ad-816a-4050-9157-c3f0cbebd159 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:30.256409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed8223ad-816a-4050-9157-c3f0cbebd159 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:30.256863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed8223ad-816a-4050-9157-c3f0cbebd159 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:30.257121 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-16f1ff1c-fdcc-435f-9cd1-9d6e816f529e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1314 microversion: 2.1 time: 0.212219 Oct 04 21:22:30.257290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed8223ad-816a-4050-9157-c3f0cbebd159 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:30.257746 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1813/3614] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:30 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:30.389169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-17f8ba28-4937-4183-b532-c4fb4c616d85 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:30.389939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-17f8ba28-4937-4183-b532-c4fb4c616d85 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:30.393449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ed8223ad-816a-4050-9157-c3f0cbebd159 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:30.397021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f8ba28-4937-4183-b532-c4fb4c616d85 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:30.397607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f8ba28-4937-4183-b532-c4fb4c616d85 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:30.398224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f8ba28-4937-4183-b532-c4fb4c616d85 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:30.399209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f8ba28-4937-4183-b532-c4fb4c616d85 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:30.399867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f8ba28-4937-4183-b532-c4fb4c616d85 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:30.400478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f8ba28-4937-4183-b532-c4fb4c616d85 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:30.404303 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ed8223ad-816a-4050-9157-c3f0cbebd159 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.161594 Oct 04 21:22:30.405070 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1802/3615] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:30 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:30.472470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5c30f032-b6fe-465e-bbaa-5e966db2dc72 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b485a60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:30.479690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-17f8ba28-4937-4183-b532-c4fb4c616d85 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:30.496182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-17f8ba28-4937-4183-b532-c4fb4c616d85 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:30.498601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-17f8ba28-4937-4183-b532-c4fb4c616d85 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:30.499952 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-17f8ba28-4937-4183-b532-c4fb4c616d85 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1357 microversion: 2.57 time: 0.115562 Oct 04 21:22:30.501744 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1814/3616] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:30 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1357 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:22:30.536539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d6975721-781e-4e4c-aae7-7732adc80564 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:30.537061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d6975721-781e-4e4c-aae7-7732adc80564 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:30.544519 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5c30f032-b6fe-465e-bbaa-5e966db2dc72 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.077061 Oct 04 21:22:30.548655 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1803/3617] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:30 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:30.549292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6975721-781e-4e4c-aae7-7732adc80564 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:30.549840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6975721-781e-4e4c-aae7-7732adc80564 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:30.550295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6975721-781e-4e4c-aae7-7732adc80564 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:30.551017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6975721-781e-4e4c-aae7-7732adc80564 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:30.551482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6975721-781e-4e4c-aae7-7732adc80564 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:30.551913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6975721-781e-4e4c-aae7-7732adc80564 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:30.584076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d6975721-781e-4e4c-aae7-7732adc80564 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:22:30.626834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:31.096985 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d6975721-781e-4e4c-aae7-7732adc80564 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 204 len: 0 microversion: 2.57 time: 0.569146 Oct 04 21:22:31.097674 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1815/3618] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:22:30 2022] DELETE /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:22:31.107024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-250d76ae-97d7-42bb-9cc7-af70c64823c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:31.107662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-250d76ae-97d7-42bb-9cc7-af70c64823c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:31.115173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-250d76ae-97d7-42bb-9cc7-af70c64823c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:31.115660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-250d76ae-97d7-42bb-9cc7-af70c64823c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:31.116122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-250d76ae-97d7-42bb-9cc7-af70c64823c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:31.116903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-250d76ae-97d7-42bb-9cc7-af70c64823c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:31.117353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-250d76ae-97d7-42bb-9cc7-af70c64823c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:31.117808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-250d76ae-97d7-42bb-9cc7-af70c64823c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:31.192886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-250d76ae-97d7-42bb-9cc7-af70c64823c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:31.206041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-250d76ae-97d7-42bb-9cc7-af70c64823c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:31.206041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-250d76ae-97d7-42bb-9cc7-af70c64823c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:31.206041 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-250d76ae-97d7-42bb-9cc7-af70c64823c6 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1363 microversion: 2.57 time: 0.102485 Oct 04 21:22:31.206041 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1804/3619] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:31 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1363 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:31.285674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-526b368c-c3f5-4929-a7ef-bd2afb2fc6dd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:31.286512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-526b368c-c3f5-4929-a7ef-bd2afb2fc6dd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:31.292454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-526b368c-c3f5-4929-a7ef-bd2afb2fc6dd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:31.292968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-526b368c-c3f5-4929-a7ef-bd2afb2fc6dd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:31.293484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-526b368c-c3f5-4929-a7ef-bd2afb2fc6dd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:31.294210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-526b368c-c3f5-4929-a7ef-bd2afb2fc6dd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:31.294669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-526b368c-c3f5-4929-a7ef-bd2afb2fc6dd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:31.295095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-526b368c-c3f5-4929-a7ef-bd2afb2fc6dd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:31.430570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9a16b6ed-3409-45d7-919d-b71ccd623673 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:31.431391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9a16b6ed-3409-45d7-919d-b71ccd623673 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:31.440103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a16b6ed-3409-45d7-919d-b71ccd623673 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:31.440614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a16b6ed-3409-45d7-919d-b71ccd623673 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:31.441464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a16b6ed-3409-45d7-919d-b71ccd623673 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:31.441881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a16b6ed-3409-45d7-919d-b71ccd623673 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:31.442315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a16b6ed-3409-45d7-919d-b71ccd623673 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:31.443262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-526b368c-c3f5-4929-a7ef-bd2afb2fc6dd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:31.443693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a16b6ed-3409-45d7-919d-b71ccd623673 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:31.453170 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-526b368c-c3f5-4929-a7ef-bd2afb2fc6dd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1314 microversion: 2.1 time: 0.172654 Oct 04 21:22:31.457969 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1816/3620] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:31 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:31.563992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-81862c8c-ee6d-429f-bf05-b595af88db4f tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f5790079d30>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:31.608206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9a16b6ed-3409-45d7-919d-b71ccd623673 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:31.618312 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9a16b6ed-3409-45d7-919d-b71ccd623673 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.193662 Oct 04 21:22:31.620135 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1805/3621] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:31 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:31.632026 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-81862c8c-ee6d-429f-bf05-b595af88db4f tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.063358 Oct 04 21:22:31.632026 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1817/3622] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:31 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:32.230894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d06ba64e-e7aa-4e15-96e5-4a27aa755a9a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:32.231542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d06ba64e-e7aa-4e15-96e5-4a27aa755a9a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:32.238787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d06ba64e-e7aa-4e15-96e5-4a27aa755a9a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:32.239422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d06ba64e-e7aa-4e15-96e5-4a27aa755a9a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:32.240310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d06ba64e-e7aa-4e15-96e5-4a27aa755a9a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:32.241159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d06ba64e-e7aa-4e15-96e5-4a27aa755a9a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:32.241673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d06ba64e-e7aa-4e15-96e5-4a27aa755a9a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:32.243115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d06ba64e-e7aa-4e15-96e5-4a27aa755a9a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:32.320684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d06ba64e-e7aa-4e15-96e5-4a27aa755a9a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:32.332709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d06ba64e-e7aa-4e15-96e5-4a27aa755a9a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:32.334398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d06ba64e-e7aa-4e15-96e5-4a27aa755a9a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:32.335595 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d06ba64e-e7aa-4e15-96e5-4a27aa755a9a tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1363 microversion: 2.57 time: 0.108800 Oct 04 21:22:32.336375 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1806/3623] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:32 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1363 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:32.480165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-53e4ccbb-5edc-4fae-a029-63bbe7858ee2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:32.481300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-53e4ccbb-5edc-4fae-a029-63bbe7858ee2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:32.488240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53e4ccbb-5edc-4fae-a029-63bbe7858ee2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:32.488732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53e4ccbb-5edc-4fae-a029-63bbe7858ee2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:32.493513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53e4ccbb-5edc-4fae-a029-63bbe7858ee2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:32.493513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53e4ccbb-5edc-4fae-a029-63bbe7858ee2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:32.493513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53e4ccbb-5edc-4fae-a029-63bbe7858ee2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:32.493513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53e4ccbb-5edc-4fae-a029-63bbe7858ee2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:32.634894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:32.642591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7bd82fb4-c758-4782-a801-7ab3505ef40c tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b488d30>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:32.656609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-53e4ccbb-5edc-4fae-a029-63bbe7858ee2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:32.675569 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-53e4ccbb-5edc-4fae-a029-63bbe7858ee2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1314 microversion: 2.1 time: 0.197340 Oct 04 21:22:32.676580 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1818/3624] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:32 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:32.686059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-16f2f8c0-aee7-4169-913c-ebfbdbb3b087 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:32.686708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-16f2f8c0-aee7-4169-913c-ebfbdbb3b087 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:32.705839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16f2f8c0-aee7-4169-913c-ebfbdbb3b087 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:32.714557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16f2f8c0-aee7-4169-913c-ebfbdbb3b087 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:32.714557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16f2f8c0-aee7-4169-913c-ebfbdbb3b087 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:32.714557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16f2f8c0-aee7-4169-913c-ebfbdbb3b087 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:32.714557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16f2f8c0-aee7-4169-913c-ebfbdbb3b087 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:32.714557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16f2f8c0-aee7-4169-913c-ebfbdbb3b087 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:32.823859 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7bd82fb4-c758-4782-a801-7ab3505ef40c tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.184026 Oct 04 21:22:32.823859 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1807/3625] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:32 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:32.867639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-16f2f8c0-aee7-4169-913c-ebfbdbb3b087 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:32.875026 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-16f2f8c0-aee7-4169-913c-ebfbdbb3b087 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.197295 Oct 04 21:22:32.875624 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1819/3626] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:32 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:33.364735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-64f011a1-c37f-446d-ab96-3eceea82b790 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:33.365329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-64f011a1-c37f-446d-ab96-3eceea82b790 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:33.375193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64f011a1-c37f-446d-ab96-3eceea82b790 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:33.375688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64f011a1-c37f-446d-ab96-3eceea82b790 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:33.376128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64f011a1-c37f-446d-ab96-3eceea82b790 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:33.376837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64f011a1-c37f-446d-ab96-3eceea82b790 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:33.377286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64f011a1-c37f-446d-ab96-3eceea82b790 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:33.377733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64f011a1-c37f-446d-ab96-3eceea82b790 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:33.418923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64f011a1-c37f-446d-ab96-3eceea82b790 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:33.420565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64f011a1-c37f-446d-ab96-3eceea82b790 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:33.421121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64f011a1-c37f-446d-ab96-3eceea82b790 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:33.421620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-64f011a1-c37f-446d-ab96-3eceea82b790 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lazy-loading 'fault' on Instance uuid 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:22:33.480582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-64f011a1-c37f-446d-ab96-3eceea82b790 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:33.489135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-64f011a1-c37f-446d-ab96-3eceea82b790 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:33.490627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-64f011a1-c37f-446d-ab96-3eceea82b790 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aa3f444b0d3472f82a6aa4de7b33bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a3ef6c17064c7ebba6e7a4b7040a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:33.492628 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-64f011a1-c37f-446d-ab96-3eceea82b790 tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 200 len: 1368 microversion: 2.57 time: 0.132628 Oct 04 21:22:33.493215 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1808/3627] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:33 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 1368 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:33.700202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4bec0661-cb54-4516-82c5-b075b7839d66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:33.701550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4bec0661-cb54-4516-82c5-b075b7839d66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:33.706826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:33.709532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4bec0661-cb54-4516-82c5-b075b7839d66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:33.710223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4bec0661-cb54-4516-82c5-b075b7839d66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:33.710673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4bec0661-cb54-4516-82c5-b075b7839d66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:33.711386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4bec0661-cb54-4516-82c5-b075b7839d66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:33.711853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4bec0661-cb54-4516-82c5-b075b7839d66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:33.712372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4bec0661-cb54-4516-82c5-b075b7839d66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:33.837962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-39e93841-f654-407b-a281-00d29319a221 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b488940>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:33.908926 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-39e93841-f654-407b-a281-00d29319a221 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.074760 Oct 04 21:22:33.912544 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1809/3628] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:33 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:33.921114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c24b444f-25d2-4a58-bc64-a00a0c5f7c68 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:33.921777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c24b444f-25d2-4a58-bc64-a00a0c5f7c68 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:33.941951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c24b444f-25d2-4a58-bc64-a00a0c5f7c68 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:33.942561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c24b444f-25d2-4a58-bc64-a00a0c5f7c68 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:33.943087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c24b444f-25d2-4a58-bc64-a00a0c5f7c68 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:33.945571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c24b444f-25d2-4a58-bc64-a00a0c5f7c68 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:33.946301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c24b444f-25d2-4a58-bc64-a00a0c5f7c68 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:33.947957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c24b444f-25d2-4a58-bc64-a00a0c5f7c68 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:33.960041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4bec0661-cb54-4516-82c5-b075b7839d66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:33.973088 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4bec0661-cb54-4516-82c5-b075b7839d66 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1314 microversion: 2.1 time: 0.276210 Oct 04 21:22:33.974837 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1820/3629] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:33 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:34.118242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c24b444f-25d2-4a58-bc64-a00a0c5f7c68 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:34.129060 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c24b444f-25d2-4a58-bc64-a00a0c5f7c68 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.217806 Oct 04 21:22:34.129858 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1810/3630] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:33 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:34.546286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7d5cafa7-ca17-4b05-821a-8139a000a61f tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:34.549170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7d5cafa7-ca17-4b05-821a-8139a000a61f tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] [instance: 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:34.557263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d5cafa7-ca17-4b05-821a-8139a000a61f tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:34.557940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d5cafa7-ca17-4b05-821a-8139a000a61f tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:34.558678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d5cafa7-ca17-4b05-821a-8139a000a61f tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:34.562293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d5cafa7-ca17-4b05-821a-8139a000a61f tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:34.562789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d5cafa7-ca17-4b05-821a-8139a000a61f tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:34.563238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d5cafa7-ca17-4b05-821a-8139a000a61f tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:34.579481 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-7d5cafa7-ca17-4b05-821a-8139a000a61f tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] HTTP exception thrown: Instance 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb could not be found. Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7d5cafa7-ca17-4b05-821a-8139a000a61f tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Request method failure captured: Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb HTTP/1.1 Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKPtN_l5cQRKdwsHvb_cgcYWor_oqgc6Zn5Qjdg1drPlKbAmqlBNyyKvD2i-gJCqNpUWtCD83aUCSgZjOTaL4sOVLVINatRLfVA2Ghr_b2zFmRARRZztVBn38aniWGQH8QdeAlsrkhl8SwxonwGtbbdCesiVYGYnTC2H-GDXLd4bbFo Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.57 Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: e2a3ef6c17064c7ebba6e7a4b7040a56 Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerShowV257Test-941327349 Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2a3ef6c17064c7ebba6e7a4b7040a56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e2a3ef6c17064c7ebba6e7a4b7040a56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e2a3ef6c17064c7ebba6e7a4b7040a56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2a3ef6c17064c7ebba6e7a4b7040a56"}]}] Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerShowV257Test-941327349 Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: e2a3ef6c17064c7ebba6e7a4b7040a56 Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerShowV257Test-941327349 Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerShowV257Test-941327349-project Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 5aa3f444b0d3472f82a6aa4de7b33bf7 Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerShowV257Test-941327349-project Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb could not be found. Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb'} Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb could not be found. Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb could not be found. Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:34.581521 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:34.586938 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:34.586938 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:34.586938 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:34.586938 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:34.586938 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:34.586938 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb could not be found. Oct 04 21:22:34.586938 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:34.586938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7d5cafa7-ca17-4b05-821a-8139a000a61f tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] Returning 404 to user: Instance 4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:34.587648 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7d5cafa7-ca17-4b05-821a-8139a000a61f tempest-ServerShowV257Test-941327349 tempest-ServerShowV257Test-941327349-project] 10.222.0.30 "GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb" status: 404 len: 111 microversion: 2.57 time: 0.060288 Oct 04 21:22:34.591866 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1821/3631] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:34 2022] GET /compute/v2.1/servers/4e2c6a98-4d6d-489c-a8a7-fdae9d6aa5bb => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:22:34.928115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-76b81103-fb0e-4cd4-9977-03f7ca7fffc0 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b45df70>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:35.005957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7910dded-c618-4421-9df9-1ba7709f1395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:35.007303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7910dded-c618-4421-9df9-1ba7709f1395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:35.009161 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-76b81103-fb0e-4cd4-9977-03f7ca7fffc0 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.086433 Oct 04 21:22:35.027024 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1811/3632] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:34 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:35.027151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7910dded-c618-4421-9df9-1ba7709f1395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:35.027151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7910dded-c618-4421-9df9-1ba7709f1395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:35.031014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7910dded-c618-4421-9df9-1ba7709f1395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:35.031884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7910dded-c618-4421-9df9-1ba7709f1395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:35.032377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7910dded-c618-4421-9df9-1ba7709f1395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:35.032853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7910dded-c618-4421-9df9-1ba7709f1395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:35.153877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1b236eb3-ac85-4aa3-acb4-bdea90329fdc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:35.154666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1b236eb3-ac85-4aa3-acb4-bdea90329fdc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:35.164472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b236eb3-ac85-4aa3-acb4-bdea90329fdc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:35.167165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b236eb3-ac85-4aa3-acb4-bdea90329fdc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:35.167630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b236eb3-ac85-4aa3-acb4-bdea90329fdc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:35.168376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b236eb3-ac85-4aa3-acb4-bdea90329fdc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:35.170973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b236eb3-ac85-4aa3-acb4-bdea90329fdc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:35.171690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b236eb3-ac85-4aa3-acb4-bdea90329fdc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:35.238156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7910dded-c618-4421-9df9-1ba7709f1395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:35.254615 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7910dded-c618-4421-9df9-1ba7709f1395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1314 microversion: 2.1 time: 0.257326 Oct 04 21:22:35.255042 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1822/3633] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:34 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:35.436671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1b236eb3-ac85-4aa3-acb4-bdea90329fdc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:35.448118 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1b236eb3-ac85-4aa3-acb4-bdea90329fdc tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.298345 Oct 04 21:22:35.448840 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1812/3634] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:35 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:36.033791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-174bab20-1f6d-4afb-b097-2a3c40081ecd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b90df70>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:36.109986 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-174bab20-1f6d-4afb-b097-2a3c40081ecd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.081527 Oct 04 21:22:36.111208 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1823/3635] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:36 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:36.248488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-974d1e8d-ad7a-401b-91ce-6db489df439f req-ec9d2c0b-da0b-4ee2-ab0a-9a3c114ec76b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4947dfca-605d-4a8f-8ad0-362c13680ab4", "name": "network-vif-plugged", "status": "completed", "tag": "980665fd-e5bf-42ba-85c6-645ed80a8b3b"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:36.267454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-974d1e8d-ad7a-401b-91ce-6db489df439f req-ec9d2c0b-da0b-4ee2-ab0a-9a3c114ec76b service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:36.270516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-974d1e8d-ad7a-401b-91ce-6db489df439f req-ec9d2c0b-da0b-4ee2-ab0a-9a3c114ec76b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:36.270516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-974d1e8d-ad7a-401b-91ce-6db489df439f req-ec9d2c0b-da0b-4ee2-ab0a-9a3c114ec76b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:36.279038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7de71f4a-565c-43ce-a472-38615814a0d0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:36.280079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7de71f4a-565c-43ce-a472-38615814a0d0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:36.297727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7de71f4a-565c-43ce-a472-38615814a0d0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:36.298842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7de71f4a-565c-43ce-a472-38615814a0d0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:36.300197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7de71f4a-565c-43ce-a472-38615814a0d0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:36.302366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7de71f4a-565c-43ce-a472-38615814a0d0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:36.303732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7de71f4a-565c-43ce-a472-38615814a0d0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:36.304936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7de71f4a-565c-43ce-a472-38615814a0d0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:36.311773 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-974d1e8d-ad7a-401b-91ce-6db489df439f req-ec9d2c0b-da0b-4ee2-ab0a-9a3c114ec76b service nova] Creating event network-vif-plugged:980665fd-e5bf-42ba-85c6-645ed80a8b3b for instance 4947dfca-605d-4a8f-8ad0-362c13680ab4 on n-h2-860282-1 Oct 04 21:22:36.323316 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-974d1e8d-ad7a-401b-91ce-6db489df439f req-ec9d2c0b-da0b-4ee2-ab0a-9a3c114ec76b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079251 Oct 04 21:22:36.326687 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1813/3636] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:36.480515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-76f6e023-7c48-4521-9d53-1d8776c9b9ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:36.482860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-76f6e023-7c48-4521-9d53-1d8776c9b9ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:36.510300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=86 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:36.512202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76f6e023-7c48-4521-9d53-1d8776c9b9ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:36.513866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76f6e023-7c48-4521-9d53-1d8776c9b9ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:36.514418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76f6e023-7c48-4521-9d53-1d8776c9b9ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:36.515163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76f6e023-7c48-4521-9d53-1d8776c9b9ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:36.515687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76f6e023-7c48-4521-9d53-1d8776c9b9ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:36.516181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76f6e023-7c48-4521-9d53-1d8776c9b9ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:36.696710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7de71f4a-565c-43ce-a472-38615814a0d0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:36.702202 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7de71f4a-565c-43ce-a472-38615814a0d0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1314 microversion: 2.1 time: 0.428501 Oct 04 21:22:36.707386 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1824/3637] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:36 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:36.805037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-76f6e023-7c48-4521-9d53-1d8776c9b9ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:36.817243 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-76f6e023-7c48-4521-9d53-1d8776c9b9ed tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.341846 Oct 04 21:22:36.819590 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1814/3638] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:36 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:37.127251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a8786262-590c-4d92-82d5-d0c5faf780d5 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f57904ed700>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:37.196680 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a8786262-590c-4d92-82d5-d0c5faf780d5 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.073389 Oct 04 21:22:37.196680 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1825/3639] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:37 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:37.735918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4ee7f193-6687-4529-bdd8-a0d089be322c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:37.740816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4ee7f193-6687-4529-bdd8-a0d089be322c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:37.761668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ee7f193-6687-4529-bdd8-a0d089be322c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:37.762461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ee7f193-6687-4529-bdd8-a0d089be322c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:37.763135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ee7f193-6687-4529-bdd8-a0d089be322c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:37.766570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ee7f193-6687-4529-bdd8-a0d089be322c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:37.767067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ee7f193-6687-4529-bdd8-a0d089be322c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:37.767515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ee7f193-6687-4529-bdd8-a0d089be322c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:37.846011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-57b2c64c-54d7-4c0b-a1bd-06d134b4e1af tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:37.862037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-57b2c64c-54d7-4c0b-a1bd-06d134b4e1af tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:37.866950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57b2c64c-54d7-4c0b-a1bd-06d134b4e1af tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:37.867321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57b2c64c-54d7-4c0b-a1bd-06d134b4e1af tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:37.868352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57b2c64c-54d7-4c0b-a1bd-06d134b4e1af tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:37.869469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57b2c64c-54d7-4c0b-a1bd-06d134b4e1af tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:37.870250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57b2c64c-54d7-4c0b-a1bd-06d134b4e1af tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:37.871282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57b2c64c-54d7-4c0b-a1bd-06d134b4e1af tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:38.102841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4ee7f193-6687-4529-bdd8-a0d089be322c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:38.111993 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4ee7f193-6687-4529-bdd8-a0d089be322c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1314 microversion: 2.1 time: 0.384181 Oct 04 21:22:38.125804 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1815/3640] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:37 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:38.296807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-57b2c64c-54d7-4c0b-a1bd-06d134b4e1af tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:38.317650 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-57b2c64c-54d7-4c0b-a1bd-06d134b4e1af tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.469388 Oct 04 21:22:38.319376 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1826/3641] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:37 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:38.336039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-012bb6e3-1cfe-40fd-80c5-e5de29892dd2 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f57905b4ee0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:38.447623 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-012bb6e3-1cfe-40fd-80c5-e5de29892dd2 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.118404 Oct 04 21:22:38.449991 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1827/3642] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:38 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:38.493137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-00038332-a8c4-4ae9-959e-10c13b73bc48 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:38.493890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-00038332-a8c4-4ae9-959e-10c13b73bc48 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:38.502030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00038332-a8c4-4ae9-959e-10c13b73bc48 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:38.502907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00038332-a8c4-4ae9-959e-10c13b73bc48 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:38.503604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00038332-a8c4-4ae9-959e-10c13b73bc48 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:38.504581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00038332-a8c4-4ae9-959e-10c13b73bc48 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:38.505299 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00038332-a8c4-4ae9-959e-10c13b73bc48 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:38.506063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00038332-a8c4-4ae9-959e-10c13b73bc48 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:38.986849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-323ec782-dccb-4455-8d0d-676a0e45dd44 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Action: 'create', calling method: .version_select at 0x7f579455c430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2080626364"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:39.074729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-00038332-a8c4-4ae9-959e-10c13b73bc48 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:39.096782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-00038332-a8c4-4ae9-959e-10c13b73bc48 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:39.107737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-00038332-a8c4-4ae9-959e-10c13b73bc48 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:39.114559 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-00038332-a8c4-4ae9-959e-10c13b73bc48 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 2955 microversion: 2.32 time: 0.986948 Oct 04 21:22:39.115747 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1816/3643] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:38 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 2955 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:39.139891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f5ee36ba-ce37-486a-b492-6fff52d33aca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:39.140565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f5ee36ba-ce37-486a-b492-6fff52d33aca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:39.146838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5ee36ba-ce37-486a-b492-6fff52d33aca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:39.147526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5ee36ba-ce37-486a-b492-6fff52d33aca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:39.148225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5ee36ba-ce37-486a-b492-6fff52d33aca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:39.148866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5ee36ba-ce37-486a-b492-6fff52d33aca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:39.149322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5ee36ba-ce37-486a-b492-6fff52d33aca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:39.149829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5ee36ba-ce37-486a-b492-6fff52d33aca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:39.178692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:39.462776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f5ee36ba-ce37-486a-b492-6fff52d33aca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:39.493576 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f5ee36ba-ce37-486a-b492-6fff52d33aca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1314 microversion: 2.1 time: 0.339887 Oct 04 21:22:39.493576 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1817/3644] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:39 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:39.507408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4e792a28-c3c0-4c8b-8ab6-77a69efbf527 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:39.507918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4e792a28-c3c0-4c8b-8ab6-77a69efbf527 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:39.516121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e792a28-c3c0-4c8b-8ab6-77a69efbf527 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:39.516630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e792a28-c3c0-4c8b-8ab6-77a69efbf527 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:39.517076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e792a28-c3c0-4c8b-8ab6-77a69efbf527 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:39.519517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e792a28-c3c0-4c8b-8ab6-77a69efbf527 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:39.520087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e792a28-c3c0-4c8b-8ab6-77a69efbf527 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:39.520693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e792a28-c3c0-4c8b-8ab6-77a69efbf527 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:39.806726 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4e792a28-c3c0-4c8b-8ab6-77a69efbf527 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.330554 Oct 04 21:22:39.807330 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1818/3645] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Oct 4 21:22:39 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0/os-interface => generated 1833 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:39.816523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fcc2a27a-2793-44a9-98c7-20f28c736793 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:39.818120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fcc2a27a-2793-44a9-98c7-20f28c736793 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:39.827455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcc2a27a-2793-44a9-98c7-20f28c736793 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:39.828236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcc2a27a-2793-44a9-98c7-20f28c736793 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:39.829350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcc2a27a-2793-44a9-98c7-20f28c736793 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:39.830337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcc2a27a-2793-44a9-98c7-20f28c736793 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:39.832018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcc2a27a-2793-44a9-98c7-20f28c736793 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:39.832700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcc2a27a-2793-44a9-98c7-20f28c736793 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:40.236702 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-323ec782-dccb-4455-8d0d-676a0e45dd44 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.559231 Oct 04 21:22:40.238095 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1828/3646] 10.222.0.30 () {60 vars in 1155 bytes} [Tue Oct 4 21:22:38 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1561 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 21:22:40.251810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0e0f3047-061c-464e-b399-d7aeabc8a542 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f57904ed550>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:40.256966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fcc2a27a-2793-44a9-98c7-20f28c736793 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:40.312603 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fcc2a27a-2793-44a9-98c7-20f28c736793 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.503905 Oct 04 21:22:40.315941 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1819/3647] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:39 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:40.329952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5d67fb90-6c0f-4183-ba80-0960808bf1c1 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f578b485a60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:40.395858 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0e0f3047-061c-464e-b399-d7aeabc8a542 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.156375 Oct 04 21:22:40.397353 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1829/3648] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:40 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:40.486682 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5d67fb90-6c0f-4183-ba80-0960808bf1c1 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f" status: 200 len: 345 microversion: 2.1 time: 0.169590 Oct 04 21:22:40.487367 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1820/3649] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:22:40 2022] GET /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f => generated 345 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:40.504168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-40d2b0bd-c273-4aba-ad05-ec17f27e153c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:40.504972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-40d2b0bd-c273-4aba-ad05-ec17f27e153c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:40.518074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40d2b0bd-c273-4aba-ad05-ec17f27e153c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:40.519682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40d2b0bd-c273-4aba-ad05-ec17f27e153c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:40.520674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40d2b0bd-c273-4aba-ad05-ec17f27e153c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:40.521736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40d2b0bd-c273-4aba-ad05-ec17f27e153c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:40.524301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40d2b0bd-c273-4aba-ad05-ec17f27e153c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:40.524301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40d2b0bd-c273-4aba-ad05-ec17f27e153c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:41.055758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-40d2b0bd-c273-4aba-ad05-ec17f27e153c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:41.066267 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-40d2b0bd-c273-4aba-ad05-ec17f27e153c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1314 microversion: 2.1 time: 0.568315 Oct 04 21:22:41.081918 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1830/3650] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:40 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:41.365934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-77428a32-7094-4210-8137-8bcb2ee2a002 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:41.366556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-77428a32-7094-4210-8137-8bcb2ee2a002 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:41.392486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77428a32-7094-4210-8137-8bcb2ee2a002 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:41.392982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77428a32-7094-4210-8137-8bcb2ee2a002 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:41.393462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77428a32-7094-4210-8137-8bcb2ee2a002 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:41.400447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77428a32-7094-4210-8137-8bcb2ee2a002 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:41.400959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77428a32-7094-4210-8137-8bcb2ee2a002 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:41.401406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77428a32-7094-4210-8137-8bcb2ee2a002 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:41.414949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-275ae57e-ed86-4b26-b848-10601557e93d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f57906319d0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:41.810344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-77428a32-7094-4210-8137-8bcb2ee2a002 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:41.819771 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-77428a32-7094-4210-8137-8bcb2ee2a002 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.481548 Oct 04 21:22:41.840666 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1821/3651] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:41 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:41.845874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-198a24c9-d5eb-4a97-9ed0-cc802ea6d7f4 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f578b4e3dc0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:41.965926 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-198a24c9-d5eb-4a97-9ed0-cc802ea6d7f4 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f" status: 200 len: 345 microversion: 2.1 time: 0.122774 Oct 04 21:22:41.966526 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1822/3652] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:22:41 2022] GET /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f => generated 345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:41.991086 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-275ae57e-ed86-4b26-b848-10601557e93d tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.582484 Oct 04 21:22:41.991679 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1831/3653] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:41 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:42.090016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-25beb07d-7bdf-443d-96e4-8071d0821833 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:42.091415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-25beb07d-7bdf-443d-96e4-8071d0821833 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:42.121926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25beb07d-7bdf-443d-96e4-8071d0821833 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:42.123340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25beb07d-7bdf-443d-96e4-8071d0821833 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:42.123876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25beb07d-7bdf-443d-96e4-8071d0821833 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:42.124645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25beb07d-7bdf-443d-96e4-8071d0821833 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:42.125125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25beb07d-7bdf-443d-96e4-8071d0821833 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:42.125600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-25beb07d-7bdf-443d-96e4-8071d0821833 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:42.496604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7f703a72-9ade-4720-9def-e6d2b00c9ecf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1686809271", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "f54abd1e-a2a0-4f4b-b858-f3831f4d8295"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:42.635315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-25beb07d-7bdf-443d-96e4-8071d0821833 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:42.645966 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-25beb07d-7bdf-443d-96e4-8071d0821833 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1314 microversion: 2.1 time: 0.559206 Oct 04 21:22:42.658844 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1832/3654] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:42 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:42.851153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5af54f29-38d1-401a-969b-0b0284ade342 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:42.852067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5af54f29-38d1-401a-969b-0b0284ade342 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:42.853029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-7f703a72-9ade-4720-9def-e6d2b00c9ecf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] validate_networks() for [('f54abd1e-a2a0-4f4b-b858-f3831f4d8295', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:22:42.865973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5af54f29-38d1-401a-969b-0b0284ade342 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:42.867931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5af54f29-38d1-401a-969b-0b0284ade342 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:42.869708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5af54f29-38d1-401a-969b-0b0284ade342 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:42.875574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5af54f29-38d1-401a-969b-0b0284ade342 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:42.876459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5af54f29-38d1-401a-969b-0b0284ade342 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:42.878318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5af54f29-38d1-401a-969b-0b0284ade342 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:43.330681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5af54f29-38d1-401a-969b-0b0284ade342 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:43.349211 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5af54f29-38d1-401a-969b-0b0284ade342 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.504957 Oct 04 21:22:43.361448 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1833/3655] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:42 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:43.361448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1d0695b3-dd67-41d7-9e35-dc9b1140e939 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f578b9729d0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:43.483718 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1d0695b3-dd67-41d7-9e35-dc9b1140e939 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f" status: 200 len: 346 microversion: 2.1 time: 0.130104 Oct 04 21:22:43.483718 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1834/3656] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:22:43 2022] GET /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f => generated 346 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:43.493310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d97d2a05-9830-4ca5-8b20-2c916a3146c7 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f579459f040>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:43.848727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7f703a72-9ade-4720-9def-e6d2b00c9ecf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:22:43.850336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7f703a72-9ade-4720-9def-e6d2b00c9ecf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:22:43.852874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7f703a72-9ade-4720-9def-e6d2b00c9ecf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:22:43.853729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7f703a72-9ade-4720-9def-e6d2b00c9ecf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:22:43.854574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7f703a72-9ade-4720-9def-e6d2b00c9ecf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:22:43.880140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f703a72-9ade-4720-9def-e6d2b00c9ecf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:43.883060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f703a72-9ade-4720-9def-e6d2b00c9ecf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:43.885083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f703a72-9ade-4720-9def-e6d2b00c9ecf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:43.888295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f703a72-9ade-4720-9def-e6d2b00c9ecf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:43.892524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f703a72-9ade-4720-9def-e6d2b00c9ecf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:43.892524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f703a72-9ade-4720-9def-e6d2b00c9ecf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:43.907132 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d97d2a05-9830-4ca5-8b20-2c916a3146c7 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.423674 Oct 04 21:22:43.922837 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1835/3657] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:43 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:43.944225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7f703a72-9ade-4720-9def-e6d2b00c9ecf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Getting quotas for project 68c56e6603d14d9b8ad9c74a9df021c9. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:22:43.948898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-56043141-fb4d-4f36-a2bb-d1774f45364c tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Action: 'create', calling method: .version_select at 0x7f578b972310>, body: {"snapshot": {"volume_id": "71435a17-42fc-4344-a6dc-90a29a816f0f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-621877814"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:43.976366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7f703a72-9ade-4720-9def-e6d2b00c9ecf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Getting quotas for user 416e0c617ee34a19a7d6936b78c1d94d and project 68c56e6603d14d9b8ad9c74a9df021c9. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:22:44.032160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7f703a72-9ade-4720-9def-e6d2b00c9ecf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:22:44.035983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7f703a72-9ade-4720-9def-e6d2b00c9ecf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:22:44.355568 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7f703a72-9ade-4720-9def-e6d2b00c9ecf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.387807 Oct 04 21:22:44.356110 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1823/3658] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:22:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:22:44.373577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-da7d68a3-c95b-4886-b5ee-2ad60c63fa6b req-ef3089ae-faa0-43da-8cd5-1a37a9ef6685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5168fa4-3950-4c8b-8950-903b3231b79e", "name": "network-vif-plugged", "status": "completed", "tag": "a40fc885-ec8e-417f-9a36-6776760c4c02"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:44.413843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-da7d68a3-c95b-4886-b5ee-2ad60c63fa6b req-ef3089ae-faa0-43da-8cd5-1a37a9ef6685 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:44.415208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-da7d68a3-c95b-4886-b5ee-2ad60c63fa6b req-ef3089ae-faa0-43da-8cd5-1a37a9ef6685 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:44.415863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-da7d68a3-c95b-4886-b5ee-2ad60c63fa6b req-ef3089ae-faa0-43da-8cd5-1a37a9ef6685 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:44.435206 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-da7d68a3-c95b-4886-b5ee-2ad60c63fa6b req-ef3089ae-faa0-43da-8cd5-1a37a9ef6685 service nova] Creating event network-vif-plugged:a40fc885-ec8e-417f-9a36-6776760c4c02 for instance d5168fa4-3950-4c8b-8950-903b3231b79e on n-h2-860282-1 Oct 04 21:22:44.443116 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-da7d68a3-c95b-4886-b5ee-2ad60c63fa6b req-ef3089ae-faa0-43da-8cd5-1a37a9ef6685 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085040 Oct 04 21:22:44.444376 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1824/3659] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:44.500668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cb851d00-242b-4d90-85ac-2b3bc21cb628 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:44.502389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cb851d00-242b-4d90-85ac-2b3bc21cb628 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:44.562019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb851d00-242b-4d90-85ac-2b3bc21cb628 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:44.564721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb851d00-242b-4d90-85ac-2b3bc21cb628 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:44.565966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb851d00-242b-4d90-85ac-2b3bc21cb628 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:44.571215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb851d00-242b-4d90-85ac-2b3bc21cb628 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:44.572513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb851d00-242b-4d90-85ac-2b3bc21cb628 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:44.573203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb851d00-242b-4d90-85ac-2b3bc21cb628 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:44.782712 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-56043141-fb4d-4f36-a2bb-d1774f45364c tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.857079 Oct 04 21:22:44.783626 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1836/3660] 10.222.0.30 () {60 vars in 1162 bytes} [Tue Oct 4 21:22:43 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:44.797595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-96236049-043b-4dea-a839-f3726d54f9a4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:44.797595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-96236049-043b-4dea-a839-f3726d54f9a4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:44.970041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-96236049-043b-4dea-a839-f3726d54f9a4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:44.974475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cb851d00-242b-4d90-85ac-2b3bc21cb628 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:44.984342 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-96236049-043b-4dea-a839-f3726d54f9a4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1215 microversion: 2.1 time: 0.199508 Oct 04 21:22:44.994231 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1837/3661] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:44 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1215 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:45.008084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7861e98b-2782-4ce8-a913-cb9af8fbb514 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:45.012322 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cb851d00-242b-4d90-85ac-2b3bc21cb628 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1314 microversion: 2.1 time: 0.538341 Oct 04 21:22:45.014663 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1825/3662] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:44 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:45.015597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7861e98b-2782-4ce8-a913-cb9af8fbb514 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:45.022441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a1b33c33-b5be-4095-a195-c7a7b078a505 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f578b4708b0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:45.044781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7861e98b-2782-4ce8-a913-cb9af8fbb514 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:45.046654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7861e98b-2782-4ce8-a913-cb9af8fbb514 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:45.047357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7861e98b-2782-4ce8-a913-cb9af8fbb514 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:45.052035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7861e98b-2782-4ce8-a913-cb9af8fbb514 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:45.052740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7861e98b-2782-4ce8-a913-cb9af8fbb514 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:45.053406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7861e98b-2782-4ce8-a913-cb9af8fbb514 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:45.080968 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a1b33c33-b5be-4095-a195-c7a7b078a505 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f" status: 200 len: 286 microversion: 2.1 time: 0.062664 Oct 04 21:22:45.082509 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1826/3663] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Oct 4 21:22:45 2022] GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:45.092245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-78f030e9-22cb-427b-b47b-cc39bf44acd2 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b4748b0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:45.190224 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-78f030e9-22cb-427b-b47b-cc39bf44acd2 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.107454 Oct 04 21:22:45.219250 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1827/3664] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:45 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:45.237450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5bc2eab3-c167-4d1e-9cf1-20405f396ff1 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f578b405ee0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:45.340206 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5bc2eab3-c167-4d1e-9cf1-20405f396ff1 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.117534 Oct 04 21:22:45.341156 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1828/3665] 10.222.0.30 () {58 vars in 1140 bytes} [Tue Oct 4 21:22:45 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:45.352749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-901b4f74-7645-4c53-88dd-027f3d6aea49 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f578b41a670>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:45.401932 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-901b4f74-7645-4c53-88dd-027f3d6aea49 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f" status: 200 len: 286 microversion: 2.1 time: 0.053379 Oct 04 21:22:45.403825 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1829/3666] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Oct 4 21:22:45 2022] GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:45.434675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7861e98b-2782-4ce8-a913-cb9af8fbb514 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:45.446507 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7861e98b-2782-4ce8-a913-cb9af8fbb514 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.451355 Oct 04 21:22:45.447109 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1838/3667] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:44 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:46.021878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-86757f27-e679-476a-97e3-76377b3bef26 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:46.021878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-86757f27-e679-476a-97e3-76377b3bef26 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:46.040489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-26989c33-968f-4ad7-bc9e-97823a47ffdf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:46.041778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-26989c33-968f-4ad7-bc9e-97823a47ffdf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:46.067745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26989c33-968f-4ad7-bc9e-97823a47ffdf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:46.074077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26989c33-968f-4ad7-bc9e-97823a47ffdf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:46.075860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26989c33-968f-4ad7-bc9e-97823a47ffdf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:46.077126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26989c33-968f-4ad7-bc9e-97823a47ffdf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:46.078111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26989c33-968f-4ad7-bc9e-97823a47ffdf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:46.078397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26989c33-968f-4ad7-bc9e-97823a47ffdf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:46.190949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-86757f27-e679-476a-97e3-76377b3bef26 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:46.200630 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-86757f27-e679-476a-97e3-76377b3bef26 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1215 microversion: 2.1 time: 0.184903 Oct 04 21:22:46.203666 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1830/3668] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:46 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1215 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:46.241637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9345571c-d4d2-4723-aa98-ea210f16b106 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b41aa60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:46.347281 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9345571c-d4d2-4723-aa98-ea210f16b106 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.115780 Oct 04 21:22:46.351607 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1831/3669] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:46 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:46.416320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0d781242-6e71-4d47-b25e-a6ab373af39c tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f578b4e3550>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:46.428000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-26989c33-968f-4ad7-bc9e-97823a47ffdf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:46.443760 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-26989c33-968f-4ad7-bc9e-97823a47ffdf tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1314 microversion: 2.1 time: 0.406922 Oct 04 21:22:46.446582 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1839/3670] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:46 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:46.477311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-60fc524a-8a44-4d10-888d-0bb451666b4a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:46.478519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-60fc524a-8a44-4d10-888d-0bb451666b4a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:46.479769 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0d781242-6e71-4d47-b25e-a6ab373af39c tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f" status: 200 len: 286 microversion: 2.1 time: 0.067548 Oct 04 21:22:46.480635 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1832/3671] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Oct 4 21:22:46 2022] GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:46.492389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60fc524a-8a44-4d10-888d-0bb451666b4a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:46.493886 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60fc524a-8a44-4d10-888d-0bb451666b4a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:46.495915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60fc524a-8a44-4d10-888d-0bb451666b4a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:46.499057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60fc524a-8a44-4d10-888d-0bb451666b4a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:46.501704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60fc524a-8a44-4d10-888d-0bb451666b4a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:46.502280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60fc524a-8a44-4d10-888d-0bb451666b4a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:46.874495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-60fc524a-8a44-4d10-888d-0bb451666b4a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:46.908516 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-60fc524a-8a44-4d10-888d-0bb451666b4a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.435408 Oct 04 21:22:46.910948 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1840/3672] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:46 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:47.238056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-517efa4c-d581-4f64-8c04-5d12aef9092b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:47.239344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-517efa4c-d581-4f64-8c04-5d12aef9092b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:47.266989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-517efa4c-d581-4f64-8c04-5d12aef9092b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:47.268073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-517efa4c-d581-4f64-8c04-5d12aef9092b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:47.269920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-517efa4c-d581-4f64-8c04-5d12aef9092b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:47.272270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-517efa4c-d581-4f64-8c04-5d12aef9092b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:47.277344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-517efa4c-d581-4f64-8c04-5d12aef9092b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:47.277344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-517efa4c-d581-4f64-8c04-5d12aef9092b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:47.365930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2fe7209d-4732-4ae5-8d4f-809fc9b54439 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b6b1280>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:47.381117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-517efa4c-d581-4f64-8c04-5d12aef9092b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:47.390058 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-517efa4c-d581-4f64-8c04-5d12aef9092b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1211 microversion: 2.1 time: 0.156350 Oct 04 21:22:47.408163 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1833/3673] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:47 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1211 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:47.473748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4beb16a1-a5f4-470a-b880-41509244ded5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:47.474930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4beb16a1-a5f4-470a-b880-41509244ded5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:47.483061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4beb16a1-a5f4-470a-b880-41509244ded5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:47.483898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4beb16a1-a5f4-470a-b880-41509244ded5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:47.485284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4beb16a1-a5f4-470a-b880-41509244ded5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:47.486375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4beb16a1-a5f4-470a-b880-41509244ded5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:47.487084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4beb16a1-a5f4-470a-b880-41509244ded5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:47.490989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4beb16a1-a5f4-470a-b880-41509244ded5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:47.498720 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2fe7209d-4732-4ae5-8d4f-809fc9b54439 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.136924 Oct 04 21:22:47.499353 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1841/3674] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:47 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:47.510856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2b1506e2-3b53-4970-98d4-6e81c51cfbda tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f5790014e50>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:47.598503 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2b1506e2-3b53-4970-98d4-6e81c51cfbda tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f" status: 200 len: 286 microversion: 2.1 time: 0.097752 Oct 04 21:22:47.599798 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1842/3675] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Oct 4 21:22:47 2022] GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:47.947372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-65c93d0b-c230-4cac-916f-8e24260b3c5e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:47.948033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-65c93d0b-c230-4cac-916f-8e24260b3c5e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:47.973403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65c93d0b-c230-4cac-916f-8e24260b3c5e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:47.980427 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65c93d0b-c230-4cac-916f-8e24260b3c5e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:47.981881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65c93d0b-c230-4cac-916f-8e24260b3c5e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:47.987634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65c93d0b-c230-4cac-916f-8e24260b3c5e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:47.988994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65c93d0b-c230-4cac-916f-8e24260b3c5e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:47.992208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65c93d0b-c230-4cac-916f-8e24260b3c5e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:48.078302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4beb16a1-a5f4-470a-b880-41509244ded5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:48.109248 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4beb16a1-a5f4-470a-b880-41509244ded5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1501 microversion: 2.1 time: 0.639334 Oct 04 21:22:48.110624 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1834/3676] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:47 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1501 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:48.134658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-94aeb60f-97b8-4abc-9d65-2f762e72be2e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:48.139064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-94aeb60f-97b8-4abc-9d65-2f762e72be2e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:48.158749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94aeb60f-97b8-4abc-9d65-2f762e72be2e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:48.166167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94aeb60f-97b8-4abc-9d65-2f762e72be2e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:48.166167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94aeb60f-97b8-4abc-9d65-2f762e72be2e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:48.166167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94aeb60f-97b8-4abc-9d65-2f762e72be2e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:48.166167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94aeb60f-97b8-4abc-9d65-2f762e72be2e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:48.166167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-94aeb60f-97b8-4abc-9d65-2f762e72be2e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:48.258540 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-94aeb60f-97b8-4abc-9d65-2f762e72be2e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action" status: 200 len: 14 microversion: 2.1 time: 0.128699 Oct 04 21:22:48.264472 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1835/3677] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:22:48 2022] POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:22:48.417560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1895022c-6635-4ccf-b226-50d383b0ec9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:48.419551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1895022c-6635-4ccf-b226-50d383b0ec9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:48.422322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-65c93d0b-c230-4cac-916f-8e24260b3c5e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:48.432581 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-65c93d0b-c230-4cac-916f-8e24260b3c5e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.490226 Oct 04 21:22:48.435992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1895022c-6635-4ccf-b226-50d383b0ec9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:48.436493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1895022c-6635-4ccf-b226-50d383b0ec9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:48.438937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1895022c-6635-4ccf-b226-50d383b0ec9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:48.439054 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1843/3678] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:47 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:48.439170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1895022c-6635-4ccf-b226-50d383b0ec9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:48.439170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1895022c-6635-4ccf-b226-50d383b0ec9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:48.439170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1895022c-6635-4ccf-b226-50d383b0ec9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:48.516010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab1f7d43-8ad7-49a4-92fd-9f9eef89e057 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f57908d5430>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:48.646318 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ab1f7d43-8ad7-49a4-92fd-9f9eef89e057 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.135641 Oct 04 21:22:48.647397 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1844/3679] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:48 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:48.667080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b972bd84-df00-41e4-87a7-5ab631d610ff tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f57908f03a0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:48.683560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1895022c-6635-4ccf-b226-50d383b0ec9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:48.702281 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1895022c-6635-4ccf-b226-50d383b0ec9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1267 microversion: 2.1 time: 0.283077 Oct 04 21:22:48.705161 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1836/3680] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:48 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1267 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:48.779249 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b972bd84-df00-41e4-87a7-5ab631d610ff tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f" status: 200 len: 287 microversion: 2.1 time: 0.128748 Oct 04 21:22:48.779854 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1845/3681] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Oct 4 21:22:48 2022] GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f => generated 287 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:48.798685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dae1f4a0-3825-48be-b61a-c8407b497b2d tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f578b488ca0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:49.000216 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dae1f4a0-3825-48be-b61a-c8407b497b2d tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f" status: 202 len: 0 microversion: 2.1 time: 0.206244 Oct 04 21:22:49.000848 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1837/3682] 10.222.0.30 () {58 vars in 1254 bytes} [Tue Oct 4 21:22:48 2022] DELETE /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:22:49.024946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f3c6130a-dc72-4ce3-9c27-faf1843f219a tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f5790035af0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:49.095304 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f3c6130a-dc72-4ce3-9c27-faf1843f219a tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f" status: 200 len: 286 microversion: 2.1 time: 0.088570 Oct 04 21:22:49.101693 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1846/3683] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Oct 4 21:22:49 2022] GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:49.272440 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c262a59e-02c9-4c51-92ee-4166822e4fa5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:49.276073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c262a59e-02c9-4c51-92ee-4166822e4fa5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:49.306550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c262a59e-02c9-4c51-92ee-4166822e4fa5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:49.310347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c262a59e-02c9-4c51-92ee-4166822e4fa5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:49.310944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c262a59e-02c9-4c51-92ee-4166822e4fa5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:49.312606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c262a59e-02c9-4c51-92ee-4166822e4fa5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:49.313825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c262a59e-02c9-4c51-92ee-4166822e4fa5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:49.316376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c262a59e-02c9-4c51-92ee-4166822e4fa5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:49.460918 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c262a59e-02c9-4c51-92ee-4166822e4fa5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action" status: 200 len: 14 microversion: 2.1 time: 0.184016 Oct 04 21:22:49.464919 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1838/3684] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:22:49 2022] POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action => generated 14 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:22:49.469303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1cef548c-eaa0-4914-ae8a-22915f1edc78 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:49.470278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1cef548c-eaa0-4914-ae8a-22915f1edc78 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:49.491206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1cef548c-eaa0-4914-ae8a-22915f1edc78 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:49.491729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1cef548c-eaa0-4914-ae8a-22915f1edc78 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:49.496411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1cef548c-eaa0-4914-ae8a-22915f1edc78 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:49.498081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1cef548c-eaa0-4914-ae8a-22915f1edc78 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:49.498588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1cef548c-eaa0-4914-ae8a-22915f1edc78 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:49.499039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1cef548c-eaa0-4914-ae8a-22915f1edc78 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:49.664234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3a2899bd-56c7-413d-af9a-bbc5b33c4f1b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b485790>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:49.768866 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3a2899bd-56c7-413d-af9a-bbc5b33c4f1b tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.109992 Oct 04 21:22:49.769586 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1839/3685] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:49 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:49.789116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f8b15d7d-a77b-4633-b61a-13e139bd09f2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:49.792783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f8b15d7d-a77b-4633-b61a-13e139bd09f2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:49.808892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8b15d7d-a77b-4633-b61a-13e139bd09f2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:49.811343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8b15d7d-a77b-4633-b61a-13e139bd09f2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:49.811987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8b15d7d-a77b-4633-b61a-13e139bd09f2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:49.812784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8b15d7d-a77b-4633-b61a-13e139bd09f2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:49.816047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8b15d7d-a77b-4633-b61a-13e139bd09f2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:49.816964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8b15d7d-a77b-4633-b61a-13e139bd09f2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:49.984320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f8b15d7d-a77b-4633-b61a-13e139bd09f2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:49.999418 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f8b15d7d-a77b-4633-b61a-13e139bd09f2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1285 microversion: 2.1 time: 0.223461 Oct 04 21:22:50.000638 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1840/3686] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:49 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:50.109414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7b334f5b-ff6f-4bc5-91d3-cb432e588cfc tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f578b474a60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:50.178833 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7b334f5b-ff6f-4bc5-91d3-cb432e588cfc tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f" status: 200 len: 286 microversion: 2.1 time: 0.074333 Oct 04 21:22:50.187644 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1841/3687] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Oct 4 21:22:50 2022] GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:50.219579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1cef548c-eaa0-4914-ae8a-22915f1edc78 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:50.234821 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1cef548c-eaa0-4914-ae8a-22915f1edc78 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.774646 Oct 04 21:22:50.256024 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1847/3688] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:49 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:50.476513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b126fc69-84d5-4015-9328-48caf34baa38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:50.479312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b126fc69-84d5-4015-9328-48caf34baa38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:50.505450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b126fc69-84d5-4015-9328-48caf34baa38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:50.506697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b126fc69-84d5-4015-9328-48caf34baa38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:50.507535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b126fc69-84d5-4015-9328-48caf34baa38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:50.508988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b126fc69-84d5-4015-9328-48caf34baa38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:50.510115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b126fc69-84d5-4015-9328-48caf34baa38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:50.517677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b126fc69-84d5-4015-9328-48caf34baa38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:50.654103 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b126fc69-84d5-4015-9328-48caf34baa38 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action" status: 200 len: 14 microversion: 2.1 time: 0.183370 Oct 04 21:22:50.655365 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1842/3689] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:22:50 2022] POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:22:50.787491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d4181694-a088-4095-affe-a88465a585df tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f5790014310>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:50.871314 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d4181694-a088-4095-affe-a88465a585df tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.088985 Oct 04 21:22:50.872656 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1848/3690] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:50 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:51.030031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3bd50c19-4cb9-48f4-b14e-4603c5c1ff18 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:51.030831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3bd50c19-4cb9-48f4-b14e-4603c5c1ff18 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:51.050310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bd50c19-4cb9-48f4-b14e-4603c5c1ff18 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:51.050818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bd50c19-4cb9-48f4-b14e-4603c5c1ff18 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:51.051271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bd50c19-4cb9-48f4-b14e-4603c5c1ff18 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:51.051998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bd50c19-4cb9-48f4-b14e-4603c5c1ff18 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:51.052515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bd50c19-4cb9-48f4-b14e-4603c5c1ff18 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:51.052959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bd50c19-4cb9-48f4-b14e-4603c5c1ff18 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:51.184832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3bd50c19-4cb9-48f4-b14e-4603c5c1ff18 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:51.196672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1fc8ef8f-1f59-44ae-a151-d1b3b13f2513 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f579059f940>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:51.223767 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3bd50c19-4cb9-48f4-b14e-4603c5c1ff18 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1273 microversion: 2.1 time: 0.199105 Oct 04 21:22:51.237790 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1843/3691] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:51 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1273 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:51.262205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-af8b4752-e80a-4551-b216-68d76e4025c3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:51.264060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-af8b4752-e80a-4551-b216-68d76e4025c3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:51.275184 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1fc8ef8f-1f59-44ae-a151-d1b3b13f2513 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f" status: 200 len: 286 microversion: 2.1 time: 0.083782 Oct 04 21:22:51.276076 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1849/3692] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Oct 4 21:22:51 2022] GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:51.283774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af8b4752-e80a-4551-b216-68d76e4025c3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:51.285544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af8b4752-e80a-4551-b216-68d76e4025c3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:51.286217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af8b4752-e80a-4551-b216-68d76e4025c3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:51.287195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af8b4752-e80a-4551-b216-68d76e4025c3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:51.297835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af8b4752-e80a-4551-b216-68d76e4025c3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:51.298573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af8b4752-e80a-4551-b216-68d76e4025c3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:51.626743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-af8b4752-e80a-4551-b216-68d76e4025c3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:51.644364 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-af8b4752-e80a-4551-b216-68d76e4025c3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1506 microversion: 2.1 time: 0.386000 Oct 04 21:22:51.666553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8b522cb4-7e8b-4185-8c64-8e4a471d725c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:51.670123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8b522cb4-7e8b-4185-8c64-8e4a471d725c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:51.673348 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1844/3693] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:51 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:51.686158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:51.687761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b522cb4-7e8b-4185-8c64-8e4a471d725c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:51.699489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b522cb4-7e8b-4185-8c64-8e4a471d725c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:51.705963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b522cb4-7e8b-4185-8c64-8e4a471d725c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:51.707244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b522cb4-7e8b-4185-8c64-8e4a471d725c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:51.707908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b522cb4-7e8b-4185-8c64-8e4a471d725c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:51.709305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b522cb4-7e8b-4185-8c64-8e4a471d725c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:51.765210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:51.789169 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8b522cb4-7e8b-4185-8c64-8e4a471d725c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action" status: 200 len: 14 microversion: 2.1 time: 0.126854 Oct 04 21:22:51.790270 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1850/3694] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:22:51 2022] POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:22:51.889378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-33edc73b-8c35-4216-9afd-379cba9cce40 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b474b80>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:51.996269 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-33edc73b-8c35-4216-9afd-379cba9cce40 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.111805 Oct 04 21:22:51.999711 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1845/3695] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:51 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:52.252238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bd9243d3-c480-4571-8953-6a2536578fe7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:52.252947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bd9243d3-c480-4571-8953-6a2536578fe7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:52.260310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd9243d3-c480-4571-8953-6a2536578fe7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:52.262924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd9243d3-c480-4571-8953-6a2536578fe7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:52.263991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd9243d3-c480-4571-8953-6a2536578fe7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:52.265307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd9243d3-c480-4571-8953-6a2536578fe7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:52.266295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd9243d3-c480-4571-8953-6a2536578fe7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:52.266962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd9243d3-c480-4571-8953-6a2536578fe7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:52.301294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a839b931-1dbe-4c4f-b31b-1c4d4e42403a tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f578b421e50>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:52.379238 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a839b931-1dbe-4c4f-b31b-1c4d4e42403a tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f" status: 200 len: 286 microversion: 2.1 time: 0.093240 Oct 04 21:22:52.380142 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1846/3696] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Oct 4 21:22:52 2022] GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:22:52.686839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bd9243d3-c480-4571-8953-6a2536578fe7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:52.698607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3f7d3a09-3a3c-4d2a-a068-51406e1c2380 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:52.699356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3f7d3a09-3a3c-4d2a-a068-51406e1c2380 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:52.700904 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bd9243d3-c480-4571-8953-6a2536578fe7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1315 microversion: 2.1 time: 0.452701 Oct 04 21:22:52.702168 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1851/3697] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:52 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:52.728797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f7d3a09-3a3c-4d2a-a068-51406e1c2380 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:52.730326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f7d3a09-3a3c-4d2a-a068-51406e1c2380 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:52.731153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f7d3a09-3a3c-4d2a-a068-51406e1c2380 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:52.732998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f7d3a09-3a3c-4d2a-a068-51406e1c2380 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:52.733716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f7d3a09-3a3c-4d2a-a068-51406e1c2380 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:52.734503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f7d3a09-3a3c-4d2a-a068-51406e1c2380 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:52.802009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7ef6a3d4-5b74-47c0-bacd-d49a9575f212 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:52.804946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7ef6a3d4-5b74-47c0-bacd-d49a9575f212 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:52.811461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ef6a3d4-5b74-47c0-bacd-d49a9575f212 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:52.812904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ef6a3d4-5b74-47c0-bacd-d49a9575f212 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:52.813620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ef6a3d4-5b74-47c0-bacd-d49a9575f212 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:52.814577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ef6a3d4-5b74-47c0-bacd-d49a9575f212 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:52.815296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ef6a3d4-5b74-47c0-bacd-d49a9575f212 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:52.815996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ef6a3d4-5b74-47c0-bacd-d49a9575f212 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:52.888070 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7ef6a3d4-5b74-47c0-bacd-d49a9575f212 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action" status: 200 len: 14 microversion: 2.1 time: 0.083703 Oct 04 21:22:52.889937 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1852/3698] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:22:52 2022] POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:22:53.030132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-047a66f3-8971-4746-a1f3-7dc93711c06a tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f57943c7a60>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:53.148060 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-047a66f3-8971-4746-a1f3-7dc93711c06a tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.121624 Oct 04 21:22:53.148060 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1853/3699] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:53 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:53.161028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3f7d3a09-3a3c-4d2a-a068-51406e1c2380 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:53.180840 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3f7d3a09-3a3c-4d2a-a068-51406e1c2380 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1486 microversion: 2.1 time: 0.486207 Oct 04 21:22:53.186339 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1847/3700] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:52 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1486 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:53.399483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d9bd1f2d-1a84-4609-b983-3ceb24fe8b31 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f5790777c10>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:53.424248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-687a75a9-505a-4f88-ab52-2015988e1930 req-d2abe77c-7974-4a1e-84d8-dcf8242df3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a90e631-8a66-4d71-9103-68015d052045", "tag": "eb356872-cb96-4adc-b7e5-647e1ac67dfe"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:53.442818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-687a75a9-505a-4f88-ab52-2015988e1930 req-d2abe77c-7974-4a1e-84d8-dcf8242df3b6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:53.443302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-687a75a9-505a-4f88-ab52-2015988e1930 req-d2abe77c-7974-4a1e-84d8-dcf8242df3b6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:53.443732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-687a75a9-505a-4f88-ab52-2015988e1930 req-d2abe77c-7974-4a1e-84d8-dcf8242df3b6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:53.470809 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-d9bd1f2d-1a84-4609-b983-3ceb24fe8b31 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] HTTP exception thrown: Snapshot 2b36781a-7802-4cbe-a712-cdb379ddd49f could not be found. Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d9bd1f2d-1a84-4609-b983-3ceb24fe8b31 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Request method failure captured: Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f HTTP/1.1 Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKQe3ACtOiHKvTySL8Lbvp6i5HO2s1zCkNS8Kyz8DKdxi9wDGTQBZxFqelT4zejCZvbkFW138jnBBpaUxMCOF-pxwhdFR9oxvaC7f0rh9TvJKTDFuIFsJXnKJeI2TUqXsI4fCqyWb5wENy4Wfsp1bikHDZ_QHfS-BtZOkXvpETxpj4o Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f996dd40ebb444fa915ddbabffc28cd7 Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-207156927 Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f996dd40ebb444fa915ddbabffc28cd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f996dd40ebb444fa915ddbabffc28cd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f996dd40ebb444fa915ddbabffc28cd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f996dd40ebb444fa915ddbabffc28cd7"}]}] Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-VolumesSnapshotsTestJSON-207156927 Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f996dd40ebb444fa915ddbabffc28cd7 Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-207156927 Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-VolumesSnapshotsTestJSON-207156927-project Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 2471c4b1354c43aba139f81c211ab11f Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-VolumesSnapshotsTestJSON-207156927-project Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: exception: Snapshot 2b36781a-7802-4cbe-a712-cdb379ddd49f could not be found. Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '2b36781a-7802-4cbe-a712-cdb379ddd49f'} Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2b36781a-7802-4cbe-a712-cdb379ddd49f could not be found. (HTTP 404) (Request-ID: req-50068772-cdc2-4430-a989-21c736c66914) Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:22:53.483203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2b36781a-7802-4cbe-a712-cdb379ddd49f could not be found. Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2b36781a-7802-4cbe-a712-cdb379ddd49f could not be found. Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2b36781a-7802-4cbe-a712-cdb379ddd49f could not be found. Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d9bd1f2d-1a84-4609-b983-3ceb24fe8b31 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Returning 404 to user: Snapshot 2b36781a-7802-4cbe-a712-cdb379ddd49f could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d9bd1f2d-1a84-4609-b983-3ceb24fe8b31 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f" status: 404 len: 111 microversion: 2.1 time: 0.090509 Oct 04 21:22:53.489452 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1854/3701] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Oct 4 21:22:53 2022] GET /compute/v2.1/os-snapshots/2b36781a-7802-4cbe-a712-cdb379ddd49f => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:22:53.493708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-099793e1-8c3e-4884-8200-39268087bb2c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-536923000", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:53.499275 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-687a75a9-505a-4f88-ab52-2015988e1930 req-d2abe77c-7974-4a1e-84d8-dcf8242df3b6 service nova] Creating event network-changed:eb356872-cb96-4adc-b7e5-647e1ac67dfe for instance 8a90e631-8a66-4d71-9103-68015d052045 on n-h2-860282-1 Oct 04 21:22:53.505823 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-687a75a9-505a-4f88-ab52-2015988e1930 req-d2abe77c-7974-4a1e-84d8-dcf8242df3b6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087255 Oct 04 21:22:53.506728 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1848/3702] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:22:53.513330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-03620b5c-39bf-4021-9246-cf9da6049bd4 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f578b454820>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:53.603275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-099793e1-8c3e-4884-8200-39268087bb2c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] validate_networks() for [('fa89d970-8853-4fbd-b730-b6a566314680', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:22:53.846081 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-03620b5c-39bf-4021-9246-cf9da6049bd4 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f" status: 202 len: 0 microversion: 2.1 time: 0.338125 Oct 04 21:22:53.851881 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1849/3703] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Oct 4 21:22:53 2022] DELETE /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:22:53.876623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-df7d72ad-8f05-4d30-ada3-bb26f4a78887 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:53.877884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-df7d72ad-8f05-4d30-ada3-bb26f4a78887 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:53.913310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df7d72ad-8f05-4d30-ada3-bb26f4a78887 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:53.913310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df7d72ad-8f05-4d30-ada3-bb26f4a78887 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:53.913310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df7d72ad-8f05-4d30-ada3-bb26f4a78887 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:53.916574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df7d72ad-8f05-4d30-ada3-bb26f4a78887 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:53.917381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df7d72ad-8f05-4d30-ada3-bb26f4a78887 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:53.920620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df7d72ad-8f05-4d30-ada3-bb26f4a78887 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:53.922444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:54.381708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-df7d72ad-8f05-4d30-ada3-bb26f4a78887 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:54.394976 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-df7d72ad-8f05-4d30-ada3-bb26f4a78887 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1315 microversion: 2.1 time: 0.541614 Oct 04 21:22:54.415552 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1850/3704] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:53 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:54.438407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0e3be61e-d1b1-455d-964a-6ba0c7900c89 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f578b454a60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:54.532363 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0e3be61e-d1b1-455d-964a-6ba0c7900c89 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f" status: 200 len: 345 microversion: 2.1 time: 0.114515 Oct 04 21:22:54.533682 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1851/3705] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:22:54 2022] GET /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f => generated 345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:54.541883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-66c487e1-a5dc-4363-9f51-be0c21d7068a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:54.557668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-66c487e1-a5dc-4363-9f51-be0c21d7068a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:54.580894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66c487e1-a5dc-4363-9f51-be0c21d7068a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:54.580894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66c487e1-a5dc-4363-9f51-be0c21d7068a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:54.580894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66c487e1-a5dc-4363-9f51-be0c21d7068a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:54.580894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66c487e1-a5dc-4363-9f51-be0c21d7068a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:54.580894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66c487e1-a5dc-4363-9f51-be0c21d7068a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:54.580894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66c487e1-a5dc-4363-9f51-be0c21d7068a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:54.695267 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-66c487e1-a5dc-4363-9f51-be0c21d7068a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action" status: 200 len: 14 microversion: 2.1 time: 0.150748 Oct 04 21:22:54.696185 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1852/3706] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:22:54 2022] POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:22:54.711993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a32265d7-013f-4434-871b-dfc94517ba09 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b4888b0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:54.790256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-099793e1-8c3e-4884-8200-39268087bb2c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:22:54.790812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-099793e1-8c3e-4884-8200-39268087bb2c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:22:54.791166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-099793e1-8c3e-4884-8200-39268087bb2c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:22:54.791583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-099793e1-8c3e-4884-8200-39268087bb2c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:22:54.792772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-099793e1-8c3e-4884-8200-39268087bb2c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:22:54.804311 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a32265d7-013f-4434-871b-dfc94517ba09 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.101807 Oct 04 21:22:54.812296 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1853/3707] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:54 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:54.842508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-099793e1-8c3e-4884-8200-39268087bb2c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:54.842508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-099793e1-8c3e-4884-8200-39268087bb2c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:54.842508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-099793e1-8c3e-4884-8200-39268087bb2c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:54.842508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-099793e1-8c3e-4884-8200-39268087bb2c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:54.846084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-099793e1-8c3e-4884-8200-39268087bb2c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:54.847229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-099793e1-8c3e-4884-8200-39268087bb2c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:54.881929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-099793e1-8c3e-4884-8200-39268087bb2c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Getting quotas for project f331cff7b8e2496bb677f8f875a36968. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:22:54.906937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-099793e1-8c3e-4884-8200-39268087bb2c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Getting quotas for user 738661b84c8c4465bf8dcde0a182af6d and project f331cff7b8e2496bb677f8f875a36968. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:22:54.935747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-099793e1-8c3e-4884-8200-39268087bb2c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:22:54.939595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-099793e1-8c3e-4884-8200-39268087bb2c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:22:55.171290 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-099793e1-8c3e-4884-8200-39268087bb2c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.684854 Oct 04 21:22:55.186242 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1855/3708] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:22:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 1700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:22:55.188022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-24b50dff-202b-48bd-98bd-2323562ef24a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:55.189344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-24b50dff-202b-48bd-98bd-2323562ef24a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:55.384205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-24b50dff-202b-48bd-98bd-2323562ef24a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:55.384205 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-24b50dff-202b-48bd-98bd-2323562ef24a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1213 microversion: 2.1 time: 0.201679 Oct 04 21:22:55.384205 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1854/3709] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:55 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1213 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:55.424750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5d9ad240-3676-4fd2-89f5-da24902ab24e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:55.425668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5d9ad240-3676-4fd2-89f5-da24902ab24e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:55.440881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d9ad240-3676-4fd2-89f5-da24902ab24e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:55.441722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d9ad240-3676-4fd2-89f5-da24902ab24e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:55.442365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d9ad240-3676-4fd2-89f5-da24902ab24e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:55.444327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d9ad240-3676-4fd2-89f5-da24902ab24e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:55.447533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d9ad240-3676-4fd2-89f5-da24902ab24e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:55.448039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d9ad240-3676-4fd2-89f5-da24902ab24e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:55.552375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-de1e147e-cd04-4be3-aa13-ac396f64eee9 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f57945a7ca0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:55.634021 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-de1e147e-cd04-4be3-aa13-ac396f64eee9 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f" status: 200 len: 345 microversion: 2.1 time: 0.090281 Oct 04 21:22:55.641241 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1855/3710] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:22:55 2022] GET /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f => generated 345 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:22:55.710634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-40de3d57-860a-41d2-8dcf-d6d5f4648075 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:55.713265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-40de3d57-860a-41d2-8dcf-d6d5f4648075 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:55.723425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40de3d57-860a-41d2-8dcf-d6d5f4648075 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:55.725015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40de3d57-860a-41d2-8dcf-d6d5f4648075 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:55.729758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40de3d57-860a-41d2-8dcf-d6d5f4648075 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:55.734163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40de3d57-860a-41d2-8dcf-d6d5f4648075 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:55.734677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40de3d57-860a-41d2-8dcf-d6d5f4648075 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:55.735132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40de3d57-860a-41d2-8dcf-d6d5f4648075 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:55.789346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:55.798746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5d9ad240-3676-4fd2-89f5-da24902ab24e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:55.818657 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5d9ad240-3676-4fd2-89f5-da24902ab24e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1315 microversion: 2.1 time: 0.399129 Oct 04 21:22:55.819319 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1856/3711] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:55 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:55.824514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dd056eda-9ba6-4bcd-a5c3-87d6f5f0532a tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f579445b8b0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:55.883339 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dd056eda-9ba6-4bcd-a5c3-87d6f5f0532a tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.062830 Oct 04 21:22:55.884725 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1857/3712] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:55 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:56.415914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d2a22220-ced8-42f2-a25a-4c95cd8793a7 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:56.429447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d2a22220-ced8-42f2-a25a-4c95cd8793a7 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:56.478578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d2a22220-ced8-42f2-a25a-4c95cd8793a7 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:56.487316 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d2a22220-ced8-42f2-a25a-4c95cd8793a7 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1213 microversion: 2.1 time: 0.077413 Oct 04 21:22:56.487954 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1858/3713] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:56 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:56.648603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5e43f2c1-bff5-4408-bd64-bc9b5bd896fb tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f57906048b0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:56.684868 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-40de3d57-860a-41d2-8dcf-d6d5f4648075 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action" status: 200 len: 14 microversion: 2.1 time: 0.978707 Oct 04 21:22:56.686440 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1856/3714] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:22:55 2022] POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action => generated 14 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:22:56.747540 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5e43f2c1-bff5-4408-bd64-bc9b5bd896fb tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f" status: 200 len: 345 microversion: 2.1 time: 0.102928 Oct 04 21:22:56.750137 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1859/3715] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:22:56 2022] GET /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f => generated 345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:22:56.851804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f226da70-cf9d-478a-bec0-d7fae5780800 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:56.852518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f226da70-cf9d-478a-bec0-d7fae5780800 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:56.883027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f226da70-cf9d-478a-bec0-d7fae5780800 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:56.883556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f226da70-cf9d-478a-bec0-d7fae5780800 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:56.884024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f226da70-cf9d-478a-bec0-d7fae5780800 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:56.885075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f226da70-cf9d-478a-bec0-d7fae5780800 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:56.885930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f226da70-cf9d-478a-bec0-d7fae5780800 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:56.886579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f226da70-cf9d-478a-bec0-d7fae5780800 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:56.910996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-86131978-7559-48bc-bfc5-24e33b5c8aad tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f579445b940>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:56.987059 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-86131978-7559-48bc-bfc5-24e33b5c8aad tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.080884 Oct 04 21:22:56.988265 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1860/3716] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:56 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:57.187276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f226da70-cf9d-478a-bec0-d7fae5780800 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:57.239133 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f226da70-cf9d-478a-bec0-d7fae5780800 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1315 microversion: 2.1 time: 0.388777 Oct 04 21:22:57.244627 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1857/3717] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:56 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:57.421089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4338af67-66fa-494f-b47b-0a1a5d9ab252 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961-project-admin] Calling method '.version_select at 0x7f579059f430>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:57.424179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4338af67-66fa-494f-b47b-0a1a5d9ab252 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:57.424961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4338af67-66fa-494f-b47b-0a1a5d9ab252 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:57.425733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4338af67-66fa-494f-b47b-0a1a5d9ab252 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:57.448831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4338af67-66fa-494f-b47b-0a1a5d9ab252 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:57.449785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4338af67-66fa-494f-b47b-0a1a5d9ab252 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:57.450609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4338af67-66fa-494f-b47b-0a1a5d9ab252 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:57.465633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4338af67-66fa-494f-b47b-0a1a5d9ab252 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:57.466587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4338af67-66fa-494f-b47b-0a1a5d9ab252 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:57.467209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4338af67-66fa-494f-b47b-0a1a5d9ab252 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:57.496492 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4338af67-66fa-494f-b47b-0a1a5d9ab252 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1814972961-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.292061 Oct 04 21:22:57.500145 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1861/3718] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:22:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:57.525639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d73c66e0-de8b-48df-9516-fb5261d357ca tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:57.525639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d73c66e0-de8b-48df-9516-fb5261d357ca tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:57.531442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d73c66e0-de8b-48df-9516-fb5261d357ca tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:57.532309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d73c66e0-de8b-48df-9516-fb5261d357ca tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:57.532922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d73c66e0-de8b-48df-9516-fb5261d357ca tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:57.534011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d73c66e0-de8b-48df-9516-fb5261d357ca tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:57.534810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d73c66e0-de8b-48df-9516-fb5261d357ca tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:57.535411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d73c66e0-de8b-48df-9516-fb5261d357ca tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:57.638615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d73c66e0-de8b-48df-9516-fb5261d357ca tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:57.647504 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d73c66e0-de8b-48df-9516-fb5261d357ca tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1217 microversion: 2.1 time: 0.132543 Oct 04 21:22:57.648095 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1858/3719] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:57 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1217 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:57.698797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-10334c7a-38c3-45ad-be59-4be8fcdc95e7 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:57.710350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-10334c7a-38c3-45ad-be59-4be8fcdc95e7 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:57.735736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10334c7a-38c3-45ad-be59-4be8fcdc95e7 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:57.735736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10334c7a-38c3-45ad-be59-4be8fcdc95e7 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:57.735736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10334c7a-38c3-45ad-be59-4be8fcdc95e7 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:57.735736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10334c7a-38c3-45ad-be59-4be8fcdc95e7 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:57.735736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10334c7a-38c3-45ad-be59-4be8fcdc95e7 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:57.739719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10334c7a-38c3-45ad-be59-4be8fcdc95e7 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:57.766413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d5d844d6-d842-4c96-b453-bb2acdbb4133 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f578b488a60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:57.821917 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-d5d844d6-d842-4c96-b453-bb2acdbb4133 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] HTTP exception thrown: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. Oct 04 21:22:57.824217 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-10334c7a-38c3-45ad-be59-4be8fcdc95e7 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action" status: 200 len: 14 microversion: 2.1 time: 0.129784 Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d5d844d6-d842-4c96-b453-bb2acdbb4133 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Request method failure captured: Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f HTTP/1.1 Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKQe3ACtOiHKvTySL8Lbvp6i5HO2s1zCkNS8Kyz8DKdxi9wDGTQBZxFqelT4zejCZvbkFW138jnBBpaUxMCOF-pxwhdFR9oxvaC7f0rh9TvJKTDFuIFsJXnKJeI2TUqXsI4fCqyWb5wENy4Wfsp1bikHDZ_QHfS-BtZOkXvpETxpj4o Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f996dd40ebb444fa915ddbabffc28cd7 Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-207156927 Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f996dd40ebb444fa915ddbabffc28cd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f996dd40ebb444fa915ddbabffc28cd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f996dd40ebb444fa915ddbabffc28cd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f996dd40ebb444fa915ddbabffc28cd7"}]}] Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-VolumesSnapshotsTestJSON-207156927 Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f996dd40ebb444fa915ddbabffc28cd7 Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-207156927 Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-VolumesSnapshotsTestJSON-207156927-project Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 2471c4b1354c43aba139f81c211ab11f Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-VolumesSnapshotsTestJSON-207156927-project Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: exception: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '71435a17-42fc-4344-a6dc-90a29a816f0f'} Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. (HTTP 404) (Request-ID: req-55275bd5-1646-461f-860d-c49f12b7e232) Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:22:57.826062 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. Oct 04 21:22:57.831605 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:57.839481 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1862/3720] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:22:57 2022] POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:22:57.839709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d5d844d6-d842-4c96-b453-bb2acdbb4133 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Returning 404 to user: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:57.839709 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d5d844d6-d842-4c96-b453-bb2acdbb4133 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f" status: 404 len: 109 microversion: 2.1 time: 0.073951 Oct 04 21:22:57.839709 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1859/3721] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:22:57 2022] GET /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:22:57.849504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-11e2f5e6-0be3-4fa5-b0af-e32a1f01b254 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f5790035af0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:57.895770 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-11e2f5e6-0be3-4fa5-b0af-e32a1f01b254 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] HTTP exception thrown: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-11e2f5e6-0be3-4fa5-b0af-e32a1f01b254 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Request method failure captured: Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f HTTP/1.1 Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKQe3ACtOiHKvTySL8Lbvp6i5HO2s1zCkNS8Kyz8DKdxi9wDGTQBZxFqelT4zejCZvbkFW138jnBBpaUxMCOF-pxwhdFR9oxvaC7f0rh9TvJKTDFuIFsJXnKJeI2TUqXsI4fCqyWb5wENy4Wfsp1bikHDZ_QHfS-BtZOkXvpETxpj4o Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f996dd40ebb444fa915ddbabffc28cd7 Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-207156927 Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f996dd40ebb444fa915ddbabffc28cd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f996dd40ebb444fa915ddbabffc28cd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f996dd40ebb444fa915ddbabffc28cd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f996dd40ebb444fa915ddbabffc28cd7"}]}] Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-VolumesSnapshotsTestJSON-207156927 Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f996dd40ebb444fa915ddbabffc28cd7 Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-207156927 Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-VolumesSnapshotsTestJSON-207156927-project Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 2471c4b1354c43aba139f81c211ab11f Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-VolumesSnapshotsTestJSON-207156927-project Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: exception: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '71435a17-42fc-4344-a6dc-90a29a816f0f'} Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. (HTTP 404) (Request-ID: req-5c95dc44-6d38-453b-9363-9743489ccd72) Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:22:57.899568 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-11e2f5e6-0be3-4fa5-b0af-e32a1f01b254 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Returning 404 to user: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-11e2f5e6-0be3-4fa5-b0af-e32a1f01b254 tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f" status: 404 len: 109 microversion: 2.1 time: 0.056891 Oct 04 21:22:57.916271 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1863/3722] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Oct 4 21:22:57 2022] DELETE /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:22:57.925297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9ef3cba-4478-4977-b51f-941482a45f9e tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Calling method '.version_select at 0x7f578b41aca0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:57.990228 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-d9ef3cba-4478-4977-b51f-941482a45f9e tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] HTTP exception thrown: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9ef3cba-4478-4977-b51f-941482a45f9e tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Request method failure captured: Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f HTTP/1.1 Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKQe3ACtOiHKvTySL8Lbvp6i5HO2s1zCkNS8Kyz8DKdxi9wDGTQBZxFqelT4zejCZvbkFW138jnBBpaUxMCOF-pxwhdFR9oxvaC7f0rh9TvJKTDFuIFsJXnKJeI2TUqXsI4fCqyWb5wENy4Wfsp1bikHDZ_QHfS-BtZOkXvpETxpj4o Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f996dd40ebb444fa915ddbabffc28cd7 Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-207156927 Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f996dd40ebb444fa915ddbabffc28cd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f996dd40ebb444fa915ddbabffc28cd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f996dd40ebb444fa915ddbabffc28cd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f996dd40ebb444fa915ddbabffc28cd7"}]}] Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-VolumesSnapshotsTestJSON-207156927 Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f996dd40ebb444fa915ddbabffc28cd7 Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-207156927 Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-VolumesSnapshotsTestJSON-207156927-project Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 2471c4b1354c43aba139f81c211ab11f Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-VolumesSnapshotsTestJSON-207156927-project Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: exception: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '71435a17-42fc-4344-a6dc-90a29a816f0f'} Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. (HTTP 404) (Request-ID: req-1ebb5b19-6c34-4bc9-af7a-077babb90d07) Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:22:57.993018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9ef3cba-4478-4977-b51f-941482a45f9e tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] Returning 404 to user: Volume 71435a17-42fc-4344-a6dc-90a29a816f0f could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d9ef3cba-4478-4977-b51f-941482a45f9e tempest-VolumesSnapshotsTestJSON-207156927 tempest-VolumesSnapshotsTestJSON-207156927-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f" status: 404 len: 109 microversion: 2.1 time: 0.086333 Oct 04 21:22:58.014473 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1860/3723] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:22:57 2022] GET /compute/v2.1/os-volumes/71435a17-42fc-4344-a6dc-90a29a816f0f => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:22:58.017920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d53ff16b-2b6d-4c00-80ae-fbfa8d806ffc tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b73eca0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:58.092338 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d53ff16b-2b6d-4c00-80ae-fbfa8d806ffc tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.091597 Oct 04 21:22:58.092938 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1864/3724] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:57 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:58.276729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-952f49ea-0821-406b-9156-73489e1f3a58 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:58.277101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-952f49ea-0821-406b-9156-73489e1f3a58 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:58.288747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-952f49ea-0821-406b-9156-73489e1f3a58 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:58.289548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-952f49ea-0821-406b-9156-73489e1f3a58 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:58.290275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-952f49ea-0821-406b-9156-73489e1f3a58 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:58.291376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-952f49ea-0821-406b-9156-73489e1f3a58 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:58.292001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-952f49ea-0821-406b-9156-73489e1f3a58 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:58.292625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-952f49ea-0821-406b-9156-73489e1f3a58 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:58.681706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c8be5501-765c-4d3f-a59f-5224428fc304 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:58.686543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c8be5501-765c-4d3f-a59f-5224428fc304 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:58.698871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8be5501-765c-4d3f-a59f-5224428fc304 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:58.698871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8be5501-765c-4d3f-a59f-5224428fc304 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:58.698871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8be5501-765c-4d3f-a59f-5224428fc304 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:58.698871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8be5501-765c-4d3f-a59f-5224428fc304 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:58.699643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8be5501-765c-4d3f-a59f-5224428fc304 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:58.700603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8be5501-765c-4d3f-a59f-5224428fc304 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:58.723100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-952f49ea-0821-406b-9156-73489e1f3a58 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:58.748442 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-952f49ea-0821-406b-9156-73489e1f3a58 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1315 microversion: 2.1 time: 0.475594 Oct 04 21:22:58.749524 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1861/3725] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:58 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:58.839311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-49b51644-3b87-499c-ba65-961e4649b274 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:58.847247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-49b51644-3b87-499c-ba65-961e4649b274 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:58.861835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49b51644-3b87-499c-ba65-961e4649b274 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:58.862612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49b51644-3b87-499c-ba65-961e4649b274 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:58.865287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49b51644-3b87-499c-ba65-961e4649b274 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:58.865287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49b51644-3b87-499c-ba65-961e4649b274 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:58.865287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49b51644-3b87-499c-ba65-961e4649b274 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:58.865287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49b51644-3b87-499c-ba65-961e4649b274 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:58.885999 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c8be5501-765c-4d3f-a59f-5224428fc304 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:58.897080 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c8be5501-765c-4d3f-a59f-5224428fc304 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1265 microversion: 2.1 time: 0.225212 Oct 04 21:22:58.902145 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1865/3726] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:58 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:58.983415 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-49b51644-3b87-499c-ba65-961e4649b274 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action" status: 200 len: 14 microversion: 2.1 time: 0.149474 Oct 04 21:22:58.985283 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1862/3727] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:22:58 2022] POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:22:59.117604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-03a56ced-a510-4dca-8213-79fa5e8374f3 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f57943b5040>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:59.238651 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-03a56ced-a510-4dca-8213-79fa5e8374f3 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.127168 Oct 04 21:22:59.243120 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1866/3728] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:59 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:59.787983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0c6c283e-062a-444f-9204-72e85a41557a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:59.789859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0c6c283e-062a-444f-9204-72e85a41557a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:59.824410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c6c283e-062a-444f-9204-72e85a41557a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:59.828077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c6c283e-062a-444f-9204-72e85a41557a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:59.830883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c6c283e-062a-444f-9204-72e85a41557a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:59.832339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c6c283e-062a-444f-9204-72e85a41557a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:59.835803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c6c283e-062a-444f-9204-72e85a41557a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:59.836878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c6c283e-062a-444f-9204-72e85a41557a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:59.932424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-333129aa-fff7-4e74-8096-68b774577f51 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:59.933045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-333129aa-fff7-4e74-8096-68b774577f51 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:59.952916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-333129aa-fff7-4e74-8096-68b774577f51 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:59.953445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-333129aa-fff7-4e74-8096-68b774577f51 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:59.953895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-333129aa-fff7-4e74-8096-68b774577f51 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:59.954609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-333129aa-fff7-4e74-8096-68b774577f51 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:59.955075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-333129aa-fff7-4e74-8096-68b774577f51 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:59.955492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-333129aa-fff7-4e74-8096-68b774577f51 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:00.217900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-333129aa-fff7-4e74-8096-68b774577f51 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:00.240298 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-333129aa-fff7-4e74-8096-68b774577f51 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1271 microversion: 2.1 time: 0.310282 Oct 04 21:23:00.243465 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1867/3729] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:59 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1271 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:00.256407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0bc7de37-cd92-4cae-81c8-f109e0863112 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:00.259477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0bc7de37-cd92-4cae-81c8-f109e0863112 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:00.276106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bc7de37-cd92-4cae-81c8-f109e0863112 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:00.276106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bc7de37-cd92-4cae-81c8-f109e0863112 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:00.276106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bc7de37-cd92-4cae-81c8-f109e0863112 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:00.276106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bc7de37-cd92-4cae-81c8-f109e0863112 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:00.276106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bc7de37-cd92-4cae-81c8-f109e0863112 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:00.276106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0bc7de37-cd92-4cae-81c8-f109e0863112 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:00.338010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0c6c283e-062a-444f-9204-72e85a41557a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:00.347384 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0c6c283e-062a-444f-9204-72e85a41557a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1315 microversion: 2.1 time: 0.565408 Oct 04 21:23:00.351178 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1863/3730] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:59 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:00.370111 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0bc7de37-cd92-4cae-81c8-f109e0863112 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action" status: 200 len: 8208 microversion: 2.1 time: 0.119696 Oct 04 21:23:00.375997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b4661c9a-020f-4079-8c40-c9cd65e7afca tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b41a430>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:00.382994 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1868/3731] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:23:00 2022] POST /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e/action => generated 8208 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:00.400696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fab55c4c-7de0-4d2e-9adb-9c25a47934f8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:00.401738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fab55c4c-7de0-4d2e-9adb-9c25a47934f8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:00.450370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fab55c4c-7de0-4d2e-9adb-9c25a47934f8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:00.450890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fab55c4c-7de0-4d2e-9adb-9c25a47934f8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:00.451306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fab55c4c-7de0-4d2e-9adb-9c25a47934f8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:00.459977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fab55c4c-7de0-4d2e-9adb-9c25a47934f8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:00.462589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fab55c4c-7de0-4d2e-9adb-9c25a47934f8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:00.464362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fab55c4c-7de0-4d2e-9adb-9c25a47934f8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:00.490487 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b4661c9a-020f-4079-8c40-c9cd65e7afca tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.137516 Oct 04 21:23:00.491079 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1864/3732] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:23:00 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:00.804150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fab55c4c-7de0-4d2e-9adb-9c25a47934f8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:00.816169 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fab55c4c-7de0-4d2e-9adb-9c25a47934f8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.431478 Oct 04 21:23:00.819684 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1869/3733] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:00 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:00.848489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7593b958-6de4-4453-9043-a873203b7a2a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:00.848489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7593b958-6de4-4453-9043-a873203b7a2a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:00.851617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7593b958-6de4-4453-9043-a873203b7a2a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:00.852369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7593b958-6de4-4453-9043-a873203b7a2a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:00.853222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7593b958-6de4-4453-9043-a873203b7a2a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:00.854142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7593b958-6de4-4453-9043-a873203b7a2a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:00.854830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7593b958-6de4-4453-9043-a873203b7a2a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:00.855435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7593b958-6de4-4453-9043-a873203b7a2a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:01.167849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7593b958-6de4-4453-9043-a873203b7a2a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:01.209788 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7593b958-6de4-4453-9043-a873203b7a2a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.347574 Oct 04 21:23:01.218385 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1865/3734] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:00 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:01.243307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1cd47387-7797-4f87-a54b-28ae5fc1c59e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:01.243948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1cd47387-7797-4f87-a54b-28ae5fc1c59e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:01.257717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1cd47387-7797-4f87-a54b-28ae5fc1c59e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:01.258227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1cd47387-7797-4f87-a54b-28ae5fc1c59e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:01.263583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1cd47387-7797-4f87-a54b-28ae5fc1c59e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:01.265728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1cd47387-7797-4f87-a54b-28ae5fc1c59e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:01.266144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1cd47387-7797-4f87-a54b-28ae5fc1c59e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:01.266888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1cd47387-7797-4f87-a54b-28ae5fc1c59e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:01.274454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d112d9c0-e52a-403c-9117-863243a5ee79 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:01.275830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d112d9c0-e52a-403c-9117-863243a5ee79 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:01.286922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d112d9c0-e52a-403c-9117-863243a5ee79 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:01.287688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d112d9c0-e52a-403c-9117-863243a5ee79 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:01.288391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d112d9c0-e52a-403c-9117-863243a5ee79 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:01.293143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d112d9c0-e52a-403c-9117-863243a5ee79 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:01.293143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d112d9c0-e52a-403c-9117-863243a5ee79 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:01.293143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d112d9c0-e52a-403c-9117-863243a5ee79 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:01.595497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d112d9c0-e52a-403c-9117-863243a5ee79 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:01.605626 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d112d9c0-e52a-403c-9117-863243a5ee79 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1313 microversion: 2.1 time: 0.339926 Oct 04 21:23:01.608528 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1866/3735] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:01 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:01.614777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a1cf1d0b-fd98-40ff-8bf4-4c3e4b8bf784 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:01.616553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a1cf1d0b-fd98-40ff-8bf4-4c3e4b8bf784 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:01.627217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1cf1d0b-fd98-40ff-8bf4-4c3e4b8bf784 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:01.628419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1cf1d0b-fd98-40ff-8bf4-4c3e4b8bf784 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:01.629113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1cf1d0b-fd98-40ff-8bf4-4c3e4b8bf784 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:01.630115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1cf1d0b-fd98-40ff-8bf4-4c3e4b8bf784 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:01.630810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1cf1d0b-fd98-40ff-8bf4-4c3e4b8bf784 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:01.632524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1cf1d0b-fd98-40ff-8bf4-4c3e4b8bf784 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:01.660295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1cd47387-7797-4f87-a54b-28ae5fc1c59e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:01.673538 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1cd47387-7797-4f87-a54b-28ae5fc1c59e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.434741 Oct 04 21:23:01.676076 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1870/3736] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:01 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:01.702503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5b4c430f-29ac-48cb-a3fc-690f210f0143 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f57943e8dc0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:01.763891 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5b4c430f-29ac-48cb-a3fc-690f210f0143 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.086514 Oct 04 21:23:01.764915 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1871/3737] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:23:01 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:01.770125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c9bd72f6-66fd-4e14-87dc-4a291b0253ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:01.771027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c9bd72f6-66fd-4e14-87dc-4a291b0253ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:01.779726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9bd72f6-66fd-4e14-87dc-4a291b0253ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:01.780617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9bd72f6-66fd-4e14-87dc-4a291b0253ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:01.781304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9bd72f6-66fd-4e14-87dc-4a291b0253ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:01.782340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9bd72f6-66fd-4e14-87dc-4a291b0253ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:01.783055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9bd72f6-66fd-4e14-87dc-4a291b0253ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:01.783851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9bd72f6-66fd-4e14-87dc-4a291b0253ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:02.009635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a1cf1d0b-fd98-40ff-8bf4-4c3e4b8bf784 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:02.040347 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a1cf1d0b-fd98-40ff-8bf4-4c3e4b8bf784 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1315 microversion: 2.1 time: 0.430420 Oct 04 21:23:02.042745 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1867/3738] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:01 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:02.101205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c9bd72f6-66fd-4e14-87dc-4a291b0253ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:02.117397 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c9bd72f6-66fd-4e14-87dc-4a291b0253ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.351065 Oct 04 21:23:02.119088 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1872/3739] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:01 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:02.156560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6b69736b-5168-4c61-98fd-b545fb4dec1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:02.158158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6b69736b-5168-4c61-98fd-b545fb4dec1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:02.166754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b69736b-5168-4c61-98fd-b545fb4dec1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:02.168012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b69736b-5168-4c61-98fd-b545fb4dec1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:02.168953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b69736b-5168-4c61-98fd-b545fb4dec1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:02.170014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b69736b-5168-4c61-98fd-b545fb4dec1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:02.171272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b69736b-5168-4c61-98fd-b545fb4dec1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:02.171926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b69736b-5168-4c61-98fd-b545fb4dec1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:02.432335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6b69736b-5168-4c61-98fd-b545fb4dec1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Locking {{(pid=122758) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 04 21:23:02.548280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-bd85add3-c631-44c9-91b2-ed4dac5f10cc req-3ffeb999-feed-493e-a657-24aeee1a88cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a90e631-8a66-4d71-9103-68015d052045", "name": "network-vif-plugged", "status": "completed", "tag": "eb356872-cb96-4adc-b7e5-647e1ac67dfe"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:02.562763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bd85add3-c631-44c9-91b2-ed4dac5f10cc req-3ffeb999-feed-493e-a657-24aeee1a88cc service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:02.563837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bd85add3-c631-44c9-91b2-ed4dac5f10cc req-3ffeb999-feed-493e-a657-24aeee1a88cc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:02.564485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bd85add3-c631-44c9-91b2-ed4dac5f10cc req-3ffeb999-feed-493e-a657-24aeee1a88cc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:02.579034 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-bd85add3-c631-44c9-91b2-ed4dac5f10cc req-3ffeb999-feed-493e-a657-24aeee1a88cc service nova] Creating event network-vif-plugged:eb356872-cb96-4adc-b7e5-647e1ac67dfe for instance 8a90e631-8a66-4d71-9103-68015d052045 on n-h2-860282-1 Oct 04 21:23:02.587124 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-bd85add3-c631-44c9-91b2-ed4dac5f10cc req-3ffeb999-feed-493e-a657-24aeee1a88cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050178 Oct 04 21:23:02.588577 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1873/3740] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:02.667921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4d148a24-6190-4d05-8922-ccb389d1a71c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:02.671167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4d148a24-6190-4d05-8922-ccb389d1a71c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:02.709095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d148a24-6190-4d05-8922-ccb389d1a71c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:02.709904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d148a24-6190-4d05-8922-ccb389d1a71c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:02.710531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d148a24-6190-4d05-8922-ccb389d1a71c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:02.711842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d148a24-6190-4d05-8922-ccb389d1a71c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:02.712455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d148a24-6190-4d05-8922-ccb389d1a71c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:02.713177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d148a24-6190-4d05-8922-ccb389d1a71c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:02.906123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4d148a24-6190-4d05-8922-ccb389d1a71c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:02.914002 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4d148a24-6190-4d05-8922-ccb389d1a71c tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1313 microversion: 2.1 time: 0.284938 Oct 04 21:23:02.914581 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1874/3741] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:02 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:02.919466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-eea27f58-2fad-42b0-9b67-6e868d274a42 req-d565da6d-755a-440d-8ce1-589b2cfa58a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33d02c46-7c8d-46b4-b0d3-1b892c9200d8", "tag": "953c5816-9edd-416a-9759-b032a931775c"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:02.929960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-eea27f58-2fad-42b0-9b67-6e868d274a42 req-d565da6d-755a-440d-8ce1-589b2cfa58a7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:02.930442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-eea27f58-2fad-42b0-9b67-6e868d274a42 req-d565da6d-755a-440d-8ce1-589b2cfa58a7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:02.930871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-eea27f58-2fad-42b0-9b67-6e868d274a42 req-d565da6d-755a-440d-8ce1-589b2cfa58a7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:02.942802 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-eea27f58-2fad-42b0-9b67-6e868d274a42 req-d565da6d-755a-440d-8ce1-589b2cfa58a7 service nova] Creating event network-changed:953c5816-9edd-416a-9759-b032a931775c for instance 33d02c46-7c8d-46b4-b0d3-1b892c9200d8 on n-h1-860282-1 Oct 04 21:23:02.947802 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-eea27f58-2fad-42b0-9b67-6e868d274a42 req-d565da6d-755a-440d-8ce1-589b2cfa58a7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032049 Oct 04 21:23:02.948406 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1875/3742] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:02.955580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3f3b5e57-bbfa-4491-b668-c738f5da1582 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f5790777940>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:03.005223 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3f3b5e57-bbfa-4491-b668-c738f5da1582 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.050097 Oct 04 21:23:03.005223 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1876/3743] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:23:02 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:03.089950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-223c03a3-e272-4b7a-8fa4-d22674c2dfc4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:03.091238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-223c03a3-e272-4b7a-8fa4-d22674c2dfc4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:03.102399 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6b69736b-5168-4c61-98fd-b545fb4dec1c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action" status: 202 len: 0 microversion: 2.1 time: 0.956372 Oct 04 21:23:03.104275 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1868/3744] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:23:02 2022] POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action => generated 0 bytes in 960 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:23:03.108689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-223c03a3-e272-4b7a-8fa4-d22674c2dfc4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:03.109238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-223c03a3-e272-4b7a-8fa4-d22674c2dfc4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:03.109864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-223c03a3-e272-4b7a-8fa4-d22674c2dfc4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:03.110867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-223c03a3-e272-4b7a-8fa4-d22674c2dfc4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:03.111334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-223c03a3-e272-4b7a-8fa4-d22674c2dfc4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:03.111775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-223c03a3-e272-4b7a-8fa4-d22674c2dfc4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:03.116327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-77b78391-44b4-4666-8f92-5d8763729ff4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:03.117088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-77b78391-44b4-4666-8f92-5d8763729ff4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:03.124871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77b78391-44b4-4666-8f92-5d8763729ff4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:03.126417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77b78391-44b4-4666-8f92-5d8763729ff4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:03.132504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77b78391-44b4-4666-8f92-5d8763729ff4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:03.132504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77b78391-44b4-4666-8f92-5d8763729ff4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:03.132504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77b78391-44b4-4666-8f92-5d8763729ff4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:03.132504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77b78391-44b4-4666-8f92-5d8763729ff4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:03.394195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-77b78391-44b4-4666-8f92-5d8763729ff4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:03.402472 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-77b78391-44b4-4666-8f92-5d8763729ff4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.291464 Oct 04 21:23:03.418011 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1869/3745] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:03 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:03.427859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-223c03a3-e272-4b7a-8fa4-d22674c2dfc4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:03.446157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6ce436cb-d393-4642-bb14-fbffa20e85d3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:03.447752 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-223c03a3-e272-4b7a-8fa4-d22674c2dfc4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1315 microversion: 2.1 time: 0.374014 Oct 04 21:23:03.448981 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1877/3746] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:03 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:03.454645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ce436cb-d393-4642-bb14-fbffa20e85d3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:03.455366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ce436cb-d393-4642-bb14-fbffa20e85d3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:03.455986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ce436cb-d393-4642-bb14-fbffa20e85d3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:03.514392 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-6ce436cb-d393-4642-bb14-fbffa20e85d3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] HTTP exception thrown: Instance ba61f85c-a75d-451d-a5f7-f9533481c406 is locked Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6ce436cb-d393-4642-bb14-fbffa20e85d3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Request method failure captured: Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action HTTP/1.1 Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 15 Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKMORPit0hTQrPIMzQtQx_UmCBmT5FIo7pDLWqLy5SiNGFiWYKdJzMYINV4AgM5hptJ-4S4yFMnq28D6VhWfZFl9iSPJwvrGQdWsUeuCxZhwibZPh1On3zv9TchRvE7UeNSX7_oKGHxGg-1hbqm1TznUUveZZBszMGCIz2Qsg_TKTD0 Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 0f62474e9d474aa28ac754b712e68652 Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerActionsTestJSON-1285044131 Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f62474e9d474aa28ac754b712e68652"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0f62474e9d474aa28ac754b712e68652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0f62474e9d474aa28ac754b712e68652"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f62474e9d474aa28ac754b712e68652"}]}] Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerActionsTestJSON-1285044131 Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 0f62474e9d474aa28ac754b712e68652 Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerActionsTestJSON-1285044131 Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerActionsTestJSON-1285044131-project Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 8ef7d2991dce46278486e0ee963d4cf3 Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerActionsTestJSON-1285044131-project Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: {"os-stop": {}} Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance ba61f85c-a75d-451d-a5f7-f9533481c406 is locked Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'ba61f85c-a75d-451d-a5f7-f9533481c406', 'body': {'os-stop': {}}} Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance ba61f85c-a75d-451d-a5f7-f9533481c406 is locked Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance ba61f85c-a75d-451d-a5f7-f9533481c406 is locked Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba61f85c-a75d-451d-a5f7-f9533481c406 is locked Oct 04 21:23:03.517018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:03.531568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6ce436cb-d393-4642-bb14-fbffa20e85d3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Returning 409 to user: Instance ba61f85c-a75d-451d-a5f7-f9533481c406 is locked {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:23:03.532712 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6ce436cb-d393-4642-bb14-fbffa20e85d3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action" status: 409 len: 107 microversion: 2.1 time: 0.090531 Oct 04 21:23:03.541006 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1870/3747] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:23:03 2022] POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action => generated 107 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 21:23:03.543948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4a865521-40de-464d-93ab-21d858dedcaa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:03.544511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4a865521-40de-464d-93ab-21d858dedcaa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:03.565257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a865521-40de-464d-93ab-21d858dedcaa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:03.566904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a865521-40de-464d-93ab-21d858dedcaa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:03.567355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a865521-40de-464d-93ab-21d858dedcaa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:03.568107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a865521-40de-464d-93ab-21d858dedcaa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:03.568568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a865521-40de-464d-93ab-21d858dedcaa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:03.573937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a865521-40de-464d-93ab-21d858dedcaa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:03.814872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4a865521-40de-464d-93ab-21d858dedcaa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Unlocking {{(pid=122757) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 21:23:03.938376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6939a39f-eb55-424a-b670-b033ed8ac986 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:03.940080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6939a39f-eb55-424a-b670-b033ed8ac986 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:03.949736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6939a39f-eb55-424a-b670-b033ed8ac986 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:03.950454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6939a39f-eb55-424a-b670-b033ed8ac986 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:03.951007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6939a39f-eb55-424a-b670-b033ed8ac986 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:03.952040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6939a39f-eb55-424a-b670-b033ed8ac986 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:03.953013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6939a39f-eb55-424a-b670-b033ed8ac986 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:03.953826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6939a39f-eb55-424a-b670-b033ed8ac986 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:04.167152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6939a39f-eb55-424a-b670-b033ed8ac986 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:04.179007 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6939a39f-eb55-424a-b670-b033ed8ac986 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1313 microversion: 2.1 time: 0.245858 Oct 04 21:23:04.179977 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1871/3748] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:03 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:04.193574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d2db3262-d628-43de-a539-081ce23fafbd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f57906c48b0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:04.223269 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4a865521-40de-464d-93ab-21d858dedcaa tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action" status: 202 len: 0 microversion: 2.1 time: 0.684014 Oct 04 21:23:04.227292 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1878/3749] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:23:03 2022] POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:23:04.233907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-292dfd65-cdc3-42ed-8977-9157bb65123d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:04.248114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-292dfd65-cdc3-42ed-8977-9157bb65123d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:04.248627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-292dfd65-cdc3-42ed-8977-9157bb65123d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:04.261395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-292dfd65-cdc3-42ed-8977-9157bb65123d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:04.262698 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d2db3262-d628-43de-a539-081ce23fafbd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1426 microversion: 2.1 time: 0.075182 Oct 04 21:23:04.262698 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1872/3750] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:23:04 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1426 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:04.264714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:04.329813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-292dfd65-cdc3-42ed-8977-9157bb65123d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Going to try to stop instance {{(pid=122757) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:23:04.478068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8cf65187-4d2a-4fdb-9557-f717b3d62b23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:04.478904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8cf65187-4d2a-4fdb-9557-f717b3d62b23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:04.486812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cf65187-4d2a-4fdb-9557-f717b3d62b23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:04.487853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cf65187-4d2a-4fdb-9557-f717b3d62b23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:04.488544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cf65187-4d2a-4fdb-9557-f717b3d62b23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:04.489605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cf65187-4d2a-4fdb-9557-f717b3d62b23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:04.490555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cf65187-4d2a-4fdb-9557-f717b3d62b23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:04.490555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cf65187-4d2a-4fdb-9557-f717b3d62b23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:04.642912 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-292dfd65-cdc3-42ed-8977-9157bb65123d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action" status: 202 len: 0 microversion: 2.1 time: 0.414193 Oct 04 21:23:04.644527 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1879/3751] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:23:04 2022] POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:23:04.666983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2baa3d1c-aa02-4357-a6a2-cd71283e52b4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:04.668369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2baa3d1c-aa02-4357-a6a2-cd71283e52b4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:04.680161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2baa3d1c-aa02-4357-a6a2-cd71283e52b4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:04.681498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2baa3d1c-aa02-4357-a6a2-cd71283e52b4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:04.681952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2baa3d1c-aa02-4357-a6a2-cd71283e52b4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:04.682677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2baa3d1c-aa02-4357-a6a2-cd71283e52b4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:04.686100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2baa3d1c-aa02-4357-a6a2-cd71283e52b4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:04.686100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2baa3d1c-aa02-4357-a6a2-cd71283e52b4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:04.686325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8cf65187-4d2a-4fdb-9557-f717b3d62b23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:04.695250 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8cf65187-4d2a-4fdb-9557-f717b3d62b23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1502 microversion: 2.1 time: 0.220676 Oct 04 21:23:04.696437 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1873/3752] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:04 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1502 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:04.723125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-95229f4a-35c0-4795-9281-871b6c2bccb4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:04.724016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-95229f4a-35c0-4795-9281-871b6c2bccb4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:04.732495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95229f4a-35c0-4795-9281-871b6c2bccb4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:04.733281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95229f4a-35c0-4795-9281-871b6c2bccb4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:04.733762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95229f4a-35c0-4795-9281-871b6c2bccb4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:04.734799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95229f4a-35c0-4795-9281-871b6c2bccb4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:04.735257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95229f4a-35c0-4795-9281-871b6c2bccb4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:04.743023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95229f4a-35c0-4795-9281-871b6c2bccb4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:04.767675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-95229f4a-35c0-4795-9281-871b6c2bccb4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:23:04.801796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:04.862072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2baa3d1c-aa02-4357-a6a2-cd71283e52b4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:04.866649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:04.872310 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2baa3d1c-aa02-4357-a6a2-cd71283e52b4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1678 microversion: 2.1 time: 0.214928 Oct 04 21:23:04.893515 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1880/3753] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:04 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1678 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:05.027958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:05.103709 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-95229f4a-35c0-4795-9281-871b6c2bccb4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 204 len: 0 microversion: 2.1 time: 0.384377 Oct 04 21:23:05.104418 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1874/3754] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:23:04 2022] DELETE /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:23:05.120860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eeb825fd-a819-4ba3-937e-25473da1019b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:05.122318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eeb825fd-a819-4ba3-937e-25473da1019b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:05.129291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eeb825fd-a819-4ba3-937e-25473da1019b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:05.129874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eeb825fd-a819-4ba3-937e-25473da1019b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:05.130649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eeb825fd-a819-4ba3-937e-25473da1019b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:05.131544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eeb825fd-a819-4ba3-937e-25473da1019b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:05.132273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eeb825fd-a819-4ba3-937e-25473da1019b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:05.133384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eeb825fd-a819-4ba3-937e-25473da1019b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:05.205161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0f83e045-f5cb-4bf2-a239-82475c942235 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:05.206693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0f83e045-f5cb-4bf2-a239-82475c942235 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:05.214079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f83e045-f5cb-4bf2-a239-82475c942235 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:05.216743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f83e045-f5cb-4bf2-a239-82475c942235 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:05.217377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f83e045-f5cb-4bf2-a239-82475c942235 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:05.219808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f83e045-f5cb-4bf2-a239-82475c942235 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:05.219808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f83e045-f5cb-4bf2-a239-82475c942235 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:05.219808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f83e045-f5cb-4bf2-a239-82475c942235 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:05.365025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eeb825fd-a819-4ba3-937e-25473da1019b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:05.377435 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eeb825fd-a819-4ba3-937e-25473da1019b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1508 microversion: 2.1 time: 0.259866 Oct 04 21:23:05.382062 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1881/3755] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:05 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1508 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:05.383389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=10 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:05.390518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-41ca5069-ed3c-4159-981c-ec347d492549 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f57908bdf70>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:05.421928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0f83e045-f5cb-4bf2-a239-82475c942235 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:05.430969 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0f83e045-f5cb-4bf2-a239-82475c942235 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1313 microversion: 2.1 time: 0.230312 Oct 04 21:23:05.432895 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1875/3756] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:05 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:05.459484 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-41ca5069-ed3c-4159-981c-ec347d492549 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1435 microversion: 2.1 time: 0.077394 Oct 04 21:23:05.460211 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1882/3757] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:23:05 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1435 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:05.474305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-18c7e952-342e-4595-ab0c-92cf010ff915 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b485280>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:05.525755 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-18c7e952-342e-4595-ab0c-92cf010ff915 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 200 len: 1435 microversion: 2.1 time: 0.055153 Oct 04 21:23:05.526353 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1876/3758] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:23:05 2022] GET /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 1435 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:05.547875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ac3e9a5c-a5a3-4fa1-ae34-5a5f36a43402 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:05.553986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ac3e9a5c-a5a3-4fa1-ae34-5a5f36a43402 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:05.561301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac3e9a5c-a5a3-4fa1-ae34-5a5f36a43402 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:05.562014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac3e9a5c-a5a3-4fa1-ae34-5a5f36a43402 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:05.562642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac3e9a5c-a5a3-4fa1-ae34-5a5f36a43402 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:05.563367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac3e9a5c-a5a3-4fa1-ae34-5a5f36a43402 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:05.563989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac3e9a5c-a5a3-4fa1-ae34-5a5f36a43402 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:05.564448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac3e9a5c-a5a3-4fa1-ae34-5a5f36a43402 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:05.820931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ac3e9a5c-a5a3-4fa1-ae34-5a5f36a43402 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:05.830482 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ac3e9a5c-a5a3-4fa1-ae34-5a5f36a43402 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1466 microversion: 2.1 time: 0.289554 Oct 04 21:23:05.837058 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1883/3759] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:05 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1466 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:05.871301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-51f0a7f2-86ef-45aa-bb89-a230cc448ed6 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b405d30>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:05.911519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-878995b2-3122-40ac-ad73-6ad3d5e8b195 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:05.912150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-878995b2-3122-40ac-ad73-6ad3d5e8b195 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:05.918916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-878995b2-3122-40ac-ad73-6ad3d5e8b195 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:05.919654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-878995b2-3122-40ac-ad73-6ad3d5e8b195 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:05.920264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-878995b2-3122-40ac-ad73-6ad3d5e8b195 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:05.921136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-878995b2-3122-40ac-ad73-6ad3d5e8b195 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:05.921848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-878995b2-3122-40ac-ad73-6ad3d5e8b195 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:05.922883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-878995b2-3122-40ac-ad73-6ad3d5e8b195 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:06.126411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-878995b2-3122-40ac-ad73-6ad3d5e8b195 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:06.134204 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-878995b2-3122-40ac-ad73-6ad3d5e8b195 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1678 microversion: 2.1 time: 0.226541 Oct 04 21:23:06.134978 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1884/3760] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:05 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:06.406725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b9f78e3b-1d9e-4d23-9276-e16d25f04ff5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:06.407350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b9f78e3b-1d9e-4d23-9276-e16d25f04ff5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:06.414845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9f78e3b-1d9e-4d23-9276-e16d25f04ff5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:06.415348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9f78e3b-1d9e-4d23-9276-e16d25f04ff5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:06.416083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9f78e3b-1d9e-4d23-9276-e16d25f04ff5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:06.416976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9f78e3b-1d9e-4d23-9276-e16d25f04ff5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:06.417737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9f78e3b-1d9e-4d23-9276-e16d25f04ff5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:06.419065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9f78e3b-1d9e-4d23-9276-e16d25f04ff5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:06.484570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=10 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:06.585169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b9f78e3b-1d9e-4d23-9276-e16d25f04ff5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:06.594687 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b9f78e3b-1d9e-4d23-9276-e16d25f04ff5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1508 microversion: 2.1 time: 0.192513 Oct 04 21:23:06.595278 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1885/3761] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:06 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1508 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:06.610763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-769322ee-2ca9-4d6c-ba80-4e198961fb6a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:06.611385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-769322ee-2ca9-4d6c-ba80-4e198961fb6a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:06.618702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-769322ee-2ca9-4d6c-ba80-4e198961fb6a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:06.619256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-769322ee-2ca9-4d6c-ba80-4e198961fb6a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:06.619709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-769322ee-2ca9-4d6c-ba80-4e198961fb6a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:06.625805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-769322ee-2ca9-4d6c-ba80-4e198961fb6a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:06.625805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-769322ee-2ca9-4d6c-ba80-4e198961fb6a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:06.625805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-769322ee-2ca9-4d6c-ba80-4e198961fb6a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:07.212753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-769322ee-2ca9-4d6c-ba80-4e198961fb6a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:07.222705 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-769322ee-2ca9-4d6c-ba80-4e198961fb6a tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1313 microversion: 2.1 time: 0.615710 Oct 04 21:23:07.233596 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1886/3762] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:06 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1313 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:07.563797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f568b343-2aea-4d06-b9eb-fe6fe2cca6ff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:07.569367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f568b343-2aea-4d06-b9eb-fe6fe2cca6ff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:07.569702 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-51f0a7f2-86ef-45aa-bb89-a230cc448ed6 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "DELETE /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f" status: 204 len: 0 microversion: 2.1 time: 1.703927 Oct 04 21:23:07.572391 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1877/3763] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:05 2022] DELETE /compute/v2.1/images/acf8505e-6a31-40d0-9cf8-eb0b5d64af4f => generated 0 bytes in 1706 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:23:07.575027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f568b343-2aea-4d06-b9eb-fe6fe2cca6ff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:07.575744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f568b343-2aea-4d06-b9eb-fe6fe2cca6ff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:07.576391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f568b343-2aea-4d06-b9eb-fe6fe2cca6ff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:07.577105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f568b343-2aea-4d06-b9eb-fe6fe2cca6ff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:07.577630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f568b343-2aea-4d06-b9eb-fe6fe2cca6ff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:07.578022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f568b343-2aea-4d06-b9eb-fe6fe2cca6ff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:07.578154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1a42ca95-488f-4c3d-9ffb-236018e2d452 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '.version_select at 0x7f578b432d30>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:07.610708 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-1a42ca95-488f-4c3d-9ffb-236018e2d452 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] HTTP exception thrown: Image not found. Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1a42ca95-488f-4c3d-9ffb-236018e2d452 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Request method failure captured: Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf HTTP/1.1 Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKPmY9oNTaMMPwARH5HODxiuXjPlgpComWqPIzNp4YpQK-Z4gqyZkdmxkCD3DPa1-2jd8Drvfl6qeW296PaW0_u4A2dsZfCXBgkfMKlvC8p3W_vepwNtoC0HY-0mPqMaZA1XWJ2EDUh5LfJAbH_L6lo9JytnYylA6ptLW26b9ncUXvU Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7d76b499bb9344a5b3cb93c4cbc0a51c Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesOneServerTestJSON-156626631 Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7d76b499bb9344a5b3cb93c4cbc0a51c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7d76b499bb9344a5b3cb93c4cbc0a51c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7d76b499bb9344a5b3cb93c4cbc0a51c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7d76b499bb9344a5b3cb93c4cbc0a51c"}]}] Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesOneServerTestJSON-156626631 Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7d76b499bb9344a5b3cb93c4cbc0a51c Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-156626631 Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesOneServerTestJSON-156626631-project Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 700a67b5993d48a59a373e9535688793 Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesOneServerTestJSON-156626631-project Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: exception: Image not found. Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '079699b7-b6ad-4f83-942f-bdc208d953bf'} Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 079699b7-b6ad-4f83-942f-bdc208d953bf to delete Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 079699b7-b6ad-4f83-942f-bdc208d953bf could not be found. Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:07.613617 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1a42ca95-488f-4c3d-9ffb-236018e2d452 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Returning 404 to user: Image not found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1a42ca95-488f-4c3d-9ffb-236018e2d452 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "DELETE /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf" status: 404 len: 62 microversion: 2.1 time: 0.041871 Oct 04 21:23:07.620096 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1878/3764] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:07 2022] DELETE /compute/v2.1/images/079699b7-b6ad-4f83-942f-bdc208d953bf => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:23:07.623705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c2342d23-14a0-4f0f-b332-e244e097276e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:07.623705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c2342d23-14a0-4f0f-b332-e244e097276e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:07.628989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2342d23-14a0-4f0f-b332-e244e097276e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:07.629570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2342d23-14a0-4f0f-b332-e244e097276e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:07.629972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2342d23-14a0-4f0f-b332-e244e097276e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:07.630764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2342d23-14a0-4f0f-b332-e244e097276e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:07.631406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2342d23-14a0-4f0f-b332-e244e097276e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:07.631946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2342d23-14a0-4f0f-b332-e244e097276e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:07.891181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f568b343-2aea-4d06-b9eb-fe6fe2cca6ff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:07.907479 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f568b343-2aea-4d06-b9eb-fe6fe2cca6ff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1678 microversion: 2.1 time: 0.682285 Oct 04 21:23:07.908324 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1887/3765] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:07 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1678 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:07.925663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e24a8249-f9d6-49dd-95e4-48e4203cfb51 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:07.927794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e24a8249-f9d6-49dd-95e4-48e4203cfb51 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:07.947333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e24a8249-f9d6-49dd-95e4-48e4203cfb51 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:07.949013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e24a8249-f9d6-49dd-95e4-48e4203cfb51 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:07.952060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e24a8249-f9d6-49dd-95e4-48e4203cfb51 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:07.954609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e24a8249-f9d6-49dd-95e4-48e4203cfb51 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:07.955547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e24a8249-f9d6-49dd-95e4-48e4203cfb51 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:07.956265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e24a8249-f9d6-49dd-95e4-48e4203cfb51 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:08.008924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e24a8249-f9d6-49dd-95e4-48e4203cfb51 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:23:08.067118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c2342d23-14a0-4f0f-b332-e244e097276e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:08.076547 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c2342d23-14a0-4f0f-b332-e244e097276e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1508 microversion: 2.1 time: 0.459399 Oct 04 21:23:08.077127 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1879/3766] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:07 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1508 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:08.082425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-57a10129-e751-486f-9f00-7118b8ea3c6f req-b8a88ea0-7e4c-4d7f-aa07-c92ed9d7c3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a90e631-8a66-4d71-9103-68015d052045", "name": "network-vif-deleted", "tag": "eb356872-cb96-4adc-b7e5-647e1ac67dfe"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:08.092092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-57a10129-e751-486f-9f00-7118b8ea3c6f req-b8a88ea0-7e4c-4d7f-aa07-c92ed9d7c3c4 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:08.092791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-57a10129-e751-486f-9f00-7118b8ea3c6f req-b8a88ea0-7e4c-4d7f-aa07-c92ed9d7c3c4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:08.093442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-57a10129-e751-486f-9f00-7118b8ea3c6f req-b8a88ea0-7e4c-4d7f-aa07-c92ed9d7c3c4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:08.419328 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-57a10129-e751-486f-9f00-7118b8ea3c6f req-b8a88ea0-7e4c-4d7f-aa07-c92ed9d7c3c4 service nova] Creating event network-vif-deleted:eb356872-cb96-4adc-b7e5-647e1ac67dfe for instance 8a90e631-8a66-4d71-9103-68015d052045 on n-h2-860282-1 Oct 04 21:23:08.425221 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-57a10129-e751-486f-9f00-7118b8ea3c6f req-b8a88ea0-7e4c-4d7f-aa07-c92ed9d7c3c4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.346371 Oct 04 21:23:08.426000 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1880/3767] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:08.440027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d38ce8d3-c257-4025-a945-1588cd918781 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:08.440027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d38ce8d3-c257-4025-a945-1588cd918781 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:08.441237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d38ce8d3-c257-4025-a945-1588cd918781 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:08.442121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d38ce8d3-c257-4025-a945-1588cd918781 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:08.442932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d38ce8d3-c257-4025-a945-1588cd918781 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:08.444001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d38ce8d3-c257-4025-a945-1588cd918781 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:08.445335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d38ce8d3-c257-4025-a945-1588cd918781 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:08.446026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d38ce8d3-c257-4025-a945-1588cd918781 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:08.511353 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e24a8249-f9d6-49dd-95e4-48e4203cfb51 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 204 len: 0 microversion: 2.1 time: 0.599746 Oct 04 21:23:08.513511 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1888/3768] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:23:07 2022] DELETE /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:23:08.553381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-22b0ac37-9a04-4c5f-a5c6-743e829eb8be tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:08.554375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-22b0ac37-9a04-4c5f-a5c6-743e829eb8be tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:08.562299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22b0ac37-9a04-4c5f-a5c6-743e829eb8be tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:08.562804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22b0ac37-9a04-4c5f-a5c6-743e829eb8be tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:08.563251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22b0ac37-9a04-4c5f-a5c6-743e829eb8be tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:08.564000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22b0ac37-9a04-4c5f-a5c6-743e829eb8be tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:08.564615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22b0ac37-9a04-4c5f-a5c6-743e829eb8be tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:08.565007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22b0ac37-9a04-4c5f-a5c6-743e829eb8be tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:08.694891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d38ce8d3-c257-4025-a945-1588cd918781 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:08.714593 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d38ce8d3-c257-4025-a945-1588cd918781 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1313 microversion: 2.1 time: 0.283768 Oct 04 21:23:08.714593 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1881/3769] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:08 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:08.737747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-5b7bf91d-5553-4f56-b3e0-3323948df717 req-21977349-ea6a-487f-a942-dbd9b3f53215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4947dfca-605d-4a8f-8ad0-362c13680ab4", "name": "network-vif-unplugged", "status": "completed", "tag": "980665fd-e5bf-42ba-85c6-645ed80a8b3b"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:08.747880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5b7bf91d-5553-4f56-b3e0-3323948df717 req-21977349-ea6a-487f-a942-dbd9b3f53215 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:08.748620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5b7bf91d-5553-4f56-b3e0-3323948df717 req-21977349-ea6a-487f-a942-dbd9b3f53215 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:08.749220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5b7bf91d-5553-4f56-b3e0-3323948df717 req-21977349-ea6a-487f-a942-dbd9b3f53215 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:08.765132 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-5b7bf91d-5553-4f56-b3e0-3323948df717 req-21977349-ea6a-487f-a942-dbd9b3f53215 service nova] Creating event network-vif-unplugged:980665fd-e5bf-42ba-85c6-645ed80a8b3b for instance 4947dfca-605d-4a8f-8ad0-362c13680ab4 on n-h2-860282-1 Oct 04 21:23:08.771222 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-5b7bf91d-5553-4f56-b3e0-3323948df717 req-21977349-ea6a-487f-a942-dbd9b3f53215 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051243 Oct 04 21:23:08.772980 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1882/3770] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:08.843614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-22b0ac37-9a04-4c5f-a5c6-743e829eb8be tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:08.859187 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-22b0ac37-9a04-4c5f-a5c6-743e829eb8be tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1472 microversion: 2.1 time: 0.333683 Oct 04 21:23:08.859709 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1889/3771] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:08 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1472 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:08.937547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9d032dba-c286-41aa-8a39-eed7e9de6b1b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:08.938629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9d032dba-c286-41aa-8a39-eed7e9de6b1b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:08.945189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d032dba-c286-41aa-8a39-eed7e9de6b1b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:08.946087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d032dba-c286-41aa-8a39-eed7e9de6b1b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:08.946734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d032dba-c286-41aa-8a39-eed7e9de6b1b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:08.947655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d032dba-c286-41aa-8a39-eed7e9de6b1b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:08.948312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d032dba-c286-41aa-8a39-eed7e9de6b1b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:08.948960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d032dba-c286-41aa-8a39-eed7e9de6b1b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:09.100635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-227c4d6c-d13f-45ec-882c-5e7e6a1b364d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:09.101257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-227c4d6c-d13f-45ec-882c-5e7e6a1b364d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:09.108731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-227c4d6c-d13f-45ec-882c-5e7e6a1b364d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:09.108731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-227c4d6c-d13f-45ec-882c-5e7e6a1b364d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:09.111091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-227c4d6c-d13f-45ec-882c-5e7e6a1b364d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:09.111091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-227c4d6c-d13f-45ec-882c-5e7e6a1b364d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:09.111091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-227c4d6c-d13f-45ec-882c-5e7e6a1b364d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:09.111091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-227c4d6c-d13f-45ec-882c-5e7e6a1b364d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:09.175393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-227c4d6c-d13f-45ec-882c-5e7e6a1b364d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:09.176278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-227c4d6c-d13f-45ec-882c-5e7e6a1b364d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:09.176423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-227c4d6c-d13f-45ec-882c-5e7e6a1b364d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:09.177092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-227c4d6c-d13f-45ec-882c-5e7e6a1b364d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lazy-loading 'fault' on Instance uuid 8a90e631-8a66-4d71-9103-68015d052045 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:23:09.226583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9d032dba-c286-41aa-8a39-eed7e9de6b1b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:09.235706 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9d032dba-c286-41aa-8a39-eed7e9de6b1b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1678 microversion: 2.1 time: 0.303634 Oct 04 21:23:09.235982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-227c4d6c-d13f-45ec-882c-5e7e6a1b364d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:09.236853 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1883/3772] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:08 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1678 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:09.243932 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-227c4d6c-d13f-45ec-882c-5e7e6a1b364d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1305 microversion: 2.1 time: 0.147752 Oct 04 21:23:09.244649 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1890/3773] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:09 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1305 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:09.741004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-78c4ea44-d4d9-4850-ab06-a73bb466fb59 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:09.743652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-78c4ea44-d4d9-4850-ab06-a73bb466fb59 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:09.751421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78c4ea44-d4d9-4850-ab06-a73bb466fb59 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:09.751967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78c4ea44-d4d9-4850-ab06-a73bb466fb59 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:09.752512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78c4ea44-d4d9-4850-ab06-a73bb466fb59 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:09.754278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78c4ea44-d4d9-4850-ab06-a73bb466fb59 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:09.757295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78c4ea44-d4d9-4850-ab06-a73bb466fb59 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:09.758149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78c4ea44-d4d9-4850-ab06-a73bb466fb59 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:09.886036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5e5220d6-26a6-4f43-8ab3-f9c98613fbcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:09.887436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5e5220d6-26a6-4f43-8ab3-f9c98613fbcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:09.895449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e5220d6-26a6-4f43-8ab3-f9c98613fbcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:09.895985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e5220d6-26a6-4f43-8ab3-f9c98613fbcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:09.896722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e5220d6-26a6-4f43-8ab3-f9c98613fbcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:09.897127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e5220d6-26a6-4f43-8ab3-f9c98613fbcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:09.897611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e5220d6-26a6-4f43-8ab3-f9c98613fbcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:09.898051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e5220d6-26a6-4f43-8ab3-f9c98613fbcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:09.916133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-78c4ea44-d4d9-4850-ab06-a73bb466fb59 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:09.929146 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-78c4ea44-d4d9-4850-ab06-a73bb466fb59 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1313 microversion: 2.1 time: 0.193570 Oct 04 21:23:09.950741 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1884/3774] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:09 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:10.122716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5e5220d6-26a6-4f43-8ab3-f9c98613fbcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:10.130784 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5e5220d6-26a6-4f43-8ab3-f9c98613fbcd tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1472 microversion: 2.1 time: 0.250008 Oct 04 21:23:10.131359 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1891/3775] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:09 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1472 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:10.262287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fa1cc237-e372-47f0-9e94-bd54d049613a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:10.263249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fa1cc237-e372-47f0-9e94-bd54d049613a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:10.268864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a7a4d1fb-6942-4b00-b6e5-fe3d5d8326ed tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:10.271276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa1cc237-e372-47f0-9e94-bd54d049613a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:10.271989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa1cc237-e372-47f0-9e94-bd54d049613a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:10.272567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a7a4d1fb-6942-4b00-b6e5-fe3d5d8326ed tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:10.272721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa1cc237-e372-47f0-9e94-bd54d049613a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:10.273391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa1cc237-e372-47f0-9e94-bd54d049613a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:10.274157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa1cc237-e372-47f0-9e94-bd54d049613a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:10.275064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa1cc237-e372-47f0-9e94-bd54d049613a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:10.283330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7a4d1fb-6942-4b00-b6e5-fe3d5d8326ed tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:10.284293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7a4d1fb-6942-4b00-b6e5-fe3d5d8326ed tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:10.286425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7a4d1fb-6942-4b00-b6e5-fe3d5d8326ed tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:10.287374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7a4d1fb-6942-4b00-b6e5-fe3d5d8326ed tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:10.287904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7a4d1fb-6942-4b00-b6e5-fe3d5d8326ed tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:10.288574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7a4d1fb-6942-4b00-b6e5-fe3d5d8326ed tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:10.335365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7a4d1fb-6942-4b00-b6e5-fe3d5d8326ed tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:10.335870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7a4d1fb-6942-4b00-b6e5-fe3d5d8326ed tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:10.336318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7a4d1fb-6942-4b00-b6e5-fe3d5d8326ed tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:10.337015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-a7a4d1fb-6942-4b00-b6e5-fe3d5d8326ed tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lazy-loading 'fault' on Instance uuid 8a90e631-8a66-4d71-9103-68015d052045 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:23:10.399294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a7a4d1fb-6942-4b00-b6e5-fe3d5d8326ed tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:10.409446 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a7a4d1fb-6942-4b00-b6e5-fe3d5d8326ed tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 200 len: 1305 microversion: 2.1 time: 0.145749 Oct 04 21:23:10.410963 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1892/3776] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:10 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 1305 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:10.628126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fa1cc237-e372-47f0-9e94-bd54d049613a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:10.644753 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fa1cc237-e372-47f0-9e94-bd54d049613a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1678 microversion: 2.1 time: 0.386507 Oct 04 21:23:10.659338 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1885/3777] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:10 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1678 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:10.830991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-c9b15cc2-d469-4fb6-b8f8-361a405175fb req-1efec4ac-60ae-47ea-810a-9097367b0821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d02c46-7c8d-46b4-b0d3-1b892c9200d8", "name": "network-vif-plugged", "status": "completed", "tag": "953c5816-9edd-416a-9759-b032a931775c"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:10.842018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c9b15cc2-d469-4fb6-b8f8-361a405175fb req-1efec4ac-60ae-47ea-810a-9097367b0821 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:10.842834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c9b15cc2-d469-4fb6-b8f8-361a405175fb req-1efec4ac-60ae-47ea-810a-9097367b0821 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:10.843454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c9b15cc2-d469-4fb6-b8f8-361a405175fb req-1efec4ac-60ae-47ea-810a-9097367b0821 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:10.861866 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-c9b15cc2-d469-4fb6-b8f8-361a405175fb req-1efec4ac-60ae-47ea-810a-9097367b0821 service nova] Creating event network-vif-plugged:953c5816-9edd-416a-9759-b032a931775c for instance 33d02c46-7c8d-46b4-b0d3-1b892c9200d8 on n-h1-860282-1 Oct 04 21:23:10.868681 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-c9b15cc2-d469-4fb6-b8f8-361a405175fb req-1efec4ac-60ae-47ea-810a-9097367b0821 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041400 Oct 04 21:23:10.869915 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1893/3778] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:10.957507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-03b17c8d-6042-48ab-a79b-cb92dca5b69f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:10.958747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-03b17c8d-6042-48ab-a79b-cb92dca5b69f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:10.965695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03b17c8d-6042-48ab-a79b-cb92dca5b69f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:10.969255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03b17c8d-6042-48ab-a79b-cb92dca5b69f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:10.969255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03b17c8d-6042-48ab-a79b-cb92dca5b69f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:10.969255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03b17c8d-6042-48ab-a79b-cb92dca5b69f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:10.969255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03b17c8d-6042-48ab-a79b-cb92dca5b69f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:10.969255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03b17c8d-6042-48ab-a79b-cb92dca5b69f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:11.156419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1edabc03-87dc-4c1c-98d1-255093bd7f90 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:11.157895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1edabc03-87dc-4c1c-98d1-255093bd7f90 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:11.164665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1edabc03-87dc-4c1c-98d1-255093bd7f90 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:11.165523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1edabc03-87dc-4c1c-98d1-255093bd7f90 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:11.166227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1edabc03-87dc-4c1c-98d1-255093bd7f90 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:11.167177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1edabc03-87dc-4c1c-98d1-255093bd7f90 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:11.167896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1edabc03-87dc-4c1c-98d1-255093bd7f90 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:11.169213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1edabc03-87dc-4c1c-98d1-255093bd7f90 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:11.188933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-03b17c8d-6042-48ab-a79b-cb92dca5b69f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:11.195249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:11.204156 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-03b17c8d-6042-48ab-a79b-cb92dca5b69f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1313 microversion: 2.1 time: 0.249495 Oct 04 21:23:11.223688 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1886/3779] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:10 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:11.361596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1edabc03-87dc-4c1c-98d1-255093bd7f90 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:11.370205 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1edabc03-87dc-4c1c-98d1-255093bd7f90 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1472 microversion: 2.1 time: 0.219582 Oct 04 21:23:11.370795 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1894/3780] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:11 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1472 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:11.438166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ca6b8c5e-f4ee-49a9-add6-d3b171c45529 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:11.438716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ca6b8c5e-f4ee-49a9-add6-d3b171c45529 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:11.450783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca6b8c5e-f4ee-49a9-add6-d3b171c45529 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:11.451784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca6b8c5e-f4ee-49a9-add6-d3b171c45529 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:11.454878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca6b8c5e-f4ee-49a9-add6-d3b171c45529 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:11.455973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca6b8c5e-f4ee-49a9-add6-d3b171c45529 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:11.460131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca6b8c5e-f4ee-49a9-add6-d3b171c45529 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:11.460752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca6b8c5e-f4ee-49a9-add6-d3b171c45529 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:11.500502 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-ca6b8c5e-f4ee-49a9-add6-d3b171c45529 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance 8a90e631-8a66-4d71-9103-68015d052045 could not be found. Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ca6b8c5e-f4ee-49a9-add6-d3b171c45529 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 HTTP/1.1 Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 8a90e631-8a66-4d71-9103-68015d052045 could not be found. Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '8a90e631-8a66-4d71-9103-68015d052045'} Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a90e631-8a66-4d71-9103-68015d052045 could not be found. Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a90e631-8a66-4d71-9103-68015d052045 could not be found. Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:11.502476 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:11.508246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:11.508246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:23:11.508246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:23:11.508246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:23:11.508246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:23:11.508246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a90e631-8a66-4d71-9103-68015d052045 could not be found. Oct 04 21:23:11.508246 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:11.516130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ca6b8c5e-f4ee-49a9-add6-d3b171c45529 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance 8a90e631-8a66-4d71-9103-68015d052045 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:23:11.517324 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ca6b8c5e-f4ee-49a9-add6-d3b171c45529 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 404 len: 111 microversion: 2.1 time: 0.084972 Oct 04 21:23:11.518484 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1887/3781] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:11 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:23:11.541907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-8b9a018d-bfe1-4df8-be31-2130570b1553 req-977c2a4d-a980-43da-9851-188315c1ec7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4947dfca-605d-4a8f-8ad0-362c13680ab4", "name": "network-vif-deleted", "tag": "980665fd-e5bf-42ba-85c6-645ed80a8b3b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:11.560231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8b9a018d-bfe1-4df8-be31-2130570b1553 req-977c2a4d-a980-43da-9851-188315c1ec7d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:11.561454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8b9a018d-bfe1-4df8-be31-2130570b1553 req-977c2a4d-a980-43da-9851-188315c1ec7d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:11.561919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8b9a018d-bfe1-4df8-be31-2130570b1553 req-977c2a4d-a980-43da-9851-188315c1ec7d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:11.577119 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-8b9a018d-bfe1-4df8-be31-2130570b1553 req-977c2a4d-a980-43da-9851-188315c1ec7d service nova] Creating event network-vif-deleted:980665fd-e5bf-42ba-85c6-645ed80a8b3b for instance 4947dfca-605d-4a8f-8ad0-362c13680ab4 on n-h2-860282-1 Oct 04 21:23:11.582627 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-8b9a018d-bfe1-4df8-be31-2130570b1553 req-977c2a4d-a980-43da-9851-188315c1ec7d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044284 Oct 04 21:23:11.586535 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1895/3782] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:11.670733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4104d197-5cf4-4e2a-abad-5bc114611982 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:11.671360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4104d197-5cf4-4e2a-abad-5bc114611982 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:11.678177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4104d197-5cf4-4e2a-abad-5bc114611982 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:11.678581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4104d197-5cf4-4e2a-abad-5bc114611982 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:11.679025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4104d197-5cf4-4e2a-abad-5bc114611982 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:11.679750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4104d197-5cf4-4e2a-abad-5bc114611982 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:11.680208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4104d197-5cf4-4e2a-abad-5bc114611982 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:11.680638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4104d197-5cf4-4e2a-abad-5bc114611982 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:11.875610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4104d197-5cf4-4e2a-abad-5bc114611982 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:11.884297 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4104d197-5cf4-4e2a-abad-5bc114611982 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1678 microversion: 2.1 time: 0.218366 Oct 04 21:23:11.885203 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1888/3783] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:11 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:11.953769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6911f57d-3dc2-4f65-86c2-d7352a306139 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-923749113", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "f54abd1e-a2a0-4f4b-b858-f3831f4d8295"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:12.033683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-6911f57d-3dc2-4f65-86c2-d7352a306139 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] validate_networks() for [('f54abd1e-a2a0-4f4b-b858-f3831f4d8295', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:23:12.231768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-40577fc0-439d-4e77-8581-229465fddbb9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:12.233311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-40577fc0-439d-4e77-8581-229465fddbb9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:12.242664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40577fc0-439d-4e77-8581-229465fddbb9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:12.243609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40577fc0-439d-4e77-8581-229465fddbb9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:12.244376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40577fc0-439d-4e77-8581-229465fddbb9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:12.245914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40577fc0-439d-4e77-8581-229465fddbb9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:12.248096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40577fc0-439d-4e77-8581-229465fddbb9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:12.248959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40577fc0-439d-4e77-8581-229465fddbb9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:12.504543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-40577fc0-439d-4e77-8581-229465fddbb9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:12.520931 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-40577fc0-439d-4e77-8581-229465fddbb9 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1313 microversion: 2.1 time: 0.294039 Oct 04 21:23:12.522983 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1889/3784] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:12 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:12.530105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ba7d87cb-1968-430b-b82b-c7ff4cb5ae19 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:12.530733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ba7d87cb-1968-430b-b82b-c7ff4cb5ae19 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:12.538625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7d87cb-1968-430b-b82b-c7ff4cb5ae19 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:12.539410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7d87cb-1968-430b-b82b-c7ff4cb5ae19 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:12.540009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7d87cb-1968-430b-b82b-c7ff4cb5ae19 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:12.540869 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7d87cb-1968-430b-b82b-c7ff4cb5ae19 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:12.541684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7d87cb-1968-430b-b82b-c7ff4cb5ae19 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:12.542374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7d87cb-1968-430b-b82b-c7ff4cb5ae19 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:12.594986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7d87cb-1968-430b-b82b-c7ff4cb5ae19 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:12.595490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7d87cb-1968-430b-b82b-c7ff4cb5ae19 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:12.595984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7d87cb-1968-430b-b82b-c7ff4cb5ae19 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:12.596637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-ba7d87cb-1968-430b-b82b-c7ff4cb5ae19 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lazy-loading 'fault' on Instance uuid 4947dfca-605d-4a8f-8ad0-362c13680ab4 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:23:12.689414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ba7d87cb-1968-430b-b82b-c7ff4cb5ae19 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700a67b5993d48a59a373e9535688793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d76b499bb9344a5b3cb93c4cbc0a51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:12.704718 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ba7d87cb-1968-430b-b82b-c7ff4cb5ae19 tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 200 len: 1306 microversion: 2.1 time: 0.179951 Oct 04 21:23:12.706264 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1890/3785] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:12 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 1306 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:12.766502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-6911f57d-3dc2-4f65-86c2-d7352a306139 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:23:12.767872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-6911f57d-3dc2-4f65-86c2-d7352a306139 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:23:12.768881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-6911f57d-3dc2-4f65-86c2-d7352a306139 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:23:12.770040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-6911f57d-3dc2-4f65-86c2-d7352a306139 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:23:12.770479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-6911f57d-3dc2-4f65-86c2-d7352a306139 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:23:12.781469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:12.788842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6911f57d-3dc2-4f65-86c2-d7352a306139 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:12.789347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6911f57d-3dc2-4f65-86c2-d7352a306139 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:12.789984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6911f57d-3dc2-4f65-86c2-d7352a306139 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:12.790860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6911f57d-3dc2-4f65-86c2-d7352a306139 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:12.791336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6911f57d-3dc2-4f65-86c2-d7352a306139 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:12.791763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6911f57d-3dc2-4f65-86c2-d7352a306139 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:12.812516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-6911f57d-3dc2-4f65-86c2-d7352a306139 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Getting quotas for project 68c56e6603d14d9b8ad9c74a9df021c9. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:23:12.818882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-6911f57d-3dc2-4f65-86c2-d7352a306139 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Getting quotas for user 416e0c617ee34a19a7d6936b78c1d94d and project 68c56e6603d14d9b8ad9c74a9df021c9. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:23:12.831972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6911f57d-3dc2-4f65-86c2-d7352a306139 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:23:12.834632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6911f57d-3dc2-4f65-86c2-d7352a306139 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:23:12.909706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9b0e7851-a086-41a9-a993-330574a21cca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:12.910462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9b0e7851-a086-41a9-a993-330574a21cca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:12.916478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b0e7851-a086-41a9-a993-330574a21cca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:12.916971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b0e7851-a086-41a9-a993-330574a21cca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:12.917496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b0e7851-a086-41a9-a993-330574a21cca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:12.918406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b0e7851-a086-41a9-a993-330574a21cca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:12.919033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b0e7851-a086-41a9-a993-330574a21cca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:12.919630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b0e7851-a086-41a9-a993-330574a21cca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:12.968501 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6911f57d-3dc2-4f65-86c2-d7352a306139 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.019879 Oct 04 21:23:12.969415 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1896/3786] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:23:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:23:12.981670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-945af3d7-b8e0-4902-b4fb-5d6b25e2268f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:12.982593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-945af3d7-b8e0-4902-b4fb-5d6b25e2268f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:13.056709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-945af3d7-b8e0-4902-b4fb-5d6b25e2268f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:13.080590 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-945af3d7-b8e0-4902-b4fb-5d6b25e2268f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1214 microversion: 2.1 time: 0.100461 Oct 04 21:23:13.084527 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1897/3787] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:12 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:13.125822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9b0e7851-a086-41a9-a993-330574a21cca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:13.134807 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9b0e7851-a086-41a9-a993-330574a21cca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1678 microversion: 2.1 time: 0.230411 Oct 04 21:23:13.135447 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1891/3788] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:12 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1678 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:13.548395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ff598df7-cdf3-4e8e-aaa1-c7fd0090cd5d tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:13.549009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ff598df7-cdf3-4e8e-aaa1-c7fd0090cd5d tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:13.557840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff598df7-cdf3-4e8e-aaa1-c7fd0090cd5d tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:13.558340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff598df7-cdf3-4e8e-aaa1-c7fd0090cd5d tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:13.559700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff598df7-cdf3-4e8e-aaa1-c7fd0090cd5d tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:13.560931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff598df7-cdf3-4e8e-aaa1-c7fd0090cd5d tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:13.561792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff598df7-cdf3-4e8e-aaa1-c7fd0090cd5d tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:13.562265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff598df7-cdf3-4e8e-aaa1-c7fd0090cd5d tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:13.725051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ff598df7-cdf3-4e8e-aaa1-c7fd0090cd5d tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:13.736190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7919eabf-fb38-45f2-aeaf-1777cbb5d3aa tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:13.737212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7919eabf-fb38-45f2-aeaf-1777cbb5d3aa tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] [instance: 4947dfca-605d-4a8f-8ad0-362c13680ab4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:13.741038 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ff598df7-cdf3-4e8e-aaa1-c7fd0090cd5d tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1500 microversion: 2.1 time: 0.196700 Oct 04 21:23:13.742255 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1898/3789] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:13 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1500 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:13.744736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7919eabf-fb38-45f2-aeaf-1777cbb5d3aa tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:13.745234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7919eabf-fb38-45f2-aeaf-1777cbb5d3aa tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:13.745715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7919eabf-fb38-45f2-aeaf-1777cbb5d3aa tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:13.747216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7919eabf-fb38-45f2-aeaf-1777cbb5d3aa tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:13.747668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7919eabf-fb38-45f2-aeaf-1777cbb5d3aa tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:13.748261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7919eabf-fb38-45f2-aeaf-1777cbb5d3aa tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:13.768444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-79019a4e-7ef8-41a8-a7f6-d1fabcd2d8a8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:13.770980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-79019a4e-7ef8-41a8-a7f6-d1fabcd2d8a8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-7919eabf-fb38-45f2-aeaf-1777cbb5d3aa tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] HTTP exception thrown: Instance 4947dfca-605d-4a8f-8ad0-362c13680ab4 could not be found. Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7919eabf-fb38-45f2-aeaf-1777cbb5d3aa tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Request method failure captured: Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 HTTP/1.1 Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKPmY9oNTaMMPwARH5HODxiuXjPlgpComWqPIzNp4YpQK-Z4gqyZkdmxkCD3DPa1-2jd8Drvfl6qeW296PaW0_u4A2dsZfCXBgkfMKlvC8p3W_vepwNtoC0HY-0mPqMaZA1XWJ2EDUh5LfJAbH_L6lo9JytnYylA6ptLW26b9ncUXvU Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7d76b499bb9344a5b3cb93c4cbc0a51c Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ImagesOneServerTestJSON-156626631 Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7d76b499bb9344a5b3cb93c4cbc0a51c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7d76b499bb9344a5b3cb93c4cbc0a51c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7d76b499bb9344a5b3cb93c4cbc0a51c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7d76b499bb9344a5b3cb93c4cbc0a51c"}]}] Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ImagesOneServerTestJSON-156626631 Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7d76b499bb9344a5b3cb93c4cbc0a51c Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-156626631 Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ImagesOneServerTestJSON-156626631-project Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 700a67b5993d48a59a373e9535688793 Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ImagesOneServerTestJSON-156626631-project Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 4947dfca-605d-4a8f-8ad0-362c13680ab4 could not be found. Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '4947dfca-605d-4a8f-8ad0-362c13680ab4'} Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4947dfca-605d-4a8f-8ad0-362c13680ab4 could not be found. Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:23:13.774948 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:23:13.780321 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4947dfca-605d-4a8f-8ad0-362c13680ab4 could not be found. Oct 04 21:23:13.780321 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:13.780321 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:13.780321 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:13.780321 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:13.780321 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:23:13.780321 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:23:13.780321 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:23:13.780321 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:23:13.780321 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4947dfca-605d-4a8f-8ad0-362c13680ab4 could not be found. Oct 04 21:23:13.780321 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:13.780321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7919eabf-fb38-45f2-aeaf-1777cbb5d3aa tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] Returning 404 to user: Instance 4947dfca-605d-4a8f-8ad0-362c13680ab4 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:23:13.780321 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7919eabf-fb38-45f2-aeaf-1777cbb5d3aa tempest-ImagesOneServerTestJSON-156626631 tempest-ImagesOneServerTestJSON-156626631-project] 10.222.0.30 "GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4" status: 404 len: 111 microversion: 2.1 time: 0.043795 Oct 04 21:23:13.781454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79019a4e-7ef8-41a8-a7f6-d1fabcd2d8a8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:13.781454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79019a4e-7ef8-41a8-a7f6-d1fabcd2d8a8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:13.781673 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1892/3790] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:13 2022] GET /compute/v2.1/servers/4947dfca-605d-4a8f-8ad0-362c13680ab4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:23:13.781779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79019a4e-7ef8-41a8-a7f6-d1fabcd2d8a8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:13.781939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79019a4e-7ef8-41a8-a7f6-d1fabcd2d8a8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:13.782414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79019a4e-7ef8-41a8-a7f6-d1fabcd2d8a8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:13.782950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79019a4e-7ef8-41a8-a7f6-d1fabcd2d8a8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:13.807545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-79019a4e-7ef8-41a8-a7f6-d1fabcd2d8a8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lazy-loading 'flavor' on Instance uuid 33d02c46-7c8d-46b4-b0d3-1b892c9200d8 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:23:14.103267 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-79019a4e-7ef8-41a8-a7f6-d1fabcd2d8a8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "POST /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8/action" status: 200 len: 32 microversion: 2.1 time: 0.338528 Oct 04 21:23:14.104571 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1899/3791] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:23:13 2022] POST /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8/action => generated 32 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:23:14.107729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-40b95d19-a354-4369-a037-f433aceb941d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:14.108410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-40b95d19-a354-4369-a037-f433aceb941d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:14.115279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d4084742-6352-4112-b9f5-5c938800eef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:14.115780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40b95d19-a354-4369-a037-f433aceb941d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:14.116117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d4084742-6352-4112-b9f5-5c938800eef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:14.116532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40b95d19-a354-4369-a037-f433aceb941d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:14.116971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40b95d19-a354-4369-a037-f433aceb941d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:14.117697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40b95d19-a354-4369-a037-f433aceb941d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:14.118327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40b95d19-a354-4369-a037-f433aceb941d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:14.119344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40b95d19-a354-4369-a037-f433aceb941d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:14.127300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4084742-6352-4112-b9f5-5c938800eef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:14.127814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4084742-6352-4112-b9f5-5c938800eef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:14.128262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4084742-6352-4112-b9f5-5c938800eef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:14.128979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4084742-6352-4112-b9f5-5c938800eef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:14.129537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4084742-6352-4112-b9f5-5c938800eef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:14.129906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4084742-6352-4112-b9f5-5c938800eef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:14.201876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-40b95d19-a354-4369-a037-f433aceb941d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:14.213100 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-40b95d19-a354-4369-a037-f433aceb941d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1218 microversion: 2.1 time: 0.110126 Oct 04 21:23:14.219992 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1893/3792] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:14 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:14.225650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2e607e4d-9604-4d87-aef1-8a0da9dd9ddd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:14.226151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2e607e4d-9604-4d87-aef1-8a0da9dd9ddd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:14.256325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e607e4d-9604-4d87-aef1-8a0da9dd9ddd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:14.256823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e607e4d-9604-4d87-aef1-8a0da9dd9ddd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:14.257260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e607e4d-9604-4d87-aef1-8a0da9dd9ddd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:14.257995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e607e4d-9604-4d87-aef1-8a0da9dd9ddd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:14.259525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e607e4d-9604-4d87-aef1-8a0da9dd9ddd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:14.259963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e607e4d-9604-4d87-aef1-8a0da9dd9ddd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:14.454012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d4084742-6352-4112-b9f5-5c938800eef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:14.464501 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d4084742-6352-4112-b9f5-5c938800eef3 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.353744 Oct 04 21:23:14.469761 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1900/3793] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:14 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:14.534050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2e607e4d-9604-4d87-aef1-8a0da9dd9ddd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:14.544538 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2e607e4d-9604-4d87-aef1-8a0da9dd9ddd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1678 microversion: 2.1 time: 0.325292 Oct 04 21:23:14.547688 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1894/3794] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:14 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1678 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:15.244292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-73e7f73d-758b-4aed-858c-e3cf875fff63 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:15.245884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-73e7f73d-758b-4aed-858c-e3cf875fff63 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:15.261265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73e7f73d-758b-4aed-858c-e3cf875fff63 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:15.273271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73e7f73d-758b-4aed-858c-e3cf875fff63 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:15.274406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73e7f73d-758b-4aed-858c-e3cf875fff63 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:15.275197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73e7f73d-758b-4aed-858c-e3cf875fff63 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:15.275692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73e7f73d-758b-4aed-858c-e3cf875fff63 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:15.289393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73e7f73d-758b-4aed-858c-e3cf875fff63 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:15.391248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-73e7f73d-758b-4aed-858c-e3cf875fff63 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:15.399214 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-73e7f73d-758b-4aed-858c-e3cf875fff63 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1266 microversion: 2.1 time: 0.159812 Oct 04 21:23:15.400084 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1901/3795] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:15 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:15.495300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-13da205b-ac56-4cf0-8b24-619c6081b6cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:15.495937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-13da205b-ac56-4cf0-8b24-619c6081b6cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:15.507022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13da205b-ac56-4cf0-8b24-619c6081b6cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:15.507324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13da205b-ac56-4cf0-8b24-619c6081b6cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:15.507835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13da205b-ac56-4cf0-8b24-619c6081b6cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:15.514296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13da205b-ac56-4cf0-8b24-619c6081b6cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:15.514782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13da205b-ac56-4cf0-8b24-619c6081b6cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:15.516865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13da205b-ac56-4cf0-8b24-619c6081b6cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:15.571743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-73b6e8de-4d4e-4b17-a840-b8f2632fe057 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:15.572360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-73b6e8de-4d4e-4b17-a840-b8f2632fe057 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:15.587287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73b6e8de-4d4e-4b17-a840-b8f2632fe057 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:15.587779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73b6e8de-4d4e-4b17-a840-b8f2632fe057 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:15.597305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73b6e8de-4d4e-4b17-a840-b8f2632fe057 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:15.601249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73b6e8de-4d4e-4b17-a840-b8f2632fe057 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:15.602665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73b6e8de-4d4e-4b17-a840-b8f2632fe057 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:15.603123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73b6e8de-4d4e-4b17-a840-b8f2632fe057 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:15.935128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-13da205b-ac56-4cf0-8b24-619c6081b6cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:15.948341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:15.957804 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-13da205b-ac56-4cf0-8b24-619c6081b6cf tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.464689 Oct 04 21:23:15.961799 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1895/3796] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:15 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:16.071913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-73b6e8de-4d4e-4b17-a840-b8f2632fe057 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:16.084013 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-73b6e8de-4d4e-4b17-a840-b8f2632fe057 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1655 microversion: 2.1 time: 0.516088 Oct 04 21:23:16.087122 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1902/3797] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:15 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1655 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:16.113802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3a578e81-63d2-4a25-93f7-89c5705638ba tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:16.121802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a578e81-63d2-4a25-93f7-89c5705638ba tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:16.122641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a578e81-63d2-4a25-93f7-89c5705638ba tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:16.123275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a578e81-63d2-4a25-93f7-89c5705638ba tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:16.169469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3a578e81-63d2-4a25-93f7-89c5705638ba tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Going to try to start instance {{(pid=122758) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 21:23:16.413608 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3a578e81-63d2-4a25-93f7-89c5705638ba tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action" status: 202 len: 0 microversion: 2.1 time: 0.303859 Oct 04 21:23:16.419099 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1896/3798] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:23:16 2022] POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:23:16.427324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c9128a0d-abec-4012-8d14-8431fe8c0c8e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:16.428959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c9128a0d-abec-4012-8d14-8431fe8c0c8e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:16.440524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e71f7ce8-a888-46ca-a3ba-e07b337693d4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:16.442259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e71f7ce8-a888-46ca-a3ba-e07b337693d4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:16.448960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e71f7ce8-a888-46ca-a3ba-e07b337693d4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:16.450186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e71f7ce8-a888-46ca-a3ba-e07b337693d4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:16.451094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e71f7ce8-a888-46ca-a3ba-e07b337693d4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:16.452504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e71f7ce8-a888-46ca-a3ba-e07b337693d4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:16.453805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e71f7ce8-a888-46ca-a3ba-e07b337693d4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:16.454562 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e71f7ce8-a888-46ca-a3ba-e07b337693d4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:16.455177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9128a0d-abec-4012-8d14-8431fe8c0c8e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:16.455788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9128a0d-abec-4012-8d14-8431fe8c0c8e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:16.456247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9128a0d-abec-4012-8d14-8431fe8c0c8e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:16.462899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9128a0d-abec-4012-8d14-8431fe8c0c8e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:16.474388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9128a0d-abec-4012-8d14-8431fe8c0c8e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:16.480134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9128a0d-abec-4012-8d14-8431fe8c0c8e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:16.671886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e71f7ce8-a888-46ca-a3ba-e07b337693d4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:16.680340 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e71f7ce8-a888-46ca-a3ba-e07b337693d4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1272 microversion: 2.1 time: 0.259781 Oct 04 21:23:16.681357 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1897/3799] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:16 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1272 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:16.825605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c9128a0d-abec-4012-8d14-8431fe8c0c8e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:16.843656 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c9128a0d-abec-4012-8d14-8431fe8c0c8e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1664 microversion: 2.1 time: 0.424003 Oct 04 21:23:16.844257 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1903/3800] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:16 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1664 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:16.987277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cd7e76d5-af4c-47f3-8fa7-7e7ed68d7d1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:16.988261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cd7e76d5-af4c-47f3-8fa7-7e7ed68d7d1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:17.012888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd7e76d5-af4c-47f3-8fa7-7e7ed68d7d1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:17.013748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd7e76d5-af4c-47f3-8fa7-7e7ed68d7d1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:17.015561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd7e76d5-af4c-47f3-8fa7-7e7ed68d7d1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:17.022956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd7e76d5-af4c-47f3-8fa7-7e7ed68d7d1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:17.025798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd7e76d5-af4c-47f3-8fa7-7e7ed68d7d1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:17.026513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd7e76d5-af4c-47f3-8fa7-7e7ed68d7d1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:17.579441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cd7e76d5-af4c-47f3-8fa7-7e7ed68d7d1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:17.614865 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cd7e76d5-af4c-47f3-8fa7-7e7ed68d7d1e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.633910 Oct 04 21:23:17.626785 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1898/3801] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:16 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:17.720455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d2bba2d1-11c9-40d7-ae81-9caa8b4c71d5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:17.720455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d2bba2d1-11c9-40d7-ae81-9caa8b4c71d5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:17.745709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2bba2d1-11c9-40d7-ae81-9caa8b4c71d5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:17.747274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2bba2d1-11c9-40d7-ae81-9caa8b4c71d5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:17.749061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2bba2d1-11c9-40d7-ae81-9caa8b4c71d5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:17.752304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2bba2d1-11c9-40d7-ae81-9caa8b4c71d5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:17.753443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2bba2d1-11c9-40d7-ae81-9caa8b4c71d5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:17.755072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2bba2d1-11c9-40d7-ae81-9caa8b4c71d5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:17.836369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e947fd08-43d5-4905-a867-9bb4e28e4738 tempest-ListImageFiltersNegativeTestJSON-31887424 tempest-ListImageFiltersNegativeTestJSON-31887424-project] Calling method '.version_select at 0x7f579059f430>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:17.871661 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-e947fd08-43d5-4905-a867-9bb4e28e4738 tempest-ListImageFiltersNegativeTestJSON-31887424 tempest-ListImageFiltersNegativeTestJSON-31887424-project] HTTP exception thrown: Image not found. Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e947fd08-43d5-4905-a867-9bb4e28e4738 tempest-ListImageFiltersNegativeTestJSON-31887424 tempest-ListImageFiltersNegativeTestJSON-31887424-project] Request method failure captured: Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/images/dd69073f-2d41-4363-8ea1-b782276aa74b HTTP/1.1 Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKRFRRbyN48bFuXmBVWBQA47TfylZiW3G7payLRUWgIySh_7eNUCtGvpSCHQA79zA_Zsi9Rgci_02VQxa1zSkw0_P18ZmcgXABLo-xMMO-9UW8fpUIq1Nk82JVJLbUCGTA9uojONdPmaytBu8mKeVy71TJ5057BgmoMB1Btil1xIff0 Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 6aada6d10cad46b3b582521853d54334 Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-31887424 Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6aada6d10cad46b3b582521853d54334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6aada6d10cad46b3b582521853d54334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6aada6d10cad46b3b582521853d54334"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6aada6d10cad46b3b582521853d54334"}]}] Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-31887424 Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 6aada6d10cad46b3b582521853d54334 Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-31887424 Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ListImageFiltersNegativeTestJSON-31887424-project Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 13ff1545cadb49ca9914226b9ba9a80d Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-31887424-project Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: exception: Image not found. Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'dd69073f-2d41-4363-8ea1-b782276aa74b'} Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID dd69073f-2d41-4363-8ea1-b782276aa74b Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 21:23:17.874984 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dd69073f-2d41-4363-8ea1-b782276aa74b could not be found. Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:23:17.882351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e947fd08-43d5-4905-a867-9bb4e28e4738 tempest-ListImageFiltersNegativeTestJSON-31887424 tempest-ListImageFiltersNegativeTestJSON-31887424-project] Returning 404 to user: Image not found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:23:17.891941 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e947fd08-43d5-4905-a867-9bb4e28e4738 tempest-ListImageFiltersNegativeTestJSON-31887424 tempest-ListImageFiltersNegativeTestJSON-31887424-project] 10.222.0.30 "GET /compute/v2.1/images/dd69073f-2d41-4363-8ea1-b782276aa74b" status: 404 len: 62 microversion: 2.1 time: 0.454873 Oct 04 21:23:17.896628 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1904/3802] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 21:23:17 2022] GET /compute/v2.1/images/dd69073f-2d41-4363-8ea1-b782276aa74b => generated 62 bytes in 457 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:23:17.902116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fbc2c336-2678-457f-824a-08679b0b8c46 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:17.905228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fbc2c336-2678-457f-824a-08679b0b8c46 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:17.915659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fbc2c336-2678-457f-824a-08679b0b8c46 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:17.916232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fbc2c336-2678-457f-824a-08679b0b8c46 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:17.916844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fbc2c336-2678-457f-824a-08679b0b8c46 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:17.918861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fbc2c336-2678-457f-824a-08679b0b8c46 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:17.920678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fbc2c336-2678-457f-824a-08679b0b8c46 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:17.921123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fbc2c336-2678-457f-824a-08679b0b8c46 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:18.165036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d2bba2d1-11c9-40d7-ae81-9caa8b4c71d5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:18.175157 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d2bba2d1-11c9-40d7-ae81-9caa8b4c71d5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1314 microversion: 2.1 time: 0.469921 Oct 04 21:23:18.180397 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1899/3803] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:17 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:18.330312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fbc2c336-2678-457f-824a-08679b0b8c46 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:18.341675 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fbc2c336-2678-457f-824a-08679b0b8c46 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1664 microversion: 2.1 time: 0.446555 Oct 04 21:23:18.343403 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1905/3804] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:17 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1664 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:18.646456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-92d95f04-5e8f-4d36-9d0f-783af9729b7b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:18.647484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-92d95f04-5e8f-4d36-9d0f-783af9729b7b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:18.669824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92d95f04-5e8f-4d36-9d0f-783af9729b7b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:18.671163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92d95f04-5e8f-4d36-9d0f-783af9729b7b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:18.673906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92d95f04-5e8f-4d36-9d0f-783af9729b7b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:18.675964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92d95f04-5e8f-4d36-9d0f-783af9729b7b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:18.677245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92d95f04-5e8f-4d36-9d0f-783af9729b7b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:18.680267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92d95f04-5e8f-4d36-9d0f-783af9729b7b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:18.962665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-92d95f04-5e8f-4d36-9d0f-783af9729b7b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:18.976440 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-92d95f04-5e8f-4d36-9d0f-783af9729b7b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.334181 Oct 04 21:23:18.977944 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1900/3805] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:18 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:19.205523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-980b9853-a95f-4790-961d-d87380ceb38f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:19.205523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-980b9853-a95f-4790-961d-d87380ceb38f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:19.216013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-980b9853-a95f-4790-961d-d87380ceb38f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:19.221265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-980b9853-a95f-4790-961d-d87380ceb38f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:19.222067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-980b9853-a95f-4790-961d-d87380ceb38f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:19.223645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-980b9853-a95f-4790-961d-d87380ceb38f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:19.224430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-980b9853-a95f-4790-961d-d87380ceb38f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:19.226043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-980b9853-a95f-4790-961d-d87380ceb38f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:19.377615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7aaf541c-e9de-49c3-be20-ba79ad45c64e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:19.378764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7aaf541c-e9de-49c3-be20-ba79ad45c64e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:19.389071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7aaf541c-e9de-49c3-be20-ba79ad45c64e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:19.392772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7aaf541c-e9de-49c3-be20-ba79ad45c64e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:19.393644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7aaf541c-e9de-49c3-be20-ba79ad45c64e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:19.395188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7aaf541c-e9de-49c3-be20-ba79ad45c64e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:19.397909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7aaf541c-e9de-49c3-be20-ba79ad45c64e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:19.399175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7aaf541c-e9de-49c3-be20-ba79ad45c64e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:19.526645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-980b9853-a95f-4790-961d-d87380ceb38f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:19.541798 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-980b9853-a95f-4790-961d-d87380ceb38f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1314 microversion: 2.1 time: 0.341002 Oct 04 21:23:19.544614 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1906/3806] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:19 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:19.631140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7aaf541c-e9de-49c3-be20-ba79ad45c64e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:19.640445 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7aaf541c-e9de-49c3-be20-ba79ad45c64e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.277128 Oct 04 21:23:19.641572 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1901/3807] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:19 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:19.665251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dee049fb-e048-43f8-97fc-9bad6a195072 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:19.666384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dee049fb-e048-43f8-97fc-9bad6a195072 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:19.678944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dee049fb-e048-43f8-97fc-9bad6a195072 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:19.679786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dee049fb-e048-43f8-97fc-9bad6a195072 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:19.680874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dee049fb-e048-43f8-97fc-9bad6a195072 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:19.681889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dee049fb-e048-43f8-97fc-9bad6a195072 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:19.682461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dee049fb-e048-43f8-97fc-9bad6a195072 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:19.683053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dee049fb-e048-43f8-97fc-9bad6a195072 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:19.697211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-c38e1d3b-0f9e-4d48-b573-bdd92344c36b req-96927241-94d0-4fac-b91d-85b4170e6f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541881f6-6361-4971-b222-65fbd3878425", "tag": "5bf3fe20-6955-4e62-8eee-3a53f13f5a34"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:19.714237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c38e1d3b-0f9e-4d48-b573-bdd92344c36b req-96927241-94d0-4fac-b91d-85b4170e6f31 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:19.715401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c38e1d3b-0f9e-4d48-b573-bdd92344c36b req-96927241-94d0-4fac-b91d-85b4170e6f31 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:19.715914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c38e1d3b-0f9e-4d48-b573-bdd92344c36b req-96927241-94d0-4fac-b91d-85b4170e6f31 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:19.732623 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-c38e1d3b-0f9e-4d48-b573-bdd92344c36b req-96927241-94d0-4fac-b91d-85b4170e6f31 service nova] Creating event network-changed:5bf3fe20-6955-4e62-8eee-3a53f13f5a34 for instance 541881f6-6361-4971-b222-65fbd3878425 on n-h2-860282-1 Oct 04 21:23:19.738507 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-c38e1d3b-0f9e-4d48-b573-bdd92344c36b req-96927241-94d0-4fac-b91d-85b4170e6f31 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045518 Oct 04 21:23:19.739898 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1902/3808] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:20.003149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-536038d3-e916-46a7-979f-701d45d5b00b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:20.004220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-536038d3-e916-46a7-979f-701d45d5b00b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:20.016114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-536038d3-e916-46a7-979f-701d45d5b00b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:20.018543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dee049fb-e048-43f8-97fc-9bad6a195072 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:20.020088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-536038d3-e916-46a7-979f-701d45d5b00b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:20.021395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-536038d3-e916-46a7-979f-701d45d5b00b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:20.024448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-536038d3-e916-46a7-979f-701d45d5b00b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:20.029635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-536038d3-e916-46a7-979f-701d45d5b00b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:20.029635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-536038d3-e916-46a7-979f-701d45d5b00b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:20.030884 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dee049fb-e048-43f8-97fc-9bad6a195072 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.369401 Oct 04 21:23:20.042143 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1907/3809] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:19 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:20.068875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-34f83106-ba20-42b1-912b-ebb9e1e0feae tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:20.070055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-34f83106-ba20-42b1-912b-ebb9e1e0feae tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:20.089330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34f83106-ba20-42b1-912b-ebb9e1e0feae tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:20.090290 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34f83106-ba20-42b1-912b-ebb9e1e0feae tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:20.090989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34f83106-ba20-42b1-912b-ebb9e1e0feae tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:20.091719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34f83106-ba20-42b1-912b-ebb9e1e0feae tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:20.092247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34f83106-ba20-42b1-912b-ebb9e1e0feae tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:20.092707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34f83106-ba20-42b1-912b-ebb9e1e0feae tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:20.389338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-34f83106-ba20-42b1-912b-ebb9e1e0feae tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Unlocking {{(pid=122757) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 21:23:20.475942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-536038d3-e916-46a7-979f-701d45d5b00b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:20.499614 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-536038d3-e916-46a7-979f-701d45d5b00b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.502080 Oct 04 21:23:20.502702 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1903/3810] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:19 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:20.581570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-244f97d2-3513-4696-bb1c-1f643eb60391 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:20.582541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-244f97d2-3513-4696-bb1c-1f643eb60391 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:20.593333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-244f97d2-3513-4696-bb1c-1f643eb60391 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:20.598949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-244f97d2-3513-4696-bb1c-1f643eb60391 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:20.615814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-244f97d2-3513-4696-bb1c-1f643eb60391 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:20.615814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-244f97d2-3513-4696-bb1c-1f643eb60391 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:20.615814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-244f97d2-3513-4696-bb1c-1f643eb60391 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:20.615814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-244f97d2-3513-4696-bb1c-1f643eb60391 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:21.120122 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-34f83106-ba20-42b1-912b-ebb9e1e0feae tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action" status: 202 len: 0 microversion: 2.1 time: 1.066785 Oct 04 21:23:21.126379 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1908/3811] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:23:20 2022] POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action => generated 0 bytes in 1074 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:23:21.134632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-49c1aa52-a716-4037-be23-dc6c6e7ecc8b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:21.135618 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-49c1aa52-a716-4037-be23-dc6c6e7ecc8b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:21.144604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49c1aa52-a716-4037-be23-dc6c6e7ecc8b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:21.145521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49c1aa52-a716-4037-be23-dc6c6e7ecc8b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:21.146276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49c1aa52-a716-4037-be23-dc6c6e7ecc8b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:21.147362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49c1aa52-a716-4037-be23-dc6c6e7ecc8b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:21.148052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49c1aa52-a716-4037-be23-dc6c6e7ecc8b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:21.148722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49c1aa52-a716-4037-be23-dc6c6e7ecc8b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:21.207430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:21.380161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-244f97d2-3513-4696-bb1c-1f643eb60391 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:21.392125 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-244f97d2-3513-4696-bb1c-1f643eb60391 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1314 microversion: 2.1 time: 0.827338 Oct 04 21:23:21.393902 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1904/3812] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:20 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1314 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:21.550882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8ede71cd-0a59-4490-a858-793076bf49f5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:21.550882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8ede71cd-0a59-4490-a858-793076bf49f5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:21.559836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ede71cd-0a59-4490-a858-793076bf49f5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:21.560347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ede71cd-0a59-4490-a858-793076bf49f5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:21.562009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ede71cd-0a59-4490-a858-793076bf49f5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:21.563974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ede71cd-0a59-4490-a858-793076bf49f5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:21.564469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ede71cd-0a59-4490-a858-793076bf49f5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:21.564911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ede71cd-0a59-4490-a858-793076bf49f5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:21.580473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-49c1aa52-a716-4037-be23-dc6c6e7ecc8b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:21.590349 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-49c1aa52-a716-4037-be23-dc6c6e7ecc8b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.461328 Oct 04 21:23:21.591023 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1909/3813] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:21 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:21.622656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d8b1fda1-c5f1-478e-b790-e2b484b33c29 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:21.623611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d8b1fda1-c5f1-478e-b790-e2b484b33c29 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:21.644753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8b1fda1-c5f1-478e-b790-e2b484b33c29 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:21.645558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8b1fda1-c5f1-478e-b790-e2b484b33c29 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:21.646186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8b1fda1-c5f1-478e-b790-e2b484b33c29 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:21.647174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8b1fda1-c5f1-478e-b790-e2b484b33c29 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:21.647802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8b1fda1-c5f1-478e-b790-e2b484b33c29 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:21.648400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8b1fda1-c5f1-478e-b790-e2b484b33c29 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:22.203387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8ede71cd-0a59-4490-a858-793076bf49f5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:22.211575 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8ede71cd-0a59-4490-a858-793076bf49f5 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.687492 Oct 04 21:23:22.212714 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1905/3814] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:21 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:22.406905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d8b1fda1-c5f1-478e-b790-e2b484b33c29 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:22.416014 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d8b1fda1-c5f1-478e-b790-e2b484b33c29 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.798600 Oct 04 21:23:22.416607 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1910/3815] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:21 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:22.419332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7f875871-6337-4ac1-b811-d42f80f3090b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:22.420063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7f875871-6337-4ac1-b811-d42f80f3090b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:22.429837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f875871-6337-4ac1-b811-d42f80f3090b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:22.430474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f875871-6337-4ac1-b811-d42f80f3090b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:22.430996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f875871-6337-4ac1-b811-d42f80f3090b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:22.431723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f875871-6337-4ac1-b811-d42f80f3090b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:22.432188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f875871-6337-4ac1-b811-d42f80f3090b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:22.432618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f875871-6337-4ac1-b811-d42f80f3090b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:22.447194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7ebcb3a6-3e2c-4005-8858-20a1ad173a59 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:22.448097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7ebcb3a6-3e2c-4005-8858-20a1ad173a59 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:22.462000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ebcb3a6-3e2c-4005-8858-20a1ad173a59 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:22.463197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ebcb3a6-3e2c-4005-8858-20a1ad173a59 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:22.465513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ebcb3a6-3e2c-4005-8858-20a1ad173a59 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:22.472539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ebcb3a6-3e2c-4005-8858-20a1ad173a59 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:22.474063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ebcb3a6-3e2c-4005-8858-20a1ad173a59 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:22.475441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ebcb3a6-3e2c-4005-8858-20a1ad173a59 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:22.774845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7f875871-6337-4ac1-b811-d42f80f3090b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:22.793843 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7f875871-6337-4ac1-b811-d42f80f3090b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1314 microversion: 2.1 time: 0.377563 Oct 04 21:23:22.795895 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1906/3816] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:22 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:22.804345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:22.830812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7ebcb3a6-3e2c-4005-8858-20a1ad173a59 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:22.841858 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7ebcb3a6-3e2c-4005-8858-20a1ad173a59 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.399297 Oct 04 21:23:22.843119 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1911/3817] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:22 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:22.866325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1e072b18-5906-480c-a91f-387dd3815fca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:22.867150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1e072b18-5906-480c-a91f-387dd3815fca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:22.875009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e072b18-5906-480c-a91f-387dd3815fca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:22.875518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e072b18-5906-480c-a91f-387dd3815fca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:22.876182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e072b18-5906-480c-a91f-387dd3815fca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:22.876904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e072b18-5906-480c-a91f-387dd3815fca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:22.877366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e072b18-5906-480c-a91f-387dd3815fca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:22.877829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e072b18-5906-480c-a91f-387dd3815fca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:23.155067 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1e072b18-5906-480c-a91f-387dd3815fca tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action" status: 202 len: 0 microversion: 2.1 time: 0.288810 Oct 04 21:23:23.155067 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1907/3818] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:23:22 2022] POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:23:23.160450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c391b356-654a-4899-91a2-ff2e3ee512a8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:23.161250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c391b356-654a-4899-91a2-ff2e3ee512a8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:23.171042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:23.176271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c391b356-654a-4899-91a2-ff2e3ee512a8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:23.177351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c391b356-654a-4899-91a2-ff2e3ee512a8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:23.178470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c391b356-654a-4899-91a2-ff2e3ee512a8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:23.179451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c391b356-654a-4899-91a2-ff2e3ee512a8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:23.182031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c391b356-654a-4899-91a2-ff2e3ee512a8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:23.187688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c391b356-654a-4899-91a2-ff2e3ee512a8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:23.239471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e1bafaa1-25de-4371-be11-bc631b57a261 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:23.247732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e1bafaa1-25de-4371-be11-bc631b57a261 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:23.257296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1bafaa1-25de-4371-be11-bc631b57a261 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:23.268383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1bafaa1-25de-4371-be11-bc631b57a261 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:23.272965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1bafaa1-25de-4371-be11-bc631b57a261 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:23.279979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1bafaa1-25de-4371-be11-bc631b57a261 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:23.279979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1bafaa1-25de-4371-be11-bc631b57a261 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:23.279979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1bafaa1-25de-4371-be11-bc631b57a261 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:23.618484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c391b356-654a-4899-91a2-ff2e3ee512a8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:23.652648 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c391b356-654a-4899-91a2-ff2e3ee512a8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1673 microversion: 2.1 time: 0.489976 Oct 04 21:23:23.657527 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1912/3819] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:23 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1673 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:23.725499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e1bafaa1-25de-4371-be11-bc631b57a261 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:23.736964 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e1bafaa1-25de-4371-be11-bc631b57a261 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.503010 Oct 04 21:23:23.741480 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1908/3820] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:23 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:23.822931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7ec60df3-3549-49a6-84b7-9a59f19dbcfd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:23.841909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7ec60df3-3549-49a6-84b7-9a59f19dbcfd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:23.859490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ec60df3-3549-49a6-84b7-9a59f19dbcfd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:23.860799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ec60df3-3549-49a6-84b7-9a59f19dbcfd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:23.862424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ec60df3-3549-49a6-84b7-9a59f19dbcfd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:23.863779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ec60df3-3549-49a6-84b7-9a59f19dbcfd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:23.864897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ec60df3-3549-49a6-84b7-9a59f19dbcfd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:23.865603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ec60df3-3549-49a6-84b7-9a59f19dbcfd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:24.104263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7ec60df3-3549-49a6-84b7-9a59f19dbcfd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:24.129505 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7ec60df3-3549-49a6-84b7-9a59f19dbcfd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1314 microversion: 2.1 time: 0.306233 Oct 04 21:23:24.130240 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1913/3821] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:23 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:24.681448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-46e75b5c-56d3-417f-9d62-860b0e079c75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:24.682065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-46e75b5c-56d3-417f-9d62-860b0e079c75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:24.695932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46e75b5c-56d3-417f-9d62-860b0e079c75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:24.696441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46e75b5c-56d3-417f-9d62-860b0e079c75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:24.696885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46e75b5c-56d3-417f-9d62-860b0e079c75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:24.697658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46e75b5c-56d3-417f-9d62-860b0e079c75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:24.698119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46e75b5c-56d3-417f-9d62-860b0e079c75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:24.698581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46e75b5c-56d3-417f-9d62-860b0e079c75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:24.763823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dffbac10-ac4d-49a0-b096-33407d1554db tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:24.764940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dffbac10-ac4d-49a0-b096-33407d1554db tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:24.791004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dffbac10-ac4d-49a0-b096-33407d1554db tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:24.791518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dffbac10-ac4d-49a0-b096-33407d1554db tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:24.791970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dffbac10-ac4d-49a0-b096-33407d1554db tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:24.793483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dffbac10-ac4d-49a0-b096-33407d1554db tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:24.794312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dffbac10-ac4d-49a0-b096-33407d1554db tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:24.794928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dffbac10-ac4d-49a0-b096-33407d1554db tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:25.182762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dffbac10-ac4d-49a0-b096-33407d1554db tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:25.197164 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dffbac10-ac4d-49a0-b096-33407d1554db tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.438026 Oct 04 21:23:25.203541 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1914/3822] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:24 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:25.228929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4939e393-bf08-4e57-b9c9-1de62e7ed3f6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:25.235900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4939e393-bf08-4e57-b9c9-1de62e7ed3f6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:25.256742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-46e75b5c-56d3-417f-9d62-860b0e079c75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:25.268601 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-46e75b5c-56d3-417f-9d62-860b0e079c75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1653 microversion: 2.1 time: 0.594106 Oct 04 21:23:25.269729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4939e393-bf08-4e57-b9c9-1de62e7ed3f6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:25.270668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4939e393-bf08-4e57-b9c9-1de62e7ed3f6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:25.271534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4939e393-bf08-4e57-b9c9-1de62e7ed3f6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:25.272554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4939e393-bf08-4e57-b9c9-1de62e7ed3f6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:25.273790 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1909/3823] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:24 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1653 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:25.279477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4939e393-bf08-4e57-b9c9-1de62e7ed3f6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:25.280272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4939e393-bf08-4e57-b9c9-1de62e7ed3f6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:25.308780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-96bb5d4d-1f86-4958-8252-6cc7daea3633 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:25.309800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-96bb5d4d-1f86-4958-8252-6cc7daea3633 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:25.328077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96bb5d4d-1f86-4958-8252-6cc7daea3633 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:25.332400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96bb5d4d-1f86-4958-8252-6cc7daea3633 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:25.333051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96bb5d4d-1f86-4958-8252-6cc7daea3633 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:25.334232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96bb5d4d-1f86-4958-8252-6cc7daea3633 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:25.336405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96bb5d4d-1f86-4958-8252-6cc7daea3633 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:25.337877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96bb5d4d-1f86-4958-8252-6cc7daea3633 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:25.447997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:25.684387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4939e393-bf08-4e57-b9c9-1de62e7ed3f6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:25.695969 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4939e393-bf08-4e57-b9c9-1de62e7ed3f6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1314 microversion: 2.1 time: 0.487506 Oct 04 21:23:25.717354 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1915/3824] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:25 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:25.720664 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-96bb5d4d-1f86-4958-8252-6cc7daea3633 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action" status: 202 len: 0 microversion: 2.1 time: 0.415327 Oct 04 21:23:25.721963 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1910/3825] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:23:25 2022] POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:23:25.735179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f6f910f3-1eed-4c56-af72-e2fa6d1d80eb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:25.735986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f6f910f3-1eed-4c56-af72-e2fa6d1d80eb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:25.763070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6f910f3-1eed-4c56-af72-e2fa6d1d80eb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:25.763882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6f910f3-1eed-4c56-af72-e2fa6d1d80eb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:25.764500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6f910f3-1eed-4c56-af72-e2fa6d1d80eb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:25.765964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6f910f3-1eed-4c56-af72-e2fa6d1d80eb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:25.766603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6f910f3-1eed-4c56-af72-e2fa6d1d80eb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:25.767217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6f910f3-1eed-4c56-af72-e2fa6d1d80eb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:26.073234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f6f910f3-1eed-4c56-af72-e2fa6d1d80eb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:26.085415 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f6f910f3-1eed-4c56-af72-e2fa6d1d80eb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1660 microversion: 2.1 time: 0.354503 Oct 04 21:23:26.086505 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1916/3826] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:25 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1660 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:26.229961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-25f23a15-de2f-4d04-a8c3-479d9cb79424 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:26.231479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-25f23a15-de2f-4d04-a8c3-479d9cb79424 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:26.249365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25f23a15-de2f-4d04-a8c3-479d9cb79424 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:26.250376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25f23a15-de2f-4d04-a8c3-479d9cb79424 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:26.251023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25f23a15-de2f-4d04-a8c3-479d9cb79424 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:26.251943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25f23a15-de2f-4d04-a8c3-479d9cb79424 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:26.252779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25f23a15-de2f-4d04-a8c3-479d9cb79424 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:26.253389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25f23a15-de2f-4d04-a8c3-479d9cb79424 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:26.492876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-25f23a15-de2f-4d04-a8c3-479d9cb79424 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:26.510146 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-25f23a15-de2f-4d04-a8c3-479d9cb79424 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.285562 Oct 04 21:23:26.533500 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1911/3827] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:26 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:26.742062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8bcd9b01-4224-4931-be11-b48d33dde450 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:26.742771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8bcd9b01-4224-4931-be11-b48d33dde450 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:26.783038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bcd9b01-4224-4931-be11-b48d33dde450 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:26.783546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bcd9b01-4224-4931-be11-b48d33dde450 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:26.783991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bcd9b01-4224-4931-be11-b48d33dde450 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:26.789778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bcd9b01-4224-4931-be11-b48d33dde450 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:26.789778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bcd9b01-4224-4931-be11-b48d33dde450 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:26.789778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bcd9b01-4224-4931-be11-b48d33dde450 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:27.073369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8bcd9b01-4224-4931-be11-b48d33dde450 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:27.085401 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8bcd9b01-4224-4931-be11-b48d33dde450 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1314 microversion: 2.1 time: 0.355016 Oct 04 21:23:27.098192 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1917/3828] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:26 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:27.113215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5d1f82cf-4f13-43ce-bcbb-48a91a9649c5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:27.113853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5d1f82cf-4f13-43ce-bcbb-48a91a9649c5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:27.125947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d1f82cf-4f13-43ce-bcbb-48a91a9649c5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:27.130279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d1f82cf-4f13-43ce-bcbb-48a91a9649c5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:27.132875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d1f82cf-4f13-43ce-bcbb-48a91a9649c5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:27.133965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d1f82cf-4f13-43ce-bcbb-48a91a9649c5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:27.136678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d1f82cf-4f13-43ce-bcbb-48a91a9649c5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:27.137139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d1f82cf-4f13-43ce-bcbb-48a91a9649c5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:27.515063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5d1f82cf-4f13-43ce-bcbb-48a91a9649c5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:27.529554 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5d1f82cf-4f13-43ce-bcbb-48a91a9649c5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.420492 Oct 04 21:23:27.530859 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1912/3829] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:27 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:27.561031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-312cb5cd-81ce-4417-b365-b5a72fcf9909 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:27.563822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-312cb5cd-81ce-4417-b365-b5a72fcf9909 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:27.569722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bc645c6a-38ef-49e8-a02a-dc259cd3541f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:27.569722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bc645c6a-38ef-49e8-a02a-dc259cd3541f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:27.579210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-312cb5cd-81ce-4417-b365-b5a72fcf9909 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:27.579887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-312cb5cd-81ce-4417-b365-b5a72fcf9909 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:27.580526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-312cb5cd-81ce-4417-b365-b5a72fcf9909 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:27.582475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-312cb5cd-81ce-4417-b365-b5a72fcf9909 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:27.584190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-312cb5cd-81ce-4417-b365-b5a72fcf9909 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:27.586765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc645c6a-38ef-49e8-a02a-dc259cd3541f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:27.587328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc645c6a-38ef-49e8-a02a-dc259cd3541f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:27.588770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-312cb5cd-81ce-4417-b365-b5a72fcf9909 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:27.590417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc645c6a-38ef-49e8-a02a-dc259cd3541f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:27.592195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc645c6a-38ef-49e8-a02a-dc259cd3541f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:27.592919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc645c6a-38ef-49e8-a02a-dc259cd3541f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:27.593596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc645c6a-38ef-49e8-a02a-dc259cd3541f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:28.089267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-312cb5cd-81ce-4417-b365-b5a72fcf9909 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:28.105989 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-312cb5cd-81ce-4417-b365-b5a72fcf9909 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.550958 Oct 04 21:23:28.122008 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1913/3830] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:27 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:28.141841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-00d3b3a4-22c7-483d-bcfa-f205fd1b4a2e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:28.142685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-00d3b3a4-22c7-483d-bcfa-f205fd1b4a2e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:28.164788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00d3b3a4-22c7-483d-bcfa-f205fd1b4a2e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:28.181574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00d3b3a4-22c7-483d-bcfa-f205fd1b4a2e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:28.185949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00d3b3a4-22c7-483d-bcfa-f205fd1b4a2e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:28.186950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00d3b3a4-22c7-483d-bcfa-f205fd1b4a2e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:28.187550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00d3b3a4-22c7-483d-bcfa-f205fd1b4a2e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:28.188015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00d3b3a4-22c7-483d-bcfa-f205fd1b4a2e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:28.255752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bc645c6a-38ef-49e8-a02a-dc259cd3541f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:28.291035 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bc645c6a-38ef-49e8-a02a-dc259cd3541f tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.752187 Oct 04 21:23:28.292001 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1918/3831] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:27 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:28.315986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-50c28721-ee41-4fe4-80c7-f8cd5b4d2788 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:28.319192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-50c28721-ee41-4fe4-80c7-f8cd5b4d2788 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:28.334295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50c28721-ee41-4fe4-80c7-f8cd5b4d2788 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:28.335310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50c28721-ee41-4fe4-80c7-f8cd5b4d2788 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:28.342440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50c28721-ee41-4fe4-80c7-f8cd5b4d2788 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:28.343749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50c28721-ee41-4fe4-80c7-f8cd5b4d2788 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:28.344602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50c28721-ee41-4fe4-80c7-f8cd5b4d2788 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:28.345203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50c28721-ee41-4fe4-80c7-f8cd5b4d2788 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:28.864617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-00d3b3a4-22c7-483d-bcfa-f205fd1b4a2e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:28.876171 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-00d3b3a4-22c7-483d-bcfa-f205fd1b4a2e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1314 microversion: 2.1 time: 0.752890 Oct 04 21:23:28.881377 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1914/3832] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:28 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:28.943050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-50c28721-ee41-4fe4-80c7-f8cd5b4d2788 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:28.954699 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-50c28721-ee41-4fe4-80c7-f8cd5b4d2788 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.651817 Oct 04 21:23:28.955294 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1919/3833] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:28 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:28.981097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-268f9faf-fcbe-4173-bd77-6b4e60c6f9cc tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:28.984668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-268f9faf-fcbe-4173-bd77-6b4e60c6f9cc tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:28.989108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-268f9faf-fcbe-4173-bd77-6b4e60c6f9cc tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:28.990070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-268f9faf-fcbe-4173-bd77-6b4e60c6f9cc tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:28.990702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-268f9faf-fcbe-4173-bd77-6b4e60c6f9cc tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:28.991591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-268f9faf-fcbe-4173-bd77-6b4e60c6f9cc tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:28.992221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-268f9faf-fcbe-4173-bd77-6b4e60c6f9cc tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:28.992839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-268f9faf-fcbe-4173-bd77-6b4e60c6f9cc tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:29.220628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-268f9faf-fcbe-4173-bd77-6b4e60c6f9cc tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:29.247313 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-268f9faf-fcbe-4173-bd77-6b4e60c6f9cc tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.264742 Oct 04 21:23:29.273954 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1915/3834] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:28 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:29.284143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7b44505a-00db-407a-9345-4b9ea5c32bde tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:29.299237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7b44505a-00db-407a-9345-4b9ea5c32bde tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:29.313377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b44505a-00db-407a-9345-4b9ea5c32bde tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:29.315822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b44505a-00db-407a-9345-4b9ea5c32bde tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:29.324337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0c307b3a-3759-4701-98e5-05cd133fb716 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:29.326228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0c307b3a-3759-4701-98e5-05cd133fb716 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:29.334199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b44505a-00db-407a-9345-4b9ea5c32bde tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:29.336644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b44505a-00db-407a-9345-4b9ea5c32bde tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:29.340034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b44505a-00db-407a-9345-4b9ea5c32bde tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:29.344711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b44505a-00db-407a-9345-4b9ea5c32bde tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:29.345911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c307b3a-3759-4701-98e5-05cd133fb716 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:29.348358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c307b3a-3759-4701-98e5-05cd133fb716 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:29.349863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c307b3a-3759-4701-98e5-05cd133fb716 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:29.354278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c307b3a-3759-4701-98e5-05cd133fb716 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:29.355297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c307b3a-3759-4701-98e5-05cd133fb716 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:29.357447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c307b3a-3759-4701-98e5-05cd133fb716 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:29.795698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0c307b3a-3759-4701-98e5-05cd133fb716 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:29.807282 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0c307b3a-3759-4701-98e5-05cd133fb716 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.488775 Oct 04 21:23:29.811459 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1916/3835] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:29 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:29.822499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7b44505a-00db-407a-9345-4b9ea5c32bde tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:29.837457 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7b44505a-00db-407a-9345-4b9ea5c32bde tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.559884 Oct 04 21:23:29.858006 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1920/3836] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:29 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:29.876544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c41d94a0-3699-412b-9fbe-a54b0f82ae71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:29.878247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c41d94a0-3699-412b-9fbe-a54b0f82ae71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:29.888573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c41d94a0-3699-412b-9fbe-a54b0f82ae71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:29.889705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c41d94a0-3699-412b-9fbe-a54b0f82ae71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:29.890618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c41d94a0-3699-412b-9fbe-a54b0f82ae71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:29.891699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c41d94a0-3699-412b-9fbe-a54b0f82ae71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:29.892514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c41d94a0-3699-412b-9fbe-a54b0f82ae71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:29.893320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c41d94a0-3699-412b-9fbe-a54b0f82ae71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:29.910219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-caf0c832-794e-408f-a4cb-5e89b139890e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:29.911363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-caf0c832-794e-408f-a4cb-5e89b139890e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:29.929383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-caf0c832-794e-408f-a4cb-5e89b139890e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:29.931466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-caf0c832-794e-408f-a4cb-5e89b139890e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:29.933164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-caf0c832-794e-408f-a4cb-5e89b139890e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:29.936499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-caf0c832-794e-408f-a4cb-5e89b139890e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:29.939249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-caf0c832-794e-408f-a4cb-5e89b139890e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:29.940053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-caf0c832-794e-408f-a4cb-5e89b139890e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:30.992985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c41d94a0-3699-412b-9fbe-a54b0f82ae71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:31.017574 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c41d94a0-3699-412b-9fbe-a54b0f82ae71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 1.145678 Oct 04 21:23:31.021749 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1917/3837] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:29 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:31.030783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-69a4bce1-9fa6-463f-8f0a-65627ec9ef1e req-e395144b-5dd5-447f-83d5-977390abe94c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541881f6-6361-4971-b222-65fbd3878425", "name": "network-vif-plugged", "status": "completed", "tag": "5bf3fe20-6955-4e62-8eee-3a53f13f5a34"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:31.038294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-caf0c832-794e-408f-a4cb-5e89b139890e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:31.048574 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-caf0c832-794e-408f-a4cb-5e89b139890e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1314 microversion: 2.1 time: 1.143659 Oct 04 21:23:31.057661 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1921/3838] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:29 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1314 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:31.064914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-69a4bce1-9fa6-463f-8f0a-65627ec9ef1e req-e395144b-5dd5-447f-83d5-977390abe94c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:31.065877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-69a4bce1-9fa6-463f-8f0a-65627ec9ef1e req-e395144b-5dd5-447f-83d5-977390abe94c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:31.075138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-47f0792f-269e-4bee-9d40-73cd1acbc5e7 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:31.078554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-69a4bce1-9fa6-463f-8f0a-65627ec9ef1e req-e395144b-5dd5-447f-83d5-977390abe94c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:31.084401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-47f0792f-269e-4bee-9d40-73cd1acbc5e7 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:31.113156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47f0792f-269e-4bee-9d40-73cd1acbc5e7 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:31.116286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47f0792f-269e-4bee-9d40-73cd1acbc5e7 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:31.120239 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-69a4bce1-9fa6-463f-8f0a-65627ec9ef1e req-e395144b-5dd5-447f-83d5-977390abe94c service nova] Creating event network-vif-plugged:5bf3fe20-6955-4e62-8eee-3a53f13f5a34 for instance 541881f6-6361-4971-b222-65fbd3878425 on n-h2-860282-1 Oct 04 21:23:31.133260 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-69a4bce1-9fa6-463f-8f0a-65627ec9ef1e req-e395144b-5dd5-447f-83d5-977390abe94c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103037 Oct 04 21:23:31.134509 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1918/3839] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:31.135802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47f0792f-269e-4bee-9d40-73cd1acbc5e7 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:31.149228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47f0792f-269e-4bee-9d40-73cd1acbc5e7 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:31.154168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47f0792f-269e-4bee-9d40-73cd1acbc5e7 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:31.154900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47f0792f-269e-4bee-9d40-73cd1acbc5e7 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:31.749560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-47f0792f-269e-4bee-9d40-73cd1acbc5e7 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:31.756015 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-47f0792f-269e-4bee-9d40-73cd1acbc5e7 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.696403 Oct 04 21:23:31.756604 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1922/3840] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:31 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:32.103859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7538208f-2f30-4df1-a0a7-9b3ddbc46018 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:32.104513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7538208f-2f30-4df1-a0a7-9b3ddbc46018 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:32.124004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7538208f-2f30-4df1-a0a7-9b3ddbc46018 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:32.124517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7538208f-2f30-4df1-a0a7-9b3ddbc46018 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:32.124965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7538208f-2f30-4df1-a0a7-9b3ddbc46018 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:32.130982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7538208f-2f30-4df1-a0a7-9b3ddbc46018 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:32.131737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7538208f-2f30-4df1-a0a7-9b3ddbc46018 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:32.140151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7538208f-2f30-4df1-a0a7-9b3ddbc46018 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:32.607859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7538208f-2f30-4df1-a0a7-9b3ddbc46018 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:32.628675 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7538208f-2f30-4df1-a0a7-9b3ddbc46018 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1314 microversion: 2.1 time: 0.529718 Oct 04 21:23:32.629921 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1923/3841] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:32 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:32.782685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3f70e89e-1e1d-4f95-b6ab-b7d4ac9abde8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:32.783715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3f70e89e-1e1d-4f95-b6ab-b7d4ac9abde8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:32.797398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f70e89e-1e1d-4f95-b6ab-b7d4ac9abde8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:32.806361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f70e89e-1e1d-4f95-b6ab-b7d4ac9abde8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:32.810795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f70e89e-1e1d-4f95-b6ab-b7d4ac9abde8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:32.813249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f70e89e-1e1d-4f95-b6ab-b7d4ac9abde8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:32.817661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f70e89e-1e1d-4f95-b6ab-b7d4ac9abde8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:32.818138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f70e89e-1e1d-4f95-b6ab-b7d4ac9abde8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:32.953041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7284e779-817f-4844-9f38-2128133b0e15 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Action: 'create', calling method: .version_select at 0x7f578b436e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-799399071", "description": "tempest-description-924329658"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:33.279167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3f70e89e-1e1d-4f95-b6ab-b7d4ac9abde8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:33.295778 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3f70e89e-1e1d-4f95-b6ab-b7d4ac9abde8 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.519069 Oct 04 21:23:33.296409 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1924/3842] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:32 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:33.656372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6a8e498a-376a-4f19-bfd0-bb43c713b885 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:33.657001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6a8e498a-376a-4f19-bfd0-bb43c713b885 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:33.675415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a8e498a-376a-4f19-bfd0-bb43c713b885 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:33.675935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a8e498a-376a-4f19-bfd0-bb43c713b885 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:33.676385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a8e498a-376a-4f19-bfd0-bb43c713b885 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:33.677174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a8e498a-376a-4f19-bfd0-bb43c713b885 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:33.677720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a8e498a-376a-4f19-bfd0-bb43c713b885 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:33.678158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a8e498a-376a-4f19-bfd0-bb43c713b885 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:34.376442 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7284e779-817f-4844-9f38-2128133b0e15 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 2.333934 Oct 04 21:23:34.377839 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1919/3843] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:23:32 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 2337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:34.385040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9bd7706a-f7e1-4a1d-8198-8a9b664c3e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:34.391885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9bd7706a-f7e1-4a1d-8198-8a9b664c3e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:34.409879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bd7706a-f7e1-4a1d-8198-8a9b664c3e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:34.410418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bd7706a-f7e1-4a1d-8198-8a9b664c3e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:34.410879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bd7706a-f7e1-4a1d-8198-8a9b664c3e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:34.415470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bd7706a-f7e1-4a1d-8198-8a9b664c3e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:34.417146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bd7706a-f7e1-4a1d-8198-8a9b664c3e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:34.418432 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bd7706a-f7e1-4a1d-8198-8a9b664c3e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:34.683796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6a8e498a-376a-4f19-bfd0-bb43c713b885 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:34.693730 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6a8e498a-376a-4f19-bfd0-bb43c713b885 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1501 microversion: 2.1 time: 1.041534 Oct 04 21:23:34.697542 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1925/3844] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:33 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1501 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:34.713745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d104effe-f1c6-4e83-9637-78e779c503dc tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Action: 'create', calling method: .version_select at 0x7f57923bfd30>, body: {"security_group_rule": {"parent_group_id": "fe407184-fb9f-4303-b181-b288665f0c08", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:35.061735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9bd7706a-f7e1-4a1d-8198-8a9b664c3e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:35.074574 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9bd7706a-f7e1-4a1d-8198-8a9b664c3e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.694922 Oct 04 21:23:35.075489 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1920/3845] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:34 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:35.886291 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d104effe-f1c6-4e83-9637-78e779c503dc tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.184600 Oct 04 21:23:35.886291 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1926/3846] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Oct 4 21:23:34 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:35.900874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-74a9b242-7904-4777-a4d7-fcfd21f66a18 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Action: 'create', calling method: .version_select at 0x7f578b421040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1262383726", "description": "tempest-description-689828582"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:36.099511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d47398fc-2b1e-41e3-992b-d7b34b849e55 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:36.100648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d47398fc-2b1e-41e3-992b-d7b34b849e55 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:36.110635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d47398fc-2b1e-41e3-992b-d7b34b849e55 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:36.111398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d47398fc-2b1e-41e3-992b-d7b34b849e55 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:36.116187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d47398fc-2b1e-41e3-992b-d7b34b849e55 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:36.116187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d47398fc-2b1e-41e3-992b-d7b34b849e55 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:36.116187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d47398fc-2b1e-41e3-992b-d7b34b849e55 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:36.116187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d47398fc-2b1e-41e3-992b-d7b34b849e55 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:36.166488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:36.403468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d47398fc-2b1e-41e3-992b-d7b34b849e55 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:36.416261 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d47398fc-2b1e-41e3-992b-d7b34b849e55 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.321369 Oct 04 21:23:36.430499 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1927/3847] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:36 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:36.699636 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-74a9b242-7904-4777-a4d7-fcfd21f66a18 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.803960 Oct 04 21:23:36.700662 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1921/3848] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:23:35 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:36.713407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d72542bb-53cf-49da-a3bf-e9eb2b9bac12 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Action: 'create', calling method: .version_select at 0x7f578b68b9d0>, body: {"security_group_rule": {"parent_group_id": "00d3d058-59db-4c61-8343-757f3924c6b6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:37.380473 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d72542bb-53cf-49da-a3bf-e9eb2b9bac12 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.670671 Oct 04 21:23:37.381700 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1928/3849] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Oct 4 21:23:36 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:37.396113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c8481d80-3a92-415a-b561-148a4d77f40a tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Action: 'create', calling method: .version_select at 0x7f578b4ad550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-130538040", "description": "tempest-description-1509761237"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:37.448711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-211b4086-b1f3-4dba-b5f7-9c2db670042b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:37.449358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-211b4086-b1f3-4dba-b5f7-9c2db670042b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:37.458964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-211b4086-b1f3-4dba-b5f7-9c2db670042b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:37.460189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-211b4086-b1f3-4dba-b5f7-9c2db670042b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:37.460819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-211b4086-b1f3-4dba-b5f7-9c2db670042b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:37.461876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-211b4086-b1f3-4dba-b5f7-9c2db670042b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:37.462521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-211b4086-b1f3-4dba-b5f7-9c2db670042b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:37.463189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-211b4086-b1f3-4dba-b5f7-9c2db670042b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:37.933961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-211b4086-b1f3-4dba-b5f7-9c2db670042b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:37.944009 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-211b4086-b1f3-4dba-b5f7-9c2db670042b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.504941 Oct 04 21:23:37.946549 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1929/3850] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:37 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:38.227949 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c8481d80-3a92-415a-b561-148a4d77f40a tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.835827 Oct 04 21:23:38.228555 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1922/3851] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:23:37 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:38.243795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d34fa0d0-9e0a-4333-ba8f-3ce7d9b7896f tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Action: 'create', calling method: .version_select at 0x7f578b68b700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-856869519", "description": "tempest-description-142627844"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:38.770263 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d34fa0d0-9e0a-4333-ba8f-3ce7d9b7896f tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.531763 Oct 04 21:23:38.774632 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1930/3852] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:23:38 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:38.797689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ae4fe9d7-323e-4935-8504-872f418cc70f tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Action: 'create', calling method: .version_select at 0x7f578bedfa60>, body: {"security_group_rule": {"parent_group_id": "33379597-1cd1-4b5c-a751-847832fbd0d4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "7cd04212-41f0-4947-b147-2d3cd4302cee"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:38.971861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-09988258-9ecb-444a-b09b-2f48dbac0789 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:38.972612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-09988258-9ecb-444a-b09b-2f48dbac0789 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:38.992454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09988258-9ecb-444a-b09b-2f48dbac0789 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:38.992454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09988258-9ecb-444a-b09b-2f48dbac0789 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:38.992454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09988258-9ecb-444a-b09b-2f48dbac0789 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:38.992454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09988258-9ecb-444a-b09b-2f48dbac0789 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:38.992454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09988258-9ecb-444a-b09b-2f48dbac0789 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:38.992454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09988258-9ecb-444a-b09b-2f48dbac0789 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:39.579307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-09988258-9ecb-444a-b09b-2f48dbac0789 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:39.579307 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-09988258-9ecb-444a-b09b-2f48dbac0789 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.367537 Oct 04 21:23:39.579307 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1931/3853] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:38 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:39.579307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f3ede0b9-3aca-47d4-b7d7-aaf87747ac4d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f90099e5-9664-4a2f-8594-27787f0c69cc"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:39.579307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f3ede0b9-3aca-47d4-b7d7-aaf87747ac4d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:39.579307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3ede0b9-3aca-47d4-b7d7-aaf87747ac4d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:39.579307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3ede0b9-3aca-47d4-b7d7-aaf87747ac4d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:39.579307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3ede0b9-3aca-47d4-b7d7-aaf87747ac4d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:39.579307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3ede0b9-3aca-47d4-b7d7-aaf87747ac4d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:39.579307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3ede0b9-3aca-47d4-b7d7-aaf87747ac4d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:39.579307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3ede0b9-3aca-47d4-b7d7-aaf87747ac4d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:39.718098 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ae4fe9d7-323e-4935-8504-872f418cc70f tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.938088 Oct 04 21:23:39.727727 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1923/3854] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Oct 4 21:23:38 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:23:39.745147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-80a40694-67bd-423c-a6d9-6042c7578116 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Action: 'create', calling method: .version_select at 0x7f5794563160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-194074965", "description": "tempest-description-143814403"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:40.389165 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-80a40694-67bd-423c-a6d9-6042c7578116 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.659025 Oct 04 21:23:40.390200 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1924/3855] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:23:39 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:40.398731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-99493824-7d3d-4221-b4a9-3a495dc4b19e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:40.400348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-99493824-7d3d-4221-b4a9-3a495dc4b19e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:40.407523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:40.414447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99493824-7d3d-4221-b4a9-3a495dc4b19e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:40.423870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99493824-7d3d-4221-b4a9-3a495dc4b19e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:40.423870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99493824-7d3d-4221-b4a9-3a495dc4b19e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:40.423870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99493824-7d3d-4221-b4a9-3a495dc4b19e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:40.423870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99493824-7d3d-4221-b4a9-3a495dc4b19e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:40.423870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99493824-7d3d-4221-b4a9-3a495dc4b19e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:40.673517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-99493824-7d3d-4221-b4a9-3a495dc4b19e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:40.691979 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f3ede0b9-3aca-47d4-b7d7-aaf87747ac4d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "POST /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.350611 Oct 04 21:23:40.700601 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1932/3856] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 21:23:39 2022] POST /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425/os-volume_attachments => generated 194 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:40.716939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a4e83377-8c2f-431c-8dd3-8a45158b15a4 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Action: 'create', calling method: .version_select at 0x7f578b9c4550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1794044077", "description": "tempest-description-1659220005"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:40.719561 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-99493824-7d3d-4221-b4a9-3a495dc4b19e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.326789 Oct 04 21:23:40.734221 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1925/3857] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:40 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:41.564278 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a4e83377-8c2f-431c-8dd3-8a45158b15a4 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.867213 Oct 04 21:23:41.565131 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1933/3858] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:23:40 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:41.579678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-83c354ab-ac9e-4b33-90ec-7f6bb8a7fc99 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Action: 'create', calling method: .version_select at 0x7f5794563160>, body: {"security_group_rule": {"parent_group_id": "d03bf3b4-0014-4246-85c6-b173b94f593b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "1b226e19-5937-44b1-be88-10cf0c3c61ca"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:41.749022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-afd24a86-5139-4065-bc74-5d5368f2e117 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:41.750685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-afd24a86-5139-4065-bc74-5d5368f2e117 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:41.783656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afd24a86-5139-4065-bc74-5d5368f2e117 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:41.789719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afd24a86-5139-4065-bc74-5d5368f2e117 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:41.789930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afd24a86-5139-4065-bc74-5d5368f2e117 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:41.790526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afd24a86-5139-4065-bc74-5d5368f2e117 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:41.791003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afd24a86-5139-4065-bc74-5d5368f2e117 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:41.791447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afd24a86-5139-4065-bc74-5d5368f2e117 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:42.503412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-afd24a86-5139-4065-bc74-5d5368f2e117 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:42.530903 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-afd24a86-5139-4065-bc74-5d5368f2e117 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.786941 Oct 04 21:23:42.532190 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1934/3859] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:41 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:42.867873 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-83c354ab-ac9e-4b33-90ec-7f6bb8a7fc99 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.292971 Oct 04 21:23:42.871674 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1926/3860] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Oct 4 21:23:41 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:42.882368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-246fe485-3c37-4ab5-8a5e-0556dce70f61 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Calling method '.version_select at 0x7f578ba1d8b0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:43.505566 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-246fe485-3c37-4ab5-8a5e-0556dce70f61 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/1b226e19-5937-44b1-be88-10cf0c3c61ca" status: 202 len: 0 microversion: 2.1 time: 0.626589 Oct 04 21:23:43.505566 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1935/3861] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:23:42 2022] DELETE /compute/v2.1/os-security-groups/1b226e19-5937-44b1-be88-10cf0c3c61ca => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:23:43.514679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-05843d37-9ce4-4ff9-ab4c-ac6c724bbbf9 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Calling method '.version_select at 0x7f5794556280>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:43.571729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6042fb60-5588-435a-9e70-bbe566c88063 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:43.572176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6042fb60-5588-435a-9e70-bbe566c88063 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:43.578950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6042fb60-5588-435a-9e70-bbe566c88063 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:43.579448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6042fb60-5588-435a-9e70-bbe566c88063 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:43.579898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6042fb60-5588-435a-9e70-bbe566c88063 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:43.580607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6042fb60-5588-435a-9e70-bbe566c88063 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:43.591639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6042fb60-5588-435a-9e70-bbe566c88063 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:43.592110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6042fb60-5588-435a-9e70-bbe566c88063 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:43.621508 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-05843d37-9ce4-4ff9-ab4c-ac6c724bbbf9 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/d03bf3b4-0014-4246-85c6-b173b94f593b" status: 200 len: 246 microversion: 2.1 time: 0.112180 Oct 04 21:23:43.622761 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1927/3862] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Oct 4 21:23:43 2022] GET /compute/v2.1/os-security-groups/d03bf3b4-0014-4246-85c6-b173b94f593b => generated 246 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:43.636339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5bae7a70-e9a1-49e9-8fe8-f0ab0e158450 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Action: 'create', calling method: .version_select at 0x7f578b41adc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-590869730", "description": "tempest-description-49024347"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:43.944045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6042fb60-5588-435a-9e70-bbe566c88063 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:43.964862 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6042fb60-5588-435a-9e70-bbe566c88063 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1486 microversion: 2.1 time: 0.395051 Oct 04 21:23:43.965784 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1936/3863] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:43 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1486 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:43.992037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-28e1ec64-b4ee-4adb-8070-0c6fb9db2e44 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:43.993129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-28e1ec64-b4ee-4adb-8070-0c6fb9db2e44 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:44.005326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28e1ec64-b4ee-4adb-8070-0c6fb9db2e44 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:44.006093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28e1ec64-b4ee-4adb-8070-0c6fb9db2e44 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:44.007226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28e1ec64-b4ee-4adb-8070-0c6fb9db2e44 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:44.008361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28e1ec64-b4ee-4adb-8070-0c6fb9db2e44 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:44.009007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28e1ec64-b4ee-4adb-8070-0c6fb9db2e44 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:44.010259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28e1ec64-b4ee-4adb-8070-0c6fb9db2e44 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:44.287618 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-28e1ec64-b4ee-4adb-8070-0c6fb9db2e44 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "POST /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8/action" status: 202 len: 0 microversion: 2.1 time: 0.301712 Oct 04 21:23:44.289246 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1937/3864] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:23:43 2022] POST /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:23:44.305485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3544adb9-6c30-4758-9b28-b6e3432c2f93 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:44.307250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3544adb9-6c30-4758-9b28-b6e3432c2f93 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:44.317285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3544adb9-6c30-4758-9b28-b6e3432c2f93 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:44.318244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3544adb9-6c30-4758-9b28-b6e3432c2f93 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:44.319019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3544adb9-6c30-4758-9b28-b6e3432c2f93 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:44.320075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3544adb9-6c30-4758-9b28-b6e3432c2f93 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:44.328607 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5bae7a70-e9a1-49e9-8fe8-f0ab0e158450 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.696002 Oct 04 21:23:44.330709 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1928/3865] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:23:43 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:23:44.333653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3544adb9-6c30-4758-9b28-b6e3432c2f93 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:44.334325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3544adb9-6c30-4758-9b28-b6e3432c2f93 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:44.345904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4f5f122c-9fcd-4009-9c21-68a4a6b521c8 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Action: 'create', calling method: .version_select at 0x7f5794563160>, body: {"security_group_rule": {"parent_group_id": "ad5132b2-6d11-4bd0-836f-0b066ca85671", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:44.983910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3544adb9-6c30-4758-9b28-b6e3432c2f93 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:44.992652 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3544adb9-6c30-4758-9b28-b6e3432c2f93 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1494 microversion: 2.1 time: 0.697311 Oct 04 21:23:44.998794 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1938/3866] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:44 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1494 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:45.626727 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4f5f122c-9fcd-4009-9c21-68a4a6b521c8 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.285654 Oct 04 21:23:45.627352 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1929/3867] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Oct 4 21:23:44 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:23:45.640817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e68c1fbe-ed43-451d-996f-41cd98ff9e54 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Action: 'create', calling method: .version_select at 0x7f579459f3a0>, body: {"security_group_rule": {"parent_group_id": "ad5132b2-6d11-4bd0-836f-0b066ca85671", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:46.019198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bfbb2960-0fda-4750-ab3e-26d35091f430 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:46.020121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bfbb2960-0fda-4750-ab3e-26d35091f430 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:46.027096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bfbb2960-0fda-4750-ab3e-26d35091f430 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:46.027850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bfbb2960-0fda-4750-ab3e-26d35091f430 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:46.029072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bfbb2960-0fda-4750-ab3e-26d35091f430 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:46.029957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bfbb2960-0fda-4750-ab3e-26d35091f430 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:46.030643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bfbb2960-0fda-4750-ab3e-26d35091f430 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:46.031075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bfbb2960-0fda-4750-ab3e-26d35091f430 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:46.286791 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e68c1fbe-ed43-451d-996f-41cd98ff9e54 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.647582 Oct 04 21:23:46.287436 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1939/3868] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Oct 4 21:23:45 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:46.301264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-017af5f5-3706-49f0-b984-2b136a466f72 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Calling method '.version_select at 0x7f578b8b5040>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:46.391697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bfbb2960-0fda-4750-ab3e-26d35091f430 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:46.406656 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bfbb2960-0fda-4750-ab3e-26d35091f430 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1494 microversion: 2.1 time: 0.388388 Oct 04 21:23:46.411898 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1930/3869] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:46 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1494 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:46.476060 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-017af5f5-3706-49f0-b984-2b136a466f72 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/ad5132b2-6d11-4bd0-836f-0b066ca85671" status: 200 len: 662 microversion: 2.1 time: 0.180209 Oct 04 21:23:46.487545 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1940/3870] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Oct 4 21:23:46 2022] GET /compute/v2.1/os-security-groups/ad5132b2-6d11-4bd0-836f-0b066ca85671 => generated 662 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:46.491154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8b9dd9b1-7ad5-4600-bdef-28083ac66bf4 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Calling method '.version_select at 0x7f5794561820>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:46.872594 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8b9dd9b1-7ad5-4600-bdef-28083ac66bf4 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/773e0edb-d1d0-43e3-af5f-b555485ec145" status: 202 len: 0 microversion: 2.1 time: 0.385308 Oct 04 21:23:46.873148 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1931/3871] 10.222.0.30 () {58 vars in 1287 bytes} [Tue Oct 4 21:23:46 2022] DELETE /compute/v2.1/os-security-group-rules/773e0edb-d1d0-43e3-af5f-b555485ec145 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:23:46.883044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7e4c3cef-c6d2-4cf1-855a-6a10a975723d tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Calling method '.version_select at 0x7f578b68b430>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:47.360050 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7e4c3cef-c6d2-4cf1-855a-6a10a975723d tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/ad5132b2-6d11-4bd0-836f-0b066ca85671" status: 202 len: 0 microversion: 2.1 time: 0.481236 Oct 04 21:23:47.367949 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1941/3872] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:23:46 2022] DELETE /compute/v2.1/os-security-groups/ad5132b2-6d11-4bd0-836f-0b066ca85671 => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:23:47.370007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d81abb27-a07f-4647-9524-84c63b763427 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Calling method '.version_select at 0x7f5794556700>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:47.436920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-70deaa77-4b59-4e78-8cad-e0923a09e14e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:47.437553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-70deaa77-4b59-4e78-8cad-e0923a09e14e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:47.439671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:47.452898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70deaa77-4b59-4e78-8cad-e0923a09e14e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:47.453833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70deaa77-4b59-4e78-8cad-e0923a09e14e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:47.454481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70deaa77-4b59-4e78-8cad-e0923a09e14e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:47.455411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70deaa77-4b59-4e78-8cad-e0923a09e14e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:47.456662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70deaa77-4b59-4e78-8cad-e0923a09e14e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:47.459581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70deaa77-4b59-4e78-8cad-e0923a09e14e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:47.491352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG neutronclient.v2_0.client [None req-d81abb27-a07f-4647-9524-84c63b763427 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1b226e19-5937-44b1-be88-10cf0c3c61ca does not exist", "detail": ""}} {{(pid=122758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:23:47.492556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.security_group_api [None req-d81abb27-a07f-4647-9524-84c63b763427 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Neutron security group 1b226e19-5937-44b1-be88-10cf0c3c61ca not found {{(pid=122758) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:23:47.493743 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-d81abb27-a07f-4647-9524-84c63b763427 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] HTTP exception thrown: Security group 1b226e19-5937-44b1-be88-10cf0c3c61ca does not exist Oct 04 21:23:47.493743 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-2cf38b99-44b1-4037-b6c6-934b27f5942f'] Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d81abb27-a07f-4647-9524-84c63b763427 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Request method failure captured: Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/os-security-groups/1b226e19-5937-44b1-be88-10cf0c3c61ca HTTP/1.1 Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKRTj7ImD8ob-rSpt5WcUIQaU1nNOdmMBVYjIHK0UaTv-wf0ipXgck57yvrwc84dtqPhQNAvkpUDe2mOT2_VPpiQMbnCqCwy6ctl_xg55RlMVO0UwZfuJCZhgHTFMmD0gcfyMZoANKvStoFuGDvfB4sO2tirxDLJU_q5U4lB82CT1xQ Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 3afb89d098b74eeb89675f3d8016fded Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1163933503 Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3afb89d098b74eeb89675f3d8016fded"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3afb89d098b74eeb89675f3d8016fded"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3afb89d098b74eeb89675f3d8016fded"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3afb89d098b74eeb89675f3d8016fded"}]}] Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1163933503 Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 3afb89d098b74eeb89675f3d8016fded Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1163933503 Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-SecurityGroupRulesTestJSON-1163933503-project Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: cc4d9541697d4b0f9ed1ab3a7f705ce1 Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1163933503-project Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: exception: Security group 1b226e19-5937-44b1-be88-10cf0c3c61ca does not exist Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-2cf38b99-44b1-4037-b6c6-934b27f5942f'] Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '1b226e19-5937-44b1-be88-10cf0c3c61ca'} Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:23:47.496159 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1b226e19-5937-44b1-be88-10cf0c3c61ca does not exist Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cf38b99-44b1-4037-b6c6-934b27f5942f'] Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1b226e19-5937-44b1-be88-10cf0c3c61ca does not exist Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cf38b99-44b1-4037-b6c6-934b27f5942f'] Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1b226e19-5937-44b1-be88-10cf0c3c61ca does not exist Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cf38b99-44b1-4037-b6c6-934b27f5942f'] Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1b226e19-5937-44b1-be88-10cf0c3c61ca does not exist Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cf38b99-44b1-4037-b6c6-934b27f5942f'] Oct 04 21:23:47.499204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:47.504166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d81abb27-a07f-4647-9524-84c63b763427 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Returning 404 to user: Security group 1b226e19-5937-44b1-be88-10cf0c3c61ca does not exist Oct 04 21:23:47.504166 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-2cf38b99-44b1-4037-b6c6-934b27f5942f'] {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:23:47.506239 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d81abb27-a07f-4647-9524-84c63b763427 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/1b226e19-5937-44b1-be88-10cf0c3c61ca" status: 404 len: 194 microversion: 2.1 time: 0.141010 Oct 04 21:23:47.510270 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1932/3873] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:23:47 2022] DELETE /compute/v2.1/os-security-groups/1b226e19-5937-44b1-be88-10cf0c3c61ca => generated 194 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:23:47.536097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f7aafe32-edbf-4f5f-a641-d50e1f95ad9f tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Calling method '.version_select at 0x7f5794556dc0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:47.827457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-70deaa77-4b59-4e78-8cad-e0923a09e14e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:47.842824 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-70deaa77-4b59-4e78-8cad-e0923a09e14e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1500 microversion: 2.1 time: 0.407933 Oct 04 21:23:47.845936 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1942/3874] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:47 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1500 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:47.879324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0839a623-5df1-4cc7-8504-8b2799cf4bf4 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:47.880125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0839a623-5df1-4cc7-8504-8b2799cf4bf4 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:47.887715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0839a623-5df1-4cc7-8504-8b2799cf4bf4 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:47.888493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0839a623-5df1-4cc7-8504-8b2799cf4bf4 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:47.889323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0839a623-5df1-4cc7-8504-8b2799cf4bf4 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:47.890242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0839a623-5df1-4cc7-8504-8b2799cf4bf4 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:47.890841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0839a623-5df1-4cc7-8504-8b2799cf4bf4 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:47.891413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0839a623-5df1-4cc7-8504-8b2799cf4bf4 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:47.921947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0839a623-5df1-4cc7-8504-8b2799cf4bf4 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:23:48.271305 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f7aafe32-edbf-4f5f-a641-d50e1f95ad9f tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/d03bf3b4-0014-4246-85c6-b173b94f593b" status: 202 len: 0 microversion: 2.1 time: 0.758868 Oct 04 21:23:48.279011 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1933/3875] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:23:47 2022] DELETE /compute/v2.1/os-security-groups/d03bf3b4-0014-4246-85c6-b173b94f593b => generated 0 bytes in 762 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:23:48.285626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f9e59375-8a05-4135-ba40-66c1f3ed9afb tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Calling method '.version_select at 0x7f5794561670>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:48.545708 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0839a623-5df1-4cc7-8504-8b2799cf4bf4 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "DELETE /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 204 len: 0 microversion: 2.1 time: 0.668938 Oct 04 21:23:48.548356 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1943/3876] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:23:47 2022] DELETE /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:23:48.562077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1e6ab7b7-b883-4c5a-bd77-a8db26506a09 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:48.565850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1e6ab7b7-b883-4c5a-bd77-a8db26506a09 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:48.587121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e6ab7b7-b883-4c5a-bd77-a8db26506a09 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:48.590067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e6ab7b7-b883-4c5a-bd77-a8db26506a09 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:48.592490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e6ab7b7-b883-4c5a-bd77-a8db26506a09 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:48.596365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e6ab7b7-b883-4c5a-bd77-a8db26506a09 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:48.597082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e6ab7b7-b883-4c5a-bd77-a8db26506a09 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:48.600201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e6ab7b7-b883-4c5a-bd77-a8db26506a09 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:48.790945 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f9e59375-8a05-4135-ba40-66c1f3ed9afb tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/7cd04212-41f0-4947-b147-2d3cd4302cee" status: 202 len: 0 microversion: 2.1 time: 0.509785 Oct 04 21:23:48.791789 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1934/3877] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:23:48 2022] DELETE /compute/v2.1/os-security-groups/7cd04212-41f0-4947-b147-2d3cd4302cee => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:23:48.801451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3dedf855-b72a-46a9-bb62-bb2d308957f0 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Calling method '.version_select at 0x7f578b421430>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:49.320258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1e6ab7b7-b883-4c5a-bd77-a8db26506a09 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:49.336345 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1e6ab7b7-b883-4c5a-bd77-a8db26506a09 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.783272 Oct 04 21:23:49.336939 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1944/3878] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:48 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:49.770109 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3dedf855-b72a-46a9-bb62-bb2d308957f0 tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/33379597-1cd1-4b5c-a751-847832fbd0d4" status: 202 len: 0 microversion: 2.1 time: 0.973296 Oct 04 21:23:49.771226 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1935/3879] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:23:48 2022] DELETE /compute/v2.1/os-security-groups/33379597-1cd1-4b5c-a751-847832fbd0d4 => generated 0 bytes in 975 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:23:49.797536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-11b9f594-3788-4e7b-99f4-9b56c7bb0acd tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Calling method '.version_select at 0x7f578ba75160>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:50.332269 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-11b9f594-3788-4e7b-99f4-9b56c7bb0acd tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/00d3d058-59db-4c61-8343-757f3924c6b6" status: 202 len: 0 microversion: 2.1 time: 0.556410 Oct 04 21:23:50.332856 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1945/3880] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:23:49 2022] DELETE /compute/v2.1/os-security-groups/00d3d058-59db-4c61-8343-757f3924c6b6 => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:23:50.342833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0b981c70-e192-4216-9733-586f6bffcaaa tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] Calling method '.version_select at 0x7f578b4d7430>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:50.365273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-851270ad-38fb-44b9-8e9f-a5af8aac5c1b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:50.366368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-851270ad-38fb-44b9-8e9f-a5af8aac5c1b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:50.388789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-851270ad-38fb-44b9-8e9f-a5af8aac5c1b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:50.388789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-851270ad-38fb-44b9-8e9f-a5af8aac5c1b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:50.388789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-851270ad-38fb-44b9-8e9f-a5af8aac5c1b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:50.389095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-851270ad-38fb-44b9-8e9f-a5af8aac5c1b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:50.389373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-851270ad-38fb-44b9-8e9f-a5af8aac5c1b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:50.390224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-851270ad-38fb-44b9-8e9f-a5af8aac5c1b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:50.793800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-851270ad-38fb-44b9-8e9f-a5af8aac5c1b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:50.802890 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-851270ad-38fb-44b9-8e9f-a5af8aac5c1b tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.444207 Oct 04 21:23:50.832557 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1946/3881] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:50 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:51.265898 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0b981c70-e192-4216-9733-586f6bffcaaa tempest-SecurityGroupRulesTestJSON-1163933503 tempest-SecurityGroupRulesTestJSON-1163933503-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/fe407184-fb9f-4303-b181-b288665f0c08" status: 202 len: 0 microversion: 2.1 time: 0.928297 Oct 04 21:23:51.268953 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1936/3882] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:23:50 2022] DELETE /compute/v2.1/os-security-groups/fe407184-fb9f-4303-b181-b288665f0c08 => generated 0 bytes in 932 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:23:51.841105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-abef2801-2403-4e93-bfdf-2f507ede0e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:51.841801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-abef2801-2403-4e93-bfdf-2f507ede0e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:51.852167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abef2801-2403-4e93-bfdf-2f507ede0e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:51.852664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abef2801-2403-4e93-bfdf-2f507ede0e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:51.858217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abef2801-2403-4e93-bfdf-2f507ede0e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:51.866581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abef2801-2403-4e93-bfdf-2f507ede0e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:51.867323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abef2801-2403-4e93-bfdf-2f507ede0e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:51.868062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abef2801-2403-4e93-bfdf-2f507ede0e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:52.251375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-abef2801-2403-4e93-bfdf-2f507ede0e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:52.258712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:52.267210 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-abef2801-2403-4e93-bfdf-2f507ede0e20 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1506 microversion: 2.1 time: 0.431232 Oct 04 21:23:52.270479 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1947/3883] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:51 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:53.298040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d4a91a20-3fe1-441c-88f2-df218a3f2836 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:53.298741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d4a91a20-3fe1-441c-88f2-df218a3f2836 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:53.314994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4a91a20-3fe1-441c-88f2-df218a3f2836 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:53.315700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4a91a20-3fe1-441c-88f2-df218a3f2836 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:53.316590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4a91a20-3fe1-441c-88f2-df218a3f2836 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:53.318803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4a91a20-3fe1-441c-88f2-df218a3f2836 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:53.321094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4a91a20-3fe1-441c-88f2-df218a3f2836 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:53.321779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4a91a20-3fe1-441c-88f2-df218a3f2836 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:53.387904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-69904fcc-5b86-4795-b7c7-d78e3bb15f1d req-30598d48-2256-4412-ab64-a79ca1e33a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d02c46-7c8d-46b4-b0d3-1b892c9200d8", "name": "network-vif-deleted", "tag": "953c5816-9edd-416a-9759-b032a931775c"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:53.434845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-69904fcc-5b86-4795-b7c7-d78e3bb15f1d req-30598d48-2256-4412-ab64-a79ca1e33a50 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:53.435359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-69904fcc-5b86-4795-b7c7-d78e3bb15f1d req-30598d48-2256-4412-ab64-a79ca1e33a50 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:53.435805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-69904fcc-5b86-4795-b7c7-d78e3bb15f1d req-30598d48-2256-4412-ab64-a79ca1e33a50 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:53.450762 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-69904fcc-5b86-4795-b7c7-d78e3bb15f1d req-30598d48-2256-4412-ab64-a79ca1e33a50 service nova] Creating event network-vif-deleted:953c5816-9edd-416a-9759-b032a931775c for instance 33d02c46-7c8d-46b4-b0d3-1b892c9200d8 on n-h1-860282-1 Oct 04 21:23:53.456636 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-69904fcc-5b86-4795-b7c7-d78e3bb15f1d req-30598d48-2256-4412-ab64-a79ca1e33a50 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073370 Oct 04 21:23:53.457846 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1948/3884] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:23:53.564275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d4a91a20-3fe1-441c-88f2-df218a3f2836 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:53.576556 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d4a91a20-3fe1-441c-88f2-df218a3f2836 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1464 microversion: 2.1 time: 0.283805 Oct 04 21:23:53.581048 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1937/3885] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:53 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1464 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:54.612535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4be23f27-1184-4fba-9699-551c59e0c343 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:54.613248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4be23f27-1184-4fba-9699-551c59e0c343 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:54.644297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4be23f27-1184-4fba-9699-551c59e0c343 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:54.660580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4be23f27-1184-4fba-9699-551c59e0c343 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:54.660580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4be23f27-1184-4fba-9699-551c59e0c343 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:54.661164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4be23f27-1184-4fba-9699-551c59e0c343 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:54.661825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4be23f27-1184-4fba-9699-551c59e0c343 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:54.662408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4be23f27-1184-4fba-9699-551c59e0c343 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:54.752137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4be23f27-1184-4fba-9699-551c59e0c343 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:54.756167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4be23f27-1184-4fba-9699-551c59e0c343 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:54.756840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4be23f27-1184-4fba-9699-551c59e0c343 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:54.758380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-4be23f27-1184-4fba-9699-551c59e0c343 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lazy-loading 'fault' on Instance uuid 33d02c46-7c8d-46b4-b0d3-1b892c9200d8 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:23:54.913404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4be23f27-1184-4fba-9699-551c59e0c343 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:54.922813 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4be23f27-1184-4fba-9699-551c59e0c343 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 200 len: 1303 microversion: 2.1 time: 0.315466 Oct 04 21:23:54.927540 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1949/3886] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:54 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 1303 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:55.954733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4d13d39e-d6f9-47f5-a041-01cdfd1c6e08 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:55.955364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4d13d39e-d6f9-47f5-a041-01cdfd1c6e08 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: 33d02c46-7c8d-46b4-b0d3-1b892c9200d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:55.965085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d13d39e-d6f9-47f5-a041-01cdfd1c6e08 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:55.965823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d13d39e-d6f9-47f5-a041-01cdfd1c6e08 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:55.972588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d13d39e-d6f9-47f5-a041-01cdfd1c6e08 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:55.973623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d13d39e-d6f9-47f5-a041-01cdfd1c6e08 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:55.974257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d13d39e-d6f9-47f5-a041-01cdfd1c6e08 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:55.974846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d13d39e-d6f9-47f5-a041-01cdfd1c6e08 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:56.001190 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-4d13d39e-d6f9-47f5-a041-01cdfd1c6e08 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] HTTP exception thrown: Instance 33d02c46-7c8d-46b4-b0d3-1b892c9200d8 could not be found. Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4d13d39e-d6f9-47f5-a041-01cdfd1c6e08 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Request method failure captured: Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 HTTP/1.1 Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKPy-Tk0xQ_FW3BRkLNta4HquJT2ssTxZhbMRr0tlmG3KeXqTOiLALJKlOGdGjA85XSd543JGKDjPp5AeTQPPx2DC0v2O_qGI0iuwDCa01QUwhr1EN_fYsbr4KNSFncxAylYnXKnOUopZIDdDURfwDaL1UwJ89Fe3rTwbvxvk2fYxK8 Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f331cff7b8e2496bb677f8f875a36968 Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerRescueTestJSON-1933810487 Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f331cff7b8e2496bb677f8f875a36968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f331cff7b8e2496bb677f8f875a36968"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f331cff7b8e2496bb677f8f875a36968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f331cff7b8e2496bb677f8f875a36968"}]}] Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerRescueTestJSON-1933810487 Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f331cff7b8e2496bb677f8f875a36968 Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerRescueTestJSON-1933810487 Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerRescueTestJSON-1933810487-project Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 738661b84c8c4465bf8dcde0a182af6d Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerRescueTestJSON-1933810487-project Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 33d02c46-7c8d-46b4-b0d3-1b892c9200d8 could not be found. Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '33d02c46-7c8d-46b4-b0d3-1b892c9200d8'} Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d02c46-7c8d-46b4-b0d3-1b892c9200d8 could not be found. Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d02c46-7c8d-46b4-b0d3-1b892c9200d8 could not be found. Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:56.004370 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:56.008479 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:56.008479 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:23:56.008479 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:23:56.008479 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:23:56.008479 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:23:56.008479 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d02c46-7c8d-46b4-b0d3-1b892c9200d8 could not be found. Oct 04 21:23:56.008479 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:23:56.009914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4d13d39e-d6f9-47f5-a041-01cdfd1c6e08 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Returning 404 to user: Instance 33d02c46-7c8d-46b4-b0d3-1b892c9200d8 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:23:56.011120 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4d13d39e-d6f9-47f5-a041-01cdfd1c6e08 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8" status: 404 len: 111 microversion: 2.1 time: 0.060369 Oct 04 21:23:56.015580 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1938/3887] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:55 2022] GET /compute/v2.1/servers/33d02c46-7c8d-46b4-b0d3-1b892c9200d8 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:23:56.021258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1fa7379d-080e-4a37-818e-0bb7c36e5bdb tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:56.021775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1fa7379d-080e-4a37-818e-0bb7c36e5bdb tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:56.037639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fa7379d-080e-4a37-818e-0bb7c36e5bdb tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:56.038532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fa7379d-080e-4a37-818e-0bb7c36e5bdb tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:56.039137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fa7379d-080e-4a37-818e-0bb7c36e5bdb tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:56.044026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fa7379d-080e-4a37-818e-0bb7c36e5bdb tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:56.044820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fa7379d-080e-4a37-818e-0bb7c36e5bdb tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:56.045457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1fa7379d-080e-4a37-818e-0bb7c36e5bdb tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:56.114726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1fa7379d-080e-4a37-818e-0bb7c36e5bdb tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:23:56.605870 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1fa7379d-080e-4a37-818e-0bb7c36e5bdb tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 204 len: 0 microversion: 2.1 time: 0.587750 Oct 04 21:23:56.623268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ca8a117a-8c34-4584-80da-4f1b5b9a4a83 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:56.623268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ca8a117a-8c34-4584-80da-4f1b5b9a4a83 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:56.623406 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1950/3888] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:23:56 2022] DELETE /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:23:56.625837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca8a117a-8c34-4584-80da-4f1b5b9a4a83 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:56.628443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca8a117a-8c34-4584-80da-4f1b5b9a4a83 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:56.629094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca8a117a-8c34-4584-80da-4f1b5b9a4a83 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:56.631157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca8a117a-8c34-4584-80da-4f1b5b9a4a83 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:56.631828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca8a117a-8c34-4584-80da-4f1b5b9a4a83 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:56.634445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca8a117a-8c34-4584-80da-4f1b5b9a4a83 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:56.919692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1961a856-b3d3-46a7-a939-559482bca109 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:56.920779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1961a856-b3d3-46a7-a939-559482bca109 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:56.929593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1961a856-b3d3-46a7-a939-559482bca109 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:56.933298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1961a856-b3d3-46a7-a939-559482bca109 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:56.933298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1961a856-b3d3-46a7-a939-559482bca109 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:56.933298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1961a856-b3d3-46a7-a939-559482bca109 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:56.933298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1961a856-b3d3-46a7-a939-559482bca109 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:56.933298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1961a856-b3d3-46a7-a939-559482bca109 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:57.000427 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1961a856-b3d3-46a7-a939-559482bca109 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:23:57.240638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ca8a117a-8c34-4584-80da-4f1b5b9a4a83 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:57.253550 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ca8a117a-8c34-4584-80da-4f1b5b9a4a83 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1492 microversion: 2.1 time: 0.640260 Oct 04 21:23:57.254719 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1939/3889] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:56 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1492 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:57.468886 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1961a856-b3d3-46a7-a939-559482bca109 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 204 len: 0 microversion: 2.1 time: 0.553416 Oct 04 21:23:57.468886 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1951/3890] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:23:56 2022] DELETE /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:23:57.476427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-734b2e33-8b75-457b-9ff1-f33354aaaf30 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:57.477020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-734b2e33-8b75-457b-9ff1-f33354aaaf30 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:57.495755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-734b2e33-8b75-457b-9ff1-f33354aaaf30 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:57.496261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-734b2e33-8b75-457b-9ff1-f33354aaaf30 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:57.496707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-734b2e33-8b75-457b-9ff1-f33354aaaf30 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:57.497461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-734b2e33-8b75-457b-9ff1-f33354aaaf30 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:57.497904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-734b2e33-8b75-457b-9ff1-f33354aaaf30 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:57.498332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-734b2e33-8b75-457b-9ff1-f33354aaaf30 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:57.898910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-734b2e33-8b75-457b-9ff1-f33354aaaf30 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:57.931010 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-734b2e33-8b75-457b-9ff1-f33354aaaf30 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1553 microversion: 2.1 time: 0.458296 Oct 04 21:23:57.934270 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1940/3891] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:57 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1553 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:58.283911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d020f799-b232-4a83-82a0-3b856ab1d791 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:58.285581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d020f799-b232-4a83-82a0-3b856ab1d791 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:58.313171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d020f799-b232-4a83-82a0-3b856ab1d791 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:58.314249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d020f799-b232-4a83-82a0-3b856ab1d791 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:58.314783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d020f799-b232-4a83-82a0-3b856ab1d791 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:58.316315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d020f799-b232-4a83-82a0-3b856ab1d791 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:58.319194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d020f799-b232-4a83-82a0-3b856ab1d791 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:58.320939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d020f799-b232-4a83-82a0-3b856ab1d791 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:58.566101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d020f799-b232-4a83-82a0-3b856ab1d791 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:58.580507 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d020f799-b232-4a83-82a0-3b856ab1d791 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1492 microversion: 2.1 time: 0.306069 Oct 04 21:23:58.593577 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1952/3892] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:58 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1492 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:58.965750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9a802534-4394-4c35-8fa1-d942b94aed54 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:58.966400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9a802534-4394-4c35-8fa1-d942b94aed54 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:58.977678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a802534-4394-4c35-8fa1-d942b94aed54 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:58.980982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a802534-4394-4c35-8fa1-d942b94aed54 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:58.981496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a802534-4394-4c35-8fa1-d942b94aed54 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:58.993133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a802534-4394-4c35-8fa1-d942b94aed54 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:58.993690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a802534-4394-4c35-8fa1-d942b94aed54 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:58.994157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a802534-4394-4c35-8fa1-d942b94aed54 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:59.023808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:59.270028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9a802534-4394-4c35-8fa1-d942b94aed54 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:59.310498 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9a802534-4394-4c35-8fa1-d942b94aed54 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1553 microversion: 2.1 time: 0.346724 Oct 04 21:23:59.322177 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1941/3893] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:58 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1553 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:59.604473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c0dc0910-7087-423f-85bc-20644cd33b66 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:59.605020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c0dc0910-7087-423f-85bc-20644cd33b66 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:59.625098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0dc0910-7087-423f-85bc-20644cd33b66 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:59.626146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0dc0910-7087-423f-85bc-20644cd33b66 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:59.626256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0dc0910-7087-423f-85bc-20644cd33b66 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:59.627044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0dc0910-7087-423f-85bc-20644cd33b66 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:59.627526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0dc0910-7087-423f-85bc-20644cd33b66 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:59.628352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0dc0910-7087-423f-85bc-20644cd33b66 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:59.734530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c0dc0910-7087-423f-85bc-20644cd33b66 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:59.750683 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c0dc0910-7087-423f-85bc-20644cd33b66 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1450 microversion: 2.1 time: 0.150322 Oct 04 21:23:59.752644 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1953/3894] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:59 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:59.798410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-aec78e88-d79b-45dc-a271-5c8d1810b38e req-90f63e34-5ea0-41e9-ae76-afac38cb7f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca035d4-24b1-4e5a-80f8-8fb43893712c", "name": "network-vif-deleted", "tag": "b3b642a3-c1cf-4b14-a833-12c2e4b93594"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:59.818930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-aec78e88-d79b-45dc-a271-5c8d1810b38e req-90f63e34-5ea0-41e9-ae76-afac38cb7f34 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:59.819425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-aec78e88-d79b-45dc-a271-5c8d1810b38e req-90f63e34-5ea0-41e9-ae76-afac38cb7f34 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:59.820016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-aec78e88-d79b-45dc-a271-5c8d1810b38e req-90f63e34-5ea0-41e9-ae76-afac38cb7f34 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:59.833386 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-aec78e88-d79b-45dc-a271-5c8d1810b38e req-90f63e34-5ea0-41e9-ae76-afac38cb7f34 service nova] Creating event network-vif-deleted:b3b642a3-c1cf-4b14-a833-12c2e4b93594 for instance dca035d4-24b1-4e5a-80f8-8fb43893712c on n-h1-860282-1 Oct 04 21:23:59.838800 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-aec78e88-d79b-45dc-a271-5c8d1810b38e req-90f63e34-5ea0-41e9-ae76-afac38cb7f34 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044154 Oct 04 21:23:59.840566 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1942/3895] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:24:00.343549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-10da4c90-7c8b-4da2-b272-f5277edeb2c3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:00.344911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-10da4c90-7c8b-4da2-b272-f5277edeb2c3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:00.353119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10da4c90-7c8b-4da2-b272-f5277edeb2c3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:00.353832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10da4c90-7c8b-4da2-b272-f5277edeb2c3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:00.354393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10da4c90-7c8b-4da2-b272-f5277edeb2c3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:00.355381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10da4c90-7c8b-4da2-b272-f5277edeb2c3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:00.355949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10da4c90-7c8b-4da2-b272-f5277edeb2c3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:00.356476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10da4c90-7c8b-4da2-b272-f5277edeb2c3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:00.757849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-10da4c90-7c8b-4da2-b272-f5277edeb2c3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:00.770087 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-10da4c90-7c8b-4da2-b272-f5277edeb2c3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1553 microversion: 2.1 time: 0.432113 Oct 04 21:24:00.770671 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1954/3896] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:00 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1553 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:00.780437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e04b68d8-8af2-44f6-bc08-6942bf1d2735 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:00.782200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e04b68d8-8af2-44f6-bc08-6942bf1d2735 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:00.800011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e04b68d8-8af2-44f6-bc08-6942bf1d2735 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:00.801260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e04b68d8-8af2-44f6-bc08-6942bf1d2735 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:00.801962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e04b68d8-8af2-44f6-bc08-6942bf1d2735 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:00.802937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e04b68d8-8af2-44f6-bc08-6942bf1d2735 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:00.803630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e04b68d8-8af2-44f6-bc08-6942bf1d2735 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:00.804465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e04b68d8-8af2-44f6-bc08-6942bf1d2735 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:00.849336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e04b68d8-8af2-44f6-bc08-6942bf1d2735 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:00.850086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e04b68d8-8af2-44f6-bc08-6942bf1d2735 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:00.850677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e04b68d8-8af2-44f6-bc08-6942bf1d2735 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:00.851277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-e04b68d8-8af2-44f6-bc08-6942bf1d2735 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lazy-loading 'fault' on Instance uuid dca035d4-24b1-4e5a-80f8-8fb43893712c {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:24:00.946372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e04b68d8-8af2-44f6-bc08-6942bf1d2735 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '738661b84c8c4465bf8dcde0a182af6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f331cff7b8e2496bb677f8f875a36968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:00.955920 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e04b68d8-8af2-44f6-bc08-6942bf1d2735 tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 200 len: 1304 microversion: 2.1 time: 0.182947 Oct 04 21:24:00.957300 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1943/3897] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:00 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 1304 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:01.086506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-8684a1c9-81b1-4885-b31c-970dbcee1b28 req-b98f5303-9f9e-4bf0-93de-a78c79e30dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541881f6-6361-4971-b222-65fbd3878425", "name": "network-vif-deleted", "tag": "5bf3fe20-6955-4e62-8eee-3a53f13f5a34"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:01.098109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8684a1c9-81b1-4885-b31c-970dbcee1b28 req-b98f5303-9f9e-4bf0-93de-a78c79e30dbc service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:01.098867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8684a1c9-81b1-4885-b31c-970dbcee1b28 req-b98f5303-9f9e-4bf0-93de-a78c79e30dbc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:01.100305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8684a1c9-81b1-4885-b31c-970dbcee1b28 req-b98f5303-9f9e-4bf0-93de-a78c79e30dbc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:01.157619 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-8684a1c9-81b1-4885-b31c-970dbcee1b28 req-b98f5303-9f9e-4bf0-93de-a78c79e30dbc service nova] Creating event network-vif-deleted:5bf3fe20-6955-4e62-8eee-3a53f13f5a34 for instance 541881f6-6361-4971-b222-65fbd3878425 on n-h2-860282-1 Oct 04 21:24:01.162980 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-8684a1c9-81b1-4885-b31c-970dbcee1b28 req-b98f5303-9f9e-4bf0-93de-a78c79e30dbc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080496 Oct 04 21:24:01.169744 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1955/3898] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:24:01.794281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7098eaef-ca89-43eb-93db-49ac7897fe82 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:01.794916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7098eaef-ca89-43eb-93db-49ac7897fe82 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:01.829062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7098eaef-ca89-43eb-93db-49ac7897fe82 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:01.831986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7098eaef-ca89-43eb-93db-49ac7897fe82 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:01.836004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7098eaef-ca89-43eb-93db-49ac7897fe82 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:01.836873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7098eaef-ca89-43eb-93db-49ac7897fe82 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:01.843561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7098eaef-ca89-43eb-93db-49ac7897fe82 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:01.844140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7098eaef-ca89-43eb-93db-49ac7897fe82 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:01.982177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-19586b60-7d7a-48bd-b699-204cdc12e62e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:01.982927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-19586b60-7d7a-48bd-b699-204cdc12e62e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] [instance: dca035d4-24b1-4e5a-80f8-8fb43893712c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:02.004450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7098eaef-ca89-43eb-93db-49ac7897fe82 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:02.008816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19586b60-7d7a-48bd-b699-204cdc12e62e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:02.010930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19586b60-7d7a-48bd-b699-204cdc12e62e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:02.014865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19586b60-7d7a-48bd-b699-204cdc12e62e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:02.014865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19586b60-7d7a-48bd-b699-204cdc12e62e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:02.015254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19586b60-7d7a-48bd-b699-204cdc12e62e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:02.016949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19586b60-7d7a-48bd-b699-204cdc12e62e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:02.019564 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7098eaef-ca89-43eb-93db-49ac7897fe82 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1345 microversion: 2.1 time: 0.230035 Oct 04 21:24:02.026705 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1944/3899] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:01 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1345 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:02.058075 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-19586b60-7d7a-48bd-b699-204cdc12e62e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] HTTP exception thrown: Instance dca035d4-24b1-4e5a-80f8-8fb43893712c could not be found. Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-19586b60-7d7a-48bd-b699-204cdc12e62e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Request method failure captured: Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c HTTP/1.1 Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKPy-Tk0xQ_FW3BRkLNta4HquJT2ssTxZhbMRr0tlmG3KeXqTOiLALJKlOGdGjA85XSd543JGKDjPp5AeTQPPx2DC0v2O_qGI0iuwDCa01QUwhr1EN_fYsbr4KNSFncxAylYnXKnOUopZIDdDURfwDaL1UwJ89Fe3rTwbvxvk2fYxK8 Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f331cff7b8e2496bb677f8f875a36968 Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerRescueTestJSON-1933810487 Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f331cff7b8e2496bb677f8f875a36968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f331cff7b8e2496bb677f8f875a36968"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f331cff7b8e2496bb677f8f875a36968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f331cff7b8e2496bb677f8f875a36968"}]}] Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerRescueTestJSON-1933810487 Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f331cff7b8e2496bb677f8f875a36968 Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerRescueTestJSON-1933810487 Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerRescueTestJSON-1933810487-project Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 738661b84c8c4465bf8dcde0a182af6d Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerRescueTestJSON-1933810487-project Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance dca035d4-24b1-4e5a-80f8-8fb43893712c could not be found. Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'dca035d4-24b1-4e5a-80f8-8fb43893712c'} Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dca035d4-24b1-4e5a-80f8-8fb43893712c could not be found. Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dca035d4-24b1-4e5a-80f8-8fb43893712c could not be found. Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:02.060136 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:02.065203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:02.065203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:02.065203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:02.065203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:24:02.065203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:24:02.065203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dca035d4-24b1-4e5a-80f8-8fb43893712c could not be found. Oct 04 21:24:02.065203 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:02.065203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-19586b60-7d7a-48bd-b699-204cdc12e62e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] Returning 404 to user: Instance dca035d4-24b1-4e5a-80f8-8fb43893712c could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:24:02.065203 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-19586b60-7d7a-48bd-b699-204cdc12e62e tempest-ServerRescueTestJSON-1933810487 tempest-ServerRescueTestJSON-1933810487-project] 10.222.0.30 "GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c" status: 404 len: 111 microversion: 2.1 time: 0.085297 Oct 04 21:24:02.066158 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1956/3900] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:01 2022] GET /compute/v2.1/servers/dca035d4-24b1-4e5a-80f8-8fb43893712c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:24:03.048982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-eebe4678-9689-47f1-9fd1-6573b1d57577 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:03.050821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-eebe4678-9689-47f1-9fd1-6573b1d57577 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:03.061339 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:24:03.061714 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 21:24:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 (ip 10.222.0.30) !!! Oct 04 21:24:03.066685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eebe4678-9689-47f1-9fd1-6573b1d57577 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:03.068174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eebe4678-9689-47f1-9fd1-6573b1d57577 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:03.068862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eebe4678-9689-47f1-9fd1-6573b1d57577 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:03.069894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eebe4678-9689-47f1-9fd1-6573b1d57577 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:03.070746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eebe4678-9689-47f1-9fd1-6573b1d57577 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:03.071438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eebe4678-9689-47f1-9fd1-6573b1d57577 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:03.216162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-eebe4678-9689-47f1-9fd1-6573b1d57577 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:03.228492 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-eebe4678-9689-47f1-9fd1-6573b1d57577 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1345 microversion: 2.1 time: 0.185362 Oct 04 21:24:03.233608 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1945/3901] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:03 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1345 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:03.429566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c994216d-5c51-4830-ae4a-39149c8c6f17 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:03.432119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c994216d-5c51-4830-ae4a-39149c8c6f17 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:03.443464 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:24:03.443861 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 21:24:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action (ip 10.222.0.30) !!! Oct 04 21:24:03.452126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c994216d-5c51-4830-ae4a-39149c8c6f17 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:03.452966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c994216d-5c51-4830-ae4a-39149c8c6f17 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:03.454595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c994216d-5c51-4830-ae4a-39149c8c6f17 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:03.455462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c994216d-5c51-4830-ae4a-39149c8c6f17 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:03.460293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c994216d-5c51-4830-ae4a-39149c8c6f17 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:03.461941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c994216d-5c51-4830-ae4a-39149c8c6f17 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:03.771353 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c994216d-5c51-4830-ae4a-39149c8c6f17 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action" status: 202 len: 0 microversion: 2.1 time: 0.345666 Oct 04 21:24:03.772109 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1957/3902] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:24:03 2022] POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:24:03.782104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-33d61a27-a52c-4ed7-9523-db6b7596c290 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:03.782104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-33d61a27-a52c-4ed7-9523-db6b7596c290 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:03.789387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33d61a27-a52c-4ed7-9523-db6b7596c290 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:03.789920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33d61a27-a52c-4ed7-9523-db6b7596c290 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:03.790366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33d61a27-a52c-4ed7-9523-db6b7596c290 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:03.791344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33d61a27-a52c-4ed7-9523-db6b7596c290 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:03.792034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33d61a27-a52c-4ed7-9523-db6b7596c290 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:03.792650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33d61a27-a52c-4ed7-9523-db6b7596c290 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:04.241797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-33d61a27-a52c-4ed7-9523-db6b7596c290 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:04.251445 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-33d61a27-a52c-4ed7-9523-db6b7596c290 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1670 microversion: 2.1 time: 0.475008 Oct 04 21:24:04.252039 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1946/3903] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:03 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1670 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:04.275707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-53a7e177-f0a9-4942-a04b-f74689e923de tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:04.277061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-53a7e177-f0a9-4942-a04b-f74689e923de tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:04.284380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53a7e177-f0a9-4942-a04b-f74689e923de tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:04.285717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53a7e177-f0a9-4942-a04b-f74689e923de tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:04.286338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53a7e177-f0a9-4942-a04b-f74689e923de tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:04.287457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53a7e177-f0a9-4942-a04b-f74689e923de tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:04.288076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53a7e177-f0a9-4942-a04b-f74689e923de tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:04.288660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53a7e177-f0a9-4942-a04b-f74689e923de tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:04.401843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-53a7e177-f0a9-4942-a04b-f74689e923de tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:04.413396 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-53a7e177-f0a9-4942-a04b-f74689e923de tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1345 microversion: 2.1 time: 0.145188 Oct 04 21:24:04.418016 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1958/3904] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:04 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1345 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:05.282918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-17054617-168a-43c3-8f25-72db93be3c4d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:05.284185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-17054617-168a-43c3-8f25-72db93be3c4d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:05.292807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17054617-168a-43c3-8f25-72db93be3c4d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:05.293559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17054617-168a-43c3-8f25-72db93be3c4d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:05.294241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17054617-168a-43c3-8f25-72db93be3c4d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:05.295251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17054617-168a-43c3-8f25-72db93be3c4d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:05.295832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17054617-168a-43c3-8f25-72db93be3c4d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:05.296714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17054617-168a-43c3-8f25-72db93be3c4d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:05.442584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3f5519da-c779-4881-9673-aef71aa3252b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:05.445057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3f5519da-c779-4881-9673-aef71aa3252b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:05.471274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f5519da-c779-4881-9673-aef71aa3252b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:05.473075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f5519da-c779-4881-9673-aef71aa3252b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:05.473568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f5519da-c779-4881-9673-aef71aa3252b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:05.485089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f5519da-c779-4881-9673-aef71aa3252b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:05.487030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f5519da-c779-4881-9673-aef71aa3252b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:05.487493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f5519da-c779-4881-9673-aef71aa3252b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:05.702784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3f5519da-c779-4881-9673-aef71aa3252b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:05.711794 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3f5519da-c779-4881-9673-aef71aa3252b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1345 microversion: 2.1 time: 0.273238 Oct 04 21:24:05.725125 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1959/3905] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:05 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1345 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:05.792985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-17054617-168a-43c3-8f25-72db93be3c4d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:05.806698 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-17054617-168a-43c3-8f25-72db93be3c4d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1670 microversion: 2.1 time: 0.527608 Oct 04 21:24:05.824303 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1947/3906] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:05 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1670 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:06.742596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d532694b-651a-48df-aac0-889938fc6ee5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:06.743776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d532694b-651a-48df-aac0-889938fc6ee5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:06.770318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d532694b-651a-48df-aac0-889938fc6ee5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:06.770860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d532694b-651a-48df-aac0-889938fc6ee5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:06.771324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d532694b-651a-48df-aac0-889938fc6ee5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:06.775308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d532694b-651a-48df-aac0-889938fc6ee5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:06.778409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d532694b-651a-48df-aac0-889938fc6ee5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:06.778945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d532694b-651a-48df-aac0-889938fc6ee5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:06.833891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-56885756-1054-49ff-929e-32f9963767f9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:06.834514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-56885756-1054-49ff-929e-32f9963767f9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:06.847204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56885756-1054-49ff-929e-32f9963767f9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:06.848969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56885756-1054-49ff-929e-32f9963767f9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:06.849444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56885756-1054-49ff-929e-32f9963767f9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:06.852486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56885756-1054-49ff-929e-32f9963767f9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:06.859265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56885756-1054-49ff-929e-32f9963767f9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:06.860003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56885756-1054-49ff-929e-32f9963767f9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:07.040026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d532694b-651a-48df-aac0-889938fc6ee5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:07.067993 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d532694b-651a-48df-aac0-889938fc6ee5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1345 microversion: 2.1 time: 0.322730 Oct 04 21:24:07.113919 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1960/3907] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:06 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1345 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:07.888448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-56885756-1054-49ff-929e-32f9963767f9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:07.906077 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-56885756-1054-49ff-929e-32f9963767f9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 1.068962 Oct 04 21:24:07.909232 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1948/3908] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:06 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:08.125953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6cdd1dcd-c4cd-413e-98da-557d7c2d69b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:08.126637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6cdd1dcd-c4cd-413e-98da-557d7c2d69b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:08.145227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cdd1dcd-c4cd-413e-98da-557d7c2d69b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:08.148023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cdd1dcd-c4cd-413e-98da-557d7c2d69b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:08.154211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cdd1dcd-c4cd-413e-98da-557d7c2d69b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:08.155263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cdd1dcd-c4cd-413e-98da-557d7c2d69b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:08.157568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cdd1dcd-c4cd-413e-98da-557d7c2d69b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:08.160723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cdd1dcd-c4cd-413e-98da-557d7c2d69b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:08.223761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cdd1dcd-c4cd-413e-98da-557d7c2d69b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:08.232818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cdd1dcd-c4cd-413e-98da-557d7c2d69b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:08.233802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cdd1dcd-c4cd-413e-98da-557d7c2d69b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:08.234498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-6cdd1dcd-c4cd-413e-98da-557d7c2d69b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lazy-loading 'fault' on Instance uuid 541881f6-6361-4971-b222-65fbd3878425 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:24:08.248370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:08.552130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6cdd1dcd-c4cd-413e-98da-557d7c2d69b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:08.570449 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6cdd1dcd-c4cd-413e-98da-557d7c2d69b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 200 len: 1350 microversion: 2.1 time: 0.439290 Oct 04 21:24:08.571151 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1961/3909] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:08 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 1350 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:09.595851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3ae2a3c6-b5fa-4c45-b248-bddd3f7cda95 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:09.598706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3ae2a3c6-b5fa-4c45-b248-bddd3f7cda95 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:09.624775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ae2a3c6-b5fa-4c45-b248-bddd3f7cda95 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:09.625306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ae2a3c6-b5fa-4c45-b248-bddd3f7cda95 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:09.627852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ae2a3c6-b5fa-4c45-b248-bddd3f7cda95 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:09.630819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ae2a3c6-b5fa-4c45-b248-bddd3f7cda95 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:09.631179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ae2a3c6-b5fa-4c45-b248-bddd3f7cda95 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:09.634377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ae2a3c6-b5fa-4c45-b248-bddd3f7cda95 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:09.688835 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-3ae2a3c6-b5fa-4c45-b248-bddd3f7cda95 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3ae2a3c6-b5fa-4c45-b248-bddd3f7cda95 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 HTTP/1.1 Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '541881f6-6361-4971-b222-65fbd3878425'} Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:09.691188 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:09.695277 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:09.695277 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:09.695277 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:09.695277 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:24:09.695277 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:24:09.695277 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:24:09.695277 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:09.696588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3ae2a3c6-b5fa-4c45-b248-bddd3f7cda95 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:24:09.698557 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3ae2a3c6-b5fa-4c45-b248-bddd3f7cda95 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 404 len: 111 microversion: 2.1 time: 0.106130 Oct 04 21:24:09.699782 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1949/3910] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:09 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:24:09.968403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-509c7c84-0342-4183-b41c-0306fe1ede9e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:09.971305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-509c7c84-0342-4183-b41c-0306fe1ede9e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:09.991412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-509c7c84-0342-4183-b41c-0306fe1ede9e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:09.992000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-509c7c84-0342-4183-b41c-0306fe1ede9e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:09.992448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-509c7c84-0342-4183-b41c-0306fe1ede9e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:09.993170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-509c7c84-0342-4183-b41c-0306fe1ede9e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:09.993663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-509c7c84-0342-4183-b41c-0306fe1ede9e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:09.994093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-509c7c84-0342-4183-b41c-0306fe1ede9e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:10.011947 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-509c7c84-0342-4183-b41c-0306fe1ede9e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-509c7c84-0342-4183-b41c-0306fe1ede9e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425/os-volume_attachments HTTP/1.1 Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'server_id': '541881f6-6361-4971-b222-65fbd3878425'} Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:24:10.013886 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:24:10.017174 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:24:10.017174 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:10.017174 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:10.017174 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:10.017174 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:10.017174 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:10.017174 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:10.017174 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:24:10.017174 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:24:10.017174 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:24:10.017174 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:10.020610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-509c7c84-0342-4183-b41c-0306fe1ede9e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:24:10.020610 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-509c7c84-0342-4183-b41c-0306fe1ede9e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.057460 Oct 04 21:24:10.021907 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1962/3911] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:24:09 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425/os-volume_attachments => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:24:10.664300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e170c710-57b5-4b4f-a173-32d51a654dff tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1034722250", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "f54abd1e-a2a0-4f4b-b858-f3831f4d8295"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:10.786901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-e170c710-57b5-4b4f-a173-32d51a654dff tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] validate_networks() for [('f54abd1e-a2a0-4f4b-b858-f3831f4d8295', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:24:12.030668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e170c710-57b5-4b4f-a173-32d51a654dff tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:24:12.031249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e170c710-57b5-4b4f-a173-32d51a654dff tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:24:12.031774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e170c710-57b5-4b4f-a173-32d51a654dff tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:24:12.032425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e170c710-57b5-4b4f-a173-32d51a654dff tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:24:12.033060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e170c710-57b5-4b4f-a173-32d51a654dff tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:24:12.120206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e170c710-57b5-4b4f-a173-32d51a654dff tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:12.120206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e170c710-57b5-4b4f-a173-32d51a654dff tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:12.120206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e170c710-57b5-4b4f-a173-32d51a654dff tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:12.120206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e170c710-57b5-4b4f-a173-32d51a654dff tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:12.120206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e170c710-57b5-4b4f-a173-32d51a654dff tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:12.120206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e170c710-57b5-4b4f-a173-32d51a654dff tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:12.120206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-e170c710-57b5-4b4f-a173-32d51a654dff tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Getting quotas for project 68c56e6603d14d9b8ad9c74a9df021c9. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:24:12.120206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-e170c710-57b5-4b4f-a173-32d51a654dff tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Getting quotas for user 416e0c617ee34a19a7d6936b78c1d94d and project 68c56e6603d14d9b8ad9c74a9df021c9. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:24:12.121926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e170c710-57b5-4b4f-a173-32d51a654dff tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:24:12.123735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e170c710-57b5-4b4f-a173-32d51a654dff tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: fa6c9848-6cc7-4532-a29d-865a35cb2e34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:24:12.450835 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e170c710-57b5-4b4f-a173-32d51a654dff tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.796100 Oct 04 21:24:12.458399 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1950/3912] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:24:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:24:12.463935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-50eb7ec9-886b-42c5-a10b-ccff655f4466 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:12.464808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-50eb7ec9-886b-42c5-a10b-ccff655f4466 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: fa6c9848-6cc7-4532-a29d-865a35cb2e34] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:12.803235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-50eb7ec9-886b-42c5-a10b-ccff655f4466 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:12.813109 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-50eb7ec9-886b-42c5-a10b-ccff655f4466 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/fa6c9848-6cc7-4532-a29d-865a35cb2e34" status: 200 len: 1215 microversion: 2.1 time: 0.353923 Oct 04 21:24:12.825841 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1963/3913] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:12 2022] GET /compute/v2.1/servers/fa6c9848-6cc7-4532-a29d-865a35cb2e34 => generated 1215 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:12.844201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1e789abf-daf0-419f-a8d2-6aec6eda65aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:12.845772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1e789abf-daf0-419f-a8d2-6aec6eda65aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: fa6c9848-6cc7-4532-a29d-865a35cb2e34] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:12.865283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:12.892602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1e789abf-daf0-419f-a8d2-6aec6eda65aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: fa6c9848-6cc7-4532-a29d-865a35cb2e34] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:24:13.957745 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.scheduler.client.report [None req-1e789abf-daf0-419f-a8d2-6aec6eda65aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Deleted allocations for instance fa6c9848-6cc7-4532-a29d-865a35cb2e34 Oct 04 21:24:13.963973 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.compute.api [None req-1e789abf-daf0-419f-a8d2-6aec6eda65aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: fa6c9848-6cc7-4532-a29d-865a35cb2e34] Instance Mapping does not exist while attempting local delete cleanup. Oct 04 21:24:13.965000 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1e789abf-daf0-419f-a8d2-6aec6eda65aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fa6c9848-6cc7-4532-a29d-865a35cb2e34" status: 204 len: 0 microversion: 2.1 time: 1.127496 Oct 04 21:24:13.981839 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1951/3914] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:24:12 2022] DELETE /compute/v2.1/servers/fa6c9848-6cc7-4532-a29d-865a35cb2e34 => generated 0 bytes in 1137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:24:13.990249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-43b716df-83ed-41d1-9e5e-026223d6d1f3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:13.990980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-43b716df-83ed-41d1-9e5e-026223d6d1f3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: fa6c9848-6cc7-4532-a29d-865a35cb2e34] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:14.011806 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-43b716df-83ed-41d1-9e5e-026223d6d1f3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance fa6c9848-6cc7-4532-a29d-865a35cb2e34 could not be found. Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-43b716df-83ed-41d1-9e5e-026223d6d1f3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/fa6c9848-6cc7-4532-a29d-865a35cb2e34 HTTP/1.1 Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance fa6c9848-6cc7-4532-a29d-865a35cb2e34 could not be found. Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'fa6c9848-6cc7-4532-a29d-865a35cb2e34'} Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa6c9848-6cc7-4532-a29d-865a35cb2e34 could not be found. Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa6c9848-6cc7-4532-a29d-865a35cb2e34 could not be found. Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:14.023565 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:14.028678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:14.028678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:24:14.028678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:24:14.028678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa6c9848-6cc7-4532-a29d-865a35cb2e34 could not be found. Oct 04 21:24:14.028678 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:14.028678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-43b716df-83ed-41d1-9e5e-026223d6d1f3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance fa6c9848-6cc7-4532-a29d-865a35cb2e34 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:24:14.028678 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-43b716df-83ed-41d1-9e5e-026223d6d1f3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/fa6c9848-6cc7-4532-a29d-865a35cb2e34" status: 404 len: 111 microversion: 2.1 time: 0.041819 Oct 04 21:24:14.031165 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1964/3915] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:13 2022] GET /compute/v2.1/servers/fa6c9848-6cc7-4532-a29d-865a35cb2e34 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:24:14.240285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7b621ad3-651f-406d-b99d-3fcc2f72907b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-700179336", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "f54abd1e-a2a0-4f4b-b858-f3831f4d8295"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:14.323437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-7b621ad3-651f-406d-b99d-3fcc2f72907b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] validate_networks() for [('f54abd1e-a2a0-4f4b-b858-f3831f4d8295', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:24:15.893984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7b621ad3-651f-406d-b99d-3fcc2f72907b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:24:15.894540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7b621ad3-651f-406d-b99d-3fcc2f72907b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:24:15.895101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7b621ad3-651f-406d-b99d-3fcc2f72907b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:24:15.895541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7b621ad3-651f-406d-b99d-3fcc2f72907b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:24:15.896039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7b621ad3-651f-406d-b99d-3fcc2f72907b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:24:15.921933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b621ad3-651f-406d-b99d-3fcc2f72907b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:15.925832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b621ad3-651f-406d-b99d-3fcc2f72907b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:15.926432 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b621ad3-651f-406d-b99d-3fcc2f72907b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:15.927126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b621ad3-651f-406d-b99d-3fcc2f72907b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:15.927570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b621ad3-651f-406d-b99d-3fcc2f72907b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:15.931784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b621ad3-651f-406d-b99d-3fcc2f72907b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:15.997059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7b621ad3-651f-406d-b99d-3fcc2f72907b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Getting quotas for project 68c56e6603d14d9b8ad9c74a9df021c9. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:24:16.005064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7b621ad3-651f-406d-b99d-3fcc2f72907b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Getting quotas for user 416e0c617ee34a19a7d6936b78c1d94d and project 68c56e6603d14d9b8ad9c74a9df021c9. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:24:16.026303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7b621ad3-651f-406d-b99d-3fcc2f72907b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:24:16.028512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7b621ad3-651f-406d-b99d-3fcc2f72907b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:24:16.172654 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7b621ad3-651f-406d-b99d-3fcc2f72907b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.936593 Oct 04 21:24:16.184939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d5f215a6-0b06-490f-b6e4-ad2011c14f77 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:16.186251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d5f215a6-0b06-490f-b6e4-ad2011c14f77 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:16.189633 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1952/3916] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:24:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:24:16.353756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d5f215a6-0b06-490f-b6e4-ad2011c14f77 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:16.361960 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d5f215a6-0b06-490f-b6e4-ad2011c14f77 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1214 microversion: 2.1 time: 0.181306 Oct 04 21:24:16.369876 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1965/3917] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:16 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:17.388129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-44ebf49c-c6b2-409e-892a-9cc9767ed198 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:17.389208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-44ebf49c-c6b2-409e-892a-9cc9767ed198 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:17.570711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-44ebf49c-c6b2-409e-892a-9cc9767ed198 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:17.582912 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-44ebf49c-c6b2-409e-892a-9cc9767ed198 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1214 microversion: 2.1 time: 0.199265 Oct 04 21:24:17.593445 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1953/3918] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:17 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1214 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:18.624814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2b7dc3bb-a1fd-446a-8e67-4f147b239e08 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:18.626332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2b7dc3bb-a1fd-446a-8e67-4f147b239e08 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:18.650272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b7dc3bb-a1fd-446a-8e67-4f147b239e08 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:18.651779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b7dc3bb-a1fd-446a-8e67-4f147b239e08 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:18.653751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b7dc3bb-a1fd-446a-8e67-4f147b239e08 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:18.656567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b7dc3bb-a1fd-446a-8e67-4f147b239e08 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:18.657164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b7dc3bb-a1fd-446a-8e67-4f147b239e08 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:18.658554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b7dc3bb-a1fd-446a-8e67-4f147b239e08 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:18.882741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2b7dc3bb-a1fd-446a-8e67-4f147b239e08 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:18.894754 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2b7dc3bb-a1fd-446a-8e67-4f147b239e08 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1210 microversion: 2.1 time: 0.276605 Oct 04 21:24:18.895372 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1954/3919] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:18 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1210 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:24:18.979321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c273bdd8-9e4d-4121-bbc2-a0fcfdacfa71 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Action: 'create', calling method: .version_select at 0x7f578b5fa3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-746852393", "description": "tempest-description-214139011"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:19.673843 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c273bdd8-9e4d-4121-bbc2-a0fcfdacfa71 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.057923 Oct 04 21:24:19.675145 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1966/3920] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:24:18 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:24:19.694913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-09b298bf-8808-46b3-8ed2-997175c37b2e tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Action: 'create', calling method: .version_select at 0x7f578be9df70>, body: {"security_group_rule": {"parent_group_id": "ad99674b-d53c-4617-89ea-744982525442", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:19.924505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-98b551e3-837b-4a4c-84d7-a8f9a6e369e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:19.925289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-98b551e3-837b-4a4c-84d7-a8f9a6e369e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:19.927249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:19.938446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98b551e3-837b-4a4c-84d7-a8f9a6e369e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:19.939059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98b551e3-837b-4a4c-84d7-a8f9a6e369e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:19.939513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98b551e3-837b-4a4c-84d7-a8f9a6e369e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:19.940244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98b551e3-837b-4a4c-84d7-a8f9a6e369e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:19.940720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98b551e3-837b-4a4c-84d7-a8f9a6e369e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:19.941156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98b551e3-837b-4a4c-84d7-a8f9a6e369e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:20.105909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-98b551e3-837b-4a4c-84d7-a8f9a6e369e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:20.117590 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-98b551e3-837b-4a4c-84d7-a8f9a6e369e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1284 microversion: 2.1 time: 0.197126 Oct 04 21:24:20.118837 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1967/3921] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:19 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:20.366918 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-09b298bf-8808-46b3-8ed2-997175c37b2e tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.682294 Oct 04 21:24:20.367819 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1955/3922] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Oct 4 21:24:19 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:24:20.380678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-67ebd9f2-1a82-449a-a29a-a2cb5a61b3bb tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Action: 'create', calling method: .version_select at 0x7f578b5fa310>, body: {"security_group_rule": {"parent_group_id": "ad99674b-d53c-4617-89ea-744982525442", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:20.472766 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-67ebd9f2-1a82-449a-a29a-a2cb5a61b3bb tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] HTTP exception thrown: This rule already exists in group ad99674b-d53c-4617-89ea-744982525442 Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-67ebd9f2-1a82-449a-a29a-a2cb5a61b3bb tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Request method failure captured: Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 138 Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKSChBH19BDJm5oTNkw3Sng0r6lse3H2PrVD4PZ0Arulp4zId60dzIuKzxMaLOkVZfHixLxTCwmluKHNK0SCnWEZK8YVNazPHeNdp-SA_pY2rdVQhy2bRaKLvHzJACo59smms-rOMDlf6bg8Wj1FNrCpkQMBaEH09HhXxZ_Wj-O5XcI Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 6e283c9c05f64d4cbe918531e604e162 Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e283c9c05f64d4cbe918531e604e162"}]}] Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 6e283c9c05f64d4cbe918531e604e162 Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-666469588-project Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: be805b5aaf65418b980924cdc4149bcc Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588-project Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: {"security_group_rule": {"parent_group_id": "ad99674b-d53c-4617-89ea-744982525442", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: exception: This rule already exists in group ad99674b-d53c-4617-89ea-744982525442 Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ad99674b-d53c-4617-89ea-744982525442', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group ad99674b-d53c-4617-89ea-744982525442 Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group ad99674b-d53c-4617-89ea-744982525442 Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:20.474361 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:20.478450 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:24:20.478450 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:24:20.478450 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group ad99674b-d53c-4617-89ea-744982525442 Oct 04 21:24:20.478450 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:20.478450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-67ebd9f2-1a82-449a-a29a-a2cb5a61b3bb tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Returning 400 to user: This rule already exists in group ad99674b-d53c-4617-89ea-744982525442 {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:24:20.478450 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-67ebd9f2-1a82-449a-a29a-a2cb5a61b3bb tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.099824 Oct 04 21:24:20.478450 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1968/3923] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Oct 4 21:24:20 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:24:20.486652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-909f2a9d-feb6-4fbf-81ed-3ab41d25f3fa tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Calling method '.version_select at 0x7f578bbf63a0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:20.844722 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-909f2a9d-feb6-4fbf-81ed-3ab41d25f3fa tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/f932199b-9588-4c86-8839-c792ceadc5c2" status: 202 len: 0 microversion: 2.1 time: 0.362438 Oct 04 21:24:20.847686 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1956/3924] 10.222.0.30 () {58 vars in 1287 bytes} [Tue Oct 4 21:24:20 2022] DELETE /compute/v2.1/os-security-group-rules/f932199b-9588-4c86-8839-c792ceadc5c2 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:24:20.859583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4717f3a7-397c-4510-8935-b93ea3a3729c tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Action: 'create', calling method: .version_select at 0x7f578b5d9280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-320924552", "description": "tempest-description-291788033"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:21.146628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9b55739e-272c-4970-ad78-c57053ee2a60 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:21.148135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9b55739e-272c-4970-ad78-c57053ee2a60 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:21.164888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b55739e-272c-4970-ad78-c57053ee2a60 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:21.168967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b55739e-272c-4970-ad78-c57053ee2a60 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:21.170210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b55739e-272c-4970-ad78-c57053ee2a60 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:21.173680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b55739e-272c-4970-ad78-c57053ee2a60 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:21.176394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b55739e-272c-4970-ad78-c57053ee2a60 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:21.177627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b55739e-272c-4970-ad78-c57053ee2a60 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:21.292699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9b55739e-272c-4970-ad78-c57053ee2a60 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:21.312757 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9b55739e-272c-4970-ad78-c57053ee2a60 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1272 microversion: 2.1 time: 0.168187 Oct 04 21:24:21.315915 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4717f3a7-397c-4510-8935-b93ea3a3729c tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.460972 Oct 04 21:24:21.316846 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1969/3925] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:24:20 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:24:21.319280 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1957/3926] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:21 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:24:21.344897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b17065e7-cfda-4512-91bd-71838966f3c5 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Action: 'create', calling method: .version_select at 0x7f578b68b5e0>, body: {"security_group_rule": {"parent_group_id": "5ac42284-8a5e-49ae-8ed7-3c3b977390fd", "ip_protocol": "tcp", "from_port": 1052477648, "to_port": 22}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:21.399263 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-b17065e7-cfda-4512-91bd-71838966f3c5 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] HTTP exception thrown: Invalid port range 1052477648:22. Former value cannot be greater than the later Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b17065e7-cfda-4512-91bd-71838966f3c5 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Request method failure captured: Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 146 Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKSChBH19BDJm5oTNkw3Sng0r6lse3H2PrVD4PZ0Arulp4zId60dzIuKzxMaLOkVZfHixLxTCwmluKHNK0SCnWEZK8YVNazPHeNdp-SA_pY2rdVQhy2bRaKLvHzJACo59smms-rOMDlf6bg8Wj1FNrCpkQMBaEH09HhXxZ_Wj-O5XcI Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 6e283c9c05f64d4cbe918531e604e162 Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e283c9c05f64d4cbe918531e604e162"}]}] Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 6e283c9c05f64d4cbe918531e604e162 Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-666469588-project Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: be805b5aaf65418b980924cdc4149bcc Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588-project Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: {"security_group_rule": {"parent_group_id": "5ac42284-8a5e-49ae-8ed7-3c3b977390fd", "ip_protocol": "tcp", "from_port": 1052477648, "to_port": 22}} Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid port range 1052477648:22. Former value cannot be greater than the later Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5ac42284-8a5e-49ae-8ed7-3c3b977390fd', 'ip_protocol': 'tcp', 'from_port': 1052477648, 'to_port': 22}}} Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1052477648:22. Former value cannot be greater than the later Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1052477648:22. Former value cannot be greater than the later Oct 04 21:24:21.401559 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:21.411923 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:21.411923 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:21.411923 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:21.411923 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:21.411923 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:21.411923 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:24:21.411923 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:24:21.411923 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1052477648:22. Former value cannot be greater than the later Oct 04 21:24:21.411923 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:21.414036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b17065e7-cfda-4512-91bd-71838966f3c5 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Returning 400 to user: Invalid port range 1052477648:22. Former value cannot be greater than the later {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:24:21.415053 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b17065e7-cfda-4512-91bd-71838966f3c5 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.074084 Oct 04 21:24:21.430346 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1970/3927] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Oct 4 21:24:21 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:24:21.442709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-14d2c53a-d37d-4b00-8be1-1076cf3ccb5f tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Action: 'create', calling method: .version_select at 0x7f578be9d0d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-387755305", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:21.448823 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-14d2c53a-d37d-4b00-8be1-1076cf3ccb5f tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] HTTP exception thrown: Security group id should be uuid Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-14d2c53a-d37d-4b00-8be1-1076cf3ccb5f tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Request method failure captured: Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 130 Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKSChBH19BDJm5oTNkw3Sng0r6lse3H2PrVD4PZ0Arulp4zId60dzIuKzxMaLOkVZfHixLxTCwmluKHNK0SCnWEZK8YVNazPHeNdp-SA_pY2rdVQhy2bRaKLvHzJACo59smms-rOMDlf6bg8Wj1FNrCpkQMBaEH09HhXxZ_Wj-O5XcI Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 6e283c9c05f64d4cbe918531e604e162 Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e283c9c05f64d4cbe918531e604e162"}]}] Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 6e283c9c05f64d4cbe918531e604e162 Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-666469588-project Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: be805b5aaf65418b980924cdc4149bcc Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588-project Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-387755305", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: exception: Security group id should be uuid Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-387755305', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:24:21.454248 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:24:21.459580 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 04 21:24:21.459580 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:21.459580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-14d2c53a-d37d-4b00-8be1-1076cf3ccb5f tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Returning 400 to user: Security group id should be uuid {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:24:21.459580 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-14d2c53a-d37d-4b00-8be1-1076cf3ccb5f tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.025965 Oct 04 21:24:21.460700 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1958/3928] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Oct 4 21:24:21 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 21:24:21.472724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-15f5a223-fe56-471c-99b8-747ff10e3ce6 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Action: 'create', calling method: .version_select at 0x7f578b5fa940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1898720942", "description": "tempest-description-196447743"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:22.067161 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-15f5a223-fe56-471c-99b8-747ff10e3ce6 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.600128 Oct 04 21:24:22.083292 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1971/3929] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:24:21 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:24:22.084866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-429d5192-a35b-46fe-8f58-3d507fb0e946 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Action: 'create', calling method: .version_select at 0x7f578bbf69d0>, body: {"security_group_rule": {"parent_group_id": "39ca8d20-53e9-40ab-bda9-140302e22f50", "ip_protocol": "tempest-999-722421362", "from_port": 22, "to_port": 22}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:22.266599 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-429d5192-a35b-46fe-8f58-3d507fb0e946 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] HTTP exception thrown: Invalid IP protocol tempest-999-722421362. Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-429d5192-a35b-46fe-8f58-3d507fb0e946 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Request method failure captured: Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 156 Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKSChBH19BDJm5oTNkw3Sng0r6lse3H2PrVD4PZ0Arulp4zId60dzIuKzxMaLOkVZfHixLxTCwmluKHNK0SCnWEZK8YVNazPHeNdp-SA_pY2rdVQhy2bRaKLvHzJACo59smms-rOMDlf6bg8Wj1FNrCpkQMBaEH09HhXxZ_Wj-O5XcI Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 6e283c9c05f64d4cbe918531e604e162 Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e283c9c05f64d4cbe918531e604e162"}]}] Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 6e283c9c05f64d4cbe918531e604e162 Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-666469588-project Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: be805b5aaf65418b980924cdc4149bcc Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588-project Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: {"security_group_rule": {"parent_group_id": "39ca8d20-53e9-40ab-bda9-140302e22f50", "ip_protocol": "tempest-999-722421362", "from_port": 22, "to_port": 22}} Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid IP protocol tempest-999-722421362. Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'security_group_rule': {'parent_group_id': '39ca8d20-53e9-40ab-bda9-140302e22f50', 'ip_protocol': 'tempest-999-722421362', 'from_port': 22, 'to_port': 22}}} Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-722421362. Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-722421362. Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:22.268342 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:22.279693 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:22.279693 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:22.279693 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:22.279693 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:22.279693 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:24:22.279693 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:24:22.279693 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-722421362. Oct 04 21:24:22.279693 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:22.279693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-429d5192-a35b-46fe-8f58-3d507fb0e946 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Returning 400 to user: Invalid IP protocol tempest-999-722421362. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:24:22.279693 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-429d5192-a35b-46fe-8f58-3d507fb0e946 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.192492 Oct 04 21:24:22.279693 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1959/3930] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Oct 4 21:24:22 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:24:22.283532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-105fe52d-786e-4578-80be-b2e342250d7f tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Action: 'create', calling method: .version_select at 0x7f578b58b9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-493365687", "description": "tempest-description-1198347135"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:22.348821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c2d250df-ee5d-49c4-bf64-1c27f125e3f5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:22.349720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c2d250df-ee5d-49c4-bf64-1c27f125e3f5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:22.364580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2d250df-ee5d-49c4-bf64-1c27f125e3f5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:22.365368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2d250df-ee5d-49c4-bf64-1c27f125e3f5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:22.366445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2d250df-ee5d-49c4-bf64-1c27f125e3f5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:22.367344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2d250df-ee5d-49c4-bf64-1c27f125e3f5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:22.367984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2d250df-ee5d-49c4-bf64-1c27f125e3f5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:22.374067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2d250df-ee5d-49c4-bf64-1c27f125e3f5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:22.714719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c2d250df-ee5d-49c4-bf64-1c27f125e3f5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:22.726533 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c2d250df-ee5d-49c4-bf64-1c27f125e3f5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1314 microversion: 2.1 time: 0.382589 Oct 04 21:24:22.727751 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1960/3931] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:22 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:24:23.317926 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-105fe52d-786e-4578-80be-b2e342250d7f tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.038106 Oct 04 21:24:23.326521 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1972/3932] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:24:22 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:24:23.334601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6257e9d2-a48e-4200-99fb-fb3cde1aeb0e tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Action: 'create', calling method: .version_select at 0x7f578b4d73a0>, body: {"security_group_rule": {"parent_group_id": "1b5ffb22-187e-4ab0-a512-2b39c22a3641", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:23.420206 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-6257e9d2-a48e-4200-99fb-fb3cde1aeb0e tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6257e9d2-a48e-4200-99fb-fb3cde1aeb0e tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Request method failure captured: Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 138 Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKSChBH19BDJm5oTNkw3Sng0r6lse3H2PrVD4PZ0Arulp4zId60dzIuKzxMaLOkVZfHixLxTCwmluKHNK0SCnWEZK8YVNazPHeNdp-SA_pY2rdVQhy2bRaKLvHzJACo59smms-rOMDlf6bg8Wj1FNrCpkQMBaEH09HhXxZ_Wj-O5XcI Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 6e283c9c05f64d4cbe918531e604e162 Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e283c9c05f64d4cbe918531e604e162"}]}] Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 6e283c9c05f64d4cbe918531e604e162 Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-666469588-project Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: be805b5aaf65418b980924cdc4149bcc Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588-project Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: {"security_group_rule": {"parent_group_id": "1b5ffb22-187e-4ab0-a512-2b39c22a3641", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1b5ffb22-187e-4ab0-a512-2b39c22a3641', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 21:24:23.422219 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:23.426326 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:23.426326 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:23.426326 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:23.426326 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:23.426326 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:23.426326 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:24:23.426326 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:24:23.426326 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 21:24:23.426326 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:23.426326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6257e9d2-a48e-4200-99fb-fb3cde1aeb0e tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:24:23.427840 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6257e9d2-a48e-4200-99fb-fb3cde1aeb0e tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.099062 Oct 04 21:24:23.428493 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1961/3933] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Oct 4 21:24:23 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:24:23.440529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-faa3e3be-4de5-4f81-b5f1-839380960d04 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Action: 'create', calling method: .version_select at 0x7f578b5d9b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1562483159", "description": "tempest-description-383280957"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:23.749529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-319f1dc8-b953-432b-b242-25ef4b48877f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:23.750119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-319f1dc8-b953-432b-b242-25ef4b48877f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:23.758468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-319f1dc8-b953-432b-b242-25ef4b48877f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:23.759894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-319f1dc8-b953-432b-b242-25ef4b48877f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:23.760433 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-319f1dc8-b953-432b-b242-25ef4b48877f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:23.761493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-319f1dc8-b953-432b-b242-25ef4b48877f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:23.761984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-319f1dc8-b953-432b-b242-25ef4b48877f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:23.762412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-319f1dc8-b953-432b-b242-25ef4b48877f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:23.985285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-319f1dc8-b953-432b-b242-25ef4b48877f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:23.999086 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-319f1dc8-b953-432b-b242-25ef4b48877f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1314 microversion: 2.1 time: 0.253507 Oct 04 21:24:24.002837 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1962/3934] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:23 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:24.476430 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-faa3e3be-4de5-4f81-b5f1-839380960d04 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.042511 Oct 04 21:24:24.478417 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1973/3935] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:24:23 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:24:24.497049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6fe165c7-c63c-423d-aa7c-ecf6cdc400dd tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Action: 'create', calling method: .version_select at 0x7f578be9d8b0>, body: {"security_group_rule": {"parent_group_id": "186fb8f0-afcc-4009-8840-7f37ee4242e3", "ip_protocol": "tcp", "from_port": 22, "to_port": 1094014137}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:24.507011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-c466c18d-5e0f-41d3-ba05-44c7da312904 req-7913052a-9ff9-45d1-9c4a-bf7b991c1284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c75626ed-54cc-4237-a6fd-f460ae7fc572", "tag": "94c461f8-8de6-41f2-9d15-5a175fc292d1"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:24.520458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c466c18d-5e0f-41d3-ba05-44c7da312904 req-7913052a-9ff9-45d1-9c4a-bf7b991c1284 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:24.521181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c466c18d-5e0f-41d3-ba05-44c7da312904 req-7913052a-9ff9-45d1-9c4a-bf7b991c1284 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:24.521806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c466c18d-5e0f-41d3-ba05-44c7da312904 req-7913052a-9ff9-45d1-9c4a-bf7b991c1284 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:24.549143 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-c466c18d-5e0f-41d3-ba05-44c7da312904 req-7913052a-9ff9-45d1-9c4a-bf7b991c1284 service nova] Creating event network-changed:94c461f8-8de6-41f2-9d15-5a175fc292d1 for instance c75626ed-54cc-4237-a6fd-f460ae7fc572 on n-h1-860282-1 Oct 04 21:24:24.554607 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-c466c18d-5e0f-41d3-ba05-44c7da312904 req-7913052a-9ff9-45d1-9c4a-bf7b991c1284 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058782 Oct 04 21:24:24.555425 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1974/3936] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:24:24.597700 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-6fe165c7-c63c-423d-aa7c-ecf6cdc400dd tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] HTTP exception thrown: Invalid port range 22:1094014137. Valid TCP ports should be between 1-65535 Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6fe165c7-c63c-423d-aa7c-ecf6cdc400dd tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Request method failure captured: Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 146 Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKSChBH19BDJm5oTNkw3Sng0r6lse3H2PrVD4PZ0Arulp4zId60dzIuKzxMaLOkVZfHixLxTCwmluKHNK0SCnWEZK8YVNazPHeNdp-SA_pY2rdVQhy2bRaKLvHzJACo59smms-rOMDlf6bg8Wj1FNrCpkQMBaEH09HhXxZ_Wj-O5XcI Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 6e283c9c05f64d4cbe918531e604e162 Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e283c9c05f64d4cbe918531e604e162"}]}] Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 6e283c9c05f64d4cbe918531e604e162 Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-666469588-project Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: be805b5aaf65418b980924cdc4149bcc Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588-project Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: {"security_group_rule": {"parent_group_id": "186fb8f0-afcc-4009-8840-7f37ee4242e3", "ip_protocol": "tcp", "from_port": 22, "to_port": 1094014137}} Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid port range 22:1094014137. Valid TCP ports should be between 1-65535 Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'security_group_rule': {'parent_group_id': '186fb8f0-afcc-4009-8840-7f37ee4242e3', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1094014137}}} Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1094014137. Valid TCP ports should be between 1-65535 Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1094014137. Valid TCP ports should be between 1-65535 Oct 04 21:24:24.599594 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:24.604097 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:24.604097 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:24.604097 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:24.604097 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:24.604097 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:24.604097 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:24:24.604097 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:24:24.604097 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1094014137. Valid TCP ports should be between 1-65535 Oct 04 21:24:24.604097 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:24.606436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6fe165c7-c63c-423d-aa7c-ecf6cdc400dd tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Returning 400 to user: Invalid port range 22:1094014137. Valid TCP ports should be between 1-65535 {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:24:24.607607 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6fe165c7-c63c-423d-aa7c-ecf6cdc400dd tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.121022 Oct 04 21:24:24.608780 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1963/3937] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Oct 4 21:24:24 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:24:24.618421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3dca0177-fbd8-47ff-af1e-c567e60e74a0 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Action: 'create', calling method: .version_select at 0x7f578b5d9820>, body: {"security_group_rule": {"parent_group_id": "287342cf-166e-44a0-9dc5-21fb23de5c45", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:24.660770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG neutronclient.v2_0.client [None req-3dca0177-fbd8-47ff-af1e-c567e60e74a0 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 287342cf-166e-44a0-9dc5-21fb23de5c45 does not exist", "detail": ""}} {{(pid=122757) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:24:24.661527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.security_group_api [None req-3dca0177-fbd8-47ff-af1e-c567e60e74a0 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Neutron security group 287342cf-166e-44a0-9dc5-21fb23de5c45 not found {{(pid=122757) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:24:24.662305 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-3dca0177-fbd8-47ff-af1e-c567e60e74a0 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] HTTP exception thrown: Security group 287342cf-166e-44a0-9dc5-21fb23de5c45 does not exist Oct 04 21:24:24.662305 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-cb57b1b4-3d60-41f8-80b2-80cef9856240'] Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3dca0177-fbd8-47ff-af1e-c567e60e74a0 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Request method failure captured: Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 138 Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKSChBH19BDJm5oTNkw3Sng0r6lse3H2PrVD4PZ0Arulp4zId60dzIuKzxMaLOkVZfHixLxTCwmluKHNK0SCnWEZK8YVNazPHeNdp-SA_pY2rdVQhy2bRaKLvHzJACo59smms-rOMDlf6bg8Wj1FNrCpkQMBaEH09HhXxZ_Wj-O5XcI Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 6e283c9c05f64d4cbe918531e604e162 Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e283c9c05f64d4cbe918531e604e162"}]}] Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 6e283c9c05f64d4cbe918531e604e162 Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-666469588-project Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: be805b5aaf65418b980924cdc4149bcc Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588-project Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: {"security_group_rule": {"parent_group_id": "287342cf-166e-44a0-9dc5-21fb23de5c45", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: exception: Security group 287342cf-166e-44a0-9dc5-21fb23de5c45 does not exist Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-cb57b1b4-3d60-41f8-80b2-80cef9856240'] Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'security_group_rule': {'parent_group_id': '287342cf-166e-44a0-9dc5-21fb23de5c45', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:24:24.668083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 287342cf-166e-44a0-9dc5-21fb23de5c45 does not exist Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb57b1b4-3d60-41f8-80b2-80cef9856240'] Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 287342cf-166e-44a0-9dc5-21fb23de5c45 does not exist Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb57b1b4-3d60-41f8-80b2-80cef9856240'] Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 287342cf-166e-44a0-9dc5-21fb23de5c45 does not exist Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb57b1b4-3d60-41f8-80b2-80cef9856240'] Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 287342cf-166e-44a0-9dc5-21fb23de5c45 does not exist Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb57b1b4-3d60-41f8-80b2-80cef9856240'] Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3dca0177-fbd8-47ff-af1e-c567e60e74a0 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Returning 404 to user: Security group 287342cf-166e-44a0-9dc5-21fb23de5c45 does not exist Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: Neutron server returns request_ids: ['req-cb57b1b4-3d60-41f8-80b2-80cef9856240'] {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3dca0177-fbd8-47ff-af1e-c567e60e74a0 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.051762 Oct 04 21:24:24.674124 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1975/3938] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Oct 4 21:24:24 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:24:24.679800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2d40fb50-ec23-4a32-bfae-58fab66711a2 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Calling method '.version_select at 0x7f578b485310>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG neutronclient.v2_0.client [None req-2d40fb50-ec23-4a32-bfae-58fab66711a2 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 8d2e1a4b-aa5e-4294-a868-a4f7a3fddf63 does not exist", "detail": ""}} {{(pid=122758) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.security_group_api [None req-2d40fb50-ec23-4a32-bfae-58fab66711a2 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Neutron security group rule 8d2e1a4b-aa5e-4294-a868-a4f7a3fddf63 not found {{(pid=122758) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-2d40fb50-ec23-4a32-bfae-58fab66711a2 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] HTTP exception thrown: Security group rule 8d2e1a4b-aa5e-4294-a868-a4f7a3fddf63 does not exist Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-0de19041-27f6-44ed-80a4-d3380e57a0f3'] Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2d40fb50-ec23-4a32-bfae-58fab66711a2 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Request method failure captured: Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/os-security-group-rules/8d2e1a4b-aa5e-4294-a868-a4f7a3fddf63 HTTP/1.1 Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKSChBH19BDJm5oTNkw3Sng0r6lse3H2PrVD4PZ0Arulp4zId60dzIuKzxMaLOkVZfHixLxTCwmluKHNK0SCnWEZK8YVNazPHeNdp-SA_pY2rdVQhy2bRaKLvHzJACo59smms-rOMDlf6bg8Wj1FNrCpkQMBaEH09HhXxZ_Wj-O5XcI Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 6e283c9c05f64d4cbe918531e604e162 Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6e283c9c05f64d4cbe918531e604e162"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e283c9c05f64d4cbe918531e604e162"}]}] Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 6e283c9c05f64d4cbe918531e604e162 Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588 Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-666469588-project Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: be805b5aaf65418b980924cdc4149bcc Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-666469588-project Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: method: Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: exception: Security group rule 8d2e1a4b-aa5e-4294-a868-a4f7a3fddf63 does not exist Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-0de19041-27f6-44ed-80a4-d3380e57a0f3'] Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '8d2e1a4b-aa5e-4294-a868-a4f7a3fddf63'} Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:24:24.719920 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 8d2e1a4b-aa5e-4294-a868-a4f7a3fddf63 does not exist Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0de19041-27f6-44ed-80a4-d3380e57a0f3'] Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 8d2e1a4b-aa5e-4294-a868-a4f7a3fddf63 does not exist Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0de19041-27f6-44ed-80a4-d3380e57a0f3'] Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 8d2e1a4b-aa5e-4294-a868-a4f7a3fddf63 does not exist Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0de19041-27f6-44ed-80a4-d3380e57a0f3'] Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 8d2e1a4b-aa5e-4294-a868-a4f7a3fddf63 does not exist Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0de19041-27f6-44ed-80a4-d3380e57a0f3'] Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2d40fb50-ec23-4a32-bfae-58fab66711a2 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Returning 404 to user: Security group rule 8d2e1a4b-aa5e-4294-a868-a4f7a3fddf63 does not exist Oct 04 21:24:24.722841 n-d-860282-1 devstack@n-api.service[122758]: Neutron server returns request_ids: ['req-0de19041-27f6-44ed-80a4-d3380e57a0f3'] {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:24:24.727262 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2d40fb50-ec23-4a32-bfae-58fab66711a2 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/8d2e1a4b-aa5e-4294-a868-a4f7a3fddf63" status: 404 len: 199 microversion: 2.1 time: 0.038422 Oct 04 21:24:24.727262 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1964/3939] 10.222.0.30 () {58 vars in 1287 bytes} [Tue Oct 4 21:24:24 2022] DELETE /compute/v2.1/os-security-group-rules/8d2e1a4b-aa5e-4294-a868-a4f7a3fddf63 => generated 199 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:24:24.732297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4810fc8d-76c6-448a-b2cc-1c0139576e36 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Calling method '.version_select at 0x7f578b5fadc0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:25.030920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-85b23e03-9be5-404b-af3b-e0684bee996d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:25.033728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-85b23e03-9be5-404b-af3b-e0684bee996d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:25.046689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85b23e03-9be5-404b-af3b-e0684bee996d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:25.050036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85b23e03-9be5-404b-af3b-e0684bee996d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:25.050668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85b23e03-9be5-404b-af3b-e0684bee996d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:25.055680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85b23e03-9be5-404b-af3b-e0684bee996d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:25.056951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85b23e03-9be5-404b-af3b-e0684bee996d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:25.059253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85b23e03-9be5-404b-af3b-e0684bee996d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:25.290045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-85b23e03-9be5-404b-af3b-e0684bee996d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:25.301591 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-85b23e03-9be5-404b-af3b-e0684bee996d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1314 microversion: 2.1 time: 0.276399 Oct 04 21:24:25.302775 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1965/3940] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:25 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:25.332399 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4810fc8d-76c6-448a-b2cc-1c0139576e36 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/186fb8f0-afcc-4009-8840-7f37ee4242e3" status: 202 len: 0 microversion: 2.1 time: 0.607213 Oct 04 21:24:25.332985 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1976/3941] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:24:24 2022] DELETE /compute/v2.1/os-security-groups/186fb8f0-afcc-4009-8840-7f37ee4242e3 => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:24:25.343215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-31b79e73-5fda-4f6d-b6a5-c2ee14126178 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Calling method '.version_select at 0x7f5794563dc0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:25.926683 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-31b79e73-5fda-4f6d-b6a5-c2ee14126178 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/1b5ffb22-187e-4ab0-a512-2b39c22a3641" status: 202 len: 0 microversion: 2.1 time: 0.589278 Oct 04 21:24:25.927703 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1966/3942] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:24:25 2022] DELETE /compute/v2.1/os-security-groups/1b5ffb22-187e-4ab0-a512-2b39c22a3641 => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:24:25.936685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-85f6102c-5c5d-413e-9788-4f4dfb1ad699 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Calling method '.version_select at 0x7f578b5fa9d0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:26.324699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9c3563aa-c135-4e47-9f3e-a4f289086f32 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:26.325315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9c3563aa-c135-4e47-9f3e-a4f289086f32 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:26.328224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:26.333183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c3563aa-c135-4e47-9f3e-a4f289086f32 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:26.333759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c3563aa-c135-4e47-9f3e-a4f289086f32 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:26.334199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c3563aa-c135-4e47-9f3e-a4f289086f32 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:26.334902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c3563aa-c135-4e47-9f3e-a4f289086f32 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:26.335517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c3563aa-c135-4e47-9f3e-a4f289086f32 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:26.337454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c3563aa-c135-4e47-9f3e-a4f289086f32 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:26.362115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:26.509817 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-85f6102c-5c5d-413e-9788-4f4dfb1ad699 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/39ca8d20-53e9-40ab-bda9-140302e22f50" status: 202 len: 0 microversion: 2.1 time: 0.576135 Oct 04 21:24:26.512016 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1977/3943] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:24:25 2022] DELETE /compute/v2.1/os-security-groups/39ca8d20-53e9-40ab-bda9-140302e22f50 => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:24:26.524917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b3e61be4-4646-462e-9e2d-ca7c8a0d4d10 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Calling method '.version_select at 0x7f578b5fae50>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:26.661230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9c3563aa-c135-4e47-9f3e-a4f289086f32 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:26.687973 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9c3563aa-c135-4e47-9f3e-a4f289086f32 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1314 microversion: 2.1 time: 0.367451 Oct 04 21:24:26.694430 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1967/3944] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:26 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:27.173109 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b3e61be4-4646-462e-9e2d-ca7c8a0d4d10 tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/5ac42284-8a5e-49ae-8ed7-3c3b977390fd" status: 202 len: 0 microversion: 2.1 time: 0.656904 Oct 04 21:24:27.174561 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1978/3945] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:24:26 2022] DELETE /compute/v2.1/os-security-groups/5ac42284-8a5e-49ae-8ed7-3c3b977390fd => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:24:27.185637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ab1894a5-5ede-44ab-b215-908b29e46d2e tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] Calling method '.version_select at 0x7f57909a2430>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:27.582311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=16 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:27.763311 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ab1894a5-5ede-44ab-b215-908b29e46d2e tempest-SecurityGroupRulesNegativeTestJSON-666469588 tempest-SecurityGroupRulesNegativeTestJSON-666469588-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/ad99674b-d53c-4617-89ea-744982525442" status: 202 len: 0 microversion: 2.1 time: 0.584348 Oct 04 21:24:27.764529 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1968/3946] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:24:27 2022] DELETE /compute/v2.1/os-security-groups/ad99674b-d53c-4617-89ea-744982525442 => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:24:27.769793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-97f53abf-810d-44cc-8537-a7886b226a23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:27.770469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-97f53abf-810d-44cc-8537-a7886b226a23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:27.792908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-97f53abf-810d-44cc-8537-a7886b226a23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:27.793873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-97f53abf-810d-44cc-8537-a7886b226a23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:27.794333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-97f53abf-810d-44cc-8537-a7886b226a23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:27.795067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-97f53abf-810d-44cc-8537-a7886b226a23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:27.795567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-97f53abf-810d-44cc-8537-a7886b226a23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:27.811274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-97f53abf-810d-44cc-8537-a7886b226a23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:27.840910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7394244c-d5b0-45f9-a9d0-1882953a5fcd tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-905545355", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:27.910985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-7394244c-d5b0-45f9-a9d0-1882953a5fcd tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] validate_networks() for [('229bd47e-32c9-4450-8024-6e4476d37819', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:24:28.236068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-97f53abf-810d-44cc-8537-a7886b226a23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:28.247486 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-97f53abf-810d-44cc-8537-a7886b226a23 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1314 microversion: 2.1 time: 0.479057 Oct 04 21:24:28.250018 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1969/3947] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:27 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:29.077061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7394244c-d5b0-45f9-a9d0-1882953a5fcd tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:24:29.086122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7394244c-d5b0-45f9-a9d0-1882953a5fcd tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:24:29.086122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7394244c-d5b0-45f9-a9d0-1882953a5fcd tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:24:29.086122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7394244c-d5b0-45f9-a9d0-1882953a5fcd tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:24:29.086122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7394244c-d5b0-45f9-a9d0-1882953a5fcd tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:24:29.122914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7394244c-d5b0-45f9-a9d0-1882953a5fcd tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:29.122914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7394244c-d5b0-45f9-a9d0-1882953a5fcd tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:29.122914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7394244c-d5b0-45f9-a9d0-1882953a5fcd tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:29.122914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7394244c-d5b0-45f9-a9d0-1882953a5fcd tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:29.122914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7394244c-d5b0-45f9-a9d0-1882953a5fcd tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:29.122914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7394244c-d5b0-45f9-a9d0-1882953a5fcd tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:29.170397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-7394244c-d5b0-45f9-a9d0-1882953a5fcd tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Getting quotas for project 0204517be8de4897977dba0343060ea9. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:24:29.180099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-7394244c-d5b0-45f9-a9d0-1882953a5fcd tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Getting quotas for user 3144ae5d4548465485e6ff93f837ad6a and project 0204517be8de4897977dba0343060ea9. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:24:29.223168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7394244c-d5b0-45f9-a9d0-1882953a5fcd tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:24:29.226353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7394244c-d5b0-45f9-a9d0-1882953a5fcd tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:24:29.274848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0f00f57a-dba9-4a69-bdf3-4b548a06d29a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:29.277205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0f00f57a-dba9-4a69-bdf3-4b548a06d29a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:29.285915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f00f57a-dba9-4a69-bdf3-4b548a06d29a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:29.287214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f00f57a-dba9-4a69-bdf3-4b548a06d29a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:29.288153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f00f57a-dba9-4a69-bdf3-4b548a06d29a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:29.289091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f00f57a-dba9-4a69-bdf3-4b548a06d29a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:29.289803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f00f57a-dba9-4a69-bdf3-4b548a06d29a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:29.290901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f00f57a-dba9-4a69-bdf3-4b548a06d29a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:29.526548 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7394244c-d5b0-45f9-a9d0-1882953a5fcd tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.879511 Oct 04 21:24:29.543268 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1979/3948] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:24:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 1897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:24:29.555302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bd35a3b8-9a59-4793-85ac-2528e1ff16e4 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:29.557309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bd35a3b8-9a59-4793-85ac-2528e1ff16e4 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:29.598216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0f00f57a-dba9-4a69-bdf3-4b548a06d29a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:29.611182 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0f00f57a-dba9-4a69-bdf3-4b548a06d29a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1314 microversion: 2.1 time: 0.341336 Oct 04 21:24:29.615315 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1970/3949] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:29 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:29.680665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bd35a3b8-9a59-4793-85ac-2528e1ff16e4 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:29.686938 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bd35a3b8-9a59-4793-85ac-2528e1ff16e4 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1222 microversion: 2.1 time: 0.136093 Oct 04 21:24:29.688416 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1980/3950] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:29 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:30.641001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a111b490-3099-4d3e-bb2f-072e4b4ffc9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:30.647790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a111b490-3099-4d3e-bb2f-072e4b4ffc9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:30.675826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a111b490-3099-4d3e-bb2f-072e4b4ffc9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:30.689058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a111b490-3099-4d3e-bb2f-072e4b4ffc9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:30.691806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a111b490-3099-4d3e-bb2f-072e4b4ffc9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:30.704809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a111b490-3099-4d3e-bb2f-072e4b4ffc9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:30.705591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a111b490-3099-4d3e-bb2f-072e4b4ffc9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:30.706233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a111b490-3099-4d3e-bb2f-072e4b4ffc9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:30.722974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7a532849-57b2-41a1-8708-8d79f7d1a45f tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:30.723737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7a532849-57b2-41a1-8708-8d79f7d1a45f tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:30.899748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:31.128557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7a532849-57b2-41a1-8708-8d79f7d1a45f tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:31.145824 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7a532849-57b2-41a1-8708-8d79f7d1a45f tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1222 microversion: 2.1 time: 0.429826 Oct 04 21:24:31.156036 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1981/3951] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:30 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1222 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:31.673960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a111b490-3099-4d3e-bb2f-072e4b4ffc9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:31.686443 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a111b490-3099-4d3e-bb2f-072e4b4ffc9b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1314 microversion: 2.1 time: 1.046596 Oct 04 21:24:31.697966 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1971/3952] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:30 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1314 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:24:32.180347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a0784dd8-4865-49ea-ac83-5ebfac101fd3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:32.187940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a0784dd8-4865-49ea-ac83-5ebfac101fd3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:32.209685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0784dd8-4865-49ea-ac83-5ebfac101fd3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:32.210464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0784dd8-4865-49ea-ac83-5ebfac101fd3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:32.217632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0784dd8-4865-49ea-ac83-5ebfac101fd3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:32.218626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0784dd8-4865-49ea-ac83-5ebfac101fd3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:32.220289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0784dd8-4865-49ea-ac83-5ebfac101fd3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:32.221847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0784dd8-4865-49ea-ac83-5ebfac101fd3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:32.332656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a0784dd8-4865-49ea-ac83-5ebfac101fd3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:32.344192 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a0784dd8-4865-49ea-ac83-5ebfac101fd3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1218 microversion: 2.1 time: 0.168688 Oct 04 21:24:32.347046 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1982/3953] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:32 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1218 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:32.720382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-37b56792-4d23-4403-bb66-ba1d832fd477 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:32.721808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-37b56792-4d23-4403-bb66-ba1d832fd477 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:32.734224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37b56792-4d23-4403-bb66-ba1d832fd477 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:32.737647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37b56792-4d23-4403-bb66-ba1d832fd477 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:32.737647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37b56792-4d23-4403-bb66-ba1d832fd477 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:32.737647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37b56792-4d23-4403-bb66-ba1d832fd477 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:32.737647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37b56792-4d23-4403-bb66-ba1d832fd477 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:32.743995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37b56792-4d23-4403-bb66-ba1d832fd477 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:33.381604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-2c0e7cbd-734c-47ef-a468-1cb4766e8f56 req-a343092c-b9e3-477f-b4bc-0de2f0d15ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c75626ed-54cc-4237-a6fd-f460ae7fc572", "name": "network-vif-plugged", "status": "completed", "tag": "94c461f8-8de6-41f2-9d15-5a175fc292d1"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:33.418671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2c0e7cbd-734c-47ef-a468-1cb4766e8f56 req-a343092c-b9e3-477f-b4bc-0de2f0d15ff8 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:33.419623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2c0e7cbd-734c-47ef-a468-1cb4766e8f56 req-a343092c-b9e3-477f-b4bc-0de2f0d15ff8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:33.420292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2c0e7cbd-734c-47ef-a468-1cb4766e8f56 req-a343092c-b9e3-477f-b4bc-0de2f0d15ff8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:33.442266 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-2c0e7cbd-734c-47ef-a468-1cb4766e8f56 req-a343092c-b9e3-477f-b4bc-0de2f0d15ff8 service nova] Creating event network-vif-plugged:94c461f8-8de6-41f2-9d15-5a175fc292d1 for instance c75626ed-54cc-4237-a6fd-f460ae7fc572 on n-h1-860282-1 Oct 04 21:24:33.450303 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-2c0e7cbd-734c-47ef-a468-1cb4766e8f56 req-a343092c-b9e3-477f-b4bc-0de2f0d15ff8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081824 Oct 04 21:24:33.451457 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1983/3954] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:24:33.458783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-15479ea4-3579-45a3-81f3-988494f3fbfe tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:33.460559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-15479ea4-3579-45a3-81f3-988494f3fbfe tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:33.475601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15479ea4-3579-45a3-81f3-988494f3fbfe tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:33.476334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15479ea4-3579-45a3-81f3-988494f3fbfe tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:33.477899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15479ea4-3579-45a3-81f3-988494f3fbfe tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:33.479433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15479ea4-3579-45a3-81f3-988494f3fbfe tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:33.480081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15479ea4-3579-45a3-81f3-988494f3fbfe tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:33.480693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15479ea4-3579-45a3-81f3-988494f3fbfe tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:33.969531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-37b56792-4d23-4403-bb66-ba1d832fd477 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:33.982814 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-37b56792-4d23-4403-bb66-ba1d832fd477 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1314 microversion: 2.1 time: 1.275105 Oct 04 21:24:33.983487 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1972/3955] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:32 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1314 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:34.127515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-15479ea4-3579-45a3-81f3-988494f3fbfe tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:34.136119 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-15479ea4-3579-45a3-81f3-988494f3fbfe tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1282 microversion: 2.1 time: 0.682817 Oct 04 21:24:34.136918 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1984/3956] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:33 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1282 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:35.014635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-49e5e398-7876-4d6f-a8cc-1b3212508e71 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:35.016327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-49e5e398-7876-4d6f-a8cc-1b3212508e71 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:35.029218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49e5e398-7876-4d6f-a8cc-1b3212508e71 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:35.034683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49e5e398-7876-4d6f-a8cc-1b3212508e71 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:35.035209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49e5e398-7876-4d6f-a8cc-1b3212508e71 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:35.035973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49e5e398-7876-4d6f-a8cc-1b3212508e71 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:35.036451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49e5e398-7876-4d6f-a8cc-1b3212508e71 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:35.036937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49e5e398-7876-4d6f-a8cc-1b3212508e71 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:35.171298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bb7b670d-7560-47bc-a5fe-357a8be14dd1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:35.172946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bb7b670d-7560-47bc-a5fe-357a8be14dd1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:35.198135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb7b670d-7560-47bc-a5fe-357a8be14dd1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:35.207280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb7b670d-7560-47bc-a5fe-357a8be14dd1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:35.207280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb7b670d-7560-47bc-a5fe-357a8be14dd1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:35.218625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb7b670d-7560-47bc-a5fe-357a8be14dd1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:35.219275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb7b670d-7560-47bc-a5fe-357a8be14dd1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:35.219735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb7b670d-7560-47bc-a5fe-357a8be14dd1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:35.601466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bb7b670d-7560-47bc-a5fe-357a8be14dd1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:35.623820 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bb7b670d-7560-47bc-a5fe-357a8be14dd1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1280 microversion: 2.1 time: 0.467999 Oct 04 21:24:35.628640 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1985/3957] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:35 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1280 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:35.752151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-49e5e398-7876-4d6f-a8cc-1b3212508e71 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:35.764886 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-49e5e398-7876-4d6f-a8cc-1b3212508e71 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1314 microversion: 2.1 time: 0.755305 Oct 04 21:24:35.766320 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1973/3958] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:35 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1314 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:36.658397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-77d1b28a-c7aa-4786-99cb-4b6510588cba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:36.659017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-77d1b28a-c7aa-4786-99cb-4b6510588cba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:36.673395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77d1b28a-c7aa-4786-99cb-4b6510588cba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:36.673931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77d1b28a-c7aa-4786-99cb-4b6510588cba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:36.674379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77d1b28a-c7aa-4786-99cb-4b6510588cba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:36.675178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77d1b28a-c7aa-4786-99cb-4b6510588cba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:36.675576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77d1b28a-c7aa-4786-99cb-4b6510588cba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:36.676011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77d1b28a-c7aa-4786-99cb-4b6510588cba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:36.788537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4fa64b05-abcd-4ba9-84d9-c0a370f8acc1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:36.794156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-77d1b28a-c7aa-4786-99cb-4b6510588cba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:36.798847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4fa64b05-abcd-4ba9-84d9-c0a370f8acc1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:36.808824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fa64b05-abcd-4ba9-84d9-c0a370f8acc1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:36.814483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fa64b05-abcd-4ba9-84d9-c0a370f8acc1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:36.831046 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-77d1b28a-c7aa-4786-99cb-4b6510588cba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1280 microversion: 2.1 time: 0.176291 Oct 04 21:24:36.845496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fa64b05-abcd-4ba9-84d9-c0a370f8acc1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:36.845496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fa64b05-abcd-4ba9-84d9-c0a370f8acc1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:36.845496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fa64b05-abcd-4ba9-84d9-c0a370f8acc1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:36.848559 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1986/3959] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:36 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1280 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:36.849096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fa64b05-abcd-4ba9-84d9-c0a370f8acc1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:37.607625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4fa64b05-abcd-4ba9-84d9-c0a370f8acc1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:37.630160 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4fa64b05-abcd-4ba9-84d9-c0a370f8acc1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1501 microversion: 2.1 time: 0.840386 Oct 04 21:24:37.630160 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1974/3960] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:36 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1501 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:37.653754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-781b3a62-fb8c-44a5-8a48-11f24febb8e4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:37.654025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-781b3a62-fb8c-44a5-8a48-11f24febb8e4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:37.682464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-781b3a62-fb8c-44a5-8a48-11f24febb8e4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:37.682464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-781b3a62-fb8c-44a5-8a48-11f24febb8e4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:37.682464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-781b3a62-fb8c-44a5-8a48-11f24febb8e4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:37.682464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-781b3a62-fb8c-44a5-8a48-11f24febb8e4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:37.682464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-781b3a62-fb8c-44a5-8a48-11f24febb8e4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:37.682464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-781b3a62-fb8c-44a5-8a48-11f24febb8e4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:37.866066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a2a9a776-941f-43cd-90bb-b4c546fdc5cc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:37.870471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a2a9a776-941f-43cd-90bb-b4c546fdc5cc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:37.879122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2a9a776-941f-43cd-90bb-b4c546fdc5cc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:37.879620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2a9a776-941f-43cd-90bb-b4c546fdc5cc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:37.880068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2a9a776-941f-43cd-90bb-b4c546fdc5cc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:37.880820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2a9a776-941f-43cd-90bb-b4c546fdc5cc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:37.881351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2a9a776-941f-43cd-90bb-b4c546fdc5cc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:37.881980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2a9a776-941f-43cd-90bb-b4c546fdc5cc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:37.985153 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-781b3a62-fb8c-44a5-8a48-11f24febb8e4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "POST /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572/action" status: 202 len: 0 microversion: 2.1 time: 0.326323 Oct 04 21:24:37.988290 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1987/3961] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:24:37 2022] POST /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:24:38.008970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6752589a-f18a-4e8b-a0e1-4451a9ff4ef4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:38.014237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6752589a-f18a-4e8b-a0e1-4451a9ff4ef4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:38.063461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6752589a-f18a-4e8b-a0e1-4451a9ff4ef4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:38.064363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6752589a-f18a-4e8b-a0e1-4451a9ff4ef4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:38.067173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6752589a-f18a-4e8b-a0e1-4451a9ff4ef4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:38.070895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6752589a-f18a-4e8b-a0e1-4451a9ff4ef4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:38.073387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6752589a-f18a-4e8b-a0e1-4451a9ff4ef4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:38.075665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6752589a-f18a-4e8b-a0e1-4451a9ff4ef4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:38.566665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a2a9a776-941f-43cd-90bb-b4c546fdc5cc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:38.583815 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a2a9a776-941f-43cd-90bb-b4c546fdc5cc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1322 microversion: 2.1 time: 0.731416 Oct 04 21:24:38.589294 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1975/3962] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:37 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1322 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:24:38.674489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6752589a-f18a-4e8b-a0e1-4451a9ff4ef4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:38.683316 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6752589a-f18a-4e8b-a0e1-4451a9ff4ef4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1506 microversion: 2.1 time: 0.685717 Oct 04 21:24:38.694964 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1988/3963] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:37 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1506 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:39.614970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-779f62eb-f7a3-460d-bf1a-f694acc93c09 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:39.615598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-779f62eb-f7a3-460d-bf1a-f694acc93c09 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:39.628295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-779f62eb-f7a3-460d-bf1a-f694acc93c09 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:39.628800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-779f62eb-f7a3-460d-bf1a-f694acc93c09 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:39.629743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-779f62eb-f7a3-460d-bf1a-f694acc93c09 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:39.630711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-779f62eb-f7a3-460d-bf1a-f694acc93c09 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:39.631183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-779f62eb-f7a3-460d-bf1a-f694acc93c09 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:39.631618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-779f62eb-f7a3-460d-bf1a-f694acc93c09 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:39.707859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-51b0778d-ea96-4557-9010-3e556d68d1d2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:39.708473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-51b0778d-ea96-4557-9010-3e556d68d1d2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:39.710650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:39.719552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51b0778d-ea96-4557-9010-3e556d68d1d2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:39.721059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51b0778d-ea96-4557-9010-3e556d68d1d2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:39.721885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51b0778d-ea96-4557-9010-3e556d68d1d2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:39.724139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51b0778d-ea96-4557-9010-3e556d68d1d2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:39.724805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51b0778d-ea96-4557-9010-3e556d68d1d2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:39.744691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51b0778d-ea96-4557-9010-3e556d68d1d2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:40.411095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-779f62eb-f7a3-460d-bf1a-f694acc93c09 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:40.443919 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-779f62eb-f7a3-460d-bf1a-f694acc93c09 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1322 microversion: 2.1 time: 0.835250 Oct 04 21:24:40.454448 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1976/3964] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:39 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1322 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:40.466757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-bc75c01b-30a2-4480-8e6f-943fe7b260b6 req-d6532e41-b693-4f37-ab82-d34d4947dcf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267676e7-8969-4f7b-9e77-da72b8e71a0b", "tag": "ccb20d83-d32e-4ee7-a699-8e1da8c412f2"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:40.475801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-51b0778d-ea96-4557-9010-3e556d68d1d2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:40.478391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-bc75c01b-30a2-4480-8e6f-943fe7b260b6 req-d6532e41-b693-4f37-ab82-d34d4947dcf6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:40.479049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-bc75c01b-30a2-4480-8e6f-943fe7b260b6 req-d6532e41-b693-4f37-ab82-d34d4947dcf6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:40.479650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-bc75c01b-30a2-4480-8e6f-943fe7b260b6 req-d6532e41-b693-4f37-ab82-d34d4947dcf6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:40.493045 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-51b0778d-ea96-4557-9010-3e556d68d1d2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1486 microversion: 2.1 time: 0.788896 Oct 04 21:24:40.495281 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1989/3965] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:39 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1486 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:24:40.498287 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-bc75c01b-30a2-4480-8e6f-943fe7b260b6 req-d6532e41-b693-4f37-ab82-d34d4947dcf6 service nova] Creating event network-changed:ccb20d83-d32e-4ee7-a699-8e1da8c412f2 for instance 267676e7-8969-4f7b-9e77-da72b8e71a0b on n-h2-860282-1 Oct 04 21:24:40.504048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f246537e-e06d-4b39-a2fd-a992e7daf894 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:40.504842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f246537e-e06d-4b39-a2fd-a992e7daf894 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:40.505500 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-bc75c01b-30a2-4480-8e6f-943fe7b260b6 req-d6532e41-b693-4f37-ab82-d34d4947dcf6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049219 Oct 04 21:24:40.506262 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1977/3966] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:24:40.512666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f246537e-e06d-4b39-a2fd-a992e7daf894 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:40.513594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f246537e-e06d-4b39-a2fd-a992e7daf894 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:40.514329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f246537e-e06d-4b39-a2fd-a992e7daf894 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:40.515707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f246537e-e06d-4b39-a2fd-a992e7daf894 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:40.516501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f246537e-e06d-4b39-a2fd-a992e7daf894 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:40.518211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f246537e-e06d-4b39-a2fd-a992e7daf894 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:40.520971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fcc2830f-75dd-44a9-a520-b45bb43a5f56 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:40.521586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fcc2830f-75dd-44a9-a520-b45bb43a5f56 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:40.529227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcc2830f-75dd-44a9-a520-b45bb43a5f56 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:40.529929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcc2830f-75dd-44a9-a520-b45bb43a5f56 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:40.530688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcc2830f-75dd-44a9-a520-b45bb43a5f56 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:40.531694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcc2830f-75dd-44a9-a520-b45bb43a5f56 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:40.532340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcc2830f-75dd-44a9-a520-b45bb43a5f56 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:40.532906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcc2830f-75dd-44a9-a520-b45bb43a5f56 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:40.569545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fcc2830f-75dd-44a9-a520-b45bb43a5f56 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:24:40.878344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f246537e-e06d-4b39-a2fd-a992e7daf894 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:40.892338 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f246537e-e06d-4b39-a2fd-a992e7daf894 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.395545 Oct 04 21:24:40.901235 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1990/3967] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:40 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:40.935851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b2431eae-f9d0-4900-9e91-89467567639f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:40.939764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b2431eae-f9d0-4900-9e91-89467567639f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:40.958830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2431eae-f9d0-4900-9e91-89467567639f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:40.959955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2431eae-f9d0-4900-9e91-89467567639f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:40.960743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2431eae-f9d0-4900-9e91-89467567639f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:40.970738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2431eae-f9d0-4900-9e91-89467567639f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:40.973842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2431eae-f9d0-4900-9e91-89467567639f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:40.981411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2431eae-f9d0-4900-9e91-89467567639f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:41.070055 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fcc2830f-75dd-44a9-a520-b45bb43a5f56 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 204 len: 0 microversion: 2.1 time: 0.553350 Oct 04 21:24:41.070976 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1978/3968] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:24:40 2022] DELETE /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:24:41.081936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-81c1222a-91fe-4bf9-8a4d-38ebdcc39d2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:41.082821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-81c1222a-91fe-4bf9-8a4d-38ebdcc39d2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:41.094604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81c1222a-91fe-4bf9-8a4d-38ebdcc39d2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:41.095118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81c1222a-91fe-4bf9-8a4d-38ebdcc39d2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:41.098799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81c1222a-91fe-4bf9-8a4d-38ebdcc39d2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:41.100621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81c1222a-91fe-4bf9-8a4d-38ebdcc39d2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:41.102945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81c1222a-91fe-4bf9-8a4d-38ebdcc39d2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:41.108939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81c1222a-91fe-4bf9-8a4d-38ebdcc39d2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:41.139636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=10 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:41.445413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b2431eae-f9d0-4900-9e91-89467567639f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:41.454858 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b2431eae-f9d0-4900-9e91-89467567639f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.534192 Oct 04 21:24:41.458304 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1991/3969] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:40 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:41.470838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f3985242-e600-46e6-a22e-c9ecbd7479e0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:41.472019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f3985242-e600-46e6-a22e-c9ecbd7479e0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:41.481056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-81c1222a-91fe-4bf9-8a4d-38ebdcc39d2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:41.486986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3985242-e600-46e6-a22e-c9ecbd7479e0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:41.489474 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-81c1222a-91fe-4bf9-8a4d-38ebdcc39d2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1492 microversion: 2.1 time: 0.413035 Oct 04 21:24:41.491703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3985242-e600-46e6-a22e-c9ecbd7479e0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:41.492458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3985242-e600-46e6-a22e-c9ecbd7479e0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:41.495189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3985242-e600-46e6-a22e-c9ecbd7479e0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:41.495881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3985242-e600-46e6-a22e-c9ecbd7479e0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:41.496918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3985242-e600-46e6-a22e-c9ecbd7479e0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:41.512290 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1979/3970] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:41 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1492 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:24:41.517958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-39bd5b01-dc86-4efb-9c9c-a5f0b9a4af9c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:41.518809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-39bd5b01-dc86-4efb-9c9c-a5f0b9a4af9c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:41.525890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39bd5b01-dc86-4efb-9c9c-a5f0b9a4af9c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:41.526596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39bd5b01-dc86-4efb-9c9c-a5f0b9a4af9c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:41.527637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39bd5b01-dc86-4efb-9c9c-a5f0b9a4af9c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:41.528535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39bd5b01-dc86-4efb-9c9c-a5f0b9a4af9c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:41.529141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39bd5b01-dc86-4efb-9c9c-a5f0b9a4af9c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:41.529913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39bd5b01-dc86-4efb-9c9c-a5f0b9a4af9c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:41.830401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f3985242-e600-46e6-a22e-c9ecbd7479e0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:41.846135 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f3985242-e600-46e6-a22e-c9ecbd7479e0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1322 microversion: 2.1 time: 0.380168 Oct 04 21:24:41.848261 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1992/3971] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:41 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:41.893140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-39bd5b01-dc86-4efb-9c9c-a5f0b9a4af9c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:41.909318 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-39bd5b01-dc86-4efb-9c9c-a5f0b9a4af9c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.394443 Oct 04 21:24:41.937552 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1980/3972] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:41 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:41.949677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1948b22d-71a9-409b-995e-23c8ec440ce4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:41.956343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1948b22d-71a9-409b-995e-23c8ec440ce4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:41.964985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1948b22d-71a9-409b-995e-23c8ec440ce4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:41.965650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1948b22d-71a9-409b-995e-23c8ec440ce4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:41.966642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1948b22d-71a9-409b-995e-23c8ec440ce4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:41.967474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1948b22d-71a9-409b-995e-23c8ec440ce4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:41.968389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1948b22d-71a9-409b-995e-23c8ec440ce4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:41.969565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1948b22d-71a9-409b-995e-23c8ec440ce4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:42.334434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1948b22d-71a9-409b-995e-23c8ec440ce4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:42.343474 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1948b22d-71a9-409b-995e-23c8ec440ce4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.402055 Oct 04 21:24:42.344866 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1993/3973] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:41 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:42.517491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-adfb19f0-68a7-4143-b285-fd14d3f007ea tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:42.518779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-adfb19f0-68a7-4143-b285-fd14d3f007ea tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:42.528148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adfb19f0-68a7-4143-b285-fd14d3f007ea tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:42.529554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adfb19f0-68a7-4143-b285-fd14d3f007ea tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:42.530376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adfb19f0-68a7-4143-b285-fd14d3f007ea tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:42.531326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adfb19f0-68a7-4143-b285-fd14d3f007ea tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:42.532005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adfb19f0-68a7-4143-b285-fd14d3f007ea tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:42.532655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adfb19f0-68a7-4143-b285-fd14d3f007ea tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:42.626845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-81cc4345-fe11-4ec3-b4e0-a5c85ab8847f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-73219500", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "734a8a85-50ab-4efa-9474-a014f1074a74"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:42.702380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-81cc4345-fe11-4ec3-b4e0-a5c85ab8847f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] validate_networks() for [('734a8a85-50ab-4efa-9474-a014f1074a74', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:24:43.466393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-adfb19f0-68a7-4143-b285-fd14d3f007ea tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:43.475508 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-adfb19f0-68a7-4143-b285-fd14d3f007ea tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1492 microversion: 2.1 time: 0.961940 Oct 04 21:24:43.476853 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1981/3974] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:42 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1492 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:43.495954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b3d1b9d9-95d5-41f9-99e4-ef56d8a3b957 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:43.498918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b3d1b9d9-95d5-41f9-99e4-ef56d8a3b957 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:43.503793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3d1b9d9-95d5-41f9-99e4-ef56d8a3b957 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:43.504299 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3d1b9d9-95d5-41f9-99e4-ef56d8a3b957 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:43.505001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3d1b9d9-95d5-41f9-99e4-ef56d8a3b957 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:43.505996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3d1b9d9-95d5-41f9-99e4-ef56d8a3b957 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:43.506667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3d1b9d9-95d5-41f9-99e4-ef56d8a3b957 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:43.507255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3d1b9d9-95d5-41f9-99e4-ef56d8a3b957 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:44.278826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b3d1b9d9-95d5-41f9-99e4-ef56d8a3b957 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:44.296995 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b3d1b9d9-95d5-41f9-99e4-ef56d8a3b957 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1322 microversion: 2.1 time: 0.818901 Oct 04 21:24:44.297630 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1982/3975] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:43 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1322 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:44.312731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-4093e193-31b4-4640-97ac-bea59d797b00 req-32cc09b2-020c-4fc5-af9a-a91c2c638338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c75626ed-54cc-4237-a6fd-f460ae7fc572", "name": "network-vif-deleted", "tag": "94c461f8-8de6-41f2-9d15-5a175fc292d1"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:44.319669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:44.328917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4093e193-31b4-4640-97ac-bea59d797b00 req-32cc09b2-020c-4fc5-af9a-a91c2c638338 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:44.329703 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4093e193-31b4-4640-97ac-bea59d797b00 req-32cc09b2-020c-4fc5-af9a-a91c2c638338 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:44.330222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4093e193-31b4-4640-97ac-bea59d797b00 req-32cc09b2-020c-4fc5-af9a-a91c2c638338 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:44.359802 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-4093e193-31b4-4640-97ac-bea59d797b00 req-32cc09b2-020c-4fc5-af9a-a91c2c638338 service nova] Creating event network-vif-deleted:94c461f8-8de6-41f2-9d15-5a175fc292d1 for instance c75626ed-54cc-4237-a6fd-f460ae7fc572 on n-h1-860282-1 Oct 04 21:24:44.369563 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-4093e193-31b4-4640-97ac-bea59d797b00 req-32cc09b2-020c-4fc5-af9a-a91c2c638338 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070086 Oct 04 21:24:44.373383 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1983/3976] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:24:44.503995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a484556a-ab33-4228-9b54-7da24f2070ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:44.510191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a484556a-ab33-4228-9b54-7da24f2070ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:44.533373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a484556a-ab33-4228-9b54-7da24f2070ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:44.533373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a484556a-ab33-4228-9b54-7da24f2070ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:44.536089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a484556a-ab33-4228-9b54-7da24f2070ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:44.542784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a484556a-ab33-4228-9b54-7da24f2070ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:44.543642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a484556a-ab33-4228-9b54-7da24f2070ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:44.546391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a484556a-ab33-4228-9b54-7da24f2070ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:44.579003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-81cc4345-fe11-4ec3-b4e0-a5c85ab8847f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:24:44.579667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-81cc4345-fe11-4ec3-b4e0-a5c85ab8847f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:24:44.579994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-81cc4345-fe11-4ec3-b4e0-a5c85ab8847f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:24:44.580607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-81cc4345-fe11-4ec3-b4e0-a5c85ab8847f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:24:44.581244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-81cc4345-fe11-4ec3-b4e0-a5c85ab8847f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:24:44.607310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81cc4345-fe11-4ec3-b4e0-a5c85ab8847f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:44.607843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81cc4345-fe11-4ec3-b4e0-a5c85ab8847f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:44.608297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81cc4345-fe11-4ec3-b4e0-a5c85ab8847f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:44.616484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81cc4345-fe11-4ec3-b4e0-a5c85ab8847f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:44.620069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81cc4345-fe11-4ec3-b4e0-a5c85ab8847f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:44.620704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81cc4345-fe11-4ec3-b4e0-a5c85ab8847f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:44.653753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:44.668467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a484556a-ab33-4228-9b54-7da24f2070ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:44.673392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a484556a-ab33-4228-9b54-7da24f2070ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:44.674374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a484556a-ab33-4228-9b54-7da24f2070ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:44.677672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-a484556a-ab33-4228-9b54-7da24f2070ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lazy-loading 'fault' on Instance uuid c75626ed-54cc-4237-a6fd-f460ae7fc572 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:24:44.698333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-81cc4345-fe11-4ec3-b4e0-a5c85ab8847f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Getting quotas for project 0f62474e9d474aa28ac754b712e68652. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:24:44.706030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-81cc4345-fe11-4ec3-b4e0-a5c85ab8847f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Getting quotas for user 8ef7d2991dce46278486e0ee963d4cf3 and project 0f62474e9d474aa28ac754b712e68652. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:24:44.723387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-81cc4345-fe11-4ec3-b4e0-a5c85ab8847f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:24:44.725786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-81cc4345-fe11-4ec3-b4e0-a5c85ab8847f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:24:44.849143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a484556a-ab33-4228-9b54-7da24f2070ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:44.876058 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a484556a-ab33-4228-9b54-7da24f2070ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 200 len: 1304 microversion: 2.1 time: 0.376989 Oct 04 21:24:44.876058 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1984/3977] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:44 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 1304 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:24:44.936662 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-81cc4345-fe11-4ec3-b4e0-a5c85ab8847f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.314178 Oct 04 21:24:44.946295 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1994/3978] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:24:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:24:44.952232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1010b1a8-be0e-4662-8269-71a0d0933c48 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:44.954301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1010b1a8-be0e-4662-8269-71a0d0933c48 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:45.084567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1010b1a8-be0e-4662-8269-71a0d0933c48 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:45.136875 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1010b1a8-be0e-4662-8269-71a0d0933c48 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 200 len: 1213 microversion: 2.1 time: 0.146030 Oct 04 21:24:45.136875 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1985/3979] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:44 2022] GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 1213 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:24:45.320149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d5d33713-d545-456c-bc3b-5232032e3560 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:45.320786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d5d33713-d545-456c-bc3b-5232032e3560 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:45.338991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d5d33713-d545-456c-bc3b-5232032e3560 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:45.342403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d5d33713-d545-456c-bc3b-5232032e3560 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:45.342921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d5d33713-d545-456c-bc3b-5232032e3560 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:45.350798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d5d33713-d545-456c-bc3b-5232032e3560 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:45.350798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d5d33713-d545-456c-bc3b-5232032e3560 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:45.350798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d5d33713-d545-456c-bc3b-5232032e3560 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:45.420277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-81017756-e75d-4f32-b666-1d93761cc98e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:45.421847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-81017756-e75d-4f32-b666-1d93761cc98e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:45.434008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81017756-e75d-4f32-b666-1d93761cc98e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:45.440127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81017756-e75d-4f32-b666-1d93761cc98e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:45.440889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81017756-e75d-4f32-b666-1d93761cc98e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:45.443233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81017756-e75d-4f32-b666-1d93761cc98e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:45.443871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81017756-e75d-4f32-b666-1d93761cc98e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:45.444468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81017756-e75d-4f32-b666-1d93761cc98e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:45.518437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-81017756-e75d-4f32-b666-1d93761cc98e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:24:45.749631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:45.895634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d5d33713-d545-456c-bc3b-5232032e3560 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:45.905615 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d5d33713-d545-456c-bc3b-5232032e3560 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1322 microversion: 2.1 time: 0.589295 Oct 04 21:24:45.906213 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1995/3980] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:45 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1322 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:45.910698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b4ef06c6-157c-42dd-9a07-343f18d0721f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:45.911317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b4ef06c6-157c-42dd-9a07-343f18d0721f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:45.919262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b4ef06c6-157c-42dd-9a07-343f18d0721f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:45.919262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b4ef06c6-157c-42dd-9a07-343f18d0721f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:45.919262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b4ef06c6-157c-42dd-9a07-343f18d0721f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:45.919947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b4ef06c6-157c-42dd-9a07-343f18d0721f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:45.920882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b4ef06c6-157c-42dd-9a07-343f18d0721f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:45.921554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b4ef06c6-157c-42dd-9a07-343f18d0721f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:45.943619 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-b4ef06c6-157c-42dd-9a07-343f18d0721f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance c75626ed-54cc-4237-a6fd-f460ae7fc572 could not be found. Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b4ef06c6-157c-42dd-9a07-343f18d0721f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 HTTP/1.1 Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance c75626ed-54cc-4237-a6fd-f460ae7fc572 could not be found. Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'c75626ed-54cc-4237-a6fd-f460ae7fc572'} Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c75626ed-54cc-4237-a6fd-f460ae7fc572 could not be found. Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c75626ed-54cc-4237-a6fd-f460ae7fc572 could not be found. Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:24:45.945682 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:45.950608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:24:45.950608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:24:45.950608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:24:45.950608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:24:45.950608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:24:45.950608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c75626ed-54cc-4237-a6fd-f460ae7fc572 could not be found. Oct 04 21:24:45.950608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:24:45.954831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b4ef06c6-157c-42dd-9a07-343f18d0721f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance c75626ed-54cc-4237-a6fd-f460ae7fc572 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:24:45.956849 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b4ef06c6-157c-42dd-9a07-343f18d0721f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 404 len: 111 microversion: 2.1 time: 0.049364 Oct 04 21:24:45.974749 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1996/3981] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:45 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:24:46.101911 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-81017756-e75d-4f32-b666-1d93761cc98e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 204 len: 0 microversion: 2.32 time: 0.691208 Oct 04 21:24:46.104507 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1986/3982] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:24:45 2022] DELETE /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:24:46.122954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-40b8fed4-cbd8-4950-b3ba-78673aa0d1c4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:46.123624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-40b8fed4-cbd8-4950-b3ba-78673aa0d1c4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:46.138947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40b8fed4-cbd8-4950-b3ba-78673aa0d1c4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:46.139456 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40b8fed4-cbd8-4950-b3ba-78673aa0d1c4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:46.139907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40b8fed4-cbd8-4950-b3ba-78673aa0d1c4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:46.154727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40b8fed4-cbd8-4950-b3ba-78673aa0d1c4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:46.157968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40b8fed4-cbd8-4950-b3ba-78673aa0d1c4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:46.160705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40b8fed4-cbd8-4950-b3ba-78673aa0d1c4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:46.167506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-220cc3ff-72e6-45ee-9f03-a1179ec7b042 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:46.168407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-220cc3ff-72e6-45ee-9f03-a1179ec7b042 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:46.433977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-220cc3ff-72e6-45ee-9f03-a1179ec7b042 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:46.445067 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-220cc3ff-72e6-45ee-9f03-a1179ec7b042 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 200 len: 1213 microversion: 2.1 time: 0.284971 Oct 04 21:24:46.454331 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1987/3983] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:46 2022] GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 1213 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:24:46.467834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e806e301-367c-4c77-b692-a2694e4d40ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1563288460", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "f54abd1e-a2a0-4f4b-b858-f3831f4d8295"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:46.600503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-e806e301-367c-4c77-b692-a2694e4d40ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] validate_networks() for [('f54abd1e-a2a0-4f4b-b858-f3831f4d8295', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:24:47.317959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-40b8fed4-cbd8-4950-b3ba-78673aa0d1c4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:47.347538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-40b8fed4-cbd8-4950-b3ba-78673aa0d1c4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:47.349628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-40b8fed4-cbd8-4950-b3ba-78673aa0d1c4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:47.351128 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-40b8fed4-cbd8-4950-b3ba-78673aa0d1c4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 2961 microversion: 2.32 time: 1.235535 Oct 04 21:24:47.365536 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1997/3984] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:46 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 2961 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:47.380011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b6f62768-cc5a-4521-87d2-18fdc554166d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:47.380763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b6f62768-cc5a-4521-87d2-18fdc554166d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:47.391441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6f62768-cc5a-4521-87d2-18fdc554166d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:47.391441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6f62768-cc5a-4521-87d2-18fdc554166d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:47.391441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6f62768-cc5a-4521-87d2-18fdc554166d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:47.391441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6f62768-cc5a-4521-87d2-18fdc554166d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:47.391441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6f62768-cc5a-4521-87d2-18fdc554166d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:47.391441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6f62768-cc5a-4521-87d2-18fdc554166d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:48.026594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b6f62768-cc5a-4521-87d2-18fdc554166d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:48.036921 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b6f62768-cc5a-4521-87d2-18fdc554166d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1322 microversion: 2.1 time: 0.662548 Oct 04 21:24:48.037525 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1998/3985] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:47 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1322 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:48.043244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-36f3faab-92c9-4ea3-a9f3-d2722d4fa99b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:48.044067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-36f3faab-92c9-4ea3-a9f3-d2722d4fa99b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:48.050952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36f3faab-92c9-4ea3-a9f3-d2722d4fa99b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:48.053236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36f3faab-92c9-4ea3-a9f3-d2722d4fa99b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:48.053893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36f3faab-92c9-4ea3-a9f3-d2722d4fa99b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:48.054770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36f3faab-92c9-4ea3-a9f3-d2722d4fa99b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:48.055402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36f3faab-92c9-4ea3-a9f3-d2722d4fa99b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:48.056586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36f3faab-92c9-4ea3-a9f3-d2722d4fa99b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:48.138552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-36f3faab-92c9-4ea3-a9f3-d2722d4fa99b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:48.154258 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-36f3faab-92c9-4ea3-a9f3-d2722d4fa99b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 200 len: 1209 microversion: 2.1 time: 0.110676 Oct 04 21:24:48.172814 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 1999/3986] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:48 2022] GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 1209 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:48.178434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-d0d1a8b2-2e09-49bb-a52e-2a6a534659b5 req-b7d42a60-0e0b-43e5-875a-80a3a5447387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267676e7-8969-4f7b-9e77-da72b8e71a0b", "name": "network-vif-plugged", "status": "completed", "tag": "ccb20d83-d32e-4ee7-a699-8e1da8c412f2"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:48.190696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d0d1a8b2-2e09-49bb-a52e-2a6a534659b5 req-b7d42a60-0e0b-43e5-875a-80a3a5447387 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:48.191569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d0d1a8b2-2e09-49bb-a52e-2a6a534659b5 req-b7d42a60-0e0b-43e5-875a-80a3a5447387 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:48.192210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d0d1a8b2-2e09-49bb-a52e-2a6a534659b5 req-b7d42a60-0e0b-43e5-875a-80a3a5447387 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:48.205624 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-d0d1a8b2-2e09-49bb-a52e-2a6a534659b5 req-b7d42a60-0e0b-43e5-875a-80a3a5447387 service nova] Creating event network-vif-plugged:ccb20d83-d32e-4ee7-a699-8e1da8c412f2 for instance 267676e7-8969-4f7b-9e77-da72b8e71a0b on n-h2-860282-1 Oct 04 21:24:48.211644 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-d0d1a8b2-2e09-49bb-a52e-2a6a534659b5 req-b7d42a60-0e0b-43e5-875a-80a3a5447387 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037181 Oct 04 21:24:48.212710 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2000/3987] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:24:48.388157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f9ba577d-bae5-4df9-bdcf-5207c527e111 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:48.389742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f9ba577d-bae5-4df9-bdcf-5207c527e111 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:48.396575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9ba577d-bae5-4df9-bdcf-5207c527e111 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:48.397158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9ba577d-bae5-4df9-bdcf-5207c527e111 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:48.397759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9ba577d-bae5-4df9-bdcf-5207c527e111 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:48.398545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9ba577d-bae5-4df9-bdcf-5207c527e111 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:48.399180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9ba577d-bae5-4df9-bdcf-5207c527e111 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:48.400309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9ba577d-bae5-4df9-bdcf-5207c527e111 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:48.459485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e806e301-367c-4c77-b692-a2694e4d40ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:24:48.464100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e806e301-367c-4c77-b692-a2694e4d40ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:24:48.468996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e806e301-367c-4c77-b692-a2694e4d40ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:24:48.469752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e806e301-367c-4c77-b692-a2694e4d40ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:24:48.470415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e806e301-367c-4c77-b692-a2694e4d40ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:24:48.481959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e806e301-367c-4c77-b692-a2694e4d40ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:48.486137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e806e301-367c-4c77-b692-a2694e4d40ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:48.486885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e806e301-367c-4c77-b692-a2694e4d40ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:48.487920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e806e301-367c-4c77-b692-a2694e4d40ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:48.488619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e806e301-367c-4c77-b692-a2694e4d40ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:48.489845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e806e301-367c-4c77-b692-a2694e4d40ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:48.512911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-e806e301-367c-4c77-b692-a2694e4d40ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Getting quotas for project 68c56e6603d14d9b8ad9c74a9df021c9. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:24:48.525966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-e806e301-367c-4c77-b692-a2694e4d40ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Getting quotas for user 416e0c617ee34a19a7d6936b78c1d94d and project 68c56e6603d14d9b8ad9c74a9df021c9. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:24:48.561209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e806e301-367c-4c77-b692-a2694e4d40ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:24:48.572104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e806e301-367c-4c77-b692-a2694e4d40ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:24:48.749655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f9ba577d-bae5-4df9-bdcf-5207c527e111 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:48.757919 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e806e301-367c-4c77-b692-a2694e4d40ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.302339 Oct 04 21:24:48.758793 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1988/3988] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:24:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:24:48.782247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f9ba577d-bae5-4df9-bdcf-5207c527e111 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:48.783127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1e33b742-7a86-44c4-94a0-511aff1efd80 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:48.783918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1e33b742-7a86-44c4-94a0-511aff1efd80 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:48.792615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f9ba577d-bae5-4df9-bdcf-5207c527e111 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:48.792615 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f9ba577d-bae5-4df9-bdcf-5207c527e111 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 2961 microversion: 2.32 time: 0.403941 Oct 04 21:24:48.808530 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2001/3989] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:48 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 2961 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:24:48.953690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1e33b742-7a86-44c4-94a0-511aff1efd80 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:48.965706 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1e33b742-7a86-44c4-94a0-511aff1efd80 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1215 microversion: 2.1 time: 0.191303 Oct 04 21:24:48.969268 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1989/3990] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:48 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1215 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:49.071252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6defacc6-ccad-49f0-91e8-d213e9b9e5ce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:49.072503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6defacc6-ccad-49f0-91e8-d213e9b9e5ce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:49.101202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6defacc6-ccad-49f0-91e8-d213e9b9e5ce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:49.101202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6defacc6-ccad-49f0-91e8-d213e9b9e5ce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:49.101202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6defacc6-ccad-49f0-91e8-d213e9b9e5ce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:49.101202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6defacc6-ccad-49f0-91e8-d213e9b9e5ce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:49.101202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6defacc6-ccad-49f0-91e8-d213e9b9e5ce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:49.101202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6defacc6-ccad-49f0-91e8-d213e9b9e5ce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:49.185566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8c0d963c-58b8-42c7-8a17-64db408ae738 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:49.186465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8c0d963c-58b8-42c7-8a17-64db408ae738 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:49.204047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c0d963c-58b8-42c7-8a17-64db408ae738 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:49.211935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c0d963c-58b8-42c7-8a17-64db408ae738 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:49.213316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c0d963c-58b8-42c7-8a17-64db408ae738 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:49.214533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c0d963c-58b8-42c7-8a17-64db408ae738 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:49.215748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c0d963c-58b8-42c7-8a17-64db408ae738 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:49.216374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c0d963c-58b8-42c7-8a17-64db408ae738 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:49.380411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8c0d963c-58b8-42c7-8a17-64db408ae738 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:49.402595 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8c0d963c-58b8-42c7-8a17-64db408ae738 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 200 len: 1273 microversion: 2.1 time: 0.220966 Oct 04 21:24:49.403434 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1990/3991] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:49 2022] GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:24:49.752652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6defacc6-ccad-49f0-91e8-d213e9b9e5ce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:49.761731 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6defacc6-ccad-49f0-91e8-d213e9b9e5ce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1322 microversion: 2.1 time: 0.694275 Oct 04 21:24:49.766119 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2002/3992] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:49 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1322 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:49.841951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1c0ea4ea-cdae-4ed9-a041-edc38653e298 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:49.842577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1c0ea4ea-cdae-4ed9-a041-edc38653e298 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:49.850133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c0ea4ea-cdae-4ed9-a041-edc38653e298 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:49.850635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c0ea4ea-cdae-4ed9-a041-edc38653e298 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:49.851088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c0ea4ea-cdae-4ed9-a041-edc38653e298 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:49.851802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c0ea4ea-cdae-4ed9-a041-edc38653e298 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:49.852265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c0ea4ea-cdae-4ed9-a041-edc38653e298 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:49.852768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c0ea4ea-cdae-4ed9-a041-edc38653e298 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:49.993811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b2c545b1-bdf7-4a8b-bdac-15496e067dcb tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:49.994621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b2c545b1-bdf7-4a8b-bdac-15496e067dcb tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:50.107783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b2c545b1-bdf7-4a8b-bdac-15496e067dcb tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:50.120235 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b2c545b1-bdf7-4a8b-bdac-15496e067dcb tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1215 microversion: 2.1 time: 0.130776 Oct 04 21:24:50.121687 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2003/3993] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:49 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:24:50.428448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-59643e5f-da8b-4907-b67b-3fae236e1d39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:50.429372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-59643e5f-da8b-4907-b67b-3fae236e1d39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:50.441907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59643e5f-da8b-4907-b67b-3fae236e1d39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:50.446084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59643e5f-da8b-4907-b67b-3fae236e1d39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:50.447590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59643e5f-da8b-4907-b67b-3fae236e1d39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:50.448538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59643e5f-da8b-4907-b67b-3fae236e1d39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:50.465157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1c0ea4ea-cdae-4ed9-a041-edc38653e298 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:50.469729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59643e5f-da8b-4907-b67b-3fae236e1d39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:50.476227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59643e5f-da8b-4907-b67b-3fae236e1d39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:50.482334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1c0ea4ea-cdae-4ed9-a041-edc38653e298 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:50.484328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1c0ea4ea-cdae-4ed9-a041-edc38653e298 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:50.486115 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1c0ea4ea-cdae-4ed9-a041-edc38653e298 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 2961 microversion: 2.32 time: 0.648395 Oct 04 21:24:50.486897 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1991/3994] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:49 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 2961 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:50.574762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-59643e5f-da8b-4907-b67b-3fae236e1d39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:50.583022 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-59643e5f-da8b-4907-b67b-3fae236e1d39 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 200 len: 1271 microversion: 2.1 time: 0.158417 Oct 04 21:24:50.585532 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2004/3995] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:50 2022] GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:50.789217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-95941878-d4a3-4525-bedf-9f9f8e649df0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:50.791988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-95941878-d4a3-4525-bedf-9f9f8e649df0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:50.811191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95941878-d4a3-4525-bedf-9f9f8e649df0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:50.812206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95941878-d4a3-4525-bedf-9f9f8e649df0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:50.812671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95941878-d4a3-4525-bedf-9f9f8e649df0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:50.813656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95941878-d4a3-4525-bedf-9f9f8e649df0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:50.814131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95941878-d4a3-4525-bedf-9f9f8e649df0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:50.814568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95941878-d4a3-4525-bedf-9f9f8e649df0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:51.073339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-95941878-d4a3-4525-bedf-9f9f8e649df0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:51.089770 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-95941878-d4a3-4525-bedf-9f9f8e649df0 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1518 microversion: 2.1 time: 0.304322 Oct 04 21:24:51.103573 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1992/3996] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:50 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1518 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:51.115938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cd0dd5e9-5efb-41af-85c2-8c76ab32d2c7 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:51.118973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cd0dd5e9-5efb-41af-85c2-8c76ab32d2c7 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:51.141808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd0dd5e9-5efb-41af-85c2-8c76ab32d2c7 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:51.142658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd0dd5e9-5efb-41af-85c2-8c76ab32d2c7 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:51.143271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd0dd5e9-5efb-41af-85c2-8c76ab32d2c7 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:51.146464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd0dd5e9-5efb-41af-85c2-8c76ab32d2c7 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:51.148267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd0dd5e9-5efb-41af-85c2-8c76ab32d2c7 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:51.148752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b7c3e003-7bc5-478d-ad6e-07dd6bab2608 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:51.151157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b7c3e003-7bc5-478d-ad6e-07dd6bab2608 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:51.151634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd0dd5e9-5efb-41af-85c2-8c76ab32d2c7 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:51.157087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7c3e003-7bc5-478d-ad6e-07dd6bab2608 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:51.157771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7c3e003-7bc5-478d-ad6e-07dd6bab2608 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:51.158332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7c3e003-7bc5-478d-ad6e-07dd6bab2608 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:51.158990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7c3e003-7bc5-478d-ad6e-07dd6bab2608 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:51.159474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7c3e003-7bc5-478d-ad6e-07dd6bab2608 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:51.159873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7c3e003-7bc5-478d-ad6e-07dd6bab2608 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:51.184836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-cd0dd5e9-5efb-41af-85c2-8c76ab32d2c7 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lazy-loading 'flavor' on Instance uuid 267676e7-8969-4f7b-9e77-da72b8e71a0b {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:24:51.700162 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cd0dd5e9-5efb-41af-85c2-8c76ab32d2c7 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "POST /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b/action" status: 200 len: 32 microversion: 2.1 time: 0.587825 Oct 04 21:24:51.702546 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2005/3997] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:24:51 2022] POST /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b/action => generated 32 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:24:51.715919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-10647d47-a0b8-49f3-a3f3-1e0b2b61c39a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:51.717770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-10647d47-a0b8-49f3-a3f3-1e0b2b61c39a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:51.728909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10647d47-a0b8-49f3-a3f3-1e0b2b61c39a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:51.729899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10647d47-a0b8-49f3-a3f3-1e0b2b61c39a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:51.736141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10647d47-a0b8-49f3-a3f3-1e0b2b61c39a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:51.736141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10647d47-a0b8-49f3-a3f3-1e0b2b61c39a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:51.736141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10647d47-a0b8-49f3-a3f3-1e0b2b61c39a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:51.736141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10647d47-a0b8-49f3-a3f3-1e0b2b61c39a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:51.810460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b7c3e003-7bc5-478d-ad6e-07dd6bab2608 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:51.824108 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b7c3e003-7bc5-478d-ad6e-07dd6bab2608 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1267 microversion: 2.1 time: 0.680856 Oct 04 21:24:51.827508 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1993/3998] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:51 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1267 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:51.844521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-0cfa116b-90a0-49ff-a4c7-c0dc05e012e2 req-6630d4e2-f613-443a-aa99-86c90e254319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "name": "network-vif-unplugged", "status": "completed", "tag": "59687d68-2ca3-4874-9671-aaaec5a44a09"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:51.867206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0cfa116b-90a0-49ff-a4c7-c0dc05e012e2 req-6630d4e2-f613-443a-aa99-86c90e254319 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:51.873305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0cfa116b-90a0-49ff-a4c7-c0dc05e012e2 req-6630d4e2-f613-443a-aa99-86c90e254319 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:51.874368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0cfa116b-90a0-49ff-a4c7-c0dc05e012e2 req-6630d4e2-f613-443a-aa99-86c90e254319 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:51.899273 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-0cfa116b-90a0-49ff-a4c7-c0dc05e012e2 req-6630d4e2-f613-443a-aa99-86c90e254319 service nova] Creating event network-vif-unplugged:59687d68-2ca3-4874-9671-aaaec5a44a09 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:24:51.919429 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-0cfa116b-90a0-49ff-a4c7-c0dc05e012e2 req-6630d4e2-f613-443a-aa99-86c90e254319 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086702 Oct 04 21:24:51.920580 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1994/3999] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:24:51.937850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c4621b45-f10f-4b6d-8639-62f6b9a34104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:51.938993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c4621b45-f10f-4b6d-8639-62f6b9a34104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:51.956356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4621b45-f10f-4b6d-8639-62f6b9a34104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:51.957158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4621b45-f10f-4b6d-8639-62f6b9a34104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:51.959442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4621b45-f10f-4b6d-8639-62f6b9a34104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:51.960410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4621b45-f10f-4b6d-8639-62f6b9a34104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:51.963897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4621b45-f10f-4b6d-8639-62f6b9a34104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:51.967648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4621b45-f10f-4b6d-8639-62f6b9a34104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:53.181864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-10647d47-a0b8-49f3-a3f3-1e0b2b61c39a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:53.199231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-10647d47-a0b8-49f3-a3f3-1e0b2b61c39a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:53.202337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-10647d47-a0b8-49f3-a3f3-1e0b2b61c39a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:53.207004 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-10647d47-a0b8-49f3-a3f3-1e0b2b61c39a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 2940 microversion: 2.32 time: 1.502659 Oct 04 21:24:53.209324 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2006/4000] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:51 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 2940 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:53.217994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a6fd901d-d60f-4917-8578-2cd62d1bcda1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:53.221893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a6fd901d-d60f-4917-8578-2cd62d1bcda1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:53.235087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:53.237066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6fd901d-d60f-4917-8578-2cd62d1bcda1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:53.237924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6fd901d-d60f-4917-8578-2cd62d1bcda1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:53.247010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6fd901d-d60f-4917-8578-2cd62d1bcda1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:53.249535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6fd901d-d60f-4917-8578-2cd62d1bcda1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:53.250181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6fd901d-d60f-4917-8578-2cd62d1bcda1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:53.250778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6fd901d-d60f-4917-8578-2cd62d1bcda1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:53.344495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c4621b45-f10f-4b6d-8639-62f6b9a34104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:53.391273 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c4621b45-f10f-4b6d-8639-62f6b9a34104 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 200 len: 1313 microversion: 2.1 time: 1.466323 Oct 04 21:24:53.394851 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1995/4001] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:51 2022] GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 1313 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:53.422778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4226eca5-6bf1-4a07-856c-2cc955892ef7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:53.424066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4226eca5-6bf1-4a07-856c-2cc955892ef7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:53.441941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4226eca5-6bf1-4a07-856c-2cc955892ef7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:53.444130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4226eca5-6bf1-4a07-856c-2cc955892ef7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:53.444130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4226eca5-6bf1-4a07-856c-2cc955892ef7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:53.444130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4226eca5-6bf1-4a07-856c-2cc955892ef7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:53.444919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4226eca5-6bf1-4a07-856c-2cc955892ef7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:53.445603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4226eca5-6bf1-4a07-856c-2cc955892ef7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:53.679096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4226eca5-6bf1-4a07-856c-2cc955892ef7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:53.707765 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4226eca5-6bf1-4a07-856c-2cc955892ef7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1273 microversion: 2.1 time: 0.300783 Oct 04 21:24:53.710730 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1996/4002] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:53 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1273 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:53.941283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a6fd901d-d60f-4917-8578-2cd62d1bcda1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:53.954118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-f0f12843-d6f8-4f36-8e0f-2f203c4ddb82 req-a6a7e4a3-4cfd-442c-804f-670b83cc7c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "name": "network-vif-unplugged", "status": "completed", "tag": "a8c25e3b-fbff-43dd-a188-c7127b5919b0"}, {"server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "name": "network-vif-unplugged", "status": "completed", "tag": "a0d59a79-d95c-4b4b-b5be-713397dfdf42"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:53.954897 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a6fd901d-d60f-4917-8578-2cd62d1bcda1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1524 microversion: 2.1 time: 0.740301 Oct 04 21:24:53.966991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f0f12843-d6f8-4f36-8e0f-2f203c4ddb82 req-a6a7e4a3-4cfd-442c-804f-670b83cc7c21 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:53.967745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f0f12843-d6f8-4f36-8e0f-2f203c4ddb82 req-a6a7e4a3-4cfd-442c-804f-670b83cc7c21 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:53.968344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f0f12843-d6f8-4f36-8e0f-2f203c4ddb82 req-a6a7e4a3-4cfd-442c-804f-670b83cc7c21 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:53.991336 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2007/4003] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:53 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1524 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:54.021939 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-f0f12843-d6f8-4f36-8e0f-2f203c4ddb82 req-a6a7e4a3-4cfd-442c-804f-670b83cc7c21 service nova] Creating event network-vif-unplugged:a8c25e3b-fbff-43dd-a188-c7127b5919b0 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:24:54.022709 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-f0f12843-d6f8-4f36-8e0f-2f203c4ddb82 req-a6a7e4a3-4cfd-442c-804f-670b83cc7c21 service nova] Creating event network-vif-unplugged:a0d59a79-d95c-4b4b-b5be-713397dfdf42 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:24:54.033956 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-f0f12843-d6f8-4f36-8e0f-2f203c4ddb82 req-a6a7e4a3-4cfd-442c-804f-670b83cc7c21 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.084336 Oct 04 21:24:54.036187 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1997/4004] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:24:54.236974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1a189897-5598-46fd-921b-bf0fb5271000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:54.238676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1a189897-5598-46fd-921b-bf0fb5271000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:54.252996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a189897-5598-46fd-921b-bf0fb5271000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:54.253536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a189897-5598-46fd-921b-bf0fb5271000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:54.253977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a189897-5598-46fd-921b-bf0fb5271000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:54.254880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a189897-5598-46fd-921b-bf0fb5271000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:54.255348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a189897-5598-46fd-921b-bf0fb5271000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:54.255777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a189897-5598-46fd-921b-bf0fb5271000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:54.424156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-893d51e8-b3fb-449b-868c-20204cdb686b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:54.424900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-893d51e8-b3fb-449b-868c-20204cdb686b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:54.439000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-893d51e8-b3fb-449b-868c-20204cdb686b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:54.439511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-893d51e8-b3fb-449b-868c-20204cdb686b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:54.439960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-893d51e8-b3fb-449b-868c-20204cdb686b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:54.440692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-893d51e8-b3fb-449b-868c-20204cdb686b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:54.441157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-893d51e8-b3fb-449b-868c-20204cdb686b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:54.441620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-893d51e8-b3fb-449b-868c-20204cdb686b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:54.650903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:54.841358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1a189897-5598-46fd-921b-bf0fb5271000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:54.851733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1a189897-5598-46fd-921b-bf0fb5271000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:54.857467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1a189897-5598-46fd-921b-bf0fb5271000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:54.863072 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1a189897-5598-46fd-921b-bf0fb5271000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 2940 microversion: 2.32 time: 0.629975 Oct 04 21:24:54.865564 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2008/4005] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:54 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 2940 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:54.887621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bb395966-c79d-4efb-b642-dc9496af515e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:54.887621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bb395966-c79d-4efb-b642-dc9496af515e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:54.904666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb395966-c79d-4efb-b642-dc9496af515e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:54.908927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb395966-c79d-4efb-b642-dc9496af515e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:54.915692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb395966-c79d-4efb-b642-dc9496af515e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:54.919823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb395966-c79d-4efb-b642-dc9496af515e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:54.920797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb395966-c79d-4efb-b642-dc9496af515e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:54.927987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb395966-c79d-4efb-b642-dc9496af515e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:55.032031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-893d51e8-b3fb-449b-868c-20204cdb686b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:55.040577 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-893d51e8-b3fb-449b-868c-20204cdb686b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 200 len: 1313 microversion: 2.1 time: 0.621079 Oct 04 21:24:55.041735 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1998/4006] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:54 2022] GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 1313 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:24:55.046750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a8ef01df-2842-45ce-b5ec-903a0087809a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:55.047542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a8ef01df-2842-45ce-b5ec-903a0087809a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:55.065298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a8ef01df-2842-45ce-b5ec-903a0087809a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:55.066237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a8ef01df-2842-45ce-b5ec-903a0087809a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:55.066887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a8ef01df-2842-45ce-b5ec-903a0087809a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:55.067832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a8ef01df-2842-45ce-b5ec-903a0087809a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:55.068547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a8ef01df-2842-45ce-b5ec-903a0087809a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:55.069051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a8ef01df-2842-45ce-b5ec-903a0087809a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:56.082189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bb395966-c79d-4efb-b642-dc9496af515e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:56.098032 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bb395966-c79d-4efb-b642-dc9496af515e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1315 microversion: 2.1 time: 1.230930 Oct 04 21:24:56.101386 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2009/4007] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:54 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1315 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:56.111945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-587b422e-6708-4d3b-988b-7bd1d0e361b4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:56.138588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-587b422e-6708-4d3b-988b-7bd1d0e361b4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:56.155337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-587b422e-6708-4d3b-988b-7bd1d0e361b4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:56.158070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-587b422e-6708-4d3b-988b-7bd1d0e361b4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:56.158671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-587b422e-6708-4d3b-988b-7bd1d0e361b4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:56.160804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-587b422e-6708-4d3b-988b-7bd1d0e361b4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:56.161547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-587b422e-6708-4d3b-988b-7bd1d0e361b4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:56.166087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-587b422e-6708-4d3b-988b-7bd1d0e361b4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:56.340459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a8ef01df-2842-45ce-b5ec-903a0087809a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:56.352533 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a8ef01df-2842-45ce-b5ec-903a0087809a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1524 microversion: 2.1 time: 1.309480 Oct 04 21:24:56.356499 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 1999/4008] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:55 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1524 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:56.362609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-181a76ce-1590-494b-b630-f39cea55c1c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:56.363268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-181a76ce-1590-494b-b630-f39cea55c1c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:56.376289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-181a76ce-1590-494b-b630-f39cea55c1c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:56.376814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-181a76ce-1590-494b-b630-f39cea55c1c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:56.377240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-181a76ce-1590-494b-b630-f39cea55c1c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:56.377989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-181a76ce-1590-494b-b630-f39cea55c1c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:56.378447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-181a76ce-1590-494b-b630-f39cea55c1c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:56.378875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-181a76ce-1590-494b-b630-f39cea55c1c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:56.622942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-587b422e-6708-4d3b-988b-7bd1d0e361b4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:56.673128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-587b422e-6708-4d3b-988b-7bd1d0e361b4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:56.684904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-587b422e-6708-4d3b-988b-7bd1d0e361b4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:56.702250 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-587b422e-6708-4d3b-988b-7bd1d0e361b4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 2919 microversion: 2.32 time: 0.592479 Oct 04 21:24:56.706155 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2010/4009] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:56 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 2919 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:56.736504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b5ed7211-c509-46e1-b0cf-2908e825bb80 req-159dabb9-8a6b-4d97-8055-227f8713e4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "name": "network-vif-unplugged", "status": "completed", "tag": "c9f0995e-f8e2-4b1b-83e4-2688e418b233"}, {"server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "name": "network-vif-unplugged", "status": "completed", "tag": "e340948f-c791-41cb-b34c-2658c4ccb363"}, {"server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "name": "network-vif-unplugged", "status": "completed", "tag": "98058dbf-2515-40f7-b898-38ee0332974c"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:56.767779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b5ed7211-c509-46e1-b0cf-2908e825bb80 req-159dabb9-8a6b-4d97-8055-227f8713e4ba service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:56.768382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b5ed7211-c509-46e1-b0cf-2908e825bb80 req-159dabb9-8a6b-4d97-8055-227f8713e4ba service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:56.769142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b5ed7211-c509-46e1-b0cf-2908e825bb80 req-159dabb9-8a6b-4d97-8055-227f8713e4ba service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:56.800442 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b5ed7211-c509-46e1-b0cf-2908e825bb80 req-159dabb9-8a6b-4d97-8055-227f8713e4ba service nova] Creating event network-vif-unplugged:c9f0995e-f8e2-4b1b-83e4-2688e418b233 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:24:56.804612 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b5ed7211-c509-46e1-b0cf-2908e825bb80 req-159dabb9-8a6b-4d97-8055-227f8713e4ba service nova] Creating event network-vif-unplugged:e340948f-c791-41cb-b34c-2658c4ccb363 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:24:56.805191 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b5ed7211-c509-46e1-b0cf-2908e825bb80 req-159dabb9-8a6b-4d97-8055-227f8713e4ba service nova] Creating event network-vif-unplugged:98058dbf-2515-40f7-b898-38ee0332974c for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:24:56.820425 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b5ed7211-c509-46e1-b0cf-2908e825bb80 req-159dabb9-8a6b-4d97-8055-227f8713e4ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.110543 Oct 04 21:24:56.825143 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2011/4010] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:24:56.880627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-181a76ce-1590-494b-b630-f39cea55c1c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:56.894201 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-181a76ce-1590-494b-b630-f39cea55c1c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 200 len: 1313 microversion: 2.1 time: 0.539803 Oct 04 21:24:56.910053 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2000/4011] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:56 2022] GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 1313 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:57.125783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b35289bb-d485-451e-85b1-b79a1ba1e794 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:57.126732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b35289bb-d485-451e-85b1-b79a1ba1e794 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:57.139911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b35289bb-d485-451e-85b1-b79a1ba1e794 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:57.153906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b35289bb-d485-451e-85b1-b79a1ba1e794 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:57.153906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b35289bb-d485-451e-85b1-b79a1ba1e794 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:57.153906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b35289bb-d485-451e-85b1-b79a1ba1e794 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:57.160238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b35289bb-d485-451e-85b1-b79a1ba1e794 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:57.162005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b35289bb-d485-451e-85b1-b79a1ba1e794 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:57.243984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:57.270518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-bd155b1a-41a3-4981-a286-f178c94b1ad3 req-44e16710-87d6-4163-8490-529fc3705336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6daf7e14-2860-48b1-8065-bd3f25f5730b", "tag": "1224f342-58fd-46fe-8e48-5613db528544"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:57.303382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-bd155b1a-41a3-4981-a286-f178c94b1ad3 req-44e16710-87d6-4163-8490-529fc3705336 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:57.304068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-bd155b1a-41a3-4981-a286-f178c94b1ad3 req-44e16710-87d6-4163-8490-529fc3705336 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:57.305064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-bd155b1a-41a3-4981-a286-f178c94b1ad3 req-44e16710-87d6-4163-8490-529fc3705336 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:57.321155 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-bd155b1a-41a3-4981-a286-f178c94b1ad3 req-44e16710-87d6-4163-8490-529fc3705336 service nova] Creating event network-changed:1224f342-58fd-46fe-8e48-5613db528544 for instance 6daf7e14-2860-48b1-8065-bd3f25f5730b on n-h1-860282-1 Oct 04 21:24:57.329446 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-bd155b1a-41a3-4981-a286-f178c94b1ad3 req-44e16710-87d6-4163-8490-529fc3705336 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072280 Oct 04 21:24:57.330796 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2001/4012] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:24:57.381352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a515d329-93d3-416c-ab80-4e4955510821 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:57.382156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a515d329-93d3-416c-ab80-4e4955510821 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:57.394531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a515d329-93d3-416c-ab80-4e4955510821 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:57.395286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a515d329-93d3-416c-ab80-4e4955510821 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:57.395900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a515d329-93d3-416c-ab80-4e4955510821 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:57.396798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a515d329-93d3-416c-ab80-4e4955510821 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:57.405619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a515d329-93d3-416c-ab80-4e4955510821 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:57.405619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a515d329-93d3-416c-ab80-4e4955510821 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:57.869667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b35289bb-d485-451e-85b1-b79a1ba1e794 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:57.878779 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b35289bb-d485-451e-85b1-b79a1ba1e794 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1315 microversion: 2.1 time: 0.757525 Oct 04 21:24:57.886034 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2012/4013] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:57 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1315 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:57.891091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b62a9be2-c45c-459a-95e6-842284cad3c5 req-98f2e81d-9fea-42df-adef-075c46673236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "name": "network-vif-deleted", "tag": "c9f0995e-f8e2-4b1b-83e4-2688e418b233"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:57.937893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b62a9be2-c45c-459a-95e6-842284cad3c5 req-98f2e81d-9fea-42df-adef-075c46673236 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:57.938433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b62a9be2-c45c-459a-95e6-842284cad3c5 req-98f2e81d-9fea-42df-adef-075c46673236 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:57.938880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b62a9be2-c45c-459a-95e6-842284cad3c5 req-98f2e81d-9fea-42df-adef-075c46673236 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:57.976238 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b62a9be2-c45c-459a-95e6-842284cad3c5 req-98f2e81d-9fea-42df-adef-075c46673236 service nova] Creating event network-vif-deleted:c9f0995e-f8e2-4b1b-83e4-2688e418b233 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:24:57.995175 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b62a9be2-c45c-459a-95e6-842284cad3c5 req-98f2e81d-9fea-42df-adef-075c46673236 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107498 Oct 04 21:24:58.006973 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2013/4014] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:24:58.020471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f01db124-7718-4dbe-8aeb-98fe435cb8b1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:58.030454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f01db124-7718-4dbe-8aeb-98fe435cb8b1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:58.044875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f01db124-7718-4dbe-8aeb-98fe435cb8b1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:58.046609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f01db124-7718-4dbe-8aeb-98fe435cb8b1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:58.047714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f01db124-7718-4dbe-8aeb-98fe435cb8b1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:58.048646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f01db124-7718-4dbe-8aeb-98fe435cb8b1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:58.050400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f01db124-7718-4dbe-8aeb-98fe435cb8b1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:58.054126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f01db124-7718-4dbe-8aeb-98fe435cb8b1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:58.408193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a515d329-93d3-416c-ab80-4e4955510821 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:58.419909 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a515d329-93d3-416c-ab80-4e4955510821 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1524 microversion: 2.1 time: 1.043416 Oct 04 21:24:58.420780 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2002/4015] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:57 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1524 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:58.502064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:58.702675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f01db124-7718-4dbe-8aeb-98fe435cb8b1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:58.736037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f01db124-7718-4dbe-8aeb-98fe435cb8b1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:58.738875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f01db124-7718-4dbe-8aeb-98fe435cb8b1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:58.745016 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f01db124-7718-4dbe-8aeb-98fe435cb8b1 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 2872 microversion: 2.32 time: 0.736588 Oct 04 21:24:58.748367 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2014/4016] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:58 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 2872 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:58.760145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a5ebf5e8-b5bf-40de-a450-f07b467feb13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:58.765305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a5ebf5e8-b5bf-40de-a450-f07b467feb13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:58.777086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5ebf5e8-b5bf-40de-a450-f07b467feb13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:58.782468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5ebf5e8-b5bf-40de-a450-f07b467feb13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:58.783196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5ebf5e8-b5bf-40de-a450-f07b467feb13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:58.784383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5ebf5e8-b5bf-40de-a450-f07b467feb13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:58.785138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5ebf5e8-b5bf-40de-a450-f07b467feb13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:58.785761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5ebf5e8-b5bf-40de-a450-f07b467feb13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:58.958579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=12 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:59.042589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bb4bc89b-fb1a-4702-923e-f328e314a149 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-506386199", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "59bc4e47-3ceb-4d57-b1a7-aefe15e4bd7e"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:59.157460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-bb4bc89b-fb1a-4702-923e-f328e314a149 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] validate_networks() for [('59bc4e47-3ceb-4d57-b1a7-aefe15e4bd7e', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:24:59.514099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a5ebf5e8-b5bf-40de-a450-f07b467feb13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:59.527303 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a5ebf5e8-b5bf-40de-a450-f07b467feb13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 200 len: 1313 microversion: 2.1 time: 0.775991 Oct 04 21:24:59.541621 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2015/4017] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:58 2022] GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 1313 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:24:59.541621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-932dd091-1900-4a3f-a16e-f6f888da1058 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:59.541621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-932dd091-1900-4a3f-a16e-f6f888da1058 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:59.561388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-932dd091-1900-4a3f-a16e-f6f888da1058 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:59.562273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-932dd091-1900-4a3f-a16e-f6f888da1058 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:59.562943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-932dd091-1900-4a3f-a16e-f6f888da1058 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:59.563935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-932dd091-1900-4a3f-a16e-f6f888da1058 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:59.566247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-932dd091-1900-4a3f-a16e-f6f888da1058 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:59.566777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-932dd091-1900-4a3f-a16e-f6f888da1058 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:00.112556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:00.142828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-932dd091-1900-4a3f-a16e-f6f888da1058 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:00.159349 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-932dd091-1900-4a3f-a16e-f6f888da1058 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1315 microversion: 2.1 time: 0.625158 Oct 04 21:25:00.160680 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2016/4018] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:24:59 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:00.171995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-99a1a73c-4b4a-4985-a16e-724108b6f613 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:00.184057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-99a1a73c-4b4a-4985-a16e-724108b6f613 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:00.199250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99a1a73c-4b4a-4985-a16e-724108b6f613 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:00.200637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99a1a73c-4b4a-4985-a16e-724108b6f613 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:00.201860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99a1a73c-4b4a-4985-a16e-724108b6f613 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:00.205067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99a1a73c-4b4a-4985-a16e-724108b6f613 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:00.205880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99a1a73c-4b4a-4985-a16e-724108b6f613 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:00.206440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99a1a73c-4b4a-4985-a16e-724108b6f613 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:01.624159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-99a1a73c-4b4a-4985-a16e-724108b6f613 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:01.635601 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-99a1a73c-4b4a-4985-a16e-724108b6f613 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1524 microversion: 2.1 time: 1.473629 Oct 04 21:25:01.653979 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2017/4019] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:00 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1524 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:01.657764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-831d1b5b-681c-4b77-aaba-55ff559f369a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:01.658604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-831d1b5b-681c-4b77-aaba-55ff559f369a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:01.665511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-831d1b5b-681c-4b77-aaba-55ff559f369a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:01.666241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-831d1b5b-681c-4b77-aaba-55ff559f369a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:01.667021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-831d1b5b-681c-4b77-aaba-55ff559f369a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:01.667987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-831d1b5b-681c-4b77-aaba-55ff559f369a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:01.668671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-831d1b5b-681c-4b77-aaba-55ff559f369a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:01.669317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-831d1b5b-681c-4b77-aaba-55ff559f369a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:02.244362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-831d1b5b-681c-4b77-aaba-55ff559f369a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:02.256269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-831d1b5b-681c-4b77-aaba-55ff559f369a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:02.257830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-831d1b5b-681c-4b77-aaba-55ff559f369a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:02.259287 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-831d1b5b-681c-4b77-aaba-55ff559f369a tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 2711 microversion: 2.32 time: 0.614279 Oct 04 21:25:02.282455 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2018/4020] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:01 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 2711 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:02.288015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-706e247f-27a6-4d8f-887c-9daa44623aee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:02.290273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-706e247f-27a6-4d8f-887c-9daa44623aee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:02.298260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-706e247f-27a6-4d8f-887c-9daa44623aee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:02.299546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-706e247f-27a6-4d8f-887c-9daa44623aee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:02.300198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-706e247f-27a6-4d8f-887c-9daa44623aee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:02.301016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-706e247f-27a6-4d8f-887c-9daa44623aee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:02.301582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-706e247f-27a6-4d8f-887c-9daa44623aee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:02.302239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-706e247f-27a6-4d8f-887c-9daa44623aee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:02.331794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-bb4bc89b-fb1a-4702-923e-f328e314a149 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:25:02.342114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-bb4bc89b-fb1a-4702-923e-f328e314a149 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:25:02.352868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-bb4bc89b-fb1a-4702-923e-f328e314a149 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:25:02.355775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-bb4bc89b-fb1a-4702-923e-f328e314a149 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:25:02.356833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-bb4bc89b-fb1a-4702-923e-f328e314a149 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:25:02.405181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb4bc89b-fb1a-4702-923e-f328e314a149 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:02.405689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb4bc89b-fb1a-4702-923e-f328e314a149 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:02.407097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb4bc89b-fb1a-4702-923e-f328e314a149 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:02.410301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb4bc89b-fb1a-4702-923e-f328e314a149 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:02.413965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb4bc89b-fb1a-4702-923e-f328e314a149 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:02.414500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb4bc89b-fb1a-4702-923e-f328e314a149 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:02.525341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-bb4bc89b-fb1a-4702-923e-f328e314a149 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Getting quotas for project 0006ee9cd0424160a0e042de4c653358. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:25:02.541475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-bb4bc89b-fb1a-4702-923e-f328e314a149 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Getting quotas for user cf4bb2f7ed99411eb8b6231d64179485 and project 0006ee9cd0424160a0e042de4c653358. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:25:02.597156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bb4bc89b-fb1a-4702-923e-f328e314a149 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:25:02.603509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bb4bc89b-fb1a-4702-923e-f328e314a149 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:25:02.702178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-706e247f-27a6-4d8f-887c-9daa44623aee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:02.716229 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-706e247f-27a6-4d8f-887c-9daa44623aee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 200 len: 1313 microversion: 2.1 time: 0.432154 Oct 04 21:25:02.718053 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2019/4021] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:02 2022] GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:02.735346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-27af91fe-3ccf-4851-80c6-1f99916024aa req-b9fdbb30-24e7-43e0-95ca-b99583b0d791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "name": "network-vif-deleted", "tag": "a0d59a79-d95c-4b4b-b5be-713397dfdf42"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:02.751046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-27af91fe-3ccf-4851-80c6-1f99916024aa req-b9fdbb30-24e7-43e0-95ca-b99583b0d791 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:02.762183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-27af91fe-3ccf-4851-80c6-1f99916024aa req-b9fdbb30-24e7-43e0-95ca-b99583b0d791 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:02.762828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-27af91fe-3ccf-4851-80c6-1f99916024aa req-b9fdbb30-24e7-43e0-95ca-b99583b0d791 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:02.775853 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bb4bc89b-fb1a-4702-923e-f328e314a149 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.326260 Oct 04 21:25:02.779546 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2003/4022] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:24:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 4331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:25:02.791928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa94137c-96da-4806-8a15-9d5c2274df07 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:02.792770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aa94137c-96da-4806-8a15-9d5c2274df07 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:02.808862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa94137c-96da-4806-8a15-9d5c2274df07 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:02.812345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa94137c-96da-4806-8a15-9d5c2274df07 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:02.813216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa94137c-96da-4806-8a15-9d5c2274df07 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:02.814571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa94137c-96da-4806-8a15-9d5c2274df07 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:02.815276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa94137c-96da-4806-8a15-9d5c2274df07 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:02.818526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa94137c-96da-4806-8a15-9d5c2274df07 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:02.822426 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-27af91fe-3ccf-4851-80c6-1f99916024aa req-b9fdbb30-24e7-43e0-95ca-b99583b0d791 service nova] Creating event network-vif-deleted:a0d59a79-d95c-4b4b-b5be-713397dfdf42 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:25:02.838220 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-27af91fe-3ccf-4851-80c6-1f99916024aa req-b9fdbb30-24e7-43e0-95ca-b99583b0d791 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111843 Oct 04 21:25:02.838875 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2020/4023] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:02.861095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-16fa8a20-507a-4a76-819c-8918ee2745b6 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:02.867917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-16fa8a20-507a-4a76-819c-8918ee2745b6 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:02.890287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16fa8a20-507a-4a76-819c-8918ee2745b6 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:02.898173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16fa8a20-507a-4a76-819c-8918ee2745b6 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:02.898630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16fa8a20-507a-4a76-819c-8918ee2745b6 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:02.899965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16fa8a20-507a-4a76-819c-8918ee2745b6 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:02.900527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16fa8a20-507a-4a76-819c-8918ee2745b6 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:02.902117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16fa8a20-507a-4a76-819c-8918ee2745b6 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:03.760308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aa94137c-96da-4806-8a15-9d5c2274df07 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:03.761641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-16fa8a20-507a-4a76-819c-8918ee2745b6 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:03.770191 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aa94137c-96da-4806-8a15-9d5c2274df07 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1315 microversion: 2.1 time: 0.989321 Oct 04 21:25:03.775702 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2004/4024] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:02 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1315 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:03.781253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3ca893fc-dd6c-4370-8482-3d1c22a7291c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:03.781902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3ca893fc-dd6c-4370-8482-3d1c22a7291c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:03.788842 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-16fa8a20-507a-4a76-819c-8918ee2745b6 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1524 microversion: 2.1 time: 0.948167 Oct 04 21:25:03.791020 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2021/4025] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:02 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1524 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:03.806329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2f580ef7-4b91-442b-a7e3-731c7f08a490 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:03.808257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2f580ef7-4b91-442b-a7e3-731c7f08a490 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:03.824025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f580ef7-4b91-442b-a7e3-731c7f08a490 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:03.824979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f580ef7-4b91-442b-a7e3-731c7f08a490 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:03.835142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f580ef7-4b91-442b-a7e3-731c7f08a490 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:03.836194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f580ef7-4b91-442b-a7e3-731c7f08a490 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:03.837257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f580ef7-4b91-442b-a7e3-731c7f08a490 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:03.837767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f580ef7-4b91-442b-a7e3-731c7f08a490 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:03.959026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3ca893fc-dd6c-4370-8482-3d1c22a7291c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:03.969225 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3ca893fc-dd6c-4370-8482-3d1c22a7291c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1217 microversion: 2.1 time: 0.191895 Oct 04 21:25:03.970616 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2005/4026] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:03 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1217 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:03.981369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6a811380-871d-4f08-8a98-6d782cf8045f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:03.981369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6a811380-871d-4f08-8a98-6d782cf8045f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:03.994989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a811380-871d-4f08-8a98-6d782cf8045f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:03.995820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a811380-871d-4f08-8a98-6d782cf8045f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:03.996459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a811380-871d-4f08-8a98-6d782cf8045f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:03.997489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a811380-871d-4f08-8a98-6d782cf8045f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:03.999291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a811380-871d-4f08-8a98-6d782cf8045f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:03.999999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a811380-871d-4f08-8a98-6d782cf8045f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:04.303998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2f580ef7-4b91-442b-a7e3-731c7f08a490 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:04.322402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2f580ef7-4b91-442b-a7e3-731c7f08a490 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:04.328476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2f580ef7-4b91-442b-a7e3-731c7f08a490 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:04.330809 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2f580ef7-4b91-442b-a7e3-731c7f08a490 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 2506 microversion: 2.32 time: 0.538443 Oct 04 21:25:04.362911 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2022/4027] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:03 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 2506 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:04.402186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6a811380-871d-4f08-8a98-6d782cf8045f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:04.411192 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6a811380-871d-4f08-8a98-6d782cf8045f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 200 len: 1313 microversion: 2.1 time: 0.438087 Oct 04 21:25:04.412449 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2006/4028] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:03 2022] GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:04.801031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a617a0fd-c51c-4381-a469-39b63fcb0d0a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:04.801763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a617a0fd-c51c-4381-a469-39b63fcb0d0a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:04.814084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a617a0fd-c51c-4381-a469-39b63fcb0d0a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:04.816423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a617a0fd-c51c-4381-a469-39b63fcb0d0a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:04.823805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ac442772-ac1a-4011-b843-6ebc3e06f599 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:04.824280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ac442772-ac1a-4011-b843-6ebc3e06f599 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:04.831249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a617a0fd-c51c-4381-a469-39b63fcb0d0a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:04.832034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a617a0fd-c51c-4381-a469-39b63fcb0d0a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:04.841106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a617a0fd-c51c-4381-a469-39b63fcb0d0a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:04.841824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a617a0fd-c51c-4381-a469-39b63fcb0d0a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:04.845301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac442772-ac1a-4011-b843-6ebc3e06f599 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:04.846164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac442772-ac1a-4011-b843-6ebc3e06f599 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:04.846778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac442772-ac1a-4011-b843-6ebc3e06f599 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:04.847697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac442772-ac1a-4011-b843-6ebc3e06f599 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:04.848328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac442772-ac1a-4011-b843-6ebc3e06f599 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:04.853413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac442772-ac1a-4011-b843-6ebc3e06f599 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:05.404591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a617a0fd-c51c-4381-a469-39b63fcb0d0a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:05.414478 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a617a0fd-c51c-4381-a469-39b63fcb0d0a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1315 microversion: 2.1 time: 0.619188 Oct 04 21:25:05.422143 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2023/4029] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:04 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:05.432302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-1cee9dca-ee27-4b08-ad0f-a0acc270e10b req-4a01a61c-e52d-4264-8edb-656475e3cc69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39f7b402-4b3a-4a39-8686-9e9b36f9e040", "tag": "c883d4ee-a39d-4507-8568-f4e4fd4c7cd3"}, {"server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "name": "network-vif-deleted", "tag": "98058dbf-2515-40f7-b898-38ee0332974c"}, {"server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "name": "network-vif-deleted", "tag": "e340948f-c791-41cb-b34c-2658c4ccb363"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:05.464427 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1cee9dca-ee27-4b08-ad0f-a0acc270e10b req-4a01a61c-e52d-4264-8edb-656475e3cc69 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:05.466774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1cee9dca-ee27-4b08-ad0f-a0acc270e10b req-4a01a61c-e52d-4264-8edb-656475e3cc69 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:05.468358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1cee9dca-ee27-4b08-ad0f-a0acc270e10b req-4a01a61c-e52d-4264-8edb-656475e3cc69 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:05.504526 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-1cee9dca-ee27-4b08-ad0f-a0acc270e10b req-4a01a61c-e52d-4264-8edb-656475e3cc69 service nova] Creating event network-changed:c883d4ee-a39d-4507-8568-f4e4fd4c7cd3 for instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 on n-h1-860282-1 Oct 04 21:25:05.504526 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-1cee9dca-ee27-4b08-ad0f-a0acc270e10b req-4a01a61c-e52d-4264-8edb-656475e3cc69 service nova] Creating event network-vif-deleted:98058dbf-2515-40f7-b898-38ee0332974c for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:25:05.504526 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-1cee9dca-ee27-4b08-ad0f-a0acc270e10b req-4a01a61c-e52d-4264-8edb-656475e3cc69 service nova] Creating event network-vif-deleted:e340948f-c791-41cb-b34c-2658c4ccb363 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:25:05.524076 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-1cee9dca-ee27-4b08-ad0f-a0acc270e10b req-4a01a61c-e52d-4264-8edb-656475e3cc69 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.100177 Oct 04 21:25:05.539824 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2024/4030] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:05.549347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-314b7285-f729-447b-ad93-4e385b3315c9 req-9d499924-8636-4446-9b7f-d7e860383df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6daf7e14-2860-48b1-8065-bd3f25f5730b", "name": "network-vif-plugged", "status": "completed", "tag": "1224f342-58fd-46fe-8e48-5613db528544"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:05.564521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-314b7285-f729-447b-ad93-4e385b3315c9 req-9d499924-8636-4446-9b7f-d7e860383df6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:05.565259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-314b7285-f729-447b-ad93-4e385b3315c9 req-9d499924-8636-4446-9b7f-d7e860383df6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:05.565931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-314b7285-f729-447b-ad93-4e385b3315c9 req-9d499924-8636-4446-9b7f-d7e860383df6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:05.581906 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-314b7285-f729-447b-ad93-4e385b3315c9 req-9d499924-8636-4446-9b7f-d7e860383df6 service nova] Creating event network-vif-plugged:1224f342-58fd-46fe-8e48-5613db528544 for instance 6daf7e14-2860-48b1-8065-bd3f25f5730b on n-h1-860282-1 Oct 04 21:25:05.586913 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-314b7285-f729-447b-ad93-4e385b3315c9 req-9d499924-8636-4446-9b7f-d7e860383df6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045172 Oct 04 21:25:05.588509 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2025/4031] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:05.594478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-09c10d9d-fbbb-4711-8911-1d04d523d18c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:05.595657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-09c10d9d-fbbb-4711-8911-1d04d523d18c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:05.603243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09c10d9d-fbbb-4711-8911-1d04d523d18c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:05.603971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09c10d9d-fbbb-4711-8911-1d04d523d18c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:05.605153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09c10d9d-fbbb-4711-8911-1d04d523d18c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:05.606048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09c10d9d-fbbb-4711-8911-1d04d523d18c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:05.606857 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09c10d9d-fbbb-4711-8911-1d04d523d18c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:05.607664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09c10d9d-fbbb-4711-8911-1d04d523d18c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:05.699110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ac442772-ac1a-4011-b843-6ebc3e06f599 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:05.715497 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ac442772-ac1a-4011-b843-6ebc3e06f599 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1524 microversion: 2.1 time: 0.898821 Oct 04 21:25:05.719853 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2007/4032] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:04 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1524 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:05.738925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-18316ad3-ba89-42f9-a15f-05e7d776ece6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:05.742695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-18316ad3-ba89-42f9-a15f-05e7d776ece6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:05.752402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18316ad3-ba89-42f9-a15f-05e7d776ece6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:05.753041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18316ad3-ba89-42f9-a15f-05e7d776ece6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:05.753627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18316ad3-ba89-42f9-a15f-05e7d776ece6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:05.755136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18316ad3-ba89-42f9-a15f-05e7d776ece6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:05.755702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18316ad3-ba89-42f9-a15f-05e7d776ece6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:05.756484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18316ad3-ba89-42f9-a15f-05e7d776ece6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:05.809954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-09c10d9d-fbbb-4711-8911-1d04d523d18c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:05.828701 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-09c10d9d-fbbb-4711-8911-1d04d523d18c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1269 microversion: 2.1 time: 0.235458 Oct 04 21:25:05.828701 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2026/4033] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:05 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1269 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:05.838757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bb5a469c-c461-4bcf-a6a2-b001398d2b3b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:05.840387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bb5a469c-c461-4bcf-a6a2-b001398d2b3b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:05.855802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb5a469c-c461-4bcf-a6a2-b001398d2b3b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:05.856391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb5a469c-c461-4bcf-a6a2-b001398d2b3b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:05.856833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb5a469c-c461-4bcf-a6a2-b001398d2b3b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:05.857758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb5a469c-c461-4bcf-a6a2-b001398d2b3b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:05.858365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb5a469c-c461-4bcf-a6a2-b001398d2b3b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:05.858942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb5a469c-c461-4bcf-a6a2-b001398d2b3b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:06.706216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-18316ad3-ba89-42f9-a15f-05e7d776ece6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:06.713959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bb5a469c-c461-4bcf-a6a2-b001398d2b3b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:06.729112 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bb5a469c-c461-4bcf-a6a2-b001398d2b3b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 200 len: 1313 microversion: 2.1 time: 0.901231 Oct 04 21:25:06.734223 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2027/4034] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:05 2022] GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 1313 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:06.741389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-18316ad3-ba89-42f9-a15f-05e7d776ece6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:06.749544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ee659206-12f2-4406-a84e-8a9655152345 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:06.750077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-18316ad3-ba89-42f9-a15f-05e7d776ece6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:06.751822 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-18316ad3-ba89-42f9-a15f-05e7d776ece6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 2345 microversion: 2.32 time: 1.030565 Oct 04 21:25:06.752756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ee659206-12f2-4406-a84e-8a9655152345 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:06.753337 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2008/4035] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:05 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 2345 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:06.763390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee659206-12f2-4406-a84e-8a9655152345 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:06.766656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4a2e2ede-e306-4e81-bed8-14b6f41c18c1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:06.770563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4a2e2ede-e306-4e81-bed8-14b6f41c18c1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:06.770685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee659206-12f2-4406-a84e-8a9655152345 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:06.783528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee659206-12f2-4406-a84e-8a9655152345 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:06.786233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee659206-12f2-4406-a84e-8a9655152345 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:06.799269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee659206-12f2-4406-a84e-8a9655152345 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:06.799724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee659206-12f2-4406-a84e-8a9655152345 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:06.813453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a2e2ede-e306-4e81-bed8-14b6f41c18c1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:06.814006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a2e2ede-e306-4e81-bed8-14b6f41c18c1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:06.814469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a2e2ede-e306-4e81-bed8-14b6f41c18c1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:06.815226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a2e2ede-e306-4e81-bed8-14b6f41c18c1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:06.815696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a2e2ede-e306-4e81-bed8-14b6f41c18c1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:06.823728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a2e2ede-e306-4e81-bed8-14b6f41c18c1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:06.888920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:07.835208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ee659206-12f2-4406-a84e-8a9655152345 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:07.849507 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ee659206-12f2-4406-a84e-8a9655152345 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1315 microversion: 2.1 time: 1.110197 Oct 04 21:25:07.850776 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2028/4036] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:06 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1315 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:07.856870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8284c32f-f1b4-40ff-b319-e9489cf79c45 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:07.864997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8284c32f-f1b4-40ff-b319-e9489cf79c45 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:07.878893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8284c32f-f1b4-40ff-b319-e9489cf79c45 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:07.881748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8284c32f-f1b4-40ff-b319-e9489cf79c45 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:07.886582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8284c32f-f1b4-40ff-b319-e9489cf79c45 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:07.887575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8284c32f-f1b4-40ff-b319-e9489cf79c45 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:07.888243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8284c32f-f1b4-40ff-b319-e9489cf79c45 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:07.888838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8284c32f-f1b4-40ff-b319-e9489cf79c45 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:08.065173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4a2e2ede-e306-4e81-bed8-14b6f41c18c1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:08.076122 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4a2e2ede-e306-4e81-bed8-14b6f41c18c1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1524 microversion: 2.1 time: 1.320640 Oct 04 21:25:08.101849 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2009/4037] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:06 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1524 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:08.104297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8284c32f-f1b4-40ff-b319-e9489cf79c45 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:08.113541 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8284c32f-f1b4-40ff-b319-e9489cf79c45 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1275 microversion: 2.1 time: 0.261362 Oct 04 21:25:08.114359 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2029/4038] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:07 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1275 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:08.119599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a5b1bcdd-7758-473e-90ee-7352c5457456 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:08.120591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a5b1bcdd-7758-473e-90ee-7352c5457456 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:08.121266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-61112c41-f9bf-4d82-97fe-3cf8f22bb1c9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:08.121919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-61112c41-f9bf-4d82-97fe-3cf8f22bb1c9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:08.127613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5b1bcdd-7758-473e-90ee-7352c5457456 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:08.128438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5b1bcdd-7758-473e-90ee-7352c5457456 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:08.129155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5b1bcdd-7758-473e-90ee-7352c5457456 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:08.130177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5b1bcdd-7758-473e-90ee-7352c5457456 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:08.131181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5b1bcdd-7758-473e-90ee-7352c5457456 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:08.131827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5b1bcdd-7758-473e-90ee-7352c5457456 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:08.150063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61112c41-f9bf-4d82-97fe-3cf8f22bb1c9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:08.150634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61112c41-f9bf-4d82-97fe-3cf8f22bb1c9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:08.151098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61112c41-f9bf-4d82-97fe-3cf8f22bb1c9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:08.151980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61112c41-f9bf-4d82-97fe-3cf8f22bb1c9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:08.152619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61112c41-f9bf-4d82-97fe-3cf8f22bb1c9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:08.152868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61112c41-f9bf-4d82-97fe-3cf8f22bb1c9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:08.433496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a5b1bcdd-7758-473e-90ee-7352c5457456 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:08.437188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a5b1bcdd-7758-473e-90ee-7352c5457456 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:08.439876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a5b1bcdd-7758-473e-90ee-7352c5457456 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:08.442062 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a5b1bcdd-7758-473e-90ee-7352c5457456 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 2163 microversion: 2.32 time: 0.326410 Oct 04 21:25:08.443251 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2030/4039] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:08 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 2163 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:08.725792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-8225ffef-2033-42c3-a524-c5851509d649 req-c98b4200-2145-403a-bf6c-3e45f752da96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7b2ecc-1ade-4b25-afa0-abcab1c3def0", "name": "network-vif-deleted", "tag": "59687d68-2ca3-4874-9671-aaaec5a44a09"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:08.751773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8225ffef-2033-42c3-a524-c5851509d649 req-c98b4200-2145-403a-bf6c-3e45f752da96 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:08.756343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8225ffef-2033-42c3-a524-c5851509d649 req-c98b4200-2145-403a-bf6c-3e45f752da96 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:08.756343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8225ffef-2033-42c3-a524-c5851509d649 req-c98b4200-2145-403a-bf6c-3e45f752da96 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:08.783438 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-8225ffef-2033-42c3-a524-c5851509d649 req-c98b4200-2145-403a-bf6c-3e45f752da96 service nova] Creating event network-vif-deleted:59687d68-2ca3-4874-9671-aaaec5a44a09 for instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 on n-h2-860282-1 Oct 04 21:25:08.795853 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-8225ffef-2033-42c3-a524-c5851509d649 req-c98b4200-2145-403a-bf6c-3e45f752da96 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075452 Oct 04 21:25:08.796780 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2031/4040] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:25:08.806565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-61112c41-f9bf-4d82-97fe-3cf8f22bb1c9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:08.829861 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-61112c41-f9bf-4d82-97fe-3cf8f22bb1c9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 200 len: 1500 microversion: 2.1 time: 0.714564 Oct 04 21:25:08.845842 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2010/4041] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:08 2022] GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 1500 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:08.878332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-109fd6b7-5799-47d7-8bb2-23a84c574fe1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:08.878962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-109fd6b7-5799-47d7-8bb2-23a84c574fe1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:08.882297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:08.883315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a9865860-8456-4b80-9a9e-305a833c345f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:08.885458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a9865860-8456-4b80-9a9e-305a833c345f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:08.888274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-109fd6b7-5799-47d7-8bb2-23a84c574fe1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:08.893981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-109fd6b7-5799-47d7-8bb2-23a84c574fe1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:08.894629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-109fd6b7-5799-47d7-8bb2-23a84c574fe1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:08.895563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-109fd6b7-5799-47d7-8bb2-23a84c574fe1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:08.896184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-109fd6b7-5799-47d7-8bb2-23a84c574fe1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:08.906308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-109fd6b7-5799-47d7-8bb2-23a84c574fe1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:08.919716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9865860-8456-4b80-9a9e-305a833c345f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:08.920493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9865860-8456-4b80-9a9e-305a833c345f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:08.920949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9865860-8456-4b80-9a9e-305a833c345f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:08.943519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9865860-8456-4b80-9a9e-305a833c345f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:08.949990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9865860-8456-4b80-9a9e-305a833c345f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:08.950589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9865860-8456-4b80-9a9e-305a833c345f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:09.029533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:09.699615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-109fd6b7-5799-47d7-8bb2-23a84c574fe1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:09.708799 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-109fd6b7-5799-47d7-8bb2-23a84c574fe1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1315 microversion: 2.1 time: 0.836466 Oct 04 21:25:09.734185 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2011/4042] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:08 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1315 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:09.740976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f0c86549-75a6-4436-966f-7943521f74bc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:09.741827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f0c86549-75a6-4436-966f-7943521f74bc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:09.754633 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.network.security_group_api [None req-a9865860-8456-4b80-9a9e-305a833c345f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Removing security group ff5fb3eb-4e95-4b55-ba8f-ee39cc445941 from port 1224f342-58fd-46fe-8e48-5613db528544 Oct 04 21:25:09.755081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f0c86549-75a6-4436-966f-7943521f74bc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:09.755643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f0c86549-75a6-4436-966f-7943521f74bc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:09.757873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f0c86549-75a6-4436-966f-7943521f74bc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:09.758994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f0c86549-75a6-4436-966f-7943521f74bc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:09.760814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f0c86549-75a6-4436-966f-7943521f74bc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:09.763036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f0c86549-75a6-4436-966f-7943521f74bc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:10.112978 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f0c86549-75a6-4436-966f-7943521f74bc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:10.124210 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f0c86549-75a6-4436-966f-7943521f74bc tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1524 microversion: 2.1 time: 0.388222 Oct 04 21:25:10.124792 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2012/4043] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:09 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1524 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:10.137526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d8f0852c-165e-4f42-bd5e-fdad3805919e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:10.137526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d8f0852c-165e-4f42-bd5e-fdad3805919e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:10.161746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8f0852c-165e-4f42-bd5e-fdad3805919e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:10.165185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8f0852c-165e-4f42-bd5e-fdad3805919e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:10.165185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8f0852c-165e-4f42-bd5e-fdad3805919e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:10.165185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8f0852c-165e-4f42-bd5e-fdad3805919e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:10.165185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8f0852c-165e-4f42-bd5e-fdad3805919e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:10.168771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8f0852c-165e-4f42-bd5e-fdad3805919e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:11.110064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d8f0852c-165e-4f42-bd5e-fdad3805919e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:11.124391 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d8f0852c-165e-4f42-bd5e-fdad3805919e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1317 microversion: 2.1 time: 0.993708 Oct 04 21:25:11.125001 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2013/4044] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:10 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1317 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:11.141630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-70d3377c-1fbe-41dd-92f9-50c8db5318df req-24566e3f-a0ae-45cb-a03f-7c074ab10a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f7b402-4b3a-4a39-8686-9e9b36f9e040", "name": "network-vif-plugged", "status": "completed", "tag": "c883d4ee-a39d-4507-8568-f4e4fd4c7cd3"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:11.160852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-70d3377c-1fbe-41dd-92f9-50c8db5318df req-24566e3f-a0ae-45cb-a03f-7c074ab10a14 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:11.161657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-70d3377c-1fbe-41dd-92f9-50c8db5318df req-24566e3f-a0ae-45cb-a03f-7c074ab10a14 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:11.164563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-70d3377c-1fbe-41dd-92f9-50c8db5318df req-24566e3f-a0ae-45cb-a03f-7c074ab10a14 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:11.189041 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-70d3377c-1fbe-41dd-92f9-50c8db5318df req-24566e3f-a0ae-45cb-a03f-7c074ab10a14 service nova] Creating event network-vif-plugged:c883d4ee-a39d-4507-8568-f4e4fd4c7cd3 for instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 on n-h1-860282-1 Oct 04 21:25:11.203634 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-70d3377c-1fbe-41dd-92f9-50c8db5318df req-24566e3f-a0ae-45cb-a03f-7c074ab10a14 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073703 Oct 04 21:25:11.204394 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2014/4045] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:11.217005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-29d1bc89-003d-40d9-a48d-26d5419812a6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:11.217750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-29d1bc89-003d-40d9-a48d-26d5419812a6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:11.239685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29d1bc89-003d-40d9-a48d-26d5419812a6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:11.239685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29d1bc89-003d-40d9-a48d-26d5419812a6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:11.239685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29d1bc89-003d-40d9-a48d-26d5419812a6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:11.239685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29d1bc89-003d-40d9-a48d-26d5419812a6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:11.239685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29d1bc89-003d-40d9-a48d-26d5419812a6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:11.239685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29d1bc89-003d-40d9-a48d-26d5419812a6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:11.470797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-29d1bc89-003d-40d9-a48d-26d5419812a6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:11.506443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-29d1bc89-003d-40d9-a48d-26d5419812a6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:11.506443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-29d1bc89-003d-40d9-a48d-26d5419812a6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:11.506443 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-29d1bc89-003d-40d9-a48d-26d5419812a6 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1875 microversion: 2.32 time: 0.289921 Oct 04 21:25:11.507854 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2015/4046] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:11 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1875 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:11.527808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b1ebf3b2-de5a-4bf6-a561-f4ef129f53ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:11.529839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b1ebf3b2-de5a-4bf6-a561-f4ef129f53ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:11.558367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1ebf3b2-de5a-4bf6-a561-f4ef129f53ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:11.562121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1ebf3b2-de5a-4bf6-a561-f4ef129f53ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:11.562600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1ebf3b2-de5a-4bf6-a561-f4ef129f53ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:11.563352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1ebf3b2-de5a-4bf6-a561-f4ef129f53ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:11.565831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1ebf3b2-de5a-4bf6-a561-f4ef129f53ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:11.566547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1ebf3b2-de5a-4bf6-a561-f4ef129f53ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:11.939005 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a9865860-8456-4b80-9a9e-305a833c345f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b/action" status: 202 len: 0 microversion: 2.1 time: 3.085962 Oct 04 21:25:11.939644 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2032/4047] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:25:08 2022] POST /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b/action => generated 0 bytes in 3088 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:25:11.944765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-05e2a27f-179f-4dab-a15a-74c865c298ea tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:11.945403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-05e2a27f-179f-4dab-a15a-74c865c298ea tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:11.974240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05e2a27f-179f-4dab-a15a-74c865c298ea tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:11.974773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05e2a27f-179f-4dab-a15a-74c865c298ea tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:11.975217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05e2a27f-179f-4dab-a15a-74c865c298ea tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:11.975971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05e2a27f-179f-4dab-a15a-74c865c298ea tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:11.976426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05e2a27f-179f-4dab-a15a-74c865c298ea tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:11.976896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05e2a27f-179f-4dab-a15a-74c865c298ea tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:12.121370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b1ebf3b2-de5a-4bf6-a561-f4ef129f53ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:12.135746 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b1ebf3b2-de5a-4bf6-a561-f4ef129f53ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1315 microversion: 2.1 time: 0.627393 Oct 04 21:25:12.151343 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2016/4048] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:11 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:12.186272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cd82b6f0-66a5-4684-aac1-3068a037d898 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:12.187260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cd82b6f0-66a5-4684-aac1-3068a037d898 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:12.198724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd82b6f0-66a5-4684-aac1-3068a037d898 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:12.199229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd82b6f0-66a5-4684-aac1-3068a037d898 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:12.199837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd82b6f0-66a5-4684-aac1-3068a037d898 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:12.200561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd82b6f0-66a5-4684-aac1-3068a037d898 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:12.201178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd82b6f0-66a5-4684-aac1-3068a037d898 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:12.201643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd82b6f0-66a5-4684-aac1-3068a037d898 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:12.450693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:12.548752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cd82b6f0-66a5-4684-aac1-3068a037d898 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:12.562289 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cd82b6f0-66a5-4684-aac1-3068a037d898 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 200 len: 1458 microversion: 2.1 time: 0.409379 Oct 04 21:25:12.563246 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2017/4049] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:12 2022] GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 1458 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:12.578948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-5b1fda1f-b473-4af7-bbe6-7395702b2d1a req-b9df4cc4-3e7f-41a1-bf49-2df16c1355d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6daf7e14-2860-48b1-8065-bd3f25f5730b", "tag": "1224f342-58fd-46fe-8e48-5613db528544"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:12.605113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5b1fda1f-b473-4af7-bbe6-7395702b2d1a req-b9df4cc4-3e7f-41a1-bf49-2df16c1355d2 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:12.605888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5b1fda1f-b473-4af7-bbe6-7395702b2d1a req-b9df4cc4-3e7f-41a1-bf49-2df16c1355d2 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:12.606587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5b1fda1f-b473-4af7-bbe6-7395702b2d1a req-b9df4cc4-3e7f-41a1-bf49-2df16c1355d2 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:12.625340 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-5b1fda1f-b473-4af7-bbe6-7395702b2d1a req-b9df4cc4-3e7f-41a1-bf49-2df16c1355d2 service nova] Creating event network-changed:1224f342-58fd-46fe-8e48-5613db528544 for instance 6daf7e14-2860-48b1-8065-bd3f25f5730b on n-h1-860282-1 Oct 04 21:25:12.632440 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-5b1fda1f-b473-4af7-bbe6-7395702b2d1a req-b9df4cc4-3e7f-41a1-bf49-2df16c1355d2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067789 Oct 04 21:25:12.636045 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2018/4050] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:12.642255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-214e3a8b-e95d-45ee-994d-0bd6e92c00be tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:12.643435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-214e3a8b-e95d-45ee-994d-0bd6e92c00be tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:12.653157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-214e3a8b-e95d-45ee-994d-0bd6e92c00be tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:12.657043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-214e3a8b-e95d-45ee-994d-0bd6e92c00be tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:12.657043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-214e3a8b-e95d-45ee-994d-0bd6e92c00be tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:12.657043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-214e3a8b-e95d-45ee-994d-0bd6e92c00be tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:12.657043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-214e3a8b-e95d-45ee-994d-0bd6e92c00be tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:12.657043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-214e3a8b-e95d-45ee-994d-0bd6e92c00be tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:12.703916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-05e2a27f-179f-4dab-a15a-74c865c298ea tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:12.715269 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-05e2a27f-179f-4dab-a15a-74c865c298ea tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1524 microversion: 2.1 time: 0.772941 Oct 04 21:25:12.729451 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2033/4051] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:11 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1524 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:12.729451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e233a915-0cf8-4145-89cb-72000d90a5d4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:12.729451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e233a915-0cf8-4145-89cb-72000d90a5d4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:12.741137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e233a915-0cf8-4145-89cb-72000d90a5d4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:12.744403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e233a915-0cf8-4145-89cb-72000d90a5d4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:12.745568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e233a915-0cf8-4145-89cb-72000d90a5d4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:12.747386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e233a915-0cf8-4145-89cb-72000d90a5d4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:12.749778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e233a915-0cf8-4145-89cb-72000d90a5d4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:12.751392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e233a915-0cf8-4145-89cb-72000d90a5d4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:12.922642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e233a915-0cf8-4145-89cb-72000d90a5d4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:12.935784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e233a915-0cf8-4145-89cb-72000d90a5d4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:12.939687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e233a915-0cf8-4145-89cb-72000d90a5d4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:12.942774 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e233a915-0cf8-4145-89cb-72000d90a5d4 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1875 microversion: 2.32 time: 0.225354 Oct 04 21:25:12.947598 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2034/4052] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:12 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1875 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:12.957278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-33df5bff-018d-478d-9fdc-c2366d74882d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:12.958319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-33df5bff-018d-478d-9fdc-c2366d74882d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:12.971938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33df5bff-018d-478d-9fdc-c2366d74882d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:12.974746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33df5bff-018d-478d-9fdc-c2366d74882d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:12.985698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33df5bff-018d-478d-9fdc-c2366d74882d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:12.993375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33df5bff-018d-478d-9fdc-c2366d74882d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:12.993375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33df5bff-018d-478d-9fdc-c2366d74882d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:12.993375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33df5bff-018d-478d-9fdc-c2366d74882d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:13.113540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-214e3a8b-e95d-45ee-994d-0bd6e92c00be tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:13.121585 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-214e3a8b-e95d-45ee-994d-0bd6e92c00be tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1317 microversion: 2.1 time: 0.484078 Oct 04 21:25:13.123294 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2019/4053] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:12 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1317 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:13.166415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-17578113-6b52-417b-b638-a0b169b95348 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:13.168195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-17578113-6b52-417b-b638-a0b169b95348 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:13.181177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17578113-6b52-417b-b638-a0b169b95348 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:13.182776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17578113-6b52-417b-b638-a0b169b95348 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:13.184148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17578113-6b52-417b-b638-a0b169b95348 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:13.188794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17578113-6b52-417b-b638-a0b169b95348 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:13.190625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17578113-6b52-417b-b638-a0b169b95348 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:13.191313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17578113-6b52-417b-b638-a0b169b95348 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:13.472979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-33df5bff-018d-478d-9fdc-c2366d74882d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:13.482910 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-33df5bff-018d-478d-9fdc-c2366d74882d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.533978 Oct 04 21:25:13.483795 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2035/4054] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:12 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:13.511240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1b324ef3-f2ac-4e23-9888-32882cd997e1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:13.512669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1b324ef3-f2ac-4e23-9888-32882cd997e1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:13.520837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1b324ef3-f2ac-4e23-9888-32882cd997e1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:13.521689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1b324ef3-f2ac-4e23-9888-32882cd997e1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:13.524545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1b324ef3-f2ac-4e23-9888-32882cd997e1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:13.524545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1b324ef3-f2ac-4e23-9888-32882cd997e1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:13.524545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1b324ef3-f2ac-4e23-9888-32882cd997e1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:13.525155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1b324ef3-f2ac-4e23-9888-32882cd997e1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:13.735511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-17578113-6b52-417b-b638-a0b169b95348 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:13.744389 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-17578113-6b52-417b-b638-a0b169b95348 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1315 microversion: 2.1 time: 0.583490 Oct 04 21:25:13.744978 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2020/4055] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:13 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:25:13.772973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2fad92f2-0d0e-4b77-9662-8d3d2ba79fce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:13.773680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2fad92f2-0d0e-4b77-9662-8d3d2ba79fce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:13.792288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fad92f2-0d0e-4b77-9662-8d3d2ba79fce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:13.792720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fad92f2-0d0e-4b77-9662-8d3d2ba79fce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:13.793160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fad92f2-0d0e-4b77-9662-8d3d2ba79fce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:13.793896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fad92f2-0d0e-4b77-9662-8d3d2ba79fce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:13.794363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fad92f2-0d0e-4b77-9662-8d3d2ba79fce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:13.795048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fad92f2-0d0e-4b77-9662-8d3d2ba79fce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:13.964787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:14.014917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1b324ef3-f2ac-4e23-9888-32882cd997e1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:14.024843 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1b324ef3-f2ac-4e23-9888-32882cd997e1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.519422 Oct 04 21:25:14.030085 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2036/4056] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:13 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:14.037693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d0991999-0289-46f9-a48b-ec3cb3cd9ba2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:14.040796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d0991999-0289-46f9-a48b-ec3cb3cd9ba2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:14.052640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0991999-0289-46f9-a48b-ec3cb3cd9ba2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:14.053204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0991999-0289-46f9-a48b-ec3cb3cd9ba2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:14.053625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0991999-0289-46f9-a48b-ec3cb3cd9ba2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:14.054325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0991999-0289-46f9-a48b-ec3cb3cd9ba2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:14.054782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0991999-0289-46f9-a48b-ec3cb3cd9ba2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:14.055809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0991999-0289-46f9-a48b-ec3cb3cd9ba2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:14.216960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d0991999-0289-46f9-a48b-ec3cb3cd9ba2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:14.237066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d0991999-0289-46f9-a48b-ec3cb3cd9ba2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:14.238544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d0991999-0289-46f9-a48b-ec3cb3cd9ba2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:14.239765 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d0991999-0289-46f9-a48b-ec3cb3cd9ba2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1875 microversion: 2.32 time: 0.208637 Oct 04 21:25:14.240654 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2037/4057] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:14 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1875 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:14.245385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8fccc726-c76a-49c0-906a-0b6f229013a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:14.250535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8fccc726-c76a-49c0-906a-0b6f229013a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:14.259921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fccc726-c76a-49c0-906a-0b6f229013a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:14.260426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fccc726-c76a-49c0-906a-0b6f229013a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:14.260866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fccc726-c76a-49c0-906a-0b6f229013a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:14.265718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fccc726-c76a-49c0-906a-0b6f229013a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:14.266271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fccc726-c76a-49c0-906a-0b6f229013a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:14.266731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fccc726-c76a-49c0-906a-0b6f229013a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:14.429508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2fad92f2-0d0e-4b77-9662-8d3d2ba79fce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:14.456982 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2fad92f2-0d0e-4b77-9662-8d3d2ba79fce tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1524 microversion: 2.1 time: 0.686282 Oct 04 21:25:14.459092 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2021/4058] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:13 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1524 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:14.478661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5def1c19-6418-4702-beb7-aa3b6506c789 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:14.487055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5def1c19-6418-4702-beb7-aa3b6506c789 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:14.495388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5def1c19-6418-4702-beb7-aa3b6506c789 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:14.496127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5def1c19-6418-4702-beb7-aa3b6506c789 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:14.496730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5def1c19-6418-4702-beb7-aa3b6506c789 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:14.497866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5def1c19-6418-4702-beb7-aa3b6506c789 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:14.498343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5def1c19-6418-4702-beb7-aa3b6506c789 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:14.499465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5def1c19-6418-4702-beb7-aa3b6506c789 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:14.778171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8fccc726-c76a-49c0-906a-0b6f229013a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:14.815797 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8fccc726-c76a-49c0-906a-0b6f229013a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.574025 Oct 04 21:25:14.822223 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2038/4059] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:14 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:14.832762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-584e0f4d-d422-4f74-a97f-74a0040383ae req-1b8534c7-d764-4e96-b303-f2449ea9c17a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbfb9eae-ce66-48c5-b7ca-8032c3596fad", "tag": "d5e1110b-c910-4bae-8abe-73bf34266071"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:14.868612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5def1c19-6418-4702-beb7-aa3b6506c789 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:14.877493 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5def1c19-6418-4702-beb7-aa3b6506c789 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1317 microversion: 2.1 time: 0.417116 Oct 04 21:25:14.878348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-584e0f4d-d422-4f74-a97f-74a0040383ae req-1b8534c7-d764-4e96-b303-f2449ea9c17a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:14.879169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-584e0f4d-d422-4f74-a97f-74a0040383ae req-1b8534c7-d764-4e96-b303-f2449ea9c17a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:14.879909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-584e0f4d-d422-4f74-a97f-74a0040383ae req-1b8534c7-d764-4e96-b303-f2449ea9c17a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:14.881184 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2022/4060] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:14 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1317 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:14.895162 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-584e0f4d-d422-4f74-a97f-74a0040383ae req-1b8534c7-d764-4e96-b303-f2449ea9c17a service nova] Creating event network-changed:d5e1110b-c910-4bae-8abe-73bf34266071 for instance bbfb9eae-ce66-48c5-b7ca-8032c3596fad on n-h2-860282-1 Oct 04 21:25:14.902581 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-584e0f4d-d422-4f74-a97f-74a0040383ae req-1b8534c7-d764-4e96-b303-f2449ea9c17a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077901 Oct 04 21:25:14.904181 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2039/4061] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:14.911701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fc65812a-2bb8-4477-b161-f8911ee62366 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:14.912710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fc65812a-2bb8-4477-b161-f8911ee62366 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:14.915931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5843ceab-0427-42a9-a247-ab6ef9454edd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:14.922741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5843ceab-0427-42a9-a247-ab6ef9454edd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:14.923337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc65812a-2bb8-4477-b161-f8911ee62366 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:14.923951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc65812a-2bb8-4477-b161-f8911ee62366 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:14.924495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc65812a-2bb8-4477-b161-f8911ee62366 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:14.925490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc65812a-2bb8-4477-b161-f8911ee62366 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:14.926174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc65812a-2bb8-4477-b161-f8911ee62366 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:14.926873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc65812a-2bb8-4477-b161-f8911ee62366 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:14.943147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5843ceab-0427-42a9-a247-ab6ef9454edd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:14.943667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5843ceab-0427-42a9-a247-ab6ef9454edd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:14.946674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5843ceab-0427-42a9-a247-ab6ef9454edd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:14.951862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5843ceab-0427-42a9-a247-ab6ef9454edd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:14.955073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5843ceab-0427-42a9-a247-ab6ef9454edd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:14.956399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5843ceab-0427-42a9-a247-ab6ef9454edd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:15.277152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fc65812a-2bb8-4477-b161-f8911ee62366 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:15.285963 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fc65812a-2bb8-4477-b161-f8911ee62366 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.379837 Oct 04 21:25:15.286559 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2040/4062] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:14 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:15.328808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2b7063b0-1d1e-4d3a-98ed-7b57657ae9cb tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:15.333455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2b7063b0-1d1e-4d3a-98ed-7b57657ae9cb tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:15.336319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5843ceab-0427-42a9-a247-ab6ef9454edd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:15.351408 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5843ceab-0427-42a9-a247-ab6ef9454edd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1503 microversion: 2.1 time: 0.465030 Oct 04 21:25:15.353878 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2023/4063] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:14 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1503 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:15.361551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b7063b0-1d1e-4d3a-98ed-7b57657ae9cb tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:15.366523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b7063b0-1d1e-4d3a-98ed-7b57657ae9cb tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:15.371603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b7063b0-1d1e-4d3a-98ed-7b57657ae9cb tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:15.373204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b7063b0-1d1e-4d3a-98ed-7b57657ae9cb tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:15.374898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b7063b0-1d1e-4d3a-98ed-7b57657ae9cb tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:15.375369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b7063b0-1d1e-4d3a-98ed-7b57657ae9cb tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:15.389052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ce3649d8-e737-4dca-baea-f656db7da90a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:15.390604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ce3649d8-e737-4dca-baea-f656db7da90a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:15.416593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce3649d8-e737-4dca-baea-f656db7da90a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:15.418036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce3649d8-e737-4dca-baea-f656db7da90a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:15.420743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce3649d8-e737-4dca-baea-f656db7da90a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:15.422359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce3649d8-e737-4dca-baea-f656db7da90a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:15.425409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce3649d8-e737-4dca-baea-f656db7da90a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:15.426989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce3649d8-e737-4dca-baea-f656db7da90a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:15.495595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-ce3649d8-e737-4dca-baea-f656db7da90a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lazy-loading 'flavor' on Instance uuid 39f7b402-4b3a-4a39-8686-9e9b36f9e040 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:25:15.602044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2b7063b0-1d1e-4d3a-98ed-7b57657ae9cb tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:15.615718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2b7063b0-1d1e-4d3a-98ed-7b57657ae9cb tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:15.620420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2b7063b0-1d1e-4d3a-98ed-7b57657ae9cb tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:15.622585 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2b7063b0-1d1e-4d3a-98ed-7b57657ae9cb tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1875 microversion: 2.32 time: 0.334219 Oct 04 21:25:15.624684 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2041/4064] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:15 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1875 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:15.630272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-631191de-8629-4947-99a5-dea5eb1f0722 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-475280656", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "734a8a85-50ab-4efa-9474-a014f1074a74"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:15.708463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-631191de-8629-4947-99a5-dea5eb1f0722 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] validate_networks() for [('734a8a85-50ab-4efa-9474-a014f1074a74', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:25:16.152718 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ce3649d8-e737-4dca-baea-f656db7da90a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "POST /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040/action" status: 202 len: 0 microversion: 2.1 time: 0.778219 Oct 04 21:25:16.154208 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2024/4065] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:25:15 2022] POST /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040/action => generated 0 bytes in 781 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:25:16.161022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f9363dc5-0140-4645-8b84-24f643918f0a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:16.161916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f9363dc5-0140-4645-8b84-24f643918f0a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:16.172808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9363dc5-0140-4645-8b84-24f643918f0a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:16.173658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9363dc5-0140-4645-8b84-24f643918f0a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:16.174353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9363dc5-0140-4645-8b84-24f643918f0a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:16.175349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9363dc5-0140-4645-8b84-24f643918f0a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:16.176031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9363dc5-0140-4645-8b84-24f643918f0a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:16.176684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9363dc5-0140-4645-8b84-24f643918f0a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:16.194641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:16.660909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-631191de-8629-4947-99a5-dea5eb1f0722 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:25:16.661443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-631191de-8629-4947-99a5-dea5eb1f0722 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:25:16.661849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-631191de-8629-4947-99a5-dea5eb1f0722 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:25:16.662279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-631191de-8629-4947-99a5-dea5eb1f0722 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:25:16.662846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-631191de-8629-4947-99a5-dea5eb1f0722 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:25:16.677732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-631191de-8629-4947-99a5-dea5eb1f0722 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:16.681260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-631191de-8629-4947-99a5-dea5eb1f0722 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:16.681260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-631191de-8629-4947-99a5-dea5eb1f0722 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:16.681260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-631191de-8629-4947-99a5-dea5eb1f0722 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:16.681260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-631191de-8629-4947-99a5-dea5eb1f0722 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:16.681260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-631191de-8629-4947-99a5-dea5eb1f0722 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:16.693335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f9363dc5-0140-4645-8b84-24f643918f0a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:16.718073 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f9363dc5-0140-4645-8b84-24f643918f0a tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1524 microversion: 2.1 time: 0.562374 Oct 04 21:25:16.720212 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2025/4066] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:16 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1524 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:16.727987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-80b957cc-b462-4673-897e-bb4ae45be5e1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:16.729265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-80b957cc-b462-4673-897e-bb4ae45be5e1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:16.730010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-631191de-8629-4947-99a5-dea5eb1f0722 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Getting quotas for project 0f62474e9d474aa28ac754b712e68652. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:25:16.736123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-631191de-8629-4947-99a5-dea5eb1f0722 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Getting quotas for user 8ef7d2991dce46278486e0ee963d4cf3 and project 0f62474e9d474aa28ac754b712e68652. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:25:16.737164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80b957cc-b462-4673-897e-bb4ae45be5e1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:16.739393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80b957cc-b462-4673-897e-bb4ae45be5e1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:16.739393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80b957cc-b462-4673-897e-bb4ae45be5e1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:16.739393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80b957cc-b462-4673-897e-bb4ae45be5e1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:16.740271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80b957cc-b462-4673-897e-bb4ae45be5e1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:16.740788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80b957cc-b462-4673-897e-bb4ae45be5e1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:16.755349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-631191de-8629-4947-99a5-dea5eb1f0722 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:25:16.757741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-631191de-8629-4947-99a5-dea5eb1f0722 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:25:16.966052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-80b957cc-b462-4673-897e-bb4ae45be5e1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:16.976189 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-80b957cc-b462-4673-897e-bb4ae45be5e1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1317 microversion: 2.1 time: 0.253429 Oct 04 21:25:16.989858 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2026/4067] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:16 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:16.989858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2cff6386-5864-483d-adda-ad0710b678b0 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:16.989858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2cff6386-5864-483d-adda-ad0710b678b0 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:16.990467 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-631191de-8629-4947-99a5-dea5eb1f0722 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.363858 Oct 04 21:25:17.003771 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2042/4068] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:25:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:25:17.006744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2cff6386-5864-483d-adda-ad0710b678b0 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:17.009618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2cff6386-5864-483d-adda-ad0710b678b0 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:17.010407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2cff6386-5864-483d-adda-ad0710b678b0 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:17.011492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2cff6386-5864-483d-adda-ad0710b678b0 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:17.012265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2cff6386-5864-483d-adda-ad0710b678b0 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:17.012978 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2cff6386-5864-483d-adda-ad0710b678b0 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:17.043314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-619f8011-3042-4b7c-95a4-ce4c4ca207f7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:17.048340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-619f8011-3042-4b7c-95a4-ce4c4ca207f7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:17.079107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-619f8011-3042-4b7c-95a4-ce4c4ca207f7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:17.083174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-619f8011-3042-4b7c-95a4-ce4c4ca207f7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:17.083901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-619f8011-3042-4b7c-95a4-ce4c4ca207f7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:17.084848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-619f8011-3042-4b7c-95a4-ce4c4ca207f7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:17.093192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-619f8011-3042-4b7c-95a4-ce4c4ca207f7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:17.094005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-619f8011-3042-4b7c-95a4-ce4c4ca207f7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:17.335824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-619f8011-3042-4b7c-95a4-ce4c4ca207f7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:17.356204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-619f8011-3042-4b7c-95a4-ce4c4ca207f7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:17.358726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-619f8011-3042-4b7c-95a4-ce4c4ca207f7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:17.360309 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-619f8011-3042-4b7c-95a4-ce4c4ca207f7 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1875 microversion: 2.32 time: 0.331883 Oct 04 21:25:17.361448 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2043/4069] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:17 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1875 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:17.376342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-11f41d99-339c-4b8b-b3a5-c3d09d681493 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:17.377265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-11f41d99-339c-4b8b-b3a5-c3d09d681493 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:17.561938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-11f41d99-339c-4b8b-b3a5-c3d09d681493 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:17.569225 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-11f41d99-339c-4b8b-b3a5-c3d09d681493 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1214 microversion: 2.1 time: 0.206503 Oct 04 21:25:17.577202 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2044/4070] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:17 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1214 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:17.920950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2cff6386-5864-483d-adda-ad0710b678b0 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:17.922869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d455b784-e5d1-4b37-a1fb-4710ddeb6670 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:17.922869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d455b784-e5d1-4b37-a1fb-4710ddeb6670 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:17.922869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d455b784-e5d1-4b37-a1fb-4710ddeb6670 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:17.925591 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2cff6386-5864-483d-adda-ad0710b678b0 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1509 microversion: 2.1 time: 0.777440 Oct 04 21:25:17.925756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d455b784-e5d1-4b37-a1fb-4710ddeb6670 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:17.925927 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2027/4071] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:16 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1509 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:17.926081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d455b784-e5d1-4b37-a1fb-4710ddeb6670 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:17.926081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d455b784-e5d1-4b37-a1fb-4710ddeb6670 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:17.926081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d455b784-e5d1-4b37-a1fb-4710ddeb6670 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:17.926081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d455b784-e5d1-4b37-a1fb-4710ddeb6670 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:18.006547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-28b4f64a-9ff5-4652-adc5-df8c8ebdf1f5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:18.007337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-28b4f64a-9ff5-4652-adc5-df8c8ebdf1f5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:18.024706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28b4f64a-9ff5-4652-adc5-df8c8ebdf1f5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:18.025793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28b4f64a-9ff5-4652-adc5-df8c8ebdf1f5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:18.027190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28b4f64a-9ff5-4652-adc5-df8c8ebdf1f5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:18.028203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28b4f64a-9ff5-4652-adc5-df8c8ebdf1f5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:18.030410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28b4f64a-9ff5-4652-adc5-df8c8ebdf1f5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:18.031096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28b4f64a-9ff5-4652-adc5-df8c8ebdf1f5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:18.074959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d455b784-e5d1-4b37-a1fb-4710ddeb6670 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:18.088382 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d455b784-e5d1-4b37-a1fb-4710ddeb6670 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1524 microversion: 2.1 time: 0.345222 Oct 04 21:25:18.089148 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2045/4072] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:17 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1524 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:25:18.319484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-28b4f64a-9ff5-4652-adc5-df8c8ebdf1f5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:18.334371 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-28b4f64a-9ff5-4652-adc5-df8c8ebdf1f5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1317 microversion: 2.1 time: 0.331829 Oct 04 21:25:18.345608 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2028/4073] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:18 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:25:18.391167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a7056503-6b85-4fbe-9d60-a1edc5e91a40 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:18.391794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a7056503-6b85-4fbe-9d60-a1edc5e91a40 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:18.399114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7056503-6b85-4fbe-9d60-a1edc5e91a40 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:18.399615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7056503-6b85-4fbe-9d60-a1edc5e91a40 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:18.400052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7056503-6b85-4fbe-9d60-a1edc5e91a40 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:18.400933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7056503-6b85-4fbe-9d60-a1edc5e91a40 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:18.401435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7056503-6b85-4fbe-9d60-a1edc5e91a40 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:18.401880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7056503-6b85-4fbe-9d60-a1edc5e91a40 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:18.470100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a7056503-6b85-4fbe-9d60-a1edc5e91a40 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:18.482822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a7056503-6b85-4fbe-9d60-a1edc5e91a40 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:18.484317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a7056503-6b85-4fbe-9d60-a1edc5e91a40 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:18.485573 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a7056503-6b85-4fbe-9d60-a1edc5e91a40 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1875 microversion: 2.32 time: 0.098345 Oct 04 21:25:18.501523 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2046/4074] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:18 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1875 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:18.597331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7368160e-be67-43af-aae3-e9b42eba7042 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:18.598942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7368160e-be67-43af-aae3-e9b42eba7042 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:18.662763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7368160e-be67-43af-aae3-e9b42eba7042 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:18.687320 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7368160e-be67-43af-aae3-e9b42eba7042 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1214 microversion: 2.1 time: 0.095517 Oct 04 21:25:18.689608 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2029/4075] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:18 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:18.944984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b5cbc79b-3839-47ac-96c7-d9ef9166bfde tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:18.945807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b5cbc79b-3839-47ac-96c7-d9ef9166bfde tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:18.951769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5cbc79b-3839-47ac-96c7-d9ef9166bfde tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:18.952242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5cbc79b-3839-47ac-96c7-d9ef9166bfde tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:18.952674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5cbc79b-3839-47ac-96c7-d9ef9166bfde tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:18.953370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5cbc79b-3839-47ac-96c7-d9ef9166bfde tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:18.956783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5cbc79b-3839-47ac-96c7-d9ef9166bfde tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:18.956783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b5cbc79b-3839-47ac-96c7-d9ef9166bfde tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:19.118011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c83efada-1cd1-4243-9984-0a5326a06e1e tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:19.120246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c83efada-1cd1-4243-9984-0a5326a06e1e tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:19.144563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c83efada-1cd1-4243-9984-0a5326a06e1e tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:19.151137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c83efada-1cd1-4243-9984-0a5326a06e1e tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:19.151137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c83efada-1cd1-4243-9984-0a5326a06e1e tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:19.151137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c83efada-1cd1-4243-9984-0a5326a06e1e tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:19.151137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c83efada-1cd1-4243-9984-0a5326a06e1e tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:19.151137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c83efada-1cd1-4243-9984-0a5326a06e1e tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:19.333220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b5cbc79b-3839-47ac-96c7-d9ef9166bfde tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:19.345912 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b5cbc79b-3839-47ac-96c7-d9ef9166bfde tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1509 microversion: 2.1 time: 0.404835 Oct 04 21:25:19.347107 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2047/4076] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:18 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1509 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:25:19.372196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-752d9e05-65fe-43d0-bc27-1041d0cc2868 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:19.373072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-752d9e05-65fe-43d0-bc27-1041d0cc2868 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:19.380145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-752d9e05-65fe-43d0-bc27-1041d0cc2868 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:19.381082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-752d9e05-65fe-43d0-bc27-1041d0cc2868 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:19.381674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-752d9e05-65fe-43d0-bc27-1041d0cc2868 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:19.382614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-752d9e05-65fe-43d0-bc27-1041d0cc2868 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:19.383878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-752d9e05-65fe-43d0-bc27-1041d0cc2868 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:19.384565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-752d9e05-65fe-43d0-bc27-1041d0cc2868 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:19.667810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c83efada-1cd1-4243-9984-0a5326a06e1e tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:19.676958 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c83efada-1cd1-4243-9984-0a5326a06e1e tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1524 microversion: 2.1 time: 0.567518 Oct 04 21:25:19.677567 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2030/4077] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:19 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1524 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:25:19.693758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-59ce3969-7a11-404f-a639-aa9e2c690f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:19.694960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-59ce3969-7a11-404f-a639-aa9e2c690f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:19.708998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59ce3969-7a11-404f-a639-aa9e2c690f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:19.709850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59ce3969-7a11-404f-a639-aa9e2c690f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:19.712910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59ce3969-7a11-404f-a639-aa9e2c690f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:19.715208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59ce3969-7a11-404f-a639-aa9e2c690f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:19.715944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59ce3969-7a11-404f-a639-aa9e2c690f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:19.716382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-752d9e05-65fe-43d0-bc27-1041d0cc2868 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:19.719043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59ce3969-7a11-404f-a639-aa9e2c690f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:19.738114 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-752d9e05-65fe-43d0-bc27-1041d0cc2868 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1317 microversion: 2.1 time: 0.376021 Oct 04 21:25:19.738751 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2048/4078] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:19 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:19.778469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4307e50c-a54e-4d2a-bfaf-c4704557e1bb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:19.779193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4307e50c-a54e-4d2a-bfaf-c4704557e1bb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:19.781301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:19.796799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4307e50c-a54e-4d2a-bfaf-c4704557e1bb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:19.799891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4307e50c-a54e-4d2a-bfaf-c4704557e1bb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:19.799891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4307e50c-a54e-4d2a-bfaf-c4704557e1bb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:19.799891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4307e50c-a54e-4d2a-bfaf-c4704557e1bb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:19.799891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4307e50c-a54e-4d2a-bfaf-c4704557e1bb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:19.799891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4307e50c-a54e-4d2a-bfaf-c4704557e1bb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:19.853554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-59ce3969-7a11-404f-a639-aa9e2c690f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:19.871550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-59ce3969-7a11-404f-a639-aa9e2c690f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:19.875819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-59ce3969-7a11-404f-a639-aa9e2c690f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:19.877324 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-59ce3969-7a11-404f-a639-aa9e2c690f93 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1875 microversion: 2.32 time: 0.193735 Oct 04 21:25:19.881777 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2031/4079] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:19 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1875 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:19.906268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4307e50c-a54e-4d2a-bfaf-c4704557e1bb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:19.916712 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4307e50c-a54e-4d2a-bfaf-c4704557e1bb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1266 microversion: 2.1 time: 0.154668 Oct 04 21:25:19.917307 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2049/4080] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:19 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:20.376177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bf0f9e83-978d-4b4d-b0e8-a5fc64688a13 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:20.383231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bf0f9e83-978d-4b4d-b0e8-a5fc64688a13 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:20.389374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bf0f9e83-978d-4b4d-b0e8-a5fc64688a13 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:20.389908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bf0f9e83-978d-4b4d-b0e8-a5fc64688a13 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:20.390356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bf0f9e83-978d-4b4d-b0e8-a5fc64688a13 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:20.391073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bf0f9e83-978d-4b4d-b0e8-a5fc64688a13 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:20.391534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bf0f9e83-978d-4b4d-b0e8-a5fc64688a13 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:20.391966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bf0f9e83-978d-4b4d-b0e8-a5fc64688a13 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:20.674969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bf0f9e83-978d-4b4d-b0e8-a5fc64688a13 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:20.700378 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bf0f9e83-978d-4b4d-b0e8-a5fc64688a13 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1509 microversion: 2.1 time: 0.327472 Oct 04 21:25:20.701966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-beb81df1-49ea-4933-b01e-2c02d409b66b tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:20.702650 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2032/4081] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:20 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:20.702932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-beb81df1-49ea-4933-b01e-2c02d409b66b tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:20.726583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-beb81df1-49ea-4933-b01e-2c02d409b66b tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:20.727128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-beb81df1-49ea-4933-b01e-2c02d409b66b tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:20.732136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-beb81df1-49ea-4933-b01e-2c02d409b66b tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:20.735216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-beb81df1-49ea-4933-b01e-2c02d409b66b tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:20.735715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-beb81df1-49ea-4933-b01e-2c02d409b66b tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:20.736889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-beb81df1-49ea-4933-b01e-2c02d409b66b tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:20.766672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9add6dd-cb47-47ac-b1ca-4ed0c926f51f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:20.767661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d9add6dd-cb47-47ac-b1ca-4ed0c926f51f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:20.781657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9add6dd-cb47-47ac-b1ca-4ed0c926f51f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:20.782491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9add6dd-cb47-47ac-b1ca-4ed0c926f51f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:20.783207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9add6dd-cb47-47ac-b1ca-4ed0c926f51f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:20.784227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9add6dd-cb47-47ac-b1ca-4ed0c926f51f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:20.784901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9add6dd-cb47-47ac-b1ca-4ed0c926f51f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:20.785598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9add6dd-cb47-47ac-b1ca-4ed0c926f51f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:21.338179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-beb81df1-49ea-4933-b01e-2c02d409b66b tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:21.347391 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-beb81df1-49ea-4933-b01e-2c02d409b66b tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1524 microversion: 2.1 time: 0.650254 Oct 04 21:25:21.351156 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2050/4082] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:20 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1524 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:25:21.364610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d9add6dd-cb47-47ac-b1ca-4ed0c926f51f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:21.366784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-204adef3-f0e6-4b65-86df-fda1ad29570e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:21.371860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-204adef3-f0e6-4b65-86df-fda1ad29570e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:21.377173 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d9add6dd-cb47-47ac-b1ca-4ed0c926f51f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1317 microversion: 2.1 time: 0.615244 Oct 04 21:25:21.380068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-204adef3-f0e6-4b65-86df-fda1ad29570e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:21.381687 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2033/4083] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:20 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1317 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:25:21.385638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-204adef3-f0e6-4b65-86df-fda1ad29570e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:21.386244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-204adef3-f0e6-4b65-86df-fda1ad29570e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:21.387265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-204adef3-f0e6-4b65-86df-fda1ad29570e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:21.387801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-204adef3-f0e6-4b65-86df-fda1ad29570e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:21.388329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-204adef3-f0e6-4b65-86df-fda1ad29570e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:21.398727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a210ed2e-410c-4644-aee2-5d28a5704477 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:21.399697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a210ed2e-410c-4644-aee2-5d28a5704477 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:21.412216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a210ed2e-410c-4644-aee2-5d28a5704477 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:21.413549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a210ed2e-410c-4644-aee2-5d28a5704477 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:21.415049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a210ed2e-410c-4644-aee2-5d28a5704477 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:21.416545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a210ed2e-410c-4644-aee2-5d28a5704477 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:21.418250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a210ed2e-410c-4644-aee2-5d28a5704477 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:21.419913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a210ed2e-410c-4644-aee2-5d28a5704477 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:21.582491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-204adef3-f0e6-4b65-86df-fda1ad29570e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:21.594288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:21.608634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-204adef3-f0e6-4b65-86df-fda1ad29570e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:21.613303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-204adef3-f0e6-4b65-86df-fda1ad29570e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:21.616687 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-204adef3-f0e6-4b65-86df-fda1ad29570e tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1875 microversion: 2.32 time: 0.262777 Oct 04 21:25:21.618992 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2051/4084] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:21 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1875 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:21.667489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a210ed2e-410c-4644-aee2-5d28a5704477 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:21.684383 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a210ed2e-410c-4644-aee2-5d28a5704477 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1272 microversion: 2.1 time: 0.294503 Oct 04 21:25:21.685087 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2034/4085] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:21 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1272 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:21.730228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b739073a-d6e8-4fc0-9bb9-705706ab5f0f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:21.730819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b739073a-d6e8-4fc0-9bb9-705706ab5f0f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:21.742361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b739073a-d6e8-4fc0-9bb9-705706ab5f0f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:21.742863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b739073a-d6e8-4fc0-9bb9-705706ab5f0f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:21.743308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b739073a-d6e8-4fc0-9bb9-705706ab5f0f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:21.744202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b739073a-d6e8-4fc0-9bb9-705706ab5f0f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:21.744638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b739073a-d6e8-4fc0-9bb9-705706ab5f0f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:21.746766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b739073a-d6e8-4fc0-9bb9-705706ab5f0f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:22.058683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-22b54a11-be23-43af-8427-145b3fd6967a req-b3b512ad-641d-4727-97a8-ea5a3dc332ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfb9eae-ce66-48c5-b7ca-8032c3596fad", "name": "network-vif-plugged", "status": "completed", "tag": "d5e1110b-c910-4bae-8abe-73bf34266071"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:22.080879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-22b54a11-be23-43af-8427-145b3fd6967a req-b3b512ad-641d-4727-97a8-ea5a3dc332ab service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:22.081600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-22b54a11-be23-43af-8427-145b3fd6967a req-b3b512ad-641d-4727-97a8-ea5a3dc332ab service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:22.082679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-22b54a11-be23-43af-8427-145b3fd6967a req-b3b512ad-641d-4727-97a8-ea5a3dc332ab service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:22.129176 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-22b54a11-be23-43af-8427-145b3fd6967a req-b3b512ad-641d-4727-97a8-ea5a3dc332ab service nova] Creating event network-vif-plugged:d5e1110b-c910-4bae-8abe-73bf34266071 for instance bbfb9eae-ce66-48c5-b7ca-8032c3596fad on n-h2-860282-1 Oct 04 21:25:22.153028 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-22b54a11-be23-43af-8427-145b3fd6967a req-b3b512ad-641d-4727-97a8-ea5a3dc332ab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092540 Oct 04 21:25:22.153028 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2035/4086] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:22.196988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b739073a-d6e8-4fc0-9bb9-705706ab5f0f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:22.208566 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b739073a-d6e8-4fc0-9bb9-705706ab5f0f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1509 microversion: 2.1 time: 0.484182 Oct 04 21:25:22.211150 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2052/4087] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:21 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1509 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:22.392696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aaa2c4c9-17e2-42ba-bb3a-460758a01903 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:22.394274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aaa2c4c9-17e2-42ba-bb3a-460758a01903 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:22.410000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-67bd3532-2e6e-481d-ba94-288f3e437445 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:22.411309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-67bd3532-2e6e-481d-ba94-288f3e437445 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:22.424405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67bd3532-2e6e-481d-ba94-288f3e437445 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:22.427148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67bd3532-2e6e-481d-ba94-288f3e437445 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:22.427756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67bd3532-2e6e-481d-ba94-288f3e437445 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:22.428661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67bd3532-2e6e-481d-ba94-288f3e437445 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:22.431464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67bd3532-2e6e-481d-ba94-288f3e437445 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:22.432106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67bd3532-2e6e-481d-ba94-288f3e437445 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:22.435021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aaa2c4c9-17e2-42ba-bb3a-460758a01903 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:22.450364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aaa2c4c9-17e2-42ba-bb3a-460758a01903 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:22.450364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aaa2c4c9-17e2-42ba-bb3a-460758a01903 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:22.450364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aaa2c4c9-17e2-42ba-bb3a-460758a01903 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:22.460314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aaa2c4c9-17e2-42ba-bb3a-460758a01903 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:22.460911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aaa2c4c9-17e2-42ba-bb3a-460758a01903 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:22.825718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aaa2c4c9-17e2-42ba-bb3a-460758a01903 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:22.856329 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aaa2c4c9-17e2-42ba-bb3a-460758a01903 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1524 microversion: 2.1 time: 0.474372 Oct 04 21:25:22.861023 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2036/4088] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:22 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1524 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:22.891215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cf8264c6-eb7c-44b5-9c26-df016e5f79d2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:22.894228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cf8264c6-eb7c-44b5-9c26-df016e5f79d2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:22.910076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf8264c6-eb7c-44b5-9c26-df016e5f79d2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:22.911103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf8264c6-eb7c-44b5-9c26-df016e5f79d2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:22.913049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf8264c6-eb7c-44b5-9c26-df016e5f79d2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:22.918179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf8264c6-eb7c-44b5-9c26-df016e5f79d2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:22.918996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf8264c6-eb7c-44b5-9c26-df016e5f79d2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:22.921055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf8264c6-eb7c-44b5-9c26-df016e5f79d2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:23.115795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-67bd3532-2e6e-481d-ba94-288f3e437445 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:23.128170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cf8264c6-eb7c-44b5-9c26-df016e5f79d2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:23.128344 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-67bd3532-2e6e-481d-ba94-288f3e437445 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1317 microversion: 2.1 time: 0.719872 Oct 04 21:25:23.141579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cf8264c6-eb7c-44b5-9c26-df016e5f79d2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:23.147622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cf8264c6-eb7c-44b5-9c26-df016e5f79d2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:23.150312 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cf8264c6-eb7c-44b5-9c26-df016e5f79d2 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1875 microversion: 2.32 time: 0.287500 Oct 04 21:25:23.157808 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2037/4089] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:22 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1875 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:23.159818 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2053/4090] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:22 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1317 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:23.171135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b81aff4b-f3dd-4b5e-b3ee-975874fe162c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:23.172018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b81aff4b-f3dd-4b5e-b3ee-975874fe162c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:23.187943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b81aff4b-f3dd-4b5e-b3ee-975874fe162c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:23.188649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b81aff4b-f3dd-4b5e-b3ee-975874fe162c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:23.189099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b81aff4b-f3dd-4b5e-b3ee-975874fe162c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:23.192384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b81aff4b-f3dd-4b5e-b3ee-975874fe162c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:23.208925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b81aff4b-f3dd-4b5e-b3ee-975874fe162c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:23.208925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b81aff4b-f3dd-4b5e-b3ee-975874fe162c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:23.237354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4a1a25d4-b55c-40ef-887c-ed642e2c1364 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:23.238860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4a1a25d4-b55c-40ef-887c-ed642e2c1364 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:23.249341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a1a25d4-b55c-40ef-887c-ed642e2c1364 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:23.259192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a1a25d4-b55c-40ef-887c-ed642e2c1364 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:23.261609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a1a25d4-b55c-40ef-887c-ed642e2c1364 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:23.262998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a1a25d4-b55c-40ef-887c-ed642e2c1364 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:23.263713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a1a25d4-b55c-40ef-887c-ed642e2c1364 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:23.264371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a1a25d4-b55c-40ef-887c-ed642e2c1364 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:24.331959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b81aff4b-f3dd-4b5e-b3ee-975874fe162c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:24.356010 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b81aff4b-f3dd-4b5e-b3ee-975874fe162c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1314 microversion: 2.1 time: 1.192548 Oct 04 21:25:24.358623 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2038/4091] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:23 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1314 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:24.373924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f7327adf-f6f0-4a4a-9163-6f379f322ce9 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:24.375095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f7327adf-f6f0-4a4a-9163-6f379f322ce9 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:24.388905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7327adf-f6f0-4a4a-9163-6f379f322ce9 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:24.389697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7327adf-f6f0-4a4a-9163-6f379f322ce9 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:24.390557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7327adf-f6f0-4a4a-9163-6f379f322ce9 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:24.391466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7327adf-f6f0-4a4a-9163-6f379f322ce9 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:24.391934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7327adf-f6f0-4a4a-9163-6f379f322ce9 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:24.401818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7327adf-f6f0-4a4a-9163-6f379f322ce9 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:24.439665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4a1a25d4-b55c-40ef-887c-ed642e2c1364 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:24.455200 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4a1a25d4-b55c-40ef-887c-ed642e2c1364 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1509 microversion: 2.1 time: 1.222549 Oct 04 21:25:24.457256 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2054/4092] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:23 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1509 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:24.462498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-46ef5265-316a-43c8-a958-42b94a44db74 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:24.473763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-46ef5265-316a-43c8-a958-42b94a44db74 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:24.487325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46ef5265-316a-43c8-a958-42b94a44db74 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:24.488265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46ef5265-316a-43c8-a958-42b94a44db74 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:24.488905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46ef5265-316a-43c8-a958-42b94a44db74 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:24.489852 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46ef5265-316a-43c8-a958-42b94a44db74 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:24.490480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46ef5265-316a-43c8-a958-42b94a44db74 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:24.498161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46ef5265-316a-43c8-a958-42b94a44db74 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:25.113159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f7327adf-f6f0-4a4a-9163-6f379f322ce9 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:25.122227 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f7327adf-f6f0-4a4a-9163-6f379f322ce9 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1504 microversion: 2.1 time: 0.762252 Oct 04 21:25:25.128703 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2039/4093] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:24 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1504 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:25.148124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9ff733c-27b7-46dd-9c84-baf93f900e23 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:25.149703 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d9ff733c-27b7-46dd-9c84-baf93f900e23 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:25.157084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9ff733c-27b7-46dd-9c84-baf93f900e23 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:25.157903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9ff733c-27b7-46dd-9c84-baf93f900e23 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:25.158704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9ff733c-27b7-46dd-9c84-baf93f900e23 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:25.159908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9ff733c-27b7-46dd-9c84-baf93f900e23 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:25.160550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9ff733c-27b7-46dd-9c84-baf93f900e23 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:25.160987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9ff733c-27b7-46dd-9c84-baf93f900e23 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:25.262912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-46ef5265-316a-43c8-a958-42b94a44db74 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:25.278930 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-46ef5265-316a-43c8-a958-42b94a44db74 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1317 microversion: 2.1 time: 0.820136 Oct 04 21:25:25.279566 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2055/4094] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:24 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1317 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:25.305762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7e5e5f57-eb49-44d7-9eea-ee5f7393a684 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Action: 'create', calling method: .version_select at 0x7f578b555430>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-146949706", "description": "tempest-description-392619376"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:25.340922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d9ff733c-27b7-46dd-9c84-baf93f900e23 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:25.361728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d9ff733c-27b7-46dd-9c84-baf93f900e23 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:25.363577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d9ff733c-27b7-46dd-9c84-baf93f900e23 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:25.364878 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d9ff733c-27b7-46dd-9c84-baf93f900e23 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1875 microversion: 2.32 time: 0.234855 Oct 04 21:25:25.365470 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2040/4095] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:25 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1875 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:25.384782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b77a9a44-5e2e-40c8-ae77-114c1fe14132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:25.385861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b77a9a44-5e2e-40c8-ae77-114c1fe14132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:25.393015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b77a9a44-5e2e-40c8-ae77-114c1fe14132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:25.393874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b77a9a44-5e2e-40c8-ae77-114c1fe14132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:25.394558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b77a9a44-5e2e-40c8-ae77-114c1fe14132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:25.395460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b77a9a44-5e2e-40c8-ae77-114c1fe14132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:25.396015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b77a9a44-5e2e-40c8-ae77-114c1fe14132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:25.396931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b77a9a44-5e2e-40c8-ae77-114c1fe14132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:25.887374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b77a9a44-5e2e-40c8-ae77-114c1fe14132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:25.902410 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b77a9a44-5e2e-40c8-ae77-114c1fe14132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1314 microversion: 2.1 time: 0.520778 Oct 04 21:25:25.903665 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2041/4096] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:25 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:25.919078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e61fbbe3-9218-4cca-8f89-89c62feb1935 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:25.920355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e61fbbe3-9218-4cca-8f89-89c62feb1935 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:25.931659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e61fbbe3-9218-4cca-8f89-89c62feb1935 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:25.932456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e61fbbe3-9218-4cca-8f89-89c62feb1935 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:25.937985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e61fbbe3-9218-4cca-8f89-89c62feb1935 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:25.938929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e61fbbe3-9218-4cca-8f89-89c62feb1935 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:25.939906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e61fbbe3-9218-4cca-8f89-89c62feb1935 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:25.940583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e61fbbe3-9218-4cca-8f89-89c62feb1935 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:26.324313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e61fbbe3-9218-4cca-8f89-89c62feb1935 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:26.342312 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e61fbbe3-9218-4cca-8f89-89c62feb1935 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1509 microversion: 2.1 time: 0.434516 Oct 04 21:25:26.343224 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2042/4097] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:25 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1509 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:26.348127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f6f8a1b7-bcbb-4aa7-9664-1095781a0b35 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:26.349083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f6f8a1b7-bcbb-4aa7-9664-1095781a0b35 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:26.359267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6f8a1b7-bcbb-4aa7-9664-1095781a0b35 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:26.364591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6f8a1b7-bcbb-4aa7-9664-1095781a0b35 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:26.365307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6f8a1b7-bcbb-4aa7-9664-1095781a0b35 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:26.366412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6f8a1b7-bcbb-4aa7-9664-1095781a0b35 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:26.367091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6f8a1b7-bcbb-4aa7-9664-1095781a0b35 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:26.367708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6f8a1b7-bcbb-4aa7-9664-1095781a0b35 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:26.593096 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7e5e5f57-eb49-44d7-9eea-ee5f7393a684 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 1.292942 Oct 04 21:25:26.594684 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2056/4098] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Oct 4 21:25:25 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:26.599981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-01acb6bc-c883-42e2-92b3-64ada592ef21 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:26.603701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-01acb6bc-c883-42e2-92b3-64ada592ef21 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:26.619224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01acb6bc-c883-42e2-92b3-64ada592ef21 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:26.620860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01acb6bc-c883-42e2-92b3-64ada592ef21 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:26.622272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01acb6bc-c883-42e2-92b3-64ada592ef21 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:26.623369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01acb6bc-c883-42e2-92b3-64ada592ef21 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:26.626358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01acb6bc-c883-42e2-92b3-64ada592ef21 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:26.627249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01acb6bc-c883-42e2-92b3-64ada592ef21 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:26.709023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:26.754838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-01acb6bc-c883-42e2-92b3-64ada592ef21 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:26.767546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-01acb6bc-c883-42e2-92b3-64ada592ef21 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:26.771392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-01acb6bc-c883-42e2-92b3-64ada592ef21 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:26.772643 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-01acb6bc-c883-42e2-92b3-64ada592ef21 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1875 microversion: 2.32 time: 0.176807 Oct 04 21:25:26.773279 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2057/4099] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:26 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1875 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:26.795460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bb96042d-0c5d-409c-a45b-925bb97cc481 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-146949706"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:26.817995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f6f8a1b7-bcbb-4aa7-9664-1095781a0b35 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:26.842362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bb96042d-0c5d-409c-a45b-925bb97cc481 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:26.847487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:26.874756 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f6f8a1b7-bcbb-4aa7-9664-1095781a0b35 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1506 microversion: 2.1 time: 0.526515 Oct 04 21:25:26.879158 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2043/4100] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:26 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1506 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:26.886118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb96042d-0c5d-409c-a45b-925bb97cc481 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:26.889177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb96042d-0c5d-409c-a45b-925bb97cc481 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:26.890757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb96042d-0c5d-409c-a45b-925bb97cc481 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:26.896483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb96042d-0c5d-409c-a45b-925bb97cc481 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:26.899261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb96042d-0c5d-409c-a45b-925bb97cc481 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:26.908149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-80c28a52-7986-49b7-8dd6-8fa5246d13c5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:26.908771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-80c28a52-7986-49b7-8dd6-8fa5246d13c5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:26.909944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb96042d-0c5d-409c-a45b-925bb97cc481 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:26.934132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80c28a52-7986-49b7-8dd6-8fa5246d13c5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:26.937554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80c28a52-7986-49b7-8dd6-8fa5246d13c5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:26.940188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80c28a52-7986-49b7-8dd6-8fa5246d13c5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:26.942444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80c28a52-7986-49b7-8dd6-8fa5246d13c5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:26.945005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80c28a52-7986-49b7-8dd6-8fa5246d13c5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:26.947275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80c28a52-7986-49b7-8dd6-8fa5246d13c5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:27.566746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:27.683059 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.network.security_group_api [None req-bb96042d-0c5d-409c-a45b-925bb97cc481 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Adding security group 57162e48-f0ee-4c4d-b378-1ec5e316074f to port ccb20d83-d32e-4ee7-a699-8e1da8c412f2 Oct 04 21:25:27.741728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-80c28a52-7986-49b7-8dd6-8fa5246d13c5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:27.760667 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-80c28a52-7986-49b7-8dd6-8fa5246d13c5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1506 microversion: 2.1 time: 0.856974 Oct 04 21:25:27.780008 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2044/4101] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:26 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1506 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:25:27.787576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-51e636a0-7481-48e8-a72d-473e82d4d2b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:27.788690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-51e636a0-7481-48e8-a72d-473e82d4d2b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:27.800926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51e636a0-7481-48e8-a72d-473e82d4d2b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:27.802221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51e636a0-7481-48e8-a72d-473e82d4d2b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:27.803041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51e636a0-7481-48e8-a72d-473e82d4d2b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:27.804167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51e636a0-7481-48e8-a72d-473e82d4d2b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:27.806041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51e636a0-7481-48e8-a72d-473e82d4d2b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:27.806658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51e636a0-7481-48e8-a72d-473e82d4d2b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:28.672877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:28.806659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-51e636a0-7481-48e8-a72d-473e82d4d2b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:28.836078 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-51e636a0-7481-48e8-a72d-473e82d4d2b0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1314 microversion: 2.1 time: 1.048185 Oct 04 21:25:28.845673 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2045/4102] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:27 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1314 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:28.845673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-bde5fb68-d22e-45e1-b855-23cc70b0b915 req-8b416246-27a6-40db-b61f-63b778b3373f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf496d06-f510-4a05-b5c7-3438c434547e", "tag": "e3b2e817-8930-4077-a86c-88d50aa94e31"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:28.897999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-bde5fb68-d22e-45e1-b855-23cc70b0b915 req-8b416246-27a6-40db-b61f-63b778b3373f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:28.898971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-bde5fb68-d22e-45e1-b855-23cc70b0b915 req-8b416246-27a6-40db-b61f-63b778b3373f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:28.906600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-bde5fb68-d22e-45e1-b855-23cc70b0b915 req-8b416246-27a6-40db-b61f-63b778b3373f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:28.957029 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-bde5fb68-d22e-45e1-b855-23cc70b0b915 req-8b416246-27a6-40db-b61f-63b778b3373f service nova] Creating event network-changed:e3b2e817-8930-4077-a86c-88d50aa94e31 for instance cf496d06-f510-4a05-b5c7-3438c434547e on n-h1-860282-1 Oct 04 21:25:28.973195 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-bde5fb68-d22e-45e1-b855-23cc70b0b915 req-8b416246-27a6-40db-b61f-63b778b3373f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132042 Oct 04 21:25:28.975204 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2046/4103] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:29.005712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ad0b8e1c-eec8-4942-ae1b-0265d6dfc8f4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:29.006655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ad0b8e1c-eec8-4942-ae1b-0265d6dfc8f4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:29.024013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad0b8e1c-eec8-4942-ae1b-0265d6dfc8f4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:29.027208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad0b8e1c-eec8-4942-ae1b-0265d6dfc8f4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:29.028750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad0b8e1c-eec8-4942-ae1b-0265d6dfc8f4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:29.032007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad0b8e1c-eec8-4942-ae1b-0265d6dfc8f4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:29.035879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad0b8e1c-eec8-4942-ae1b-0265d6dfc8f4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:29.036553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad0b8e1c-eec8-4942-ae1b-0265d6dfc8f4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:29.525070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ad0b8e1c-eec8-4942-ae1b-0265d6dfc8f4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:29.540970 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ad0b8e1c-eec8-4942-ae1b-0265d6dfc8f4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1509 microversion: 2.1 time: 0.562618 Oct 04 21:25:29.545680 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bb96042d-0c5d-409c-a45b-925bb97cc481 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "POST /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b/action" status: 202 len: 0 microversion: 2.1 time: 2.761530 Oct 04 21:25:29.550414 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2058/4104] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:25:26 2022] POST /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b/action => generated 0 bytes in 2776 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:25:29.558281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:29.562511 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2047/4105] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:28 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1509 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:29.589775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:29.596999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c274708a-a5cd-4ada-b197-b2131979dca8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:29.610582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c274708a-a5cd-4ada-b197-b2131979dca8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:29.615825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:29.616352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:29.619100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:29.626305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c274708a-a5cd-4ada-b197-b2131979dca8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:29.626305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c274708a-a5cd-4ada-b197-b2131979dca8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:29.626305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c274708a-a5cd-4ada-b197-b2131979dca8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:29.627235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c274708a-a5cd-4ada-b197-b2131979dca8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:29.628001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c274708a-a5cd-4ada-b197-b2131979dca8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:29.628653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c274708a-a5cd-4ada-b197-b2131979dca8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:29.629081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:29.632483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:29.633626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:29.839284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:25:29.847439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:25:29.848056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:25:29.848670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:25:29.849297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:25:30.029754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c274708a-a5cd-4ada-b197-b2131979dca8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:30.050429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c274708a-a5cd-4ada-b197-b2131979dca8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:30.052112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c274708a-a5cd-4ada-b197-b2131979dca8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:30.057171 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c274708a-a5cd-4ada-b197-b2131979dca8 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1875 microversion: 2.32 time: 0.471420 Oct 04 21:25:30.073454 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2048/4106] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:29 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1875 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:30.073454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8758c717-99d5-4106-849b-9737e258816d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-146949706"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:30.073723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8758c717-99d5-4106-849b-9737e258816d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:30.111063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8758c717-99d5-4106-849b-9737e258816d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:30.113663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8758c717-99d5-4106-849b-9737e258816d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:30.114153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8758c717-99d5-4106-849b-9737e258816d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:30.116066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8758c717-99d5-4106-849b-9737e258816d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:30.116066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8758c717-99d5-4106-849b-9737e258816d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:30.116066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8758c717-99d5-4106-849b-9737e258816d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:30.160117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:30.178311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:30.178819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:30.179266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:30.180546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:30.186941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:30.188176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:30.256588 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d9b0da01-f1bb-4329-a186-8613fa1c2554 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "POST /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad/action" status: 202 len: 1108 microversion: 2.1 time: 0.704365 Oct 04 21:25:30.258438 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2059/4107] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:25:29 2022] POST /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad/action => generated 1108 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 21:25:30.265407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cb607094-40d0-4ca7-81fe-aecb3cecd9a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:30.272395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cb607094-40d0-4ca7-81fe-aecb3cecd9a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:30.300665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb607094-40d0-4ca7-81fe-aecb3cecd9a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:30.310866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb607094-40d0-4ca7-81fe-aecb3cecd9a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:30.310866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb607094-40d0-4ca7-81fe-aecb3cecd9a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:30.310866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb607094-40d0-4ca7-81fe-aecb3cecd9a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:30.310866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb607094-40d0-4ca7-81fe-aecb3cecd9a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:30.310866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb607094-40d0-4ca7-81fe-aecb3cecd9a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:31.323266 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.network.security_group_api [None req-8758c717-99d5-4106-849b-9737e258816d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Removing security group 57162e48-f0ee-4c4d-b378-1ec5e316074f from port ccb20d83-d32e-4ee7-a699-8e1da8c412f2 Oct 04 21:25:31.610675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cb607094-40d0-4ca7-81fe-aecb3cecd9a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:31.623297 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cb607094-40d0-4ca7-81fe-aecb3cecd9a4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1314 microversion: 2.1 time: 1.359324 Oct 04 21:25:31.623984 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2060/4108] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:30 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1314 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:31.630360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d1fa3c24-d8e5-45ed-b755-b8afc862bd1c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:31.631174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d1fa3c24-d8e5-45ed-b755-b8afc862bd1c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:31.638300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1fa3c24-d8e5-45ed-b755-b8afc862bd1c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:31.639110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1fa3c24-d8e5-45ed-b755-b8afc862bd1c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:31.639775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1fa3c24-d8e5-45ed-b755-b8afc862bd1c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:31.640675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1fa3c24-d8e5-45ed-b755-b8afc862bd1c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:31.641287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1fa3c24-d8e5-45ed-b755-b8afc862bd1c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:31.641921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1fa3c24-d8e5-45ed-b755-b8afc862bd1c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:32.159386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d1fa3c24-d8e5-45ed-b755-b8afc862bd1c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:32.171994 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d1fa3c24-d8e5-45ed-b755-b8afc862bd1c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1513 microversion: 2.1 time: 0.545485 Oct 04 21:25:32.173277 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2061/4109] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:31 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1513 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:32.178290 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-23e150a8-f4ab-4e23-b37f-ce78e7fba4b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:32.179351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-23e150a8-f4ab-4e23-b37f-ce78e7fba4b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:32.186955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23e150a8-f4ab-4e23-b37f-ce78e7fba4b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:32.187651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23e150a8-f4ab-4e23-b37f-ce78e7fba4b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:32.189728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23e150a8-f4ab-4e23-b37f-ce78e7fba4b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:32.192531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23e150a8-f4ab-4e23-b37f-ce78e7fba4b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:32.193267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23e150a8-f4ab-4e23-b37f-ce78e7fba4b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:32.193844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23e150a8-f4ab-4e23-b37f-ce78e7fba4b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:32.648985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-23e150a8-f4ab-4e23-b37f-ce78e7fba4b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:32.661769 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-23e150a8-f4ab-4e23-b37f-ce78e7fba4b3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1509 microversion: 2.1 time: 0.487125 Oct 04 21:25:32.662744 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2062/4110] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:32 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1509 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:32.677687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3e39d9ca-c1fc-4cdb-8ecf-334a6ec18202 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:32.678321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3e39d9ca-c1fc-4cdb-8ecf-334a6ec18202 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:32.721275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e39d9ca-c1fc-4cdb-8ecf-334a6ec18202 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:32.721813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e39d9ca-c1fc-4cdb-8ecf-334a6ec18202 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:32.722261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e39d9ca-c1fc-4cdb-8ecf-334a6ec18202 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:32.723203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e39d9ca-c1fc-4cdb-8ecf-334a6ec18202 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:32.723585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e39d9ca-c1fc-4cdb-8ecf-334a6ec18202 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:32.724017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e39d9ca-c1fc-4cdb-8ecf-334a6ec18202 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:32.811344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e39d9ca-c1fc-4cdb-8ecf-334a6ec18202 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:32.812566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e39d9ca-c1fc-4cdb-8ecf-334a6ec18202 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:32.814547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e39d9ca-c1fc-4cdb-8ecf-334a6ec18202 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:32.815204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-3e39d9ca-c1fc-4cdb-8ecf-334a6ec18202 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lazy-loading 'fault' on Instance uuid aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:25:32.832775 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8758c717-99d5-4106-849b-9737e258816d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "POST /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b/action" status: 202 len: 0 microversion: 2.1 time: 2.768717 Oct 04 21:25:32.833756 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2049/4111] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:25:30 2022] POST /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b/action => generated 0 bytes in 2773 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:25:32.839071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-70a15945-0b84-47a8-aec3-f34725be12f0 req-a8f0a021-1977-4ad8-819e-0ecdf60aa8af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267676e7-8969-4f7b-9e77-da72b8e71a0b", "tag": "ccb20d83-d32e-4ee7-a699-8e1da8c412f2"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:32.873275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-70a15945-0b84-47a8-aec3-f34725be12f0 req-a8f0a021-1977-4ad8-819e-0ecdf60aa8af service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:32.873928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-70a15945-0b84-47a8-aec3-f34725be12f0 req-a8f0a021-1977-4ad8-819e-0ecdf60aa8af service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:32.874627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-70a15945-0b84-47a8-aec3-f34725be12f0 req-a8f0a021-1977-4ad8-819e-0ecdf60aa8af service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:32.909038 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-70a15945-0b84-47a8-aec3-f34725be12f0 req-a8f0a021-1977-4ad8-819e-0ecdf60aa8af service nova] Creating event network-changed:ccb20d83-d32e-4ee7-a699-8e1da8c412f2 for instance 267676e7-8969-4f7b-9e77-da72b8e71a0b on n-h2-860282-1 Oct 04 21:25:32.922809 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-70a15945-0b84-47a8-aec3-f34725be12f0 req-a8f0a021-1977-4ad8-819e-0ecdf60aa8af service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087731 Oct 04 21:25:32.923461 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2050/4112] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:32.944715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5c62e7ec-d877-42cf-a5fb-7d8932470aa6 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:32.945627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5c62e7ec-d877-42cf-a5fb-7d8932470aa6 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:32.964970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c62e7ec-d877-42cf-a5fb-7d8932470aa6 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:32.967642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c62e7ec-d877-42cf-a5fb-7d8932470aa6 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:32.967846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c62e7ec-d877-42cf-a5fb-7d8932470aa6 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:32.968871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c62e7ec-d877-42cf-a5fb-7d8932470aa6 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:32.969400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c62e7ec-d877-42cf-a5fb-7d8932470aa6 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:32.970622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c62e7ec-d877-42cf-a5fb-7d8932470aa6 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:33.067104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3e39d9ca-c1fc-4cdb-8ecf-334a6ec18202 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:33.078203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3e39d9ca-c1fc-4cdb-8ecf-334a6ec18202 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:33.082779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3e39d9ca-c1fc-4cdb-8ecf-334a6ec18202 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7d792ce0a9f4f6da9406759dd9d665c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb8b6a67e463d9cec9f0aa581c2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:33.087218 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3e39d9ca-c1fc-4cdb-8ecf-334a6ec18202 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 200 len: 1642 microversion: 2.32 time: 0.423014 Oct 04 21:25:33.089926 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2063/4113] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:32 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 1642 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:33.102907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-51b92258-2968-419b-8e8b-5aef7444aaa2 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Action: 'create', calling method: .version_select at 0x7f578b5748b0>, body: {"pool": null} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:33.710322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5c62e7ec-d877-42cf-a5fb-7d8932470aa6 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:33.720634 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5c62e7ec-d877-42cf-a5fb-7d8932470aa6 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1314 microversion: 2.1 time: 0.788072 Oct 04 21:25:33.721759 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2051/4114] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:32 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1314 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:33.727650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e8e7a9be-6db3-47d4-830a-eedeaa8b526e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:33.728505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e8e7a9be-6db3-47d4-830a-eedeaa8b526e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:33.735862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8e7a9be-6db3-47d4-830a-eedeaa8b526e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:33.736588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8e7a9be-6db3-47d4-830a-eedeaa8b526e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:33.737514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8e7a9be-6db3-47d4-830a-eedeaa8b526e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:33.738544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8e7a9be-6db3-47d4-830a-eedeaa8b526e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:33.739220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8e7a9be-6db3-47d4-830a-eedeaa8b526e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:33.740855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8e7a9be-6db3-47d4-830a-eedeaa8b526e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:34.165574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e8e7a9be-6db3-47d4-830a-eedeaa8b526e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:34.183500 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e8e7a9be-6db3-47d4-830a-eedeaa8b526e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1513 microversion: 2.1 time: 0.460483 Oct 04 21:25:34.207193 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2052/4115] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:33 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1513 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:34.214351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e46c342e-d4ca-41bb-a398-733717241815 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:34.215573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e46c342e-d4ca-41bb-a398-733717241815 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:34.229338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e46c342e-d4ca-41bb-a398-733717241815 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:34.230247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e46c342e-d4ca-41bb-a398-733717241815 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:34.230879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e46c342e-d4ca-41bb-a398-733717241815 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:34.231766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e46c342e-d4ca-41bb-a398-733717241815 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:34.232433 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e46c342e-d4ca-41bb-a398-733717241815 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:34.233032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e46c342e-d4ca-41bb-a398-733717241815 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:35.254904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e46c342e-d4ca-41bb-a398-733717241815 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:35.268537 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e46c342e-d4ca-41bb-a398-733717241815 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1509 microversion: 2.1 time: 1.059885 Oct 04 21:25:35.269295 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2053/4116] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:34 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1509 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:35.278224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-45d48e0d-8c28-4222-9115-9c117112b9db tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:35.283144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-45d48e0d-8c28-4222-9115-9c117112b9db tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:35.300548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45d48e0d-8c28-4222-9115-9c117112b9db tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:35.301820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45d48e0d-8c28-4222-9115-9c117112b9db tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:35.302272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45d48e0d-8c28-4222-9115-9c117112b9db tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:35.303710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45d48e0d-8c28-4222-9115-9c117112b9db tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:35.304934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45d48e0d-8c28-4222-9115-9c117112b9db tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:35.305883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45d48e0d-8c28-4222-9115-9c117112b9db tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:35.324357 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-45d48e0d-8c28-4222-9115-9c117112b9db tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] HTTP exception thrown: Instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 could not be found. Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-45d48e0d-8c28-4222-9115-9c117112b9db tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Request method failure captured: Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 HTTP/1.1 Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKLStfemsjJYuIes-iRVOH29yHbr634iSFIgRBy2M0zsDK8lMLDNzFzrAg2tZ5byoVMc2iDH_PaaDZ-4UTcRYPQRtkSQUp-Lc8Rn4TLQatlGDlTsrPnWUZUFH4DETcJezHbj7lKzfeDfgW7sWcpTekMaaqTf8P_5GdHaPg-Z4vC90KU Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: b1bcb8b6a67e463d9cec9f0aa581c2e5 Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TaggedBootDevicesTest-1780310521 Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b1bcb8b6a67e463d9cec9f0aa581c2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b1bcb8b6a67e463d9cec9f0aa581c2e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b1bcb8b6a67e463d9cec9f0aa581c2e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b1bcb8b6a67e463d9cec9f0aa581c2e5"}]}] Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TaggedBootDevicesTest-1780310521 Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: b1bcb8b6a67e463d9cec9f0aa581c2e5 Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1780310521 Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TaggedBootDevicesTest-1780310521-project Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: f7d792ce0a9f4f6da9406759dd9d665c Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TaggedBootDevicesTest-1780310521-project Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 could not be found. Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'aa7b2ecc-1ade-4b25-afa0-abcab1c3def0'} Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 could not be found. Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 could not be found. Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:25:35.326403 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:25:35.331072 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:25:35.331072 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:25:35.331072 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:25:35.331072 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:25:35.331072 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:25:35.331072 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:25:35.331072 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 could not be found. Oct 04 21:25:35.331072 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:25:35.332290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-45d48e0d-8c28-4222-9115-9c117112b9db tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Returning 404 to user: Instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:25:35.334142 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-45d48e0d-8c28-4222-9115-9c117112b9db tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 404 len: 111 microversion: 2.32 time: 0.063142 Oct 04 21:25:35.334878 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2054/4117] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:35 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:25:35.339891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9af47abd-e888-4a10-8267-579ddcc77929 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:35.340729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9af47abd-e888-4a10-8267-579ddcc77929 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:35.347640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9af47abd-e888-4a10-8267-579ddcc77929 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:35.348339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9af47abd-e888-4a10-8267-579ddcc77929 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:35.348929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9af47abd-e888-4a10-8267-579ddcc77929 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:35.349910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9af47abd-e888-4a10-8267-579ddcc77929 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:35.350544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9af47abd-e888-4a10-8267-579ddcc77929 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:35.351161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9af47abd-e888-4a10-8267-579ddcc77929 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:35.720954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9af47abd-e888-4a10-8267-579ddcc77929 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:35.734979 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9af47abd-e888-4a10-8267-579ddcc77929 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1314 microversion: 2.1 time: 0.398779 Oct 04 21:25:35.737808 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2055/4118] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:35 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:35.745351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-e002284f-8acf-4d0c-8f78-67580a88dd6d req-ee28fe78-a0a0-4fd5-bb43-d5c00002a2af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267676e7-8969-4f7b-9e77-da72b8e71a0b", "tag": "ccb20d83-d32e-4ee7-a699-8e1da8c412f2"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:35.771443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e002284f-8acf-4d0c-8f78-67580a88dd6d req-ee28fe78-a0a0-4fd5-bb43-d5c00002a2af service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:35.772260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e002284f-8acf-4d0c-8f78-67580a88dd6d req-ee28fe78-a0a0-4fd5-bb43-d5c00002a2af service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:35.772855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e002284f-8acf-4d0c-8f78-67580a88dd6d req-ee28fe78-a0a0-4fd5-bb43-d5c00002a2af service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:35.794164 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-e002284f-8acf-4d0c-8f78-67580a88dd6d req-ee28fe78-a0a0-4fd5-bb43-d5c00002a2af service nova] Creating event network-changed:ccb20d83-d32e-4ee7-a699-8e1da8c412f2 for instance 267676e7-8969-4f7b-9e77-da72b8e71a0b on n-h2-860282-1 Oct 04 21:25:35.802616 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-e002284f-8acf-4d0c-8f78-67580a88dd6d req-ee28fe78-a0a0-4fd5-bb43-d5c00002a2af service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063376 Oct 04 21:25:35.808583 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2056/4119] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:35.833503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-f8b301eb-4fba-43aa-ac7d-d7848a5f46d9 req-50d579af-6072-4122-8bc8-352bec7685d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf496d06-f510-4a05-b5c7-3438c434547e", "name": "network-vif-plugged", "status": "completed", "tag": "e3b2e817-8930-4077-a86c-88d50aa94e31"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:35.874064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f8b301eb-4fba-43aa-ac7d-d7848a5f46d9 req-50d579af-6072-4122-8bc8-352bec7685d9 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:35.874587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f8b301eb-4fba-43aa-ac7d-d7848a5f46d9 req-50d579af-6072-4122-8bc8-352bec7685d9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:35.876555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f8b301eb-4fba-43aa-ac7d-d7848a5f46d9 req-50d579af-6072-4122-8bc8-352bec7685d9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:35.909024 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-f8b301eb-4fba-43aa-ac7d-d7848a5f46d9 req-50d579af-6072-4122-8bc8-352bec7685d9 service nova] Creating event network-vif-plugged:e3b2e817-8930-4077-a86c-88d50aa94e31 for instance cf496d06-f510-4a05-b5c7-3438c434547e on n-h1-860282-1 Oct 04 21:25:35.927584 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-f8b301eb-4fba-43aa-ac7d-d7848a5f46d9 req-50d579af-6072-4122-8bc8-352bec7685d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109689 Oct 04 21:25:35.929342 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2057/4120] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:35.935785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4c882f2f-29f1-43cb-a6d5-c0272de83bf7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:35.943839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4c882f2f-29f1-43cb-a6d5-c0272de83bf7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:35.971298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c882f2f-29f1-43cb-a6d5-c0272de83bf7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:35.972110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c882f2f-29f1-43cb-a6d5-c0272de83bf7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:35.972796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c882f2f-29f1-43cb-a6d5-c0272de83bf7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:35.973622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c882f2f-29f1-43cb-a6d5-c0272de83bf7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:35.974038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c882f2f-29f1-43cb-a6d5-c0272de83bf7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:35.974480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c882f2f-29f1-43cb-a6d5-c0272de83bf7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:36.574353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4c882f2f-29f1-43cb-a6d5-c0272de83bf7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:36.582048 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4c882f2f-29f1-43cb-a6d5-c0272de83bf7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1513 microversion: 2.1 time: 0.651122 Oct 04 21:25:36.594451 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2058/4121] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:35 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1513 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:36.601634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e217d5bf-3d22-42c7-9bf9-2a4d437aa47f tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '.version_select at 0x7f57906c4700>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:36.620576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:36.698778 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e217d5bf-3d22-42c7-9bf9-2a4d437aa47f tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447739478" status: 204 len: 0 microversion: 2.32 time: 0.102822 Oct 04 21:25:36.699453 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2059/4122] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Oct 4 21:25:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447739478 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:25:36.704591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4af6db53-fa02-467a-b651-ad3586148b5a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:36.705476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4af6db53-fa02-467a-b651-ad3586148b5a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:36.718119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4af6db53-fa02-467a-b651-ad3586148b5a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:36.718119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4af6db53-fa02-467a-b651-ad3586148b5a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:36.718119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4af6db53-fa02-467a-b651-ad3586148b5a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:36.718119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4af6db53-fa02-467a-b651-ad3586148b5a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:36.718119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4af6db53-fa02-467a-b651-ad3586148b5a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:36.718119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4af6db53-fa02-467a-b651-ad3586148b5a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:37.239461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4af6db53-fa02-467a-b651-ad3586148b5a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:37.250912 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4af6db53-fa02-467a-b651-ad3586148b5a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1509 microversion: 2.1 time: 0.550010 Oct 04 21:25:37.265449 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2060/4123] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:36 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1509 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:37.265449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a1ea896f-8221-4900-9107-a001570719d1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:37.265449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a1ea896f-8221-4900-9107-a001570719d1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:37.272003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1ea896f-8221-4900-9107-a001570719d1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:37.272505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1ea896f-8221-4900-9107-a001570719d1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:37.273019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1ea896f-8221-4900-9107-a001570719d1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:37.274442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1ea896f-8221-4900-9107-a001570719d1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:37.274916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1ea896f-8221-4900-9107-a001570719d1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:37.275363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1ea896f-8221-4900-9107-a001570719d1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:37.559433 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a1ea896f-8221-4900-9107-a001570719d1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:37.568088 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a1ea896f-8221-4900-9107-a001570719d1 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1314 microversion: 2.1 time: 0.308663 Oct 04 21:25:37.573380 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2061/4124] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:37 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:37.579431 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-51b92258-2968-419b-8e8b-5aef7444aaa2 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.486337 Oct 04 21:25:37.580027 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2064/4125] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Oct 4 21:25:33 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:37.594444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2704f725-7907-4cb0-b9b5-b2bc28c2e710 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.40"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:37.597218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2704f725-7907-4cb0-b9b5-b2bc28c2e710 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:37.604147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2704f725-7907-4cb0-b9b5-b2bc28c2e710 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:37.604872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2704f725-7907-4cb0-b9b5-b2bc28c2e710 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:37.605680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2704f725-7907-4cb0-b9b5-b2bc28c2e710 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:37.606675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2704f725-7907-4cb0-b9b5-b2bc28c2e710 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:37.607291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2704f725-7907-4cb0-b9b5-b2bc28c2e710 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:37.607911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2704f725-7907-4cb0-b9b5-b2bc28c2e710 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:37.611240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ee94e935-a623-4ca2-b810-7c2e7d34eb1d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:37.611932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ee94e935-a623-4ca2-b810-7c2e7d34eb1d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:37.621137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee94e935-a623-4ca2-b810-7c2e7d34eb1d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:37.621831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee94e935-a623-4ca2-b810-7c2e7d34eb1d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:37.622378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee94e935-a623-4ca2-b810-7c2e7d34eb1d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:37.623977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee94e935-a623-4ca2-b810-7c2e7d34eb1d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:37.624621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee94e935-a623-4ca2-b810-7c2e7d34eb1d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:37.625272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee94e935-a623-4ca2-b810-7c2e7d34eb1d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:37.636900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2704f725-7907-4cb0-b9b5-b2bc28c2e710 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "refresh_cache-267676e7-8969-4f7b-9e77-da72b8e71a0b" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:25:37.637993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2704f725-7907-4cb0-b9b5-b2bc28c2e710 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquired lock "refresh_cache-267676e7-8969-4f7b-9e77-da72b8e71a0b" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:25:37.958461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ee94e935-a623-4ca2-b810-7c2e7d34eb1d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:37.968440 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ee94e935-a623-4ca2-b810-7c2e7d34eb1d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1513 microversion: 2.1 time: 0.363611 Oct 04 21:25:37.971062 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2065/4126] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:37 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1513 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:38.278878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ea3931fd-efcf-43b7-8885-4a1a86b9c9ce tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:38.279531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ea3931fd-efcf-43b7-8885-4a1a86b9c9ce tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:38.286755 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea3931fd-efcf-43b7-8885-4a1a86b9c9ce tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:38.287594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea3931fd-efcf-43b7-8885-4a1a86b9c9ce tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:38.288200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea3931fd-efcf-43b7-8885-4a1a86b9c9ce tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:38.289170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea3931fd-efcf-43b7-8885-4a1a86b9c9ce tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:38.289860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea3931fd-efcf-43b7-8885-4a1a86b9c9ce tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:38.290511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea3931fd-efcf-43b7-8885-4a1a86b9c9ce tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:39.061258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ea3931fd-efcf-43b7-8885-4a1a86b9c9ce tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:39.077977 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ea3931fd-efcf-43b7-8885-4a1a86b9c9ce tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1509 microversion: 2.1 time: 0.805116 Oct 04 21:25:39.080298 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2066/4127] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:38 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1509 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:39.090023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0de3acee-bd14-457b-80b9-1b2b0fda83d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:39.096321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0de3acee-bd14-457b-80b9-1b2b0fda83d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:39.101851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0de3acee-bd14-457b-80b9-1b2b0fda83d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:39.103624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0de3acee-bd14-457b-80b9-1b2b0fda83d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:39.104310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0de3acee-bd14-457b-80b9-1b2b0fda83d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:39.105924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0de3acee-bd14-457b-80b9-1b2b0fda83d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:39.106604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0de3acee-bd14-457b-80b9-1b2b0fda83d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:39.107714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0de3acee-bd14-457b-80b9-1b2b0fda83d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:39.498154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0de3acee-bd14-457b-80b9-1b2b0fda83d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:39.512367 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0de3acee-bd14-457b-80b9-1b2b0fda83d9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1500 microversion: 2.1 time: 0.428664 Oct 04 21:25:39.514387 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2067/4128] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:39 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1500 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:39.526742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-45cdcb57-f9c9-4ba3-8ea1-753f34bc1f75 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:39.527621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-45cdcb57-f9c9-4ba3-8ea1-753f34bc1f75 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:39.535765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45cdcb57-f9c9-4ba3-8ea1-753f34bc1f75 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:39.536589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45cdcb57-f9c9-4ba3-8ea1-753f34bc1f75 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:39.537722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45cdcb57-f9c9-4ba3-8ea1-753f34bc1f75 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:39.540598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45cdcb57-f9c9-4ba3-8ea1-753f34bc1f75 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:39.541316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45cdcb57-f9c9-4ba3-8ea1-753f34bc1f75 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:39.542180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45cdcb57-f9c9-4ba3-8ea1-753f34bc1f75 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:39.562982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:39.938660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-45cdcb57-f9c9-4ba3-8ea1-753f34bc1f75 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:39.948342 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-45cdcb57-f9c9-4ba3-8ea1-753f34bc1f75 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1513 microversion: 2.1 time: 0.430227 Oct 04 21:25:39.967232 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2068/4129] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:39 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1513 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:39.967232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8abb05ae-0933-44dd-be92-7442010dba30 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:39.967232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8abb05ae-0933-44dd-be92-7442010dba30 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:39.967232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8abb05ae-0933-44dd-be92-7442010dba30 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:39.967232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8abb05ae-0933-44dd-be92-7442010dba30 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:39.967232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8abb05ae-0933-44dd-be92-7442010dba30 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:39.967232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8abb05ae-0933-44dd-be92-7442010dba30 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:39.967232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8abb05ae-0933-44dd-be92-7442010dba30 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:39.967232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8abb05ae-0933-44dd-be92-7442010dba30 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:40.238201 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8abb05ae-0933-44dd-be92-7442010dba30 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e/action" status: 202 len: 0 microversion: 2.1 time: 0.277780 Oct 04 21:25:40.238201 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2069/4130] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:25:39 2022] POST /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:25:40.245161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4cbc1565-642f-40c1-905a-c4bf00578a69 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:40.247195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4cbc1565-642f-40c1-905a-c4bf00578a69 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:40.255078 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cbc1565-642f-40c1-905a-c4bf00578a69 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:40.255726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cbc1565-642f-40c1-905a-c4bf00578a69 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:40.256832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cbc1565-642f-40c1-905a-c4bf00578a69 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:40.257360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cbc1565-642f-40c1-905a-c4bf00578a69 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:40.259459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cbc1565-642f-40c1-905a-c4bf00578a69 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:40.259459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cbc1565-642f-40c1-905a-c4bf00578a69 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:40.791784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-2704f725-7907-4cb0-b9b5-b2bc28c2e710 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Building network info cache for instance {{(pid=122758) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 21:25:40.880082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4cbc1565-642f-40c1-905a-c4bf00578a69 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:40.890088 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4cbc1565-642f-40c1-905a-c4bf00578a69 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1509 microversion: 2.1 time: 0.657991 Oct 04 21:25:40.896473 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2070/4131] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:40 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1509 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:40.900681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bf79a324-7edc-44c1-942a-bfc87fda8547 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:40.904290 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bf79a324-7edc-44c1-942a-bfc87fda8547 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:40.919716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf79a324-7edc-44c1-942a-bfc87fda8547 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:40.921179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf79a324-7edc-44c1-942a-bfc87fda8547 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:40.921867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf79a324-7edc-44c1-942a-bfc87fda8547 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:40.924092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf79a324-7edc-44c1-942a-bfc87fda8547 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:40.924951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf79a324-7edc-44c1-942a-bfc87fda8547 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:40.925739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf79a324-7edc-44c1-942a-bfc87fda8547 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:41.334239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bf79a324-7edc-44c1-942a-bfc87fda8547 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:41.348305 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bf79a324-7edc-44c1-942a-bfc87fda8547 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1485 microversion: 2.1 time: 0.456442 Oct 04 21:25:41.352271 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2071/4132] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:40 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1485 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:41.360382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-f39efab6-42e3-4140-9bd2-49ca72a01d29 req-377c8469-b56c-4f04-9e8b-9ece5312ce82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267676e7-8969-4f7b-9e77-da72b8e71a0b", "tag": "ccb20d83-d32e-4ee7-a699-8e1da8c412f2"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:41.374801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f39efab6-42e3-4140-9bd2-49ca72a01d29 req-377c8469-b56c-4f04-9e8b-9ece5312ce82 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:41.375633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f39efab6-42e3-4140-9bd2-49ca72a01d29 req-377c8469-b56c-4f04-9e8b-9ece5312ce82 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:41.376616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f39efab6-42e3-4140-9bd2-49ca72a01d29 req-377c8469-b56c-4f04-9e8b-9ece5312ce82 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:41.392772 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-f39efab6-42e3-4140-9bd2-49ca72a01d29 req-377c8469-b56c-4f04-9e8b-9ece5312ce82 service nova] Creating event network-changed:ccb20d83-d32e-4ee7-a699-8e1da8c412f2 for instance 267676e7-8969-4f7b-9e77-da72b8e71a0b on n-h2-860282-1 Oct 04 21:25:41.400378 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-f39efab6-42e3-4140-9bd2-49ca72a01d29 req-377c8469-b56c-4f04-9e8b-9ece5312ce82 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045147 Oct 04 21:25:41.401538 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2072/4133] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:41.409009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9c0651c4-f7aa-4c64-926e-d01c37c79671 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:41.410091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9c0651c4-f7aa-4c64-926e-d01c37c79671 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:41.436938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c0651c4-f7aa-4c64-926e-d01c37c79671 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:41.437600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c0651c4-f7aa-4c64-926e-d01c37c79671 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:41.438069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c0651c4-f7aa-4c64-926e-d01c37c79671 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:41.438963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c0651c4-f7aa-4c64-926e-d01c37c79671 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:41.439297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c0651c4-f7aa-4c64-926e-d01c37c79671 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:41.439709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c0651c4-f7aa-4c64-926e-d01c37c79671 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:42.057995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9c0651c4-f7aa-4c64-926e-d01c37c79671 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:42.068670 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9c0651c4-f7aa-4c64-926e-d01c37c79671 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1513 microversion: 2.1 time: 0.665519 Oct 04 21:25:42.069942 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2073/4134] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:41 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1513 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:42.076355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-979f0ae7-4202-4750-8d3d-4c030d9ef6a9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:42.077449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-979f0ae7-4202-4750-8d3d-4c030d9ef6a9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:42.086091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-979f0ae7-4202-4750-8d3d-4c030d9ef6a9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:42.087055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-979f0ae7-4202-4750-8d3d-4c030d9ef6a9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:42.087813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-979f0ae7-4202-4750-8d3d-4c030d9ef6a9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:42.088737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-979f0ae7-4202-4750-8d3d-4c030d9ef6a9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:42.089408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-979f0ae7-4202-4750-8d3d-4c030d9ef6a9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:42.090125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-979f0ae7-4202-4750-8d3d-4c030d9ef6a9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:42.140895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-979f0ae7-4202-4750-8d3d-4c030d9ef6a9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lazy-loading 'flavor' on Instance uuid cf496d06-f510-4a05-b5c7-3438c434547e {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:25:42.352891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-2704f725-7907-4cb0-b9b5-b2bc28c2e710 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Updating instance_info_cache with network_info: [{"id": "ccb20d83-d32e-4ee7-a699-8e1da8c412f2", "address": "fa:16:3e:b7:36:f7", "network": {"id": "229bd47e-32c9-4450-8024-6e4476d37819", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1993840493-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0204517be8de4897977dba0343060ea9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapccb20d83-d3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122758) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:25:42.525967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2704f725-7907-4cb0-b9b5-b2bc28c2e710 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Releasing lock "refresh_cache-267676e7-8969-4f7b-9e77-da72b8e71a0b" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:25:42.552131 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2704f725-7907-4cb0-b9b5-b2bc28c2e710 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "POST /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b/action" status: 202 len: 0 microversion: 2.1 time: 4.961814 Oct 04 21:25:42.554795 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2062/4135] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:25:37 2022] POST /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b/action => generated 0 bytes in 4964 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 21:25:42.568753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-64491c92-f5f0-44ac-b61e-7adb97479e11 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:42.574240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-64491c92-f5f0-44ac-b61e-7adb97479e11 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:42.598709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64491c92-f5f0-44ac-b61e-7adb97479e11 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:42.598709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64491c92-f5f0-44ac-b61e-7adb97479e11 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:42.598709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64491c92-f5f0-44ac-b61e-7adb97479e11 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:42.598709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64491c92-f5f0-44ac-b61e-7adb97479e11 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:42.600570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64491c92-f5f0-44ac-b61e-7adb97479e11 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:42.603516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64491c92-f5f0-44ac-b61e-7adb97479e11 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:43.008389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-64491c92-f5f0-44ac-b61e-7adb97479e11 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:43.026116 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-64491c92-f5f0-44ac-b61e-7adb97479e11 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1530 microversion: 2.1 time: 0.469943 Oct 04 21:25:43.027400 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2063/4136] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:42 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1530 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:43.032533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1d8f6e1f-7c79-466d-b337-7d76ad00ea96 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.40"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:43.038312 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-979f0ae7-4202-4750-8d3d-4c030d9ef6a9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e/action" status: 202 len: 0 microversion: 2.1 time: 0.966606 Oct 04 21:25:43.039124 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2074/4137] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:25:42 2022] POST /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e/action => generated 0 bytes in 968 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:25:43.055212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-76f1ed0d-6a70-497a-a293-909f1cb50849 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:43.056255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-76f1ed0d-6a70-497a-a293-909f1cb50849 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:43.063917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76f1ed0d-6a70-497a-a293-909f1cb50849 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:43.065005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76f1ed0d-6a70-497a-a293-909f1cb50849 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:43.065653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76f1ed0d-6a70-497a-a293-909f1cb50849 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:43.066634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76f1ed0d-6a70-497a-a293-909f1cb50849 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:43.067462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76f1ed0d-6a70-497a-a293-909f1cb50849 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:43.068118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76f1ed0d-6a70-497a-a293-909f1cb50849 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:43.559101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1d8f6e1f-7c79-466d-b337-7d76ad00ea96 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:43.565693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d8f6e1f-7c79-466d-b337-7d76ad00ea96 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:43.566347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d8f6e1f-7c79-466d-b337-7d76ad00ea96 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:43.566901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d8f6e1f-7c79-466d-b337-7d76ad00ea96 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:43.570146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d8f6e1f-7c79-466d-b337-7d76ad00ea96 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:43.571117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d8f6e1f-7c79-466d-b337-7d76ad00ea96 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:43.571696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d8f6e1f-7c79-466d-b337-7d76ad00ea96 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:43.580751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:43.596992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-76f1ed0d-6a70-497a-a293-909f1cb50849 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:43.610272 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-76f1ed0d-6a70-497a-a293-909f1cb50849 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1491 microversion: 2.1 time: 0.559252 Oct 04 21:25:43.614658 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2075/4138] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:43 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1491 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:43.619547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5f2f5fa1-ee8b-4a10-8627-d0f491fe1a15 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:43.620434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5f2f5fa1-ee8b-4a10-8627-d0f491fe1a15 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:43.628269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f2f5fa1-ee8b-4a10-8627-d0f491fe1a15 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:43.629053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f2f5fa1-ee8b-4a10-8627-d0f491fe1a15 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:43.629824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f2f5fa1-ee8b-4a10-8627-d0f491fe1a15 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:43.630745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f2f5fa1-ee8b-4a10-8627-d0f491fe1a15 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:43.631383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f2f5fa1-ee8b-4a10-8627-d0f491fe1a15 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:43.631912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f2f5fa1-ee8b-4a10-8627-d0f491fe1a15 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:44.035855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5f2f5fa1-ee8b-4a10-8627-d0f491fe1a15 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:44.048300 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5f2f5fa1-ee8b-4a10-8627-d0f491fe1a15 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1513 microversion: 2.1 time: 0.435054 Oct 04 21:25:44.050108 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2076/4139] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:43 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1513 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:44.071863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5e66e0b2-79ff-4ac4-98f7-8d983f855f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:44.078601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5e66e0b2-79ff-4ac4-98f7-8d983f855f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:44.089899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e66e0b2-79ff-4ac4-98f7-8d983f855f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:44.090582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e66e0b2-79ff-4ac4-98f7-8d983f855f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:44.094129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e66e0b2-79ff-4ac4-98f7-8d983f855f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:44.095054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e66e0b2-79ff-4ac4-98f7-8d983f855f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:44.095650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e66e0b2-79ff-4ac4-98f7-8d983f855f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:44.096848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e66e0b2-79ff-4ac4-98f7-8d983f855f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:44.102733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d8f6e1f-7c79-466d-b337-7d76ad00ea96 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "refresh_cache-267676e7-8969-4f7b-9e77-da72b8e71a0b" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:25:44.103440 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d8f6e1f-7c79-466d-b337-7d76ad00ea96 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquired lock "refresh_cache-267676e7-8969-4f7b-9e77-da72b8e71a0b" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:25:44.843375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5e66e0b2-79ff-4ac4-98f7-8d983f855f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:44.852214 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5e66e0b2-79ff-4ac4-98f7-8d983f855f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1530 microversion: 2.1 time: 0.795482 Oct 04 21:25:44.856362 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2077/4140] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:44 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1530 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:25:44.870588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e233a35a-fe88-4501-84cd-9cb9e9b13000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:44.871408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e233a35a-fe88-4501-84cd-9cb9e9b13000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:44.888149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e233a35a-fe88-4501-84cd-9cb9e9b13000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:44.889094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e233a35a-fe88-4501-84cd-9cb9e9b13000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:44.889783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e233a35a-fe88-4501-84cd-9cb9e9b13000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:44.890695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e233a35a-fe88-4501-84cd-9cb9e9b13000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:44.891346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e233a35a-fe88-4501-84cd-9cb9e9b13000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:44.891959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e233a35a-fe88-4501-84cd-9cb9e9b13000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:44.918275 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-e233a35a-fe88-4501-84cd-9cb9e9b13000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] HTTP exception thrown: Instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 could not be found. Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e233a35a-fe88-4501-84cd-9cb9e9b13000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Request method failure captured: Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 HTTP/1.1 Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKLStfemsjJYuIes-iRVOH29yHbr634iSFIgRBy2M0zsDK8lMLDNzFzrAg2tZ5byoVMc2iDH_PaaDZ-4UTcRYPQRtkSQUp-Lc8Rn4TLQatlGDlTsrPnWUZUFH4DETcJezHbj7lKzfeDfgW7sWcpTekMaaqTf8P_5GdHaPg-Z4vC90KU Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: b1bcb8b6a67e463d9cec9f0aa581c2e5 Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TaggedBootDevicesTest-1780310521 Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b1bcb8b6a67e463d9cec9f0aa581c2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b1bcb8b6a67e463d9cec9f0aa581c2e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b1bcb8b6a67e463d9cec9f0aa581c2e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b1bcb8b6a67e463d9cec9f0aa581c2e5"}]}] Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TaggedBootDevicesTest-1780310521 Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: b1bcb8b6a67e463d9cec9f0aa581c2e5 Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1780310521 Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TaggedBootDevicesTest-1780310521-project Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: f7d792ce0a9f4f6da9406759dd9d665c Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TaggedBootDevicesTest-1780310521-project Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 could not be found. Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'aa7b2ecc-1ade-4b25-afa0-abcab1c3def0'} Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 could not be found. Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:25:44.922635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:25:44.928142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 could not be found. Oct 04 21:25:44.928142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:25:44.928142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:25:44.928142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:25:44.928142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:25:44.928142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:25:44.928142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:25:44.928142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:25:44.928142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:25:44.928142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 could not be found. Oct 04 21:25:44.928142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:25:44.928142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e233a35a-fe88-4501-84cd-9cb9e9b13000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Returning 404 to user: Instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:25:44.928142 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e233a35a-fe88-4501-84cd-9cb9e9b13000 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 404 len: 111 microversion: 2.32 time: 0.059307 Oct 04 21:25:44.934193 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2078/4141] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:25:44 2022] DELETE /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:25:44.940399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2d50cd3a-7b84-4bb8-8990-3fa40d2db1c4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:44.941027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2d50cd3a-7b84-4bb8-8990-3fa40d2db1c4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:44.958162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d50cd3a-7b84-4bb8-8990-3fa40d2db1c4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:44.958758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d50cd3a-7b84-4bb8-8990-3fa40d2db1c4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:44.959297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d50cd3a-7b84-4bb8-8990-3fa40d2db1c4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:44.965307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d50cd3a-7b84-4bb8-8990-3fa40d2db1c4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:44.966074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d50cd3a-7b84-4bb8-8990-3fa40d2db1c4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:44.966684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d50cd3a-7b84-4bb8-8990-3fa40d2db1c4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:45.170261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2d50cd3a-7b84-4bb8-8990-3fa40d2db1c4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:45.179529 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2d50cd3a-7b84-4bb8-8990-3fa40d2db1c4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1512 microversion: 2.1 time: 0.243579 Oct 04 21:25:45.180214 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2079/4142] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:44 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1512 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:45.184935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-982efa2e-a5d8-4b6e-a058-a4bd8b709522 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:45.185818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-982efa2e-a5d8-4b6e-a058-a4bd8b709522 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] [instance: aa7b2ecc-1ade-4b25-afa0-abcab1c3def0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:45.192593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-982efa2e-a5d8-4b6e-a058-a4bd8b709522 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:45.193364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-982efa2e-a5d8-4b6e-a058-a4bd8b709522 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:45.194042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-982efa2e-a5d8-4b6e-a058-a4bd8b709522 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:45.195610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-982efa2e-a5d8-4b6e-a058-a4bd8b709522 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:45.196280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-982efa2e-a5d8-4b6e-a058-a4bd8b709522 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:45.196921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-982efa2e-a5d8-4b6e-a058-a4bd8b709522 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:45.214135 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-982efa2e-a5d8-4b6e-a058-a4bd8b709522 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] HTTP exception thrown: Instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 could not be found. Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-982efa2e-a5d8-4b6e-a058-a4bd8b709522 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Request method failure captured: Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 HTTP/1.1 Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKLStfemsjJYuIes-iRVOH29yHbr634iSFIgRBy2M0zsDK8lMLDNzFzrAg2tZ5byoVMc2iDH_PaaDZ-4UTcRYPQRtkSQUp-Lc8Rn4TLQatlGDlTsrPnWUZUFH4DETcJezHbj7lKzfeDfgW7sWcpTekMaaqTf8P_5GdHaPg-Z4vC90KU Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: b1bcb8b6a67e463d9cec9f0aa581c2e5 Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TaggedBootDevicesTest-1780310521 Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b1bcb8b6a67e463d9cec9f0aa581c2e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b1bcb8b6a67e463d9cec9f0aa581c2e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b1bcb8b6a67e463d9cec9f0aa581c2e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b1bcb8b6a67e463d9cec9f0aa581c2e5"}]}] Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TaggedBootDevicesTest-1780310521 Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: b1bcb8b6a67e463d9cec9f0aa581c2e5 Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1780310521 Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TaggedBootDevicesTest-1780310521-project Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: f7d792ce0a9f4f6da9406759dd9d665c Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TaggedBootDevicesTest-1780310521-project Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 could not be found. Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'aa7b2ecc-1ade-4b25-afa0-abcab1c3def0'} Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 could not be found. Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 could not be found. Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:25:45.216083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:25:45.220518 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:25:45.220518 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:25:45.220518 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:25:45.220518 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:25:45.220518 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:25:45.220518 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:25:45.220518 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 could not be found. Oct 04 21:25:45.220518 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:25:45.223179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-982efa2e-a5d8-4b6e-a058-a4bd8b709522 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] Returning 404 to user: Instance aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:25:45.224195 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-982efa2e-a5d8-4b6e-a058-a4bd8b709522 tempest-TaggedBootDevicesTest-1780310521 tempest-TaggedBootDevicesTest-1780310521-project] 10.222.0.30 "GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0" status: 404 len: 111 microversion: 2.32 time: 0.042819 Oct 04 21:25:45.225279 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2080/4143] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:45 2022] GET /compute/v2.1/servers/aa7b2ecc-1ade-4b25-afa0-abcab1c3def0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:25:45.234324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-453cc942-479d-4e35-9447-ec2ab0c96ebb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:45.234324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-453cc942-479d-4e35-9447-ec2ab0c96ebb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:45.260351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-453cc942-479d-4e35-9447-ec2ab0c96ebb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:45.260854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-453cc942-479d-4e35-9447-ec2ab0c96ebb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:45.261506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-453cc942-479d-4e35-9447-ec2ab0c96ebb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:45.280051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-453cc942-479d-4e35-9447-ec2ab0c96ebb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:45.280657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-453cc942-479d-4e35-9447-ec2ab0c96ebb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:45.284610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-453cc942-479d-4e35-9447-ec2ab0c96ebb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:45.897310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-453cc942-479d-4e35-9447-ec2ab0c96ebb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:45.908999 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-453cc942-479d-4e35-9447-ec2ab0c96ebb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1513 microversion: 2.1 time: 0.679858 Oct 04 21:25:45.910107 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2081/4144] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:45 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1513 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:45.918130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bac8d9f5-5d1e-4c75-8166-553889962fa4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:45.919306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bac8d9f5-5d1e-4c75-8166-553889962fa4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:45.943018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bac8d9f5-5d1e-4c75-8166-553889962fa4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:45.943895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bac8d9f5-5d1e-4c75-8166-553889962fa4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:45.949650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bac8d9f5-5d1e-4c75-8166-553889962fa4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:45.950679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bac8d9f5-5d1e-4c75-8166-553889962fa4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:45.951369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bac8d9f5-5d1e-4c75-8166-553889962fa4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:45.952359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bac8d9f5-5d1e-4c75-8166-553889962fa4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:46.783233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-1d8f6e1f-7c79-466d-b337-7d76ad00ea96 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Building network info cache for instance {{(pid=122758) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 21:25:47.043188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bac8d9f5-5d1e-4c75-8166-553889962fa4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:47.061919 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bac8d9f5-5d1e-4c75-8166-553889962fa4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1525 microversion: 2.1 time: 1.149712 Oct 04 21:25:47.069018 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2082/4145] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:45 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1525 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:47.089098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2312f7df-4f5f-4e44-ac75-3939652b4e16 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:47.091775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2312f7df-4f5f-4e44-ac75-3939652b4e16 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:47.100173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2312f7df-4f5f-4e44-ac75-3939652b4e16 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:47.100957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2312f7df-4f5f-4e44-ac75-3939652b4e16 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:47.101642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2312f7df-4f5f-4e44-ac75-3939652b4e16 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:47.102766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2312f7df-4f5f-4e44-ac75-3939652b4e16 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:47.104651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2312f7df-4f5f-4e44-ac75-3939652b4e16 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:47.105325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2312f7df-4f5f-4e44-ac75-3939652b4e16 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:47.510673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2312f7df-4f5f-4e44-ac75-3939652b4e16 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:47.556453 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2312f7df-4f5f-4e44-ac75-3939652b4e16 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1507 microversion: 2.1 time: 0.471718 Oct 04 21:25:47.573576 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2083/4146] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:47 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1507 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:47.578992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-cfa9125e-48d5-4698-bb70-53f90b8d9249 req-8da2df18-370e-4c9e-8922-1679d46dc289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267676e7-8969-4f7b-9e77-da72b8e71a0b", "tag": "ccb20d83-d32e-4ee7-a699-8e1da8c412f2"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:47.615452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cfa9125e-48d5-4698-bb70-53f90b8d9249 req-8da2df18-370e-4c9e-8922-1679d46dc289 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:47.618109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cfa9125e-48d5-4698-bb70-53f90b8d9249 req-8da2df18-370e-4c9e-8922-1679d46dc289 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:47.623963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cfa9125e-48d5-4698-bb70-53f90b8d9249 req-8da2df18-370e-4c9e-8922-1679d46dc289 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:47.655760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:47.659504 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-cfa9125e-48d5-4698-bb70-53f90b8d9249 req-8da2df18-370e-4c9e-8922-1679d46dc289 service nova] Creating event network-changed:ccb20d83-d32e-4ee7-a699-8e1da8c412f2 for instance 267676e7-8969-4f7b-9e77-da72b8e71a0b on n-h2-860282-1 Oct 04 21:25:47.666865 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-cfa9125e-48d5-4698-bb70-53f90b8d9249 req-8da2df18-370e-4c9e-8922-1679d46dc289 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102534 Oct 04 21:25:47.667729 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2084/4147] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:47.674669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-60f7069c-4bd8-4d43-8294-50eea54c6854 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:47.675736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-60f7069c-4bd8-4d43-8294-50eea54c6854 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:47.704952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60f7069c-4bd8-4d43-8294-50eea54c6854 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:47.710312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60f7069c-4bd8-4d43-8294-50eea54c6854 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:47.710312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60f7069c-4bd8-4d43-8294-50eea54c6854 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:47.710312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60f7069c-4bd8-4d43-8294-50eea54c6854 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:47.710312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60f7069c-4bd8-4d43-8294-50eea54c6854 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:47.710312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60f7069c-4bd8-4d43-8294-50eea54c6854 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:48.753153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-1d8f6e1f-7c79-466d-b337-7d76ad00ea96 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Updating instance_info_cache with network_info: [{"id": "ccb20d83-d32e-4ee7-a699-8e1da8c412f2", "address": "fa:16:3e:b7:36:f7", "network": {"id": "229bd47e-32c9-4450-8024-6e4476d37819", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1993840493-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0204517be8de4897977dba0343060ea9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapccb20d83-d3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122758) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:25:48.892474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d8f6e1f-7c79-466d-b337-7d76ad00ea96 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Releasing lock "refresh_cache-267676e7-8969-4f7b-9e77-da72b8e71a0b" {{(pid=122758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:25:48.893561 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1d8f6e1f-7c79-466d-b337-7d76ad00ea96 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "POST /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b/action" status: 202 len: 0 microversion: 2.1 time: 5.864883 Oct 04 21:25:48.894441 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2064/4148] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:25:43 2022] POST /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b/action => generated 0 bytes in 5866 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 21:25:48.900629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ce13b2f9-c229-4adc-9cd8-bf967a811a8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:48.905987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ce13b2f9-c229-4adc-9cd8-bf967a811a8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:48.932046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce13b2f9-c229-4adc-9cd8-bf967a811a8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:48.936746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce13b2f9-c229-4adc-9cd8-bf967a811a8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:48.946421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce13b2f9-c229-4adc-9cd8-bf967a811a8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:48.954784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce13b2f9-c229-4adc-9cd8-bf967a811a8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:48.955409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce13b2f9-c229-4adc-9cd8-bf967a811a8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:48.957547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce13b2f9-c229-4adc-9cd8-bf967a811a8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:48.965923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-60f7069c-4bd8-4d43-8294-50eea54c6854 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:48.978522 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-60f7069c-4bd8-4d43-8294-50eea54c6854 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1513 microversion: 2.1 time: 1.309225 Oct 04 21:25:48.985829 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2085/4149] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:47 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1513 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:48.998555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d033568e-f6ba-4b21-b0a7-89cf1394da13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:49.032790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d033568e-f6ba-4b21-b0a7-89cf1394da13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:49.041749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d033568e-f6ba-4b21-b0a7-89cf1394da13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:49.044736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d033568e-f6ba-4b21-b0a7-89cf1394da13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:49.045479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d033568e-f6ba-4b21-b0a7-89cf1394da13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:49.046448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d033568e-f6ba-4b21-b0a7-89cf1394da13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:49.047627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d033568e-f6ba-4b21-b0a7-89cf1394da13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:49.048317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d033568e-f6ba-4b21-b0a7-89cf1394da13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:49.527301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ce13b2f9-c229-4adc-9cd8-bf967a811a8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:49.547241 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ce13b2f9-c229-4adc-9cd8-bf967a811a8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1525 microversion: 2.1 time: 0.646963 Oct 04 21:25:49.548410 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2065/4150] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:48 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1525 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:49.572248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-47c65ef9-2826-4b96-901a-38d7464a60a1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '.version_select at 0x7f57909253a0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:49.715003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d033568e-f6ba-4b21-b0a7-89cf1394da13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:49.723929 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d033568e-f6ba-4b21-b0a7-89cf1394da13 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1507 microversion: 2.1 time: 0.737515 Oct 04 21:25:49.745976 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2086/4151] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:48 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1507 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:50.011592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a9f0cb0d-8c3d-488e-924c-10d2de9e3c44 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:50.013070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a9f0cb0d-8c3d-488e-924c-10d2de9e3c44 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:50.030283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9f0cb0d-8c3d-488e-924c-10d2de9e3c44 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:50.043043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9f0cb0d-8c3d-488e-924c-10d2de9e3c44 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:50.052528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9f0cb0d-8c3d-488e-924c-10d2de9e3c44 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:50.053684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9f0cb0d-8c3d-488e-924c-10d2de9e3c44 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:50.056164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9f0cb0d-8c3d-488e-924c-10d2de9e3c44 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:50.056876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9f0cb0d-8c3d-488e-924c-10d2de9e3c44 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:50.854815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a9f0cb0d-8c3d-488e-924c-10d2de9e3c44 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:50.868878 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a9f0cb0d-8c3d-488e-924c-10d2de9e3c44 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1513 microversion: 2.1 time: 0.862130 Oct 04 21:25:50.877782 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2087/4152] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:50 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1513 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:25:50.893902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1c1cc62a-e549-40d0-a6e8-7ec221348993 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:50.899171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1c1cc62a-e549-40d0-a6e8-7ec221348993 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:50.932656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c1cc62a-e549-40d0-a6e8-7ec221348993 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:50.933506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c1cc62a-e549-40d0-a6e8-7ec221348993 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:50.934201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c1cc62a-e549-40d0-a6e8-7ec221348993 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:50.935132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c1cc62a-e549-40d0-a6e8-7ec221348993 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:50.938029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c1cc62a-e549-40d0-a6e8-7ec221348993 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:50.941307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c1cc62a-e549-40d0-a6e8-7ec221348993 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:52.249825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1c1cc62a-e549-40d0-a6e8-7ec221348993 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:52.266565 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1c1cc62a-e549-40d0-a6e8-7ec221348993 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1525 microversion: 2.1 time: 1.387224 Oct 04 21:25:52.271440 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2088/4153] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:50 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1525 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:52.294778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-47e8d944-215b-439d-b20a-1e5b94c1aed8 req-e4c29dd8-d61d-4240-acaa-30429631d5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f7b402-4b3a-4a39-8686-9e9b36f9e040", "name": "network-vif-plugged", "status": "completed", "tag": "c883d4ee-a39d-4507-8568-f4e4fd4c7cd3"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:52.335406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=82 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:52.339872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-47e8d944-215b-439d-b20a-1e5b94c1aed8 req-e4c29dd8-d61d-4240-acaa-30429631d5e6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:52.345005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-47e8d944-215b-439d-b20a-1e5b94c1aed8 req-e4c29dd8-d61d-4240-acaa-30429631d5e6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:52.350326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-47e8d944-215b-439d-b20a-1e5b94c1aed8 req-e4c29dd8-d61d-4240-acaa-30429631d5e6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:52.392480 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-47e8d944-215b-439d-b20a-1e5b94c1aed8 req-e4c29dd8-d61d-4240-acaa-30429631d5e6 service nova] Creating event network-vif-plugged:c883d4ee-a39d-4507-8568-f4e4fd4c7cd3 for instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 on n-h1-860282-1 Oct 04 21:25:52.411460 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-47e8d944-215b-439d-b20a-1e5b94c1aed8 req-e4c29dd8-d61d-4240-acaa-30429631d5e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141677 Oct 04 21:25:52.419863 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2089/4154] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:52.432734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f3cf9037-f6a8-4b5d-9c7b-edfd34efc7c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:52.442364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f3cf9037-f6a8-4b5d-9c7b-edfd34efc7c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:52.469044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3cf9037-f6a8-4b5d-9c7b-edfd34efc7c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:52.471669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3cf9037-f6a8-4b5d-9c7b-edfd34efc7c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:52.471669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3cf9037-f6a8-4b5d-9c7b-edfd34efc7c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:52.471669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3cf9037-f6a8-4b5d-9c7b-edfd34efc7c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:52.472094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3cf9037-f6a8-4b5d-9c7b-edfd34efc7c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:52.472185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3cf9037-f6a8-4b5d-9c7b-edfd34efc7c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:53.844064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f3cf9037-f6a8-4b5d-9c7b-edfd34efc7c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:53.861475 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f3cf9037-f6a8-4b5d-9c7b-edfd34efc7c2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1507 microversion: 2.1 time: 1.437820 Oct 04 21:25:53.869782 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2090/4155] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:52 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1507 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:53.881361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bec2cb72-07bd-4b09-a9cc-5f7171e0e97a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:53.887055 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-47c65ef9-2826-4b96-901a-38d7464a60a1 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/98af9af2-5a17-4f00-986e-87c8b3aa9a0d" status: 202 len: 0 microversion: 2.1 time: 4.334463 Oct 04 21:25:53.888557 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2066/4156] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Oct 4 21:25:49 2022] DELETE /compute/v2.1/os-floating-ips/98af9af2-5a17-4f00-986e-87c8b3aa9a0d => generated 0 bytes in 4339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:25:53.889701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bec2cb72-07bd-4b09-a9cc-5f7171e0e97a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:53.898484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e2a727d8-95e6-4390-a674-67526b9c8e4a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:53.899287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e2a727d8-95e6-4390-a674-67526b9c8e4a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:53.912076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bec2cb72-07bd-4b09-a9cc-5f7171e0e97a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:53.918025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bec2cb72-07bd-4b09-a9cc-5f7171e0e97a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:53.920445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bec2cb72-07bd-4b09-a9cc-5f7171e0e97a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:53.921993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bec2cb72-07bd-4b09-a9cc-5f7171e0e97a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:53.923919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bec2cb72-07bd-4b09-a9cc-5f7171e0e97a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:53.925442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2a727d8-95e6-4390-a674-67526b9c8e4a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:53.925955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2a727d8-95e6-4390-a674-67526b9c8e4a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:53.926400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2a727d8-95e6-4390-a674-67526b9c8e4a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:53.927121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2a727d8-95e6-4390-a674-67526b9c8e4a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:53.927582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2a727d8-95e6-4390-a674-67526b9c8e4a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:53.930393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bec2cb72-07bd-4b09-a9cc-5f7171e0e97a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:53.940519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2a727d8-95e6-4390-a674-67526b9c8e4a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:55.450033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bec2cb72-07bd-4b09-a9cc-5f7171e0e97a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:55.466637 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bec2cb72-07bd-4b09-a9cc-5f7171e0e97a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1513 microversion: 2.1 time: 1.593892 Oct 04 21:25:55.485890 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2091/4157] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:53 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1513 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:55.499848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eeb99267-5511-4c34-8111-2290e614960e tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '.version_select at 0x7f578b555550>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:55.722351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e2a727d8-95e6-4390-a674-67526b9c8e4a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:55.735382 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e2a727d8-95e6-4390-a674-67526b9c8e4a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1525 microversion: 2.1 time: 1.841577 Oct 04 21:25:55.736639 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2067/4158] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:53 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1525 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:55.744340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-4ec13388-151e-481a-b122-c5438188f8e4 req-3557a42b-d826-43b8-b2cf-89e214e1c3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf496d06-f510-4a05-b5c7-3438c434547e", "name": "network-vif-plugged", "status": "completed", "tag": "e3b2e817-8930-4077-a86c-88d50aa94e31"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:55.767299 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4ec13388-151e-481a-b122-c5438188f8e4 req-3557a42b-d826-43b8-b2cf-89e214e1c3b6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:55.771349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4ec13388-151e-481a-b122-c5438188f8e4 req-3557a42b-d826-43b8-b2cf-89e214e1c3b6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:55.772058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4ec13388-151e-481a-b122-c5438188f8e4 req-3557a42b-d826-43b8-b2cf-89e214e1c3b6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:55.810609 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-4ec13388-151e-481a-b122-c5438188f8e4 req-3557a42b-d826-43b8-b2cf-89e214e1c3b6 service nova] Creating event network-vif-plugged:e3b2e817-8930-4077-a86c-88d50aa94e31 for instance cf496d06-f510-4a05-b5c7-3438c434547e on n-h1-860282-1 Oct 04 21:25:55.824553 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-4ec13388-151e-481a-b122-c5438188f8e4 req-3557a42b-d826-43b8-b2cf-89e214e1c3b6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086113 Oct 04 21:25:55.828183 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2068/4159] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:55.847185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d44257a3-5b7d-4324-aabc-94b44af40c73 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:55.849048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d44257a3-5b7d-4324-aabc-94b44af40c73 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:55.873212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d44257a3-5b7d-4324-aabc-94b44af40c73 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:55.874163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d44257a3-5b7d-4324-aabc-94b44af40c73 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:55.874929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d44257a3-5b7d-4324-aabc-94b44af40c73 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:55.875946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d44257a3-5b7d-4324-aabc-94b44af40c73 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:55.876644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d44257a3-5b7d-4324-aabc-94b44af40c73 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:55.881410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d44257a3-5b7d-4324-aabc-94b44af40c73 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:56.791600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d44257a3-5b7d-4324-aabc-94b44af40c73 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:56.827709 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d44257a3-5b7d-4324-aabc-94b44af40c73 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1507 microversion: 2.1 time: 0.995532 Oct 04 21:25:56.829697 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2069/4160] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:55 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1507 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:56.854115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bce898be-df47-4ab0-9f31-187eb0fa5026 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:56.855227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bce898be-df47-4ab0-9f31-187eb0fa5026 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:56.911356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bce898be-df47-4ab0-9f31-187eb0fa5026 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:56.911861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bce898be-df47-4ab0-9f31-187eb0fa5026 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:56.918032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bce898be-df47-4ab0-9f31-187eb0fa5026 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:56.920672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bce898be-df47-4ab0-9f31-187eb0fa5026 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:56.945172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bce898be-df47-4ab0-9f31-187eb0fa5026 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:56.948113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bce898be-df47-4ab0-9f31-187eb0fa5026 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:57.042500 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eeb99267-5511-4c34-8111-2290e614960e tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/57162e48-f0ee-4c4d-b378-1ec5e316074f" status: 202 len: 0 microversion: 2.1 time: 1.554977 Oct 04 21:25:57.043405 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2092/4161] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:25:55 2022] DELETE /compute/v2.1/os-security-groups/57162e48-f0ee-4c4d-b378-1ec5e316074f => generated 0 bytes in 1557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:25:57.048675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f0f1d873-92bf-432f-bf4c-ce9fc74c8c9f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:57.049590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f0f1d873-92bf-432f-bf4c-ce9fc74c8c9f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:57.071434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0f1d873-92bf-432f-bf4c-ce9fc74c8c9f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:57.072789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0f1d873-92bf-432f-bf4c-ce9fc74c8c9f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:57.077956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0f1d873-92bf-432f-bf4c-ce9fc74c8c9f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:57.078963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0f1d873-92bf-432f-bf4c-ce9fc74c8c9f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:57.079595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0f1d873-92bf-432f-bf4c-ce9fc74c8c9f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:57.080205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0f1d873-92bf-432f-bf4c-ce9fc74c8c9f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:57.323716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bce898be-df47-4ab0-9f31-187eb0fa5026 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:57.334096 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bce898be-df47-4ab0-9f31-187eb0fa5026 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1513 microversion: 2.1 time: 0.502752 Oct 04 21:25:57.340726 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2070/4162] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:56 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1513 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:57.353232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8cf02e75-1d2a-4000-a6a2-8243d019b8ed tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:57.356246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8cf02e75-1d2a-4000-a6a2-8243d019b8ed tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:57.373049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cf02e75-1d2a-4000-a6a2-8243d019b8ed tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:57.376964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cf02e75-1d2a-4000-a6a2-8243d019b8ed tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:57.378416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cf02e75-1d2a-4000-a6a2-8243d019b8ed tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:57.381410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cf02e75-1d2a-4000-a6a2-8243d019b8ed tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:57.383640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cf02e75-1d2a-4000-a6a2-8243d019b8ed tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:57.385644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cf02e75-1d2a-4000-a6a2-8243d019b8ed tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:57.509029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8cf02e75-1d2a-4000-a6a2-8243d019b8ed tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:25:57.556254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f0f1d873-92bf-432f-bf4c-ce9fc74c8c9f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:57.572712 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f0f1d873-92bf-432f-bf4c-ce9fc74c8c9f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1525 microversion: 2.1 time: 0.527717 Oct 04 21:25:57.599166 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2093/4163] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:57 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1525 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:57.860699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a1f18822-6428-455f-a33e-c150302fb67b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:57.861345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a1f18822-6428-455f-a33e-c150302fb67b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:57.872830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1f18822-6428-455f-a33e-c150302fb67b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:57.876998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1f18822-6428-455f-a33e-c150302fb67b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:57.883329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1f18822-6428-455f-a33e-c150302fb67b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:57.884149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1f18822-6428-455f-a33e-c150302fb67b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:57.898481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1f18822-6428-455f-a33e-c150302fb67b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:57.898960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1f18822-6428-455f-a33e-c150302fb67b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:58.167302 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8cf02e75-1d2a-4000-a6a2-8243d019b8ed tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "DELETE /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 204 len: 0 microversion: 2.1 time: 0.824963 Oct 04 21:25:58.172626 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2071/4164] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:25:57 2022] DELETE /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 0 bytes in 828 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:25:58.183307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f4df429a-3ab7-4604-92aa-6ff25de3d7ba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:58.184454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f4df429a-3ab7-4604-92aa-6ff25de3d7ba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:58.199987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f4df429a-3ab7-4604-92aa-6ff25de3d7ba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:58.200816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f4df429a-3ab7-4604-92aa-6ff25de3d7ba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:58.202530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f4df429a-3ab7-4604-92aa-6ff25de3d7ba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:58.204693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f4df429a-3ab7-4604-92aa-6ff25de3d7ba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:58.205379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f4df429a-3ab7-4604-92aa-6ff25de3d7ba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:58.206745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f4df429a-3ab7-4604-92aa-6ff25de3d7ba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:58.539733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a1f18822-6428-455f-a33e-c150302fb67b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:58.549977 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a1f18822-6428-455f-a33e-c150302fb67b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1507 microversion: 2.1 time: 0.694254 Oct 04 21:25:58.559169 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2094/4165] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:57 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1507 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:58.564257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6d06c83d-a70d-4857-abb7-73f2a3d5545b tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:58.570867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6d06c83d-a70d-4857-abb7-73f2a3d5545b tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:58.601763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d06c83d-a70d-4857-abb7-73f2a3d5545b tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:58.602810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d06c83d-a70d-4857-abb7-73f2a3d5545b tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:58.603444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d06c83d-a70d-4857-abb7-73f2a3d5545b tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:58.604465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d06c83d-a70d-4857-abb7-73f2a3d5545b tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:58.610777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d06c83d-a70d-4857-abb7-73f2a3d5545b tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:58.611455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d06c83d-a70d-4857-abb7-73f2a3d5545b tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:58.684167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f4df429a-3ab7-4604-92aa-6ff25de3d7ba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:58.692761 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f4df429a-3ab7-4604-92aa-6ff25de3d7ba tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1510 microversion: 2.1 time: 0.518568 Oct 04 21:25:58.698533 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2072/4166] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:58 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1510 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:58.705006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ce04cc89-c52a-4a41-b222-7d13460899a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:58.710419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ce04cc89-c52a-4a41-b222-7d13460899a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:58.731512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce04cc89-c52a-4a41-b222-7d13460899a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:58.732345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce04cc89-c52a-4a41-b222-7d13460899a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:58.732993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce04cc89-c52a-4a41-b222-7d13460899a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:58.733941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce04cc89-c52a-4a41-b222-7d13460899a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:58.734626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce04cc89-c52a-4a41-b222-7d13460899a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:58.735256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce04cc89-c52a-4a41-b222-7d13460899a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:59.080244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6d06c83d-a70d-4857-abb7-73f2a3d5545b tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:59.089880 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6d06c83d-a70d-4857-abb7-73f2a3d5545b tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1513 microversion: 2.1 time: 0.529280 Oct 04 21:25:59.105137 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2095/4167] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:58 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1513 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:59.213206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ce04cc89-c52a-4a41-b222-7d13460899a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:59.222029 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ce04cc89-c52a-4a41-b222-7d13460899a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1525 microversion: 2.1 time: 0.521350 Oct 04 21:25:59.240829 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2073/4168] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:58 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1525 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:59.587759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3b29a157-71ef-4f73-b655-19b060669995 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:59.588528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3b29a157-71ef-4f73-b655-19b060669995 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:59.604473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b29a157-71ef-4f73-b655-19b060669995 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:59.611054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b29a157-71ef-4f73-b655-19b060669995 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:59.611700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b29a157-71ef-4f73-b655-19b060669995 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:59.612615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b29a157-71ef-4f73-b655-19b060669995 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:59.614012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b29a157-71ef-4f73-b655-19b060669995 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:59.614612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b29a157-71ef-4f73-b655-19b060669995 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:59.727228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ed356965-75a0-4f3b-8116-bec67dee9568 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:59.748359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ed356965-75a0-4f3b-8116-bec67dee9568 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:59.777170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed356965-75a0-4f3b-8116-bec67dee9568 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:59.777708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed356965-75a0-4f3b-8116-bec67dee9568 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:59.781142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed356965-75a0-4f3b-8116-bec67dee9568 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:59.782965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed356965-75a0-4f3b-8116-bec67dee9568 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:59.784067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed356965-75a0-4f3b-8116-bec67dee9568 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:59.794459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed356965-75a0-4f3b-8116-bec67dee9568 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:00.153701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3b29a157-71ef-4f73-b655-19b060669995 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:00.168376 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3b29a157-71ef-4f73-b655-19b060669995 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1507 microversion: 2.1 time: 0.588003 Oct 04 21:26:00.173170 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2096/4169] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:59 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1507 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:00.233216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dcd897b7-93c1-42a3-97f0-99b036c6bb17 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:00.233888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dcd897b7-93c1-42a3-97f0-99b036c6bb17 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:00.288734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcd897b7-93c1-42a3-97f0-99b036c6bb17 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:00.291101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcd897b7-93c1-42a3-97f0-99b036c6bb17 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:00.293041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcd897b7-93c1-42a3-97f0-99b036c6bb17 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:00.294630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcd897b7-93c1-42a3-97f0-99b036c6bb17 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:00.299534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcd897b7-93c1-42a3-97f0-99b036c6bb17 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:00.302161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcd897b7-93c1-42a3-97f0-99b036c6bb17 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:00.611867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ed356965-75a0-4f3b-8116-bec67dee9568 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:00.633716 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ed356965-75a0-4f3b-8116-bec67dee9568 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1510 microversion: 2.1 time: 0.911041 Oct 04 21:26:00.639425 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2074/4170] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:59 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1510 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:00.663416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-60f37d03-4e76-41f7-9d5e-a5e2adbe8c8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:00.672242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-60f37d03-4e76-41f7-9d5e-a5e2adbe8c8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:00.715355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60f37d03-4e76-41f7-9d5e-a5e2adbe8c8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:00.715890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60f37d03-4e76-41f7-9d5e-a5e2adbe8c8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:00.718709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60f37d03-4e76-41f7-9d5e-a5e2adbe8c8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:00.719497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60f37d03-4e76-41f7-9d5e-a5e2adbe8c8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:00.719980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60f37d03-4e76-41f7-9d5e-a5e2adbe8c8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:00.720426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60f37d03-4e76-41f7-9d5e-a5e2adbe8c8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:00.962088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dcd897b7-93c1-42a3-97f0-99b036c6bb17 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:00.974665 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dcd897b7-93c1-42a3-97f0-99b036c6bb17 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1513 microversion: 2.1 time: 0.762948 Oct 04 21:26:00.990214 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2097/4171] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:00 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1513 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:01.204832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4fb875f2-08a9-41ec-bf79-bac0b8bbf371 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:01.208172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4fb875f2-08a9-41ec-bf79-bac0b8bbf371 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:01.245986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fb875f2-08a9-41ec-bf79-bac0b8bbf371 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:01.247583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-60f37d03-4e76-41f7-9d5e-a5e2adbe8c8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:01.248272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fb875f2-08a9-41ec-bf79-bac0b8bbf371 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:01.250076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fb875f2-08a9-41ec-bf79-bac0b8bbf371 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:01.252843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fb875f2-08a9-41ec-bf79-bac0b8bbf371 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:01.254969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fb875f2-08a9-41ec-bf79-bac0b8bbf371 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:01.258739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fb875f2-08a9-41ec-bf79-bac0b8bbf371 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:01.262483 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-60f37d03-4e76-41f7-9d5e-a5e2adbe8c8a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1525 microversion: 2.1 time: 0.621920 Oct 04 21:26:01.270584 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2075/4172] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:00 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1525 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:01.658614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f97906bb-2a14-49d0-a4f2-7e72ae6a9b6d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:01.659298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f97906bb-2a14-49d0-a4f2-7e72ae6a9b6d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:01.675621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f97906bb-2a14-49d0-a4f2-7e72ae6a9b6d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:01.677476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f97906bb-2a14-49d0-a4f2-7e72ae6a9b6d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:01.678600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f97906bb-2a14-49d0-a4f2-7e72ae6a9b6d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:01.681375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f97906bb-2a14-49d0-a4f2-7e72ae6a9b6d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:01.689468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f97906bb-2a14-49d0-a4f2-7e72ae6a9b6d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:01.690383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f97906bb-2a14-49d0-a4f2-7e72ae6a9b6d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:02.115749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4fb875f2-08a9-41ec-bf79-bac0b8bbf371 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:02.134190 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4fb875f2-08a9-41ec-bf79-bac0b8bbf371 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1507 microversion: 2.1 time: 0.932439 Oct 04 21:26:02.163450 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2098/4173] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:01 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1507 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:02.179190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-11094c7f-c99a-4106-9b77-6d41e865f101 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:02.179826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-11094c7f-c99a-4106-9b77-6d41e865f101 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:02.242723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-11094c7f-c99a-4106-9b77-6d41e865f101 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:02.243239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-11094c7f-c99a-4106-9b77-6d41e865f101 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:02.243686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-11094c7f-c99a-4106-9b77-6d41e865f101 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:02.244422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-11094c7f-c99a-4106-9b77-6d41e865f101 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:02.244899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-11094c7f-c99a-4106-9b77-6d41e865f101 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:02.245330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-11094c7f-c99a-4106-9b77-6d41e865f101 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:02.703236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f97906bb-2a14-49d0-a4f2-7e72ae6a9b6d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:02.711680 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f97906bb-2a14-49d0-a4f2-7e72ae6a9b6d tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1510 microversion: 2.1 time: 1.057006 Oct 04 21:26:02.712271 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2076/4174] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:01 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1510 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:02.729647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4b0f3000-bf76-49d4-90ed-85e66d0a3f1a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:02.746581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4b0f3000-bf76-49d4-90ed-85e66d0a3f1a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:02.775218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b0f3000-bf76-49d4-90ed-85e66d0a3f1a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:02.775972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b0f3000-bf76-49d4-90ed-85e66d0a3f1a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:02.779718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b0f3000-bf76-49d4-90ed-85e66d0a3f1a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:02.782114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b0f3000-bf76-49d4-90ed-85e66d0a3f1a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:02.784472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b0f3000-bf76-49d4-90ed-85e66d0a3f1a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:02.785134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b0f3000-bf76-49d4-90ed-85e66d0a3f1a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:03.411726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-11094c7f-c99a-4106-9b77-6d41e865f101 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:03.435642 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-11094c7f-c99a-4106-9b77-6d41e865f101 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1513 microversion: 2.1 time: 1.265178 Oct 04 21:26:03.440187 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2099/4175] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:02 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1513 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:03.473831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-1886f188-9efe-42e5-804a-e72b607adf8d req-2990343b-ff63-4574-9d25-db078a5c62b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267676e7-8969-4f7b-9e77-da72b8e71a0b", "name": "network-vif-deleted", "tag": "ccb20d83-d32e-4ee7-a699-8e1da8c412f2"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:03.519465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1886f188-9efe-42e5-804a-e72b607adf8d req-2990343b-ff63-4574-9d25-db078a5c62b6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:03.519961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1886f188-9efe-42e5-804a-e72b607adf8d req-2990343b-ff63-4574-9d25-db078a5c62b6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:03.520406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1886f188-9efe-42e5-804a-e72b607adf8d req-2990343b-ff63-4574-9d25-db078a5c62b6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:03.532489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4b0f3000-bf76-49d4-90ed-85e66d0a3f1a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:03.545987 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4b0f3000-bf76-49d4-90ed-85e66d0a3f1a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1525 microversion: 2.1 time: 0.827498 Oct 04 21:26:03.546828 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2077/4176] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:02 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1525 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:03.563589 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-1886f188-9efe-42e5-804a-e72b607adf8d req-2990343b-ff63-4574-9d25-db078a5c62b6 service nova] Creating event network-vif-deleted:ccb20d83-d32e-4ee7-a699-8e1da8c412f2 for instance 267676e7-8969-4f7b-9e77-da72b8e71a0b on n-h2-860282-1 Oct 04 21:26:03.582799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-751aaf54-18b9-465d-9569-43512c649e48 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:03.586230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-751aaf54-18b9-465d-9569-43512c649e48 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:03.586353 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-1886f188-9efe-42e5-804a-e72b607adf8d req-2990343b-ff63-4574-9d25-db078a5c62b6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140244 Oct 04 21:26:03.586353 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2100/4177] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:26:03.634785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-751aaf54-18b9-465d-9569-43512c649e48 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:03.635600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-751aaf54-18b9-465d-9569-43512c649e48 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:03.636243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-751aaf54-18b9-465d-9569-43512c649e48 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:03.637450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-751aaf54-18b9-465d-9569-43512c649e48 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:03.638079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-751aaf54-18b9-465d-9569-43512c649e48 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:03.638695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-751aaf54-18b9-465d-9569-43512c649e48 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:03.738942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-84aae0b5-3e0c-4a4d-a036-310c5841bbb3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:03.743325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-84aae0b5-3e0c-4a4d-a036-310c5841bbb3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:03.781033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84aae0b5-3e0c-4a4d-a036-310c5841bbb3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:03.781846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84aae0b5-3e0c-4a4d-a036-310c5841bbb3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:03.782478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84aae0b5-3e0c-4a4d-a036-310c5841bbb3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:03.783594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84aae0b5-3e0c-4a4d-a036-310c5841bbb3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:03.784801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84aae0b5-3e0c-4a4d-a036-310c5841bbb3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:03.787414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84aae0b5-3e0c-4a4d-a036-310c5841bbb3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:03.952716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84aae0b5-3e0c-4a4d-a036-310c5841bbb3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:03.953511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84aae0b5-3e0c-4a4d-a036-310c5841bbb3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:03.954128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84aae0b5-3e0c-4a4d-a036-310c5841bbb3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:03.954792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-84aae0b5-3e0c-4a4d-a036-310c5841bbb3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lazy-loading 'fault' on Instance uuid 267676e7-8969-4f7b-9e77-da72b8e71a0b {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:26:04.133672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-84aae0b5-3e0c-4a4d-a036-310c5841bbb3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:04.160727 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-84aae0b5-3e0c-4a4d-a036-310c5841bbb3 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1312 microversion: 2.1 time: 0.426989 Oct 04 21:26:04.165611 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2101/4178] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:03 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1312 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:04.416990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-751aaf54-18b9-465d-9569-43512c649e48 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:04.440411 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-751aaf54-18b9-465d-9569-43512c649e48 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1507 microversion: 2.1 time: 0.890787 Oct 04 21:26:04.452518 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2078/4179] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:03 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1507 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:04.464573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bd6a9d2a-1c94-4447-893f-36b400297c69 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:04.465120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bd6a9d2a-1c94-4447-893f-36b400297c69 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:04.473087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd6a9d2a-1c94-4447-893f-36b400297c69 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:04.473358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd6a9d2a-1c94-4447-893f-36b400297c69 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:04.473829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd6a9d2a-1c94-4447-893f-36b400297c69 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:04.475061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd6a9d2a-1c94-4447-893f-36b400297c69 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:04.476162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd6a9d2a-1c94-4447-893f-36b400297c69 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:04.476758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd6a9d2a-1c94-4447-893f-36b400297c69 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:04.660520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-92dfbb84-42aa-4d30-b700-4562a8ce8085 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:04.660520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-92dfbb84-42aa-4d30-b700-4562a8ce8085 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:04.660520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92dfbb84-42aa-4d30-b700-4562a8ce8085 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:04.660520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92dfbb84-42aa-4d30-b700-4562a8ce8085 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:04.660520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92dfbb84-42aa-4d30-b700-4562a8ce8085 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:04.660520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92dfbb84-42aa-4d30-b700-4562a8ce8085 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:04.660520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92dfbb84-42aa-4d30-b700-4562a8ce8085 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:04.660520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92dfbb84-42aa-4d30-b700-4562a8ce8085 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:04.898671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bd6a9d2a-1c94-4447-893f-36b400297c69 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:04.908844 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bd6a9d2a-1c94-4447-893f-36b400297c69 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1519 microversion: 2.1 time: 0.451425 Oct 04 21:26:04.934749 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2102/4180] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:04 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1519 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:05.002951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-92dfbb84-42aa-4d30-b700-4562a8ce8085 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:05.023454 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-92dfbb84-42aa-4d30-b700-4562a8ce8085 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1525 microversion: 2.1 time: 0.448940 Oct 04 21:26:05.026840 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2079/4181] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:04 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1525 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:26:05.191884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3d93ca2e-1618-4d61-a33f-faba399da549 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:05.192557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3d93ca2e-1618-4d61-a33f-faba399da549 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:05.202046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d93ca2e-1618-4d61-a33f-faba399da549 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:05.204821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d93ca2e-1618-4d61-a33f-faba399da549 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:05.205678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d93ca2e-1618-4d61-a33f-faba399da549 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:05.206534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d93ca2e-1618-4d61-a33f-faba399da549 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:05.207112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d93ca2e-1618-4d61-a33f-faba399da549 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:05.207741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d93ca2e-1618-4d61-a33f-faba399da549 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:05.230857 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:05.265808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d93ca2e-1618-4d61-a33f-faba399da549 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:05.266710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d93ca2e-1618-4d61-a33f-faba399da549 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:05.291999 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d93ca2e-1618-4d61-a33f-faba399da549 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:05.292493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-3d93ca2e-1618-4d61-a33f-faba399da549 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lazy-loading 'fault' on Instance uuid 267676e7-8969-4f7b-9e77-da72b8e71a0b {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:26:05.378797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3d93ca2e-1618-4d61-a33f-faba399da549 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3144ae5d4548465485e6ff93f837ad6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0204517be8de4897977dba0343060ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:05.387279 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3d93ca2e-1618-4d61-a33f-faba399da549 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 200 len: 1312 microversion: 2.1 time: 0.199384 Oct 04 21:26:05.387868 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2103/4182] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:05 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 1312 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:05.478229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-568c8af1-4387-4fc1-ae91-1508cdeb4f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:05.479267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-568c8af1-4387-4fc1-ae91-1508cdeb4f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:05.488671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-568c8af1-4387-4fc1-ae91-1508cdeb4f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:05.489182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-568c8af1-4387-4fc1-ae91-1508cdeb4f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:05.491977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-568c8af1-4387-4fc1-ae91-1508cdeb4f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:05.492733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-568c8af1-4387-4fc1-ae91-1508cdeb4f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:05.493209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-568c8af1-4387-4fc1-ae91-1508cdeb4f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:05.493713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-568c8af1-4387-4fc1-ae91-1508cdeb4f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:05.561226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:05.889125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-568c8af1-4387-4fc1-ae91-1508cdeb4f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:05.914431 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-568c8af1-4387-4fc1-ae91-1508cdeb4f18 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1507 microversion: 2.1 time: 0.441720 Oct 04 21:26:05.919175 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2080/4183] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:05 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1507 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:05.942507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-339c0a6a-f61b-444e-abac-e645f0f8a926 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:05.944560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-339c0a6a-f61b-444e-abac-e645f0f8a926 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:05.963914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-339c0a6a-f61b-444e-abac-e645f0f8a926 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:05.972192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-339c0a6a-f61b-444e-abac-e645f0f8a926 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:05.974740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-339c0a6a-f61b-444e-abac-e645f0f8a926 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:05.977705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-339c0a6a-f61b-444e-abac-e645f0f8a926 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:05.979990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-339c0a6a-f61b-444e-abac-e645f0f8a926 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:05.980684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-339c0a6a-f61b-444e-abac-e645f0f8a926 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:06.051431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-16dccd75-2c4f-4a45-a8e3-f46c582c0967 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:06.053098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-16dccd75-2c4f-4a45-a8e3-f46c582c0967 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:06.071472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16dccd75-2c4f-4a45-a8e3-f46c582c0967 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:06.077349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16dccd75-2c4f-4a45-a8e3-f46c582c0967 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:06.078108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16dccd75-2c4f-4a45-a8e3-f46c582c0967 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:06.079055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16dccd75-2c4f-4a45-a8e3-f46c582c0967 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:06.086019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16dccd75-2c4f-4a45-a8e3-f46c582c0967 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:06.087030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16dccd75-2c4f-4a45-a8e3-f46c582c0967 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:06.663750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-339c0a6a-f61b-444e-abac-e645f0f8a926 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:06.674259 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-339c0a6a-f61b-444e-abac-e645f0f8a926 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1519 microversion: 2.1 time: 0.735641 Oct 04 21:26:06.680819 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2104/4184] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:05 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1519 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:06.693174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-dffcf827-3ecf-4f65-baa6-a1b787ebfe09 req-b879a307-4bde-469c-96b3-6fb0bc88195d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfb9eae-ce66-48c5-b7ca-8032c3596fad", "name": "network-vif-unplugged", "status": "completed", "tag": "d5e1110b-c910-4bae-8abe-73bf34266071"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:06.755817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-dffcf827-3ecf-4f65-baa6-a1b787ebfe09 req-b879a307-4bde-469c-96b3-6fb0bc88195d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:06.760516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-dffcf827-3ecf-4f65-baa6-a1b787ebfe09 req-b879a307-4bde-469c-96b3-6fb0bc88195d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:06.762091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-dffcf827-3ecf-4f65-baa6-a1b787ebfe09 req-b879a307-4bde-469c-96b3-6fb0bc88195d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:06.773828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-16dccd75-2c4f-4a45-a8e3-f46c582c0967 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:06.792780 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-16dccd75-2c4f-4a45-a8e3-f46c582c0967 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1525 microversion: 2.1 time: 0.745223 Oct 04 21:26:06.808871 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2081/4185] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:06 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1525 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:06.831114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-09fd0333-f167-41f7-8453-c692975d67f5 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:06.833121 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-dffcf827-3ecf-4f65-baa6-a1b787ebfe09 req-b879a307-4bde-469c-96b3-6fb0bc88195d service nova] Creating event network-vif-unplugged:d5e1110b-c910-4bae-8abe-73bf34266071 for instance bbfb9eae-ce66-48c5-b7ca-8032c3596fad on n-h2-860282-1 Oct 04 21:26:06.834078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-09fd0333-f167-41f7-8453-c692975d67f5 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] [instance: 267676e7-8969-4f7b-9e77-da72b8e71a0b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:06.854778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-09fd0333-f167-41f7-8453-c692975d67f5 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:06.854778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-09fd0333-f167-41f7-8453-c692975d67f5 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:06.855140 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-dffcf827-3ecf-4f65-baa6-a1b787ebfe09 req-b879a307-4bde-469c-96b3-6fb0bc88195d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164752 Oct 04 21:26:06.856131 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2105/4186] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:26:06.856424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-09fd0333-f167-41f7-8453-c692975d67f5 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:06.857503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-09fd0333-f167-41f7-8453-c692975d67f5 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:06.859342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-09fd0333-f167-41f7-8453-c692975d67f5 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:06.860006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-09fd0333-f167-41f7-8453-c692975d67f5 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:06.907433 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-09fd0333-f167-41f7-8453-c692975d67f5 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] HTTP exception thrown: Instance 267676e7-8969-4f7b-9e77-da72b8e71a0b could not be found. Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-09fd0333-f167-41f7-8453-c692975d67f5 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Request method failure captured: Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b HTTP/1.1 Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKSLX0ze0sWaKyrsoUQjMX4DLx8NiRwDaQQb3FJLKs2osdaPWszR8XV281RGTYFdz1a7rSJQhGLSDrVo7z8zysqPecukRt0wxjN45yfDhboevrfe39kz2NFRWc2AJvZo4Nq29lL9veBMmsb4-sSW4x4z5CKBwqtUPtpB82LO9_f0lBk Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 0204517be8de4897977dba0343060ea9 Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1350415775 Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0204517be8de4897977dba0343060ea9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0204517be8de4897977dba0343060ea9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0204517be8de4897977dba0343060ea9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0204517be8de4897977dba0343060ea9"}]}] Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1350415775 Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 0204517be8de4897977dba0343060ea9 Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1350415775 Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerRescueTestJSONUnderV235-1350415775-project Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3144ae5d4548465485e6ff93f837ad6a Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1350415775-project Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 267676e7-8969-4f7b-9e77-da72b8e71a0b could not be found. Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '267676e7-8969-4f7b-9e77-da72b8e71a0b'} Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267676e7-8969-4f7b-9e77-da72b8e71a0b could not be found. Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267676e7-8969-4f7b-9e77-da72b8e71a0b could not be found. Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:26:06.922104 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:26:06.926215 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:26:06.926215 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:06.926215 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:26:06.926215 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:26:06.926215 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:26:06.926215 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:26:06.926215 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267676e7-8969-4f7b-9e77-da72b8e71a0b could not be found. Oct 04 21:26:06.926215 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:26:06.931935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-09fd0333-f167-41f7-8453-c692975d67f5 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] Returning 404 to user: Instance 267676e7-8969-4f7b-9e77-da72b8e71a0b could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:26:06.951252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1bb3f2f0-9d3f-4de1-96c2-0c3791666c6d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:06.952514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1bb3f2f0-9d3f-4de1-96c2-0c3791666c6d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:06.959287 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-09fd0333-f167-41f7-8453-c692975d67f5 tempest-ServerRescueTestJSONUnderV235-1350415775 tempest-ServerRescueTestJSONUnderV235-1350415775-project] 10.222.0.30 "GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b" status: 404 len: 111 microversion: 2.1 time: 0.145237 Oct 04 21:26:06.966718 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2082/4187] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:06 2022] GET /compute/v2.1/servers/267676e7-8969-4f7b-9e77-da72b8e71a0b => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:26:06.976177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bb3f2f0-9d3f-4de1-96c2-0c3791666c6d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:06.976829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bb3f2f0-9d3f-4de1-96c2-0c3791666c6d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:06.977380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bb3f2f0-9d3f-4de1-96c2-0c3791666c6d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:06.979831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bb3f2f0-9d3f-4de1-96c2-0c3791666c6d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:06.980568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bb3f2f0-9d3f-4de1-96c2-0c3791666c6d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:06.983508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bb3f2f0-9d3f-4de1-96c2-0c3791666c6d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:07.645778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1bb3f2f0-9d3f-4de1-96c2-0c3791666c6d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:07.674438 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1bb3f2f0-9d3f-4de1-96c2-0c3791666c6d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1507 microversion: 2.1 time: 0.714868 Oct 04 21:26:07.695971 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2106/4188] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:06 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1507 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:07.724103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-020d189a-d139-4592-90d7-4b14c25c7fd1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:07.724972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-020d189a-d139-4592-90d7-4b14c25c7fd1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:07.727829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:07.780120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-020d189a-d139-4592-90d7-4b14c25c7fd1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:07.780751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-020d189a-d139-4592-90d7-4b14c25c7fd1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:07.781118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-020d189a-d139-4592-90d7-4b14c25c7fd1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:07.781897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-020d189a-d139-4592-90d7-4b14c25c7fd1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:07.791158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-020d189a-d139-4592-90d7-4b14c25c7fd1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:07.800005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-020d189a-d139-4592-90d7-4b14c25c7fd1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:07.835195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8c0cbdab-1e48-4fb6-9c66-e63538b0e38d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:07.836671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8c0cbdab-1e48-4fb6-9c66-e63538b0e38d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:07.858407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c0cbdab-1e48-4fb6-9c66-e63538b0e38d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:07.865679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c0cbdab-1e48-4fb6-9c66-e63538b0e38d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:07.870235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c0cbdab-1e48-4fb6-9c66-e63538b0e38d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:07.875193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c0cbdab-1e48-4fb6-9c66-e63538b0e38d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:07.875372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c0cbdab-1e48-4fb6-9c66-e63538b0e38d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:07.878204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c0cbdab-1e48-4fb6-9c66-e63538b0e38d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:09.059139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8c0cbdab-1e48-4fb6-9c66-e63538b0e38d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:09.075076 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8c0cbdab-1e48-4fb6-9c66-e63538b0e38d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1525 microversion: 2.1 time: 1.241788 Oct 04 21:26:09.087976 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2107/4189] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:07 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1525 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:26:09.107954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-08ad6972-1bb0-4578-93be-f3d38af34ab8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:09.111644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-08ad6972-1bb0-4578-93be-f3d38af34ab8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:09.138798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-020d189a-d139-4592-90d7-4b14c25c7fd1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:09.145013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08ad6972-1bb0-4578-93be-f3d38af34ab8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:09.145662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08ad6972-1bb0-4578-93be-f3d38af34ab8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:09.146126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08ad6972-1bb0-4578-93be-f3d38af34ab8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:09.146870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08ad6972-1bb0-4578-93be-f3d38af34ab8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:09.147377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08ad6972-1bb0-4578-93be-f3d38af34ab8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:09.147813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08ad6972-1bb0-4578-93be-f3d38af34ab8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:09.156387 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-020d189a-d139-4592-90d7-4b14c25c7fd1 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1519 microversion: 2.1 time: 1.440135 Oct 04 21:26:09.177943 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2083/4190] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:07 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1519 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:10.104753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9b2760f5-6bcd-4f31-9e17-650dfaa5f01a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:10.105641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9b2760f5-6bcd-4f31-9e17-650dfaa5f01a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:10.127011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b2760f5-6bcd-4f31-9e17-650dfaa5f01a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:10.133096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b2760f5-6bcd-4f31-9e17-650dfaa5f01a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:10.137385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b2760f5-6bcd-4f31-9e17-650dfaa5f01a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:10.142673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b2760f5-6bcd-4f31-9e17-650dfaa5f01a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:10.148357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b2760f5-6bcd-4f31-9e17-650dfaa5f01a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:10.151169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b2760f5-6bcd-4f31-9e17-650dfaa5f01a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:10.640451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-08ad6972-1bb0-4578-93be-f3d38af34ab8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:10.656501 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-08ad6972-1bb0-4578-93be-f3d38af34ab8 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1507 microversion: 2.1 time: 1.567041 Oct 04 21:26:10.661516 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2108/4191] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:09 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1507 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:10.678192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-64f75bfd-e4a8-4e50-a1dc-fab6d57fd315 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:10.682445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-64f75bfd-e4a8-4e50-a1dc-fab6d57fd315 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:10.712695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64f75bfd-e4a8-4e50-a1dc-fab6d57fd315 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:10.713560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64f75bfd-e4a8-4e50-a1dc-fab6d57fd315 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:10.714864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64f75bfd-e4a8-4e50-a1dc-fab6d57fd315 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:10.724327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64f75bfd-e4a8-4e50-a1dc-fab6d57fd315 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:10.724942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64f75bfd-e4a8-4e50-a1dc-fab6d57fd315 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:10.726011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64f75bfd-e4a8-4e50-a1dc-fab6d57fd315 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:11.211016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9b2760f5-6bcd-4f31-9e17-650dfaa5f01a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:11.222772 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9b2760f5-6bcd-4f31-9e17-650dfaa5f01a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1525 microversion: 2.1 time: 1.122333 Oct 04 21:26:11.238503 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2084/4192] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:10 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1525 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:26:11.245722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-1bc9453c-8bd6-4ec2-8e25-0e347b1ecce4 req-ed538128-64a4-4cf5-99f9-7e7d6525f33c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfb9eae-ce66-48c5-b7ca-8032c3596fad", "name": "network-vif-plugged", "status": "completed", "tag": "d5e1110b-c910-4bae-8abe-73bf34266071"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:11.281567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1bc9453c-8bd6-4ec2-8e25-0e347b1ecce4 req-ed538128-64a4-4cf5-99f9-7e7d6525f33c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:11.292479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1bc9453c-8bd6-4ec2-8e25-0e347b1ecce4 req-ed538128-64a4-4cf5-99f9-7e7d6525f33c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:11.294218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1bc9453c-8bd6-4ec2-8e25-0e347b1ecce4 req-ed538128-64a4-4cf5-99f9-7e7d6525f33c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:11.337763 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-1bc9453c-8bd6-4ec2-8e25-0e347b1ecce4 req-ed538128-64a4-4cf5-99f9-7e7d6525f33c service nova] Creating event network-vif-plugged:d5e1110b-c910-4bae-8abe-73bf34266071 for instance bbfb9eae-ce66-48c5-b7ca-8032c3596fad on n-h2-860282-1 Oct 04 21:26:11.352899 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-1bc9453c-8bd6-4ec2-8e25-0e347b1ecce4 req-ed538128-64a4-4cf5-99f9-7e7d6525f33c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111703 Oct 04 21:26:11.354251 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2085/4193] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:26:11.587049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-64f75bfd-e4a8-4e50-a1dc-fab6d57fd315 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:11.602302 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-64f75bfd-e4a8-4e50-a1dc-fab6d57fd315 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1519 microversion: 2.1 time: 0.939624 Oct 04 21:26:11.614361 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2109/4194] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:10 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1519 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:11.685865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9bfd1436-8616-4b77-b778-517edd00b3e4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:11.686762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9bfd1436-8616-4b77-b778-517edd00b3e4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:11.695242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bfd1436-8616-4b77-b778-517edd00b3e4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:11.699250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bfd1436-8616-4b77-b778-517edd00b3e4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:11.699956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bfd1436-8616-4b77-b778-517edd00b3e4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:11.701812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bfd1436-8616-4b77-b778-517edd00b3e4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:11.703259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bfd1436-8616-4b77-b778-517edd00b3e4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:11.706091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bfd1436-8616-4b77-b778-517edd00b3e4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:12.263286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c6e85dd7-9107-4fa2-88a6-486a9d507041 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:12.263905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c6e85dd7-9107-4fa2-88a6-486a9d507041 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:12.275533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6e85dd7-9107-4fa2-88a6-486a9d507041 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:12.278106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6e85dd7-9107-4fa2-88a6-486a9d507041 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:12.290257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6e85dd7-9107-4fa2-88a6-486a9d507041 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:12.291035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6e85dd7-9107-4fa2-88a6-486a9d507041 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:12.291515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6e85dd7-9107-4fa2-88a6-486a9d507041 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:12.291947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6e85dd7-9107-4fa2-88a6-486a9d507041 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:12.345301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9bfd1436-8616-4b77-b778-517edd00b3e4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:12.365848 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9bfd1436-8616-4b77-b778-517edd00b3e4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1507 microversion: 2.1 time: 0.684925 Oct 04 21:26:12.375334 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2086/4195] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:11 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1507 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:12.629063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cbdef5f0-e81b-4dbd-a52b-e7a77bca0be5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:12.629910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cbdef5f0-e81b-4dbd-a52b-e7a77bca0be5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:12.648221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cbdef5f0-e81b-4dbd-a52b-e7a77bca0be5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:12.655414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cbdef5f0-e81b-4dbd-a52b-e7a77bca0be5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:12.661136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cbdef5f0-e81b-4dbd-a52b-e7a77bca0be5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:12.661136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cbdef5f0-e81b-4dbd-a52b-e7a77bca0be5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:12.661136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cbdef5f0-e81b-4dbd-a52b-e7a77bca0be5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:12.661136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cbdef5f0-e81b-4dbd-a52b-e7a77bca0be5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:13.898229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c6e85dd7-9107-4fa2-88a6-486a9d507041 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:13.913391 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c6e85dd7-9107-4fa2-88a6-486a9d507041 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1525 microversion: 2.1 time: 1.654138 Oct 04 21:26:13.915560 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2110/4196] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:12 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1525 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:13.921011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c9adc966-12c6-4f6f-9461-e253fb823365 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:13.921657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c9adc966-12c6-4f6f-9461-e253fb823365 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:13.929836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9adc966-12c6-4f6f-9461-e253fb823365 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:13.930590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9adc966-12c6-4f6f-9461-e253fb823365 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:13.931214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9adc966-12c6-4f6f-9461-e253fb823365 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:13.932147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9adc966-12c6-4f6f-9461-e253fb823365 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:13.932749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9adc966-12c6-4f6f-9461-e253fb823365 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:13.933357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9adc966-12c6-4f6f-9461-e253fb823365 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:14.267677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cbdef5f0-e81b-4dbd-a52b-e7a77bca0be5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:14.285274 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cbdef5f0-e81b-4dbd-a52b-e7a77bca0be5 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1519 microversion: 2.1 time: 1.660430 Oct 04 21:26:14.288692 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2087/4197] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:12 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1519 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:14.382711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c9adc966-12c6-4f6f-9461-e253fb823365 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:14.392271 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c9adc966-12c6-4f6f-9461-e253fb823365 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1507 microversion: 2.1 time: 0.475466 Oct 04 21:26:14.392897 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2111/4198] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:13 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1507 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:14.947037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-80d453cb-d379-402b-a009-3f11d889deb5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:14.948699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-80d453cb-d379-402b-a009-3f11d889deb5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:14.961408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80d453cb-d379-402b-a009-3f11d889deb5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:14.961944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80d453cb-d379-402b-a009-3f11d889deb5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:14.962549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80d453cb-d379-402b-a009-3f11d889deb5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:14.963130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80d453cb-d379-402b-a009-3f11d889deb5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:14.969682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80d453cb-d379-402b-a009-3f11d889deb5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:14.970376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80d453cb-d379-402b-a009-3f11d889deb5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:15.311659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c26ccb87-409a-4231-aa79-577b9f16797c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:15.314085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c26ccb87-409a-4231-aa79-577b9f16797c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:15.336852 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c26ccb87-409a-4231-aa79-577b9f16797c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:15.347115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c26ccb87-409a-4231-aa79-577b9f16797c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:15.350513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c26ccb87-409a-4231-aa79-577b9f16797c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:15.358699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c26ccb87-409a-4231-aa79-577b9f16797c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:15.364949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c26ccb87-409a-4231-aa79-577b9f16797c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:15.367652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c26ccb87-409a-4231-aa79-577b9f16797c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:15.371474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-80d453cb-d379-402b-a009-3f11d889deb5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:15.408154 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-80d453cb-d379-402b-a009-3f11d889deb5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1525 microversion: 2.1 time: 0.463745 Oct 04 21:26:15.415235 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2088/4199] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:14 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1525 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:15.455758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a79cb125-86db-4c00-ba7a-ba868f2e7893 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:15.456322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a79cb125-86db-4c00-ba7a-ba868f2e7893 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:15.495146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a79cb125-86db-4c00-ba7a-ba868f2e7893 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:15.496540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a79cb125-86db-4c00-ba7a-ba868f2e7893 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:15.498765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a79cb125-86db-4c00-ba7a-ba868f2e7893 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:15.499692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a79cb125-86db-4c00-ba7a-ba868f2e7893 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:15.500826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a79cb125-86db-4c00-ba7a-ba868f2e7893 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:15.501887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a79cb125-86db-4c00-ba7a-ba868f2e7893 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:16.138757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c26ccb87-409a-4231-aa79-577b9f16797c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:16.158484 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c26ccb87-409a-4231-aa79-577b9f16797c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1504 microversion: 2.1 time: 0.847718 Oct 04 21:26:16.161237 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2112/4200] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:15 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1504 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:26:16.192558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-13da3fa8-45cc-4f3c-a5eb-ce3f94fbd6bb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:16.193492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-13da3fa8-45cc-4f3c-a5eb-ce3f94fbd6bb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:16.221602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13da3fa8-45cc-4f3c-a5eb-ce3f94fbd6bb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:16.234165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13da3fa8-45cc-4f3c-a5eb-ce3f94fbd6bb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:16.236919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13da3fa8-45cc-4f3c-a5eb-ce3f94fbd6bb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:16.241966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13da3fa8-45cc-4f3c-a5eb-ce3f94fbd6bb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:16.248161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13da3fa8-45cc-4f3c-a5eb-ce3f94fbd6bb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:16.251684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13da3fa8-45cc-4f3c-a5eb-ce3f94fbd6bb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:16.336923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a79cb125-86db-4c00-ba7a-ba868f2e7893 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:16.350510 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a79cb125-86db-4c00-ba7a-ba868f2e7893 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1507 microversion: 2.1 time: 0.910698 Oct 04 21:26:16.352036 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2089/4201] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:15 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1507 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:16.439828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c988eb74-8d83-42f5-ad10-90209f43426d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:16.440590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c988eb74-8d83-42f5-ad10-90209f43426d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:16.456122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c988eb74-8d83-42f5-ad10-90209f43426d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:16.460346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c988eb74-8d83-42f5-ad10-90209f43426d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:16.461073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c988eb74-8d83-42f5-ad10-90209f43426d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:16.462664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c988eb74-8d83-42f5-ad10-90209f43426d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:16.465177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c988eb74-8d83-42f5-ad10-90209f43426d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:16.472052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c988eb74-8d83-42f5-ad10-90209f43426d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:17.125941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-13da3fa8-45cc-4f3c-a5eb-ce3f94fbd6bb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:17.138752 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-13da3fa8-45cc-4f3c-a5eb-ce3f94fbd6bb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 200 len: 1504 microversion: 2.1 time: 0.952798 Oct 04 21:26:17.145758 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2113/4202] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:16 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 1504 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:17.176355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e74cf764-dadb-43a7-b795-4f2eb18e9f50 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:17.176355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e74cf764-dadb-43a7-b795-4f2eb18e9f50 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:17.187903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e74cf764-dadb-43a7-b795-4f2eb18e9f50 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:17.192894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e74cf764-dadb-43a7-b795-4f2eb18e9f50 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:17.193726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e74cf764-dadb-43a7-b795-4f2eb18e9f50 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:17.194707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e74cf764-dadb-43a7-b795-4f2eb18e9f50 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:17.199741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e74cf764-dadb-43a7-b795-4f2eb18e9f50 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:17.200698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e74cf764-dadb-43a7-b795-4f2eb18e9f50 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:17.310294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e74cf764-dadb-43a7-b795-4f2eb18e9f50 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:26:17.374574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c988eb74-8d83-42f5-ad10-90209f43426d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:17.393924 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c988eb74-8d83-42f5-ad10-90209f43426d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1525 microversion: 2.1 time: 0.958098 Oct 04 21:26:17.397951 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2090/4203] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:16 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1525 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:17.417742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9c263422-9c67-4f94-94f7-c5cd92fc2927 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:17.420831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9c263422-9c67-4f94-94f7-c5cd92fc2927 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:17.449872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c263422-9c67-4f94-94f7-c5cd92fc2927 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:17.451328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c263422-9c67-4f94-94f7-c5cd92fc2927 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:17.452025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c263422-9c67-4f94-94f7-c5cd92fc2927 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:17.453072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c263422-9c67-4f94-94f7-c5cd92fc2927 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:17.456018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c263422-9c67-4f94-94f7-c5cd92fc2927 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:17.456866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c263422-9c67-4f94-94f7-c5cd92fc2927 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:17.891106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9c263422-9c67-4f94-94f7-c5cd92fc2927 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:17.902404 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9c263422-9c67-4f94-94f7-c5cd92fc2927 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1507 microversion: 2.1 time: 0.501725 Oct 04 21:26:17.921506 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e74cf764-dadb-43a7-b795-4f2eb18e9f50 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 204 len: 0 microversion: 2.1 time: 0.752959 Oct 04 21:26:17.922539 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2114/4204] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:26:17 2022] DELETE /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 0 bytes in 756 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:26:17.926112 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2091/4205] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:17 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1507 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:18.179577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eeeb0dd2-06d4-48ce-a8a3-cb93a9d5da77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1837117014", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "59bc4e47-3ceb-4d57-b1a7-aefe15e4bd7e"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:18.343270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-eeeb0dd2-06d4-48ce-a8a3-cb93a9d5da77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] validate_networks() for [('59bc4e47-3ceb-4d57-b1a7-aefe15e4bd7e', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:26:18.421180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-238d9a08-01dd-49fa-a55f-9149ec1a930b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:18.430879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-238d9a08-01dd-49fa-a55f-9149ec1a930b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:18.444686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-238d9a08-01dd-49fa-a55f-9149ec1a930b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:18.453959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-238d9a08-01dd-49fa-a55f-9149ec1a930b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:18.454511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-238d9a08-01dd-49fa-a55f-9149ec1a930b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:18.462033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-238d9a08-01dd-49fa-a55f-9149ec1a930b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:18.462396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-238d9a08-01dd-49fa-a55f-9149ec1a930b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:18.462855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-238d9a08-01dd-49fa-a55f-9149ec1a930b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:19.139584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-238d9a08-01dd-49fa-a55f-9149ec1a930b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:19.151810 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-238d9a08-01dd-49fa-a55f-9149ec1a930b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1507 microversion: 2.1 time: 0.734974 Oct 04 21:26:19.169181 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2092/4206] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:18 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1507 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:19.176095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-24e633fc-da98-4741-b639-be7eb9cf815d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:19.176731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-24e633fc-da98-4741-b639-be7eb9cf815d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:19.184398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24e633fc-da98-4741-b639-be7eb9cf815d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:19.185323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24e633fc-da98-4741-b639-be7eb9cf815d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:19.186823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24e633fc-da98-4741-b639-be7eb9cf815d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:19.189547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24e633fc-da98-4741-b639-be7eb9cf815d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:19.191692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24e633fc-da98-4741-b639-be7eb9cf815d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:19.192531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24e633fc-da98-4741-b639-be7eb9cf815d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:21.119799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-24e633fc-da98-4741-b639-be7eb9cf815d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:21.128905 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-24e633fc-da98-4741-b639-be7eb9cf815d tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1504 microversion: 2.1 time: 1.954163 Oct 04 21:26:21.129576 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2093/4207] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:19 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1504 bytes in 1960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:21.140807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bbcecd13-ad47-4e6b-981b-add72e4b1ecd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:21.142870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bbcecd13-ad47-4e6b-981b-add72e4b1ecd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:21.175139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbcecd13-ad47-4e6b-981b-add72e4b1ecd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:21.181543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbcecd13-ad47-4e6b-981b-add72e4b1ecd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:21.182538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbcecd13-ad47-4e6b-981b-add72e4b1ecd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:21.189879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbcecd13-ad47-4e6b-981b-add72e4b1ecd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:21.189879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbcecd13-ad47-4e6b-981b-add72e4b1ecd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:21.189879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbcecd13-ad47-4e6b-981b-add72e4b1ecd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:22.010833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-eeeb0dd2-06d4-48ce-a8a3-cb93a9d5da77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:26:22.011357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-eeeb0dd2-06d4-48ce-a8a3-cb93a9d5da77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:26:22.011951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-eeeb0dd2-06d4-48ce-a8a3-cb93a9d5da77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:26:22.012474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-eeeb0dd2-06d4-48ce-a8a3-cb93a9d5da77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:26:22.012995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-eeeb0dd2-06d4-48ce-a8a3-cb93a9d5da77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:26:22.031537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eeeb0dd2-06d4-48ce-a8a3-cb93a9d5da77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:22.032191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eeeb0dd2-06d4-48ce-a8a3-cb93a9d5da77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:22.038714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eeeb0dd2-06d4-48ce-a8a3-cb93a9d5da77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:22.040573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eeeb0dd2-06d4-48ce-a8a3-cb93a9d5da77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:22.041538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eeeb0dd2-06d4-48ce-a8a3-cb93a9d5da77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:22.042238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eeeb0dd2-06d4-48ce-a8a3-cb93a9d5da77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:22.087971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-eeeb0dd2-06d4-48ce-a8a3-cb93a9d5da77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Getting quotas for project 0006ee9cd0424160a0e042de4c653358. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:26:22.112492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-eeeb0dd2-06d4-48ce-a8a3-cb93a9d5da77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Getting quotas for user cf4bb2f7ed99411eb8b6231d64179485 and project 0006ee9cd0424160a0e042de4c653358. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:26:22.152958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eeeb0dd2-06d4-48ce-a8a3-cb93a9d5da77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:26:22.166084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eeeb0dd2-06d4-48ce-a8a3-cb93a9d5da77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:26:22.287975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bbcecd13-ad47-4e6b-981b-add72e4b1ecd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:22.304152 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bbcecd13-ad47-4e6b-981b-add72e4b1ecd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1507 microversion: 2.1 time: 1.169778 Oct 04 21:26:22.306644 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2094/4208] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:21 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1507 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:22.338859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-690478f4-7a87-4d2a-8265-4f6592b9bf44 req-9e2e6432-914d-4080-84e2-58ebb1c79986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f7b402-4b3a-4a39-8686-9e9b36f9e040", "name": "network-vif-unplugged", "status": "completed", "tag": "c883d4ee-a39d-4507-8568-f4e4fd4c7cd3"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:22.381715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-690478f4-7a87-4d2a-8265-4f6592b9bf44 req-9e2e6432-914d-4080-84e2-58ebb1c79986 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:22.382290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-690478f4-7a87-4d2a-8265-4f6592b9bf44 req-9e2e6432-914d-4080-84e2-58ebb1c79986 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:22.383377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-690478f4-7a87-4d2a-8265-4f6592b9bf44 req-9e2e6432-914d-4080-84e2-58ebb1c79986 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:22.428527 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-690478f4-7a87-4d2a-8265-4f6592b9bf44 req-9e2e6432-914d-4080-84e2-58ebb1c79986 service nova] Creating event network-vif-unplugged:c883d4ee-a39d-4507-8568-f4e4fd4c7cd3 for instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 on n-h1-860282-1 Oct 04 21:26:22.461313 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-690478f4-7a87-4d2a-8265-4f6592b9bf44 req-9e2e6432-914d-4080-84e2-58ebb1c79986 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153353 Oct 04 21:26:22.464317 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2095/4209] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:26:22.479074 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eeeb0dd2-06d4-48ce-a8a3-cb93a9d5da77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.301972 Oct 04 21:26:22.493567 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2115/4210] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:26:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 4318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:26:22.514811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7529b179-a27c-4342-8c85-d0a93e774227 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:22.519970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7529b179-a27c-4342-8c85-d0a93e774227 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:22.525363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-51f8964f-e257-48c1-bb5b-94fd18f1dbd3 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:22.526886 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-51f8964f-e257-48c1-bb5b-94fd18f1dbd3 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:22.559773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7529b179-a27c-4342-8c85-d0a93e774227 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:22.561670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7529b179-a27c-4342-8c85-d0a93e774227 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:22.574705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7529b179-a27c-4342-8c85-d0a93e774227 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:22.575656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7529b179-a27c-4342-8c85-d0a93e774227 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:22.577773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7529b179-a27c-4342-8c85-d0a93e774227 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:22.580668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7529b179-a27c-4342-8c85-d0a93e774227 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:22.837903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-51f8964f-e257-48c1-bb5b-94fd18f1dbd3 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:22.852568 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-51f8964f-e257-48c1-bb5b-94fd18f1dbd3 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1218 microversion: 2.1 time: 0.353607 Oct 04 21:26:22.853210 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2116/4211] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:22 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1218 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:23.332744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c3a09956-3dc5-4dc9-889e-d74814f0591b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:23.335110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c3a09956-3dc5-4dc9-889e-d74814f0591b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:23.340030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:23.347996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3a09956-3dc5-4dc9-889e-d74814f0591b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:23.351584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3a09956-3dc5-4dc9-889e-d74814f0591b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:23.352417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3a09956-3dc5-4dc9-889e-d74814f0591b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:23.353577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3a09956-3dc5-4dc9-889e-d74814f0591b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:23.355830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3a09956-3dc5-4dc9-889e-d74814f0591b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:23.376169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3a09956-3dc5-4dc9-889e-d74814f0591b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:24.381142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7529b179-a27c-4342-8c85-d0a93e774227 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:24.425091 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7529b179-a27c-4342-8c85-d0a93e774227 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1504 microversion: 2.1 time: 1.945503 Oct 04 21:26:24.429648 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2096/4212] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:22 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1504 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:24.448340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4d55ee2e-2b40-4f60-92d2-7ba0ae95dbf2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:24.457548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4d55ee2e-2b40-4f60-92d2-7ba0ae95dbf2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:24.514267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d55ee2e-2b40-4f60-92d2-7ba0ae95dbf2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:24.521215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d55ee2e-2b40-4f60-92d2-7ba0ae95dbf2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:24.522008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d55ee2e-2b40-4f60-92d2-7ba0ae95dbf2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:24.523447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d55ee2e-2b40-4f60-92d2-7ba0ae95dbf2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:24.523956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d55ee2e-2b40-4f60-92d2-7ba0ae95dbf2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:24.524403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d55ee2e-2b40-4f60-92d2-7ba0ae95dbf2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:24.724419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c3a09956-3dc5-4dc9-889e-d74814f0591b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:24.746482 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c3a09956-3dc5-4dc9-889e-d74814f0591b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1507 microversion: 2.1 time: 1.417795 Oct 04 21:26:24.750315 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2117/4213] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:23 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1507 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:26:24.774409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4d55ee2e-2b40-4f60-92d2-7ba0ae95dbf2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:24.804737 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4d55ee2e-2b40-4f60-92d2-7ba0ae95dbf2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1222 microversion: 2.1 time: 0.359830 Oct 04 21:26:24.823905 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2097/4214] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:24 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1222 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:25.183126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-50ac3bcf-8972-4be9-b48c-acdcd0c5e6d2 req-3009568f-52b9-4e3b-9be3-3658278f8ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfb9eae-ce66-48c5-b7ca-8032c3596fad", "name": "network-vif-unplugged", "status": "completed", "tag": "d5e1110b-c910-4bae-8abe-73bf34266071"}, {"server_uuid": "cf496d06-f510-4a05-b5c7-3438c434547e", "name": "network-vif-unplugged", "status": "completed", "tag": "e3b2e817-8930-4077-a86c-88d50aa94e31"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:25.200032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-50ac3bcf-8972-4be9-b48c-acdcd0c5e6d2 req-3009568f-52b9-4e3b-9be3-3658278f8ee7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:25.201135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-50ac3bcf-8972-4be9-b48c-acdcd0c5e6d2 req-3009568f-52b9-4e3b-9be3-3658278f8ee7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:25.201877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-50ac3bcf-8972-4be9-b48c-acdcd0c5e6d2 req-3009568f-52b9-4e3b-9be3-3658278f8ee7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:25.217480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-78cb1679-505f-489e-8a8b-c4b6cf542a39 req-031d1d03-84bf-44e5-bd36-e367a7235f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfb9eae-ce66-48c5-b7ca-8032c3596fad", "name": "network-vif-deleted", "tag": "d5e1110b-c910-4bae-8abe-73bf34266071"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:25.241064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-78cb1679-505f-489e-8a8b-c4b6cf542a39 req-031d1d03-84bf-44e5-bd36-e367a7235f3c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:25.241865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-78cb1679-505f-489e-8a8b-c4b6cf542a39 req-031d1d03-84bf-44e5-bd36-e367a7235f3c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:25.242462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-78cb1679-505f-489e-8a8b-c4b6cf542a39 req-031d1d03-84bf-44e5-bd36-e367a7235f3c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:25.261729 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-50ac3bcf-8972-4be9-b48c-acdcd0c5e6d2 req-3009568f-52b9-4e3b-9be3-3658278f8ee7 service nova] Creating event network-vif-unplugged:d5e1110b-c910-4bae-8abe-73bf34266071 for instance bbfb9eae-ce66-48c5-b7ca-8032c3596fad on n-h2-860282-1 Oct 04 21:26:25.269304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.compute.server_external_events [req-50ac3bcf-8972-4be9-b48c-acdcd0c5e6d2 req-3009568f-52b9-4e3b-9be3-3658278f8ee7 service nova] Unable to find a host for instance cf496d06-f510-4a05-b5c7-3438c434547e. Dropping event network-vif-unplugged {{(pid=122757) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 21:26:25.284700 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-78cb1679-505f-489e-8a8b-c4b6cf542a39 req-031d1d03-84bf-44e5-bd36-e367a7235f3c service nova] Creating event network-vif-deleted:d5e1110b-c910-4bae-8abe-73bf34266071 for instance bbfb9eae-ce66-48c5-b7ca-8032c3596fad on n-h2-860282-1 Oct 04 21:26:25.286134 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-50ac3bcf-8972-4be9-b48c-acdcd0c5e6d2 req-3009568f-52b9-4e3b-9be3-3658278f8ee7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 355 microversion: 2.1 time: 0.532191 Oct 04 21:26:25.288421 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2118/4215] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 355 bytes in 537 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 21:26:25.297618 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-78cb1679-505f-489e-8a8b-c4b6cf542a39 req-031d1d03-84bf-44e5-bd36-e367a7235f3c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082177 Oct 04 21:26:25.301863 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2098/4216] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:26:25.457585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-21b3d335-2fd0-4f6a-abb5-252fad7478df tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:25.458309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-21b3d335-2fd0-4f6a-abb5-252fad7478df tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:25.472501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21b3d335-2fd0-4f6a-abb5-252fad7478df tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:25.473010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21b3d335-2fd0-4f6a-abb5-252fad7478df tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:25.473485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21b3d335-2fd0-4f6a-abb5-252fad7478df tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:25.474218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21b3d335-2fd0-4f6a-abb5-252fad7478df tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:25.475236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21b3d335-2fd0-4f6a-abb5-252fad7478df tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:25.475985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21b3d335-2fd0-4f6a-abb5-252fad7478df tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:25.777192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2a5d8381-a7f4-4b5e-85b2-7096b771cef3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:25.777192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2a5d8381-a7f4-4b5e-85b2-7096b771cef3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:25.782588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a5d8381-a7f4-4b5e-85b2-7096b771cef3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:25.783079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a5d8381-a7f4-4b5e-85b2-7096b771cef3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:25.784115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a5d8381-a7f4-4b5e-85b2-7096b771cef3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:25.784834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a5d8381-a7f4-4b5e-85b2-7096b771cef3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:25.785325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a5d8381-a7f4-4b5e-85b2-7096b771cef3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:25.785781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a5d8381-a7f4-4b5e-85b2-7096b771cef3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:25.807430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:25.933968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-21b3d335-2fd0-4f6a-abb5-252fad7478df tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:25.944968 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-21b3d335-2fd0-4f6a-abb5-252fad7478df tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 200 len: 1447 microversion: 2.1 time: 0.492692 Oct 04 21:26:25.968094 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2119/4217] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:25 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 1447 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:25.968094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-055752cd-317e-43df-8fa6-7e390d2b8eed tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:25.968094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-055752cd-317e-43df-8fa6-7e390d2b8eed tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:25.976438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-055752cd-317e-43df-8fa6-7e390d2b8eed tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:25.977176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-055752cd-317e-43df-8fa6-7e390d2b8eed tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:25.977858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-055752cd-317e-43df-8fa6-7e390d2b8eed tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:25.978603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-055752cd-317e-43df-8fa6-7e390d2b8eed tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:25.979229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-055752cd-317e-43df-8fa6-7e390d2b8eed tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:25.979839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-055752cd-317e-43df-8fa6-7e390d2b8eed tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:26.100193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-055752cd-317e-43df-8fa6-7e390d2b8eed tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:26.121266 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-055752cd-317e-43df-8fa6-7e390d2b8eed tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1270 microversion: 2.1 time: 0.157328 Oct 04 21:26:26.123286 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2120/4218] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:25 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:26.142269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3bffdd74-e718-4dd3-870e-e2e13b38cd28 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:26.147819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3bffdd74-e718-4dd3-870e-e2e13b38cd28 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:26.152399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bffdd74-e718-4dd3-870e-e2e13b38cd28 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:26.153300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bffdd74-e718-4dd3-870e-e2e13b38cd28 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:26.154000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bffdd74-e718-4dd3-870e-e2e13b38cd28 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:26.154865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bffdd74-e718-4dd3-870e-e2e13b38cd28 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:26.155493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bffdd74-e718-4dd3-870e-e2e13b38cd28 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:26.156208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bffdd74-e718-4dd3-870e-e2e13b38cd28 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:26.160110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2a5d8381-a7f4-4b5e-85b2-7096b771cef3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:26.161760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:26.177169 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2a5d8381-a7f4-4b5e-85b2-7096b771cef3 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1507 microversion: 2.1 time: 0.406857 Oct 04 21:26:26.188010 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2099/4219] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:25 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1507 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:26:26.872704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3bffdd74-e718-4dd3-870e-e2e13b38cd28 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:26.885403 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3bffdd74-e718-4dd3-870e-e2e13b38cd28 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.761008 Oct 04 21:26:26.897465 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2121/4220] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:26 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:26.924869 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-89a5a3b7-5da5-43a3-92f7-d3e762949c67 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:26.928911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-89a5a3b7-5da5-43a3-92f7-d3e762949c67 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:26.953543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89a5a3b7-5da5-43a3-92f7-d3e762949c67 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:26.960811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89a5a3b7-5da5-43a3-92f7-d3e762949c67 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:26.960811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89a5a3b7-5da5-43a3-92f7-d3e762949c67 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:26.960811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89a5a3b7-5da5-43a3-92f7-d3e762949c67 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:26.960811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89a5a3b7-5da5-43a3-92f7-d3e762949c67 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:26.960811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89a5a3b7-5da5-43a3-92f7-d3e762949c67 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:27.147475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ee7e6be8-1627-4043-8a61-3f9872600074 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:27.148472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ee7e6be8-1627-4043-8a61-3f9872600074 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:27.164109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee7e6be8-1627-4043-8a61-3f9872600074 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:27.167084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee7e6be8-1627-4043-8a61-3f9872600074 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:27.170635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee7e6be8-1627-4043-8a61-3f9872600074 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:27.172598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee7e6be8-1627-4043-8a61-3f9872600074 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:27.176642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee7e6be8-1627-4043-8a61-3f9872600074 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:27.177357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee7e6be8-1627-4043-8a61-3f9872600074 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:27.269788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ee7e6be8-1627-4043-8a61-3f9872600074 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:27.308128 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ee7e6be8-1627-4043-8a61-3f9872600074 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1270 microversion: 2.1 time: 0.167724 Oct 04 21:26:27.322628 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2122/4221] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:27 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1270 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:26:27.335670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-89a5a3b7-5da5-43a3-92f7-d3e762949c67 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:27.351554 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-89a5a3b7-5da5-43a3-92f7-d3e762949c67 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.431887 Oct 04 21:26:27.352363 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2100/4222] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:26 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:27.353010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e556456a-e0d9-4347-9734-eeb76383681a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:27.353885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e556456a-e0d9-4347-9734-eeb76383681a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:27.367003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e556456a-e0d9-4347-9734-eeb76383681a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:27.368842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e556456a-e0d9-4347-9734-eeb76383681a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:27.369344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e556456a-e0d9-4347-9734-eeb76383681a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:27.370091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e556456a-e0d9-4347-9734-eeb76383681a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:27.370562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e556456a-e0d9-4347-9734-eeb76383681a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:27.370977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e556456a-e0d9-4347-9734-eeb76383681a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:27.376900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fd63f81f-90ed-4a1d-b01e-81f8348b62f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:27.377799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fd63f81f-90ed-4a1d-b01e-81f8348b62f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:27.387173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd63f81f-90ed-4a1d-b01e-81f8348b62f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:27.390106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd63f81f-90ed-4a1d-b01e-81f8348b62f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:27.390703 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd63f81f-90ed-4a1d-b01e-81f8348b62f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:27.391993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd63f81f-90ed-4a1d-b01e-81f8348b62f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:27.392638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd63f81f-90ed-4a1d-b01e-81f8348b62f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:27.396093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd63f81f-90ed-4a1d-b01e-81f8348b62f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:27.887348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e556456a-e0d9-4347-9734-eeb76383681a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:27.907416 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e556456a-e0d9-4347-9734-eeb76383681a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 200 len: 1510 microversion: 2.1 time: 0.583435 Oct 04 21:26:27.908048 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2123/4223] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:27 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 1510 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:27.931586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e11a6530-c11b-4d69-936b-d28f4ee262f1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:27.932396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e11a6530-c11b-4d69-936b-d28f4ee262f1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:27.939816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e11a6530-c11b-4d69-936b-d28f4ee262f1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:27.940564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e11a6530-c11b-4d69-936b-d28f4ee262f1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:27.941208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e11a6530-c11b-4d69-936b-d28f4ee262f1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:27.942167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e11a6530-c11b-4d69-936b-d28f4ee262f1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:27.942827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e11a6530-c11b-4d69-936b-d28f4ee262f1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:27.944297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e11a6530-c11b-4d69-936b-d28f4ee262f1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:27.996420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e11a6530-c11b-4d69-936b-d28f4ee262f1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:26:28.003986 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.compute.api [None req-e11a6530-c11b-4d69-936b-d28f4ee262f1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Working on deleting snapshot 84fe5eb2-fb1f-41ce-bc93-fdb1c9581827 from shelved instance... Oct 04 21:26:28.157516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fd63f81f-90ed-4a1d-b01e-81f8348b62f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:28.171518 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fd63f81f-90ed-4a1d-b01e-81f8348b62f3 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.798718 Oct 04 21:26:28.174752 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2101/4224] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:27 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:26:28.201207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d95855c2-51e2-45c3-98b7-f98a6706aa79 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:28.203049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d95855c2-51e2-45c3-98b7-f98a6706aa79 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:28.212186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d95855c2-51e2-45c3-98b7-f98a6706aa79 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:28.216152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d95855c2-51e2-45c3-98b7-f98a6706aa79 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:28.216849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d95855c2-51e2-45c3-98b7-f98a6706aa79 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:28.218912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d95855c2-51e2-45c3-98b7-f98a6706aa79 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:28.220653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d95855c2-51e2-45c3-98b7-f98a6706aa79 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:28.221184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d95855c2-51e2-45c3-98b7-f98a6706aa79 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:28.670719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d95855c2-51e2-45c3-98b7-f98a6706aa79 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:28.681275 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d95855c2-51e2-45c3-98b7-f98a6706aa79 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.484456 Oct 04 21:26:28.700809 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2102/4225] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:28 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:28.714565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e21223ae-bca4-46c2-b6c5-d19205b83338 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:28.716127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e21223ae-bca4-46c2-b6c5-d19205b83338 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:28.725278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e21223ae-bca4-46c2-b6c5-d19205b83338 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:28.726466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e21223ae-bca4-46c2-b6c5-d19205b83338 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:28.727096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e21223ae-bca4-46c2-b6c5-d19205b83338 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:28.727984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e21223ae-bca4-46c2-b6c5-d19205b83338 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:28.728955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e21223ae-bca4-46c2-b6c5-d19205b83338 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:28.730249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e21223ae-bca4-46c2-b6c5-d19205b83338 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:28.892257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e21223ae-bca4-46c2-b6c5-d19205b83338 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:28.923393 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e21223ae-bca4-46c2-b6c5-d19205b83338 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1276 microversion: 2.1 time: 0.216863 Oct 04 21:26:28.928233 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2103/4226] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:28 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1276 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:28.934709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0d5fe716-af2d-4745-811c-c88eeb50e102 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:28.946426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d5fe716-af2d-4745-811c-c88eeb50e102 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:28.947382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d5fe716-af2d-4745-811c-c88eeb50e102 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:28.948075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d5fe716-af2d-4745-811c-c88eeb50e102 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:28.983762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0d5fe716-af2d-4745-811c-c88eeb50e102 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Going to try to stop instance {{(pid=122758) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:26:29.241837 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0d5fe716-af2d-4745-811c-c88eeb50e102 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action" status: 202 len: 0 microversion: 2.1 time: 0.305313 Oct 04 21:26:29.241837 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2104/4227] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:26:28 2022] POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:26:29.250899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8779d704-9d44-49cb-b02d-d24b0695e385 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:29.254912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8779d704-9d44-49cb-b02d-d24b0695e385 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:29.280833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8779d704-9d44-49cb-b02d-d24b0695e385 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:29.282060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8779d704-9d44-49cb-b02d-d24b0695e385 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:29.284273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8779d704-9d44-49cb-b02d-d24b0695e385 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:29.285138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8779d704-9d44-49cb-b02d-d24b0695e385 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:29.288767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8779d704-9d44-49cb-b02d-d24b0695e385 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:29.289257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8779d704-9d44-49cb-b02d-d24b0695e385 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:29.908011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8779d704-9d44-49cb-b02d-d24b0695e385 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:29.919552 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8779d704-9d44-49cb-b02d-d24b0695e385 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1678 microversion: 2.1 time: 0.679847 Oct 04 21:26:29.920184 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2105/4228] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:29 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1678 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:26:29.950335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fa9d4b21-7942-455b-aa86-64e9e493ab5f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:29.950962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fa9d4b21-7942-455b-aa86-64e9e493ab5f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:29.967364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa9d4b21-7942-455b-aa86-64e9e493ab5f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:29.967873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa9d4b21-7942-455b-aa86-64e9e493ab5f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:29.968384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa9d4b21-7942-455b-aa86-64e9e493ab5f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:29.969106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa9d4b21-7942-455b-aa86-64e9e493ab5f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:29.969953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa9d4b21-7942-455b-aa86-64e9e493ab5f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:29.970392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa9d4b21-7942-455b-aa86-64e9e493ab5f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:30.464812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e11a6530-c11b-4d69-936b-d28f4ee262f1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Doing local delete in cell 016bade6-ba85-4482-99c1-a6ee7c8937c1(cell1) {{(pid=122757) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 21:26:30.466897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e11a6530-c11b-4d69-936b-d28f4ee262f1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:30.467766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e11a6530-c11b-4d69-936b-d28f4ee262f1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:30.468429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e11a6530-c11b-4d69-936b-d28f4ee262f1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:30.469633 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.compute.api [None req-e11a6530-c11b-4d69-936b-d28f4ee262f1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 21:26:30.481126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-e11a6530-c11b-4d69-936b-d28f4ee262f1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] deallocate_for_instance() {{(pid=122757) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 21:26:30.490396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fa9d4b21-7942-455b-aa86-64e9e493ab5f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:30.498958 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fa9d4b21-7942-455b-aa86-64e9e493ab5f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1276 microversion: 2.1 time: 0.552572 Oct 04 21:26:30.506375 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2106/4229] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:29 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1276 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:26:30.959893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-50bec9c5-36f3-4beb-bb21-746250ed0a2f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:30.960949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-50bec9c5-36f3-4beb-bb21-746250ed0a2f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:30.968540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50bec9c5-36f3-4beb-bb21-746250ed0a2f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:30.969366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50bec9c5-36f3-4beb-bb21-746250ed0a2f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:30.970245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50bec9c5-36f3-4beb-bb21-746250ed0a2f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:30.971163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50bec9c5-36f3-4beb-bb21-746250ed0a2f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:30.971624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50bec9c5-36f3-4beb-bb21-746250ed0a2f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:30.972058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50bec9c5-36f3-4beb-bb21-746250ed0a2f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:31.775151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-50bec9c5-36f3-4beb-bb21-746250ed0a2f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:31.788138 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-50bec9c5-36f3-4beb-bb21-746250ed0a2f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1678 microversion: 2.1 time: 0.844280 Oct 04 21:26:31.792899 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2107/4230] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:30 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1678 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:31.798467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-21104b2a-3346-453f-b953-eda8b7ff2a19 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:31.803844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-21104b2a-3346-453f-b953-eda8b7ff2a19 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:31.822684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21104b2a-3346-453f-b953-eda8b7ff2a19 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:31.823180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21104b2a-3346-453f-b953-eda8b7ff2a19 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:31.823703 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21104b2a-3346-453f-b953-eda8b7ff2a19 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:31.824412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21104b2a-3346-453f-b953-eda8b7ff2a19 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:31.824869 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21104b2a-3346-453f-b953-eda8b7ff2a19 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:31.825321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21104b2a-3346-453f-b953-eda8b7ff2a19 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:32.070502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:32.462397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-21104b2a-3346-453f-b953-eda8b7ff2a19 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:32.479083 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-21104b2a-3346-453f-b953-eda8b7ff2a19 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1318 microversion: 2.1 time: 0.684017 Oct 04 21:26:32.480603 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2108/4231] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:31 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1318 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:32.817503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1e5f9ebe-3e94-4ff3-a5a8-bb72f39cbad2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:32.820022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1e5f9ebe-3e94-4ff3-a5a8-bb72f39cbad2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:32.829536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e5f9ebe-3e94-4ff3-a5a8-bb72f39cbad2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:32.830366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e5f9ebe-3e94-4ff3-a5a8-bb72f39cbad2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:32.831046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e5f9ebe-3e94-4ff3-a5a8-bb72f39cbad2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:32.832487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e5f9ebe-3e94-4ff3-a5a8-bb72f39cbad2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:32.833182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e5f9ebe-3e94-4ff3-a5a8-bb72f39cbad2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:32.834446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e5f9ebe-3e94-4ff3-a5a8-bb72f39cbad2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:32.847195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:33.104434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-e11a6530-c11b-4d69-936b-d28f4ee262f1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Updating instance_info_cache with network_info: [] {{(pid=122757) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:26:33.393996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1e5f9ebe-3e94-4ff3-a5a8-bb72f39cbad2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:33.406701 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1e5f9ebe-3e94-4ff3-a5a8-bb72f39cbad2 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1678 microversion: 2.1 time: 0.593774 Oct 04 21:26:33.414135 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2109/4232] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:32 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1678 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:33.997052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-d9c9aabe-4bb5-45a1-9775-87695d2682e9 req-15d0e14e-9c0a-443f-b706-d970d8618971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f7b402-4b3a-4a39-8686-9e9b36f9e040", "name": "network-vif-deleted", "tag": "c883d4ee-a39d-4507-8568-f4e4fd4c7cd3"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:34.029470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d9c9aabe-4bb5-45a1-9775-87695d2682e9 req-15d0e14e-9c0a-443f-b706-d970d8618971 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:34.029470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d9c9aabe-4bb5-45a1-9775-87695d2682e9 req-15d0e14e-9c0a-443f-b706-d970d8618971 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:34.029470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d9c9aabe-4bb5-45a1-9775-87695d2682e9 req-15d0e14e-9c0a-443f-b706-d970d8618971 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:34.049243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.compute.server_external_events [req-d9c9aabe-4bb5-45a1-9775-87695d2682e9 req-15d0e14e-9c0a-443f-b706-d970d8618971 service nova] Unable to find a host for instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040. Dropping event network-vif-deleted {{(pid=122758) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 21:26:34.050547 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-d9c9aabe-4bb5-45a1-9775-87695d2682e9 req-15d0e14e-9c0a-443f-b706-d970d8618971 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.630670 Oct 04 21:26:34.051687 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2110/4233] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 637 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 21:26:34.058369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5e5fc79c-1827-4d51-82a7-fb389616ebd4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:34.060584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5e5fc79c-1827-4d51-82a7-fb389616ebd4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:34.069187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e5fc79c-1827-4d51-82a7-fb389616ebd4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:34.073563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e5fc79c-1827-4d51-82a7-fb389616ebd4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:34.076687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e5fc79c-1827-4d51-82a7-fb389616ebd4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:34.077673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e5fc79c-1827-4d51-82a7-fb389616ebd4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:34.078217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e5fc79c-1827-4d51-82a7-fb389616ebd4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:34.078659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e5fc79c-1827-4d51-82a7-fb389616ebd4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:34.509983 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e11a6530-c11b-4d69-936b-d28f4ee262f1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 204 len: 0 microversion: 2.1 time: 6.583413 Oct 04 21:26:34.515239 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2124/4234] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:26:27 2022] DELETE /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 0 bytes in 6586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:26:34.523599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6dfdb793-1765-4e56-81f6-b40140c34c0e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:34.524379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6dfdb793-1765-4e56-81f6-b40140c34c0e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:34.540465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6dfdb793-1765-4e56-81f6-b40140c34c0e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:34.541035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6dfdb793-1765-4e56-81f6-b40140c34c0e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:34.541597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6dfdb793-1765-4e56-81f6-b40140c34c0e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:34.542628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6dfdb793-1765-4e56-81f6-b40140c34c0e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:34.543566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6dfdb793-1765-4e56-81f6-b40140c34c0e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:34.544208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6dfdb793-1765-4e56-81f6-b40140c34c0e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:35.134091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5e5fc79c-1827-4d51-82a7-fb389616ebd4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:35.136876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6dfdb793-1765-4e56-81f6-b40140c34c0e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:35.145203 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5e5fc79c-1827-4d51-82a7-fb389616ebd4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1318 microversion: 2.1 time: 1.091577 Oct 04 21:26:35.147711 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6dfdb793-1765-4e56-81f6-b40140c34c0e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1678 microversion: 2.1 time: 0.631058 Oct 04 21:26:35.148306 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2125/4235] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:34 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1678 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:35.164807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1a2f945c-8526-46b4-b13a-b37a10ae77f7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:35.165679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1a2f945c-8526-46b4-b13a-b37a10ae77f7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:35.165933 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2111/4236] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:34 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1318 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:35.179140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a2f945c-8526-46b4-b13a-b37a10ae77f7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:35.181214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a2f945c-8526-46b4-b13a-b37a10ae77f7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:35.184040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a2f945c-8526-46b4-b13a-b37a10ae77f7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:35.184945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a2f945c-8526-46b4-b13a-b37a10ae77f7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:35.185605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a2f945c-8526-46b4-b13a-b37a10ae77f7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:35.186220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a2f945c-8526-46b4-b13a-b37a10ae77f7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:35.203721 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-1a2f945c-8526-46b4-b13a-b37a10ae77f7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 could not be found. Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1a2f945c-8526-46b4-b13a-b37a10ae77f7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 HTTP/1.1 Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 could not be found. Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '39f7b402-4b3a-4a39-8686-9e9b36f9e040'} Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 could not be found. Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 could not be found. Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:26:35.205598 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:26:35.215343 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:35.215343 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:26:35.215343 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:26:35.215343 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:26:35.215343 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:26:35.215343 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 could not be found. Oct 04 21:26:35.215343 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:26:35.215343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1a2f945c-8526-46b4-b13a-b37a10ae77f7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:26:35.215343 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1a2f945c-8526-46b4-b13a-b37a10ae77f7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 404 len: 111 microversion: 2.1 time: 0.056942 Oct 04 21:26:35.215343 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2126/4237] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:35 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:26:35.394189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6d1813fa-e5cd-43f9-8432-92150ed78697 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1220554853", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "f54abd1e-a2a0-4f4b-b858-f3831f4d8295"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:35.474743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-6d1813fa-e5cd-43f9-8432-92150ed78697 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] validate_networks() for [('f54abd1e-a2a0-4f4b-b858-f3831f4d8295', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:26:36.102657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-3d0883d6-a25f-4945-9328-cd4342b50dd3 req-1ce5f2b4-f2da-4047-95eb-9ae6f740fd2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67efa537-ebf8-481f-8d5b-dfcae879bc9c", "tag": "26c619a4-039b-446b-b368-a9c902c8e043"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:36.137024 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3d0883d6-a25f-4945-9328-cd4342b50dd3 req-1ce5f2b4-f2da-4047-95eb-9ae6f740fd2a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:36.141121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3d0883d6-a25f-4945-9328-cd4342b50dd3 req-1ce5f2b4-f2da-4047-95eb-9ae6f740fd2a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:36.141743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3d0883d6-a25f-4945-9328-cd4342b50dd3 req-1ce5f2b4-f2da-4047-95eb-9ae6f740fd2a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:36.178474 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-3d0883d6-a25f-4945-9328-cd4342b50dd3 req-1ce5f2b4-f2da-4047-95eb-9ae6f740fd2a service nova] Creating event network-changed:26c619a4-039b-446b-b368-a9c902c8e043 for instance 67efa537-ebf8-481f-8d5b-dfcae879bc9c on n-h1-860282-1 Oct 04 21:26:36.191063 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-3d0883d6-a25f-4945-9328-cd4342b50dd3 req-1ce5f2b4-f2da-4047-95eb-9ae6f740fd2a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093426 Oct 04 21:26:36.191691 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2127/4238] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:26:36.205708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a6447170-72cf-4aef-bf17-7d561319d487 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:36.210376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a6447170-72cf-4aef-bf17-7d561319d487 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:36.236675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6447170-72cf-4aef-bf17-7d561319d487 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:36.237331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6447170-72cf-4aef-bf17-7d561319d487 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:36.249273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6447170-72cf-4aef-bf17-7d561319d487 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:36.249273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6447170-72cf-4aef-bf17-7d561319d487 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:36.249273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6447170-72cf-4aef-bf17-7d561319d487 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:36.249273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6447170-72cf-4aef-bf17-7d561319d487 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:37.059391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6d1813fa-e5cd-43f9-8432-92150ed78697 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:26:37.059962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6d1813fa-e5cd-43f9-8432-92150ed78697 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:26:37.060307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6d1813fa-e5cd-43f9-8432-92150ed78697 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:26:37.064237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6d1813fa-e5cd-43f9-8432-92150ed78697 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:26:37.064759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6d1813fa-e5cd-43f9-8432-92150ed78697 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:26:37.083684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d1813fa-e5cd-43f9-8432-92150ed78697 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:37.084805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d1813fa-e5cd-43f9-8432-92150ed78697 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:37.085477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d1813fa-e5cd-43f9-8432-92150ed78697 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:37.086412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d1813fa-e5cd-43f9-8432-92150ed78697 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:37.087163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d1813fa-e5cd-43f9-8432-92150ed78697 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:37.087769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d1813fa-e5cd-43f9-8432-92150ed78697 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:37.112748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-6d1813fa-e5cd-43f9-8432-92150ed78697 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Getting quotas for project 68c56e6603d14d9b8ad9c74a9df021c9. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:26:37.120557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-6d1813fa-e5cd-43f9-8432-92150ed78697 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Getting quotas for user 416e0c617ee34a19a7d6936b78c1d94d and project 68c56e6603d14d9b8ad9c74a9df021c9. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:26:37.137695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6d1813fa-e5cd-43f9-8432-92150ed78697 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:26:37.141356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6d1813fa-e5cd-43f9-8432-92150ed78697 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:26:37.220604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a6447170-72cf-4aef-bf17-7d561319d487 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:37.235016 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a6447170-72cf-4aef-bf17-7d561319d487 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1678 microversion: 2.1 time: 1.039620 Oct 04 21:26:37.245533 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2128/4239] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:36 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1678 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:37.245533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4346608c-c39e-4317-adb1-57887869e112 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:37.245533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4346608c-c39e-4317-adb1-57887869e112 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:37.259354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4346608c-c39e-4317-adb1-57887869e112 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:37.262715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4346608c-c39e-4317-adb1-57887869e112 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:37.263441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4346608c-c39e-4317-adb1-57887869e112 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:37.266479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4346608c-c39e-4317-adb1-57887869e112 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:37.267647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4346608c-c39e-4317-adb1-57887869e112 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:37.268260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4346608c-c39e-4317-adb1-57887869e112 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:37.343885 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6d1813fa-e5cd-43f9-8432-92150ed78697 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.957317 Oct 04 21:26:37.394259 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2112/4240] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:26:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:26:37.430728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dbcd5b9c-6bcc-437b-b119-4d4972782508 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:37.439408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dbcd5b9c-6bcc-437b-b119-4d4972782508 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:37.862507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dbcd5b9c-6bcc-437b-b119-4d4972782508 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:37.873363 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dbcd5b9c-6bcc-437b-b119-4d4972782508 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1215 microversion: 2.1 time: 0.470891 Oct 04 21:26:37.883626 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2113/4241] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:37 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1215 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:38.266291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0af6754d-c375-4a5a-83c6-bb5cb5c8084a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:38.266939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0af6754d-c375-4a5a-83c6-bb5cb5c8084a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:38.274048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0af6754d-c375-4a5a-83c6-bb5cb5c8084a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:38.274556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0af6754d-c375-4a5a-83c6-bb5cb5c8084a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:38.275009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0af6754d-c375-4a5a-83c6-bb5cb5c8084a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:38.275729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0af6754d-c375-4a5a-83c6-bb5cb5c8084a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:38.286756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0af6754d-c375-4a5a-83c6-bb5cb5c8084a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:38.287917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0af6754d-c375-4a5a-83c6-bb5cb5c8084a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:38.824099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4346608c-c39e-4317-adb1-57887869e112 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:38.853163 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4346608c-c39e-4317-adb1-57887869e112 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1318 microversion: 2.1 time: 1.615996 Oct 04 21:26:38.854237 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2129/4242] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:37 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1318 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:38.886407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0af6754d-c375-4a5a-83c6-bb5cb5c8084a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:38.896703 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0af6754d-c375-4a5a-83c6-bb5cb5c8084a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1678 microversion: 2.1 time: 0.636959 Oct 04 21:26:38.898225 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2114/4243] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:38 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1678 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:38.909345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4b2d4a5f-8f82-4c8b-a194-e618e8332277 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:38.911082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4b2d4a5f-8f82-4c8b-a194-e618e8332277 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:39.118656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4b2d4a5f-8f82-4c8b-a194-e618e8332277 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:39.134860 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4b2d4a5f-8f82-4c8b-a194-e618e8332277 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1215 microversion: 2.1 time: 0.229035 Oct 04 21:26:39.135712 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2130/4244] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:38 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1215 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:39.877973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-79e03e34-b83c-4162-8960-b509a77b85af tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:39.879549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-79e03e34-b83c-4162-8960-b509a77b85af tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:39.889129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:39.891813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79e03e34-b83c-4162-8960-b509a77b85af tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:39.892540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79e03e34-b83c-4162-8960-b509a77b85af tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:39.893502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79e03e34-b83c-4162-8960-b509a77b85af tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:39.894811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79e03e34-b83c-4162-8960-b509a77b85af tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:39.897698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79e03e34-b83c-4162-8960-b509a77b85af tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:39.902188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79e03e34-b83c-4162-8960-b509a77b85af tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:39.937841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-44126252-e80d-4b8b-ac96-467878430003 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:39.940060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-44126252-e80d-4b8b-ac96-467878430003 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:39.967503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44126252-e80d-4b8b-ac96-467878430003 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:39.975186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44126252-e80d-4b8b-ac96-467878430003 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:39.975853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44126252-e80d-4b8b-ac96-467878430003 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:39.989890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44126252-e80d-4b8b-ac96-467878430003 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:39.989890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44126252-e80d-4b8b-ac96-467878430003 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:39.989890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44126252-e80d-4b8b-ac96-467878430003 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:41.767373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-79e03e34-b83c-4162-8960-b509a77b85af tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:41.787946 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-79e03e34-b83c-4162-8960-b509a77b85af tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1318 microversion: 2.1 time: 1.914937 Oct 04 21:26:41.821157 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2115/4245] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:39 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1318 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:41.834122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-15fe45f9-3490-44f4-a4fc-c9485aef8f01 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:41.835202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-15fe45f9-3490-44f4-a4fc-c9485aef8f01 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:41.842156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15fe45f9-3490-44f4-a4fc-c9485aef8f01 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:41.849770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15fe45f9-3490-44f4-a4fc-c9485aef8f01 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:41.849770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15fe45f9-3490-44f4-a4fc-c9485aef8f01 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:41.849770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15fe45f9-3490-44f4-a4fc-c9485aef8f01 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:41.849770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15fe45f9-3490-44f4-a4fc-c9485aef8f01 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:41.849770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15fe45f9-3490-44f4-a4fc-c9485aef8f01 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:42.273020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-15fe45f9-3490-44f4-a4fc-c9485aef8f01 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:42.284238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-44126252-e80d-4b8b-ac96-467878430003 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:42.300399 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-44126252-e80d-4b8b-ac96-467878430003 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1655 microversion: 2.1 time: 2.379200 Oct 04 21:26:42.306453 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-15fe45f9-3490-44f4-a4fc-c9485aef8f01 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1273 microversion: 2.1 time: 0.484217 Oct 04 21:26:42.321596 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2131/4246] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:39 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1655 bytes in 2388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:42.325210 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2116/4247] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:41 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1273 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:42.358429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f7b3de3b-021c-4725-a2e6-75219fb2431b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:42.371387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7b3de3b-021c-4725-a2e6-75219fb2431b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:42.374573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7b3de3b-021c-4725-a2e6-75219fb2431b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:42.375129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7b3de3b-021c-4725-a2e6-75219fb2431b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:42.445840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f7b3de3b-021c-4725-a2e6-75219fb2431b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Going to try to start instance {{(pid=122757) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 21:26:42.667280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:42.819630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c36a1f5a-c76f-4413-9a53-16e6cb135c28 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:42.821222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c36a1f5a-c76f-4413-9a53-16e6cb135c28 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:42.831608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c36a1f5a-c76f-4413-9a53-16e6cb135c28 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:42.832536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c36a1f5a-c76f-4413-9a53-16e6cb135c28 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:42.834031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c36a1f5a-c76f-4413-9a53-16e6cb135c28 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:42.835314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c36a1f5a-c76f-4413-9a53-16e6cb135c28 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:42.836141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c36a1f5a-c76f-4413-9a53-16e6cb135c28 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:42.836772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c36a1f5a-c76f-4413-9a53-16e6cb135c28 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:42.848767 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f7b3de3b-021c-4725-a2e6-75219fb2431b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action" status: 202 len: 0 microversion: 2.1 time: 0.497365 Oct 04 21:26:42.850510 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2132/4248] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:26:42 2022] POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:26:42.888152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:42.896264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-43a0b4f4-fe68-49a9-8ba5-bc910785195f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:42.897821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-43a0b4f4-fe68-49a9-8ba5-bc910785195f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:42.907346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43a0b4f4-fe68-49a9-8ba5-bc910785195f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:42.908110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43a0b4f4-fe68-49a9-8ba5-bc910785195f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:42.908815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43a0b4f4-fe68-49a9-8ba5-bc910785195f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:42.910050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43a0b4f4-fe68-49a9-8ba5-bc910785195f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:42.910738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43a0b4f4-fe68-49a9-8ba5-bc910785195f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:42.912082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43a0b4f4-fe68-49a9-8ba5-bc910785195f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:43.548356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-43a0b4f4-fe68-49a9-8ba5-bc910785195f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:43.562805 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-43a0b4f4-fe68-49a9-8ba5-bc910785195f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1664 microversion: 2.1 time: 0.707524 Oct 04 21:26:43.566143 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2133/4249] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:42 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1664 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:26:43.576617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c3a848be-e007-48a1-9d8f-37266c7b671f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:43.577917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c3a848be-e007-48a1-9d8f-37266c7b671f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:43.600093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3a848be-e007-48a1-9d8f-37266c7b671f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:43.610297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3a848be-e007-48a1-9d8f-37266c7b671f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:43.613953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3a848be-e007-48a1-9d8f-37266c7b671f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:43.615717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3a848be-e007-48a1-9d8f-37266c7b671f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:43.626267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3a848be-e007-48a1-9d8f-37266c7b671f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:43.627109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3a848be-e007-48a1-9d8f-37266c7b671f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:44.352665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c3a848be-e007-48a1-9d8f-37266c7b671f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:44.367633 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c3a848be-e007-48a1-9d8f-37266c7b671f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1273 microversion: 2.1 time: 0.795660 Oct 04 21:26:44.383562 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2134/4250] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:43 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1273 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:44.397279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-bd610f99-cf75-4562-b5cd-3e20e00ff528 req-3819b4c6-2c97-4a35-bf05-b6e85e0e82e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67efa537-ebf8-481f-8d5b-dfcae879bc9c", "name": "network-vif-plugged", "status": "completed", "tag": "26c619a4-039b-446b-b368-a9c902c8e043"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:44.421355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bd610f99-cf75-4562-b5cd-3e20e00ff528 req-3819b4c6-2c97-4a35-bf05-b6e85e0e82e7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:44.421871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bd610f99-cf75-4562-b5cd-3e20e00ff528 req-3819b4c6-2c97-4a35-bf05-b6e85e0e82e7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:44.426634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bd610f99-cf75-4562-b5cd-3e20e00ff528 req-3819b4c6-2c97-4a35-bf05-b6e85e0e82e7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:44.448659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c36a1f5a-c76f-4413-9a53-16e6cb135c28 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:44.475987 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c36a1f5a-c76f-4413-9a53-16e6cb135c28 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1318 microversion: 2.1 time: 1.664028 Oct 04 21:26:44.476852 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2117/4251] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:42 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1318 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:44.499677 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-bd610f99-cf75-4562-b5cd-3e20e00ff528 req-3819b4c6-2c97-4a35-bf05-b6e85e0e82e7 service nova] Creating event network-vif-plugged:26c619a4-039b-446b-b368-a9c902c8e043 for instance 67efa537-ebf8-481f-8d5b-dfcae879bc9c on n-h1-860282-1 Oct 04 21:26:44.511509 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-bd610f99-cf75-4562-b5cd-3e20e00ff528 req-3819b4c6-2c97-4a35-bf05-b6e85e0e82e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126581 Oct 04 21:26:44.516010 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2135/4252] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:26:44.594143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1aa1dfcb-657b-4248-9cf5-2b7a296993ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:44.595226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1aa1dfcb-657b-4248-9cf5-2b7a296993ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:44.606374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1aa1dfcb-657b-4248-9cf5-2b7a296993ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:44.608684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1aa1dfcb-657b-4248-9cf5-2b7a296993ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:44.615062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1aa1dfcb-657b-4248-9cf5-2b7a296993ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:44.615062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1aa1dfcb-657b-4248-9cf5-2b7a296993ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:44.615062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1aa1dfcb-657b-4248-9cf5-2b7a296993ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:44.615062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1aa1dfcb-657b-4248-9cf5-2b7a296993ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:44.782591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-844b1906-dcad-4e55-a4a2-cc470a832b8d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Action: 'create', calling method: .version_select at 0x7f578b4ca700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1894313533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTS+nNpVY6symNCiYqRSUhn/B3Hs17ZkuL5sSjub9QrpqP4aknj8mwzbt9m9fv9QeUrnDupQrkRN8J7uT7jAahVfq1sgqZN2a/78WoC29file511THPf+HggZy2PIj4xA=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:44.806228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-844b1906-dcad-4e55-a4a2-cc470a832b8d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Getting quotas for project f74afbd0dc37402fa84ec9d6e2cb53f4. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:26:44.814250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-844b1906-dcad-4e55-a4a2-cc470a832b8d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Getting quotas for user 933f720fbafe482d95b27cd372934ab6 and project f74afbd0dc37402fa84ec9d6e2cb53f4. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:26:44.912723 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-844b1906-dcad-4e55-a4a2-cc470a832b8d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.134507 Oct 04 21:26:44.914136 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2136/4253] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:26:44 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:26:45.398041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-58d8fe3c-ad63-4b7c-911c-40550c508d3d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:45.399106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-58d8fe3c-ad63-4b7c-911c-40550c508d3d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:45.412337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58d8fe3c-ad63-4b7c-911c-40550c508d3d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:45.412853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58d8fe3c-ad63-4b7c-911c-40550c508d3d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:45.413296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58d8fe3c-ad63-4b7c-911c-40550c508d3d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:45.414041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58d8fe3c-ad63-4b7c-911c-40550c508d3d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:45.416632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58d8fe3c-ad63-4b7c-911c-40550c508d3d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:45.418756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58d8fe3c-ad63-4b7c-911c-40550c508d3d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:45.492646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1aa1dfcb-657b-4248-9cf5-2b7a296993ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:45.506759 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1aa1dfcb-657b-4248-9cf5-2b7a296993ac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1664 microversion: 2.1 time: 0.916592 Oct 04 21:26:45.507373 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2118/4254] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:44 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1664 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:45.526796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-80606b33-fc37-441f-9fbc-1dff0e614e05 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:45.528942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-80606b33-fc37-441f-9fbc-1dff0e614e05 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:45.547507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80606b33-fc37-441f-9fbc-1dff0e614e05 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:45.549600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80606b33-fc37-441f-9fbc-1dff0e614e05 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:45.551423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80606b33-fc37-441f-9fbc-1dff0e614e05 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:45.554790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80606b33-fc37-441f-9fbc-1dff0e614e05 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:45.555777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80606b33-fc37-441f-9fbc-1dff0e614e05 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:45.557870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80606b33-fc37-441f-9fbc-1dff0e614e05 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:46.370829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-80606b33-fc37-441f-9fbc-1dff0e614e05 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:46.380051 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-80606b33-fc37-441f-9fbc-1dff0e614e05 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1318 microversion: 2.1 time: 0.871608 Oct 04 21:26:46.381928 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2119/4255] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:45 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1318 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:46.539846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1ceb630e-39e7-4d83-b4a3-dffc06936aac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:46.543802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1ceb630e-39e7-4d83-b4a3-dffc06936aac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:46.549026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-58d8fe3c-ad63-4b7c-911c-40550c508d3d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:46.553990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ceb630e-39e7-4d83-b4a3-dffc06936aac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:46.558292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ceb630e-39e7-4d83-b4a3-dffc06936aac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:46.559001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ceb630e-39e7-4d83-b4a3-dffc06936aac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:46.559538 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-58d8fe3c-ad63-4b7c-911c-40550c508d3d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1315 microversion: 2.1 time: 1.167202 Oct 04 21:26:46.562369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ceb630e-39e7-4d83-b4a3-dffc06936aac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:46.569193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ceb630e-39e7-4d83-b4a3-dffc06936aac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:46.569193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ceb630e-39e7-4d83-b4a3-dffc06936aac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:46.585028 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2137/4256] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:45 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1315 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:26:47.101027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:47.420188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4f6c8ca7-5d45-4d9e-8b81-dfffd1349bd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:47.421198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4f6c8ca7-5d45-4d9e-8b81-dfffd1349bd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:47.441132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f6c8ca7-5d45-4d9e-8b81-dfffd1349bd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:47.442019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f6c8ca7-5d45-4d9e-8b81-dfffd1349bd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:47.443242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f6c8ca7-5d45-4d9e-8b81-dfffd1349bd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:47.444311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f6c8ca7-5d45-4d9e-8b81-dfffd1349bd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:47.445027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f6c8ca7-5d45-4d9e-8b81-dfffd1349bd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:47.446069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f6c8ca7-5d45-4d9e-8b81-dfffd1349bd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:47.611210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1ceb630e-39e7-4d83-b4a3-dffc06936aac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:47.656604 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1ceb630e-39e7-4d83-b4a3-dffc06936aac tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1664 microversion: 2.1 time: 1.125304 Oct 04 21:26:47.665188 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2120/4257] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:46 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1664 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:47.679461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dd6c072b-fa80-4b27-83a1-6a688faef830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:47.680088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dd6c072b-fa80-4b27-83a1-6a688faef830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:47.697482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd6c072b-fa80-4b27-83a1-6a688faef830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:47.698014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd6c072b-fa80-4b27-83a1-6a688faef830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:47.698475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd6c072b-fa80-4b27-83a1-6a688faef830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:47.699222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd6c072b-fa80-4b27-83a1-6a688faef830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:47.699727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd6c072b-fa80-4b27-83a1-6a688faef830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:47.700155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd6c072b-fa80-4b27-83a1-6a688faef830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:47.870102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:48.250472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4f6c8ca7-5d45-4d9e-8b81-dfffd1349bd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:48.261254 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4f6c8ca7-5d45-4d9e-8b81-dfffd1349bd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1508 microversion: 2.1 time: 0.856122 Oct 04 21:26:48.265584 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2138/4258] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:47 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1508 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:48.293084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f03c37b4-747b-4d78-aec3-59925f00f108 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:48.294107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f03c37b4-747b-4d78-aec3-59925f00f108 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:48.304375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f03c37b4-747b-4d78-aec3-59925f00f108 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:48.304795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f03c37b4-747b-4d78-aec3-59925f00f108 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:48.305239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f03c37b4-747b-4d78-aec3-59925f00f108 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:48.305978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f03c37b4-747b-4d78-aec3-59925f00f108 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:48.306439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f03c37b4-747b-4d78-aec3-59925f00f108 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:48.310049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f03c37b4-747b-4d78-aec3-59925f00f108 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:48.383457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dd6c072b-fa80-4b27-83a1-6a688faef830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:48.409130 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dd6c072b-fa80-4b27-83a1-6a688faef830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1315 microversion: 2.1 time: 0.733157 Oct 04 21:26:48.431438 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2121/4259] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:47 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1315 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:48.689399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-428d0917-5aef-4707-afda-896fd95633db tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:48.691885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-428d0917-5aef-4707-afda-896fd95633db tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:48.704704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-428d0917-5aef-4707-afda-896fd95633db tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:48.705121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-428d0917-5aef-4707-afda-896fd95633db tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:48.710244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-428d0917-5aef-4707-afda-896fd95633db tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:48.711821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-428d0917-5aef-4707-afda-896fd95633db tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:48.713011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-428d0917-5aef-4707-afda-896fd95633db tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:48.713985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-428d0917-5aef-4707-afda-896fd95633db tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:49.407712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-428d0917-5aef-4707-afda-896fd95633db tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:49.412355 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-428d0917-5aef-4707-afda-896fd95633db tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1664 microversion: 2.1 time: 0.727062 Oct 04 21:26:49.412968 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2122/4260] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:48 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1664 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:49.470805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dac1997b-55c5-4c3c-8d25-7571bc9a39aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:49.472542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f03c37b4-747b-4d78-aec3-59925f00f108 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:49.478209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dac1997b-55c5-4c3c-8d25-7571bc9a39aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:49.504718 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f03c37b4-747b-4d78-aec3-59925f00f108 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1508 microversion: 2.1 time: 1.215634 Oct 04 21:26:49.511905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dac1997b-55c5-4c3c-8d25-7571bc9a39aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:49.512751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dac1997b-55c5-4c3c-8d25-7571bc9a39aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:49.513083 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2139/4261] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:48 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1508 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:49.513691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dac1997b-55c5-4c3c-8d25-7571bc9a39aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:49.514726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dac1997b-55c5-4c3c-8d25-7571bc9a39aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:49.515374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dac1997b-55c5-4c3c-8d25-7571bc9a39aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:49.516057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dac1997b-55c5-4c3c-8d25-7571bc9a39aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:49.540851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cb427bc2-3d64-4181-ac11-ac2839f97ecf tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:49.544702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cb427bc2-3d64-4181-ac11-ac2839f97ecf tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:49.556333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb427bc2-3d64-4181-ac11-ac2839f97ecf tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:49.557160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb427bc2-3d64-4181-ac11-ac2839f97ecf tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:49.557866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb427bc2-3d64-4181-ac11-ac2839f97ecf tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:49.558906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb427bc2-3d64-4181-ac11-ac2839f97ecf tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:49.559638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb427bc2-3d64-4181-ac11-ac2839f97ecf tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:49.560292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb427bc2-3d64-4181-ac11-ac2839f97ecf tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:49.769172 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cb427bc2-3d64-4181-ac11-ac2839f97ecf tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "PUT /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1080 microversion: 2.1 time: 0.230828 Oct 04 21:26:49.778105 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2140/4262] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Oct 4 21:26:49 2022] PUT /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1080 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:49.807788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5c649b4a-5bdb-45c9-8d78-c1d7c602b228 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:49.808928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5c649b4a-5bdb-45c9-8d78-c1d7c602b228 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:49.820385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c649b4a-5bdb-45c9-8d78-c1d7c602b228 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:49.820889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c649b4a-5bdb-45c9-8d78-c1d7c602b228 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:49.821334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c649b4a-5bdb-45c9-8d78-c1d7c602b228 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:49.832783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c649b4a-5bdb-45c9-8d78-c1d7c602b228 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:49.832783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c649b4a-5bdb-45c9-8d78-c1d7c602b228 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:49.832783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c649b4a-5bdb-45c9-8d78-c1d7c602b228 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:50.748156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dac1997b-55c5-4c3c-8d25-7571bc9a39aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:50.775194 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dac1997b-55c5-4c3c-8d25-7571bc9a39aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1315 microversion: 2.1 time: 1.338411 Oct 04 21:26:50.778663 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2123/4263] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:49 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1315 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:50.790678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1163c26a-5e53-4d58-8a28-88d297edce69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:50.798391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1163c26a-5e53-4d58-8a28-88d297edce69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:50.812483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1163c26a-5e53-4d58-8a28-88d297edce69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:50.812993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1163c26a-5e53-4d58-8a28-88d297edce69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:50.813478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1163c26a-5e53-4d58-8a28-88d297edce69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:50.814389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1163c26a-5e53-4d58-8a28-88d297edce69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:50.815018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1163c26a-5e53-4d58-8a28-88d297edce69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:50.815656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1163c26a-5e53-4d58-8a28-88d297edce69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:50.833389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5c649b4a-5bdb-45c9-8d78-c1d7c602b228 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:50.844534 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5c649b4a-5bdb-45c9-8d78-c1d7c602b228 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1506 microversion: 2.1 time: 1.049450 Oct 04 21:26:50.847239 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2141/4264] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:49 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1506 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:50.852983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-639889bf-b65c-4078-8246-410be8be2f6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1341649243", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "f2f00a17-9e6b-4ed6-a8f4-25b2c96e8828"}], "key_name": "tempest-TestNetworkBasicOps-1894313533", "security_groups": [{"name": "tempest-secgroup-smoke-434404215"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:51.184748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-639889bf-b65c-4078-8246-410be8be2f6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] validate_networks() for [('f2f00a17-9e6b-4ed6-a8f4-25b2c96e8828', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:26:52.010732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1163c26a-5e53-4d58-8a28-88d297edce69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:52.019819 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1163c26a-5e53-4d58-8a28-88d297edce69 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 1.240041 Oct 04 21:26:52.022685 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2124/4265] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:50 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:52.029412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7291c090-1e0f-44dd-9912-6f81b8efb524 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:52.032516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7291c090-1e0f-44dd-9912-6f81b8efb524 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:52.053105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7291c090-1e0f-44dd-9912-6f81b8efb524 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:52.053633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7291c090-1e0f-44dd-9912-6f81b8efb524 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:52.055650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7291c090-1e0f-44dd-9912-6f81b8efb524 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:52.056591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7291c090-1e0f-44dd-9912-6f81b8efb524 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:52.057721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7291c090-1e0f-44dd-9912-6f81b8efb524 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:52.061004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7291c090-1e0f-44dd-9912-6f81b8efb524 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:53.185468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7291c090-1e0f-44dd-9912-6f81b8efb524 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:53.205752 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7291c090-1e0f-44dd-9912-6f81b8efb524 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1506 microversion: 2.1 time: 1.181187 Oct 04 21:26:53.209814 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2125/4266] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:52 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1506 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:53.224738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4c7a001f-8f2c-41ae-8a91-c12b376c3421 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:53.225457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4c7a001f-8f2c-41ae-8a91-c12b376c3421 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:53.235636 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c7a001f-8f2c-41ae-8a91-c12b376c3421 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:53.237263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c7a001f-8f2c-41ae-8a91-c12b376c3421 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:53.237843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c7a001f-8f2c-41ae-8a91-c12b376c3421 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:53.238701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c7a001f-8f2c-41ae-8a91-c12b376c3421 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:53.239227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c7a001f-8f2c-41ae-8a91-c12b376c3421 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:53.239756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c7a001f-8f2c-41ae-8a91-c12b376c3421 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:53.938844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4c7a001f-8f2c-41ae-8a91-c12b376c3421 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:53.952178 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4c7a001f-8f2c-41ae-8a91-c12b376c3421 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1315 microversion: 2.1 time: 0.741143 Oct 04 21:26:53.968858 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2126/4267] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:53 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1315 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:53.985899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e037c5a6-73ea-4955-b67a-ecf1b7a82fff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:53.993238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e037c5a6-73ea-4955-b67a-ecf1b7a82fff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:54.013102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e037c5a6-73ea-4955-b67a-ecf1b7a82fff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:54.016656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e037c5a6-73ea-4955-b67a-ecf1b7a82fff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:54.017345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e037c5a6-73ea-4955-b67a-ecf1b7a82fff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:54.018378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e037c5a6-73ea-4955-b67a-ecf1b7a82fff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:54.019031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e037c5a6-73ea-4955-b67a-ecf1b7a82fff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:54.019627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e037c5a6-73ea-4955-b67a-ecf1b7a82fff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:54.185781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-639889bf-b65c-4078-8246-410be8be2f6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:26:54.187355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-639889bf-b65c-4078-8246-410be8be2f6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:26:54.188265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-639889bf-b65c-4078-8246-410be8be2f6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:26:54.188975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-639889bf-b65c-4078-8246-410be8be2f6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:26:54.189962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-639889bf-b65c-4078-8246-410be8be2f6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:26:54.203462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-639889bf-b65c-4078-8246-410be8be2f6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:54.204099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-639889bf-b65c-4078-8246-410be8be2f6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:54.204668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-639889bf-b65c-4078-8246-410be8be2f6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:54.205683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-639889bf-b65c-4078-8246-410be8be2f6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:54.206453 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-639889bf-b65c-4078-8246-410be8be2f6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:54.207253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-639889bf-b65c-4078-8246-410be8be2f6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:54.261790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-639889bf-b65c-4078-8246-410be8be2f6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Getting quotas for project f74afbd0dc37402fa84ec9d6e2cb53f4. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:26:54.270341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-639889bf-b65c-4078-8246-410be8be2f6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Getting quotas for user 933f720fbafe482d95b27cd372934ab6 and project f74afbd0dc37402fa84ec9d6e2cb53f4. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:26:54.284839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-639889bf-b65c-4078-8246-410be8be2f6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:26:54.289402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-639889bf-b65c-4078-8246-410be8be2f6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:26:54.511537 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-639889bf-b65c-4078-8246-410be8be2f6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.664628 Oct 04 21:26:54.512203 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2142/4268] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:26:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 3666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:26:54.543749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:54.554883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:54.571284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:54.574328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:54.577235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:54.580532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:54.581897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:54.583845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:54.636890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e037c5a6-73ea-4955-b67a-ecf1b7a82fff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:54.650432 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e037c5a6-73ea-4955-b67a-ecf1b7a82fff tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.685603 Oct 04 21:26:54.654724 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2127/4269] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:53 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:54.666830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-204133ad-217a-40e6-abf1-136eaf5f3c94 req-c18bd70a-2dc4-41d0-9bcd-2710dac8fe4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7fd7fe3-c8fd-446d-b1a7-41e34a12159c", "tag": "2103b760-e65f-45c3-84a6-ec2f94579876"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:54.693002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-204133ad-217a-40e6-abf1-136eaf5f3c94 req-c18bd70a-2dc4-41d0-9bcd-2710dac8fe4d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:54.694853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-204133ad-217a-40e6-abf1-136eaf5f3c94 req-c18bd70a-2dc4-41d0-9bcd-2710dac8fe4d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:54.696782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-204133ad-217a-40e6-abf1-136eaf5f3c94 req-c18bd70a-2dc4-41d0-9bcd-2710dac8fe4d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:54.707515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:54.711748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:26:54.712426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:26:54.713064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:26:54.713683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:26:54.714254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:26:54.746454 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-204133ad-217a-40e6-abf1-136eaf5f3c94 req-c18bd70a-2dc4-41d0-9bcd-2710dac8fe4d service nova] Creating event network-changed:2103b760-e65f-45c3-84a6-ec2f94579876 for instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c on n-h2-860282-1 Oct 04 21:26:54.758646 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-204133ad-217a-40e6-abf1-136eaf5f3c94 req-c18bd70a-2dc4-41d0-9bcd-2710dac8fe4d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099505 Oct 04 21:26:54.762453 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2128/4270] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:26:54.777491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fca79baa-aae3-4437-879f-a314bbc0c64f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:54.778744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fca79baa-aae3-4437-879f-a314bbc0c64f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:55.213684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:55.249010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:55.249736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:55.250291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:55.251110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:55.254019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:55.254728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:55.351764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fca79baa-aae3-4437-879f-a314bbc0c64f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:55.365503 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fca79baa-aae3-4437-879f-a314bbc0c64f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37" status: 200 len: 1249 microversion: 2.1 time: 0.599804 Oct 04 21:26:55.377788 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2129/4271] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:54 2022] GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37 => generated 1249 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:55.378287 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-33f73743-67c1-4a37-9e62-0ec55fbebfea tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "POST /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c/action" status: 202 len: 1112 microversion: 2.1 time: 0.863520 Oct 04 21:26:55.378944 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2143/4272] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:26:54 2022] POST /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c/action => generated 1112 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 21:26:55.383875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-65fd811d-4157-4520-b34c-c6148511623a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:55.389084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-65fd811d-4157-4520-b34c-c6148511623a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:55.391215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e7e880db-812a-400f-8be8-40132cfe625e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:55.399660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e7e880db-812a-400f-8be8-40132cfe625e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:55.409000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7e880db-812a-400f-8be8-40132cfe625e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:55.409833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7e880db-812a-400f-8be8-40132cfe625e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:55.411778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7e880db-812a-400f-8be8-40132cfe625e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:55.415268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65fd811d-4157-4520-b34c-c6148511623a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:55.422170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65fd811d-4157-4520-b34c-c6148511623a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:55.425447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65fd811d-4157-4520-b34c-c6148511623a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:55.427320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7e880db-812a-400f-8be8-40132cfe625e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:55.428375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65fd811d-4157-4520-b34c-c6148511623a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:55.430867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65fd811d-4157-4520-b34c-c6148511623a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:55.432827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65fd811d-4157-4520-b34c-c6148511623a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:55.442017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7e880db-812a-400f-8be8-40132cfe625e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:55.443308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7e880db-812a-400f-8be8-40132cfe625e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:56.353120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e7e880db-812a-400f-8be8-40132cfe625e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:56.365333 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e7e880db-812a-400f-8be8-40132cfe625e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1315 microversion: 2.1 time: 0.980552 Oct 04 21:26:56.367337 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2144/4273] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:55 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1315 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:56.382538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f67bd7a1-59fd-431d-be60-572a6c0c6974 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:56.386494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f67bd7a1-59fd-431d-be60-572a6c0c6974 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:56.401809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f67bd7a1-59fd-431d-be60-572a6c0c6974 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:56.403258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f67bd7a1-59fd-431d-be60-572a6c0c6974 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:56.403258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f67bd7a1-59fd-431d-be60-572a6c0c6974 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:56.405537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f67bd7a1-59fd-431d-be60-572a6c0c6974 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:56.407693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f67bd7a1-59fd-431d-be60-572a6c0c6974 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:56.408155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f67bd7a1-59fd-431d-be60-572a6c0c6974 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:56.452705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-65fd811d-4157-4520-b34c-c6148511623a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:56.466705 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-65fd811d-4157-4520-b34c-c6148511623a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 1.087545 Oct 04 21:26:56.467547 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2130/4274] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:55 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:56.518881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a17f218e-4845-4985-9976-de73ce6813b7 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:56.522009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a17f218e-4845-4985-9976-de73ce6813b7 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:56.550203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a17f218e-4845-4985-9976-de73ce6813b7 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:56.552502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a17f218e-4845-4985-9976-de73ce6813b7 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:56.553457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a17f218e-4845-4985-9976-de73ce6813b7 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:56.554577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a17f218e-4845-4985-9976-de73ce6813b7 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:56.555480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a17f218e-4845-4985-9976-de73ce6813b7 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:56.556576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a17f218e-4845-4985-9976-de73ce6813b7 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:56.743887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a17f218e-4845-4985-9976-de73ce6813b7 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:56.752291 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a17f218e-4845-4985-9976-de73ce6813b7 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37" status: 200 len: 1253 microversion: 2.1 time: 0.250045 Oct 04 21:26:56.753115 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2131/4275] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:56 2022] GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37 => generated 1253 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:56.759541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1b4d0f2d-c56c-4fdc-b3f0-d58f41d1f183 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:56.760227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1b4d0f2d-c56c-4fdc-b3f0-d58f41d1f183 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:56.769520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b4d0f2d-c56c-4fdc-b3f0-d58f41d1f183 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:56.772525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b4d0f2d-c56c-4fdc-b3f0-d58f41d1f183 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:56.773040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b4d0f2d-c56c-4fdc-b3f0-d58f41d1f183 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:56.776386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b4d0f2d-c56c-4fdc-b3f0-d58f41d1f183 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:56.777074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b4d0f2d-c56c-4fdc-b3f0-d58f41d1f183 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:56.777534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b4d0f2d-c56c-4fdc-b3f0-d58f41d1f183 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:57.122487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f67bd7a1-59fd-431d-be60-572a6c0c6974 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:57.136197 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f67bd7a1-59fd-431d-be60-572a6c0c6974 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1517 microversion: 2.1 time: 0.763885 Oct 04 21:26:57.136838 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2145/4276] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:56 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1517 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:57.348064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1b4d0f2d-c56c-4fdc-b3f0-d58f41d1f183 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:57.359220 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1b4d0f2d-c56c-4fdc-b3f0-d58f41d1f183 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.604833 Oct 04 21:26:57.385367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b072cd3e-4c09-4767-9d8e-48c7ac2ff052 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:57.386636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b072cd3e-4c09-4767-9d8e-48c7ac2ff052 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:57.389936 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2132/4277] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:56 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:57.393756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b072cd3e-4c09-4767-9d8e-48c7ac2ff052 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:57.402506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b072cd3e-4c09-4767-9d8e-48c7ac2ff052 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:57.404943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b072cd3e-4c09-4767-9d8e-48c7ac2ff052 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:57.405893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b072cd3e-4c09-4767-9d8e-48c7ac2ff052 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:57.406622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-392fc7c3-9417-4ae9-9375-7077309cb2b8 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:57.407275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b072cd3e-4c09-4767-9d8e-48c7ac2ff052 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:57.408093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-392fc7c3-9417-4ae9-9375-7077309cb2b8 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:57.408711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b072cd3e-4c09-4767-9d8e-48c7ac2ff052 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:57.421545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-392fc7c3-9417-4ae9-9375-7077309cb2b8 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:57.422279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-392fc7c3-9417-4ae9-9375-7077309cb2b8 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:57.422906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-392fc7c3-9417-4ae9-9375-7077309cb2b8 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:57.425351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-392fc7c3-9417-4ae9-9375-7077309cb2b8 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:57.426018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-392fc7c3-9417-4ae9-9375-7077309cb2b8 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:57.427148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-392fc7c3-9417-4ae9-9375-7077309cb2b8 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:58.007932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-392fc7c3-9417-4ae9-9375-7077309cb2b8 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:58.023972 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-392fc7c3-9417-4ae9-9375-7077309cb2b8 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1315 microversion: 2.1 time: 0.625277 Oct 04 21:26:58.024894 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2133/4278] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:57 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:58.100876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b072cd3e-4c09-4767-9d8e-48c7ac2ff052 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:58.112167 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b072cd3e-4c09-4767-9d8e-48c7ac2ff052 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.732380 Oct 04 21:26:58.112764 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2146/4279] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:57 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:58.119833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3ba93ad1-1c22-4cbe-97ec-26e2408197b0 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:58.140536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3ba93ad1-1c22-4cbe-97ec-26e2408197b0 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:58.150574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ba93ad1-1c22-4cbe-97ec-26e2408197b0 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:58.151651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ba93ad1-1c22-4cbe-97ec-26e2408197b0 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:58.152270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ba93ad1-1c22-4cbe-97ec-26e2408197b0 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:58.156905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ba93ad1-1c22-4cbe-97ec-26e2408197b0 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:58.156905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ba93ad1-1c22-4cbe-97ec-26e2408197b0 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:58.156905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ba93ad1-1c22-4cbe-97ec-26e2408197b0 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:58.302455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-99ebf62c-4a1e-4c38-a3ab-8910b6bc39fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1989352141", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:58.386071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3ba93ad1-1c22-4cbe-97ec-26e2408197b0 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:58.402288 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3ba93ad1-1c22-4cbe-97ec-26e2408197b0 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37" status: 200 len: 1301 microversion: 2.1 time: 0.286000 Oct 04 21:26:58.406627 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2147/4280] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:58 2022] GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37 => generated 1301 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:58.422175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3eb25190-6665-44e8-9191-fd4794cadf1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:58.423258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3eb25190-6665-44e8-9191-fd4794cadf1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:58.430039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3eb25190-6665-44e8-9191-fd4794cadf1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:58.430890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3eb25190-6665-44e8-9191-fd4794cadf1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:58.445903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3eb25190-6665-44e8-9191-fd4794cadf1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:58.447093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3eb25190-6665-44e8-9191-fd4794cadf1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:58.447963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3eb25190-6665-44e8-9191-fd4794cadf1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:58.448634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3eb25190-6665-44e8-9191-fd4794cadf1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:58.452443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-99ebf62c-4a1e-4c38-a3ab-8910b6bc39fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] validate_networks() for [('6854610d-7b7e-44e1-90bf-b66a6b17f7da', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:26:58.481330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-3eb25190-6665-44e8-9191-fd4794cadf1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lazy-loading 'flavor' on Instance uuid ba61f85c-a75d-451d-a5f7-f9533481c406 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:26:58.508912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:58.866859 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3eb25190-6665-44e8-9191-fd4794cadf1e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action" status: 202 len: 0 microversion: 2.1 time: 0.457210 Oct 04 21:26:58.871682 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2148/4281] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:26:58 2022] POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:26:58.888737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7cd07cad-f8d0-430a-abd0-3c3f95692ab8 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:58.892765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7cd07cad-f8d0-430a-abd0-3c3f95692ab8 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:58.907727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7cd07cad-f8d0-430a-abd0-3c3f95692ab8 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:58.912337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7cd07cad-f8d0-430a-abd0-3c3f95692ab8 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:58.913145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7cd07cad-f8d0-430a-abd0-3c3f95692ab8 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:58.914794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7cd07cad-f8d0-430a-abd0-3c3f95692ab8 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:58.917822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7cd07cad-f8d0-430a-abd0-3c3f95692ab8 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:58.918507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7cd07cad-f8d0-430a-abd0-3c3f95692ab8 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:00.009514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7cd07cad-f8d0-430a-abd0-3c3f95692ab8 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:00.017320 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7cd07cad-f8d0-430a-abd0-3c3f95692ab8 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1517 microversion: 2.1 time: 1.148204 Oct 04 21:27:00.017951 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2149/4282] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:58 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1517 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:00.037669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ead02e01-e372-484b-9d55-9f9e5a366772 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:00.040207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ead02e01-e372-484b-9d55-9f9e5a366772 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:00.057632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ead02e01-e372-484b-9d55-9f9e5a366772 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:00.058157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ead02e01-e372-484b-9d55-9f9e5a366772 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:00.058612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ead02e01-e372-484b-9d55-9f9e5a366772 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:00.059351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ead02e01-e372-484b-9d55-9f9e5a366772 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:00.059816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ead02e01-e372-484b-9d55-9f9e5a366772 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:00.060463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ead02e01-e372-484b-9d55-9f9e5a366772 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:00.474663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ead02e01-e372-484b-9d55-9f9e5a366772 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:00.491090 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ead02e01-e372-484b-9d55-9f9e5a366772 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1659 microversion: 2.1 time: 0.471503 Oct 04 21:27:00.493371 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2150/4283] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:00 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1659 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:00.502244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6bed8371-34f0-4da3-b1ae-5064df6984a4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:00.503649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6bed8371-34f0-4da3-b1ae-5064df6984a4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:00.515863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6bed8371-34f0-4da3-b1ae-5064df6984a4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:00.517054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6bed8371-34f0-4da3-b1ae-5064df6984a4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:00.518136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6bed8371-34f0-4da3-b1ae-5064df6984a4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:00.519126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6bed8371-34f0-4da3-b1ae-5064df6984a4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:00.522885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6bed8371-34f0-4da3-b1ae-5064df6984a4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:00.524242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6bed8371-34f0-4da3-b1ae-5064df6984a4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:00.572234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-99ebf62c-4a1e-4c38-a3ab-8910b6bc39fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:27:00.573271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-99ebf62c-4a1e-4c38-a3ab-8910b6bc39fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:27:00.574138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-99ebf62c-4a1e-4c38-a3ab-8910b6bc39fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:27:00.574714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-99ebf62c-4a1e-4c38-a3ab-8910b6bc39fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:27:00.575898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-99ebf62c-4a1e-4c38-a3ab-8910b6bc39fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:27:00.598263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99ebf62c-4a1e-4c38-a3ab-8910b6bc39fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:00.600373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99ebf62c-4a1e-4c38-a3ab-8910b6bc39fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:00.601005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99ebf62c-4a1e-4c38-a3ab-8910b6bc39fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:00.602225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99ebf62c-4a1e-4c38-a3ab-8910b6bc39fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:00.602876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99ebf62c-4a1e-4c38-a3ab-8910b6bc39fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:00.608615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99ebf62c-4a1e-4c38-a3ab-8910b6bc39fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:00.651425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-99ebf62c-4a1e-4c38-a3ab-8910b6bc39fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Getting quotas for project a177c1fc19f0456dbf217e4582e3eb2b. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:27:00.672203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-99ebf62c-4a1e-4c38-a3ab-8910b6bc39fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Getting quotas for user 3022b1f60e82428482675f26d2621f39 and project a177c1fc19f0456dbf217e4582e3eb2b. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:27:00.734809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-99ebf62c-4a1e-4c38-a3ab-8910b6bc39fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:27:00.740721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-99ebf62c-4a1e-4c38-a3ab-8910b6bc39fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:27:00.908056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6bed8371-34f0-4da3-b1ae-5064df6984a4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:00.917221 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6bed8371-34f0-4da3-b1ae-5064df6984a4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1315 microversion: 2.1 time: 0.421367 Oct 04 21:27:00.932377 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2151/4284] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:00 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:00.939889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c1ddc693-bdf1-4ccb-92a4-8bfd82d5201d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:00.940917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c1ddc693-bdf1-4ccb-92a4-8bfd82d5201d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:00.947931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1ddc693-bdf1-4ccb-92a4-8bfd82d5201d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:00.948706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1ddc693-bdf1-4ccb-92a4-8bfd82d5201d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:00.949362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1ddc693-bdf1-4ccb-92a4-8bfd82d5201d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:00.950338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1ddc693-bdf1-4ccb-92a4-8bfd82d5201d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:00.950969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1ddc693-bdf1-4ccb-92a4-8bfd82d5201d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:00.951738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1ddc693-bdf1-4ccb-92a4-8bfd82d5201d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:00.969766 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-99ebf62c-4a1e-4c38-a3ab-8910b6bc39fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.943148 Oct 04 21:27:00.970495 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2134/4285] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:26:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:27:00.986979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-275bf2b5-a6b1-457d-a607-260d9fd82b2a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:01.003360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-275bf2b5-a6b1-457d-a607-260d9fd82b2a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:01.027093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-275bf2b5-a6b1-457d-a607-260d9fd82b2a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:01.027652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-275bf2b5-a6b1-457d-a607-260d9fd82b2a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:01.028115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-275bf2b5-a6b1-457d-a607-260d9fd82b2a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:01.032754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-275bf2b5-a6b1-457d-a607-260d9fd82b2a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:01.033259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-275bf2b5-a6b1-457d-a607-260d9fd82b2a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:01.033736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-275bf2b5-a6b1-457d-a607-260d9fd82b2a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:01.128065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:01.316229 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-275bf2b5-a6b1-457d-a607-260d9fd82b2a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action" status: 202 len: 0 microversion: 2.1 time: 0.344435 Oct 04 21:27:01.320680 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2135/4286] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:27:00 2022] POST /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:27:01.321311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c1ddc693-bdf1-4ccb-92a4-8bfd82d5201d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:01.330665 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c1ddc693-bdf1-4ccb-92a4-8bfd82d5201d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37" status: 200 len: 1307 microversion: 2.1 time: 0.396743 Oct 04 21:27:01.334732 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2152/4287] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:00 2022] GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37 => generated 1307 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:01.342137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f7d81320-5edc-4a86-a29a-5f2c554887a9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:01.347319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f7d81320-5edc-4a86-a29a-5f2c554887a9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:01.353233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-01ac7843-3979-417f-951b-e54bd8f46df4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:01.354320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-01ac7843-3979-417f-951b-e54bd8f46df4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:01.373401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01ac7843-3979-417f-951b-e54bd8f46df4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:01.374276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01ac7843-3979-417f-951b-e54bd8f46df4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:01.375061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01ac7843-3979-417f-951b-e54bd8f46df4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:01.378187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01ac7843-3979-417f-951b-e54bd8f46df4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:01.378951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01ac7843-3979-417f-951b-e54bd8f46df4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:01.380365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01ac7843-3979-417f-951b-e54bd8f46df4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:01.464222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f7d81320-5edc-4a86-a29a-5f2c554887a9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:01.481544 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f7d81320-5edc-4a86-a29a-5f2c554887a9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1217 microversion: 2.1 time: 0.159401 Oct 04 21:27:01.483276 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2136/4288] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:01 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:01.490151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-99edcbdf-e0f6-4671-b89b-e9a21a8b652c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:01.491123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-99edcbdf-e0f6-4671-b89b-e9a21a8b652c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:01.501134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99edcbdf-e0f6-4671-b89b-e9a21a8b652c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:01.501993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99edcbdf-e0f6-4671-b89b-e9a21a8b652c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:01.503785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99edcbdf-e0f6-4671-b89b-e9a21a8b652c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:01.505582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99edcbdf-e0f6-4671-b89b-e9a21a8b652c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:01.506983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99edcbdf-e0f6-4671-b89b-e9a21a8b652c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:01.507835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99edcbdf-e0f6-4671-b89b-e9a21a8b652c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:02.254737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-01ac7843-3979-417f-951b-e54bd8f46df4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:02.267709 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-01ac7843-3979-417f-951b-e54bd8f46df4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1517 microversion: 2.1 time: 0.931402 Oct 04 21:27:02.280974 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2153/4289] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:01 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1517 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:02.307514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4886d1bc-d159-4746-aea0-6252c459e93c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:02.307514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4886d1bc-d159-4746-aea0-6252c459e93c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:02.318286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4886d1bc-d159-4746-aea0-6252c459e93c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:02.319150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4886d1bc-d159-4746-aea0-6252c459e93c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:02.319783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4886d1bc-d159-4746-aea0-6252c459e93c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:02.320752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4886d1bc-d159-4746-aea0-6252c459e93c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:02.323165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4886d1bc-d159-4746-aea0-6252c459e93c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:02.324425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4886d1bc-d159-4746-aea0-6252c459e93c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:02.622099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-99edcbdf-e0f6-4671-b89b-e9a21a8b652c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:02.635977 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-99edcbdf-e0f6-4671-b89b-e9a21a8b652c tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1665 microversion: 2.1 time: 1.149776 Oct 04 21:27:02.660613 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2137/4290] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:01 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1665 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:02.669588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b0d1eb27-e81e-4cc2-a062-7f6c776d6d36 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:02.681234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b0d1eb27-e81e-4cc2-a062-7f6c776d6d36 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:02.700614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0d1eb27-e81e-4cc2-a062-7f6c776d6d36 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:02.702009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0d1eb27-e81e-4cc2-a062-7f6c776d6d36 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:02.712446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0d1eb27-e81e-4cc2-a062-7f6c776d6d36 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:02.712446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0d1eb27-e81e-4cc2-a062-7f6c776d6d36 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:02.712446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0d1eb27-e81e-4cc2-a062-7f6c776d6d36 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:02.712446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0d1eb27-e81e-4cc2-a062-7f6c776d6d36 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:03.136230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4886d1bc-d159-4746-aea0-6252c459e93c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:03.149168 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4886d1bc-d159-4746-aea0-6252c459e93c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1315 microversion: 2.1 time: 0.861008 Oct 04 21:27:03.157093 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2154/4291] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:02 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1315 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:03.164036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a646e653-ed76-40e8-af94-549938dc395f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:03.180141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a646e653-ed76-40e8-af94-549938dc395f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:03.194775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a646e653-ed76-40e8-af94-549938dc395f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:03.200313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a646e653-ed76-40e8-af94-549938dc395f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:03.200782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a646e653-ed76-40e8-af94-549938dc395f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:03.201749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a646e653-ed76-40e8-af94-549938dc395f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:03.202222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a646e653-ed76-40e8-af94-549938dc395f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:03.202653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a646e653-ed76-40e8-af94-549938dc395f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:03.559681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a646e653-ed76-40e8-af94-549938dc395f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:03.573956 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a646e653-ed76-40e8-af94-549938dc395f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1221 microversion: 2.1 time: 0.414548 Oct 04 21:27:03.576691 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2155/4292] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:03 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1221 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:03.595834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-03c57e1a-16fb-49ce-b2d9-2de2322a1dbb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:03.596736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-03c57e1a-16fb-49ce-b2d9-2de2322a1dbb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:03.645034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03c57e1a-16fb-49ce-b2d9-2de2322a1dbb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:03.650110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03c57e1a-16fb-49ce-b2d9-2de2322a1dbb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:03.652557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03c57e1a-16fb-49ce-b2d9-2de2322a1dbb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:03.658982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03c57e1a-16fb-49ce-b2d9-2de2322a1dbb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:03.659519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03c57e1a-16fb-49ce-b2d9-2de2322a1dbb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:03.667054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03c57e1a-16fb-49ce-b2d9-2de2322a1dbb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:03.695529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b0d1eb27-e81e-4cc2-a062-7f6c776d6d36 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:03.708680 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b0d1eb27-e81e-4cc2-a062-7f6c776d6d36 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37" status: 200 len: 1374 microversion: 2.1 time: 1.045231 Oct 04 21:27:03.712008 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2138/4293] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:02 2022] GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37 => generated 1374 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:03.726640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4813bc91-378e-4337-ba5c-6356f7942166 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:03.730588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4813bc91-378e-4337-ba5c-6356f7942166 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:03.745335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4813bc91-378e-4337-ba5c-6356f7942166 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:03.746067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4813bc91-378e-4337-ba5c-6356f7942166 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:03.746682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4813bc91-378e-4337-ba5c-6356f7942166 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:03.747629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4813bc91-378e-4337-ba5c-6356f7942166 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:03.748240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4813bc91-378e-4337-ba5c-6356f7942166 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:03.748935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4813bc91-378e-4337-ba5c-6356f7942166 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:04.227150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:04.278108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=12 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:04.697542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4813bc91-378e-4337-ba5c-6356f7942166 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:04.732372 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4813bc91-378e-4337-ba5c-6356f7942166 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1665 microversion: 2.1 time: 1.009518 Oct 04 21:27:04.733302 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2139/4294] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:03 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1665 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:04.753844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-62f6498a-384c-44cf-80af-e86e86c1f14b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:04.756022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-62f6498a-384c-44cf-80af-e86e86c1f14b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:04.763990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-03c57e1a-16fb-49ce-b2d9-2de2322a1dbb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:04.778121 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-03c57e1a-16fb-49ce-b2d9-2de2322a1dbb tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1517 microversion: 2.1 time: 1.193101 Oct 04 21:27:04.779131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62f6498a-384c-44cf-80af-e86e86c1f14b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:04.779640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62f6498a-384c-44cf-80af-e86e86c1f14b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:04.780084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62f6498a-384c-44cf-80af-e86e86c1f14b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:04.780894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62f6498a-384c-44cf-80af-e86e86c1f14b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:04.781309 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2156/4295] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:03 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1517 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:04.789872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62f6498a-384c-44cf-80af-e86e86c1f14b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:04.790439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62f6498a-384c-44cf-80af-e86e86c1f14b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:04.799135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-d4138884-0867-48bb-934c-99226ae2c28a req-7015b35d-106e-45ff-bedd-2b9975690278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fd7fe3-c8fd-446d-b1a7-41e34a12159c", "name": "network-vif-plugged", "status": "completed", "tag": "2103b760-e65f-45c3-84a6-ec2f94579876"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:04.827535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d4138884-0867-48bb-934c-99226ae2c28a req-7015b35d-106e-45ff-bedd-2b9975690278 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:04.831613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d4138884-0867-48bb-934c-99226ae2c28a req-7015b35d-106e-45ff-bedd-2b9975690278 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:04.834348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d4138884-0867-48bb-934c-99226ae2c28a req-7015b35d-106e-45ff-bedd-2b9975690278 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:04.858426 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-d4138884-0867-48bb-934c-99226ae2c28a req-7015b35d-106e-45ff-bedd-2b9975690278 service nova] Creating event network-vif-plugged:2103b760-e65f-45c3-84a6-ec2f94579876 for instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c on n-h2-860282-1 Oct 04 21:27:04.877941 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-d4138884-0867-48bb-934c-99226ae2c28a req-7015b35d-106e-45ff-bedd-2b9975690278 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095241 Oct 04 21:27:04.878760 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2157/4296] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:04.894531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ece6608f-5cfa-4e47-a63c-a56db8fa53a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:04.901079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ece6608f-5cfa-4e47-a63c-a56db8fa53a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:04.919644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ece6608f-5cfa-4e47-a63c-a56db8fa53a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:04.923223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ece6608f-5cfa-4e47-a63c-a56db8fa53a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:04.924204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ece6608f-5cfa-4e47-a63c-a56db8fa53a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:04.925249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ece6608f-5cfa-4e47-a63c-a56db8fa53a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:04.930798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ece6608f-5cfa-4e47-a63c-a56db8fa53a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:04.932337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ece6608f-5cfa-4e47-a63c-a56db8fa53a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:05.277461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ece6608f-5cfa-4e47-a63c-a56db8fa53a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:05.288150 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ece6608f-5cfa-4e47-a63c-a56db8fa53a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1277 microversion: 2.1 time: 0.407362 Oct 04 21:27:05.290725 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2158/4297] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:04 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1277 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:05.303808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-28c8a20b-b592-40c0-a609-43cc7affafdb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:05.304726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-28c8a20b-b592-40c0-a609-43cc7affafdb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:05.318557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28c8a20b-b592-40c0-a609-43cc7affafdb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:05.321785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28c8a20b-b592-40c0-a609-43cc7affafdb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:05.324152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28c8a20b-b592-40c0-a609-43cc7affafdb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:05.324857 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28c8a20b-b592-40c0-a609-43cc7affafdb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:05.325342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28c8a20b-b592-40c0-a609-43cc7affafdb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:05.325848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28c8a20b-b592-40c0-a609-43cc7affafdb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:05.757930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-28c8a20b-b592-40c0-a609-43cc7affafdb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:05.773719 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-28c8a20b-b592-40c0-a609-43cc7affafdb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37" status: 200 len: 1374 microversion: 2.1 time: 0.481792 Oct 04 21:27:05.774399 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2159/4298] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:05 2022] GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37 => generated 1374 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:05.815897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cd3e5da2-12a3-4dd7-afc5-12f4683a605a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:05.822526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cd3e5da2-12a3-4dd7-afc5-12f4683a605a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:05.874061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd3e5da2-12a3-4dd7-afc5-12f4683a605a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:05.874744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd3e5da2-12a3-4dd7-afc5-12f4683a605a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:05.883620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd3e5da2-12a3-4dd7-afc5-12f4683a605a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:05.884534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd3e5da2-12a3-4dd7-afc5-12f4683a605a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:05.890420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd3e5da2-12a3-4dd7-afc5-12f4683a605a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:05.890897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd3e5da2-12a3-4dd7-afc5-12f4683a605a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:05.904568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-62f6498a-384c-44cf-80af-e86e86c1f14b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:05.915030 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-62f6498a-384c-44cf-80af-e86e86c1f14b tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1315 microversion: 2.1 time: 1.179199 Oct 04 21:27:05.915624 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2140/4299] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:04 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1315 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:05.945410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-249e1c3d-26a9-43f2-a524-aa064b9bc587 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:05.948349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-249e1c3d-26a9-43f2-a524-aa064b9bc587 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:05.995562 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-249e1c3d-26a9-43f2-a524-aa064b9bc587 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:05.996314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-249e1c3d-26a9-43f2-a524-aa064b9bc587 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:05.997089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-249e1c3d-26a9-43f2-a524-aa064b9bc587 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:05.998054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-249e1c3d-26a9-43f2-a524-aa064b9bc587 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:05.998865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-249e1c3d-26a9-43f2-a524-aa064b9bc587 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:05.999487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-249e1c3d-26a9-43f2-a524-aa064b9bc587 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:07.198612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cd3e5da2-12a3-4dd7-afc5-12f4683a605a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:07.214107 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cd3e5da2-12a3-4dd7-afc5-12f4683a605a tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1665 microversion: 2.1 time: 1.418702 Oct 04 21:27:07.229485 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2160/4300] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:05 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1665 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:07.229485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2b294540-9e32-4d1c-9267-2daeed28a6e4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:07.229485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2b294540-9e32-4d1c-9267-2daeed28a6e4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:07.229866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b294540-9e32-4d1c-9267-2daeed28a6e4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:07.232036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b294540-9e32-4d1c-9267-2daeed28a6e4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:07.232722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b294540-9e32-4d1c-9267-2daeed28a6e4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:07.236327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b294540-9e32-4d1c-9267-2daeed28a6e4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:07.237051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b294540-9e32-4d1c-9267-2daeed28a6e4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:07.237774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b294540-9e32-4d1c-9267-2daeed28a6e4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:07.303426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-249e1c3d-26a9-43f2-a524-aa064b9bc587 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:07.311810 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-249e1c3d-26a9-43f2-a524-aa064b9bc587 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1517 microversion: 2.1 time: 1.383458 Oct 04 21:27:07.332239 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2141/4301] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:05 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1517 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:07.352449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-76a7c34c-9b2b-46c2-a10f-f86065bbd035 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:07.355710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-76a7c34c-9b2b-46c2-a10f-f86065bbd035 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:07.362705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76a7c34c-9b2b-46c2-a10f-f86065bbd035 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:07.368057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76a7c34c-9b2b-46c2-a10f-f86065bbd035 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:07.368820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76a7c34c-9b2b-46c2-a10f-f86065bbd035 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:07.369812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76a7c34c-9b2b-46c2-a10f-f86065bbd035 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:07.370483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76a7c34c-9b2b-46c2-a10f-f86065bbd035 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:07.371350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76a7c34c-9b2b-46c2-a10f-f86065bbd035 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:07.412454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2b294540-9e32-4d1c-9267-2daeed28a6e4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:07.425080 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2b294540-9e32-4d1c-9267-2daeed28a6e4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1275 microversion: 2.1 time: 0.208369 Oct 04 21:27:07.426499 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2161/4302] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:07 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1275 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:07.432028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fc5bcf90-06bc-4659-bb4a-8cc6658f78c6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:07.432867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fc5bcf90-06bc-4659-bb4a-8cc6658f78c6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:07.441199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc5bcf90-06bc-4659-bb4a-8cc6658f78c6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:07.446361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc5bcf90-06bc-4659-bb4a-8cc6658f78c6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:07.446361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc5bcf90-06bc-4659-bb4a-8cc6658f78c6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:07.446361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc5bcf90-06bc-4659-bb4a-8cc6658f78c6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:07.446361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc5bcf90-06bc-4659-bb4a-8cc6658f78c6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:07.446361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc5bcf90-06bc-4659-bb4a-8cc6658f78c6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:08.171416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-76a7c34c-9b2b-46c2-a10f-f86065bbd035 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:08.184953 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-76a7c34c-9b2b-46c2-a10f-f86065bbd035 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37" status: 200 len: 1374 microversion: 2.1 time: 0.850416 Oct 04 21:27:08.186246 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2142/4303] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:07 2022] GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37 => generated 1374 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:08.211409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-1638bec3-26d1-4a49-9cc2-08aaf147a638 req-37defdbc-2427-4362-9c59-c024115c920e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e3f92fe-569e-4490-8f75-6e2edde12f37", "tag": "8b26b180-3007-4dc0-8a67-0a0e4522bd4c"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:08.226228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fc5bcf90-06bc-4659-bb4a-8cc6658f78c6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:08.241777 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fc5bcf90-06bc-4659-bb4a-8cc6658f78c6 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1502 microversion: 2.1 time: 0.807478 Oct 04 21:27:08.243256 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2162/4304] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:07 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1502 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:08.252400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-94f1cba0-52f2-48ce-b8f9-981ffc40073b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:08.253310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-94f1cba0-52f2-48ce-b8f9-981ffc40073b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:08.268531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94f1cba0-52f2-48ce-b8f9-981ffc40073b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:08.269204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94f1cba0-52f2-48ce-b8f9-981ffc40073b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:08.269829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94f1cba0-52f2-48ce-b8f9-981ffc40073b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:08.270752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94f1cba0-52f2-48ce-b8f9-981ffc40073b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:08.271384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94f1cba0-52f2-48ce-b8f9-981ffc40073b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:08.271521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1638bec3-26d1-4a49-9cc2-08aaf147a638 req-37defdbc-2427-4362-9c59-c024115c920e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:08.271946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1638bec3-26d1-4a49-9cc2-08aaf147a638 req-37defdbc-2427-4362-9c59-c024115c920e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:08.272279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-94f1cba0-52f2-48ce-b8f9-981ffc40073b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:08.272400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1638bec3-26d1-4a49-9cc2-08aaf147a638 req-37defdbc-2427-4362-9c59-c024115c920e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:08.297094 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-1638bec3-26d1-4a49-9cc2-08aaf147a638 req-37defdbc-2427-4362-9c59-c024115c920e service nova] Creating event network-changed:8b26b180-3007-4dc0-8a67-0a0e4522bd4c for instance 7e3f92fe-569e-4490-8f75-6e2edde12f37 on n-h1-860282-1 Oct 04 21:27:08.318545 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-1638bec3-26d1-4a49-9cc2-08aaf147a638 req-37defdbc-2427-4362-9c59-c024115c920e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125386 Oct 04 21:27:08.319899 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2143/4305] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:08.337776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-40feacc3-e5e4-4ece-ad88-e6c34e2ba89c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:08.358256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40feacc3-e5e4-4ece-ad88-e6c34e2ba89c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:08.360117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40feacc3-e5e4-4ece-ad88-e6c34e2ba89c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:08.360759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40feacc3-e5e4-4ece-ad88-e6c34e2ba89c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:08.423943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-40feacc3-e5e4-4ece-ad88-e6c34e2ba89c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Going to try to stop instance {{(pid=122758) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:27:08.764038 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-40feacc3-e5e4-4ece-ad88-e6c34e2ba89c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "POST /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c/action" status: 202 len: 0 microversion: 2.1 time: 0.441386 Oct 04 21:27:08.778351 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2144/4306] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:27:08 2022] POST /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:27:08.796988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c371dca3-73ae-444b-ada2-327d4886b710 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:08.811419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c371dca3-73ae-444b-ada2-327d4886b710 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:08.832147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c371dca3-73ae-444b-ada2-327d4886b710 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:08.835665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c371dca3-73ae-444b-ada2-327d4886b710 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:08.836342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c371dca3-73ae-444b-ada2-327d4886b710 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:08.837462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c371dca3-73ae-444b-ada2-327d4886b710 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:08.838108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c371dca3-73ae-444b-ada2-327d4886b710 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:08.839974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c371dca3-73ae-444b-ada2-327d4886b710 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:09.161338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-94f1cba0-52f2-48ce-b8f9-981ffc40073b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:09.175028 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-94f1cba0-52f2-48ce-b8f9-981ffc40073b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.930292 Oct 04 21:27:09.177217 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2163/4307] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:08 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:09.183071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f100aa3b-42f3-43de-9f24-5ecbc95fb185 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:09.184459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f100aa3b-42f3-43de-9f24-5ecbc95fb185 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:09.200564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f100aa3b-42f3-43de-9f24-5ecbc95fb185 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:09.203425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f100aa3b-42f3-43de-9f24-5ecbc95fb185 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:09.204430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f100aa3b-42f3-43de-9f24-5ecbc95fb185 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:09.209587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f100aa3b-42f3-43de-9f24-5ecbc95fb185 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:09.210674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f100aa3b-42f3-43de-9f24-5ecbc95fb185 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:09.212148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f100aa3b-42f3-43de-9f24-5ecbc95fb185 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:09.370623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f100aa3b-42f3-43de-9f24-5ecbc95fb185 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:09.379459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:09.381099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c371dca3-73ae-444b-ada2-327d4886b710 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:09.389073 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f100aa3b-42f3-43de-9f24-5ecbc95fb185 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1275 microversion: 2.1 time: 0.209792 Oct 04 21:27:09.392441 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2164/4308] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:09 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1275 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:09.397487 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c371dca3-73ae-444b-ada2-327d4886b710 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1517 microversion: 2.1 time: 0.611705 Oct 04 21:27:09.397487 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2145/4309] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:08 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1517 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:09.421876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-65a2a80e-3a01-4d79-a88d-18b4b9f191c9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:09.422895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-65a2a80e-3a01-4d79-a88d-18b4b9f191c9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:09.425881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c1ce6b05-41ff-4d31-a0fc-c3e0096be86e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:09.426940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c1ce6b05-41ff-4d31-a0fc-c3e0096be86e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:09.434337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1ce6b05-41ff-4d31-a0fc-c3e0096be86e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:09.435067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1ce6b05-41ff-4d31-a0fc-c3e0096be86e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:09.435697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1ce6b05-41ff-4d31-a0fc-c3e0096be86e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:09.437048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1ce6b05-41ff-4d31-a0fc-c3e0096be86e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:09.437836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1ce6b05-41ff-4d31-a0fc-c3e0096be86e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:09.438710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1ce6b05-41ff-4d31-a0fc-c3e0096be86e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:09.441635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65a2a80e-3a01-4d79-a88d-18b4b9f191c9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:09.442688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65a2a80e-3a01-4d79-a88d-18b4b9f191c9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:09.443255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65a2a80e-3a01-4d79-a88d-18b4b9f191c9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:09.454003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65a2a80e-3a01-4d79-a88d-18b4b9f191c9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:09.458926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65a2a80e-3a01-4d79-a88d-18b4b9f191c9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:09.489546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65a2a80e-3a01-4d79-a88d-18b4b9f191c9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:09.995049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c1ce6b05-41ff-4d31-a0fc-c3e0096be86e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:10.009956 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c1ce6b05-41ff-4d31-a0fc-c3e0096be86e tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1668 microversion: 2.1 time: 0.600593 Oct 04 21:27:10.016876 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2146/4310] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:09 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1668 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:10.022157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-24954d9b-192d-4f39-ba83-dc9819fe4257 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:10.042462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-24954d9b-192d-4f39-ba83-dc9819fe4257 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:10.052042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24954d9b-192d-4f39-ba83-dc9819fe4257 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:10.062285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24954d9b-192d-4f39-ba83-dc9819fe4257 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:10.063073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24954d9b-192d-4f39-ba83-dc9819fe4257 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:10.064033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24954d9b-192d-4f39-ba83-dc9819fe4257 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:10.064704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24954d9b-192d-4f39-ba83-dc9819fe4257 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:10.065559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24954d9b-192d-4f39-ba83-dc9819fe4257 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:10.216280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-65a2a80e-3a01-4d79-a88d-18b4b9f191c9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:10.232743 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-65a2a80e-3a01-4d79-a88d-18b4b9f191c9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1512 microversion: 2.1 time: 0.839145 Oct 04 21:27:10.234880 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2165/4311] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:09 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1512 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:10.249799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2fd39109-ca7d-46ce-aa7f-485c4027f0ed tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:10.249799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2fd39109-ca7d-46ce-aa7f-485c4027f0ed tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:10.256410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fd39109-ca7d-46ce-aa7f-485c4027f0ed tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:10.257549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fd39109-ca7d-46ce-aa7f-485c4027f0ed tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:10.258546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fd39109-ca7d-46ce-aa7f-485c4027f0ed tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:10.260129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fd39109-ca7d-46ce-aa7f-485c4027f0ed tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:10.261496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fd39109-ca7d-46ce-aa7f-485c4027f0ed tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:10.262223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fd39109-ca7d-46ce-aa7f-485c4027f0ed tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:10.346269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2fd39109-ca7d-46ce-aa7f-485c4027f0ed tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:27:10.364944 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.compute.api [None req-2fd39109-ca7d-46ce-aa7f-485c4027f0ed tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Working on deleting snapshot fa2fada4-701a-4eeb-8625-464e50101b07 from shelved instance... Oct 04 21:27:10.525828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-24954d9b-192d-4f39-ba83-dc9819fe4257 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:10.535614 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-24954d9b-192d-4f39-ba83-dc9819fe4257 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37" status: 200 len: 1374 microversion: 2.1 time: 0.517269 Oct 04 21:27:10.536716 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2147/4312] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:10 2022] GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37 => generated 1374 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:10.548536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d4e64a9f-a457-4507-bd90-a55e10b78036 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:10.552014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d4e64a9f-a457-4507-bd90-a55e10b78036 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:10.572663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4e64a9f-a457-4507-bd90-a55e10b78036 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:10.573209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4e64a9f-a457-4507-bd90-a55e10b78036 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:10.573680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4e64a9f-a457-4507-bd90-a55e10b78036 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:10.580610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4e64a9f-a457-4507-bd90-a55e10b78036 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:10.581284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4e64a9f-a457-4507-bd90-a55e10b78036 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:10.581914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4e64a9f-a457-4507-bd90-a55e10b78036 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:10.621833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:10.990495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d4e64a9f-a457-4507-bd90-a55e10b78036 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:11.003202 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d4e64a9f-a457-4507-bd90-a55e10b78036 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1317 microversion: 2.1 time: 0.459049 Oct 04 21:27:11.004081 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2148/4313] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:10 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:11.045784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f1642e6f-d593-4665-9e54-c393efc9aa4e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:11.047850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f1642e6f-d593-4665-9e54-c393efc9aa4e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:11.063744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1642e6f-d593-4665-9e54-c393efc9aa4e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:11.063903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1642e6f-d593-4665-9e54-c393efc9aa4e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:11.065111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1642e6f-d593-4665-9e54-c393efc9aa4e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:11.067477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1642e6f-d593-4665-9e54-c393efc9aa4e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:11.068276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1642e6f-d593-4665-9e54-c393efc9aa4e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:11.069865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1642e6f-d593-4665-9e54-c393efc9aa4e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:11.308608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f1642e6f-d593-4665-9e54-c393efc9aa4e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:11.320528 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f1642e6f-d593-4665-9e54-c393efc9aa4e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1517 microversion: 2.1 time: 0.311900 Oct 04 21:27:11.321234 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2149/4314] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:11 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1517 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:11.341494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fcf01d11-4c5a-46fa-a0b2-31b894bba6db tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:11.348939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fcf01d11-4c5a-46fa-a0b2-31b894bba6db tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:11.352578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:11.355280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcf01d11-4c5a-46fa-a0b2-31b894bba6db tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:11.356760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcf01d11-4c5a-46fa-a0b2-31b894bba6db tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:11.357457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcf01d11-4c5a-46fa-a0b2-31b894bba6db tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:11.358558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcf01d11-4c5a-46fa-a0b2-31b894bba6db tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:11.359285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcf01d11-4c5a-46fa-a0b2-31b894bba6db tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:11.360348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcf01d11-4c5a-46fa-a0b2-31b894bba6db tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:11.471313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=10 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:11.842517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fcf01d11-4c5a-46fa-a0b2-31b894bba6db tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:11.852515 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fcf01d11-4c5a-46fa-a0b2-31b894bba6db tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1512 microversion: 2.1 time: 0.530014 Oct 04 21:27:11.853118 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2150/4315] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:11 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1512 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:11.867346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-78fb6800-655a-4a29-914b-72a83118d64d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:11.869509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-78fb6800-655a-4a29-914b-72a83118d64d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:11.887714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78fb6800-655a-4a29-914b-72a83118d64d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:11.893841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78fb6800-655a-4a29-914b-72a83118d64d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:11.894549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78fb6800-655a-4a29-914b-72a83118d64d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:11.896123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78fb6800-655a-4a29-914b-72a83118d64d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:11.901070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78fb6800-655a-4a29-914b-72a83118d64d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:11.902054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78fb6800-655a-4a29-914b-72a83118d64d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:12.124946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-78fb6800-655a-4a29-914b-72a83118d64d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:12.133441 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-78fb6800-655a-4a29-914b-72a83118d64d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37" status: 200 len: 1374 microversion: 2.1 time: 0.270422 Oct 04 21:27:12.135187 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2151/4316] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:11 2022] GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37 => generated 1374 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:12.155592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8989c506-5bf7-4283-b89a-935260d25d1f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:12.157607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8989c506-5bf7-4283-b89a-935260d25d1f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:12.178292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8989c506-5bf7-4283-b89a-935260d25d1f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:12.179044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8989c506-5bf7-4283-b89a-935260d25d1f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:12.180593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8989c506-5bf7-4283-b89a-935260d25d1f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:12.184806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8989c506-5bf7-4283-b89a-935260d25d1f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:12.186941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8989c506-5bf7-4283-b89a-935260d25d1f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:12.187890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8989c506-5bf7-4283-b89a-935260d25d1f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:12.395720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2fd39109-ca7d-46ce-aa7f-485c4027f0ed tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Doing local delete in cell 016bade6-ba85-4482-99c1-a6ee7c8937c1(cell1) {{(pid=122757) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 21:27:12.396617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fd39109-ca7d-46ce-aa7f-485c4027f0ed tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:12.397110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fd39109-ca7d-46ce-aa7f-485c4027f0ed tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:12.397587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fd39109-ca7d-46ce-aa7f-485c4027f0ed tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:12.398021 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.compute.api [None req-2fd39109-ca7d-46ce-aa7f-485c4027f0ed tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 21:27:12.401941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-2fd39109-ca7d-46ce-aa7f-485c4027f0ed tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] deallocate_for_instance() {{(pid=122757) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 21:27:12.653383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8989c506-5bf7-4283-b89a-935260d25d1f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:12.655578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:12.664896 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8989c506-5bf7-4283-b89a-935260d25d1f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1317 microversion: 2.1 time: 0.528415 Oct 04 21:27:12.668278 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2152/4317] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:12 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1317 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:12.678212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-8ee3d6c8-9972-40cf-86f5-154c23c5a0ef req-4168ddf2-8779-4d71-a7be-fd883b1cd8be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "144fff2d-9df3-4a93-833f-7f76acc85185", "tag": "cef3ff62-fc82-48d3-a981-5cadb2647961"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:12.700808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8ee3d6c8-9972-40cf-86f5-154c23c5a0ef req-4168ddf2-8779-4d71-a7be-fd883b1cd8be service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:12.705802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8ee3d6c8-9972-40cf-86f5-154c23c5a0ef req-4168ddf2-8779-4d71-a7be-fd883b1cd8be service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:12.706578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8ee3d6c8-9972-40cf-86f5-154c23c5a0ef req-4168ddf2-8779-4d71-a7be-fd883b1cd8be service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:12.741908 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-8ee3d6c8-9972-40cf-86f5-154c23c5a0ef req-4168ddf2-8779-4d71-a7be-fd883b1cd8be service nova] Creating event network-changed:cef3ff62-fc82-48d3-a981-5cadb2647961 for instance 144fff2d-9df3-4a93-833f-7f76acc85185 on n-h2-860282-1 Oct 04 21:27:12.759627 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-8ee3d6c8-9972-40cf-86f5-154c23c5a0ef req-4168ddf2-8779-4d71-a7be-fd883b1cd8be service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089793 Oct 04 21:27:12.760566 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2153/4318] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:12.767609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e05da6bf-bd35-462b-a3e5-57b1c02988e3 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:12.771344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e05da6bf-bd35-462b-a3e5-57b1c02988e3 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:12.791777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e05da6bf-bd35-462b-a3e5-57b1c02988e3 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:12.792551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e05da6bf-bd35-462b-a3e5-57b1c02988e3 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:12.792992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e05da6bf-bd35-462b-a3e5-57b1c02988e3 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:12.793911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e05da6bf-bd35-462b-a3e5-57b1c02988e3 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:12.794540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e05da6bf-bd35-462b-a3e5-57b1c02988e3 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:12.795137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e05da6bf-bd35-462b-a3e5-57b1c02988e3 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:13.325363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e05da6bf-bd35-462b-a3e5-57b1c02988e3 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:13.338547 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e05da6bf-bd35-462b-a3e5-57b1c02988e3 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1535 microversion: 2.1 time: 0.572835 Oct 04 21:27:13.339165 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2154/4319] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:12 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1535 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:13.355790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-92cf00a8-5383-4a1a-a596-8f888ef18408 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:13.358714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-92cf00a8-5383-4a1a-a596-8f888ef18408 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:13.378766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92cf00a8-5383-4a1a-a596-8f888ef18408 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:13.380343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92cf00a8-5383-4a1a-a596-8f888ef18408 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:13.390127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92cf00a8-5383-4a1a-a596-8f888ef18408 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:13.391164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92cf00a8-5383-4a1a-a596-8f888ef18408 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:13.397186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92cf00a8-5383-4a1a-a596-8f888ef18408 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:13.402659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92cf00a8-5383-4a1a-a596-8f888ef18408 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:14.588964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-92cf00a8-5383-4a1a-a596-8f888ef18408 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:14.607233 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-92cf00a8-5383-4a1a-a596-8f888ef18408 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1512 microversion: 2.1 time: 1.266880 Oct 04 21:27:14.608798 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2155/4320] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:13 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1512 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:14.615270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dc1ec566-bc66-45d9-b8f2-3548e77aae09 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:14.616208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dc1ec566-bc66-45d9-b8f2-3548e77aae09 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:14.624398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc1ec566-bc66-45d9-b8f2-3548e77aae09 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:14.625084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc1ec566-bc66-45d9-b8f2-3548e77aae09 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:14.625929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc1ec566-bc66-45d9-b8f2-3548e77aae09 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:14.628844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc1ec566-bc66-45d9-b8f2-3548e77aae09 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:14.629923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc1ec566-bc66-45d9-b8f2-3548e77aae09 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:14.630649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc1ec566-bc66-45d9-b8f2-3548e77aae09 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:14.886558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dc1ec566-bc66-45d9-b8f2-3548e77aae09 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:14.896636 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dc1ec566-bc66-45d9-b8f2-3548e77aae09 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37" status: 200 len: 1374 microversion: 2.1 time: 0.286413 Oct 04 21:27:14.897257 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2156/4321] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:14 2022] GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37 => generated 1374 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:14.915343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7709c7da-35ca-4fc1-a783-841154c1283d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:14.915998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7709c7da-35ca-4fc1-a783-841154c1283d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:14.924390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7709c7da-35ca-4fc1-a783-841154c1283d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:14.924891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7709c7da-35ca-4fc1-a783-841154c1283d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:14.929644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7709c7da-35ca-4fc1-a783-841154c1283d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:14.929644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7709c7da-35ca-4fc1-a783-841154c1283d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:14.929644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7709c7da-35ca-4fc1-a783-841154c1283d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:14.929644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7709c7da-35ca-4fc1-a783-841154c1283d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:15.247543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7709c7da-35ca-4fc1-a783-841154c1283d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:15.257456 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7709c7da-35ca-4fc1-a783-841154c1283d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1317 microversion: 2.1 time: 0.355847 Oct 04 21:27:15.258376 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2157/4322] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:14 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:15.263936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-913f0c1e-5375-4a1c-a1e7-8e12527e11d7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:15.268404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-913f0c1e-5375-4a1c-a1e7-8e12527e11d7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:15.283530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-2fd39109-ca7d-46ce-aa7f-485c4027f0ed tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Updating instance_info_cache with network_info: [] {{(pid=122757) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:27:15.303913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-913f0c1e-5375-4a1c-a1e7-8e12527e11d7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:15.304424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-913f0c1e-5375-4a1c-a1e7-8e12527e11d7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:15.304867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-913f0c1e-5375-4a1c-a1e7-8e12527e11d7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:15.305611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-913f0c1e-5375-4a1c-a1e7-8e12527e11d7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:15.324025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-913f0c1e-5375-4a1c-a1e7-8e12527e11d7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:15.324871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-913f0c1e-5375-4a1c-a1e7-8e12527e11d7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:15.616007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-913f0c1e-5375-4a1c-a1e7-8e12527e11d7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:15.629775 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-913f0c1e-5375-4a1c-a1e7-8e12527e11d7 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1523 microversion: 2.1 time: 0.366141 Oct 04 21:27:15.629775 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2158/4323] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:15 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1523 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:15.634410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-47ccbc60-b4a2-4d14-83d5-5f5ffb2cf3b0 req-2e9f1457-7644-4317-9bb5-219cf4489121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf496d06-f510-4a05-b5c7-3438c434547e", "name": "network-vif-deleted", "tag": "e3b2e817-8930-4077-a86c-88d50aa94e31"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:15.647170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-47ccbc60-b4a2-4d14-83d5-5f5ffb2cf3b0 req-2e9f1457-7644-4317-9bb5-219cf4489121 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:15.647656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-47ccbc60-b4a2-4d14-83d5-5f5ffb2cf3b0 req-2e9f1457-7644-4317-9bb5-219cf4489121 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:15.648287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-47ccbc60-b4a2-4d14-83d5-5f5ffb2cf3b0 req-2e9f1457-7644-4317-9bb5-219cf4489121 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:15.674668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.compute.server_external_events [req-47ccbc60-b4a2-4d14-83d5-5f5ffb2cf3b0 req-2e9f1457-7644-4317-9bb5-219cf4489121 service nova] Unable to find a host for instance cf496d06-f510-4a05-b5c7-3438c434547e. Dropping event network-vif-deleted {{(pid=122758) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 21:27:15.674668 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-47ccbc60-b4a2-4d14-83d5-5f5ffb2cf3b0 req-2e9f1457-7644-4317-9bb5-219cf4489121 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.040652 Oct 04 21:27:15.674668 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2159/4324] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 21:27:15.683029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-139d2cb1-da0e-44ce-a748-e2b9ffc48286 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:15.683966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-139d2cb1-da0e-44ce-a748-e2b9ffc48286 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:15.691010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-139d2cb1-da0e-44ce-a748-e2b9ffc48286 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:15.692341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-139d2cb1-da0e-44ce-a748-e2b9ffc48286 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:15.693021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-139d2cb1-da0e-44ce-a748-e2b9ffc48286 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:15.694271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-139d2cb1-da0e-44ce-a748-e2b9ffc48286 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:15.695096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-139d2cb1-da0e-44ce-a748-e2b9ffc48286 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:15.695747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-139d2cb1-da0e-44ce-a748-e2b9ffc48286 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:16.145339 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2fd39109-ca7d-46ce-aa7f-485c4027f0ed tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 204 len: 0 microversion: 2.1 time: 5.908792 Oct 04 21:27:16.146099 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2166/4325] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:27:10 2022] DELETE /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 0 bytes in 5910 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:27:16.154846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-f0cd5e24-96e5-43a5-810a-b13bb7aecab1 req-65154227-2733-4bc2-84b7-34e6b3de8333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e3f92fe-569e-4490-8f75-6e2edde12f37", "name": "network-vif-plugged", "status": "completed", "tag": "8b26b180-3007-4dc0-8a67-0a0e4522bd4c"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:16.170510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f0cd5e24-96e5-43a5-810a-b13bb7aecab1 req-65154227-2733-4bc2-84b7-34e6b3de8333 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:16.171236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f0cd5e24-96e5-43a5-810a-b13bb7aecab1 req-65154227-2733-4bc2-84b7-34e6b3de8333 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:16.172032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f0cd5e24-96e5-43a5-810a-b13bb7aecab1 req-65154227-2733-4bc2-84b7-34e6b3de8333 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:16.188182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-139d2cb1-da0e-44ce-a748-e2b9ffc48286 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:16.192689 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-f0cd5e24-96e5-43a5-810a-b13bb7aecab1 req-65154227-2733-4bc2-84b7-34e6b3de8333 service nova] Creating event network-vif-plugged:8b26b180-3007-4dc0-8a67-0a0e4522bd4c for instance 7e3f92fe-569e-4490-8f75-6e2edde12f37 on n-h1-860282-1 Oct 04 21:27:16.205114 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-139d2cb1-da0e-44ce-a748-e2b9ffc48286 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1512 microversion: 2.1 time: 0.531408 Oct 04 21:27:16.208298 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2160/4326] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:15 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1512 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:16.215330 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-f0cd5e24-96e5-43a5-810a-b13bb7aecab1 req-65154227-2733-4bc2-84b7-34e6b3de8333 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064821 Oct 04 21:27:16.218163 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2167/4327] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:16.220610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c8c1d088-48d2-44e9-adfa-478d24261f3f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:16.225051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c8c1d088-48d2-44e9-adfa-478d24261f3f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:16.236215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4ac50578-54c6-491c-a670-7ce4e5715e71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:16.239461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4ac50578-54c6-491c-a670-7ce4e5715e71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: cf496d06-f510-4a05-b5c7-3438c434547e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:16.248525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8c1d088-48d2-44e9-adfa-478d24261f3f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:16.250490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8c1d088-48d2-44e9-adfa-478d24261f3f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:16.252701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8c1d088-48d2-44e9-adfa-478d24261f3f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:16.253564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8c1d088-48d2-44e9-adfa-478d24261f3f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:16.255971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8c1d088-48d2-44e9-adfa-478d24261f3f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:16.258097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ac50578-54c6-491c-a670-7ce4e5715e71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:16.261247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c8c1d088-48d2-44e9-adfa-478d24261f3f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:16.268895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ac50578-54c6-491c-a670-7ce4e5715e71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:16.269711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ac50578-54c6-491c-a670-7ce4e5715e71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:16.271863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ac50578-54c6-491c-a670-7ce4e5715e71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:16.273869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ac50578-54c6-491c-a670-7ce4e5715e71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:16.274493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ac50578-54c6-491c-a670-7ce4e5715e71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:16.318783 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-4ac50578-54c6-491c-a670-7ce4e5715e71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] HTTP exception thrown: Instance cf496d06-f510-4a05-b5c7-3438c434547e could not be found. Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4ac50578-54c6-491c-a670-7ce4e5715e71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Request method failure captured: Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e HTTP/1.1 Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKMORPit0hTQrPIMzQtQx_UmCBmT5FIo7pDLWqLy5SiNGFiWYKdJzMYINV4AgM5hptJ-4S4yFMnq28D6VhWfZFl9iSPJwvrGQdWsUeuCxZhwibZPh1On3zv9TchRvE7UeNSX7_oKGHxGg-1hbqm1TznUUveZZBszMGCIz2Qsg_TKTD0 Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 0f62474e9d474aa28ac754b712e68652 Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerActionsTestJSON-1285044131 Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f62474e9d474aa28ac754b712e68652"}]}, {"type": "tempest-type-992649439", "name": "tempest-service-540783405", "endpoints": [{"region": "tempest-region-1225708338", "internalURL": "https://url-63677349.com"}]}, {"type": "tempest-type-1238556208", "name": "tempest-service-722626554", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0f62474e9d474aa28ac754b712e68652"}]}, {"type": "tempest-type-625574546", "name": "tempest-service-447491652", "endpoints": [{"region": "tempest-region-391707900", "publicURL": "https://url-992999868.com"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0f62474e9d474aa28ac754b712e68652"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f62474e9d474aa28ac754b712e68652"}]}] Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerActionsTestJSON-1285044131 Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 0f62474e9d474aa28ac754b712e68652 Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerActionsTestJSON-1285044131 Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerActionsTestJSON-1285044131-project Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 8ef7d2991dce46278486e0ee963d4cf3 Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerActionsTestJSON-1285044131-project Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance cf496d06-f510-4a05-b5c7-3438c434547e could not be found. Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'cf496d06-f510-4a05-b5c7-3438c434547e'} Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf496d06-f510-4a05-b5c7-3438c434547e could not be found. Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:27:16.321217 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:27:16.325016 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:27:16.325016 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf496d06-f510-4a05-b5c7-3438c434547e could not be found. Oct 04 21:27:16.325016 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:16.325016 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:16.325016 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:16.325016 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:16.325016 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:16.325016 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:16.325016 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:27:16.325016 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:27:16.325016 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf496d06-f510-4a05-b5c7-3438c434547e could not be found. Oct 04 21:27:16.325016 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:16.331111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4ac50578-54c6-491c-a670-7ce4e5715e71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Returning 404 to user: Instance cf496d06-f510-4a05-b5c7-3438c434547e could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:16.335235 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4ac50578-54c6-491c-a670-7ce4e5715e71 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e" status: 404 len: 111 microversion: 2.1 time: 0.112548 Oct 04 21:27:16.345242 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2168/4328] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:16 2022] GET /compute/v2.1/servers/cf496d06-f510-4a05-b5c7-3438c434547e => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:27:16.345842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-deea11a6-b013-44c9-874f-13abea54e343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:16.346705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-deea11a6-b013-44c9-874f-13abea54e343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:16.363221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-deea11a6-b013-44c9-874f-13abea54e343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:16.365872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-deea11a6-b013-44c9-874f-13abea54e343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:16.372569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-deea11a6-b013-44c9-874f-13abea54e343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:16.378140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-deea11a6-b013-44c9-874f-13abea54e343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:16.378140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-deea11a6-b013-44c9-874f-13abea54e343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:16.378140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-deea11a6-b013-44c9-874f-13abea54e343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:16.805313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c8c1d088-48d2-44e9-adfa-478d24261f3f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:16.815601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-deea11a6-b013-44c9-874f-13abea54e343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:16.823264 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c8c1d088-48d2-44e9-adfa-478d24261f3f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37" status: 200 len: 1374 microversion: 2.1 time: 0.610094 Oct 04 21:27:16.823815 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-deea11a6-b013-44c9-874f-13abea54e343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1317 microversion: 2.1 time: 0.482337 Oct 04 21:27:16.826124 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2161/4329] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:16 2022] GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37 => generated 1374 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:16.836203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6eb8b3c0-8f5c-4967-9ed0-2ff4ae499dee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:16.837050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6eb8b3c0-8f5c-4967-9ed0-2ff4ae499dee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:16.847863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6eb8b3c0-8f5c-4967-9ed0-2ff4ae499dee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:16.849058 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2169/4330] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:16 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:16.856296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6eb8b3c0-8f5c-4967-9ed0-2ff4ae499dee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:16.856296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6eb8b3c0-8f5c-4967-9ed0-2ff4ae499dee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:16.856296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6eb8b3c0-8f5c-4967-9ed0-2ff4ae499dee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:16.856296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6eb8b3c0-8f5c-4967-9ed0-2ff4ae499dee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:16.856296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6eb8b3c0-8f5c-4967-9ed0-2ff4ae499dee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:16.856727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bc9fe534-b0ed-405d-bd56-5069eaf4c25e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:16.856727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bc9fe534-b0ed-405d-bd56-5069eaf4c25e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:16.873692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc9fe534-b0ed-405d-bd56-5069eaf4c25e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:16.874117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc9fe534-b0ed-405d-bd56-5069eaf4c25e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:16.874767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc9fe534-b0ed-405d-bd56-5069eaf4c25e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:16.875654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc9fe534-b0ed-405d-bd56-5069eaf4c25e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:16.891774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc9fe534-b0ed-405d-bd56-5069eaf4c25e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:16.893826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc9fe534-b0ed-405d-bd56-5069eaf4c25e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:16.952658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6eb8b3c0-8f5c-4967-9ed0-2ff4ae499dee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:27:17.300524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bc9fe534-b0ed-405d-bd56-5069eaf4c25e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:17.314767 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bc9fe534-b0ed-405d-bd56-5069eaf4c25e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1523 microversion: 2.1 time: 0.464036 Oct 04 21:27:17.315372 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2170/4331] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:16 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1523 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:17.320732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-20977672-8ebc-4a04-bcbd-bd842f0e7f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:17.328342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-20977672-8ebc-4a04-bcbd-bd842f0e7f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:17.328342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20977672-8ebc-4a04-bcbd-bd842f0e7f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:17.328342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20977672-8ebc-4a04-bcbd-bd842f0e7f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:17.328342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20977672-8ebc-4a04-bcbd-bd842f0e7f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:17.328941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20977672-8ebc-4a04-bcbd-bd842f0e7f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:17.329611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20977672-8ebc-4a04-bcbd-bd842f0e7f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:17.330206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20977672-8ebc-4a04-bcbd-bd842f0e7f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:17.411735 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6eb8b3c0-8f5c-4967-9ed0-2ff4ae499dee tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 204 len: 0 microversion: 2.1 time: 0.583773 Oct 04 21:27:17.413744 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2162/4332] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:27:16 2022] DELETE /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:27:17.425150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-83d93f9c-0ef9-4797-a170-acbc3e32f5e7 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:17.435340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-83d93f9c-0ef9-4797-a170-acbc3e32f5e7 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:17.458428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83d93f9c-0ef9-4797-a170-acbc3e32f5e7 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:17.459178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83d93f9c-0ef9-4797-a170-acbc3e32f5e7 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:17.462888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83d93f9c-0ef9-4797-a170-acbc3e32f5e7 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:17.469349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83d93f9c-0ef9-4797-a170-acbc3e32f5e7 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:17.470110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83d93f9c-0ef9-4797-a170-acbc3e32f5e7 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:17.470721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83d93f9c-0ef9-4797-a170-acbc3e32f5e7 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:17.650416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-83d93f9c-0ef9-4797-a170-acbc3e32f5e7 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:17.658281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-20977672-8ebc-4a04-bcbd-bd842f0e7f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:17.660335 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-83d93f9c-0ef9-4797-a170-acbc3e32f5e7 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 200 len: 1464 microversion: 2.1 time: 0.241930 Oct 04 21:27:17.661539 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2163/4333] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:17 2022] GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 1464 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:17.671979 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-20977672-8ebc-4a04-bcbd-bd842f0e7f87 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1512 microversion: 2.1 time: 0.355358 Oct 04 21:27:17.674238 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2171/4334] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:17 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1512 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:17.853815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a2ce2d65-3682-48f7-b4b9-1fe75d10488a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:17.854437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a2ce2d65-3682-48f7-b4b9-1fe75d10488a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:17.872753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ddf862f6-fb39-4fcc-8f04-404b738670bc tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:17.873943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ddf862f6-fb39-4fcc-8f04-404b738670bc tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:17.874670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2ce2d65-3682-48f7-b4b9-1fe75d10488a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:17.875350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2ce2d65-3682-48f7-b4b9-1fe75d10488a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:17.878151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2ce2d65-3682-48f7-b4b9-1fe75d10488a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:17.878151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2ce2d65-3682-48f7-b4b9-1fe75d10488a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:17.878151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2ce2d65-3682-48f7-b4b9-1fe75d10488a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:17.878424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2ce2d65-3682-48f7-b4b9-1fe75d10488a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:17.884001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ddf862f6-fb39-4fcc-8f04-404b738670bc tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:17.885709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ddf862f6-fb39-4fcc-8f04-404b738670bc tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:17.886247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ddf862f6-fb39-4fcc-8f04-404b738670bc tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:17.887199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ddf862f6-fb39-4fcc-8f04-404b738670bc tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:17.888447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ddf862f6-fb39-4fcc-8f04-404b738670bc tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:17.889089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ddf862f6-fb39-4fcc-8f04-404b738670bc tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:18.305125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ddf862f6-fb39-4fcc-8f04-404b738670bc tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:18.323657 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ddf862f6-fb39-4fcc-8f04-404b738670bc tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1317 microversion: 2.1 time: 0.458273 Oct 04 21:27:18.338400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a2ce2d65-3682-48f7-b4b9-1fe75d10488a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:18.339476 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2172/4335] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:17 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:18.348490 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a2ce2d65-3682-48f7-b4b9-1fe75d10488a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37" status: 200 len: 1374 microversion: 2.1 time: 0.497399 Oct 04 21:27:18.348490 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2164/4336] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:17 2022] GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37 => generated 1374 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:18.353317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-86ffb2c2-552b-4c15-992e-90921b953d0f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:18.354300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-86ffb2c2-552b-4c15-992e-90921b953d0f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:18.361836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86ffb2c2-552b-4c15-992e-90921b953d0f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:18.364200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86ffb2c2-552b-4c15-992e-90921b953d0f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:18.365226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86ffb2c2-552b-4c15-992e-90921b953d0f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:18.366625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86ffb2c2-552b-4c15-992e-90921b953d0f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:18.367731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86ffb2c2-552b-4c15-992e-90921b953d0f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:18.368612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-580c0e07-de79-49eb-8a24-eb50ebad7760 req-34d661c9-1d73-42ef-9d7a-d18dd632a5dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67efa537-ebf8-481f-8d5b-dfcae879bc9c", "name": "network-vif-unplugged", "status": "completed", "tag": "26c619a4-039b-446b-b368-a9c902c8e043"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:18.369121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86ffb2c2-552b-4c15-992e-90921b953d0f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:18.388242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-580c0e07-de79-49eb-8a24-eb50ebad7760 req-34d661c9-1d73-42ef-9d7a-d18dd632a5dc service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:18.388725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-580c0e07-de79-49eb-8a24-eb50ebad7760 req-34d661c9-1d73-42ef-9d7a-d18dd632a5dc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:18.389219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-580c0e07-de79-49eb-8a24-eb50ebad7760 req-34d661c9-1d73-42ef-9d7a-d18dd632a5dc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:18.403743 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-580c0e07-de79-49eb-8a24-eb50ebad7760 req-34d661c9-1d73-42ef-9d7a-d18dd632a5dc service nova] Creating event network-vif-unplugged:26c619a4-039b-446b-b368-a9c902c8e043 for instance 67efa537-ebf8-481f-8d5b-dfcae879bc9c on n-h1-860282-1 Oct 04 21:27:18.409638 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-580c0e07-de79-49eb-8a24-eb50ebad7760 req-34d661c9-1d73-42ef-9d7a-d18dd632a5dc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046864 Oct 04 21:27:18.411151 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2165/4337] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:18.604060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-86ffb2c2-552b-4c15-992e-90921b953d0f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:18.614882 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-86ffb2c2-552b-4c15-992e-90921b953d0f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1523 microversion: 2.1 time: 0.273562 Oct 04 21:27:18.618786 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2173/4338] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:18 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1523 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:18.686535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3561de83-9397-4c79-8eba-c55ce5f8bffd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:18.687340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3561de83-9397-4c79-8eba-c55ce5f8bffd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:18.705082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0c1131b0-3e94-4094-8ba7-6aee6ba0b811 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:18.706059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0c1131b0-3e94-4094-8ba7-6aee6ba0b811 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:18.715910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3561de83-9397-4c79-8eba-c55ce5f8bffd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:18.717611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c1131b0-3e94-4094-8ba7-6aee6ba0b811 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:18.718276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c1131b0-3e94-4094-8ba7-6aee6ba0b811 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:18.722595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3561de83-9397-4c79-8eba-c55ce5f8bffd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:18.723977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c1131b0-3e94-4094-8ba7-6aee6ba0b811 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:18.724770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c1131b0-3e94-4094-8ba7-6aee6ba0b811 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:18.725243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c1131b0-3e94-4094-8ba7-6aee6ba0b811 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:18.725705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c1131b0-3e94-4094-8ba7-6aee6ba0b811 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:18.729898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3561de83-9397-4c79-8eba-c55ce5f8bffd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:18.732737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3561de83-9397-4c79-8eba-c55ce5f8bffd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:18.732737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3561de83-9397-4c79-8eba-c55ce5f8bffd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:18.732737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3561de83-9397-4c79-8eba-c55ce5f8bffd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:18.871580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3561de83-9397-4c79-8eba-c55ce5f8bffd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:18.889659 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3561de83-9397-4c79-8eba-c55ce5f8bffd tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 200 len: 1464 microversion: 2.1 time: 0.205874 Oct 04 21:27:18.891803 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2166/4339] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:18 2022] GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 1464 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:19.060243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0c1131b0-3e94-4094-8ba7-6aee6ba0b811 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:19.080117 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0c1131b0-3e94-4094-8ba7-6aee6ba0b811 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1512 microversion: 2.1 time: 0.377004 Oct 04 21:27:19.081542 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2174/4340] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:18 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1512 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:19.355200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-913fb168-8b2b-45b4-8408-f7ae7ad8d491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:19.356142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-913fb168-8b2b-45b4-8408-f7ae7ad8d491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:19.364475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-913fb168-8b2b-45b4-8408-f7ae7ad8d491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:19.364475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-913fb168-8b2b-45b4-8408-f7ae7ad8d491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:19.364475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-913fb168-8b2b-45b4-8408-f7ae7ad8d491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:19.365015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-913fb168-8b2b-45b4-8408-f7ae7ad8d491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:19.365564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-913fb168-8b2b-45b4-8408-f7ae7ad8d491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:19.366131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-913fb168-8b2b-45b4-8408-f7ae7ad8d491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:19.384604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-212c16f0-5a3f-493a-a0ff-d1b862e9986d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:19.384604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-212c16f0-5a3f-493a-a0ff-d1b862e9986d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:19.387459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-212c16f0-5a3f-493a-a0ff-d1b862e9986d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:19.394033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-212c16f0-5a3f-493a-a0ff-d1b862e9986d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:19.394474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-212c16f0-5a3f-493a-a0ff-d1b862e9986d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:19.396224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-212c16f0-5a3f-493a-a0ff-d1b862e9986d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:19.396859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-212c16f0-5a3f-493a-a0ff-d1b862e9986d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:19.399184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-212c16f0-5a3f-493a-a0ff-d1b862e9986d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:19.777101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-913fb168-8b2b-45b4-8408-f7ae7ad8d491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:19.807683 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-913fb168-8b2b-45b4-8408-f7ae7ad8d491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1317 microversion: 2.1 time: 0.456514 Oct 04 21:27:19.808742 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2167/4341] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:19 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:19.819771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8ad50dc5-f1a3-4640-909b-cc4baebddfb6 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:19.828539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8ad50dc5-f1a3-4640-909b-cc4baebddfb6 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:19.836684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ad50dc5-f1a3-4640-909b-cc4baebddfb6 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:19.838771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ad50dc5-f1a3-4640-909b-cc4baebddfb6 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:19.838771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ad50dc5-f1a3-4640-909b-cc4baebddfb6 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:19.838771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ad50dc5-f1a3-4640-909b-cc4baebddfb6 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:19.839535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ad50dc5-f1a3-4640-909b-cc4baebddfb6 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:19.840120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ad50dc5-f1a3-4640-909b-cc4baebddfb6 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:19.859364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-212c16f0-5a3f-493a-a0ff-d1b862e9986d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:19.871081 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-212c16f0-5a3f-493a-a0ff-d1b862e9986d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37" status: 200 len: 1546 microversion: 2.1 time: 0.497694 Oct 04 21:27:19.889172 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2175/4342] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:19 2022] GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37 => generated 1546 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:19.900614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1e486183-30c3-48ea-9d16-c31f60e3a6dc tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:19.901619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1e486183-30c3-48ea-9d16-c31f60e3a6dc tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:19.911029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e486183-30c3-48ea-9d16-c31f60e3a6dc tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:19.912343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e486183-30c3-48ea-9d16-c31f60e3a6dc tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:19.913360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e486183-30c3-48ea-9d16-c31f60e3a6dc tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:19.914397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e486183-30c3-48ea-9d16-c31f60e3a6dc tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:19.915305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e486183-30c3-48ea-9d16-c31f60e3a6dc tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:19.916022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e486183-30c3-48ea-9d16-c31f60e3a6dc tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:19.991033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:20.159961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8ad50dc5-f1a3-4640-909b-cc4baebddfb6 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:20.172798 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8ad50dc5-f1a3-4640-909b-cc4baebddfb6 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1523 microversion: 2.1 time: 0.361798 Oct 04 21:27:20.174688 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2168/4343] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:19 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1523 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:20.189343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9ad092c3-d5a7-4b6c-bc80-fdbaae6bf132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:20.190007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9ad092c3-d5a7-4b6c-bc80-fdbaae6bf132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:20.204964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ad092c3-d5a7-4b6c-bc80-fdbaae6bf132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:20.206153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ad092c3-d5a7-4b6c-bc80-fdbaae6bf132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:20.206823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ad092c3-d5a7-4b6c-bc80-fdbaae6bf132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:20.209012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ad092c3-d5a7-4b6c-bc80-fdbaae6bf132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:20.209704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ad092c3-d5a7-4b6c-bc80-fdbaae6bf132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:20.210593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ad092c3-d5a7-4b6c-bc80-fdbaae6bf132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:20.374757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9ad092c3-d5a7-4b6c-bc80-fdbaae6bf132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:20.374757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:20.374757 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9ad092c3-d5a7-4b6c-bc80-fdbaae6bf132 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 200 len: 1464 microversion: 2.1 time: 0.173556 Oct 04 21:27:20.374757 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2169/4344] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:20 2022] GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 1464 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:20.374757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-16239081-715e-49bb-818d-db0d215e891a req-0af2be4a-d6e8-40ad-a5e8-827ffbe520dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6daf7e14-2860-48b1-8065-bd3f25f5730b", "name": "network-vif-deleted", "tag": "1224f342-58fd-46fe-8e48-5613db528544"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:20.403959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-16239081-715e-49bb-818d-db0d215e891a req-0af2be4a-d6e8-40ad-a5e8-827ffbe520dc service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:20.404486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-16239081-715e-49bb-818d-db0d215e891a req-0af2be4a-d6e8-40ad-a5e8-827ffbe520dc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:20.405219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-16239081-715e-49bb-818d-db0d215e891a req-0af2be4a-d6e8-40ad-a5e8-827ffbe520dc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:20.433464 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-16239081-715e-49bb-818d-db0d215e891a req-0af2be4a-d6e8-40ad-a5e8-827ffbe520dc service nova] Creating event network-vif-deleted:1224f342-58fd-46fe-8e48-5613db528544 for instance 6daf7e14-2860-48b1-8065-bd3f25f5730b on n-h1-860282-1 Oct 04 21:27:20.435758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1e486183-30c3-48ea-9d16-c31f60e3a6dc tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:20.440497 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-16239081-715e-49bb-818d-db0d215e891a req-0af2be4a-d6e8-40ad-a5e8-827ffbe520dc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086182 Oct 04 21:27:20.445826 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2170/4345] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:20.451990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bb82967c-2415-48ac-b71f-65cb533fbb28 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:20.474854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bb82967c-2415-48ac-b71f-65cb533fbb28 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:20.474854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb82967c-2415-48ac-b71f-65cb533fbb28 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:20.474854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb82967c-2415-48ac-b71f-65cb533fbb28 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:20.474854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb82967c-2415-48ac-b71f-65cb533fbb28 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:20.474854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb82967c-2415-48ac-b71f-65cb533fbb28 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:20.474854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb82967c-2415-48ac-b71f-65cb533fbb28 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:20.474854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb82967c-2415-48ac-b71f-65cb533fbb28 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:20.475860 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1e486183-30c3-48ea-9d16-c31f60e3a6dc tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37" status: 200 len: 1546 microversion: 2.1 time: 0.571710 Oct 04 21:27:20.475860 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2176/4346] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:19 2022] GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37 => generated 1546 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:20.480566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-2a4bbb30-5d70-4d5c-abc8-574c52d93258 req-cffaf9e7-c299-4aa2-96be-5cf57a809855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67efa537-ebf8-481f-8d5b-dfcae879bc9c", "name": "network-vif-plugged", "status": "completed", "tag": "26c619a4-039b-446b-b368-a9c902c8e043"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:20.502811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2a4bbb30-5d70-4d5c-abc8-574c52d93258 req-cffaf9e7-c299-4aa2-96be-5cf57a809855 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:20.503794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2a4bbb30-5d70-4d5c-abc8-574c52d93258 req-cffaf9e7-c299-4aa2-96be-5cf57a809855 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:20.505033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2a4bbb30-5d70-4d5c-abc8-574c52d93258 req-cffaf9e7-c299-4aa2-96be-5cf57a809855 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:20.535611 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-2a4bbb30-5d70-4d5c-abc8-574c52d93258 req-cffaf9e7-c299-4aa2-96be-5cf57a809855 service nova] Creating event network-vif-plugged:26c619a4-039b-446b-b368-a9c902c8e043 for instance 67efa537-ebf8-481f-8d5b-dfcae879bc9c on n-h1-860282-1 Oct 04 21:27:20.558971 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-2a4bbb30-5d70-4d5c-abc8-574c52d93258 req-cffaf9e7-c299-4aa2-96be-5cf57a809855 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088750 Oct 04 21:27:20.566181 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2177/4347] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:20.849544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-480ccca2-9875-4410-9097-8802ce1a474e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:20.853608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-480ccca2-9875-4410-9097-8802ce1a474e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:20.869024 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480ccca2-9875-4410-9097-8802ce1a474e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:20.871204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480ccca2-9875-4410-9097-8802ce1a474e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:20.873125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480ccca2-9875-4410-9097-8802ce1a474e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:20.876709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480ccca2-9875-4410-9097-8802ce1a474e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:20.879751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480ccca2-9875-4410-9097-8802ce1a474e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:20.880370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480ccca2-9875-4410-9097-8802ce1a474e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:21.135316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bb82967c-2415-48ac-b71f-65cb533fbb28 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:21.170043 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bb82967c-2415-48ac-b71f-65cb533fbb28 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1512 microversion: 2.1 time: 0.711053 Oct 04 21:27:21.172218 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2171/4348] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:20 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1512 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:21.205548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-28f72c42-b21a-42d4-a260-7a45c4a07496 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:21.206484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-28f72c42-b21a-42d4-a260-7a45c4a07496 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:21.221239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28f72c42-b21a-42d4-a260-7a45c4a07496 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:21.226007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28f72c42-b21a-42d4-a260-7a45c4a07496 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:21.226705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28f72c42-b21a-42d4-a260-7a45c4a07496 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:21.227642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28f72c42-b21a-42d4-a260-7a45c4a07496 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:21.228410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28f72c42-b21a-42d4-a260-7a45c4a07496 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:21.230657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28f72c42-b21a-42d4-a260-7a45c4a07496 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:21.491473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-480ccca2-9875-4410-9097-8802ce1a474e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:21.503051 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-480ccca2-9875-4410-9097-8802ce1a474e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1317 microversion: 2.1 time: 0.674427 Oct 04 21:27:21.508048 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2178/4349] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:20 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1317 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:21.519209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b905e4c2-26bf-4daf-9f35-1e772a73cbab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:21.519880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b905e4c2-26bf-4daf-9f35-1e772a73cbab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:21.554302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b905e4c2-26bf-4daf-9f35-1e772a73cbab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:21.554850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b905e4c2-26bf-4daf-9f35-1e772a73cbab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:21.555308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b905e4c2-26bf-4daf-9f35-1e772a73cbab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:21.558910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b905e4c2-26bf-4daf-9f35-1e772a73cbab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:21.559437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b905e4c2-26bf-4daf-9f35-1e772a73cbab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:21.559894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b905e4c2-26bf-4daf-9f35-1e772a73cbab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:21.654491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b905e4c2-26bf-4daf-9f35-1e772a73cbab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:21.655041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b905e4c2-26bf-4daf-9f35-1e772a73cbab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:21.655488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b905e4c2-26bf-4daf-9f35-1e772a73cbab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:21.655950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-b905e4c2-26bf-4daf-9f35-1e772a73cbab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lazy-loading 'fault' on Instance uuid 6daf7e14-2860-48b1-8065-bd3f25f5730b {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:27:21.676350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-28f72c42-b21a-42d4-a260-7a45c4a07496 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:21.691187 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-28f72c42-b21a-42d4-a260-7a45c4a07496 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1523 microversion: 2.1 time: 0.489613 Oct 04 21:27:21.693239 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2172/4350] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:21 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1523 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:21.731503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b905e4c2-26bf-4daf-9f35-1e772a73cbab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:21.743347 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b905e4c2-26bf-4daf-9f35-1e772a73cbab tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 200 len: 1303 microversion: 2.1 time: 0.233865 Oct 04 21:27:21.744339 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2179/4351] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:21 2022] GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 1303 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:22.208513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-329cf1af-77d6-4cc3-8a15-a029fb4b6e2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:22.210253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-329cf1af-77d6-4cc3-8a15-a029fb4b6e2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:22.237147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-329cf1af-77d6-4cc3-8a15-a029fb4b6e2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:22.238453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-329cf1af-77d6-4cc3-8a15-a029fb4b6e2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:22.239971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-329cf1af-77d6-4cc3-8a15-a029fb4b6e2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:22.244115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-329cf1af-77d6-4cc3-8a15-a029fb4b6e2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:22.245853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-329cf1af-77d6-4cc3-8a15-a029fb4b6e2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:22.247274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-329cf1af-77d6-4cc3-8a15-a029fb4b6e2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:22.535331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b0eaf672-b83d-48c2-b585-15f87d120df9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:22.537894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b0eaf672-b83d-48c2-b585-15f87d120df9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:22.554984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b0eaf672-b83d-48c2-b585-15f87d120df9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:22.556271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b0eaf672-b83d-48c2-b585-15f87d120df9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:22.556934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b0eaf672-b83d-48c2-b585-15f87d120df9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:22.557991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b0eaf672-b83d-48c2-b585-15f87d120df9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:22.558619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b0eaf672-b83d-48c2-b585-15f87d120df9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:22.560822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b0eaf672-b83d-48c2-b585-15f87d120df9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:22.608955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-329cf1af-77d6-4cc3-8a15-a029fb4b6e2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:22.623314 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-329cf1af-77d6-4cc3-8a15-a029fb4b6e2a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1512 microversion: 2.1 time: 0.430965 Oct 04 21:27:22.624741 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2173/4352] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:22 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1512 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:22.631116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-789450b0-f42b-4a84-9b05-ef62ea6653c2 req-7e6161c3-aaaf-49b7-9c18-38817646a7ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144fff2d-9df3-4a93-833f-7f76acc85185", "name": "network-vif-plugged", "status": "completed", "tag": "cef3ff62-fc82-48d3-a981-5cadb2647961"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:22.697024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-789450b0-f42b-4a84-9b05-ef62ea6653c2 req-7e6161c3-aaaf-49b7-9c18-38817646a7ef service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:22.697889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-789450b0-f42b-4a84-9b05-ef62ea6653c2 req-7e6161c3-aaaf-49b7-9c18-38817646a7ef service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:22.698513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-789450b0-f42b-4a84-9b05-ef62ea6653c2 req-7e6161c3-aaaf-49b7-9c18-38817646a7ef service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:22.742097 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-789450b0-f42b-4a84-9b05-ef62ea6653c2 req-7e6161c3-aaaf-49b7-9c18-38817646a7ef service nova] Creating event network-vif-plugged:cef3ff62-fc82-48d3-a981-5cadb2647961 for instance 144fff2d-9df3-4a93-833f-7f76acc85185 on n-h2-860282-1 Oct 04 21:27:22.753552 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-789450b0-f42b-4a84-9b05-ef62ea6653c2 req-7e6161c3-aaaf-49b7-9c18-38817646a7ef service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126268 Oct 04 21:27:22.755772 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2174/4353] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:22.762469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-13f00312-fc68-484d-88a4-f4b0c6bdbf4d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:22.764148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-13f00312-fc68-484d-88a4-f4b0c6bdbf4d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:22.772993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13f00312-fc68-484d-88a4-f4b0c6bdbf4d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:22.773890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13f00312-fc68-484d-88a4-f4b0c6bdbf4d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:22.774746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13f00312-fc68-484d-88a4-f4b0c6bdbf4d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:22.775644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13f00312-fc68-484d-88a4-f4b0c6bdbf4d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:22.776596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13f00312-fc68-484d-88a4-f4b0c6bdbf4d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:22.777503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13f00312-fc68-484d-88a4-f4b0c6bdbf4d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:23.500573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b0eaf672-b83d-48c2-b585-15f87d120df9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:23.515794 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b0eaf672-b83d-48c2-b585-15f87d120df9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1317 microversion: 2.1 time: 0.981525 Oct 04 21:27:23.517153 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2180/4354] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:22 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1317 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:23.523403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a990953c-92ea-4fef-9059-dcca1b509aa9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:23.553846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a990953c-92ea-4fef-9059-dcca1b509aa9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 6daf7e14-2860-48b1-8065-bd3f25f5730b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:23.570699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a990953c-92ea-4fef-9059-dcca1b509aa9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:23.573755 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a990953c-92ea-4fef-9059-dcca1b509aa9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:23.574385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a990953c-92ea-4fef-9059-dcca1b509aa9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:23.576276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a990953c-92ea-4fef-9059-dcca1b509aa9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:23.576748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a990953c-92ea-4fef-9059-dcca1b509aa9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:23.577178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a990953c-92ea-4fef-9059-dcca1b509aa9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:23.610020 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-a990953c-92ea-4fef-9059-dcca1b509aa9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] HTTP exception thrown: Instance 6daf7e14-2860-48b1-8065-bd3f25f5730b could not be found. Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a990953c-92ea-4fef-9059-dcca1b509aa9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Request method failure captured: Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b HTTP/1.1 Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKMORPit0hTQrPIMzQtQx_UmCBmT5FIo7pDLWqLy5SiNGFiWYKdJzMYINV4AgM5hptJ-4S4yFMnq28D6VhWfZFl9iSPJwvrGQdWsUeuCxZhwibZPh1On3zv9TchRvE7UeNSX7_oKGHxGg-1hbqm1TznUUveZZBszMGCIz2Qsg_TKTD0 Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 0f62474e9d474aa28ac754b712e68652 Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerActionsTestJSON-1285044131 Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f62474e9d474aa28ac754b712e68652"}]}, {"type": "tempest-type-992649439", "name": "tempest-service-540783405", "endpoints": [{"region": "tempest-region-1225708338", "internalURL": "https://url-63677349.com"}]}, {"type": "tempest-type-1238556208", "name": "tempest-service-722626554", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0f62474e9d474aa28ac754b712e68652"}]}, {"type": "tempest-type-625574546", "name": "tempest-service-447491652", "endpoints": [{"region": "tempest-region-391707900", "publicURL": "https://url-992999868.com"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0f62474e9d474aa28ac754b712e68652"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f62474e9d474aa28ac754b712e68652"}]}] Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerActionsTestJSON-1285044131 Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 0f62474e9d474aa28ac754b712e68652 Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerActionsTestJSON-1285044131 Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerActionsTestJSON-1285044131-project Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 8ef7d2991dce46278486e0ee963d4cf3 Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerActionsTestJSON-1285044131-project Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 6daf7e14-2860-48b1-8065-bd3f25f5730b could not be found. Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '6daf7e14-2860-48b1-8065-bd3f25f5730b'} Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6daf7e14-2860-48b1-8065-bd3f25f5730b could not be found. Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:27:23.612386 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:27:23.616887 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:27:23.616887 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6daf7e14-2860-48b1-8065-bd3f25f5730b could not be found. Oct 04 21:27:23.616887 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:23.616887 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:23.616887 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:23.616887 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:23.616887 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:23.616887 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:23.616887 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:27:23.616887 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:27:23.616887 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6daf7e14-2860-48b1-8065-bd3f25f5730b could not be found. Oct 04 21:27:23.616887 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:23.618712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a990953c-92ea-4fef-9059-dcca1b509aa9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Returning 404 to user: Instance 6daf7e14-2860-48b1-8065-bd3f25f5730b could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:23.619802 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a990953c-92ea-4fef-9059-dcca1b509aa9 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b" status: 404 len: 111 microversion: 2.1 time: 0.100385 Oct 04 21:27:23.620531 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2181/4355] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:23 2022] GET /compute/v2.1/servers/6daf7e14-2860-48b1-8065-bd3f25f5730b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:27:23.628982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-56a1f524-128f-43ab-95db-5947c98217e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:23.629783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-56a1f524-128f-43ab-95db-5947c98217e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:23.637498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56a1f524-128f-43ab-95db-5947c98217e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:23.647033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56a1f524-128f-43ab-95db-5947c98217e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:23.647033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56a1f524-128f-43ab-95db-5947c98217e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:23.647033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56a1f524-128f-43ab-95db-5947c98217e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:23.647033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56a1f524-128f-43ab-95db-5947c98217e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:23.647033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56a1f524-128f-43ab-95db-5947c98217e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:23.696356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-56a1f524-128f-43ab-95db-5947c98217e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:27:23.953930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-13f00312-fc68-484d-88a4-f4b0c6bdbf4d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:23.968577 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-13f00312-fc68-484d-88a4-f4b0c6bdbf4d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1508 microversion: 2.1 time: 1.211359 Oct 04 21:27:23.973564 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2175/4356] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:22 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1508 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:23.983742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ff40652d-ae57-4383-b468-036e8fea1767 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:23.985300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ff40652d-ae57-4383-b468-036e8fea1767 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:24.030995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff40652d-ae57-4383-b468-036e8fea1767 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:24.030995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff40652d-ae57-4383-b468-036e8fea1767 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:24.030995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff40652d-ae57-4383-b468-036e8fea1767 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:24.030995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff40652d-ae57-4383-b468-036e8fea1767 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:24.030995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff40652d-ae57-4383-b468-036e8fea1767 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:24.036619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff40652d-ae57-4383-b468-036e8fea1767 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:24.079056 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-56a1f524-128f-43ab-95db-5947c98217e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 204 len: 0 microversion: 2.1 time: 0.453677 Oct 04 21:27:24.079691 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2182/4357] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:27:23 2022] DELETE /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:27:24.087362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-82bdf9ce-84a8-4bf9-b81b-db5bd382d271 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:24.090396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-82bdf9ce-84a8-4bf9-b81b-db5bd382d271 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:24.115694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82bdf9ce-84a8-4bf9-b81b-db5bd382d271 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:24.117000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82bdf9ce-84a8-4bf9-b81b-db5bd382d271 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:24.117492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82bdf9ce-84a8-4bf9-b81b-db5bd382d271 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:24.125354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82bdf9ce-84a8-4bf9-b81b-db5bd382d271 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:24.125936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82bdf9ce-84a8-4bf9-b81b-db5bd382d271 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:24.132186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82bdf9ce-84a8-4bf9-b81b-db5bd382d271 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:24.564568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ff40652d-ae57-4383-b468-036e8fea1767 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:24.574104 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ff40652d-ae57-4383-b468-036e8fea1767 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1512 microversion: 2.1 time: 0.598664 Oct 04 21:27:24.574785 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2176/4358] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:23 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1512 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:24.605095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-82bdf9ce-84a8-4bf9-b81b-db5bd382d271 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:24.619807 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-82bdf9ce-84a8-4bf9-b81b-db5bd382d271 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 200 len: 1508 microversion: 2.1 time: 0.538256 Oct 04 21:27:24.626317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-998f6882-b5ab-473c-89f0-81cac56056f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:24.626973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-998f6882-b5ab-473c-89f0-81cac56056f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:24.640097 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2183/4359] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:24 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 1508 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:24.648581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fb21bc96-f0a9-494c-b706-b135a90e4e97 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:24.650135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fb21bc96-f0a9-494c-b706-b135a90e4e97 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:24.652652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998f6882-b5ab-473c-89f0-81cac56056f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:24.659055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998f6882-b5ab-473c-89f0-81cac56056f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:24.659055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998f6882-b5ab-473c-89f0-81cac56056f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:24.659055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998f6882-b5ab-473c-89f0-81cac56056f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:24.659055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998f6882-b5ab-473c-89f0-81cac56056f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:24.659055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998f6882-b5ab-473c-89f0-81cac56056f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:24.659634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:24.659634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb21bc96-f0a9-494c-b706-b135a90e4e97 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:24.661468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb21bc96-f0a9-494c-b706-b135a90e4e97 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:24.662375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb21bc96-f0a9-494c-b706-b135a90e4e97 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:24.663307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb21bc96-f0a9-494c-b706-b135a90e4e97 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:24.664122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb21bc96-f0a9-494c-b706-b135a90e4e97 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:24.664998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb21bc96-f0a9-494c-b706-b135a90e4e97 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:25.095708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fb21bc96-f0a9-494c-b706-b135a90e4e97 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:25.104484 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fb21bc96-f0a9-494c-b706-b135a90e4e97 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1317 microversion: 2.1 time: 0.462879 Oct 04 21:27:25.121216 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2184/4360] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:24 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:25.127596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f01e9f36-31a6-4478-95f1-a8b3c11bfbef tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:25.128337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f01e9f36-31a6-4478-95f1-a8b3c11bfbef tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:25.142906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f01e9f36-31a6-4478-95f1-a8b3c11bfbef tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:25.144119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f01e9f36-31a6-4478-95f1-a8b3c11bfbef tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:25.145105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f01e9f36-31a6-4478-95f1-a8b3c11bfbef tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:25.147842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f01e9f36-31a6-4478-95f1-a8b3c11bfbef tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:25.148321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f01e9f36-31a6-4478-95f1-a8b3c11bfbef tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:25.148770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f01e9f36-31a6-4478-95f1-a8b3c11bfbef tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:25.168038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-998f6882-b5ab-473c-89f0-81cac56056f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:25.192338 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-998f6882-b5ab-473c-89f0-81cac56056f0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1507 microversion: 2.1 time: 0.591961 Oct 04 21:27:25.193895 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2177/4361] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:24 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1507 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:25.206424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f01e9f36-31a6-4478-95f1-a8b3c11bfbef tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:27:25.607635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6f9ca636-2fb8-4f6e-a9c2-4309808b594a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:25.608265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6f9ca636-2fb8-4f6e-a9c2-4309808b594a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:25.623713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f9ca636-2fb8-4f6e-a9c2-4309808b594a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:25.624636 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f9ca636-2fb8-4f6e-a9c2-4309808b594a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:25.625456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f9ca636-2fb8-4f6e-a9c2-4309808b594a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:25.627107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f9ca636-2fb8-4f6e-a9c2-4309808b594a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:25.627753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f9ca636-2fb8-4f6e-a9c2-4309808b594a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:25.628344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f9ca636-2fb8-4f6e-a9c2-4309808b594a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:25.644878 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f01e9f36-31a6-4478-95f1-a8b3c11bfbef tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "DELETE /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 204 len: 0 microversion: 2.1 time: 0.521430 Oct 04 21:27:25.645903 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2185/4362] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:27:25 2022] DELETE /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:27:25.934417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b3ec3b8f-06ac-4c62-b3b9-ccd78ccecd2c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1908397202", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "59bc4e47-3ceb-4d57-b1a7-aefe15e4bd7e"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:26.049402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-b3ec3b8f-06ac-4c62-b3b9-ccd78ccecd2c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] validate_networks() for [('59bc4e47-3ceb-4d57-b1a7-aefe15e4bd7e', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:27:26.066933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6f9ca636-2fb8-4f6e-a9c2-4309808b594a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:26.077072 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6f9ca636-2fb8-4f6e-a9c2-4309808b594a tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1512 microversion: 2.1 time: 0.476626 Oct 04 21:27:26.078145 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2178/4363] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:25 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1512 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:26.129789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6fe12380-0d5e-4cca-b60e-fe80bc2ab420 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:26.133018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6fe12380-0d5e-4cca-b60e-fe80bc2ab420 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:26.147097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fe12380-0d5e-4cca-b60e-fe80bc2ab420 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:26.147810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fe12380-0d5e-4cca-b60e-fe80bc2ab420 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:26.152358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fe12380-0d5e-4cca-b60e-fe80bc2ab420 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:26.153874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fe12380-0d5e-4cca-b60e-fe80bc2ab420 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:26.157409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fe12380-0d5e-4cca-b60e-fe80bc2ab420 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:26.158077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fe12380-0d5e-4cca-b60e-fe80bc2ab420 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:26.629641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6fe12380-0d5e-4cca-b60e-fe80bc2ab420 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:26.647287 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6fe12380-0d5e-4cca-b60e-fe80bc2ab420 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1317 microversion: 2.1 time: 0.517600 Oct 04 21:27:26.652873 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2179/4364] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:26 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1317 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:26.654419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-b9f2e7ac-62ef-46d8-9e10-ff1ee8492d2d req-a597610b-5014-47f3-9115-a3a4a35a3357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e3f92fe-569e-4490-8f75-6e2edde12f37", "tag": "8b26b180-3007-4dc0-8a67-0a0e4522bd4c"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:26.680101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b9f2e7ac-62ef-46d8-9e10-ff1ee8492d2d req-a597610b-5014-47f3-9115-a3a4a35a3357 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:26.686974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b9f2e7ac-62ef-46d8-9e10-ff1ee8492d2d req-a597610b-5014-47f3-9115-a3a4a35a3357 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:26.686974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b9f2e7ac-62ef-46d8-9e10-ff1ee8492d2d req-a597610b-5014-47f3-9115-a3a4a35a3357 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:26.707638 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-b9f2e7ac-62ef-46d8-9e10-ff1ee8492d2d req-a597610b-5014-47f3-9115-a3a4a35a3357 service nova] Creating event network-changed:8b26b180-3007-4dc0-8a67-0a0e4522bd4c for instance 7e3f92fe-569e-4490-8f75-6e2edde12f37 on n-h1-860282-1 Oct 04 21:27:26.732432 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-b9f2e7ac-62ef-46d8-9e10-ff1ee8492d2d req-a597610b-5014-47f3-9115-a3a4a35a3357 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070240 Oct 04 21:27:26.733593 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2180/4365] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:26.749945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b41587ab-197e-4acf-8499-15944d9139ce tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:26.750987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b41587ab-197e-4acf-8499-15944d9139ce tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:26.789285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b41587ab-197e-4acf-8499-15944d9139ce tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:26.790681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b41587ab-197e-4acf-8499-15944d9139ce tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:26.793183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b41587ab-197e-4acf-8499-15944d9139ce tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:26.795442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b41587ab-197e-4acf-8499-15944d9139ce tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:26.796544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b41587ab-197e-4acf-8499-15944d9139ce tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:26.797047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b41587ab-197e-4acf-8499-15944d9139ce tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:27.252310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b41587ab-197e-4acf-8499-15944d9139ce tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:27.264834 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b41587ab-197e-4acf-8499-15944d9139ce tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1507 microversion: 2.1 time: 0.529255 Oct 04 21:27:27.280319 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2181/4366] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:26 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1507 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:27.294948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e749e5fb-02ca-4d6e-bd40-41b25f2046cc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:27.297836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e749e5fb-02ca-4d6e-bd40-41b25f2046cc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:27.305225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e749e5fb-02ca-4d6e-bd40-41b25f2046cc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:27.306181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e749e5fb-02ca-4d6e-bd40-41b25f2046cc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:27.306871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e749e5fb-02ca-4d6e-bd40-41b25f2046cc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:27.307821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e749e5fb-02ca-4d6e-bd40-41b25f2046cc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:27.308583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e749e5fb-02ca-4d6e-bd40-41b25f2046cc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:27.309246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e749e5fb-02ca-4d6e-bd40-41b25f2046cc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:27.489242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-b3ec3b8f-06ac-4c62-b3b9-ccd78ccecd2c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:27:27.490396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-b3ec3b8f-06ac-4c62-b3b9-ccd78ccecd2c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:27:27.491935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-b3ec3b8f-06ac-4c62-b3b9-ccd78ccecd2c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:27:27.492597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-b3ec3b8f-06ac-4c62-b3b9-ccd78ccecd2c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:27:27.493244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-b3ec3b8f-06ac-4c62-b3b9-ccd78ccecd2c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:27:27.511267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3ec3b8f-06ac-4c62-b3b9-ccd78ccecd2c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:27.514790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3ec3b8f-06ac-4c62-b3b9-ccd78ccecd2c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:27.515197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3ec3b8f-06ac-4c62-b3b9-ccd78ccecd2c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:27.516616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3ec3b8f-06ac-4c62-b3b9-ccd78ccecd2c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:27.520853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3ec3b8f-06ac-4c62-b3b9-ccd78ccecd2c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:27.522061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3ec3b8f-06ac-4c62-b3b9-ccd78ccecd2c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:27.624146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-b3ec3b8f-06ac-4c62-b3b9-ccd78ccecd2c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Getting quotas for project 0006ee9cd0424160a0e042de4c653358. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:27:27.642358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-b3ec3b8f-06ac-4c62-b3b9-ccd78ccecd2c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Getting quotas for user cf4bb2f7ed99411eb8b6231d64179485 and project 0006ee9cd0424160a0e042de4c653358. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:27:27.693543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b3ec3b8f-06ac-4c62-b3b9-ccd78ccecd2c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:27:27.698853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b3ec3b8f-06ac-4c62-b3b9-ccd78ccecd2c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:27:27.798661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e749e5fb-02ca-4d6e-bd40-41b25f2046cc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:27.825213 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e749e5fb-02ca-4d6e-bd40-41b25f2046cc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1512 microversion: 2.1 time: 0.531183 Oct 04 21:27:27.837888 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2182/4367] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:27 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1512 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:27.843527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7c43699c-05dc-4445-bd5b-db053187f340 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:27.844386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7c43699c-05dc-4445-bd5b-db053187f340 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:27.863795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c43699c-05dc-4445-bd5b-db053187f340 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:27.864778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c43699c-05dc-4445-bd5b-db053187f340 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:27.865746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c43699c-05dc-4445-bd5b-db053187f340 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:27.866879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c43699c-05dc-4445-bd5b-db053187f340 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:27.867511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c43699c-05dc-4445-bd5b-db053187f340 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:27.868202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c43699c-05dc-4445-bd5b-db053187f340 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:27.916621 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b3ec3b8f-06ac-4c62-b3b9-ccd78ccecd2c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.986302 Oct 04 21:27:27.920636 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2186/4368] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:27:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:27:27.934495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-244a26bf-b941-4a0d-b504-4753c2c1aa32 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:27.949299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-244a26bf-b941-4a0d-b504-4753c2c1aa32 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:28.236290 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-244a26bf-b941-4a0d-b504-4753c2c1aa32 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:28.255753 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-244a26bf-b941-4a0d-b504-4753c2c1aa32 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1218 microversion: 2.1 time: 0.324990 Oct 04 21:27:28.280788 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2187/4369] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:27 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1218 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:28.296109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-df3944e3-37b4-4d5d-883b-cdc2af9815e5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:28.296676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-df3944e3-37b4-4d5d-883b-cdc2af9815e5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:28.320388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df3944e3-37b4-4d5d-883b-cdc2af9815e5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:28.320888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df3944e3-37b4-4d5d-883b-cdc2af9815e5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:28.321327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df3944e3-37b4-4d5d-883b-cdc2af9815e5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:28.322370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df3944e3-37b4-4d5d-883b-cdc2af9815e5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:28.322827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df3944e3-37b4-4d5d-883b-cdc2af9815e5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:28.323251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df3944e3-37b4-4d5d-883b-cdc2af9815e5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:28.417598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df3944e3-37b4-4d5d-883b-cdc2af9815e5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:28.417598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df3944e3-37b4-4d5d-883b-cdc2af9815e5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:28.417598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df3944e3-37b4-4d5d-883b-cdc2af9815e5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:28.417598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-df3944e3-37b4-4d5d-883b-cdc2af9815e5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lazy-loading 'fault' on Instance uuid d5168fa4-3950-4c8b-8950-903b3231b79e {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:27:28.599757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-df3944e3-37b4-4d5d-883b-cdc2af9815e5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:28.623094 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-df3944e3-37b4-4d5d-883b-cdc2af9815e5 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 200 len: 1304 microversion: 2.1 time: 0.328152 Oct 04 21:27:28.642683 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2188/4370] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:28 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 1304 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:28.724715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7c43699c-05dc-4445-bd5b-db053187f340 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:28.751456 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7c43699c-05dc-4445-bd5b-db053187f340 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.916288 Oct 04 21:27:28.757282 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2183/4371] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:27 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:28.820082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-e6e07c84-b52f-4129-98f0-221c5783ce00 req-0d156059-a929-46c7-a905-16c53c40093f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5168fa4-3950-4c8b-8950-903b3231b79e", "name": "network-vif-deleted", "tag": "a40fc885-ec8e-417f-9a36-6776760c4c02"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:28.859899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e6e07c84-b52f-4129-98f0-221c5783ce00 req-0d156059-a929-46c7-a905-16c53c40093f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:28.860472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e6e07c84-b52f-4129-98f0-221c5783ce00 req-0d156059-a929-46c7-a905-16c53c40093f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:28.865199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e6e07c84-b52f-4129-98f0-221c5783ce00 req-0d156059-a929-46c7-a905-16c53c40093f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:28.883934 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-e6e07c84-b52f-4129-98f0-221c5783ce00 req-0d156059-a929-46c7-a905-16c53c40093f service nova] Creating event network-vif-deleted:a40fc885-ec8e-417f-9a36-6776760c4c02 for instance d5168fa4-3950-4c8b-8950-903b3231b79e on n-h2-860282-1 Oct 04 21:27:28.930227 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-e6e07c84-b52f-4129-98f0-221c5783ce00 req-0d156059-a929-46c7-a905-16c53c40093f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112984 Oct 04 21:27:28.948078 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2189/4372] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:28.965947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-480396c2-3c8f-4c0c-ad70-2136fff6d9aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:28.969193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-480396c2-3c8f-4c0c-ad70-2136fff6d9aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:28.992710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480396c2-3c8f-4c0c-ad70-2136fff6d9aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:28.993219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480396c2-3c8f-4c0c-ad70-2136fff6d9aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:28.993686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480396c2-3c8f-4c0c-ad70-2136fff6d9aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:28.994396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480396c2-3c8f-4c0c-ad70-2136fff6d9aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:28.994858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480396c2-3c8f-4c0c-ad70-2136fff6d9aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:28.995288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-480396c2-3c8f-4c0c-ad70-2136fff6d9aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:29.001807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-2ca9c08f-a813-4615-9cb5-aaa4fdbe71c6 req-aa1ff2e8-a8c2-4547-a495-2deabae92333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67efa537-ebf8-481f-8d5b-dfcae879bc9c", "name": "network-vif-deleted", "tag": "26c619a4-039b-446b-b368-a9c902c8e043"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:29.033960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2ca9c08f-a813-4615-9cb5-aaa4fdbe71c6 req-aa1ff2e8-a8c2-4547-a495-2deabae92333 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:29.034738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2ca9c08f-a813-4615-9cb5-aaa4fdbe71c6 req-aa1ff2e8-a8c2-4547-a495-2deabae92333 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:29.035429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2ca9c08f-a813-4615-9cb5-aaa4fdbe71c6 req-aa1ff2e8-a8c2-4547-a495-2deabae92333 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:29.063430 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-2ca9c08f-a813-4615-9cb5-aaa4fdbe71c6 req-aa1ff2e8-a8c2-4547-a495-2deabae92333 service nova] Creating event network-vif-deleted:26c619a4-039b-446b-b368-a9c902c8e043 for instance 67efa537-ebf8-481f-8d5b-dfcae879bc9c on n-h1-860282-1 Oct 04 21:27:29.078180 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-2ca9c08f-a813-4615-9cb5-aaa4fdbe71c6 req-aa1ff2e8-a8c2-4547-a495-2deabae92333 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228986 Oct 04 21:27:29.086463 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2184/4373] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:27:29.100376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cf3b5204-8b80-45c4-9c86-753acbe8b3b1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1063055754", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:29.194652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-cf3b5204-8b80-45c4-9c86-753acbe8b3b1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] validate_networks() for [('6854610d-7b7e-44e1-90bf-b66a6b17f7da', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:27:30.073742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-480396c2-3c8f-4c0c-ad70-2136fff6d9aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:30.083942 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-480396c2-3c8f-4c0c-ad70-2136fff6d9aa tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1512 microversion: 2.1 time: 1.134235 Oct 04 21:27:30.084687 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2190/4374] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:28 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1512 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:30.090150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1af215eb-af18-4d8e-bb56-7c2c846419fe tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:30.091685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1af215eb-af18-4d8e-bb56-7c2c846419fe tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:30.099213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1af215eb-af18-4d8e-bb56-7c2c846419fe tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:30.100297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1af215eb-af18-4d8e-bb56-7c2c846419fe tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:30.101246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1af215eb-af18-4d8e-bb56-7c2c846419fe tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:30.102348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1af215eb-af18-4d8e-bb56-7c2c846419fe tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:30.103296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1af215eb-af18-4d8e-bb56-7c2c846419fe tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:30.103943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1af215eb-af18-4d8e-bb56-7c2c846419fe tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:30.286605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1af215eb-af18-4d8e-bb56-7c2c846419fe tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:30.295830 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1af215eb-af18-4d8e-bb56-7c2c846419fe tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1222 microversion: 2.1 time: 0.209805 Oct 04 21:27:30.299444 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2191/4375] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:30 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1222 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:30.309758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2cb50274-e506-4724-8e8e-3c356f4ea0fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:30.310713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2cb50274-e506-4724-8e8e-3c356f4ea0fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: d5168fa4-3950-4c8b-8950-903b3231b79e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:30.328663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2cb50274-e506-4724-8e8e-3c356f4ea0fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:30.330678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2cb50274-e506-4724-8e8e-3c356f4ea0fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:30.331436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2cb50274-e506-4724-8e8e-3c356f4ea0fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:30.333039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2cb50274-e506-4724-8e8e-3c356f4ea0fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:30.335408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2cb50274-e506-4724-8e8e-3c356f4ea0fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:30.335967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2cb50274-e506-4724-8e8e-3c356f4ea0fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:30.357665 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-2cb50274-e506-4724-8e8e-3c356f4ea0fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] HTTP exception thrown: Instance d5168fa4-3950-4c8b-8950-903b3231b79e could not be found. Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2cb50274-e506-4724-8e8e-3c356f4ea0fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Request method failure captured: Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e HTTP/1.1 Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKMORPit0hTQrPIMzQtQx_UmCBmT5FIo7pDLWqLy5SiNGFiWYKdJzMYINV4AgM5hptJ-4S4yFMnq28D6VhWfZFl9iSPJwvrGQdWsUeuCxZhwibZPh1On3zv9TchRvE7UeNSX7_oKGHxGg-1hbqm1TznUUveZZBszMGCIz2Qsg_TKTD0 Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 0f62474e9d474aa28ac754b712e68652 Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerActionsTestJSON-1285044131 Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f62474e9d474aa28ac754b712e68652"}]}, {"type": "tempest-type-992649439", "name": "tempest-service-540783405", "endpoints": [{"region": "tempest-region-1225708338", "internalURL": "https://url-63677349.com"}]}, {"type": "tempest-type-1238556208", "name": "tempest-service-722626554", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0f62474e9d474aa28ac754b712e68652"}]}, {"type": "tempest-type-625574546", "name": "tempest-service-447491652", "endpoints": [{"region": "tempest-region-391707900", "publicURL": "https://url-992999868.com"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0f62474e9d474aa28ac754b712e68652"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f62474e9d474aa28ac754b712e68652"}]}] Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerActionsTestJSON-1285044131 Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 0f62474e9d474aa28ac754b712e68652 Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerActionsTestJSON-1285044131 Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerActionsTestJSON-1285044131-project Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 8ef7d2991dce46278486e0ee963d4cf3 Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerActionsTestJSON-1285044131-project Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance d5168fa4-3950-4c8b-8950-903b3231b79e could not be found. Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'd5168fa4-3950-4c8b-8950-903b3231b79e'} Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5168fa4-3950-4c8b-8950-903b3231b79e could not be found. Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:27:30.359836 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:27:30.363597 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:27:30.363597 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5168fa4-3950-4c8b-8950-903b3231b79e could not be found. Oct 04 21:27:30.363597 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:30.363597 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:30.363597 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:30.363597 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:30.363597 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:30.363597 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:30.363597 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:27:30.363597 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:27:30.363597 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5168fa4-3950-4c8b-8950-903b3231b79e could not be found. Oct 04 21:27:30.363597 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:30.366571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2cb50274-e506-4724-8e8e-3c356f4ea0fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Returning 404 to user: Instance d5168fa4-3950-4c8b-8950-903b3231b79e could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:30.370224 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2cb50274-e506-4724-8e8e-3c356f4ea0fe tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e" status: 404 len: 111 microversion: 2.1 time: 0.069415 Oct 04 21:27:30.371128 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2192/4376] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:30 2022] GET /compute/v2.1/servers/d5168fa4-3950-4c8b-8950-903b3231b79e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:27:30.382213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1a68a808-743a-4af0-bc34-99b896d24745 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:30.383163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1a68a808-743a-4af0-bc34-99b896d24745 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:30.391364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a68a808-743a-4af0-bc34-99b896d24745 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:30.392237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a68a808-743a-4af0-bc34-99b896d24745 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:30.392688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a68a808-743a-4af0-bc34-99b896d24745 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:30.395763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a68a808-743a-4af0-bc34-99b896d24745 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:30.395763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a68a808-743a-4af0-bc34-99b896d24745 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:30.395763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a68a808-743a-4af0-bc34-99b896d24745 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:30.417062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:30.430678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1a68a808-743a-4af0-bc34-99b896d24745 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:27:30.697514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-cf3b5204-8b80-45c4-9c86-753acbe8b3b1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:27:30.698014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-cf3b5204-8b80-45c4-9c86-753acbe8b3b1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:27:30.698410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-cf3b5204-8b80-45c4-9c86-753acbe8b3b1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:27:30.698821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-cf3b5204-8b80-45c4-9c86-753acbe8b3b1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:27:30.699412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-cf3b5204-8b80-45c4-9c86-753acbe8b3b1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:27:30.712790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf3b5204-8b80-45c4-9c86-753acbe8b3b1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:30.713894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf3b5204-8b80-45c4-9c86-753acbe8b3b1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:30.714423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf3b5204-8b80-45c4-9c86-753acbe8b3b1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:30.719229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf3b5204-8b80-45c4-9c86-753acbe8b3b1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:30.719229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf3b5204-8b80-45c4-9c86-753acbe8b3b1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:30.719229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf3b5204-8b80-45c4-9c86-753acbe8b3b1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:30.740670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-cf3b5204-8b80-45c4-9c86-753acbe8b3b1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Getting quotas for project a177c1fc19f0456dbf217e4582e3eb2b. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:27:30.747293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-cf3b5204-8b80-45c4-9c86-753acbe8b3b1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Getting quotas for user 3022b1f60e82428482675f26d2621f39 and project a177c1fc19f0456dbf217e4582e3eb2b. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:27:30.765560 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1a68a808-743a-4af0-bc34-99b896d24745 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "DELETE /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 204 len: 0 microversion: 2.1 time: 0.389550 Oct 04 21:27:30.766152 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2193/4377] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:27:30 2022] DELETE /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:27:30.766309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cf3b5204-8b80-45c4-9c86-753acbe8b3b1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:27:30.772051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cf3b5204-8b80-45c4-9c86-753acbe8b3b1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:27:30.776509 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9fa0732e-15c6-4f96-a018-ad6e54ec8fbb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:30.777594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9fa0732e-15c6-4f96-a018-ad6e54ec8fbb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:30.785288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9fa0732e-15c6-4f96-a018-ad6e54ec8fbb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:30.785832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9fa0732e-15c6-4f96-a018-ad6e54ec8fbb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:30.786312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9fa0732e-15c6-4f96-a018-ad6e54ec8fbb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:30.787025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9fa0732e-15c6-4f96-a018-ad6e54ec8fbb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:30.790242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9fa0732e-15c6-4f96-a018-ad6e54ec8fbb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:30.790242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9fa0732e-15c6-4f96-a018-ad6e54ec8fbb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:30.884093 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cf3b5204-8b80-45c4-9c86-753acbe8b3b1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.795988 Oct 04 21:27:30.885052 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2185/4378] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:27:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:27:30.896058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e8652195-808e-4184-b69b-15a772e4957d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:30.899069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e8652195-808e-4184-b69b-15a772e4957d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:31.012325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e8652195-808e-4184-b69b-15a772e4957d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:31.024952 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e8652195-808e-4184-b69b-15a772e4957d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 200 len: 1217 microversion: 2.1 time: 0.132041 Oct 04 21:27:31.025880 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2186/4379] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:30 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 1217 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:31.030511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9fa0732e-15c6-4f96-a018-ad6e54ec8fbb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:31.039999 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9fa0732e-15c6-4f96-a018-ad6e54ec8fbb tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1494 microversion: 2.1 time: 0.268043 Oct 04 21:27:31.046161 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2194/4380] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:30 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1494 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:31.121136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a568cbe3-3044-4edf-abc8-387ffe11b1e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:31.122113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a568cbe3-3044-4edf-abc8-387ffe11b1e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:31.147216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a568cbe3-3044-4edf-abc8-387ffe11b1e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:31.147879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a568cbe3-3044-4edf-abc8-387ffe11b1e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:31.150571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a568cbe3-3044-4edf-abc8-387ffe11b1e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:31.151552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a568cbe3-3044-4edf-abc8-387ffe11b1e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:31.152128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a568cbe3-3044-4edf-abc8-387ffe11b1e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:31.154666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a568cbe3-3044-4edf-abc8-387ffe11b1e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:31.331517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3ac1b6e2-768b-4d8b-912c-5f8bf5d8ae9c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:31.333181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3ac1b6e2-768b-4d8b-912c-5f8bf5d8ae9c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:31.341379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ac1b6e2-768b-4d8b-912c-5f8bf5d8ae9c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:31.343017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ac1b6e2-768b-4d8b-912c-5f8bf5d8ae9c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:31.343714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ac1b6e2-768b-4d8b-912c-5f8bf5d8ae9c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:31.344985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ac1b6e2-768b-4d8b-912c-5f8bf5d8ae9c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:31.345710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ac1b6e2-768b-4d8b-912c-5f8bf5d8ae9c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:31.346420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ac1b6e2-768b-4d8b-912c-5f8bf5d8ae9c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:31.595757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a568cbe3-3044-4edf-abc8-387ffe11b1e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:31.605055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3ac1b6e2-768b-4d8b-912c-5f8bf5d8ae9c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:31.613965 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a568cbe3-3044-4edf-abc8-387ffe11b1e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1512 microversion: 2.1 time: 0.505883 Oct 04 21:27:31.618065 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2187/4381] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:31 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1512 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:31.620431 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3ac1b6e2-768b-4d8b-912c-5f8bf5d8ae9c tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1270 microversion: 2.1 time: 0.296851 Oct 04 21:27:31.634216 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2195/4382] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:31 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1270 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:32.049904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fe9713fe-cd1d-4c53-9dba-343a402bbe6c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:32.051269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fe9713fe-cd1d-4c53-9dba-343a402bbe6c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:32.064846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-410ba793-fdf3-4685-8b26-ff2a50548d78 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:32.065508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-410ba793-fdf3-4685-8b26-ff2a50548d78 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:32.079526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-410ba793-fdf3-4685-8b26-ff2a50548d78 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:32.080031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-410ba793-fdf3-4685-8b26-ff2a50548d78 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:32.080476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-410ba793-fdf3-4685-8b26-ff2a50548d78 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:32.087844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-410ba793-fdf3-4685-8b26-ff2a50548d78 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:32.090012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-410ba793-fdf3-4685-8b26-ff2a50548d78 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:32.091490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-410ba793-fdf3-4685-8b26-ff2a50548d78 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:32.210720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fe9713fe-cd1d-4c53-9dba-343a402bbe6c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:32.224874 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fe9713fe-cd1d-4c53-9dba-343a402bbe6c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 200 len: 1217 microversion: 2.1 time: 0.180151 Oct 04 21:27:32.226239 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2196/4383] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:32 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 1217 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:32.451277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-c3e76130-fffb-4004-83b3-4d18a454d38c req-b9fe6543-3370-422e-aa99-f7370de12a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05443ed3-535e-4dc0-a5fc-e052c224df2d", "name": "network-vif-deleted", "tag": "805ba44a-a1d1-4c81-bb46-975a050922ee"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:32.494597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-410ba793-fdf3-4685-8b26-ff2a50548d78 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:32.495301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c3e76130-fffb-4004-83b3-4d18a454d38c req-b9fe6543-3370-422e-aa99-f7370de12a9f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:32.497540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c3e76130-fffb-4004-83b3-4d18a454d38c req-b9fe6543-3370-422e-aa99-f7370de12a9f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:32.498434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c3e76130-fffb-4004-83b3-4d18a454d38c req-b9fe6543-3370-422e-aa99-f7370de12a9f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:32.506193 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-410ba793-fdf3-4685-8b26-ff2a50548d78 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1494 microversion: 2.1 time: 0.446557 Oct 04 21:27:32.509196 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2188/4384] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:32 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1494 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:32.553140 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-c3e76130-fffb-4004-83b3-4d18a454d38c req-b9fe6543-3370-422e-aa99-f7370de12a9f service nova] Creating event network-vif-deleted:805ba44a-a1d1-4c81-bb46-975a050922ee for instance 05443ed3-535e-4dc0-a5fc-e052c224df2d on n-h1-860282-1 Oct 04 21:27:32.562205 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-c3e76130-fffb-4004-83b3-4d18a454d38c req-b9fe6543-3370-422e-aa99-f7370de12a9f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117822 Oct 04 21:27:32.565691 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2197/4385] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:32.646266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-25ab9570-33a4-4b48-9e4c-afcfcb522222 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:32.647225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-25ab9570-33a4-4b48-9e4c-afcfcb522222 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:32.653804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6eed443f-6168-41d3-b32c-7e51fd2697f4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:32.654797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6eed443f-6168-41d3-b32c-7e51fd2697f4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:32.670313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:32.675497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6eed443f-6168-41d3-b32c-7e51fd2697f4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:32.677377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6eed443f-6168-41d3-b32c-7e51fd2697f4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:32.678047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6eed443f-6168-41d3-b32c-7e51fd2697f4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:32.679880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6eed443f-6168-41d3-b32c-7e51fd2697f4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:32.680272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25ab9570-33a4-4b48-9e4c-afcfcb522222 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:32.680879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6eed443f-6168-41d3-b32c-7e51fd2697f4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:32.681014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25ab9570-33a4-4b48-9e4c-afcfcb522222 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:32.681552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25ab9570-33a4-4b48-9e4c-afcfcb522222 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:32.681755 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6eed443f-6168-41d3-b32c-7e51fd2697f4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:32.684390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25ab9570-33a4-4b48-9e4c-afcfcb522222 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:32.691555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25ab9570-33a4-4b48-9e4c-afcfcb522222 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:32.697094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25ab9570-33a4-4b48-9e4c-afcfcb522222 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:33.278184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-25ab9570-33a4-4b48-9e4c-afcfcb522222 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:33.297015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6eed443f-6168-41d3-b32c-7e51fd2697f4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:33.300630 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-25ab9570-33a4-4b48-9e4c-afcfcb522222 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1512 microversion: 2.1 time: 0.660985 Oct 04 21:27:33.301533 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2189/4386] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:32 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1512 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:33.324285 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6eed443f-6168-41d3-b32c-7e51fd2697f4 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1318 microversion: 2.1 time: 0.679957 Oct 04 21:27:33.325547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a6f5e5f-6fea-446f-9b29-2f4b9f9256b2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:33.327514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7a6f5e5f-6fea-446f-9b29-2f4b9f9256b2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:33.327680 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2198/4387] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:32 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1318 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:33.339060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a6f5e5f-6fea-446f-9b29-2f4b9f9256b2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:33.340462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a6f5e5f-6fea-446f-9b29-2f4b9f9256b2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:33.341057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a6f5e5f-6fea-446f-9b29-2f4b9f9256b2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:33.342385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a6f5e5f-6fea-446f-9b29-2f4b9f9256b2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:33.344381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a6f5e5f-6fea-446f-9b29-2f4b9f9256b2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:33.345228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a6f5e5f-6fea-446f-9b29-2f4b9f9256b2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:33.530196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7a6f5e5f-6fea-446f-9b29-2f4b9f9256b2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:33.533351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:33.544763 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7a6f5e5f-6fea-446f-9b29-2f4b9f9256b2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 200 len: 1269 microversion: 2.1 time: 0.241729 Oct 04 21:27:33.545227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6ce07738-3d73-40ed-8f08-22a40f18ee21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:33.545891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6ce07738-3d73-40ed-8f08-22a40f18ee21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:33.546353 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2190/4388] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:33 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 1269 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:33.568661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ce07738-3d73-40ed-8f08-22a40f18ee21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:33.569561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ce07738-3d73-40ed-8f08-22a40f18ee21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:33.570567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ce07738-3d73-40ed-8f08-22a40f18ee21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:33.581462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ce07738-3d73-40ed-8f08-22a40f18ee21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:33.583478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ce07738-3d73-40ed-8f08-22a40f18ee21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:33.584600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ce07738-3d73-40ed-8f08-22a40f18ee21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:33.628512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ce07738-3d73-40ed-8f08-22a40f18ee21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:33.629732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ce07738-3d73-40ed-8f08-22a40f18ee21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:33.630430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ce07738-3d73-40ed-8f08-22a40f18ee21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:33.630907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-6ce07738-3d73-40ed-8f08-22a40f18ee21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lazy-loading 'fault' on Instance uuid 05443ed3-535e-4dc0-a5fc-e052c224df2d {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:27:33.727098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6ce07738-3d73-40ed-8f08-22a40f18ee21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:33.736599 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6ce07738-3d73-40ed-8f08-22a40f18ee21 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 200 len: 1305 microversion: 2.1 time: 0.195339 Oct 04 21:27:33.737214 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2199/4389] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:33 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 1305 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:34.326265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a30740b5-4951-4427-87f4-2cec2595f502 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:34.331046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a30740b5-4951-4427-87f4-2cec2595f502 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:34.340172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a30740b5-4951-4427-87f4-2cec2595f502 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:34.341856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a30740b5-4951-4427-87f4-2cec2595f502 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:34.342304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a30740b5-4951-4427-87f4-2cec2595f502 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:34.345701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a30740b5-4951-4427-87f4-2cec2595f502 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:34.346340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a30740b5-4951-4427-87f4-2cec2595f502 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:34.361055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b1982998-dc3e-44ed-a87f-fba6b3b44c2f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:34.361707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a30740b5-4951-4427-87f4-2cec2595f502 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:34.361835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b1982998-dc3e-44ed-a87f-fba6b3b44c2f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:34.370320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1982998-dc3e-44ed-a87f-fba6b3b44c2f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:34.371134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1982998-dc3e-44ed-a87f-fba6b3b44c2f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:34.371736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1982998-dc3e-44ed-a87f-fba6b3b44c2f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:34.372804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1982998-dc3e-44ed-a87f-fba6b3b44c2f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:34.373662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1982998-dc3e-44ed-a87f-fba6b3b44c2f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:34.374258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1982998-dc3e-44ed-a87f-fba6b3b44c2f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:34.871313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b1982998-dc3e-44ed-a87f-fba6b3b44c2f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:34.892585 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b1982998-dc3e-44ed-a87f-fba6b3b44c2f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1318 microversion: 2.1 time: 0.540145 Oct 04 21:27:34.894270 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2200/4390] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:34 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:34.900600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bd24aecd-4bff-4cd4-be23-ede1cbd7282d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:34.901563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bd24aecd-4bff-4cd4-be23-ede1cbd7282d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:34.923420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd24aecd-4bff-4cd4-be23-ede1cbd7282d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:34.927239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd24aecd-4bff-4cd4-be23-ede1cbd7282d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:34.928172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd24aecd-4bff-4cd4-be23-ede1cbd7282d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:34.929189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd24aecd-4bff-4cd4-be23-ede1cbd7282d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:34.938343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd24aecd-4bff-4cd4-be23-ede1cbd7282d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:34.940152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd24aecd-4bff-4cd4-be23-ede1cbd7282d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:35.484620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bd24aecd-4bff-4cd4-be23-ede1cbd7282d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:35.506762 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bd24aecd-4bff-4cd4-be23-ede1cbd7282d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 200 len: 1287 microversion: 2.1 time: 0.598809 Oct 04 21:27:35.506762 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2201/4391] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:34 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 1287 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:35.507052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a30740b5-4951-4427-87f4-2cec2595f502 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:35.517257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d197f1c3-f744-4f74-b34d-e74a7b148b37 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:35.517961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d197f1c3-f744-4f74-b34d-e74a7b148b37 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: 05443ed3-535e-4dc0-a5fc-e052c224df2d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:35.518464 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a30740b5-4951-4427-87f4-2cec2595f502 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1512 microversion: 2.1 time: 1.197108 Oct 04 21:27:35.524001 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2191/4392] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:34 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1512 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:35.534940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d197f1c3-f744-4f74-b34d-e74a7b148b37 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:35.536818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d197f1c3-f744-4f74-b34d-e74a7b148b37 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:35.537250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d197f1c3-f744-4f74-b34d-e74a7b148b37 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:35.539884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-06c67450-6181-4f8f-aef9-87c93a0fb454 req-3e60a951-7643-4f9e-80e9-d165b7cc3812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e08c87b8-0afc-4878-a793-35f36d4a8f95", "tag": "c0c382b1-3df9-4830-86eb-c2c4030f517f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:35.542137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d197f1c3-f744-4f74-b34d-e74a7b148b37 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:35.545467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d197f1c3-f744-4f74-b34d-e74a7b148b37 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:35.546881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d197f1c3-f744-4f74-b34d-e74a7b148b37 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:35.581142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-06c67450-6181-4f8f-aef9-87c93a0fb454 req-3e60a951-7643-4f9e-80e9-d165b7cc3812 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:35.586215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-06c67450-6181-4f8f-aef9-87c93a0fb454 req-3e60a951-7643-4f9e-80e9-d165b7cc3812 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:35.586933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-06c67450-6181-4f8f-aef9-87c93a0fb454 req-3e60a951-7643-4f9e-80e9-d165b7cc3812 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:35.620262 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-d197f1c3-f744-4f74-b34d-e74a7b148b37 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] HTTP exception thrown: Instance 05443ed3-535e-4dc0-a5fc-e052c224df2d could not be found. Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d197f1c3-f744-4f74-b34d-e74a7b148b37 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Request method failure captured: Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d HTTP/1.1 Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKMORPit0hTQrPIMzQtQx_UmCBmT5FIo7pDLWqLy5SiNGFiWYKdJzMYINV4AgM5hptJ-4S4yFMnq28D6VhWfZFl9iSPJwvrGQdWsUeuCxZhwibZPh1On3zv9TchRvE7UeNSX7_oKGHxGg-1hbqm1TznUUveZZBszMGCIz2Qsg_TKTD0 Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 0f62474e9d474aa28ac754b712e68652 Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerActionsTestJSON-1285044131 Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f62474e9d474aa28ac754b712e68652"}]}, {"type": "tempest-type-992649439", "name": "tempest-service-540783405", "endpoints": [{"region": "tempest-region-1225708338", "internalURL": "https://url-63677349.com"}]}, {"type": "tempest-type-1238556208", "name": "tempest-service-722626554", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0f62474e9d474aa28ac754b712e68652"}]}, {"type": "tempest-type-625574546", "name": "tempest-service-447491652", "endpoints": [{"region": "tempest-region-391707900", "publicURL": "https://url-992999868.com"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0f62474e9d474aa28ac754b712e68652"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f62474e9d474aa28ac754b712e68652"}]}] Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerActionsTestJSON-1285044131 Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 0f62474e9d474aa28ac754b712e68652 Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerActionsTestJSON-1285044131 Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerActionsTestJSON-1285044131-project Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 8ef7d2991dce46278486e0ee963d4cf3 Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerActionsTestJSON-1285044131-project Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 05443ed3-535e-4dc0-a5fc-e052c224df2d could not be found. Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '05443ed3-535e-4dc0-a5fc-e052c224df2d'} Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05443ed3-535e-4dc0-a5fc-e052c224df2d could not be found. Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:27:35.625706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:27:35.634688 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:27:35.634688 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05443ed3-535e-4dc0-a5fc-e052c224df2d could not be found. Oct 04 21:27:35.634688 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:35.634688 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:35.634688 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:35.634688 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:35.634688 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:35.634688 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:35.634688 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:27:35.634688 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:27:35.634688 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05443ed3-535e-4dc0-a5fc-e052c224df2d could not be found. Oct 04 21:27:35.634688 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:35.634688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d197f1c3-f744-4f74-b34d-e74a7b148b37 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Returning 404 to user: Instance 05443ed3-535e-4dc0-a5fc-e052c224df2d could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:35.634688 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d197f1c3-f744-4f74-b34d-e74a7b148b37 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d" status: 404 len: 111 microversion: 2.1 time: 0.126333 Oct 04 21:27:35.634688 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2202/4393] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:35 2022] GET /compute/v2.1/servers/05443ed3-535e-4dc0-a5fc-e052c224df2d => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:27:35.644831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-66816a5e-6822-4d67-b02b-8a6cb8222162 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:35.645339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-66816a5e-6822-4d67-b02b-8a6cb8222162 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:35.650298 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-06c67450-6181-4f8f-aef9-87c93a0fb454 req-3e60a951-7643-4f9e-80e9-d165b7cc3812 service nova] Creating event network-changed:c0c382b1-3df9-4830-86eb-c2c4030f517f for instance e08c87b8-0afc-4878-a793-35f36d4a8f95 on n-h1-860282-1 Oct 04 21:27:35.656471 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-06c67450-6181-4f8f-aef9-87c93a0fb454 req-3e60a951-7643-4f9e-80e9-d165b7cc3812 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130851 Oct 04 21:27:35.658203 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2192/4394] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:35.660464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66816a5e-6822-4d67-b02b-8a6cb8222162 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:35.661507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66816a5e-6822-4d67-b02b-8a6cb8222162 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:35.662037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66816a5e-6822-4d67-b02b-8a6cb8222162 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:35.662872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66816a5e-6822-4d67-b02b-8a6cb8222162 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:35.663551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66816a5e-6822-4d67-b02b-8a6cb8222162 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:35.664160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66816a5e-6822-4d67-b02b-8a6cb8222162 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:35.709776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-66816a5e-6822-4d67-b02b-8a6cb8222162 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:27:35.921343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-645d046f-efec-4a65-b3cc-181023deff77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:35.922422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-645d046f-efec-4a65-b3cc-181023deff77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:35.935544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-645d046f-efec-4a65-b3cc-181023deff77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:35.936054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-645d046f-efec-4a65-b3cc-181023deff77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:35.943705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-645d046f-efec-4a65-b3cc-181023deff77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:35.943705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-645d046f-efec-4a65-b3cc-181023deff77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:35.943705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-645d046f-efec-4a65-b3cc-181023deff77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:35.944365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-645d046f-efec-4a65-b3cc-181023deff77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:36.124041 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-66816a5e-6822-4d67-b02b-8a6cb8222162 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 204 len: 0 microversion: 2.1 time: 0.483352 Oct 04 21:27:36.125258 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2203/4395] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:27:35 2022] DELETE /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:27:36.135010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e888dcd0-3e4a-4ecc-8231-25c15ddf6671 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:36.135965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e888dcd0-3e4a-4ecc-8231-25c15ddf6671 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:36.148033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e888dcd0-3e4a-4ecc-8231-25c15ddf6671 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:36.148763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e888dcd0-3e4a-4ecc-8231-25c15ddf6671 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:36.150715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e888dcd0-3e4a-4ecc-8231-25c15ddf6671 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:36.151629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e888dcd0-3e4a-4ecc-8231-25c15ddf6671 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:36.152955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e888dcd0-3e4a-4ecc-8231-25c15ddf6671 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:36.156643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e888dcd0-3e4a-4ecc-8231-25c15ddf6671 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:36.402973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-645d046f-efec-4a65-b3cc-181023deff77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:36.412808 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-645d046f-efec-4a65-b3cc-181023deff77 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1318 microversion: 2.1 time: 0.496130 Oct 04 21:27:36.417917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e888dcd0-3e4a-4ecc-8231-25c15ddf6671 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:36.420726 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2193/4396] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:35 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:36.434527 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e888dcd0-3e4a-4ecc-8231-25c15ddf6671 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1674 microversion: 2.1 time: 0.303688 Oct 04 21:27:36.435124 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2204/4397] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:36 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1674 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:36.527055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-610d0d90-d8c7-4eb2-95a0-3e0765992713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:36.527729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-610d0d90-d8c7-4eb2-95a0-3e0765992713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:36.537046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-610d0d90-d8c7-4eb2-95a0-3e0765992713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:36.543378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8159cf76-fc8b-422d-b572-11a8f849bedf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:36.544412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8159cf76-fc8b-422d-b572-11a8f849bedf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:36.556638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-610d0d90-d8c7-4eb2-95a0-3e0765992713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:36.558265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-610d0d90-d8c7-4eb2-95a0-3e0765992713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:36.560174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8159cf76-fc8b-422d-b572-11a8f849bedf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:36.561329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-610d0d90-d8c7-4eb2-95a0-3e0765992713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:36.562185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8159cf76-fc8b-422d-b572-11a8f849bedf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:36.563061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8159cf76-fc8b-422d-b572-11a8f849bedf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:36.563828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-610d0d90-d8c7-4eb2-95a0-3e0765992713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:36.566992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-610d0d90-d8c7-4eb2-95a0-3e0765992713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:36.570354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8159cf76-fc8b-422d-b572-11a8f849bedf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:36.571198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8159cf76-fc8b-422d-b572-11a8f849bedf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:36.574323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8159cf76-fc8b-422d-b572-11a8f849bedf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:36.690089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-610d0d90-d8c7-4eb2-95a0-3e0765992713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:36.701810 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-610d0d90-d8c7-4eb2-95a0-3e0765992713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 200 len: 1275 microversion: 2.1 time: 0.178644 Oct 04 21:27:36.706258 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2194/4398] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:36 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 1275 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:37.073061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8159cf76-fc8b-422d-b572-11a8f849bedf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:37.078288 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8159cf76-fc8b-422d-b572-11a8f849bedf tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1512 microversion: 2.1 time: 0.539448 Oct 04 21:27:37.079395 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2205/4399] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:36 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1512 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:37.461686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ce55571e-ad9b-4b38-9c52-186a5d2c6cd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:37.462593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ce55571e-ad9b-4b38-9c52-186a5d2c6cd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:37.463091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-614c77f4-2c59-4578-848a-b36a375c085b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:37.464256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-614c77f4-2c59-4578-848a-b36a375c085b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:37.479542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce55571e-ad9b-4b38-9c52-186a5d2c6cd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:37.481950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-614c77f4-2c59-4578-848a-b36a375c085b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:37.482749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce55571e-ad9b-4b38-9c52-186a5d2c6cd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:37.485752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-614c77f4-2c59-4578-848a-b36a375c085b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:37.486402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-614c77f4-2c59-4578-848a-b36a375c085b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:37.487297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-614c77f4-2c59-4578-848a-b36a375c085b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:37.487939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-614c77f4-2c59-4578-848a-b36a375c085b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:37.488369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce55571e-ad9b-4b38-9c52-186a5d2c6cd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:37.489680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-614c77f4-2c59-4578-848a-b36a375c085b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:37.490371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce55571e-ad9b-4b38-9c52-186a5d2c6cd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:37.491017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce55571e-ad9b-4b38-9c52-186a5d2c6cd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:37.491628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce55571e-ad9b-4b38-9c52-186a5d2c6cd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:37.600520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:38.243472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-614c77f4-2c59-4578-848a-b36a375c085b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:38.261889 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-614c77f4-2c59-4578-848a-b36a375c085b tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1674 microversion: 2.1 time: 0.803607 Oct 04 21:27:38.277575 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2206/4400] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:37 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1674 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:38.284570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bbdb6bde-952c-4146-94fd-97e64d18de9e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:38.289619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bbdb6bde-952c-4146-94fd-97e64d18de9e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:38.319391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bbdb6bde-952c-4146-94fd-97e64d18de9e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:38.320190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bbdb6bde-952c-4146-94fd-97e64d18de9e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:38.322955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bbdb6bde-952c-4146-94fd-97e64d18de9e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:38.325292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bbdb6bde-952c-4146-94fd-97e64d18de9e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:38.328775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bbdb6bde-952c-4146-94fd-97e64d18de9e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:38.329631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bbdb6bde-952c-4146-94fd-97e64d18de9e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:38.384851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ce55571e-ad9b-4b38-9c52-186a5d2c6cd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:38.395383 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ce55571e-ad9b-4b38-9c52-186a5d2c6cd2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1318 microversion: 2.1 time: 0.938897 Oct 04 21:27:38.396592 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2195/4401] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:37 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1318 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:38.409414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-88929237-6b75-4d4c-8f0a-21b10f452f77 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:38.410483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-88929237-6b75-4d4c-8f0a-21b10f452f77 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:38.417246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88929237-6b75-4d4c-8f0a-21b10f452f77 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:38.418003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88929237-6b75-4d4c-8f0a-21b10f452f77 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:38.418641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88929237-6b75-4d4c-8f0a-21b10f452f77 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:38.419563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88929237-6b75-4d4c-8f0a-21b10f452f77 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:38.420215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88929237-6b75-4d4c-8f0a-21b10f452f77 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:38.420837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88929237-6b75-4d4c-8f0a-21b10f452f77 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:38.762650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bbdb6bde-952c-4146-94fd-97e64d18de9e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:38.784063 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bbdb6bde-952c-4146-94fd-97e64d18de9e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 200 len: 1317 microversion: 2.1 time: 0.503997 Oct 04 21:27:38.785127 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2207/4402] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:38 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:38.877592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-88929237-6b75-4d4c-8f0a-21b10f452f77 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:38.889229 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-88929237-6b75-4d4c-8f0a-21b10f452f77 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1512 microversion: 2.1 time: 0.491190 Oct 04 21:27:38.890189 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2196/4403] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:38 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1512 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:39.294707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-8141fe09-cdde-418e-9188-05575268b00a req-8b367a4a-e51e-49a9-b352-0d0e7ff40968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae649a1e-b6ec-4d6c-9584-7738fff25315", "tag": "9487709f-e232-4f06-bd45-23384ef95d73"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:39.297049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b22387e6-c51b-4a81-a8c3-479985779a75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:39.297718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b22387e6-c51b-4a81-a8c3-479985779a75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:39.311007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b22387e6-c51b-4a81-a8c3-479985779a75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:39.311535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b22387e6-c51b-4a81-a8c3-479985779a75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:39.324484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b22387e6-c51b-4a81-a8c3-479985779a75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:39.324484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b22387e6-c51b-4a81-a8c3-479985779a75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:39.325917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b22387e6-c51b-4a81-a8c3-479985779a75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:39.326375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b22387e6-c51b-4a81-a8c3-479985779a75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:39.327757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8141fe09-cdde-418e-9188-05575268b00a req-8b367a4a-e51e-49a9-b352-0d0e7ff40968 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:39.328247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8141fe09-cdde-418e-9188-05575268b00a req-8b367a4a-e51e-49a9-b352-0d0e7ff40968 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:39.331637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8141fe09-cdde-418e-9188-05575268b00a req-8b367a4a-e51e-49a9-b352-0d0e7ff40968 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:39.368221 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-8141fe09-cdde-418e-9188-05575268b00a req-8b367a4a-e51e-49a9-b352-0d0e7ff40968 service nova] Creating event network-changed:9487709f-e232-4f06-bd45-23384ef95d73 for instance ae649a1e-b6ec-4d6c-9584-7738fff25315 on n-h1-860282-1 Oct 04 21:27:39.376989 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-8141fe09-cdde-418e-9188-05575268b00a req-8b367a4a-e51e-49a9-b352-0d0e7ff40968 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085778 Oct 04 21:27:39.377987 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2197/4404] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:27:39.432862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-beb98bc4-d02f-426a-94e3-c37e962ccb6d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:39.433777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-beb98bc4-d02f-426a-94e3-c37e962ccb6d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:39.444349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-beb98bc4-d02f-426a-94e3-c37e962ccb6d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:39.444349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-beb98bc4-d02f-426a-94e3-c37e962ccb6d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:39.444349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-beb98bc4-d02f-426a-94e3-c37e962ccb6d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:39.444349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-beb98bc4-d02f-426a-94e3-c37e962ccb6d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:39.444349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-beb98bc4-d02f-426a-94e3-c37e962ccb6d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:39.444349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-beb98bc4-d02f-426a-94e3-c37e962ccb6d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:39.606230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b22387e6-c51b-4a81-a8c3-479985779a75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:39.615622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:39.637755 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b22387e6-c51b-4a81-a8c3-479985779a75 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1608 microversion: 2.1 time: 0.353042 Oct 04 21:27:39.646377 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2208/4405] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:39 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1608 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:39.814532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5ebc15ca-b332-4d43-a6c9-790da75e03b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:39.816138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5ebc15ca-b332-4d43-a6c9-790da75e03b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:39.833664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ebc15ca-b332-4d43-a6c9-790da75e03b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:39.834671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ebc15ca-b332-4d43-a6c9-790da75e03b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:39.839041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ebc15ca-b332-4d43-a6c9-790da75e03b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:39.840149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ebc15ca-b332-4d43-a6c9-790da75e03b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:39.845294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ebc15ca-b332-4d43-a6c9-790da75e03b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:39.846041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ebc15ca-b332-4d43-a6c9-790da75e03b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:39.861123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-beb98bc4-d02f-426a-94e3-c37e962ccb6d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:39.873238 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-beb98bc4-d02f-426a-94e3-c37e962ccb6d tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1318 microversion: 2.1 time: 0.454001 Oct 04 21:27:39.873896 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2198/4406] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:39 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1318 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:39.917343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d697ec53-6793-4c34-862e-4869aa004431 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:39.918626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d697ec53-6793-4c34-862e-4869aa004431 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:39.932302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d697ec53-6793-4c34-862e-4869aa004431 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:39.932850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d697ec53-6793-4c34-862e-4869aa004431 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:39.933306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d697ec53-6793-4c34-862e-4869aa004431 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:39.934076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d697ec53-6793-4c34-862e-4869aa004431 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:39.934548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d697ec53-6793-4c34-862e-4869aa004431 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:39.934987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d697ec53-6793-4c34-862e-4869aa004431 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:40.290131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5ebc15ca-b332-4d43-a6c9-790da75e03b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:40.306191 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5ebc15ca-b332-4d43-a6c9-790da75e03b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 200 len: 1317 microversion: 2.1 time: 0.500587 Oct 04 21:27:40.321858 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2209/4407] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:39 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 1317 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:40.392973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d697ec53-6793-4c34-862e-4869aa004431 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:40.410850 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d697ec53-6793-4c34-862e-4869aa004431 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1489 microversion: 2.1 time: 0.492612 Oct 04 21:27:40.411837 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2199/4408] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:39 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1489 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:40.436377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-54c1c97d-1d12-41e0-b2f9-ab18b5316922 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:40.437274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-54c1c97d-1d12-41e0-b2f9-ab18b5316922 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:40.445547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54c1c97d-1d12-41e0-b2f9-ab18b5316922 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:40.447393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54c1c97d-1d12-41e0-b2f9-ab18b5316922 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:40.448361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54c1c97d-1d12-41e0-b2f9-ab18b5316922 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:40.449537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54c1c97d-1d12-41e0-b2f9-ab18b5316922 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:40.450229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54c1c97d-1d12-41e0-b2f9-ab18b5316922 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:40.451343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54c1c97d-1d12-41e0-b2f9-ab18b5316922 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:40.515877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-54c1c97d-1d12-41e0-b2f9-ab18b5316922 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:27:40.667541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b688669c-468d-409c-8f5c-524eb2bf41e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:40.672504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b688669c-468d-409c-8f5c-524eb2bf41e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:40.695114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b688669c-468d-409c-8f5c-524eb2bf41e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:40.696049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b688669c-468d-409c-8f5c-524eb2bf41e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:40.700330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b688669c-468d-409c-8f5c-524eb2bf41e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:40.701405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b688669c-468d-409c-8f5c-524eb2bf41e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:40.702150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b688669c-468d-409c-8f5c-524eb2bf41e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:40.702938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b688669c-468d-409c-8f5c-524eb2bf41e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:40.736435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:40.828112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b688669c-468d-409c-8f5c-524eb2bf41e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:40.839323 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b688669c-468d-409c-8f5c-524eb2bf41e0 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1608 microversion: 2.1 time: 0.175982 Oct 04 21:27:40.840533 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2200/4409] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:40 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1608 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:40.897274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-65c520da-a3fa-49a0-b6da-4de702a86cc2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:40.898111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-65c520da-a3fa-49a0-b6da-4de702a86cc2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:40.909191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65c520da-a3fa-49a0-b6da-4de702a86cc2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:40.910925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65c520da-a3fa-49a0-b6da-4de702a86cc2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:40.912560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65c520da-a3fa-49a0-b6da-4de702a86cc2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:40.916041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65c520da-a3fa-49a0-b6da-4de702a86cc2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:40.917633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65c520da-a3fa-49a0-b6da-4de702a86cc2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:40.922349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65c520da-a3fa-49a0-b6da-4de702a86cc2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:41.017520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:41.036385 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-54c1c97d-1d12-41e0-b2f9-ab18b5316922 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 204 len: 0 microversion: 2.1 time: 0.605015 Oct 04 21:27:41.037840 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2210/4410] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:27:40 2022] DELETE /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 0 bytes in 608 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:27:41.053906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-97d52c31-44df-488f-8424-dfc99ac227fd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:41.055356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-97d52c31-44df-488f-8424-dfc99ac227fd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:41.072438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:41.073973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97d52c31-44df-488f-8424-dfc99ac227fd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:41.074472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97d52c31-44df-488f-8424-dfc99ac227fd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:41.074917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97d52c31-44df-488f-8424-dfc99ac227fd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:41.077689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97d52c31-44df-488f-8424-dfc99ac227fd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:41.078202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97d52c31-44df-488f-8424-dfc99ac227fd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:41.085470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97d52c31-44df-488f-8424-dfc99ac227fd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:41.229500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-65c520da-a3fa-49a0-b6da-4de702a86cc2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:41.268864 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-65c520da-a3fa-49a0-b6da-4de702a86cc2 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1318 microversion: 2.1 time: 0.374377 Oct 04 21:27:41.273136 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2201/4411] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:40 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:41.332167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fc459d66-a47f-4140-a0f3-c70137b0a3fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:41.333697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fc459d66-a47f-4140-a0f3-c70137b0a3fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:41.344575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc459d66-a47f-4140-a0f3-c70137b0a3fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:41.348531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc459d66-a47f-4140-a0f3-c70137b0a3fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:41.355742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-97d52c31-44df-488f-8424-dfc99ac227fd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:41.359407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc459d66-a47f-4140-a0f3-c70137b0a3fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:41.360204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc459d66-a47f-4140-a0f3-c70137b0a3fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:41.360688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc459d66-a47f-4140-a0f3-c70137b0a3fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:41.361122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc459d66-a47f-4140-a0f3-c70137b0a3fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:41.367191 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-97d52c31-44df-488f-8424-dfc99ac227fd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1495 microversion: 2.1 time: 0.318260 Oct 04 21:27:41.381120 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2211/4412] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:41 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1495 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:41.419177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-4aac8e86-5504-40cf-81aa-1967d2cfa824 req-3bd9df7c-acb6-47a5-9a4c-b0e9c3a7ccf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba61f85c-a75d-451d-a5f7-f9533481c406", "name": "network-vif-deleted", "tag": "34504880-4c91-4512-980a-45596f508743"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:41.461481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4aac8e86-5504-40cf-81aa-1967d2cfa824 req-3bd9df7c-acb6-47a5-9a4c-b0e9c3a7ccf8 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:41.461992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4aac8e86-5504-40cf-81aa-1967d2cfa824 req-3bd9df7c-acb6-47a5-9a4c-b0e9c3a7ccf8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:41.462540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4aac8e86-5504-40cf-81aa-1967d2cfa824 req-3bd9df7c-acb6-47a5-9a4c-b0e9c3a7ccf8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:41.498928 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-4aac8e86-5504-40cf-81aa-1967d2cfa824 req-3bd9df7c-acb6-47a5-9a4c-b0e9c3a7ccf8 service nova] Creating event network-vif-deleted:34504880-4c91-4512-980a-45596f508743 for instance ba61f85c-a75d-451d-a5f7-f9533481c406 on n-h2-860282-1 Oct 04 21:27:41.512054 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-4aac8e86-5504-40cf-81aa-1967d2cfa824 req-3bd9df7c-acb6-47a5-9a4c-b0e9c3a7ccf8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111882 Oct 04 21:27:41.517567 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2212/4413] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:41.618676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fc459d66-a47f-4140-a0f3-c70137b0a3fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:41.627968 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fc459d66-a47f-4140-a0f3-c70137b0a3fd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 200 len: 1317 microversion: 2.1 time: 0.301433 Oct 04 21:27:41.630385 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2202/4414] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:41 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:41.682878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-ee53dd0e-7829-44f7-8e6a-8474fac2c83c req-832926e0-38b2-41dd-992c-5dcf13dd594b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08c87b8-0afc-4878-a793-35f36d4a8f95", "name": "network-vif-plugged", "status": "completed", "tag": "c0c382b1-3df9-4830-86eb-c2c4030f517f"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:41.697255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ee53dd0e-7829-44f7-8e6a-8474fac2c83c req-832926e0-38b2-41dd-992c-5dcf13dd594b service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:41.698228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ee53dd0e-7829-44f7-8e6a-8474fac2c83c req-832926e0-38b2-41dd-992c-5dcf13dd594b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:41.698990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ee53dd0e-7829-44f7-8e6a-8474fac2c83c req-832926e0-38b2-41dd-992c-5dcf13dd594b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:41.719973 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-ee53dd0e-7829-44f7-8e6a-8474fac2c83c req-832926e0-38b2-41dd-992c-5dcf13dd594b service nova] Creating event network-vif-plugged:c0c382b1-3df9-4830-86eb-c2c4030f517f for instance e08c87b8-0afc-4878-a793-35f36d4a8f95 on n-h1-860282-1 Oct 04 21:27:41.731466 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-ee53dd0e-7829-44f7-8e6a-8474fac2c83c req-832926e0-38b2-41dd-992c-5dcf13dd594b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054578 Oct 04 21:27:41.732388 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2213/4415] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:41.864707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-710ecf49-3874-422f-a07c-57d40266dfc4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:41.865329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-710ecf49-3874-422f-a07c-57d40266dfc4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:41.877802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-710ecf49-3874-422f-a07c-57d40266dfc4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:41.877802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-710ecf49-3874-422f-a07c-57d40266dfc4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:41.877802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-710ecf49-3874-422f-a07c-57d40266dfc4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:41.879160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-710ecf49-3874-422f-a07c-57d40266dfc4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:41.879823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-710ecf49-3874-422f-a07c-57d40266dfc4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:41.880437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-710ecf49-3874-422f-a07c-57d40266dfc4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:41.929437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-710ecf49-3874-422f-a07c-57d40266dfc4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:41.930660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-710ecf49-3874-422f-a07c-57d40266dfc4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:41.931403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-710ecf49-3874-422f-a07c-57d40266dfc4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:41.932339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-710ecf49-3874-422f-a07c-57d40266dfc4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lazy-loading 'fault' on Instance uuid ba61f85c-a75d-451d-a5f7-f9533481c406 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:27:42.015895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-710ecf49-3874-422f-a07c-57d40266dfc4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:42.027054 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-710ecf49-3874-422f-a07c-57d40266dfc4 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1329 microversion: 2.1 time: 0.166760 Oct 04 21:27:42.031219 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2203/4416] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:41 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1329 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:42.297695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=10 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:42.306450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0f58800a-3ae8-4177-8ba7-4d52ccd6b226 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:42.307059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0f58800a-3ae8-4177-8ba7-4d52ccd6b226 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:42.325096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f58800a-3ae8-4177-8ba7-4d52ccd6b226 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:42.325615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f58800a-3ae8-4177-8ba7-4d52ccd6b226 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:42.327507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f58800a-3ae8-4177-8ba7-4d52ccd6b226 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:42.328390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f58800a-3ae8-4177-8ba7-4d52ccd6b226 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:42.331291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f58800a-3ae8-4177-8ba7-4d52ccd6b226 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:42.332409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f58800a-3ae8-4177-8ba7-4d52ccd6b226 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:42.676792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d3ffe15c-b2fa-4fc5-9dfc-b62643a6a9cd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:42.677620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d3ffe15c-b2fa-4fc5-9dfc-b62643a6a9cd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:42.695969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3ffe15c-b2fa-4fc5-9dfc-b62643a6a9cd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:42.696798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3ffe15c-b2fa-4fc5-9dfc-b62643a6a9cd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:42.697259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3ffe15c-b2fa-4fc5-9dfc-b62643a6a9cd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:42.702355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3ffe15c-b2fa-4fc5-9dfc-b62643a6a9cd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:42.702355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3ffe15c-b2fa-4fc5-9dfc-b62643a6a9cd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:42.702355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3ffe15c-b2fa-4fc5-9dfc-b62643a6a9cd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:42.755393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0f58800a-3ae8-4177-8ba7-4d52ccd6b226 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:42.771256 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0f58800a-3ae8-4177-8ba7-4d52ccd6b226 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1318 microversion: 2.1 time: 0.474847 Oct 04 21:27:42.772558 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2214/4417] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:42 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1318 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:42.790623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2f36acdd-a092-486b-ac49-fee3ba3c9ba0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:42.790623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2f36acdd-a092-486b-ac49-fee3ba3c9ba0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:42.794429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f36acdd-a092-486b-ac49-fee3ba3c9ba0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:42.795118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f36acdd-a092-486b-ac49-fee3ba3c9ba0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:42.795844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f36acdd-a092-486b-ac49-fee3ba3c9ba0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:42.796704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f36acdd-a092-486b-ac49-fee3ba3c9ba0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:42.797311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f36acdd-a092-486b-ac49-fee3ba3c9ba0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:42.797909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f36acdd-a092-486b-ac49-fee3ba3c9ba0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:43.031374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d3ffe15c-b2fa-4fc5-9dfc-b62643a6a9cd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:43.040590 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d3ffe15c-b2fa-4fc5-9dfc-b62643a6a9cd tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1495 microversion: 2.1 time: 0.649481 Oct 04 21:27:43.045639 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2204/4418] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:42 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1495 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:43.056618 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2f36acdd-a092-486b-ac49-fee3ba3c9ba0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:43.057507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-29b04780-e9b7-4ff8-8c51-d325a9c7f63c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:43.059875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-29b04780-e9b7-4ff8-8c51-d325a9c7f63c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:43.066982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29b04780-e9b7-4ff8-8c51-d325a9c7f63c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:43.067648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29b04780-e9b7-4ff8-8c51-d325a9c7f63c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:43.068094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29b04780-e9b7-4ff8-8c51-d325a9c7f63c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:43.068820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29b04780-e9b7-4ff8-8c51-d325a9c7f63c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:43.069282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29b04780-e9b7-4ff8-8c51-d325a9c7f63c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:43.069965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29b04780-e9b7-4ff8-8c51-d325a9c7f63c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:43.074686 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2f36acdd-a092-486b-ac49-fee3ba3c9ba0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 200 len: 1317 microversion: 2.1 time: 0.299854 Oct 04 21:27:43.074686 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2215/4419] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:42 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:43.079566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1317f19c-99c9-4789-b29e-8906b450d395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:43.080417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1317f19c-99c9-4789-b29e-8906b450d395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:43.087071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1317f19c-99c9-4789-b29e-8906b450d395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:43.087821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1317f19c-99c9-4789-b29e-8906b450d395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:43.088474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1317f19c-99c9-4789-b29e-8906b450d395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:43.089391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1317f19c-99c9-4789-b29e-8906b450d395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:43.090033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1317f19c-99c9-4789-b29e-8906b450d395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:43.090630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1317f19c-99c9-4789-b29e-8906b450d395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:43.165047 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-29b04780-e9b7-4ff8-8c51-d325a9c7f63c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "POST /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37/action" status: 200 len: 24565 microversion: 2.1 time: 0.117995 Oct 04 21:27:43.168298 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2205/4420] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:27:43 2022] POST /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37/action => generated 24565 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:27:43.194716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1317f19c-99c9-4789-b29e-8906b450d395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:43.195464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1317f19c-99c9-4789-b29e-8906b450d395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:43.195918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1317f19c-99c9-4789-b29e-8906b450d395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:43.196387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-1317f19c-99c9-4789-b29e-8906b450d395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lazy-loading 'fault' on Instance uuid ba61f85c-a75d-451d-a5f7-f9533481c406 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:27:43.318908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1317f19c-99c9-4789-b29e-8906b450d395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef7d2991dce46278486e0ee963d4cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f62474e9d474aa28ac754b712e68652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:43.330597 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1317f19c-99c9-4789-b29e-8906b450d395 tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 200 len: 1329 microversion: 2.1 time: 0.254545 Oct 04 21:27:43.334949 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2216/4421] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:43 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 1329 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:43.808253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ad7e714e-8951-4701-9cfc-ee729acbc27f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:43.809395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ad7e714e-8951-4701-9cfc-ee729acbc27f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:43.823822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad7e714e-8951-4701-9cfc-ee729acbc27f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:43.824603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad7e714e-8951-4701-9cfc-ee729acbc27f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:43.828340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad7e714e-8951-4701-9cfc-ee729acbc27f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:43.828340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad7e714e-8951-4701-9cfc-ee729acbc27f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:43.828340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad7e714e-8951-4701-9cfc-ee729acbc27f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:43.828340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad7e714e-8951-4701-9cfc-ee729acbc27f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:44.071627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8101aba8-c41b-43f2-b6a3-058ecd4b8a47 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:44.072281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8101aba8-c41b-43f2-b6a3-058ecd4b8a47 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:44.086342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8101aba8-c41b-43f2-b6a3-058ecd4b8a47 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:44.089739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8101aba8-c41b-43f2-b6a3-058ecd4b8a47 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:44.090856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8101aba8-c41b-43f2-b6a3-058ecd4b8a47 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:44.093327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8101aba8-c41b-43f2-b6a3-058ecd4b8a47 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:44.096032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8101aba8-c41b-43f2-b6a3-058ecd4b8a47 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:44.099605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8101aba8-c41b-43f2-b6a3-058ecd4b8a47 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:44.532622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ad7e714e-8951-4701-9cfc-ee729acbc27f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:44.545341 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ad7e714e-8951-4701-9cfc-ee729acbc27f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1318 microversion: 2.1 time: 0.741664 Oct 04 21:27:44.547177 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2206/4422] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:43 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1318 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:44.554097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-799df106-72a0-4e80-ba93-e7dee75d0daa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:44.554956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-799df106-72a0-4e80-ba93-e7dee75d0daa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:44.564793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8101aba8-c41b-43f2-b6a3-058ecd4b8a47 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:44.595211 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8101aba8-c41b-43f2-b6a3-058ecd4b8a47 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1495 microversion: 2.1 time: 0.513002 Oct 04 21:27:44.595211 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2217/4423] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:44 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1495 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:44.595388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-799df106-72a0-4e80-ba93-e7dee75d0daa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:44.595388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-799df106-72a0-4e80-ba93-e7dee75d0daa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:44.595388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-799df106-72a0-4e80-ba93-e7dee75d0daa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:44.595388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-799df106-72a0-4e80-ba93-e7dee75d0daa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:44.595388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-799df106-72a0-4e80-ba93-e7dee75d0daa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:44.595388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-799df106-72a0-4e80-ba93-e7dee75d0daa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:44.595834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-39521398-c4ec-4272-988a-8958d90c644f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:44.595834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-39521398-c4ec-4272-988a-8958d90c644f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] [instance: ba61f85c-a75d-451d-a5f7-f9533481c406] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:44.603844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39521398-c4ec-4272-988a-8958d90c644f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:44.604797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39521398-c4ec-4272-988a-8958d90c644f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:44.605506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39521398-c4ec-4272-988a-8958d90c644f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:44.606603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39521398-c4ec-4272-988a-8958d90c644f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:44.607296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39521398-c4ec-4272-988a-8958d90c644f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:44.609473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39521398-c4ec-4272-988a-8958d90c644f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:44.626734 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-39521398-c4ec-4272-988a-8958d90c644f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] HTTP exception thrown: Instance ba61f85c-a75d-451d-a5f7-f9533481c406 could not be found. Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-39521398-c4ec-4272-988a-8958d90c644f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Request method failure captured: Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 HTTP/1.1 Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKMORPit0hTQrPIMzQtQx_UmCBmT5FIo7pDLWqLy5SiNGFiWYKdJzMYINV4AgM5hptJ-4S4yFMnq28D6VhWfZFl9iSPJwvrGQdWsUeuCxZhwibZPh1On3zv9TchRvE7UeNSX7_oKGHxGg-1hbqm1TznUUveZZBszMGCIz2Qsg_TKTD0 Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 0f62474e9d474aa28ac754b712e68652 Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerActionsTestJSON-1285044131 Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f62474e9d474aa28ac754b712e68652"}]}, {"type": "tempest-type-992649439", "name": "tempest-service-540783405", "endpoints": [{"region": "tempest-region-1225708338", "internalURL": "https://url-63677349.com"}]}, {"type": "tempest-type-1238556208", "name": "tempest-service-722626554", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0f62474e9d474aa28ac754b712e68652"}]}, {"type": "tempest-type-625574546", "name": "tempest-service-447491652", "endpoints": [{"region": "tempest-region-391707900", "publicURL": "https://url-992999868.com"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0f62474e9d474aa28ac754b712e68652"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f62474e9d474aa28ac754b712e68652"}]}] Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerActionsTestJSON-1285044131 Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 0f62474e9d474aa28ac754b712e68652 Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerActionsTestJSON-1285044131 Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerActionsTestJSON-1285044131-project Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 8ef7d2991dce46278486e0ee963d4cf3 Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerActionsTestJSON-1285044131-project Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance ba61f85c-a75d-451d-a5f7-f9533481c406 could not be found. Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'ba61f85c-a75d-451d-a5f7-f9533481c406'} Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba61f85c-a75d-451d-a5f7-f9533481c406 could not be found. Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:27:44.629166 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:27:44.632991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:27:44.632991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba61f85c-a75d-451d-a5f7-f9533481c406 could not be found. Oct 04 21:27:44.632991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:44.632991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:44.632991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:44.632991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:44.632991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:44.632991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:44.632991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:27:44.632991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:27:44.632991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba61f85c-a75d-451d-a5f7-f9533481c406 could not be found. Oct 04 21:27:44.632991 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:44.637612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-39521398-c4ec-4272-988a-8958d90c644f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Returning 404 to user: Instance ba61f85c-a75d-451d-a5f7-f9533481c406 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:44.650790 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-39521398-c4ec-4272-988a-8958d90c644f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406" status: 404 len: 111 microversion: 2.1 time: 0.067231 Oct 04 21:27:44.655284 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2218/4424] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:44 2022] GET /compute/v2.1/servers/ba61f85c-a75d-451d-a5f7-f9533481c406 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:27:44.662436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-d07bad41-df4e-4d55-afbc-ca627c3ea7e7 req-4bdefb34-4d1c-4113-b4e8-8680c92baf19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fd7fe3-c8fd-446d-b1a7-41e34a12159c", "name": "network-vif-deleted", "tag": "2103b760-e65f-45c3-84a6-ec2f94579876"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:44.694775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d07bad41-df4e-4d55-afbc-ca627c3ea7e7 req-4bdefb34-4d1c-4113-b4e8-8680c92baf19 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:44.695616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d07bad41-df4e-4d55-afbc-ca627c3ea7e7 req-4bdefb34-4d1c-4113-b4e8-8680c92baf19 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:44.696275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d07bad41-df4e-4d55-afbc-ca627c3ea7e7 req-4bdefb34-4d1c-4113-b4e8-8680c92baf19 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:44.712190 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-d07bad41-df4e-4d55-afbc-ca627c3ea7e7 req-4bdefb34-4d1c-4113-b4e8-8680c92baf19 service nova] Creating event network-vif-deleted:2103b760-e65f-45c3-84a6-ec2f94579876 for instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c on n-h2-860282-1 Oct 04 21:27:44.719016 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-d07bad41-df4e-4d55-afbc-ca627c3ea7e7 req-4bdefb34-4d1c-4113-b4e8-8680c92baf19 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061510 Oct 04 21:27:44.720438 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2219/4425] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:44.726966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fc6145f8-e922-4a00-a2c1-b69431f5f06f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] Calling method '.version_select at 0x7f578b9c4f70>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:44.880710 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fc6145f8-e922-4a00-a2c1-b69431f5f06f tempest-ServerActionsTestJSON-1285044131 tempest-ServerActionsTestJSON-1285044131-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626876242" status: 202 len: 0 microversion: 2.1 time: 0.158349 Oct 04 21:27:44.884745 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2220/4426] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Oct 4 21:27:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626876242 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:27:44.897884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-799df106-72a0-4e80-ba93-e7dee75d0daa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:44.908820 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-799df106-72a0-4e80-ba93-e7dee75d0daa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 200 len: 1317 microversion: 2.1 time: 0.360445 Oct 04 21:27:44.913742 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2207/4427] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:44 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:45.572431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e216323a-8d49-4324-a33b-d174907e3f8e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:45.573155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e216323a-8d49-4324-a33b-d174907e3f8e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:45.586791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e216323a-8d49-4324-a33b-d174907e3f8e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:45.587569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e216323a-8d49-4324-a33b-d174907e3f8e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:45.588189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e216323a-8d49-4324-a33b-d174907e3f8e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:45.589096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e216323a-8d49-4324-a33b-d174907e3f8e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:45.589750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e216323a-8d49-4324-a33b-d174907e3f8e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:45.590349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e216323a-8d49-4324-a33b-d174907e3f8e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:45.624289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-038aa2a0-e173-4eb0-b8ff-9adfeba931bc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:45.625845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-038aa2a0-e173-4eb0-b8ff-9adfeba931bc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:45.655532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-038aa2a0-e173-4eb0-b8ff-9adfeba931bc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:45.656745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-038aa2a0-e173-4eb0-b8ff-9adfeba931bc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:45.657399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-038aa2a0-e173-4eb0-b8ff-9adfeba931bc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:45.658698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-038aa2a0-e173-4eb0-b8ff-9adfeba931bc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:45.659778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-038aa2a0-e173-4eb0-b8ff-9adfeba931bc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:45.660809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-038aa2a0-e173-4eb0-b8ff-9adfeba931bc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:45.727282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-038aa2a0-e173-4eb0-b8ff-9adfeba931bc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:45.728392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-038aa2a0-e173-4eb0-b8ff-9adfeba931bc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:45.729150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-038aa2a0-e173-4eb0-b8ff-9adfeba931bc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:45.729822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-038aa2a0-e173-4eb0-b8ff-9adfeba931bc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lazy-loading 'fault' on Instance uuid e7fd7fe3-c8fd-446d-b1a7-41e34a12159c {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:27:45.735875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:45.811229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-038aa2a0-e173-4eb0-b8ff-9adfeba931bc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:45.825264 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-038aa2a0-e173-4eb0-b8ff-9adfeba931bc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 200 len: 1305 microversion: 2.1 time: 0.211895 Oct 04 21:27:45.825904 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2208/4428] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:45 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 1305 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:45.937448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fba96ee3-91ab-46a0-899b-720d1014adcf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:45.938467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fba96ee3-91ab-46a0-899b-720d1014adcf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:45.950457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fba96ee3-91ab-46a0-899b-720d1014adcf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:45.951696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fba96ee3-91ab-46a0-899b-720d1014adcf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:45.952338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fba96ee3-91ab-46a0-899b-720d1014adcf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:45.953384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fba96ee3-91ab-46a0-899b-720d1014adcf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:45.954074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fba96ee3-91ab-46a0-899b-720d1014adcf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:45.954706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fba96ee3-91ab-46a0-899b-720d1014adcf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:45.988457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e216323a-8d49-4324-a33b-d174907e3f8e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:46.016278 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e216323a-8d49-4324-a33b-d174907e3f8e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1508 microversion: 2.1 time: 0.447829 Oct 04 21:27:46.043066 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2221/4429] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:45 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1508 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:46.055522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b170a6e6-20bf-4951-86ad-339d5ed791a9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:46.056158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b170a6e6-20bf-4951-86ad-339d5ed791a9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:46.081929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b170a6e6-20bf-4951-86ad-339d5ed791a9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:46.082607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b170a6e6-20bf-4951-86ad-339d5ed791a9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:46.083140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b170a6e6-20bf-4951-86ad-339d5ed791a9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:46.091435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b170a6e6-20bf-4951-86ad-339d5ed791a9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:46.091970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b170a6e6-20bf-4951-86ad-339d5ed791a9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:46.092430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b170a6e6-20bf-4951-86ad-339d5ed791a9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:46.396983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fba96ee3-91ab-46a0-899b-720d1014adcf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:46.411740 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fba96ee3-91ab-46a0-899b-720d1014adcf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 200 len: 1317 microversion: 2.1 time: 0.479683 Oct 04 21:27:46.448316 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2209/4430] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:45 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 1317 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:46.486133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b170a6e6-20bf-4951-86ad-339d5ed791a9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:46.496511 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b170a6e6-20bf-4951-86ad-339d5ed791a9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1508 microversion: 2.1 time: 0.447727 Oct 04 21:27:46.497563 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2222/4431] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:46 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1508 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:46.525410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-db2af2d9-8bc5-43f1-aec3-c918dd09499f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:46.528109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-db2af2d9-8bc5-43f1-aec3-c918dd09499f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:46.535931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db2af2d9-8bc5-43f1-aec3-c918dd09499f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:46.536895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db2af2d9-8bc5-43f1-aec3-c918dd09499f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:46.537604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db2af2d9-8bc5-43f1-aec3-c918dd09499f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:46.539484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db2af2d9-8bc5-43f1-aec3-c918dd09499f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:46.540561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db2af2d9-8bc5-43f1-aec3-c918dd09499f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:46.541625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db2af2d9-8bc5-43f1-aec3-c918dd09499f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:46.793365 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-db2af2d9-8bc5-43f1-aec3-c918dd09499f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "PUT /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1080 microversion: 2.1 time: 0.274209 Oct 04 21:27:46.801831 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2210/4432] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Oct 4 21:27:46 2022] PUT /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1080 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:46.814856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-54617a29-cbf4-4851-979b-4e1b7c430908 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:46.815473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-54617a29-cbf4-4851-979b-4e1b7c430908 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:46.823062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54617a29-cbf4-4851-979b-4e1b7c430908 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:46.830418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54617a29-cbf4-4851-979b-4e1b7c430908 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:46.830418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54617a29-cbf4-4851-979b-4e1b7c430908 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:46.830418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54617a29-cbf4-4851-979b-4e1b7c430908 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:46.830418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54617a29-cbf4-4851-979b-4e1b7c430908 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:46.830418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54617a29-cbf4-4851-979b-4e1b7c430908 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:46.852376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e6dab1f9-35a5-4dc9-a691-14bd5006c997 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:46.853535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e6dab1f9-35a5-4dc9-a691-14bd5006c997 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:46.868364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6dab1f9-35a5-4dc9-a691-14bd5006c997 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:46.870974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6dab1f9-35a5-4dc9-a691-14bd5006c997 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:46.871787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6dab1f9-35a5-4dc9-a691-14bd5006c997 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:46.876791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6dab1f9-35a5-4dc9-a691-14bd5006c997 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:46.887591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6dab1f9-35a5-4dc9-a691-14bd5006c997 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:46.888751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6dab1f9-35a5-4dc9-a691-14bd5006c997 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:46.936217 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-e6dab1f9-35a5-4dc9-a691-14bd5006c997 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c could not be found. Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e6dab1f9-35a5-4dc9-a691-14bd5006c997 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c HTTP/1.1 Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c could not be found. Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'e7fd7fe3-c8fd-446d-b1a7-41e34a12159c'} Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c could not be found. Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c could not be found. Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:46.940169 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:46.945071 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:46.945071 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:46.945071 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:46.945071 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:27:46.945071 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:27:46.945071 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c could not be found. Oct 04 21:27:46.945071 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:46.945071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e6dab1f9-35a5-4dc9-a691-14bd5006c997 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:46.945071 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e6dab1f9-35a5-4dc9-a691-14bd5006c997 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 404 len: 111 microversion: 2.1 time: 0.095518 Oct 04 21:27:46.945071 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2211/4433] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:46 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:27:47.084180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a344306f-fc8b-430b-8f09-a73db76d1a31 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2107675591", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "f54abd1e-a2a0-4f4b-b858-f3831f4d8295"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:47.133551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-54617a29-cbf4-4851-979b-4e1b7c430908 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:47.143776 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-54617a29-cbf4-4851-979b-4e1b7c430908 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1506 microversion: 2.1 time: 0.333006 Oct 04 21:27:47.147370 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2223/4434] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:46 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:47.147541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-a344306f-fc8b-430b-8f09-a73db76d1a31 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] validate_networks() for [('f54abd1e-a2a0-4f4b-b858-f3831f4d8295', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:27:47.173041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b45f03f3-a0c6-47fb-886c-1084079a211f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:47.173982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b45f03f3-a0c6-47fb-886c-1084079a211f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:47.181637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b45f03f3-a0c6-47fb-886c-1084079a211f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:47.182184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b45f03f3-a0c6-47fb-886c-1084079a211f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:47.182563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b45f03f3-a0c6-47fb-886c-1084079a211f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:47.183271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b45f03f3-a0c6-47fb-886c-1084079a211f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:47.193787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b45f03f3-a0c6-47fb-886c-1084079a211f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:47.194448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b45f03f3-a0c6-47fb-886c-1084079a211f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:47.542240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b45f03f3-a0c6-47fb-886c-1084079a211f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:47.554894 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b45f03f3-a0c6-47fb-886c-1084079a211f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1506 microversion: 2.1 time: 0.386000 Oct 04 21:27:47.555495 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2224/4435] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:47 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:47.573784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8a100df5-2a96-41cd-930a-331cb5a79c19 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:47.574685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8a100df5-2a96-41cd-930a-331cb5a79c19 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:47.581454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a100df5-2a96-41cd-930a-331cb5a79c19 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:47.582225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a100df5-2a96-41cd-930a-331cb5a79c19 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:47.582803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a100df5-2a96-41cd-930a-331cb5a79c19 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:47.583652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a100df5-2a96-41cd-930a-331cb5a79c19 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:47.584294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a100df5-2a96-41cd-930a-331cb5a79c19 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:47.584941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a100df5-2a96-41cd-930a-331cb5a79c19 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:47.957689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8a100df5-2a96-41cd-930a-331cb5a79c19 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:47.968053 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8a100df5-2a96-41cd-930a-331cb5a79c19 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 200 len: 1317 microversion: 2.1 time: 0.411508 Oct 04 21:27:47.970318 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2225/4436] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:47 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:47.992655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-e2ef52c4-9bfe-4d31-871d-56d8cfc47054 req-3df0406b-d248-43f3-a541-16712c61ed9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae649a1e-b6ec-4d6c-9584-7738fff25315", "name": "network-vif-plugged", "status": "completed", "tag": "9487709f-e232-4f06-bd45-23384ef95d73"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:48.012867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e2ef52c4-9bfe-4d31-871d-56d8cfc47054 req-3df0406b-d248-43f3-a541-16712c61ed9f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:48.013578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e2ef52c4-9bfe-4d31-871d-56d8cfc47054 req-3df0406b-d248-43f3-a541-16712c61ed9f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:48.014172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e2ef52c4-9bfe-4d31-871d-56d8cfc47054 req-3df0406b-d248-43f3-a541-16712c61ed9f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:48.029615 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-e2ef52c4-9bfe-4d31-871d-56d8cfc47054 req-3df0406b-d248-43f3-a541-16712c61ed9f service nova] Creating event network-vif-plugged:9487709f-e232-4f06-bd45-23384ef95d73 for instance ae649a1e-b6ec-4d6c-9584-7738fff25315 on n-h1-860282-1 Oct 04 21:27:48.044762 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-e2ef52c4-9bfe-4d31-871d-56d8cfc47054 req-3df0406b-d248-43f3-a541-16712c61ed9f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067416 Oct 04 21:27:48.051539 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2226/4437] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:48.085599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e909e7d0-9174-4bea-8bf2-8a65767a095a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:48.101492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e909e7d0-9174-4bea-8bf2-8a65767a095a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:48.115795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e909e7d0-9174-4bea-8bf2-8a65767a095a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:48.116889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e909e7d0-9174-4bea-8bf2-8a65767a095a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:48.117354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e909e7d0-9174-4bea-8bf2-8a65767a095a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:48.118309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e909e7d0-9174-4bea-8bf2-8a65767a095a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:48.118771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e909e7d0-9174-4bea-8bf2-8a65767a095a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:48.119334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e909e7d0-9174-4bea-8bf2-8a65767a095a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:48.163181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:48.280631 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e909e7d0-9174-4bea-8bf2-8a65767a095a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "PUT /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1082 microversion: 2.1 time: 0.225123 Oct 04 21:27:48.281927 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2227/4438] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Oct 4 21:27:48 2022] PUT /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1082 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:48.304734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1f376a2c-4e9b-4f4d-aaca-75d70b791607 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:48.305658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1f376a2c-4e9b-4f4d-aaca-75d70b791607 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:48.313688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f376a2c-4e9b-4f4d-aaca-75d70b791607 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:48.318281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f376a2c-4e9b-4f4d-aaca-75d70b791607 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:48.318924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f376a2c-4e9b-4f4d-aaca-75d70b791607 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:48.320946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f376a2c-4e9b-4f4d-aaca-75d70b791607 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:48.323078 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f376a2c-4e9b-4f4d-aaca-75d70b791607 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:48.323686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f376a2c-4e9b-4f4d-aaca-75d70b791607 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:48.474974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a344306f-fc8b-430b-8f09-a73db76d1a31 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:27:48.476327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a344306f-fc8b-430b-8f09-a73db76d1a31 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:27:48.477114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a344306f-fc8b-430b-8f09-a73db76d1a31 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:27:48.477642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a344306f-fc8b-430b-8f09-a73db76d1a31 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:27:48.478068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a344306f-fc8b-430b-8f09-a73db76d1a31 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:27:48.504100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a344306f-fc8b-430b-8f09-a73db76d1a31 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:48.504602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a344306f-fc8b-430b-8f09-a73db76d1a31 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:48.505046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a344306f-fc8b-430b-8f09-a73db76d1a31 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:48.505811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a344306f-fc8b-430b-8f09-a73db76d1a31 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:48.506485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a344306f-fc8b-430b-8f09-a73db76d1a31 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:48.507137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a344306f-fc8b-430b-8f09-a73db76d1a31 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:48.527544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-a344306f-fc8b-430b-8f09-a73db76d1a31 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Getting quotas for project 68c56e6603d14d9b8ad9c74a9df021c9. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:27:48.533525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-a344306f-fc8b-430b-8f09-a73db76d1a31 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Getting quotas for user 416e0c617ee34a19a7d6936b78c1d94d and project 68c56e6603d14d9b8ad9c74a9df021c9. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:27:48.549163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a344306f-fc8b-430b-8f09-a73db76d1a31 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:27:48.558329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a344306f-fc8b-430b-8f09-a73db76d1a31 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:27:48.660144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1f376a2c-4e9b-4f4d-aaca-75d70b791607 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:48.668227 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1f376a2c-4e9b-4f4d-aaca-75d70b791607 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1508 microversion: 2.1 time: 0.369304 Oct 04 21:27:48.668838 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2228/4439] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:48 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1508 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:48.691724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2c86fd62-a950-4f7f-af7b-8cf056e206e9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:48.692643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2c86fd62-a950-4f7f-af7b-8cf056e206e9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:48.698734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c86fd62-a950-4f7f-af7b-8cf056e206e9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:48.699228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c86fd62-a950-4f7f-af7b-8cf056e206e9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:48.699697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c86fd62-a950-4f7f-af7b-8cf056e206e9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:48.700403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c86fd62-a950-4f7f-af7b-8cf056e206e9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:48.700868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c86fd62-a950-4f7f-af7b-8cf056e206e9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:48.701325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c86fd62-a950-4f7f-af7b-8cf056e206e9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:48.777645 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a344306f-fc8b-430b-8f09-a73db76d1a31 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.698193 Oct 04 21:27:48.781075 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2212/4440] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:27:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:27:48.809808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e2fd42e3-970a-43b5-89d9-1c76aabefca9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:48.811901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e2fd42e3-970a-43b5-89d9-1c76aabefca9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:48.978825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e2fd42e3-970a-43b5-89d9-1c76aabefca9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:48.992799 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e2fd42e3-970a-43b5-89d9-1c76aabefca9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1215 microversion: 2.1 time: 0.205701 Oct 04 21:27:49.001858 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2213/4441] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:48 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1215 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:49.025159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f1d81cc1-2a21-4e01-85ed-595ea87dc4ef tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:49.025818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f1d81cc1-2a21-4e01-85ed-595ea87dc4ef tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:49.034087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1d81cc1-2a21-4e01-85ed-595ea87dc4ef tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:49.035178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1d81cc1-2a21-4e01-85ed-595ea87dc4ef tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:49.035948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1d81cc1-2a21-4e01-85ed-595ea87dc4ef tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:49.036737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1d81cc1-2a21-4e01-85ed-595ea87dc4ef tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:49.037213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1d81cc1-2a21-4e01-85ed-595ea87dc4ef tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:49.037683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1d81cc1-2a21-4e01-85ed-595ea87dc4ef tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:49.052664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2c86fd62-a950-4f7f-af7b-8cf056e206e9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:49.069078 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2c86fd62-a950-4f7f-af7b-8cf056e206e9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1508 microversion: 2.1 time: 0.378198 Oct 04 21:27:49.070099 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2229/4442] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:48 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1508 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:49.098188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0d6ffa94-a84d-45d1-b506-27308d334919 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:49.102523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0d6ffa94-a84d-45d1-b506-27308d334919 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:49.109176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d6ffa94-a84d-45d1-b506-27308d334919 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:49.110225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d6ffa94-a84d-45d1-b506-27308d334919 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:49.110885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d6ffa94-a84d-45d1-b506-27308d334919 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:49.112373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d6ffa94-a84d-45d1-b506-27308d334919 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:49.113828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d6ffa94-a84d-45d1-b506-27308d334919 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:49.114536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d6ffa94-a84d-45d1-b506-27308d334919 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:49.150129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0d6ffa94-a84d-45d1-b506-27308d334919 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:27:49.398123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f1d81cc1-2a21-4e01-85ed-595ea87dc4ef tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:49.412545 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f1d81cc1-2a21-4e01-85ed-595ea87dc4ef tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 200 len: 1317 microversion: 2.1 time: 0.409468 Oct 04 21:27:49.413455 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2214/4443] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:49 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:49.637517 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0d6ffa94-a84d-45d1-b506-27308d334919 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 204 len: 0 microversion: 2.1 time: 0.543467 Oct 04 21:27:49.638924 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2230/4444] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:27:49 2022] DELETE /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:27:49.658171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-46c11ed3-5633-404f-a5b0-afe21ed15235 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:49.658780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-46c11ed3-5633-404f-a5b0-afe21ed15235 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:49.669183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46c11ed3-5633-404f-a5b0-afe21ed15235 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:49.670511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46c11ed3-5633-404f-a5b0-afe21ed15235 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:49.671259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46c11ed3-5633-404f-a5b0-afe21ed15235 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:49.672211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46c11ed3-5633-404f-a5b0-afe21ed15235 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:49.672959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46c11ed3-5633-404f-a5b0-afe21ed15235 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:49.673631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46c11ed3-5633-404f-a5b0-afe21ed15235 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:49.708946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-46c11ed3-5633-404f-a5b0-afe21ed15235 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:27:49.884072 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.compute.api [None req-46c11ed3-5633-404f-a5b0-afe21ed15235 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Instance is already in deleting state, ignoring this request Oct 04 21:27:49.885801 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-46c11ed3-5633-404f-a5b0-afe21ed15235 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 204 len: 0 microversion: 2.1 time: 0.231613 Oct 04 21:27:49.890247 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2215/4445] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:27:49 2022] DELETE /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:27:49.899516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eb0e0c0c-6f6e-4a04-853c-a70983899069 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:49.901551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eb0e0c0c-6f6e-4a04-853c-a70983899069 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:49.918047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb0e0c0c-6f6e-4a04-853c-a70983899069 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:49.918688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb0e0c0c-6f6e-4a04-853c-a70983899069 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:49.919324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb0e0c0c-6f6e-4a04-853c-a70983899069 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:49.920236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb0e0c0c-6f6e-4a04-853c-a70983899069 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:49.920880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb0e0c0c-6f6e-4a04-853c-a70983899069 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:49.921574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb0e0c0c-6f6e-4a04-853c-a70983899069 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:50.020111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-38846441-f6a7-4e5e-8961-5b2a57d013ab tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:50.020734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-38846441-f6a7-4e5e-8961-5b2a57d013ab tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:50.186193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-38846441-f6a7-4e5e-8961-5b2a57d013ab tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:50.201520 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-38846441-f6a7-4e5e-8961-5b2a57d013ab tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1215 microversion: 2.1 time: 0.187529 Oct 04 21:27:50.202837 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2216/4446] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:50 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1215 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:50.438490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9ea59c10-fcf5-40e4-b162-1b466c2e9a96 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:50.439511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9ea59c10-fcf5-40e4-b162-1b466c2e9a96 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:50.446501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ea59c10-fcf5-40e4-b162-1b466c2e9a96 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:50.447677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ea59c10-fcf5-40e4-b162-1b466c2e9a96 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:50.448527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ea59c10-fcf5-40e4-b162-1b466c2e9a96 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:50.449666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ea59c10-fcf5-40e4-b162-1b466c2e9a96 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:50.451112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ea59c10-fcf5-40e4-b162-1b466c2e9a96 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:50.451720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ea59c10-fcf5-40e4-b162-1b466c2e9a96 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:50.551812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eb0e0c0c-6f6e-4a04-853c-a70983899069 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:50.575038 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eb0e0c0c-6f6e-4a04-853c-a70983899069 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1514 microversion: 2.1 time: 0.681181 Oct 04 21:27:50.575949 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2231/4447] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:49 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1514 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:51.228376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-35d39403-22d7-43d9-9922-ebec8ed3987e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:51.229166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-35d39403-22d7-43d9-9922-ebec8ed3987e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:51.240060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35d39403-22d7-43d9-9922-ebec8ed3987e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:51.242205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35d39403-22d7-43d9-9922-ebec8ed3987e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:51.242664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35d39403-22d7-43d9-9922-ebec8ed3987e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:51.243394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35d39403-22d7-43d9-9922-ebec8ed3987e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:51.243856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35d39403-22d7-43d9-9922-ebec8ed3987e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:51.247948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35d39403-22d7-43d9-9922-ebec8ed3987e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:51.461952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9ea59c10-fcf5-40e4-b162-1b466c2e9a96 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:51.473231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-35d39403-22d7-43d9-9922-ebec8ed3987e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:51.487299 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9ea59c10-fcf5-40e4-b162-1b466c2e9a96 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 200 len: 1317 microversion: 2.1 time: 1.053052 Oct 04 21:27:51.492504 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-35d39403-22d7-43d9-9922-ebec8ed3987e tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1267 microversion: 2.1 time: 0.268513 Oct 04 21:27:51.493551 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2232/4448] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:51 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1267 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:51.494051 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2217/4449] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:50 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 1317 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:51.601584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bfde0703-2dc1-45c5-b7c2-c005f9575a2a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:51.602221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bfde0703-2dc1-45c5-b7c2-c005f9575a2a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:51.609846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfde0703-2dc1-45c5-b7c2-c005f9575a2a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:51.610351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfde0703-2dc1-45c5-b7c2-c005f9575a2a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:51.610796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfde0703-2dc1-45c5-b7c2-c005f9575a2a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:51.611582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfde0703-2dc1-45c5-b7c2-c005f9575a2a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:51.612067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfde0703-2dc1-45c5-b7c2-c005f9575a2a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:51.612713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfde0703-2dc1-45c5-b7c2-c005f9575a2a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:52.082701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bfde0703-2dc1-45c5-b7c2-c005f9575a2a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:52.090896 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bfde0703-2dc1-45c5-b7c2-c005f9575a2a tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1514 microversion: 2.1 time: 0.493413 Oct 04 21:27:52.091771 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2233/4450] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:51 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1514 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:52.529219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d1e3dc1f-29ad-453d-a102-6f9cdbc7ca55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:52.531799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d1e3dc1f-29ad-453d-a102-6f9cdbc7ca55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:52.538040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6913c8e0-47b6-4785-a680-bc4b16f82ce9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:52.538668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6913c8e0-47b6-4785-a680-bc4b16f82ce9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:52.551976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1e3dc1f-29ad-453d-a102-6f9cdbc7ca55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:52.552483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1e3dc1f-29ad-453d-a102-6f9cdbc7ca55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:52.552922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1e3dc1f-29ad-453d-a102-6f9cdbc7ca55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:52.553847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1e3dc1f-29ad-453d-a102-6f9cdbc7ca55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:52.555442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6913c8e0-47b6-4785-a680-bc4b16f82ce9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:52.556036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6913c8e0-47b6-4785-a680-bc4b16f82ce9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:52.556318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1e3dc1f-29ad-453d-a102-6f9cdbc7ca55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:52.556796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6913c8e0-47b6-4785-a680-bc4b16f82ce9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:52.557132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1e3dc1f-29ad-453d-a102-6f9cdbc7ca55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:52.557717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6913c8e0-47b6-4785-a680-bc4b16f82ce9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:52.560773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6913c8e0-47b6-4785-a680-bc4b16f82ce9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:52.561469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6913c8e0-47b6-4785-a680-bc4b16f82ce9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:52.829249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6913c8e0-47b6-4785-a680-bc4b16f82ce9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:52.842819 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6913c8e0-47b6-4785-a680-bc4b16f82ce9 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1273 microversion: 2.1 time: 0.312151 Oct 04 21:27:52.843412 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2234/4451] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:52 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1273 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:52.873732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-e2f0d724-4e2a-4374-80d2-676afa343990 req-d642c9ed-efb2-4ea4-967d-73e24f9cea90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08c87b8-0afc-4878-a793-35f36d4a8f95", "name": "network-vif-deleted", "tag": "c0c382b1-3df9-4830-86eb-c2c4030f517f"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:52.898089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e2f0d724-4e2a-4374-80d2-676afa343990 req-d642c9ed-efb2-4ea4-967d-73e24f9cea90 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:52.898813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e2f0d724-4e2a-4374-80d2-676afa343990 req-d642c9ed-efb2-4ea4-967d-73e24f9cea90 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:52.899417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e2f0d724-4e2a-4374-80d2-676afa343990 req-d642c9ed-efb2-4ea4-967d-73e24f9cea90 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:52.914988 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-e2f0d724-4e2a-4374-80d2-676afa343990 req-d642c9ed-efb2-4ea4-967d-73e24f9cea90 service nova] Creating event network-vif-deleted:c0c382b1-3df9-4830-86eb-c2c4030f517f for instance e08c87b8-0afc-4878-a793-35f36d4a8f95 on n-h1-860282-1 Oct 04 21:27:52.920610 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-e2f0d724-4e2a-4374-80d2-676afa343990 req-d642c9ed-efb2-4ea4-967d-73e24f9cea90 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050579 Oct 04 21:27:52.922437 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2235/4452] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:53.088235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d1e3dc1f-29ad-453d-a102-6f9cdbc7ca55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:53.101905 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d1e3dc1f-29ad-453d-a102-6f9cdbc7ca55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 200 len: 1505 microversion: 2.1 time: 0.577301 Oct 04 21:27:53.115593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cfc383a6-30ec-418d-8dd7-5b0d6125f043 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:53.117354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cfc383a6-30ec-418d-8dd7-5b0d6125f043 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:53.126164 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2218/4453] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:52 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 1505 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:53.139476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cfc383a6-30ec-418d-8dd7-5b0d6125f043 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:53.140994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-621ae0df-5374-4d56-8853-0472ec59cfd0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:53.141680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cfc383a6-30ec-418d-8dd7-5b0d6125f043 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:53.143015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cfc383a6-30ec-418d-8dd7-5b0d6125f043 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:53.143260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-621ae0df-5374-4d56-8853-0472ec59cfd0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:53.155574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cfc383a6-30ec-418d-8dd7-5b0d6125f043 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:53.156370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cfc383a6-30ec-418d-8dd7-5b0d6125f043 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:53.156935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cfc383a6-30ec-418d-8dd7-5b0d6125f043 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:53.158971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-621ae0df-5374-4d56-8853-0472ec59cfd0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:53.159517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-621ae0df-5374-4d56-8853-0472ec59cfd0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:53.159971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-621ae0df-5374-4d56-8853-0472ec59cfd0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:53.160681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-621ae0df-5374-4d56-8853-0472ec59cfd0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:53.161742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-621ae0df-5374-4d56-8853-0472ec59cfd0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:53.162546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-621ae0df-5374-4d56-8853-0472ec59cfd0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:53.210762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-621ae0df-5374-4d56-8853-0472ec59cfd0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:27:53.589826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cfc383a6-30ec-418d-8dd7-5b0d6125f043 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:53.603582 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cfc383a6-30ec-418d-8dd7-5b0d6125f043 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1303 microversion: 2.1 time: 0.492453 Oct 04 21:27:53.605237 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2236/4454] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:53 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1303 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:53.667080 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-621ae0df-5374-4d56-8853-0472ec59cfd0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 204 len: 0 microversion: 2.1 time: 0.538870 Oct 04 21:27:53.668910 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2219/4455] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:27:53 2022] DELETE /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:27:53.679326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f9ca3d1c-a3d4-439f-b2ba-b57e6432b0ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:53.680257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f9ca3d1c-a3d4-439f-b2ba-b57e6432b0ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:53.695597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9ca3d1c-a3d4-439f-b2ba-b57e6432b0ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:53.698189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9ca3d1c-a3d4-439f-b2ba-b57e6432b0ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:53.702114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9ca3d1c-a3d4-439f-b2ba-b57e6432b0ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:53.702114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9ca3d1c-a3d4-439f-b2ba-b57e6432b0ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:53.702114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9ca3d1c-a3d4-439f-b2ba-b57e6432b0ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:53.704297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9ca3d1c-a3d4-439f-b2ba-b57e6432b0ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:53.872028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7021ebf8-145b-4d53-bab0-7880682dd791 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:53.873173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7021ebf8-145b-4d53-bab0-7880682dd791 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:53.886855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7021ebf8-145b-4d53-bab0-7880682dd791 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:53.888440 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7021ebf8-145b-4d53-bab0-7880682dd791 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:53.890001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7021ebf8-145b-4d53-bab0-7880682dd791 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:53.891045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7021ebf8-145b-4d53-bab0-7880682dd791 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:53.891719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7021ebf8-145b-4d53-bab0-7880682dd791 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:53.892782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7021ebf8-145b-4d53-bab0-7880682dd791 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:54.076554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7021ebf8-145b-4d53-bab0-7880682dd791 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:54.116386 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7021ebf8-145b-4d53-bab0-7880682dd791 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1273 microversion: 2.1 time: 0.251274 Oct 04 21:27:54.121730 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2220/4456] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:53 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:54.252911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f9ca3d1c-a3d4-439f-b2ba-b57e6432b0ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:54.272260 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f9ca3d1c-a3d4-439f-b2ba-b57e6432b0ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 200 len: 1511 microversion: 2.1 time: 0.597590 Oct 04 21:27:54.274944 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2237/4457] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:53 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 1511 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:54.629284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bca230e6-f899-4216-b3c3-5b3f3c7dbe84 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:54.630017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bca230e6-f899-4216-b3c3-5b3f3c7dbe84 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:54.639412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bca230e6-f899-4216-b3c3-5b3f3c7dbe84 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:54.639925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bca230e6-f899-4216-b3c3-5b3f3c7dbe84 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:54.640373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bca230e6-f899-4216-b3c3-5b3f3c7dbe84 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:54.641097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bca230e6-f899-4216-b3c3-5b3f3c7dbe84 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:54.641615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bca230e6-f899-4216-b3c3-5b3f3c7dbe84 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:54.642047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bca230e6-f899-4216-b3c3-5b3f3c7dbe84 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:54.698271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bca230e6-f899-4216-b3c3-5b3f3c7dbe84 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:54.699780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bca230e6-f899-4216-b3c3-5b3f3c7dbe84 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:54.700781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bca230e6-f899-4216-b3c3-5b3f3c7dbe84 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:54.701888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-bca230e6-f899-4216-b3c3-5b3f3c7dbe84 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lazy-loading 'fault' on Instance uuid e08c87b8-0afc-4878-a793-35f36d4a8f95 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:27:54.812297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bca230e6-f899-4216-b3c3-5b3f3c7dbe84 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bb2f7ed99411eb8b6231d64179485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006ee9cd0424160a0e042de4c653358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:54.825457 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bca230e6-f899-4216-b3c3-5b3f3c7dbe84 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 200 len: 1308 microversion: 2.1 time: 0.200999 Oct 04 21:27:54.829227 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2221/4458] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:54 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 1308 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:55.141833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-78d1d8da-a6fc-4433-944d-987f5995c708 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:55.142711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-78d1d8da-a6fc-4433-944d-987f5995c708 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:55.155093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78d1d8da-a6fc-4433-944d-987f5995c708 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:55.165645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78d1d8da-a6fc-4433-944d-987f5995c708 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:55.166625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78d1d8da-a6fc-4433-944d-987f5995c708 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:55.167587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78d1d8da-a6fc-4433-944d-987f5995c708 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:55.168066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78d1d8da-a6fc-4433-944d-987f5995c708 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:55.168515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78d1d8da-a6fc-4433-944d-987f5995c708 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:55.301439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-28819b9e-5e04-488e-95a8-750c2fdbfdaa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:55.302396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-28819b9e-5e04-488e-95a8-750c2fdbfdaa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:55.318254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28819b9e-5e04-488e-95a8-750c2fdbfdaa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:55.318254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28819b9e-5e04-488e-95a8-750c2fdbfdaa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:55.319138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28819b9e-5e04-488e-95a8-750c2fdbfdaa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:55.320183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28819b9e-5e04-488e-95a8-750c2fdbfdaa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:55.320938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28819b9e-5e04-488e-95a8-750c2fdbfdaa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:55.321579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28819b9e-5e04-488e-95a8-750c2fdbfdaa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:56.068693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-28819b9e-5e04-488e-95a8-750c2fdbfdaa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:56.086556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-78d1d8da-a6fc-4433-944d-987f5995c708 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:56.106611 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-78d1d8da-a6fc-4433-944d-987f5995c708 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1315 microversion: 2.1 time: 0.969075 Oct 04 21:27:56.107237 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2238/4459] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:55 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1315 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:56.111318 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-28819b9e-5e04-488e-95a8-750c2fdbfdaa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 200 len: 1511 microversion: 2.1 time: 0.816432 Oct 04 21:27:56.115129 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2222/4460] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:55 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 1511 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:56.115304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f664725f-4809-4aed-ad53-938d9cfb575e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:56.115777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f664725f-4809-4aed-ad53-938d9cfb575e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: e08c87b8-0afc-4878-a793-35f36d4a8f95] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:56.131256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f664725f-4809-4aed-ad53-938d9cfb575e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:56.135121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f664725f-4809-4aed-ad53-938d9cfb575e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:56.135121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f664725f-4809-4aed-ad53-938d9cfb575e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:56.135121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f664725f-4809-4aed-ad53-938d9cfb575e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:56.135121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f664725f-4809-4aed-ad53-938d9cfb575e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:56.135121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f664725f-4809-4aed-ad53-938d9cfb575e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:56.158879 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-f664725f-4809-4aed-ad53-938d9cfb575e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] HTTP exception thrown: Instance e08c87b8-0afc-4878-a793-35f36d4a8f95 could not be found. Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f664725f-4809-4aed-ad53-938d9cfb575e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Request method failure captured: Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 HTTP/1.1 Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKSp1JwW64Mjgat6pRwzB3_MiccNJUkxd8R4R0XsXlyybN7AH3Ycf38IQJTB8UBIDZprGYEVE2yM3OMX8uXajRHAoPsxDOiRLr74fbkfCXg7Zt_po5mgye-beYZK-B6qyVcu2wHXLLTk6CEzRsygVti5B8TsuVlw32mrq3y3L4huYVY Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 0006ee9cd0424160a0e042de4c653358 Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1881569214 Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0006ee9cd0424160a0e042de4c653358"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0006ee9cd0424160a0e042de4c653358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0006ee9cd0424160a0e042de4c653358"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0006ee9cd0424160a0e042de4c653358"}]}] Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerDiskConfigTestJSON-1881569214 Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 0006ee9cd0424160a0e042de4c653358 Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1881569214 Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerDiskConfigTestJSON-1881569214-project Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: cf4bb2f7ed99411eb8b6231d64179485 Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerDiskConfigTestJSON-1881569214-project Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance e08c87b8-0afc-4878-a793-35f36d4a8f95 could not be found. Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'e08c87b8-0afc-4878-a793-35f36d4a8f95'} Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e08c87b8-0afc-4878-a793-35f36d4a8f95 could not be found. Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e08c87b8-0afc-4878-a793-35f36d4a8f95 could not be found. Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:56.160842 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.174114 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:56.174114 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:56.174114 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:56.174114 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:27:56.174114 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:27:56.174114 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e08c87b8-0afc-4878-a793-35f36d4a8f95 could not be found. Oct 04 21:27:56.174114 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.174114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f664725f-4809-4aed-ad53-938d9cfb575e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Returning 404 to user: Instance e08c87b8-0afc-4878-a793-35f36d4a8f95 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:56.174114 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f664725f-4809-4aed-ad53-938d9cfb575e tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95" status: 404 len: 111 microversion: 2.1 time: 0.053524 Oct 04 21:27:56.174114 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2239/4461] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:56 2022] GET /compute/v2.1/servers/e08c87b8-0afc-4878-a793-35f36d4a8f95 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:27:56.180341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a7725d74-cb58-4a3b-b99e-45b2c37e6345 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:56.180897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a7725d74-cb58-4a3b-b99e-45b2c37e6345 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:56.188238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7725d74-cb58-4a3b-b99e-45b2c37e6345 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:56.188977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7725d74-cb58-4a3b-b99e-45b2c37e6345 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:56.189649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7725d74-cb58-4a3b-b99e-45b2c37e6345 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:56.191190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7725d74-cb58-4a3b-b99e-45b2c37e6345 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:56.191852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7725d74-cb58-4a3b-b99e-45b2c37e6345 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:56.196859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7725d74-cb58-4a3b-b99e-45b2c37e6345 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:56.208692 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-a7725d74-cb58-4a3b-b99e-45b2c37e6345 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] HTTP exception thrown: Instance 67efa537-ebf8-481f-8d5b-dfcae879bc9c could not be found. Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a7725d74-cb58-4a3b-b99e-45b2c37e6345 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Request method failure captured: Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c HTTP/1.1 Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKSp1JwW64Mjgat6pRwzB3_MiccNJUkxd8R4R0XsXlyybN7AH3Ycf38IQJTB8UBIDZprGYEVE2yM3OMX8uXajRHAoPsxDOiRLr74fbkfCXg7Zt_po5mgye-beYZK-B6qyVcu2wHXLLTk6CEzRsygVti5B8TsuVlw32mrq3y3L4huYVY Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 0006ee9cd0424160a0e042de4c653358 Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1881569214 Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0006ee9cd0424160a0e042de4c653358"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0006ee9cd0424160a0e042de4c653358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0006ee9cd0424160a0e042de4c653358"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0006ee9cd0424160a0e042de4c653358"}]}] Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerDiskConfigTestJSON-1881569214 Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 0006ee9cd0424160a0e042de4c653358 Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1881569214 Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerDiskConfigTestJSON-1881569214-project Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: cf4bb2f7ed99411eb8b6231d64179485 Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerDiskConfigTestJSON-1881569214-project Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 67efa537-ebf8-481f-8d5b-dfcae879bc9c could not be found. Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '67efa537-ebf8-481f-8d5b-dfcae879bc9c'} Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67efa537-ebf8-481f-8d5b-dfcae879bc9c could not be found. Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:27:56.210450 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:27:56.215230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67efa537-ebf8-481f-8d5b-dfcae879bc9c could not be found. Oct 04 21:27:56.215230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.215230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:56.215230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.215230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:56.215230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:56.215230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:56.215230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:27:56.215230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:27:56.215230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67efa537-ebf8-481f-8d5b-dfcae879bc9c could not be found. Oct 04 21:27:56.215230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.215230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a7725d74-cb58-4a3b-b99e-45b2c37e6345 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Returning 404 to user: Instance 67efa537-ebf8-481f-8d5b-dfcae879bc9c could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:56.215230 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a7725d74-cb58-4a3b-b99e-45b2c37e6345 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "DELETE /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 404 len: 111 microversion: 2.1 time: 0.037840 Oct 04 21:27:56.217076 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2223/4462] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:27:56 2022] DELETE /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:27:56.221362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-53af45d8-f63b-4d64-92e6-637f50f58723 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:56.222375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-53af45d8-f63b-4d64-92e6-637f50f58723 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: 67efa537-ebf8-481f-8d5b-dfcae879bc9c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:56.229705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53af45d8-f63b-4d64-92e6-637f50f58723 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:56.230997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53af45d8-f63b-4d64-92e6-637f50f58723 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:56.231781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53af45d8-f63b-4d64-92e6-637f50f58723 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:56.232718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53af45d8-f63b-4d64-92e6-637f50f58723 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:56.233391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53af45d8-f63b-4d64-92e6-637f50f58723 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:56.234072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53af45d8-f63b-4d64-92e6-637f50f58723 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:56.251966 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-53af45d8-f63b-4d64-92e6-637f50f58723 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] HTTP exception thrown: Instance 67efa537-ebf8-481f-8d5b-dfcae879bc9c could not be found. Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-53af45d8-f63b-4d64-92e6-637f50f58723 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Request method failure captured: Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c HTTP/1.1 Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKSp1JwW64Mjgat6pRwzB3_MiccNJUkxd8R4R0XsXlyybN7AH3Ycf38IQJTB8UBIDZprGYEVE2yM3OMX8uXajRHAoPsxDOiRLr74fbkfCXg7Zt_po5mgye-beYZK-B6qyVcu2wHXLLTk6CEzRsygVti5B8TsuVlw32mrq3y3L4huYVY Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 0006ee9cd0424160a0e042de4c653358 Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1881569214 Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0006ee9cd0424160a0e042de4c653358"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0006ee9cd0424160a0e042de4c653358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0006ee9cd0424160a0e042de4c653358"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0006ee9cd0424160a0e042de4c653358"}]}] Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerDiskConfigTestJSON-1881569214 Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 0006ee9cd0424160a0e042de4c653358 Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1881569214 Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerDiskConfigTestJSON-1881569214-project Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: cf4bb2f7ed99411eb8b6231d64179485 Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerDiskConfigTestJSON-1881569214-project Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 67efa537-ebf8-481f-8d5b-dfcae879bc9c could not be found. Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '67efa537-ebf8-481f-8d5b-dfcae879bc9c'} Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67efa537-ebf8-481f-8d5b-dfcae879bc9c could not be found. Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67efa537-ebf8-481f-8d5b-dfcae879bc9c could not be found. Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:56.254608 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.269382 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:56.269382 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:56.269382 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:56.269382 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:27:56.269382 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:27:56.269382 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67efa537-ebf8-481f-8d5b-dfcae879bc9c could not be found. Oct 04 21:27:56.269382 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.269382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-53af45d8-f63b-4d64-92e6-637f50f58723 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Returning 404 to user: Instance 67efa537-ebf8-481f-8d5b-dfcae879bc9c could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:56.269382 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-53af45d8-f63b-4d64-92e6-637f50f58723 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c" status: 404 len: 111 microversion: 2.1 time: 0.044014 Oct 04 21:27:56.273336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-99f32d9f-d76b-4156-ae80-bd784a4c1a6f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:56.273966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-99f32d9f-d76b-4156-ae80-bd784a4c1a6f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:56.276277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:56.279074 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2240/4463] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:56 2022] GET /compute/v2.1/servers/67efa537-ebf8-481f-8d5b-dfcae879bc9c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:27:56.283914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99f32d9f-d76b-4156-ae80-bd784a4c1a6f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:56.284742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99f32d9f-d76b-4156-ae80-bd784a4c1a6f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:56.285404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99f32d9f-d76b-4156-ae80-bd784a4c1a6f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:56.286358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99f32d9f-d76b-4156-ae80-bd784a4c1a6f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:56.287022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99f32d9f-d76b-4156-ae80-bd784a4c1a6f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:56.287595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-99f32d9f-d76b-4156-ae80-bd784a4c1a6f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:56.303256 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-99f32d9f-d76b-4156-ae80-bd784a4c1a6f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] HTTP exception thrown: Instance bbfb9eae-ce66-48c5-b7ca-8032c3596fad could not be found. Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-99f32d9f-d76b-4156-ae80-bd784a4c1a6f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Request method failure captured: Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad HTTP/1.1 Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKSp1JwW64Mjgat6pRwzB3_MiccNJUkxd8R4R0XsXlyybN7AH3Ycf38IQJTB8UBIDZprGYEVE2yM3OMX8uXajRHAoPsxDOiRLr74fbkfCXg7Zt_po5mgye-beYZK-B6qyVcu2wHXLLTk6CEzRsygVti5B8TsuVlw32mrq3y3L4huYVY Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 0006ee9cd0424160a0e042de4c653358 Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1881569214 Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0006ee9cd0424160a0e042de4c653358"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0006ee9cd0424160a0e042de4c653358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0006ee9cd0424160a0e042de4c653358"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0006ee9cd0424160a0e042de4c653358"}]}] Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerDiskConfigTestJSON-1881569214 Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 0006ee9cd0424160a0e042de4c653358 Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1881569214 Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerDiskConfigTestJSON-1881569214-project Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: cf4bb2f7ed99411eb8b6231d64179485 Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerDiskConfigTestJSON-1881569214-project Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance bbfb9eae-ce66-48c5-b7ca-8032c3596fad could not be found. Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'bbfb9eae-ce66-48c5-b7ca-8032c3596fad'} Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbfb9eae-ce66-48c5-b7ca-8032c3596fad could not be found. Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:27:56.305319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:27:56.309872 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbfb9eae-ce66-48c5-b7ca-8032c3596fad could not be found. Oct 04 21:27:56.309872 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.309872 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:56.309872 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.309872 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:56.309872 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:56.309872 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:56.309872 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:27:56.309872 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:27:56.309872 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbfb9eae-ce66-48c5-b7ca-8032c3596fad could not be found. Oct 04 21:27:56.309872 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.311365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-99f32d9f-d76b-4156-ae80-bd784a4c1a6f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Returning 404 to user: Instance bbfb9eae-ce66-48c5-b7ca-8032c3596fad could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:56.312376 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-99f32d9f-d76b-4156-ae80-bd784a4c1a6f tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 404 len: 111 microversion: 2.1 time: 0.046438 Oct 04 21:27:56.316863 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2224/4464] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:27:56 2022] DELETE /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:27:56.324001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-93586dc7-1a9a-46e8-b353-191b3381b7c9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:56.324995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-93586dc7-1a9a-46e8-b353-191b3381b7c9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] [instance: bbfb9eae-ce66-48c5-b7ca-8032c3596fad] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:56.332497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93586dc7-1a9a-46e8-b353-191b3381b7c9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:56.333473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93586dc7-1a9a-46e8-b353-191b3381b7c9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:56.333903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93586dc7-1a9a-46e8-b353-191b3381b7c9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:56.334750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93586dc7-1a9a-46e8-b353-191b3381b7c9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:56.335061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93586dc7-1a9a-46e8-b353-191b3381b7c9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:56.335490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93586dc7-1a9a-46e8-b353-191b3381b7c9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:56.368505 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-93586dc7-1a9a-46e8-b353-191b3381b7c9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] HTTP exception thrown: Instance bbfb9eae-ce66-48c5-b7ca-8032c3596fad could not be found. Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-93586dc7-1a9a-46e8-b353-191b3381b7c9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Request method failure captured: Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad HTTP/1.1 Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKSp1JwW64Mjgat6pRwzB3_MiccNJUkxd8R4R0XsXlyybN7AH3Ycf38IQJTB8UBIDZprGYEVE2yM3OMX8uXajRHAoPsxDOiRLr74fbkfCXg7Zt_po5mgye-beYZK-B6qyVcu2wHXLLTk6CEzRsygVti5B8TsuVlw32mrq3y3L4huYVY Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 0006ee9cd0424160a0e042de4c653358 Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1881569214 Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0006ee9cd0424160a0e042de4c653358"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0006ee9cd0424160a0e042de4c653358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0006ee9cd0424160a0e042de4c653358"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0006ee9cd0424160a0e042de4c653358"}]}] Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerDiskConfigTestJSON-1881569214 Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 0006ee9cd0424160a0e042de4c653358 Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1881569214 Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerDiskConfigTestJSON-1881569214-project Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: cf4bb2f7ed99411eb8b6231d64179485 Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerDiskConfigTestJSON-1881569214-project Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance bbfb9eae-ce66-48c5-b7ca-8032c3596fad could not be found. Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'bbfb9eae-ce66-48c5-b7ca-8032c3596fad'} Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbfb9eae-ce66-48c5-b7ca-8032c3596fad could not be found. Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbfb9eae-ce66-48c5-b7ca-8032c3596fad could not be found. Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:56.381107 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.386851 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:56.386851 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:56.386851 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:56.386851 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:27:56.386851 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:27:56.386851 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbfb9eae-ce66-48c5-b7ca-8032c3596fad could not be found. Oct 04 21:27:56.386851 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:56.386851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-93586dc7-1a9a-46e8-b353-191b3381b7c9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] Returning 404 to user: Instance bbfb9eae-ce66-48c5-b7ca-8032c3596fad could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:56.386851 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-93586dc7-1a9a-46e8-b353-191b3381b7c9 tempest-ServerDiskConfigTestJSON-1881569214 tempest-ServerDiskConfigTestJSON-1881569214-project] 10.222.0.30 "GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad" status: 404 len: 111 microversion: 2.1 time: 0.066099 Oct 04 21:27:56.387881 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2241/4465] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:56 2022] GET /compute/v2.1/servers/bbfb9eae-ce66-48c5-b7ca-8032c3596fad => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:27:56.935078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-a1a386e3-b6de-41a5-8d96-fb23090096e2 req-76907d0b-bd2e-4c66-a097-7ca242fe950f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae649a1e-b6ec-4d6c-9584-7738fff25315", "name": "network-vif-deleted", "tag": "9487709f-e232-4f06-bd45-23384ef95d73"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:56.982181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a1a386e3-b6de-41a5-8d96-fb23090096e2 req-76907d0b-bd2e-4c66-a097-7ca242fe950f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:56.983251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a1a386e3-b6de-41a5-8d96-fb23090096e2 req-76907d0b-bd2e-4c66-a097-7ca242fe950f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:56.984954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a1a386e3-b6de-41a5-8d96-fb23090096e2 req-76907d0b-bd2e-4c66-a097-7ca242fe950f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:57.011499 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-a1a386e3-b6de-41a5-8d96-fb23090096e2 req-76907d0b-bd2e-4c66-a097-7ca242fe950f service nova] Creating event network-vif-deleted:9487709f-e232-4f06-bd45-23384ef95d73 for instance ae649a1e-b6ec-4d6c-9584-7738fff25315 on n-h1-860282-1 Oct 04 21:27:57.035051 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-a1a386e3-b6de-41a5-8d96-fb23090096e2 req-76907d0b-bd2e-4c66-a097-7ca242fe950f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113210 Oct 04 21:27:57.037501 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2225/4466] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:57.143025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-44449b4b-1163-4dff-b811-4b79229aa089 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:57.147428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-db685f15-2249-47ba-bdaa-288bf6b2d8b8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:57.148896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-44449b4b-1163-4dff-b811-4b79229aa089 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:57.149578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-db685f15-2249-47ba-bdaa-288bf6b2d8b8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:57.165684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44449b4b-1163-4dff-b811-4b79229aa089 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:57.167477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44449b4b-1163-4dff-b811-4b79229aa089 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:57.168959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44449b4b-1163-4dff-b811-4b79229aa089 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:57.171893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44449b4b-1163-4dff-b811-4b79229aa089 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:57.172291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44449b4b-1163-4dff-b811-4b79229aa089 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:57.173588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44449b4b-1163-4dff-b811-4b79229aa089 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:57.182594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db685f15-2249-47ba-bdaa-288bf6b2d8b8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:57.185363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db685f15-2249-47ba-bdaa-288bf6b2d8b8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:57.187547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db685f15-2249-47ba-bdaa-288bf6b2d8b8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:57.190118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db685f15-2249-47ba-bdaa-288bf6b2d8b8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:57.191834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db685f15-2249-47ba-bdaa-288bf6b2d8b8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:57.192761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db685f15-2249-47ba-bdaa-288bf6b2d8b8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:57.223580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:57.649225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-db685f15-2249-47ba-bdaa-288bf6b2d8b8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:57.667406 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-db685f15-2249-47ba-bdaa-288bf6b2d8b8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 200 len: 1302 microversion: 2.1 time: 0.531880 Oct 04 21:27:57.670405 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2242/4467] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:57 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 1302 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:58.034408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-44449b4b-1163-4dff-b811-4b79229aa089 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:58.039051 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-44449b4b-1163-4dff-b811-4b79229aa089 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1315 microversion: 2.1 time: 0.900633 Oct 04 21:27:58.070583 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2226/4468] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:57 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1315 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:58.694504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a3d5b6e5-31d6-4fa6-9972-133d79ae1b07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:58.695869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a3d5b6e5-31d6-4fa6-9972-133d79ae1b07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:58.704506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3d5b6e5-31d6-4fa6-9972-133d79ae1b07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:58.705309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3d5b6e5-31d6-4fa6-9972-133d79ae1b07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:58.706547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3d5b6e5-31d6-4fa6-9972-133d79ae1b07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:58.710832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3d5b6e5-31d6-4fa6-9972-133d79ae1b07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:58.710832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3d5b6e5-31d6-4fa6-9972-133d79ae1b07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:58.710832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3d5b6e5-31d6-4fa6-9972-133d79ae1b07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:58.728046 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-a3d5b6e5-31d6-4fa6-9972-133d79ae1b07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a3d5b6e5-31d6-4fa6-9972-133d79ae1b07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 HTTP/1.1 Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'ae649a1e-b6ec-4d6c-9584-7738fff25315'} Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:58.730277 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:58.738560 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:58.738560 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:58.738560 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:58.738560 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:27:58.738560 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:27:58.738560 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:27:58.738560 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:27:58.738560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a3d5b6e5-31d6-4fa6-9972-133d79ae1b07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:58.738560 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a3d5b6e5-31d6-4fa6-9972-133d79ae1b07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 404 len: 111 microversion: 2.1 time: 0.043870 Oct 04 21:27:58.738560 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2243/4469] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:58 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:27:58.745217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f12338d6-e358-472e-8379-5d0e89d9e11a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:58.748093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f12338d6-e358-472e-8379-5d0e89d9e11a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:58.771837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:58.773842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f12338d6-e358-472e-8379-5d0e89d9e11a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:58.775806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f12338d6-e358-472e-8379-5d0e89d9e11a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:58.776894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f12338d6-e358-472e-8379-5d0e89d9e11a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:58.779385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f12338d6-e358-472e-8379-5d0e89d9e11a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:58.782968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f12338d6-e358-472e-8379-5d0e89d9e11a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:58.784801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f12338d6-e358-472e-8379-5d0e89d9e11a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:59.065536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-862f5f2d-ee4b-4ee2-a2d7-2d1a00c29bc7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:59.067164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-862f5f2d-ee4b-4ee2-a2d7-2d1a00c29bc7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:59.083677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-862f5f2d-ee4b-4ee2-a2d7-2d1a00c29bc7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:59.084216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-862f5f2d-ee4b-4ee2-a2d7-2d1a00c29bc7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:59.084665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-862f5f2d-ee4b-4ee2-a2d7-2d1a00c29bc7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:59.088847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-862f5f2d-ee4b-4ee2-a2d7-2d1a00c29bc7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:59.100088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-862f5f2d-ee4b-4ee2-a2d7-2d1a00c29bc7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:59.101008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-862f5f2d-ee4b-4ee2-a2d7-2d1a00c29bc7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:59.399750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f12338d6-e358-472e-8379-5d0e89d9e11a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:59.405353 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f12338d6-e358-472e-8379-5d0e89d9e11a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.664145 Oct 04 21:27:59.410014 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2227/4470] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:58 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:59.417660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-e39b3986-aa52-4284-a51b-6266efae6f91 req-a91db22a-8cd2-4cfa-bfbd-2bf877845b66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f70dc9fb-d2fe-433b-b46a-c296c126ce5e", "tag": "fd475cd3-9ea0-4313-9dea-2d1ee1f543ce"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:59.444818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e39b3986-aa52-4284-a51b-6266efae6f91 req-a91db22a-8cd2-4cfa-bfbd-2bf877845b66 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:59.448543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e39b3986-aa52-4284-a51b-6266efae6f91 req-a91db22a-8cd2-4cfa-bfbd-2bf877845b66 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:59.449197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e39b3986-aa52-4284-a51b-6266efae6f91 req-a91db22a-8cd2-4cfa-bfbd-2bf877845b66 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:59.481604 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-e39b3986-aa52-4284-a51b-6266efae6f91 req-a91db22a-8cd2-4cfa-bfbd-2bf877845b66 service nova] Creating event network-changed:fd475cd3-9ea0-4313-9dea-2d1ee1f543ce for instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e on n-h2-860282-1 Oct 04 21:27:59.499358 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-e39b3986-aa52-4284-a51b-6266efae6f91 req-a91db22a-8cd2-4cfa-bfbd-2bf877845b66 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087962 Oct 04 21:27:59.500305 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2228/4471] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:59.702643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-862f5f2d-ee4b-4ee2-a2d7-2d1a00c29bc7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:59.713603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2c6ea707-4273-4131-8360-71b849cc2542 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:59.720684 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-862f5f2d-ee4b-4ee2-a2d7-2d1a00c29bc7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1315 microversion: 2.1 time: 0.661586 Oct 04 21:27:59.721298 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2244/4472] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:59 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2c6ea707-4273-4131-8360-71b849cc2542 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 163 Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: {"server": {"name": 12345, "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'networks': [{'uuid': '6854610d-7b7e-44e1-90bf-b66a6b17f7da'}]}}} Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 12345 Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:27:59.750000 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:27:59.760695 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:27:59.760695 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 21:27:59.760695 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:59.760695 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:59.760695 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:59.760695 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:59.760695 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:59.760695 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:59.760695 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:27:59.760695 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:27:59.760695 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 21:27:59.760695 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:27:59.775360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2c6ea707-4273-4131-8360-71b849cc2542 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:59.784735 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2c6ea707-4273-4131-8360-71b849cc2542 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.087958 Oct 04 21:27:59.791698 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2229/4473] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:27:59 2022] POST /compute/v2.1/servers => generated 127 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:27:59.813850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c97768fa-88e9-46f1-9d42-33254bf3a819 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:59.820699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c97768fa-88e9-46f1-9d42-33254bf3a819 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:59.829892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c97768fa-88e9-46f1-9d42-33254bf3a819 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:59.830408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c97768fa-88e9-46f1-9d42-33254bf3a819 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:59.830856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c97768fa-88e9-46f1-9d42-33254bf3a819 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:59.831624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c97768fa-88e9-46f1-9d42-33254bf3a819 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:59.832095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c97768fa-88e9-46f1-9d42-33254bf3a819 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:59.832530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c97768fa-88e9-46f1-9d42-33254bf3a819 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:59.850840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:00.751385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8d18d259-a63b-43ff-9e92-432e306c16ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:00.753147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8d18d259-a63b-43ff-9e92-432e306c16ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:00.762545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=10 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:00.766764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d18d259-a63b-43ff-9e92-432e306c16ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:00.766764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d18d259-a63b-43ff-9e92-432e306c16ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:00.766764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d18d259-a63b-43ff-9e92-432e306c16ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:00.768336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d18d259-a63b-43ff-9e92-432e306c16ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:00.769173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d18d259-a63b-43ff-9e92-432e306c16ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:00.769906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d18d259-a63b-43ff-9e92-432e306c16ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:00.902647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c97768fa-88e9-46f1-9d42-33254bf3a819 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:00.915089 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c97768fa-88e9-46f1-9d42-33254bf3a819 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 1.117575 Oct 04 21:28:00.924731 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2245/4474] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:59 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:00.945259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e37039a2-2dae-4b93-970f-e2cf476db3c5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:00.946939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e37039a2-2dae-4b93-970f-e2cf476db3c5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:00.960898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e37039a2-2dae-4b93-970f-e2cf476db3c5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:00.963207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e37039a2-2dae-4b93-970f-e2cf476db3c5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:00.964781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e37039a2-2dae-4b93-970f-e2cf476db3c5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:00.966910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e37039a2-2dae-4b93-970f-e2cf476db3c5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:00.968395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e37039a2-2dae-4b93-970f-e2cf476db3c5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:00.969813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e37039a2-2dae-4b93-970f-e2cf476db3c5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:01.686549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8d18d259-a63b-43ff-9e92-432e306c16ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:01.700841 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8d18d259-a63b-43ff-9e92-432e306c16ca tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1315 microversion: 2.1 time: 0.953813 Oct 04 21:28:01.710120 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2230/4475] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:00 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1315 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:01.717997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-750855f4-4d17-4958-85c0-087ec5e38acb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Action: 'create', calling method: .version_select at 0x7f578b608ca0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1964809015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlODEQ565jgvIbAIM/bxNocfxvEmX4eMDBqduRrcxs4PKWCD2OZYXIZtE1ZnF5u04BZ4IGQaKH6GrPvrmp4xjmOFxsn8bstWuZU0dYuG+4mI2jIbxRSyQhSmSEH0dUxHQ=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:01.753950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-750855f4-4d17-4958-85c0-087ec5e38acb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Getting quotas for project f74afbd0dc37402fa84ec9d6e2cb53f4. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:28:01.770560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-750855f4-4d17-4958-85c0-087ec5e38acb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Getting quotas for user 933f720fbafe482d95b27cd372934ab6 and project f74afbd0dc37402fa84ec9d6e2cb53f4. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:28:01.883904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e37039a2-2dae-4b93-970f-e2cf476db3c5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:01.908057 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e37039a2-2dae-4b93-970f-e2cf476db3c5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.968443 Oct 04 21:28:01.921521 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2246/4476] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:00 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:01.964491 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-750855f4-4d17-4958-85c0-087ec5e38acb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.252708 Oct 04 21:28:01.968002 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2231/4477] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:28:01 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:28:02.741404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-07cd42f3-4789-4537-8f21-ee2c9669fa1d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:02.742511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-07cd42f3-4789-4537-8f21-ee2c9669fa1d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:02.752637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-07cd42f3-4789-4537-8f21-ee2c9669fa1d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:02.753565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-07cd42f3-4789-4537-8f21-ee2c9669fa1d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:02.754243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-07cd42f3-4789-4537-8f21-ee2c9669fa1d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:02.755462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-07cd42f3-4789-4537-8f21-ee2c9669fa1d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:02.756360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-07cd42f3-4789-4537-8f21-ee2c9669fa1d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:02.757003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-07cd42f3-4789-4537-8f21-ee2c9669fa1d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:03.632496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-07cd42f3-4789-4537-8f21-ee2c9669fa1d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:03.646213 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-07cd42f3-4789-4537-8f21-ee2c9669fa1d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1315 microversion: 2.1 time: 0.910501 Oct 04 21:28:03.648209 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2247/4478] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:02 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1315 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:04.677135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e3603f79-8a53-4d86-879f-3316f25e8f8d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:04.678601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e3603f79-8a53-4d86-879f-3316f25e8f8d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:04.699887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3603f79-8a53-4d86-879f-3316f25e8f8d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:04.700393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3603f79-8a53-4d86-879f-3316f25e8f8d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:04.703045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3603f79-8a53-4d86-879f-3316f25e8f8d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:04.705560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3603f79-8a53-4d86-879f-3316f25e8f8d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:04.706255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3603f79-8a53-4d86-879f-3316f25e8f8d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:04.709795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3603f79-8a53-4d86-879f-3316f25e8f8d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:05.473562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-23f7495d-b5fb-4db6-aecb-5ec5d1ce6e10 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-23652493", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "547de817-c247-45de-b605-77babaaba17a", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:05.693108 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-23f7495d-b5fb-4db6-aecb-5ec5d1ce6e10 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Block Device 547de817-c247-45de-b605-77babaaba17a is not bootable. Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-23f7495d-b5fb-4db6-aecb-5ec5d1ce6e10 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 356 Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-23652493", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "547de817-c247-45de-b605-77babaaba17a", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: exception: Block Device 547de817-c247-45de-b605-77babaaba17a is not bootable. Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-23652493', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '547de817-c247-45de-b605-77babaaba17a'}], 'networks': [{'uuid': '6854610d-7b7e-44e1-90bf-b66a6b17f7da'}]}}} Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 547de817-c247-45de-b605-77babaaba17a is not bootable. Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:05.706435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:05.711179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:05.711179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:05.711179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:05.711179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:28:05.711179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 21:28:05.711179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 21:28:05.711179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 547de817-c247-45de-b605-77babaaba17a is not bootable. Oct 04 21:28:05.711179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:05.711179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:05.711179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:05.711179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:05.711179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:05.711179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:05.711179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:05.711179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:05.711179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 547de817-c247-45de-b605-77babaaba17a is not bootable. Oct 04 21:28:05.711179 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:05.715270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-23f7495d-b5fb-4db6-aecb-5ec5d1ce6e10 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 400 to user: Block Device 547de817-c247-45de-b605-77babaaba17a is not bootable. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:05.722366 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-23f7495d-b5fb-4db6-aecb-5ec5d1ce6e10 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.249020 Oct 04 21:28:05.722366 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2248/4479] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:28:05 2022] POST /compute/v2.1/servers => generated 110 bytes in 250 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:28:05.727531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8722da97-84f2-4ccf-9fa7-d39520a196b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:05.728438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8722da97-84f2-4ccf-9fa7-d39520a196b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:05.745065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8722da97-84f2-4ccf-9fa7-d39520a196b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:05.745923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8722da97-84f2-4ccf-9fa7-d39520a196b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:05.747331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8722da97-84f2-4ccf-9fa7-d39520a196b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:05.755247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8722da97-84f2-4ccf-9fa7-d39520a196b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:05.765044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8722da97-84f2-4ccf-9fa7-d39520a196b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:05.768088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8722da97-84f2-4ccf-9fa7-d39520a196b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:06.301792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e3603f79-8a53-4d86-879f-3316f25e8f8d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:06.313147 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e3603f79-8a53-4d86-879f-3316f25e8f8d tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1315 microversion: 2.1 time: 1.642947 Oct 04 21:28:06.316372 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2232/4480] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:04 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1315 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:06.559748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8722da97-84f2-4ccf-9fa7-d39520a196b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:06.572865 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8722da97-84f2-4ccf-9fa7-d39520a196b9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.851338 Oct 04 21:28:06.575501 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2249/4481] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:05 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:06.607619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9da7c70e-3075-457f-9cac-60b3d2d635b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:06.608546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9da7c70e-3075-457f-9cac-60b3d2d635b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:06.616048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9da7c70e-3075-457f-9cac-60b3d2d635b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:06.616746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9da7c70e-3075-457f-9cac-60b3d2d635b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:06.617355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9da7c70e-3075-457f-9cac-60b3d2d635b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:06.618442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9da7c70e-3075-457f-9cac-60b3d2d635b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:06.619076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9da7c70e-3075-457f-9cac-60b3d2d635b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:06.619677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9da7c70e-3075-457f-9cac-60b3d2d635b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:07.108541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9da7c70e-3075-457f-9cac-60b3d2d635b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:07.121338 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9da7c70e-3075-457f-9cac-60b3d2d635b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.518985 Oct 04 21:28:07.136481 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2233/4482] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:06 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:07.344316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-524959c1-d881-46ee-9928-59307777da8f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:07.345019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-524959c1-d881-46ee-9928-59307777da8f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:07.359216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-524959c1-d881-46ee-9928-59307777da8f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:07.360217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-524959c1-d881-46ee-9928-59307777da8f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:07.360868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-524959c1-d881-46ee-9928-59307777da8f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:07.364845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-524959c1-d881-46ee-9928-59307777da8f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:07.366561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-524959c1-d881-46ee-9928-59307777da8f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:07.367192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-524959c1-d881-46ee-9928-59307777da8f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:07.835746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-524959c1-d881-46ee-9928-59307777da8f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:07.844917 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-524959c1-d881-46ee-9928-59307777da8f tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1315 microversion: 2.1 time: 0.505471 Oct 04 21:28:07.853731 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2250/4483] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:07 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:08.870381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9c8a8a39-967c-42bb-9233-c06beb152a8c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:08.871001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9c8a8a39-967c-42bb-9233-c06beb152a8c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:08.883612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c8a8a39-967c-42bb-9233-c06beb152a8c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:08.884111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c8a8a39-967c-42bb-9233-c06beb152a8c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:08.884557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c8a8a39-967c-42bb-9233-c06beb152a8c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:08.885271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c8a8a39-967c-42bb-9233-c06beb152a8c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:08.901461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c8a8a39-967c-42bb-9233-c06beb152a8c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:08.901993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c8a8a39-967c-42bb-9233-c06beb152a8c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:09.485044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-486a47a6-118d-4058-bff0-cfbe1ddd410b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1849552904", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "2d38569b-b782-4376-b643-6d2550a96f07"}], "key_name": "tempest-TestNetworkBasicOps-1964809015", "security_groups": [{"name": "tempest-secgroup-smoke-527985433"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:10.247823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9c8a8a39-967c-42bb-9233-c06beb152a8c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:10.262647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-486a47a6-118d-4058-bff0-cfbe1ddd410b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] validate_networks() for [('2d38569b-b782-4376-b643-6d2550a96f07', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:28:10.269813 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9c8a8a39-967c-42bb-9233-c06beb152a8c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1315 microversion: 2.1 time: 1.401753 Oct 04 21:28:10.275446 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2234/4484] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:08 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1315 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:10.291298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-38cce253-8a57-4774-a499-d0099ed48f8f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Action: 'create', calling method: .version_select at 0x7f579457d1f0>, body: {"keypair": {"name": "tempest-keypair-1290707702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuHBeIGUZHNA4KLAK38CjXHSY++XgLoVv/0+ZDV5GzYG/2o3wLkPdVQDAE68RDf4KlwxIzWq8Hfv9+ODtjRqJGqzZeZxgiojCcrQGATZYYLkAQAv1vhMX+n0r2kOXBtYQ=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:10.386145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-38cce253-8a57-4774-a499-d0099ed48f8f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Getting quotas for project a8479b5f07f048e6ac713898fa3ad78d. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:28:10.406918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-38cce253-8a57-4774-a499-d0099ed48f8f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Getting quotas for user e97fbecf827246dc8dd8ab24e418cff3 and project a8479b5f07f048e6ac713898fa3ad78d. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:28:10.617039 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-38cce253-8a57-4774-a499-d0099ed48f8f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.339964 Oct 04 21:28:10.624973 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2235/4485] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Oct 4 21:28:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 342 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:28:11.305326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-39409f70-8ae7-4ad6-b926-8d0a18d049d7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:11.307882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-39409f70-8ae7-4ad6-b926-8d0a18d049d7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:11.380055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39409f70-8ae7-4ad6-b926-8d0a18d049d7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:11.384072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39409f70-8ae7-4ad6-b926-8d0a18d049d7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:11.388205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39409f70-8ae7-4ad6-b926-8d0a18d049d7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:11.392104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39409f70-8ae7-4ad6-b926-8d0a18d049d7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:11.400409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39409f70-8ae7-4ad6-b926-8d0a18d049d7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:11.400920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39409f70-8ae7-4ad6-b926-8d0a18d049d7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:11.941378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-486a47a6-118d-4058-bff0-cfbe1ddd410b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:28:11.942445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-486a47a6-118d-4058-bff0-cfbe1ddd410b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:28:11.943278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-486a47a6-118d-4058-bff0-cfbe1ddd410b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:28:11.943871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-486a47a6-118d-4058-bff0-cfbe1ddd410b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:28:11.944473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-486a47a6-118d-4058-bff0-cfbe1ddd410b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:28:11.951958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-39409f70-8ae7-4ad6-b926-8d0a18d049d7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:11.963793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-486a47a6-118d-4058-bff0-cfbe1ddd410b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:11.967976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-486a47a6-118d-4058-bff0-cfbe1ddd410b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:11.967976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-486a47a6-118d-4058-bff0-cfbe1ddd410b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:11.971172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-486a47a6-118d-4058-bff0-cfbe1ddd410b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:11.971484 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-39409f70-8ae7-4ad6-b926-8d0a18d049d7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1315 microversion: 2.1 time: 0.670710 Oct 04 21:28:11.972962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-486a47a6-118d-4058-bff0-cfbe1ddd410b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:11.973677 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2236/4486] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:11 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1315 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:11.974314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-486a47a6-118d-4058-bff0-cfbe1ddd410b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:11.991816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-69e84cb3-7ec7-4fc9-ba61-c17fcdf6d542 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2037283014", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "destination_type": "local"}, {"source_type": "volume", "uuid": "ab335ad4-ce0f-4350-acde-50379e4a2384", "destination_type": "invalid"}], "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-69e84cb3-7ec7-4fc9-ba61-c17fcdf6d542 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 495 Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2037283014", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "destination_type": "local"}, {"source_type": "volume", "uuid": "ab335ad4-ce0f-4350-acde-50379e4a2384", "destination_type": "invalid"}], "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2037283014', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'ab335ad4-ce0f-4350-acde-50379e4a2384', 'destination_type': 'invalid'}], 'networks': [{'uuid': '6854610d-7b7e-44e1-90bf-b66a6b17f7da'}]}}} Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:12.011753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:12.016570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-69e84cb3-7ec7-4fc9-ba61-c17fcdf6d542 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:12.018766 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-69e84cb3-7ec7-4fc9-ba61-c17fcdf6d542 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.039354 Oct 04 21:28:12.025450 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2237/4487] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:28:11 2022] POST /compute/v2.1/servers => generated 155 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:28:12.025643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-486a47a6-118d-4058-bff0-cfbe1ddd410b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Getting quotas for project f74afbd0dc37402fa84ec9d6e2cb53f4. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:28:12.035520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-56b61a4b-3545-4c4c-b5b4-df3ec9e794c0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:12.036399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-56b61a4b-3545-4c4c-b5b4-df3ec9e794c0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:12.044642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-486a47a6-118d-4058-bff0-cfbe1ddd410b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Getting quotas for user 933f720fbafe482d95b27cd372934ab6 and project f74afbd0dc37402fa84ec9d6e2cb53f4. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:28:12.049007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:12.063010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-486a47a6-118d-4058-bff0-cfbe1ddd410b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:28:12.066376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-486a47a6-118d-4058-bff0-cfbe1ddd410b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: e48d8482-b411-41d3-acab-2505e7521d63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:28:12.076533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56b61a4b-3545-4c4c-b5b4-df3ec9e794c0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:12.076533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56b61a4b-3545-4c4c-b5b4-df3ec9e794c0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:12.076533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56b61a4b-3545-4c4c-b5b4-df3ec9e794c0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:12.077105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56b61a4b-3545-4c4c-b5b4-df3ec9e794c0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:12.077601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56b61a4b-3545-4c4c-b5b4-df3ec9e794c0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:12.078041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56b61a4b-3545-4c4c-b5b4-df3ec9e794c0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:12.316677 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-486a47a6-118d-4058-bff0-cfbe1ddd410b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.837196 Oct 04 21:28:12.317374 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2251/4488] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:28:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 2839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:28:12.330151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6af478c5-5dfd-4a26-bb13-8dd93d86a748 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:12.332530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6af478c5-5dfd-4a26-bb13-8dd93d86a748 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: e48d8482-b411-41d3-acab-2505e7521d63] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:13.055228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6af478c5-5dfd-4a26-bb13-8dd93d86a748 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:13.091114 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6af478c5-5dfd-4a26-bb13-8dd93d86a748 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63" status: 200 len: 1249 microversion: 2.1 time: 0.763829 Oct 04 21:28:13.092435 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2252/4489] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:12 2022] GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63 => generated 1249 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:13.115065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-274db174-4da2-4d3d-a99e-b8b833d4e3b5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:13.120361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-274db174-4da2-4d3d-a99e-b8b833d4e3b5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:13.133759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-274db174-4da2-4d3d-a99e-b8b833d4e3b5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:13.134549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-274db174-4da2-4d3d-a99e-b8b833d4e3b5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:13.135205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-274db174-4da2-4d3d-a99e-b8b833d4e3b5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:13.136141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-274db174-4da2-4d3d-a99e-b8b833d4e3b5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:13.137371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-274db174-4da2-4d3d-a99e-b8b833d4e3b5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:13.138617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-274db174-4da2-4d3d-a99e-b8b833d4e3b5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:13.185589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-56b61a4b-3545-4c4c-b5b4-df3ec9e794c0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:13.195805 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-56b61a4b-3545-4c4c-b5b4-df3ec9e794c0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 1.173244 Oct 04 21:28:13.198813 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2238/4490] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:12 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:13.224834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c1da50bb-0e70-4348-9c51-e017e8ca8839 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:13.226520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c1da50bb-0e70-4348-9c51-e017e8ca8839 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:13.239123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1da50bb-0e70-4348-9c51-e017e8ca8839 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:13.239940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1da50bb-0e70-4348-9c51-e017e8ca8839 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:13.240732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1da50bb-0e70-4348-9c51-e017e8ca8839 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:13.245715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1da50bb-0e70-4348-9c51-e017e8ca8839 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:13.246353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1da50bb-0e70-4348-9c51-e017e8ca8839 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:13.246897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1da50bb-0e70-4348-9c51-e017e8ca8839 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:13.707852 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-274db174-4da2-4d3d-a99e-b8b833d4e3b5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:13.719013 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-274db174-4da2-4d3d-a99e-b8b833d4e3b5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1315 microversion: 2.1 time: 0.621287 Oct 04 21:28:13.723780 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2253/4491] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:13 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1315 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:13.756231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c1da50bb-0e70-4348-9c51-e017e8ca8839 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:13.771523 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c1da50bb-0e70-4348-9c51-e017e8ca8839 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.550277 Oct 04 21:28:13.773602 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2239/4492] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:13 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:28:13.966476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fda1ba7d-047f-4f9d-8cd0-c6993fc7dd1e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-999534877", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fda1ba7d-047f-4f9d-8cd0-c6993fc7dd1e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 491 Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-999534877", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-999534877', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '6854610d-7b7e-44e1-90bf-b66a6b17f7da'}]}}} Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:13.972661 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:13.976368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fda1ba7d-047f-4f9d-8cd0-c6993fc7dd1e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:13.985985 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fda1ba7d-047f-4f9d-8cd0-c6993fc7dd1e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.013226 Oct 04 21:28:13.985985 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2254/4493] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:28:13 2022] POST /compute/v2.1/servers => generated 624 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:28:13.991027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fa57e37f-e89c-49c6-86b2-c7ca2457fcf1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:13.991641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fa57e37f-e89c-49c6-86b2-c7ca2457fcf1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:14.006468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa57e37f-e89c-49c6-86b2-c7ca2457fcf1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:14.007182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa57e37f-e89c-49c6-86b2-c7ca2457fcf1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:14.007684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa57e37f-e89c-49c6-86b2-c7ca2457fcf1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:14.010882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa57e37f-e89c-49c6-86b2-c7ca2457fcf1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:14.010882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa57e37f-e89c-49c6-86b2-c7ca2457fcf1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:14.010882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa57e37f-e89c-49c6-86b2-c7ca2457fcf1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:14.118130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-49c79513-134c-40c6-9965-0698ef6aca8c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:14.118749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-49c79513-134c-40c6-9965-0698ef6aca8c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: e48d8482-b411-41d3-acab-2505e7521d63] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:14.138767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49c79513-134c-40c6-9965-0698ef6aca8c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:14.139205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49c79513-134c-40c6-9965-0698ef6aca8c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:14.139657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49c79513-134c-40c6-9965-0698ef6aca8c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:14.140388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49c79513-134c-40c6-9965-0698ef6aca8c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:14.140862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49c79513-134c-40c6-9965-0698ef6aca8c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:14.141298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49c79513-134c-40c6-9965-0698ef6aca8c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:14.386070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-49c79513-134c-40c6-9965-0698ef6aca8c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:14.400090 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-49c79513-134c-40c6-9965-0698ef6aca8c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63" status: 200 len: 1253 microversion: 2.1 time: 0.286258 Oct 04 21:28:14.408832 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2255/4494] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:14 2022] GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63 => generated 1253 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:14.693076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fa57e37f-e89c-49c6-86b2-c7ca2457fcf1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:14.709311 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fa57e37f-e89c-49c6-86b2-c7ca2457fcf1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.722602 Oct 04 21:28:14.732012 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2240/4495] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:13 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:14.750045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-87b68396-58aa-4b90-a9f8-8e07e6aa5713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:14.751689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-87b68396-58aa-4b90-a9f8-8e07e6aa5713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:14.777357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87b68396-58aa-4b90-a9f8-8e07e6aa5713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:14.777357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87b68396-58aa-4b90-a9f8-8e07e6aa5713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:14.777357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87b68396-58aa-4b90-a9f8-8e07e6aa5713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:14.777816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87b68396-58aa-4b90-a9f8-8e07e6aa5713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:14.778068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87b68396-58aa-4b90-a9f8-8e07e6aa5713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:14.778491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87b68396-58aa-4b90-a9f8-8e07e6aa5713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:14.935180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b818e12e-a8d9-4e08-8780-2b30716a459a tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-278519367", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "d8d8cd68-8a0a-4b32-b2ed-165fbcadc17b"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:15.032617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-b818e12e-a8d9-4e08-8780-2b30716a459a tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] validate_networks() for [('d8d8cd68-8a0a-4b32-b2ed-165fbcadc17b', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:28:15.395168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-87b68396-58aa-4b90-a9f8-8e07e6aa5713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:15.405247 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-87b68396-58aa-4b90-a9f8-8e07e6aa5713 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.671148 Oct 04 21:28:15.414905 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2241/4496] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:14 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:15.419118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2bf9042e-e61a-4e2b-b44e-a7a1f331f7bb tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:15.420394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2bf9042e-e61a-4e2b-b44e-a7a1f331f7bb tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:15.437016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bf9042e-e61a-4e2b-b44e-a7a1f331f7bb tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:15.439590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bf9042e-e61a-4e2b-b44e-a7a1f331f7bb tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:15.440878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bf9042e-e61a-4e2b-b44e-a7a1f331f7bb tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:15.442939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bf9042e-e61a-4e2b-b44e-a7a1f331f7bb tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:15.445289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bf9042e-e61a-4e2b-b44e-a7a1f331f7bb tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:15.447349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bf9042e-e61a-4e2b-b44e-a7a1f331f7bb tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:16.209707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2bf9042e-e61a-4e2b-b44e-a7a1f331f7bb tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:16.220727 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2bf9042e-e61a-4e2b-b44e-a7a1f331f7bb tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1315 microversion: 2.1 time: 0.807154 Oct 04 21:28:16.224273 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2242/4497] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:15 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1315 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:16.233020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f230d4d6-7462-4e66-b085-6f157d95e4a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:16.238398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f230d4d6-7462-4e66-b085-6f157d95e4a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: e48d8482-b411-41d3-acab-2505e7521d63] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:16.253952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f230d4d6-7462-4e66-b085-6f157d95e4a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:16.254690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f230d4d6-7462-4e66-b085-6f157d95e4a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:16.259071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f230d4d6-7462-4e66-b085-6f157d95e4a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:16.260036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f230d4d6-7462-4e66-b085-6f157d95e4a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:16.260872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f230d4d6-7462-4e66-b085-6f157d95e4a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:16.261556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f230d4d6-7462-4e66-b085-6f157d95e4a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:16.520527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f230d4d6-7462-4e66-b085-6f157d95e4a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:16.558819 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f230d4d6-7462-4e66-b085-6f157d95e4a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63" status: 200 len: 1319 microversion: 2.1 time: 0.326799 Oct 04 21:28:16.561306 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2243/4498] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:16 2022] GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63 => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:16.576039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-70a8c859-1a21-4d46-99de-8a6bef2c34e4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-70a8c859-1a21-4d46-99de-8a6bef2c34e4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 416 Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'networks': [{'uuid': '6854610d-7b7e-44e1-90bf-b66a6b17f7da'}]}}} Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:16.590045 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:16.599702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-70a8c859-1a21-4d46-99de-8a6bef2c34e4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:16.602593 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-70a8c859-1a21-4d46-99de-8a6bef2c34e4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.029482 Oct 04 21:28:16.602593 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2244/4499] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:28:16 2022] POST /compute/v2.1/servers => generated 619 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:28:16.610865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f1509be5-6a41-4ee2-a483-47f1ba3aa4b5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:16.615858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f1509be5-6a41-4ee2-a483-47f1ba3aa4b5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:16.634508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1509be5-6a41-4ee2-a483-47f1ba3aa4b5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:16.635951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1509be5-6a41-4ee2-a483-47f1ba3aa4b5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:16.637690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1509be5-6a41-4ee2-a483-47f1ba3aa4b5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:16.640251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1509be5-6a41-4ee2-a483-47f1ba3aa4b5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:16.641259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1509be5-6a41-4ee2-a483-47f1ba3aa4b5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:16.641982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1509be5-6a41-4ee2-a483-47f1ba3aa4b5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:17.125107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f1509be5-6a41-4ee2-a483-47f1ba3aa4b5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:17.134875 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f1509be5-6a41-4ee2-a483-47f1ba3aa4b5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.527815 Oct 04 21:28:17.138739 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2245/4500] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:16 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:17.163825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-b818e12e-a8d9-4e08-8780-2b30716a459a tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:28:17.167250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-b818e12e-a8d9-4e08-8780-2b30716a459a tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:28:17.167958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-b818e12e-a8d9-4e08-8780-2b30716a459a tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:28:17.169240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-86e03299-1157-4666-8c9d-2a51dfb902e8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:17.169870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-b818e12e-a8d9-4e08-8780-2b30716a459a tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:28:17.170213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-86e03299-1157-4666-8c9d-2a51dfb902e8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:17.170341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-b818e12e-a8d9-4e08-8780-2b30716a459a tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:28:17.187267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86e03299-1157-4666-8c9d-2a51dfb902e8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:17.187989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86e03299-1157-4666-8c9d-2a51dfb902e8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:17.188633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86e03299-1157-4666-8c9d-2a51dfb902e8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:17.189555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86e03299-1157-4666-8c9d-2a51dfb902e8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:17.190426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86e03299-1157-4666-8c9d-2a51dfb902e8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:17.191146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86e03299-1157-4666-8c9d-2a51dfb902e8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:17.204925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b818e12e-a8d9-4e08-8780-2b30716a459a tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:17.205821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b818e12e-a8d9-4e08-8780-2b30716a459a tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:17.208925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b818e12e-a8d9-4e08-8780-2b30716a459a tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:17.210936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b818e12e-a8d9-4e08-8780-2b30716a459a tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:17.212210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b818e12e-a8d9-4e08-8780-2b30716a459a tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:17.214558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b818e12e-a8d9-4e08-8780-2b30716a459a tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:17.264193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-b818e12e-a8d9-4e08-8780-2b30716a459a tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Getting quotas for project bbce00070c7e40489a4b3dc76bf2d0e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:28:17.295004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-b818e12e-a8d9-4e08-8780-2b30716a459a tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Getting quotas for user 0de918301f494171b6ebdb04323a9894 and project bbce00070c7e40489a4b3dc76bf2d0e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:28:17.333236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b818e12e-a8d9-4e08-8780-2b30716a459a tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:28:17.343925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b818e12e-a8d9-4e08-8780-2b30716a459a tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] [instance: 55b962f0-2136-4bd9-bf4d-a0b207f1f495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:28:17.516848 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b818e12e-a8d9-4e08-8780-2b30716a459a tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.867526 Oct 04 21:28:17.521794 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2256/4501] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:28:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:28:17.541798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-80929db1-2ee4-42f0-93e9-dc151b1de5ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:17.542437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-80929db1-2ee4-42f0-93e9-dc151b1de5ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:17.554968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80929db1-2ee4-42f0-93e9-dc151b1de5ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:17.555708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80929db1-2ee4-42f0-93e9-dc151b1de5ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:17.556327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80929db1-2ee4-42f0-93e9-dc151b1de5ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:17.557376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80929db1-2ee4-42f0-93e9-dc151b1de5ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:17.558065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80929db1-2ee4-42f0-93e9-dc151b1de5ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:17.561500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80929db1-2ee4-42f0-93e9-dc151b1de5ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:18.034083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-86e03299-1157-4666-8c9d-2a51dfb902e8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:18.046896 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-86e03299-1157-4666-8c9d-2a51dfb902e8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.882905 Oct 04 21:28:18.062834 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2246/4502] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:17 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:28:18.062834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-45464c50-7559-4430-b78b-46eec3868b44 req-45ce5d4f-5b59-4546-8bbd-b1e4f950ccfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70dc9fb-d2fe-433b-b46a-c296c126ce5e", "name": "network-vif-plugged", "status": "completed", "tag": "fd475cd3-9ea0-4313-9dea-2d1ee1f543ce"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:18.101659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-45464c50-7559-4430-b78b-46eec3868b44 req-45ce5d4f-5b59-4546-8bbd-b1e4f950ccfe service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:18.102156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-45464c50-7559-4430-b78b-46eec3868b44 req-45ce5d4f-5b59-4546-8bbd-b1e4f950ccfe service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:18.102641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-45464c50-7559-4430-b78b-46eec3868b44 req-45ce5d4f-5b59-4546-8bbd-b1e4f950ccfe service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:18.163060 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-45464c50-7559-4430-b78b-46eec3868b44 req-45ce5d4f-5b59-4546-8bbd-b1e4f950ccfe service nova] Creating event network-vif-plugged:fd475cd3-9ea0-4313-9dea-2d1ee1f543ce for instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e on n-h2-860282-1 Oct 04 21:28:18.183646 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-45464c50-7559-4430-b78b-46eec3868b44 req-45ce5d4f-5b59-4546-8bbd-b1e4f950ccfe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118518 Oct 04 21:28:18.185281 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2247/4503] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:28:18.220452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-47cbc937-bef7-46be-97c8-bfb85c43aa86 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:18.227190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-47cbc937-bef7-46be-97c8-bfb85c43aa86 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] [instance: 55b962f0-2136-4bd9-bf4d-a0b207f1f495] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:18.663406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-47cbc937-bef7-46be-97c8-bfb85c43aa86 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de918301f494171b6ebdb04323a9894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbce00070c7e40489a4b3dc76bf2d0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:18.682328 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-47cbc937-bef7-46be-97c8-bfb85c43aa86 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] 10.222.0.30 "GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495" status: 200 len: 1216 microversion: 2.1 time: 0.476239 Oct 04 21:28:18.682972 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2248/4504] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:18 2022] GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495 => generated 1216 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:18.711732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ab3a9be4-eb2c-4f74-b4fb-69a8bc88c2d5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:18.715248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ab3a9be4-eb2c-4f74-b4fb-69a8bc88c2d5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: e48d8482-b411-41d3-acab-2505e7521d63] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:18.737283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab3a9be4-eb2c-4f74-b4fb-69a8bc88c2d5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:18.742653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab3a9be4-eb2c-4f74-b4fb-69a8bc88c2d5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:18.742653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab3a9be4-eb2c-4f74-b4fb-69a8bc88c2d5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:18.743177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab3a9be4-eb2c-4f74-b4fb-69a8bc88c2d5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:18.743904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab3a9be4-eb2c-4f74-b4fb-69a8bc88c2d5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:18.744610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab3a9be4-eb2c-4f74-b4fb-69a8bc88c2d5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:18.973390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-80929db1-2ee4-42f0-93e9-dc151b1de5ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:18.993210 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-80929db1-2ee4-42f0-93e9-dc151b1de5ec tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1315 microversion: 2.1 time: 1.463383 Oct 04 21:28:19.000959 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2257/4505] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:17 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1315 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:19.015787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ab3a9be4-eb2c-4f74-b4fb-69a8bc88c2d5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:19.048820 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ab3a9be4-eb2c-4f74-b4fb-69a8bc88c2d5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63" status: 200 len: 1307 microversion: 2.1 time: 0.343676 Oct 04 21:28:19.054150 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2249/4506] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:18 2022] GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63 => generated 1307 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:19.056768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8a7c1823-2481-411b-b197-17f91316c79e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1715459370", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": -1, "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:19.085641 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-8a7c1823-2481-411b-b197-17f91316c79e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Flavor -1 could not be found. Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8a7c1823-2481-411b-b197-17f91316c79e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 206 Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1715459370", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": -1, "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: exception: Flavor -1 could not be found. Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1715459370', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': -1, 'networks': [{'uuid': '6854610d-7b7e-44e1-90bf-b66a6b17f7da'}]}}} Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:19.094238 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8a7c1823-2481-411b-b197-17f91316c79e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8a7c1823-2481-411b-b197-17f91316c79e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.054658 Oct 04 21:28:19.098515 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2258/4507] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:28:19 2022] POST /compute/v2.1/servers => generated 73 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:28:19.123326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a3be2076-3a7e-4c26-9e5f-c97fd5d1d4d9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:19.128035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a3be2076-3a7e-4c26-9e5f-c97fd5d1d4d9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:19.137762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3be2076-3a7e-4c26-9e5f-c97fd5d1d4d9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:19.138450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3be2076-3a7e-4c26-9e5f-c97fd5d1d4d9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:19.138909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3be2076-3a7e-4c26-9e5f-c97fd5d1d4d9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:19.139634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3be2076-3a7e-4c26-9e5f-c97fd5d1d4d9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:19.140153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3be2076-3a7e-4c26-9e5f-c97fd5d1d4d9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:19.140594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3be2076-3a7e-4c26-9e5f-c97fd5d1d4d9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:19.178535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:19.558269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a3be2076-3a7e-4c26-9e5f-c97fd5d1d4d9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:19.568842 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a3be2076-3a7e-4c26-9e5f-c97fd5d1d4d9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.467992 Oct 04 21:28:19.569843 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2250/4508] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:19 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:19.608014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fe4824b0-42a0-4027-8315-48adb904c450 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:19.608578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fe4824b0-42a0-4027-8315-48adb904c450 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:19.626203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe4824b0-42a0-4027-8315-48adb904c450 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:19.626953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe4824b0-42a0-4027-8315-48adb904c450 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:19.628603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe4824b0-42a0-4027-8315-48adb904c450 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:19.629561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe4824b0-42a0-4027-8315-48adb904c450 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:19.632922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe4824b0-42a0-4027-8315-48adb904c450 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:19.637097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe4824b0-42a0-4027-8315-48adb904c450 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:19.708543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1cee04ae-0cfa-47c5-9a6c-7a716c1f2a2d tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:19.709866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1cee04ae-0cfa-47c5-9a6c-7a716c1f2a2d tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] [instance: 55b962f0-2136-4bd9-bf4d-a0b207f1f495] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:19.721088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cee04ae-0cfa-47c5-9a6c-7a716c1f2a2d tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:19.727308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cee04ae-0cfa-47c5-9a6c-7a716c1f2a2d tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:19.727947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cee04ae-0cfa-47c5-9a6c-7a716c1f2a2d tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:19.737945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cee04ae-0cfa-47c5-9a6c-7a716c1f2a2d tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:19.738792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cee04ae-0cfa-47c5-9a6c-7a716c1f2a2d tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:19.740203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cee04ae-0cfa-47c5-9a6c-7a716c1f2a2d tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:19.988571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1cee04ae-0cfa-47c5-9a6c-7a716c1f2a2d tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de918301f494171b6ebdb04323a9894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbce00070c7e40489a4b3dc76bf2d0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:20.004476 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1cee04ae-0cfa-47c5-9a6c-7a716c1f2a2d tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] 10.222.0.30 "GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495" status: 200 len: 1220 microversion: 2.1 time: 0.300153 Oct 04 21:28:20.018716 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2251/4509] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:19 2022] GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495 => generated 1220 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:28:20.043751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-82e04925-470b-422c-8e1f-b9a535d0ec7b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-99113663", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "190c6763-99fd-44cb-b129-3df385e2e67a"}, {"port": "a034a9b0-c92a-4d81-bced-4e3be86dabfe", "tag": "port-1"}, {"port": "894d7765-eae0-4e33-8784-9f8532801474", "tag": "port-2"}, {"uuid": "1c939f05-2f71-476f-8c73-e04ca2145dc2", "tag": "net-1"}, {"uuid": "1c939f05-2f71-476f-8c73-e04ca2145dc2"}, {"uuid": "6588fc9a-a06c-4e8e-bc6c-f8cc01e2731a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6588fc9a-a06c-4e8e-bc6c-f8cc01e2731a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "1aeccdbb-0425-46de-b89f-0daf77fa2eaf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "fe4a0ed9-c985-46bb-b0bd-b922902b9061", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "84e98bd8-e516-451a-8a7a-d5171cdd6dac", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--69652687"}], "key_name": "tempest-keypair-1290707702", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:20.251905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fe4824b0-42a0-4027-8315-48adb904c450 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:20.264233 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fe4824b0-42a0-4027-8315-48adb904c450 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.663855 Oct 04 21:28:20.265409 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2259/4510] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:19 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:20.271619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-29e2d6ef-28a0-4237-9309-9c39471f4888 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:20.272509 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-29e2d6ef-28a0-4237-9309-9c39471f4888 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:20.291796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29e2d6ef-28a0-4237-9309-9c39471f4888 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:20.293381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29e2d6ef-28a0-4237-9309-9c39471f4888 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:20.294462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29e2d6ef-28a0-4237-9309-9c39471f4888 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:20.295423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29e2d6ef-28a0-4237-9309-9c39471f4888 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:20.296088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29e2d6ef-28a0-4237-9309-9c39471f4888 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:20.296717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29e2d6ef-28a0-4237-9309-9c39471f4888 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:20.409339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-82e04925-470b-422c-8e1f-b9a535d0ec7b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] validate_networks() for [('190c6763-99fd-44cb-b129-3df385e2e67a', None, None, None, None, None), (None, None, 'a034a9b0-c92a-4d81-bced-4e3be86dabfe', None, None, None), (None, None, '894d7765-eae0-4e33-8784-9f8532801474', None, None, None), ('1c939f05-2f71-476f-8c73-e04ca2145dc2', None, None, None, None, None), ('1c939f05-2f71-476f-8c73-e04ca2145dc2', None, None, None, None, None), ('6588fc9a-a06c-4e8e-bc6c-f8cc01e2731a', '10.2.2.100', None, None, None, None), ('6588fc9a-a06c-4e8e-bc6c-f8cc01e2731a', '10.2.2.200', None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:28:21.638258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-29e2d6ef-28a0-4237-9309-9c39471f4888 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:21.651644 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-29e2d6ef-28a0-4237-9309-9c39471f4888 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1315 microversion: 2.1 time: 1.384600 Oct 04 21:28:21.653018 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2260/4511] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:20 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1315 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:21.659420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-875cac4a-0d6d-43ef-8204-306182b19a90 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:21.660423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-875cac4a-0d6d-43ef-8204-306182b19a90 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: e48d8482-b411-41d3-acab-2505e7521d63] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:21.668450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-875cac4a-0d6d-43ef-8204-306182b19a90 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:21.669484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-875cac4a-0d6d-43ef-8204-306182b19a90 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:21.670178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-875cac4a-0d6d-43ef-8204-306182b19a90 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:21.671203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-875cac4a-0d6d-43ef-8204-306182b19a90 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:21.671891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-875cac4a-0d6d-43ef-8204-306182b19a90 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:21.672555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-875cac4a-0d6d-43ef-8204-306182b19a90 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:22.302721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-875cac4a-0d6d-43ef-8204-306182b19a90 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:22.314152 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-875cac4a-0d6d-43ef-8204-306182b19a90 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63" status: 200 len: 1374 microversion: 2.1 time: 0.659107 Oct 04 21:28:22.321776 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2261/4512] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:21 2022] GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63 => generated 1374 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:22.637288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e7c0c824-8c2a-468d-8250-889e5c2607cf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-587447862", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "3b0f95b8-a55a-4c88-8cc3-cbcc3969f9ab"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:22.729336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-e7c0c824-8c2a-468d-8250-889e5c2607cf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] validate_networks() for [('3b0f95b8-a55a-4c88-8cc3-cbcc3969f9ab', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:28:24.968178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e7c0c824-8c2a-468d-8250-889e5c2607cf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:28:24.972074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e7c0c824-8c2a-468d-8250-889e5c2607cf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:28:24.972074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e7c0c824-8c2a-468d-8250-889e5c2607cf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:28:24.972074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e7c0c824-8c2a-468d-8250-889e5c2607cf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:28:24.972074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e7c0c824-8c2a-468d-8250-889e5c2607cf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:28:24.985685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7c0c824-8c2a-468d-8250-889e5c2607cf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:24.986196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7c0c824-8c2a-468d-8250-889e5c2607cf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:24.986831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7c0c824-8c2a-468d-8250-889e5c2607cf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:24.988014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7c0c824-8c2a-468d-8250-889e5c2607cf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:24.988503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7c0c824-8c2a-468d-8250-889e5c2607cf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:24.989127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e7c0c824-8c2a-468d-8250-889e5c2607cf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:25.025331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-e7c0c824-8c2a-468d-8250-889e5c2607cf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Getting quotas for project f315fab8318a4c9f84f0b39ce233ee57. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:28:25.032687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-e7c0c824-8c2a-468d-8250-889e5c2607cf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Getting quotas for user de17081946dc4da8864f5338123b6ed1 and project f315fab8318a4c9f84f0b39ce233ee57. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:28:25.051145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e7c0c824-8c2a-468d-8250-889e5c2607cf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:28:25.054791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e7c0c824-8c2a-468d-8250-889e5c2607cf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:28:25.212719 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e7c0c824-8c2a-468d-8250-889e5c2607cf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.889267 Oct 04 21:28:25.216674 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2262/4513] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:28:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:28:25.219631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-01457537-fdd4-4f8a-8e99-17328a193cdb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1811110799", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-01457537-fdd4-4f8a-8e99-17328a193cdb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 173 Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1811110799", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1811110799', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '6854610d-7b7e-44e1-90bf-b66a6b17f7da'}]}}} Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi -1 Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:28:25.224875 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:28:25.230652 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:28:25.230652 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:28:25.230652 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:28:25.230652 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 21:28:25.230652 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:25.230652 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:25.230652 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:25.230652 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:25.230652 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:25.230652 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:25.230652 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:28:25.230652 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:28:25.230652 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 21:28:25.230652 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:25.234233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-01457537-fdd4-4f8a-8e99-17328a193cdb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:25.235321 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-01457537-fdd4-4f8a-8e99-17328a193cdb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.020065 Oct 04 21:28:25.239509 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2263/4514] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:28:25 2022] POST /compute/v2.1/servers => generated 145 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:28:25.246346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3862c8d4-fdeb-44eb-b077-af5e648959e7 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:25.253756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3862c8d4-fdeb-44eb-b077-af5e648959e7 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] [instance: 55b962f0-2136-4bd9-bf4d-a0b207f1f495] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:25.259286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3862c8d4-fdeb-44eb-b077-af5e648959e7 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:25.259998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3862c8d4-fdeb-44eb-b077-af5e648959e7 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:25.260648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3862c8d4-fdeb-44eb-b077-af5e648959e7 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:25.262782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3862c8d4-fdeb-44eb-b077-af5e648959e7 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:25.264525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3862c8d4-fdeb-44eb-b077-af5e648959e7 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:25.265522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3862c8d4-fdeb-44eb-b077-af5e648959e7 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:26.988358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3862c8d4-fdeb-44eb-b077-af5e648959e7 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de918301f494171b6ebdb04323a9894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbce00070c7e40489a4b3dc76bf2d0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:26.998007 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3862c8d4-fdeb-44eb-b077-af5e648959e7 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] 10.222.0.30 "GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495" status: 200 len: 1316 microversion: 2.1 time: 1.757030 Oct 04 21:28:27.001533 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2264/4515] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:25 2022] GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495 => generated 1316 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:27.012671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bc973d98-8890-4dc4-b900-63000461cd40 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:27.016040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bc973d98-8890-4dc4-b900-63000461cd40 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:27.034825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc973d98-8890-4dc4-b900-63000461cd40 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:27.035516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc973d98-8890-4dc4-b900-63000461cd40 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:27.036079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc973d98-8890-4dc4-b900-63000461cd40 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:27.037004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc973d98-8890-4dc4-b900-63000461cd40 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:27.037658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc973d98-8890-4dc4-b900-63000461cd40 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:27.038360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc973d98-8890-4dc4-b900-63000461cd40 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:27.696787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bc973d98-8890-4dc4-b900-63000461cd40 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:27.748907 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bc973d98-8890-4dc4-b900-63000461cd40 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1503 microversion: 2.1 time: 0.740638 Oct 04 21:28:27.750038 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2265/4516] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:27 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1503 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:27.760440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6e0b9d1e-7068-4ea0-8411-e151555fe08e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:27.764139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6e0b9d1e-7068-4ea0-8411-e151555fe08e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: e48d8482-b411-41d3-acab-2505e7521d63] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:27.777540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e0b9d1e-7068-4ea0-8411-e151555fe08e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:27.779023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e0b9d1e-7068-4ea0-8411-e151555fe08e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:27.788182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e0b9d1e-7068-4ea0-8411-e151555fe08e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:27.798660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e0b9d1e-7068-4ea0-8411-e151555fe08e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:27.800477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e0b9d1e-7068-4ea0-8411-e151555fe08e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:27.801244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e0b9d1e-7068-4ea0-8411-e151555fe08e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:28.675228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=10 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:28.677914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6e0b9d1e-7068-4ea0-8411-e151555fe08e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:28.687271 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6e0b9d1e-7068-4ea0-8411-e151555fe08e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63" status: 200 len: 1374 microversion: 2.1 time: 0.936046 Oct 04 21:28:28.689674 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2266/4517] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:27 2022] GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63 => generated 1374 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:28.709354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-d0fb57f5-6850-44dc-a83e-f77c3344210e req-5b6403e1-1ff1-49c1-90bb-b7e30580a37e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e48d8482-b411-41d3-acab-2505e7521d63", "tag": "7624b45b-ac4c-4dca-9048-d041c68ca170"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:28.724467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d0fb57f5-6850-44dc-a83e-f77c3344210e req-5b6403e1-1ff1-49c1-90bb-b7e30580a37e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:28.733823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d0fb57f5-6850-44dc-a83e-f77c3344210e req-5b6403e1-1ff1-49c1-90bb-b7e30580a37e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:28.738837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d0fb57f5-6850-44dc-a83e-f77c3344210e req-5b6403e1-1ff1-49c1-90bb-b7e30580a37e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:28.756539 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-d0fb57f5-6850-44dc-a83e-f77c3344210e req-5b6403e1-1ff1-49c1-90bb-b7e30580a37e service nova] Creating event network-changed:7624b45b-ac4c-4dca-9048-d041c68ca170 for instance e48d8482-b411-41d3-acab-2505e7521d63 on n-h1-860282-1 Oct 04 21:28:28.762344 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-d0fb57f5-6850-44dc-a83e-f77c3344210e req-5b6403e1-1ff1-49c1-90bb-b7e30580a37e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059267 Oct 04 21:28:28.763054 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2267/4518] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:28:28.780273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f936db59-4930-40e0-9515-d34e779a0770 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:28.781205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f936db59-4930-40e0-9515-d34e779a0770 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:28.788803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f936db59-4930-40e0-9515-d34e779a0770 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:28.793046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f936db59-4930-40e0-9515-d34e779a0770 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:28.793046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f936db59-4930-40e0-9515-d34e779a0770 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:28.793046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f936db59-4930-40e0-9515-d34e779a0770 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:28.793046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f936db59-4930-40e0-9515-d34e779a0770 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:28.793046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f936db59-4930-40e0-9515-d34e779a0770 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:29.551127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f936db59-4930-40e0-9515-d34e779a0770 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:29.569866 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f936db59-4930-40e0-9515-d34e779a0770 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.794609 Oct 04 21:28:29.570475 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2268/4519] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:28 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:29.593046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e2b7a9c1-1459-4e12-b7f8-0ae6d1b5a004 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-739868563", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "3b0f95b8-a55a-4c88-8cc3-cbcc3969f9ab"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:29.725369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-e2b7a9c1-1459-4e12-b7f8-0ae6d1b5a004 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] validate_networks() for [('3b0f95b8-a55a-4c88-8cc3-cbcc3969f9ab', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:28:29.994129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=9 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:30.491156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-82e04925-470b-422c-8e1f-b9a535d0ec7b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:28:30.496993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-82e04925-470b-422c-8e1f-b9a535d0ec7b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:28:30.496993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-82e04925-470b-422c-8e1f-b9a535d0ec7b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:28:30.496993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-82e04925-470b-422c-8e1f-b9a535d0ec7b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:28:30.496993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-82e04925-470b-422c-8e1f-b9a535d0ec7b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:28:30.501751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:30.557974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82e04925-470b-422c-8e1f-b9a535d0ec7b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:30.558479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82e04925-470b-422c-8e1f-b9a535d0ec7b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:30.558933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82e04925-470b-422c-8e1f-b9a535d0ec7b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:30.562174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82e04925-470b-422c-8e1f-b9a535d0ec7b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:30.562922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82e04925-470b-422c-8e1f-b9a535d0ec7b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:30.563546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82e04925-470b-422c-8e1f-b9a535d0ec7b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:30.613748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-82e04925-470b-422c-8e1f-b9a535d0ec7b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Getting quotas for project a8479b5f07f048e6ac713898fa3ad78d. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:28:30.628887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-82e04925-470b-422c-8e1f-b9a535d0ec7b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Getting quotas for user e97fbecf827246dc8dd8ab24e418cff3 and project a8479b5f07f048e6ac713898fa3ad78d. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:28:30.978448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-82e04925-470b-422c-8e1f-b9a535d0ec7b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:28:30.981939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-82e04925-470b-422c-8e1f-b9a535d0ec7b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='1aeccdbb-0425-46de-b89f-0daf77fa2eaf',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='fe4a0ed9-c985-46bb-b0bd-b922902b9061',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84e98bd8-e516-451a-8a7a-d5171cdd6dac',volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:28:31.793245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e2b7a9c1-1459-4e12-b7f8-0ae6d1b5a004 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:28:31.794001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e2b7a9c1-1459-4e12-b7f8-0ae6d1b5a004 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:28:31.795012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e2b7a9c1-1459-4e12-b7f8-0ae6d1b5a004 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:28:31.795664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e2b7a9c1-1459-4e12-b7f8-0ae6d1b5a004 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:28:31.796145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e2b7a9c1-1459-4e12-b7f8-0ae6d1b5a004 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:28:31.808934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2b7a9c1-1459-4e12-b7f8-0ae6d1b5a004 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:31.809521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2b7a9c1-1459-4e12-b7f8-0ae6d1b5a004 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:31.814299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2b7a9c1-1459-4e12-b7f8-0ae6d1b5a004 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:31.814299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2b7a9c1-1459-4e12-b7f8-0ae6d1b5a004 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:31.814299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2b7a9c1-1459-4e12-b7f8-0ae6d1b5a004 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:31.814299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2b7a9c1-1459-4e12-b7f8-0ae6d1b5a004 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:31.840385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-e2b7a9c1-1459-4e12-b7f8-0ae6d1b5a004 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Getting quotas for project f315fab8318a4c9f84f0b39ce233ee57. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:28:31.852613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-e2b7a9c1-1459-4e12-b7f8-0ae6d1b5a004 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Getting quotas for user de17081946dc4da8864f5338123b6ed1 and project f315fab8318a4c9f84f0b39ce233ee57. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:28:31.893603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e2b7a9c1-1459-4e12-b7f8-0ae6d1b5a004 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:28:31.901383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e2b7a9c1-1459-4e12-b7f8-0ae6d1b5a004 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: db85fc78-9a76-401a-89fc-c92d828ae8d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:28:32.097547 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e2b7a9c1-1459-4e12-b7f8-0ae6d1b5a004 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.514584 Oct 04 21:28:32.097827 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2269/4520] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:28:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:28:32.103689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c8b6e06c-5e05-4b30-b11c-56aa34b90a88 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:32.104427 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c8b6e06c-5e05-4b30-b11c-56aa34b90a88 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:32.138562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8b6e06c-5e05-4b30-b11c-56aa34b90a88 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:32.144907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8b6e06c-5e05-4b30-b11c-56aa34b90a88 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:32.146892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8b6e06c-5e05-4b30-b11c-56aa34b90a88 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:32.150228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8b6e06c-5e05-4b30-b11c-56aa34b90a88 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:32.153405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8b6e06c-5e05-4b30-b11c-56aa34b90a88 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:32.154749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8b6e06c-5e05-4b30-b11c-56aa34b90a88 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:32.204827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:32.209560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-c8b6e06c-5e05-4b30-b11c-56aa34b90a88 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lazy-loading 'flavor' on Instance uuid f70dc9fb-d2fe-433b-b46a-c296c126ce5e {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:28:32.509067 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-82e04925-470b-422c-8e1f-b9a535d0ec7b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 12.488888 Oct 04 21:28:32.510520 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2252/4521] 10.222.0.30 () {62 vars in 1189 bytes} [Tue Oct 4 21:28:20 2022] POST /compute/v2.1/servers => generated 404 bytes in 12491 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:28:32.516250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f56b444b-f539-43b7-8e95-841ffead3d69 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:32.517542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f56b444b-f539-43b7-8e95-841ffead3d69 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] [instance: 55b962f0-2136-4bd9-bf4d-a0b207f1f495] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:32.525555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f56b444b-f539-43b7-8e95-841ffead3d69 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:32.526369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f56b444b-f539-43b7-8e95-841ffead3d69 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:32.527467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f56b444b-f539-43b7-8e95-841ffead3d69 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:32.528482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f56b444b-f539-43b7-8e95-841ffead3d69 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:32.529129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f56b444b-f539-43b7-8e95-841ffead3d69 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:32.529773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f56b444b-f539-43b7-8e95-841ffead3d69 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:32.605536 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c8b6e06c-5e05-4b30-b11c-56aa34b90a88 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "POST /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e/action" status: 202 len: 0 microversion: 2.1 time: 0.505846 Oct 04 21:28:32.610971 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2270/4522] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:28:32 2022] POST /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:28:32.617845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cb419bf2-46ae-40d6-9cd9-5646bfbe64cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:32.618873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cb419bf2-46ae-40d6-9cd9-5646bfbe64cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:32.628848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb419bf2-46ae-40d6-9cd9-5646bfbe64cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:32.629739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb419bf2-46ae-40d6-9cd9-5646bfbe64cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:32.631419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb419bf2-46ae-40d6-9cd9-5646bfbe64cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:32.632519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb419bf2-46ae-40d6-9cd9-5646bfbe64cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:32.633260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb419bf2-46ae-40d6-9cd9-5646bfbe64cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:32.633934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb419bf2-46ae-40d6-9cd9-5646bfbe64cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:33.317006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cb419bf2-46ae-40d6-9cd9-5646bfbe64cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:33.319620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f56b444b-f539-43b7-8e95-841ffead3d69 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de918301f494171b6ebdb04323a9894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbce00070c7e40489a4b3dc76bf2d0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:33.330958 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cb419bf2-46ae-40d6-9cd9-5646bfbe64cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.717216 Oct 04 21:28:33.334679 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2271/4523] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:32 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:33.354467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-11132786-631e-45f2-8f6f-edf701b4b765 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:33.355766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-11132786-631e-45f2-8f6f-edf701b4b765 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: e48d8482-b411-41d3-acab-2505e7521d63] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:33.360884 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f56b444b-f539-43b7-8e95-841ffead3d69 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] 10.222.0.30 "GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495" status: 200 len: 1316 microversion: 2.1 time: 0.849006 Oct 04 21:28:33.382255 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2253/4524] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:32 2022] GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495 => generated 1316 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:33.383142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-11132786-631e-45f2-8f6f-edf701b4b765 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:33.384053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-11132786-631e-45f2-8f6f-edf701b4b765 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:33.384192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-11132786-631e-45f2-8f6f-edf701b4b765 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:33.387161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-6d149785-4189-4d47-b136-873ffaaef1b0 req-7858aac7-237f-4514-bccc-996de42aa1e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55b962f0-2136-4bd9-bf4d-a0b207f1f495", "tag": "8965e7e8-2aff-4dbd-911f-346ddae3c1f6"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:33.389697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-11132786-631e-45f2-8f6f-edf701b4b765 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:33.390207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-11132786-631e-45f2-8f6f-edf701b4b765 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:33.406880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-11132786-631e-45f2-8f6f-edf701b4b765 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:33.407799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6d149785-4189-4d47-b136-873ffaaef1b0 req-7858aac7-237f-4514-bccc-996de42aa1e1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:33.407799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6d149785-4189-4d47-b136-873ffaaef1b0 req-7858aac7-237f-4514-bccc-996de42aa1e1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:33.407799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6d149785-4189-4d47-b136-873ffaaef1b0 req-7858aac7-237f-4514-bccc-996de42aa1e1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:33.422583 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-6d149785-4189-4d47-b136-873ffaaef1b0 req-7858aac7-237f-4514-bccc-996de42aa1e1 service nova] Creating event network-changed:8965e7e8-2aff-4dbd-911f-346ddae3c1f6 for instance 55b962f0-2136-4bd9-bf4d-a0b207f1f495 on n-h2-860282-1 Oct 04 21:28:33.435049 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-6d149785-4189-4d47-b136-873ffaaef1b0 req-7858aac7-237f-4514-bccc-996de42aa1e1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051403 Oct 04 21:28:33.438465 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2254/4525] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:28:33.458536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c2ab078f-5eb9-4eaa-8e14-edd918f7f66f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-457758359", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "451", "networks": [{"uuid": "3b0f95b8-a55a-4c88-8cc3-cbcc3969f9ab"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:33.552341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-c2ab078f-5eb9-4eaa-8e14-edd918f7f66f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] validate_networks() for [('3b0f95b8-a55a-4c88-8cc3-cbcc3969f9ab', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:28:34.185640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-11132786-631e-45f2-8f6f-edf701b4b765 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:34.194232 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-11132786-631e-45f2-8f6f-edf701b4b765 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63" status: 200 len: 1374 microversion: 2.1 time: 0.858186 Oct 04 21:28:34.196999 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2272/4526] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:33 2022] GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63 => generated 1374 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:34.226608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-82be35f3-1701-4dff-80ab-859c622980d0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:34.234430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-82be35f3-1701-4dff-80ab-859c622980d0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:34.487166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-82be35f3-1701-4dff-80ab-859c622980d0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:34.502444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-82be35f3-1701-4dff-80ab-859c622980d0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:34.503989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-82be35f3-1701-4dff-80ab-859c622980d0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:34.505215 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-82be35f3-1701-4dff-80ab-859c622980d0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1284 microversion: 2.42 time: 0.304280 Oct 04 21:28:34.521641 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2273/4527] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:34 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1284 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:34.521641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9f324dd3-78f2-4ca6-8b3e-35ea13578de4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:34.521641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9f324dd3-78f2-4ca6-8b3e-35ea13578de4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:34.532025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f324dd3-78f2-4ca6-8b3e-35ea13578de4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:34.532524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f324dd3-78f2-4ca6-8b3e-35ea13578de4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:34.533031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f324dd3-78f2-4ca6-8b3e-35ea13578de4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:34.538428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f324dd3-78f2-4ca6-8b3e-35ea13578de4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:34.538957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f324dd3-78f2-4ca6-8b3e-35ea13578de4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:34.540608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f324dd3-78f2-4ca6-8b3e-35ea13578de4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:34.593885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c2ab078f-5eb9-4eaa-8e14-edd918f7f66f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:28:34.594436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c2ab078f-5eb9-4eaa-8e14-edd918f7f66f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:28:34.595020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c2ab078f-5eb9-4eaa-8e14-edd918f7f66f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:28:34.596114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c2ab078f-5eb9-4eaa-8e14-edd918f7f66f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:28:34.596775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c2ab078f-5eb9-4eaa-8e14-edd918f7f66f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:28:34.613292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2ab078f-5eb9-4eaa-8e14-edd918f7f66f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:34.613825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2ab078f-5eb9-4eaa-8e14-edd918f7f66f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:34.626298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2ab078f-5eb9-4eaa-8e14-edd918f7f66f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:34.627933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2ab078f-5eb9-4eaa-8e14-edd918f7f66f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:34.627933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2ab078f-5eb9-4eaa-8e14-edd918f7f66f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:34.628102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2ab078f-5eb9-4eaa-8e14-edd918f7f66f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:34.661269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-c2ab078f-5eb9-4eaa-8e14-edd918f7f66f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Getting quotas for project f315fab8318a4c9f84f0b39ce233ee57. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:28:34.685859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-c2ab078f-5eb9-4eaa-8e14-edd918f7f66f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Getting quotas for user de17081946dc4da8864f5338123b6ed1 and project f315fab8318a4c9f84f0b39ce233ee57. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:28:34.710298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c2ab078f-5eb9-4eaa-8e14-edd918f7f66f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:28:34.713821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c2ab078f-5eb9-4eaa-8e14-edd918f7f66f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:28:34.763799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9f324dd3-78f2-4ca6-8b3e-35ea13578de4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:34.775489 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9f324dd3-78f2-4ca6-8b3e-35ea13578de4 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1494 microversion: 2.1 time: 0.268108 Oct 04 21:28:34.776574 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2274/4528] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:34 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1494 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:34.782017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4ad73c55-df98-4d44-8f54-3d3f674bcb28 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-398128360", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:34.788669 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-4ad73c55-df98-4d44-8f54-3d3f674bcb28 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4ad73c55-df98-4d44-8f54-3d3f674bcb28 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 215 Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-398128360", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-398128360', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:34.792424 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:34.797446 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:34.797446 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:34.797446 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:34.797446 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:34.797446 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:34.797446 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:34.797446 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 21:28:34.797446 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:34.819748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4ad73c55-df98-4d44-8f54-3d3f674bcb28 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:34.820833 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4ad73c55-df98-4d44-8f54-3d3f674bcb28 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.043027 Oct 04 21:28:34.826590 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2275/4529] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:28:34 2022] POST /compute/v2.1/servers => generated 123 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:28:34.848832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-76ce62f0-6d3d-4b1f-aeff-a1da8256a7d0 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:34.856665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-76ce62f0-6d3d-4b1f-aeff-a1da8256a7d0 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] [instance: 55b962f0-2136-4bd9-bf4d-a0b207f1f495] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:34.904202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76ce62f0-6d3d-4b1f-aeff-a1da8256a7d0 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:34.904202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76ce62f0-6d3d-4b1f-aeff-a1da8256a7d0 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:34.904202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76ce62f0-6d3d-4b1f-aeff-a1da8256a7d0 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:34.904202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76ce62f0-6d3d-4b1f-aeff-a1da8256a7d0 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:34.904202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76ce62f0-6d3d-4b1f-aeff-a1da8256a7d0 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:34.904202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76ce62f0-6d3d-4b1f-aeff-a1da8256a7d0 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:34.924814 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c2ab078f-5eb9-4eaa-8e14-edd918f7f66f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.484287 Oct 04 21:28:34.931330 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2255/4530] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:28:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:28:34.984333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8e0532bd-a3ce-469a-a5bc-34480c5820a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:34.986847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8e0532bd-a3ce-469a-a5bc-34480c5820a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:35.031121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e0532bd-a3ce-469a-a5bc-34480c5820a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:35.031626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e0532bd-a3ce-469a-a5bc-34480c5820a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:35.032213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e0532bd-a3ce-469a-a5bc-34480c5820a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:35.045743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e0532bd-a3ce-469a-a5bc-34480c5820a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:35.046260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e0532bd-a3ce-469a-a5bc-34480c5820a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:35.046733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e0532bd-a3ce-469a-a5bc-34480c5820a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:35.141128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8e0532bd-a3ce-469a-a5bc-34480c5820a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:28:35.677800 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8e0532bd-a3ce-469a-a5bc-34480c5820a1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 204 len: 0 microversion: 2.1 time: 0.728103 Oct 04 21:28:35.679107 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2256/4531] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:28:34 2022] DELETE /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 0 bytes in 747 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:28:35.685259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4198d9ec-92e9-47e1-935f-b473366d6891 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:35.686265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4198d9ec-92e9-47e1-935f-b473366d6891 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:35.714103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4198d9ec-92e9-47e1-935f-b473366d6891 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:35.724699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4198d9ec-92e9-47e1-935f-b473366d6891 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:35.727909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4198d9ec-92e9-47e1-935f-b473366d6891 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:35.728858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4198d9ec-92e9-47e1-935f-b473366d6891 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:35.729492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4198d9ec-92e9-47e1-935f-b473366d6891 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:35.736862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4198d9ec-92e9-47e1-935f-b473366d6891 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:35.788056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-76ce62f0-6d3d-4b1f-aeff-a1da8256a7d0 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de918301f494171b6ebdb04323a9894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbce00070c7e40489a4b3dc76bf2d0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:35.803111 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-76ce62f0-6d3d-4b1f-aeff-a1da8256a7d0 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] 10.222.0.30 "GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495" status: 200 len: 1316 microversion: 2.1 time: 0.974968 Oct 04 21:28:35.811307 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2276/4532] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:34 2022] GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495 => generated 1316 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:35.832673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-85304808-eb44-4d06-988d-e0bc28beecd8 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:35.833331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-85304808-eb44-4d06-988d-e0bc28beecd8 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:35.877922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:36.101763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-85304808-eb44-4d06-988d-e0bc28beecd8 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:36.106316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=29 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:36.119441 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-85304808-eb44-4d06-988d-e0bc28beecd8 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 200 len: 1220 microversion: 2.1 time: 0.303606 Oct 04 21:28:36.137149 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2277/4533] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:35 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 1220 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:36.143702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-60429377-03e4-40c3-9afe-6ebf2369f15d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:36.145204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-60429377-03e4-40c3-9afe-6ebf2369f15d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: e48d8482-b411-41d3-acab-2505e7521d63] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:36.165932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60429377-03e4-40c3-9afe-6ebf2369f15d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:36.168830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60429377-03e4-40c3-9afe-6ebf2369f15d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:36.169529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60429377-03e4-40c3-9afe-6ebf2369f15d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:36.170459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60429377-03e4-40c3-9afe-6ebf2369f15d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:36.171831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60429377-03e4-40c3-9afe-6ebf2369f15d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:36.179684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60429377-03e4-40c3-9afe-6ebf2369f15d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:36.225172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4198d9ec-92e9-47e1-935f-b473366d6891 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:36.240630 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4198d9ec-92e9-47e1-935f-b473366d6891 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.557322 Oct 04 21:28:36.241633 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2257/4534] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:35 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:36.255165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fc901450-bf4b-4551-bea5-27dda98b7ae9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:36.256250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fc901450-bf4b-4551-bea5-27dda98b7ae9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:36.288520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc901450-bf4b-4551-bea5-27dda98b7ae9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:36.291169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc901450-bf4b-4551-bea5-27dda98b7ae9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:36.291666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc901450-bf4b-4551-bea5-27dda98b7ae9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:36.294470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc901450-bf4b-4551-bea5-27dda98b7ae9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:36.294470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc901450-bf4b-4551-bea5-27dda98b7ae9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:36.300552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc901450-bf4b-4551-bea5-27dda98b7ae9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:36.519759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fc901450-bf4b-4551-bea5-27dda98b7ae9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:36.561156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fc901450-bf4b-4551-bea5-27dda98b7ae9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:36.567337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fc901450-bf4b-4551-bea5-27dda98b7ae9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:36.573301 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fc901450-bf4b-4551-bea5-27dda98b7ae9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1518 microversion: 2.42 time: 0.328261 Oct 04 21:28:36.578411 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2258/4535] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:36 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1518 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:36.602317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-53c06703-899a-4591-88a3-5d2a46984891 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:36.605311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-53c06703-899a-4591-88a3-5d2a46984891 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:36.614110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53c06703-899a-4591-88a3-5d2a46984891 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:36.615092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53c06703-899a-4591-88a3-5d2a46984891 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:36.616209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53c06703-899a-4591-88a3-5d2a46984891 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:36.617781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53c06703-899a-4591-88a3-5d2a46984891 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:36.618787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53c06703-899a-4591-88a3-5d2a46984891 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:36.619560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53c06703-899a-4591-88a3-5d2a46984891 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:36.753247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-60429377-03e4-40c3-9afe-6ebf2369f15d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:36.765054 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-60429377-03e4-40c3-9afe-6ebf2369f15d tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63" status: 200 len: 1374 microversion: 2.1 time: 0.626331 Oct 04 21:28:36.781461 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2278/4536] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:36 2022] GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63 => generated 1374 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:36.783760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2a8d1f2c-b041-4002-b737-9043b7f06abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:36.793077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2a8d1f2c-b041-4002-b737-9043b7f06abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:36.805977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a8d1f2c-b041-4002-b737-9043b7f06abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:36.805977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a8d1f2c-b041-4002-b737-9043b7f06abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:36.805977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a8d1f2c-b041-4002-b737-9043b7f06abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:36.805977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a8d1f2c-b041-4002-b737-9043b7f06abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:36.805977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a8d1f2c-b041-4002-b737-9043b7f06abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:36.805977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a8d1f2c-b041-4002-b737-9043b7f06abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:37.263555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-53c06703-899a-4591-88a3-5d2a46984891 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:37.278253 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-53c06703-899a-4591-88a3-5d2a46984891 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1500 microversion: 2.1 time: 0.697081 Oct 04 21:28:37.280822 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2259/4537] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:36 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1500 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:37.300723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-7ed03907-5d3b-47d5-bbe3-04b018fa10b2 req-ed1d16b6-34aa-4487-8667-1548b628fb98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48d8482-b411-41d3-acab-2505e7521d63", "name": "network-vif-plugged", "status": "completed", "tag": "7624b45b-ac4c-4dca-9048-d041c68ca170"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:37.323869 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-7ed03907-5d3b-47d5-bbe3-04b018fa10b2 req-ed1d16b6-34aa-4487-8667-1548b628fb98 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:37.324644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-7ed03907-5d3b-47d5-bbe3-04b018fa10b2 req-ed1d16b6-34aa-4487-8667-1548b628fb98 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:37.325298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-7ed03907-5d3b-47d5-bbe3-04b018fa10b2 req-ed1d16b6-34aa-4487-8667-1548b628fb98 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:37.354612 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-7ed03907-5d3b-47d5-bbe3-04b018fa10b2 req-ed1d16b6-34aa-4487-8667-1548b628fb98 service nova] Creating event network-vif-plugged:7624b45b-ac4c-4dca-9048-d041c68ca170 for instance e48d8482-b411-41d3-acab-2505e7521d63 on n-h1-860282-1 Oct 04 21:28:37.365833 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-7ed03907-5d3b-47d5-bbe3-04b018fa10b2 req-ed1d16b6-34aa-4487-8667-1548b628fb98 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081376 Oct 04 21:28:37.369887 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2260/4538] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:28:37.378719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-19d39ac3-21f4-409d-8a45-cd61da16bae7 req-2b348d22-6462-49cf-9f55-39825d451169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11842dec-199c-4673-99ef-286d7f858e1b", "tag": "f9b6d7bc-4a67-4957-a540-4bc24b3633e1"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:37.394923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-19d39ac3-21f4-409d-8a45-cd61da16bae7 req-2b348d22-6462-49cf-9f55-39825d451169 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:37.395936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-19d39ac3-21f4-409d-8a45-cd61da16bae7 req-2b348d22-6462-49cf-9f55-39825d451169 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:37.396582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-19d39ac3-21f4-409d-8a45-cd61da16bae7 req-2b348d22-6462-49cf-9f55-39825d451169 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:37.425600 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-19d39ac3-21f4-409d-8a45-cd61da16bae7 req-2b348d22-6462-49cf-9f55-39825d451169 service nova] Creating event network-changed:f9b6d7bc-4a67-4957-a540-4bc24b3633e1 for instance 11842dec-199c-4673-99ef-286d7f858e1b on n-h1-860282-1 Oct 04 21:28:37.432421 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-19d39ac3-21f4-409d-8a45-cd61da16bae7 req-2b348d22-6462-49cf-9f55-39825d451169 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060714 Oct 04 21:28:37.433829 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2261/4539] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:28:37.441216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cc9d236c-8d70-42c5-b5e2-e57d52795ac6 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:37.448097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cc9d236c-8d70-42c5-b5e2-e57d52795ac6 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] [instance: 55b962f0-2136-4bd9-bf4d-a0b207f1f495] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:37.472566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc9d236c-8d70-42c5-b5e2-e57d52795ac6 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:37.476665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc9d236c-8d70-42c5-b5e2-e57d52795ac6 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:37.476665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc9d236c-8d70-42c5-b5e2-e57d52795ac6 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:37.476665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc9d236c-8d70-42c5-b5e2-e57d52795ac6 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:37.476665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc9d236c-8d70-42c5-b5e2-e57d52795ac6 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:37.476665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc9d236c-8d70-42c5-b5e2-e57d52795ac6 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:37.839706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2a8d1f2c-b041-4002-b737-9043b7f06abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:37.856903 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2a8d1f2c-b041-4002-b737-9043b7f06abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 1.082438 Oct 04 21:28:37.858160 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2279/4540] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:36 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:37.868426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1e8e1198-3fbe-4e70-9773-1a5444d04b49 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:37.888975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1e8e1198-3fbe-4e70-9773-1a5444d04b49 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:37.898069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e8e1198-3fbe-4e70-9773-1a5444d04b49 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:37.898960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e8e1198-3fbe-4e70-9773-1a5444d04b49 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:37.899657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e8e1198-3fbe-4e70-9773-1a5444d04b49 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:37.900616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e8e1198-3fbe-4e70-9773-1a5444d04b49 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:37.901312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e8e1198-3fbe-4e70-9773-1a5444d04b49 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:37.902104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e8e1198-3fbe-4e70-9773-1a5444d04b49 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:38.239013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1e8e1198-3fbe-4e70-9773-1a5444d04b49 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:38.248991 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1e8e1198-3fbe-4e70-9773-1a5444d04b49 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 200 len: 1216 microversion: 2.1 time: 0.386167 Oct 04 21:28:38.250261 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2280/4541] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:37 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 1216 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:38.279586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-515ca621-93a6-4b49-9eed-c787fc6a102e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:38.279586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-515ca621-93a6-4b49-9eed-c787fc6a102e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:38.288645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-515ca621-93a6-4b49-9eed-c787fc6a102e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:38.289150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-515ca621-93a6-4b49-9eed-c787fc6a102e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:38.289634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-515ca621-93a6-4b49-9eed-c787fc6a102e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:38.290610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-515ca621-93a6-4b49-9eed-c787fc6a102e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:38.291080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-515ca621-93a6-4b49-9eed-c787fc6a102e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:38.291517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-515ca621-93a6-4b49-9eed-c787fc6a102e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:38.370830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cc9d236c-8d70-42c5-b5e2-e57d52795ac6 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de918301f494171b6ebdb04323a9894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbce00070c7e40489a4b3dc76bf2d0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:38.381456 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cc9d236c-8d70-42c5-b5e2-e57d52795ac6 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] 10.222.0.30 "GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495" status: 200 len: 1316 microversion: 2.1 time: 0.945288 Oct 04 21:28:38.384371 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2262/4542] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:37 2022] GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495 => generated 1316 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:38.389193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-14d99fa4-f1bf-4e6d-85ba-9302446e6959 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:38.389905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-14d99fa4-f1bf-4e6d-85ba-9302446e6959 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: e48d8482-b411-41d3-acab-2505e7521d63] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:38.398052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14d99fa4-f1bf-4e6d-85ba-9302446e6959 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:38.398774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14d99fa4-f1bf-4e6d-85ba-9302446e6959 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:38.399417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14d99fa4-f1bf-4e6d-85ba-9302446e6959 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:38.402821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14d99fa4-f1bf-4e6d-85ba-9302446e6959 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:38.403514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14d99fa4-f1bf-4e6d-85ba-9302446e6959 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:38.404868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14d99fa4-f1bf-4e6d-85ba-9302446e6959 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:38.424692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-515ca621-93a6-4b49-9eed-c787fc6a102e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:38.445454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-515ca621-93a6-4b49-9eed-c787fc6a102e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:38.447773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-515ca621-93a6-4b49-9eed-c787fc6a102e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:38.451353 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-515ca621-93a6-4b49-9eed-c787fc6a102e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1574 microversion: 2.42 time: 0.197515 Oct 04 21:28:38.453310 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2281/4543] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:38 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1574 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:38.506951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aaeffbee-5665-4494-9490-a7b51ff11c86 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1262512821", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "key_name": "tempest-key-376317000", "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:38.624426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-aaeffbee-5665-4494-9490-a7b51ff11c86 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] validate_networks() for [('6854610d-7b7e-44e1-90bf-b66a6b17f7da', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:28:38.845243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-14d99fa4-f1bf-4e6d-85ba-9302446e6959 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:38.877693 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-14d99fa4-f1bf-4e6d-85ba-9302446e6959 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63" status: 200 len: 1374 microversion: 2.1 time: 0.491179 Oct 04 21:28:38.880187 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2263/4544] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:38 2022] GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63 => generated 1374 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:38.887678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f5e824c5-c630-4016-a2be-f0efdfcf0f06 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:38.888748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f5e824c5-c630-4016-a2be-f0efdfcf0f06 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:38.899187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5e824c5-c630-4016-a2be-f0efdfcf0f06 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:38.900387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5e824c5-c630-4016-a2be-f0efdfcf0f06 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:38.901146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5e824c5-c630-4016-a2be-f0efdfcf0f06 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:38.902548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5e824c5-c630-4016-a2be-f0efdfcf0f06 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:38.905719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5e824c5-c630-4016-a2be-f0efdfcf0f06 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:38.906517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5e824c5-c630-4016-a2be-f0efdfcf0f06 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:39.647794 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-aaeffbee-5665-4494-9490-a7b51ff11c86 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Invalid key_name provided. Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aaeffbee-5665-4494-9490-a7b51ff11c86 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 246 Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1262512821", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "key_name": "tempest-key-376317000", "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid key_name provided. Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1262512821', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'key_name': 'tempest-key-376317000', 'networks': [{'uuid': '6854610d-7b7e-44e1-90bf-b66a6b17f7da'}]}}} Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-376317000 not found for user 3022b1f60e82428482675f26d2621f39 Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:39.649940 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 04 21:28:39.654734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:39.657278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aaeffbee-5665-4494-9490-a7b51ff11c86 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 400 to user: Invalid key_name provided. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:39.660044 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-aaeffbee-5665-4494-9490-a7b51ff11c86 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.169505 Oct 04 21:28:39.663111 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2282/4545] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:28:38 2022] POST /compute/v2.1/servers => generated 70 bytes in 1209 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 21:28:39.670622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f5e824c5-c630-4016-a2be-f0efdfcf0f06 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:39.672912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-308851de-5b27-4fe3-9b3d-d990663136c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:39.676835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-308851de-5b27-4fe3-9b3d-d990663136c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:39.682798 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f5e824c5-c630-4016-a2be-f0efdfcf0f06 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1500 microversion: 2.1 time: 0.800539 Oct 04 21:28:39.684011 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2264/4546] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:38 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1500 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:39.695029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-b3afc4e0-6993-44f8-b818-590f1c93a33f req-d51fde37-a076-45a6-a142-cccc82dedba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55b962f0-2136-4bd9-bf4d-a0b207f1f495", "name": "network-vif-plugged", "status": "completed", "tag": "8965e7e8-2aff-4dbd-911f-346ddae3c1f6"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:39.707288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-308851de-5b27-4fe3-9b3d-d990663136c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:39.713278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-308851de-5b27-4fe3-9b3d-d990663136c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:39.714392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-308851de-5b27-4fe3-9b3d-d990663136c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:39.715333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-308851de-5b27-4fe3-9b3d-d990663136c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:39.716435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-308851de-5b27-4fe3-9b3d-d990663136c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:39.717058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-308851de-5b27-4fe3-9b3d-d990663136c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:39.728849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b3afc4e0-6993-44f8-b818-590f1c93a33f req-d51fde37-a076-45a6-a142-cccc82dedba7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:39.731839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b3afc4e0-6993-44f8-b818-590f1c93a33f req-d51fde37-a076-45a6-a142-cccc82dedba7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:39.732881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b3afc4e0-6993-44f8-b818-590f1c93a33f req-d51fde37-a076-45a6-a142-cccc82dedba7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:39.836620 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-b3afc4e0-6993-44f8-b818-590f1c93a33f req-d51fde37-a076-45a6-a142-cccc82dedba7 service nova] Creating event network-vif-plugged:8965e7e8-2aff-4dbd-911f-346ddae3c1f6 for instance 55b962f0-2136-4bd9-bf4d-a0b207f1f495 on n-h2-860282-1 Oct 04 21:28:39.856035 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-b3afc4e0-6993-44f8-b818-590f1c93a33f req-d51fde37-a076-45a6-a142-cccc82dedba7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167417 Oct 04 21:28:39.857304 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2265/4547] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:28:39.875197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9d23921f-5c0a-4109-808f-f292e83a89de tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:39.875197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9d23921f-5c0a-4109-808f-f292e83a89de tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] [instance: 55b962f0-2136-4bd9-bf4d-a0b207f1f495] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:39.896492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d23921f-5c0a-4109-808f-f292e83a89de tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:39.899190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d23921f-5c0a-4109-808f-f292e83a89de tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:39.900901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d23921f-5c0a-4109-808f-f292e83a89de tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:39.905482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d23921f-5c0a-4109-808f-f292e83a89de tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:39.906188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d23921f-5c0a-4109-808f-f292e83a89de tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:39.912215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d23921f-5c0a-4109-808f-f292e83a89de tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:40.152456 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-308851de-5b27-4fe3-9b3d-d990663136c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:40.170934 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-308851de-5b27-4fe3-9b3d-d990663136c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 200 len: 1272 microversion: 2.1 time: 0.506474 Oct 04 21:28:40.181739 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2283/4548] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:39 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 1272 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:40.195430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-20ebe1ed-dbea-4512-98c8-a0dcf3055cba tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:40.196074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-20ebe1ed-dbea-4512-98c8-a0dcf3055cba tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:40.218409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20ebe1ed-dbea-4512-98c8-a0dcf3055cba tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:40.218923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20ebe1ed-dbea-4512-98c8-a0dcf3055cba tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:40.219377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20ebe1ed-dbea-4512-98c8-a0dcf3055cba tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:40.220112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20ebe1ed-dbea-4512-98c8-a0dcf3055cba tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:40.221144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20ebe1ed-dbea-4512-98c8-a0dcf3055cba tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:40.221656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20ebe1ed-dbea-4512-98c8-a0dcf3055cba tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:40.794917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-20ebe1ed-dbea-4512-98c8-a0dcf3055cba tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:40.813031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-20ebe1ed-dbea-4512-98c8-a0dcf3055cba tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:40.820379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-20ebe1ed-dbea-4512-98c8-a0dcf3055cba tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:40.824538 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-20ebe1ed-dbea-4512-98c8-a0dcf3055cba tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1592 microversion: 2.42 time: 0.638804 Oct 04 21:28:40.825992 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2284/4549] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:40 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1592 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:40.832032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dcacf3da-2b85-4666-ab41-36d7fe455ff4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:40.832877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dcacf3da-2b85-4666-ab41-36d7fe455ff4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:40.840156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcacf3da-2b85-4666-ab41-36d7fe455ff4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:40.845165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcacf3da-2b85-4666-ab41-36d7fe455ff4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:40.846104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcacf3da-2b85-4666-ab41-36d7fe455ff4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:40.847066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcacf3da-2b85-4666-ab41-36d7fe455ff4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:40.849043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcacf3da-2b85-4666-ab41-36d7fe455ff4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:40.850426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcacf3da-2b85-4666-ab41-36d7fe455ff4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:41.302395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9d23921f-5c0a-4109-808f-f292e83a89de tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de918301f494171b6ebdb04323a9894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbce00070c7e40489a4b3dc76bf2d0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:41.317332 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9d23921f-5c0a-4109-808f-f292e83a89de tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] 10.222.0.30 "GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495" status: 200 len: 1316 microversion: 2.1 time: 1.458674 Oct 04 21:28:41.318872 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2266/4550] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:39 2022] GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495 => generated 1316 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:41.326282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-82517a93-57ad-4071-839b-6940c77cde3e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:41.327287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-82517a93-57ad-4071-839b-6940c77cde3e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: e48d8482-b411-41d3-acab-2505e7521d63] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:41.335165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82517a93-57ad-4071-839b-6940c77cde3e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:41.342797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82517a93-57ad-4071-839b-6940c77cde3e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:41.343657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82517a93-57ad-4071-839b-6940c77cde3e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:41.344648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82517a93-57ad-4071-839b-6940c77cde3e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:41.345224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82517a93-57ad-4071-839b-6940c77cde3e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:41.346633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82517a93-57ad-4071-839b-6940c77cde3e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:41.830093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:42.049518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dcacf3da-2b85-4666-ab41-36d7fe455ff4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:42.071717 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dcacf3da-2b85-4666-ab41-36d7fe455ff4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 1.243270 Oct 04 21:28:42.076175 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2285/4551] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:40 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:42.088064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-85963c65-f7ca-4494-97cc-9d3577ed6fcd req-e1d28273-54e8-490b-a872-72d8aee82f85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70dc9fb-d2fe-433b-b46a-c296c126ce5e", "name": "network-vif-deleted", "tag": "fd475cd3-9ea0-4313-9dea-2d1ee1f543ce"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:42.111850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-85963c65-f7ca-4494-97cc-9d3577ed6fcd req-e1d28273-54e8-490b-a872-72d8aee82f85 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:42.112875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-85963c65-f7ca-4494-97cc-9d3577ed6fcd req-e1d28273-54e8-490b-a872-72d8aee82f85 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:42.113598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-85963c65-f7ca-4494-97cc-9d3577ed6fcd req-e1d28273-54e8-490b-a872-72d8aee82f85 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:42.130080 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-85963c65-f7ca-4494-97cc-9d3577ed6fcd req-e1d28273-54e8-490b-a872-72d8aee82f85 service nova] Creating event network-vif-deleted:fd475cd3-9ea0-4313-9dea-2d1ee1f543ce for instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e on n-h2-860282-1 Oct 04 21:28:42.139654 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-85963c65-f7ca-4494-97cc-9d3577ed6fcd req-e1d28273-54e8-490b-a872-72d8aee82f85 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059844 Oct 04 21:28:42.141705 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2286/4552] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:28:42.150596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5cd748e5-777b-47da-b0cd-9024d5ee80e7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:42.152668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5cd748e5-777b-47da-b0cd-9024d5ee80e7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:42.163326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd748e5-777b-47da-b0cd-9024d5ee80e7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:42.164281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd748e5-777b-47da-b0cd-9024d5ee80e7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:42.166596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd748e5-777b-47da-b0cd-9024d5ee80e7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:42.167740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd748e5-777b-47da-b0cd-9024d5ee80e7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:42.168732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd748e5-777b-47da-b0cd-9024d5ee80e7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:42.169468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd748e5-777b-47da-b0cd-9024d5ee80e7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:42.236907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-82517a93-57ad-4071-839b-6940c77cde3e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:42.254750 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-82517a93-57ad-4071-839b-6940c77cde3e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63" status: 200 len: 1546 microversion: 2.1 time: 0.933888 Oct 04 21:28:42.258549 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2267/4553] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:41 2022] GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63 => generated 1546 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:42.267564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c09e0edf-3096-4c28-a9d0-ac92e16a17ba tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:42.268561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c09e0edf-3096-4c28-a9d0-ac92e16a17ba tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:42.283751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c09e0edf-3096-4c28-a9d0-ac92e16a17ba tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:42.300026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c09e0edf-3096-4c28-a9d0-ac92e16a17ba tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:42.303230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c09e0edf-3096-4c28-a9d0-ac92e16a17ba tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:42.304770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c09e0edf-3096-4c28-a9d0-ac92e16a17ba tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:42.304893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd748e5-777b-47da-b0cd-9024d5ee80e7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:42.305344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd748e5-777b-47da-b0cd-9024d5ee80e7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:42.306159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd748e5-777b-47da-b0cd-9024d5ee80e7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:42.306556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c09e0edf-3096-4c28-a9d0-ac92e16a17ba tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:42.306992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-5cd748e5-777b-47da-b0cd-9024d5ee80e7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lazy-loading 'fault' on Instance uuid f70dc9fb-d2fe-433b-b46a-c296c126ce5e {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:28:42.307554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c09e0edf-3096-4c28-a9d0-ac92e16a17ba tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:42.399895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5cd748e5-777b-47da-b0cd-9024d5ee80e7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416e0c617ee34a19a7d6936b78c1d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c56e6603d14d9b8ad9c74a9df021c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:42.411145 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5cd748e5-777b-47da-b0cd-9024d5ee80e7 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 200 len: 1305 microversion: 2.1 time: 0.267615 Oct 04 21:28:42.412904 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2287/4554] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:42 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 1305 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:42.431156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1a22b191-e14b-459f-aacb-8e1f669b9fc4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:42.432219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1a22b191-e14b-459f-aacb-8e1f669b9fc4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:42.436526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c09e0edf-3096-4c28-a9d0-ac92e16a17ba tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:42.441460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a22b191-e14b-459f-aacb-8e1f669b9fc4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:42.442389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a22b191-e14b-459f-aacb-8e1f669b9fc4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:42.443784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a22b191-e14b-459f-aacb-8e1f669b9fc4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:42.444754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a22b191-e14b-459f-aacb-8e1f669b9fc4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:42.445465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a22b191-e14b-459f-aacb-8e1f669b9fc4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:42.446277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a22b191-e14b-459f-aacb-8e1f669b9fc4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:42.475482 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c09e0edf-3096-4c28-a9d0-ac92e16a17ba tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 200 len: 1278 microversion: 2.1 time: 0.215518 Oct 04 21:28:42.481476 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2268/4555] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:42 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 1278 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:42.496079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-48b6bd28-7c6d-4b2c-9f28-19d5165a59da tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:42.502451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-48b6bd28-7c6d-4b2c-9f28-19d5165a59da tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:42.520442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48b6bd28-7c6d-4b2c-9f28-19d5165a59da tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:42.522245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48b6bd28-7c6d-4b2c-9f28-19d5165a59da tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:42.522727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48b6bd28-7c6d-4b2c-9f28-19d5165a59da tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:42.525691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48b6bd28-7c6d-4b2c-9f28-19d5165a59da tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:42.526174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48b6bd28-7c6d-4b2c-9f28-19d5165a59da tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:42.530190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48b6bd28-7c6d-4b2c-9f28-19d5165a59da tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:42.799371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1a22b191-e14b-459f-aacb-8e1f669b9fc4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:42.827190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1a22b191-e14b-459f-aacb-8e1f669b9fc4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:42.828882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1a22b191-e14b-459f-aacb-8e1f669b9fc4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:42.830716 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1a22b191-e14b-459f-aacb-8e1f669b9fc4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1592 microversion: 2.42 time: 0.414827 Oct 04 21:28:42.832257 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2288/4556] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:42 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1592 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:42.837102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2a4ee95c-2c2a-4aa7-9b90-662d42123a5e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:42.847869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2a4ee95c-2c2a-4aa7-9b90-662d42123a5e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: e48d8482-b411-41d3-acab-2505e7521d63] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:42.854449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a4ee95c-2c2a-4aa7-9b90-662d42123a5e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:42.855188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a4ee95c-2c2a-4aa7-9b90-662d42123a5e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:42.855818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a4ee95c-2c2a-4aa7-9b90-662d42123a5e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:42.856716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a4ee95c-2c2a-4aa7-9b90-662d42123a5e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:42.857348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a4ee95c-2c2a-4aa7-9b90-662d42123a5e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:42.857972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a4ee95c-2c2a-4aa7-9b90-662d42123a5e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:42.906473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-48b6bd28-7c6d-4b2c-9f28-19d5165a59da tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:42.922195 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-48b6bd28-7c6d-4b2c-9f28-19d5165a59da tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.439313 Oct 04 21:28:42.922776 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2269/4557] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:42 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:42.928266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9ca76d0-5e95-4e94-ae11-937294ec8938 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:42.942363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d9ca76d0-5e95-4e94-ae11-937294ec8938 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] [instance: 55b962f0-2136-4bd9-bf4d-a0b207f1f495] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:42.948870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9ca76d0-5e95-4e94-ae11-937294ec8938 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:42.949659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9ca76d0-5e95-4e94-ae11-937294ec8938 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:42.950293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9ca76d0-5e95-4e94-ae11-937294ec8938 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:42.951190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9ca76d0-5e95-4e94-ae11-937294ec8938 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:42.951822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9ca76d0-5e95-4e94-ae11-937294ec8938 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:42.952416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9ca76d0-5e95-4e94-ae11-937294ec8938 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:43.398416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d9ca76d0-5e95-4e94-ae11-937294ec8938 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de918301f494171b6ebdb04323a9894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbce00070c7e40489a4b3dc76bf2d0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:43.405024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:43.415297 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d9ca76d0-5e95-4e94-ae11-937294ec8938 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] 10.222.0.30 "GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495" status: 200 len: 1505 microversion: 2.1 time: 0.490451 Oct 04 21:28:43.418795 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2270/4558] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:42 2022] GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495 => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:43.428317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2a4ee95c-2c2a-4aa7-9b90-662d42123a5e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:43.435975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:43.451269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a5be7c06-3e0e-44a5-9aed-577567069a7c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1703536110", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:43.454306 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2a4ee95c-2c2a-4aa7-9b90-662d42123a5e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63" status: 200 len: 1546 microversion: 2.1 time: 0.620764 Oct 04 21:28:43.460116 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2289/4559] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:42 2022] GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63 => generated 1546 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:43.480091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-157c2ccc-dd7a-41d7-9caa-d44465c9d705 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:43.484578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-157c2ccc-dd7a-41d7-9caa-d44465c9d705 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:43.510301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-157c2ccc-dd7a-41d7-9caa-d44465c9d705 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:43.516502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-157c2ccc-dd7a-41d7-9caa-d44465c9d705 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:43.518652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-157c2ccc-dd7a-41d7-9caa-d44465c9d705 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:43.523797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-157c2ccc-dd7a-41d7-9caa-d44465c9d705 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:43.525804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-157c2ccc-dd7a-41d7-9caa-d44465c9d705 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:43.527857 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-157c2ccc-dd7a-41d7-9caa-d44465c9d705 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:43.586235 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-157c2ccc-dd7a-41d7-9caa-d44465c9d705 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e could not be found. Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-157c2ccc-dd7a-41d7-9caa-d44465c9d705 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e HTTP/1.1 Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e could not be found. Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'f70dc9fb-d2fe-433b-b46a-c296c126ce5e'} Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e could not be found. Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e could not be found. Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:43.590677 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.602254 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:43.602254 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:43.602254 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:43.602254 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:43.602254 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:43.602254 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e could not be found. Oct 04 21:28:43.602254 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.602254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-157c2ccc-dd7a-41d7-9caa-d44465c9d705 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:43.607354 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-157c2ccc-dd7a-41d7-9caa-d44465c9d705 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 404 len: 111 microversion: 2.1 time: 0.130904 Oct 04 21:28:43.608739 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2290/4560] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:43 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:43.625809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-17f098c9-e9f9-440a-9f93-03480765c9ad tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:43.627800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-17f098c9-e9f9-440a-9f93-03480765c9ad tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] [instance: 55b962f0-2136-4bd9-bf4d-a0b207f1f495] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:43.651552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f098c9-e9f9-440a-9f93-03480765c9ad tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:43.652662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f098c9-e9f9-440a-9f93-03480765c9ad tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:43.653330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f098c9-e9f9-440a-9f93-03480765c9ad tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:43.654601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f098c9-e9f9-440a-9f93-03480765c9ad tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:43.669092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f098c9-e9f9-440a-9f93-03480765c9ad tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:43.670389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17f098c9-e9f9-440a-9f93-03480765c9ad tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:43.696267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.security_group_api [None req-a5be7c06-3e0e-44a5-9aed-577567069a7c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Neutron security group does_not_exist not found {{(pid=122758) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 04 21:28:43.696267 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-a5be7c06-3e0e-44a5-9aed-577567069a7c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a5be7c06-3e0e-44a5-9aed-577567069a7c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 258 Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1703536110", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1703536110', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '6854610d-7b7e-44e1-90bf-b66a6b17f7da'}]}}} Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 04 21:28:43.700900 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.709052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a5be7c06-3e0e-44a5-9aed-577567069a7c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:43.723327 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a5be7c06-3e0e-44a5-9aed-577567069a7c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.282774 Oct 04 21:28:43.723327 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2271/4561] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:28:43 2022] POST /compute/v2.1/servers => generated 106 bytes in 288 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:28:43.723327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4de97545-800b-452d-afc9-33eb000030c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:43.723327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4de97545-800b-452d-afc9-33eb000030c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:43.724666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4de97545-800b-452d-afc9-33eb000030c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:43.725171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4de97545-800b-452d-afc9-33eb000030c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:43.725800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4de97545-800b-452d-afc9-33eb000030c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:43.726529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4de97545-800b-452d-afc9-33eb000030c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:43.727035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4de97545-800b-452d-afc9-33eb000030c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:43.727638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4de97545-800b-452d-afc9-33eb000030c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:43.748527 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-17f098c9-e9f9-440a-9f93-03480765c9ad tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] 10.222.0.30 "GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495/ips" status: 200 len: 109 microversion: 2.1 time: 0.138155 Oct 04 21:28:43.753326 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2291/4562] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Oct 4 21:28:43 2022] GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495/ips => generated 109 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:28:43.765741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c3a33663-9df0-449f-a591-44a4c55ff0c1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:43.767018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c3a33663-9df0-449f-a591-44a4c55ff0c1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:43.775182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3a33663-9df0-449f-a591-44a4c55ff0c1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:43.775998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3a33663-9df0-449f-a591-44a4c55ff0c1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:43.777120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3a33663-9df0-449f-a591-44a4c55ff0c1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:43.778205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3a33663-9df0-449f-a591-44a4c55ff0c1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:43.778848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3a33663-9df0-449f-a591-44a4c55ff0c1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:43.779598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3a33663-9df0-449f-a591-44a4c55ff0c1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:43.803815 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-c3a33663-9df0-449f-a591-44a4c55ff0c1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e could not be found. Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c3a33663-9df0-449f-a591-44a4c55ff0c1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e HTTP/1.1 Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e could not be found. Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'f70dc9fb-d2fe-433b-b46a-c296c126ce5e'} Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e could not be found. Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:43.806491 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:43.811356 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e could not be found. Oct 04 21:28:43.811356 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.811356 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:43.811356 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.811356 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:43.811356 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:43.811356 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:43.811356 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:43.811356 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:43.811356 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e could not be found. Oct 04 21:28:43.811356 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:43.811356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c3a33663-9df0-449f-a591-44a4c55ff0c1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:43.811356 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c3a33663-9df0-449f-a591-44a4c55ff0c1 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 404 len: 111 microversion: 2.1 time: 0.059287 Oct 04 21:28:43.813449 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2292/4563] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:28:43 2022] DELETE /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:43.820496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-829d94fb-3fed-4f7e-931d-6cf145379dfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:43.826937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-829d94fb-3fed-4f7e-931d-6cf145379dfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:43.833639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-829d94fb-3fed-4f7e-931d-6cf145379dfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:43.835156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-829d94fb-3fed-4f7e-931d-6cf145379dfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:43.835796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-829d94fb-3fed-4f7e-931d-6cf145379dfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:43.837132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-829d94fb-3fed-4f7e-931d-6cf145379dfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:43.837800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-829d94fb-3fed-4f7e-931d-6cf145379dfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:43.839083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-829d94fb-3fed-4f7e-931d-6cf145379dfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:43.885534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4de97545-800b-452d-afc9-33eb000030c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:43.901841 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4de97545-800b-452d-afc9-33eb000030c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 200 len: 1278 microversion: 2.1 time: 0.185136 Oct 04 21:28:43.903279 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2272/4564] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:43 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 1278 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:43.921576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-66d7bf56-66db-4ea7-b8e1-a2ea0dde65fd req-9ffdefac-9a36-4362-a193-324255ad4382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db85fc78-9a76-401a-89fc-c92d828ae8d4", "tag": "2e5eca04-7b74-4aba-820d-7f1cab5ba85d"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:43.949990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-66d7bf56-66db-4ea7-b8e1-a2ea0dde65fd req-9ffdefac-9a36-4362-a193-324255ad4382 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:43.950765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-66d7bf56-66db-4ea7-b8e1-a2ea0dde65fd req-9ffdefac-9a36-4362-a193-324255ad4382 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:43.951213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-66d7bf56-66db-4ea7-b8e1-a2ea0dde65fd req-9ffdefac-9a36-4362-a193-324255ad4382 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:44.007037 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-66d7bf56-66db-4ea7-b8e1-a2ea0dde65fd req-9ffdefac-9a36-4362-a193-324255ad4382 service nova] Creating event network-changed:2e5eca04-7b74-4aba-820d-7f1cab5ba85d for instance db85fc78-9a76-401a-89fc-c92d828ae8d4 on n-h2-860282-1 Oct 04 21:28:44.035045 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-66d7bf56-66db-4ea7-b8e1-a2ea0dde65fd req-9ffdefac-9a36-4362-a193-324255ad4382 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130125 Oct 04 21:28:44.041046 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2273/4565] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:28:44.052640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-03484a9a-3c79-45f7-ad4d-bfc03de6d46c tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:44.053809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-03484a9a-3c79-45f7-ad4d-bfc03de6d46c tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] [instance: 55b962f0-2136-4bd9-bf4d-a0b207f1f495] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:44.065295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03484a9a-3c79-45f7-ad4d-bfc03de6d46c tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:44.065823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03484a9a-3c79-45f7-ad4d-bfc03de6d46c tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:44.066268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03484a9a-3c79-45f7-ad4d-bfc03de6d46c tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:44.066985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03484a9a-3c79-45f7-ad4d-bfc03de6d46c tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:44.067446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03484a9a-3c79-45f7-ad4d-bfc03de6d46c tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:44.067875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03484a9a-3c79-45f7-ad4d-bfc03de6d46c tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:44.132479 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-03484a9a-3c79-45f7-ad4d-bfc03de6d46c tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] 10.222.0.30 "GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495/ips" status: 200 len: 109 microversion: 2.1 time: 0.089911 Oct 04 21:28:44.141364 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2274/4566] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Oct 4 21:28:44 2022] GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495/ips => generated 109 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:28:44.149049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-85c17281-293c-4a93-9861-85626e481d36 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:44.149893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-85c17281-293c-4a93-9861-85626e481d36 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: f70dc9fb-d2fe-433b-b46a-c296c126ce5e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:44.156604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85c17281-293c-4a93-9861-85626e481d36 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:44.157381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85c17281-293c-4a93-9861-85626e481d36 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:44.158650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85c17281-293c-4a93-9861-85626e481d36 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:44.159643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85c17281-293c-4a93-9861-85626e481d36 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:44.160276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85c17281-293c-4a93-9861-85626e481d36 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:44.161860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85c17281-293c-4a93-9861-85626e481d36 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:44.180217 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-85c17281-293c-4a93-9861-85626e481d36 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e could not be found. Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-85c17281-293c-4a93-9861-85626e481d36 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e HTTP/1.1 Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e could not be found. Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'f70dc9fb-d2fe-433b-b46a-c296c126ce5e'} Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e could not be found. Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e could not be found. Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:44.182268 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:44.188254 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:44.188254 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:44.188254 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:44.188254 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:44.188254 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:44.188254 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e could not be found. Oct 04 21:28:44.188254 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:44.190844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-85c17281-293c-4a93-9861-85626e481d36 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance f70dc9fb-d2fe-433b-b46a-c296c126ce5e could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:44.192221 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-85c17281-293c-4a93-9861-85626e481d36 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e" status: 404 len: 111 microversion: 2.1 time: 0.048831 Oct 04 21:28:44.194248 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2275/4567] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:44 2022] GET /compute/v2.1/servers/f70dc9fb-d2fe-433b-b46a-c296c126ce5e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:44.201015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6706804b-882b-4beb-a4a7-f019f30fc711 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:44.202049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6706804b-882b-4beb-a4a7-f019f30fc711 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:44.211295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6706804b-882b-4beb-a4a7-f019f30fc711 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:44.211981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6706804b-882b-4beb-a4a7-f019f30fc711 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:44.212591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6706804b-882b-4beb-a4a7-f019f30fc711 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:44.213533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6706804b-882b-4beb-a4a7-f019f30fc711 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:44.215059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6706804b-882b-4beb-a4a7-f019f30fc711 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:44.221288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6706804b-882b-4beb-a4a7-f019f30fc711 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:44.559990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-829d94fb-3fed-4f7e-931d-6cf145379dfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:44.572076 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-829d94fb-3fed-4f7e-931d-6cf145379dfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.758069 Oct 04 21:28:44.573859 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2293/4568] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:43 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:44.583235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-526f3857-42a3-49e9-8585-6f26b6b4f1df req-905a8ab7-1ed3-43f8-9f6e-79473c473351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11842dec-199c-4673-99ef-286d7f858e1b", "name": "network-vif-plugged", "status": "completed", "tag": "f9b6d7bc-4a67-4957-a540-4bc24b3633e1"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:44.609793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-526f3857-42a3-49e9-8585-6f26b6b4f1df req-905a8ab7-1ed3-43f8-9f6e-79473c473351 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:44.610366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-526f3857-42a3-49e9-8585-6f26b6b4f1df req-905a8ab7-1ed3-43f8-9f6e-79473c473351 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:44.622553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-526f3857-42a3-49e9-8585-6f26b6b4f1df req-905a8ab7-1ed3-43f8-9f6e-79473c473351 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:44.634676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:44.650584 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-526f3857-42a3-49e9-8585-6f26b6b4f1df req-905a8ab7-1ed3-43f8-9f6e-79473c473351 service nova] Creating event network-vif-plugged:f9b6d7bc-4a67-4957-a540-4bc24b3633e1 for instance 11842dec-199c-4673-99ef-286d7f858e1b on n-h1-860282-1 Oct 04 21:28:44.659199 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-526f3857-42a3-49e9-8585-6f26b6b4f1df req-905a8ab7-1ed3-43f8-9f6e-79473c473351 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083124 Oct 04 21:28:44.659811 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2294/4569] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:28:44.666085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-466764d7-aeaa-4866-9cbe-36d807a71416 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:44.666918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-466764d7-aeaa-4866-9cbe-36d807a71416 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] [instance: 55b962f0-2136-4bd9-bf4d-a0b207f1f495] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:44.676504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-466764d7-aeaa-4866-9cbe-36d807a71416 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:44.677901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-466764d7-aeaa-4866-9cbe-36d807a71416 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:44.682600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-466764d7-aeaa-4866-9cbe-36d807a71416 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:44.682600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-466764d7-aeaa-4866-9cbe-36d807a71416 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:44.682600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-466764d7-aeaa-4866-9cbe-36d807a71416 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:44.682600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-466764d7-aeaa-4866-9cbe-36d807a71416 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:44.704611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=12 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:44.715764 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-466764d7-aeaa-4866-9cbe-36d807a71416 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] 10.222.0.30 "GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495/ips/tempest-ServerAddressesTestJSON-1202770821-network" status: 200 len: 94 microversion: 2.1 time: 0.054286 Oct 04 21:28:44.716662 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2295/4570] 10.222.0.30 () {58 vars in 1401 bytes} [Tue Oct 4 21:28:44 2022] GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495/ips/tempest-ServerAddressesTestJSON-1202770821-network => generated 94 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:28:44.733692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-30a7d23b-206d-4dc5-a0d2-be6d5617da33 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:44.735110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-30a7d23b-206d-4dc5-a0d2-be6d5617da33 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:44.743152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30a7d23b-206d-4dc5-a0d2-be6d5617da33 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:44.743922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30a7d23b-206d-4dc5-a0d2-be6d5617da33 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:44.746237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30a7d23b-206d-4dc5-a0d2-be6d5617da33 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:44.747808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30a7d23b-206d-4dc5-a0d2-be6d5617da33 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:44.748457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30a7d23b-206d-4dc5-a0d2-be6d5617da33 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:44.749066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30a7d23b-206d-4dc5-a0d2-be6d5617da33 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:44.767472 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-30a7d23b-206d-4dc5-a0d2-be6d5617da33 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c could not be found. Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-30a7d23b-206d-4dc5-a0d2-be6d5617da33 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c HTTP/1.1 Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c could not be found. Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'e7fd7fe3-c8fd-446d-b1a7-41e34a12159c'} Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c could not be found. Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:44.770916 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:44.776645 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c could not be found. Oct 04 21:28:44.776645 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:44.776645 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:44.776645 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:44.776645 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:44.776645 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:44.776645 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:44.776645 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:44.776645 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:44.776645 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c could not be found. Oct 04 21:28:44.776645 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:44.779213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-30a7d23b-206d-4dc5-a0d2-be6d5617da33 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:44.780667 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-30a7d23b-206d-4dc5-a0d2-be6d5617da33 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 404 len: 111 microversion: 2.1 time: 0.052875 Oct 04 21:28:44.782026 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2296/4571] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:28:44 2022] DELETE /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:44.792236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ad68b98f-c700-4111-9755-7eed96c9d5a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:44.793251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ad68b98f-c700-4111-9755-7eed96c9d5a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:44.802824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad68b98f-c700-4111-9755-7eed96c9d5a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:44.803585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad68b98f-c700-4111-9755-7eed96c9d5a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:44.804197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad68b98f-c700-4111-9755-7eed96c9d5a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:44.805196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad68b98f-c700-4111-9755-7eed96c9d5a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:44.806023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad68b98f-c700-4111-9755-7eed96c9d5a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:44.806701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad68b98f-c700-4111-9755-7eed96c9d5a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:44.973679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6706804b-882b-4beb-a4a7-f019f30fc711 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:44.991617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6706804b-882b-4beb-a4a7-f019f30fc711 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:44.996861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6706804b-882b-4beb-a4a7-f019f30fc711 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:45.000382 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6706804b-882b-4beb-a4a7-f019f30fc711 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1658 microversion: 2.42 time: 0.804803 Oct 04 21:28:45.003501 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2276/4572] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:44 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1658 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:45.009781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f8fba12c-e99f-4991-95e3-97d1c3a4dcfa tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:45.012718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f8fba12c-e99f-4991-95e3-97d1c3a4dcfa tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] [instance: 55b962f0-2136-4bd9-bf4d-a0b207f1f495] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:45.030643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8fba12c-e99f-4991-95e3-97d1c3a4dcfa tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:45.031432 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8fba12c-e99f-4991-95e3-97d1c3a4dcfa tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:45.038068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8fba12c-e99f-4991-95e3-97d1c3a4dcfa tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:45.040668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8fba12c-e99f-4991-95e3-97d1c3a4dcfa tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:45.041738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8fba12c-e99f-4991-95e3-97d1c3a4dcfa tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:45.043560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8fba12c-e99f-4991-95e3-97d1c3a4dcfa tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:45.098912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f8fba12c-e99f-4991-95e3-97d1c3a4dcfa tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] [instance: 55b962f0-2136-4bd9-bf4d-a0b207f1f495] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:28:45.293785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ad68b98f-c700-4111-9755-7eed96c9d5a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:45.308593 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ad68b98f-c700-4111-9755-7eed96c9d5a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.521640 Oct 04 21:28:45.309672 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2297/4573] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:44 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:45.332151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-34950333-b485-4a80-9286-3fbd28c8b830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:45.332805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-34950333-b485-4a80-9286-3fbd28c8b830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: e7fd7fe3-c8fd-446d-b1a7-41e34a12159c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:45.339185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34950333-b485-4a80-9286-3fbd28c8b830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:45.339714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34950333-b485-4a80-9286-3fbd28c8b830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:45.340099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34950333-b485-4a80-9286-3fbd28c8b830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:45.340811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34950333-b485-4a80-9286-3fbd28c8b830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:45.341273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34950333-b485-4a80-9286-3fbd28c8b830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:45.341784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34950333-b485-4a80-9286-3fbd28c8b830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:45.375653 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-34950333-b485-4a80-9286-3fbd28c8b830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c could not be found. Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-34950333-b485-4a80-9286-3fbd28c8b830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c HTTP/1.1 Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c could not be found. Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'e7fd7fe3-c8fd-446d-b1a7-41e34a12159c'} Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c could not be found. Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c could not be found. Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:45.382007 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:45.386971 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:45.386971 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:45.386971 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:45.386971 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:45.386971 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:45.386971 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c could not be found. Oct 04 21:28:45.386971 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:45.386971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-34950333-b485-4a80-9286-3fbd28c8b830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance e7fd7fe3-c8fd-446d-b1a7-41e34a12159c could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:45.386971 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-34950333-b485-4a80-9286-3fbd28c8b830 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c" status: 404 len: 111 microversion: 2.1 time: 0.057622 Oct 04 21:28:45.391021 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2298/4574] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:45 2022] GET /compute/v2.1/servers/e7fd7fe3-c8fd-446d-b1a7-41e34a12159c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:45.397780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ff28cecf-590a-4d31-91a4-116d0ae98813 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:45.398563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ff28cecf-590a-4d31-91a4-116d0ae98813 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:45.406233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff28cecf-590a-4d31-91a4-116d0ae98813 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:45.406743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff28cecf-590a-4d31-91a4-116d0ae98813 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:45.407244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff28cecf-590a-4d31-91a4-116d0ae98813 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:45.412646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff28cecf-590a-4d31-91a4-116d0ae98813 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:45.412646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff28cecf-590a-4d31-91a4-116d0ae98813 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:45.412646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff28cecf-590a-4d31-91a4-116d0ae98813 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:45.500692 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f8fba12c-e99f-4991-95e3-97d1c3a4dcfa tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] 10.222.0.30 "DELETE /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495" status: 204 len: 0 microversion: 2.1 time: 0.494495 Oct 04 21:28:45.503074 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2277/4575] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:28:45 2022] DELETE /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:28:45.510864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3811aafa-e77d-419f-a195-a21644663e1c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:45.512979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3811aafa-e77d-419f-a195-a21644663e1c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 41c6a18b-7e46-429d-804a-f86ae3837037] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:45.523913 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-3811aafa-e77d-419f-a195-a21644663e1c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance 41c6a18b-7e46-429d-804a-f86ae3837037 could not be found. Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3811aafa-e77d-419f-a195-a21644663e1c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/41c6a18b-7e46-429d-804a-f86ae3837037 HTTP/1.1 Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 41c6a18b-7e46-429d-804a-f86ae3837037 could not be found. Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '41c6a18b-7e46-429d-804a-f86ae3837037'} Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41c6a18b-7e46-429d-804a-f86ae3837037 could not be found. Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41c6a18b-7e46-429d-804a-f86ae3837037 could not be found. Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:45.527051 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:45.533890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:45.533890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:45.533890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:45.533890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:45.533890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:45.533890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:45.533890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41c6a18b-7e46-429d-804a-f86ae3837037 could not be found. Oct 04 21:28:45.533890 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:45.537472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3811aafa-e77d-419f-a195-a21644663e1c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance 41c6a18b-7e46-429d-804a-f86ae3837037 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:45.538606 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3811aafa-e77d-419f-a195-a21644663e1c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "DELETE /compute/v2.1/servers/41c6a18b-7e46-429d-804a-f86ae3837037" status: 404 len: 111 microversion: 2.1 time: 0.034368 Oct 04 21:28:45.540761 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2278/4576] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:28:45 2022] DELETE /compute/v2.1/servers/41c6a18b-7e46-429d-804a-f86ae3837037 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:45.548358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-445380db-0932-42a0-8688-c8dd8e73bd6c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:45.549236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-445380db-0932-42a0-8688-c8dd8e73bd6c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:45.558955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-445380db-0932-42a0-8688-c8dd8e73bd6c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:45.559699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-445380db-0932-42a0-8688-c8dd8e73bd6c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:45.560335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-445380db-0932-42a0-8688-c8dd8e73bd6c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:45.561373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-445380db-0932-42a0-8688-c8dd8e73bd6c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:45.561943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-445380db-0932-42a0-8688-c8dd8e73bd6c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:45.562479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-445380db-0932-42a0-8688-c8dd8e73bd6c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:45.582119 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-445380db-0932-42a0-8688-c8dd8e73bd6c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 could not be found. Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-445380db-0932-42a0-8688-c8dd8e73bd6c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 HTTP/1.1 Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 could not be found. Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '39f7b402-4b3a-4a39-8686-9e9b36f9e040'} Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 could not be found. Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:45.584332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:45.589082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 could not be found. Oct 04 21:28:45.589082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:45.589082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:45.589082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:45.589082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:45.589082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:45.589082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:45.589082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:45.589082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:45.589082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 could not be found. Oct 04 21:28:45.589082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:45.592197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-445380db-0932-42a0-8688-c8dd8e73bd6c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:45.593877 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-445380db-0932-42a0-8688-c8dd8e73bd6c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 404 len: 111 microversion: 2.1 time: 0.051390 Oct 04 21:28:45.594926 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2279/4577] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:28:45 2022] DELETE /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:45.605435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-28ca2496-f9a6-47ae-a76d-db06cc5e2745 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:45.606416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-28ca2496-f9a6-47ae-a76d-db06cc5e2745 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] [instance: 55b962f0-2136-4bd9-bf4d-a0b207f1f495] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:45.614332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28ca2496-f9a6-47ae-a76d-db06cc5e2745 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:45.615032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28ca2496-f9a6-47ae-a76d-db06cc5e2745 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:45.615688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28ca2496-f9a6-47ae-a76d-db06cc5e2745 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:45.616572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28ca2496-f9a6-47ae-a76d-db06cc5e2745 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:45.617217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28ca2496-f9a6-47ae-a76d-db06cc5e2745 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:45.618020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28ca2496-f9a6-47ae-a76d-db06cc5e2745 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:45.782117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ff28cecf-590a-4d31-91a4-116d0ae98813 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:45.795386 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ff28cecf-590a-4d31-91a4-116d0ae98813 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 200 len: 1320 microversion: 2.1 time: 0.401546 Oct 04 21:28:45.796023 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2299/4578] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:45 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 1320 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:45.813844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8ec85f50-b2da-4821-a572-fabd766145d5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:45.815040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8ec85f50-b2da-4821-a572-fabd766145d5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:45.826975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ec85f50-b2da-4821-a572-fabd766145d5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:45.828205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ec85f50-b2da-4821-a572-fabd766145d5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:45.830756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ec85f50-b2da-4821-a572-fabd766145d5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:45.831831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ec85f50-b2da-4821-a572-fabd766145d5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:45.832596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ec85f50-b2da-4821-a572-fabd766145d5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:45.833301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ec85f50-b2da-4821-a572-fabd766145d5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:46.095722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-28ca2496-f9a6-47ae-a76d-db06cc5e2745 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de918301f494171b6ebdb04323a9894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbce00070c7e40489a4b3dc76bf2d0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:46.129111 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-28ca2496-f9a6-47ae-a76d-db06cc5e2745 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] 10.222.0.30 "GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495" status: 200 len: 1511 microversion: 2.1 time: 0.528962 Oct 04 21:28:46.130359 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2280/4579] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:45 2022] GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495 => generated 1511 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:46.155302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c120591f-c562-45c3-91f3-2885e57bc8fc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:46.156301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c120591f-c562-45c3-91f3-2885e57bc8fc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 39f7b402-4b3a-4a39-8686-9e9b36f9e040] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:46.178573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c120591f-c562-45c3-91f3-2885e57bc8fc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:46.180646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c120591f-c562-45c3-91f3-2885e57bc8fc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:46.182880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c120591f-c562-45c3-91f3-2885e57bc8fc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:46.184238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c120591f-c562-45c3-91f3-2885e57bc8fc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:46.188714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c120591f-c562-45c3-91f3-2885e57bc8fc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:46.191301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c120591f-c562-45c3-91f3-2885e57bc8fc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:46.266724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8ec85f50-b2da-4821-a572-fabd766145d5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:46.277636 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8ec85f50-b2da-4821-a572-fabd766145d5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.480492 Oct 04 21:28:46.286265 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2300/4580] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:45 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:46.291771 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-c120591f-c562-45c3-91f3-2885e57bc8fc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 could not be found. Oct 04 21:28:46.294402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fa19644a-b7fb-4281-b9ea-c39dec5bf5a4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:46.295050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fa19644a-b7fb-4281-b9ea-c39dec5bf5a4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c120591f-c562-45c3-91f3-2885e57bc8fc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 HTTP/1.1 Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 could not be found. Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '39f7b402-4b3a-4a39-8686-9e9b36f9e040'} Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 could not be found. Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 could not be found. Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:46.298194 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:46.305394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:46.305394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:46.305394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:46.305394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:46.305394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:46.305394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 could not be found. Oct 04 21:28:46.305394 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:46.311330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa19644a-b7fb-4281-b9ea-c39dec5bf5a4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:46.311843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa19644a-b7fb-4281-b9ea-c39dec5bf5a4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:46.312299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa19644a-b7fb-4281-b9ea-c39dec5bf5a4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:46.313028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa19644a-b7fb-4281-b9ea-c39dec5bf5a4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:46.324087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c120591f-c562-45c3-91f3-2885e57bc8fc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance 39f7b402-4b3a-4a39-8686-9e9b36f9e040 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:46.326346 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c120591f-c562-45c3-91f3-2885e57bc8fc tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040" status: 404 len: 111 microversion: 2.1 time: 0.191613 Oct 04 21:28:46.330103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa19644a-b7fb-4281-b9ea-c39dec5bf5a4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:46.331055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa19644a-b7fb-4281-b9ea-c39dec5bf5a4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:46.332115 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2281/4581] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:46 2022] GET /compute/v2.1/servers/39f7b402-4b3a-4a39-8686-9e9b36f9e040 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:46.346101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-71f2ed3d-c4a6-418e-b7e5-6d4f7e238bdd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:46.347795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-71f2ed3d-c4a6-418e-b7e5-6d4f7e238bdd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:46.357914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71f2ed3d-c4a6-418e-b7e5-6d4f7e238bdd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:46.358818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71f2ed3d-c4a6-418e-b7e5-6d4f7e238bdd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:46.361008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71f2ed3d-c4a6-418e-b7e5-6d4f7e238bdd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:46.362377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71f2ed3d-c4a6-418e-b7e5-6d4f7e238bdd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:46.363151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71f2ed3d-c4a6-418e-b7e5-6d4f7e238bdd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:46.369637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71f2ed3d-c4a6-418e-b7e5-6d4f7e238bdd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:46.922306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:47.254840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-71f2ed3d-c4a6-418e-b7e5-6d4f7e238bdd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:47.282559 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-71f2ed3d-c4a6-418e-b7e5-6d4f7e238bdd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.948999 Oct 04 21:28:47.288182 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2282/4582] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:46 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:47.303398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2b7a51af-4d5a-44a7-9db3-8b43f0a285c5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:47.304044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2b7a51af-4d5a-44a7-9db3-8b43f0a285c5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:47.318080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:47.319660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b7a51af-4d5a-44a7-9db3-8b43f0a285c5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:47.320354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b7a51af-4d5a-44a7-9db3-8b43f0a285c5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:47.320953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b7a51af-4d5a-44a7-9db3-8b43f0a285c5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:47.322112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b7a51af-4d5a-44a7-9db3-8b43f0a285c5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:47.323081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b7a51af-4d5a-44a7-9db3-8b43f0a285c5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:47.323753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b7a51af-4d5a-44a7-9db3-8b43f0a285c5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:47.342369 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-2b7a51af-4d5a-44a7-9db3-8b43f0a285c5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance c75626ed-54cc-4237-a6fd-f460ae7fc572 could not be found. Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2b7a51af-4d5a-44a7-9db3-8b43f0a285c5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 HTTP/1.1 Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance c75626ed-54cc-4237-a6fd-f460ae7fc572 could not be found. Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'c75626ed-54cc-4237-a6fd-f460ae7fc572'} Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c75626ed-54cc-4237-a6fd-f460ae7fc572 could not be found. Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:47.344404 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:47.353554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c75626ed-54cc-4237-a6fd-f460ae7fc572 could not be found. Oct 04 21:28:47.353554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:47.353554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:47.353554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:47.353554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:47.353554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:47.353554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:47.353554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:47.353554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:47.353554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c75626ed-54cc-4237-a6fd-f460ae7fc572 could not be found. Oct 04 21:28:47.353554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:47.353554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2b7a51af-4d5a-44a7-9db3-8b43f0a285c5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance c75626ed-54cc-4237-a6fd-f460ae7fc572 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:47.353554 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2b7a51af-4d5a-44a7-9db3-8b43f0a285c5 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 404 len: 111 microversion: 2.1 time: 0.048093 Oct 04 21:28:47.353554 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2283/4583] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:28:47 2022] DELETE /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:47.358363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-eca77168-a5a8-4809-bd04-1efd4c6bd105 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:47.359221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-eca77168-a5a8-4809-bd04-1efd4c6bd105 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:47.366264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eca77168-a5a8-4809-bd04-1efd4c6bd105 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:47.367122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eca77168-a5a8-4809-bd04-1efd4c6bd105 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:47.367755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eca77168-a5a8-4809-bd04-1efd4c6bd105 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:47.371021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eca77168-a5a8-4809-bd04-1efd4c6bd105 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:47.372177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eca77168-a5a8-4809-bd04-1efd4c6bd105 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:47.372806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eca77168-a5a8-4809-bd04-1efd4c6bd105 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:48.119311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fa19644a-b7fb-4281-b9ea-c39dec5bf5a4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:48.143771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fa19644a-b7fb-4281-b9ea-c39dec5bf5a4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:48.148260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fa19644a-b7fb-4281-b9ea-c39dec5bf5a4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:48.152950 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fa19644a-b7fb-4281-b9ea-c39dec5bf5a4 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1658 microversion: 2.42 time: 1.862388 Oct 04 21:28:48.162812 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2301/4584] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:46 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1658 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:48.180764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8c7e4e21-c8d2-4d2e-9041-11f59508b256 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:48.181767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8c7e4e21-c8d2-4d2e-9041-11f59508b256 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] [instance: 55b962f0-2136-4bd9-bf4d-a0b207f1f495] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:48.192757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c7e4e21-c8d2-4d2e-9041-11f59508b256 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:48.193910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c7e4e21-c8d2-4d2e-9041-11f59508b256 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:48.195585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c7e4e21-c8d2-4d2e-9041-11f59508b256 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:48.196641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c7e4e21-c8d2-4d2e-9041-11f59508b256 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:48.197444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c7e4e21-c8d2-4d2e-9041-11f59508b256 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:48.198090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c7e4e21-c8d2-4d2e-9041-11f59508b256 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:48.210125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-eca77168-a5a8-4809-bd04-1efd4c6bd105 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:48.225463 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-eca77168-a5a8-4809-bd04-1efd4c6bd105 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 200 len: 1320 microversion: 2.1 time: 0.875823 Oct 04 21:28:48.226029 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2284/4585] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:47 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 1320 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:48.233053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fddb8a10-9ac2-4864-8e85-368114e0ecae tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:48.233795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fddb8a10-9ac2-4864-8e85-368114e0ecae tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 21:28:48.234563 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-fddb8a10-9ac2-4864-8e85-368114e0ecae tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fddb8a10-9ac2-4864-8e85-368114e0ecae tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 9223372036854775808 could not be found. Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '9223372036854775808'} Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:48.236783 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:48.240965 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:48.240965 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:48.240965 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:48.240965 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 04 21:28:48.240965 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.247265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fddb8a10-9ac2-4864-8e85-368114e0ecae tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:48.248160 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fddb8a10-9ac2-4864-8e85-368114e0ecae tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.021019 Oct 04 21:28:48.257905 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2285/4586] 10.222.0.30 () {58 vars in 1188 bytes} [Tue Oct 4 21:28:48 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:28:48.262907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f17da4d4-4ddc-420b-af53-2278cb1d8476 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:48.263531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f17da4d4-4ddc-420b-af53-2278cb1d8476 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: c75626ed-54cc-4237-a6fd-f460ae7fc572] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:48.282490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f17da4d4-4ddc-420b-af53-2278cb1d8476 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:48.283579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f17da4d4-4ddc-420b-af53-2278cb1d8476 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:48.284282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f17da4d4-4ddc-420b-af53-2278cb1d8476 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:48.285311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f17da4d4-4ddc-420b-af53-2278cb1d8476 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:48.286059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f17da4d4-4ddc-420b-af53-2278cb1d8476 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:48.286757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f17da4d4-4ddc-420b-af53-2278cb1d8476 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:48.313960 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-f17da4d4-4ddc-420b-af53-2278cb1d8476 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance c75626ed-54cc-4237-a6fd-f460ae7fc572 could not be found. Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f17da4d4-4ddc-420b-af53-2278cb1d8476 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 HTTP/1.1 Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance c75626ed-54cc-4237-a6fd-f460ae7fc572 could not be found. Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'c75626ed-54cc-4237-a6fd-f460ae7fc572'} Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c75626ed-54cc-4237-a6fd-f460ae7fc572 could not be found. Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c75626ed-54cc-4237-a6fd-f460ae7fc572 could not be found. Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:48.320596 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.327936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:48.327936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:48.327936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:48.327936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:48.327936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:48.327936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c75626ed-54cc-4237-a6fd-f460ae7fc572 could not be found. Oct 04 21:28:48.327936 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.327936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f17da4d4-4ddc-420b-af53-2278cb1d8476 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance c75626ed-54cc-4237-a6fd-f460ae7fc572 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:48.327936 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f17da4d4-4ddc-420b-af53-2278cb1d8476 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572" status: 404 len: 111 microversion: 2.1 time: 0.063304 Oct 04 21:28:48.327936 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2286/4587] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:48 2022] GET /compute/v2.1/servers/c75626ed-54cc-4237-a6fd-f460ae7fc572 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:48.341162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-a1945c09-c138-4289-998d-4dd52797062b req-62c0b966-3f07-4995-a3a8-ede9e7637e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ec20b6-bf43-4824-b5a4-6e76eae9f564", "tag": "ee4c4f8c-35f1-415c-9490-b28a659f9a08"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:48.367512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a1945c09-c138-4289-998d-4dd52797062b req-62c0b966-3f07-4995-a3a8-ede9e7637e4f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:48.368084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a1945c09-c138-4289-998d-4dd52797062b req-62c0b966-3f07-4995-a3a8-ede9e7637e4f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:48.368610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a1945c09-c138-4289-998d-4dd52797062b req-62c0b966-3f07-4995-a3a8-ede9e7637e4f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:48.382277 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-a1945c09-c138-4289-998d-4dd52797062b req-62c0b966-3f07-4995-a3a8-ede9e7637e4f service nova] Creating event network-changed:ee4c4f8c-35f1-415c-9490-b28a659f9a08 for instance 44ec20b6-bf43-4824-b5a4-6e76eae9f564 on n-h2-860282-1 Oct 04 21:28:48.404858 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-a1945c09-c138-4289-998d-4dd52797062b req-62c0b966-3f07-4995-a3a8-ede9e7637e4f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077306 Oct 04 21:28:48.405890 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2287/4588] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:28:48.412131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d493f4c2-6a57-48a8-8d9f-ecc70178b067 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:48.416703 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d493f4c2-6a57-48a8-8d9f-ecc70178b067 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:48.426705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d493f4c2-6a57-48a8-8d9f-ecc70178b067 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:48.429135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d493f4c2-6a57-48a8-8d9f-ecc70178b067 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:48.429135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d493f4c2-6a57-48a8-8d9f-ecc70178b067 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:48.429135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d493f4c2-6a57-48a8-8d9f-ecc70178b067 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:48.434746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d493f4c2-6a57-48a8-8d9f-ecc70178b067 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:48.435473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d493f4c2-6a57-48a8-8d9f-ecc70178b067 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:48.888632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8c7e4e21-c8d2-4d2e-9041-11f59508b256 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de918301f494171b6ebdb04323a9894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbce00070c7e40489a4b3dc76bf2d0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:48.899675 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8c7e4e21-c8d2-4d2e-9041-11f59508b256 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] 10.222.0.30 "GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495" status: 200 len: 1511 microversion: 2.1 time: 0.735357 Oct 04 21:28:48.900507 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2302/4589] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:48 2022] GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495 => generated 1511 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:48.925944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0575b7f4-582c-4d25-be65-295c77621854 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:48.926706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0575b7f4-582c-4d25-be65-295c77621854 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: fa6c9848-6cc7-4532-a29d-865a35cb2e34] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:48.933606 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-0575b7f4-582c-4d25-be65-295c77621854 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance fa6c9848-6cc7-4532-a29d-865a35cb2e34 could not be found. Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0575b7f4-582c-4d25-be65-295c77621854 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/fa6c9848-6cc7-4532-a29d-865a35cb2e34 HTTP/1.1 Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance fa6c9848-6cc7-4532-a29d-865a35cb2e34 could not be found. Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'fa6c9848-6cc7-4532-a29d-865a35cb2e34'} Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa6c9848-6cc7-4532-a29d-865a35cb2e34 could not be found. Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa6c9848-6cc7-4532-a29d-865a35cb2e34 could not be found. Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:48.936699 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.946031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:48.946031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:48.946031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:48.946031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:48.946031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:48.946031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa6c9848-6cc7-4532-a29d-865a35cb2e34 could not be found. Oct 04 21:28:48.946031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.946031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0575b7f4-582c-4d25-be65-295c77621854 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance fa6c9848-6cc7-4532-a29d-865a35cb2e34 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:48.946031 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0575b7f4-582c-4d25-be65-295c77621854 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fa6c9848-6cc7-4532-a29d-865a35cb2e34" status: 404 len: 111 microversion: 2.1 time: 0.019019 Oct 04 21:28:48.946031 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2303/4590] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:28:48 2022] DELETE /compute/v2.1/servers/fa6c9848-6cc7-4532-a29d-865a35cb2e34 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:48.950452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9d5f3274-8590-427b-a66f-bb97abc7f936 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:48.951541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9d5f3274-8590-427b-a66f-bb97abc7f936 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: fa6c9848-6cc7-4532-a29d-865a35cb2e34] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:48.960323 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-9d5f3274-8590-427b-a66f-bb97abc7f936 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance fa6c9848-6cc7-4532-a29d-865a35cb2e34 could not be found. Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9d5f3274-8590-427b-a66f-bb97abc7f936 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/fa6c9848-6cc7-4532-a29d-865a35cb2e34 HTTP/1.1 Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance fa6c9848-6cc7-4532-a29d-865a35cb2e34 could not be found. Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'fa6c9848-6cc7-4532-a29d-865a35cb2e34'} Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa6c9848-6cc7-4532-a29d-865a35cb2e34 could not be found. Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa6c9848-6cc7-4532-a29d-865a35cb2e34 could not be found. Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:48.962684 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:48.975500 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:48.975500 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:48.975500 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:48.975500 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa6c9848-6cc7-4532-a29d-865a35cb2e34 could not be found. Oct 04 21:28:48.975500 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:48.975500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9d5f3274-8590-427b-a66f-bb97abc7f936 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance fa6c9848-6cc7-4532-a29d-865a35cb2e34 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:48.975500 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9d5f3274-8590-427b-a66f-bb97abc7f936 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/fa6c9848-6cc7-4532-a29d-865a35cb2e34" status: 404 len: 111 microversion: 2.1 time: 0.018511 Oct 04 21:28:48.975500 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2304/4591] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:48 2022] GET /compute/v2.1/servers/fa6c9848-6cc7-4532-a29d-865a35cb2e34 => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:49.182620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2ca28351-d827-4e0f-8d95-a95cd70bc4df tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:49.183252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2ca28351-d827-4e0f-8d95-a95cd70bc4df tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:49.192812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ca28351-d827-4e0f-8d95-a95cd70bc4df tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:49.193313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ca28351-d827-4e0f-8d95-a95cd70bc4df tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:49.193789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ca28351-d827-4e0f-8d95-a95cd70bc4df tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:49.194503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ca28351-d827-4e0f-8d95-a95cd70bc4df tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:49.196087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d493f4c2-6a57-48a8-8d9f-ecc70178b067 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:49.204899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ca28351-d827-4e0f-8d95-a95cd70bc4df tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:49.204899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ca28351-d827-4e0f-8d95-a95cd70bc4df tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:49.205270 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d493f4c2-6a57-48a8-8d9f-ecc70178b067 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.797734 Oct 04 21:28:49.221993 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2288/4592] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:48 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:49.235263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fcfe6505-7c0a-4091-90b7-0a9b3d11eea1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:49.239523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fcfe6505-7c0a-4091-90b7-0a9b3d11eea1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:49.244332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcfe6505-7c0a-4091-90b7-0a9b3d11eea1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:49.245394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcfe6505-7c0a-4091-90b7-0a9b3d11eea1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:49.246219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcfe6505-7c0a-4091-90b7-0a9b3d11eea1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:49.247812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcfe6505-7c0a-4091-90b7-0a9b3d11eea1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:49.248471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcfe6505-7c0a-4091-90b7-0a9b3d11eea1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:49.249411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcfe6505-7c0a-4091-90b7-0a9b3d11eea1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:50.363425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fcfe6505-7c0a-4091-90b7-0a9b3d11eea1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:50.407173 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fcfe6505-7c0a-4091-90b7-0a9b3d11eea1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 1.176298 Oct 04 21:28:50.410021 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2289/4593] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:49 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:50.425746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4a60a959-093f-480d-98fe-7669f6545230 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:50.430159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4a60a959-093f-480d-98fe-7669f6545230 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:50.443474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a60a959-093f-480d-98fe-7669f6545230 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:50.444231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a60a959-093f-480d-98fe-7669f6545230 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:50.447339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a60a959-093f-480d-98fe-7669f6545230 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:50.448221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a60a959-093f-480d-98fe-7669f6545230 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:50.449962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a60a959-093f-480d-98fe-7669f6545230 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:50.451072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a60a959-093f-480d-98fe-7669f6545230 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:50.461404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2ca28351-d827-4e0f-8d95-a95cd70bc4df tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:50.483989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2ca28351-d827-4e0f-8d95-a95cd70bc4df tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:50.493030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2ca28351-d827-4e0f-8d95-a95cd70bc4df tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:50.499257 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2ca28351-d827-4e0f-8d95-a95cd70bc4df tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1703 microversion: 2.42 time: 1.322808 Oct 04 21:28:50.506493 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2305/4594] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:49 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1703 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:50.537605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-daa2f8d0-6e30-43da-9194-b4c3b6cc0047 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:50.541467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-daa2f8d0-6e30-43da-9194-b4c3b6cc0047 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] [instance: 55b962f0-2136-4bd9-bf4d-a0b207f1f495] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:50.560217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-daa2f8d0-6e30-43da-9194-b4c3b6cc0047 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:50.563457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-daa2f8d0-6e30-43da-9194-b4c3b6cc0047 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:50.565439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-daa2f8d0-6e30-43da-9194-b4c3b6cc0047 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:50.568366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-daa2f8d0-6e30-43da-9194-b4c3b6cc0047 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:50.571426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-daa2f8d0-6e30-43da-9194-b4c3b6cc0047 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:50.573262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-daa2f8d0-6e30-43da-9194-b4c3b6cc0047 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:50.842622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-daa2f8d0-6e30-43da-9194-b4c3b6cc0047 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de918301f494171b6ebdb04323a9894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbce00070c7e40489a4b3dc76bf2d0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:50.857003 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-daa2f8d0-6e30-43da-9194-b4c3b6cc0047 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] 10.222.0.30 "GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495" status: 200 len: 1469 microversion: 2.1 time: 0.346983 Oct 04 21:28:50.858318 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2306/4595] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:50 2022] GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495 => generated 1469 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:50.873371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eb4efd6f-5a02-44b0-85c3-596453fee4aa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:50.875063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eb4efd6f-5a02-44b0-85c3-596453fee4aa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Failed to fetch instance by id -1 {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 21:28:50.877671 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-eb4efd6f-5a02-44b0-85c3-596453fee4aa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance -1 could not be found. Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eb4efd6f-5a02-44b0-85c3-596453fee4aa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance -1 could not be found. Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '-1'} Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:50.884022 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:50.888907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:50.888907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:50.888907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 04 21:28:50.888907 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:50.891432 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eb4efd6f-5a02-44b0-85c3-596453fee4aa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:50.897357 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eb4efd6f-5a02-44b0-85c3-596453fee4aa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.032826 Oct 04 21:28:50.900785 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2307/4596] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:28:50 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:28:50.932833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-dbb59e29-5cde-4ba4-ae3d-3c6d12e536ce req-9c82165c-2097-4b50-bec8-023f24f799ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55b962f0-2136-4bd9-bf4d-a0b207f1f495", "name": "network-vif-deleted", "tag": "8965e7e8-2aff-4dbd-911f-346ddae3c1f6"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:50.967858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-dbb59e29-5cde-4ba4-ae3d-3c6d12e536ce req-9c82165c-2097-4b50-bec8-023f24f799ca service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:50.969000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-dbb59e29-5cde-4ba4-ae3d-3c6d12e536ce req-9c82165c-2097-4b50-bec8-023f24f799ca service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:50.972393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-dbb59e29-5cde-4ba4-ae3d-3c6d12e536ce req-9c82165c-2097-4b50-bec8-023f24f799ca service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:51.022371 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-dbb59e29-5cde-4ba4-ae3d-3c6d12e536ce req-9c82165c-2097-4b50-bec8-023f24f799ca service nova] Creating event network-vif-deleted:8965e7e8-2aff-4dbd-911f-346ddae3c1f6 for instance 55b962f0-2136-4bd9-bf4d-a0b207f1f495 on n-h2-860282-1 Oct 04 21:28:51.045127 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-dbb59e29-5cde-4ba4-ae3d-3c6d12e536ce req-9c82165c-2097-4b50-bec8-023f24f799ca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135589 Oct 04 21:28:51.047044 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2308/4597] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:28:51.056407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4a60a959-093f-480d-98fe-7669f6545230 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:51.070273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8126ad1c-6f90-4d22-8e79-5ea605516ded tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:51.071287 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4a60a959-093f-480d-98fe-7669f6545230 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 200 len: 1320 microversion: 2.1 time: 0.658300 Oct 04 21:28:51.071579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8126ad1c-6f90-4d22-8e79-5ea605516ded tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:51.073116 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2290/4598] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:50 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 1320 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:51.079198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8126ad1c-6f90-4d22-8e79-5ea605516ded tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:51.080598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8126ad1c-6f90-4d22-8e79-5ea605516ded tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:51.081261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8126ad1c-6f90-4d22-8e79-5ea605516ded tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:51.082269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8126ad1c-6f90-4d22-8e79-5ea605516ded tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:51.082927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8126ad1c-6f90-4d22-8e79-5ea605516ded tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:51.083587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8126ad1c-6f90-4d22-8e79-5ea605516ded tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:51.536631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-55fa0300-06c4-446c-b292-2ad6eb010d6a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:51.537976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-55fa0300-06c4-446c-b292-2ad6eb010d6a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:51.572948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55fa0300-06c4-446c-b292-2ad6eb010d6a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:51.580961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55fa0300-06c4-446c-b292-2ad6eb010d6a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:51.587648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55fa0300-06c4-446c-b292-2ad6eb010d6a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:51.588510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55fa0300-06c4-446c-b292-2ad6eb010d6a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:51.589066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55fa0300-06c4-446c-b292-2ad6eb010d6a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:51.604269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55fa0300-06c4-446c-b292-2ad6eb010d6a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:51.757840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8126ad1c-6f90-4d22-8e79-5ea605516ded tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:51.768632 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8126ad1c-6f90-4d22-8e79-5ea605516ded tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.718194 Oct 04 21:28:51.772887 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2309/4599] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:51 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:51.800560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-557a0327-ebd8-42a9-ab08-a86fd55de6fe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:51.802084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-557a0327-ebd8-42a9-ab08-a86fd55de6fe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:51.809517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-557a0327-ebd8-42a9-ab08-a86fd55de6fe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:51.819601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-557a0327-ebd8-42a9-ab08-a86fd55de6fe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:51.821859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-557a0327-ebd8-42a9-ab08-a86fd55de6fe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:51.824854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-557a0327-ebd8-42a9-ab08-a86fd55de6fe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:51.826620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-557a0327-ebd8-42a9-ab08-a86fd55de6fe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:51.827884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-557a0327-ebd8-42a9-ab08-a86fd55de6fe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:53.326621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-55fa0300-06c4-446c-b292-2ad6eb010d6a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:53.328891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-557a0327-ebd8-42a9-ab08-a86fd55de6fe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:53.341837 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-557a0327-ebd8-42a9-ab08-a86fd55de6fe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 1.542378 Oct 04 21:28:53.343144 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2310/4600] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:51 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:53.356510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5ee7c524-3746-4573-8ebe-3d61780b9e04 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:53.356999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-55fa0300-06c4-446c-b292-2ad6eb010d6a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:53.374900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5ee7c524-3746-4573-8ebe-3d61780b9e04 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] [instance: 55b962f0-2136-4bd9-bf4d-a0b207f1f495] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:53.375093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-55fa0300-06c4-446c-b292-2ad6eb010d6a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:53.375093 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-55fa0300-06c4-446c-b292-2ad6eb010d6a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1748 microversion: 2.42 time: 1.835609 Oct 04 21:28:53.375093 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2291/4601] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:51 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1748 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:53.376239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ee7c524-3746-4573-8ebe-3d61780b9e04 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:53.377569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ee7c524-3746-4573-8ebe-3d61780b9e04 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:53.378244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ee7c524-3746-4573-8ebe-3d61780b9e04 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:53.379165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ee7c524-3746-4573-8ebe-3d61780b9e04 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:53.379848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ee7c524-3746-4573-8ebe-3d61780b9e04 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:53.380488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ee7c524-3746-4573-8ebe-3d61780b9e04 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:53.380904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b156933e-3529-4121-a05a-fea31e589521 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:53.381581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b156933e-3529-4121-a05a-fea31e589521 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:53.394334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b156933e-3529-4121-a05a-fea31e589521 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:53.394838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b156933e-3529-4121-a05a-fea31e589521 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:53.395326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b156933e-3529-4121-a05a-fea31e589521 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:53.396035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b156933e-3529-4121-a05a-fea31e589521 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:53.400075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b156933e-3529-4121-a05a-fea31e589521 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:53.403611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b156933e-3529-4121-a05a-fea31e589521 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:53.458860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ee7c524-3746-4573-8ebe-3d61780b9e04 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:53.462493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ee7c524-3746-4573-8ebe-3d61780b9e04 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:53.463250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ee7c524-3746-4573-8ebe-3d61780b9e04 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:53.465928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-5ee7c524-3746-4573-8ebe-3d61780b9e04 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lazy-loading 'fault' on Instance uuid 55b962f0-2136-4bd9-bf4d-a0b207f1f495 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:28:53.541504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5ee7c524-3746-4573-8ebe-3d61780b9e04 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de918301f494171b6ebdb04323a9894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbce00070c7e40489a4b3dc76bf2d0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:53.558942 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5ee7c524-3746-4573-8ebe-3d61780b9e04 tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] 10.222.0.30 "GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495" status: 200 len: 1306 microversion: 2.1 time: 0.214420 Oct 04 21:28:53.561917 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2311/4602] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:53 2022] GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495 => generated 1306 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:53.578590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-4338b0ad-0b63-4c66-ab37-ebb2787b0219 req-4b7857da-c3a6-4991-98ec-27bad4158fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db85fc78-9a76-401a-89fc-c92d828ae8d4", "name": "network-vif-plugged", "status": "completed", "tag": "2e5eca04-7b74-4aba-820d-7f1cab5ba85d"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:53.589278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4338b0ad-0b63-4c66-ab37-ebb2787b0219 req-4b7857da-c3a6-4991-98ec-27bad4158fb4 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:53.590050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4338b0ad-0b63-4c66-ab37-ebb2787b0219 req-4b7857da-c3a6-4991-98ec-27bad4158fb4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:53.590666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4338b0ad-0b63-4c66-ab37-ebb2787b0219 req-4b7857da-c3a6-4991-98ec-27bad4158fb4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:53.616353 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-4338b0ad-0b63-4c66-ab37-ebb2787b0219 req-4b7857da-c3a6-4991-98ec-27bad4158fb4 service nova] Creating event network-vif-plugged:2e5eca04-7b74-4aba-820d-7f1cab5ba85d for instance db85fc78-9a76-401a-89fc-c92d828ae8d4 on n-h2-860282-1 Oct 04 21:28:53.631917 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-4338b0ad-0b63-4c66-ab37-ebb2787b0219 req-4b7857da-c3a6-4991-98ec-27bad4158fb4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056291 Oct 04 21:28:53.632557 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2312/4603] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:28:53.647532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-26e4b7cb-75ca-4bcd-8f8c-1e9133cde453 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:53.648908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-26e4b7cb-75ca-4bcd-8f8c-1e9133cde453 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 2ffab848-8e0e-480f-96a8-cb1ebd512a27] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:53.670334 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-26e4b7cb-75ca-4bcd-8f8c-1e9133cde453 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance 2ffab848-8e0e-480f-96a8-cb1ebd512a27 could not be found. Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-26e4b7cb-75ca-4bcd-8f8c-1e9133cde453 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/2ffab848-8e0e-480f-96a8-cb1ebd512a27/action HTTP/1.1 Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 19 Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: {"forceDelete": {}} Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 2ffab848-8e0e-480f-96a8-cb1ebd512a27 could not be found. Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '2ffab848-8e0e-480f-96a8-cb1ebd512a27', 'body': {'forceDelete': {}}} Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ffab848-8e0e-480f-96a8-cb1ebd512a27 could not be found. Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ffab848-8e0e-480f-96a8-cb1ebd512a27 could not be found. Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:53.685075 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:53.696102 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:53.696102 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:53.696102 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ffab848-8e0e-480f-96a8-cb1ebd512a27 could not be found. Oct 04 21:28:53.696102 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:53.696102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-26e4b7cb-75ca-4bcd-8f8c-1e9133cde453 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance 2ffab848-8e0e-480f-96a8-cb1ebd512a27 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:53.696102 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-26e4b7cb-75ca-4bcd-8f8c-1e9133cde453 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/2ffab848-8e0e-480f-96a8-cb1ebd512a27/action" status: 404 len: 111 microversion: 2.1 time: 0.054241 Oct 04 21:28:53.696102 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2313/4604] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:28:53 2022] POST /compute/v2.1/servers/2ffab848-8e0e-480f-96a8-cb1ebd512a27/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:53.702949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-040c7341-5bc5-40a2-87c1-d8e3b252a80a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:53.703564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-040c7341-5bc5-40a2-87c1-d8e3b252a80a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:53.720860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-040c7341-5bc5-40a2-87c1-d8e3b252a80a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:53.721361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-040c7341-5bc5-40a2-87c1-d8e3b252a80a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:53.721827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-040c7341-5bc5-40a2-87c1-d8e3b252a80a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:53.722539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-040c7341-5bc5-40a2-87c1-d8e3b252a80a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:53.722998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-040c7341-5bc5-40a2-87c1-d8e3b252a80a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:53.723426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-040c7341-5bc5-40a2-87c1-d8e3b252a80a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:55.420274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b156933e-3529-4121-a05a-fea31e589521 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:55.442766 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b156933e-3529-4121-a05a-fea31e589521 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 200 len: 1320 microversion: 2.1 time: 2.071651 Oct 04 21:28:55.446771 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2292/4605] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:53 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 1320 bytes in 2078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:55.468236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-83fc2836-6a55-43d7-9f2d-0dac423d6a41 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:55.468880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-83fc2836-6a55-43d7-9f2d-0dac423d6a41 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:55.484602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83fc2836-6a55-43d7-9f2d-0dac423d6a41 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:55.485108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83fc2836-6a55-43d7-9f2d-0dac423d6a41 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:55.486164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83fc2836-6a55-43d7-9f2d-0dac423d6a41 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:55.486883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83fc2836-6a55-43d7-9f2d-0dac423d6a41 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:55.487335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83fc2836-6a55-43d7-9f2d-0dac423d6a41 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:55.487763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83fc2836-6a55-43d7-9f2d-0dac423d6a41 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:55.515437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-040c7341-5bc5-40a2-87c1-d8e3b252a80a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:55.524971 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-040c7341-5bc5-40a2-87c1-d8e3b252a80a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 1.825903 Oct 04 21:28:55.542658 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2314/4606] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:53 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:55.560905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-efd09516-4571-40b5-b9b6-8a9f5eaa90bc tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:55.561632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-efd09516-4571-40b5-b9b6-8a9f5eaa90bc tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] [instance: 55b962f0-2136-4bd9-bf4d-a0b207f1f495] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:55.582323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efd09516-4571-40b5-b9b6-8a9f5eaa90bc tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:55.582885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efd09516-4571-40b5-b9b6-8a9f5eaa90bc tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:55.583459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efd09516-4571-40b5-b9b6-8a9f5eaa90bc tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:55.584115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efd09516-4571-40b5-b9b6-8a9f5eaa90bc tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:55.584574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efd09516-4571-40b5-b9b6-8a9f5eaa90bc tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:55.585005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efd09516-4571-40b5-b9b6-8a9f5eaa90bc tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:55.619257 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-efd09516-4571-40b5-b9b6-8a9f5eaa90bc tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] HTTP exception thrown: Instance 55b962f0-2136-4bd9-bf4d-a0b207f1f495 could not be found. Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-efd09516-4571-40b5-b9b6-8a9f5eaa90bc tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Request method failure captured: Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495 HTTP/1.1 Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKVuYY1X3HVFDXgVRaCZaej6Pix5iluo-df_FPefVHaamImehm65OaxJhPLSdYYrPIPQaLnA6_NG6pylYfk4OWzFt6JZVCY72eiT75TLUtJqrQozy82ov9ve6VFT4wLGbtAaqpcCYru9sAdSdjmvN00sTc5hm37eGFjlD8bW7mjTIlo Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: bbce00070c7e40489a4b3dc76bf2d0e3 Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerAddressesTestJSON-1556269119 Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bbce00070c7e40489a4b3dc76bf2d0e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bbce00070c7e40489a4b3dc76bf2d0e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bbce00070c7e40489a4b3dc76bf2d0e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bbce00070c7e40489a4b3dc76bf2d0e3"}]}] Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerAddressesTestJSON-1556269119 Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: bbce00070c7e40489a4b3dc76bf2d0e3 Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1556269119 Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerAddressesTestJSON-1556269119-project Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 0de918301f494171b6ebdb04323a9894 Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerAddressesTestJSON-1556269119-project Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 55b962f0-2136-4bd9-bf4d-a0b207f1f495 could not be found. Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '55b962f0-2136-4bd9-bf4d-a0b207f1f495'} Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55b962f0-2136-4bd9-bf4d-a0b207f1f495 could not be found. Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55b962f0-2136-4bd9-bf4d-a0b207f1f495 could not be found. Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:55.620737 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:55.625780 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:55.625780 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:55.625780 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:55.625780 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:55.625780 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:55.625780 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55b962f0-2136-4bd9-bf4d-a0b207f1f495 could not be found. Oct 04 21:28:55.625780 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:55.640499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-efd09516-4571-40b5-b9b6-8a9f5eaa90bc tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] Returning 404 to user: Instance 55b962f0-2136-4bd9-bf4d-a0b207f1f495 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:55.640499 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-efd09516-4571-40b5-b9b6-8a9f5eaa90bc tempest-ServerAddressesTestJSON-1556269119 tempest-ServerAddressesTestJSON-1556269119-project] 10.222.0.30 "GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495" status: 404 len: 111 microversion: 2.1 time: 0.091368 Oct 04 21:28:55.640499 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2315/4607] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:55 2022] GET /compute/v2.1/servers/55b962f0-2136-4bd9-bf4d-a0b207f1f495 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:55.652428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c0f75405-c9cf-45d0-84ce-50cb23116d42 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:55.653190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c0f75405-c9cf-45d0-84ce-50cb23116d42 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:55.674005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0f75405-c9cf-45d0-84ce-50cb23116d42 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:55.674839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0f75405-c9cf-45d0-84ce-50cb23116d42 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:55.675453 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0f75405-c9cf-45d0-84ce-50cb23116d42 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:55.676359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0f75405-c9cf-45d0-84ce-50cb23116d42 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:55.677033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0f75405-c9cf-45d0-84ce-50cb23116d42 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:55.677746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c0f75405-c9cf-45d0-84ce-50cb23116d42 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:55.681223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:55.734986 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-c0f75405-c9cf-45d0-84ce-50cb23116d42 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c0f75405-c9cf-45d0-84ce-50cb23116d42 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 HTTP/1.1 Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '541881f6-6361-4971-b222-65fbd3878425'} Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:55.744076 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:55.748897 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:28:55.748897 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:55.748897 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:55.748897 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:55.748897 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:55.748897 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:55.748897 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:55.748897 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:55.748897 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:55.748897 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:28:55.748897 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:28:55.750322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c0f75405-c9cf-45d0-84ce-50cb23116d42 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:55.754562 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c0f75405-c9cf-45d0-84ce-50cb23116d42 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 404 len: 111 microversion: 2.1 time: 0.117854 Oct 04 21:28:55.756560 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2316/4608] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:28:55 2022] DELETE /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:55.769298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7f5dbac5-8826-4cd9-b3f9-8106fff49c8f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:55.773822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7f5dbac5-8826-4cd9-b3f9-8106fff49c8f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:55.794033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f5dbac5-8826-4cd9-b3f9-8106fff49c8f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:55.796597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f5dbac5-8826-4cd9-b3f9-8106fff49c8f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:55.797552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f5dbac5-8826-4cd9-b3f9-8106fff49c8f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:55.802108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f5dbac5-8826-4cd9-b3f9-8106fff49c8f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:55.803394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f5dbac5-8826-4cd9-b3f9-8106fff49c8f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:55.804071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f5dbac5-8826-4cd9-b3f9-8106fff49c8f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:57.250656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-83fc2836-6a55-43d7-9f2d-0dac423d6a41 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:57.260673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:57.281132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-83fc2836-6a55-43d7-9f2d-0dac423d6a41 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:57.289061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-83fc2836-6a55-43d7-9f2d-0dac423d6a41 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:57.290938 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-83fc2836-6a55-43d7-9f2d-0dac423d6a41 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1793 microversion: 2.42 time: 1.842960 Oct 04 21:28:57.292973 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2293/4609] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:55 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1793 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:57.306516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-43161b04-15a8-4209-a746-179080f64bab tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:57.308380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-43161b04-15a8-4209-a746-179080f64bab tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 541881f6-6361-4971-b222-65fbd3878425] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:57.353121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43161b04-15a8-4209-a746-179080f64bab tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:57.356576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43161b04-15a8-4209-a746-179080f64bab tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:57.359074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43161b04-15a8-4209-a746-179080f64bab tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:57.363043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43161b04-15a8-4209-a746-179080f64bab tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:57.363043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43161b04-15a8-4209-a746-179080f64bab tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:57.363043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43161b04-15a8-4209-a746-179080f64bab tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:57.388084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7f5dbac5-8826-4cd9-b3f9-8106fff49c8f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:57.400073 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7f5dbac5-8826-4cd9-b3f9-8106fff49c8f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 1.641493 Oct 04 21:28:57.408385 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-43161b04-15a8-4209-a746-179080f64bab tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:28:57.416169 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2317/4610] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:55 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-43161b04-15a8-4209-a746-179080f64bab tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 HTTP/1.1 Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '541881f6-6361-4971-b222-65fbd3878425'} Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:57.417118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:57.425703 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:57.425703 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:57.425703 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:57.425703 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:57.425703 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:57.425703 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. Oct 04 21:28:57.425703 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:57.426336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0fa8c2d9-4429-48ae-9dba-f3a82846d2d2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:57.427561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-43161b04-15a8-4209-a746-179080f64bab tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance 541881f6-6361-4971-b222-65fbd3878425 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:57.428749 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-43161b04-15a8-4209-a746-179080f64bab tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425" status: 404 len: 111 microversion: 2.1 time: 0.133974 Oct 04 21:28:57.430891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0fa8c2d9-4429-48ae-9dba-f3a82846d2d2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:57.432338 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2294/4611] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:57 2022] GET /compute/v2.1/servers/541881f6-6361-4971-b222-65fbd3878425 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:57.445251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fa8c2d9-4429-48ae-9dba-f3a82846d2d2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:57.445811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6c6c499a-71bc-4732-a3f3-1e87b894669b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:57.449054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fa8c2d9-4429-48ae-9dba-f3a82846d2d2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:57.449054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fa8c2d9-4429-48ae-9dba-f3a82846d2d2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:57.451452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6c6c499a-71bc-4732-a3f3-1e87b894669b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: e2e02992-cb85-4ea8-b88a-5cb23128f6b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:57.460191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fa8c2d9-4429-48ae-9dba-f3a82846d2d2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:57.460760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fa8c2d9-4429-48ae-9dba-f3a82846d2d2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:57.461301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fa8c2d9-4429-48ae-9dba-f3a82846d2d2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:57.477829 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-6c6c499a-71bc-4732-a3f3-1e87b894669b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance e2e02992-cb85-4ea8-b88a-5cb23128f6b8 could not be found. Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6c6c499a-71bc-4732-a3f3-1e87b894669b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/e2e02992-cb85-4ea8-b88a-5cb23128f6b8/action HTTP/1.1 Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 39 Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: {"os-getConsoleOutput": {"length": 10}} Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance e2e02992-cb85-4ea8-b88a-5cb23128f6b8 could not be found. Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'e2e02992-cb85-4ea8-b88a-5cb23128f6b8', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e02992-cb85-4ea8-b88a-5cb23128f6b8 could not be found. Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e02992-cb85-4ea8-b88a-5cb23128f6b8 could not be found. Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:57.483239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:57.488576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:57.488576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:57.488576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:57.488576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:57.488576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e02992-cb85-4ea8-b88a-5cb23128f6b8 could not be found. Oct 04 21:28:57.488576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:57.490612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6c6c499a-71bc-4732-a3f3-1e87b894669b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance e2e02992-cb85-4ea8-b88a-5cb23128f6b8 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:57.493254 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6c6c499a-71bc-4732-a3f3-1e87b894669b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/e2e02992-cb85-4ea8-b88a-5cb23128f6b8/action" status: 404 len: 111 microversion: 2.1 time: 0.058501 Oct 04 21:28:57.496669 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2295/4612] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:28:57 2022] POST /compute/v2.1/servers/e2e02992-cb85-4ea8-b88a-5cb23128f6b8/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:57.508445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d8205498-7a8a-44e8-acb2-661d8694c17c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:57.511133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d8205498-7a8a-44e8-acb2-661d8694c17c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:57.533504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8205498-7a8a-44e8-acb2-661d8694c17c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:57.535709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8205498-7a8a-44e8-acb2-661d8694c17c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:57.544466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8205498-7a8a-44e8-acb2-661d8694c17c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:57.545637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8205498-7a8a-44e8-acb2-661d8694c17c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:57.549666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8205498-7a8a-44e8-acb2-661d8694c17c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:57.550309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8205498-7a8a-44e8-acb2-661d8694c17c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:57.608923 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-d8205498-7a8a-44e8-acb2-661d8694c17c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance 8a90e631-8a66-4d71-9103-68015d052045 could not be found. Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d8205498-7a8a-44e8-acb2-661d8694c17c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 HTTP/1.1 Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 8a90e631-8a66-4d71-9103-68015d052045 could not be found. Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '8a90e631-8a66-4d71-9103-68015d052045'} Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a90e631-8a66-4d71-9103-68015d052045 could not be found. Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:57.612453 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:57.616532 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a90e631-8a66-4d71-9103-68015d052045 could not be found. Oct 04 21:28:57.616532 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:57.616532 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:57.616532 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:57.616532 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:57.616532 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:57.616532 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:57.616532 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:57.616532 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:57.616532 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a90e631-8a66-4d71-9103-68015d052045 could not be found. Oct 04 21:28:57.616532 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:57.616532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d8205498-7a8a-44e8-acb2-661d8694c17c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance 8a90e631-8a66-4d71-9103-68015d052045 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:57.618676 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d8205498-7a8a-44e8-acb2-661d8694c17c tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 404 len: 111 microversion: 2.1 time: 0.120638 Oct 04 21:28:57.622367 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2296/4613] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:28:57 2022] DELETE /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:57.630377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-44c74114-4f7e-43f5-baef-6b2e8212551c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:57.631357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-44c74114-4f7e-43f5-baef-6b2e8212551c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:57.638406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44c74114-4f7e-43f5-baef-6b2e8212551c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:57.639251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44c74114-4f7e-43f5-baef-6b2e8212551c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:57.639962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44c74114-4f7e-43f5-baef-6b2e8212551c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:57.641004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44c74114-4f7e-43f5-baef-6b2e8212551c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:57.642524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44c74114-4f7e-43f5-baef-6b2e8212551c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:57.643408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44c74114-4f7e-43f5-baef-6b2e8212551c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:58.203876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-44c74114-4f7e-43f5-baef-6b2e8212551c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:58.228342 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-44c74114-4f7e-43f5-baef-6b2e8212551c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.605400 Oct 04 21:28:58.229694 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2297/4614] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:57 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:58.236677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-90f07106-d83a-4efe-a425-9448029b30e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:58.239533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-90f07106-d83a-4efe-a425-9448029b30e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] [instance: 8a90e631-8a66-4d71-9103-68015d052045] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:58.254272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90f07106-d83a-4efe-a425-9448029b30e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:58.256050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90f07106-d83a-4efe-a425-9448029b30e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:58.261349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90f07106-d83a-4efe-a425-9448029b30e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:58.262692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90f07106-d83a-4efe-a425-9448029b30e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:58.263493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90f07106-d83a-4efe-a425-9448029b30e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:58.264046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90f07106-d83a-4efe-a425-9448029b30e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:58.287054 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-90f07106-d83a-4efe-a425-9448029b30e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] HTTP exception thrown: Instance 8a90e631-8a66-4d71-9103-68015d052045 could not be found. Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-90f07106-d83a-4efe-a425-9448029b30e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Request method failure captured: Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 HTTP/1.1 Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKQh0qwFVBqX-n3NbYl3UliZU5qbd8LvRFxQ_MpE5EU85eahUM6_OZ1WZBGWUmyKef_xXlqngAyBglpMJYlsGYaGws99T8snxzrNNyyaAyTNe0RBQwYX8ff31O1TqDXBW3c3arJ4ld8acE1DjYNob1X5-btWX-cYOgZvztlAFoBdw-0 Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68c56e6603d14d9b8ad9c74a9df021c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68c56e6603d14d9b8ad9c74a9df021c9"}]}] Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 68c56e6603d14d9b8ad9c74a9df021c9 Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-DeleteServersTestJSON-598841369 Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 416e0c617ee34a19a7d6936b78c1d94d Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-DeleteServersTestJSON-598841369-project Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 8a90e631-8a66-4d71-9103-68015d052045 could not be found. Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '8a90e631-8a66-4d71-9103-68015d052045'} Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a90e631-8a66-4d71-9103-68015d052045 could not be found. Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a90e631-8a66-4d71-9103-68015d052045 could not be found. Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:58.288620 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:58.293902 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:58.293902 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:58.293902 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:58.293902 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:58.293902 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:58.293902 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a90e631-8a66-4d71-9103-68015d052045 could not be found. Oct 04 21:28:58.293902 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:58.306173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-90f07106-d83a-4efe-a425-9448029b30e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] Returning 404 to user: Instance 8a90e631-8a66-4d71-9103-68015d052045 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:58.308034 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-90f07106-d83a-4efe-a425-9448029b30e2 tempest-DeleteServersTestJSON-598841369 tempest-DeleteServersTestJSON-598841369-project] 10.222.0.30 "GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045" status: 404 len: 111 microversion: 2.1 time: 0.076420 Oct 04 21:28:58.312765 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2298/4615] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:58 2022] GET /compute/v2.1/servers/8a90e631-8a66-4d71-9103-68015d052045 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:58.326401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6a074bd7-868e-4975-8bec-f013e9ec92f4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:58.327600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6a074bd7-868e-4975-8bec-f013e9ec92f4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:58.364868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a074bd7-868e-4975-8bec-f013e9ec92f4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:58.365809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a074bd7-868e-4975-8bec-f013e9ec92f4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:58.366437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a074bd7-868e-4975-8bec-f013e9ec92f4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:58.367348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a074bd7-868e-4975-8bec-f013e9ec92f4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:58.367977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a074bd7-868e-4975-8bec-f013e9ec92f4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:58.368593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a074bd7-868e-4975-8bec-f013e9ec92f4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:58.709394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0fa8c2d9-4429-48ae-9dba-f3a82846d2d2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:58.727461 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0fa8c2d9-4429-48ae-9dba-f3a82846d2d2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 200 len: 1320 microversion: 2.1 time: 1.310067 Oct 04 21:28:58.729267 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2318/4616] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:57 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 1320 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:58.739451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0a0238da-cf49-452b-a4c0-3caf7d51f0fe tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:58.740990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0a0238da-cf49-452b-a4c0-3caf7d51f0fe tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:58.790667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a0238da-cf49-452b-a4c0-3caf7d51f0fe tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:58.792680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a0238da-cf49-452b-a4c0-3caf7d51f0fe tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:58.796052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a0238da-cf49-452b-a4c0-3caf7d51f0fe tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:58.800369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a0238da-cf49-452b-a4c0-3caf7d51f0fe tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:58.801018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a0238da-cf49-452b-a4c0-3caf7d51f0fe tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:58.803272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a0238da-cf49-452b-a4c0-3caf7d51f0fe tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:59.053692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6a074bd7-868e-4975-8bec-f013e9ec92f4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:59.069457 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6a074bd7-868e-4975-8bec-f013e9ec92f4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.752665 Oct 04 21:28:59.075740 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2299/4617] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:58 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:28:59.102612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-30b94792-1dc2-4eb5-b1cd-48642f68d386 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:59.103708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-30b94792-1dc2-4eb5-b1cd-48642f68d386 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: de9cf0d0-b2d4-4adb-b4f2-b788c01f41d6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:59.111083 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-30b94792-1dc2-4eb5-b1cd-48642f68d386 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance de9cf0d0-b2d4-4adb-b4f2-b788c01f41d6 could not be found. Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-30b94792-1dc2-4eb5-b1cd-48642f68d386 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/de9cf0d0-b2d4-4adb-b4f2-b788c01f41d6 HTTP/1.1 Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance de9cf0d0-b2d4-4adb-b4f2-b788c01f41d6 could not be found. Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'de9cf0d0-b2d4-4adb-b4f2-b788c01f41d6'} Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9cf0d0-b2d4-4adb-b4f2-b788c01f41d6 could not be found. Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9cf0d0-b2d4-4adb-b4f2-b788c01f41d6 could not be found. Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:28:59.114892 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:28:59.122425 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:28:59.122425 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:28:59.122425 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:28:59.122425 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9cf0d0-b2d4-4adb-b4f2-b788c01f41d6 could not be found. Oct 04 21:28:59.122425 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:28:59.122425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-30b94792-1dc2-4eb5-b1cd-48642f68d386 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance de9cf0d0-b2d4-4adb-b4f2-b788c01f41d6 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:28:59.123636 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-30b94792-1dc2-4eb5-b1cd-48642f68d386 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/de9cf0d0-b2d4-4adb-b4f2-b788c01f41d6" status: 404 len: 111 microversion: 2.1 time: 0.020770 Oct 04 21:28:59.128495 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2300/4618] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:59 2022] GET /compute/v2.1/servers/de9cf0d0-b2d4-4adb-b4f2-b788c01f41d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:59.136968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b58ea384-26fc-444c-a01e-2a62cf6bd34d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:59.140712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b58ea384-26fc-444c-a01e-2a62cf6bd34d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:59.160451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b58ea384-26fc-444c-a01e-2a62cf6bd34d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:59.161957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b58ea384-26fc-444c-a01e-2a62cf6bd34d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:59.162648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b58ea384-26fc-444c-a01e-2a62cf6bd34d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:59.163647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b58ea384-26fc-444c-a01e-2a62cf6bd34d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:59.164998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b58ea384-26fc-444c-a01e-2a62cf6bd34d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:59.165661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b58ea384-26fc-444c-a01e-2a62cf6bd34d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:59.901741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0a0238da-cf49-452b-a4c0-3caf7d51f0fe tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:59.913661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0a0238da-cf49-452b-a4c0-3caf7d51f0fe tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:59.915348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0a0238da-cf49-452b-a4c0-3caf7d51f0fe tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:59.916539 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0a0238da-cf49-452b-a4c0-3caf7d51f0fe tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1793 microversion: 2.42 time: 1.185949 Oct 04 21:28:59.923524 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2319/4619] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:58 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1793 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:59.949144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-257dc04a-9dfe-4ea3-b6aa-7ae2d54c931b req-4d0c8fc8-1a78-4601-9654-cfce818642e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ec20b6-bf43-4824-b5a4-6e76eae9f564", "name": "network-vif-plugged", "status": "completed", "tag": "ee4c4f8c-35f1-415c-9490-b28a659f9a08"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:59.982089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-257dc04a-9dfe-4ea3-b6aa-7ae2d54c931b req-4d0c8fc8-1a78-4601-9654-cfce818642e7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:59.982584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-257dc04a-9dfe-4ea3-b6aa-7ae2d54c931b req-4d0c8fc8-1a78-4601-9654-cfce818642e7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:59.983029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-257dc04a-9dfe-4ea3-b6aa-7ae2d54c931b req-4d0c8fc8-1a78-4601-9654-cfce818642e7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:00.008018 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-257dc04a-9dfe-4ea3-b6aa-7ae2d54c931b req-4d0c8fc8-1a78-4601-9654-cfce818642e7 service nova] Creating event network-vif-plugged:ee4c4f8c-35f1-415c-9490-b28a659f9a08 for instance 44ec20b6-bf43-4824-b5a4-6e76eae9f564 on n-h2-860282-1 Oct 04 21:29:00.035319 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-257dc04a-9dfe-4ea3-b6aa-7ae2d54c931b req-4d0c8fc8-1a78-4601-9654-cfce818642e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090706 Oct 04 21:29:00.035319 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2320/4620] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:00.036481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b58ea384-26fc-444c-a01e-2a62cf6bd34d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:00.050207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1c1497fa-4b2e-4161-8957-ad95bba3493a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:00.051977 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b58ea384-26fc-444c-a01e-2a62cf6bd34d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.921874 Oct 04 21:29:00.052567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1c1497fa-4b2e-4161-8957-ad95bba3493a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:00.065879 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2301/4621] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:28:59 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:00.066301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c1497fa-4b2e-4161-8957-ad95bba3493a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:00.066301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c1497fa-4b2e-4161-8957-ad95bba3493a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:00.066301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c1497fa-4b2e-4161-8957-ad95bba3493a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:00.066301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c1497fa-4b2e-4161-8957-ad95bba3493a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:00.066301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c1497fa-4b2e-4161-8957-ad95bba3493a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:00.067510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c1497fa-4b2e-4161-8957-ad95bba3493a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:00.081294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a464a691-33ed-416c-a57f-bf40af31b908 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:00.081959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a464a691-33ed-416c-a57f-bf40af31b908 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:00.096466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a464a691-33ed-416c-a57f-bf40af31b908 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:00.097351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a464a691-33ed-416c-a57f-bf40af31b908 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:00.098050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a464a691-33ed-416c-a57f-bf40af31b908 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:00.101196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a464a691-33ed-416c-a57f-bf40af31b908 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:00.103566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a464a691-33ed-416c-a57f-bf40af31b908 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:00.106639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a464a691-33ed-416c-a57f-bf40af31b908 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:00.650698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a464a691-33ed-416c-a57f-bf40af31b908 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:00.686846 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a464a691-33ed-416c-a57f-bf40af31b908 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.609910 Oct 04 21:29:00.692529 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2302/4622] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:00 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:00.799542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1c1497fa-4b2e-4161-8957-ad95bba3493a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:00.811970 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1c1497fa-4b2e-4161-8957-ad95bba3493a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 200 len: 1320 microversion: 2.1 time: 0.786372 Oct 04 21:29:00.815756 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2321/4623] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:00 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 1320 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:00.870423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a0431234-d533-4268-bc2a-5ce92b4f2200 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1609512817", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a0431234-d533-4268-bc2a-5ce92b4f2200 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 238 Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1609512817", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1609512817', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '6854610d-7b7e-44e1-90bf-b66a6b17f7da'}]}}} Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:00.896226 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 21:29:00.902285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:00.906587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a0431234-d533-4268-bc2a-5ce92b4f2200 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:00.909382 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a0431234-d533-4268-bc2a-5ce92b4f2200 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.042485 Oct 04 21:29:00.911191 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2303/4624] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:29:00 2022] POST /compute/v2.1/servers => generated 139 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:29:00.919065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-04e7d9b7-eca2-4bd0-94be-cc74dd2243ab tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:00.919827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-04e7d9b7-eca2-4bd0-94be-cc74dd2243ab tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:00.927130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04e7d9b7-eca2-4bd0-94be-cc74dd2243ab tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:00.927999 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04e7d9b7-eca2-4bd0-94be-cc74dd2243ab tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:00.928687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04e7d9b7-eca2-4bd0-94be-cc74dd2243ab tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:00.929691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04e7d9b7-eca2-4bd0-94be-cc74dd2243ab tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:00.930384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04e7d9b7-eca2-4bd0-94be-cc74dd2243ab tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:00.931077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04e7d9b7-eca2-4bd0-94be-cc74dd2243ab tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:00.952649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1c6fad8f-5f1a-4a49-8fdd-7211affea170 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:00.953682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1c6fad8f-5f1a-4a49-8fdd-7211affea170 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:00.965933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6fad8f-5f1a-4a49-8fdd-7211affea170 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:00.967014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6fad8f-5f1a-4a49-8fdd-7211affea170 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:00.967743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6fad8f-5f1a-4a49-8fdd-7211affea170 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:00.968710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6fad8f-5f1a-4a49-8fdd-7211affea170 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:00.969398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6fad8f-5f1a-4a49-8fdd-7211affea170 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:00.970687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6fad8f-5f1a-4a49-8fdd-7211affea170 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:01.368975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-04e7d9b7-eca2-4bd0-94be-cc74dd2243ab tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:01.382635 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-04e7d9b7-eca2-4bd0-94be-cc74dd2243ab tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.467779 Oct 04 21:29:01.383281 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2322/4625] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:00 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:01.411198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bf9601d2-aae0-4f39-a7fd-9f39df7eee6e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:01.411893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bf9601d2-aae0-4f39-a7fd-9f39df7eee6e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:01.421710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf9601d2-aae0-4f39-a7fd-9f39df7eee6e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:01.424158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf9601d2-aae0-4f39-a7fd-9f39df7eee6e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:01.424803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf9601d2-aae0-4f39-a7fd-9f39df7eee6e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:01.427032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf9601d2-aae0-4f39-a7fd-9f39df7eee6e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:01.431105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf9601d2-aae0-4f39-a7fd-9f39df7eee6e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:01.431762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf9601d2-aae0-4f39-a7fd-9f39df7eee6e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:01.617752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1c6fad8f-5f1a-4a49-8fdd-7211affea170 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:01.632991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1c6fad8f-5f1a-4a49-8fdd-7211affea170 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:01.639182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1c6fad8f-5f1a-4a49-8fdd-7211affea170 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:01.643445 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1c6fad8f-5f1a-4a49-8fdd-7211affea170 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1838 microversion: 2.42 time: 0.692758 Oct 04 21:29:01.662114 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2304/4626] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:00 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1838 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:29:01.842732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5cc00222-6866-489b-9850-b9c27f898075 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:01.843676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5cc00222-6866-489b-9850-b9c27f898075 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:01.860688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5cc00222-6866-489b-9850-b9c27f898075 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:01.863484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5cc00222-6866-489b-9850-b9c27f898075 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:01.867357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5cc00222-6866-489b-9850-b9c27f898075 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:01.874750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5cc00222-6866-489b-9850-b9c27f898075 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:01.879274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5cc00222-6866-489b-9850-b9c27f898075 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:01.880328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5cc00222-6866-489b-9850-b9c27f898075 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:02.066386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bf9601d2-aae0-4f39-a7fd-9f39df7eee6e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:02.081059 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bf9601d2-aae0-4f39-a7fd-9f39df7eee6e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.673938 Oct 04 21:29:02.084496 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2323/4627] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:01 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:02.310588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8aae948a-e6f4-40bc-afa3-f6d84adbe3f9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-611562310", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8aae948a-e6f4-40bc-afa3-f6d84adbe3f9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 234 Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-611562310", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-611562310', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '6854610d-7b7e-44e1-90bf-b66a6b17f7da'}]}}} Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:02.324691 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:02.336142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8aae948a-e6f4-40bc-afa3-f6d84adbe3f9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:02.341711 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8aae948a-e6f4-40bc-afa3-f6d84adbe3f9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.038682 Oct 04 21:29:02.344282 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2324/4628] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:29:02 2022] POST /compute/v2.1/servers => generated 133 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:29:02.359611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-de110db8-3420-462a-9e1a-4ce0029dbf95 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:02.359611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-de110db8-3420-462a-9e1a-4ce0029dbf95 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:02.368350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de110db8-3420-462a-9e1a-4ce0029dbf95 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:02.369342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de110db8-3420-462a-9e1a-4ce0029dbf95 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:02.370511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de110db8-3420-462a-9e1a-4ce0029dbf95 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:02.373203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de110db8-3420-462a-9e1a-4ce0029dbf95 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:02.374225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de110db8-3420-462a-9e1a-4ce0029dbf95 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:02.374764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de110db8-3420-462a-9e1a-4ce0029dbf95 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:02.632225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5cc00222-6866-489b-9850-b9c27f898075 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:02.647617 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5cc00222-6866-489b-9850-b9c27f898075 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 200 len: 1320 microversion: 2.1 time: 0.808918 Oct 04 21:29:02.648257 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2305/4629] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:01 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 1320 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:02.680690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4db4598d-d43c-4d07-ae55-2ddb40e1247e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:02.685536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4db4598d-d43c-4d07-ae55-2ddb40e1247e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:02.691408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4db4598d-d43c-4d07-ae55-2ddb40e1247e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:02.691922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4db4598d-d43c-4d07-ae55-2ddb40e1247e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:02.692376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4db4598d-d43c-4d07-ae55-2ddb40e1247e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:02.693097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4db4598d-d43c-4d07-ae55-2ddb40e1247e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:02.693600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4db4598d-d43c-4d07-ae55-2ddb40e1247e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:02.694036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4db4598d-d43c-4d07-ae55-2ddb40e1247e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:03.200492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-de110db8-3420-462a-9e1a-4ce0029dbf95 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:03.213704 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-de110db8-3420-462a-9e1a-4ce0029dbf95 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.864866 Oct 04 21:29:03.215079 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2325/4630] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:02 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:03.246370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-793459ef-b304-486e-8d7b-5e8b7d7c8057 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:03.247428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-793459ef-b304-486e-8d7b-5e8b7d7c8057 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:03.254386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:03.256074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-793459ef-b304-486e-8d7b-5e8b7d7c8057 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:03.256952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-793459ef-b304-486e-8d7b-5e8b7d7c8057 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:03.257612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-793459ef-b304-486e-8d7b-5e8b7d7c8057 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:03.258584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-793459ef-b304-486e-8d7b-5e8b7d7c8057 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:03.259208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-793459ef-b304-486e-8d7b-5e8b7d7c8057 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:03.259839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-793459ef-b304-486e-8d7b-5e8b7d7c8057 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:03.444516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4db4598d-d43c-4d07-ae55-2ddb40e1247e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:03.458804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4db4598d-d43c-4d07-ae55-2ddb40e1247e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:03.460758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4db4598d-d43c-4d07-ae55-2ddb40e1247e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:03.462755 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4db4598d-d43c-4d07-ae55-2ddb40e1247e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1838 microversion: 2.42 time: 0.786046 Oct 04 21:29:03.464125 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2306/4631] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:02 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1838 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:29:03.674994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0b935b98-1ea8-4297-8c57-75087471de41 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:03.680194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0b935b98-1ea8-4297-8c57-75087471de41 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:03.697991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b935b98-1ea8-4297-8c57-75087471de41 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:03.701755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b935b98-1ea8-4297-8c57-75087471de41 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:03.701755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b935b98-1ea8-4297-8c57-75087471de41 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:03.703467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b935b98-1ea8-4297-8c57-75087471de41 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:03.704450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b935b98-1ea8-4297-8c57-75087471de41 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:03.708927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b935b98-1ea8-4297-8c57-75087471de41 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:04.231187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0b935b98-1ea8-4297-8c57-75087471de41 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:04.246294 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0b935b98-1ea8-4297-8c57-75087471de41 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 200 len: 1511 microversion: 2.1 time: 0.576807 Oct 04 21:29:04.248539 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2307/4632] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:03 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 1511 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:04.265610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-793459ef-b304-486e-8d7b-5e8b7d7c8057 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:04.275454 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-793459ef-b304-486e-8d7b-5e8b7d7c8057 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 1.037558 Oct 04 21:29:04.276448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-12c95794-d528-48cf-95c1-92a61e90dce0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:04.277060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-12c95794-d528-48cf-95c1-92a61e90dce0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:04.277186 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2326/4633] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:03 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:29:04.292235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12c95794-d528-48cf-95c1-92a61e90dce0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:04.298417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12c95794-d528-48cf-95c1-92a61e90dce0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:04.299074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12c95794-d528-48cf-95c1-92a61e90dce0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:04.299825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12c95794-d528-48cf-95c1-92a61e90dce0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:04.300293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12c95794-d528-48cf-95c1-92a61e90dce0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:04.300715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12c95794-d528-48cf-95c1-92a61e90dce0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:04.307327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d8603284-ad96-4972-a340-5cab0e0adec1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:04.315608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d8603284-ad96-4972-a340-5cab0e0adec1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 4deb5073-b200-4e2a-b8b2-1ad503d3684d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:04.316236 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-d8603284-ad96-4972-a340-5cab0e0adec1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance 4deb5073-b200-4e2a-b8b2-1ad503d3684d could not be found. Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d8603284-ad96-4972-a340-5cab0e0adec1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/4deb5073-b200-4e2a-b8b2-1ad503d3684d/action HTTP/1.1 Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 13 Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: {"pause": {}} Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 4deb5073-b200-4e2a-b8b2-1ad503d3684d could not be found. Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '4deb5073-b200-4e2a-b8b2-1ad503d3684d', 'body': {'pause': {}}} Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4deb5073-b200-4e2a-b8b2-1ad503d3684d could not be found. Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4deb5073-b200-4e2a-b8b2-1ad503d3684d could not be found. Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:04.327231 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:04.332422 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:04.332422 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:04.332422 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4deb5073-b200-4e2a-b8b2-1ad503d3684d could not be found. Oct 04 21:29:04.332422 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:04.332422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d8603284-ad96-4972-a340-5cab0e0adec1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance 4deb5073-b200-4e2a-b8b2-1ad503d3684d could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:04.332422 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d8603284-ad96-4972-a340-5cab0e0adec1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/4deb5073-b200-4e2a-b8b2-1ad503d3684d/action" status: 404 len: 111 microversion: 2.1 time: 0.025653 Oct 04 21:29:04.332422 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2327/4634] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:29:04 2022] POST /compute/v2.1/servers/4deb5073-b200-4e2a-b8b2-1ad503d3684d/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:29:04.338753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f2a0bfac-7921-44a1-ad97-6a17d7c5a0f7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:04.339477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f2a0bfac-7921-44a1-ad97-6a17d7c5a0f7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:04.359656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2a0bfac-7921-44a1-ad97-6a17d7c5a0f7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:04.364732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2a0bfac-7921-44a1-ad97-6a17d7c5a0f7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:04.365202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2a0bfac-7921-44a1-ad97-6a17d7c5a0f7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:04.366040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2a0bfac-7921-44a1-ad97-6a17d7c5a0f7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:04.367330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2a0bfac-7921-44a1-ad97-6a17d7c5a0f7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:04.367991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2a0bfac-7921-44a1-ad97-6a17d7c5a0f7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:05.305947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-12c95794-d528-48cf-95c1-92a61e90dce0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:05.317062 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-12c95794-d528-48cf-95c1-92a61e90dce0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b" status: 200 len: 1511 microversion: 2.1 time: 1.045392 Oct 04 21:29:05.318042 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2308/4635] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:04 2022] GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b => generated 1511 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:05.344239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-c5edf2a8-c3ed-486b-bbc5-81a3f4234228 req-bde28472-3c06-4ceb-adce-2120fc40366e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "tag": "3f36f0e8-027a-49e9-b359-7053dd5e96b7"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:05.367560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c5edf2a8-c3ed-486b-bbc5-81a3f4234228 req-bde28472-3c06-4ceb-adce-2120fc40366e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:05.368220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c5edf2a8-c3ed-486b-bbc5-81a3f4234228 req-bde28472-3c06-4ceb-adce-2120fc40366e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:05.368846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c5edf2a8-c3ed-486b-bbc5-81a3f4234228 req-bde28472-3c06-4ceb-adce-2120fc40366e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:05.403071 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-c5edf2a8-c3ed-486b-bbc5-81a3f4234228 req-bde28472-3c06-4ceb-adce-2120fc40366e service nova] Creating event network-changed:3f36f0e8-027a-49e9-b359-7053dd5e96b7 for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:29:05.418557 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-c5edf2a8-c3ed-486b-bbc5-81a3f4234228 req-bde28472-3c06-4ceb-adce-2120fc40366e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098407 Oct 04 21:29:05.419450 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2309/4636] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:05.435094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f2a0bfac-7921-44a1-ad97-6a17d7c5a0f7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:05.450824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-50ce36cf-c53e-46e7-9c41-8c469c2e0812 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:05.451542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-50ce36cf-c53e-46e7-9c41-8c469c2e0812 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:05.452038 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f2a0bfac-7921-44a1-ad97-6a17d7c5a0f7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 1.117538 Oct 04 21:29:05.452922 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2328/4637] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:04 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:05.479951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8f7227a0-21aa-4804-a60e-4085fa4fb9af tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:05.479951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8f7227a0-21aa-4804-a60e-4085fa4fb9af tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: db85fc78-9a76-401a-89fc-c92d828ae8d4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:05.480485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50ce36cf-c53e-46e7-9c41-8c469c2e0812 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:05.480485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50ce36cf-c53e-46e7-9c41-8c469c2e0812 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:05.480485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50ce36cf-c53e-46e7-9c41-8c469c2e0812 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:05.480485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50ce36cf-c53e-46e7-9c41-8c469c2e0812 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:05.483888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50ce36cf-c53e-46e7-9c41-8c469c2e0812 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:05.484666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50ce36cf-c53e-46e7-9c41-8c469c2e0812 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:05.487067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f7227a0-21aa-4804-a60e-4085fa4fb9af tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:05.487754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f7227a0-21aa-4804-a60e-4085fa4fb9af tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:05.488391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f7227a0-21aa-4804-a60e-4085fa4fb9af tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:05.489280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f7227a0-21aa-4804-a60e-4085fa4fb9af tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:05.489935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f7227a0-21aa-4804-a60e-4085fa4fb9af tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:05.490530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f7227a0-21aa-4804-a60e-4085fa4fb9af tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:06.087398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8f7227a0-21aa-4804-a60e-4085fa4fb9af tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:06.100480 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8f7227a0-21aa-4804-a60e-4085fa4fb9af tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/db85fc78-9a76-401a-89fc-c92d828ae8d4" status: 200 len: 1510 microversion: 2.1 time: 0.643685 Oct 04 21:29:06.111849 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2329/4638] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:05 2022] GET /compute/v2.1/servers/db85fc78-9a76-401a-89fc-c92d828ae8d4 => generated 1510 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:06.127182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e54ab2cc-2818-497b-a679-6a18903a5958 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:06.129917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e54ab2cc-2818-497b-a679-6a18903a5958 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:06.151545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e54ab2cc-2818-497b-a679-6a18903a5958 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:06.152117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e54ab2cc-2818-497b-a679-6a18903a5958 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:06.152757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e54ab2cc-2818-497b-a679-6a18903a5958 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:06.153488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e54ab2cc-2818-497b-a679-6a18903a5958 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:06.153951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e54ab2cc-2818-497b-a679-6a18903a5958 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:06.154379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e54ab2cc-2818-497b-a679-6a18903a5958 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:06.585198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-50ce36cf-c53e-46e7-9c41-8c469c2e0812 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:06.601268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-50ce36cf-c53e-46e7-9c41-8c469c2e0812 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:06.603342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-50ce36cf-c53e-46e7-9c41-8c469c2e0812 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:06.607414 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-50ce36cf-c53e-46e7-9c41-8c469c2e0812 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1838 microversion: 2.42 time: 1.186679 Oct 04 21:29:06.634330 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2310/4639] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:05 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1838 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:06.645377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-03ae0451-e6c1-4c88-92f2-8e1970d639ad tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:06.656753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-03ae0451-e6c1-4c88-92f2-8e1970d639ad tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:06.657868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-03ae0451-e6c1-4c88-92f2-8e1970d639ad tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:06.701937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03ae0451-e6c1-4c88-92f2-8e1970d639ad tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:06.702436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03ae0451-e6c1-4c88-92f2-8e1970d639ad tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:06.709177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03ae0451-e6c1-4c88-92f2-8e1970d639ad tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:06.710053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03ae0451-e6c1-4c88-92f2-8e1970d639ad tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:06.710533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03ae0451-e6c1-4c88-92f2-8e1970d639ad tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:06.710968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03ae0451-e6c1-4c88-92f2-8e1970d639ad tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:06.871350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e54ab2cc-2818-497b-a679-6a18903a5958 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:06.885658 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e54ab2cc-2818-497b-a679-6a18903a5958 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.772271 Oct 04 21:29:06.886435 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2330/4640] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:06 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:06.897678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.multi_cell_list [None req-03ae0451-e6c1-4c88-92f2-8e1970d639ad tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:29:06.914238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9e91214f-455b-4ef5-b702-dfcf2e4d1eac tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:06.919075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9e91214f-455b-4ef5-b702-dfcf2e4d1eac tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:06.931788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e91214f-455b-4ef5-b702-dfcf2e4d1eac tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:06.935516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e91214f-455b-4ef5-b702-dfcf2e4d1eac tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:06.942403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e91214f-455b-4ef5-b702-dfcf2e4d1eac tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:06.943365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e91214f-455b-4ef5-b702-dfcf2e4d1eac tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:06.943967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e91214f-455b-4ef5-b702-dfcf2e4d1eac tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:06.944523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e91214f-455b-4ef5-b702-dfcf2e4d1eac tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:06.976096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-03ae0451-e6c1-4c88-92f2-8e1970d639ad tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:06.995212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03ae0451-e6c1-4c88-92f2-8e1970d639ad tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:06.996015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03ae0451-e6c1-4c88-92f2-8e1970d639ad tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:06.996364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03ae0451-e6c1-4c88-92f2-8e1970d639ad tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:07.333706 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9e91214f-455b-4ef5-b702-dfcf2e4d1eac tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action" status: 202 len: 0 microversion: 2.1 time: 0.425945 Oct 04 21:29:07.334444 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2331/4641] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:29:06 2022] POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:29:07.347282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9e18f87f-aaea-4ad3-8c89-075e0bf68724 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:07.356816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9e18f87f-aaea-4ad3-8c89-075e0bf68724 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:07.373393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e18f87f-aaea-4ad3-8c89-075e0bf68724 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:07.373933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e18f87f-aaea-4ad3-8c89-075e0bf68724 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:07.374483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e18f87f-aaea-4ad3-8c89-075e0bf68724 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:07.375218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e18f87f-aaea-4ad3-8c89-075e0bf68724 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:07.376303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e18f87f-aaea-4ad3-8c89-075e0bf68724 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:07.376967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e18f87f-aaea-4ad3-8c89-075e0bf68724 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:07.765730 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-03ae0451-e6c1-4c88-92f2-8e1970d639ad tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 1.129636 Oct 04 21:29:07.775266 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2311/4642] 10.222.0.30 () {58 vars in 1167 bytes} [Tue Oct 4 21:29:06 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:07.792147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ef1eacde-6355-447c-a678-2efb2b97ba98 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:07.796706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ef1eacde-6355-447c-a678-2efb2b97ba98 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:07.802152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef1eacde-6355-447c-a678-2efb2b97ba98 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:07.802940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef1eacde-6355-447c-a678-2efb2b97ba98 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:07.803690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef1eacde-6355-447c-a678-2efb2b97ba98 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:07.805044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef1eacde-6355-447c-a678-2efb2b97ba98 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:07.805863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef1eacde-6355-447c-a678-2efb2b97ba98 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:07.806508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef1eacde-6355-447c-a678-2efb2b97ba98 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:08.342199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9e18f87f-aaea-4ad3-8c89-075e0bf68724 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:08.360588 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9e18f87f-aaea-4ad3-8c89-075e0bf68724 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1511 microversion: 2.1 time: 1.018728 Oct 04 21:29:08.361415 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2332/4643] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:07 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1511 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:29:08.390264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a91f4ffd-0048-4653-8367-26cfad564a5c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:08.396560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a91f4ffd-0048-4653-8367-26cfad564a5c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:08.397715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a91f4ffd-0048-4653-8367-26cfad564a5c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-587447862', 'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:08.403933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a91f4ffd-0048-4653-8367-26cfad564a5c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:08.404422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a91f4ffd-0048-4653-8367-26cfad564a5c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:08.404864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a91f4ffd-0048-4653-8367-26cfad564a5c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:08.406722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a91f4ffd-0048-4653-8367-26cfad564a5c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:08.406722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a91f4ffd-0048-4653-8367-26cfad564a5c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:08.407080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a91f4ffd-0048-4653-8367-26cfad564a5c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:08.511324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-a91f4ffd-0048-4653-8367-26cfad564a5c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:29:08.634428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a91f4ffd-0048-4653-8367-26cfad564a5c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:08.640734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a91f4ffd-0048-4653-8367-26cfad564a5c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:08.641834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a91f4ffd-0048-4653-8367-26cfad564a5c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:08.642601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a91f4ffd-0048-4653-8367-26cfad564a5c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:08.832559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ef1eacde-6355-447c-a678-2efb2b97ba98 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:08.845956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ef1eacde-6355-447c-a678-2efb2b97ba98 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:08.856591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ef1eacde-6355-447c-a678-2efb2b97ba98 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:08.858175 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ef1eacde-6355-447c-a678-2efb2b97ba98 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1859 microversion: 2.42 time: 1.080724 Oct 04 21:29:08.870628 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2312/4644] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:07 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1859 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:09.063519 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a91f4ffd-0048-4653-8367-26cfad564a5c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-587447862" status: 200 len: 1514 microversion: 2.1 time: 0.680067 Oct 04 21:29:09.064496 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2333/4645] 10.222.0.30 () {58 vars in 1261 bytes} [Tue Oct 4 21:29:08 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-587447862 => generated 1514 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:09.109037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7cad56ed-609e-4209-84cf-85f17fad450b tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:09.125947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7cad56ed-609e-4209-84cf-85f17fad450b tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:09.127585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7cad56ed-609e-4209-84cf-85f17fad450b tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:09.151320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cad56ed-609e-4209-84cf-85f17fad450b tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:09.151820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cad56ed-609e-4209-84cf-85f17fad450b tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:09.153629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cad56ed-609e-4209-84cf-85f17fad450b tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:09.158429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cad56ed-609e-4209-84cf-85f17fad450b tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:09.160822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cad56ed-609e-4209-84cf-85f17fad450b tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:09.160822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cad56ed-609e-4209-84cf-85f17fad450b tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:09.308062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-9163a7f3-737a-4a04-8b9f-0b09c9bf7b37 req-7618ce44-e6c2-4cdc-a8b6-e6a0268cabd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "tag": "a034a9b0-c92a-4d81-bced-4e3be86dabfe"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:09.325212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.multi_cell_list [None req-7cad56ed-609e-4209-84cf-85f17fad450b tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:29:09.353547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9163a7f3-737a-4a04-8b9f-0b09c9bf7b37 req-7618ce44-e6c2-4cdc-a8b6-e6a0268cabd7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:09.359016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9163a7f3-737a-4a04-8b9f-0b09c9bf7b37 req-7618ce44-e6c2-4cdc-a8b6-e6a0268cabd7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:09.359637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9163a7f3-737a-4a04-8b9f-0b09c9bf7b37 req-7618ce44-e6c2-4cdc-a8b6-e6a0268cabd7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:09.402479 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-9163a7f3-737a-4a04-8b9f-0b09c9bf7b37 req-7618ce44-e6c2-4cdc-a8b6-e6a0268cabd7 service nova] Creating event network-changed:a034a9b0-c92a-4d81-bced-4e3be86dabfe for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:29:09.409002 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-9163a7f3-737a-4a04-8b9f-0b09c9bf7b37 req-7618ce44-e6c2-4cdc-a8b6-e6a0268cabd7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105543 Oct 04 21:29:09.410626 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2334/4646] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:09.428138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e58c1dfe-67e3-4ab3-8b7c-4a222a18d6a8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:09.429235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e58c1dfe-67e3-4ab3-8b7c-4a222a18d6a8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:09.437901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e58c1dfe-67e3-4ab3-8b7c-4a222a18d6a8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:09.439587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e58c1dfe-67e3-4ab3-8b7c-4a222a18d6a8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:09.440265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e58c1dfe-67e3-4ab3-8b7c-4a222a18d6a8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:09.441835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e58c1dfe-67e3-4ab3-8b7c-4a222a18d6a8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:09.455107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e58c1dfe-67e3-4ab3-8b7c-4a222a18d6a8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:09.458148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e58c1dfe-67e3-4ab3-8b7c-4a222a18d6a8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:09.467552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:09.525075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7cad56ed-609e-4209-84cf-85f17fad450b tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:09.562022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cad56ed-609e-4209-84cf-85f17fad450b tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:09.563871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cad56ed-609e-4209-84cf-85f17fad450b tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:09.564816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cad56ed-609e-4209-84cf-85f17fad450b tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:10.271501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e58c1dfe-67e3-4ab3-8b7c-4a222a18d6a8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:10.274626 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7cad56ed-609e-4209-84cf-85f17fad450b tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 1.184524 Oct 04 21:29:10.276019 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2313/4647] 10.222.0.30 () {58 vars in 1173 bytes} [Tue Oct 4 21:29:09 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:10.284921 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e58c1dfe-67e3-4ab3-8b7c-4a222a18d6a8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1491 microversion: 2.1 time: 0.872841 Oct 04 21:29:10.289834 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2335/4648] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:09 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1491 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:10.307758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e0c5d117-99f8-499c-b31e-5646f529e24d tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:10.309048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-33de560f-874d-4cf1-8707-b83db0891683 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:10.310984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-33de560f-874d-4cf1-8707-b83db0891683 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:10.317550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e0c5d117-99f8-499c-b31e-5646f529e24d tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:10.319259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.compute.servers [None req-e0c5d117-99f8-499c-b31e-5646f529e24d tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Removing options 'limit' from query {{(pid=122757) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 21:29:10.321164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e0c5d117-99f8-499c-b31e-5646f529e24d tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:10.327277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33de560f-874d-4cf1-8707-b83db0891683 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:10.331018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33de560f-874d-4cf1-8707-b83db0891683 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:10.336516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33de560f-874d-4cf1-8707-b83db0891683 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:10.336655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0c5d117-99f8-499c-b31e-5646f529e24d tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:10.336655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0c5d117-99f8-499c-b31e-5646f529e24d tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:10.336900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33de560f-874d-4cf1-8707-b83db0891683 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:10.337003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0c5d117-99f8-499c-b31e-5646f529e24d tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:10.337111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33de560f-874d-4cf1-8707-b83db0891683 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:10.337111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33de560f-874d-4cf1-8707-b83db0891683 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:10.337303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0c5d117-99f8-499c-b31e-5646f529e24d tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:10.338930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0c5d117-99f8-499c-b31e-5646f529e24d tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:10.339595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0c5d117-99f8-499c-b31e-5646f529e24d tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:10.413822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e0c5d117-99f8-499c-b31e-5646f529e24d tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:10.428427 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0c5d117-99f8-499c-b31e-5646f529e24d tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:10.428929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0c5d117-99f8-499c-b31e-5646f529e24d tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:10.429650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0c5d117-99f8-499c-b31e-5646f529e24d tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:11.042253 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e0c5d117-99f8-499c-b31e-5646f529e24d tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.738791 Oct 04 21:29:11.043406 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2336/4649] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Oct 4 21:29:10 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:29:11.062384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f1955790-1065-4914-9e27-e8c4e580c70a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:11.063554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f1955790-1065-4914-9e27-e8c4e580c70a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:11.074167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1955790-1065-4914-9e27-e8c4e580c70a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:11.074697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1955790-1065-4914-9e27-e8c4e580c70a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:11.076391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1955790-1065-4914-9e27-e8c4e580c70a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:11.077132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1955790-1065-4914-9e27-e8c4e580c70a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:11.077640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1955790-1065-4914-9e27-e8c4e580c70a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:11.078135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1955790-1065-4914-9e27-e8c4e580c70a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:11.091841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-33de560f-874d-4cf1-8707-b83db0891683 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:11.096696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:11.111196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-33de560f-874d-4cf1-8707-b83db0891683 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:11.113055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-33de560f-874d-4cf1-8707-b83db0891683 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:11.119621 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-33de560f-874d-4cf1-8707-b83db0891683 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1847 microversion: 2.42 time: 0.833069 Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-f1955790-1065-4914-9e27-e8c4e580c70a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Cannot 'pause' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state paused Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f1955790-1065-4914-9e27-e8c4e580c70a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action HTTP/1.1 Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 13 Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: {"pause": {}} Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: exception: Cannot 'pause' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state paused Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '144fff2d-9df3-4a93-833f-7f76acc85185', 'body': {'pause': {}}} Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 144fff2d-9df3-4a93-833f-7f76acc85185 in vm_state paused. Cannot pause while the instance is in this state. Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state paused Oct 04 21:29:11.132752 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:11.151115 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:11.151115 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:11.151115 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:11.151115 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:11.151115 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:11.151115 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:11.151115 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:11.151115 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state paused Oct 04 21:29:11.151115 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:11.151115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f1955790-1065-4914-9e27-e8c4e580c70a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 409 to user: Cannot 'pause' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state paused {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:11.151115 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f1955790-1065-4914-9e27-e8c4e580c70a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action" status: 409 len: 143 microversion: 2.1 time: 0.088897 Oct 04 21:29:11.151115 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2337/4650] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:29:11 2022] POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action => generated 143 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:29:11.151115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cb453a2b-64bb-46fe-a679-6762247977ec tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:11.152159 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2314/4651] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:10 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1847 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:11.152260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cb453a2b-64bb-46fe-a679-6762247977ec tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:11.152260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cb453a2b-64bb-46fe-a679-6762247977ec tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:11.156691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb453a2b-64bb-46fe-a679-6762247977ec tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:11.158111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb453a2b-64bb-46fe-a679-6762247977ec tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:11.158377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1bdeda52-bb4d-4c22-a578-564227b76839 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:11.158703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb453a2b-64bb-46fe-a679-6762247977ec tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:11.159294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1bdeda52-bb4d-4c22-a578-564227b76839 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:11.159512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb453a2b-64bb-46fe-a679-6762247977ec tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:11.159986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb453a2b-64bb-46fe-a679-6762247977ec tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:11.160424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb453a2b-64bb-46fe-a679-6762247977ec tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:11.176587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1bdeda52-bb4d-4c22-a578-564227b76839 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:11.177288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1bdeda52-bb4d-4c22-a578-564227b76839 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:11.178049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1bdeda52-bb4d-4c22-a578-564227b76839 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:11.184495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1bdeda52-bb4d-4c22-a578-564227b76839 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:11.184495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1bdeda52-bb4d-4c22-a578-564227b76839 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:11.184495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1bdeda52-bb4d-4c22-a578-564227b76839 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:11.215789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-cb453a2b-64bb-46fe-a679-6762247977ec tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:29:11.282380 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cb453a2b-64bb-46fe-a679-6762247977ec tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.144008 Oct 04 21:29:11.292867 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2338/4652] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:29:11 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:11.313058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f353b55e-b275-4cd3-8b6e-d0fb2018fe65 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:11.327034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f353b55e-b275-4cd3-8b6e-d0fb2018fe65 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:11.333484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.compute.servers [None req-f353b55e-b275-4cd3-8b6e-d0fb2018fe65 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Removing options 'limit' from query {{(pid=122757) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 21:29:11.333484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f353b55e-b275-4cd3-8b6e-d0fb2018fe65 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:11.342554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f353b55e-b275-4cd3-8b6e-d0fb2018fe65 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:11.343047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f353b55e-b275-4cd3-8b6e-d0fb2018fe65 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:11.343564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f353b55e-b275-4cd3-8b6e-d0fb2018fe65 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:11.345052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f353b55e-b275-4cd3-8b6e-d0fb2018fe65 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:11.345586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f353b55e-b275-4cd3-8b6e-d0fb2018fe65 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:11.346020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f353b55e-b275-4cd3-8b6e-d0fb2018fe65 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:11.402163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-f353b55e-b275-4cd3-8b6e-d0fb2018fe65 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:29:11.417834 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1bdeda52-bb4d-4c22-a578-564227b76839 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action" status: 202 len: 0 microversion: 2.1 time: 0.270224 Oct 04 21:29:11.421744 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2315/4653] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:29:11 2022] POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:29:11.445002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b13fc318-b2c3-4d93-b5d2-c50ea1bd7331 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:11.445866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b13fc318-b2c3-4d93-b5d2-c50ea1bd7331 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:11.458891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b13fc318-b2c3-4d93-b5d2-c50ea1bd7331 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:11.459795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b13fc318-b2c3-4d93-b5d2-c50ea1bd7331 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:11.460423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b13fc318-b2c3-4d93-b5d2-c50ea1bd7331 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:11.465553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b13fc318-b2c3-4d93-b5d2-c50ea1bd7331 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:11.465553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b13fc318-b2c3-4d93-b5d2-c50ea1bd7331 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:11.465553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b13fc318-b2c3-4d93-b5d2-c50ea1bd7331 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:11.491822 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f353b55e-b275-4cd3-8b6e-d0fb2018fe65 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.192369 Oct 04 21:29:11.504549 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2339/4654] 10.222.0.30 () {58 vars in 1150 bytes} [Tue Oct 4 21:29:11 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:11.509605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aa5c8b68-b0e9-4fc5-8361-a729f5729f9c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:11.548333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-aa5c8b68-b0e9-4fc5-8361-a729f5729f9c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:11.549296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-aa5c8b68-b0e9-4fc5-8361-a729f5729f9c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:11.557504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa5c8b68-b0e9-4fc5-8361-a729f5729f9c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:11.558456 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa5c8b68-b0e9-4fc5-8361-a729f5729f9c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:11.559633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa5c8b68-b0e9-4fc5-8361-a729f5729f9c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:11.580842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa5c8b68-b0e9-4fc5-8361-a729f5729f9c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:11.581568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa5c8b68-b0e9-4fc5-8361-a729f5729f9c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:11.583671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa5c8b68-b0e9-4fc5-8361-a729f5729f9c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:11.644035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-aa5c8b68-b0e9-4fc5-8361-a729f5729f9c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:29:11.730586 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-aa5c8b68-b0e9-4fc5-8361-a729f5729f9c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.223735 Oct 04 21:29:11.730586 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2340/4655] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Oct 4 21:29:11 2022] GET /compute/v2.1/servers => generated 1009 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:11.747978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-035a6b14-f26d-4600-8076-7f186b46db2e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:11.762341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-035a6b14-f26d-4600-8076-7f186b46db2e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:11.765709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-035a6b14-f26d-4600-8076-7f186b46db2e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:11.799891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-035a6b14-f26d-4600-8076-7f186b46db2e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:11.800396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-035a6b14-f26d-4600-8076-7f186b46db2e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:11.800838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-035a6b14-f26d-4600-8076-7f186b46db2e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:11.801608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-035a6b14-f26d-4600-8076-7f186b46db2e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:11.802079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-035a6b14-f26d-4600-8076-7f186b46db2e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:11.802495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-035a6b14-f26d-4600-8076-7f186b46db2e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:12.061054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-035a6b14-f26d-4600-8076-7f186b46db2e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:29:12.220071 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-035a6b14-f26d-4600-8076-7f186b46db2e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.475709 Oct 04 21:29:12.227367 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2341/4656] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:29:11 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:12.237229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dccb4f34-0358-403d-91f1-de96fcaf4b2a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:12.237799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dccb4f34-0358-403d-91f1-de96fcaf4b2a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:12.252249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dccb4f34-0358-403d-91f1-de96fcaf4b2a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:12.252766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dccb4f34-0358-403d-91f1-de96fcaf4b2a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:12.253201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dccb4f34-0358-403d-91f1-de96fcaf4b2a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:12.262462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dccb4f34-0358-403d-91f1-de96fcaf4b2a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:12.263027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dccb4f34-0358-403d-91f1-de96fcaf4b2a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:12.263600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dccb4f34-0358-403d-91f1-de96fcaf4b2a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:12.811553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b13fc318-b2c3-4d93-b5d2-c50ea1bd7331 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:12.831439 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b13fc318-b2c3-4d93-b5d2-c50ea1bd7331 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1498 microversion: 2.1 time: 1.406463 Oct 04 21:29:12.832566 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2316/4657] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:11 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1498 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:12.842141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-67db1b49-405e-4edf-8082-7a6f1a2ac75c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:12.863802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67db1b49-405e-4edf-8082-7a6f1a2ac75c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:12.864539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.compute.servers [None req-67db1b49-405e-4edf-8082-7a6f1a2ac75c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Removing options 'limit' from query {{(pid=122758) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 21:29:12.865593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-67db1b49-405e-4edf-8082-7a6f1a2ac75c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:12.878748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67db1b49-405e-4edf-8082-7a6f1a2ac75c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:12.879687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67db1b49-405e-4edf-8082-7a6f1a2ac75c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:12.880474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67db1b49-405e-4edf-8082-7a6f1a2ac75c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:12.881510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67db1b49-405e-4edf-8082-7a6f1a2ac75c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:12.882496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67db1b49-405e-4edf-8082-7a6f1a2ac75c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:12.883737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67db1b49-405e-4edf-8082-7a6f1a2ac75c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:12.927020 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-67db1b49-405e-4edf-8082-7a6f1a2ac75c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.091743 Oct 04 21:29:12.929007 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2317/4658] 10.222.0.30 () {58 vars in 1140 bytes} [Tue Oct 4 21:29:12 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:12.947185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-069fc885-38c0-4608-a87e-f2c2b0ce6190 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:12.964852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-069fc885-38c0-4608-a87e-f2c2b0ce6190 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:12.965597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-069fc885-38c0-4608-a87e-f2c2b0ce6190 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-587447862', 'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:12.975041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-069fc885-38c0-4608-a87e-f2c2b0ce6190 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:12.975932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-069fc885-38c0-4608-a87e-f2c2b0ce6190 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:12.976585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-069fc885-38c0-4608-a87e-f2c2b0ce6190 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:12.977570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-069fc885-38c0-4608-a87e-f2c2b0ce6190 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:12.978290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-069fc885-38c0-4608-a87e-f2c2b0ce6190 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:12.978932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-069fc885-38c0-4608-a87e-f2c2b0ce6190 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:13.148485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.multi_cell_list [None req-069fc885-38c0-4608-a87e-f2c2b0ce6190 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:29:13.274285 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-069fc885-38c0-4608-a87e-f2c2b0ce6190 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-587447862" status: 200 len: 345 microversion: 2.1 time: 0.330559 Oct 04 21:29:13.289617 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2318/4659] 10.222.0.30 () {58 vars in 1240 bytes} [Tue Oct 4 21:29:12 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-587447862 => generated 345 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:13.297390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-55c6fd39-25f0-411d-810c-5983e16c6269 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:13.303173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55c6fd39-25f0-411d-810c-5983e16c6269 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:13.304522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55c6fd39-25f0-411d-810c-5983e16c6269 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:13.305156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55c6fd39-25f0-411d-810c-5983e16c6269 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:13.339391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-55c6fd39-25f0-411d-810c-5983e16c6269 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Going to try to stop instance {{(pid=122758) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:29:13.449315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dccb4f34-0358-403d-91f1-de96fcaf4b2a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:13.458308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dccb4f34-0358-403d-91f1-de96fcaf4b2a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:13.459817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dccb4f34-0358-403d-91f1-de96fcaf4b2a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:13.461034 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dccb4f34-0358-403d-91f1-de96fcaf4b2a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 1.234157 Oct 04 21:29:13.461631 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2342/4660] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:12 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:13.577782 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-55c6fd39-25f0-411d-810c-5983e16c6269 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "POST /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b/action" status: 202 len: 0 microversion: 2.1 time: 0.285604 Oct 04 21:29:13.582443 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2319/4661] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:29:13 2022] POST /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:29:13.596381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-35704ad5-ec27-4536-b3d9-12577a5e23ca tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:13.597134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-35704ad5-ec27-4536-b3d9-12577a5e23ca tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:13.615403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35704ad5-ec27-4536-b3d9-12577a5e23ca tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:13.616665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35704ad5-ec27-4536-b3d9-12577a5e23ca tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:13.618036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35704ad5-ec27-4536-b3d9-12577a5e23ca tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:13.620503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35704ad5-ec27-4536-b3d9-12577a5e23ca tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:13.621991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35704ad5-ec27-4536-b3d9-12577a5e23ca tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:13.622844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35704ad5-ec27-4536-b3d9-12577a5e23ca tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:13.727763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-927bc08b-f04e-4515-b124-549e7b2ca5b7 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-482650585", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:13.799630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-927bc08b-f04e-4515-b124-549e7b2ca5b7 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:29:14.086002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-35704ad5-ec27-4536-b3d9-12577a5e23ca tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:14.096222 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-35704ad5-ec27-4536-b3d9-12577a5e23ca tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b" status: 200 len: 1521 microversion: 2.1 time: 0.508970 Oct 04 21:29:14.101983 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2343/4662] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:13 2022] GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b => generated 1521 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:14.117812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-60a1d889-c310-4aa1-94c1-024e3b63ce91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:14.118432 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-60a1d889-c310-4aa1-94c1-024e3b63ce91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:14.126447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60a1d889-c310-4aa1-94c1-024e3b63ce91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:14.127199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60a1d889-c310-4aa1-94c1-024e3b63ce91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:14.127802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60a1d889-c310-4aa1-94c1-024e3b63ce91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:14.128677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60a1d889-c310-4aa1-94c1-024e3b63ce91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:14.129297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60a1d889-c310-4aa1-94c1-024e3b63ce91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:14.129911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60a1d889-c310-4aa1-94c1-024e3b63ce91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:14.660906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-60a1d889-c310-4aa1-94c1-024e3b63ce91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:14.679217 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-60a1d889-c310-4aa1-94c1-024e3b63ce91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.565747 Oct 04 21:29:14.680578 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2344/4663] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:14 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:14.691382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b1c6fe32-3100-4ebe-a1c4-0dc1eddcd581 req-aa8fffb0-b4f5-4355-bd61-509f01f64891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "tag": "894d7765-eae0-4e33-8784-9f8532801474"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:14.729773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b1c6fe32-3100-4ebe-a1c4-0dc1eddcd581 req-aa8fffb0-b4f5-4355-bd61-509f01f64891 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:14.730578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b1c6fe32-3100-4ebe-a1c4-0dc1eddcd581 req-aa8fffb0-b4f5-4355-bd61-509f01f64891 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:14.731266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b1c6fe32-3100-4ebe-a1c4-0dc1eddcd581 req-aa8fffb0-b4f5-4355-bd61-509f01f64891 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:14.756087 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b1c6fe32-3100-4ebe-a1c4-0dc1eddcd581 req-aa8fffb0-b4f5-4355-bd61-509f01f64891 service nova] Creating event network-changed:894d7765-eae0-4e33-8784-9f8532801474 for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:29:14.762097 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b1c6fe32-3100-4ebe-a1c4-0dc1eddcd581 req-aa8fffb0-b4f5-4355-bd61-509f01f64891 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079992 Oct 04 21:29:14.763419 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2345/4664] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:14.770434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5d0ac17c-c9b9-4cd0-97d9-282f39e2743e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:14.772071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5d0ac17c-c9b9-4cd0-97d9-282f39e2743e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:14.780312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d0ac17c-c9b9-4cd0-97d9-282f39e2743e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:14.781157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d0ac17c-c9b9-4cd0-97d9-282f39e2743e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:14.782492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d0ac17c-c9b9-4cd0-97d9-282f39e2743e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:14.788964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d0ac17c-c9b9-4cd0-97d9-282f39e2743e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:14.788964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d0ac17c-c9b9-4cd0-97d9-282f39e2743e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:14.788964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d0ac17c-c9b9-4cd0-97d9-282f39e2743e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:14.846655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-927bc08b-f04e-4515-b124-549e7b2ca5b7 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:29:14.847149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-927bc08b-f04e-4515-b124-549e7b2ca5b7 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:29:14.847636 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-927bc08b-f04e-4515-b124-549e7b2ca5b7 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:29:14.848108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-927bc08b-f04e-4515-b124-549e7b2ca5b7 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:29:14.848755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-927bc08b-f04e-4515-b124-549e7b2ca5b7 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:29:14.869178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-927bc08b-f04e-4515-b124-549e7b2ca5b7 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:14.870071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-927bc08b-f04e-4515-b124-549e7b2ca5b7 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:14.870880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-927bc08b-f04e-4515-b124-549e7b2ca5b7 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:14.871835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-927bc08b-f04e-4515-b124-549e7b2ca5b7 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:14.874227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-927bc08b-f04e-4515-b124-549e7b2ca5b7 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:14.880560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-927bc08b-f04e-4515-b124-549e7b2ca5b7 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:14.922397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-927bc08b-f04e-4515-b124-549e7b2ca5b7 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Getting quotas for project c333838cc56b4d1ca8e3a958ef7e3599. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:29:14.929932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-927bc08b-f04e-4515-b124-549e7b2ca5b7 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Getting quotas for user f5921599c20640a09da6909a1ba3aece and project c333838cc56b4d1ca8e3a958ef7e3599. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:29:14.963699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-927bc08b-f04e-4515-b124-549e7b2ca5b7 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:29:14.968393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-927bc08b-f04e-4515-b124-549e7b2ca5b7 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] [instance: 94d63466-634c-4c84-9b35-38ba9234431d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:29:15.135022 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-927bc08b-f04e-4515-b124-549e7b2ca5b7 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.414531 Oct 04 21:29:15.135693 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2320/4665] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:29:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:29:15.140696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2dc6fb32-f4a3-4764-9618-ec2f03e1d58a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:15.149913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2dc6fb32-f4a3-4764-9618-ec2f03e1d58a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:15.160540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2dc6fb32-f4a3-4764-9618-ec2f03e1d58a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:15.161951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2dc6fb32-f4a3-4764-9618-ec2f03e1d58a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:15.162416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2dc6fb32-f4a3-4764-9618-ec2f03e1d58a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:15.163349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2dc6fb32-f4a3-4764-9618-ec2f03e1d58a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:15.163962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2dc6fb32-f4a3-4764-9618-ec2f03e1d58a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:15.165982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2dc6fb32-f4a3-4764-9618-ec2f03e1d58a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:15.555121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2dc6fb32-f4a3-4764-9618-ec2f03e1d58a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:15.568567 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2dc6fb32-f4a3-4764-9618-ec2f03e1d58a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.431378 Oct 04 21:29:15.583551 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2321/4666] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:15 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:15.593482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b3e4e445-6fb4-4e36-9b9a-4e856e1a3c8a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:15.595533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b3e4e445-6fb4-4e36-9b9a-4e856e1a3c8a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:15.602358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3e4e445-6fb4-4e36-9b9a-4e856e1a3c8a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:15.603231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3e4e445-6fb4-4e36-9b9a-4e856e1a3c8a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:15.603893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3e4e445-6fb4-4e36-9b9a-4e856e1a3c8a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:15.605229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3e4e445-6fb4-4e36-9b9a-4e856e1a3c8a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:15.606001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3e4e445-6fb4-4e36-9b9a-4e856e1a3c8a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:15.607663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3e4e445-6fb4-4e36-9b9a-4e856e1a3c8a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:16.469794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5d0ac17c-c9b9-4cd0-97d9-282f39e2743e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:16.490084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5d0ac17c-c9b9-4cd0-97d9-282f39e2743e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:16.491891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5d0ac17c-c9b9-4cd0-97d9-282f39e2743e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:16.493123 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5d0ac17c-c9b9-4cd0-97d9-282f39e2743e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 1.728386 Oct 04 21:29:16.495286 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2346/4667] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:14 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:16.532572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d6a528b2-5b41-4b4d-8709-7ff6d156f3ed tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:16.534396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d6a528b2-5b41-4b4d-8709-7ff6d156f3ed tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] [instance: 94d63466-634c-4c84-9b35-38ba9234431d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:16.584097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b3e4e445-6fb4-4e36-9b9a-4e856e1a3c8a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:16.593931 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b3e4e445-6fb4-4e36-9b9a-4e856e1a3c8a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b" status: 200 len: 1521 microversion: 2.1 time: 1.008898 Oct 04 21:29:16.595968 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2322/4668] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:15 2022] GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b => generated 1521 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:16.602543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8873bc9c-8fbf-43b9-9872-a4ac538e49f6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:16.606280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8873bc9c-8fbf-43b9-9872-a4ac538e49f6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:16.615762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8873bc9c-8fbf-43b9-9872-a4ac538e49f6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:16.616477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8873bc9c-8fbf-43b9-9872-a4ac538e49f6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:16.617078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8873bc9c-8fbf-43b9-9872-a4ac538e49f6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:16.617986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8873bc9c-8fbf-43b9-9872-a4ac538e49f6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:16.618623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8873bc9c-8fbf-43b9-9872-a4ac538e49f6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:16.619316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8873bc9c-8fbf-43b9-9872-a4ac538e49f6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:16.639547 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-8873bc9c-8fbf-43b9-9872-a4ac538e49f6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8873bc9c-8fbf-43b9-9872-a4ac538e49f6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315/action HTTP/1.1 Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 28 Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: {"reboot": {"type": "SOFT"}} Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'ae649a1e-b6ec-4d6c-9584-7738fff25315', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:29:16.642078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:29:16.649319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:29:16.649319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:16.649319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:16.649319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:16.649319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:16.649319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:16.649319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:16.649319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:16.649319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:16.649319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:29:16.649319 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:16.649319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8873bc9c-8fbf-43b9-9872-a4ac538e49f6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:16.659052 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8873bc9c-8fbf-43b9-9872-a4ac538e49f6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315/action" status: 404 len: 111 microversion: 2.1 time: 0.053831 Oct 04 21:29:16.659052 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2323/4669] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:29:16 2022] POST /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:29:16.665377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9a8e141e-dfaa-463b-8763-55f67b9a258c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:16.665918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9a8e141e-dfaa-463b-8763-55f67b9a258c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: e48d8482-b411-41d3-acab-2505e7521d63] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:16.684268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a8e141e-dfaa-463b-8763-55f67b9a258c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:16.684268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a8e141e-dfaa-463b-8763-55f67b9a258c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:16.685780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a8e141e-dfaa-463b-8763-55f67b9a258c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:16.687507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a8e141e-dfaa-463b-8763-55f67b9a258c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:16.690031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a8e141e-dfaa-463b-8763-55f67b9a258c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:16.694039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a8e141e-dfaa-463b-8763-55f67b9a258c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:16.695897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d6a528b2-5b41-4b4d-8709-7ff6d156f3ed tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5921599c20640a09da6909a1ba3aece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c333838cc56b4d1ca8e3a958ef7e3599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:16.703645 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d6a528b2-5b41-4b4d-8709-7ff6d156f3ed tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] 10.222.0.30 "GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d" status: 200 len: 1214 microversion: 2.1 time: 0.189085 Oct 04 21:29:16.713606 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2347/4670] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:16 2022] GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d => generated 1214 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:16.720781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-293270a5-664a-4380-951d-f17ec41db860 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:16.721748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-293270a5-664a-4380-951d-f17ec41db860 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:16.751807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-293270a5-664a-4380-951d-f17ec41db860 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:16.754307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-293270a5-664a-4380-951d-f17ec41db860 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:16.757096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-293270a5-664a-4380-951d-f17ec41db860 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:16.760156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-293270a5-664a-4380-951d-f17ec41db860 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:16.760902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-293270a5-664a-4380-951d-f17ec41db860 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:16.761699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-293270a5-664a-4380-951d-f17ec41db860 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:16.817388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9a8e141e-dfaa-463b-8763-55f67b9a258c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: e48d8482-b411-41d3-acab-2505e7521d63] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:29:17.103608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-293270a5-664a-4380-951d-f17ec41db860 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:17.112745 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-293270a5-664a-4380-951d-f17ec41db860 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.404591 Oct 04 21:29:17.113340 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2348/4671] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:16 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:17.138333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e922f7c7-f390-416c-9b4f-bf900e4061cd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:17.138953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e922f7c7-f390-416c-9b4f-bf900e4061cd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:17.146188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e922f7c7-f390-416c-9b4f-bf900e4061cd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:17.146690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e922f7c7-f390-416c-9b4f-bf900e4061cd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:17.147413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e922f7c7-f390-416c-9b4f-bf900e4061cd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:17.148775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e922f7c7-f390-416c-9b4f-bf900e4061cd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:17.149478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e922f7c7-f390-416c-9b4f-bf900e4061cd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:17.153992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e922f7c7-f390-416c-9b4f-bf900e4061cd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:17.163972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:17.319283 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9a8e141e-dfaa-463b-8763-55f67b9a258c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63" status: 204 len: 0 microversion: 2.1 time: 0.666219 Oct 04 21:29:17.320202 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2324/4672] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:29:16 2022] DELETE /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:29:17.329674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-614e62e0-69a3-43a2-a5be-9b876cfbca26 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:17.332281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-614e62e0-69a3-43a2-a5be-9b876cfbca26 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: e48d8482-b411-41d3-acab-2505e7521d63] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:17.350375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-614e62e0-69a3-43a2-a5be-9b876cfbca26 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:17.351198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-614e62e0-69a3-43a2-a5be-9b876cfbca26 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:17.355167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-614e62e0-69a3-43a2-a5be-9b876cfbca26 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:17.356130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-614e62e0-69a3-43a2-a5be-9b876cfbca26 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:17.358156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-614e62e0-69a3-43a2-a5be-9b876cfbca26 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:17.358794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-614e62e0-69a3-43a2-a5be-9b876cfbca26 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:17.537862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e922f7c7-f390-416c-9b4f-bf900e4061cd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:17.551306 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e922f7c7-f390-416c-9b4f-bf900e4061cd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.416997 Oct 04 21:29:17.552273 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2349/4673] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:17 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:17.571196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0e204262-ab26-453c-a87c-fa4a2137f695 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:17.572038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0e204262-ab26-453c-a87c-fa4a2137f695 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:17.579806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e204262-ab26-453c-a87c-fa4a2137f695 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:17.580398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e204262-ab26-453c-a87c-fa4a2137f695 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:17.588138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e204262-ab26-453c-a87c-fa4a2137f695 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:17.589867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e204262-ab26-453c-a87c-fa4a2137f695 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:17.592713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e204262-ab26-453c-a87c-fa4a2137f695 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:17.593275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e204262-ab26-453c-a87c-fa4a2137f695 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:17.909938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-614e62e0-69a3-43a2-a5be-9b876cfbca26 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:17.933642 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-614e62e0-69a3-43a2-a5be-9b876cfbca26 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63" status: 200 len: 1552 microversion: 2.1 time: 0.607302 Oct 04 21:29:17.936238 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2325/4674] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:17 2022] GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63 => generated 1552 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:17.944656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-eeeb56c5-386f-4d1c-a80f-a95ff5968fe9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:17.948587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-eeeb56c5-386f-4d1c-a80f-a95ff5968fe9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 01c7b368-723e-4eef-8d08-9e933a1fad4c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:17.962903 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-eeeb56c5-386f-4d1c-a80f-a95ff5968fe9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance 01c7b368-723e-4eef-8d08-9e933a1fad4c could not be found. Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-eeeb56c5-386f-4d1c-a80f-a95ff5968fe9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/01c7b368-723e-4eef-8d08-9e933a1fad4c/action HTTP/1.1 Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 28 Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: {"reboot": {"type": "SOFT"}} Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 01c7b368-723e-4eef-8d08-9e933a1fad4c could not be found. Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '01c7b368-723e-4eef-8d08-9e933a1fad4c', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c7b368-723e-4eef-8d08-9e933a1fad4c could not be found. Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c7b368-723e-4eef-8d08-9e933a1fad4c could not be found. Oct 04 21:29:17.967689 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:17.981796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:17.981796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:17.981796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:17.981796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:17.981796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:17.981796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:17.981796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:17.981796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c7b368-723e-4eef-8d08-9e933a1fad4c could not be found. Oct 04 21:29:17.981796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:17.981796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-eeeb56c5-386f-4d1c-a80f-a95ff5968fe9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance 01c7b368-723e-4eef-8d08-9e933a1fad4c could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:17.981796 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-eeeb56c5-386f-4d1c-a80f-a95ff5968fe9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/01c7b368-723e-4eef-8d08-9e933a1fad4c/action" status: 404 len: 111 microversion: 2.1 time: 0.034209 Oct 04 21:29:17.981796 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2326/4675] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:29:17 2022] POST /compute/v2.1/servers/01c7b368-723e-4eef-8d08-9e933a1fad4c/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:29:17.981796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-67cb0209-34fb-44a1-bd32-45ec32b7c552 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:17.981796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-67cb0209-34fb-44a1-bd32-45ec32b7c552 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:17.991876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67cb0209-34fb-44a1-bd32-45ec32b7c552 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:17.992393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67cb0209-34fb-44a1-bd32-45ec32b7c552 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:17.992852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67cb0209-34fb-44a1-bd32-45ec32b7c552 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:17.993760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67cb0209-34fb-44a1-bd32-45ec32b7c552 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:17.994291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67cb0209-34fb-44a1-bd32-45ec32b7c552 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:17.994755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67cb0209-34fb-44a1-bd32-45ec32b7c552 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:18.023948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0e204262-ab26-453c-a87c-fa4a2137f695 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:18.035995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0e204262-ab26-453c-a87c-fa4a2137f695 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:18.041651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0e204262-ab26-453c-a87c-fa4a2137f695 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:18.044848 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0e204262-ab26-453c-a87c-fa4a2137f695 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.486347 Oct 04 21:29:18.050682 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2350/4676] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:17 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:18.074678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3d405478-2b83-40dc-ae36-b14ad8175a90 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:18.075866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3d405478-2b83-40dc-ae36-b14ad8175a90 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] [instance: 94d63466-634c-4c84-9b35-38ba9234431d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:18.092569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d405478-2b83-40dc-ae36-b14ad8175a90 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:18.093074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d405478-2b83-40dc-ae36-b14ad8175a90 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:18.093571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d405478-2b83-40dc-ae36-b14ad8175a90 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:18.094887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d405478-2b83-40dc-ae36-b14ad8175a90 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:18.095355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d405478-2b83-40dc-ae36-b14ad8175a90 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:18.096399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d405478-2b83-40dc-ae36-b14ad8175a90 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:18.542348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3d405478-2b83-40dc-ae36-b14ad8175a90 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5921599c20640a09da6909a1ba3aece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c333838cc56b4d1ca8e3a958ef7e3599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:18.564430 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3d405478-2b83-40dc-ae36-b14ad8175a90 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] 10.222.0.30 "GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d" status: 200 len: 1266 microversion: 2.1 time: 0.511847 Oct 04 21:29:18.565406 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2351/4677] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:18 2022] GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d => generated 1266 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:18.593130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3d4859c4-7db8-4465-9ba6-c1487b76eba4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:18.596179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3d4859c4-7db8-4465-9ba6-c1487b76eba4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:18.602902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d4859c4-7db8-4465-9ba6-c1487b76eba4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:18.603991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d4859c4-7db8-4465-9ba6-c1487b76eba4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:18.604771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d4859c4-7db8-4465-9ba6-c1487b76eba4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:18.606113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d4859c4-7db8-4465-9ba6-c1487b76eba4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:18.606806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d4859c4-7db8-4465-9ba6-c1487b76eba4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:18.607458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d4859c4-7db8-4465-9ba6-c1487b76eba4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:18.633816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:18.825996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67cb0209-34fb-44a1-bd32-45ec32b7c552 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:18.845541 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-67cb0209-34fb-44a1-bd32-45ec32b7c552 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b" status: 200 len: 1521 microversion: 2.1 time: 0.871130 Oct 04 21:29:18.859016 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2327/4678] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:17 2022] GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b => generated 1521 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:18.870202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-4bac0ff3-5075-46dc-b437-e4ed00fdd701 req-7ff06ed2-2056-43b7-a94d-a040a2afc131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "tag": "ce41b261-1a55-4261-a0af-98d834d3178a"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:18.883414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4bac0ff3-5075-46dc-b437-e4ed00fdd701 req-7ff06ed2-2056-43b7-a94d-a040a2afc131 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:18.887364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4bac0ff3-5075-46dc-b437-e4ed00fdd701 req-7ff06ed2-2056-43b7-a94d-a040a2afc131 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:18.887364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4bac0ff3-5075-46dc-b437-e4ed00fdd701 req-7ff06ed2-2056-43b7-a94d-a040a2afc131 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:18.898943 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-4bac0ff3-5075-46dc-b437-e4ed00fdd701 req-7ff06ed2-2056-43b7-a94d-a040a2afc131 service nova] Creating event network-changed:ce41b261-1a55-4261-a0af-98d834d3178a for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:29:18.904379 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-4bac0ff3-5075-46dc-b437-e4ed00fdd701 req-7ff06ed2-2056-43b7-a94d-a040a2afc131 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043337 Oct 04 21:29:18.905379 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2328/4679] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:18.969743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e2ccd6a8-01df-4d65-a137-cdb158afa031 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:18.970584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e2ccd6a8-01df-4d65-a137-cdb158afa031 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: e48d8482-b411-41d3-acab-2505e7521d63] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:18.978592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2ccd6a8-01df-4d65-a137-cdb158afa031 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:18.979089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2ccd6a8-01df-4d65-a137-cdb158afa031 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:18.979536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2ccd6a8-01df-4d65-a137-cdb158afa031 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:18.980255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2ccd6a8-01df-4d65-a137-cdb158afa031 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:18.980723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2ccd6a8-01df-4d65-a137-cdb158afa031 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:18.981145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e2ccd6a8-01df-4d65-a137-cdb158afa031 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:19.217173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3d4859c4-7db8-4465-9ba6-c1487b76eba4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:19.228867 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3d4859c4-7db8-4465-9ba6-c1487b76eba4 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.645704 Oct 04 21:29:19.233288 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2352/4680] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:18 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:19.245390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1e0150fa-9307-49fe-8a95-1ddc40d9f8e5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:19.257669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1e0150fa-9307-49fe-8a95-1ddc40d9f8e5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:19.282936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e0150fa-9307-49fe-8a95-1ddc40d9f8e5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:19.286072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e0150fa-9307-49fe-8a95-1ddc40d9f8e5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:19.286733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e0150fa-9307-49fe-8a95-1ddc40d9f8e5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:19.289932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e0150fa-9307-49fe-8a95-1ddc40d9f8e5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:19.290800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e0150fa-9307-49fe-8a95-1ddc40d9f8e5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:19.291984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e0150fa-9307-49fe-8a95-1ddc40d9f8e5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:20.072219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e2ccd6a8-01df-4d65-a137-cdb158afa031 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:20.084960 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e2ccd6a8-01df-4d65-a137-cdb158afa031 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63" status: 200 len: 1552 microversion: 2.1 time: 1.125000 Oct 04 21:29:20.122688 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2329/4681] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:18 2022] GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63 => generated 1552 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:20.131671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4d6f15ff-bc8f-457e-8659-28d71afc8347 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:20.132708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4d6f15ff-bc8f-457e-8659-28d71afc8347 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:20.145391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d6f15ff-bc8f-457e-8659-28d71afc8347 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:20.146382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d6f15ff-bc8f-457e-8659-28d71afc8347 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:20.147123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d6f15ff-bc8f-457e-8659-28d71afc8347 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:20.148297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d6f15ff-bc8f-457e-8659-28d71afc8347 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:20.148977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d6f15ff-bc8f-457e-8659-28d71afc8347 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:20.149656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d6f15ff-bc8f-457e-8659-28d71afc8347 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:20.338381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1e0150fa-9307-49fe-8a95-1ddc40d9f8e5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:20.348464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1e0150fa-9307-49fe-8a95-1ddc40d9f8e5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:20.370341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1e0150fa-9307-49fe-8a95-1ddc40d9f8e5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:20.370341 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1e0150fa-9307-49fe-8a95-1ddc40d9f8e5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 1.128701 Oct 04 21:29:20.370341 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2353/4682] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:19 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:20.378779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8bb80bf0-d870-46a4-97ed-f4c22d32c445 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:20.378779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8bb80bf0-d870-46a4-97ed-f4c22d32c445 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] [instance: 94d63466-634c-4c84-9b35-38ba9234431d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:20.394785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bb80bf0-d870-46a4-97ed-f4c22d32c445 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:20.395490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bb80bf0-d870-46a4-97ed-f4c22d32c445 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:20.396010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bb80bf0-d870-46a4-97ed-f4c22d32c445 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:20.407394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bb80bf0-d870-46a4-97ed-f4c22d32c445 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:20.407394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bb80bf0-d870-46a4-97ed-f4c22d32c445 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:20.407394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bb80bf0-d870-46a4-97ed-f4c22d32c445 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:20.527438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8bb80bf0-d870-46a4-97ed-f4c22d32c445 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5921599c20640a09da6909a1ba3aece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c333838cc56b4d1ca8e3a958ef7e3599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:20.549289 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8bb80bf0-d870-46a4-97ed-f4c22d32c445 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] 10.222.0.30 "GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d" status: 200 len: 1272 microversion: 2.1 time: 0.180770 Oct 04 21:29:20.551318 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2354/4683] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:20 2022] GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:20.556119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-09b949e8-96a7-4b43-a95c-18bfd3a814b3 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:20.556737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-09b949e8-96a7-4b43-a95c-18bfd3a814b3 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:20.567099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09b949e8-96a7-4b43-a95c-18bfd3a814b3 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:20.567826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09b949e8-96a7-4b43-a95c-18bfd3a814b3 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:20.568578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09b949e8-96a7-4b43-a95c-18bfd3a814b3 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:20.569677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09b949e8-96a7-4b43-a95c-18bfd3a814b3 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:20.570144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09b949e8-96a7-4b43-a95c-18bfd3a814b3 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:20.570573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09b949e8-96a7-4b43-a95c-18bfd3a814b3 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:20.604439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4d6f15ff-bc8f-457e-8659-28d71afc8347 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:20.613555 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4d6f15ff-bc8f-457e-8659-28d71afc8347 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.488239 Oct 04 21:29:20.614830 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2330/4684] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:20 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:20.803503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-20fc2d9c-307d-4e5f-ade7-d3d6c75dd9b9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1631539602", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "91818fc5-ec07-482e-8cd9-31e97cd43fa1"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:20.924283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-20fc2d9c-307d-4e5f-ade7-d3d6c75dd9b9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] validate_networks() for [('91818fc5-ec07-482e-8cd9-31e97cd43fa1', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:29:21.028989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-09b949e8-96a7-4b43-a95c-18bfd3a814b3 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:21.042682 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-09b949e8-96a7-4b43-a95c-18bfd3a814b3 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b" status: 200 len: 1521 microversion: 2.1 time: 0.490221 Oct 04 21:29:21.043421 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2355/4685] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:20 2022] GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:21.056855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3281d9e2-1d99-47cf-91b7-29cedb9bd43c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:21.070233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3281d9e2-1d99-47cf-91b7-29cedb9bd43c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:21.090904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3281d9e2-1d99-47cf-91b7-29cedb9bd43c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:21.091401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3281d9e2-1d99-47cf-91b7-29cedb9bd43c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:21.091923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3281d9e2-1d99-47cf-91b7-29cedb9bd43c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:21.092574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3281d9e2-1d99-47cf-91b7-29cedb9bd43c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:21.098550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3281d9e2-1d99-47cf-91b7-29cedb9bd43c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:21.099023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3281d9e2-1d99-47cf-91b7-29cedb9bd43c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:21.171214 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-3281d9e2-1d99-47cf-91b7-29cedb9bd43c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3281d9e2-1d99-47cf-91b7-29cedb9bd43c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315/action HTTP/1.1 Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 65 Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: {"rebuild": {"imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1"}} Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'ae649a1e-b6ec-4d6c-9584-7738fff25315', 'body': {'rebuild': {'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1'}}} Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 21:29:21.171679 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 21:29:21.177034 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 21:29:21.177034 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:29:21.177034 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:29:21.177034 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:29:21.177034 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:29:21.177034 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:29:21.177034 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:21.177034 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:21.177034 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:21.177034 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:21.177034 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:21.177034 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:21.177034 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:21.177034 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:21.177034 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:29:21.177034 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:21.177034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3281d9e2-1d99-47cf-91b7-29cedb9bd43c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:21.177034 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3281d9e2-1d99-47cf-91b7-29cedb9bd43c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315/action" status: 404 len: 111 microversion: 2.1 time: 0.129458 Oct 04 21:29:21.177034 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2356/4686] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:29:21 2022] POST /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315/action => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:29:21.182008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b6a8e063-d91e-42d6-a8c0-69053bb926a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:21.183529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b6a8e063-d91e-42d6-a8c0-69053bb926a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: e48d8482-b411-41d3-acab-2505e7521d63] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:21.197110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6a8e063-d91e-42d6-a8c0-69053bb926a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:21.197616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6a8e063-d91e-42d6-a8c0-69053bb926a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:21.198628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6a8e063-d91e-42d6-a8c0-69053bb926a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:21.199360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6a8e063-d91e-42d6-a8c0-69053bb926a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:21.200350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6a8e063-d91e-42d6-a8c0-69053bb926a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:21.202132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6a8e063-d91e-42d6-a8c0-69053bb926a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:21.345195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b6a8e063-d91e-42d6-a8c0-69053bb926a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:21.363427 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b6a8e063-d91e-42d6-a8c0-69053bb926a9 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63" status: 200 len: 1485 microversion: 2.1 time: 0.185674 Oct 04 21:29:21.372626 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2357/4687] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:21 2022] GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63 => generated 1485 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:21.386755 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-76c93492-2190-49a3-a85e-80588b73f174 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:21.387412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-76c93492-2190-49a3-a85e-80588b73f174 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:21.398254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76c93492-2190-49a3-a85e-80588b73f174 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:21.399505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76c93492-2190-49a3-a85e-80588b73f174 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:21.400122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76c93492-2190-49a3-a85e-80588b73f174 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:21.408302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76c93492-2190-49a3-a85e-80588b73f174 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:21.408302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76c93492-2190-49a3-a85e-80588b73f174 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:21.408302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76c93492-2190-49a3-a85e-80588b73f174 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:21.911594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=12 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:22.315601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-76c93492-2190-49a3-a85e-80588b73f174 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:22.344675 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-76c93492-2190-49a3-a85e-80588b73f174 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.967707 Oct 04 21:29:22.345898 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2358/4688] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:21 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:22.355155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-15266fc2-164d-4ba5-af3d-19e47a35b99f req-3a3ab00e-c867-407e-98d2-1fcdb400131f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48d8482-b411-41d3-acab-2505e7521d63", "name": "network-vif-deleted", "tag": "7624b45b-ac4c-4dca-9048-d041c68ca170"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:22.372544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-15266fc2-164d-4ba5-af3d-19e47a35b99f req-3a3ab00e-c867-407e-98d2-1fcdb400131f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:22.374484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-15266fc2-164d-4ba5-af3d-19e47a35b99f req-3a3ab00e-c867-407e-98d2-1fcdb400131f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:22.376016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-15266fc2-164d-4ba5-af3d-19e47a35b99f req-3a3ab00e-c867-407e-98d2-1fcdb400131f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:22.393795 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-15266fc2-164d-4ba5-af3d-19e47a35b99f req-3a3ab00e-c867-407e-98d2-1fcdb400131f service nova] Creating event network-vif-deleted:7624b45b-ac4c-4dca-9048-d041c68ca170 for instance e48d8482-b411-41d3-acab-2505e7521d63 on n-h1-860282-1 Oct 04 21:29:22.399490 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-15266fc2-164d-4ba5-af3d-19e47a35b99f req-3a3ab00e-c867-407e-98d2-1fcdb400131f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050926 Oct 04 21:29:22.400862 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2359/4689] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:22.411206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e59b9cf1-16ac-4f86-932d-193624a2e4bb tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:22.412395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e59b9cf1-16ac-4f86-932d-193624a2e4bb tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:22.424482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e59b9cf1-16ac-4f86-932d-193624a2e4bb tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:22.425004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e59b9cf1-16ac-4f86-932d-193624a2e4bb tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:22.425514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e59b9cf1-16ac-4f86-932d-193624a2e4bb tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:22.426251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e59b9cf1-16ac-4f86-932d-193624a2e4bb tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:22.426736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e59b9cf1-16ac-4f86-932d-193624a2e4bb tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:22.427172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e59b9cf1-16ac-4f86-932d-193624a2e4bb tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:22.630860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-20fc2d9c-307d-4e5f-ade7-d3d6c75dd9b9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:29:22.631884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-20fc2d9c-307d-4e5f-ade7-d3d6c75dd9b9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:29:22.632730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-20fc2d9c-307d-4e5f-ade7-d3d6c75dd9b9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:29:22.633328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-20fc2d9c-307d-4e5f-ade7-d3d6c75dd9b9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:29:22.634087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-20fc2d9c-307d-4e5f-ade7-d3d6c75dd9b9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:29:22.651796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20fc2d9c-307d-4e5f-ade7-d3d6c75dd9b9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:22.653291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20fc2d9c-307d-4e5f-ade7-d3d6c75dd9b9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:22.653936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20fc2d9c-307d-4e5f-ade7-d3d6c75dd9b9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:22.654961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20fc2d9c-307d-4e5f-ade7-d3d6c75dd9b9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:22.655732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20fc2d9c-307d-4e5f-ade7-d3d6c75dd9b9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:22.657608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20fc2d9c-307d-4e5f-ade7-d3d6c75dd9b9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:22.671674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:22.691840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-20fc2d9c-307d-4e5f-ade7-d3d6c75dd9b9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Getting quotas for project 4c5b73e007104ebda49ce621d7b83868. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:29:22.699453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-20fc2d9c-307d-4e5f-ade7-d3d6c75dd9b9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Getting quotas for user cce53afc8b3e4755b990518ff2304275 and project 4c5b73e007104ebda49ce621d7b83868. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:29:22.739939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-20fc2d9c-307d-4e5f-ade7-d3d6c75dd9b9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:29:22.742488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-20fc2d9c-307d-4e5f-ade7-d3d6c75dd9b9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:29:22.810764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e59b9cf1-16ac-4f86-932d-193624a2e4bb tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:22.824479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e59b9cf1-16ac-4f86-932d-193624a2e4bb tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:22.840022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e59b9cf1-16ac-4f86-932d-193624a2e4bb tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:22.844457 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e59b9cf1-16ac-4f86-932d-193624a2e4bb tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.436641 Oct 04 21:29:22.849572 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2360/4690] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:22 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:22.855252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-034e69f7-196c-49af-bf04-d4b30183606a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:22.856986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-034e69f7-196c-49af-bf04-d4b30183606a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] [instance: 94d63466-634c-4c84-9b35-38ba9234431d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:22.865523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-034e69f7-196c-49af-bf04-d4b30183606a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:22.866173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-034e69f7-196c-49af-bf04-d4b30183606a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:22.866889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-034e69f7-196c-49af-bf04-d4b30183606a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:22.867988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-034e69f7-196c-49af-bf04-d4b30183606a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:22.868757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-034e69f7-196c-49af-bf04-d4b30183606a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:22.869294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-034e69f7-196c-49af-bf04-d4b30183606a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:22.926033 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-20fc2d9c-307d-4e5f-ade7-d3d6c75dd9b9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.309905 Oct 04 21:29:22.927736 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2331/4691] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Oct 4 21:29:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2312 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:29:22.933462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cf092a17-775a-4bf9-8d71-e3f4cf5b2938 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:22.934402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cf092a17-775a-4bf9-8d71-e3f4cf5b2938 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:22.942462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf092a17-775a-4bf9-8d71-e3f4cf5b2938 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:22.943127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf092a17-775a-4bf9-8d71-e3f4cf5b2938 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:22.943707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf092a17-775a-4bf9-8d71-e3f4cf5b2938 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:22.944499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf092a17-775a-4bf9-8d71-e3f4cf5b2938 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:22.945214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf092a17-775a-4bf9-8d71-e3f4cf5b2938 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:22.947390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf092a17-775a-4bf9-8d71-e3f4cf5b2938 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:23.601468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-034e69f7-196c-49af-bf04-d4b30183606a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5921599c20640a09da6909a1ba3aece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c333838cc56b4d1ca8e3a958ef7e3599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:23.608488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cf092a17-775a-4bf9-8d71-e3f4cf5b2938 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:23.609306 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-034e69f7-196c-49af-bf04-d4b30183606a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] 10.222.0.30 "GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d" status: 200 len: 1314 microversion: 2.1 time: 0.758127 Oct 04 21:29:23.609988 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2361/4692] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:22 2022] GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d => generated 1314 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:23.621406 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cf092a17-775a-4bf9-8d71-e3f4cf5b2938 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b" status: 200 len: 1521 microversion: 2.1 time: 0.691699 Oct 04 21:29:23.622834 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2332/4693] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:22 2022] GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b => generated 1521 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:23.634177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b0a5afa8-d92e-4802-bb23-ea943eccff34 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:23.636713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b0a5afa8-d92e-4802-bb23-ea943eccff34 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: e48d8482-b411-41d3-acab-2505e7521d63] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:23.639728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-09339cd4-e1bd-4efe-a607-2927b6f9fdfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:23.640353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-09339cd4-e1bd-4efe-a607-2927b6f9fdfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:23.652807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09339cd4-e1bd-4efe-a607-2927b6f9fdfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:23.655777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09339cd4-e1bd-4efe-a607-2927b6f9fdfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:23.657149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09339cd4-e1bd-4efe-a607-2927b6f9fdfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:23.664621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0a5afa8-d92e-4802-bb23-ea943eccff34 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:23.664809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09339cd4-e1bd-4efe-a607-2927b6f9fdfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:23.664809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09339cd4-e1bd-4efe-a607-2927b6f9fdfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:23.664809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09339cd4-e1bd-4efe-a607-2927b6f9fdfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:23.665056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0a5afa8-d92e-4802-bb23-ea943eccff34 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:23.665056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0a5afa8-d92e-4802-bb23-ea943eccff34 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:23.665056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0a5afa8-d92e-4802-bb23-ea943eccff34 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:23.667129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0a5afa8-d92e-4802-bb23-ea943eccff34 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:23.669150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0a5afa8-d92e-4802-bb23-ea943eccff34 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:23.723286 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-b0a5afa8-d92e-4802-bb23-ea943eccff34 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] HTTP exception thrown: Instance e48d8482-b411-41d3-acab-2505e7521d63 could not be found. Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b0a5afa8-d92e-4802-bb23-ea943eccff34 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Request method failure captured: Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63 HTTP/1.1 Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUDTGg7T7VmitVTpKF-9FBNIahULcSg1Wrhgxdvxnw-Guiea8B89zhK-rmHA6jLrq1dY4k5V7smqycj9Wwj4V1XlUTI--J420yQ9x-HG1Yvp0xOQwsH8vGq2YOT5Y5PE_YuJxvI37NIhLHdaKHC_0_Ru-aYkhIjOlmzffo7yTPu4r8 Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f74afbd0dc37402fa84ec9d6e2cb53f4 Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestNetworkBasicOps-1291671602 Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f74afbd0dc37402fa84ec9d6e2cb53f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f74afbd0dc37402fa84ec9d6e2cb53f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f74afbd0dc37402fa84ec9d6e2cb53f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f74afbd0dc37402fa84ec9d6e2cb53f4"}]}] Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestNetworkBasicOps-1291671602 Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f74afbd0dc37402fa84ec9d6e2cb53f4 Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestNetworkBasicOps-1291671602 Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestNetworkBasicOps-1291671602-project Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 933f720fbafe482d95b27cd372934ab6 Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestNetworkBasicOps-1291671602-project Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance e48d8482-b411-41d3-acab-2505e7521d63 could not be found. Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'e48d8482-b411-41d3-acab-2505e7521d63'} Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e48d8482-b411-41d3-acab-2505e7521d63 could not be found. Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e48d8482-b411-41d3-acab-2505e7521d63 could not be found. Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:23.725984 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:23.730205 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:23.730205 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:23.730205 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:23.730205 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:23.730205 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:23.730205 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e48d8482-b411-41d3-acab-2505e7521d63 could not be found. Oct 04 21:29:23.730205 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:23.730205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b0a5afa8-d92e-4802-bb23-ea943eccff34 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Returning 404 to user: Instance e48d8482-b411-41d3-acab-2505e7521d63 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:23.730205 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b0a5afa8-d92e-4802-bb23-ea943eccff34 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63" status: 404 len: 111 microversion: 2.1 time: 0.102767 Oct 04 21:29:23.730205 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2333/4694] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:23 2022] GET /compute/v2.1/servers/e48d8482-b411-41d3-acab-2505e7521d63 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:29:23.737558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0fd7ef08-3614-4670-ad3f-f62f92454936 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:23.738493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0fd7ef08-3614-4670-ad3f-f62f92454936 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:23.895251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0fd7ef08-3614-4670-ad3f-f62f92454936 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:23.945270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0fd7ef08-3614-4670-ad3f-f62f92454936 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:23.949853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0fd7ef08-3614-4670-ad3f-f62f92454936 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:23.952672 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0fd7ef08-3614-4670-ad3f-f62f92454936 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72" status: 200 len: 1262 microversion: 2.26 time: 0.220371 Oct 04 21:29:23.954406 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2334/4695] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:23 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72 => generated 1262 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:23.979759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3ac20cbe-4538-42e5-84ee-6e5997d55a4a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:23.982475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3ac20cbe-4538-42e5-84ee-6e5997d55a4a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:24.004693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ac20cbe-4538-42e5-84ee-6e5997d55a4a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:24.005346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ac20cbe-4538-42e5-84ee-6e5997d55a4a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:24.006877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ac20cbe-4538-42e5-84ee-6e5997d55a4a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:24.007821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ac20cbe-4538-42e5-84ee-6e5997d55a4a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:24.009039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ac20cbe-4538-42e5-84ee-6e5997d55a4a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:24.009823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ac20cbe-4538-42e5-84ee-6e5997d55a4a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:24.193827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-09339cd4-e1bd-4efe-a607-2927b6f9fdfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:24.202696 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-09339cd4-e1bd-4efe-a607-2927b6f9fdfe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.591659 Oct 04 21:29:24.208121 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2362/4696] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:23 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:24.240555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e707b75d-4460-47eb-b644-2146db8312a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:24.244678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e707b75d-4460-47eb-b644-2146db8312a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: a96225ca-772d-464f-87e8-fb41dea4f317] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:24.252316 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-e707b75d-4460-47eb-b644-2146db8312a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance a96225ca-772d-464f-87e8-fb41dea4f317 could not be found. Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e707b75d-4460-47eb-b644-2146db8312a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/a96225ca-772d-464f-87e8-fb41dea4f317/action HTTP/1.1 Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 65 Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: {"rebuild": {"imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1"}} Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance a96225ca-772d-464f-87e8-fb41dea4f317 could not be found. Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'a96225ca-772d-464f-87e8-fb41dea4f317', 'body': {'rebuild': {'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1'}}} Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a96225ca-772d-464f-87e8-fb41dea4f317 could not be found. Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 21:29:24.254526 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:29:24.259459 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:29:24.259459 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:29:24.259459 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:29:24.259459 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a96225ca-772d-464f-87e8-fb41dea4f317 could not be found. Oct 04 21:29:24.259459 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:24.259459 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:24.259459 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:24.259459 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:24.259459 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:24.259459 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:24.259459 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:24.259459 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:24.259459 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a96225ca-772d-464f-87e8-fb41dea4f317 could not be found. Oct 04 21:29:24.259459 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:24.261562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e707b75d-4460-47eb-b644-2146db8312a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance a96225ca-772d-464f-87e8-fb41dea4f317 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:24.262602 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e707b75d-4460-47eb-b644-2146db8312a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/a96225ca-772d-464f-87e8-fb41dea4f317/action" status: 404 len: 111 microversion: 2.1 time: 0.026244 Oct 04 21:29:24.272706 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2363/4697] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:29:24 2022] POST /compute/v2.1/servers/a96225ca-772d-464f-87e8-fb41dea4f317/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:29:24.278242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-65e94965-fe30-44b6-9c82-ff2ec401300d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:24.279026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-65e94965-fe30-44b6-9c82-ff2ec401300d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:24.288075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65e94965-fe30-44b6-9c82-ff2ec401300d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:24.289503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65e94965-fe30-44b6-9c82-ff2ec401300d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:24.289998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65e94965-fe30-44b6-9c82-ff2ec401300d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:24.290797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65e94965-fe30-44b6-9c82-ff2ec401300d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:24.291262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65e94965-fe30-44b6-9c82-ff2ec401300d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:24.291693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65e94965-fe30-44b6-9c82-ff2ec401300d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:24.473368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3ac20cbe-4538-42e5-84ee-6e5997d55a4a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:24.505726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3ac20cbe-4538-42e5-84ee-6e5997d55a4a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:24.505726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3ac20cbe-4538-42e5-84ee-6e5997d55a4a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:24.505726 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3ac20cbe-4538-42e5-84ee-6e5997d55a4a tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.545707 Oct 04 21:29:24.505726 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2335/4698] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:23 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:24.536478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-a0c4d161-5c9e-4f44-a77b-cf9e90793824 req-30101b7c-4a04-4071-96a9-5c23d7bb7e75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94d63466-634c-4c84-9b35-38ba9234431d", "tag": "f2274b0e-6a72-460d-9ee4-893f88c2840f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:24.560629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a0c4d161-5c9e-4f44-a77b-cf9e90793824 req-30101b7c-4a04-4071-96a9-5c23d7bb7e75 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:24.561367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a0c4d161-5c9e-4f44-a77b-cf9e90793824 req-30101b7c-4a04-4071-96a9-5c23d7bb7e75 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:24.562077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a0c4d161-5c9e-4f44-a77b-cf9e90793824 req-30101b7c-4a04-4071-96a9-5c23d7bb7e75 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:24.581713 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-a0c4d161-5c9e-4f44-a77b-cf9e90793824 req-30101b7c-4a04-4071-96a9-5c23d7bb7e75 service nova] Creating event network-changed:f2274b0e-6a72-460d-9ee4-893f88c2840f for instance 94d63466-634c-4c84-9b35-38ba9234431d on n-h1-860282-1 Oct 04 21:29:24.589499 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-a0c4d161-5c9e-4f44-a77b-cf9e90793824 req-30101b7c-4a04-4071-96a9-5c23d7bb7e75 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070800 Oct 04 21:29:24.596716 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2336/4699] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:24.603212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-fa4e04c3-a705-49b6-bcb5-a7e6bc43e40f req-faf0067d-8b45-4ef1-b378-754694abece5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "tag": "462dd518-2956-4aa9-94c8-c6a32d3a0b42"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:24.616225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-fa4e04c3-a705-49b6-bcb5-a7e6bc43e40f req-faf0067d-8b45-4ef1-b378-754694abece5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:24.616996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-fa4e04c3-a705-49b6-bcb5-a7e6bc43e40f req-faf0067d-8b45-4ef1-b378-754694abece5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:24.617868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-fa4e04c3-a705-49b6-bcb5-a7e6bc43e40f req-faf0067d-8b45-4ef1-b378-754694abece5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:24.645810 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-fa4e04c3-a705-49b6-bcb5-a7e6bc43e40f req-faf0067d-8b45-4ef1-b378-754694abece5 service nova] Creating event network-changed:462dd518-2956-4aa9-94c8-c6a32d3a0b42 for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:29:24.660951 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-fa4e04c3-a705-49b6-bcb5-a7e6bc43e40f req-faf0067d-8b45-4ef1-b378-754694abece5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053283 Oct 04 21:29:24.676306 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2337/4700] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:24.683827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-99f902b6-6f69-4cc9-a5c0-f2c2033f2d59 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '.version_select at 0x7f578b26d4c0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:24.752133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-65e94965-fe30-44b6-9c82-ff2ec401300d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:24.769884 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-65e94965-fe30-44b6-9c82-ff2ec401300d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.488152 Oct 04 21:29:24.771200 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2364/4701] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:24 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:24.776366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-47e5d4f4-ae70-430d-9870-da197fbd2f58 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:24.782901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-47e5d4f4-ae70-430d-9870-da197fbd2f58 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] [instance: 94d63466-634c-4c84-9b35-38ba9234431d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:24.795335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47e5d4f4-ae70-430d-9870-da197fbd2f58 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:24.798517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47e5d4f4-ae70-430d-9870-da197fbd2f58 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:24.798517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47e5d4f4-ae70-430d-9870-da197fbd2f58 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:24.798517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47e5d4f4-ae70-430d-9870-da197fbd2f58 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:24.799642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47e5d4f4-ae70-430d-9870-da197fbd2f58 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:24.800309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47e5d4f4-ae70-430d-9870-da197fbd2f58 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:24.801309 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-99f902b6-6f69-4cc9-a5c0-f2c2033f2d59 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1964809015" status: 202 len: 0 microversion: 2.1 time: 0.123358 Oct 04 21:29:24.801937 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2338/4702] 10.222.0.30 () {58 vars in 1257 bytes} [Tue Oct 4 21:29:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1964809015 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:29:24.808215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-277dc5d3-2db2-4105-bc34-693c53546342 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:24.811274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-277dc5d3-2db2-4105-bc34-693c53546342 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:24.827013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-277dc5d3-2db2-4105-bc34-693c53546342 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:24.830000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-277dc5d3-2db2-4105-bc34-693c53546342 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:24.832924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-277dc5d3-2db2-4105-bc34-693c53546342 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:24.837088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-277dc5d3-2db2-4105-bc34-693c53546342 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:24.837693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-277dc5d3-2db2-4105-bc34-693c53546342 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:24.838152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-277dc5d3-2db2-4105-bc34-693c53546342 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:25.315149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-277dc5d3-2db2-4105-bc34-693c53546342 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:25.323767 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-277dc5d3-2db2-4105-bc34-693c53546342 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b" status: 200 len: 1498 microversion: 2.1 time: 0.519442 Oct 04 21:29:25.324362 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2339/4703] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:24 2022] GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b => generated 1498 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:25.337036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e3ce7ef3-b50e-4174-a3a6-0dd228d4eab5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:25.342319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e3ce7ef3-b50e-4174-a3a6-0dd228d4eab5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:25.356753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3ce7ef3-b50e-4174-a3a6-0dd228d4eab5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:25.357259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3ce7ef3-b50e-4174-a3a6-0dd228d4eab5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:25.361735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3ce7ef3-b50e-4174-a3a6-0dd228d4eab5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:25.362548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3ce7ef3-b50e-4174-a3a6-0dd228d4eab5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:25.363041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3ce7ef3-b50e-4174-a3a6-0dd228d4eab5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:25.363492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3ce7ef3-b50e-4174-a3a6-0dd228d4eab5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:25.415235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-47e5d4f4-ae70-430d-9870-da197fbd2f58 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5921599c20640a09da6909a1ba3aece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c333838cc56b4d1ca8e3a958ef7e3599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:25.435834 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-47e5d4f4-ae70-430d-9870-da197fbd2f58 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] 10.222.0.30 "GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d" status: 200 len: 1314 microversion: 2.1 time: 0.663121 Oct 04 21:29:25.437200 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2365/4704] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:24 2022] GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:25.444708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-576135f3-4ceb-4f49-9716-027423bf9cb4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:25.446109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-576135f3-4ceb-4f49-9716-027423bf9cb4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:25.459767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-576135f3-4ceb-4f49-9716-027423bf9cb4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:25.460495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-576135f3-4ceb-4f49-9716-027423bf9cb4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:25.461631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-576135f3-4ceb-4f49-9716-027423bf9cb4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:25.462634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-576135f3-4ceb-4f49-9716-027423bf9cb4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:25.463233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-576135f3-4ceb-4f49-9716-027423bf9cb4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:25.463764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-576135f3-4ceb-4f49-9716-027423bf9cb4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:25.649210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-576135f3-4ceb-4f49-9716-027423bf9cb4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:25.668837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-576135f3-4ceb-4f49-9716-027423bf9cb4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:25.670800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-576135f3-4ceb-4f49-9716-027423bf9cb4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:25.673068 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-576135f3-4ceb-4f49-9716-027423bf9cb4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72" status: 200 len: 1258 microversion: 2.26 time: 0.233959 Oct 04 21:29:25.684523 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2366/4705] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:25 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72 => generated 1258 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:25.706412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-23b515d9-75b9-4538-bf2d-145344495294 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:25.725116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-23b515d9-75b9-4538-bf2d-145344495294 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:25.726300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-23b515d9-75b9-4538-bf2d-145344495294 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:25.733566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23b515d9-75b9-4538-bf2d-145344495294 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:25.734340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23b515d9-75b9-4538-bf2d-145344495294 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:25.735223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23b515d9-75b9-4538-bf2d-145344495294 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:25.736308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23b515d9-75b9-4538-bf2d-145344495294 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:25.737382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23b515d9-75b9-4538-bf2d-145344495294 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:25.738064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23b515d9-75b9-4538-bf2d-145344495294 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:25.789807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-23b515d9-75b9-4538-bf2d-145344495294 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:29:25.862928 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-23b515d9-75b9-4538-bf2d-145344495294 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.170028 Oct 04 21:29:25.876122 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2367/4706] 10.222.0.30 () {58 vars in 1154 bytes} [Tue Oct 4 21:29:25 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:25.886298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8bdafefe-54b7-4bf0-99c5-bb48466d77d1 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:25.887600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8bdafefe-54b7-4bf0-99c5-bb48466d77d1 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:25.895254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bdafefe-54b7-4bf0-99c5-bb48466d77d1 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:25.896307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bdafefe-54b7-4bf0-99c5-bb48466d77d1 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:25.896912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bdafefe-54b7-4bf0-99c5-bb48466d77d1 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:25.898101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bdafefe-54b7-4bf0-99c5-bb48466d77d1 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:25.900457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bdafefe-54b7-4bf0-99c5-bb48466d77d1 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:25.901362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bdafefe-54b7-4bf0-99c5-bb48466d77d1 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:25.976242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e3ce7ef3-b50e-4174-a3a6-0dd228d4eab5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:25.991328 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e3ce7ef3-b50e-4174-a3a6-0dd228d4eab5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.661418 Oct 04 21:29:25.992034 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2340/4707] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:25 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:26.009657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-67a3dd61-4176-48b2-97f0-a11206b77694 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:26.016526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67a3dd61-4176-48b2-97f0-a11206b77694 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:26.019064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67a3dd61-4176-48b2-97f0-a11206b77694 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:26.019578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67a3dd61-4176-48b2-97f0-a11206b77694 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:26.364728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8bdafefe-54b7-4bf0-99c5-bb48466d77d1 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:26.380259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8bdafefe-54b7-4bf0-99c5-bb48466d77d1 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:26.385075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8bdafefe-54b7-4bf0-99c5-bb48466d77d1 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:26.385546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-67a3dd61-4176-48b2-97f0-a11206b77694 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Going to try to start instance {{(pid=122758) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 21:29:26.386843 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8bdafefe-54b7-4bf0-99c5-bb48466d77d1 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.508855 Oct 04 21:29:26.390548 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2368/4708] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:25 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:26.406142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f7cadca8-6059-46c6-a8b3-d8002c2189d2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:26.406875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f7cadca8-6059-46c6-a8b3-d8002c2189d2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 3b253ea7-55a1-4ea7-8c80-c6ef7ef53de5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:26.418747 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-f7cadca8-6059-46c6-a8b3-d8002c2189d2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance 3b253ea7-55a1-4ea7-8c80-c6ef7ef53de5 could not be found. Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f7cadca8-6059-46c6-a8b3-d8002c2189d2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/3b253ea7-55a1-4ea7-8c80-c6ef7ef53de5/action HTTP/1.1 Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 15 Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: {"restore": {}} Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 3b253ea7-55a1-4ea7-8c80-c6ef7ef53de5 could not be found. Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '3b253ea7-55a1-4ea7-8c80-c6ef7ef53de5', 'body': {'restore': {}}} Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b253ea7-55a1-4ea7-8c80-c6ef7ef53de5 could not be found. Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b253ea7-55a1-4ea7-8c80-c6ef7ef53de5 could not be found. Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:26.420289 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:26.428008 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:26.428008 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:26.428008 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b253ea7-55a1-4ea7-8c80-c6ef7ef53de5 could not be found. Oct 04 21:29:26.428008 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:26.428008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f7cadca8-6059-46c6-a8b3-d8002c2189d2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance 3b253ea7-55a1-4ea7-8c80-c6ef7ef53de5 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:26.429608 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f7cadca8-6059-46c6-a8b3-d8002c2189d2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/3b253ea7-55a1-4ea7-8c80-c6ef7ef53de5/action" status: 404 len: 111 microversion: 2.1 time: 0.034533 Oct 04 21:29:26.430715 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2369/4709] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:29:26 2022] POST /compute/v2.1/servers/3b253ea7-55a1-4ea7-8c80-c6ef7ef53de5/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:29:26.454532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6a290438-b1d6-4db7-8962-b4fd42d254cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:26.458645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6a290438-b1d6-4db7-8962-b4fd42d254cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:26.481763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a290438-b1d6-4db7-8962-b4fd42d254cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:26.496666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a290438-b1d6-4db7-8962-b4fd42d254cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:26.497132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a290438-b1d6-4db7-8962-b4fd42d254cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:26.497919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a290438-b1d6-4db7-8962-b4fd42d254cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:26.498387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a290438-b1d6-4db7-8962-b4fd42d254cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:26.505809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a290438-b1d6-4db7-8962-b4fd42d254cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:26.709141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:26.730348 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-67a3dd61-4176-48b2-97f0-a11206b77694 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "POST /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b/action" status: 202 len: 0 microversion: 2.1 time: 0.736438 Oct 04 21:29:26.731499 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2341/4710] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:29:25 2022] POST /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b/action => generated 0 bytes in 738 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:29:26.745731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e7aa7f97-92d0-4ea9-8b5e-5abc5e4e8d6a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:26.747061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e7aa7f97-92d0-4ea9-8b5e-5abc5e4e8d6a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] [instance: 94d63466-634c-4c84-9b35-38ba9234431d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:26.768222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7aa7f97-92d0-4ea9-8b5e-5abc5e4e8d6a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:26.769021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7aa7f97-92d0-4ea9-8b5e-5abc5e4e8d6a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:26.769682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7aa7f97-92d0-4ea9-8b5e-5abc5e4e8d6a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:26.770591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7aa7f97-92d0-4ea9-8b5e-5abc5e4e8d6a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:26.771245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7aa7f97-92d0-4ea9-8b5e-5abc5e4e8d6a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:26.771856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7aa7f97-92d0-4ea9-8b5e-5abc5e4e8d6a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:27.131148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6a290438-b1d6-4db7-8962-b4fd42d254cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:27.142639 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6a290438-b1d6-4db7-8962-b4fd42d254cf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.707871 Oct 04 21:29:27.159613 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2370/4711] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:26 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:27.159613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fa24ca05-267f-43ed-9d2d-b2130b8d742d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:27.159613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fa24ca05-267f-43ed-9d2d-b2130b8d742d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:27.171402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa24ca05-267f-43ed-9d2d-b2130b8d742d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:27.172789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa24ca05-267f-43ed-9d2d-b2130b8d742d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:27.175435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa24ca05-267f-43ed-9d2d-b2130b8d742d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:27.182540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa24ca05-267f-43ed-9d2d-b2130b8d742d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:27.182540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa24ca05-267f-43ed-9d2d-b2130b8d742d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:27.182540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa24ca05-267f-43ed-9d2d-b2130b8d742d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:27.424692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e7aa7f97-92d0-4ea9-8b5e-5abc5e4e8d6a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5921599c20640a09da6909a1ba3aece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c333838cc56b4d1ca8e3a958ef7e3599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:27.435808 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e7aa7f97-92d0-4ea9-8b5e-5abc5e4e8d6a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] 10.222.0.30 "GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d" status: 200 len: 1314 microversion: 2.1 time: 0.703031 Oct 04 21:29:27.437159 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2342/4712] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:26 2022] GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:27.452490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-d1f97373-b664-4cef-bd81-fa950cf8ee4c req-165a63c1-4eb7-4ff1-bb57-e16c415d0228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "tag": "7be12e96-c1eb-431c-880c-1656a2d42226"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:27.474723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d1f97373-b664-4cef-bd81-fa950cf8ee4c req-165a63c1-4eb7-4ff1-bb57-e16c415d0228 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:27.475203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d1f97373-b664-4cef-bd81-fa950cf8ee4c req-165a63c1-4eb7-4ff1-bb57-e16c415d0228 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:27.476606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d1f97373-b664-4cef-bd81-fa950cf8ee4c req-165a63c1-4eb7-4ff1-bb57-e16c415d0228 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:27.498219 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-d1f97373-b664-4cef-bd81-fa950cf8ee4c req-165a63c1-4eb7-4ff1-bb57-e16c415d0228 service nova] Creating event network-changed:7be12e96-c1eb-431c-880c-1656a2d42226 for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:29:27.522436 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-d1f97373-b664-4cef-bd81-fa950cf8ee4c req-165a63c1-4eb7-4ff1-bb57-e16c415d0228 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064248 Oct 04 21:29:27.522436 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2343/4713] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:27.530680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8d597241-ce46-4154-a5e5-0d20b74e23d4 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:27.531510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8d597241-ce46-4154-a5e5-0d20b74e23d4 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:27.551197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d597241-ce46-4154-a5e5-0d20b74e23d4 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:27.551694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d597241-ce46-4154-a5e5-0d20b74e23d4 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:27.552264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d597241-ce46-4154-a5e5-0d20b74e23d4 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:27.553156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d597241-ce46-4154-a5e5-0d20b74e23d4 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:27.553662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d597241-ce46-4154-a5e5-0d20b74e23d4 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:27.554098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d597241-ce46-4154-a5e5-0d20b74e23d4 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:27.726600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fa24ca05-267f-43ed-9d2d-b2130b8d742d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:27.765514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fa24ca05-267f-43ed-9d2d-b2130b8d742d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:27.768157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fa24ca05-267f-43ed-9d2d-b2130b8d742d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:27.770371 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fa24ca05-267f-43ed-9d2d-b2130b8d742d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72" status: 200 len: 1320 microversion: 2.26 time: 0.622376 Oct 04 21:29:27.791253 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2371/4714] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:27 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72 => generated 1320 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:27.806031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a955232b-438e-44d2-9899-569f7ee15dbd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:27.811162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a955232b-438e-44d2-9899-569f7ee15dbd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:27.816444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:27.820514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a955232b-438e-44d2-9899-569f7ee15dbd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:27.821027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a955232b-438e-44d2-9899-569f7ee15dbd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:27.821526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a955232b-438e-44d2-9899-569f7ee15dbd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:27.822258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a955232b-438e-44d2-9899-569f7ee15dbd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:27.822714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a955232b-438e-44d2-9899-569f7ee15dbd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:27.832842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a955232b-438e-44d2-9899-569f7ee15dbd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:27.842785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:28.477707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8d597241-ce46-4154-a5e5-0d20b74e23d4 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:28.487198 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8d597241-ce46-4154-a5e5-0d20b74e23d4 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b" status: 200 len: 1507 microversion: 2.1 time: 0.966136 Oct 04 21:29:28.497769 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2344/4715] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:27 2022] GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b => generated 1507 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:28.504649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e9ffc5ca-17cf-4747-9fc3-dd0e0d126656 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:28.505261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e9ffc5ca-17cf-4747-9fc3-dd0e0d126656 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:28.519200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9ffc5ca-17cf-4747-9fc3-dd0e0d126656 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:28.519713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9ffc5ca-17cf-4747-9fc3-dd0e0d126656 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:28.520159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9ffc5ca-17cf-4747-9fc3-dd0e0d126656 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:28.520867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9ffc5ca-17cf-4747-9fc3-dd0e0d126656 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:28.521545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9ffc5ca-17cf-4747-9fc3-dd0e0d126656 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:28.522167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9ffc5ca-17cf-4747-9fc3-dd0e0d126656 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:28.758934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a955232b-438e-44d2-9899-569f7ee15dbd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:28.768131 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a955232b-438e-44d2-9899-569f7ee15dbd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.977213 Oct 04 21:29:28.768725 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2372/4716] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:27 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:28.773767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cc5a936f-ad69-460c-8dcc-5cb9e4ab3690 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:28.774590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cc5a936f-ad69-460c-8dcc-5cb9e4ab3690 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] [instance: 94d63466-634c-4c84-9b35-38ba9234431d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:28.780988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc5a936f-ad69-460c-8dcc-5cb9e4ab3690 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:28.784664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc5a936f-ad69-460c-8dcc-5cb9e4ab3690 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:28.784664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc5a936f-ad69-460c-8dcc-5cb9e4ab3690 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:28.784664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc5a936f-ad69-460c-8dcc-5cb9e4ab3690 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:28.784664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc5a936f-ad69-460c-8dcc-5cb9e4ab3690 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:28.784664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc5a936f-ad69-460c-8dcc-5cb9e4ab3690 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:29.154550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e9ffc5ca-17cf-4747-9fc3-dd0e0d126656 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:29.192850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e9ffc5ca-17cf-4747-9fc3-dd0e0d126656 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:29.192850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e9ffc5ca-17cf-4747-9fc3-dd0e0d126656 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:29.192850 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e9ffc5ca-17cf-4747-9fc3-dd0e0d126656 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.678505 Oct 04 21:29:29.193879 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2345/4717] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:28 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:29.203250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a2fd6605-192f-4890-991d-e2ad244ee52c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:29.204043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a2fd6605-192f-4890-991d-e2ad244ee52c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:29.210370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2fd6605-192f-4890-991d-e2ad244ee52c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:29.214729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2fd6605-192f-4890-991d-e2ad244ee52c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:29.214729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2fd6605-192f-4890-991d-e2ad244ee52c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:29.214729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2fd6605-192f-4890-991d-e2ad244ee52c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:29.214729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2fd6605-192f-4890-991d-e2ad244ee52c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:29.214729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2fd6605-192f-4890-991d-e2ad244ee52c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:29.240669 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-a2fd6605-192f-4890-991d-e2ad244ee52c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Cannot 'restore' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a2fd6605-192f-4890-991d-e2ad244ee52c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action HTTP/1.1 Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 15 Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: {"restore": {}} Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: exception: Cannot 'restore' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '144fff2d-9df3-4a93-833f-7f76acc85185', 'body': {'restore': {}}} Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 144fff2d-9df3-4a93-833f-7f76acc85185 in vm_state active. Cannot restore while the instance is in this state. Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:29.242675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:29.247532 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:29.247532 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:29.247532 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:29.247532 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active Oct 04 21:29:29.247532 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:29.247532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a2fd6605-192f-4890-991d-e2ad244ee52c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 409 to user: Cannot 'restore' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:29.247532 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a2fd6605-192f-4890-991d-e2ad244ee52c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action" status: 409 len: 145 microversion: 2.1 time: 0.048982 Oct 04 21:29:29.248521 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2346/4718] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:29:29 2022] POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action => generated 145 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:29:29.254234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ba7110b0-9f06-4a63-980d-5be1e37ae899 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:29.255160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ba7110b0-9f06-4a63-980d-5be1e37ae899 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:29.261376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7110b0-9f06-4a63-980d-5be1e37ae899 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:29.266494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7110b0-9f06-4a63-980d-5be1e37ae899 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:29.266494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7110b0-9f06-4a63-980d-5be1e37ae899 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:29.266494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7110b0-9f06-4a63-980d-5be1e37ae899 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:29.266494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7110b0-9f06-4a63-980d-5be1e37ae899 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:29.266494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba7110b0-9f06-4a63-980d-5be1e37ae899 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:29.280094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cc5a936f-ad69-460c-8dcc-5cb9e4ab3690 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5921599c20640a09da6909a1ba3aece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c333838cc56b4d1ca8e3a958ef7e3599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:29.293167 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cc5a936f-ad69-460c-8dcc-5cb9e4ab3690 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] 10.222.0.30 "GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d" status: 200 len: 1314 microversion: 2.1 time: 0.523166 Oct 04 21:29:29.306574 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2373/4719] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:28 2022] GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:29.319054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cf32507b-711a-4538-9dfe-0b5b1d2a2308 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:29.319720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cf32507b-711a-4538-9dfe-0b5b1d2a2308 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:29.327267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf32507b-711a-4538-9dfe-0b5b1d2a2308 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:29.329546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf32507b-711a-4538-9dfe-0b5b1d2a2308 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:29.329546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf32507b-711a-4538-9dfe-0b5b1d2a2308 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:29.329546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf32507b-711a-4538-9dfe-0b5b1d2a2308 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:29.329848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf32507b-711a-4538-9dfe-0b5b1d2a2308 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:29.330014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf32507b-711a-4538-9dfe-0b5b1d2a2308 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:29.842135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ba7110b0-9f06-4a63-980d-5be1e37ae899 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:29.854207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ba7110b0-9f06-4a63-980d-5be1e37ae899 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:29.857918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ba7110b0-9f06-4a63-980d-5be1e37ae899 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:29.860385 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ba7110b0-9f06-4a63-980d-5be1e37ae899 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72" status: 200 len: 1362 microversion: 2.26 time: 0.610715 Oct 04 21:29:29.861564 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2347/4720] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:29 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72 => generated 1362 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:29.872605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cf32507b-711a-4538-9dfe-0b5b1d2a2308 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:29.888977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9bb122e5-bf6a-4bdd-824c-28c827cc7b73 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:29.888977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9bb122e5-bf6a-4bdd-824c-28c827cc7b73 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:29.893100 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cf32507b-711a-4538-9dfe-0b5b1d2a2308 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.577714 Oct 04 21:29:29.894248 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2374/4721] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:29 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:29.900069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-9db6d66b-bfac-4215-ac3b-246a5dc2a7e5 req-4b058ed3-e0d0-447d-819c-19e4c2e990df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "tag": "02286074-41e4-4d16-8a7a-59c1ece211dc"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:29.903588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bb122e5-bf6a-4bdd-824c-28c827cc7b73 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:29.904359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bb122e5-bf6a-4bdd-824c-28c827cc7b73 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:29.904968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bb122e5-bf6a-4bdd-824c-28c827cc7b73 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:29.905933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bb122e5-bf6a-4bdd-824c-28c827cc7b73 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:29.907425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bb122e5-bf6a-4bdd-824c-28c827cc7b73 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:29.910439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bb122e5-bf6a-4bdd-824c-28c827cc7b73 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:29.914977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9db6d66b-bfac-4215-ac3b-246a5dc2a7e5 req-4b058ed3-e0d0-447d-819c-19e4c2e990df service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:29.915728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9db6d66b-bfac-4215-ac3b-246a5dc2a7e5 req-4b058ed3-e0d0-447d-819c-19e4c2e990df service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:29.916331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9db6d66b-bfac-4215-ac3b-246a5dc2a7e5 req-4b058ed3-e0d0-447d-819c-19e4c2e990df service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:29.947942 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-9db6d66b-bfac-4215-ac3b-246a5dc2a7e5 req-4b058ed3-e0d0-447d-819c-19e4c2e990df service nova] Creating event network-changed:02286074-41e4-4d16-8a7a-59c1ece211dc for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:29:29.953789 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-9db6d66b-bfac-4215-ac3b-246a5dc2a7e5 req-4b058ed3-e0d0-447d-819c-19e4c2e990df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057860 Oct 04 21:29:29.955399 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2375/4722] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:29.966233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-99408481-abeb-45ef-a868-8d557863fa38 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:29.967180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-99408481-abeb-45ef-a868-8d557863fa38 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:29.975272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99408481-abeb-45ef-a868-8d557863fa38 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:29.975992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99408481-abeb-45ef-a868-8d557863fa38 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:29.976631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99408481-abeb-45ef-a868-8d557863fa38 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:29.978131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99408481-abeb-45ef-a868-8d557863fa38 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:29.978766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99408481-abeb-45ef-a868-8d557863fa38 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:29.979363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99408481-abeb-45ef-a868-8d557863fa38 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:30.386854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9bb122e5-bf6a-4bdd-824c-28c827cc7b73 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:30.395768 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9bb122e5-bf6a-4bdd-824c-28c827cc7b73 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b" status: 200 len: 1507 microversion: 2.1 time: 0.532929 Oct 04 21:29:30.396571 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2348/4723] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:29 2022] GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b => generated 1507 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:30.420628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2fdbca9d-fc41-48e1-82bf-87a4f637608f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:30.425668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2fdbca9d-fc41-48e1-82bf-87a4f637608f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:30.441257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fdbca9d-fc41-48e1-82bf-87a4f637608f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:30.442609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fdbca9d-fc41-48e1-82bf-87a4f637608f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:30.443973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fdbca9d-fc41-48e1-82bf-87a4f637608f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:30.444833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fdbca9d-fc41-48e1-82bf-87a4f637608f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:30.446089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fdbca9d-fc41-48e1-82bf-87a4f637608f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:30.447859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fdbca9d-fc41-48e1-82bf-87a4f637608f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:30.483398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-99408481-abeb-45ef-a868-8d557863fa38 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:30.492474 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-99408481-abeb-45ef-a868-8d557863fa38 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.535620 Oct 04 21:29:30.497486 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2376/4724] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:29 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:30.502730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-10e52f02-b83a-4a74-a2ac-a15eaaea4a55 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:30.503356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-10e52f02-b83a-4a74-a2ac-a15eaaea4a55 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] [instance: 94d63466-634c-4c84-9b35-38ba9234431d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:30.522600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10e52f02-b83a-4a74-a2ac-a15eaaea4a55 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:30.523407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10e52f02-b83a-4a74-a2ac-a15eaaea4a55 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:30.524013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10e52f02-b83a-4a74-a2ac-a15eaaea4a55 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:30.524910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10e52f02-b83a-4a74-a2ac-a15eaaea4a55 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:30.525571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10e52f02-b83a-4a74-a2ac-a15eaaea4a55 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:30.526159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10e52f02-b83a-4a74-a2ac-a15eaaea4a55 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:30.946623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2fdbca9d-fc41-48e1-82bf-87a4f637608f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:30.961119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2fdbca9d-fc41-48e1-82bf-87a4f637608f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:30.963104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2fdbca9d-fc41-48e1-82bf-87a4f637608f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:30.964987 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2fdbca9d-fc41-48e1-82bf-87a4f637608f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.567285 Oct 04 21:29:30.966251 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2349/4725] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:30 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:30.972666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a34f447-2ee6-470e-9d39-a41663e281ed tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:30.973600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7a34f447-2ee6-470e-9d39-a41663e281ed tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ed382833-40b5-46a8-b819-244396ca2565] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:30.980019 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-7a34f447-2ee6-470e-9d39-a41663e281ed tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance ed382833-40b5-46a8-b819-244396ca2565 could not be found. Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a34f447-2ee6-470e-9d39-a41663e281ed tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/ed382833-40b5-46a8-b819-244396ca2565/action HTTP/1.1 Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 14 Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: {"resume": {}} Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance ed382833-40b5-46a8-b819-244396ca2565 could not be found. Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'ed382833-40b5-46a8-b819-244396ca2565', 'body': {'resume': {}}} Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed382833-40b5-46a8-b819-244396ca2565 could not be found. Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed382833-40b5-46a8-b819-244396ca2565 could not be found. Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:30.987451 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:30.999675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:30.999675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:30.999675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed382833-40b5-46a8-b819-244396ca2565 could not be found. Oct 04 21:29:30.999675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:30.999675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a34f447-2ee6-470e-9d39-a41663e281ed tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance ed382833-40b5-46a8-b819-244396ca2565 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:30.999675 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7a34f447-2ee6-470e-9d39-a41663e281ed tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/ed382833-40b5-46a8-b819-244396ca2565/action" status: 404 len: 111 microversion: 2.1 time: 0.021626 Oct 04 21:29:30.999675 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2350/4726] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:29:30 2022] POST /compute/v2.1/servers/ed382833-40b5-46a8-b819-244396ca2565/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:29:31.002891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2b3ecf1a-8d77-4d31-9278-58c52d53ffa1 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:31.007264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2b3ecf1a-8d77-4d31-9278-58c52d53ffa1 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:31.021475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b3ecf1a-8d77-4d31-9278-58c52d53ffa1 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:31.022050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b3ecf1a-8d77-4d31-9278-58c52d53ffa1 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:31.022760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b3ecf1a-8d77-4d31-9278-58c52d53ffa1 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:31.025649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b3ecf1a-8d77-4d31-9278-58c52d53ffa1 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:31.026203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b3ecf1a-8d77-4d31-9278-58c52d53ffa1 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:31.027974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b3ecf1a-8d77-4d31-9278-58c52d53ffa1 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:31.037709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-10e52f02-b83a-4a74-a2ac-a15eaaea4a55 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5921599c20640a09da6909a1ba3aece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c333838cc56b4d1ca8e3a958ef7e3599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:31.064416 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-10e52f02-b83a-4a74-a2ac-a15eaaea4a55 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] 10.222.0.30 "GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d" status: 200 len: 1314 microversion: 2.1 time: 0.565000 Oct 04 21:29:31.079878 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2377/4727] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:30 2022] GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:31.086374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-82e0b24a-5287-41ad-8d39-908ad9ec8afb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:31.087558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-82e0b24a-5287-41ad-8d39-908ad9ec8afb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:31.095502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82e0b24a-5287-41ad-8d39-908ad9ec8afb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:31.096250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82e0b24a-5287-41ad-8d39-908ad9ec8afb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:31.097308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82e0b24a-5287-41ad-8d39-908ad9ec8afb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:31.099388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82e0b24a-5287-41ad-8d39-908ad9ec8afb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:31.100577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82e0b24a-5287-41ad-8d39-908ad9ec8afb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:31.101124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82e0b24a-5287-41ad-8d39-908ad9ec8afb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:31.458130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2b3ecf1a-8d77-4d31-9278-58c52d53ffa1 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:31.469757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2b3ecf1a-8d77-4d31-9278-58c52d53ffa1 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:31.474275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2b3ecf1a-8d77-4d31-9278-58c52d53ffa1 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:31.475756 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2b3ecf1a-8d77-4d31-9278-58c52d53ffa1 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72" status: 200 len: 1362 microversion: 2.26 time: 0.481093 Oct 04 21:29:31.476212 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2351/4728] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:30 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72 => generated 1362 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:31.485527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-70e368c4-cda8-4a60-821e-29152c8d64ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:31.485993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-70e368c4-cda8-4a60-821e-29152c8d64ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:31.493819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-82e0b24a-5287-41ad-8d39-908ad9ec8afb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:31.502562 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-82e0b24a-5287-41ad-8d39-908ad9ec8afb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.424609 Oct 04 21:29:31.503161 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2378/4729] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:31 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:31.518416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70e368c4-cda8-4a60-821e-29152c8d64ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:31.522740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70e368c4-cda8-4a60-821e-29152c8d64ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:31.523557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70e368c4-cda8-4a60-821e-29152c8d64ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:31.529081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70e368c4-cda8-4a60-821e-29152c8d64ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:31.529081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70e368c4-cda8-4a60-821e-29152c8d64ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:31.529081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70e368c4-cda8-4a60-821e-29152c8d64ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:31.548775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-edc8a6eb-b3a2-4b5e-9ba2-fb752ecea65d req-389a7a56-8e3c-41fa-b538-68732dcf2f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e3f92fe-569e-4490-8f75-6e2edde12f37", "tag": "8b26b180-3007-4dc0-8a67-0a0e4522bd4c"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:31.587691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-edc8a6eb-b3a2-4b5e-9ba2-fb752ecea65d req-389a7a56-8e3c-41fa-b538-68732dcf2f80 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:31.590562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-edc8a6eb-b3a2-4b5e-9ba2-fb752ecea65d req-389a7a56-8e3c-41fa-b538-68732dcf2f80 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:31.592485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-edc8a6eb-b3a2-4b5e-9ba2-fb752ecea65d req-389a7a56-8e3c-41fa-b538-68732dcf2f80 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:31.628477 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-edc8a6eb-b3a2-4b5e-9ba2-fb752ecea65d req-389a7a56-8e3c-41fa-b538-68732dcf2f80 service nova] Creating event network-changed:8b26b180-3007-4dc0-8a67-0a0e4522bd4c for instance 7e3f92fe-569e-4490-8f75-6e2edde12f37 on n-h1-860282-1 Oct 04 21:29:31.629665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-70e368c4-cda8-4a60-821e-29152c8d64ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:29:31.641571 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-edc8a6eb-b3a2-4b5e-9ba2-fb752ecea65d req-389a7a56-8e3c-41fa-b538-68732dcf2f80 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128945 Oct 04 21:29:31.644966 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2379/4730] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:31.666492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7596271d-f245-4de3-a17e-f1f20d5421f8 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:31.667630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7596271d-f245-4de3-a17e-f1f20d5421f8 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:31.686014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7596271d-f245-4de3-a17e-f1f20d5421f8 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:31.686827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7596271d-f245-4de3-a17e-f1f20d5421f8 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:31.690309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7596271d-f245-4de3-a17e-f1f20d5421f8 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:31.691495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7596271d-f245-4de3-a17e-f1f20d5421f8 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:31.694146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7596271d-f245-4de3-a17e-f1f20d5421f8 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:31.694798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7596271d-f245-4de3-a17e-f1f20d5421f8 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:31.718300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:32.055783 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-70e368c4-cda8-4a60-821e-29152c8d64ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37" status: 204 len: 0 microversion: 2.1 time: 0.577280 Oct 04 21:29:32.059600 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2352/4731] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:29:31 2022] DELETE /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:29:32.065562 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-49c51768-573d-4a67-9df5-8609aeac130b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:32.067462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-49c51768-573d-4a67-9df5-8609aeac130b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:32.084154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49c51768-573d-4a67-9df5-8609aeac130b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:32.086510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49c51768-573d-4a67-9df5-8609aeac130b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:32.087275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49c51768-573d-4a67-9df5-8609aeac130b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:32.088206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49c51768-573d-4a67-9df5-8609aeac130b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:32.092256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49c51768-573d-4a67-9df5-8609aeac130b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:32.092935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49c51768-573d-4a67-9df5-8609aeac130b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:32.150995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7596271d-f245-4de3-a17e-f1f20d5421f8 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:32.161736 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7596271d-f245-4de3-a17e-f1f20d5421f8 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b" status: 200 len: 1511 microversion: 2.1 time: 0.515282 Oct 04 21:29:32.166318 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2380/4732] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:31 2022] GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b => generated 1511 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:32.188264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d06d04ca-2e61-4fec-bbc3-a0b9bcf984ed tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:32.195682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d06d04ca-2e61-4fec-bbc3-a0b9bcf984ed tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:32.214144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d06d04ca-2e61-4fec-bbc3-a0b9bcf984ed tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:32.216272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d06d04ca-2e61-4fec-bbc3-a0b9bcf984ed tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:32.217169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d06d04ca-2e61-4fec-bbc3-a0b9bcf984ed tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:32.218141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d06d04ca-2e61-4fec-bbc3-a0b9bcf984ed tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:32.221015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d06d04ca-2e61-4fec-bbc3-a0b9bcf984ed tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:32.221726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d06d04ca-2e61-4fec-bbc3-a0b9bcf984ed tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:32.673508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=12 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:33.435539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-49c51768-573d-4a67-9df5-8609aeac130b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:33.451926 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-49c51768-573d-4a67-9df5-8609aeac130b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 1.390786 Oct 04 21:29:33.452530 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2353/4733] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:32 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:33.459212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f2e75966-44f8-43ef-9824-e9ce2da437aa tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:33.460580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f2e75966-44f8-43ef-9824-e9ce2da437aa tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:33.475404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2e75966-44f8-43ef-9824-e9ce2da437aa tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:33.476387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2e75966-44f8-43ef-9824-e9ce2da437aa tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:33.476951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2e75966-44f8-43ef-9824-e9ce2da437aa tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:33.477930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2e75966-44f8-43ef-9824-e9ce2da437aa tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:33.478587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2e75966-44f8-43ef-9824-e9ce2da437aa tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:33.479208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2e75966-44f8-43ef-9824-e9ce2da437aa tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:33.495211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d06d04ca-2e61-4fec-bbc3-a0b9bcf984ed tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:33.508693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d06d04ca-2e61-4fec-bbc3-a0b9bcf984ed tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:33.515269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d06d04ca-2e61-4fec-bbc3-a0b9bcf984ed tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:33.517202 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d06d04ca-2e61-4fec-bbc3-a0b9bcf984ed tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 1.349864 Oct 04 21:29:33.561228 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2381/4734] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:32 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:33.573956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-13fbfd15-c3bf-4de1-b62c-f236910cc265 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:33.574613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-13fbfd15-c3bf-4de1-b62c-f236910cc265 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] [instance: 94d63466-634c-4c84-9b35-38ba9234431d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:33.589307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13fbfd15-c3bf-4de1-b62c-f236910cc265 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:33.590287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13fbfd15-c3bf-4de1-b62c-f236910cc265 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:33.595385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13fbfd15-c3bf-4de1-b62c-f236910cc265 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:33.595385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13fbfd15-c3bf-4de1-b62c-f236910cc265 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:33.595385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13fbfd15-c3bf-4de1-b62c-f236910cc265 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:33.595385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13fbfd15-c3bf-4de1-b62c-f236910cc265 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:33.925220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=18 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:33.956069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-13fbfd15-c3bf-4de1-b62c-f236910cc265 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5921599c20640a09da6909a1ba3aece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c333838cc56b4d1ca8e3a958ef7e3599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:33.969340 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-13fbfd15-c3bf-4de1-b62c-f236910cc265 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] 10.222.0.30 "GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d" status: 200 len: 1314 microversion: 2.1 time: 0.406447 Oct 04 21:29:33.972312 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2382/4735] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:33 2022] GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:33.987347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-657c1edd-cd26-437b-aa2a-ddf65baeb158 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:34.003996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f2e75966-44f8-43ef-9824-e9ce2da437aa tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:34.004832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-657c1edd-cd26-437b-aa2a-ddf65baeb158 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:34.005581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.compute.servers [None req-657c1edd-cd26-437b-aa2a-ddf65baeb158 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Removing options 'limit' from query {{(pid=122757) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 21:29:34.014622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-657c1edd-cd26-437b-aa2a-ddf65baeb158 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:34.017143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-657c1edd-cd26-437b-aa2a-ddf65baeb158 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:34.017884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-657c1edd-cd26-437b-aa2a-ddf65baeb158 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:34.018571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-657c1edd-cd26-437b-aa2a-ddf65baeb158 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:34.019519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-657c1edd-cd26-437b-aa2a-ddf65baeb158 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:34.019969 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f2e75966-44f8-43ef-9824-e9ce2da437aa tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37" status: 200 len: 1670 microversion: 2.1 time: 0.565388 Oct 04 21:29:34.020437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-657c1edd-cd26-437b-aa2a-ddf65baeb158 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:34.021274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-657c1edd-cd26-437b-aa2a-ddf65baeb158 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:34.024639 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2354/4736] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:33 2022] GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37 => generated 1670 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:34.025477 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-657c1edd-cd26-437b-aa2a-ddf65baeb158 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.046464 Oct 04 21:29:34.041352 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2383/4737] 10.222.0.30 () {58 vars in 1140 bytes} [Tue Oct 4 21:29:33 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:29:34.041771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e9380c51-6677-4b0b-a764-7357bb275838 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:34.041771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e9380c51-6677-4b0b-a764-7357bb275838 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:34.053204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-282b5d08-ba75-46a0-a02d-175d5da69538 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:34.054098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-282b5d08-ba75-46a0-a02d-175d5da69538 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:34.066662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-282b5d08-ba75-46a0-a02d-175d5da69538 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:34.067551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-282b5d08-ba75-46a0-a02d-175d5da69538 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:34.067715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9380c51-6677-4b0b-a764-7357bb275838 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:34.068267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-282b5d08-ba75-46a0-a02d-175d5da69538 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:34.069059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-282b5d08-ba75-46a0-a02d-175d5da69538 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:34.069638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-282b5d08-ba75-46a0-a02d-175d5da69538 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:34.070226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9380c51-6677-4b0b-a764-7357bb275838 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:34.070502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-282b5d08-ba75-46a0-a02d-175d5da69538 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:34.070671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9380c51-6677-4b0b-a764-7357bb275838 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:34.075148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9380c51-6677-4b0b-a764-7357bb275838 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:34.076033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9380c51-6677-4b0b-a764-7357bb275838 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:34.076638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9380c51-6677-4b0b-a764-7357bb275838 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:34.098985 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-282b5d08-ba75-46a0-a02d-175d5da69538 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Cannot 'resume' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-282b5d08-ba75-46a0-a02d-175d5da69538 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action HTTP/1.1 Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 14 Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: {"resume": {}} Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: exception: Cannot 'resume' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '144fff2d-9df3-4a93-833f-7f76acc85185', 'body': {'resume': {}}} Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 144fff2d-9df3-4a93-833f-7f76acc85185 in vm_state active. Cannot resume while the instance is in this state. Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:34.101190 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:34.106348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:34.106348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:34.106348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:34.106348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:34.106348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:34.106348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active Oct 04 21:29:34.106348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:34.108106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-282b5d08-ba75-46a0-a02d-175d5da69538 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 409 to user: Cannot 'resume' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:34.109809 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-282b5d08-ba75-46a0-a02d-175d5da69538 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action" status: 409 len: 144 microversion: 2.1 time: 0.078164 Oct 04 21:29:34.113934 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2384/4738] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:29:34 2022] POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action => generated 144 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:29:34.134696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-bdb00204-5b25-40c0-bf51-896e52c9cd99 req-b29e6780-ba70-4408-88fc-c43fd8e39010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce9f90a0-8efc-4043-a990-f6663196db72", "tag": "d1666e7e-ec76-4b74-9ed9-96bfa3bedf25"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:34.160138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bdb00204-5b25-40c0-bf51-896e52c9cd99 req-b29e6780-ba70-4408-88fc-c43fd8e39010 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:34.161899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bdb00204-5b25-40c0-bf51-896e52c9cd99 req-b29e6780-ba70-4408-88fc-c43fd8e39010 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:34.169279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bdb00204-5b25-40c0-bf51-896e52c9cd99 req-b29e6780-ba70-4408-88fc-c43fd8e39010 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:34.194017 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-bdb00204-5b25-40c0-bf51-896e52c9cd99 req-b29e6780-ba70-4408-88fc-c43fd8e39010 service nova] Creating event network-changed:d1666e7e-ec76-4b74-9ed9-96bfa3bedf25 for instance ce9f90a0-8efc-4043-a990-f6663196db72 on n-h1-860282-1 Oct 04 21:29:34.212034 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-bdb00204-5b25-40c0-bf51-896e52c9cd99 req-b29e6780-ba70-4408-88fc-c43fd8e39010 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096482 Oct 04 21:29:34.212568 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2385/4739] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:34.228094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c93caf30-5810-4019-8c1e-ee4b3de6cdc7 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:34.228829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c93caf30-5810-4019-8c1e-ee4b3de6cdc7 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:34.248872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c93caf30-5810-4019-8c1e-ee4b3de6cdc7 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:34.251314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c93caf30-5810-4019-8c1e-ee4b3de6cdc7 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:34.256356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c93caf30-5810-4019-8c1e-ee4b3de6cdc7 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:34.256356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c93caf30-5810-4019-8c1e-ee4b3de6cdc7 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:34.256356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c93caf30-5810-4019-8c1e-ee4b3de6cdc7 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:34.256356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c93caf30-5810-4019-8c1e-ee4b3de6cdc7 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:34.840909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e9380c51-6677-4b0b-a764-7357bb275838 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:34.852078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e9380c51-6677-4b0b-a764-7357bb275838 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:34.857361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e9380c51-6677-4b0b-a764-7357bb275838 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:34.861413 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e9380c51-6677-4b0b-a764-7357bb275838 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72" status: 200 len: 1362 microversion: 2.26 time: 0.834593 Oct 04 21:29:34.866969 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2355/4740] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:34 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72 => generated 1362 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:34.873597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-8e9e7da2-b264-433b-b73a-dc9babae3ae1 req-b45e0afd-eec6-4032-99a4-fa0133814d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94d63466-634c-4c84-9b35-38ba9234431d", "name": "network-vif-plugged", "status": "completed", "tag": "f2274b0e-6a72-460d-9ee4-893f88c2840f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:34.893486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8e9e7da2-b264-433b-b73a-dc9babae3ae1 req-b45e0afd-eec6-4032-99a4-fa0133814d78 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:34.894347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8e9e7da2-b264-433b-b73a-dc9babae3ae1 req-b45e0afd-eec6-4032-99a4-fa0133814d78 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:34.895113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8e9e7da2-b264-433b-b73a-dc9babae3ae1 req-b45e0afd-eec6-4032-99a4-fa0133814d78 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:34.908958 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-8e9e7da2-b264-433b-b73a-dc9babae3ae1 req-b45e0afd-eec6-4032-99a4-fa0133814d78 service nova] Creating event network-vif-plugged:f2274b0e-6a72-460d-9ee4-893f88c2840f for instance 94d63466-634c-4c84-9b35-38ba9234431d on n-h1-860282-1 Oct 04 21:29:34.915731 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-8e9e7da2-b264-433b-b73a-dc9babae3ae1 req-b45e0afd-eec6-4032-99a4-fa0133814d78 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046955 Oct 04 21:29:34.921182 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2356/4741] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:34.927946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6e623562-fab3-48cf-8145-2b6b0088be65 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:34.929050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6e623562-fab3-48cf-8145-2b6b0088be65 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:34.939668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e623562-fab3-48cf-8145-2b6b0088be65 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:34.940614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e623562-fab3-48cf-8145-2b6b0088be65 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:34.941566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e623562-fab3-48cf-8145-2b6b0088be65 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:34.951727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e623562-fab3-48cf-8145-2b6b0088be65 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:34.951727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e623562-fab3-48cf-8145-2b6b0088be65 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:34.951727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e623562-fab3-48cf-8145-2b6b0088be65 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:35.071745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c93caf30-5810-4019-8c1e-ee4b3de6cdc7 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:35.085866 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c93caf30-5810-4019-8c1e-ee4b3de6cdc7 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b" status: 200 len: 1511 microversion: 2.1 time: 0.871479 Oct 04 21:29:35.101809 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2386/4742] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:34 2022] GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b => generated 1511 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:35.108177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-994df6f5-e14b-43bf-8331-974a8c6d7688 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:35.109203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-994df6f5-e14b-43bf-8331-974a8c6d7688 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:35.116837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-994df6f5-e14b-43bf-8331-974a8c6d7688 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:35.123896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-994df6f5-e14b-43bf-8331-974a8c6d7688 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:35.123896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-994df6f5-e14b-43bf-8331-974a8c6d7688 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:35.123896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-994df6f5-e14b-43bf-8331-974a8c6d7688 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:35.123896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-994df6f5-e14b-43bf-8331-974a8c6d7688 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:35.123896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-994df6f5-e14b-43bf-8331-974a8c6d7688 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:35.749649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:35.814069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-994df6f5-e14b-43bf-8331-974a8c6d7688 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:35.830982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-994df6f5-e14b-43bf-8331-974a8c6d7688 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:35.836615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-994df6f5-e14b-43bf-8331-974a8c6d7688 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:35.841003 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-994df6f5-e14b-43bf-8331-974a8c6d7688 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.737693 Oct 04 21:29:35.843946 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2387/4743] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:35 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:35.854366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4c50d9ba-7e45-497a-99b5-d487dfc330d8 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:35.855256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4c50d9ba-7e45-497a-99b5-d487dfc330d8 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] [instance: 94d63466-634c-4c84-9b35-38ba9234431d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:35.864483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6e623562-fab3-48cf-8145-2b6b0088be65 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:35.874270 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6e623562-fab3-48cf-8145-2b6b0088be65 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.951357 Oct 04 21:29:35.881934 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2357/4744] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:34 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:35.884518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c50d9ba-7e45-497a-99b5-d487dfc330d8 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:35.887732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c50d9ba-7e45-497a-99b5-d487dfc330d8 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:35.889038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c50d9ba-7e45-497a-99b5-d487dfc330d8 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:35.892515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a72b8756-cc8b-4cb8-b2c1-eb1bcd7ca7fd tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:35.893698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c50d9ba-7e45-497a-99b5-d487dfc330d8 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:35.897975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c50d9ba-7e45-497a-99b5-d487dfc330d8 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:35.899188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c50d9ba-7e45-497a-99b5-d487dfc330d8 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:35.902370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a72b8756-cc8b-4cb8-b2c1-eb1bcd7ca7fd tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:35.914910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a72b8756-cc8b-4cb8-b2c1-eb1bcd7ca7fd tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:35.915578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a72b8756-cc8b-4cb8-b2c1-eb1bcd7ca7fd tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:35.916123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a72b8756-cc8b-4cb8-b2c1-eb1bcd7ca7fd tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:35.916936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a72b8756-cc8b-4cb8-b2c1-eb1bcd7ca7fd tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:35.917672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a72b8756-cc8b-4cb8-b2c1-eb1bcd7ca7fd tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:35.918208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a72b8756-cc8b-4cb8-b2c1-eb1bcd7ca7fd tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:36.014793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a72b8756-cc8b-4cb8-b2c1-eb1bcd7ca7fd tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:36.025120 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a72b8756-cc8b-4cb8-b2c1-eb1bcd7ca7fd tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37" status: 200 len: 1334 microversion: 2.1 time: 0.138590 Oct 04 21:29:36.029107 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2358/4745] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:35 2022] GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37 => generated 1334 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:36.079579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e1aad4e1-2295-45f5-8c0d-332e901427c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:36.079579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e1aad4e1-2295-45f5-8c0d-332e901427c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: db85fc78-9a76-401a-89fc-c92d828ae8d4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:36.099369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1aad4e1-2295-45f5-8c0d-332e901427c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:36.102123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1aad4e1-2295-45f5-8c0d-332e901427c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:36.102582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1aad4e1-2295-45f5-8c0d-332e901427c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:36.103327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1aad4e1-2295-45f5-8c0d-332e901427c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:36.103785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1aad4e1-2295-45f5-8c0d-332e901427c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:36.104216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1aad4e1-2295-45f5-8c0d-332e901427c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:36.350351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4c50d9ba-7e45-497a-99b5-d487dfc330d8 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5921599c20640a09da6909a1ba3aece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c333838cc56b4d1ca8e3a958ef7e3599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:36.362382 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4c50d9ba-7e45-497a-99b5-d487dfc330d8 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] 10.222.0.30 "GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d" status: 200 len: 1314 microversion: 2.1 time: 0.517209 Oct 04 21:29:36.363982 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2388/4746] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:35 2022] GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:36.369959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-66a5247c-c086-4418-8a91-0c74d06d6ed7 req-04f02e7e-1fc5-4fac-8361-7f52a955785c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e3f92fe-569e-4490-8f75-6e2edde12f37", "name": "network-vif-deleted", "tag": "8b26b180-3007-4dc0-8a67-0a0e4522bd4c"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:36.384018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-66a5247c-c086-4418-8a91-0c74d06d6ed7 req-04f02e7e-1fc5-4fac-8361-7f52a955785c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:36.384958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-66a5247c-c086-4418-8a91-0c74d06d6ed7 req-04f02e7e-1fc5-4fac-8361-7f52a955785c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:36.385659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-66a5247c-c086-4418-8a91-0c74d06d6ed7 req-04f02e7e-1fc5-4fac-8361-7f52a955785c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:36.399028 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-66a5247c-c086-4418-8a91-0c74d06d6ed7 req-04f02e7e-1fc5-4fac-8361-7f52a955785c service nova] Creating event network-vif-deleted:8b26b180-3007-4dc0-8a67-0a0e4522bd4c for instance 7e3f92fe-569e-4490-8f75-6e2edde12f37 on n-h1-860282-1 Oct 04 21:29:36.407465 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-66a5247c-c086-4418-8a91-0c74d06d6ed7 req-04f02e7e-1fc5-4fac-8361-7f52a955785c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040576 Oct 04 21:29:36.409409 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2389/4747] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:36.453414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e1aad4e1-2295-45f5-8c0d-332e901427c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:36.467010 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e1aad4e1-2295-45f5-8c0d-332e901427c6 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/db85fc78-9a76-401a-89fc-c92d828ae8d4" status: 200 len: 1510 microversion: 2.1 time: 0.433470 Oct 04 21:29:36.467807 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2359/4748] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:36 2022] GET /compute/v2.1/servers/db85fc78-9a76-401a-89fc-c92d828ae8d4 => generated 1510 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:36.476094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9c393175-9327-4d86-9cc9-7edf37cd6585 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:36.477145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9c393175-9327-4d86-9cc9-7edf37cd6585 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:36.502973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:36.502973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c393175-9327-4d86-9cc9-7edf37cd6585 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:36.502973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c393175-9327-4d86-9cc9-7edf37cd6585 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:36.502973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c393175-9327-4d86-9cc9-7edf37cd6585 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:36.503853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c393175-9327-4d86-9cc9-7edf37cd6585 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:36.504368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c393175-9327-4d86-9cc9-7edf37cd6585 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:36.504864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c393175-9327-4d86-9cc9-7edf37cd6585 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:36.621498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a8103742-a8e7-4d0b-ad69-0ea184781207 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-2023134111", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "f9328395-b63c-4f5a-9d32-23fa7cfe6c6d"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:36.691826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-a8103742-a8e7-4d0b-ad69-0ea184781207 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] validate_networks() for [('f9328395-b63c-4f5a-9d32-23fa7cfe6c6d', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:29:36.848023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9c393175-9327-4d86-9cc9-7edf37cd6585 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:36.865573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9c393175-9327-4d86-9cc9-7edf37cd6585 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:36.869860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9c393175-9327-4d86-9cc9-7edf37cd6585 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:36.871486 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9c393175-9327-4d86-9cc9-7edf37cd6585 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72" status: 200 len: 1362 microversion: 2.26 time: 0.400020 Oct 04 21:29:36.873251 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2360/4749] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:36 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72 => generated 1362 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:36.881398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-49fb178d-8af7-4ff9-bd70-ad24f591d297 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:36.882550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-49fb178d-8af7-4ff9-bd70-ad24f591d297 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:36.889106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49fb178d-8af7-4ff9-bd70-ad24f591d297 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:36.894194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49fb178d-8af7-4ff9-bd70-ad24f591d297 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:36.894194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49fb178d-8af7-4ff9-bd70-ad24f591d297 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:36.894194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49fb178d-8af7-4ff9-bd70-ad24f591d297 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:36.894194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49fb178d-8af7-4ff9-bd70-ad24f591d297 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:36.894194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-49fb178d-8af7-4ff9-bd70-ad24f591d297 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:37.248719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-49fb178d-8af7-4ff9-bd70-ad24f591d297 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:37.261538 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-49fb178d-8af7-4ff9-bd70-ad24f591d297 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.383078 Oct 04 21:29:37.262527 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2361/4750] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:36 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:37.273632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-74e783f9-de1b-41f3-b608-edb0821eca21 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:37.273632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-74e783f9-de1b-41f3-b608-edb0821eca21 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:37.287151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74e783f9-de1b-41f3-b608-edb0821eca21 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:37.292473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74e783f9-de1b-41f3-b608-edb0821eca21 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:37.293103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74e783f9-de1b-41f3-b608-edb0821eca21 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:37.294050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74e783f9-de1b-41f3-b608-edb0821eca21 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:37.294677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74e783f9-de1b-41f3-b608-edb0821eca21 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:37.295272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74e783f9-de1b-41f3-b608-edb0821eca21 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:38.132120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-74e783f9-de1b-41f3-b608-edb0821eca21 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:38.142072 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-74e783f9-de1b-41f3-b608-edb0821eca21 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 200 len: 1511 microversion: 2.1 time: 0.878463 Oct 04 21:29:38.142650 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2362/4751] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:37 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 1511 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:38.148303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5c96d67e-8f11-4296-8807-604ebd493361 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:38.149599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5c96d67e-8f11-4296-8807-604ebd493361 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:38.161170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c96d67e-8f11-4296-8807-604ebd493361 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:38.162015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c96d67e-8f11-4296-8807-604ebd493361 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:38.162654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c96d67e-8f11-4296-8807-604ebd493361 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:38.164045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c96d67e-8f11-4296-8807-604ebd493361 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:38.166093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c96d67e-8f11-4296-8807-604ebd493361 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:38.167750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c96d67e-8f11-4296-8807-604ebd493361 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:38.687077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-a8103742-a8e7-4d0b-ad69-0ea184781207 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:29:38.688685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-a8103742-a8e7-4d0b-ad69-0ea184781207 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:29:38.688979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-a8103742-a8e7-4d0b-ad69-0ea184781207 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:29:38.689500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-a8103742-a8e7-4d0b-ad69-0ea184781207 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:29:38.689956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-a8103742-a8e7-4d0b-ad69-0ea184781207 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:29:38.700473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8103742-a8e7-4d0b-ad69-0ea184781207 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:38.701859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8103742-a8e7-4d0b-ad69-0ea184781207 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:38.703917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8103742-a8e7-4d0b-ad69-0ea184781207 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:38.704924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8103742-a8e7-4d0b-ad69-0ea184781207 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:38.705408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8103742-a8e7-4d0b-ad69-0ea184781207 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:38.705877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8103742-a8e7-4d0b-ad69-0ea184781207 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:38.723655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5c96d67e-8f11-4296-8807-604ebd493361 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:38.739210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5c96d67e-8f11-4296-8807-604ebd493361 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:38.742813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5c96d67e-8f11-4296-8807-604ebd493361 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:38.746462 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5c96d67e-8f11-4296-8807-604ebd493361 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.602438 Oct 04 21:29:38.748135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-a8103742-a8e7-4d0b-ad69-0ea184781207 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Getting quotas for project fde68efb46fc44b5b0d83138b9048f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:29:38.749950 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2363/4752] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:38 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:38.755497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2358a8fc-6273-4383-ab87-56a7ae3aff17 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:38.761464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-a8103742-a8e7-4d0b-ad69-0ea184781207 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Getting quotas for user b9289c5fa9844ae3bb1c797bdab5c56c and project fde68efb46fc44b5b0d83138b9048f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:29:38.764819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2358a8fc-6273-4383-ab87-56a7ae3aff17 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 7e3f92fe-569e-4490-8f75-6e2edde12f37] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:38.789401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2358a8fc-6273-4383-ab87-56a7ae3aff17 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:38.789401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2358a8fc-6273-4383-ab87-56a7ae3aff17 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:38.793682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2358a8fc-6273-4383-ab87-56a7ae3aff17 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:38.794701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2358a8fc-6273-4383-ab87-56a7ae3aff17 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:38.796383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2358a8fc-6273-4383-ab87-56a7ae3aff17 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:38.799153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2358a8fc-6273-4383-ab87-56a7ae3aff17 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:38.809569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a8103742-a8e7-4d0b-ad69-0ea184781207 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:29:38.815640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a8103742-a8e7-4d0b-ad69-0ea184781207 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 35db7403-53d9-4c74-8512-1bae943a086f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:29:38.817521 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-2358a8fc-6273-4383-ab87-56a7ae3aff17 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] HTTP exception thrown: Instance 7e3f92fe-569e-4490-8f75-6e2edde12f37 could not be found. Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2358a8fc-6273-4383-ab87-56a7ae3aff17 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Request method failure captured: Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37 HTTP/1.1 Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUDTGg7T7VmitVTpKF-9FBNIahULcSg1Wrhgxdvxnw-Guiea8B89zhK-rmHA6jLrq1dY4k5V7smqycj9Wwj4V1XlUTI--J420yQ9x-HG1Yvp0xOQwsH8vGq2YOT5Y5PE_YuJxvI37NIhLHdaKHC_0_Ru-aYkhIjOlmzffo7yTPu4r8 Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f74afbd0dc37402fa84ec9d6e2cb53f4 Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestNetworkBasicOps-1291671602 Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f74afbd0dc37402fa84ec9d6e2cb53f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f74afbd0dc37402fa84ec9d6e2cb53f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f74afbd0dc37402fa84ec9d6e2cb53f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f74afbd0dc37402fa84ec9d6e2cb53f4"}]}] Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestNetworkBasicOps-1291671602 Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f74afbd0dc37402fa84ec9d6e2cb53f4 Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestNetworkBasicOps-1291671602 Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestNetworkBasicOps-1291671602-project Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 933f720fbafe482d95b27cd372934ab6 Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestNetworkBasicOps-1291671602-project Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 7e3f92fe-569e-4490-8f75-6e2edde12f37 could not be found. Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '7e3f92fe-569e-4490-8f75-6e2edde12f37'} Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e3f92fe-569e-4490-8f75-6e2edde12f37 could not be found. Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e3f92fe-569e-4490-8f75-6e2edde12f37 could not be found. Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:38.822599 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:38.827515 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:38.827515 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:38.827515 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:38.827515 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:38.827515 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:38.827515 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e3f92fe-569e-4490-8f75-6e2edde12f37 could not be found. Oct 04 21:29:38.827515 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:38.829304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2358a8fc-6273-4383-ab87-56a7ae3aff17 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Returning 404 to user: Instance 7e3f92fe-569e-4490-8f75-6e2edde12f37 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:38.833153 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2358a8fc-6273-4383-ab87-56a7ae3aff17 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37" status: 404 len: 111 microversion: 2.1 time: 0.079305 Oct 04 21:29:38.835027 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2364/4753] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:38 2022] GET /compute/v2.1/servers/7e3f92fe-569e-4490-8f75-6e2edde12f37 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:29:38.842661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cc179e77-0b73-4440-9fc3-5edbb6da4a9a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:38.843303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cc179e77-0b73-4440-9fc3-5edbb6da4a9a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] [instance: 94d63466-634c-4c84-9b35-38ba9234431d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:38.855773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc179e77-0b73-4440-9fc3-5edbb6da4a9a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:38.856524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc179e77-0b73-4440-9fc3-5edbb6da4a9a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:38.857140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc179e77-0b73-4440-9fc3-5edbb6da4a9a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:38.858083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc179e77-0b73-4440-9fc3-5edbb6da4a9a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:38.858721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc179e77-0b73-4440-9fc3-5edbb6da4a9a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:38.859927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc179e77-0b73-4440-9fc3-5edbb6da4a9a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:39.045579 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a8103742-a8e7-4d0b-ad69-0ea184781207 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.629547 Oct 04 21:29:39.048081 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2390/4754] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:29:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:29:39.056590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f1d47e71-8a52-471c-b6de-d45b49dea120 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f1d47e71-8a52-471c-b6de-d45b49dea120 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 160 Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: {"server": {"name": "", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "6854610d-7b7e-44e1-90bf-b66a6b17f7da"}]}} Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'server': {'name': '', 'imageRef': 'd55fbb2c-685c-4db7-a38c-ac6cf5459ad1', 'flavorRef': '452', 'networks': [{'uuid': '6854610d-7b7e-44e1-90bf-b66a6b17f7da'}]}}} Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi '' Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:29:39.061876 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:29:39.066519 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:29:39.066519 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:29:39.066519 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:39.066519 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:39.066519 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:39.066519 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:39.066519 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:39.066519 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:39.066519 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:29:39.066519 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:29:39.066519 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:29:39.066519 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:39.070409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f1d47e71-8a52-471c-b6de-d45b49dea120 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:39.071564 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f1d47e71-8a52-471c-b6de-d45b49dea120 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.022144 Oct 04 21:29:39.097241 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2391/4755] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:29:39 2022] POST /compute/v2.1/servers => generated 108 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:29:39.105301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-73d25d25-29c6-4ef3-b98a-71b84762538d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:39.106212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-73d25d25-29c6-4ef3-b98a-71b84762538d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:39.118290 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73d25d25-29c6-4ef3-b98a-71b84762538d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:39.119039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73d25d25-29c6-4ef3-b98a-71b84762538d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:39.120436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73d25d25-29c6-4ef3-b98a-71b84762538d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:39.121388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73d25d25-29c6-4ef3-b98a-71b84762538d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:39.122106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73d25d25-29c6-4ef3-b98a-71b84762538d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:39.122643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73d25d25-29c6-4ef3-b98a-71b84762538d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:39.133717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cc179e77-0b73-4440-9fc3-5edbb6da4a9a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5921599c20640a09da6909a1ba3aece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c333838cc56b4d1ca8e3a958ef7e3599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:39.151035 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cc179e77-0b73-4440-9fc3-5edbb6da4a9a tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] 10.222.0.30 "GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d" status: 200 len: 1464 microversion: 2.1 time: 0.308842 Oct 04 21:29:39.165455 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2365/4756] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:38 2022] GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d => generated 1464 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:39.183366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-48190935-0276-4898-bc9f-bedae974cc6a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:39.200112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-48190935-0276-4898-bc9f-bedae974cc6a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:39.201372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-48190935-0276-4898-bc9f-bedae974cc6a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:39.384993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48190935-0276-4898-bc9f-bedae974cc6a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:39.385664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48190935-0276-4898-bc9f-bedae974cc6a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:39.386287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48190935-0276-4898-bc9f-bedae974cc6a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:39.387237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48190935-0276-4898-bc9f-bedae974cc6a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:39.387807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48190935-0276-4898-bc9f-bedae974cc6a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:39.388876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48190935-0276-4898-bc9f-bedae974cc6a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:39.407972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-73d25d25-29c6-4ef3-b98a-71b84762538d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:39.420895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-73d25d25-29c6-4ef3-b98a-71b84762538d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:39.427809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-73d25d25-29c6-4ef3-b98a-71b84762538d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:39.429642 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-73d25d25-29c6-4ef3-b98a-71b84762538d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72" status: 200 len: 1362 microversion: 2.26 time: 0.331157 Oct 04 21:29:39.430975 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2392/4757] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:39 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72 => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:39.436219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e3fbce02-54ee-4b8a-a2c7-31ea99c7773d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:39.438018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e3fbce02-54ee-4b8a-a2c7-31ea99c7773d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 35db7403-53d9-4c74-8512-1bae943a086f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:39.530915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.multi_cell_list [None req-48190935-0276-4898-bc9f-bedae974cc6a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:29:39.551714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e3fbce02-54ee-4b8a-a2c7-31ea99c7773d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:39.571395 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e3fbce02-54ee-4b8a-a2c7-31ea99c7773d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f" status: 200 len: 1193 microversion: 2.1 time: 0.136510 Oct 04 21:29:39.572220 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2393/4758] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:39 2022] GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f => generated 1193 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:39.586537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-daa37e27-e841-48e8-aec0-cdf44e2b93e2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:39.589760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-daa37e27-e841-48e8-aec0-cdf44e2b93e2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:39.596576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-daa37e27-e841-48e8-aec0-cdf44e2b93e2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:39.597273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-daa37e27-e841-48e8-aec0-cdf44e2b93e2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:39.598236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-daa37e27-e841-48e8-aec0-cdf44e2b93e2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:39.599244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-daa37e27-e841-48e8-aec0-cdf44e2b93e2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:39.599751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-daa37e27-e841-48e8-aec0-cdf44e2b93e2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:39.600716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-daa37e27-e841-48e8-aec0-cdf44e2b93e2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:39.613388 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-48190935-0276-4898-bc9f-bedae974cc6a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 345 microversion: 2.1 time: 0.459979 Oct 04 21:29:39.622387 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2366/4759] 10.222.0.30 () {58 vars in 1154 bytes} [Tue Oct 4 21:29:39 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 345 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:39.629932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f0d7a1c2-b0be-4a29-96b9-1bd53ad13a65 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '.version_select at 0x7f57943bb280>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:39.725529 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f0d7a1c2-b0be-4a29-96b9-1bd53ad13a65 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1894313533" status: 202 len: 0 microversion: 2.1 time: 0.100468 Oct 04 21:29:39.726405 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2367/4760] 10.222.0.30 () {58 vars in 1257 bytes} [Tue Oct 4 21:29:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1894313533 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:29:39.731480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5a824b82-2cd2-4283-be51-e5d0547ad507 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:39.732178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5a824b82-2cd2-4283-be51-e5d0547ad507 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] [instance: 94d63466-634c-4c84-9b35-38ba9234431d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:39.739707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a824b82-2cd2-4283-be51-e5d0547ad507 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:39.740576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a824b82-2cd2-4283-be51-e5d0547ad507 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:39.741071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a824b82-2cd2-4283-be51-e5d0547ad507 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:39.742023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a824b82-2cd2-4283-be51-e5d0547ad507 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:39.742579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a824b82-2cd2-4283-be51-e5d0547ad507 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:39.743055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a824b82-2cd2-4283-be51-e5d0547ad507 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:39.770248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5a824b82-2cd2-4283-be51-e5d0547ad507 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] [instance: 94d63466-634c-4c84-9b35-38ba9234431d] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:29:39.883046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-daa37e27-e841-48e8-aec0-cdf44e2b93e2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:39.897361 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-daa37e27-e841-48e8-aec0-cdf44e2b93e2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.320552 Oct 04 21:29:39.898011 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2394/4761] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:39 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:39.922224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c69d5f86-c93b-4fa2-b870-afd9a86e9e1a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:39.922863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c69d5f86-c93b-4fa2-b870-afd9a86e9e1a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:39.935744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c69d5f86-c93b-4fa2-b870-afd9a86e9e1a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:39.936598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c69d5f86-c93b-4fa2-b870-afd9a86e9e1a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:39.937272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c69d5f86-c93b-4fa2-b870-afd9a86e9e1a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:39.938233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c69d5f86-c93b-4fa2-b870-afd9a86e9e1a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:39.938951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c69d5f86-c93b-4fa2-b870-afd9a86e9e1a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:39.939707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c69d5f86-c93b-4fa2-b870-afd9a86e9e1a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:39.950523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:39.961391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:40.160479 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5a824b82-2cd2-4283-be51-e5d0547ad507 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] 10.222.0.30 "DELETE /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d" status: 204 len: 0 microversion: 2.1 time: 0.432634 Oct 04 21:29:40.161170 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2368/4762] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:29:39 2022] DELETE /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:29:40.167436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9888819c-b5eb-4c87-aefe-9cec008f0dd7 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:40.168484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9888819c-b5eb-4c87-aefe-9cec008f0dd7 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:40.176593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9888819c-b5eb-4c87-aefe-9cec008f0dd7 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:40.177745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9888819c-b5eb-4c87-aefe-9cec008f0dd7 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:40.179270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9888819c-b5eb-4c87-aefe-9cec008f0dd7 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:40.180218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9888819c-b5eb-4c87-aefe-9cec008f0dd7 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:40.180904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9888819c-b5eb-4c87-aefe-9cec008f0dd7 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:40.181815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9888819c-b5eb-4c87-aefe-9cec008f0dd7 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:40.225761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c69d5f86-c93b-4fa2-b870-afd9a86e9e1a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:40.233722 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c69d5f86-c93b-4fa2-b870-afd9a86e9e1a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b" status: 200 len: 1511 microversion: 2.1 time: 0.324348 Oct 04 21:29:40.249849 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2395/4763] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:39 2022] GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b => generated 1511 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:40.260911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d66b7cc5-de85-4687-b9ec-d31a6642630b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:40.261772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d66b7cc5-de85-4687-b9ec-d31a6642630b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:40.268854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d66b7cc5-de85-4687-b9ec-d31a6642630b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:40.269472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d66b7cc5-de85-4687-b9ec-d31a6642630b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:40.270034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d66b7cc5-de85-4687-b9ec-d31a6642630b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:40.270822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d66b7cc5-de85-4687-b9ec-d31a6642630b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:40.271377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d66b7cc5-de85-4687-b9ec-d31a6642630b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:40.271899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d66b7cc5-de85-4687-b9ec-d31a6642630b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:40.743203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9888819c-b5eb-4c87-aefe-9cec008f0dd7 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:40.744746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d66b7cc5-de85-4687-b9ec-d31a6642630b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:40.753763 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d66b7cc5-de85-4687-b9ec-d31a6642630b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.502138 Oct 04 21:29:40.757564 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2396/4764] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:40 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:40.759538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9888819c-b5eb-4c87-aefe-9cec008f0dd7 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:40.762103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9888819c-b5eb-4c87-aefe-9cec008f0dd7 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:40.763330 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9888819c-b5eb-4c87-aefe-9cec008f0dd7 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.601024 Oct 04 21:29:40.766013 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2369/4765] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:40 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:40.766228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f9756559-b5d8-4ff1-b208-36d7137af68f tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:40.766715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f9756559-b5d8-4ff1-b208-36d7137af68f tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] [instance: 94d63466-634c-4c84-9b35-38ba9234431d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:40.771131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-282fbeeb-5941-4eef-9cb0-6180ceb4073c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:40.771969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-282fbeeb-5941-4eef-9cb0-6180ceb4073c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: db85fc78-9a76-401a-89fc-c92d828ae8d4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:40.775817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9756559-b5d8-4ff1-b208-36d7137af68f tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:40.776425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9756559-b5d8-4ff1-b208-36d7137af68f tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:40.776975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9756559-b5d8-4ff1-b208-36d7137af68f tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:40.777797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9756559-b5d8-4ff1-b208-36d7137af68f tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:40.779555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-282fbeeb-5941-4eef-9cb0-6180ceb4073c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:40.780281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-282fbeeb-5941-4eef-9cb0-6180ceb4073c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:40.780416 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9756559-b5d8-4ff1-b208-36d7137af68f tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:40.781963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-282fbeeb-5941-4eef-9cb0-6180ceb4073c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:40.782144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9756559-b5d8-4ff1-b208-36d7137af68f tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:40.783033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-282fbeeb-5941-4eef-9cb0-6180ceb4073c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:40.783668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-282fbeeb-5941-4eef-9cb0-6180ceb4073c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:40.784276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-282fbeeb-5941-4eef-9cb0-6180ceb4073c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:41.009669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-282fbeeb-5941-4eef-9cb0-6180ceb4073c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:41.017580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f9756559-b5d8-4ff1-b208-36d7137af68f tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5921599c20640a09da6909a1ba3aece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c333838cc56b4d1ca8e3a958ef7e3599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:41.023952 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-282fbeeb-5941-4eef-9cb0-6180ceb4073c tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/db85fc78-9a76-401a-89fc-c92d828ae8d4" status: 200 len: 1510 microversion: 2.1 time: 0.259017 Oct 04 21:29:41.024849 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2370/4766] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:40 2022] GET /compute/v2.1/servers/db85fc78-9a76-401a-89fc-c92d828ae8d4 => generated 1510 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:41.030428 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f9756559-b5d8-4ff1-b208-36d7137af68f tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] 10.222.0.30 "GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d" status: 200 len: 1470 microversion: 2.1 time: 0.271495 Oct 04 21:29:41.046381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b0943691-ba9a-4f84-bfa6-23c4ee894b6f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:41.050535 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2397/4767] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:40 2022] GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d => generated 1470 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:41.050709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b0943691-ba9a-4f84-bfa6-23c4ee894b6f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:41.056951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab3d7075-6d57-4498-8ac5-7c36c23dda5a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:41.057786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ab3d7075-6d57-4498-8ac5-7c36c23dda5a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 35db7403-53d9-4c74-8512-1bae943a086f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:41.066376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0943691-ba9a-4f84-bfa6-23c4ee894b6f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:41.066767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab3d7075-6d57-4498-8ac5-7c36c23dda5a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:41.067108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0943691-ba9a-4f84-bfa6-23c4ee894b6f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:41.067653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0943691-ba9a-4f84-bfa6-23c4ee894b6f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:41.067804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab3d7075-6d57-4498-8ac5-7c36c23dda5a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:41.068399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab3d7075-6d57-4498-8ac5-7c36c23dda5a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:41.068675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0943691-ba9a-4f84-bfa6-23c4ee894b6f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:41.069687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab3d7075-6d57-4498-8ac5-7c36c23dda5a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:41.069915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0943691-ba9a-4f84-bfa6-23c4ee894b6f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:41.070512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab3d7075-6d57-4498-8ac5-7c36c23dda5a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:41.071117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab3d7075-6d57-4498-8ac5-7c36c23dda5a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:41.071247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0943691-ba9a-4f84-bfa6-23c4ee894b6f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:41.150229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ab3d7075-6d57-4498-8ac5-7c36c23dda5a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:41.162431 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ab3d7075-6d57-4498-8ac5-7c36c23dda5a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f" status: 200 len: 1197 microversion: 2.1 time: 0.110397 Oct 04 21:29:41.163732 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2398/4768] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:41 2022] GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f => generated 1197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:41.174557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f7d915fb-1ae8-403e-950d-eae93211f2a3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:41.182329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f7d915fb-1ae8-403e-950d-eae93211f2a3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ba0a0be5-4d9a-447f-b732-c618151b4afa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:41.194946 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-f7d915fb-1ae8-403e-950d-eae93211f2a3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance ba0a0be5-4d9a-447f-b732-c618151b4afa could not be found. Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f7d915fb-1ae8-403e-950d-eae93211f2a3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/ba0a0be5-4d9a-447f-b732-c618151b4afa/action HTTP/1.1 Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 14 Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: {"shelve": {}} Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance ba0a0be5-4d9a-447f-b732-c618151b4afa could not be found. Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'ba0a0be5-4d9a-447f-b732-c618151b4afa', 'body': {'shelve': {}}} Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba0a0be5-4d9a-447f-b732-c618151b4afa could not be found. Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba0a0be5-4d9a-447f-b732-c618151b4afa could not be found. Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:41.199300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:41.204550 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:41.204550 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:41.204550 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba0a0be5-4d9a-447f-b732-c618151b4afa could not be found. Oct 04 21:29:41.204550 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:41.206456 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f7d915fb-1ae8-403e-950d-eae93211f2a3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance ba0a0be5-4d9a-447f-b732-c618151b4afa could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:41.207455 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f7d915fb-1ae8-403e-950d-eae93211f2a3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/ba0a0be5-4d9a-447f-b732-c618151b4afa/action" status: 404 len: 111 microversion: 2.1 time: 0.042521 Oct 04 21:29:41.208141 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2399/4769] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:29:41 2022] POST /compute/v2.1/servers/ba0a0be5-4d9a-447f-b732-c618151b4afa/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:29:41.215172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e6596eba-bbbf-44a7-a728-27197db0de9f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:41.216029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e6596eba-bbbf-44a7-a728-27197db0de9f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:41.224400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e6596eba-bbbf-44a7-a728-27197db0de9f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:41.226208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e6596eba-bbbf-44a7-a728-27197db0de9f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:41.227909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e6596eba-bbbf-44a7-a728-27197db0de9f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:41.228729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e6596eba-bbbf-44a7-a728-27197db0de9f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:41.229379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e6596eba-bbbf-44a7-a728-27197db0de9f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:41.230964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e6596eba-bbbf-44a7-a728-27197db0de9f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:41.329671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b0943691-ba9a-4f84-bfa6-23c4ee894b6f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:41.350866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b0943691-ba9a-4f84-bfa6-23c4ee894b6f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:41.364391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b0943691-ba9a-4f84-bfa6-23c4ee894b6f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:41.364391 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b0943691-ba9a-4f84-bfa6-23c4ee894b6f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72" status: 200 len: 1362 microversion: 2.26 time: 0.329360 Oct 04 21:29:41.364391 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2371/4770] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:41 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72 => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:41.364391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2a62bcb0-1b6e-4fd5-be17-42e251e85790 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:41.364391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2a62bcb0-1b6e-4fd5-be17-42e251e85790 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:41.393341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a62bcb0-1b6e-4fd5-be17-42e251e85790 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:41.398025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a62bcb0-1b6e-4fd5-be17-42e251e85790 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:41.398025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a62bcb0-1b6e-4fd5-be17-42e251e85790 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:41.398025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a62bcb0-1b6e-4fd5-be17-42e251e85790 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:41.398025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a62bcb0-1b6e-4fd5-be17-42e251e85790 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:41.398025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a62bcb0-1b6e-4fd5-be17-42e251e85790 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:41.471113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e6596eba-bbbf-44a7-a728-27197db0de9f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:41.483118 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e6596eba-bbbf-44a7-a728-27197db0de9f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 200 len: 1511 microversion: 2.1 time: 0.273078 Oct 04 21:29:41.485327 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2400/4771] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:41 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 1511 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:41.510501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c33be9c8-5a25-4221-9695-638fbb25eedb tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:41.516595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c33be9c8-5a25-4221-9695-638fbb25eedb tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:41.517481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c33be9c8-5a25-4221-9695-638fbb25eedb tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:41.523919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c33be9c8-5a25-4221-9695-638fbb25eedb tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:41.524406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c33be9c8-5a25-4221-9695-638fbb25eedb tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:41.524838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c33be9c8-5a25-4221-9695-638fbb25eedb tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:41.525740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c33be9c8-5a25-4221-9695-638fbb25eedb tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:41.539579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c33be9c8-5a25-4221-9695-638fbb25eedb tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:41.539971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c33be9c8-5a25-4221-9695-638fbb25eedb tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:41.587847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-c33be9c8-5a25-4221-9695-638fbb25eedb tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:29:41.634725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c33be9c8-5a25-4221-9695-638fbb25eedb tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:41.642919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c33be9c8-5a25-4221-9695-638fbb25eedb tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:41.644007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2a62bcb0-1b6e-4fd5-be17-42e251e85790 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:41.648400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c33be9c8-5a25-4221-9695-638fbb25eedb tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:41.650534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c33be9c8-5a25-4221-9695-638fbb25eedb tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:41.653874 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2a62bcb0-1b6e-4fd5-be17-42e251e85790 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.295434 Oct 04 21:29:41.671322 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2372/4772] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:41 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:41.679626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b3bce199-4363-4c24-a8d0-2351b6405a61 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:41.681024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b3bce199-4363-4c24-a8d0-2351b6405a61 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:41.688681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3bce199-4363-4c24-a8d0-2351b6405a61 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:41.689517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3bce199-4363-4c24-a8d0-2351b6405a61 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:41.690212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3bce199-4363-4c24-a8d0-2351b6405a61 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:41.691161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3bce199-4363-4c24-a8d0-2351b6405a61 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:41.692443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3bce199-4363-4c24-a8d0-2351b6405a61 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:41.693104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3bce199-4363-4c24-a8d0-2351b6405a61 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:42.116353 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c33be9c8-5a25-4221-9695-638fbb25eedb tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.611470 Oct 04 21:29:42.118009 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2401/4773] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:29:41 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:29:42.122957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8f9a1cfc-126c-4331-bc64-f9bf39e38680 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:42.123838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8f9a1cfc-126c-4331-bc64-f9bf39e38680 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:42.131971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f9a1cfc-126c-4331-bc64-f9bf39e38680 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:42.135373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f9a1cfc-126c-4331-bc64-f9bf39e38680 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:42.135373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f9a1cfc-126c-4331-bc64-f9bf39e38680 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:42.135373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f9a1cfc-126c-4331-bc64-f9bf39e38680 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:42.136901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f9a1cfc-126c-4331-bc64-f9bf39e38680 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:42.137924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f9a1cfc-126c-4331-bc64-f9bf39e38680 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:42.220578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b3bce199-4363-4c24-a8d0-2351b6405a61 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:42.232455 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b3bce199-4363-4c24-a8d0-2351b6405a61 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.556846 Oct 04 21:29:42.238133 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2373/4774] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:41 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:29:42.242828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-c33a4d07-486b-4025-8948-5252fdc86e84 req-3b918158-3183-4828-ab2a-6c5af10e7f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9f90a0-8efc-4043-a990-f6663196db72", "name": "network-vif-plugged", "status": "completed", "tag": "d1666e7e-ec76-4b74-9ed9-96bfa3bedf25"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:42.265939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c33a4d07-486b-4025-8948-5252fdc86e84 req-3b918158-3183-4828-ab2a-6c5af10e7f38 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:42.275254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c33a4d07-486b-4025-8948-5252fdc86e84 req-3b918158-3183-4828-ab2a-6c5af10e7f38 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:42.275254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c33a4d07-486b-4025-8948-5252fdc86e84 req-3b918158-3183-4828-ab2a-6c5af10e7f38 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:42.292027 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-c33a4d07-486b-4025-8948-5252fdc86e84 req-3b918158-3183-4828-ab2a-6c5af10e7f38 service nova] Creating event network-vif-plugged:d1666e7e-ec76-4b74-9ed9-96bfa3bedf25 for instance ce9f90a0-8efc-4043-a990-f6663196db72 on n-h1-860282-1 Oct 04 21:29:42.301355 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-c33a4d07-486b-4025-8948-5252fdc86e84 req-3b918158-3183-4828-ab2a-6c5af10e7f38 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061936 Oct 04 21:29:42.302961 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2374/4775] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:42.309383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2a2507e2-8d2d-456b-a53b-b08d5aa75b42 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:42.313190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2a2507e2-8d2d-456b-a53b-b08d5aa75b42 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] [instance: 94d63466-634c-4c84-9b35-38ba9234431d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:42.320535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a2507e2-8d2d-456b-a53b-b08d5aa75b42 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:42.321258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a2507e2-8d2d-456b-a53b-b08d5aa75b42 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:42.321882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a2507e2-8d2d-456b-a53b-b08d5aa75b42 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:42.322665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a2507e2-8d2d-456b-a53b-b08d5aa75b42 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:42.323197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a2507e2-8d2d-456b-a53b-b08d5aa75b42 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:42.323863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a2507e2-8d2d-456b-a53b-b08d5aa75b42 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:42.777438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2a2507e2-8d2d-456b-a53b-b08d5aa75b42 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5921599c20640a09da6909a1ba3aece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c333838cc56b4d1ca8e3a958ef7e3599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:42.794530 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2a2507e2-8d2d-456b-a53b-b08d5aa75b42 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] 10.222.0.30 "GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d" status: 200 len: 1470 microversion: 2.1 time: 0.489739 Oct 04 21:29:42.795373 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2375/4776] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:42 2022] GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d => generated 1470 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:42.801559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cf9bb9b6-5cfc-4f68-812a-0cf66ac69462 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:42.814414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cf9bb9b6-5cfc-4f68-812a-0cf66ac69462 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:42.817799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cf9bb9b6-5cfc-4f68-812a-0cf66ac69462 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:42.950896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8f9a1cfc-126c-4331-bc64-f9bf39e38680 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:42.964354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8f9a1cfc-126c-4331-bc64-f9bf39e38680 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:42.971196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8f9a1cfc-126c-4331-bc64-f9bf39e38680 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:42.977900 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8f9a1cfc-126c-4331-bc64-f9bf39e38680 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.858522 Oct 04 21:29:42.981489 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2402/4777] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:42 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:43.000965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf9bb9b6-5cfc-4f68-812a-0cf66ac69462 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:43.001593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf9bb9b6-5cfc-4f68-812a-0cf66ac69462 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:43.002242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf9bb9b6-5cfc-4f68-812a-0cf66ac69462 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:43.003205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf9bb9b6-5cfc-4f68-812a-0cf66ac69462 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:43.004009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf9bb9b6-5cfc-4f68-812a-0cf66ac69462 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:43.004661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf9bb9b6-5cfc-4f68-812a-0cf66ac69462 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:43.019447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ac409042-fe8d-4665-a019-310124fc5b79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:43.024657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ac409042-fe8d-4665-a019-310124fc5b79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 35db7403-53d9-4c74-8512-1bae943a086f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:43.028249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac409042-fe8d-4665-a019-310124fc5b79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:43.029677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac409042-fe8d-4665-a019-310124fc5b79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:43.030404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac409042-fe8d-4665-a019-310124fc5b79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:43.031943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac409042-fe8d-4665-a019-310124fc5b79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:43.034922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac409042-fe8d-4665-a019-310124fc5b79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:43.035973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac409042-fe8d-4665-a019-310124fc5b79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:43.114534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.multi_cell_list [None req-cf9bb9b6-5cfc-4f68-812a-0cf66ac69462 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:29:43.202436 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cf9bb9b6-5cfc-4f68-812a-0cf66ac69462 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.404421 Oct 04 21:29:43.204494 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2376/4778] 10.222.0.30 () {58 vars in 1150 bytes} [Tue Oct 4 21:29:42 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:43.219684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b7f4f540-5b8d-420b-b260-9d1e15c73557 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:43.220362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b7f4f540-5b8d-420b-b260-9d1e15c73557 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:43.227806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7f4f540-5b8d-420b-b260-9d1e15c73557 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:43.228319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7f4f540-5b8d-420b-b260-9d1e15c73557 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:43.228761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7f4f540-5b8d-420b-b260-9d1e15c73557 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:43.229499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7f4f540-5b8d-420b-b260-9d1e15c73557 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:43.230067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7f4f540-5b8d-420b-b260-9d1e15c73557 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:43.230420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7f4f540-5b8d-420b-b260-9d1e15c73557 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:43.270424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ac409042-fe8d-4665-a019-310124fc5b79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:43.277754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-b7f4f540-5b8d-420b-b260-9d1e15c73557 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lazy-loading 'flavor' on Instance uuid 144fff2d-9df3-4a93-833f-7f76acc85185 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:29:43.286567 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ac409042-fe8d-4665-a019-310124fc5b79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f" status: 200 len: 1253 microversion: 2.1 time: 0.303703 Oct 04 21:29:43.289129 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2403/4779] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:42 2022] GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f => generated 1253 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:43.301576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-196fb878-887c-4fdb-92ed-5f4492d5559a tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:43.303024 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-196fb878-887c-4fdb-92ed-5f4492d5559a tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:43.324331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-196fb878-887c-4fdb-92ed-5f4492d5559a tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:43.325783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-196fb878-887c-4fdb-92ed-5f4492d5559a tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:43.328180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-196fb878-887c-4fdb-92ed-5f4492d5559a tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:43.329239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-196fb878-887c-4fdb-92ed-5f4492d5559a tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:43.331231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-196fb878-887c-4fdb-92ed-5f4492d5559a tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:43.331932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-196fb878-887c-4fdb-92ed-5f4492d5559a tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:43.658403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-196fb878-887c-4fdb-92ed-5f4492d5559a tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:43.669610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-196fb878-887c-4fdb-92ed-5f4492d5559a tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:43.671064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-196fb878-887c-4fdb-92ed-5f4492d5559a tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:43.677858 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-196fb878-887c-4fdb-92ed-5f4492d5559a tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72" status: 200 len: 1362 microversion: 2.26 time: 0.382577 Oct 04 21:29:43.678470 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2404/4780] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:43 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72 => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:43.683052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-82354493-e1af-4da4-9f64-c830cbfe4c4c req-6850bfa3-2c6c-4cd5-9666-207c5beb1842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94d63466-634c-4c84-9b35-38ba9234431d", "name": "network-vif-deleted", "tag": "f2274b0e-6a72-460d-9ee4-893f88c2840f"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:43.700578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-82354493-e1af-4da4-9f64-c830cbfe4c4c req-6850bfa3-2c6c-4cd5-9666-207c5beb1842 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:43.701357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-82354493-e1af-4da4-9f64-c830cbfe4c4c req-6850bfa3-2c6c-4cd5-9666-207c5beb1842 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:43.702010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-82354493-e1af-4da4-9f64-c830cbfe4c4c req-6850bfa3-2c6c-4cd5-9666-207c5beb1842 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:43.720330 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-82354493-e1af-4da4-9f64-c830cbfe4c4c req-6850bfa3-2c6c-4cd5-9666-207c5beb1842 service nova] Creating event network-vif-deleted:f2274b0e-6a72-460d-9ee4-893f88c2840f for instance 94d63466-634c-4c84-9b35-38ba9234431d on n-h1-860282-1 Oct 04 21:29:43.727718 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-82354493-e1af-4da4-9f64-c830cbfe4c4c req-6850bfa3-2c6c-4cd5-9666-207c5beb1842 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048046 Oct 04 21:29:43.728974 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2405/4781] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:43.736285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-686753cc-943e-4b90-9f46-b4aca7ce7f25 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:43.742287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-686753cc-943e-4b90-9f46-b4aca7ce7f25 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:43.743314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-686753cc-943e-4b90-9f46-b4aca7ce7f25 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:43.751079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-686753cc-943e-4b90-9f46-b4aca7ce7f25 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:43.751944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-686753cc-943e-4b90-9f46-b4aca7ce7f25 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:43.752638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-686753cc-943e-4b90-9f46-b4aca7ce7f25 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:43.753706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-686753cc-943e-4b90-9f46-b4aca7ce7f25 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:43.754432 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-686753cc-943e-4b90-9f46-b4aca7ce7f25 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:43.757870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-686753cc-943e-4b90-9f46-b4aca7ce7f25 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:43.870461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-686753cc-943e-4b90-9f46-b4aca7ce7f25 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:29:43.952256 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-686753cc-943e-4b90-9f46-b4aca7ce7f25 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.221533 Oct 04 21:29:43.960885 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2406/4782] 10.222.0.30 () {58 vars in 1212 bytes} [Tue Oct 4 21:29:43 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:43.969810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c9e09398-748b-4451-a7be-b01c409095fd tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:43.970602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c9e09398-748b-4451-a7be-b01c409095fd tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] [instance: 94d63466-634c-4c84-9b35-38ba9234431d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:43.971002 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b7f4f540-5b8d-420b-b260-9d1e15c73557 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action" status: 202 len: 0 microversion: 2.1 time: 0.759722 Oct 04 21:29:43.973324 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2377/4783] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:29:43 2022] POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action => generated 0 bytes in 761 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:29:43.982198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9e09398-748b-4451-a7be-b01c409095fd tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:43.984114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9e09398-748b-4451-a7be-b01c409095fd tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:43.984737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9e09398-748b-4451-a7be-b01c409095fd tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:43.985787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9e09398-748b-4451-a7be-b01c409095fd tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:43.987218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9e09398-748b-4451-a7be-b01c409095fd tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:43.987827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9e09398-748b-4451-a7be-b01c409095fd tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:43.991375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-62b7771b-ccb9-4fdc-a9ec-0dd87f7d1a87 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:43.998668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-62b7771b-ccb9-4fdc-a9ec-0dd87f7d1a87 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:44.000751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-62b7771b-ccb9-4fdc-a9ec-0dd87f7d1a87 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:44.009504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62b7771b-ccb9-4fdc-a9ec-0dd87f7d1a87 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:44.011655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62b7771b-ccb9-4fdc-a9ec-0dd87f7d1a87 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:44.012333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62b7771b-ccb9-4fdc-a9ec-0dd87f7d1a87 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:44.013581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62b7771b-ccb9-4fdc-a9ec-0dd87f7d1a87 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:44.014236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62b7771b-ccb9-4fdc-a9ec-0dd87f7d1a87 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:44.015853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62b7771b-ccb9-4fdc-a9ec-0dd87f7d1a87 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:44.031270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9e09398-748b-4451-a7be-b01c409095fd tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:44.032316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9e09398-748b-4451-a7be-b01c409095fd tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:44.032793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9e09398-748b-4451-a7be-b01c409095fd tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:44.033264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-c9e09398-748b-4451-a7be-b01c409095fd tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lazy-loading 'fault' on Instance uuid 94d63466-634c-4c84-9b35-38ba9234431d {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:29:44.131435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.multi_cell_list [None req-62b7771b-ccb9-4fdc-a9ec-0dd87f7d1a87 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:29:44.136895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c9e09398-748b-4451-a7be-b01c409095fd tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5921599c20640a09da6909a1ba3aece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c333838cc56b4d1ca8e3a958ef7e3599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:44.160716 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c9e09398-748b-4451-a7be-b01c409095fd tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] 10.222.0.30 "GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d" status: 200 len: 1304 microversion: 2.1 time: 0.198025 Oct 04 21:29:44.165550 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2407/4784] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:43 2022] GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d => generated 1304 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:44.180297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ccaab0cd-8b71-47a4-b9b9-5dbd7adfc0ec tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:44.180939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ccaab0cd-8b71-47a4-b9b9-5dbd7adfc0ec tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:44.208439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccaab0cd-8b71-47a4-b9b9-5dbd7adfc0ec tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:44.209105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccaab0cd-8b71-47a4-b9b9-5dbd7adfc0ec tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:44.216035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccaab0cd-8b71-47a4-b9b9-5dbd7adfc0ec tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:44.216035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccaab0cd-8b71-47a4-b9b9-5dbd7adfc0ec tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:44.216035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccaab0cd-8b71-47a4-b9b9-5dbd7adfc0ec tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:44.219597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccaab0cd-8b71-47a4-b9b9-5dbd7adfc0ec tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:44.282188 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-62b7771b-ccb9-4fdc-a9ec-0dd87f7d1a87 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.309227 Oct 04 21:29:44.282794 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2378/4785] 10.222.0.30 () {58 vars in 1196 bytes} [Tue Oct 4 21:29:43 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:44.288663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5d1fc50d-2cfa-406c-a2ec-04bcd8a094db tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:44.289783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5d1fc50d-2cfa-406c-a2ec-04bcd8a094db tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:44.297114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d1fc50d-2cfa-406c-a2ec-04bcd8a094db tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:44.298226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d1fc50d-2cfa-406c-a2ec-04bcd8a094db tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:44.298929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d1fc50d-2cfa-406c-a2ec-04bcd8a094db tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:44.299906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d1fc50d-2cfa-406c-a2ec-04bcd8a094db tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:44.300600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d1fc50d-2cfa-406c-a2ec-04bcd8a094db tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:44.301334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d1fc50d-2cfa-406c-a2ec-04bcd8a094db tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.002530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ccaab0cd-8b71-47a4-b9b9-5dbd7adfc0ec tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:45.027814 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ccaab0cd-8b71-47a4-b9b9-5dbd7adfc0ec tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1512 microversion: 2.1 time: 0.861015 Oct 04 21:29:45.032913 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2408/4786] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:44 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1512 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:45.056339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5d1fc50d-2cfa-406c-a2ec-04bcd8a094db tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:45.080582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ae7521ba-eab6-48bb-883e-c1b57d6b4dcc tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:45.083591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5d1fc50d-2cfa-406c-a2ec-04bcd8a094db tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:45.095720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5d1fc50d-2cfa-406c-a2ec-04bcd8a094db tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:45.099736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ae7521ba-eab6-48bb-883e-c1b57d6b4dcc tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:45.102668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ae7521ba-eab6-48bb-883e-c1b57d6b4dcc tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'name': '-587447862', 'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:45.103729 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5d1fc50d-2cfa-406c-a2ec-04bcd8a094db tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.817533 Oct 04 21:29:45.114835 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2379/4787] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:44 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:45.128894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-624b71b2-fe78-4005-943d-7402823043d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:45.130182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae7521ba-eab6-48bb-883e-c1b57d6b4dcc tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.130727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae7521ba-eab6-48bb-883e-c1b57d6b4dcc tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.131199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-624b71b2-fe78-4005-943d-7402823043d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 35db7403-53d9-4c74-8512-1bae943a086f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:45.133170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae7521ba-eab6-48bb-883e-c1b57d6b4dcc tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.134099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae7521ba-eab6-48bb-883e-c1b57d6b4dcc tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.134573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae7521ba-eab6-48bb-883e-c1b57d6b4dcc tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.135007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae7521ba-eab6-48bb-883e-c1b57d6b4dcc tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.152263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-624b71b2-fe78-4005-943d-7402823043d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.153044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-624b71b2-fe78-4005-943d-7402823043d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.153689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-624b71b2-fe78-4005-943d-7402823043d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.154630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-624b71b2-fe78-4005-943d-7402823043d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.155272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-624b71b2-fe78-4005-943d-7402823043d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.155762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-624b71b2-fe78-4005-943d-7402823043d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.260807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-ae7521ba-eab6-48bb-883e-c1b57d6b4dcc tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:29:45.391293 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ae7521ba-eab6-48bb-883e-c1b57d6b4dcc tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers?name=-587447862" status: 200 len: 345 microversion: 2.1 time: 0.354579 Oct 04 21:29:45.393851 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2409/4788] 10.222.0.30 () {58 vars in 1156 bytes} [Tue Oct 4 21:29:45 2022] GET /compute/v2.1/servers?name=-587447862 => generated 345 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:45.397543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fd059369-7ef5-437f-b70b-d6dc17f76a92 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:45.398339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fd059369-7ef5-437f-b70b-d6dc17f76a92 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:45.404812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd059369-7ef5-437f-b70b-d6dc17f76a92 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.405310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd059369-7ef5-437f-b70b-d6dc17f76a92 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.406330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd059369-7ef5-437f-b70b-d6dc17f76a92 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.407057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd059369-7ef5-437f-b70b-d6dc17f76a92 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.407511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd059369-7ef5-437f-b70b-d6dc17f76a92 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.407944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd059369-7ef5-437f-b70b-d6dc17f76a92 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.532277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-624b71b2-fe78-4005-943d-7402823043d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:45.541554 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-624b71b2-fe78-4005-943d-7402823043d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f" status: 200 len: 1293 microversion: 2.1 time: 0.425265 Oct 04 21:29:45.542836 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2380/4789] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:45 2022] GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f => generated 1293 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:45.548995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a8f6ec2-1059-407c-9d54-974ae1664b29 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:45.549731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7a8f6ec2-1059-407c-9d54-974ae1664b29 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] [instance: 94d63466-634c-4c84-9b35-38ba9234431d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:45.558698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a8f6ec2-1059-407c-9d54-974ae1664b29 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.559283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a8f6ec2-1059-407c-9d54-974ae1664b29 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.559828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a8f6ec2-1059-407c-9d54-974ae1664b29 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.560641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a8f6ec2-1059-407c-9d54-974ae1664b29 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.561166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a8f6ec2-1059-407c-9d54-974ae1664b29 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.561723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a8f6ec2-1059-407c-9d54-974ae1664b29 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.578279 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-7a8f6ec2-1059-407c-9d54-974ae1664b29 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] HTTP exception thrown: Instance 94d63466-634c-4c84-9b35-38ba9234431d could not be found. Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a8f6ec2-1059-407c-9d54-974ae1664b29 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Request method failure captured: Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d HTTP/1.1 Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKWmWzqPb2sT8iBh_FA89I_t8FpxyL6Xhrv3vrSKFVsgksF0aaZmGI8jnf0Vjo9185r492-bYX48IMoLLSl0OTFGt3NrKhpJ0AN2tmslv_YyLdiQNU1iB7rLfOusbmb1LuK4jXmtsAeVo5ctW9euwVweXKVr_PBzV4vFl5jbXdsc35g Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: c333838cc56b4d1ca8e3a958ef7e3599 Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-VolumesNegativeTest-36219574 Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c333838cc56b4d1ca8e3a958ef7e3599"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c333838cc56b4d1ca8e3a958ef7e3599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c333838cc56b4d1ca8e3a958ef7e3599"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c333838cc56b4d1ca8e3a958ef7e3599"}]}] Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-VolumesNegativeTest-36219574 Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: c333838cc56b4d1ca8e3a958ef7e3599 Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-VolumesNegativeTest-36219574 Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-VolumesNegativeTest-36219574-project Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: f5921599c20640a09da6909a1ba3aece Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-VolumesNegativeTest-36219574-project Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 94d63466-634c-4c84-9b35-38ba9234431d could not be found. Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '94d63466-634c-4c84-9b35-38ba9234431d'} Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94d63466-634c-4c84-9b35-38ba9234431d could not be found. Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94d63466-634c-4c84-9b35-38ba9234431d could not be found. Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:45.580352 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:45.584784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:45.584784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:45.584784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:45.584784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:45.584784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:45.584784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94d63466-634c-4c84-9b35-38ba9234431d could not be found. Oct 04 21:29:45.584784 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:29:45.584784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a8f6ec2-1059-407c-9d54-974ae1664b29 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] Returning 404 to user: Instance 94d63466-634c-4c84-9b35-38ba9234431d could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:45.584784 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7a8f6ec2-1059-407c-9d54-974ae1664b29 tempest-VolumesNegativeTest-36219574 tempest-VolumesNegativeTest-36219574-project] 10.222.0.30 "GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d" status: 404 len: 111 microversion: 2.1 time: 0.037141 Oct 04 21:29:45.588586 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2381/4790] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:45 2022] GET /compute/v2.1/servers/94d63466-634c-4c84-9b35-38ba9234431d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:29:45.595749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-864763ef-81ae-4e89-98d0-8b60a71707b9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:45.602850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-864763ef-81ae-4e89-98d0-8b60a71707b9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:45.605734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-864763ef-81ae-4e89-98d0-8b60a71707b9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:45.612333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-864763ef-81ae-4e89-98d0-8b60a71707b9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.613153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-864763ef-81ae-4e89-98d0-8b60a71707b9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.614499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-864763ef-81ae-4e89-98d0-8b60a71707b9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.615530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-864763ef-81ae-4e89-98d0-8b60a71707b9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.616471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-864763ef-81ae-4e89-98d0-8b60a71707b9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.617097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-864763ef-81ae-4e89-98d0-8b60a71707b9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.685034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fd059369-7ef5-437f-b70b-d6dc17f76a92 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:45.694994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fd059369-7ef5-437f-b70b-d6dc17f76a92 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:45.697237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fd059369-7ef5-437f-b70b-d6dc17f76a92 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:45.698541 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fd059369-7ef5-437f-b70b-d6dc17f76a92 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72" status: 200 len: 1546 microversion: 2.26 time: 0.305492 Oct 04 21:29:45.715080 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2410/4791] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:45 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72 => generated 1546 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:45.726546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1f753f6a-21ad-4859-b898-f018e6813b28 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '.version_select at 0x7f578b7abaf0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:45.732961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.multi_cell_list [None req-864763ef-81ae-4e89-98d0-8b60a71707b9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:29:45.736609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f753f6a-21ad-4859-b898-f018e6813b28 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.737362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f753f6a-21ad-4859-b898-f018e6813b28 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.738039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f753f6a-21ad-4859-b898-f018e6813b28 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.742287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1f753f6a-21ad-4859-b898-f018e6813b28 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:45.746066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f753f6a-21ad-4859-b898-f018e6813b28 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.746876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f753f6a-21ad-4859-b898-f018e6813b28 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.747539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f753f6a-21ad-4859-b898-f018e6813b28 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.748502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f753f6a-21ad-4859-b898-f018e6813b28 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.749059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f753f6a-21ad-4859-b898-f018e6813b28 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.750159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f753f6a-21ad-4859-b898-f018e6813b28 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.777840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f753f6a-21ad-4859-b898-f018e6813b28 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.778698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f753f6a-21ad-4859-b898-f018e6813b28 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.779380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f753f6a-21ad-4859-b898-f018e6813b28 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.800899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f753f6a-21ad-4859-b898-f018e6813b28 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.801821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f753f6a-21ad-4859-b898-f018e6813b28 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.802493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f753f6a-21ad-4859-b898-f018e6813b28 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.813586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:45.826398 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-864763ef-81ae-4e89-98d0-8b60a71707b9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.236423 Oct 04 21:29:45.827246 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2382/4792] 10.222.0.30 () {58 vars in 1154 bytes} [Tue Oct 4 21:29:45 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:45.841045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-525fc65b-455d-4f8e-bf1f-405057b977bf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:45.847484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-525fc65b-455d-4f8e-bf1f-405057b977bf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:45.848151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-525fc65b-455d-4f8e-bf1f-405057b977bf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-58744786', 'deleted': False, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:29:45.853936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-525fc65b-455d-4f8e-bf1f-405057b977bf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.854553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-525fc65b-455d-4f8e-bf1f-405057b977bf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.854984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-525fc65b-455d-4f8e-bf1f-405057b977bf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.855695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-525fc65b-455d-4f8e-bf1f-405057b977bf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.856140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-525fc65b-455d-4f8e-bf1f-405057b977bf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.856556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-525fc65b-455d-4f8e-bf1f-405057b977bf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.900509 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-1f753f6a-21ad-4859-b898-f018e6813b28 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lazy-loading 'flavor' on Instance uuid ce9f90a0-8efc-4043-a990-f6663196db72 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:29:45.918031 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1f753f6a-21ad-4859-b898-f018e6813b28 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "PUT /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags/tempest-tag-1393487186" status: 201 len: 0 microversion: 2.26 time: 0.195134 Oct 04 21:29:45.923730 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2411/4793] 10.222.0.30 () {62 vars in 1380 bytes} [Tue Oct 4 21:29:45 2022] PUT /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags/tempest-tag-1393487186 => generated 0 bytes in 202 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 21:29:45.929060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c1e2e1c1-6aee-4315-9aa5-ab06f8cd605e tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '.version_select at 0x7f578b7abf70>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:45.937501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1e2e1c1-6aee-4315-9aa5-ab06f8cd605e tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.938099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1e2e1c1-6aee-4315-9aa5-ab06f8cd605e tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.938542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1e2e1c1-6aee-4315-9aa5-ab06f8cd605e tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.951185 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c1e2e1c1-6aee-4315-9aa5-ab06f8cd605e tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags/tempest-tag-1393487186" status: 204 len: 0 microversion: 2.26 time: 0.026358 Oct 04 21:29:45.952024 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2412/4794] 10.222.0.30 () {60 vars in 1361 bytes} [Tue Oct 4 21:29:45 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags/tempest-tag-1393487186 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:29:45.962212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.multi_cell_list [None req-525fc65b-455d-4f8e-bf1f-405057b977bf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:29:45.967130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:45.969368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-78919ceb-781a-44d8-9ec5-26d7557962b8 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '.version_select at 0x7f578b8b4550>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:45.980333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:45.984328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78919ceb-781a-44d8-9ec5-26d7557962b8 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.985041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78919ceb-781a-44d8-9ec5-26d7557962b8 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.985700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78919ceb-781a-44d8-9ec5-26d7557962b8 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.986373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-78919ceb-781a-44d8-9ec5-26d7557962b8 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:45.992324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78919ceb-781a-44d8-9ec5-26d7557962b8 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.993025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78919ceb-781a-44d8-9ec5-26d7557962b8 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.993658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78919ceb-781a-44d8-9ec5-26d7557962b8 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.994551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78919ceb-781a-44d8-9ec5-26d7557962b8 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:45.995191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78919ceb-781a-44d8-9ec5-26d7557962b8 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:45.996741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78919ceb-781a-44d8-9ec5-26d7557962b8 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:46.031811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78919ceb-781a-44d8-9ec5-26d7557962b8 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:46.032369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78919ceb-781a-44d8-9ec5-26d7557962b8 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:46.032700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78919ceb-781a-44d8-9ec5-26d7557962b8 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:46.079981 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-525fc65b-455d-4f8e-bf1f-405057b977bf tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-58744786" status: 200 len: 345 microversion: 2.1 time: 0.242914 Oct 04 21:29:46.083181 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2383/4795] 10.222.0.30 () {58 vars in 1226 bytes} [Tue Oct 4 21:29:45 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-58744786 => generated 345 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:29:46.095193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-20bc0873-4daf-4ae1-b14b-50c4f9ce86a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:46.095956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-20bc0873-4daf-4ae1-b14b-50c4f9ce86a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:46.103743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20bc0873-4daf-4ae1-b14b-50c4f9ce86a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:46.104486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20bc0873-4daf-4ae1-b14b-50c4f9ce86a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:46.105754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20bc0873-4daf-4ae1-b14b-50c4f9ce86a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:46.107296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20bc0873-4daf-4ae1-b14b-50c4f9ce86a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:46.108237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20bc0873-4daf-4ae1-b14b-50c4f9ce86a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:46.113026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20bc0873-4daf-4ae1-b14b-50c4f9ce86a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:46.167413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-78919ceb-781a-44d8-9ec5-26d7557962b8 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lazy-loading 'flavor' on Instance uuid ce9f90a0-8efc-4043-a990-f6663196db72 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:29:46.198992 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-78919ceb-781a-44d8-9ec5-26d7557962b8 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags" status: 204 len: 0 microversion: 2.26 time: 0.241352 Oct 04 21:29:46.204301 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2413/4796] 10.222.0.30 () {60 vars in 1295 bytes} [Tue Oct 4 21:29:45 2022] DELETE /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:29:46.208722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-73e7fde5-5335-4fcd-9c02-a47565fee35a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:46.209671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-73e7fde5-5335-4fcd-9c02-a47565fee35a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:46.217109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73e7fde5-5335-4fcd-9c02-a47565fee35a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:46.217649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73e7fde5-5335-4fcd-9c02-a47565fee35a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:46.218740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73e7fde5-5335-4fcd-9c02-a47565fee35a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:46.219952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73e7fde5-5335-4fcd-9c02-a47565fee35a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:46.220858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73e7fde5-5335-4fcd-9c02-a47565fee35a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:46.221811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73e7fde5-5335-4fcd-9c02-a47565fee35a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:46.256520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-73e7fde5-5335-4fcd-9c02-a47565fee35a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:29:46.332854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-20bc0873-4daf-4ae1-b14b-50c4f9ce86a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:46.341147 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-20bc0873-4daf-4ae1-b14b-50c4f9ce86a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1512 microversion: 2.1 time: 0.256361 Oct 04 21:29:46.341780 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2384/4797] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:46 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1512 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:46.348242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0d6e8935-02e4-4d24-864f-c7e396baa56c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:46.349086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0d6e8935-02e4-4d24-864f-c7e396baa56c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:46.355168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d6e8935-02e4-4d24-864f-c7e396baa56c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:46.355829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d6e8935-02e4-4d24-864f-c7e396baa56c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:46.356449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d6e8935-02e4-4d24-864f-c7e396baa56c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:46.357324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d6e8935-02e4-4d24-864f-c7e396baa56c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:46.358078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d6e8935-02e4-4d24-864f-c7e396baa56c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:46.358709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d6e8935-02e4-4d24-864f-c7e396baa56c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:46.680870 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-73e7fde5-5335-4fcd-9c02-a47565fee35a tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "DELETE /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 204 len: 0 microversion: 2.1 time: 0.479967 Oct 04 21:29:46.681477 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2414/4798] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:29:46 2022] DELETE /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:29:46.688422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8f6463bd-f7ad-4413-b552-8b92bf5ee8b2 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '.version_select at 0x7f578b841430>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:46.696463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f6463bd-f7ad-4413-b552-8b92bf5ee8b2 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:46.696959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f6463bd-f7ad-4413-b552-8b92bf5ee8b2 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:46.697491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f6463bd-f7ad-4413-b552-8b92bf5ee8b2 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:46.708309 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8f6463bd-f7ad-4413-b552-8b92bf5ee8b2 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags" status: 200 len: 12 microversion: 2.26 time: 0.025236 Oct 04 21:29:46.709207 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2415/4799] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Oct 4 21:29:46 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags => generated 12 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:46.714734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f3db0944-52a7-4023-9ce2-55923a5c6fe2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:46.715810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f3db0944-52a7-4023-9ce2-55923a5c6fe2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 35db7403-53d9-4c74-8512-1bae943a086f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:46.722371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3db0944-52a7-4023-9ce2-55923a5c6fe2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:46.723151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3db0944-52a7-4023-9ce2-55923a5c6fe2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:46.723650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3db0944-52a7-4023-9ce2-55923a5c6fe2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:46.724595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3db0944-52a7-4023-9ce2-55923a5c6fe2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:46.725270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3db0944-52a7-4023-9ce2-55923a5c6fe2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:46.725910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3db0944-52a7-4023-9ce2-55923a5c6fe2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:46.822535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0d6e8935-02e4-4d24-864f-c7e396baa56c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:46.833474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0d6e8935-02e4-4d24-864f-c7e396baa56c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:46.835277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0d6e8935-02e4-4d24-864f-c7e396baa56c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:46.836991 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0d6e8935-02e4-4d24-864f-c7e396baa56c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.494278 Oct 04 21:29:46.850013 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2385/4800] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:46 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:46.862886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a3a20f62-c0a3-4685-9da1-883ecb50af7e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:46.865679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a3a20f62-c0a3-4685-9da1-883ecb50af7e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:46.871327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3a20f62-c0a3-4685-9da1-883ecb50af7e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:46.872139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3a20f62-c0a3-4685-9da1-883ecb50af7e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:46.872811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3a20f62-c0a3-4685-9da1-883ecb50af7e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:46.873795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3a20f62-c0a3-4685-9da1-883ecb50af7e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:46.875153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3a20f62-c0a3-4685-9da1-883ecb50af7e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:46.875876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3a20f62-c0a3-4685-9da1-883ecb50af7e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.068547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f3db0944-52a7-4023-9ce2-55923a5c6fe2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:47.083003 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f3db0944-52a7-4023-9ce2-55923a5c6fe2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f" status: 200 len: 1293 microversion: 2.1 time: 0.369440 Oct 04 21:29:47.083998 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2416/4801] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:46 2022] GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f => generated 1293 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:47.102526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f6c75022-3876-4d1b-949d-92aad9c6d258 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '.version_select at 0x7f5790014550>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:47.120615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6c75022-3876-4d1b-949d-92aad9c6d258 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.127775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6c75022-3876-4d1b-949d-92aad9c6d258 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.128467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6c75022-3876-4d1b-949d-92aad9c6d258 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.129217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f6c75022-3876-4d1b-949d-92aad9c6d258 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:47.142311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6c75022-3876-4d1b-949d-92aad9c6d258 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.143050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6c75022-3876-4d1b-949d-92aad9c6d258 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.143682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6c75022-3876-4d1b-949d-92aad9c6d258 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.144548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6c75022-3876-4d1b-949d-92aad9c6d258 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.145166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6c75022-3876-4d1b-949d-92aad9c6d258 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.147017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6c75022-3876-4d1b-949d-92aad9c6d258 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.173812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a3a20f62-c0a3-4685-9da1-883ecb50af7e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:47.182907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6c75022-3876-4d1b-949d-92aad9c6d258 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.183621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6c75022-3876-4d1b-949d-92aad9c6d258 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.184262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6c75022-3876-4d1b-949d-92aad9c6d258 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.188174 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a3a20f62-c0a3-4685-9da1-883ecb50af7e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 200 len: 1517 microversion: 2.1 time: 0.336848 Oct 04 21:29:47.190985 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2386/4802] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:46 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 1517 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:47.202364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6c75022-3876-4d1b-949d-92aad9c6d258 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.202364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6c75022-3876-4d1b-949d-92aad9c6d258 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.202364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6c75022-3876-4d1b-949d-92aad9c6d258 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.302700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-f6c75022-3876-4d1b-949d-92aad9c6d258 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lazy-loading 'flavor' on Instance uuid ce9f90a0-8efc-4043-a990-f6663196db72 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:29:47.318490 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f6c75022-3876-4d1b-949d-92aad9c6d258 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "PUT /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags/tempest-tag-449816056" status: 201 len: 0 microversion: 2.26 time: 0.233140 Oct 04 21:29:47.329463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-3840c580-7ddc-488f-9c6e-96700d36a5e3 req-03b8a776-8fdb-4cc9-9de7-8168895d8964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35db7403-53d9-4c74-8512-1bae943a086f", "tag": "c4f8b3f0-6dc7-45b6-95d6-2ac1592501bc"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:47.334099 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2417/4803] 10.222.0.30 () {62 vars in 1377 bytes} [Tue Oct 4 21:29:47 2022] PUT /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags/tempest-tag-449816056 => generated 0 bytes in 249 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 21:29:47.350662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-96100f99-7ce7-4ba5-96ce-5f9cae1f0332 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '.version_select at 0x7f578b972430>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:47.352528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3840c580-7ddc-488f-9c6e-96700d36a5e3 req-03b8a776-8fdb-4cc9-9de7-8168895d8964 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.353026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3840c580-7ddc-488f-9c6e-96700d36a5e3 req-03b8a776-8fdb-4cc9-9de7-8168895d8964 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.353484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3840c580-7ddc-488f-9c6e-96700d36a5e3 req-03b8a776-8fdb-4cc9-9de7-8168895d8964 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.359771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96100f99-7ce7-4ba5-96ce-5f9cae1f0332 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.360455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96100f99-7ce7-4ba5-96ce-5f9cae1f0332 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.361016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96100f99-7ce7-4ba5-96ce-5f9cae1f0332 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.378601 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-96100f99-7ce7-4ba5-96ce-5f9cae1f0332 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags" status: 200 len: 35 microversion: 2.26 time: 0.037428 Oct 04 21:29:47.378601 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2418/4804] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Oct 4 21:29:47 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags => generated 35 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:47.380130 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-3840c580-7ddc-488f-9c6e-96700d36a5e3 req-03b8a776-8fdb-4cc9-9de7-8168895d8964 service nova] Creating event network-changed:c4f8b3f0-6dc7-45b6-95d6-2ac1592501bc for instance 35db7403-53d9-4c74-8512-1bae943a086f on n-h1-860282-1 Oct 04 21:29:47.386480 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-3840c580-7ddc-488f-9c6e-96700d36a5e3 req-03b8a776-8fdb-4cc9-9de7-8168895d8964 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062064 Oct 04 21:29:47.387417 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2387/4805] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:29:47.391934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-578ae554-8e32-4400-8853-d65d0964fbfa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:47.393016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-578ae554-8e32-4400-8853-d65d0964fbfa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:47.394623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2d172396-d163-4af5-8f07-a5daee666d47 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '.version_select at 0x7f579013eca0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:47.401333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-578ae554-8e32-4400-8853-d65d0964fbfa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.401941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-578ae554-8e32-4400-8853-d65d0964fbfa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.402459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-578ae554-8e32-4400-8853-d65d0964fbfa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.403283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-578ae554-8e32-4400-8853-d65d0964fbfa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.403644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2d172396-d163-4af5-8f07-a5daee666d47 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.404008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-578ae554-8e32-4400-8853-d65d0964fbfa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.404477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2d172396-d163-4af5-8f07-a5daee666d47 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.404623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-578ae554-8e32-4400-8853-d65d0964fbfa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.406633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2d172396-d163-4af5-8f07-a5daee666d47 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.407868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2d172396-d163-4af5-8f07-a5daee666d47 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:47.414482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2d172396-d163-4af5-8f07-a5daee666d47 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.415199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2d172396-d163-4af5-8f07-a5daee666d47 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.415812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2d172396-d163-4af5-8f07-a5daee666d47 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.416689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2d172396-d163-4af5-8f07-a5daee666d47 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.417317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2d172396-d163-4af5-8f07-a5daee666d47 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.418753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2d172396-d163-4af5-8f07-a5daee666d47 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.454090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2d172396-d163-4af5-8f07-a5daee666d47 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.455747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2d172396-d163-4af5-8f07-a5daee666d47 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.456374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2d172396-d163-4af5-8f07-a5daee666d47 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.596291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-2d172396-d163-4af5-8f07-a5daee666d47 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lazy-loading 'flavor' on Instance uuid ce9f90a0-8efc-4043-a990-f6663196db72 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:29:47.642066 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2d172396-d163-4af5-8f07-a5daee666d47 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags/tempest-tag-449816056" status: 204 len: 0 microversion: 2.26 time: 0.253187 Oct 04 21:29:47.645823 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2388/4806] 10.222.0.30 () {60 vars in 1361 bytes} [Tue Oct 4 21:29:47 2022] DELETE /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags/tempest-tag-449816056 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:29:47.656801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-69f31ea5-e9ec-49b1-9daa-ddb4d240b787 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '.version_select at 0x7f579013ef70>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:47.668237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-69f31ea5-e9ec-49b1-9daa-ddb4d240b787 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.669761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-69f31ea5-e9ec-49b1-9daa-ddb4d240b787 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.670415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-69f31ea5-e9ec-49b1-9daa-ddb4d240b787 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.682507 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-69f31ea5-e9ec-49b1-9daa-ddb4d240b787 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags" status: 200 len: 12 microversion: 2.26 time: 0.032138 Oct 04 21:29:47.684765 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2389/4807] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Oct 4 21:29:47 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags => generated 12 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:47.696864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c80123af-86a9-42e9-8743-0ec04684a23f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '.version_select at 0x7f579443d700>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:47.706036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c80123af-86a9-42e9-8743-0ec04684a23f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.706810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c80123af-86a9-42e9-8743-0ec04684a23f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.707457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c80123af-86a9-42e9-8743-0ec04684a23f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.708160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c80123af-86a9-42e9-8743-0ec04684a23f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:47.714498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c80123af-86a9-42e9-8743-0ec04684a23f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.715054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c80123af-86a9-42e9-8743-0ec04684a23f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.715500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c80123af-86a9-42e9-8743-0ec04684a23f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.716433 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c80123af-86a9-42e9-8743-0ec04684a23f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.716908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c80123af-86a9-42e9-8743-0ec04684a23f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.717391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c80123af-86a9-42e9-8743-0ec04684a23f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.748207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c80123af-86a9-42e9-8743-0ec04684a23f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.748878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c80123af-86a9-42e9-8743-0ec04684a23f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.750601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c80123af-86a9-42e9-8743-0ec04684a23f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.764566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-578ae554-8e32-4400-8853-d65d0964fbfa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:47.769442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-c80123af-86a9-42e9-8743-0ec04684a23f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lazy-loading 'flavor' on Instance uuid ce9f90a0-8efc-4043-a990-f6663196db72 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:29:47.786828 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-578ae554-8e32-4400-8853-d65d0964fbfa tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1512 microversion: 2.1 time: 0.405699 Oct 04 21:29:47.801751 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2419/4808] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:47 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1512 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:47.803545 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c80123af-86a9-42e9-8743-0ec04684a23f tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags" status: 204 len: 0 microversion: 2.26 time: 0.097354 Oct 04 21:29:47.812703 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2390/4809] 10.222.0.30 () {60 vars in 1295 bytes} [Tue Oct 4 21:29:47 2022] DELETE /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:29:47.819220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f76f853c-d68d-4a87-b288-eedd60aac37b tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '.version_select at 0x7f578b780670>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:47.844072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76f853c-d68d-4a87-b288-eedd60aac37b tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.844663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76f853c-d68d-4a87-b288-eedd60aac37b tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.846894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76f853c-d68d-4a87-b288-eedd60aac37b tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.847433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f76f853c-d68d-4a87-b288-eedd60aac37b tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:47.863008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76f853c-d68d-4a87-b288-eedd60aac37b tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.863252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76f853c-d68d-4a87-b288-eedd60aac37b tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.869218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ebf12487-12c6-4437-a89a-b8eeab4d5f9e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:47.870170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ebf12487-12c6-4437-a89a-b8eeab4d5f9e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:47.888954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76f853c-d68d-4a87-b288-eedd60aac37b tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.888954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76f853c-d68d-4a87-b288-eedd60aac37b tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.888954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76f853c-d68d-4a87-b288-eedd60aac37b tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.888954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76f853c-d68d-4a87-b288-eedd60aac37b tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.889372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebf12487-12c6-4437-a89a-b8eeab4d5f9e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.889372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebf12487-12c6-4437-a89a-b8eeab4d5f9e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.889372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebf12487-12c6-4437-a89a-b8eeab4d5f9e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.889372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebf12487-12c6-4437-a89a-b8eeab4d5f9e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.889372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebf12487-12c6-4437-a89a-b8eeab4d5f9e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.889372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebf12487-12c6-4437-a89a-b8eeab4d5f9e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.933944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76f853c-d68d-4a87-b288-eedd60aac37b tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.934506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76f853c-d68d-4a87-b288-eedd60aac37b tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.935206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76f853c-d68d-4a87-b288-eedd60aac37b tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:47.946646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76f853c-d68d-4a87-b288-eedd60aac37b tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:47.947374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76f853c-d68d-4a87-b288-eedd60aac37b tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:47.947888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76f853c-d68d-4a87-b288-eedd60aac37b tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:48.063740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-f76f853c-d68d-4a87-b288-eedd60aac37b tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lazy-loading 'flavor' on Instance uuid ce9f90a0-8efc-4043-a990-f6663196db72 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:29:48.096174 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f76f853c-d68d-4a87-b288-eedd60aac37b tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "PUT /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags/tempest-tag-2146286373" status: 201 len: 0 microversion: 2.26 time: 0.280953 Oct 04 21:29:48.096174 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2420/4810] 10.222.0.30 () {62 vars in 1380 bytes} [Tue Oct 4 21:29:47 2022] PUT /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags/tempest-tag-2146286373 => generated 0 bytes in 282 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 21:29:48.106458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a1431f40-1426-43b2-895a-e0d90170c703 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '.version_select at 0x7f578b8ffc10>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:48.130989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1431f40-1426-43b2-895a-e0d90170c703 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:48.130989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1431f40-1426-43b2-895a-e0d90170c703 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:48.130989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1431f40-1426-43b2-895a-e0d90170c703 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:48.130989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a1431f40-1426-43b2-895a-e0d90170c703 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:48.141115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1431f40-1426-43b2-895a-e0d90170c703 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:48.141717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1431f40-1426-43b2-895a-e0d90170c703 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:48.142164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1431f40-1426-43b2-895a-e0d90170c703 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:48.142877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1431f40-1426-43b2-895a-e0d90170c703 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:48.143461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1431f40-1426-43b2-895a-e0d90170c703 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:48.143906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1431f40-1426-43b2-895a-e0d90170c703 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:48.178532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1431f40-1426-43b2-895a-e0d90170c703 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:48.179030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1431f40-1426-43b2-895a-e0d90170c703 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:48.180465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1431f40-1426-43b2-895a-e0d90170c703 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:48.192154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1431f40-1426-43b2-895a-e0d90170c703 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:48.192942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1431f40-1426-43b2-895a-e0d90170c703 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:48.194799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1431f40-1426-43b2-895a-e0d90170c703 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:48.211361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=86,nova_cell1:SAVEPOINT=4,nova_cell1:INSERT=5,nova_cell1:RELEASE=3,nova_cell1:DELETE=1,nova_cell1:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:48.309944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-a1431f40-1426-43b2-895a-e0d90170c703 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lazy-loading 'flavor' on Instance uuid ce9f90a0-8efc-4043-a990-f6663196db72 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:29:48.354691 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a1431f40-1426-43b2-895a-e0d90170c703 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "PUT /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags/tempest-tag-1775367130" status: 201 len: 0 microversion: 2.26 time: 0.253098 Oct 04 21:29:48.356384 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2421/4811] 10.222.0.30 () {62 vars in 1380 bytes} [Tue Oct 4 21:29:48 2022] PUT /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags/tempest-tag-1775367130 => generated 0 bytes in 255 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 21:29:48.366546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3f6853ed-83be-4a9e-8b29-badaa663f2e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:48.368300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3f6853ed-83be-4a9e-8b29-badaa663f2e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 35db7403-53d9-4c74-8512-1bae943a086f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:48.379775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f6853ed-83be-4a9e-8b29-badaa663f2e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:48.381926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f6853ed-83be-4a9e-8b29-badaa663f2e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:48.381926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f6853ed-83be-4a9e-8b29-badaa663f2e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:48.383367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f6853ed-83be-4a9e-8b29-badaa663f2e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:48.384930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f6853ed-83be-4a9e-8b29-badaa663f2e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:48.385863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f6853ed-83be-4a9e-8b29-badaa663f2e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:48.406222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ebf12487-12c6-4437-a89a-b8eeab4d5f9e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:48.419342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ebf12487-12c6-4437-a89a-b8eeab4d5f9e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:48.421089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ebf12487-12c6-4437-a89a-b8eeab4d5f9e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:48.423202 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ebf12487-12c6-4437-a89a-b8eeab4d5f9e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.558305 Oct 04 21:29:48.424027 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2391/4812] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:47 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:48.428745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ec57ea3e-9691-4733-9ee5-b22c52dc6144 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:48.429522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ec57ea3e-9691-4733-9ee5-b22c52dc6144 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:48.435646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec57ea3e-9691-4733-9ee5-b22c52dc6144 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:48.436197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec57ea3e-9691-4733-9ee5-b22c52dc6144 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:48.436701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec57ea3e-9691-4733-9ee5-b22c52dc6144 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:48.437517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec57ea3e-9691-4733-9ee5-b22c52dc6144 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:48.438037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec57ea3e-9691-4733-9ee5-b22c52dc6144 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:48.438546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec57ea3e-9691-4733-9ee5-b22c52dc6144 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:48.905574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3f6853ed-83be-4a9e-8b29-badaa663f2e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:48.918301 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3f6853ed-83be-4a9e-8b29-badaa663f2e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f" status: 200 len: 1293 microversion: 2.1 time: 0.560326 Oct 04 21:29:48.918950 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2422/4813] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:48 2022] GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f => generated 1293 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:48.944409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0cf84c41-cca4-4b6e-a7e7-7a1bfa030dbf tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '.version_select at 0x7f578b7688b0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:48.964652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ec57ea3e-9691-4733-9ee5-b22c52dc6144 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:48.973599 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ec57ea3e-9691-4733-9ee5-b22c52dc6144 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 200 len: 1517 microversion: 2.1 time: 0.548193 Oct 04 21:29:48.974199 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2392/4814] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:48 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 1517 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:48.989507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cf84c41-cca4-4b6e-a7e7-7a1bfa030dbf tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:48.993948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cf84c41-cca4-4b6e-a7e7-7a1bfa030dbf tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:48.994987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cf84c41-cca4-4b6e-a7e7-7a1bfa030dbf tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:48.995630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0cf84c41-cca4-4b6e-a7e7-7a1bfa030dbf tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:49.003460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cf84c41-cca4-4b6e-a7e7-7a1bfa030dbf tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.003972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cf84c41-cca4-4b6e-a7e7-7a1bfa030dbf tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.004487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cf84c41-cca4-4b6e-a7e7-7a1bfa030dbf tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.005690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cf84c41-cca4-4b6e-a7e7-7a1bfa030dbf tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.008261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cf84c41-cca4-4b6e-a7e7-7a1bfa030dbf tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.008747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cf84c41-cca4-4b6e-a7e7-7a1bfa030dbf tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.015799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-63a2b266-543b-43ee-ab82-9c128ac63c91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:49.021497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-63a2b266-543b-43ee-ab82-9c128ac63c91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:49.031808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63a2b266-543b-43ee-ab82-9c128ac63c91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.032309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63a2b266-543b-43ee-ab82-9c128ac63c91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.032751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63a2b266-543b-43ee-ab82-9c128ac63c91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.033511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63a2b266-543b-43ee-ab82-9c128ac63c91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.033977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63a2b266-543b-43ee-ab82-9c128ac63c91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.034403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63a2b266-543b-43ee-ab82-9c128ac63c91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.052147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cf84c41-cca4-4b6e-a7e7-7a1bfa030dbf tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.052656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cf84c41-cca4-4b6e-a7e7-7a1bfa030dbf tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.053399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cf84c41-cca4-4b6e-a7e7-7a1bfa030dbf tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.139456 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-0cf84c41-cca4-4b6e-a7e7-7a1bfa030dbf tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lazy-loading 'flavor' on Instance uuid ce9f90a0-8efc-4043-a990-f6663196db72 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:29:49.163032 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0cf84c41-cca4-4b6e-a7e7-7a1bfa030dbf tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags" status: 204 len: 0 microversion: 2.26 time: 0.222661 Oct 04 21:29:49.167515 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2423/4815] 10.222.0.30 () {60 vars in 1295 bytes} [Tue Oct 4 21:29:48 2022] DELETE /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:29:49.174586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3c7a8d8b-a7cb-4d54-8e58-c2e61557a06d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '.version_select at 0x7f578b898790>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:49.183682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c7a8d8b-a7cb-4d54-8e58-c2e61557a06d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.184439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c7a8d8b-a7cb-4d54-8e58-c2e61557a06d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.184984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c7a8d8b-a7cb-4d54-8e58-c2e61557a06d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.196911 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3c7a8d8b-a7cb-4d54-8e58-c2e61557a06d tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags" status: 200 len: 12 microversion: 2.26 time: 0.028138 Oct 04 21:29:49.203282 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2424/4816] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Oct 4 21:29:49 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags => generated 12 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:49.209259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5d26b193-35e3-43d8-8e38-16f1229b00c4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '.version_select at 0x7f578b768430>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:49.237348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d26b193-35e3-43d8-8e38-16f1229b00c4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.241098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d26b193-35e3-43d8-8e38-16f1229b00c4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.241806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d26b193-35e3-43d8-8e38-16f1229b00c4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.242567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5d26b193-35e3-43d8-8e38-16f1229b00c4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:49.261255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d26b193-35e3-43d8-8e38-16f1229b00c4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.272031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d26b193-35e3-43d8-8e38-16f1229b00c4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.272504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d26b193-35e3-43d8-8e38-16f1229b00c4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.273852 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d26b193-35e3-43d8-8e38-16f1229b00c4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.273852 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d26b193-35e3-43d8-8e38-16f1229b00c4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.277225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d26b193-35e3-43d8-8e38-16f1229b00c4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.325841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d26b193-35e3-43d8-8e38-16f1229b00c4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.326344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d26b193-35e3-43d8-8e38-16f1229b00c4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.329840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d26b193-35e3-43d8-8e38-16f1229b00c4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.362145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-5d26b193-35e3-43d8-8e38-16f1229b00c4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lazy-loading 'flavor' on Instance uuid ce9f90a0-8efc-4043-a990-f6663196db72 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:29:49.380549 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5d26b193-35e3-43d8-8e38-16f1229b00c4 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags" status: 204 len: 0 microversion: 2.26 time: 0.175983 Oct 04 21:29:49.387121 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2425/4817] 10.222.0.30 () {60 vars in 1295 bytes} [Tue Oct 4 21:29:49 2022] DELETE /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:29:49.396183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ad77a746-2239-4503-9d21-553e422997f9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '.version_select at 0x7f578b8ff9d0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:49.410370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad77a746-2239-4503-9d21-553e422997f9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.413700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad77a746-2239-4503-9d21-553e422997f9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.413700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad77a746-2239-4503-9d21-553e422997f9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.413700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ad77a746-2239-4503-9d21-553e422997f9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:49.420789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad77a746-2239-4503-9d21-553e422997f9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.421340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad77a746-2239-4503-9d21-553e422997f9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.422287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad77a746-2239-4503-9d21-553e422997f9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.423570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad77a746-2239-4503-9d21-553e422997f9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.424052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad77a746-2239-4503-9d21-553e422997f9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.425327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad77a746-2239-4503-9d21-553e422997f9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.461746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad77a746-2239-4503-9d21-553e422997f9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.462539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad77a746-2239-4503-9d21-553e422997f9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.463148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad77a746-2239-4503-9d21-553e422997f9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.475886 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad77a746-2239-4503-9d21-553e422997f9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.476558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad77a746-2239-4503-9d21-553e422997f9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.477166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad77a746-2239-4503-9d21-553e422997f9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.480782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-63a2b266-543b-43ee-ab82-9c128ac63c91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:49.489486 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-63a2b266-543b-43ee-ab82-9c128ac63c91 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1512 microversion: 2.1 time: 0.492760 Oct 04 21:29:49.490083 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2393/4818] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:48 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1512 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:49.511499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d975772b-b1fe-47d4-91de-c0fea986005d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:49.512477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d975772b-b1fe-47d4-91de-c0fea986005d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:49.528379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d975772b-b1fe-47d4-91de-c0fea986005d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.528942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d975772b-b1fe-47d4-91de-c0fea986005d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.536199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d975772b-b1fe-47d4-91de-c0fea986005d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.537047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d975772b-b1fe-47d4-91de-c0fea986005d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.537569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d975772b-b1fe-47d4-91de-c0fea986005d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.538744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d975772b-b1fe-47d4-91de-c0fea986005d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.625490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-ad77a746-2239-4503-9d21-553e422997f9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lazy-loading 'flavor' on Instance uuid ce9f90a0-8efc-4043-a990-f6663196db72 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:29:49.711980 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ad77a746-2239-4503-9d21-553e422997f9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "PUT /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags/tempest-tag-1778126489" status: 201 len: 0 microversion: 2.26 time: 0.319047 Oct 04 21:29:49.718180 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2426/4819] 10.222.0.30 () {62 vars in 1380 bytes} [Tue Oct 4 21:29:49 2022] PUT /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags/tempest-tag-1778126489 => generated 0 bytes in 327 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 21:29:49.726559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d9d5965c-66fc-4ef6-b639-6b65f88896ff tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '.version_select at 0x7f578b898310>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:49.738008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9d5965c-66fc-4ef6-b639-6b65f88896ff tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.738628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9d5965c-66fc-4ef6-b639-6b65f88896ff tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.739706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9d5965c-66fc-4ef6-b639-6b65f88896ff tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.739706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d9d5965c-66fc-4ef6-b639-6b65f88896ff tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:49.748084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9d5965c-66fc-4ef6-b639-6b65f88896ff tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.748181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9d5965c-66fc-4ef6-b639-6b65f88896ff tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.748741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9d5965c-66fc-4ef6-b639-6b65f88896ff tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.750683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9d5965c-66fc-4ef6-b639-6b65f88896ff tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.750874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9d5965c-66fc-4ef6-b639-6b65f88896ff tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.752192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9d5965c-66fc-4ef6-b639-6b65f88896ff tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.820180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9d5965c-66fc-4ef6-b639-6b65f88896ff tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.820937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9d5965c-66fc-4ef6-b639-6b65f88896ff tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.821671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9d5965c-66fc-4ef6-b639-6b65f88896ff tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.834233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9d5965c-66fc-4ef6-b639-6b65f88896ff tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.836198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9d5965c-66fc-4ef6-b639-6b65f88896ff tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.836198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9d5965c-66fc-4ef6-b639-6b65f88896ff tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.872567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d975772b-b1fe-47d4-91de-c0fea986005d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:49.897193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d975772b-b1fe-47d4-91de-c0fea986005d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:49.898706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d975772b-b1fe-47d4-91de-c0fea986005d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:49.906155 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d975772b-b1fe-47d4-91de-c0fea986005d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.403737 Oct 04 21:29:49.908007 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2394/4820] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:49 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:49.961401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-d9d5965c-66fc-4ef6-b639-6b65f88896ff tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lazy-loading 'flavor' on Instance uuid ce9f90a0-8efc-4043-a990-f6663196db72 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:29:49.962633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4f6be48f-cee6-462f-9fec-0a9180962509 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:49.965642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4f6be48f-cee6-462f-9fec-0a9180962509 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 35db7403-53d9-4c74-8512-1bae943a086f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:49.986406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f6be48f-cee6-462f-9fec-0a9180962509 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.987009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f6be48f-cee6-462f-9fec-0a9180962509 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.987598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f6be48f-cee6-462f-9fec-0a9180962509 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.988321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f6be48f-cee6-462f-9fec-0a9180962509 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.991013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f6be48f-cee6-462f-9fec-0a9180962509 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.991745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f6be48f-cee6-462f-9fec-0a9180962509 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:50.004611 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d9d5965c-66fc-4ef6-b639-6b65f88896ff tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "PUT /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags/tempest-tag-601863488" status: 201 len: 0 microversion: 2.26 time: 0.283531 Oct 04 21:29:50.008488 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2427/4821] 10.222.0.30 () {62 vars in 1377 bytes} [Tue Oct 4 21:29:49 2022] PUT /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags/tempest-tag-601863488 => generated 0 bytes in 288 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 21:29:50.023508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-f8e3b934-70e0-4e33-a4e2-4d8c3defdab5 req-3e3d9a9f-f9cd-49a9-af62-d77ff8d0eaf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ec20b6-bf43-4824-b5a4-6e76eae9f564", "name": "network-vif-deleted", "tag": "ee4c4f8c-35f1-415c-9490-b28a659f9a08"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:50.048720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f8e3b934-70e0-4e33-a4e2-4d8c3defdab5 req-3e3d9a9f-f9cd-49a9-af62-d77ff8d0eaf2 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:50.049215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f8e3b934-70e0-4e33-a4e2-4d8c3defdab5 req-3e3d9a9f-f9cd-49a9-af62-d77ff8d0eaf2 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:50.049676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f8e3b934-70e0-4e33-a4e2-4d8c3defdab5 req-3e3d9a9f-f9cd-49a9-af62-d77ff8d0eaf2 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:50.081823 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-f8e3b934-70e0-4e33-a4e2-4d8c3defdab5 req-3e3d9a9f-f9cd-49a9-af62-d77ff8d0eaf2 service nova] Creating event network-vif-deleted:ee4c4f8c-35f1-415c-9490-b28a659f9a08 for instance 44ec20b6-bf43-4824-b5a4-6e76eae9f564 on n-h2-860282-1 Oct 04 21:29:50.131749 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-f8e3b934-70e0-4e33-a4e2-4d8c3defdab5 req-3e3d9a9f-f9cd-49a9-af62-d77ff8d0eaf2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119005 Oct 04 21:29:50.135804 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2428/4822] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:50.165481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7f495f57-2ae1-49c0-947b-c830f1fe70b5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:50.166269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7f495f57-2ae1-49c0-947b-c830f1fe70b5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:50.197099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f495f57-2ae1-49c0-947b-c830f1fe70b5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:50.203244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f495f57-2ae1-49c0-947b-c830f1fe70b5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:50.206108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f495f57-2ae1-49c0-947b-c830f1fe70b5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:50.206901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f495f57-2ae1-49c0-947b-c830f1fe70b5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:50.207389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f495f57-2ae1-49c0-947b-c830f1fe70b5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:50.211717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f495f57-2ae1-49c0-947b-c830f1fe70b5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:50.379656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7f495f57-2ae1-49c0-947b-c830f1fe70b5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:50.424627 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7f495f57-2ae1-49c0-947b-c830f1fe70b5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 200 len: 1305 microversion: 2.1 time: 0.281957 Oct 04 21:29:50.426753 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2429/4823] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:50 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 1305 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:50.431288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4f6be48f-cee6-462f-9fec-0a9180962509 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:50.438693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0d74e67d-54cd-46c8-ab6d-ab017a21baf9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Action: 'update_all', calling method: .version_select at 0x7f578b6a8790>, body: {"tags": ["tempest-tag-974690568", "tempest-tag-1397402709"]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:50.449133 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4f6be48f-cee6-462f-9fec-0a9180962509 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f" status: 200 len: 1293 microversion: 2.1 time: 0.506187 Oct 04 21:29:50.459064 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2395/4824] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:49 2022] GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f => generated 1293 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:29:50.468292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d74e67d-54cd-46c8-ab6d-ab017a21baf9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:50.470660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d74e67d-54cd-46c8-ab6d-ab017a21baf9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:50.472788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d74e67d-54cd-46c8-ab6d-ab017a21baf9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:50.474067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0d74e67d-54cd-46c8-ab6d-ab017a21baf9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:50.494377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d74e67d-54cd-46c8-ab6d-ab017a21baf9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:50.497121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d74e67d-54cd-46c8-ab6d-ab017a21baf9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:50.498123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d74e67d-54cd-46c8-ab6d-ab017a21baf9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:50.499146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d74e67d-54cd-46c8-ab6d-ab017a21baf9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:50.502716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d74e67d-54cd-46c8-ab6d-ab017a21baf9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:50.505484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d74e67d-54cd-46c8-ab6d-ab017a21baf9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:50.517800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f72a2511-1773-4dc2-981d-896af731ef02 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:50.518505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f72a2511-1773-4dc2-981d-896af731ef02 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:50.527608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f72a2511-1773-4dc2-981d-896af731ef02 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:50.528030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f72a2511-1773-4dc2-981d-896af731ef02 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:50.528471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f72a2511-1773-4dc2-981d-896af731ef02 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:50.534153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f72a2511-1773-4dc2-981d-896af731ef02 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:50.534794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f72a2511-1773-4dc2-981d-896af731ef02 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:50.535254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f72a2511-1773-4dc2-981d-896af731ef02 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:50.585550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d74e67d-54cd-46c8-ab6d-ab017a21baf9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:50.586461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d74e67d-54cd-46c8-ab6d-ab017a21baf9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:50.590255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d74e67d-54cd-46c8-ab6d-ab017a21baf9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:50.709405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-0d74e67d-54cd-46c8-ab6d-ab017a21baf9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lazy-loading 'flavor' on Instance uuid ce9f90a0-8efc-4043-a990-f6663196db72 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:29:50.766202 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0d74e67d-54cd-46c8-ab6d-ab017a21baf9 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "PUT /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags" status: 200 len: 61 microversion: 2.26 time: 0.335885 Oct 04 21:29:50.767252 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2430/4825] 10.222.0.30 () {62 vars in 1312 bytes} [Tue Oct 4 21:29:50 2022] PUT /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags => generated 61 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:50.780370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-40ecf5a4-e4d3-4bd4-b316-6ab37ff569f7 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '.version_select at 0x7f578b730280>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:50.792981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40ecf5a4-e4d3-4bd4-b316-6ab37ff569f7 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:50.792981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40ecf5a4-e4d3-4bd4-b316-6ab37ff569f7 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:50.793732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40ecf5a4-e4d3-4bd4-b316-6ab37ff569f7 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:50.805471 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-40ecf5a4-e4d3-4bd4-b316-6ab37ff569f7 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags" status: 200 len: 61 microversion: 2.26 time: 0.029013 Oct 04 21:29:50.812725 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2431/4826] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Oct 4 21:29:50 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags => generated 61 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:50.819839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b83749d4-f02f-4158-8bee-9668fea1bb54 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '.version_select at 0x7f578b77b550>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:50.841030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b83749d4-f02f-4158-8bee-9668fea1bb54 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:50.853543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b83749d4-f02f-4158-8bee-9668fea1bb54 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:50.853543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b83749d4-f02f-4158-8bee-9668fea1bb54 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:50.853543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b83749d4-f02f-4158-8bee-9668fea1bb54 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:50.860159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b83749d4-f02f-4158-8bee-9668fea1bb54 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:50.860159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b83749d4-f02f-4158-8bee-9668fea1bb54 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:50.860159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b83749d4-f02f-4158-8bee-9668fea1bb54 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:50.862829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b83749d4-f02f-4158-8bee-9668fea1bb54 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:50.863329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b83749d4-f02f-4158-8bee-9668fea1bb54 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:50.863788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b83749d4-f02f-4158-8bee-9668fea1bb54 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:50.891936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b83749d4-f02f-4158-8bee-9668fea1bb54 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:50.893444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b83749d4-f02f-4158-8bee-9668fea1bb54 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:50.893444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b83749d4-f02f-4158-8bee-9668fea1bb54 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:51.017666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-b83749d4-f02f-4158-8bee-9668fea1bb54 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lazy-loading 'flavor' on Instance uuid ce9f90a0-8efc-4043-a990-f6663196db72 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:29:51.060698 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b83749d4-f02f-4158-8bee-9668fea1bb54 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags" status: 204 len: 0 microversion: 2.26 time: 0.246214 Oct 04 21:29:51.062862 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2432/4827] 10.222.0.30 () {60 vars in 1295 bytes} [Tue Oct 4 21:29:50 2022] DELETE /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72/tags => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:29:51.068775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c94fb401-0a82-4adc-b375-3ef7a5c1397c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:51.069829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c94fb401-0a82-4adc-b375-3ef7a5c1397c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:51.092381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c94fb401-0a82-4adc-b375-3ef7a5c1397c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:51.095645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c94fb401-0a82-4adc-b375-3ef7a5c1397c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:51.096373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c94fb401-0a82-4adc-b375-3ef7a5c1397c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:51.103488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c94fb401-0a82-4adc-b375-3ef7a5c1397c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:51.105872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c94fb401-0a82-4adc-b375-3ef7a5c1397c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:51.107096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c94fb401-0a82-4adc-b375-3ef7a5c1397c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:51.164603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:RELEASE=3,nova_cell1:SELECT=88,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:51.287103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f72a2511-1773-4dc2-981d-896af731ef02 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:51.298396 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f72a2511-1773-4dc2-981d-896af731ef02 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1512 microversion: 2.1 time: 0.785796 Oct 04 21:29:51.313789 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2396/4828] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:50 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1512 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:51.318938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fa407f56-a054-4bd0-925a-5c7a70524261 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:51.326185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fa407f56-a054-4bd0-925a-5c7a70524261 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:51.351647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa407f56-a054-4bd0-925a-5c7a70524261 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:51.352445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa407f56-a054-4bd0-925a-5c7a70524261 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:51.353369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa407f56-a054-4bd0-925a-5c7a70524261 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:51.354117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa407f56-a054-4bd0-925a-5c7a70524261 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:51.354770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa407f56-a054-4bd0-925a-5c7a70524261 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:51.355359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa407f56-a054-4bd0-925a-5c7a70524261 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:51.426791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fa407f56-a054-4bd0-925a-5c7a70524261 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:29:51.634321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=10 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:51.855957 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fa407f56-a054-4bd0-925a-5c7a70524261 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72" status: 204 len: 0 microversion: 2.26 time: 0.540426 Oct 04 21:29:51.857392 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2397/4829] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:29:51 2022] DELETE /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:29:51.864430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8dd4bf64-c9b4-4878-9655-a15ca07b5041 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:51.882805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8dd4bf64-c9b4-4878-9655-a15ca07b5041 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:51.922111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dd4bf64-c9b4-4878-9655-a15ca07b5041 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:51.924594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dd4bf64-c9b4-4878-9655-a15ca07b5041 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:51.925545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dd4bf64-c9b4-4878-9655-a15ca07b5041 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:51.928955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dd4bf64-c9b4-4878-9655-a15ca07b5041 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:51.931940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dd4bf64-c9b4-4878-9655-a15ca07b5041 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:51.932466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dd4bf64-c9b4-4878-9655-a15ca07b5041 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:51.948524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:DELETE=2,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:52.031808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dd4bf64-c9b4-4878-9655-a15ca07b5041 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:52.032273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dd4bf64-c9b4-4878-9655-a15ca07b5041 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:52.034922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dd4bf64-c9b4-4878-9655-a15ca07b5041 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:52.035426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-8dd4bf64-c9b4-4878-9655-a15ca07b5041 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lazy-loading 'fault' on Instance uuid 44ec20b6-bf43-4824-b5a4-6e76eae9f564 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:29:52.125701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c94fb401-0a82-4adc-b375-3ef7a5c1397c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:52.166719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c94fb401-0a82-4adc-b375-3ef7a5c1397c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:52.168856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c94fb401-0a82-4adc-b375-3ef7a5c1397c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:52.170557 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c94fb401-0a82-4adc-b375-3ef7a5c1397c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 1.106579 Oct 04 21:29:52.190451 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2433/4830] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:51 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:52.200546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5c234c9c-95b2-4c46-889b-629919a8fb4b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:52.201524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5c234c9c-95b2-4c46-889b-629919a8fb4b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 35db7403-53d9-4c74-8512-1bae943a086f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:52.209976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c234c9c-95b2-4c46-889b-629919a8fb4b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:52.210676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c234c9c-95b2-4c46-889b-629919a8fb4b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:52.211584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c234c9c-95b2-4c46-889b-629919a8fb4b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:52.212950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c234c9c-95b2-4c46-889b-629919a8fb4b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:52.213909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c234c9c-95b2-4c46-889b-629919a8fb4b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:52.214571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c234c9c-95b2-4c46-889b-629919a8fb4b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:52.755351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8dd4bf64-c9b4-4878-9655-a15ca07b5041 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:52.767467 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8dd4bf64-c9b4-4878-9655-a15ca07b5041 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 200 len: 1310 microversion: 2.1 time: 0.908213 Oct 04 21:29:52.768267 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2398/4831] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:51 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 1310 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:52.786012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-62e63149-6cb7-4af7-8dac-84bfbb676d40 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:52.787418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-62e63149-6cb7-4af7-8dac-84bfbb676d40 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:52.815966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62e63149-6cb7-4af7-8dac-84bfbb676d40 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:52.818851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62e63149-6cb7-4af7-8dac-84bfbb676d40 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:52.819378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62e63149-6cb7-4af7-8dac-84bfbb676d40 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:52.832242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62e63149-6cb7-4af7-8dac-84bfbb676d40 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:52.840880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62e63149-6cb7-4af7-8dac-84bfbb676d40 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:52.840880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62e63149-6cb7-4af7-8dac-84bfbb676d40 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:53.112568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5c234c9c-95b2-4c46-889b-629919a8fb4b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:53.128219 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5c234c9c-95b2-4c46-889b-629919a8fb4b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f" status: 200 len: 1293 microversion: 2.1 time: 0.936053 Oct 04 21:29:53.129116 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2434/4832] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:52 2022] GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f => generated 1293 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:53.137139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e5ca7bfb-0428-40ed-982e-59ae25cb1bfd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:53.140535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e5ca7bfb-0428-40ed-982e-59ae25cb1bfd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:53.157224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5ca7bfb-0428-40ed-982e-59ae25cb1bfd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:53.158102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5ca7bfb-0428-40ed-982e-59ae25cb1bfd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:53.158551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5ca7bfb-0428-40ed-982e-59ae25cb1bfd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:53.159274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5ca7bfb-0428-40ed-982e-59ae25cb1bfd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:53.159725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5ca7bfb-0428-40ed-982e-59ae25cb1bfd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:53.162008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5ca7bfb-0428-40ed-982e-59ae25cb1bfd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:53.506441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-62e63149-6cb7-4af7-8dac-84bfbb676d40 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:53.516898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-62e63149-6cb7-4af7-8dac-84bfbb676d40 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:53.518399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-62e63149-6cb7-4af7-8dac-84bfbb676d40 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:53.519703 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-62e63149-6cb7-4af7-8dac-84bfbb676d40 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72" status: 200 len: 1552 microversion: 2.26 time: 0.748842 Oct 04 21:29:53.529228 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2399/4833] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:52 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72 => generated 1552 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:53.549362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-67cab94f-6359-436e-987f-9c747f4bfd02 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:53.550278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-67cab94f-6359-436e-987f-9c747f4bfd02 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:53.558044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67cab94f-6359-436e-987f-9c747f4bfd02 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:53.558864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67cab94f-6359-436e-987f-9c747f4bfd02 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:53.559481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67cab94f-6359-436e-987f-9c747f4bfd02 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:53.560423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67cab94f-6359-436e-987f-9c747f4bfd02 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:53.564082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67cab94f-6359-436e-987f-9c747f4bfd02 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:53.568904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67cab94f-6359-436e-987f-9c747f4bfd02 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:53.971350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e5ca7bfb-0428-40ed-982e-59ae25cb1bfd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:53.979887 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e5ca7bfb-0428-40ed-982e-59ae25cb1bfd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1512 microversion: 2.1 time: 0.849524 Oct 04 21:29:53.982140 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2435/4834] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:53 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1512 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:53.997630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d95ded2b-77e8-4374-8b6c-22ba9e70ba1e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:53.998572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d95ded2b-77e8-4374-8b6c-22ba9e70ba1e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 44ec20b6-bf43-4824-b5a4-6e76eae9f564] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:54.010686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d95ded2b-77e8-4374-8b6c-22ba9e70ba1e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:54.014595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d95ded2b-77e8-4374-8b6c-22ba9e70ba1e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:54.015976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d95ded2b-77e8-4374-8b6c-22ba9e70ba1e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:54.016952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d95ded2b-77e8-4374-8b6c-22ba9e70ba1e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:54.017688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d95ded2b-77e8-4374-8b6c-22ba9e70ba1e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:54.021795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d95ded2b-77e8-4374-8b6c-22ba9e70ba1e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:54.083750 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-d95ded2b-77e8-4374-8b6c-22ba9e70ba1e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] HTTP exception thrown: Instance 44ec20b6-bf43-4824-b5a4-6e76eae9f564 could not be found. Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d95ded2b-77e8-4374-8b6c-22ba9e70ba1e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Request method failure captured: Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 HTTP/1.1 Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKVzN2QN1VdZBD95-EI-DUk2t7amwzDKij18KilE0o7X9TszcumC1SzME1RGdD0VR6ZHWrWtJOD9l505jwaOV_GgKCDAAauxKA-AsjXqYS22WTiMb7zyQeBJxldUDZiAXBYE8Dk-B-M-hV2qNvj_cHi-fxbvupVGITxqLAHAfkMemIY Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f315fab8318a4c9f84f0b39ce233ee57 Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ListServerFiltersTestJSON-439877241 Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f315fab8318a4c9f84f0b39ce233ee57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f315fab8318a4c9f84f0b39ce233ee57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f315fab8318a4c9f84f0b39ce233ee57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f315fab8318a4c9f84f0b39ce233ee57"}]}] Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ListServerFiltersTestJSON-439877241 Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f315fab8318a4c9f84f0b39ce233ee57 Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-439877241 Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ListServerFiltersTestJSON-439877241-project Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: de17081946dc4da8864f5338123b6ed1 Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ListServerFiltersTestJSON-439877241-project Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 44ec20b6-bf43-4824-b5a4-6e76eae9f564 could not be found. Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '44ec20b6-bf43-4824-b5a4-6e76eae9f564'} Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44ec20b6-bf43-4824-b5a4-6e76eae9f564 could not be found. Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44ec20b6-bf43-4824-b5a4-6e76eae9f564 could not be found. Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:54.092055 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:54.096975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:54.096975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:54.096975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:54.096975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:54.096975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:54.096975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44ec20b6-bf43-4824-b5a4-6e76eae9f564 could not be found. Oct 04 21:29:54.096975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:54.096975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d95ded2b-77e8-4374-8b6c-22ba9e70ba1e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Returning 404 to user: Instance 44ec20b6-bf43-4824-b5a4-6e76eae9f564 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:54.096975 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d95ded2b-77e8-4374-8b6c-22ba9e70ba1e tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564" status: 404 len: 111 microversion: 2.1 time: 0.113196 Oct 04 21:29:54.105176 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2436/4835] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:53 2022] GET /compute/v2.1/servers/44ec20b6-bf43-4824-b5a4-6e76eae9f564 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:29:54.120454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f215267d-f4ca-446d-947a-19a83cb8b3d0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:54.120454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f215267d-f4ca-446d-947a-19a83cb8b3d0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: db85fc78-9a76-401a-89fc-c92d828ae8d4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:54.137900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f215267d-f4ca-446d-947a-19a83cb8b3d0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:54.142282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f215267d-f4ca-446d-947a-19a83cb8b3d0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:54.157734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f215267d-f4ca-446d-947a-19a83cb8b3d0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:54.157734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f215267d-f4ca-446d-947a-19a83cb8b3d0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:54.157734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f215267d-f4ca-446d-947a-19a83cb8b3d0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:54.157734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f215267d-f4ca-446d-947a-19a83cb8b3d0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:54.213277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f215267d-f4ca-446d-947a-19a83cb8b3d0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: db85fc78-9a76-401a-89fc-c92d828ae8d4] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:29:54.301485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67cab94f-6359-436e-987f-9c747f4bfd02 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:54.319620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67cab94f-6359-436e-987f-9c747f4bfd02 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:54.324596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67cab94f-6359-436e-987f-9c747f4bfd02 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:54.326704 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-67cab94f-6359-436e-987f-9c747f4bfd02 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.796088 Oct 04 21:29:54.328032 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2400/4836] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:53 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:54.344027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0f5bd57c-98c1-4419-b15d-3e33a71bf09e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:54.344640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0f5bd57c-98c1-4419-b15d-3e33a71bf09e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 35db7403-53d9-4c74-8512-1bae943a086f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:54.357525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f5bd57c-98c1-4419-b15d-3e33a71bf09e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:54.357807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f5bd57c-98c1-4419-b15d-3e33a71bf09e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:54.358400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f5bd57c-98c1-4419-b15d-3e33a71bf09e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:54.358988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f5bd57c-98c1-4419-b15d-3e33a71bf09e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:54.359442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f5bd57c-98c1-4419-b15d-3e33a71bf09e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:54.359862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f5bd57c-98c1-4419-b15d-3e33a71bf09e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:54.659615 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f215267d-f4ca-446d-947a-19a83cb8b3d0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "DELETE /compute/v2.1/servers/db85fc78-9a76-401a-89fc-c92d828ae8d4" status: 204 len: 0 microversion: 2.1 time: 0.551412 Oct 04 21:29:54.664802 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2437/4837] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:29:54 2022] DELETE /compute/v2.1/servers/db85fc78-9a76-401a-89fc-c92d828ae8d4 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:29:54.679548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3ea6cab2-14ff-43cf-9ee0-0256b7777851 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:54.681253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3ea6cab2-14ff-43cf-9ee0-0256b7777851 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:54.700307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ea6cab2-14ff-43cf-9ee0-0256b7777851 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:54.701220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ea6cab2-14ff-43cf-9ee0-0256b7777851 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:54.704504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ea6cab2-14ff-43cf-9ee0-0256b7777851 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:54.705589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ea6cab2-14ff-43cf-9ee0-0256b7777851 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:54.706313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ea6cab2-14ff-43cf-9ee0-0256b7777851 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:54.710712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ea6cab2-14ff-43cf-9ee0-0256b7777851 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:54.781730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0f5bd57c-98c1-4419-b15d-3e33a71bf09e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:54.793670 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0f5bd57c-98c1-4419-b15d-3e33a71bf09e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f" status: 200 len: 1293 microversion: 2.1 time: 0.451681 Oct 04 21:29:54.795057 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2401/4838] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:54 2022] GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f => generated 1293 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:54.801328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b05743f6-e500-4467-87c7-b594c8d833c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:54.802009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b05743f6-e500-4467-87c7-b594c8d833c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: db85fc78-9a76-401a-89fc-c92d828ae8d4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:54.805044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:54.808766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b05743f6-e500-4467-87c7-b594c8d833c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:54.809256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b05743f6-e500-4467-87c7-b594c8d833c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:54.813893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b05743f6-e500-4467-87c7-b594c8d833c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:54.818690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b05743f6-e500-4467-87c7-b594c8d833c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:54.819489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b05743f6-e500-4467-87c7-b594c8d833c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:54.820345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b05743f6-e500-4467-87c7-b594c8d833c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:54.866928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3ea6cab2-14ff-43cf-9ee0-0256b7777851 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:54.882142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3ea6cab2-14ff-43cf-9ee0-0256b7777851 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:54.887083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3ea6cab2-14ff-43cf-9ee0-0256b7777851 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:54.892833 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3ea6cab2-14ff-43cf-9ee0-0256b7777851 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72" status: 200 len: 1510 microversion: 2.26 time: 0.227756 Oct 04 21:29:54.906681 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2438/4839] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:54 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72 => generated 1510 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:54.920637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-f09b94dd-14d1-4674-a9ae-7cf9d23d704f req-718cec7f-eef8-4e55-ae0a-1fcc8e2adcf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9f90a0-8efc-4043-a990-f6663196db72", "name": "network-vif-deleted", "tag": "d1666e7e-ec76-4b74-9ed9-96bfa3bedf25"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:54.932131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f09b94dd-14d1-4674-a9ae-7cf9d23d704f req-718cec7f-eef8-4e55-ae0a-1fcc8e2adcf2 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:54.932627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f09b94dd-14d1-4674-a9ae-7cf9d23d704f req-718cec7f-eef8-4e55-ae0a-1fcc8e2adcf2 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:54.933065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f09b94dd-14d1-4674-a9ae-7cf9d23d704f req-718cec7f-eef8-4e55-ae0a-1fcc8e2adcf2 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:54.964542 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-f09b94dd-14d1-4674-a9ae-7cf9d23d704f req-718cec7f-eef8-4e55-ae0a-1fcc8e2adcf2 service nova] Creating event network-vif-deleted:d1666e7e-ec76-4b74-9ed9-96bfa3bedf25 for instance ce9f90a0-8efc-4043-a990-f6663196db72 on n-h1-860282-1 Oct 04 21:29:54.991236 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-f09b94dd-14d1-4674-a9ae-7cf9d23d704f req-718cec7f-eef8-4e55-ae0a-1fcc8e2adcf2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081343 Oct 04 21:29:54.993805 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2439/4840] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:55.012272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e9b603be-9a51-4592-a4eb-5e4816948865 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:55.012992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e9b603be-9a51-4592-a4eb-5e4816948865 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:55.054710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9b603be-9a51-4592-a4eb-5e4816948865 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:55.055433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9b603be-9a51-4592-a4eb-5e4816948865 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:55.057244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9b603be-9a51-4592-a4eb-5e4816948865 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:55.059459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9b603be-9a51-4592-a4eb-5e4816948865 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:55.061055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9b603be-9a51-4592-a4eb-5e4816948865 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:55.062713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e9b603be-9a51-4592-a4eb-5e4816948865 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:55.208332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:55.352973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b05743f6-e500-4467-87c7-b594c8d833c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:55.361245 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b05743f6-e500-4467-87c7-b594c8d833c9 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/db85fc78-9a76-401a-89fc-c92d828ae8d4" status: 200 len: 1516 microversion: 2.1 time: 0.564046 Oct 04 21:29:55.362224 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2402/4841] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:54 2022] GET /compute/v2.1/servers/db85fc78-9a76-401a-89fc-c92d828ae8d4 => generated 1516 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:55.366705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-b0ace87a-27dc-49fc-9d08-d11c3f2baa9f req-2fbc8515-c3ac-486e-a37d-d6b326b2a5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35db7403-53d9-4c74-8512-1bae943a086f", "name": "network-vif-plugged", "status": "completed", "tag": "c4f8b3f0-6dc7-45b6-95d6-2ac1592501bc"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:55.377340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b0ace87a-27dc-49fc-9d08-d11c3f2baa9f req-2fbc8515-c3ac-486e-a37d-d6b326b2a5f1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:55.377979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b0ace87a-27dc-49fc-9d08-d11c3f2baa9f req-2fbc8515-c3ac-486e-a37d-d6b326b2a5f1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:55.378266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b0ace87a-27dc-49fc-9d08-d11c3f2baa9f req-2fbc8515-c3ac-486e-a37d-d6b326b2a5f1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:55.400187 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-b0ace87a-27dc-49fc-9d08-d11c3f2baa9f req-2fbc8515-c3ac-486e-a37d-d6b326b2a5f1 service nova] Creating event network-vif-plugged:c4f8b3f0-6dc7-45b6-95d6-2ac1592501bc for instance 35db7403-53d9-4c74-8512-1bae943a086f on n-h1-860282-1 Oct 04 21:29:55.409206 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-b0ace87a-27dc-49fc-9d08-d11c3f2baa9f req-2fbc8515-c3ac-486e-a37d-d6b326b2a5f1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045588 Oct 04 21:29:55.410376 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2403/4842] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:55.422474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fc0f8280-fbf7-4800-84b4-5f383a665604 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:55.423633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fc0f8280-fbf7-4800-84b4-5f383a665604 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:55.433747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc0f8280-fbf7-4800-84b4-5f383a665604 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:55.434534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc0f8280-fbf7-4800-84b4-5f383a665604 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:55.435895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc0f8280-fbf7-4800-84b4-5f383a665604 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:55.438887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc0f8280-fbf7-4800-84b4-5f383a665604 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:55.439733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc0f8280-fbf7-4800-84b4-5f383a665604 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:55.440372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc0f8280-fbf7-4800-84b4-5f383a665604 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:55.490876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e9b603be-9a51-4592-a4eb-5e4816948865 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:55.517058 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e9b603be-9a51-4592-a4eb-5e4816948865 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1533 microversion: 2.1 time: 0.494333 Oct 04 21:29:55.517058 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2440/4843] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:55 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1533 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:29:55.827558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9f1a3a8c-4225-4583-a3c0-a58b0b256ff0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:55.842353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9f1a3a8c-4225-4583-a3c0-a58b0b256ff0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 35db7403-53d9-4c74-8512-1bae943a086f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:55.852219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f1a3a8c-4225-4583-a3c0-a58b0b256ff0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:55.853128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f1a3a8c-4225-4583-a3c0-a58b0b256ff0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:55.854184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f1a3a8c-4225-4583-a3c0-a58b0b256ff0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:55.854991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f1a3a8c-4225-4583-a3c0-a58b0b256ff0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:55.855508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f1a3a8c-4225-4583-a3c0-a58b0b256ff0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:55.856007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f1a3a8c-4225-4583-a3c0-a58b0b256ff0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:55.885119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=10 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:56.078825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fc0f8280-fbf7-4800-84b4-5f383a665604 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:56.102871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fc0f8280-fbf7-4800-84b4-5f383a665604 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:56.106153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fc0f8280-fbf7-4800-84b4-5f383a665604 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:56.107351 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fc0f8280-fbf7-4800-84b4-5f383a665604 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.694568 Oct 04 21:29:56.107927 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2404/4844] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:55 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:56.113982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4764be89-2944-4faa-bbdf-f1c163d9b1be tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:56.114941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4764be89-2944-4faa-bbdf-f1c163d9b1be tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:56.121053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4764be89-2944-4faa-bbdf-f1c163d9b1be tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:56.122746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4764be89-2944-4faa-bbdf-f1c163d9b1be tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:56.123397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4764be89-2944-4faa-bbdf-f1c163d9b1be tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:56.124722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4764be89-2944-4faa-bbdf-f1c163d9b1be tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:56.125360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4764be89-2944-4faa-bbdf-f1c163d9b1be tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:56.126084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4764be89-2944-4faa-bbdf-f1c163d9b1be tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:56.166175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4764be89-2944-4faa-bbdf-f1c163d9b1be tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:56.167065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4764be89-2944-4faa-bbdf-f1c163d9b1be tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:56.167898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4764be89-2944-4faa-bbdf-f1c163d9b1be tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:56.168569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-4764be89-2944-4faa-bbdf-f1c163d9b1be tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lazy-loading 'fault' on Instance uuid ce9f90a0-8efc-4043-a990-f6663196db72 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:29:56.251285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4764be89-2944-4faa-bbdf-f1c163d9b1be tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:56.260037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9f1a3a8c-4225-4583-a3c0-a58b0b256ff0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:56.262758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4764be89-2944-4faa-bbdf-f1c163d9b1be tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:56.264393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4764be89-2944-4faa-bbdf-f1c163d9b1be tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cce53afc8b3e4755b990518ff2304275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5b73e007104ebda49ce621d7b83868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:56.265621 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4764be89-2944-4faa-bbdf-f1c163d9b1be tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72" status: 200 len: 1352 microversion: 2.26 time: 0.155760 Oct 04 21:29:56.266187 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2405/4845] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:56 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72 => generated 1352 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:56.269338 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9f1a3a8c-4225-4583-a3c0-a58b0b256ff0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f" status: 200 len: 1293 microversion: 2.1 time: 0.450765 Oct 04 21:29:56.273488 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2441/4846] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:55 2022] GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f => generated 1293 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:29:56.394671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6f921e2d-25d9-4730-b1ef-c0f16ff19d54 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:56.395968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6f921e2d-25d9-4730-b1ef-c0f16ff19d54 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: db85fc78-9a76-401a-89fc-c92d828ae8d4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:56.407360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f921e2d-25d9-4730-b1ef-c0f16ff19d54 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:56.417318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f921e2d-25d9-4730-b1ef-c0f16ff19d54 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:56.417318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f921e2d-25d9-4730-b1ef-c0f16ff19d54 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:56.417318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f921e2d-25d9-4730-b1ef-c0f16ff19d54 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:56.417318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f921e2d-25d9-4730-b1ef-c0f16ff19d54 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:56.417318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f921e2d-25d9-4730-b1ef-c0f16ff19d54 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:56.530049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-882e2d15-2ee7-465d-bf83-55f3704ee122 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:56.531346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-882e2d15-2ee7-465d-bf83-55f3704ee122 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:56.543178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-882e2d15-2ee7-465d-bf83-55f3704ee122 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:56.544097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-882e2d15-2ee7-465d-bf83-55f3704ee122 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:56.545647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-882e2d15-2ee7-465d-bf83-55f3704ee122 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:56.546626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-882e2d15-2ee7-465d-bf83-55f3704ee122 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:56.547288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-882e2d15-2ee7-465d-bf83-55f3704ee122 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:56.547891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-882e2d15-2ee7-465d-bf83-55f3704ee122 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:56.792211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6f921e2d-25d9-4730-b1ef-c0f16ff19d54 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:56.802590 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6f921e2d-25d9-4730-b1ef-c0f16ff19d54 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/db85fc78-9a76-401a-89fc-c92d828ae8d4" status: 200 len: 1516 microversion: 2.1 time: 0.413304 Oct 04 21:29:56.805618 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2406/4847] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:56 2022] GET /compute/v2.1/servers/db85fc78-9a76-401a-89fc-c92d828ae8d4 => generated 1516 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:56.879577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-882e2d15-2ee7-465d-bf83-55f3704ee122 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:56.889248 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-882e2d15-2ee7-465d-bf83-55f3704ee122 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1533 microversion: 2.1 time: 0.362993 Oct 04 21:29:56.906667 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2442/4848] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:56 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1533 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:57.137772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1ccc6f65-f944-4dcc-9a39-611bca03a73d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:57.138365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1ccc6f65-f944-4dcc-9a39-611bca03a73d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:57.154611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ccc6f65-f944-4dcc-9a39-611bca03a73d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:57.156277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ccc6f65-f944-4dcc-9a39-611bca03a73d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:57.157193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ccc6f65-f944-4dcc-9a39-611bca03a73d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:57.157875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ccc6f65-f944-4dcc-9a39-611bca03a73d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:57.158532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ccc6f65-f944-4dcc-9a39-611bca03a73d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:57.159136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ccc6f65-f944-4dcc-9a39-611bca03a73d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:57.294021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a3a96f95-1c22-434d-805f-c35ee2fa3f00 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:57.294622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a3a96f95-1c22-434d-805f-c35ee2fa3f00 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] [instance: ce9f90a0-8efc-4043-a990-f6663196db72] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:57.302779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3a96f95-1c22-434d-805f-c35ee2fa3f00 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:57.303272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3a96f95-1c22-434d-805f-c35ee2fa3f00 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:57.303911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3a96f95-1c22-434d-805f-c35ee2fa3f00 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:57.304915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3a96f95-1c22-434d-805f-c35ee2fa3f00 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:57.305379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3a96f95-1c22-434d-805f-c35ee2fa3f00 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:57.306535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3a96f95-1c22-434d-805f-c35ee2fa3f00 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:57.323665 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-a3a96f95-1c22-434d-805f-c35ee2fa3f00 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] HTTP exception thrown: Instance ce9f90a0-8efc-4043-a990-f6663196db72 could not be found. Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a3a96f95-1c22-434d-805f-c35ee2fa3f00 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Request method failure captured: Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72 HTTP/1.1 Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKWw_tghdTVbdf2WVa_v56RjeronfNfRZzhg6cFNX-hnDp3NI_uKJxlZte2RKSHB2zXvjjVMjtP3J4E7biK4Kc3IYz2q10ZPIrD94y4timLgs1mQlbPuCPquR3OWQhZ2c6TG9s-jng4VZklPalxPcxCzt4jNxeWWbR3Xr0mUGZ72pao Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.26 Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 4c5b73e007104ebda49ce621d7b83868 Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerTagsTestJSON-904876074 Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4c5b73e007104ebda49ce621d7b83868"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4c5b73e007104ebda49ce621d7b83868"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4c5b73e007104ebda49ce621d7b83868"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4c5b73e007104ebda49ce621d7b83868"}]}] Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerTagsTestJSON-904876074 Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 4c5b73e007104ebda49ce621d7b83868 Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerTagsTestJSON-904876074 Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerTagsTestJSON-904876074-project Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: cce53afc8b3e4755b990518ff2304275 Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerTagsTestJSON-904876074-project Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance ce9f90a0-8efc-4043-a990-f6663196db72 could not be found. Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'ce9f90a0-8efc-4043-a990-f6663196db72'} Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce9f90a0-8efc-4043-a990-f6663196db72 could not be found. Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce9f90a0-8efc-4043-a990-f6663196db72 could not be found. Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:57.325351 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:57.333340 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:57.333340 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:57.333340 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:57.333340 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:57.333340 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:57.333340 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce9f90a0-8efc-4043-a990-f6663196db72 could not be found. Oct 04 21:29:57.333340 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:29:57.333340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a3a96f95-1c22-434d-805f-c35ee2fa3f00 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] Returning 404 to user: Instance ce9f90a0-8efc-4043-a990-f6663196db72 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:57.333340 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a3a96f95-1c22-434d-805f-c35ee2fa3f00 tempest-ServerTagsTestJSON-904876074 tempest-ServerTagsTestJSON-904876074-project] 10.222.0.30 "GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72" status: 404 len: 111 microversion: 2.26 time: 0.038672 Oct 04 21:29:57.333340 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2443/4849] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:57 2022] GET /compute/v2.1/servers/ce9f90a0-8efc-4043-a990-f6663196db72 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:29:57.342318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-28a9479e-0e5a-41a7-897f-32aadd6ec0c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:57.342318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-28a9479e-0e5a-41a7-897f-32aadd6ec0c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 35db7403-53d9-4c74-8512-1bae943a086f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:57.345376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28a9479e-0e5a-41a7-897f-32aadd6ec0c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:57.354209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28a9479e-0e5a-41a7-897f-32aadd6ec0c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:57.357682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28a9479e-0e5a-41a7-897f-32aadd6ec0c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:57.360620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28a9479e-0e5a-41a7-897f-32aadd6ec0c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:57.360620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28a9479e-0e5a-41a7-897f-32aadd6ec0c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:57.360620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28a9479e-0e5a-41a7-897f-32aadd6ec0c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:57.918837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1ccc6f65-f944-4dcc-9a39-611bca03a73d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:57.933307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1ccc6f65-f944-4dcc-9a39-611bca03a73d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:57.935075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1ccc6f65-f944-4dcc-9a39-611bca03a73d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:57.937307 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1ccc6f65-f944-4dcc-9a39-611bca03a73d tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.802565 Oct 04 21:29:57.949483 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2407/4850] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:57 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:57.961473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d4cf30a2-0213-4326-97ae-e548b4cfe8a5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:57.961473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d4cf30a2-0213-4326-97ae-e548b4cfe8a5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: db85fc78-9a76-401a-89fc-c92d828ae8d4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:57.984937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4cf30a2-0213-4326-97ae-e548b4cfe8a5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:57.985602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4cf30a2-0213-4326-97ae-e548b4cfe8a5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:57.987482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4cf30a2-0213-4326-97ae-e548b4cfe8a5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:57.988318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4cf30a2-0213-4326-97ae-e548b4cfe8a5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:57.989194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4cf30a2-0213-4326-97ae-e548b4cfe8a5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:57.989717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4cf30a2-0213-4326-97ae-e548b4cfe8a5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:58.542855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-28a9479e-0e5a-41a7-897f-32aadd6ec0c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:58.555011 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-28a9479e-0e5a-41a7-897f-32aadd6ec0c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f" status: 200 len: 1474 microversion: 2.1 time: 1.222060 Oct 04 21:29:58.559853 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2444/4851] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:57 2022] GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f => generated 1474 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:58.584763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-28f313e4-be2c-435a-a3e3-45e085757971 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:58.584763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-28f313e4-be2c-435a-a3e3-45e085757971 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:58.600779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28f313e4-be2c-435a-a3e3-45e085757971 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:58.605030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28f313e4-be2c-435a-a3e3-45e085757971 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:58.605030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28f313e4-be2c-435a-a3e3-45e085757971 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:58.605030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28f313e4-be2c-435a-a3e3-45e085757971 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:58.610662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28f313e4-be2c-435a-a3e3-45e085757971 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:58.617778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28f313e4-be2c-435a-a3e3-45e085757971 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:58.851724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d4cf30a2-0213-4326-97ae-e548b4cfe8a5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:58.864817 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d4cf30a2-0213-4326-97ae-e548b4cfe8a5 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/db85fc78-9a76-401a-89fc-c92d828ae8d4" status: 200 len: 1516 microversion: 2.1 time: 0.925440 Oct 04 21:29:58.867018 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2408/4852] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:57 2022] GET /compute/v2.1/servers/db85fc78-9a76-401a-89fc-c92d828ae8d4 => generated 1516 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:58.882654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-74b495f4-bacf-409a-a4a2-5f7e1e141ff6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-833762599", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:58.999812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-74b495f4-bacf-409a-a4a2-5f7e1e141ff6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] validate_networks() for [('f9328395-b63c-4f5a-9d32-23fa7cfe6c6d', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:29:59.564255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-28f313e4-be2c-435a-a3e3-45e085757971 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:59.595483 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-28f313e4-be2c-435a-a3e3-45e085757971 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1533 microversion: 2.1 time: 1.026889 Oct 04 21:29:59.595483 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2445/4853] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:58 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1533 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:59.617032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-216f3e37-d429-493e-bf03-603d33b4fa5e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:59.623293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-216f3e37-d429-493e-bf03-603d33b4fa5e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:59.640798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-216f3e37-d429-493e-bf03-603d33b4fa5e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:59.641490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-216f3e37-d429-493e-bf03-603d33b4fa5e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:59.642047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-216f3e37-d429-493e-bf03-603d33b4fa5e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:59.642780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-216f3e37-d429-493e-bf03-603d33b4fa5e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:59.667882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-216f3e37-d429-493e-bf03-603d33b4fa5e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:59.668506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-216f3e37-d429-493e-bf03-603d33b4fa5e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:00.509493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-216f3e37-d429-493e-bf03-603d33b4fa5e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:00.526805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-216f3e37-d429-493e-bf03-603d33b4fa5e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:00.535147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-216f3e37-d429-493e-bf03-603d33b4fa5e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:00.538683 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-216f3e37-d429-493e-bf03-603d33b4fa5e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.927784 Oct 04 21:30:00.539475 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2446/4854] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:59 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:00.553584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f0086834-5a55-46bf-af2a-5f309c48fdda tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:00.557311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f0086834-5a55-46bf-af2a-5f309c48fdda tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: db85fc78-9a76-401a-89fc-c92d828ae8d4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:00.570309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:00.598390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0086834-5a55-46bf-af2a-5f309c48fdda tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:00.598913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0086834-5a55-46bf-af2a-5f309c48fdda tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:00.599368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0086834-5a55-46bf-af2a-5f309c48fdda tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:00.600099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0086834-5a55-46bf-af2a-5f309c48fdda tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:00.600562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0086834-5a55-46bf-af2a-5f309c48fdda tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:00.600997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0086834-5a55-46bf-af2a-5f309c48fdda tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:00.924129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f0086834-5a55-46bf-af2a-5f309c48fdda tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:00.973588 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f0086834-5a55-46bf-af2a-5f309c48fdda tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/db85fc78-9a76-401a-89fc-c92d828ae8d4" status: 200 len: 1474 microversion: 2.1 time: 0.424277 Oct 04 21:30:00.995164 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2447/4855] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:00 2022] GET /compute/v2.1/servers/db85fc78-9a76-401a-89fc-c92d828ae8d4 => generated 1474 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:01.006067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-af49ee1e-eb26-42f3-8daf-55b4361d0876 req-66a675d5-46e7-4723-bd16-b51f62f3914e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144fff2d-9df3-4a93-833f-7f76acc85185", "name": "network-vif-plugged", "status": "completed", "tag": "cef3ff62-fc82-48d3-a981-5cadb2647961"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:01.060021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-af49ee1e-eb26-42f3-8daf-55b4361d0876 req-66a675d5-46e7-4723-bd16-b51f62f3914e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:01.060938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-af49ee1e-eb26-42f3-8daf-55b4361d0876 req-66a675d5-46e7-4723-bd16-b51f62f3914e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:01.061820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-af49ee1e-eb26-42f3-8daf-55b4361d0876 req-66a675d5-46e7-4723-bd16-b51f62f3914e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:01.091833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-74b495f4-bacf-409a-a4a2-5f7e1e141ff6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:30:01.093133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-74b495f4-bacf-409a-a4a2-5f7e1e141ff6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:30:01.093857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-74b495f4-bacf-409a-a4a2-5f7e1e141ff6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:30:01.096825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-74b495f4-bacf-409a-a4a2-5f7e1e141ff6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:30:01.096825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-74b495f4-bacf-409a-a4a2-5f7e1e141ff6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:30:01.100764 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-af49ee1e-eb26-42f3-8daf-55b4361d0876 req-66a675d5-46e7-4723-bd16-b51f62f3914e service nova] Creating event network-vif-plugged:cef3ff62-fc82-48d3-a981-5cadb2647961 for instance 144fff2d-9df3-4a93-833f-7f76acc85185 on n-h2-860282-1 Oct 04 21:30:01.121465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74b495f4-bacf-409a-a4a2-5f7e1e141ff6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:01.121759 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-af49ee1e-eb26-42f3-8daf-55b4361d0876 req-66a675d5-46e7-4723-bd16-b51f62f3914e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123585 Oct 04 21:30:01.123505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74b495f4-bacf-409a-a4a2-5f7e1e141ff6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:01.123963 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2448/4856] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:01.126587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74b495f4-bacf-409a-a4a2-5f7e1e141ff6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:01.131198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74b495f4-bacf-409a-a4a2-5f7e1e141ff6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:01.131198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74b495f4-bacf-409a-a4a2-5f7e1e141ff6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:01.131198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74b495f4-bacf-409a-a4a2-5f7e1e141ff6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:01.135790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-1ec7faf6-43cb-45f4-8be7-464f3b02eeaf req-2ea10709-9350-4248-8319-89a26f427bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db85fc78-9a76-401a-89fc-c92d828ae8d4", "name": "network-vif-deleted", "tag": "2e5eca04-7b74-4aba-820d-7f1cab5ba85d"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:01.182945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1ec7faf6-43cb-45f4-8be7-464f3b02eeaf req-2ea10709-9350-4248-8319-89a26f427bf1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:01.186252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1ec7faf6-43cb-45f4-8be7-464f3b02eeaf req-2ea10709-9350-4248-8319-89a26f427bf1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:01.194350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1ec7faf6-43cb-45f4-8be7-464f3b02eeaf req-2ea10709-9350-4248-8319-89a26f427bf1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:01.212886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-74b495f4-bacf-409a-a4a2-5f7e1e141ff6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Getting quotas for project fde68efb46fc44b5b0d83138b9048f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:30:01.259570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-74b495f4-bacf-409a-a4a2-5f7e1e141ff6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Getting quotas for user b9289c5fa9844ae3bb1c797bdab5c56c and project fde68efb46fc44b5b0d83138b9048f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:30:01.269300 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-1ec7faf6-43cb-45f4-8be7-464f3b02eeaf req-2ea10709-9350-4248-8319-89a26f427bf1 service nova] Creating event network-vif-deleted:2e5eca04-7b74-4aba-820d-7f1cab5ba85d for instance db85fc78-9a76-401a-89fc-c92d828ae8d4 on n-h2-860282-1 Oct 04 21:30:01.283197 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-1ec7faf6-43cb-45f4-8be7-464f3b02eeaf req-2ea10709-9350-4248-8319-89a26f427bf1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156973 Oct 04 21:30:01.291935 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2449/4857] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:01.315445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-004fa489-3691-4aba-999c-516ee87aa718 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:01.316427 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-004fa489-3691-4aba-999c-516ee87aa718 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:01.325238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-74b495f4-bacf-409a-a4a2-5f7e1e141ff6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:30:01.332528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-74b495f4-bacf-409a-a4a2-5f7e1e141ff6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:30:01.350460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-004fa489-3691-4aba-999c-516ee87aa718 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:01.357021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-004fa489-3691-4aba-999c-516ee87aa718 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:01.358777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-004fa489-3691-4aba-999c-516ee87aa718 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:01.365151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-004fa489-3691-4aba-999c-516ee87aa718 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:01.365737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-004fa489-3691-4aba-999c-516ee87aa718 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:01.366195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-004fa489-3691-4aba-999c-516ee87aa718 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:01.510880 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-74b495f4-bacf-409a-a4a2-5f7e1e141ff6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.641469 Oct 04 21:30:01.512584 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2409/4858] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:29:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:30:01.528490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-34fba389-05a6-42f7-8fee-1ee01efc8ae0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:01.531761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-34fba389-05a6-42f7-8fee-1ee01efc8ae0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:01.628205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-34fba389-05a6-42f7-8fee-1ee01efc8ae0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:30:02.170068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-004fa489-3691-4aba-999c-516ee87aa718 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:02.184658 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-004fa489-3691-4aba-999c-516ee87aa718 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1528 microversion: 2.1 time: 0.887955 Oct 04 21:30:02.188701 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2450/4859] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:01 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1528 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:02.197305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d5a6e07b-b159-48a9-ab77-745e2e75eca0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:02.198169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d5a6e07b-b159-48a9-ab77-745e2e75eca0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:02.246785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d5a6e07b-b159-48a9-ab77-745e2e75eca0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:02.252522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d5a6e07b-b159-48a9-ab77-745e2e75eca0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:02.253105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d5a6e07b-b159-48a9-ab77-745e2e75eca0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:02.253949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d5a6e07b-b159-48a9-ab77-745e2e75eca0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:02.254426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d5a6e07b-b159-48a9-ab77-745e2e75eca0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:02.257841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d5a6e07b-b159-48a9-ab77-745e2e75eca0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:02.307288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:02.473208 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-34fba389-05a6-42f7-8fee-1ee01efc8ae0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "DELETE /compute/v2.1/servers/341c02c4-69e6-4e78-a51b-7e8b40fcf3b5" status: 204 len: 0 microversion: 2.1 time: 0.953151 Oct 04 21:30:02.474076 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2410/4860] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:30:01 2022] DELETE /compute/v2.1/servers/341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 => generated 0 bytes in 955 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:30:02.479179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d40fccb1-c671-44e8-bd81-eebfe2cf4851 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:02.481550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d40fccb1-c671-44e8-bd81-eebfe2cf4851 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: db85fc78-9a76-401a-89fc-c92d828ae8d4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:02.493855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d40fccb1-c671-44e8-bd81-eebfe2cf4851 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:02.494336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d40fccb1-c671-44e8-bd81-eebfe2cf4851 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:02.510018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d40fccb1-c671-44e8-bd81-eebfe2cf4851 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:02.512846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d40fccb1-c671-44e8-bd81-eebfe2cf4851 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:02.516662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d40fccb1-c671-44e8-bd81-eebfe2cf4851 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:02.517607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d40fccb1-c671-44e8-bd81-eebfe2cf4851 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:02.579063 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-d40fccb1-c671-44e8-bd81-eebfe2cf4851 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] HTTP exception thrown: Instance db85fc78-9a76-401a-89fc-c92d828ae8d4 could not be found. Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d40fccb1-c671-44e8-bd81-eebfe2cf4851 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Request method failure captured: Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/db85fc78-9a76-401a-89fc-c92d828ae8d4 HTTP/1.1 Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKVzN2QN1VdZBD95-EI-DUk2t7amwzDKij18KilE0o7X9TszcumC1SzME1RGdD0VR6ZHWrWtJOD9l505jwaOV_GgKCDAAauxKA-AsjXqYS22WTiMb7zyQeBJxldUDZiAXBYE8Dk-B-M-hV2qNvj_cHi-fxbvupVGITxqLAHAfkMemIY Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f315fab8318a4c9f84f0b39ce233ee57 Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ListServerFiltersTestJSON-439877241 Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f315fab8318a4c9f84f0b39ce233ee57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f315fab8318a4c9f84f0b39ce233ee57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f315fab8318a4c9f84f0b39ce233ee57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f315fab8318a4c9f84f0b39ce233ee57"}]}] Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ListServerFiltersTestJSON-439877241 Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f315fab8318a4c9f84f0b39ce233ee57 Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-439877241 Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ListServerFiltersTestJSON-439877241-project Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: de17081946dc4da8864f5338123b6ed1 Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ListServerFiltersTestJSON-439877241-project Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance db85fc78-9a76-401a-89fc-c92d828ae8d4 could not be found. Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'db85fc78-9a76-401a-89fc-c92d828ae8d4'} Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db85fc78-9a76-401a-89fc-c92d828ae8d4 could not be found. Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db85fc78-9a76-401a-89fc-c92d828ae8d4 could not be found. Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:02.585329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:30:02.590665 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:02.590665 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:02.590665 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:02.590665 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:30:02.590665 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:30:02.590665 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db85fc78-9a76-401a-89fc-c92d828ae8d4 could not be found. Oct 04 21:30:02.590665 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:30:02.592152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d40fccb1-c671-44e8-bd81-eebfe2cf4851 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Returning 404 to user: Instance db85fc78-9a76-401a-89fc-c92d828ae8d4 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:30:02.597072 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d40fccb1-c671-44e8-bd81-eebfe2cf4851 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/db85fc78-9a76-401a-89fc-c92d828ae8d4" status: 404 len: 111 microversion: 2.1 time: 0.121486 Oct 04 21:30:02.598230 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2411/4861] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:02 2022] GET /compute/v2.1/servers/db85fc78-9a76-401a-89fc-c92d828ae8d4 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:30:02.611961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4c42127f-7158-4949-b255-47d0aa25303b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Action: 'create', calling method: .version_select at 0x7f5790b4b1f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-806395857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAagF9/S25Wk3tv92jHAbYj28/M/RvTYZgxKxEyulY2Etppv6eO/c8egdiUzJTGcdtz+p1TyPWOGagdorO6CAEaFjJz+TbznBTz3LL3ro5gsbPIdeLzgD5mcMYgr47waw=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:02.683119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-4c42127f-7158-4949-b255-47d0aa25303b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Getting quotas for project f74afbd0dc37402fa84ec9d6e2cb53f4. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:30:02.698180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-4c42127f-7158-4949-b255-47d0aa25303b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Getting quotas for user 933f720fbafe482d95b27cd372934ab6 and project f74afbd0dc37402fa84ec9d6e2cb53f4. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:30:02.854992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d5a6e07b-b159-48a9-ab77-745e2e75eca0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:02.871799 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4c42127f-7158-4949-b255-47d0aa25303b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.265347 Oct 04 21:30:02.883868 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2412/4862] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:30:02 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:02.898226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-88f4aa0a-b99c-44e5-88ab-a6decea10bf8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:02.904007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-88f4aa0a-b99c-44e5-88ab-a6decea10bf8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:02.919177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d5a6e07b-b159-48a9-ab77-745e2e75eca0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:02.929629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d5a6e07b-b159-48a9-ab77-745e2e75eca0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:02.931513 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d5a6e07b-b159-48a9-ab77-745e2e75eca0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.741506 Oct 04 21:30:02.936004 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2451/4863] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:02 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:02.938772 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-88f4aa0a-b99c-44e5-88ab-a6decea10bf8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 could not be found. Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-88f4aa0a-b99c-44e5-88ab-a6decea10bf8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 HTTP/1.1 Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 could not be found. Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '341c02c4-69e6-4e78-a51b-7e8b40fcf3b5'} Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 could not be found. Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 could not be found. Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:02.944243 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:02.948712 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:02.948712 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:30:02.948712 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:30:02.948712 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 could not be found. Oct 04 21:30:02.948712 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:30:02.951054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-88f4aa0a-b99c-44e5-88ab-a6decea10bf8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:30:02.958186 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-88f4aa0a-b99c-44e5-88ab-a6decea10bf8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/341c02c4-69e6-4e78-a51b-7e8b40fcf3b5" status: 404 len: 111 microversion: 2.1 time: 0.069240 Oct 04 21:30:02.960227 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2413/4864] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:02 2022] GET /compute/v2.1/servers/341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:30:02.960885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1ff239b0-05f3-46f3-899b-f87c2b88b82f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:02.963275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1ff239b0-05f3-46f3-899b-f87c2b88b82f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:02.978848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ff239b0-05f3-46f3-899b-f87c2b88b82f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:02.981275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ff239b0-05f3-46f3-899b-f87c2b88b82f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:02.986800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ff239b0-05f3-46f3-899b-f87c2b88b82f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:03.001358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ff239b0-05f3-46f3-899b-f87c2b88b82f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:03.003854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ff239b0-05f3-46f3-899b-f87c2b88b82f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:03.006590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ff239b0-05f3-46f3-899b-f87c2b88b82f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:03.064299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1ff239b0-05f3-46f3-899b-f87c2b88b82f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:30:03.221606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-938de882-fa98-4297-ba4f-e7ec95acb242 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:03.225631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-938de882-fa98-4297-ba4f-e7ec95acb242 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:03.239576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-938de882-fa98-4297-ba4f-e7ec95acb242 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:03.253964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-938de882-fa98-4297-ba4f-e7ec95acb242 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:03.255412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-938de882-fa98-4297-ba4f-e7ec95acb242 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:03.262324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-938de882-fa98-4297-ba4f-e7ec95acb242 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:03.264195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-938de882-fa98-4297-ba4f-e7ec95acb242 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:03.267429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-938de882-fa98-4297-ba4f-e7ec95acb242 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:03.559247 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1ff239b0-05f3-46f3-899b-f87c2b88b82f tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "DELETE /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b" status: 204 len: 0 microversion: 2.1 time: 0.620898 Oct 04 21:30:03.564714 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2452/4865] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:30:02 2022] DELETE /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b => generated 0 bytes in 623 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:30:03.571549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c1799ae9-a1ad-4ff6-8e34-361942a4c639 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1780484959", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "f9328395-b63c-4f5a-9d32-23fa7cfe6c6d"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:03.695785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-c1799ae9-a1ad-4ff6-8e34-361942a4c639 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] validate_networks() for [('f9328395-b63c-4f5a-9d32-23fa7cfe6c6d', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:30:03.723427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-938de882-fa98-4297-ba4f-e7ec95acb242 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:03.737393 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-938de882-fa98-4297-ba4f-e7ec95acb242 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1528 microversion: 2.1 time: 0.525579 Oct 04 21:30:03.769824 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2414/4866] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:03 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1528 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:30:03.786515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7ebff07c-f4dc-4217-80b0-c014d92d9ff2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:03.787519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7ebff07c-f4dc-4217-80b0-c014d92d9ff2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:03.798372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ebff07c-f4dc-4217-80b0-c014d92d9ff2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:03.799539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ebff07c-f4dc-4217-80b0-c014d92d9ff2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:03.800522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ebff07c-f4dc-4217-80b0-c014d92d9ff2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:03.802274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ebff07c-f4dc-4217-80b0-c014d92d9ff2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:03.802980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ebff07c-f4dc-4217-80b0-c014d92d9ff2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:03.803699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ebff07c-f4dc-4217-80b0-c014d92d9ff2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:04.240375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7ebff07c-f4dc-4217-80b0-c014d92d9ff2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:04.254491 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7ebff07c-f4dc-4217-80b0-c014d92d9ff2 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b" status: 200 len: 1517 microversion: 2.1 time: 0.472393 Oct 04 21:30:04.255702 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2415/4867] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:03 2022] GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b => generated 1517 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:04.270189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ed13fc3b-2155-4e4b-ba41-1e22d8b81110 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:04.271334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ed13fc3b-2155-4e4b-ba41-1e22d8b81110 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:04.284736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed13fc3b-2155-4e4b-ba41-1e22d8b81110 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:04.285541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed13fc3b-2155-4e4b-ba41-1e22d8b81110 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:04.288892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed13fc3b-2155-4e4b-ba41-1e22d8b81110 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:04.288892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed13fc3b-2155-4e4b-ba41-1e22d8b81110 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:04.288892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed13fc3b-2155-4e4b-ba41-1e22d8b81110 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:04.288892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed13fc3b-2155-4e4b-ba41-1e22d8b81110 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:04.876071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ed13fc3b-2155-4e4b-ba41-1e22d8b81110 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:04.891877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ed13fc3b-2155-4e4b-ba41-1e22d8b81110 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:04.897689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ed13fc3b-2155-4e4b-ba41-1e22d8b81110 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:04.899908 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ed13fc3b-2155-4e4b-ba41-1e22d8b81110 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.642948 Oct 04 21:30:04.903143 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2416/4868] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:04 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:04.910130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9ff34a35-1a34-4df0-b650-5a6fc9c48acf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:04.911083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9ff34a35-1a34-4df0-b650-5a6fc9c48acf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:04.924144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ff34a35-1a34-4df0-b650-5a6fc9c48acf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:04.924144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ff34a35-1a34-4df0-b650-5a6fc9c48acf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:04.924144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ff34a35-1a34-4df0-b650-5a6fc9c48acf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:04.924144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ff34a35-1a34-4df0-b650-5a6fc9c48acf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:04.924144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ff34a35-1a34-4df0-b650-5a6fc9c48acf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:04.925634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ff34a35-1a34-4df0-b650-5a6fc9c48acf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:05.155329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-c1799ae9-a1ad-4ff6-8e34-361942a4c639 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:30:05.155947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-c1799ae9-a1ad-4ff6-8e34-361942a4c639 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:30:05.156434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-c1799ae9-a1ad-4ff6-8e34-361942a4c639 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:30:05.156849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-c1799ae9-a1ad-4ff6-8e34-361942a4c639 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:30:05.157260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-c1799ae9-a1ad-4ff6-8e34-361942a4c639 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:30:05.181899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1799ae9-a1ad-4ff6-8e34-361942a4c639 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:05.181899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1799ae9-a1ad-4ff6-8e34-361942a4c639 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:05.181899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1799ae9-a1ad-4ff6-8e34-361942a4c639 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:05.182773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1799ae9-a1ad-4ff6-8e34-361942a4c639 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:05.183431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1799ae9-a1ad-4ff6-8e34-361942a4c639 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:05.184049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1799ae9-a1ad-4ff6-8e34-361942a4c639 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:05.208040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-c1799ae9-a1ad-4ff6-8e34-361942a4c639 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Getting quotas for project fde68efb46fc44b5b0d83138b9048f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:30:05.214376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-c1799ae9-a1ad-4ff6-8e34-361942a4c639 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Getting quotas for user b9289c5fa9844ae3bb1c797bdab5c56c and project fde68efb46fc44b5b0d83138b9048f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:30:05.229389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c1799ae9-a1ad-4ff6-8e34-361942a4c639 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:30:05.232386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c1799ae9-a1ad-4ff6-8e34-361942a4c639 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:30:05.305142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9ff34a35-1a34-4df0-b650-5a6fc9c48acf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:05.321572 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9ff34a35-1a34-4df0-b650-5a6fc9c48acf tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1528 microversion: 2.1 time: 0.416903 Oct 04 21:30:05.326434 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2417/4869] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:04 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1528 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:05.347139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-22892d4a-4bb4-4929-b02a-1d15aad1eba0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:05.349657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-22892d4a-4bb4-4929-b02a-1d15aad1eba0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:05.366590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22892d4a-4bb4-4929-b02a-1d15aad1eba0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:05.379718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22892d4a-4bb4-4929-b02a-1d15aad1eba0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:05.383165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22892d4a-4bb4-4929-b02a-1d15aad1eba0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:05.385308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22892d4a-4bb4-4929-b02a-1d15aad1eba0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:05.386044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22892d4a-4bb4-4929-b02a-1d15aad1eba0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:05.387715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22892d4a-4bb4-4929-b02a-1d15aad1eba0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:05.414172 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c1799ae9-a1ad-4ff6-8e34-361942a4c639 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.847461 Oct 04 21:30:05.416589 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2453/4870] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:30:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:30:05.427631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-917b8b86-28ff-4ea5-ba6f-3443cb057581 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:05.429321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-917b8b86-28ff-4ea5-ba6f-3443cb057581 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:05.811996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-917b8b86-28ff-4ea5-ba6f-3443cb057581 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:05.824654 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-917b8b86-28ff-4ea5-ba6f-3443cb057581 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41" status: 200 len: 1221 microversion: 2.1 time: 0.400535 Oct 04 21:30:05.827408 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2454/4871] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:05 2022] GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 => generated 1221 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:05.932559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8a3da9a6-5709-4b59-b556-a7433730d058 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:05.933560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8a3da9a6-5709-4b59-b556-a7433730d058 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:05.951897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a3da9a6-5709-4b59-b556-a7433730d058 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:05.958096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a3da9a6-5709-4b59-b556-a7433730d058 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:05.958558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a3da9a6-5709-4b59-b556-a7433730d058 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:05.962576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a3da9a6-5709-4b59-b556-a7433730d058 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:05.963082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a3da9a6-5709-4b59-b556-a7433730d058 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:05.963977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8a3da9a6-5709-4b59-b556-a7433730d058 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:06.397708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-22892d4a-4bb4-4929-b02a-1d15aad1eba0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:06.442401 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-22892d4a-4bb4-4929-b02a-1d15aad1eba0 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b" status: 200 len: 1517 microversion: 2.1 time: 1.112832 Oct 04 21:30:06.446736 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2418/4872] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:05 2022] GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b => generated 1517 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:06.458576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7ec3790c-b120-46f5-a8d5-f2ce4f056705 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:06.459561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7ec3790c-b120-46f5-a8d5-f2ce4f056705 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:06.480968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ec3790c-b120-46f5-a8d5-f2ce4f056705 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:06.483133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ec3790c-b120-46f5-a8d5-f2ce4f056705 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:06.486957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ec3790c-b120-46f5-a8d5-f2ce4f056705 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:06.490528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ec3790c-b120-46f5-a8d5-f2ce4f056705 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:06.499974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ec3790c-b120-46f5-a8d5-f2ce4f056705 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:06.500701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ec3790c-b120-46f5-a8d5-f2ce4f056705 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:06.506371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:07.751161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8a3da9a6-5709-4b59-b556-a7433730d058 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:07.770645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8a3da9a6-5709-4b59-b556-a7433730d058 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:07.773034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8a3da9a6-5709-4b59-b556-a7433730d058 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:07.776499 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8a3da9a6-5709-4b59-b556-a7433730d058 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 1.848151 Oct 04 21:30:07.778557 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2455/4873] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:05 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:07.800461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b9217d93-b4e2-47cf-9c5b-782304210a89 req-864173c7-6cec-4afb-96e7-9b941b698462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11842dec-199c-4673-99ef-286d7f858e1b", "name": "network-vif-deleted", "tag": "f9b6d7bc-4a67-4957-a540-4bc24b3633e1"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:07.821090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b9217d93-b4e2-47cf-9c5b-782304210a89 req-864173c7-6cec-4afb-96e7-9b941b698462 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:07.824750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b9217d93-b4e2-47cf-9c5b-782304210a89 req-864173c7-6cec-4afb-96e7-9b941b698462 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:07.824750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b9217d93-b4e2-47cf-9c5b-782304210a89 req-864173c7-6cec-4afb-96e7-9b941b698462 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:07.869605 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b9217d93-b4e2-47cf-9c5b-782304210a89 req-864173c7-6cec-4afb-96e7-9b941b698462 service nova] Creating event network-vif-deleted:f9b6d7bc-4a67-4957-a540-4bc24b3633e1 for instance 11842dec-199c-4673-99ef-286d7f858e1b on n-h1-860282-1 Oct 04 21:30:07.883922 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b9217d93-b4e2-47cf-9c5b-782304210a89 req-864173c7-6cec-4afb-96e7-9b941b698462 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102645 Oct 04 21:30:07.885287 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2456/4874] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:07.891025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7ec3790c-b120-46f5-a8d5-f2ce4f056705 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:07.891926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fcc070b6-3c43-43f1-a303-3fb63a6e472e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:07.892931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fcc070b6-3c43-43f1-a303-3fb63a6e472e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:07.905980 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7ec3790c-b120-46f5-a8d5-f2ce4f056705 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1528 microversion: 2.1 time: 1.456896 Oct 04 21:30:07.916000 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2419/4875] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:06 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1528 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:07.917636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fcc070b6-3c43-43f1-a303-3fb63a6e472e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:07.918418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fcc070b6-3c43-43f1-a303-3fb63a6e472e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:07.919064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fcc070b6-3c43-43f1-a303-3fb63a6e472e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:07.919969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fcc070b6-3c43-43f1-a303-3fb63a6e472e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:07.921267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fcc070b6-3c43-43f1-a303-3fb63a6e472e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:07.922586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fcc070b6-3c43-43f1-a303-3fb63a6e472e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:07.943271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dc7f9c33-6a74-4a17-b598-f791cebf3313 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:07.944727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dc7f9c33-6a74-4a17-b598-f791cebf3313 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:07.964677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc7f9c33-6a74-4a17-b598-f791cebf3313 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:07.965333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc7f9c33-6a74-4a17-b598-f791cebf3313 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:07.965912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc7f9c33-6a74-4a17-b598-f791cebf3313 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:07.967931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc7f9c33-6a74-4a17-b598-f791cebf3313 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:07.969958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc7f9c33-6a74-4a17-b598-f791cebf3313 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:07.970576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc7f9c33-6a74-4a17-b598-f791cebf3313 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:08.080685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc7f9c33-6a74-4a17-b598-f791cebf3313 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:08.088932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc7f9c33-6a74-4a17-b598-f791cebf3313 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:08.089901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc7f9c33-6a74-4a17-b598-f791cebf3313 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:08.091517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-dc7f9c33-6a74-4a17-b598-f791cebf3313 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lazy-loading 'fault' on Instance uuid 11842dec-199c-4673-99ef-286d7f858e1b {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:30:08.145353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fcc070b6-3c43-43f1-a303-3fb63a6e472e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:08.157367 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fcc070b6-3c43-43f1-a303-3fb63a6e472e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41" status: 200 len: 1217 microversion: 2.1 time: 0.270577 Oct 04 21:30:08.160666 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2457/4876] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:07 2022] GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 => generated 1217 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:08.217061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dc7f9c33-6a74-4a17-b598-f791cebf3313 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de17081946dc4da8864f5338123b6ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f315fab8318a4c9f84f0b39ce233ee57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:08.227604 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dc7f9c33-6a74-4a17-b598-f791cebf3313 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b" status: 200 len: 1310 microversion: 2.1 time: 0.308321 Oct 04 21:30:08.248245 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2420/4877] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:07 2022] GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b => generated 1310 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:08.728026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-19aa3537-e28c-481d-bcdc-83305fbba208 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-791268659", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "19c5f4d4-6d18-43d3-ae1d-318b3ba7eb43"}], "key_name": "tempest-TestNetworkBasicOps-806395857", "security_groups": [{"name": "tempest-secgroup-smoke-1470652570"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:08.814511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5df13f12-fb79-4737-83fd-ef5e85f1b3b5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:08.814511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5df13f12-fb79-4737-83fd-ef5e85f1b3b5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:08.821828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5df13f12-fb79-4737-83fd-ef5e85f1b3b5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:08.822967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5df13f12-fb79-4737-83fd-ef5e85f1b3b5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:08.823589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5df13f12-fb79-4737-83fd-ef5e85f1b3b5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:08.824483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5df13f12-fb79-4737-83fd-ef5e85f1b3b5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:08.825110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5df13f12-fb79-4737-83fd-ef5e85f1b3b5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:08.825832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5df13f12-fb79-4737-83fd-ef5e85f1b3b5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:09.099365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-19aa3537-e28c-481d-bcdc-83305fbba208 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] validate_networks() for [('19c5f4d4-6d18-43d3-ae1d-318b3ba7eb43', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:30:09.621199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5df13f12-fb79-4737-83fd-ef5e85f1b3b5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:09.643466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5df13f12-fb79-4737-83fd-ef5e85f1b3b5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:09.646250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5df13f12-fb79-4737-83fd-ef5e85f1b3b5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:09.647646 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5df13f12-fb79-4737-83fd-ef5e85f1b3b5 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.843939 Oct 04 21:30:09.650136 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2421/4878] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:08 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:30:09.657585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3e3ad701-b3c0-4471-b858-e3c003276b3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:09.658722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3e3ad701-b3c0-4471-b858-e3c003276b3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:09.666138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3ad701-b3c0-4471-b858-e3c003276b3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:09.666787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3ad701-b3c0-4471-b858-e3c003276b3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:09.667341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3ad701-b3c0-4471-b858-e3c003276b3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:09.668223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3ad701-b3c0-4471-b858-e3c003276b3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:09.668744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3ad701-b3c0-4471-b858-e3c003276b3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:09.669742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3ad701-b3c0-4471-b858-e3c003276b3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:10.155829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3e3ad701-b3c0-4471-b858-e3c003276b3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:10.167631 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3e3ad701-b3c0-4471-b858-e3c003276b3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1528 microversion: 2.1 time: 0.516360 Oct 04 21:30:10.180789 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2422/4879] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:09 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1528 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:10.180789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-163bb4ab-a292-4155-ae22-5d39aa830feb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:10.180789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-163bb4ab-a292-4155-ae22-5d39aa830feb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:10.187907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-163bb4ab-a292-4155-ae22-5d39aa830feb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:10.188622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-163bb4ab-a292-4155-ae22-5d39aa830feb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:10.189250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-163bb4ab-a292-4155-ae22-5d39aa830feb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:10.190307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-163bb4ab-a292-4155-ae22-5d39aa830feb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:10.190960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-163bb4ab-a292-4155-ae22-5d39aa830feb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:10.191561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-163bb4ab-a292-4155-ae22-5d39aa830feb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:10.219479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-19aa3537-e28c-481d-bcdc-83305fbba208 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:30:10.221013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-19aa3537-e28c-481d-bcdc-83305fbba208 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:30:10.222114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-19aa3537-e28c-481d-bcdc-83305fbba208 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:30:10.223100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-19aa3537-e28c-481d-bcdc-83305fbba208 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:30:10.224018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-19aa3537-e28c-481d-bcdc-83305fbba208 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:30:10.237042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19aa3537-e28c-481d-bcdc-83305fbba208 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:10.238321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19aa3537-e28c-481d-bcdc-83305fbba208 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:10.318381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19aa3537-e28c-481d-bcdc-83305fbba208 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:10.318381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19aa3537-e28c-481d-bcdc-83305fbba208 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:10.318381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19aa3537-e28c-481d-bcdc-83305fbba208 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:10.318381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19aa3537-e28c-481d-bcdc-83305fbba208 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:10.318381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-19aa3537-e28c-481d-bcdc-83305fbba208 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Getting quotas for project f74afbd0dc37402fa84ec9d6e2cb53f4. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:30:10.318381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-19aa3537-e28c-481d-bcdc-83305fbba208 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Getting quotas for user 933f720fbafe482d95b27cd372934ab6 and project f74afbd0dc37402fa84ec9d6e2cb53f4. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:30:10.319125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-163bb4ab-a292-4155-ae22-5d39aa830feb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:10.319125 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-163bb4ab-a292-4155-ae22-5d39aa830feb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41" status: 200 len: 1279 microversion: 2.1 time: 0.115891 Oct 04 21:30:10.319125 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2423/4880] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:10 2022] GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 => generated 1279 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:10.319709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-19aa3537-e28c-481d-bcdc-83305fbba208 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:30:10.319709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-19aa3537-e28c-481d-bcdc-83305fbba208 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:30:10.319904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d4aed977-ef53-4e0b-a84a-4535b0003593 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:10.319904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d4aed977-ef53-4e0b-a84a-4535b0003593 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] [instance: 11842dec-199c-4673-99ef-286d7f858e1b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:10.319904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4aed977-ef53-4e0b-a84a-4535b0003593 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:10.319904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4aed977-ef53-4e0b-a84a-4535b0003593 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:10.319904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4aed977-ef53-4e0b-a84a-4535b0003593 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:10.319904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4aed977-ef53-4e0b-a84a-4535b0003593 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:10.319904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4aed977-ef53-4e0b-a84a-4535b0003593 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:10.319904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4aed977-ef53-4e0b-a84a-4535b0003593 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:10.341215 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-d4aed977-ef53-4e0b-a84a-4535b0003593 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] HTTP exception thrown: Instance 11842dec-199c-4673-99ef-286d7f858e1b could not be found. Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d4aed977-ef53-4e0b-a84a-4535b0003593 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Request method failure captured: Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b HTTP/1.1 Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKVzN2QN1VdZBD95-EI-DUk2t7amwzDKij18KilE0o7X9TszcumC1SzME1RGdD0VR6ZHWrWtJOD9l505jwaOV_GgKCDAAauxKA-AsjXqYS22WTiMb7zyQeBJxldUDZiAXBYE8Dk-B-M-hV2qNvj_cHi-fxbvupVGITxqLAHAfkMemIY Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f315fab8318a4c9f84f0b39ce233ee57 Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ListServerFiltersTestJSON-439877241 Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f315fab8318a4c9f84f0b39ce233ee57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f315fab8318a4c9f84f0b39ce233ee57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f315fab8318a4c9f84f0b39ce233ee57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f315fab8318a4c9f84f0b39ce233ee57"}]}] Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ListServerFiltersTestJSON-439877241 Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f315fab8318a4c9f84f0b39ce233ee57 Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-439877241 Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ListServerFiltersTestJSON-439877241-project Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: de17081946dc4da8864f5338123b6ed1 Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ListServerFiltersTestJSON-439877241-project Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 11842dec-199c-4673-99ef-286d7f858e1b could not be found. Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '11842dec-199c-4673-99ef-286d7f858e1b'} Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11842dec-199c-4673-99ef-286d7f858e1b could not be found. Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11842dec-199c-4673-99ef-286d7f858e1b could not be found. Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:10.343598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:30:10.348818 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:10.348818 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:10.348818 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:10.348818 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:30:10.348818 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:30:10.348818 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11842dec-199c-4673-99ef-286d7f858e1b could not be found. Oct 04 21:30:10.348818 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:30:10.348818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d4aed977-ef53-4e0b-a84a-4535b0003593 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] Returning 404 to user: Instance 11842dec-199c-4673-99ef-286d7f858e1b could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:30:10.348818 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d4aed977-ef53-4e0b-a84a-4535b0003593 tempest-ListServerFiltersTestJSON-439877241 tempest-ListServerFiltersTestJSON-439877241-project] 10.222.0.30 "GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b" status: 404 len: 111 microversion: 2.1 time: 0.060998 Oct 04 21:30:10.349529 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2424/4881] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:10 2022] GET /compute/v2.1/servers/11842dec-199c-4673-99ef-286d7f858e1b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:30:10.540174 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-19aa3537-e28c-481d-bcdc-83305fbba208 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.816113 Oct 04 21:30:10.541478 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2458/4882] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:30:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:30:10.557571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d76f2420-47cc-4cf0-82c2-7ee5f7b4f79e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:10.558466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d76f2420-47cc-4cf0-82c2-7ee5f7b4f79e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:10.681569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-79893649-d837-4c2b-af6c-f414790e98e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:10.682189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-79893649-d837-4c2b-af6c-f414790e98e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:10.696336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79893649-d837-4c2b-af6c-f414790e98e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:10.705152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79893649-d837-4c2b-af6c-f414790e98e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:10.705659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79893649-d837-4c2b-af6c-f414790e98e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:10.706408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79893649-d837-4c2b-af6c-f414790e98e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:10.707045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79893649-d837-4c2b-af6c-f414790e98e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:10.707478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79893649-d837-4c2b-af6c-f414790e98e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:11.172414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:11.299447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d76f2420-47cc-4cf0-82c2-7ee5f7b4f79e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:11.325967 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d76f2420-47cc-4cf0-82c2-7ee5f7b4f79e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 200 len: 1247 microversion: 2.1 time: 0.776000 Oct 04 21:30:11.327140 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2425/4883] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:10 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 1247 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:11.334329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-346bab5e-9f6a-44de-93cc-7defb4b7f9a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:11.346541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-346bab5e-9f6a-44de-93cc-7defb4b7f9a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:11.377887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-346bab5e-9f6a-44de-93cc-7defb4b7f9a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:11.378395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-346bab5e-9f6a-44de-93cc-7defb4b7f9a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:11.398270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-346bab5e-9f6a-44de-93cc-7defb4b7f9a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:11.408885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-346bab5e-9f6a-44de-93cc-7defb4b7f9a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:11.425064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-346bab5e-9f6a-44de-93cc-7defb4b7f9a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:11.437190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-346bab5e-9f6a-44de-93cc-7defb4b7f9a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:11.460781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-79893649-d837-4c2b-af6c-f414790e98e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:11.478197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-79893649-d837-4c2b-af6c-f414790e98e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:11.488370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-79893649-d837-4c2b-af6c-f414790e98e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:11.494677 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-79893649-d837-4c2b-af6c-f414790e98e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.818316 Oct 04 21:30:11.511374 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2459/4884] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:10 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:11.533773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4d424772-bb0a-4633-b375-39a3ecdd0af7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:11.535339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4d424772-bb0a-4633-b375-39a3ecdd0af7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:11.559501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d424772-bb0a-4633-b375-39a3ecdd0af7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:11.562209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d424772-bb0a-4633-b375-39a3ecdd0af7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:11.565235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d424772-bb0a-4633-b375-39a3ecdd0af7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:11.567254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d424772-bb0a-4633-b375-39a3ecdd0af7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:11.567254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d424772-bb0a-4633-b375-39a3ecdd0af7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:11.569202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d424772-bb0a-4633-b375-39a3ecdd0af7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:12.054691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4d424772-bb0a-4633-b375-39a3ecdd0af7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:12.066249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-346bab5e-9f6a-44de-93cc-7defb4b7f9a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:12.091260 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-346bab5e-9f6a-44de-93cc-7defb4b7f9a2 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1528 microversion: 2.1 time: 0.760104 Oct 04 21:30:12.091885 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4d424772-bb0a-4633-b375-39a3ecdd0af7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41" status: 200 len: 1321 microversion: 2.1 time: 0.577686 Oct 04 21:30:12.111509 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2460/4886] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:11 2022] GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 => generated 1321 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:12.111771 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2426/4886] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:11 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1528 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:12.355698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f0feca13-eb0b-491c-bc5e-f0a8c7d8673e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:12.356331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f0feca13-eb0b-491c-bc5e-f0a8c7d8673e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:12.370512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0feca13-eb0b-491c-bc5e-f0a8c7d8673e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:12.372335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0feca13-eb0b-491c-bc5e-f0a8c7d8673e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:12.377563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0feca13-eb0b-491c-bc5e-f0a8c7d8673e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:12.377563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0feca13-eb0b-491c-bc5e-f0a8c7d8673e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:12.377563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0feca13-eb0b-491c-bc5e-f0a8c7d8673e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:12.378651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0feca13-eb0b-491c-bc5e-f0a8c7d8673e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:12.522904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-16ef399e-c10b-499a-8075-ab0d47b294f3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1490791816", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": "none"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:12.599908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f0feca13-eb0b-491c-bc5e-f0a8c7d8673e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:12.618214 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f0feca13-eb0b-491c-bc5e-f0a8c7d8673e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 200 len: 1251 microversion: 2.1 time: 0.268108 Oct 04 21:30:12.651637 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2461/4887] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:12 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 1251 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:12.656856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-16ef399e-c10b-499a-8075-ab0d47b294f3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:30:12.660529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-16ef399e-c10b-499a-8075-ab0d47b294f3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:30:12.663549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-16ef399e-c10b-499a-8075-ab0d47b294f3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:30:12.663549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-16ef399e-c10b-499a-8075-ab0d47b294f3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:30:12.664876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-16ef399e-c10b-499a-8075-ab0d47b294f3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:30:12.670445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-65f11d56-3d96-4470-ad45-ce9f548bce7f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:12.673374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-65f11d56-3d96-4470-ad45-ce9f548bce7f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:12.693854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65f11d56-3d96-4470-ad45-ce9f548bce7f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:12.694764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16ef399e-c10b-499a-8075-ab0d47b294f3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:12.695787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16ef399e-c10b-499a-8075-ab0d47b294f3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:12.696161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65f11d56-3d96-4470-ad45-ce9f548bce7f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:12.696831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65f11d56-3d96-4470-ad45-ce9f548bce7f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:12.698037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65f11d56-3d96-4470-ad45-ce9f548bce7f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:12.698431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16ef399e-c10b-499a-8075-ab0d47b294f3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:12.700425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16ef399e-c10b-499a-8075-ab0d47b294f3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:12.701104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65f11d56-3d96-4470-ad45-ce9f548bce7f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:12.702178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65f11d56-3d96-4470-ad45-ce9f548bce7f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:12.702451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16ef399e-c10b-499a-8075-ab0d47b294f3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:12.703974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16ef399e-c10b-499a-8075-ab0d47b294f3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:12.756548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-16ef399e-c10b-499a-8075-ab0d47b294f3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Getting quotas for project 5308e8f8d3714caebcf21c76211de44d. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:30:12.759178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:12.764707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-16ef399e-c10b-499a-8075-ab0d47b294f3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Getting quotas for user f6931e7717dc44b0b25454266c315ac9 and project 5308e8f8d3714caebcf21c76211de44d. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:30:12.786983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-16ef399e-c10b-499a-8075-ab0d47b294f3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:30:12.789931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-16ef399e-c10b-499a-8075-ab0d47b294f3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 4ba401ec-5056-44df-8255-49786814ccf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:30:13.018088 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-16ef399e-c10b-499a-8075-ab0d47b294f3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.902113 Oct 04 21:30:13.023549 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2427/4888] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Oct 4 21:30:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:30:13.044100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e7583fc1-35fc-4d13-8406-ddd2457ba7c4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:13.044620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e7583fc1-35fc-4d13-8406-ddd2457ba7c4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 4ba401ec-5056-44df-8255-49786814ccf9] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:13.109473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-65f11d56-3d96-4470-ad45-ce9f548bce7f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:13.132198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-65f11d56-3d96-4470-ad45-ce9f548bce7f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:13.146469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-65f11d56-3d96-4470-ad45-ce9f548bce7f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:13.150808 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-65f11d56-3d96-4470-ad45-ce9f548bce7f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.496975 Oct 04 21:30:13.151411 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2462/4889] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:12 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:13.172048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ea1090e0-e600-444b-84cf-5efba223a5c5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:13.172672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ea1090e0-e600-444b-84cf-5efba223a5c5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:13.202405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea1090e0-e600-444b-84cf-5efba223a5c5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:13.202911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea1090e0-e600-444b-84cf-5efba223a5c5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:13.207530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea1090e0-e600-444b-84cf-5efba223a5c5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:13.215274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea1090e0-e600-444b-84cf-5efba223a5c5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:13.216198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea1090e0-e600-444b-84cf-5efba223a5c5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:13.216866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea1090e0-e600-444b-84cf-5efba223a5c5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:13.235888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e7583fc1-35fc-4d13-8406-ddd2457ba7c4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:13.260969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e7583fc1-35fc-4d13-8406-ddd2457ba7c4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:13.264138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e7583fc1-35fc-4d13-8406-ddd2457ba7c4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:13.270264 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e7583fc1-35fc-4d13-8406-ddd2457ba7c4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba401ec-5056-44df-8255-49786814ccf9" status: 200 len: 1278 microversion: 2.47 time: 0.240234 Oct 04 21:30:13.270875 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2428/4890] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:13 2022] GET /compute/v2.1/servers/4ba401ec-5056-44df-8255-49786814ccf9 => generated 1278 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:13.287346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-91d20b5e-5b06-4196-9d5c-904dd8cee75e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:13.288212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-91d20b5e-5b06-4196-9d5c-904dd8cee75e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:13.322042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91d20b5e-5b06-4196-9d5c-904dd8cee75e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:13.324971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91d20b5e-5b06-4196-9d5c-904dd8cee75e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:13.328385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91d20b5e-5b06-4196-9d5c-904dd8cee75e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:13.329517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91d20b5e-5b06-4196-9d5c-904dd8cee75e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:13.330178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91d20b5e-5b06-4196-9d5c-904dd8cee75e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:13.330775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91d20b5e-5b06-4196-9d5c-904dd8cee75e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:13.742704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-91d20b5e-5b06-4196-9d5c-904dd8cee75e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:13.755894 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-91d20b5e-5b06-4196-9d5c-904dd8cee75e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1528 microversion: 2.1 time: 0.481052 Oct 04 21:30:13.758608 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2429/4891] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:13 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1528 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:13.765853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ea1090e0-e600-444b-84cf-5efba223a5c5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:13.769101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ca4835b3-bce7-48e9-a5e9-f5d0c0f0d303 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1734186160", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": "none"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:13.793516 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ea1090e0-e600-444b-84cf-5efba223a5c5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41" status: 200 len: 1321 microversion: 2.1 time: 0.639577 Oct 04 21:30:13.800645 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2463/4892] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:13 2022] GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 => generated 1321 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:13.808426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f246585d-ce74-49b1-aea2-36f49994a993 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:13.808959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f246585d-ce74-49b1-aea2-36f49994a993 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:13.852034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f246585d-ce74-49b1-aea2-36f49994a993 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:13.853614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f246585d-ce74-49b1-aea2-36f49994a993 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:13.855087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f246585d-ce74-49b1-aea2-36f49994a993 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:13.857362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f246585d-ce74-49b1-aea2-36f49994a993 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:13.858951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f246585d-ce74-49b1-aea2-36f49994a993 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:13.861578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ca4835b3-bce7-48e9-a5e9-f5d0c0f0d303 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:30:13.862025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f246585d-ce74-49b1-aea2-36f49994a993 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:13.862156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ca4835b3-bce7-48e9-a5e9-f5d0c0f0d303 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:30:13.862467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ca4835b3-bce7-48e9-a5e9-f5d0c0f0d303 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:30:13.863073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ca4835b3-bce7-48e9-a5e9-f5d0c0f0d303 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:30:13.863667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ca4835b3-bce7-48e9-a5e9-f5d0c0f0d303 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:30:13.874584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca4835b3-bce7-48e9-a5e9-f5d0c0f0d303 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:13.875412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca4835b3-bce7-48e9-a5e9-f5d0c0f0d303 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:13.876059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca4835b3-bce7-48e9-a5e9-f5d0c0f0d303 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:13.880720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca4835b3-bce7-48e9-a5e9-f5d0c0f0d303 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:13.880720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca4835b3-bce7-48e9-a5e9-f5d0c0f0d303 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:13.880720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca4835b3-bce7-48e9-a5e9-f5d0c0f0d303 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:13.910474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ca4835b3-bce7-48e9-a5e9-f5d0c0f0d303 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Getting quotas for project 5308e8f8d3714caebcf21c76211de44d. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:30:13.935711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ca4835b3-bce7-48e9-a5e9-f5d0c0f0d303 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Getting quotas for user f6931e7717dc44b0b25454266c315ac9 and project 5308e8f8d3714caebcf21c76211de44d. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:30:14.013511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f246585d-ce74-49b1-aea2-36f49994a993 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:14.027504 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f246585d-ce74-49b1-aea2-36f49994a993 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 200 len: 1299 microversion: 2.1 time: 0.225729 Oct 04 21:30:14.031923 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2464/4893] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:13 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 1299 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:14.048119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ca4835b3-bce7-48e9-a5e9-f5d0c0f0d303 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:30:14.052895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-20af291b-0620-4bcb-b8eb-31915eeef5ff req-ef523a35-f215-4be1-8bf9-1d69fef4cc29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd27d01e-c242-427c-bed3-52c8711a5f41", "tag": "de87e1af-a11a-4d67-a675-7f0d93fe0ed0"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:14.054524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ca4835b3-bce7-48e9-a5e9-f5d0c0f0d303 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:30:14.073980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-20af291b-0620-4bcb-b8eb-31915eeef5ff req-ef523a35-f215-4be1-8bf9-1d69fef4cc29 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:14.073980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-20af291b-0620-4bcb-b8eb-31915eeef5ff req-ef523a35-f215-4be1-8bf9-1d69fef4cc29 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:14.081088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-20af291b-0620-4bcb-b8eb-31915eeef5ff req-ef523a35-f215-4be1-8bf9-1d69fef4cc29 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:14.117592 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-20af291b-0620-4bcb-b8eb-31915eeef5ff req-ef523a35-f215-4be1-8bf9-1d69fef4cc29 service nova] Creating event network-changed:de87e1af-a11a-4d67-a675-7f0d93fe0ed0 for instance dd27d01e-c242-427c-bed3-52c8711a5f41 on n-h1-860282-1 Oct 04 21:30:14.129561 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-20af291b-0620-4bcb-b8eb-31915eeef5ff req-ef523a35-f215-4be1-8bf9-1d69fef4cc29 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096178 Oct 04 21:30:14.133781 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2465/4894] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:14.188659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0dba8dcd-0e5a-4437-9089-e93722edaa95 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:14.189772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0dba8dcd-0e5a-4437-9089-e93722edaa95 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:14.199158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0dba8dcd-0e5a-4437-9089-e93722edaa95 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:14.199916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0dba8dcd-0e5a-4437-9089-e93722edaa95 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:14.200587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0dba8dcd-0e5a-4437-9089-e93722edaa95 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:14.201630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0dba8dcd-0e5a-4437-9089-e93722edaa95 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:14.202853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0dba8dcd-0e5a-4437-9089-e93722edaa95 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:14.203798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0dba8dcd-0e5a-4437-9089-e93722edaa95 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:14.223557 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ca4835b3-bce7-48e9-a5e9-f5d0c0f0d303 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.459795 Oct 04 21:30:14.225126 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2430/4895] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Oct 4 21:30:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:30:14.254237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-307f1038-a788-4b37-acae-4ef587cf6f8c tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:14.262532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-307f1038-a788-4b37-acae-4ef587cf6f8c tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:14.336640 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-307f1038-a788-4b37-acae-4ef587cf6f8c tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "PUT /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 992 microversion: 2.47 time: 0.097298 Oct 04 21:30:14.351299 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2431/4896] 10.222.0.30 () {62 vars in 1297 bytes} [Tue Oct 4 21:30:14 2022] PUT /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 992 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:30:14.367016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1dc88aa6-420e-49b7-b438-f7e587ae96e5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:14.369884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1dc88aa6-420e-49b7-b438-f7e587ae96e5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:14.956817 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1dc88aa6-420e-49b7-b438-f7e587ae96e5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:14.966491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1dc88aa6-420e-49b7-b438-f7e587ae96e5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:14.975490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1dc88aa6-420e-49b7-b438-f7e587ae96e5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:14.982566 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1dc88aa6-420e-49b7-b438-f7e587ae96e5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1278 microversion: 2.47 time: 0.623762 Oct 04 21:30:14.984252 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2432/4897] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:14 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1278 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:30:14.995632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-215c5667-e16b-4e07-857e-55f14c27cf55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:15.021405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-215c5667-e16b-4e07-857e-55f14c27cf55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:15.039321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215c5667-e16b-4e07-857e-55f14c27cf55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:15.049051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215c5667-e16b-4e07-857e-55f14c27cf55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:15.049804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215c5667-e16b-4e07-857e-55f14c27cf55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:15.052355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215c5667-e16b-4e07-857e-55f14c27cf55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:15.052986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215c5667-e16b-4e07-857e-55f14c27cf55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:15.054113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215c5667-e16b-4e07-857e-55f14c27cf55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:15.643244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0dba8dcd-0e5a-4437-9089-e93722edaa95 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:15.655617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0dba8dcd-0e5a-4437-9089-e93722edaa95 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:15.673555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0dba8dcd-0e5a-4437-9089-e93722edaa95 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:15.675004 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0dba8dcd-0e5a-4437-9089-e93722edaa95 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 1.494978 Oct 04 21:30:15.690566 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2466/4898] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:14 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:30:15.714862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4de11cbd-81f6-49e6-857e-1348cc82e10f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:15.718986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4de11cbd-81f6-49e6-857e-1348cc82e10f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:15.738667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4de11cbd-81f6-49e6-857e-1348cc82e10f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:15.739744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4de11cbd-81f6-49e6-857e-1348cc82e10f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:15.740543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4de11cbd-81f6-49e6-857e-1348cc82e10f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:15.741440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4de11cbd-81f6-49e6-857e-1348cc82e10f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:15.742061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4de11cbd-81f6-49e6-857e-1348cc82e10f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:15.744128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4de11cbd-81f6-49e6-857e-1348cc82e10f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:16.324824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-215c5667-e16b-4e07-857e-55f14c27cf55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:16.353544 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-215c5667-e16b-4e07-857e-55f14c27cf55 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1528 microversion: 2.1 time: 1.363492 Oct 04 21:30:16.364167 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2433/4899] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:14 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1528 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:16.377821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fb5160b4-5526-44bd-8723-e300a0fe7876 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:16.387282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fb5160b4-5526-44bd-8723-e300a0fe7876 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:16.409781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb5160b4-5526-44bd-8723-e300a0fe7876 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:16.422328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb5160b4-5526-44bd-8723-e300a0fe7876 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:16.423068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb5160b4-5526-44bd-8723-e300a0fe7876 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:16.428039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb5160b4-5526-44bd-8723-e300a0fe7876 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:16.428774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb5160b4-5526-44bd-8723-e300a0fe7876 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:16.430228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb5160b4-5526-44bd-8723-e300a0fe7876 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:16.706129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4de11cbd-81f6-49e6-857e-1348cc82e10f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:16.719815 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4de11cbd-81f6-49e6-857e-1348cc82e10f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41" status: 200 len: 1321 microversion: 2.1 time: 1.027436 Oct 04 21:30:16.721145 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2467/4900] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:15 2022] GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 => generated 1321 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:16.728522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-52da2d01-7640-4e3c-a7e1-12478b4bee2e req-0fffb075-d11c-4690-9088-026c3458a38c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "name": "network-vif-plugged", "status": "completed", "tag": "ce41b261-1a55-4261-a0af-98d834d3178a"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:16.760881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-52da2d01-7640-4e3c-a7e1-12478b4bee2e req-0fffb075-d11c-4690-9088-026c3458a38c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:16.762486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-52da2d01-7640-4e3c-a7e1-12478b4bee2e req-0fffb075-d11c-4690-9088-026c3458a38c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:16.763201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-52da2d01-7640-4e3c-a7e1-12478b4bee2e req-0fffb075-d11c-4690-9088-026c3458a38c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:16.782392 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-52da2d01-7640-4e3c-a7e1-12478b4bee2e req-0fffb075-d11c-4690-9088-026c3458a38c service nova] Creating event network-vif-plugged:ce41b261-1a55-4261-a0af-98d834d3178a for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:30:16.788696 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-52da2d01-7640-4e3c-a7e1-12478b4bee2e req-0fffb075-d11c-4690-9088-026c3458a38c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065864 Oct 04 21:30:16.790209 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2468/4901] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:16.800107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-59e7df1f-dc65-4be7-bf07-1e1d90dfef89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:16.801638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-59e7df1f-dc65-4be7-bf07-1e1d90dfef89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:16.810441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59e7df1f-dc65-4be7-bf07-1e1d90dfef89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:16.813071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59e7df1f-dc65-4be7-bf07-1e1d90dfef89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:16.813232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fb5160b4-5526-44bd-8723-e300a0fe7876 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:16.814440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59e7df1f-dc65-4be7-bf07-1e1d90dfef89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:16.815452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59e7df1f-dc65-4be7-bf07-1e1d90dfef89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:16.816326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59e7df1f-dc65-4be7-bf07-1e1d90dfef89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:16.816995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59e7df1f-dc65-4be7-bf07-1e1d90dfef89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:16.822769 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fb5160b4-5526-44bd-8723-e300a0fe7876 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 200 len: 1305 microversion: 2.1 time: 0.457309 Oct 04 21:30:16.843822 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2434/4902] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:16 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 1305 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:16.855822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-90500801-4131-4f44-9d15-56b201eaefee tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:16.857290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-90500801-4131-4f44-9d15-56b201eaefee tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:16.875752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90500801-4131-4f44-9d15-56b201eaefee tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:16.875752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90500801-4131-4f44-9d15-56b201eaefee tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:16.876153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90500801-4131-4f44-9d15-56b201eaefee tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:16.877090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90500801-4131-4f44-9d15-56b201eaefee tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:16.877789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90500801-4131-4f44-9d15-56b201eaefee tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:16.878855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90500801-4131-4f44-9d15-56b201eaefee tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:17.022386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-59e7df1f-dc65-4be7-bf07-1e1d90dfef89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:17.057990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-59e7df1f-dc65-4be7-bf07-1e1d90dfef89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:17.062422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-59e7df1f-dc65-4be7-bf07-1e1d90dfef89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:17.065802 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-59e7df1f-dc65-4be7-bf07-1e1d90dfef89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1282 microversion: 2.47 time: 0.273632 Oct 04 21:30:17.068402 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2469/4903] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:16 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1282 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:17.392731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cbe8023f-e5f9-4068-a626-9b4234e2d21c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:17.393367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cbe8023f-e5f9-4068-a626-9b4234e2d21c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:17.415933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cbe8023f-e5f9-4068-a626-9b4234e2d21c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:17.418263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cbe8023f-e5f9-4068-a626-9b4234e2d21c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:17.421917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cbe8023f-e5f9-4068-a626-9b4234e2d21c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:17.423945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cbe8023f-e5f9-4068-a626-9b4234e2d21c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:17.432305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cbe8023f-e5f9-4068-a626-9b4234e2d21c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:17.432733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cbe8023f-e5f9-4068-a626-9b4234e2d21c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:17.831245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-90500801-4131-4f44-9d15-56b201eaefee tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:17.846066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-90500801-4131-4f44-9d15-56b201eaefee tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:17.849500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-90500801-4131-4f44-9d15-56b201eaefee tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:17.851160 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-90500801-4131-4f44-9d15-56b201eaefee tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 1.006227 Oct 04 21:30:17.852279 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2435/4904] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:16 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:17.857796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-397d9dc8-e227-4df0-bf11-e63fc77d57e4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:17.858640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-397d9dc8-e227-4df0-bf11-e63fc77d57e4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:17.873968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-397d9dc8-e227-4df0-bf11-e63fc77d57e4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:17.874497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-397d9dc8-e227-4df0-bf11-e63fc77d57e4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:17.874947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-397d9dc8-e227-4df0-bf11-e63fc77d57e4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:17.876127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-397d9dc8-e227-4df0-bf11-e63fc77d57e4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:17.876884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-397d9dc8-e227-4df0-bf11-e63fc77d57e4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:17.878906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-397d9dc8-e227-4df0-bf11-e63fc77d57e4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:18.054222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cbe8023f-e5f9-4068-a626-9b4234e2d21c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:18.056718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:18.072343 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cbe8023f-e5f9-4068-a626-9b4234e2d21c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1528 microversion: 2.1 time: 0.686385 Oct 04 21:30:18.073344 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2470/4905] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:17 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1528 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:30:18.085990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-29dd8350-4484-4442-b620-df228788d042 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:18.086964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-29dd8350-4484-4442-b620-df228788d042 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:18.099432 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29dd8350-4484-4442-b620-df228788d042 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:18.099956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29dd8350-4484-4442-b620-df228788d042 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:18.100401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29dd8350-4484-4442-b620-df228788d042 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:18.101172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29dd8350-4484-4442-b620-df228788d042 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:18.101757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29dd8350-4484-4442-b620-df228788d042 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:18.102379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29dd8350-4484-4442-b620-df228788d042 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:18.160085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-397d9dc8-e227-4df0-bf11-e63fc77d57e4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:18.176333 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-397d9dc8-e227-4df0-bf11-e63fc77d57e4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41" status: 200 len: 1321 microversion: 2.1 time: 0.320260 Oct 04 21:30:18.177341 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2436/4906] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:17 2022] GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:18.194270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6422618b-67f6-41f5-b9b0-a0049f8cf75d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:18.207335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6422618b-67f6-41f5-b9b0-a0049f8cf75d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:18.232801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6422618b-67f6-41f5-b9b0-a0049f8cf75d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:18.234540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6422618b-67f6-41f5-b9b0-a0049f8cf75d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:18.235268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6422618b-67f6-41f5-b9b0-a0049f8cf75d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:18.237060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6422618b-67f6-41f5-b9b0-a0049f8cf75d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:18.239257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6422618b-67f6-41f5-b9b0-a0049f8cf75d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:18.241903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6422618b-67f6-41f5-b9b0-a0049f8cf75d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:18.470150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6422618b-67f6-41f5-b9b0-a0049f8cf75d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:18.505003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6422618b-67f6-41f5-b9b0-a0049f8cf75d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:18.514785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6422618b-67f6-41f5-b9b0-a0049f8cf75d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:18.525821 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6422618b-67f6-41f5-b9b0-a0049f8cf75d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1274 microversion: 2.47 time: 0.339180 Oct 04 21:30:18.527113 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2437/4907] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:18 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1274 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:18.665959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-29dd8350-4484-4442-b620-df228788d042 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:18.677072 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-29dd8350-4484-4442-b620-df228788d042 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 200 len: 1373 microversion: 2.1 time: 0.598354 Oct 04 21:30:18.679513 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2471/4908] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:18 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 1373 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:18.831059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-4c9d9714-f063-4d0d-94dc-603b3f7e0363 req-51a18595-a9cb-4732-ac1d-a7d7fc7786f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "name": "network-vif-plugged", "status": "completed", "tag": "a034a9b0-c92a-4d81-bced-4e3be86dabfe"}, {"server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "name": "network-vif-plugged", "status": "completed", "tag": "7be12e96-c1eb-431c-880c-1656a2d42226"}, {"server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "name": "network-vif-plugged", "status": "completed", "tag": "02286074-41e4-4d16-8a7a-59c1ece211dc"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:18.860682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4c9d9714-f063-4d0d-94dc-603b3f7e0363 req-51a18595-a9cb-4732-ac1d-a7d7fc7786f8 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:18.861319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4c9d9714-f063-4d0d-94dc-603b3f7e0363 req-51a18595-a9cb-4732-ac1d-a7d7fc7786f8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:18.861647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4c9d9714-f063-4d0d-94dc-603b3f7e0363 req-51a18595-a9cb-4732-ac1d-a7d7fc7786f8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:18.891067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0d91fc82-605b-4be5-ae0e-2ffdaf966507 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:18.892143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0d91fc82-605b-4be5-ae0e-2ffdaf966507 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:18.912160 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-4c9d9714-f063-4d0d-94dc-603b3f7e0363 req-51a18595-a9cb-4732-ac1d-a7d7fc7786f8 service nova] Creating event network-vif-plugged:a034a9b0-c92a-4d81-bced-4e3be86dabfe for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:30:18.918195 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-4c9d9714-f063-4d0d-94dc-603b3f7e0363 req-51a18595-a9cb-4732-ac1d-a7d7fc7786f8 service nova] Creating event network-vif-plugged:7be12e96-c1eb-431c-880c-1656a2d42226 for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:30:18.918195 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-4c9d9714-f063-4d0d-94dc-603b3f7e0363 req-51a18595-a9cb-4732-ac1d-a7d7fc7786f8 service nova] Creating event network-vif-plugged:02286074-41e4-4d16-8a7a-59c1ece211dc for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:30:18.918937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d91fc82-605b-4be5-ae0e-2ffdaf966507 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:18.918937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d91fc82-605b-4be5-ae0e-2ffdaf966507 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:18.919202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d91fc82-605b-4be5-ae0e-2ffdaf966507 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:18.923456 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d91fc82-605b-4be5-ae0e-2ffdaf966507 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:18.926659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d91fc82-605b-4be5-ae0e-2ffdaf966507 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:18.927304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d91fc82-605b-4be5-ae0e-2ffdaf966507 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:18.984128 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-4c9d9714-f063-4d0d-94dc-603b3f7e0363 req-51a18595-a9cb-4732-ac1d-a7d7fc7786f8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.152929 Oct 04 21:30:18.991948 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2438/4909] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:19.115091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b987b098-23d3-4699-899b-d3cadd8fe316 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:19.118837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b987b098-23d3-4699-899b-d3cadd8fe316 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:19.149460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b987b098-23d3-4699-899b-d3cadd8fe316 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:19.152511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b987b098-23d3-4699-899b-d3cadd8fe316 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:19.156557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b987b098-23d3-4699-899b-d3cadd8fe316 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:19.156557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b987b098-23d3-4699-899b-d3cadd8fe316 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:19.156882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b987b098-23d3-4699-899b-d3cadd8fe316 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:19.157272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b987b098-23d3-4699-899b-d3cadd8fe316 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:19.953458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b987b098-23d3-4699-899b-d3cadd8fe316 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:19.986016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0d91fc82-605b-4be5-ae0e-2ffdaf966507 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:19.987336 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b987b098-23d3-4699-899b-d3cadd8fe316 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1528 microversion: 2.1 time: 0.887496 Oct 04 21:30:19.990884 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2439/4910] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:19 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1528 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:30:20.004171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0d91fc82-605b-4be5-ae0e-2ffdaf966507 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:20.007101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0d91fc82-605b-4be5-ae0e-2ffdaf966507 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:20.007936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-01f67be0-493f-481b-a615-9034e2af38c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:20.010818 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0d91fc82-605b-4be5-ae0e-2ffdaf966507 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 1.126478 Oct 04 21:30:20.027598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-01f67be0-493f-481b-a615-9034e2af38c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:20.027974 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2472/4911] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:18 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:30:20.027974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ec0215cc-b275-45b4-8596-2f71f9f6f105 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:20.027974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ec0215cc-b275-45b4-8596-2f71f9f6f105 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:20.028213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01f67be0-493f-481b-a615-9034e2af38c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:20.031571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01f67be0-493f-481b-a615-9034e2af38c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:20.032082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01f67be0-493f-481b-a615-9034e2af38c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:20.032844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01f67be0-493f-481b-a615-9034e2af38c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:20.035464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01f67be0-493f-481b-a615-9034e2af38c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:20.035937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01f67be0-493f-481b-a615-9034e2af38c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:20.040523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec0215cc-b275-45b4-8596-2f71f9f6f105 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:20.042006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec0215cc-b275-45b4-8596-2f71f9f6f105 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:20.043697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec0215cc-b275-45b4-8596-2f71f9f6f105 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:20.049922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec0215cc-b275-45b4-8596-2f71f9f6f105 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:20.050718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec0215cc-b275-45b4-8596-2f71f9f6f105 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:20.051367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec0215cc-b275-45b4-8596-2f71f9f6f105 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:20.256304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:20.283435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ec0215cc-b275-45b4-8596-2f71f9f6f105 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:20.318467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=14 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:20.335374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ec0215cc-b275-45b4-8596-2f71f9f6f105 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:20.341671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ec0215cc-b275-45b4-8596-2f71f9f6f105 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:20.345414 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ec0215cc-b275-45b4-8596-2f71f9f6f105 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1338 microversion: 2.47 time: 0.331777 Oct 04 21:30:20.368723 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2473/4912] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:20 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1338 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:20.376421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5b1076ec-a192-4175-ba70-79834f4f371e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:20.377326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5b1076ec-a192-4175-ba70-79834f4f371e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:20.392604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b1076ec-a192-4175-ba70-79834f4f371e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:20.393473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b1076ec-a192-4175-ba70-79834f4f371e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:20.394438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b1076ec-a192-4175-ba70-79834f4f371e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:20.395385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b1076ec-a192-4175-ba70-79834f4f371e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:20.396114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b1076ec-a192-4175-ba70-79834f4f371e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:20.396758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b1076ec-a192-4175-ba70-79834f4f371e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:20.463618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-01f67be0-493f-481b-a615-9034e2af38c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:20.476316 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-01f67be0-493f-481b-a615-9034e2af38c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41" status: 200 len: 1321 microversion: 2.1 time: 0.483172 Oct 04 21:30:20.498271 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2440/4913] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:19 2022] GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 => generated 1321 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:20.740880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5b1076ec-a192-4175-ba70-79834f4f371e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:20.751157 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5b1076ec-a192-4175-ba70-79834f4f371e tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 200 len: 1373 microversion: 2.1 time: 0.378876 Oct 04 21:30:20.756161 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2474/4914] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:20 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 1373 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:21.016550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e435dbea-412f-45a2-a306-203c0ec15900 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:21.017146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e435dbea-412f-45a2-a306-203c0ec15900 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:21.030948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e435dbea-412f-45a2-a306-203c0ec15900 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:21.030948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e435dbea-412f-45a2-a306-203c0ec15900 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:21.030948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e435dbea-412f-45a2-a306-203c0ec15900 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:21.037238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e435dbea-412f-45a2-a306-203c0ec15900 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:21.038170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e435dbea-412f-45a2-a306-203c0ec15900 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:21.038620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e435dbea-412f-45a2-a306-203c0ec15900 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:21.058099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a9286c54-ef2c-4708-88e4-01a69dd01f3f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:21.058882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a9286c54-ef2c-4708-88e4-01a69dd01f3f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:21.077693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9286c54-ef2c-4708-88e4-01a69dd01f3f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:21.078501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9286c54-ef2c-4708-88e4-01a69dd01f3f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:21.086255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9286c54-ef2c-4708-88e4-01a69dd01f3f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:21.087129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9286c54-ef2c-4708-88e4-01a69dd01f3f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:21.087687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9286c54-ef2c-4708-88e4-01a69dd01f3f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:21.094367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9286c54-ef2c-4708-88e4-01a69dd01f3f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:21.485227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e435dbea-412f-45a2-a306-203c0ec15900 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:21.507074 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e435dbea-412f-45a2-a306-203c0ec15900 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1528 microversion: 2.1 time: 0.493974 Oct 04 21:30:21.510905 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2441/4915] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:21 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1528 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:21.523021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-85e87797-e909-4aec-b628-6020f80b642f req-2845fc5e-d7fd-464e-9c28-060630e67f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "name": "network-vif-plugged", "status": "completed", "tag": "894d7765-eae0-4e33-8784-9f8532801474"}, {"server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "name": "network-vif-plugged", "status": "completed", "tag": "462dd518-2956-4aa9-94c8-c6a32d3a0b42"}, {"server_uuid": "dd27d01e-c242-427c-bed3-52c8711a5f41", "name": "network-vif-plugged", "status": "completed", "tag": "de87e1af-a11a-4d67-a675-7f0d93fe0ed0"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:21.569858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-85e87797-e909-4aec-b628-6020f80b642f req-2845fc5e-d7fd-464e-9c28-060630e67f14 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:21.570861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-85e87797-e909-4aec-b628-6020f80b642f req-2845fc5e-d7fd-464e-9c28-060630e67f14 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:21.571558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-85e87797-e909-4aec-b628-6020f80b642f req-2845fc5e-d7fd-464e-9c28-060630e67f14 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:21.605222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:21.616081 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-85e87797-e909-4aec-b628-6020f80b642f req-2845fc5e-d7fd-464e-9c28-060630e67f14 service nova] Creating event network-vif-plugged:894d7765-eae0-4e33-8784-9f8532801474 for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:30:21.616684 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-85e87797-e909-4aec-b628-6020f80b642f req-2845fc5e-d7fd-464e-9c28-060630e67f14 service nova] Creating event network-vif-plugged:462dd518-2956-4aa9-94c8-c6a32d3a0b42 for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:30:21.617281 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-85e87797-e909-4aec-b628-6020f80b642f req-2845fc5e-d7fd-464e-9c28-060630e67f14 service nova] Creating event network-vif-plugged:de87e1af-a11a-4d67-a675-7f0d93fe0ed0 for instance dd27d01e-c242-427c-bed3-52c8711a5f41 on n-h1-860282-1 Oct 04 21:30:21.643292 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-85e87797-e909-4aec-b628-6020f80b642f req-2845fc5e-d7fd-464e-9c28-060630e67f14 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.130614 Oct 04 21:30:21.644123 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2442/4916] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:21.649732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-33b60b6d-8001-4625-baca-3e2d2b892370 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:21.650443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-33b60b6d-8001-4625-baca-3e2d2b892370 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:21.670767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33b60b6d-8001-4625-baca-3e2d2b892370 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:21.671422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33b60b6d-8001-4625-baca-3e2d2b892370 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:21.672153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33b60b6d-8001-4625-baca-3e2d2b892370 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:21.672881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33b60b6d-8001-4625-baca-3e2d2b892370 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:21.673941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33b60b6d-8001-4625-baca-3e2d2b892370 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:21.686908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33b60b6d-8001-4625-baca-3e2d2b892370 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:21.737662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a9286c54-ef2c-4708-88e4-01a69dd01f3f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:21.748147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a9286c54-ef2c-4708-88e4-01a69dd01f3f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:21.750782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a9286c54-ef2c-4708-88e4-01a69dd01f3f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:21.753252 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a9286c54-ef2c-4708-88e4-01a69dd01f3f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.699447 Oct 04 21:30:21.754662 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2475/4917] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:21 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:21.767439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-15ad77fd-4bab-4db0-bfd5-12c0b464f2ad req-9dfb9ddc-2cb7-457c-a668-9d1eb73f8570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "090f4719-1122-427c-b849-7c1865ac1ff5", "tag": "d0935e96-259f-4617-85cd-eac52e8c9e52"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:21.784510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-15ad77fd-4bab-4db0-bfd5-12c0b464f2ad req-9dfb9ddc-2cb7-457c-a668-9d1eb73f8570 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:21.785718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-15ad77fd-4bab-4db0-bfd5-12c0b464f2ad req-9dfb9ddc-2cb7-457c-a668-9d1eb73f8570 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:21.786299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-15ad77fd-4bab-4db0-bfd5-12c0b464f2ad req-9dfb9ddc-2cb7-457c-a668-9d1eb73f8570 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:21.800407 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-15ad77fd-4bab-4db0-bfd5-12c0b464f2ad req-9dfb9ddc-2cb7-457c-a668-9d1eb73f8570 service nova] Creating event network-changed:d0935e96-259f-4617-85cd-eac52e8c9e52 for instance 090f4719-1122-427c-b849-7c1865ac1ff5 on n-h2-860282-1 Oct 04 21:30:21.823310 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-15ad77fd-4bab-4db0-bfd5-12c0b464f2ad req-9dfb9ddc-2cb7-457c-a668-9d1eb73f8570 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066991 Oct 04 21:30:21.827246 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2476/4918] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:21.843017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-630ae707-2972-438c-aa09-62283150f22c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:21.846414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-630ae707-2972-438c-aa09-62283150f22c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:21.862503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-33b60b6d-8001-4625-baca-3e2d2b892370 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:21.872264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-630ae707-2972-438c-aa09-62283150f22c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:21.875245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-630ae707-2972-438c-aa09-62283150f22c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:21.877354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-33b60b6d-8001-4625-baca-3e2d2b892370 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:21.878073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-630ae707-2972-438c-aa09-62283150f22c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:21.878865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-630ae707-2972-438c-aa09-62283150f22c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:21.880429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-630ae707-2972-438c-aa09-62283150f22c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:21.884261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-630ae707-2972-438c-aa09-62283150f22c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:21.886849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-33b60b6d-8001-4625-baca-3e2d2b892370 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:21.894748 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-33b60b6d-8001-4625-baca-3e2d2b892370 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1336 microversion: 2.47 time: 0.249075 Oct 04 21:30:21.897635 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2443/4919] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:21 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1336 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:21.926428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e491f8cf-b8c1-4674-89ae-b9e978c6fab5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:21.927695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e491f8cf-b8c1-4674-89ae-b9e978c6fab5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:21.951975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e491f8cf-b8c1-4674-89ae-b9e978c6fab5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:21.955609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e491f8cf-b8c1-4674-89ae-b9e978c6fab5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:21.956331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e491f8cf-b8c1-4674-89ae-b9e978c6fab5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:21.957399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e491f8cf-b8c1-4674-89ae-b9e978c6fab5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:21.958623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e491f8cf-b8c1-4674-89ae-b9e978c6fab5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:21.959315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e491f8cf-b8c1-4674-89ae-b9e978c6fab5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:22.710527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e491f8cf-b8c1-4674-89ae-b9e978c6fab5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:22.733646 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e491f8cf-b8c1-4674-89ae-b9e978c6fab5 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 200 len: 1373 microversion: 2.1 time: 0.823865 Oct 04 21:30:22.749141 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2444/4920] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:21 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 1373 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:22.756387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d8d80961-c804-427e-87af-04ef7e99a0fb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:22.757746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d8d80961-c804-427e-87af-04ef7e99a0fb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:22.781759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8d80961-c804-427e-87af-04ef7e99a0fb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:22.782413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8d80961-c804-427e-87af-04ef7e99a0fb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:22.786066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8d80961-c804-427e-87af-04ef7e99a0fb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:22.786995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8d80961-c804-427e-87af-04ef7e99a0fb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:22.787845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8d80961-c804-427e-87af-04ef7e99a0fb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:22.788380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8d80961-c804-427e-87af-04ef7e99a0fb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:22.950478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-630ae707-2972-438c-aa09-62283150f22c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:22.965170 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-630ae707-2972-438c-aa09-62283150f22c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41" status: 200 len: 1321 microversion: 2.1 time: 1.133726 Oct 04 21:30:22.967756 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2477/4921] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:21 2022] GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 => generated 1321 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:22.983135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-814c76af-b603-46eb-a3c5-f458d0ae47f2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:22.984344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-814c76af-b603-46eb-a3c5-f458d0ae47f2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:22.987006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:23.004861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-814c76af-b603-46eb-a3c5-f458d0ae47f2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:23.006207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-814c76af-b603-46eb-a3c5-f458d0ae47f2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:23.007952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-814c76af-b603-46eb-a3c5-f458d0ae47f2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:23.008904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-814c76af-b603-46eb-a3c5-f458d0ae47f2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:23.013274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-814c76af-b603-46eb-a3c5-f458d0ae47f2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:23.013884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-814c76af-b603-46eb-a3c5-f458d0ae47f2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:23.510109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d8d80961-c804-427e-87af-04ef7e99a0fb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:23.564047 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d8d80961-c804-427e-87af-04ef7e99a0fb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1528 microversion: 2.1 time: 0.813123 Oct 04 21:30:23.594019 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2445/4922] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:22 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1528 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:23.598284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0230657c-ce5f-438a-84e4-f27b0bdcac56 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:23.600297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0230657c-ce5f-438a-84e4-f27b0bdcac56 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:23.619558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0230657c-ce5f-438a-84e4-f27b0bdcac56 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:23.620628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0230657c-ce5f-438a-84e4-f27b0bdcac56 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:23.621184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0230657c-ce5f-438a-84e4-f27b0bdcac56 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:23.622061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0230657c-ce5f-438a-84e4-f27b0bdcac56 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:23.622706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0230657c-ce5f-438a-84e4-f27b0bdcac56 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:23.623825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0230657c-ce5f-438a-84e4-f27b0bdcac56 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:23.693319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-814c76af-b603-46eb-a3c5-f458d0ae47f2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:23.722463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-814c76af-b603-46eb-a3c5-f458d0ae47f2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:23.724621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-814c76af-b603-46eb-a3c5-f458d0ae47f2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:23.726834 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-814c76af-b603-46eb-a3c5-f458d0ae47f2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.757210 Oct 04 21:30:23.729111 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2478/4923] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:22 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:23.754584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-7d09e6d4-3fa2-41e7-a04e-8f493b4b5be8 req-22f2ba9f-3793-45ac-88dd-c9c4b5c9686e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "name": "network-vif-plugged", "status": "completed", "tag": "3f36f0e8-027a-49e9-b359-7053dd5e96b7"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:23.766975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7d09e6d4-3fa2-41e7-a04e-8f493b4b5be8 req-22f2ba9f-3793-45ac-88dd-c9c4b5c9686e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:23.767699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7d09e6d4-3fa2-41e7-a04e-8f493b4b5be8 req-22f2ba9f-3793-45ac-88dd-c9c4b5c9686e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:23.768384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7d09e6d4-3fa2-41e7-a04e-8f493b4b5be8 req-22f2ba9f-3793-45ac-88dd-c9c4b5c9686e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:23.781865 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-7d09e6d4-3fa2-41e7-a04e-8f493b4b5be8 req-22f2ba9f-3793-45ac-88dd-c9c4b5c9686e service nova] Creating event network-vif-plugged:3f36f0e8-027a-49e9-b359-7053dd5e96b7 for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:30:23.786143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0230657c-ce5f-438a-84e4-f27b0bdcac56 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:23.802553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0230657c-ce5f-438a-84e4-f27b0bdcac56 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:23.804000 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-7d09e6d4-3fa2-41e7-a04e-8f493b4b5be8 req-22f2ba9f-3793-45ac-88dd-c9c4b5c9686e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072122 Oct 04 21:30:23.804140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0230657c-ce5f-438a-84e4-f27b0bdcac56 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:23.805238 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0230657c-ce5f-438a-84e4-f27b0bdcac56 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1336 microversion: 2.47 time: 0.223172 Oct 04 21:30:23.813653 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2479/4924] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:23.831923 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2446/4925] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:23 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1336 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:23.833664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-45fd7235-cdbc-4580-9a15-c5e4371a3033 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:23.838493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-45fd7235-cdbc-4580-9a15-c5e4371a3033 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:23.896873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45fd7235-cdbc-4580-9a15-c5e4371a3033 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:23.908448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45fd7235-cdbc-4580-9a15-c5e4371a3033 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:23.908925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45fd7235-cdbc-4580-9a15-c5e4371a3033 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:23.909711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45fd7235-cdbc-4580-9a15-c5e4371a3033 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:23.912329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45fd7235-cdbc-4580-9a15-c5e4371a3033 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:23.915933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45fd7235-cdbc-4580-9a15-c5e4371a3033 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:24.007713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f617e086-895e-45b8-8aae-942e8c627098 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:24.008480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f617e086-895e-45b8-8aae-942e8c627098 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:24.010595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:24.022400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f617e086-895e-45b8-8aae-942e8c627098 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:24.023762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f617e086-895e-45b8-8aae-942e8c627098 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:24.024379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f617e086-895e-45b8-8aae-942e8c627098 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:24.025293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f617e086-895e-45b8-8aae-942e8c627098 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:24.025993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f617e086-895e-45b8-8aae-942e8c627098 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:24.026587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f617e086-895e-45b8-8aae-942e8c627098 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:24.246380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-45fd7235-cdbc-4580-9a15-c5e4371a3033 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:24.270469 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-45fd7235-cdbc-4580-9a15-c5e4371a3033 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 200 len: 1373 microversion: 2.1 time: 0.456901 Oct 04 21:30:24.271902 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2480/4926] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:23 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 1373 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:24.292850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f617e086-895e-45b8-8aae-942e8c627098 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:24.306287 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f617e086-895e-45b8-8aae-942e8c627098 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41" status: 200 len: 1321 microversion: 2.1 time: 0.314298 Oct 04 21:30:24.309494 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2447/4927] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:23 2022] GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:24.614632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-90f35d3d-1303-449f-aca2-d34041c0dfc9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:24.615410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-90f35d3d-1303-449f-aca2-d34041c0dfc9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:24.634772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90f35d3d-1303-449f-aca2-d34041c0dfc9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:24.639946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90f35d3d-1303-449f-aca2-d34041c0dfc9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:24.640749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90f35d3d-1303-449f-aca2-d34041c0dfc9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:24.641943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90f35d3d-1303-449f-aca2-d34041c0dfc9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:24.648844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90f35d3d-1303-449f-aca2-d34041c0dfc9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:24.649867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90f35d3d-1303-449f-aca2-d34041c0dfc9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:24.757785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ba36e52f-aced-45e8-84eb-e905dd3cc547 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:24.758874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ba36e52f-aced-45e8-84eb-e905dd3cc547 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:24.767504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba36e52f-aced-45e8-84eb-e905dd3cc547 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:24.768884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba36e52f-aced-45e8-84eb-e905dd3cc547 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:24.769483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba36e52f-aced-45e8-84eb-e905dd3cc547 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:24.770320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba36e52f-aced-45e8-84eb-e905dd3cc547 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:24.771085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba36e52f-aced-45e8-84eb-e905dd3cc547 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:24.771765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba36e52f-aced-45e8-84eb-e905dd3cc547 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:24.913305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-90f35d3d-1303-449f-aca2-d34041c0dfc9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:24.922798 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-90f35d3d-1303-449f-aca2-d34041c0dfc9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1528 microversion: 2.1 time: 0.312006 Oct 04 21:30:24.927637 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2481/4928] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:24 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1528 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:24.946790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0529eb1d-007d-4aff-8261-0358715e98e6 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:24.954573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0529eb1d-007d-4aff-8261-0358715e98e6 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:24.961385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=30 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:24.976184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0529eb1d-007d-4aff-8261-0358715e98e6 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:24.979202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0529eb1d-007d-4aff-8261-0358715e98e6 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:24.979202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0529eb1d-007d-4aff-8261-0358715e98e6 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:24.979202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0529eb1d-007d-4aff-8261-0358715e98e6 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:24.979731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0529eb1d-007d-4aff-8261-0358715e98e6 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:24.980059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0529eb1d-007d-4aff-8261-0358715e98e6 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:25.199334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0529eb1d-007d-4aff-8261-0358715e98e6 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:25.214494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0529eb1d-007d-4aff-8261-0358715e98e6 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:25.215899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0529eb1d-007d-4aff-8261-0358715e98e6 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:25.222587 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0529eb1d-007d-4aff-8261-0358715e98e6 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1357 microversion: 2.47 time: 0.293032 Oct 04 21:30:25.223418 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2482/4929] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:24 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1357 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:25.329224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:25.329224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:25.329224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:25.329224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:25.329224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:25.329224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:25.329224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:25.329224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:25.402800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ba36e52f-aced-45e8-84eb-e905dd3cc547 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:25.426161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:30:25.427361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ba36e52f-aced-45e8-84eb-e905dd3cc547 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:25.428736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:30:25.437468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ba36e52f-aced-45e8-84eb-e905dd3cc547 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:25.438967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:30:25.439417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:30:25.439849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:30:25.440573 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ba36e52f-aced-45e8-84eb-e905dd3cc547 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.687916 Oct 04 21:30:25.443132 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2448/4930] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:24 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:25.471039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-23fb42cc-208d-4a7b-be7f-8774c126a648 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:25.474149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-23fb42cc-208d-4a7b-be7f-8774c126a648 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:25.487658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23fb42cc-208d-4a7b-be7f-8774c126a648 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:25.488741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23fb42cc-208d-4a7b-be7f-8774c126a648 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:25.490045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23fb42cc-208d-4a7b-be7f-8774c126a648 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:25.490948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23fb42cc-208d-4a7b-be7f-8774c126a648 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:25.491497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23fb42cc-208d-4a7b-be7f-8774c126a648 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:25.492011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23fb42cc-208d-4a7b-be7f-8774c126a648 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:25.663313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-23fb42cc-208d-4a7b-be7f-8774c126a648 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:25.684087 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-23fb42cc-208d-4a7b-be7f-8774c126a648 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 200 len: 1373 microversion: 2.1 time: 0.231339 Oct 04 21:30:25.688665 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2449/4931] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:25 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 1373 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:25.700419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-eac422d1-fb7c-4cab-ab03-876807eaacbd tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:25.701043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-eac422d1-fb7c-4cab-ab03-876807eaacbd tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:25.747041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eac422d1-fb7c-4cab-ab03-876807eaacbd tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:25.751125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:25.752790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eac422d1-fb7c-4cab-ab03-876807eaacbd tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:25.757741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eac422d1-fb7c-4cab-ab03-876807eaacbd tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:25.761926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eac422d1-fb7c-4cab-ab03-876807eaacbd tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:25.771773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eac422d1-fb7c-4cab-ab03-876807eaacbd tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:25.773678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eac422d1-fb7c-4cab-ab03-876807eaacbd tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:25.788930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:25.789465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:25.789927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:25.790743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:25.791187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:25.791618 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:25.880181 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-98ade01c-64ef-4e38-a606-986537491fef tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "POST /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220/action" status: 202 len: 1079 microversion: 2.47 time: 0.619901 Oct 04 21:30:25.881327 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2483/4932] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Oct 4 21:30:25 2022] POST /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220/action => generated 1079 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 21:30:25.909221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a0583ca6-7311-4a71-885a-01492e25901e tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:25.910219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a0583ca6-7311-4a71-885a-01492e25901e tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:25.920053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0583ca6-7311-4a71-885a-01492e25901e tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:25.920804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0583ca6-7311-4a71-885a-01492e25901e tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:25.921546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0583ca6-7311-4a71-885a-01492e25901e tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:25.922430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0583ca6-7311-4a71-885a-01492e25901e tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:25.923053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0583ca6-7311-4a71-885a-01492e25901e tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:25.923700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0583ca6-7311-4a71-885a-01492e25901e tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:26.061850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a0583ca6-7311-4a71-885a-01492e25901e tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:26.082361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a0583ca6-7311-4a71-885a-01492e25901e tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:26.084685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a0583ca6-7311-4a71-885a-01492e25901e tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:26.086206 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a0583ca6-7311-4a71-885a-01492e25901e tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1366 microversion: 2.47 time: 0.181520 Oct 04 21:30:26.089204 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2484/4933] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:25 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:30:26.099279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-80481f49-ef7c-4290-b2cf-5b58309bf583 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:26.104228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-80481f49-ef7c-4290-b2cf-5b58309bf583 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:26.118678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80481f49-ef7c-4290-b2cf-5b58309bf583 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:26.124203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80481f49-ef7c-4290-b2cf-5b58309bf583 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:26.125105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80481f49-ef7c-4290-b2cf-5b58309bf583 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:26.126196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80481f49-ef7c-4290-b2cf-5b58309bf583 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:26.130113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80481f49-ef7c-4290-b2cf-5b58309bf583 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:26.130810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80481f49-ef7c-4290-b2cf-5b58309bf583 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:26.212811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-eac422d1-fb7c-4cab-ab03-876807eaacbd tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:26.223125 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-eac422d1-fb7c-4cab-ab03-876807eaacbd tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41" status: 200 len: 1501 microversion: 2.1 time: 0.533339 Oct 04 21:30:26.234186 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2450/4934] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:25 2022] GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 => generated 1501 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:26.261480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bad0e297-35cb-45a0-b679-0955897be387 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:26.262407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bad0e297-35cb-45a0-b679-0955897be387 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:26.270224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bad0e297-35cb-45a0-b679-0955897be387 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:26.271020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bad0e297-35cb-45a0-b679-0955897be387 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:26.272293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bad0e297-35cb-45a0-b679-0955897be387 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:26.273497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bad0e297-35cb-45a0-b679-0955897be387 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:26.274255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bad0e297-35cb-45a0-b679-0955897be387 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:26.275061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bad0e297-35cb-45a0-b679-0955897be387 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:26.667459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-80481f49-ef7c-4290-b2cf-5b58309bf583 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:26.677677 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-80481f49-ef7c-4290-b2cf-5b58309bf583 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1528 microversion: 2.1 time: 0.586751 Oct 04 21:30:26.681251 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2485/4935] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:26 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1528 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:26.698169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-330d9685-51eb-41b6-97cf-70eb87d0c809 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:26.700029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-330d9685-51eb-41b6-97cf-70eb87d0c809 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:26.715595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-330d9685-51eb-41b6-97cf-70eb87d0c809 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:26.716219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-330d9685-51eb-41b6-97cf-70eb87d0c809 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:26.716684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-330d9685-51eb-41b6-97cf-70eb87d0c809 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:26.720391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-330d9685-51eb-41b6-97cf-70eb87d0c809 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:26.723185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-330d9685-51eb-41b6-97cf-70eb87d0c809 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:26.725863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-330d9685-51eb-41b6-97cf-70eb87d0c809 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:26.796734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bad0e297-35cb-45a0-b679-0955897be387 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:26.806186 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bad0e297-35cb-45a0-b679-0955897be387 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41" status: 200 len: 1501 microversion: 2.1 time: 0.549237 Oct 04 21:30:26.834042 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2451/4936] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:26 2022] GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 => generated 1501 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:26.839616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a7a6fe29-bf07-4a91-b188-9d34b7f13b6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:26.843011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a7a6fe29-bf07-4a91-b188-9d34b7f13b6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:26.856610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7a6fe29-bf07-4a91-b188-9d34b7f13b6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:26.864142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7a6fe29-bf07-4a91-b188-9d34b7f13b6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:26.864980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7a6fe29-bf07-4a91-b188-9d34b7f13b6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:26.866041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7a6fe29-bf07-4a91-b188-9d34b7f13b6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:26.866828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7a6fe29-bf07-4a91-b188-9d34b7f13b6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:26.867546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7a6fe29-bf07-4a91-b188-9d34b7f13b6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:27.334616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-330d9685-51eb-41b6-97cf-70eb87d0c809 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:27.335714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:27.354294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-330d9685-51eb-41b6-97cf-70eb87d0c809 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:27.358382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-330d9685-51eb-41b6-97cf-70eb87d0c809 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:27.360987 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-330d9685-51eb-41b6-97cf-70eb87d0c809 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1868 microversion: 2.42 time: 0.678635 Oct 04 21:30:27.363639 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2486/4937] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:26 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1868 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:27.375702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab3352cd-439d-4a0b-b510-339558f232d4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:27.377573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ab3352cd-439d-4a0b-b510-339558f232d4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:27.392713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab3352cd-439d-4a0b-b510-339558f232d4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:27.393567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab3352cd-439d-4a0b-b510-339558f232d4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:27.394220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab3352cd-439d-4a0b-b510-339558f232d4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:27.395150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab3352cd-439d-4a0b-b510-339558f232d4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:27.395608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab3352cd-439d-4a0b-b510-339558f232d4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:27.397477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab3352cd-439d-4a0b-b510-339558f232d4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:27.460820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ab3352cd-439d-4a0b-b510-339558f232d4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:30:27.562044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a7a6fe29-bf07-4a91-b188-9d34b7f13b6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:27.575179 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a7a6fe29-bf07-4a91-b188-9d34b7f13b6c tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 200 len: 1373 microversion: 2.1 time: 0.739570 Oct 04 21:30:27.581519 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2452/4938] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:26 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 1373 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:27.604735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-42aa5997-3f75-4c93-8cdd-fced6a758abd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:27.605998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-42aa5997-3f75-4c93-8cdd-fced6a758abd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:27.624859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42aa5997-3f75-4c93-8cdd-fced6a758abd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:27.627025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42aa5997-3f75-4c93-8cdd-fced6a758abd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:27.627741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42aa5997-3f75-4c93-8cdd-fced6a758abd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:27.631251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42aa5997-3f75-4c93-8cdd-fced6a758abd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:27.633649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42aa5997-3f75-4c93-8cdd-fced6a758abd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:27.634340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42aa5997-3f75-4c93-8cdd-fced6a758abd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:27.793654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-42aa5997-3f75-4c93-8cdd-fced6a758abd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:27.804094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-42aa5997-3f75-4c93-8cdd-fced6a758abd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:27.806471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-42aa5997-3f75-4c93-8cdd-fced6a758abd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:27.807666 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-42aa5997-3f75-4c93-8cdd-fced6a758abd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1366 microversion: 2.47 time: 0.223071 Oct 04 21:30:27.808889 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2453/4939] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:27 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:27.828385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fa882f28-e091-475f-9693-cb5358ddc765 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:27.828946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fa882f28-e091-475f-9693-cb5358ddc765 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:27.840489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa882f28-e091-475f-9693-cb5358ddc765 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:27.841252 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa882f28-e091-475f-9693-cb5358ddc765 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:27.842454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa882f28-e091-475f-9693-cb5358ddc765 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:27.848738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa882f28-e091-475f-9693-cb5358ddc765 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:27.848738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa882f28-e091-475f-9693-cb5358ddc765 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:27.848738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa882f28-e091-475f-9693-cb5358ddc765 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:28.050829 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ab3352cd-439d-4a0b-b510-339558f232d4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41" status: 204 len: 0 microversion: 2.1 time: 0.684286 Oct 04 21:30:28.052384 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2487/4940] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:30:27 2022] DELETE /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:30:28.061958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-79e5f72d-4b40-4d1b-8c33-25bc44a8fc92 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:28.063153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-79e5f72d-4b40-4d1b-8c33-25bc44a8fc92 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:28.079659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79e5f72d-4b40-4d1b-8c33-25bc44a8fc92 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:28.080514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79e5f72d-4b40-4d1b-8c33-25bc44a8fc92 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:28.081290 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79e5f72d-4b40-4d1b-8c33-25bc44a8fc92 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:28.082188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79e5f72d-4b40-4d1b-8c33-25bc44a8fc92 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:28.082755 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79e5f72d-4b40-4d1b-8c33-25bc44a8fc92 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:28.083339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79e5f72d-4b40-4d1b-8c33-25bc44a8fc92 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:28.088046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fa882f28-e091-475f-9693-cb5358ddc765 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:28.099078 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fa882f28-e091-475f-9693-cb5358ddc765 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1528 microversion: 2.1 time: 0.288884 Oct 04 21:30:28.099825 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2454/4941] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:27 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1528 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:28.288164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-79e5f72d-4b40-4d1b-8c33-25bc44a8fc92 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:28.298241 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-79e5f72d-4b40-4d1b-8c33-25bc44a8fc92 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41" status: 200 len: 1507 microversion: 2.1 time: 0.241107 Oct 04 21:30:28.301617 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2488/4942] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:28 2022] GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:30:28.392939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-89a23cb0-101f-464f-8824-7b20722ba202 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:28.393610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-89a23cb0-101f-464f-8824-7b20722ba202 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:28.400698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89a23cb0-101f-464f-8824-7b20722ba202 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:28.401187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89a23cb0-101f-464f-8824-7b20722ba202 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:28.401655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89a23cb0-101f-464f-8824-7b20722ba202 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:28.402355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89a23cb0-101f-464f-8824-7b20722ba202 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:28.402822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89a23cb0-101f-464f-8824-7b20722ba202 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:28.403310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89a23cb0-101f-464f-8824-7b20722ba202 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:28.605022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-593519f8-2cdf-4418-8577-38c5114e76ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:28.605891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-593519f8-2cdf-4418-8577-38c5114e76ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:28.615313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-593519f8-2cdf-4418-8577-38c5114e76ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:28.617927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-593519f8-2cdf-4418-8577-38c5114e76ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:28.618519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-593519f8-2cdf-4418-8577-38c5114e76ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:28.620194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-593519f8-2cdf-4418-8577-38c5114e76ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:28.620760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-593519f8-2cdf-4418-8577-38c5114e76ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:28.632414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-593519f8-2cdf-4418-8577-38c5114e76ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:29.311754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-89a23cb0-101f-464f-8824-7b20722ba202 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:29.323130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-89a23cb0-101f-464f-8824-7b20722ba202 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:29.324566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-89a23cb0-101f-464f-8824-7b20722ba202 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:29.327207 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-89a23cb0-101f-464f-8824-7b20722ba202 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 2826 microversion: 2.42 time: 0.940014 Oct 04 21:30:29.331092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-593519f8-2cdf-4418-8577-38c5114e76ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:29.333509 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2455/4943] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:28 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 2826 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:29.340934 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-593519f8-2cdf-4418-8577-38c5114e76ec tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 200 len: 1373 microversion: 2.1 time: 0.739539 Oct 04 21:30:29.341077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4f0276ab-c69b-4983-a3f1-860e78481fb5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:29.342640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4f0276ab-c69b-4983-a3f1-860e78481fb5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:29.350425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f0276ab-c69b-4983-a3f1-860e78481fb5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:29.351519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f0276ab-c69b-4983-a3f1-860e78481fb5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:29.351966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f0276ab-c69b-4983-a3f1-860e78481fb5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:29.352835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f0276ab-c69b-4983-a3f1-860e78481fb5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:29.353290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f0276ab-c69b-4983-a3f1-860e78481fb5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:29.353746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f0276ab-c69b-4983-a3f1-860e78481fb5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:29.356346 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2489/4944] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:28 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 1373 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:30:29.483858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4f0276ab-c69b-4983-a3f1-860e78481fb5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:29.497405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4f0276ab-c69b-4983-a3f1-860e78481fb5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:29.503737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4f0276ab-c69b-4983-a3f1-860e78481fb5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:29.505065 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4f0276ab-c69b-4983-a3f1-860e78481fb5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1366 microversion: 2.47 time: 0.170341 Oct 04 21:30:29.505680 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2456/4945] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:29 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:29.523367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-55795e7b-c06a-44f4-8e90-8257355e5264 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:29.525092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-55795e7b-c06a-44f4-8e90-8257355e5264 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:29.542343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55795e7b-c06a-44f4-8e90-8257355e5264 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:29.544524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55795e7b-c06a-44f4-8e90-8257355e5264 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:29.546461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55795e7b-c06a-44f4-8e90-8257355e5264 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:29.549092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55795e7b-c06a-44f4-8e90-8257355e5264 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:29.549659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55795e7b-c06a-44f4-8e90-8257355e5264 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:29.550106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55795e7b-c06a-44f4-8e90-8257355e5264 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:29.690626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5da0ad38-7fd0-4036-a68d-b5548552ea50 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1342451111", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "61466b7d-ab16-465a-ab01-55e8561f4b19"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:29.764733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-5da0ad38-7fd0-4036-a68d-b5548552ea50 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] validate_networks() for [('61466b7d-ab16-465a-ab01-55e8561f4b19', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:30:30.089129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-55795e7b-c06a-44f4-8e90-8257355e5264 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:30.103569 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-55795e7b-c06a-44f4-8e90-8257355e5264 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1510 microversion: 2.1 time: 0.591675 Oct 04 21:30:30.104725 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2457/4946] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:29 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1510 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:30.111965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-76f6f61f-eff6-45d4-84ca-d0b6e6bf2296 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:30.112581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-76f6f61f-eff6-45d4-84ca-d0b6e6bf2296 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:30.128749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76f6f61f-eff6-45d4-84ca-d0b6e6bf2296 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:30.129063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76f6f61f-eff6-45d4-84ca-d0b6e6bf2296 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:30.130092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76f6f61f-eff6-45d4-84ca-d0b6e6bf2296 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:30.130682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76f6f61f-eff6-45d4-84ca-d0b6e6bf2296 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:30.131131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76f6f61f-eff6-45d4-84ca-d0b6e6bf2296 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:30.131553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76f6f61f-eff6-45d4-84ca-d0b6e6bf2296 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:30.539236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-76f6f61f-eff6-45d4-84ca-d0b6e6bf2296 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:30.559107 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-76f6f61f-eff6-45d4-84ca-d0b6e6bf2296 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41" status: 200 len: 1507 microversion: 2.1 time: 0.452141 Oct 04 21:30:30.560432 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2458/4947] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:30 2022] GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 => generated 1507 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:30.565796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-22d5b13e-b763-40fc-a6fd-88b346e54d25 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:30.566702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-22d5b13e-b763-40fc-a6fd-88b346e54d25 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:30.573880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22d5b13e-b763-40fc-a6fd-88b346e54d25 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:30.574623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22d5b13e-b763-40fc-a6fd-88b346e54d25 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:30.575290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22d5b13e-b763-40fc-a6fd-88b346e54d25 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:30.576322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22d5b13e-b763-40fc-a6fd-88b346e54d25 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:30.577028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22d5b13e-b763-40fc-a6fd-88b346e54d25 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:30.577712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22d5b13e-b763-40fc-a6fd-88b346e54d25 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:30.612798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:30.835255 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-22d5b13e-b763-40fc-a6fd-88b346e54d25 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.271401 Oct 04 21:30:30.836237 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2459/4948] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Oct 4 21:30:30 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f/os-interface => generated 1832 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:30.849923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-27792024-696e-4e13-a11d-9ea22760ce98 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:30.867778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-27792024-696e-4e13-a11d-9ea22760ce98 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:30.899866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27792024-696e-4e13-a11d-9ea22760ce98 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:30.905300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27792024-696e-4e13-a11d-9ea22760ce98 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:30.908856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27792024-696e-4e13-a11d-9ea22760ce98 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:30.910075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27792024-696e-4e13-a11d-9ea22760ce98 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:30.910700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27792024-696e-4e13-a11d-9ea22760ce98 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:30.914161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27792024-696e-4e13-a11d-9ea22760ce98 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:31.223740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5da0ad38-7fd0-4036-a68d-b5548552ea50 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:30:31.225977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5da0ad38-7fd0-4036-a68d-b5548552ea50 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:30:31.226605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5da0ad38-7fd0-4036-a68d-b5548552ea50 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:30:31.227127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5da0ad38-7fd0-4036-a68d-b5548552ea50 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:30:31.227652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5da0ad38-7fd0-4036-a68d-b5548552ea50 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:30:31.244323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5da0ad38-7fd0-4036-a68d-b5548552ea50 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:31.254619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5da0ad38-7fd0-4036-a68d-b5548552ea50 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:31.255385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5da0ad38-7fd0-4036-a68d-b5548552ea50 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:31.256814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5da0ad38-7fd0-4036-a68d-b5548552ea50 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:31.260977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5da0ad38-7fd0-4036-a68d-b5548552ea50 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:31.263208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5da0ad38-7fd0-4036-a68d-b5548552ea50 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:31.345349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5da0ad38-7fd0-4036-a68d-b5548552ea50 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Getting quotas for project 12da8c6a64ae484bb779149dca92d2e7. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:30:31.359885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5da0ad38-7fd0-4036-a68d-b5548552ea50 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Getting quotas for user e3789d0f886643fb849af4f51838af4d and project 12da8c6a64ae484bb779149dca92d2e7. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:30:31.398553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5da0ad38-7fd0-4036-a68d-b5548552ea50 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Going to run 2 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:30:31.401593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5da0ad38-7fd0-4036-a68d-b5548552ea50 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 3b9a73ee-951f-415e-9088-ad819e929ae9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:30:31.413376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-27792024-696e-4e13-a11d-9ea22760ce98 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:31.429875 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-27792024-696e-4e13-a11d-9ea22760ce98 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 200 len: 1373 microversion: 2.1 time: 0.586770 Oct 04 21:30:31.451167 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2460/4949] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:30 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 1373 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:31.458995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3fd1442a-9413-4b5f-ac2d-d75e24868278 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:31.464838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3fd1442a-9413-4b5f-ac2d-d75e24868278 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:31.468264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:31.490628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fd1442a-9413-4b5f-ac2d-d75e24868278 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:31.492417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fd1442a-9413-4b5f-ac2d-d75e24868278 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:31.492417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fd1442a-9413-4b5f-ac2d-d75e24868278 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:31.496210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fd1442a-9413-4b5f-ac2d-d75e24868278 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:31.497499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fd1442a-9413-4b5f-ac2d-d75e24868278 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:31.498786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fd1442a-9413-4b5f-ac2d-d75e24868278 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:31.644121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3fd1442a-9413-4b5f-ac2d-d75e24868278 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:31.645118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5da0ad38-7fd0-4036-a68d-b5548552ea50 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: b96184fe-5a1c-418f-b473-41ac84763259] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=3b9a73ee-951f-415e-9088-ad819e929ae9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:30:31.691015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3fd1442a-9413-4b5f-ac2d-d75e24868278 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:31.697140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3fd1442a-9413-4b5f-ac2d-d75e24868278 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:31.699410 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3fd1442a-9413-4b5f-ac2d-d75e24868278 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1366 microversion: 2.47 time: 0.246224 Oct 04 21:30:31.699994 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2461/4950] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:31 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:31.723096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-277af351-a395-4e3b-86b8-763ab6fe0a2b req-aad1531f-decc-447c-a569-aedea223242d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "090f4719-1122-427c-b849-7c1865ac1ff5", "name": "network-vif-plugged", "status": "completed", "tag": "d0935e96-259f-4617-85cd-eac52e8c9e52"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:31.742761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-277af351-a395-4e3b-86b8-763ab6fe0a2b req-aad1531f-decc-447c-a569-aedea223242d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:31.743497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-277af351-a395-4e3b-86b8-763ab6fe0a2b req-aad1531f-decc-447c-a569-aedea223242d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:31.744187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-277af351-a395-4e3b-86b8-763ab6fe0a2b req-aad1531f-decc-447c-a569-aedea223242d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:31.761803 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-277af351-a395-4e3b-86b8-763ab6fe0a2b req-aad1531f-decc-447c-a569-aedea223242d service nova] Creating event network-vif-plugged:d0935e96-259f-4617-85cd-eac52e8c9e52 for instance 090f4719-1122-427c-b849-7c1865ac1ff5 on n-h2-860282-1 Oct 04 21:30:31.767912 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-277af351-a395-4e3b-86b8-763ab6fe0a2b req-aad1531f-decc-447c-a569-aedea223242d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064808 Oct 04 21:30:31.769108 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2462/4951] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:31.777091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e5c3a075-e2bb-4042-a874-7b2b38c1d78e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:31.778502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e5c3a075-e2bb-4042-a874-7b2b38c1d78e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:31.786028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5c3a075-e2bb-4042-a874-7b2b38c1d78e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:31.786532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5c3a075-e2bb-4042-a874-7b2b38c1d78e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:31.786985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5c3a075-e2bb-4042-a874-7b2b38c1d78e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:31.789093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5c3a075-e2bb-4042-a874-7b2b38c1d78e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:31.789093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5c3a075-e2bb-4042-a874-7b2b38c1d78e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:31.789306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5c3a075-e2bb-4042-a874-7b2b38c1d78e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:31.926906 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5da0ad38-7fd0-4036-a68d-b5548552ea50 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.563029 Oct 04 21:30:31.926906 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2490/4952] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:30:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:30:31.956647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-2d854d5c-0fc4-4552-8f66-10dd5513a595 req-bda43faf-a9de-460c-9112-bb2c15b345e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd27d01e-c242-427c-bed3-52c8711a5f41", "name": "network-vif-deleted", "tag": "de87e1af-a11a-4d67-a675-7f0d93fe0ed0"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:31.993630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2d854d5c-0fc4-4552-8f66-10dd5513a595 req-bda43faf-a9de-460c-9112-bb2c15b345e9 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:31.995307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2d854d5c-0fc4-4552-8f66-10dd5513a595 req-bda43faf-a9de-460c-9112-bb2c15b345e9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:31.995307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2d854d5c-0fc4-4552-8f66-10dd5513a595 req-bda43faf-a9de-460c-9112-bb2c15b345e9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:32.025603 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-2d854d5c-0fc4-4552-8f66-10dd5513a595 req-bda43faf-a9de-460c-9112-bb2c15b345e9 service nova] Creating event network-vif-deleted:de87e1af-a11a-4d67-a675-7f0d93fe0ed0 for instance dd27d01e-c242-427c-bed3-52c8711a5f41 on n-h1-860282-1 Oct 04 21:30:32.045547 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-2d854d5c-0fc4-4552-8f66-10dd5513a595 req-bda43faf-a9de-460c-9112-bb2c15b345e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119534 Oct 04 21:30:32.046844 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2491/4953] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:32.063825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-355dda74-a55c-4c33-b079-046f7c0b0d41 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:32.064720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-355dda74-a55c-4c33-b079-046f7c0b0d41 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:32.082039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-355dda74-a55c-4c33-b079-046f7c0b0d41 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:32.085660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-355dda74-a55c-4c33-b079-046f7c0b0d41 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:32.087094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-355dda74-a55c-4c33-b079-046f7c0b0d41 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:32.088182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-355dda74-a55c-4c33-b079-046f7c0b0d41 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:32.092313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-355dda74-a55c-4c33-b079-046f7c0b0d41 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:32.094005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-355dda74-a55c-4c33-b079-046f7c0b0d41 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:32.117838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e5c3a075-e2bb-4042-a874-7b2b38c1d78e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:32.139228 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e5c3a075-e2bb-4042-a874-7b2b38c1d78e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1510 microversion: 2.1 time: 0.368441 Oct 04 21:30:32.141796 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2463/4954] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:31 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1510 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:32.147225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1d8b62a9-181a-47f0-bb95-17449cf7b8da tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:32.152357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1d8b62a9-181a-47f0-bb95-17449cf7b8da tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:32.153339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1d8b62a9-181a-47f0-bb95-17449cf7b8da tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Searching by: {'deleted': False, 'project_id': '12da8c6a64ae484bb779149dca92d2e7'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:30:32.190315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d8b62a9-181a-47f0-bb95-17449cf7b8da tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:32.191124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d8b62a9-181a-47f0-bb95-17449cf7b8da tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:32.192289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d8b62a9-181a-47f0-bb95-17449cf7b8da tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:32.193258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d8b62a9-181a-47f0-bb95-17449cf7b8da tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:32.195811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d8b62a9-181a-47f0-bb95-17449cf7b8da tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:32.196584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d8b62a9-181a-47f0-bb95-17449cf7b8da tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:32.210465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-355dda74-a55c-4c33-b079-046f7c0b0d41 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:32.211207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-355dda74-a55c-4c33-b079-046f7c0b0d41 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:32.214143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-355dda74-a55c-4c33-b079-046f7c0b0d41 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:32.214882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-355dda74-a55c-4c33-b079-046f7c0b0d41 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lazy-loading 'fault' on Instance uuid dd27d01e-c242-427c-bed3-52c8711a5f41 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:30:32.302028 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1d8b62a9-181a-47f0-bb95-17449cf7b8da tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.154449 Oct 04 21:30:32.318777 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2464/4955] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Oct 4 21:30:32 2022] GET /compute/v2.1/servers => generated 677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:32.330904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ba9513b3-6b89-44f9-a6a2-f0e6c5a69ee7 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:32.338075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ba9513b3-6b89-44f9-a6a2-f0e6c5a69ee7 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: b96184fe-5a1c-418f-b473-41ac84763259] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:32.480384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-355dda74-a55c-4c33-b079-046f7c0b0d41 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:32.490625 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-355dda74-a55c-4c33-b079-046f7c0b0d41 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41" status: 200 len: 1311 microversion: 2.1 time: 0.442539 Oct 04 21:30:32.491225 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2492/4956] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:32 2022] GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 => generated 1311 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:32.529848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3e777240-5fe5-469a-8db8-d1e4e7a6375b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:32.542338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3e777240-5fe5-469a-8db8-d1e4e7a6375b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:32.585249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e777240-5fe5-469a-8db8-d1e4e7a6375b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:32.589786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ba9513b3-6b89-44f9-a6a2-f0e6c5a69ee7 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:32.610902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e777240-5fe5-469a-8db8-d1e4e7a6375b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:32.611582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e777240-5fe5-469a-8db8-d1e4e7a6375b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:32.615406 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ba9513b3-6b89-44f9-a6a2-f0e6c5a69ee7 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259" status: 200 len: 1220 microversion: 2.1 time: 0.296055 Oct 04 21:30:32.620721 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2465/4957] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:32 2022] GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259 => generated 1220 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:32.638830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e777240-5fe5-469a-8db8-d1e4e7a6375b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:32.639690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e777240-5fe5-469a-8db8-d1e4e7a6375b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:32.644798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e777240-5fe5-469a-8db8-d1e4e7a6375b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:32.727570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cefc9105-559d-4e22-8c81-3007ceca5de5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:32.728194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cefc9105-559d-4e22-8c81-3007ceca5de5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:32.740877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cefc9105-559d-4e22-8c81-3007ceca5de5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:32.747607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cefc9105-559d-4e22-8c81-3007ceca5de5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:32.750367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cefc9105-559d-4e22-8c81-3007ceca5de5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:32.760708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cefc9105-559d-4e22-8c81-3007ceca5de5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:32.764090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cefc9105-559d-4e22-8c81-3007ceca5de5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:32.768980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cefc9105-559d-4e22-8c81-3007ceca5de5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:32.982072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cefc9105-559d-4e22-8c81-3007ceca5de5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:33.018392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cefc9105-559d-4e22-8c81-3007ceca5de5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:33.018749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3e777240-5fe5-469a-8db8-d1e4e7a6375b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:33.021471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cefc9105-559d-4e22-8c81-3007ceca5de5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:33.031407 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3e777240-5fe5-469a-8db8-d1e4e7a6375b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 200 len: 1373 microversion: 2.1 time: 0.521981 Oct 04 21:30:33.032266 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2493/4958] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:32 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 1373 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:33.053788 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cefc9105-559d-4e22-8c81-3007ceca5de5 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1366 microversion: 2.47 time: 0.299397 Oct 04 21:30:33.056676 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2466/4959] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:32 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:30:33.171288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b8eab50d-10b5-4c45-a1a3-1fd1e984619f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:33.172566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b8eab50d-10b5-4c45-a1a3-1fd1e984619f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:33.182953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8eab50d-10b5-4c45-a1a3-1fd1e984619f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:33.183457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8eab50d-10b5-4c45-a1a3-1fd1e984619f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:33.183900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8eab50d-10b5-4c45-a1a3-1fd1e984619f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:33.187150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8eab50d-10b5-4c45-a1a3-1fd1e984619f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:33.188137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8eab50d-10b5-4c45-a1a3-1fd1e984619f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:33.188583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8eab50d-10b5-4c45-a1a3-1fd1e984619f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:33.430257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b8eab50d-10b5-4c45-a1a3-1fd1e984619f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:33.444283 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b8eab50d-10b5-4c45-a1a3-1fd1e984619f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1513 microversion: 2.1 time: 0.283770 Oct 04 21:30:33.444670 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2494/4960] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:33 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1513 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:33.478126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8bdb4f16-2edd-4c39-8434-3f8e5e22489e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:33.478750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8bdb4f16-2edd-4c39-8434-3f8e5e22489e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:33.497077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8bdb4f16-2edd-4c39-8434-3f8e5e22489e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:33.503511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8bdb4f16-2edd-4c39-8434-3f8e5e22489e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:33.503511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8bdb4f16-2edd-4c39-8434-3f8e5e22489e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:33.503511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8bdb4f16-2edd-4c39-8434-3f8e5e22489e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:33.503511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8bdb4f16-2edd-4c39-8434-3f8e5e22489e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:33.503511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8bdb4f16-2edd-4c39-8434-3f8e5e22489e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:33.525699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-784508ee-69d8-44d7-82c0-99ca7ed8003a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:33.527113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-784508ee-69d8-44d7-82c0-99ca7ed8003a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:33.542908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-784508ee-69d8-44d7-82c0-99ca7ed8003a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:33.543944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-784508ee-69d8-44d7-82c0-99ca7ed8003a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:33.544597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-784508ee-69d8-44d7-82c0-99ca7ed8003a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:33.545991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-784508ee-69d8-44d7-82c0-99ca7ed8003a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:33.546447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-784508ee-69d8-44d7-82c0-99ca7ed8003a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:33.546957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-784508ee-69d8-44d7-82c0-99ca7ed8003a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:33.596703 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-784508ee-69d8-44d7-82c0-99ca7ed8003a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance dd27d01e-c242-427c-bed3-52c8711a5f41 could not be found. Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-784508ee-69d8-44d7-82c0-99ca7ed8003a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 HTTP/1.1 Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance dd27d01e-c242-427c-bed3-52c8711a5f41 could not be found. Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'dd27d01e-c242-427c-bed3-52c8711a5f41'} Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd27d01e-c242-427c-bed3-52c8711a5f41 could not be found. Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd27d01e-c242-427c-bed3-52c8711a5f41 could not be found. Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:33.601853 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:30:33.622651 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:33.622651 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:33.622651 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:33.622651 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:30:33.622651 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:30:33.622651 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd27d01e-c242-427c-bed3-52c8711a5f41 could not be found. Oct 04 21:30:33.622651 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:30:33.622651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-784508ee-69d8-44d7-82c0-99ca7ed8003a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance dd27d01e-c242-427c-bed3-52c8711a5f41 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:30:33.622651 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-784508ee-69d8-44d7-82c0-99ca7ed8003a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41" status: 404 len: 111 microversion: 2.1 time: 0.091216 Oct 04 21:30:33.622651 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2495/4961] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:33 2022] GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:30:33.635418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2eb03ae7-636f-452a-b49e-18b305286954 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Action: 'create', calling method: .version_select at 0x7f578b8419d0>, body: {"keypair": {"name": "tempest-key-1138255015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuGHNq7yw2/xZ3vFBD+2C/fD5d7sdjoch072TMVL7SbCpDwwSFKa46iAZMRnLiMefi3FLUao3SZcq2PnOIjUHnDT/BPscmrIKtqQoriu7ff7/JLbmx+eU9/DEWBWNleqA=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:33.666527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-2eb03ae7-636f-452a-b49e-18b305286954 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Getting quotas for project fde68efb46fc44b5b0d83138b9048f46. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:30:33.694302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-2eb03ae7-636f-452a-b49e-18b305286954 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Getting quotas for user b9289c5fa9844ae3bb1c797bdab5c56c and project fde68efb46fc44b5b0d83138b9048f46. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:30:33.863459 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2eb03ae7-636f-452a-b49e-18b305286954 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.235100 Oct 04 21:30:33.864550 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2496/4962] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:30:33 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:30:33.876969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4c662115-c1a2-4126-9836-42bc64d52fd0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:33.882473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4c662115-c1a2-4126-9836-42bc64d52fd0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: b96184fe-5a1c-418f-b473-41ac84763259] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:33.889900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8bdb4f16-2edd-4c39-8434-3f8e5e22489e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:33.900650 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8bdb4f16-2edd-4c39-8434-3f8e5e22489e tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1513 microversion: 2.1 time: 0.427302 Oct 04 21:30:33.901851 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2467/4963] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:33 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1513 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:30:33.907399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-d86a628c-7e0b-4c4d-9b12-66a81190b657 req-07c86a27-68c3-4170-86e3-9d1c8dfe2743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144fff2d-9df3-4a93-833f-7f76acc85185", "name": "network-vif-unplugged", "status": "completed", "tag": "cef3ff62-fc82-48d3-a981-5cadb2647961"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:33.941592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d86a628c-7e0b-4c4d-9b12-66a81190b657 req-07c86a27-68c3-4170-86e3-9d1c8dfe2743 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:33.947510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d86a628c-7e0b-4c4d-9b12-66a81190b657 req-07c86a27-68c3-4170-86e3-9d1c8dfe2743 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:33.949081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d86a628c-7e0b-4c4d-9b12-66a81190b657 req-07c86a27-68c3-4170-86e3-9d1c8dfe2743 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:33.991187 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-d86a628c-7e0b-4c4d-9b12-66a81190b657 req-07c86a27-68c3-4170-86e3-9d1c8dfe2743 service nova] Creating event network-vif-unplugged:cef3ff62-fc82-48d3-a981-5cadb2647961 for instance 144fff2d-9df3-4a93-833f-7f76acc85185 on n-h2-860282-1 Oct 04 21:30:34.036629 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-d86a628c-7e0b-4c4d-9b12-66a81190b657 req-07c86a27-68c3-4170-86e3-9d1c8dfe2743 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133227 Oct 04 21:30:34.039251 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2468/4964] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:34.050843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-5e251a7b-8be8-4db0-a865-20636c64021c req-19a14c6f-be62-473b-b159-152c73ea6722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "tag": "3f36f0e8-027a-49e9-b359-7053dd5e96b7"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:34.057076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4c662115-c1a2-4126-9836-42bc64d52fd0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:34.065450 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4c662115-c1a2-4126-9836-42bc64d52fd0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259" status: 200 len: 1220 microversion: 2.1 time: 0.193709 Oct 04 21:30:34.069052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5e251a7b-8be8-4db0-a865-20636c64021c req-19a14c6f-be62-473b-b159-152c73ea6722 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:34.069404 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2497/4965] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:33 2022] GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259 => generated 1220 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:34.070094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5e251a7b-8be8-4db0-a865-20636c64021c req-19a14c6f-be62-473b-b159-152c73ea6722 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:34.070722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5e251a7b-8be8-4db0-a865-20636c64021c req-19a14c6f-be62-473b-b159-152c73ea6722 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:34.084338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ddeb9bd9-3a65-4a27-a6eb-1f65f03820a7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '.version_select at 0x7f578b183e50>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:34.091501 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-5e251a7b-8be8-4db0-a865-20636c64021c req-19a14c6f-be62-473b-b159-152c73ea6722 service nova] Creating event network-changed:3f36f0e8-027a-49e9-b359-7053dd5e96b7 for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:30:34.092280 n-d-860282-1 devstack@n-api.service[122757]: WARNING oslo_db.sqlalchemy.utils [None req-ddeb9bd9-3a65-4a27-a6eb-1f65f03820a7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 21:30:34.101931 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ddeb9bd9-3a65-4a27-a6eb-1f65f03820a7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.031162 Oct 04 21:30:34.104661 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-5e251a7b-8be8-4db0-a865-20636c64021c req-19a14c6f-be62-473b-b159-152c73ea6722 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063793 Oct 04 21:30:34.108545 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2498/4966] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:30:34 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:34.108856 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2469/4967] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:34.114094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1d560dc4-1a18-44c2-bddd-705e19ce6aed tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:34.116088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1d560dc4-1a18-44c2-bddd-705e19ce6aed tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:34.125282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d560dc4-1a18-44c2-bddd-705e19ce6aed tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:34.125874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-af5b84f0-ef89-4e9d-8728-59f59e574632 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:34.126366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d560dc4-1a18-44c2-bddd-705e19ce6aed tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:34.126820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d560dc4-1a18-44c2-bddd-705e19ce6aed tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:34.127012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-af5b84f0-ef89-4e9d-8728-59f59e574632 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:34.127530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d560dc4-1a18-44c2-bddd-705e19ce6aed tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:34.128789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d560dc4-1a18-44c2-bddd-705e19ce6aed tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:34.129196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d560dc4-1a18-44c2-bddd-705e19ce6aed tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:34.135389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af5b84f0-ef89-4e9d-8728-59f59e574632 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:34.135896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af5b84f0-ef89-4e9d-8728-59f59e574632 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:34.136346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af5b84f0-ef89-4e9d-8728-59f59e574632 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:34.137060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af5b84f0-ef89-4e9d-8728-59f59e574632 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:34.137870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af5b84f0-ef89-4e9d-8728-59f59e574632 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:34.138316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af5b84f0-ef89-4e9d-8728-59f59e574632 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:34.177550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-af5b84f0-ef89-4e9d-8728-59f59e574632 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lazy-loading 'flavor' on Instance uuid 144fff2d-9df3-4a93-833f-7f76acc85185 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:30:34.196611 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-af5b84f0-ef89-4e9d-8728-59f59e574632 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Cannot 'shelve' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state shelved_offloaded Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-af5b84f0-ef89-4e9d-8728-59f59e574632 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action HTTP/1.1 Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 14 Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: {"shelve": {}} Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: exception: Cannot 'shelve' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state shelved_offloaded Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '144fff2d-9df3-4a93-833f-7f76acc85185', 'body': {'shelve': {}}} Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 144fff2d-9df3-4a93-833f-7f76acc85185 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:30:34.198621 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:30:34.205215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:30:34.205215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state shelved_offloaded Oct 04 21:30:34.205215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:30:34.205215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:34.205215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:30:34.205215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:34.205215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:34.205215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:34.205215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:30:34.205215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:30:34.205215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state shelved_offloaded Oct 04 21:30:34.205215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:30:34.207420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-af5b84f0-ef89-4e9d-8728-59f59e574632 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 409 to user: Cannot 'shelve' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state shelved_offloaded {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:30:34.208534 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-af5b84f0-ef89-4e9d-8728-59f59e574632 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action" status: 409 len: 155 microversion: 2.1 time: 0.088285 Oct 04 21:30:34.214150 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2499/4968] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:30:34 2022] POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action => generated 155 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:30:34.230418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d34193c3-1c51-438a-a7f7-94980445b071 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:34.231114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d34193c3-1c51-438a-a7f7-94980445b071 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:34.250043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d34193c3-1c51-438a-a7f7-94980445b071 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:34.250802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d34193c3-1c51-438a-a7f7-94980445b071 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:34.252512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d34193c3-1c51-438a-a7f7-94980445b071 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:34.253251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d34193c3-1c51-438a-a7f7-94980445b071 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:34.256463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d34193c3-1c51-438a-a7f7-94980445b071 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:34.257158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d34193c3-1c51-438a-a7f7-94980445b071 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:34.486313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d34193c3-1c51-438a-a7f7-94980445b071 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:34.498615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d34193c3-1c51-438a-a7f7-94980445b071 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:34.503457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d34193c3-1c51-438a-a7f7-94980445b071 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:34.504614 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d34193c3-1c51-438a-a7f7-94980445b071 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1366 microversion: 2.47 time: 0.282316 Oct 04 21:30:34.523410 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2500/4969] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:34 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:34.530469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f8f5af31-f558-49f4-a656-f32cac76c9a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:34.531772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f8f5af31-f558-49f4-a656-f32cac76c9a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:34.541256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8f5af31-f558-49f4-a656-f32cac76c9a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:34.542161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8f5af31-f558-49f4-a656-f32cac76c9a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:34.552614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8f5af31-f558-49f4-a656-f32cac76c9a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:34.553706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8f5af31-f558-49f4-a656-f32cac76c9a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:34.554430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8f5af31-f558-49f4-a656-f32cac76c9a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:34.555428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8f5af31-f558-49f4-a656-f32cac76c9a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:34.639852 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f8f5af31-f558-49f4-a656-f32cac76c9a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122757) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 21:30:34.743189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1d560dc4-1a18-44c2-bddd-705e19ce6aed tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:34.758132 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1d560dc4-1a18-44c2-bddd-705e19ce6aed tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 200 len: 1373 microversion: 2.1 time: 0.650812 Oct 04 21:30:34.758724 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2470/4970] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:34 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 1373 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:34.797168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e1e3e3fe-f57e-4808-a1a2-07a7b0d4a194 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1342973544", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "key_name": "tempest-key-1138255015", "networks": [{"uuid": "f9328395-b63c-4f5a-9d32-23fa7cfe6c6d"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:34.918720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-e1e3e3fe-f57e-4808-a1a2-07a7b0d4a194 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] validate_networks() for [('f9328395-b63c-4f5a-9d32-23fa7cfe6c6d', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:30:35.200538 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f8f5af31-f558-49f4-a656-f32cac76c9a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action" status: 202 len: 0 microversion: 2.1 time: 0.676049 Oct 04 21:30:35.208549 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2501/4971] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:30:34 2022] POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:30:35.228017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ef5eb0ec-390a-4dbc-9dbd-98ac38612189 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:35.228017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ef5eb0ec-390a-4dbc-9dbd-98ac38612189 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: b96184fe-5a1c-418f-b473-41ac84763259] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:35.345948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ef5eb0ec-390a-4dbc-9dbd-98ac38612189 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:35.394109 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ef5eb0ec-390a-4dbc-9dbd-98ac38612189 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259" status: 200 len: 1220 microversion: 2.1 time: 0.182120 Oct 04 21:30:35.421718 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2502/4972] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:35 2022] GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259 => generated 1220 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:35.457534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3cdab2f6-2460-4449-9cf3-2915b360eb1c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:35.462475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3cdab2f6-2460-4449-9cf3-2915b360eb1c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:35.488620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:35.510357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3cdab2f6-2460-4449-9cf3-2915b360eb1c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:35.521036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3cdab2f6-2460-4449-9cf3-2915b360eb1c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:35.521929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3cdab2f6-2460-4449-9cf3-2915b360eb1c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:35.533218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3cdab2f6-2460-4449-9cf3-2915b360eb1c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:35.534904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3cdab2f6-2460-4449-9cf3-2915b360eb1c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:35.535562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3cdab2f6-2460-4449-9cf3-2915b360eb1c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:36.703159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3cdab2f6-2460-4449-9cf3-2915b360eb1c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:36.720624 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3cdab2f6-2460-4449-9cf3-2915b360eb1c tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1461 microversion: 2.1 time: 1.294126 Oct 04 21:30:36.735703 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2503/4973] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:35 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1461 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:36.758010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5aa997b5-38db-4476-ae1e-f4ac16afe5af tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:36.759365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5aa997b5-38db-4476-ae1e-f4ac16afe5af tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:36.797181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5aa997b5-38db-4476-ae1e-f4ac16afe5af tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:36.800226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5aa997b5-38db-4476-ae1e-f4ac16afe5af tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:36.802813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5aa997b5-38db-4476-ae1e-f4ac16afe5af tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:36.807385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5aa997b5-38db-4476-ae1e-f4ac16afe5af tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:36.808405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5aa997b5-38db-4476-ae1e-f4ac16afe5af tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:36.809257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5aa997b5-38db-4476-ae1e-f4ac16afe5af tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:37.024230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5aa997b5-38db-4476-ae1e-f4ac16afe5af tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:37.040418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5aa997b5-38db-4476-ae1e-f4ac16afe5af tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:37.053696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5aa997b5-38db-4476-ae1e-f4ac16afe5af tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:37.056897 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5aa997b5-38db-4476-ae1e-f4ac16afe5af tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1366 microversion: 2.47 time: 0.320089 Oct 04 21:30:37.063753 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2504/4974] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:36 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:37.080840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-832473a4-ebf0-4518-b163-fa78c46d98cb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:37.083898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-832473a4-ebf0-4518-b163-fa78c46d98cb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:37.111060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-832473a4-ebf0-4518-b163-fa78c46d98cb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:37.115047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-832473a4-ebf0-4518-b163-fa78c46d98cb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:37.120065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-832473a4-ebf0-4518-b163-fa78c46d98cb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:37.122366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-832473a4-ebf0-4518-b163-fa78c46d98cb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:37.132054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-832473a4-ebf0-4518-b163-fa78c46d98cb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:37.132054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-832473a4-ebf0-4518-b163-fa78c46d98cb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:37.321983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e1e3e3fe-f57e-4808-a1a2-07a7b0d4a194 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:30:37.323420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e1e3e3fe-f57e-4808-a1a2-07a7b0d4a194 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:30:37.324095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e1e3e3fe-f57e-4808-a1a2-07a7b0d4a194 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:30:37.324827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e1e3e3fe-f57e-4808-a1a2-07a7b0d4a194 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:30:37.326881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e1e3e3fe-f57e-4808-a1a2-07a7b0d4a194 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:30:37.344807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1e3e3fe-f57e-4808-a1a2-07a7b0d4a194 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:37.356109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1e3e3fe-f57e-4808-a1a2-07a7b0d4a194 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:37.356109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1e3e3fe-f57e-4808-a1a2-07a7b0d4a194 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:37.356109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1e3e3fe-f57e-4808-a1a2-07a7b0d4a194 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:37.356109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1e3e3fe-f57e-4808-a1a2-07a7b0d4a194 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:37.356109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1e3e3fe-f57e-4808-a1a2-07a7b0d4a194 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:37.438077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-e1e3e3fe-f57e-4808-a1a2-07a7b0d4a194 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Getting quotas for project fde68efb46fc44b5b0d83138b9048f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:30:37.450278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-e1e3e3fe-f57e-4808-a1a2-07a7b0d4a194 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Getting quotas for user b9289c5fa9844ae3bb1c797bdab5c56c and project fde68efb46fc44b5b0d83138b9048f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:30:37.486078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e1e3e3fe-f57e-4808-a1a2-07a7b0d4a194 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:30:37.492794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e1e3e3fe-f57e-4808-a1a2-07a7b0d4a194 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:30:37.718270 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e1e3e3fe-f57e-4808-a1a2-07a7b0d4a194 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.926550 Oct 04 21:30:37.724412 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2471/4975] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:30:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:30:37.733924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-832473a4-ebf0-4518-b163-fa78c46d98cb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:37.734637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-316e5229-b216-488f-8a8b-6ff3e9c26441 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:37.741974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-316e5229-b216-488f-8a8b-6ff3e9c26441 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: b96184fe-5a1c-418f-b473-41ac84763259] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:37.742994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-316e5229-b216-488f-8a8b-6ff3e9c26441 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:37.743670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-316e5229-b216-488f-8a8b-6ff3e9c26441 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:37.744287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-316e5229-b216-488f-8a8b-6ff3e9c26441 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:37.745607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-316e5229-b216-488f-8a8b-6ff3e9c26441 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:37.746240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-316e5229-b216-488f-8a8b-6ff3e9c26441 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:37.750414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-316e5229-b216-488f-8a8b-6ff3e9c26441 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:37.786783 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-832473a4-ebf0-4518-b163-fa78c46d98cb tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 200 len: 1545 microversion: 2.1 time: 0.714502 Oct 04 21:30:37.786783 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2505/4976] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:37 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 1545 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:37.804840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a7dd1f47-8a21-4184-ae02-66e8adc987ee tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:37.807426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a7dd1f47-8a21-4184-ae02-66e8adc987ee tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:38.131669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-316e5229-b216-488f-8a8b-6ff3e9c26441 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:38.142648 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-316e5229-b216-488f-8a8b-6ff3e9c26441 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259" status: 200 len: 1272 microversion: 2.1 time: 0.417096 Oct 04 21:30:38.156777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a7dd1f47-8a21-4184-ae02-66e8adc987ee tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:38.161238 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2472/4977] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:37 2022] GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259 => generated 1272 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:38.171604 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a7dd1f47-8a21-4184-ae02-66e8adc987ee tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1229 microversion: 2.1 time: 0.370923 Oct 04 21:30:38.181756 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2506/4978] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:37 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1229 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:38.189917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-307e19db-4dd0-4e43-b6d8-87f5cfe61791 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:38.193253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-307e19db-4dd0-4e43-b6d8-87f5cfe61791 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:38.208959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-79838eb8-93d1-4719-8e18-51488899c13a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:38.224735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-79838eb8-93d1-4719-8e18-51488899c13a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:38.230100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-307e19db-4dd0-4e43-b6d8-87f5cfe61791 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:38.231571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-307e19db-4dd0-4e43-b6d8-87f5cfe61791 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:38.232411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-307e19db-4dd0-4e43-b6d8-87f5cfe61791 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:38.233936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-307e19db-4dd0-4e43-b6d8-87f5cfe61791 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:38.237308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-307e19db-4dd0-4e43-b6d8-87f5cfe61791 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:38.238011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-307e19db-4dd0-4e43-b6d8-87f5cfe61791 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:38.240296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79838eb8-93d1-4719-8e18-51488899c13a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:38.242248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79838eb8-93d1-4719-8e18-51488899c13a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:38.245589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79838eb8-93d1-4719-8e18-51488899c13a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:38.248779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79838eb8-93d1-4719-8e18-51488899c13a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:38.254220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79838eb8-93d1-4719-8e18-51488899c13a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:38.254573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79838eb8-93d1-4719-8e18-51488899c13a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:38.340946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:38.934851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-307e19db-4dd0-4e43-b6d8-87f5cfe61791 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:38.954480 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-307e19db-4dd0-4e43-b6d8-87f5cfe61791 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1461 microversion: 2.1 time: 0.791219 Oct 04 21:30:38.956057 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2473/4979] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:38 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1461 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:38.978503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c90875da-5d6d-4dee-8db8-640b13227ef7 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:38.979379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c90875da-5d6d-4dee-8db8-640b13227ef7 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:39.000566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c90875da-5d6d-4dee-8db8-640b13227ef7 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:39.001637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c90875da-5d6d-4dee-8db8-640b13227ef7 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:39.002315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c90875da-5d6d-4dee-8db8-640b13227ef7 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:39.003272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c90875da-5d6d-4dee-8db8-640b13227ef7 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:39.004142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c90875da-5d6d-4dee-8db8-640b13227ef7 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:39.004808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c90875da-5d6d-4dee-8db8-640b13227ef7 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:39.075715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-79838eb8-93d1-4719-8e18-51488899c13a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:39.088514 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-79838eb8-93d1-4719-8e18-51488899c13a tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 200 len: 1545 microversion: 2.1 time: 0.902772 Oct 04 21:30:39.090128 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2507/4980] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:38 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 1545 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:39.139664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c90875da-5d6d-4dee-8db8-640b13227ef7 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:39.155256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c90875da-5d6d-4dee-8db8-640b13227ef7 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:39.156929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c90875da-5d6d-4dee-8db8-640b13227ef7 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:39.158617 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c90875da-5d6d-4dee-8db8-640b13227ef7 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1366 microversion: 2.47 time: 0.189394 Oct 04 21:30:39.166063 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2474/4981] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:38 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:39.174525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0144d053-44c4-43e6-8160-6e50475b894c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:39.175760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0144d053-44c4-43e6-8160-6e50475b894c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: b96184fe-5a1c-418f-b473-41ac84763259] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:39.184127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0144d053-44c4-43e6-8160-6e50475b894c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:39.184907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0144d053-44c4-43e6-8160-6e50475b894c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:39.186780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0144d053-44c4-43e6-8160-6e50475b894c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:39.187720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0144d053-44c4-43e6-8160-6e50475b894c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:39.188355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0144d053-44c4-43e6-8160-6e50475b894c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:39.189100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0144d053-44c4-43e6-8160-6e50475b894c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:39.212484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e1ecd84a-1c0f-46e7-a4ab-8b79703e9ea3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:39.212781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e1ecd84a-1c0f-46e7-a4ab-8b79703e9ea3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:39.427102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e1ecd84a-1c0f-46e7-a4ab-8b79703e9ea3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:39.436914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0144d053-44c4-43e6-8160-6e50475b894c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:39.437492 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e1ecd84a-1c0f-46e7-a4ab-8b79703e9ea3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1229 microversion: 2.1 time: 0.228990 Oct 04 21:30:39.439110 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2475/4982] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:39 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1229 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:39.448868 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0144d053-44c4-43e6-8160-6e50475b894c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259" status: 200 len: 1278 microversion: 2.1 time: 0.278992 Oct 04 21:30:39.451156 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2508/4983] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:39 2022] GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259 => generated 1278 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:39.998614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6e5832e6-a3ea-45f5-a01b-f8382ca72263 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:40.000640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6e5832e6-a3ea-45f5-a01b-f8382ca72263 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:40.039722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e5832e6-a3ea-45f5-a01b-f8382ca72263 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:40.046365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e5832e6-a3ea-45f5-a01b-f8382ca72263 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:40.053736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e5832e6-a3ea-45f5-a01b-f8382ca72263 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:40.055032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e5832e6-a3ea-45f5-a01b-f8382ca72263 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:40.056394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e5832e6-a3ea-45f5-a01b-f8382ca72263 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:40.056849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e5832e6-a3ea-45f5-a01b-f8382ca72263 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:40.207200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a1e0834b-698a-4557-b5ec-baf184e1141b tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:40.210457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a1e0834b-698a-4557-b5ec-baf184e1141b tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:40.239631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1e0834b-698a-4557-b5ec-baf184e1141b tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:40.242857 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1e0834b-698a-4557-b5ec-baf184e1141b tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:40.243323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1e0834b-698a-4557-b5ec-baf184e1141b tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:40.244075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1e0834b-698a-4557-b5ec-baf184e1141b tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:40.244543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1e0834b-698a-4557-b5ec-baf184e1141b tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:40.245005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1e0834b-698a-4557-b5ec-baf184e1141b tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:40.646715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a1e0834b-698a-4557-b5ec-baf184e1141b tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:40.713453 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a1e0834b-698a-4557-b5ec-baf184e1141b tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:40.719347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a1e0834b-698a-4557-b5ec-baf184e1141b tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:40.721510 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a1e0834b-698a-4557-b5ec-baf184e1141b tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1366 microversion: 2.47 time: 0.533890 Oct 04 21:30:40.738420 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2509/4984] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:40 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1366 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:30:40.755916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1cfd0b57-9d0b-4124-b907-981292035c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:40.757723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1cfd0b57-9d0b-4124-b907-981292035c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:40.777329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1cfd0b57-9d0b-4124-b907-981292035c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:40.778062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1cfd0b57-9d0b-4124-b907-981292035c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:40.778680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1cfd0b57-9d0b-4124-b907-981292035c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:40.781076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1cfd0b57-9d0b-4124-b907-981292035c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:40.782117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1cfd0b57-9d0b-4124-b907-981292035c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:40.782879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1cfd0b57-9d0b-4124-b907-981292035c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:40.932551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6e5832e6-a3ea-45f5-a01b-f8382ca72263 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:40.949370 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6e5832e6-a3ea-45f5-a01b-f8382ca72263 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1519 microversion: 2.1 time: 0.960462 Oct 04 21:30:40.955499 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2476/4985] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:39 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1519 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:40.962253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4948b907-9b44-4d3f-9b1b-9175edab9f38 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:40.963236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4948b907-9b44-4d3f-9b1b-9175edab9f38 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: b96184fe-5a1c-418f-b473-41ac84763259] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:40.980067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4948b907-9b44-4d3f-9b1b-9175edab9f38 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:40.980920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4948b907-9b44-4d3f-9b1b-9175edab9f38 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:40.982792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4948b907-9b44-4d3f-9b1b-9175edab9f38 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:40.984086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4948b907-9b44-4d3f-9b1b-9175edab9f38 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:40.985096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4948b907-9b44-4d3f-9b1b-9175edab9f38 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:40.985864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4948b907-9b44-4d3f-9b1b-9175edab9f38 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:41.312089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:41.401955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1cfd0b57-9d0b-4124-b907-981292035c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:41.424793 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1cfd0b57-9d0b-4124-b907-981292035c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1281 microversion: 2.1 time: 0.679534 Oct 04 21:30:41.426616 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2510/4986] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:40 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1281 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:41.448659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4948b907-9b44-4d3f-9b1b-9175edab9f38 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:41.469843 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4948b907-9b44-4d3f-9b1b-9175edab9f38 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259" status: 200 len: 1278 microversion: 2.1 time: 0.512127 Oct 04 21:30:41.471163 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2477/4987] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:40 2022] GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259 => generated 1278 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:41.760770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2c014227-70f0-462d-807a-49e9f518d224 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:41.761582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2c014227-70f0-462d-807a-49e9f518d224 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:41.786280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c014227-70f0-462d-807a-49e9f518d224 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:41.787311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c014227-70f0-462d-807a-49e9f518d224 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:41.789524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c014227-70f0-462d-807a-49e9f518d224 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:41.790483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c014227-70f0-462d-807a-49e9f518d224 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:41.791108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c014227-70f0-462d-807a-49e9f518d224 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:41.791738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c014227-70f0-462d-807a-49e9f518d224 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:41.982994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6a73dd12-c265-47f4-82b8-cfc56bf41a63 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:41.987071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6a73dd12-c265-47f4-82b8-cfc56bf41a63 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:42.027294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a73dd12-c265-47f4-82b8-cfc56bf41a63 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:42.028634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a73dd12-c265-47f4-82b8-cfc56bf41a63 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:42.032296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a73dd12-c265-47f4-82b8-cfc56bf41a63 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:42.033269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a73dd12-c265-47f4-82b8-cfc56bf41a63 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:42.052497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a73dd12-c265-47f4-82b8-cfc56bf41a63 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:42.052497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a73dd12-c265-47f4-82b8-cfc56bf41a63 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:42.323666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2c014227-70f0-462d-807a-49e9f518d224 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:42.334931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2c014227-70f0-462d-807a-49e9f518d224 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:42.338221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2c014227-70f0-462d-807a-49e9f518d224 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:42.341207 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2c014227-70f0-462d-807a-49e9f518d224 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1366 microversion: 2.47 time: 0.588525 Oct 04 21:30:42.359184 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2511/4988] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:41 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1366 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:42.457001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9088caec-f382-431f-b842-276d4632d9a2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:42.458552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9088caec-f382-431f-b842-276d4632d9a2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:42.474035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9088caec-f382-431f-b842-276d4632d9a2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:42.474858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9088caec-f382-431f-b842-276d4632d9a2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:42.475539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9088caec-f382-431f-b842-276d4632d9a2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:42.476470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9088caec-f382-431f-b842-276d4632d9a2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:42.477155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9088caec-f382-431f-b842-276d4632d9a2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:42.477829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9088caec-f382-431f-b842-276d4632d9a2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:42.587785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6a73dd12-c265-47f4-82b8-cfc56bf41a63 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:42.600830 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6a73dd12-c265-47f4-82b8-cfc56bf41a63 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1519 microversion: 2.1 time: 0.627474 Oct 04 21:30:42.603366 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2478/4989] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:41 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1519 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:30:42.617830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-569c9324-c850-4a4b-96db-be30911e201d tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:42.617830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-569c9324-c850-4a4b-96db-be30911e201d tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: b96184fe-5a1c-418f-b473-41ac84763259] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:42.635330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-569c9324-c850-4a4b-96db-be30911e201d tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:42.639099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-569c9324-c850-4a4b-96db-be30911e201d tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:42.639554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-569c9324-c850-4a4b-96db-be30911e201d tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:42.640294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-569c9324-c850-4a4b-96db-be30911e201d tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:42.640751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-569c9324-c850-4a4b-96db-be30911e201d tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:42.641175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-569c9324-c850-4a4b-96db-be30911e201d tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:42.770622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9088caec-f382-431f-b842-276d4632d9a2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:42.805815 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9088caec-f382-431f-b842-276d4632d9a2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1287 microversion: 2.1 time: 0.352610 Oct 04 21:30:42.823192 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2512/4990] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:42 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1287 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:30:42.993832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-569c9324-c850-4a4b-96db-be30911e201d tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:43.003751 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-569c9324-c850-4a4b-96db-be30911e201d tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259" status: 200 len: 1320 microversion: 2.1 time: 0.394911 Oct 04 21:30:43.004913 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2479/4991] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:42 2022] GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259 => generated 1320 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:43.272980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-44623f41-051a-43a9-bf8f-f2613e406cc6 req-9ae0004e-4060-4f9a-9423-e7103f49e112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "090f4719-1122-427c-b849-7c1865ac1ff5", "tag": "d0935e96-259f-4617-85cd-eac52e8c9e52"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:43.298807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-44623f41-051a-43a9-bf8f-f2613e406cc6 req-9ae0004e-4060-4f9a-9423-e7103f49e112 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:43.299316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-44623f41-051a-43a9-bf8f-f2613e406cc6 req-9ae0004e-4060-4f9a-9423-e7103f49e112 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:43.303359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-44623f41-051a-43a9-bf8f-f2613e406cc6 req-9ae0004e-4060-4f9a-9423-e7103f49e112 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:43.343003 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-44623f41-051a-43a9-bf8f-f2613e406cc6 req-9ae0004e-4060-4f9a-9423-e7103f49e112 service nova] Creating event network-changed:d0935e96-259f-4617-85cd-eac52e8c9e52 for instance 090f4719-1122-427c-b849-7c1865ac1ff5 on n-h2-860282-1 Oct 04 21:30:43.357780 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-44623f41-051a-43a9-bf8f-f2613e406cc6 req-9ae0004e-4060-4f9a-9423-e7103f49e112 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090312 Oct 04 21:30:43.360695 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2513/4992] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:43.382641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9347dee-71f1-4b7b-81f0-b3e72e1e68e4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:43.383558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d9347dee-71f1-4b7b-81f0-b3e72e1e68e4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:43.411341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9347dee-71f1-4b7b-81f0-b3e72e1e68e4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:43.419161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9347dee-71f1-4b7b-81f0-b3e72e1e68e4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:43.420693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9347dee-71f1-4b7b-81f0-b3e72e1e68e4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:43.421774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9347dee-71f1-4b7b-81f0-b3e72e1e68e4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:43.423040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9347dee-71f1-4b7b-81f0-b3e72e1e68e4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:43.423040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9347dee-71f1-4b7b-81f0-b3e72e1e68e4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:43.652591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-71654507-10e8-4873-8302-0b854aad5a98 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:43.659588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-71654507-10e8-4873-8302-0b854aad5a98 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:43.698574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71654507-10e8-4873-8302-0b854aad5a98 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:43.699739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71654507-10e8-4873-8302-0b854aad5a98 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:43.701354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71654507-10e8-4873-8302-0b854aad5a98 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:43.704817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71654507-10e8-4873-8302-0b854aad5a98 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:43.704817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71654507-10e8-4873-8302-0b854aad5a98 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:43.704817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71654507-10e8-4873-8302-0b854aad5a98 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:43.748518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d9347dee-71f1-4b7b-81f0-b3e72e1e68e4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:43.768732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d9347dee-71f1-4b7b-81f0-b3e72e1e68e4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:43.790585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d9347dee-71f1-4b7b-81f0-b3e72e1e68e4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:43.790585 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d9347dee-71f1-4b7b-81f0-b3e72e1e68e4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1366 microversion: 2.47 time: 0.420994 Oct 04 21:30:43.792472 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2480/4993] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:43 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1366 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:43.865762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3622db8c-b199-4325-bc38-41d2a3ef7900 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:43.867195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3622db8c-b199-4325-bc38-41d2a3ef7900 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:43.908889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3622db8c-b199-4325-bc38-41d2a3ef7900 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:43.915923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3622db8c-b199-4325-bc38-41d2a3ef7900 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:43.915923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3622db8c-b199-4325-bc38-41d2a3ef7900 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:43.922086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3622db8c-b199-4325-bc38-41d2a3ef7900 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:43.924522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3622db8c-b199-4325-bc38-41d2a3ef7900 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:43.928472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3622db8c-b199-4325-bc38-41d2a3ef7900 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:45.915469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-71654507-10e8-4873-8302-0b854aad5a98 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:45.991231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3622db8c-b199-4325-bc38-41d2a3ef7900 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:45.995565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:45.995819 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-71654507-10e8-4873-8302-0b854aad5a98 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1519 microversion: 2.1 time: 2.363439 Oct 04 21:30:45.996439 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2514/4994] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:43 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1519 bytes in 2369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:46.008880 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3622db8c-b199-4325-bc38-41d2a3ef7900 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1329 microversion: 2.1 time: 2.177587 Oct 04 21:30:46.009898 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2481/4995] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:43 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1329 bytes in 2180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:46.012497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f655bd64-1b14-4cb8-b4fe-afab945b5bc0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:46.013704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f655bd64-1b14-4cb8-b4fe-afab945b5bc0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: b96184fe-5a1c-418f-b473-41ac84763259] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:46.026476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-060c3895-d690-42fc-b603-7c694fbb1b89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:46.027458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-060c3895-d690-42fc-b603-7c694fbb1b89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:46.063848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f655bd64-1b14-4cb8-b4fe-afab945b5bc0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:46.071796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f655bd64-1b14-4cb8-b4fe-afab945b5bc0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:46.072530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-060c3895-d690-42fc-b603-7c694fbb1b89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:46.074290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-060c3895-d690-42fc-b603-7c694fbb1b89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:46.075056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-060c3895-d690-42fc-b603-7c694fbb1b89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:46.076929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-060c3895-d690-42fc-b603-7c694fbb1b89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:46.077965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-060c3895-d690-42fc-b603-7c694fbb1b89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:46.078392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f655bd64-1b14-4cb8-b4fe-afab945b5bc0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:46.079719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-060c3895-d690-42fc-b603-7c694fbb1b89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:46.089973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f655bd64-1b14-4cb8-b4fe-afab945b5bc0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:46.094138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f655bd64-1b14-4cb8-b4fe-afab945b5bc0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:46.095073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f655bd64-1b14-4cb8-b4fe-afab945b5bc0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:46.414263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-060c3895-d690-42fc-b603-7c694fbb1b89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:46.430248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-060c3895-d690-42fc-b603-7c694fbb1b89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:46.437976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-060c3895-d690-42fc-b603-7c694fbb1b89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:46.439228 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-060c3895-d690-42fc-b603-7c694fbb1b89 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1366 microversion: 2.47 time: 0.428158 Oct 04 21:30:46.470383 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2482/4996] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:46 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1366 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:46.610306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-a92f386a-b703-4e28-9ff7-ca141f6f7d2e req-d2607497-677b-4503-b9e4-5d07b957caf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b9a73ee-951f-415e-9088-ad819e929ae9", "tag": "c0ae92ef-0f60-4dbd-8e5b-19f51b47ad19"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:46.631751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a92f386a-b703-4e28-9ff7-ca141f6f7d2e req-d2607497-677b-4503-b9e4-5d07b957caf3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:46.632884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a92f386a-b703-4e28-9ff7-ca141f6f7d2e req-d2607497-677b-4503-b9e4-5d07b957caf3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:46.633804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a92f386a-b703-4e28-9ff7-ca141f6f7d2e req-d2607497-677b-4503-b9e4-5d07b957caf3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:46.650736 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-a92f386a-b703-4e28-9ff7-ca141f6f7d2e req-d2607497-677b-4503-b9e4-5d07b957caf3 service nova] Creating event network-changed:c0ae92ef-0f60-4dbd-8e5b-19f51b47ad19 for instance 3b9a73ee-951f-415e-9088-ad819e929ae9 on n-h2-860282-1 Oct 04 21:30:46.659641 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-a92f386a-b703-4e28-9ff7-ca141f6f7d2e req-d2607497-677b-4503-b9e4-5d07b957caf3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057553 Oct 04 21:30:46.661685 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2483/4997] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:47.024142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f655bd64-1b14-4cb8-b4fe-afab945b5bc0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:47.039894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-2476f6d1-ee5b-4adc-ae66-9e7a92d66087 req-a5af029f-b2b4-4443-a27c-831228c1f84c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e21bf0e6-f7df-4150-aa24-150a14fe3c4e", "tag": "45b08d6d-7a13-49d7-a0fd-7132d7256f7f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:47.065241 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f655bd64-1b14-4cb8-b4fe-afab945b5bc0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259" status: 200 len: 1320 microversion: 2.1 time: 1.066969 Oct 04 21:30:47.067103 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2515/4998] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:45 2022] GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259 => generated 1320 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:47.083045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2476f6d1-ee5b-4adc-ae66-9e7a92d66087 req-a5af029f-b2b4-4443-a27c-831228c1f84c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:47.083045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2476f6d1-ee5b-4adc-ae66-9e7a92d66087 req-a5af029f-b2b4-4443-a27c-831228c1f84c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:47.083045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2476f6d1-ee5b-4adc-ae66-9e7a92d66087 req-a5af029f-b2b4-4443-a27c-831228c1f84c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:47.097114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3205ee4a-2ad5-487b-85f3-8052eaa01e0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:47.098336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3205ee4a-2ad5-487b-85f3-8052eaa01e0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:47.108158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3205ee4a-2ad5-487b-85f3-8052eaa01e0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:47.109090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3205ee4a-2ad5-487b-85f3-8052eaa01e0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:47.110227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3205ee4a-2ad5-487b-85f3-8052eaa01e0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:47.115220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3205ee4a-2ad5-487b-85f3-8052eaa01e0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:47.115220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3205ee4a-2ad5-487b-85f3-8052eaa01e0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:47.115220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3205ee4a-2ad5-487b-85f3-8052eaa01e0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:47.116811 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-2476f6d1-ee5b-4adc-ae66-9e7a92d66087 req-a5af029f-b2b4-4443-a27c-831228c1f84c service nova] Creating event network-changed:45b08d6d-7a13-49d7-a0fd-7132d7256f7f for instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e on n-h2-860282-1 Oct 04 21:30:47.124284 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-2476f6d1-ee5b-4adc-ae66-9e7a92d66087 req-a5af029f-b2b4-4443-a27c-831228c1f84c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110126 Oct 04 21:30:47.125181 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2484/4999] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:30:47.133074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-833df54f-5fee-4dee-b902-f297741c38e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:47.133809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-833df54f-5fee-4dee-b902-f297741c38e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:47.142581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-833df54f-5fee-4dee-b902-f297741c38e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:47.143071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-833df54f-5fee-4dee-b902-f297741c38e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:47.143701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-833df54f-5fee-4dee-b902-f297741c38e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:47.144566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-833df54f-5fee-4dee-b902-f297741c38e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:47.145304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-833df54f-5fee-4dee-b902-f297741c38e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:47.146059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-833df54f-5fee-4dee-b902-f297741c38e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:47.377909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:47.568247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-833df54f-5fee-4dee-b902-f297741c38e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:47.583603 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-833df54f-5fee-4dee-b902-f297741c38e0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1329 microversion: 2.1 time: 0.456933 Oct 04 21:30:47.585280 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2485/5000] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:47 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1329 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:47.590725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-011669ee-4816-4ccb-a39a-79d78f73b514 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:47.592435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-011669ee-4816-4ccb-a39a-79d78f73b514 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:47.601704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-011669ee-4816-4ccb-a39a-79d78f73b514 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:47.605485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-011669ee-4816-4ccb-a39a-79d78f73b514 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:47.608560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-011669ee-4816-4ccb-a39a-79d78f73b514 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:47.613110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-011669ee-4816-4ccb-a39a-79d78f73b514 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:47.613110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-011669ee-4816-4ccb-a39a-79d78f73b514 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:47.613110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-011669ee-4816-4ccb-a39a-79d78f73b514 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:47.947549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-011669ee-4816-4ccb-a39a-79d78f73b514 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:47.949066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3205ee4a-2ad5-487b-85f3-8052eaa01e0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:47.963456 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3205ee4a-2ad5-487b-85f3-8052eaa01e0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1519 microversion: 2.1 time: 0.877751 Oct 04 21:30:47.964343 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2516/5001] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:47 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1519 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:47.987264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-011669ee-4816-4ccb-a39a-79d78f73b514 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:47.993777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-011669ee-4816-4ccb-a39a-79d78f73b514 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:47.995192 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-011669ee-4816-4ccb-a39a-79d78f73b514 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1366 microversion: 2.47 time: 0.408586 Oct 04 21:30:47.995794 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2486/5002] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:47 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1366 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:48.104807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-addc241c-7a2b-4462-943e-0260c1caf77e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:48.105953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-addc241c-7a2b-4462-943e-0260c1caf77e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: b96184fe-5a1c-418f-b473-41ac84763259] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:48.126008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-addc241c-7a2b-4462-943e-0260c1caf77e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:48.128749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-addc241c-7a2b-4462-943e-0260c1caf77e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:48.130731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-addc241c-7a2b-4462-943e-0260c1caf77e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:48.133883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-addc241c-7a2b-4462-943e-0260c1caf77e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:48.135513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-addc241c-7a2b-4462-943e-0260c1caf77e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:48.137803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-addc241c-7a2b-4462-943e-0260c1caf77e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:48.196998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=16 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:48.503766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-addc241c-7a2b-4462-943e-0260c1caf77e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:48.515292 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-addc241c-7a2b-4462-943e-0260c1caf77e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259" status: 200 len: 1320 microversion: 2.1 time: 0.416522 Oct 04 21:30:48.517373 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2517/5003] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:48 2022] GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259 => generated 1320 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:48.613158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8a746deb-d609-4a93-958c-9efc794cea85 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:48.617339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8a746deb-d609-4a93-958c-9efc794cea85 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:48.625662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a746deb-d609-4a93-958c-9efc794cea85 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:48.626174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a746deb-d609-4a93-958c-9efc794cea85 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:48.626633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a746deb-d609-4a93-958c-9efc794cea85 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:48.627354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a746deb-d609-4a93-958c-9efc794cea85 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:48.627814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a746deb-d609-4a93-958c-9efc794cea85 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:48.628258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a746deb-d609-4a93-958c-9efc794cea85 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:48.751692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-29bdf819-00f6-46ce-81ea-fe41ce1fc08e req-cc75c140-d262-431a-a7ff-44c095c5549d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b96184fe-5a1c-418f-b473-41ac84763259", "tag": "6bef1f74-036f-46b5-9078-ff5b70fe10c1"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:48.770077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-29bdf819-00f6-46ce-81ea-fe41ce1fc08e req-cc75c140-d262-431a-a7ff-44c095c5549d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:48.770841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-29bdf819-00f6-46ce-81ea-fe41ce1fc08e req-cc75c140-d262-431a-a7ff-44c095c5549d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:48.772307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-29bdf819-00f6-46ce-81ea-fe41ce1fc08e req-cc75c140-d262-431a-a7ff-44c095c5549d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:48.786348 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-29bdf819-00f6-46ce-81ea-fe41ce1fc08e req-cc75c140-d262-431a-a7ff-44c095c5549d service nova] Creating event network-changed:6bef1f74-036f-46b5-9078-ff5b70fe10c1 for instance b96184fe-5a1c-418f-b473-41ac84763259 on n-h1-860282-1 Oct 04 21:30:48.793107 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-29bdf819-00f6-46ce-81ea-fe41ce1fc08e req-cc75c140-d262-431a-a7ff-44c095c5549d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046613 Oct 04 21:30:48.794962 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2518/5004] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:30:48.882699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8a746deb-d609-4a93-958c-9efc794cea85 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:48.896663 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8a746deb-d609-4a93-958c-9efc794cea85 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1329 microversion: 2.1 time: 0.287242 Oct 04 21:30:48.898021 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2487/5005] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:48 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1329 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:49.001802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1e7e57ee-8dc9-4395-962f-bce34b51ae3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:49.002525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1e7e57ee-8dc9-4395-962f-bce34b51ae3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:49.010478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e7e57ee-8dc9-4395-962f-bce34b51ae3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:49.010968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e7e57ee-8dc9-4395-962f-bce34b51ae3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:49.011762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e7e57ee-8dc9-4395-962f-bce34b51ae3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:49.012656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e7e57ee-8dc9-4395-962f-bce34b51ae3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:49.014444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e7e57ee-8dc9-4395-962f-bce34b51ae3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:49.014992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e7e57ee-8dc9-4395-962f-bce34b51ae3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:49.044071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-463dbda8-a683-42af-86f1-06109d9f3335 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:49.045439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-463dbda8-a683-42af-86f1-06109d9f3335 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:49.054840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-463dbda8-a683-42af-86f1-06109d9f3335 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:49.056363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-463dbda8-a683-42af-86f1-06109d9f3335 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:49.057175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-463dbda8-a683-42af-86f1-06109d9f3335 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:49.079991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-463dbda8-a683-42af-86f1-06109d9f3335 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:49.080645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-463dbda8-a683-42af-86f1-06109d9f3335 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:49.081099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-463dbda8-a683-42af-86f1-06109d9f3335 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:49.195724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-463dbda8-a683-42af-86f1-06109d9f3335 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:49.209060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-463dbda8-a683-42af-86f1-06109d9f3335 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:49.214264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-463dbda8-a683-42af-86f1-06109d9f3335 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:49.215732 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-463dbda8-a683-42af-86f1-06109d9f3335 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1366 microversion: 2.47 time: 0.185432 Oct 04 21:30:49.219382 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2488/5006] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:49 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:49.309731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1e7e57ee-8dc9-4395-962f-bce34b51ae3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:49.322526 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1e7e57ee-8dc9-4395-962f-bce34b51ae3d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1519 microversion: 2.1 time: 0.332486 Oct 04 21:30:49.323560 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2519/5007] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:48 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1519 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:49.545771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b73d6c0f-d3b7-47ba-8334-af049b254c99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:49.546386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b73d6c0f-d3b7-47ba-8334-af049b254c99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: b96184fe-5a1c-418f-b473-41ac84763259] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:49.548202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=10 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:49.553186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b73d6c0f-d3b7-47ba-8334-af049b254c99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:49.553854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b73d6c0f-d3b7-47ba-8334-af049b254c99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:49.554444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b73d6c0f-d3b7-47ba-8334-af049b254c99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:49.555180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b73d6c0f-d3b7-47ba-8334-af049b254c99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:49.555664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b73d6c0f-d3b7-47ba-8334-af049b254c99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:49.556086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b73d6c0f-d3b7-47ba-8334-af049b254c99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:49.806570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b73d6c0f-d3b7-47ba-8334-af049b254c99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:49.816972 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b73d6c0f-d3b7-47ba-8334-af049b254c99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259" status: 200 len: 1320 microversion: 2.1 time: 0.275527 Oct 04 21:30:49.829122 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2489/5008] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:49 2022] GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259 => generated 1320 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:49.924963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-26b44dbb-3dd0-4dd3-88fe-6db480d5140a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:49.925806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-26b44dbb-3dd0-4dd3-88fe-6db480d5140a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:49.935786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26b44dbb-3dd0-4dd3-88fe-6db480d5140a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:49.935786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26b44dbb-3dd0-4dd3-88fe-6db480d5140a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:49.936599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26b44dbb-3dd0-4dd3-88fe-6db480d5140a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:49.940122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26b44dbb-3dd0-4dd3-88fe-6db480d5140a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:49.942259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26b44dbb-3dd0-4dd3-88fe-6db480d5140a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:49.943676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26b44dbb-3dd0-4dd3-88fe-6db480d5140a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:50.244482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4b3ddb5a-8a76-448a-b817-b24b83b31b7f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:50.245799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4b3ddb5a-8a76-448a-b817-b24b83b31b7f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:50.260259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b3ddb5a-8a76-448a-b817-b24b83b31b7f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:50.272354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b3ddb5a-8a76-448a-b817-b24b83b31b7f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:50.277877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b3ddb5a-8a76-448a-b817-b24b83b31b7f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:50.280495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b3ddb5a-8a76-448a-b817-b24b83b31b7f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:50.282671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b3ddb5a-8a76-448a-b817-b24b83b31b7f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:50.284901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b3ddb5a-8a76-448a-b817-b24b83b31b7f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:50.401063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4b3ddb5a-8a76-448a-b817-b24b83b31b7f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:50.416384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4b3ddb5a-8a76-448a-b817-b24b83b31b7f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:50.423791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4b3ddb5a-8a76-448a-b817-b24b83b31b7f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:50.425083 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4b3ddb5a-8a76-448a-b817-b24b83b31b7f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1366 microversion: 2.47 time: 0.184721 Oct 04 21:30:50.428201 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2490/5009] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:50 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:30:50.439588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7142a7b0-b59c-41cd-8d86-8c91d93e6283 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:50.443482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7142a7b0-b59c-41cd-8d86-8c91d93e6283 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:50.458997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7142a7b0-b59c-41cd-8d86-8c91d93e6283 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:50.459508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7142a7b0-b59c-41cd-8d86-8c91d93e6283 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:50.462616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7142a7b0-b59c-41cd-8d86-8c91d93e6283 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:50.463937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7142a7b0-b59c-41cd-8d86-8c91d93e6283 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:50.464589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7142a7b0-b59c-41cd-8d86-8c91d93e6283 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:50.465039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7142a7b0-b59c-41cd-8d86-8c91d93e6283 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:50.499299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-26b44dbb-3dd0-4dd3-88fe-6db480d5140a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:50.507897 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-26b44dbb-3dd0-4dd3-88fe-6db480d5140a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1329 microversion: 2.1 time: 0.587280 Oct 04 21:30:50.511624 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2520/5010] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:49 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1329 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:50.676273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7142a7b0-b59c-41cd-8d86-8c91d93e6283 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:50.691978 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7142a7b0-b59c-41cd-8d86-8c91d93e6283 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1519 microversion: 2.1 time: 0.262082 Oct 04 21:30:50.692851 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2491/5011] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:50 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1519 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:50.848803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7e2f280e-8d66-4ef5-9ad6-9549d33fe7af tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:50.849637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7e2f280e-8d66-4ef5-9ad6-9549d33fe7af tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: b96184fe-5a1c-418f-b473-41ac84763259] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:50.870185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e2f280e-8d66-4ef5-9ad6-9549d33fe7af tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:50.870701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e2f280e-8d66-4ef5-9ad6-9549d33fe7af tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:50.871149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e2f280e-8d66-4ef5-9ad6-9549d33fe7af tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:50.871881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e2f280e-8d66-4ef5-9ad6-9549d33fe7af tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:50.872942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e2f280e-8d66-4ef5-9ad6-9549d33fe7af tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:50.873385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e2f280e-8d66-4ef5-9ad6-9549d33fe7af tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:51.116376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7e2f280e-8d66-4ef5-9ad6-9549d33fe7af tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:51.126930 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7e2f280e-8d66-4ef5-9ad6-9549d33fe7af tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259" status: 200 len: 1320 microversion: 2.1 time: 0.281594 Oct 04 21:30:51.128339 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2521/5012] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:50 2022] GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259 => generated 1320 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:51.460410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1203189c-edcd-4a79-bb9a-48b09163afff tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:51.460947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1203189c-edcd-4a79-bb9a-48b09163afff tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:51.467687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1203189c-edcd-4a79-bb9a-48b09163afff tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:51.468277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1203189c-edcd-4a79-bb9a-48b09163afff tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:51.468780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1203189c-edcd-4a79-bb9a-48b09163afff tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:51.469724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1203189c-edcd-4a79-bb9a-48b09163afff tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:51.478612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1203189c-edcd-4a79-bb9a-48b09163afff tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:51.479167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1203189c-edcd-4a79-bb9a-48b09163afff tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:51.539842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3763569a-c45a-4b08-829f-3d94271ab6eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:51.547493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3763569a-c45a-4b08-829f-3d94271ab6eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:51.563373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3763569a-c45a-4b08-829f-3d94271ab6eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:51.563876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3763569a-c45a-4b08-829f-3d94271ab6eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:51.567580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3763569a-c45a-4b08-829f-3d94271ab6eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:51.568800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3763569a-c45a-4b08-829f-3d94271ab6eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:51.569783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3763569a-c45a-4b08-829f-3d94271ab6eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:51.570425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3763569a-c45a-4b08-829f-3d94271ab6eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:51.586341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1203189c-edcd-4a79-bb9a-48b09163afff tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:51.610442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1203189c-edcd-4a79-bb9a-48b09163afff tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:51.613915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1203189c-edcd-4a79-bb9a-48b09163afff tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:51.615201 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1203189c-edcd-4a79-bb9a-48b09163afff tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1366 microversion: 2.47 time: 0.158865 Oct 04 21:30:51.620749 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2492/5013] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:51 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:51.715379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-73109113-f157-451c-9e3f-5ffb71805800 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:51.716996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-73109113-f157-451c-9e3f-5ffb71805800 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:51.727107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73109113-f157-451c-9e3f-5ffb71805800 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:51.727107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73109113-f157-451c-9e3f-5ffb71805800 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:51.727107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73109113-f157-451c-9e3f-5ffb71805800 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:51.727107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73109113-f157-451c-9e3f-5ffb71805800 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:51.727848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73109113-f157-451c-9e3f-5ffb71805800 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:51.727848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73109113-f157-451c-9e3f-5ffb71805800 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:51.791709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3763569a-c45a-4b08-829f-3d94271ab6eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:51.800796 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3763569a-c45a-4b08-829f-3d94271ab6eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1329 microversion: 2.1 time: 0.267959 Oct 04 21:30:51.802544 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2522/5014] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:51 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1329 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:51.914686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-73109113-f157-451c-9e3f-5ffb71805800 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:51.923801 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-73109113-f157-451c-9e3f-5ffb71805800 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1519 microversion: 2.1 time: 0.212227 Oct 04 21:30:51.927570 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2493/5015] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:51 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1519 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:52.152039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f03e8c39-911d-4cb3-a74a-78f234ba951c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:52.155818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f03e8c39-911d-4cb3-a74a-78f234ba951c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: b96184fe-5a1c-418f-b473-41ac84763259] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:52.160873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f03e8c39-911d-4cb3-a74a-78f234ba951c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:52.161378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f03e8c39-911d-4cb3-a74a-78f234ba951c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:52.162169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f03e8c39-911d-4cb3-a74a-78f234ba951c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:52.162881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f03e8c39-911d-4cb3-a74a-78f234ba951c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:52.163351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f03e8c39-911d-4cb3-a74a-78f234ba951c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:52.163776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f03e8c39-911d-4cb3-a74a-78f234ba951c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:52.399643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f03e8c39-911d-4cb3-a74a-78f234ba951c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:52.411398 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f03e8c39-911d-4cb3-a74a-78f234ba951c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259" status: 200 len: 1320 microversion: 2.1 time: 0.263357 Oct 04 21:30:52.426260 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2523/5016] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:52 2022] GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259 => generated 1320 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:30:52.648625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bb5338a6-98a9-42a3-a577-fcfdbc9324db tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:52.651683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bb5338a6-98a9-42a3-a577-fcfdbc9324db tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:52.660399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb5338a6-98a9-42a3-a577-fcfdbc9324db tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:52.661165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb5338a6-98a9-42a3-a577-fcfdbc9324db tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:52.662294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb5338a6-98a9-42a3-a577-fcfdbc9324db tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:52.663415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb5338a6-98a9-42a3-a577-fcfdbc9324db tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:52.663876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb5338a6-98a9-42a3-a577-fcfdbc9324db tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:52.664480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb5338a6-98a9-42a3-a577-fcfdbc9324db tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:52.748795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bb5338a6-98a9-42a3-a577-fcfdbc9324db tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:52.758516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bb5338a6-98a9-42a3-a577-fcfdbc9324db tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:52.778848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bb5338a6-98a9-42a3-a577-fcfdbc9324db tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:52.778848 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bb5338a6-98a9-42a3-a577-fcfdbc9324db tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1366 microversion: 2.47 time: 0.129830 Oct 04 21:30:52.778848 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2494/5017] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:52 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:52.834826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-68f034da-d2aa-4cc1-beac-647397e42242 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:52.836088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-68f034da-d2aa-4cc1-beac-647397e42242 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:52.843555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68f034da-d2aa-4cc1-beac-647397e42242 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:52.844041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68f034da-d2aa-4cc1-beac-647397e42242 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:52.844496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68f034da-d2aa-4cc1-beac-647397e42242 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:52.845735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68f034da-d2aa-4cc1-beac-647397e42242 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:52.850042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68f034da-d2aa-4cc1-beac-647397e42242 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:52.850820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-68f034da-d2aa-4cc1-beac-647397e42242 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:52.947528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ca4fc3ac-64e2-4b30-93e5-6cbdeb7f1443 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:52.948502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ca4fc3ac-64e2-4b30-93e5-6cbdeb7f1443 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:52.956083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca4fc3ac-64e2-4b30-93e5-6cbdeb7f1443 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:52.956847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca4fc3ac-64e2-4b30-93e5-6cbdeb7f1443 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:52.957865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca4fc3ac-64e2-4b30-93e5-6cbdeb7f1443 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:52.959031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca4fc3ac-64e2-4b30-93e5-6cbdeb7f1443 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:52.960006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca4fc3ac-64e2-4b30-93e5-6cbdeb7f1443 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:52.960669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca4fc3ac-64e2-4b30-93e5-6cbdeb7f1443 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:53.137493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-68f034da-d2aa-4cc1-beac-647397e42242 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:53.147554 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-68f034da-d2aa-4cc1-beac-647397e42242 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1329 microversion: 2.1 time: 0.317079 Oct 04 21:30:53.148465 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2524/5018] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:52 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1329 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:53.243813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ca4fc3ac-64e2-4b30-93e5-6cbdeb7f1443 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:53.252919 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ca4fc3ac-64e2-4b30-93e5-6cbdeb7f1443 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1519 microversion: 2.1 time: 0.309162 Oct 04 21:30:53.253763 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2495/5019] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:52 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1519 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:30:53.439343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d1e4b3ef-55fd-4590-a296-6d49f9ef194e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:53.439966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d1e4b3ef-55fd-4590-a296-6d49f9ef194e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: b96184fe-5a1c-418f-b473-41ac84763259] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:53.456104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1e4b3ef-55fd-4590-a296-6d49f9ef194e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:53.466704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1e4b3ef-55fd-4590-a296-6d49f9ef194e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:53.466704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1e4b3ef-55fd-4590-a296-6d49f9ef194e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:53.466704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1e4b3ef-55fd-4590-a296-6d49f9ef194e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:53.466704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1e4b3ef-55fd-4590-a296-6d49f9ef194e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:53.466704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1e4b3ef-55fd-4590-a296-6d49f9ef194e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:53.476343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:53.801656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-715cfdd0-d9d2-4c51-80fb-1c86479c24e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:53.802285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-715cfdd0-d9d2-4c51-80fb-1c86479c24e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:53.815609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-715cfdd0-d9d2-4c51-80fb-1c86479c24e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:53.816110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-715cfdd0-d9d2-4c51-80fb-1c86479c24e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:53.816549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-715cfdd0-d9d2-4c51-80fb-1c86479c24e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:53.834079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-715cfdd0-d9d2-4c51-80fb-1c86479c24e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:53.834079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-715cfdd0-d9d2-4c51-80fb-1c86479c24e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:53.834079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-715cfdd0-d9d2-4c51-80fb-1c86479c24e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:54.159813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-715cfdd0-d9d2-4c51-80fb-1c86479c24e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:54.159813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-715cfdd0-d9d2-4c51-80fb-1c86479c24e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:54.159813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-715cfdd0-d9d2-4c51-80fb-1c86479c24e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:54.159813 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-715cfdd0-d9d2-4c51-80fb-1c86479c24e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1372 microversion: 2.47 time: 0.247264 Oct 04 21:30:54.159813 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2496/5020] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:53 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1372 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:54.160673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d1e4b3ef-55fd-4590-a296-6d49f9ef194e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:54.160673 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d1e4b3ef-55fd-4590-a296-6d49f9ef194e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259" status: 200 len: 1320 microversion: 2.1 time: 0.642122 Oct 04 21:30:54.160673 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2525/5021] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:53 2022] GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259 => generated 1320 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:54.174818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e74fd0c2-6225-43e2-94dd-1f60d75f25cc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:54.175945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e74fd0c2-6225-43e2-94dd-1f60d75f25cc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:54.188130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e74fd0c2-6225-43e2-94dd-1f60d75f25cc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:54.211153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e74fd0c2-6225-43e2-94dd-1f60d75f25cc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:54.211153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e74fd0c2-6225-43e2-94dd-1f60d75f25cc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:54.211153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e74fd0c2-6225-43e2-94dd-1f60d75f25cc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:54.211153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e74fd0c2-6225-43e2-94dd-1f60d75f25cc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:54.211153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e74fd0c2-6225-43e2-94dd-1f60d75f25cc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:54.282488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-44024716-93b3-4ac5-b08f-3cb5e68c2607 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:54.290615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-44024716-93b3-4ac5-b08f-3cb5e68c2607 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:54.298068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44024716-93b3-4ac5-b08f-3cb5e68c2607 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:54.298724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44024716-93b3-4ac5-b08f-3cb5e68c2607 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:54.299327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44024716-93b3-4ac5-b08f-3cb5e68c2607 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:54.300246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44024716-93b3-4ac5-b08f-3cb5e68c2607 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:54.300975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44024716-93b3-4ac5-b08f-3cb5e68c2607 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:54.301665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44024716-93b3-4ac5-b08f-3cb5e68c2607 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:54.750121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e74fd0c2-6225-43e2-94dd-1f60d75f25cc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:54.765645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-44024716-93b3-4ac5-b08f-3cb5e68c2607 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:54.769046 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e74fd0c2-6225-43e2-94dd-1f60d75f25cc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1329 microversion: 2.1 time: 0.600498 Oct 04 21:30:54.770343 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2497/5022] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:54 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1329 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:54.778030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-94564ab1-7acb-4f95-a4c3-2e3d7b25381e req-729d0180-a26a-47bb-903e-d3a64bd92577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96184fe-5a1c-418f-b473-41ac84763259", "name": "network-vif-plugged", "status": "completed", "tag": "6bef1f74-036f-46b5-9078-ff5b70fe10c1"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:54.782084 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-44024716-93b3-4ac5-b08f-3cb5e68c2607 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1519 microversion: 2.1 time: 0.503886 Oct 04 21:30:54.785362 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2526/5023] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:54 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1519 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:54.795734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-94564ab1-7acb-4f95-a4c3-2e3d7b25381e req-729d0180-a26a-47bb-903e-d3a64bd92577 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:54.796453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-94564ab1-7acb-4f95-a4c3-2e3d7b25381e req-729d0180-a26a-47bb-903e-d3a64bd92577 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:54.797039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-94564ab1-7acb-4f95-a4c3-2e3d7b25381e req-729d0180-a26a-47bb-903e-d3a64bd92577 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:54.811401 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-94564ab1-7acb-4f95-a4c3-2e3d7b25381e req-729d0180-a26a-47bb-903e-d3a64bd92577 service nova] Creating event network-vif-plugged:6bef1f74-036f-46b5-9078-ff5b70fe10c1 for instance b96184fe-5a1c-418f-b473-41ac84763259 on n-h1-860282-1 Oct 04 21:30:54.817460 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-94564ab1-7acb-4f95-a4c3-2e3d7b25381e req-729d0180-a26a-47bb-903e-d3a64bd92577 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045225 Oct 04 21:30:54.818330 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2498/5024] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:55.198136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9334c13a-7ab6-420d-a728-19268f852d79 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:55.199644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9334c13a-7ab6-420d-a728-19268f852d79 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: b96184fe-5a1c-418f-b473-41ac84763259] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:55.208844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3c52ae85-01aa-4fe4-80d2-a1762d257e6f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:55.209887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3c52ae85-01aa-4fe4-80d2-a1762d257e6f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:55.211008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9334c13a-7ab6-420d-a728-19268f852d79 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:55.211561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9334c13a-7ab6-420d-a728-19268f852d79 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:55.212005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9334c13a-7ab6-420d-a728-19268f852d79 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:55.212795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9334c13a-7ab6-420d-a728-19268f852d79 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:55.213271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9334c13a-7ab6-420d-a728-19268f852d79 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:55.213742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9334c13a-7ab6-420d-a728-19268f852d79 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:55.218925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c52ae85-01aa-4fe4-80d2-a1762d257e6f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:55.219984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c52ae85-01aa-4fe4-80d2-a1762d257e6f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:55.220651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c52ae85-01aa-4fe4-80d2-a1762d257e6f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:55.221596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c52ae85-01aa-4fe4-80d2-a1762d257e6f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:55.222222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c52ae85-01aa-4fe4-80d2-a1762d257e6f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:55.222813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c52ae85-01aa-4fe4-80d2-a1762d257e6f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:55.392153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3c52ae85-01aa-4fe4-80d2-a1762d257e6f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:55.401738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3c52ae85-01aa-4fe4-80d2-a1762d257e6f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:55.402984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3c52ae85-01aa-4fe4-80d2-a1762d257e6f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:55.404684 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3c52ae85-01aa-4fe4-80d2-a1762d257e6f tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1372 microversion: 2.47 time: 0.199967 Oct 04 21:30:55.405376 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2499/5025] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:55 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1372 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:30:55.455258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9334c13a-7ab6-420d-a728-19268f852d79 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:55.463879 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9334c13a-7ab6-420d-a728-19268f852d79 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259" status: 200 len: 1320 microversion: 2.1 time: 0.271225 Oct 04 21:30:55.464423 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2527/5026] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:55 2022] GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259 => generated 1320 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:55.796548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-db37a0c0-ee6e-46f9-b9a6-207e808e4b5e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:55.797215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-db37a0c0-ee6e-46f9-b9a6-207e808e4b5e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:55.803579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db37a0c0-ee6e-46f9-b9a6-207e808e4b5e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:55.804190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db37a0c0-ee6e-46f9-b9a6-207e808e4b5e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:55.806445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db37a0c0-ee6e-46f9-b9a6-207e808e4b5e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:55.806445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db37a0c0-ee6e-46f9-b9a6-207e808e4b5e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:55.806445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db37a0c0-ee6e-46f9-b9a6-207e808e4b5e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:55.807078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db37a0c0-ee6e-46f9-b9a6-207e808e4b5e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:55.812275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-82041812-161c-4fad-b304-9cc5079055e5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:55.813118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-82041812-161c-4fad-b304-9cc5079055e5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:55.819614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82041812-161c-4fad-b304-9cc5079055e5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:55.820923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82041812-161c-4fad-b304-9cc5079055e5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:55.821567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82041812-161c-4fad-b304-9cc5079055e5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:55.822544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82041812-161c-4fad-b304-9cc5079055e5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:55.823171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82041812-161c-4fad-b304-9cc5079055e5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:55.823825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82041812-161c-4fad-b304-9cc5079055e5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:55.842062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:56.065873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-82041812-161c-4fad-b304-9cc5079055e5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:56.068854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-db37a0c0-ee6e-46f9-b9a6-207e808e4b5e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:56.074070 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-82041812-161c-4fad-b304-9cc5079055e5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1519 microversion: 2.1 time: 0.266483 Oct 04 21:30:56.089948 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-db37a0c0-ee6e-46f9-b9a6-207e808e4b5e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1329 microversion: 2.1 time: 0.287439 Oct 04 21:30:56.090767 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2528/5027] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:55 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1519 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:56.092023 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2500/5028] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:55 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1329 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:56.434526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-167a51d2-22a4-4366-89ec-e7f1269576b1 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:56.435901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-167a51d2-22a4-4366-89ec-e7f1269576b1 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:56.443922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-167a51d2-22a4-4366-89ec-e7f1269576b1 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:56.443922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-167a51d2-22a4-4366-89ec-e7f1269576b1 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:56.444347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-167a51d2-22a4-4366-89ec-e7f1269576b1 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:56.444947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-167a51d2-22a4-4366-89ec-e7f1269576b1 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:56.445578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-167a51d2-22a4-4366-89ec-e7f1269576b1 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:56.446217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-167a51d2-22a4-4366-89ec-e7f1269576b1 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:56.488764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-070b5eff-1a5b-4da6-a433-1193cd33c58b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:56.489397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-070b5eff-1a5b-4da6-a433-1193cd33c58b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: b96184fe-5a1c-418f-b473-41ac84763259] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:56.495705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:56.497221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-070b5eff-1a5b-4da6-a433-1193cd33c58b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:56.497925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-070b5eff-1a5b-4da6-a433-1193cd33c58b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:56.498425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-070b5eff-1a5b-4da6-a433-1193cd33c58b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:56.499102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-070b5eff-1a5b-4da6-a433-1193cd33c58b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:56.499613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-070b5eff-1a5b-4da6-a433-1193cd33c58b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:56.500042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-070b5eff-1a5b-4da6-a433-1193cd33c58b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:56.540673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-167a51d2-22a4-4366-89ec-e7f1269576b1 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:56.571692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-167a51d2-22a4-4366-89ec-e7f1269576b1 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:56.574819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-167a51d2-22a4-4366-89ec-e7f1269576b1 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:56.577711 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-167a51d2-22a4-4366-89ec-e7f1269576b1 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1357 microversion: 2.47 time: 0.148991 Oct 04 21:30:56.617333 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2529/5029] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:56 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:56.637185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d9df9f70-8ea0-4ea2-8c52-bb5c3ed69fc4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:56.654942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d9df9f70-8ea0-4ea2-8c52-bb5c3ed69fc4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:56.659801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d9df9f70-8ea0-4ea2-8c52-bb5c3ed69fc4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Searching by: {'deleted': False, 'project_id': '5308e8f8d3714caebcf21c76211de44d'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:30:56.664811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9df9f70-8ea0-4ea2-8c52-bb5c3ed69fc4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:56.665783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9df9f70-8ea0-4ea2-8c52-bb5c3ed69fc4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:56.666572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9df9f70-8ea0-4ea2-8c52-bb5c3ed69fc4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:56.668558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9df9f70-8ea0-4ea2-8c52-bb5c3ed69fc4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:56.671317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9df9f70-8ea0-4ea2-8c52-bb5c3ed69fc4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:56.674874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9df9f70-8ea0-4ea2-8c52-bb5c3ed69fc4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:56.735173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-070b5eff-1a5b-4da6-a433-1193cd33c58b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:56.744341 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-070b5eff-1a5b-4da6-a433-1193cd33c58b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259" status: 200 len: 1320 microversion: 2.1 time: 0.259808 Oct 04 21:30:56.745106 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2501/5030] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:56 2022] GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259 => generated 1320 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:56.829101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-d9df9f70-8ea0-4ea2-8c52-bb5c3ed69fc4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:30:56.932509 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d9df9f70-8ea0-4ea2-8c52-bb5c3ed69fc4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:56.941594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9df9f70-8ea0-4ea2-8c52-bb5c3ed69fc4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:56.942630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9df9f70-8ea0-4ea2-8c52-bb5c3ed69fc4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:56.943751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9df9f70-8ea0-4ea2-8c52-bb5c3ed69fc4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:56.959173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d9df9f70-8ea0-4ea2-8c52-bb5c3ed69fc4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:56.960720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d9df9f70-8ea0-4ea2-8c52-bb5c3ed69fc4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:57.015543 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d9df9f70-8ea0-4ea2-8c52-bb5c3ed69fc4 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.393925 Oct 04 21:30:57.016385 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2530/5031] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Oct 4 21:30:56 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:57.050872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-55bf9c63-8f93-4fc0-9af6-6b4a0ca0ff06 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:57.051488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-55bf9c63-8f93-4fc0-9af6-6b4a0ca0ff06 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:57.059231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55bf9c63-8f93-4fc0-9af6-6b4a0ca0ff06 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:57.059765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55bf9c63-8f93-4fc0-9af6-6b4a0ca0ff06 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:57.060701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55bf9c63-8f93-4fc0-9af6-6b4a0ca0ff06 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:57.061690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55bf9c63-8f93-4fc0-9af6-6b4a0ca0ff06 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:57.062223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55bf9c63-8f93-4fc0-9af6-6b4a0ca0ff06 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:57.062731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55bf9c63-8f93-4fc0-9af6-6b4a0ca0ff06 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:57.098763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-55bf9c63-8f93-4fc0-9af6-6b4a0ca0ff06 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:30:57.102007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f7b3b6d1-6776-4e0f-9baf-83f9b66e53eb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:57.102725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f7b3b6d1-6776-4e0f-9baf-83f9b66e53eb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:57.110330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7b3b6d1-6776-4e0f-9baf-83f9b66e53eb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:57.110828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7b3b6d1-6776-4e0f-9baf-83f9b66e53eb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:57.111407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7b3b6d1-6776-4e0f-9baf-83f9b66e53eb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:57.112158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7b3b6d1-6776-4e0f-9baf-83f9b66e53eb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:57.112622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7b3b6d1-6776-4e0f-9baf-83f9b66e53eb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:57.113054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7b3b6d1-6776-4e0f-9baf-83f9b66e53eb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:57.352772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f7b3b6d1-6776-4e0f-9baf-83f9b66e53eb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:57.381759 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f7b3b6d1-6776-4e0f-9baf-83f9b66e53eb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1519 microversion: 2.1 time: 0.270786 Oct 04 21:30:57.381759 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2531/5032] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:57 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1519 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:57.381759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d81e87d6-f395-4c89-b1bc-0fdb799f2ddb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:57.381759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d81e87d6-f395-4c89-b1bc-0fdb799f2ddb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:57.390483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d81e87d6-f395-4c89-b1bc-0fdb799f2ddb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:57.390483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d81e87d6-f395-4c89-b1bc-0fdb799f2ddb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:57.390483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d81e87d6-f395-4c89-b1bc-0fdb799f2ddb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:57.390483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d81e87d6-f395-4c89-b1bc-0fdb799f2ddb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:57.391006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d81e87d6-f395-4c89-b1bc-0fdb799f2ddb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:57.391127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d81e87d6-f395-4c89-b1bc-0fdb799f2ddb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:57.556063 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-55bf9c63-8f93-4fc0-9af6-6b4a0ca0ff06 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "DELETE /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 204 len: 0 microversion: 2.47 time: 0.510001 Oct 04 21:30:57.556668 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2502/5033] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:30:57 2022] DELETE /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:30:57.573349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-31303998-fc5e-4494-9987-d7f6e866e4a3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:57.574661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-31303998-fc5e-4494-9987-d7f6e866e4a3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:57.582305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31303998-fc5e-4494-9987-d7f6e866e4a3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:57.583086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31303998-fc5e-4494-9987-d7f6e866e4a3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:57.583735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31303998-fc5e-4494-9987-d7f6e866e4a3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:57.584889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31303998-fc5e-4494-9987-d7f6e866e4a3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:57.585346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31303998-fc5e-4494-9987-d7f6e866e4a3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:57.585790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31303998-fc5e-4494-9987-d7f6e866e4a3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:57.592182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d81e87d6-f395-4c89-b1bc-0fdb799f2ddb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:57.603065 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d81e87d6-f395-4c89-b1bc-0fdb799f2ddb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1329 microversion: 2.1 time: 0.231610 Oct 04 21:30:57.604591 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2532/5034] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:57 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1329 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:57.707288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-31303998-fc5e-4494-9987-d7f6e866e4a3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:57.720871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-31303998-fc5e-4494-9987-d7f6e866e4a3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:57.722727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-31303998-fc5e-4494-9987-d7f6e866e4a3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:57.724204 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-31303998-fc5e-4494-9987-d7f6e866e4a3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1363 microversion: 2.47 time: 0.155300 Oct 04 21:30:57.725369 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2503/5035] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:57 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:57.768218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-898c8ba5-c26b-4e8b-a702-1799cfec9f27 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:57.769208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-898c8ba5-c26b-4e8b-a702-1799cfec9f27 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: b96184fe-5a1c-418f-b473-41ac84763259] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:57.775997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-898c8ba5-c26b-4e8b-a702-1799cfec9f27 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:57.776482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-898c8ba5-c26b-4e8b-a702-1799cfec9f27 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:57.776930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-898c8ba5-c26b-4e8b-a702-1799cfec9f27 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:57.778185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-898c8ba5-c26b-4e8b-a702-1799cfec9f27 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:57.779150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-898c8ba5-c26b-4e8b-a702-1799cfec9f27 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:57.782779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-898c8ba5-c26b-4e8b-a702-1799cfec9f27 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:57.924742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-898c8ba5-c26b-4e8b-a702-1799cfec9f27 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:57.932822 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-898c8ba5-c26b-4e8b-a702-1799cfec9f27 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259" status: 200 len: 1508 microversion: 2.1 time: 0.169498 Oct 04 21:30:57.933392 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2533/5036] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:57 2022] GET /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:57.955420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-65b2ca5d-2eca-413b-8193-8cad49be2425 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:57.956032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-65b2ca5d-2eca-413b-8193-8cad49be2425 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 3b9a73ee-951f-415e-9088-ad819e929ae9] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:57.962361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65b2ca5d-2eca-413b-8193-8cad49be2425 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:57.962851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65b2ca5d-2eca-413b-8193-8cad49be2425 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:57.963294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65b2ca5d-2eca-413b-8193-8cad49be2425 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:57.963990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65b2ca5d-2eca-413b-8193-8cad49be2425 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:57.964447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65b2ca5d-2eca-413b-8193-8cad49be2425 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:57.964906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65b2ca5d-2eca-413b-8193-8cad49be2425 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:58.104059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-65b2ca5d-2eca-413b-8193-8cad49be2425 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:58.112251 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-65b2ca5d-2eca-413b-8193-8cad49be2425 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/3b9a73ee-951f-415e-9088-ad819e929ae9" status: 200 len: 1320 microversion: 2.1 time: 0.160692 Oct 04 21:30:58.112761 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2504/5037] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:57 2022] GET /compute/v2.1/servers/3b9a73ee-951f-415e-9088-ad819e929ae9 => generated 1320 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:58.397761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f1e86076-c6c2-467d-8818-a22e34c42bcd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:58.398377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f1e86076-c6c2-467d-8818-a22e34c42bcd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:58.405926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1e86076-c6c2-467d-8818-a22e34c42bcd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:58.406418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1e86076-c6c2-467d-8818-a22e34c42bcd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:58.406855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1e86076-c6c2-467d-8818-a22e34c42bcd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:58.408158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1e86076-c6c2-467d-8818-a22e34c42bcd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:58.408620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1e86076-c6c2-467d-8818-a22e34c42bcd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:58.409047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1e86076-c6c2-467d-8818-a22e34c42bcd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:58.628188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5ad2d8b7-144a-49e2-802f-a34fb1093f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:58.629154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5ad2d8b7-144a-49e2-802f-a34fb1093f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:58.635187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ad2d8b7-144a-49e2-802f-a34fb1093f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:58.635884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ad2d8b7-144a-49e2-802f-a34fb1093f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:58.636427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ad2d8b7-144a-49e2-802f-a34fb1093f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:58.638874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ad2d8b7-144a-49e2-802f-a34fb1093f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:58.639633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ad2d8b7-144a-49e2-802f-a34fb1093f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:58.640605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ad2d8b7-144a-49e2-802f-a34fb1093f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:58.733658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f1e86076-c6c2-467d-8818-a22e34c42bcd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:58.738673 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f1e86076-c6c2-467d-8818-a22e34c42bcd tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1519 microversion: 2.1 time: 0.344815 Oct 04 21:30:58.739267 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2534/5038] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:58 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1519 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:58.756402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-42a02f84-ef05-417b-b7c4-208010b85b81 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:58.757032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-42a02f84-ef05-417b-b7c4-208010b85b81 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:58.763524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42a02f84-ef05-417b-b7c4-208010b85b81 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:58.764115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42a02f84-ef05-417b-b7c4-208010b85b81 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:58.764565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42a02f84-ef05-417b-b7c4-208010b85b81 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:58.765533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42a02f84-ef05-417b-b7c4-208010b85b81 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:58.766171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42a02f84-ef05-417b-b7c4-208010b85b81 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:58.766781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-42a02f84-ef05-417b-b7c4-208010b85b81 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:58.864244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-42a02f84-ef05-417b-b7c4-208010b85b81 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:58.881511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-42a02f84-ef05-417b-b7c4-208010b85b81 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:58.883583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-42a02f84-ef05-417b-b7c4-208010b85b81 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:58.885558 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-42a02f84-ef05-417b-b7c4-208010b85b81 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1363 microversion: 2.47 time: 0.133176 Oct 04 21:30:58.886581 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2535/5039] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:58 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1363 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:30:58.922731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-98b1b4f6-7555-4956-94bb-e3d5cc22dd20 req-34b7a5fd-6a8d-4d1a-95f8-13e47a8d75ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9a73ee-951f-415e-9088-ad819e929ae9", "name": "network-vif-plugged", "status": "completed", "tag": "c0ae92ef-0f60-4dbd-8e5b-19f51b47ad19"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:58.933442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-98b1b4f6-7555-4956-94bb-e3d5cc22dd20 req-34b7a5fd-6a8d-4d1a-95f8-13e47a8d75ff service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:58.933958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-98b1b4f6-7555-4956-94bb-e3d5cc22dd20 req-34b7a5fd-6a8d-4d1a-95f8-13e47a8d75ff service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:58.934396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-98b1b4f6-7555-4956-94bb-e3d5cc22dd20 req-34b7a5fd-6a8d-4d1a-95f8-13e47a8d75ff service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:58.949793 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-98b1b4f6-7555-4956-94bb-e3d5cc22dd20 req-34b7a5fd-6a8d-4d1a-95f8-13e47a8d75ff service nova] Creating event network-vif-plugged:c0ae92ef-0f60-4dbd-8e5b-19f51b47ad19 for instance 3b9a73ee-951f-415e-9088-ad819e929ae9 on n-h2-860282-1 Oct 04 21:30:58.953398 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-98b1b4f6-7555-4956-94bb-e3d5cc22dd20 req-34b7a5fd-6a8d-4d1a-95f8-13e47a8d75ff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034960 Oct 04 21:30:58.955160 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2536/5040] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:30:59.113311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5ad2d8b7-144a-49e2-802f-a34fb1093f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:59.137940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5b5e3180-7d73-4fd6-97c8-42e577f35b1e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:59.139555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5b5e3180-7d73-4fd6-97c8-42e577f35b1e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 3b9a73ee-951f-415e-9088-ad819e929ae9] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:59.144750 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5ad2d8b7-144a-49e2-802f-a34fb1093f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1329 microversion: 2.1 time: 0.520754 Oct 04 21:30:59.154046 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2505/5041] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:58 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1329 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:59.159756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b5e3180-7d73-4fd6-97c8-42e577f35b1e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:59.160551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b5e3180-7d73-4fd6-97c8-42e577f35b1e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:59.162215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b5e3180-7d73-4fd6-97c8-42e577f35b1e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:59.164042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b5e3180-7d73-4fd6-97c8-42e577f35b1e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:59.166106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b5e3180-7d73-4fd6-97c8-42e577f35b1e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:59.170490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b5e3180-7d73-4fd6-97c8-42e577f35b1e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:59.556622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5b5e3180-7d73-4fd6-97c8-42e577f35b1e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:59.568425 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5b5e3180-7d73-4fd6-97c8-42e577f35b1e tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/3b9a73ee-951f-415e-9088-ad819e929ae9" status: 200 len: 1320 microversion: 2.1 time: 0.436312 Oct 04 21:30:59.583205 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2537/5042] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:59 2022] GET /compute/v2.1/servers/3b9a73ee-951f-415e-9088-ad819e929ae9 => generated 1320 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:30:59.762617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ebf1612d-aa22-4317-b2a6-696666615969 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:59.763247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ebf1612d-aa22-4317-b2a6-696666615969 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:59.769444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebf1612d-aa22-4317-b2a6-696666615969 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:59.770023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebf1612d-aa22-4317-b2a6-696666615969 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:59.770537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebf1612d-aa22-4317-b2a6-696666615969 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:59.771308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebf1612d-aa22-4317-b2a6-696666615969 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:59.771914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebf1612d-aa22-4317-b2a6-696666615969 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:59.772386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebf1612d-aa22-4317-b2a6-696666615969 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:59.915684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4932b46f-0139-4f52-9be1-ba83e183fddd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:59.924768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4932b46f-0139-4f52-9be1-ba83e183fddd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:59.925139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ebf1612d-aa22-4317-b2a6-696666615969 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:59.925325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4932b46f-0139-4f52-9be1-ba83e183fddd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:59.925325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4932b46f-0139-4f52-9be1-ba83e183fddd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:59.925325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4932b46f-0139-4f52-9be1-ba83e183fddd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:59.925767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4932b46f-0139-4f52-9be1-ba83e183fddd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:59.926221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4932b46f-0139-4f52-9be1-ba83e183fddd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:59.926650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4932b46f-0139-4f52-9be1-ba83e183fddd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:59.932579 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ebf1612d-aa22-4317-b2a6-696666615969 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1519 microversion: 2.1 time: 0.173790 Oct 04 21:30:59.933186 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2506/5043] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:59 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:59.967590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4932b46f-0139-4f52-9be1-ba83e183fddd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:59.968004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4932b46f-0139-4f52-9be1-ba83e183fddd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:59.968480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4932b46f-0139-4f52-9be1-ba83e183fddd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:59.968940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-4932b46f-0139-4f52-9be1-ba83e183fddd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lazy-loading 'fault' on Instance uuid 79131bec-4c4c-4289-a1cb-9a24fa5be220 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:31:00.013336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4932b46f-0139-4f52-9be1-ba83e183fddd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:00.022783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4932b46f-0139-4f52-9be1-ba83e183fddd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:00.024348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4932b46f-0139-4f52-9be1-ba83e183fddd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:00.026372 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4932b46f-0139-4f52-9be1-ba83e183fddd tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 200 len: 1368 microversion: 2.47 time: 0.115134 Oct 04 21:31:00.026942 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2538/5044] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:59 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 1368 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:31:00.181448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b75a6361-b162-4f9f-a72b-632d54605a8a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:00.182128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b75a6361-b162-4f9f-a72b-632d54605a8a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:00.189928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b75a6361-b162-4f9f-a72b-632d54605a8a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:00.193778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b75a6361-b162-4f9f-a72b-632d54605a8a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:00.193778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b75a6361-b162-4f9f-a72b-632d54605a8a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:00.193778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b75a6361-b162-4f9f-a72b-632d54605a8a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:00.193778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b75a6361-b162-4f9f-a72b-632d54605a8a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:00.193778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b75a6361-b162-4f9f-a72b-632d54605a8a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:00.380331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b75a6361-b162-4f9f-a72b-632d54605a8a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:00.390368 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b75a6361-b162-4f9f-a72b-632d54605a8a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1329 microversion: 2.1 time: 0.212902 Oct 04 21:31:00.397395 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2507/5045] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:00 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1329 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:00.594804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-90fd3699-3d24-4b58-914e-895ad9c0c3b6 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:00.595481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-90fd3699-3d24-4b58-914e-895ad9c0c3b6 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 3b9a73ee-951f-415e-9088-ad819e929ae9] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:00.602330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90fd3699-3d24-4b58-914e-895ad9c0c3b6 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:00.602814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90fd3699-3d24-4b58-914e-895ad9c0c3b6 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:00.603255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90fd3699-3d24-4b58-914e-895ad9c0c3b6 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:00.603940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90fd3699-3d24-4b58-914e-895ad9c0c3b6 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:00.604397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90fd3699-3d24-4b58-914e-895ad9c0c3b6 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:00.604826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90fd3699-3d24-4b58-914e-895ad9c0c3b6 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:00.752078 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-90fd3699-3d24-4b58-914e-895ad9c0c3b6 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:00.759813 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-90fd3699-3d24-4b58-914e-895ad9c0c3b6 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/3b9a73ee-951f-415e-9088-ad819e929ae9" status: 200 len: 1320 microversion: 2.1 time: 0.168948 Oct 04 21:31:00.760389 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2539/5046] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:00 2022] GET /compute/v2.1/servers/3b9a73ee-951f-415e-9088-ad819e929ae9 => generated 1320 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:00.960030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ae6b50ab-3a0d-475b-ba45-84e1ff7d50ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:00.960673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ae6b50ab-3a0d-475b-ba45-84e1ff7d50ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:00.967408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae6b50ab-3a0d-475b-ba45-84e1ff7d50ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:00.967888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae6b50ab-3a0d-475b-ba45-84e1ff7d50ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:00.968326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae6b50ab-3a0d-475b-ba45-84e1ff7d50ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:00.969009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae6b50ab-3a0d-475b-ba45-84e1ff7d50ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:00.969478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae6b50ab-3a0d-475b-ba45-84e1ff7d50ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:00.969913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae6b50ab-3a0d-475b-ba45-84e1ff7d50ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:01.054855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab06c1b1-8537-4971-940c-f1e0ef96e500 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:01.055564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ab06c1b1-8537-4971-940c-f1e0ef96e500 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 79131bec-4c4c-4289-a1cb-9a24fa5be220] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:01.063654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab06c1b1-8537-4971-940c-f1e0ef96e500 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:01.064663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab06c1b1-8537-4971-940c-f1e0ef96e500 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:01.065463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab06c1b1-8537-4971-940c-f1e0ef96e500 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:01.066554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab06c1b1-8537-4971-940c-f1e0ef96e500 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:01.067095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab06c1b1-8537-4971-940c-f1e0ef96e500 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:01.067691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab06c1b1-8537-4971-940c-f1e0ef96e500 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:01.084726 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-ab06c1b1-8537-4971-940c-f1e0ef96e500 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] HTTP exception thrown: Instance 79131bec-4c4c-4289-a1cb-9a24fa5be220 could not be found. Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab06c1b1-8537-4971-940c-f1e0ef96e500 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Request method failure captured: Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 HTTP/1.1 Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKXjlaYKzWN73BLwVUkbLJsPBrRhZFow-AUC6Dx2nF2dFicXneeaZPs6LC5NKg7VqLun1mldBPb1w93gkzXYeZjTv7oB04LBSQa4-ac73U68FADX-rtkghxYaeaMFzDID741VkElL3wlzbfANlfk0ZQ2FS4k9PT_ql33F5KOqdEA88I Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 5308e8f8d3714caebcf21c76211de44d Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerShowV247Test-862805411 Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5308e8f8d3714caebcf21c76211de44d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5308e8f8d3714caebcf21c76211de44d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5308e8f8d3714caebcf21c76211de44d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5308e8f8d3714caebcf21c76211de44d"}]}] Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerShowV247Test-862805411 Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 5308e8f8d3714caebcf21c76211de44d Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerShowV247Test-862805411 Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerShowV247Test-862805411-project Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: f6931e7717dc44b0b25454266c315ac9 Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerShowV247Test-862805411-project Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 79131bec-4c4c-4289-a1cb-9a24fa5be220 could not be found. Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '79131bec-4c4c-4289-a1cb-9a24fa5be220'} Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79131bec-4c4c-4289-a1cb-9a24fa5be220 could not be found. Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79131bec-4c4c-4289-a1cb-9a24fa5be220 could not be found. Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:01.086546 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:01.092328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:01.092328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:01.092328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:01.092328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:01.092328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:01.092328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79131bec-4c4c-4289-a1cb-9a24fa5be220 could not be found. Oct 04 21:31:01.092328 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:01.092328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab06c1b1-8537-4971-940c-f1e0ef96e500 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Returning 404 to user: Instance 79131bec-4c4c-4289-a1cb-9a24fa5be220 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:01.092328 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ab06c1b1-8537-4971-940c-f1e0ef96e500 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220" status: 404 len: 111 microversion: 2.47 time: 0.037996 Oct 04 21:31:01.094569 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2540/5047] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:31:01 2022] GET /compute/v2.1/servers/79131bec-4c4c-4289-a1cb-9a24fa5be220 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:31:01.097297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-82b01e7c-54ce-4f5d-9a77-5a9b0aa3c97d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:01.097829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-82b01e7c-54ce-4f5d-9a77-5a9b0aa3c97d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 4ba401ec-5056-44df-8255-49786814ccf9] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:01.103815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82b01e7c-54ce-4f5d-9a77-5a9b0aa3c97d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:01.104680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82b01e7c-54ce-4f5d-9a77-5a9b0aa3c97d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:01.104817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82b01e7c-54ce-4f5d-9a77-5a9b0aa3c97d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:01.105501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82b01e7c-54ce-4f5d-9a77-5a9b0aa3c97d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:01.106108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82b01e7c-54ce-4f5d-9a77-5a9b0aa3c97d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:01.106987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82b01e7c-54ce-4f5d-9a77-5a9b0aa3c97d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:01.125569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ae6b50ab-3a0d-475b-ba45-84e1ff7d50ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:01.134093 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ae6b50ab-3a0d-475b-ba45-84e1ff7d50ad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1519 microversion: 2.1 time: 0.177960 Oct 04 21:31:01.135069 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2508/5048] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:00 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:01.135203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-82b01e7c-54ce-4f5d-9a77-5a9b0aa3c97d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 4ba401ec-5056-44df-8255-49786814ccf9] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:31:01.165816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:01.414704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-19ee604a-636a-4892-a06f-c9eaa2ca5e79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:01.415352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-19ee604a-636a-4892-a06f-c9eaa2ca5e79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:01.418790 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-82b01e7c-54ce-4f5d-9a77-5a9b0aa3c97d tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4ba401ec-5056-44df-8255-49786814ccf9" status: 204 len: 0 microversion: 2.47 time: 0.325040 Oct 04 21:31:01.419670 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2541/5049] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:31:01 2022] DELETE /compute/v2.1/servers/4ba401ec-5056-44df-8255-49786814ccf9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:31:01.421970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19ee604a-636a-4892-a06f-c9eaa2ca5e79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:01.422462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19ee604a-636a-4892-a06f-c9eaa2ca5e79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:01.422902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19ee604a-636a-4892-a06f-c9eaa2ca5e79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:01.423601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19ee604a-636a-4892-a06f-c9eaa2ca5e79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:01.424064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19ee604a-636a-4892-a06f-c9eaa2ca5e79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:01.424490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19ee604a-636a-4892-a06f-c9eaa2ca5e79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:01.428908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-90ea6a97-ad11-4548-8550-a21b2e0c1ad3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:01.429731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-90ea6a97-ad11-4548-8550-a21b2e0c1ad3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 4ba401ec-5056-44df-8255-49786814ccf9] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:01.436476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90ea6a97-ad11-4548-8550-a21b2e0c1ad3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:01.437179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90ea6a97-ad11-4548-8550-a21b2e0c1ad3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:01.437661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90ea6a97-ad11-4548-8550-a21b2e0c1ad3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:01.439427 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90ea6a97-ad11-4548-8550-a21b2e0c1ad3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:01.439895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90ea6a97-ad11-4548-8550-a21b2e0c1ad3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:01.440320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-90ea6a97-ad11-4548-8550-a21b2e0c1ad3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:01.818950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-90ea6a97-ad11-4548-8550-a21b2e0c1ad3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:01.829915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-90ea6a97-ad11-4548-8550-a21b2e0c1ad3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:01.831596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-90ea6a97-ad11-4548-8550-a21b2e0c1ad3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:01.832904 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-90ea6a97-ad11-4548-8550-a21b2e0c1ad3 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba401ec-5056-44df-8255-49786814ccf9" status: 200 len: 1363 microversion: 2.47 time: 0.408534 Oct 04 21:31:01.833642 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2542/5050] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:31:01 2022] GET /compute/v2.1/servers/4ba401ec-5056-44df-8255-49786814ccf9 => generated 1363 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:31:01.838238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-64c03134-a72a-491b-934c-6156a0b53965 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:01.838855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-64c03134-a72a-491b-934c-6156a0b53965 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 3b9a73ee-951f-415e-9088-ad819e929ae9] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:01.856213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64c03134-a72a-491b-934c-6156a0b53965 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:01.856213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64c03134-a72a-491b-934c-6156a0b53965 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:01.856213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64c03134-a72a-491b-934c-6156a0b53965 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:01.856213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64c03134-a72a-491b-934c-6156a0b53965 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:01.856213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64c03134-a72a-491b-934c-6156a0b53965 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:01.856213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-64c03134-a72a-491b-934c-6156a0b53965 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:01.988834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-19ee604a-636a-4892-a06f-c9eaa2ca5e79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:01.996820 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-19ee604a-636a-4892-a06f-c9eaa2ca5e79 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1329 microversion: 2.1 time: 0.586294 Oct 04 21:31:01.997450 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2509/5051] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:01 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1329 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:02.067552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-64c03134-a72a-491b-934c-6156a0b53965 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:02.075640 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-64c03134-a72a-491b-934c-6156a0b53965 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/3b9a73ee-951f-415e-9088-ad819e929ae9" status: 200 len: 1507 microversion: 2.1 time: 0.240787 Oct 04 21:31:02.077464 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2543/5052] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:01 2022] GET /compute/v2.1/servers/3b9a73ee-951f-415e-9088-ad819e929ae9 => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:02.098402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-283cf348-656e-4d2e-977a-9733a01a572f tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:02.098907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-283cf348-656e-4d2e-977a-9733a01a572f tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 3b9a73ee-951f-415e-9088-ad819e929ae9] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:02.105700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-283cf348-656e-4d2e-977a-9733a01a572f tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:02.107077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-283cf348-656e-4d2e-977a-9733a01a572f tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:02.107402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-283cf348-656e-4d2e-977a-9733a01a572f tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:02.108113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-283cf348-656e-4d2e-977a-9733a01a572f tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:02.108575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-283cf348-656e-4d2e-977a-9733a01a572f tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:02.109008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-283cf348-656e-4d2e-977a-9733a01a572f tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:02.133948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-283cf348-656e-4d2e-977a-9733a01a572f tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 3b9a73ee-951f-415e-9088-ad819e929ae9] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:31:02.163002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c4a70443-ac8a-4e7b-8079-fbf930b80624 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:02.164337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c4a70443-ac8a-4e7b-8079-fbf930b80624 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:02.182567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4a70443-ac8a-4e7b-8079-fbf930b80624 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:02.183477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4a70443-ac8a-4e7b-8079-fbf930b80624 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:02.183997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4a70443-ac8a-4e7b-8079-fbf930b80624 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:02.184789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4a70443-ac8a-4e7b-8079-fbf930b80624 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:02.185338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4a70443-ac8a-4e7b-8079-fbf930b80624 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:02.185884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4a70443-ac8a-4e7b-8079-fbf930b80624 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:02.337447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c4a70443-ac8a-4e7b-8079-fbf930b80624 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:02.346222 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c4a70443-ac8a-4e7b-8079-fbf930b80624 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1519 microversion: 2.1 time: 0.189183 Oct 04 21:31:02.346810 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2544/5053] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:02 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:02.351301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-1af38ca7-7f5a-472f-8bf5-2562c83c4f8e req-ca32b6b5-bbdf-4a5e-8846-c1a86cf6708a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144fff2d-9df3-4a93-833f-7f76acc85185", "name": "network-vif-plugged", "status": "completed", "tag": "cef3ff62-fc82-48d3-a981-5cadb2647961"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:02.360711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1af38ca7-7f5a-472f-8bf5-2562c83c4f8e req-ca32b6b5-bbdf-4a5e-8846-c1a86cf6708a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:02.365192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1af38ca7-7f5a-472f-8bf5-2562c83c4f8e req-ca32b6b5-bbdf-4a5e-8846-c1a86cf6708a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:02.365192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1af38ca7-7f5a-472f-8bf5-2562c83c4f8e req-ca32b6b5-bbdf-4a5e-8846-c1a86cf6708a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:02.376537 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-1af38ca7-7f5a-472f-8bf5-2562c83c4f8e req-ca32b6b5-bbdf-4a5e-8846-c1a86cf6708a service nova] Creating event network-vif-plugged:cef3ff62-fc82-48d3-a981-5cadb2647961 for instance 144fff2d-9df3-4a93-833f-7f76acc85185 on n-h2-860282-1 Oct 04 21:31:02.382261 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-1af38ca7-7f5a-472f-8bf5-2562c83c4f8e req-ca32b6b5-bbdf-4a5e-8846-c1a86cf6708a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033967 Oct 04 21:31:02.383184 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2545/5054] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:02.484075 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-283cf348-656e-4d2e-977a-9733a01a572f tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3b9a73ee-951f-415e-9088-ad819e929ae9" status: 204 len: 0 microversion: 2.1 time: 0.389275 Oct 04 21:31:02.484839 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2510/5055] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:31:02 2022] DELETE /compute/v2.1/servers/3b9a73ee-951f-415e-9088-ad819e929ae9 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:31:02.493815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ad532582-542b-46b5-a3e0-953a5b38fd82 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:02.494402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ad532582-542b-46b5-a3e0-953a5b38fd82 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: b96184fe-5a1c-418f-b473-41ac84763259] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:02.500790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad532582-542b-46b5-a3e0-953a5b38fd82 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:02.501275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad532582-542b-46b5-a3e0-953a5b38fd82 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:02.501771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad532582-542b-46b5-a3e0-953a5b38fd82 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:02.502465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad532582-542b-46b5-a3e0-953a5b38fd82 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:02.502916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad532582-542b-46b5-a3e0-953a5b38fd82 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:02.503339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad532582-542b-46b5-a3e0-953a5b38fd82 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:02.530263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ad532582-542b-46b5-a3e0-953a5b38fd82 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: b96184fe-5a1c-418f-b473-41ac84763259] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:31:02.862173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-483379f3-8d10-4454-84e7-366de77d6f80 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:02.862914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-483379f3-8d10-4454-84e7-366de77d6f80 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 4ba401ec-5056-44df-8255-49786814ccf9] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:02.868877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-483379f3-8d10-4454-84e7-366de77d6f80 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:02.869363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-483379f3-8d10-4454-84e7-366de77d6f80 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:02.869838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-483379f3-8d10-4454-84e7-366de77d6f80 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:02.870561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-483379f3-8d10-4454-84e7-366de77d6f80 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:02.871023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-483379f3-8d10-4454-84e7-366de77d6f80 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:02.871459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-483379f3-8d10-4454-84e7-366de77d6f80 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:02.938769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-483379f3-8d10-4454-84e7-366de77d6f80 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:02.940805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:02.951929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-483379f3-8d10-4454-84e7-366de77d6f80 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:02.954490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-483379f3-8d10-4454-84e7-366de77d6f80 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:02.969546 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-483379f3-8d10-4454-84e7-366de77d6f80 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba401ec-5056-44df-8255-49786814ccf9" status: 200 len: 1363 microversion: 2.47 time: 0.098162 Oct 04 21:31:02.969546 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2511/5056] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:31:02 2022] GET /compute/v2.1/servers/4ba401ec-5056-44df-8255-49786814ccf9 => generated 1363 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:31:03.024437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-92326ac1-ce19-41d5-a15e-abd0d9995a2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:03.024437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-92326ac1-ce19-41d5-a15e-abd0d9995a2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:03.027019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92326ac1-ce19-41d5-a15e-abd0d9995a2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:03.027507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92326ac1-ce19-41d5-a15e-abd0d9995a2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:03.027943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92326ac1-ce19-41d5-a15e-abd0d9995a2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:03.029692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92326ac1-ce19-41d5-a15e-abd0d9995a2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:03.030115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92326ac1-ce19-41d5-a15e-abd0d9995a2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:03.030777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92326ac1-ce19-41d5-a15e-abd0d9995a2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:03.112288 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ad532582-542b-46b5-a3e0-953a5b38fd82 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259" status: 204 len: 0 microversion: 2.1 time: 0.622703 Oct 04 21:31:03.112894 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2546/5057] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:31:02 2022] DELETE /compute/v2.1/servers/b96184fe-5a1c-418f-b473-41ac84763259 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:31:03.172927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-92326ac1-ce19-41d5-a15e-abd0d9995a2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:03.182950 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-92326ac1-ce19-41d5-a15e-abd0d9995a2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1329 microversion: 2.1 time: 0.164858 Oct 04 21:31:03.182950 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2512/5058] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:03 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1329 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:03.224749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5ccd46da-ef81-44ae-af8a-35fc429d36be tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-286973961", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "61466b7d-ab16-465a-ab01-55e8561f4b19"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:03.282481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-5ccd46da-ef81-44ae-af8a-35fc429d36be tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] validate_networks() for [('61466b7d-ab16-465a-ab01-55e8561f4b19', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:31:03.369551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4c8ff18d-8e72-4da6-8452-683680ff7e87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:03.370267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4c8ff18d-8e72-4da6-8452-683680ff7e87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:03.376965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c8ff18d-8e72-4da6-8452-683680ff7e87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:03.377564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c8ff18d-8e72-4da6-8452-683680ff7e87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:03.378081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c8ff18d-8e72-4da6-8452-683680ff7e87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:03.378867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c8ff18d-8e72-4da6-8452-683680ff7e87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:03.379506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c8ff18d-8e72-4da6-8452-683680ff7e87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:03.380123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c8ff18d-8e72-4da6-8452-683680ff7e87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:03.609667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4c8ff18d-8e72-4da6-8452-683680ff7e87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:03.612033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:03.618687 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4c8ff18d-8e72-4da6-8452-683680ff7e87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1519 microversion: 2.1 time: 0.253102 Oct 04 21:31:03.619265 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2513/5059] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:03 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1519 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:03.778849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5ccd46da-ef81-44ae-af8a-35fc429d36be tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:31:03.779285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5ccd46da-ef81-44ae-af8a-35fc429d36be tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:31:03.779778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5ccd46da-ef81-44ae-af8a-35fc429d36be tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:31:03.780202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5ccd46da-ef81-44ae-af8a-35fc429d36be tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:31:03.780629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5ccd46da-ef81-44ae-af8a-35fc429d36be tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:31:03.790458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ccd46da-ef81-44ae-af8a-35fc429d36be tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:03.790954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ccd46da-ef81-44ae-af8a-35fc429d36be tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:03.791402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ccd46da-ef81-44ae-af8a-35fc429d36be tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:03.792146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ccd46da-ef81-44ae-af8a-35fc429d36be tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:03.792611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ccd46da-ef81-44ae-af8a-35fc429d36be tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:03.793049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ccd46da-ef81-44ae-af8a-35fc429d36be tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:03.815267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5ccd46da-ef81-44ae-af8a-35fc429d36be tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Getting quotas for project 12da8c6a64ae484bb779149dca92d2e7. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:31:03.821665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5ccd46da-ef81-44ae-af8a-35fc429d36be tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Getting quotas for user e3789d0f886643fb849af4f51838af4d and project 12da8c6a64ae484bb779149dca92d2e7. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:31:03.835594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5ccd46da-ef81-44ae-af8a-35fc429d36be tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Going to run 2 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:31:03.838429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5ccd46da-ef81-44ae-af8a-35fc429d36be tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: e0246d29-9597-4269-a64b-6daf8bf0cd8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:31:03.970106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5ccd46da-ef81-44ae-af8a-35fc429d36be tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=e0246d29-9597-4269-a64b-6daf8bf0cd8f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:31:03.986902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4c1efc57-69b7-465a-bd8f-752b50912428 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:03.987514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4c1efc57-69b7-465a-bd8f-752b50912428 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 4ba401ec-5056-44df-8255-49786814ccf9] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:03.994508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c1efc57-69b7-465a-bd8f-752b50912428 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:03.995000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c1efc57-69b7-465a-bd8f-752b50912428 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:03.996389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c1efc57-69b7-465a-bd8f-752b50912428 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:03.996389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c1efc57-69b7-465a-bd8f-752b50912428 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:03.996599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c1efc57-69b7-465a-bd8f-752b50912428 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:03.996981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c1efc57-69b7-465a-bd8f-752b50912428 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:04.068657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4c1efc57-69b7-465a-bd8f-752b50912428 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:04.077528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4c1efc57-69b7-465a-bd8f-752b50912428 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:04.089216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4c1efc57-69b7-465a-bd8f-752b50912428 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:04.089216 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4c1efc57-69b7-465a-bd8f-752b50912428 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba401ec-5056-44df-8255-49786814ccf9" status: 200 len: 1363 microversion: 2.47 time: 0.097483 Oct 04 21:31:04.089216 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2514/5060] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:31:03 2022] GET /compute/v2.1/servers/4ba401ec-5056-44df-8255-49786814ccf9 => generated 1363 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:31:04.114258 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5ccd46da-ef81-44ae-af8a-35fc429d36be tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.893292 Oct 04 21:31:04.116235 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2547/5061] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:31:03 2022] POST /compute/v2.1/servers => generated 32 bytes in 896 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 21:31:04.125898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0998febb-6040-4aa0-8b47-ef92b15cf1b9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:04.131405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0998febb-6040-4aa0-8b47-ef92b15cf1b9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:04.132440 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0998febb-6040-4aa0-8b47-ef92b15cf1b9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Searching by: {'deleted': False, 'project_id': '12da8c6a64ae484bb779149dca92d2e7'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:31:04.160224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0998febb-6040-4aa0-8b47-ef92b15cf1b9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:04.161277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0998febb-6040-4aa0-8b47-ef92b15cf1b9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:04.161277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0998febb-6040-4aa0-8b47-ef92b15cf1b9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:04.162215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0998febb-6040-4aa0-8b47-ef92b15cf1b9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:04.162674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0998febb-6040-4aa0-8b47-ef92b15cf1b9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:04.163107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0998febb-6040-4aa0-8b47-ef92b15cf1b9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:04.196338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.multi_cell_list [None req-0998febb-6040-4aa0-8b47-ef92b15cf1b9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:31:04.204491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0660cb4e-59fe-4dc5-be7f-623b56975bc6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:04.205302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0660cb4e-59fe-4dc5-be7f-623b56975bc6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:04.220976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0660cb4e-59fe-4dc5-be7f-623b56975bc6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:04.221654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0660cb4e-59fe-4dc5-be7f-623b56975bc6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:04.222354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0660cb4e-59fe-4dc5-be7f-623b56975bc6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:04.223321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0660cb4e-59fe-4dc5-be7f-623b56975bc6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:04.223890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0660cb4e-59fe-4dc5-be7f-623b56975bc6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:04.224564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0660cb4e-59fe-4dc5-be7f-623b56975bc6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:04.270236 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0998febb-6040-4aa0-8b47-ef92b15cf1b9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.149817 Oct 04 21:31:04.271015 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2515/5062] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Oct 4 21:31:04 2022] GET /compute/v2.1/servers => generated 1335 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:04.286207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9786f93-2f70-4ab0-bf40-c2c00612d79b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:04.287308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d9786f93-2f70-4ab0-bf40-c2c00612d79b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:04.397210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d9786f93-2f70-4ab0-bf40-c2c00612d79b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:04.407300 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d9786f93-2f70-4ab0-bf40-c2c00612d79b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03" status: 200 len: 1217 microversion: 2.1 time: 0.126609 Oct 04 21:31:04.422903 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2516/5063] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:04 2022] GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 => generated 1217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:04.436198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-276c86f5-37de-4407-ba6b-14930de4ee18 req-dfd7decc-b568-4e33-8a08-87092c4a5a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21bf0e6-f7df-4150-aa24-150a14fe3c4e", "name": "network-vif-plugged", "status": "completed", "tag": "45b08d6d-7a13-49d7-a0fd-7132d7256f7f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:04.451975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-276c86f5-37de-4407-ba6b-14930de4ee18 req-dfd7decc-b568-4e33-8a08-87092c4a5a33 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:04.452404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-276c86f5-37de-4407-ba6b-14930de4ee18 req-dfd7decc-b568-4e33-8a08-87092c4a5a33 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:04.452725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-276c86f5-37de-4407-ba6b-14930de4ee18 req-dfd7decc-b568-4e33-8a08-87092c4a5a33 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:04.467526 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-276c86f5-37de-4407-ba6b-14930de4ee18 req-dfd7decc-b568-4e33-8a08-87092c4a5a33 service nova] Creating event network-vif-plugged:45b08d6d-7a13-49d7-a0fd-7132d7256f7f for instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e on n-h2-860282-1 Oct 04 21:31:04.473545 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-276c86f5-37de-4407-ba6b-14930de4ee18 req-dfd7decc-b568-4e33-8a08-87092c4a5a33 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049125 Oct 04 21:31:04.474647 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2517/5064] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:04.519859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0660cb4e-59fe-4dc5-be7f-623b56975bc6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:04.529060 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0660cb4e-59fe-4dc5-be7f-623b56975bc6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1329 microversion: 2.1 time: 0.328647 Oct 04 21:31:04.529699 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2548/5065] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:04 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1329 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:04.646279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b6471ac2-c374-44fb-bb94-2980ade51516 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:04.646279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b6471ac2-c374-44fb-bb94-2980ade51516 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:04.651431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b6471ac2-c374-44fb-bb94-2980ade51516 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:04.652147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b6471ac2-c374-44fb-bb94-2980ade51516 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:04.652818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b6471ac2-c374-44fb-bb94-2980ade51516 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:04.654050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b6471ac2-c374-44fb-bb94-2980ade51516 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:04.654771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b6471ac2-c374-44fb-bb94-2980ade51516 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:04.655404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b6471ac2-c374-44fb-bb94-2980ade51516 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:04.948754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-03b2490a-5df9-497d-84a1-f06cc8710ffa tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:04.951701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-03b2490a-5df9-497d-84a1-f06cc8710ffa tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:04.958130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03b2490a-5df9-497d-84a1-f06cc8710ffa tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:04.958630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03b2490a-5df9-497d-84a1-f06cc8710ffa tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:04.959077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03b2490a-5df9-497d-84a1-f06cc8710ffa tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:04.959788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03b2490a-5df9-497d-84a1-f06cc8710ffa tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:04.960286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03b2490a-5df9-497d-84a1-f06cc8710ffa tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:04.961252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03b2490a-5df9-497d-84a1-f06cc8710ffa tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:05.044449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b6471ac2-c374-44fb-bb94-2980ade51516 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:05.058884 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b6471ac2-c374-44fb-bb94-2980ade51516 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1519 microversion: 2.1 time: 0.418788 Oct 04 21:31:05.073701 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2518/5066] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:04 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1519 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:05.110423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1b6233af-40f0-42f8-b691-816bcf00ae21 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:05.111307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1b6233af-40f0-42f8-b691-816bcf00ae21 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 4ba401ec-5056-44df-8255-49786814ccf9] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:05.123383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b6233af-40f0-42f8-b691-816bcf00ae21 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:05.125492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b6233af-40f0-42f8-b691-816bcf00ae21 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:05.129133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b6233af-40f0-42f8-b691-816bcf00ae21 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:05.130481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b6233af-40f0-42f8-b691-816bcf00ae21 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:05.131173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b6233af-40f0-42f8-b691-816bcf00ae21 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:05.131835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b6233af-40f0-42f8-b691-816bcf00ae21 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:05.185849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b6233af-40f0-42f8-b691-816bcf00ae21 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:05.186484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b6233af-40f0-42f8-b691-816bcf00ae21 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:05.187021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b6233af-40f0-42f8-b691-816bcf00ae21 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:05.187597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-1b6233af-40f0-42f8-b691-816bcf00ae21 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lazy-loading 'fault' on Instance uuid 4ba401ec-5056-44df-8255-49786814ccf9 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:31:05.232677 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-03b2490a-5df9-497d-84a1-f06cc8710ffa tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "POST /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5/action" status: 200 len: 24556 microversion: 2.1 time: 0.287742 Oct 04 21:31:05.233684 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2549/5067] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:31:04 2022] POST /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5/action => generated 24556 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:31:05.297222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1b6233af-40f0-42f8-b691-816bcf00ae21 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:05.308121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1b6233af-40f0-42f8-b691-816bcf00ae21 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:05.310823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1b6233af-40f0-42f8-b691-816bcf00ae21 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6931e7717dc44b0b25454266c315ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5308e8f8d3714caebcf21c76211de44d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:05.316159 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1b6233af-40f0-42f8-b691-816bcf00ae21 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba401ec-5056-44df-8255-49786814ccf9" status: 200 len: 1368 microversion: 2.47 time: 0.213327 Oct 04 21:31:05.321604 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2519/5068] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:31:05 2022] GET /compute/v2.1/servers/4ba401ec-5056-44df-8255-49786814ccf9 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:31:05.440856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fbf1991c-27eb-4636-a3ca-921d9a6f87c0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:05.441257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fbf1991c-27eb-4636-a3ca-921d9a6f87c0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:05.559148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-22a859db-37b7-401c-812e-14f49a9103ac tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:05.560824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-22a859db-37b7-401c-812e-14f49a9103ac tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:05.573050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22a859db-37b7-401c-812e-14f49a9103ac tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:05.578244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22a859db-37b7-401c-812e-14f49a9103ac tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:05.578828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22a859db-37b7-401c-812e-14f49a9103ac tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:05.586461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22a859db-37b7-401c-812e-14f49a9103ac tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:05.587108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22a859db-37b7-401c-812e-14f49a9103ac tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:05.587665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22a859db-37b7-401c-812e-14f49a9103ac tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:05.660049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fbf1991c-27eb-4636-a3ca-921d9a6f87c0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:05.665773 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fbf1991c-27eb-4636-a3ca-921d9a6f87c0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03" status: 200 len: 1217 microversion: 2.1 time: 0.231888 Oct 04 21:31:05.666568 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2550/5069] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:05 2022] GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 => generated 1217 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:05.688848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-deb317ba-992e-4e94-8dce-ca1217ac9490 req-c291144c-7462-4b77-87be-ba4bcf2390d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9a73ee-951f-415e-9088-ad819e929ae9", "name": "network-vif-deleted", "tag": "c0ae92ef-0f60-4dbd-8e5b-19f51b47ad19"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:05.720845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-deb317ba-992e-4e94-8dce-ca1217ac9490 req-c291144c-7462-4b77-87be-ba4bcf2390d1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:05.721658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-deb317ba-992e-4e94-8dce-ca1217ac9490 req-c291144c-7462-4b77-87be-ba4bcf2390d1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:05.722497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-deb317ba-992e-4e94-8dce-ca1217ac9490 req-c291144c-7462-4b77-87be-ba4bcf2390d1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:05.742236 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-deb317ba-992e-4e94-8dce-ca1217ac9490 req-c291144c-7462-4b77-87be-ba4bcf2390d1 service nova] Creating event network-vif-deleted:c0ae92ef-0f60-4dbd-8e5b-19f51b47ad19 for instance 3b9a73ee-951f-415e-9088-ad819e929ae9 on n-h2-860282-1 Oct 04 21:31:05.753691 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-deb317ba-992e-4e94-8dce-ca1217ac9490 req-c291144c-7462-4b77-87be-ba4bcf2390d1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070847 Oct 04 21:31:05.754520 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2551/5070] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:05.862800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-22a859db-37b7-401c-812e-14f49a9103ac tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:05.877389 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-22a859db-37b7-401c-812e-14f49a9103ac tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1329 microversion: 2.1 time: 0.322101 Oct 04 21:31:05.879511 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2520/5071] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:05 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1329 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:06.093316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-af44f83d-9ad5-4c9a-a046-46fa21023e90 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:06.094324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-af44f83d-9ad5-4c9a-a046-46fa21023e90 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:06.101943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af44f83d-9ad5-4c9a-a046-46fa21023e90 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:06.102877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af44f83d-9ad5-4c9a-a046-46fa21023e90 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:06.103512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af44f83d-9ad5-4c9a-a046-46fa21023e90 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:06.104552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af44f83d-9ad5-4c9a-a046-46fa21023e90 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:06.105210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af44f83d-9ad5-4c9a-a046-46fa21023e90 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:06.105857 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af44f83d-9ad5-4c9a-a046-46fa21023e90 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:06.298662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-af44f83d-9ad5-4c9a-a046-46fa21023e90 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:06.317148 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-af44f83d-9ad5-4c9a-a046-46fa21023e90 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1519 microversion: 2.1 time: 0.230292 Oct 04 21:31:06.329445 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2552/5072] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:06 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1519 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:06.348119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-acfe115d-e553-4fec-a996-55c2350610e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:06.348726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-acfe115d-e553-4fec-a996-55c2350610e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] [instance: 4ba401ec-5056-44df-8255-49786814ccf9] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:06.359333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acfe115d-e553-4fec-a996-55c2350610e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:06.360396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acfe115d-e553-4fec-a996-55c2350610e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:06.361225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acfe115d-e553-4fec-a996-55c2350610e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:06.362573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acfe115d-e553-4fec-a996-55c2350610e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:06.363594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acfe115d-e553-4fec-a996-55c2350610e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:06.364137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-acfe115d-e553-4fec-a996-55c2350610e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:06.382691 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-acfe115d-e553-4fec-a996-55c2350610e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] HTTP exception thrown: Instance 4ba401ec-5056-44df-8255-49786814ccf9 could not be found. Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-acfe115d-e553-4fec-a996-55c2350610e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Request method failure captured: Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/4ba401ec-5056-44df-8255-49786814ccf9 HTTP/1.1 Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKXjlaYKzWN73BLwVUkbLJsPBrRhZFow-AUC6Dx2nF2dFicXneeaZPs6LC5NKg7VqLun1mldBPb1w93gkzXYeZjTv7oB04LBSQa4-ac73U68FADX-rtkghxYaeaMFzDID741VkElL3wlzbfANlfk0ZQ2FS4k9PT_ql33F5KOqdEA88I Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 5308e8f8d3714caebcf21c76211de44d Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerShowV247Test-862805411 Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5308e8f8d3714caebcf21c76211de44d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5308e8f8d3714caebcf21c76211de44d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5308e8f8d3714caebcf21c76211de44d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5308e8f8d3714caebcf21c76211de44d"}]}] Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerShowV247Test-862805411 Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 5308e8f8d3714caebcf21c76211de44d Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerShowV247Test-862805411 Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerShowV247Test-862805411-project Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: f6931e7717dc44b0b25454266c315ac9 Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerShowV247Test-862805411-project Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 4ba401ec-5056-44df-8255-49786814ccf9 could not be found. Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '4ba401ec-5056-44df-8255-49786814ccf9'} Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ba401ec-5056-44df-8255-49786814ccf9 could not be found. Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ba401ec-5056-44df-8255-49786814ccf9 could not be found. Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:06.399360 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:06.406774 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:06.406774 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:06.406774 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:06.406774 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:06.406774 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:06.406774 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ba401ec-5056-44df-8255-49786814ccf9 could not be found. Oct 04 21:31:06.406774 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:06.406774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-acfe115d-e553-4fec-a996-55c2350610e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] Returning 404 to user: Instance 4ba401ec-5056-44df-8255-49786814ccf9 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:06.406774 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-acfe115d-e553-4fec-a996-55c2350610e8 tempest-ServerShowV247Test-862805411 tempest-ServerShowV247Test-862805411-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba401ec-5056-44df-8255-49786814ccf9" status: 404 len: 111 microversion: 2.47 time: 0.042027 Oct 04 21:31:06.406774 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2521/5073] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:31:06 2022] GET /compute/v2.1/servers/4ba401ec-5056-44df-8255-49786814ccf9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:31:06.694036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f6b89f8f-b7f5-4626-a53d-68142bb4dd96 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:06.694667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f6b89f8f-b7f5-4626-a53d-68142bb4dd96 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:06.702331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6b89f8f-b7f5-4626-a53d-68142bb4dd96 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:06.702829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6b89f8f-b7f5-4626-a53d-68142bb4dd96 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:06.704433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6b89f8f-b7f5-4626-a53d-68142bb4dd96 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:06.705151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6b89f8f-b7f5-4626-a53d-68142bb4dd96 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:06.705654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6b89f8f-b7f5-4626-a53d-68142bb4dd96 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:06.706091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6b89f8f-b7f5-4626-a53d-68142bb4dd96 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:06.834581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f6b89f8f-b7f5-4626-a53d-68142bb4dd96 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:06.852218 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f6b89f8f-b7f5-4626-a53d-68142bb4dd96 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03" status: 200 len: 1221 microversion: 2.1 time: 0.162012 Oct 04 21:31:06.880960 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2553/5074] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:06 2022] GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 => generated 1221 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:06.902073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-332bded1-8026-417e-9ad6-801c2e9b6f94 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:06.902799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-332bded1-8026-417e-9ad6-801c2e9b6f94 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:06.910054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-332bded1-8026-417e-9ad6-801c2e9b6f94 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:06.910914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-332bded1-8026-417e-9ad6-801c2e9b6f94 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:06.912138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-332bded1-8026-417e-9ad6-801c2e9b6f94 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:06.913303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-332bded1-8026-417e-9ad6-801c2e9b6f94 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:06.914016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-332bded1-8026-417e-9ad6-801c2e9b6f94 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:06.914517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-332bded1-8026-417e-9ad6-801c2e9b6f94 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:07.081188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-332bded1-8026-417e-9ad6-801c2e9b6f94 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:07.090903 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-332bded1-8026-417e-9ad6-801c2e9b6f94 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1509 microversion: 2.1 time: 0.192744 Oct 04 21:31:07.120855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b81cd225-4006-422f-8248-7dcc05860396 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:07.121709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b81cd225-4006-422f-8248-7dcc05860396 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:07.126113 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2522/5075] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:06 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1509 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:07.132557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b81cd225-4006-422f-8248-7dcc05860396 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:07.132557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b81cd225-4006-422f-8248-7dcc05860396 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:07.132557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b81cd225-4006-422f-8248-7dcc05860396 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:07.134271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b81cd225-4006-422f-8248-7dcc05860396 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:07.134879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b81cd225-4006-422f-8248-7dcc05860396 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:07.135466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b81cd225-4006-422f-8248-7dcc05860396 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:07.328186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b81cd225-4006-422f-8248-7dcc05860396 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:07.339297 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b81cd225-4006-422f-8248-7dcc05860396 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1509 microversion: 2.1 time: 0.225644 Oct 04 21:31:07.339906 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2554/5076] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:07 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1509 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:07.344727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-708b208b-f913-4284-95d2-915b21abf03f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:07.345446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-708b208b-f913-4284-95d2-915b21abf03f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:07.351721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-708b208b-f913-4284-95d2-915b21abf03f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:07.352540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-708b208b-f913-4284-95d2-915b21abf03f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:07.353036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-708b208b-f913-4284-95d2-915b21abf03f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:07.354020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-708b208b-f913-4284-95d2-915b21abf03f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:07.354744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-708b208b-f913-4284-95d2-915b21abf03f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:07.355481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-708b208b-f913-4284-95d2-915b21abf03f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:07.373086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-74118619-e8cb-4049-bd79-cebbbc2c0beb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:07.375611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-74118619-e8cb-4049-bd79-cebbbc2c0beb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:07.382677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74118619-e8cb-4049-bd79-cebbbc2c0beb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:07.383659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74118619-e8cb-4049-bd79-cebbbc2c0beb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:07.384003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74118619-e8cb-4049-bd79-cebbbc2c0beb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:07.384713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74118619-e8cb-4049-bd79-cebbbc2c0beb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:07.385172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74118619-e8cb-4049-bd79-cebbbc2c0beb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:07.385681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74118619-e8cb-4049-bd79-cebbbc2c0beb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:07.417490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-74118619-e8cb-4049-bd79-cebbbc2c0beb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:31:07.578462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-708b208b-f913-4284-95d2-915b21abf03f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:07.588388 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-708b208b-f913-4284-95d2-915b21abf03f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1519 microversion: 2.1 time: 0.248791 Oct 04 21:31:07.589456 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2523/5077] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:07 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1519 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:07.786803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-e4de3980-d0c2-40cf-969a-d7ba9135af2b req-bdd8727a-3753-42fa-afba-56a2dbf16385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96184fe-5a1c-418f-b473-41ac84763259", "name": "network-vif-deleted", "tag": "6bef1f74-036f-46b5-9078-ff5b70fe10c1"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:07.797060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e4de3980-d0c2-40cf-969a-d7ba9135af2b req-bdd8727a-3753-42fa-afba-56a2dbf16385 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:07.797561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e4de3980-d0c2-40cf-969a-d7ba9135af2b req-bdd8727a-3753-42fa-afba-56a2dbf16385 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:07.797990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e4de3980-d0c2-40cf-969a-d7ba9135af2b req-bdd8727a-3753-42fa-afba-56a2dbf16385 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:07.810060 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-e4de3980-d0c2-40cf-969a-d7ba9135af2b req-bdd8727a-3753-42fa-afba-56a2dbf16385 service nova] Creating event network-vif-deleted:6bef1f74-036f-46b5-9078-ff5b70fe10c1 for instance b96184fe-5a1c-418f-b473-41ac84763259 on n-h1-860282-1 Oct 04 21:31:07.814915 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-e4de3980-d0c2-40cf-969a-d7ba9135af2b req-bdd8727a-3753-42fa-afba-56a2dbf16385 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032129 Oct 04 21:31:07.815494 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2524/5078] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:31:07.882457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0d30cfb4-0cdb-4fb2-99dd-517417c0a964 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:07.883770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0d30cfb4-0cdb-4fb2-99dd-517417c0a964 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:07.891007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d30cfb4-0cdb-4fb2-99dd-517417c0a964 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:07.891502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d30cfb4-0cdb-4fb2-99dd-517417c0a964 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:07.892020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d30cfb4-0cdb-4fb2-99dd-517417c0a964 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:07.892762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d30cfb4-0cdb-4fb2-99dd-517417c0a964 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:07.893216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d30cfb4-0cdb-4fb2-99dd-517417c0a964 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:07.893863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d30cfb4-0cdb-4fb2-99dd-517417c0a964 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:07.921972 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-74118619-e8cb-4049-bd79-cebbbc2c0beb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 204 len: 0 microversion: 2.1 time: 0.558632 Oct 04 21:31:07.921972 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2555/5079] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:31:07 2022] DELETE /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:31:07.932104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ae6b81a5-0eb4-4e23-b9aa-ca3674f62f33 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:07.933967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ae6b81a5-0eb4-4e23-b9aa-ca3674f62f33 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:07.944307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae6b81a5-0eb4-4e23-b9aa-ca3674f62f33 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:07.950718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae6b81a5-0eb4-4e23-b9aa-ca3674f62f33 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:07.950718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae6b81a5-0eb4-4e23-b9aa-ca3674f62f33 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:07.950718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae6b81a5-0eb4-4e23-b9aa-ca3674f62f33 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:07.950718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae6b81a5-0eb4-4e23-b9aa-ca3674f62f33 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:07.950718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae6b81a5-0eb4-4e23-b9aa-ca3674f62f33 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:08.004333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0d30cfb4-0cdb-4fb2-99dd-517417c0a964 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:08.015806 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0d30cfb4-0cdb-4fb2-99dd-517417c0a964 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03" status: 200 len: 1269 microversion: 2.1 time: 0.139402 Oct 04 21:31:08.016935 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2525/5080] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:07 2022] GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 => generated 1269 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:08.110578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ae6b81a5-0eb4-4e23-b9aa-ca3674f62f33 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:08.118965 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ae6b81a5-0eb4-4e23-b9aa-ca3674f62f33 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1515 microversion: 2.1 time: 0.192140 Oct 04 21:31:08.119552 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2556/5081] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:07 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1515 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:08.615663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4046e40a-81a6-4f4e-a972-ea468ece550f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:08.616214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4046e40a-81a6-4f4e-a972-ea468ece550f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:08.624334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4046e40a-81a6-4f4e-a972-ea468ece550f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:08.624848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4046e40a-81a6-4f4e-a972-ea468ece550f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:08.626728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4046e40a-81a6-4f4e-a972-ea468ece550f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:08.626728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4046e40a-81a6-4f4e-a972-ea468ece550f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:08.626728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4046e40a-81a6-4f4e-a972-ea468ece550f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:08.627109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4046e40a-81a6-4f4e-a972-ea468ece550f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:08.842917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4046e40a-81a6-4f4e-a972-ea468ece550f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:08.851168 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4046e40a-81a6-4f4e-a972-ea468ece550f tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.239779 Oct 04 21:31:08.852060 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2526/5082] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:08 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:08.879100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-70148aee-e92a-41ae-af80-35fc152e8854 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:08.879828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-70148aee-e92a-41ae-af80-35fc152e8854 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:08.887638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70148aee-e92a-41ae-af80-35fc152e8854 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:08.888609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70148aee-e92a-41ae-af80-35fc152e8854 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:08.889203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70148aee-e92a-41ae-af80-35fc152e8854 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:08.890198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70148aee-e92a-41ae-af80-35fc152e8854 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:08.890858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70148aee-e92a-41ae-af80-35fc152e8854 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:08.891753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70148aee-e92a-41ae-af80-35fc152e8854 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:08.909280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:09.039939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-902b1a5d-4caa-477c-b811-5a60fd121061 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:09.041388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-902b1a5d-4caa-477c-b811-5a60fd121061 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:09.049028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-902b1a5d-4caa-477c-b811-5a60fd121061 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:09.049566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-902b1a5d-4caa-477c-b811-5a60fd121061 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:09.050227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-902b1a5d-4caa-477c-b811-5a60fd121061 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:09.051216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-902b1a5d-4caa-477c-b811-5a60fd121061 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:09.052160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-902b1a5d-4caa-477c-b811-5a60fd121061 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:09.052450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-902b1a5d-4caa-477c-b811-5a60fd121061 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:09.140251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-902b1a5d-4caa-477c-b811-5a60fd121061 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:09.151532 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-902b1a5d-4caa-477c-b811-5a60fd121061 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03" status: 200 len: 1269 microversion: 2.1 time: 0.116187 Oct 04 21:31:09.165454 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2527/5083] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:09 2022] GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 => generated 1269 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:09.177091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-948e966e-ef20-41f0-83c3-213043814626 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:09.177937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-948e966e-ef20-41f0-83c3-213043814626 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:09.185924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-948e966e-ef20-41f0-83c3-213043814626 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:09.186512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-948e966e-ef20-41f0-83c3-213043814626 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:09.187053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-948e966e-ef20-41f0-83c3-213043814626 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:09.187992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-948e966e-ef20-41f0-83c3-213043814626 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:09.188859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-948e966e-ef20-41f0-83c3-213043814626 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:09.189339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-948e966e-ef20-41f0-83c3-213043814626 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:09.247576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-70148aee-e92a-41ae-af80-35fc152e8854 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:09.257845 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-70148aee-e92a-41ae-af80-35fc152e8854 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.383170 Oct 04 21:31:09.274418 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2557/5084] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:08 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:09.294671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-61d33fdb-1ea1-4bad-9c37-f7bb49a49b87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:09.295796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-61d33fdb-1ea1-4bad-9c37-f7bb49a49b87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:09.303004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61d33fdb-1ea1-4bad-9c37-f7bb49a49b87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:09.304254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61d33fdb-1ea1-4bad-9c37-f7bb49a49b87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:09.304885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61d33fdb-1ea1-4bad-9c37-f7bb49a49b87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:09.305914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61d33fdb-1ea1-4bad-9c37-f7bb49a49b87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:09.306560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61d33fdb-1ea1-4bad-9c37-f7bb49a49b87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:09.307176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61d33fdb-1ea1-4bad-9c37-f7bb49a49b87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:09.526584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-948e966e-ef20-41f0-83c3-213043814626 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:09.538395 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-948e966e-ef20-41f0-83c3-213043814626 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1515 microversion: 2.1 time: 0.378948 Oct 04 21:31:09.540362 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2528/5085] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:09 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1515 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:09.924035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-61d33fdb-1ea1-4bad-9c37-f7bb49a49b87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:09.940606 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-61d33fdb-1ea1-4bad-9c37-f7bb49a49b87 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.650002 Oct 04 21:31:09.942148 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2558/5086] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:09 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:09.971530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-494cc3ff-2345-40cd-a2f7-a5d4d1334df6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:09.981982 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-494cc3ff-2345-40cd-a2f7-a5d4d1334df6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance fa9d77c1-d0a0-4153-859f-4af5d61120b4 has no mapping to a cell. Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-494cc3ff-2345-40cd-a2f7-a5d4d1334df6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/fa9d77c1-d0a0-4153-859f-4af5d61120b4/action HTTP/1.1 Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 15 Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: {"os-stop": {}} Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance fa9d77c1-d0a0-4153-859f-4af5d61120b4 has no mapping to a cell. Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'fa9d77c1-d0a0-4153-859f-4af5d61120b4', 'body': {'os-stop': {}}} Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance fa9d77c1-d0a0-4153-859f-4af5d61120b4 has no mapping to a cell. Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:09.994621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa9d77c1-d0a0-4153-859f-4af5d61120b4 has no mapping to a cell. Oct 04 21:31:10.009224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:10.009224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:10.009224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:10.009224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:10.009224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:10.009224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:10.009224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:10.009224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:10.009224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa9d77c1-d0a0-4153-859f-4af5d61120b4 has no mapping to a cell. Oct 04 21:31:10.009224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:10.009224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-494cc3ff-2345-40cd-a2f7-a5d4d1334df6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance fa9d77c1-d0a0-4153-859f-4af5d61120b4 has no mapping to a cell. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:10.009224 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-494cc3ff-2345-40cd-a2f7-a5d4d1334df6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/fa9d77c1-d0a0-4153-859f-4af5d61120b4/action" status: 404 len: 117 microversion: 2.1 time: 0.032017 Oct 04 21:31:10.009224 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2529/5087] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:31:09 2022] POST /compute/v2.1/servers/fa9d77c1-d0a0-4153-859f-4af5d61120b4/action => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:31:10.010416 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4441284c-1083-4995-9da4-c7a8098b8bb8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:10.010416 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4441284c-1083-4995-9da4-c7a8098b8bb8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:10.014266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4441284c-1083-4995-9da4-c7a8098b8bb8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:10.014885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4441284c-1083-4995-9da4-c7a8098b8bb8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:10.015471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4441284c-1083-4995-9da4-c7a8098b8bb8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:10.016436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4441284c-1083-4995-9da4-c7a8098b8bb8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:10.016970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4441284c-1083-4995-9da4-c7a8098b8bb8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:10.017499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4441284c-1083-4995-9da4-c7a8098b8bb8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:10.176121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-791087bc-3869-4468-bd37-10315a8bade2 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:10.177538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-791087bc-3869-4468-bd37-10315a8bade2 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:10.186260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-791087bc-3869-4468-bd37-10315a8bade2 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:10.187320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-791087bc-3869-4468-bd37-10315a8bade2 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:10.188207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-791087bc-3869-4468-bd37-10315a8bade2 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:10.189124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-791087bc-3869-4468-bd37-10315a8bade2 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:10.189641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-791087bc-3869-4468-bd37-10315a8bade2 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:10.190091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-791087bc-3869-4468-bd37-10315a8bade2 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:10.324723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-791087bc-3869-4468-bd37-10315a8bade2 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:10.334389 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-791087bc-3869-4468-bd37-10315a8bade2 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03" status: 200 len: 1287 microversion: 2.1 time: 0.161965 Oct 04 21:31:10.334983 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2530/5088] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:10 2022] GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 => generated 1287 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:10.570154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f1231032-dc5f-4723-bc80-a11474980daf tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:10.570841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f1231032-dc5f-4723-bc80-a11474980daf tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:10.577725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1231032-dc5f-4723-bc80-a11474980daf tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:10.578358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1231032-dc5f-4723-bc80-a11474980daf tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:10.578807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1231032-dc5f-4723-bc80-a11474980daf tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:10.579504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1231032-dc5f-4723-bc80-a11474980daf tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:10.579962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1231032-dc5f-4723-bc80-a11474980daf tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:10.580391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1231032-dc5f-4723-bc80-a11474980daf tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:10.623666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4441284c-1083-4995-9da4-c7a8098b8bb8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:10.631340 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4441284c-1083-4995-9da4-c7a8098b8bb8 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.629169 Oct 04 21:31:10.632165 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2559/5089] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:10 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:10.662887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-47366bb2-6b19-4289-89d4-8bdfe5487eb6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:10.663526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-47366bb2-6b19-4289-89d4-8bdfe5487eb6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:10.674239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47366bb2-6b19-4289-89d4-8bdfe5487eb6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:10.675192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47366bb2-6b19-4289-89d4-8bdfe5487eb6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:10.678035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47366bb2-6b19-4289-89d4-8bdfe5487eb6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:10.678892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47366bb2-6b19-4289-89d4-8bdfe5487eb6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:10.679381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47366bb2-6b19-4289-89d4-8bdfe5487eb6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:10.679831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47366bb2-6b19-4289-89d4-8bdfe5487eb6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:10.999175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f1231032-dc5f-4723-bc80-a11474980daf tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:11.007317 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f1231032-dc5f-4723-bc80-a11474980daf tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1515 microversion: 2.1 time: 0.441545 Oct 04 21:31:11.008383 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2531/5090] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:10 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1515 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:11.065439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-47366bb2-6b19-4289-89d4-8bdfe5487eb6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:11.075201 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-47366bb2-6b19-4289-89d4-8bdfe5487eb6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.416457 Oct 04 21:31:11.076189 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2560/5091] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:10 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:11.099169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6dd526e9-97fd-4c22-8e28-ffdc50b0c040 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:11.100129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6dd526e9-97fd-4c22-8e28-ffdc50b0c040 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: c4787b59-16bd-414e-a1bf-f37dac5c3ce3] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:11.106793 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-6dd526e9-97fd-4c22-8e28-ffdc50b0c040 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance c4787b59-16bd-414e-a1bf-f37dac5c3ce3 could not be found. Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6dd526e9-97fd-4c22-8e28-ffdc50b0c040 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/c4787b59-16bd-414e-a1bf-f37dac5c3ce3/action HTTP/1.1 Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 15 Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: {"suspend": {}} Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance c4787b59-16bd-414e-a1bf-f37dac5c3ce3 could not be found. Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'c4787b59-16bd-414e-a1bf-f37dac5c3ce3', 'body': {'suspend': {}}} Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4787b59-16bd-414e-a1bf-f37dac5c3ce3 could not be found. Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4787b59-16bd-414e-a1bf-f37dac5c3ce3 could not be found. Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:11.108535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:11.113305 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:11.113305 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:11.113305 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4787b59-16bd-414e-a1bf-f37dac5c3ce3 could not be found. Oct 04 21:31:11.113305 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:11.113305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6dd526e9-97fd-4c22-8e28-ffdc50b0c040 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance c4787b59-16bd-414e-a1bf-f37dac5c3ce3 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:11.113305 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6dd526e9-97fd-4c22-8e28-ffdc50b0c040 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/c4787b59-16bd-414e-a1bf-f37dac5c3ce3/action" status: 404 len: 111 microversion: 2.1 time: 0.014911 Oct 04 21:31:11.113305 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2532/5092] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:31:11 2022] POST /compute/v2.1/servers/c4787b59-16bd-414e-a1bf-f37dac5c3ce3/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:31:11.124133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b39ce49c-fb6a-41a0-b9e4-01614095d343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:11.124774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b39ce49c-fb6a-41a0-b9e4-01614095d343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:11.133751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b39ce49c-fb6a-41a0-b9e4-01614095d343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:11.134536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b39ce49c-fb6a-41a0-b9e4-01614095d343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:11.136002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b39ce49c-fb6a-41a0-b9e4-01614095d343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:11.137133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b39ce49c-fb6a-41a0-b9e4-01614095d343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:11.137965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b39ce49c-fb6a-41a0-b9e4-01614095d343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:11.138637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b39ce49c-fb6a-41a0-b9e4-01614095d343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:11.358779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-06cd7684-d9f4-436c-a022-866c125d08a4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:11.360064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-06cd7684-d9f4-436c-a022-866c125d08a4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:11.377808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06cd7684-d9f4-436c-a022-866c125d08a4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:11.378322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06cd7684-d9f4-436c-a022-866c125d08a4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:11.378773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06cd7684-d9f4-436c-a022-866c125d08a4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:11.379497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06cd7684-d9f4-436c-a022-866c125d08a4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:11.380163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06cd7684-d9f4-436c-a022-866c125d08a4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:11.380781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06cd7684-d9f4-436c-a022-866c125d08a4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:11.592091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-06cd7684-d9f4-436c-a022-866c125d08a4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:11.618909 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-06cd7684-d9f4-436c-a022-866c125d08a4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03" status: 200 len: 1275 microversion: 2.1 time: 0.264015 Oct 04 21:31:11.620090 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2533/5093] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:11 2022] GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 => generated 1275 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:11.634710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-678b696b-fe86-481f-8f7c-36b8421b6922 req-bbb0f500-e2d1-4946-8985-4f25f681e843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21bf0e6-f7df-4150-aa24-150a14fe3c4e", "name": "network-vif-deleted", "tag": "45b08d6d-7a13-49d7-a0fd-7132d7256f7f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:11.647034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-678b696b-fe86-481f-8f7c-36b8421b6922 req-bbb0f500-e2d1-4946-8985-4f25f681e843 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:11.647859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-678b696b-fe86-481f-8f7c-36b8421b6922 req-bbb0f500-e2d1-4946-8985-4f25f681e843 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:11.648463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-678b696b-fe86-481f-8f7c-36b8421b6922 req-bbb0f500-e2d1-4946-8985-4f25f681e843 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:11.671848 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-678b696b-fe86-481f-8f7c-36b8421b6922 req-bbb0f500-e2d1-4946-8985-4f25f681e843 service nova] Creating event network-vif-deleted:45b08d6d-7a13-49d7-a0fd-7132d7256f7f for instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e on n-h2-860282-1 Oct 04 21:31:11.677745 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-678b696b-fe86-481f-8f7c-36b8421b6922 req-bbb0f500-e2d1-4946-8985-4f25f681e843 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055783 Oct 04 21:31:11.678981 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2534/5094] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:11.727373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b39ce49c-fb6a-41a0-b9e4-01614095d343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:11.738346 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b39ce49c-fb6a-41a0-b9e4-01614095d343 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.622498 Oct 04 21:31:11.739357 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2561/5095] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:11 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:11.764757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-761aab06-6f70-409e-9498-4aa8d9037ee5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:11.765560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-761aab06-6f70-409e-9498-4aa8d9037ee5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:11.773553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-761aab06-6f70-409e-9498-4aa8d9037ee5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:11.774420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-761aab06-6f70-409e-9498-4aa8d9037ee5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:11.775111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-761aab06-6f70-409e-9498-4aa8d9037ee5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:11.775887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-761aab06-6f70-409e-9498-4aa8d9037ee5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:11.776649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-761aab06-6f70-409e-9498-4aa8d9037ee5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:11.777174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-761aab06-6f70-409e-9498-4aa8d9037ee5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:11.796049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:12.035327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-60a51b3a-5bf1-4dbe-b912-b1a26e88ffcc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:12.044514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-60a51b3a-5bf1-4dbe-b912-b1a26e88ffcc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:12.062661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60a51b3a-5bf1-4dbe-b912-b1a26e88ffcc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:12.063315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60a51b3a-5bf1-4dbe-b912-b1a26e88ffcc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:12.064507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60a51b3a-5bf1-4dbe-b912-b1a26e88ffcc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:12.066395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60a51b3a-5bf1-4dbe-b912-b1a26e88ffcc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:12.066992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60a51b3a-5bf1-4dbe-b912-b1a26e88ffcc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:12.070197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60a51b3a-5bf1-4dbe-b912-b1a26e88ffcc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:12.074620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-761aab06-6f70-409e-9498-4aa8d9037ee5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:12.087830 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-761aab06-6f70-409e-9498-4aa8d9037ee5 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.327411 Oct 04 21:31:12.090397 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2535/5096] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:11 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:12.115315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60a51b3a-5bf1-4dbe-b912-b1a26e88ffcc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:12.116544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60a51b3a-5bf1-4dbe-b912-b1a26e88ffcc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:12.117216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60a51b3a-5bf1-4dbe-b912-b1a26e88ffcc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:12.118225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-39d7bc75-aece-49bd-ae88-0c2890f91a56 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:12.118225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-39d7bc75-aece-49bd-ae88-0c2890f91a56 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:12.123815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-60a51b3a-5bf1-4dbe-b912-b1a26e88ffcc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lazy-loading 'fault' on Instance uuid e21bf0e6-f7df-4150-aa24-150a14fe3c4e {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:31:12.128870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39d7bc75-aece-49bd-ae88-0c2890f91a56 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:12.129446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39d7bc75-aece-49bd-ae88-0c2890f91a56 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:12.129898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39d7bc75-aece-49bd-ae88-0c2890f91a56 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:12.130659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39d7bc75-aece-49bd-ae88-0c2890f91a56 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:12.131115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39d7bc75-aece-49bd-ae88-0c2890f91a56 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:12.134915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39d7bc75-aece-49bd-ae88-0c2890f91a56 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:12.187373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-39d7bc75-aece-49bd-ae88-0c2890f91a56 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lazy-loading 'flavor' on Instance uuid 144fff2d-9df3-4a93-833f-7f76acc85185 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:31:12.190876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-60a51b3a-5bf1-4dbe-b912-b1a26e88ffcc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:12.209653 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-60a51b3a-5bf1-4dbe-b912-b1a26e88ffcc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 200 len: 1319 microversion: 2.1 time: 0.179767 Oct 04 21:31:12.211219 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2562/5097] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:12 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:12.646073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0a3a5bd6-fd76-4a23-8a16-993c23bf5151 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:12.646828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0a3a5bd6-fd76-4a23-8a16-993c23bf5151 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:12.655106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a3a5bd6-fd76-4a23-8a16-993c23bf5151 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:12.656237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a3a5bd6-fd76-4a23-8a16-993c23bf5151 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:12.656858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a3a5bd6-fd76-4a23-8a16-993c23bf5151 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:12.657907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a3a5bd6-fd76-4a23-8a16-993c23bf5151 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:12.658967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a3a5bd6-fd76-4a23-8a16-993c23bf5151 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:12.659412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a3a5bd6-fd76-4a23-8a16-993c23bf5151 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:12.704540 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-39d7bc75-aece-49bd-ae88-0c2890f91a56 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action" status: 202 len: 0 microversion: 2.1 time: 0.591048 Oct 04 21:31:12.709882 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2536/5098] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:31:12 2022] POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:31:12.717179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1a108a23-a05a-4141-bd9e-c87d0284e227 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:12.718329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1a108a23-a05a-4141-bd9e-c87d0284e227 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:12.756347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1a108a23-a05a-4141-bd9e-c87d0284e227 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:12.756847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1a108a23-a05a-4141-bd9e-c87d0284e227 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:12.757287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1a108a23-a05a-4141-bd9e-c87d0284e227 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:12.758025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1a108a23-a05a-4141-bd9e-c87d0284e227 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:12.763709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1a108a23-a05a-4141-bd9e-c87d0284e227 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:12.764494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1a108a23-a05a-4141-bd9e-c87d0284e227 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:13.478944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0a3a5bd6-fd76-4a23-8a16-993c23bf5151 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:13.490056 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0a3a5bd6-fd76-4a23-8a16-993c23bf5151 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03" status: 200 len: 1317 microversion: 2.1 time: 0.849243 Oct 04 21:31:13.491478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1a108a23-a05a-4141-bd9e-c87d0284e227 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:13.495795 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2563/5099] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:12 2022] GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 => generated 1317 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:13.502406 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1a108a23-a05a-4141-bd9e-c87d0284e227 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1514 microversion: 2.1 time: 0.790591 Oct 04 21:31:13.504264 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2537/5100] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:12 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1514 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:13.510965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-afff0ef0-50c8-472a-8505-72de31868473 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:13.511905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-afff0ef0-50c8-472a-8505-72de31868473 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:13.526612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afff0ef0-50c8-472a-8505-72de31868473 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:13.527497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afff0ef0-50c8-472a-8505-72de31868473 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:13.529306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afff0ef0-50c8-472a-8505-72de31868473 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:13.530600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afff0ef0-50c8-472a-8505-72de31868473 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:13.531359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afff0ef0-50c8-472a-8505-72de31868473 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:13.532070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afff0ef0-50c8-472a-8505-72de31868473 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:13.573204 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-afff0ef0-50c8-472a-8505-72de31868473 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e could not be found. Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-afff0ef0-50c8-472a-8505-72de31868473 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e HTTP/1.1 Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e could not be found. Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'e21bf0e6-f7df-4150-aa24-150a14fe3c4e'} Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e could not be found. Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e could not be found. Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:13.575749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:13.581323 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:13.581323 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:13.581323 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:13.581323 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:13.581323 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:13.581323 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e could not be found. Oct 04 21:31:13.581323 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:13.581323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-afff0ef0-50c8-472a-8505-72de31868473 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:13.581323 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-afff0ef0-50c8-472a-8505-72de31868473 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 404 len: 111 microversion: 2.1 time: 0.084448 Oct 04 21:31:13.581323 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2564/5101] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:13 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:31:13.592726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-890a8783-363d-4cc2-826d-2c18141df7ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '.version_select at 0x7f578bbe1040>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:13.692913 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-890a8783-363d-4cc2-826d-2c18141df7ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-key-1138255015" status: 202 len: 0 microversion: 2.1 time: 0.104903 Oct 04 21:31:13.694452 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2538/5102] 10.222.0.30 () {58 vars in 1209 bytes} [Tue Oct 4 21:31:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1138255015 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:31:13.709262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-4c2c3da9-a467-453f-9979-689825ee4a09 req-eacab3e4-e237-40e6-8e22-b335a3b9379c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0246d29-9597-4269-a64b-6daf8bf0cd8f", "tag": "06396457-8e5a-4a64-9577-be563f077dc8"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:13.727031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4c2c3da9-a467-453f-9979-689825ee4a09 req-eacab3e4-e237-40e6-8e22-b335a3b9379c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:13.730192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4c2c3da9-a467-453f-9979-689825ee4a09 req-eacab3e4-e237-40e6-8e22-b335a3b9379c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:13.730686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4c2c3da9-a467-453f-9979-689825ee4a09 req-eacab3e4-e237-40e6-8e22-b335a3b9379c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:13.759988 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-4c2c3da9-a467-453f-9979-689825ee4a09 req-eacab3e4-e237-40e6-8e22-b335a3b9379c service nova] Creating event network-changed:06396457-8e5a-4a64-9577-be563f077dc8 for instance e0246d29-9597-4269-a64b-6daf8bf0cd8f on n-h1-860282-1 Oct 04 21:31:13.770835 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-4c2c3da9-a467-453f-9979-689825ee4a09 req-eacab3e4-e237-40e6-8e22-b335a3b9379c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065295 Oct 04 21:31:13.773779 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2565/5103] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:13.838210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7b91febe-a072-4bc7-b375-7d490e905431 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-832375398", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "f9328395-b63c-4f5a-9d32-23fa7cfe6c6d"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:13.942086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-7b91febe-a072-4bc7-b375-7d490e905431 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] validate_networks() for [('f9328395-b63c-4f5a-9d32-23fa7cfe6c6d', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:31:14.171277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:14.408410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:14.528387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:14.546594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c280e930-d937-4b70-b157-d47b14ced82c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:14.556047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c280e930-d937-4b70-b157-d47b14ced82c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:14.572486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c280e930-d937-4b70-b157-d47b14ced82c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:14.573350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c280e930-d937-4b70-b157-d47b14ced82c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:14.574134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c280e930-d937-4b70-b157-d47b14ced82c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:14.575547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c280e930-d937-4b70-b157-d47b14ced82c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:14.576201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c280e930-d937-4b70-b157-d47b14ced82c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:14.577113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c280e930-d937-4b70-b157-d47b14ced82c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:14.911609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c280e930-d937-4b70-b157-d47b14ced82c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:14.923224 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c280e930-d937-4b70-b157-d47b14ced82c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03" status: 200 len: 1317 microversion: 2.1 time: 0.396821 Oct 04 21:31:14.932514 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2566/5104] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:14 2022] GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:14.940258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f5bb0f4c-ec7d-4bb4-84aa-51e773d7d499 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:14.940860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f5bb0f4c-ec7d-4bb4-84aa-51e773d7d499 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:14.961288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5bb0f4c-ec7d-4bb4-84aa-51e773d7d499 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:14.961288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5bb0f4c-ec7d-4bb4-84aa-51e773d7d499 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:14.961288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5bb0f4c-ec7d-4bb4-84aa-51e773d7d499 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:14.961288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5bb0f4c-ec7d-4bb4-84aa-51e773d7d499 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:14.961288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5bb0f4c-ec7d-4bb4-84aa-51e773d7d499 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:14.961288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5bb0f4c-ec7d-4bb4-84aa-51e773d7d499 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:15.027533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7b91febe-a072-4bc7-b375-7d490e905431 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:31:15.029461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7b91febe-a072-4bc7-b375-7d490e905431 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:31:15.030121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7b91febe-a072-4bc7-b375-7d490e905431 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:31:15.030703 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7b91febe-a072-4bc7-b375-7d490e905431 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:31:15.031343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7b91febe-a072-4bc7-b375-7d490e905431 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:31:15.050032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b91febe-a072-4bc7-b375-7d490e905431 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:15.050032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b91febe-a072-4bc7-b375-7d490e905431 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:15.050032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b91febe-a072-4bc7-b375-7d490e905431 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:15.050032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b91febe-a072-4bc7-b375-7d490e905431 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:15.050032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b91febe-a072-4bc7-b375-7d490e905431 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:15.053788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b91febe-a072-4bc7-b375-7d490e905431 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:15.087349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7b91febe-a072-4bc7-b375-7d490e905431 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Getting quotas for project fde68efb46fc44b5b0d83138b9048f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:31:15.091425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:15.095576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7b91febe-a072-4bc7-b375-7d490e905431 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Getting quotas for user b9289c5fa9844ae3bb1c797bdab5c56c and project fde68efb46fc44b5b0d83138b9048f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:31:15.112990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7b91febe-a072-4bc7-b375-7d490e905431 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:31:15.117022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7b91febe-a072-4bc7-b375-7d490e905431 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:31:15.326229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f5bb0f4c-ec7d-4bb4-84aa-51e773d7d499 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:15.334414 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f5bb0f4c-ec7d-4bb4-84aa-51e773d7d499 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1497 microversion: 2.1 time: 0.403986 Oct 04 21:31:15.335346 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2567/5105] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:14 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1497 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:15.352956 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7b91febe-a072-4bc7-b375-7d490e905431 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.518864 Oct 04 21:31:15.355776 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2539/5106] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:31:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:31:15.368855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-96aa788f-84e0-4b3c-864e-9acbae153f3e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:15.369865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-96aa788f-84e0-4b3c-864e-9acbae153f3e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:15.383279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dd3b3fba-6a62-47a9-ad91-3ef966a083f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:15.383279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dd3b3fba-6a62-47a9-ad91-3ef966a083f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:15.413975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd3b3fba-6a62-47a9-ad91-3ef966a083f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:15.414554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd3b3fba-6a62-47a9-ad91-3ef966a083f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:15.417371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd3b3fba-6a62-47a9-ad91-3ef966a083f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:15.417371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd3b3fba-6a62-47a9-ad91-3ef966a083f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:15.417371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd3b3fba-6a62-47a9-ad91-3ef966a083f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:15.417808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd3b3fba-6a62-47a9-ad91-3ef966a083f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:15.449211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-dd3b3fba-6a62-47a9-ad91-3ef966a083f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lazy-loading 'flavor' on Instance uuid 144fff2d-9df3-4a93-833f-7f76acc85185 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:31:15.466062 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-dd3b3fba-6a62-47a9-ad91-3ef966a083f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Cannot 'suspend' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state suspended Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dd3b3fba-6a62-47a9-ad91-3ef966a083f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action HTTP/1.1 Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 15 Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: {"suspend": {}} Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: exception: Cannot 'suspend' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state suspended Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '144fff2d-9df3-4a93-833f-7f76acc85185', 'body': {'suspend': {}}} Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 144fff2d-9df3-4a93-833f-7f76acc85185 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 04 21:31:15.469354 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:31:15.477314 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:31:15.477314 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:31:15.477314 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state suspended Oct 04 21:31:15.477314 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:15.477314 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:15.477314 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:15.477314 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:15.477314 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:15.477314 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:15.477314 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:15.477314 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:15.477314 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state suspended Oct 04 21:31:15.477314 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:15.482519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dd3b3fba-6a62-47a9-ad91-3ef966a083f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 409 to user: Cannot 'suspend' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state suspended {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:15.482519 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dd3b3fba-6a62-47a9-ad91-3ef966a083f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action" status: 409 len: 148 microversion: 2.1 time: 0.105973 Oct 04 21:31:15.482519 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2540/5107] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:31:15 2022] POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action => generated 148 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:31:15.490203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0af9fa5a-e8f3-4162-a50d-c8664c4dd5a9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:15.490759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0af9fa5a-e8f3-4162-a50d-c8664c4dd5a9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:15.497827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0af9fa5a-e8f3-4162-a50d-c8664c4dd5a9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:15.498473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0af9fa5a-e8f3-4162-a50d-c8664c4dd5a9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:15.499167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0af9fa5a-e8f3-4162-a50d-c8664c4dd5a9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:15.500159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0af9fa5a-e8f3-4162-a50d-c8664c4dd5a9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:15.500937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0af9fa5a-e8f3-4162-a50d-c8664c4dd5a9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:15.502195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0af9fa5a-e8f3-4162-a50d-c8664c4dd5a9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:15.537708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-96aa788f-84e0-4b3c-864e-9acbae153f3e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:15.547910 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-96aa788f-84e0-4b3c-864e-9acbae153f3e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 200 len: 1208 microversion: 2.1 time: 0.182877 Oct 04 21:31:15.550178 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2568/5108] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:15 2022] GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 1208 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:15.812459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-18dba347-73ce-4419-9180-e2aa3c34d690 req-4f51f733-de5f-4b1b-b571-53e6a508e283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03", "tag": "5985f943-f63c-4483-8bee-3953653e940f"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:15.825461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-18dba347-73ce-4419-9180-e2aa3c34d690 req-4f51f733-de5f-4b1b-b571-53e6a508e283 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:15.825958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-18dba347-73ce-4419-9180-e2aa3c34d690 req-4f51f733-de5f-4b1b-b571-53e6a508e283 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:15.826399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-18dba347-73ce-4419-9180-e2aa3c34d690 req-4f51f733-de5f-4b1b-b571-53e6a508e283 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:15.839336 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-18dba347-73ce-4419-9180-e2aa3c34d690 req-4f51f733-de5f-4b1b-b571-53e6a508e283 service nova] Creating event network-changed:5985f943-f63c-4483-8bee-3953653e940f for instance 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 on n-h2-860282-1 Oct 04 21:31:15.846023 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-18dba347-73ce-4419-9180-e2aa3c34d690 req-4f51f733-de5f-4b1b-b571-53e6a508e283 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037600 Oct 04 21:31:15.847018 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2569/5109] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:31:15.870291 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0af9fa5a-e8f3-4162-a50d-c8664c4dd5a9 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action" status: 202 len: 0 microversion: 2.1 time: 0.384054 Oct 04 21:31:15.875160 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2541/5110] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:31:15 2022] POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:31:15.898725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8cf6538f-fcd0-427f-87dc-b78b8dea4b70 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:15.899596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8cf6538f-fcd0-427f-87dc-b78b8dea4b70 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:15.921242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8cf6538f-fcd0-427f-87dc-b78b8dea4b70 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:15.921899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8cf6538f-fcd0-427f-87dc-b78b8dea4b70 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:15.925889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8cf6538f-fcd0-427f-87dc-b78b8dea4b70 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:15.927422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8cf6538f-fcd0-427f-87dc-b78b8dea4b70 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:15.928136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8cf6538f-fcd0-427f-87dc-b78b8dea4b70 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:15.929867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8cf6538f-fcd0-427f-87dc-b78b8dea4b70 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:15.963190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-52f1e180-2a47-4326-ad0a-35c0bfbdf5c9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:15.963902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-52f1e180-2a47-4326-ad0a-35c0bfbdf5c9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:15.986727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52f1e180-2a47-4326-ad0a-35c0bfbdf5c9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:15.987701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52f1e180-2a47-4326-ad0a-35c0bfbdf5c9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:15.990258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52f1e180-2a47-4326-ad0a-35c0bfbdf5c9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:15.991438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52f1e180-2a47-4326-ad0a-35c0bfbdf5c9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:15.993315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52f1e180-2a47-4326-ad0a-35c0bfbdf5c9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:15.993962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52f1e180-2a47-4326-ad0a-35c0bfbdf5c9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:16.582764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-52f1e180-2a47-4326-ad0a-35c0bfbdf5c9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:16.593076 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-52f1e180-2a47-4326-ad0a-35c0bfbdf5c9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03" status: 200 len: 1317 microversion: 2.1 time: 0.636184 Oct 04 21:31:16.594406 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2542/5111] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:15 2022] GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 => generated 1317 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:16.599617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-853d16ab-d843-4dfd-bb60-cbf9dde1e09b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:16.602401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-853d16ab-d843-4dfd-bb60-cbf9dde1e09b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:16.611959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-853d16ab-d843-4dfd-bb60-cbf9dde1e09b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:16.612809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-853d16ab-d843-4dfd-bb60-cbf9dde1e09b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:16.613699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-853d16ab-d843-4dfd-bb60-cbf9dde1e09b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:16.614684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-853d16ab-d843-4dfd-bb60-cbf9dde1e09b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:16.615590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-853d16ab-d843-4dfd-bb60-cbf9dde1e09b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:16.616340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-853d16ab-d843-4dfd-bb60-cbf9dde1e09b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:16.703933 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-853d16ab-d843-4dfd-bb60-cbf9dde1e09b tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "POST /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5/action" status: 200 len: 32623 microversion: 2.1 time: 0.103677 Oct 04 21:31:16.705999 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2543/5112] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:31:16 2022] POST /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5/action => generated 32623 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:31:16.714274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-049a4361-d301-4784-bf74-88f29a41e939 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:16.716445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-049a4361-d301-4784-bf74-88f29a41e939 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:16.732863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8cf6538f-fcd0-427f-87dc-b78b8dea4b70 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:16.747817 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8cf6538f-fcd0-427f-87dc-b78b8dea4b70 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1503 microversion: 2.1 time: 0.871794 Oct 04 21:31:16.756292 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2570/5113] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:15 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1503 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:16.836364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-049a4361-d301-4784-bf74-88f29a41e939 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:16.852039 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-049a4361-d301-4784-bf74-88f29a41e939 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 200 len: 1208 microversion: 2.1 time: 0.143079 Oct 04 21:31:16.853413 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2544/5114] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:16 2022] GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 1208 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:17.523897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-006e16e8-de26-4916-b669-cac2145cd3a2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Action: 'create', calling method: .version_select at 0x7f578b1c79d0>, body: {"keypair": {"name": "tempest-keypair-204641264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbU9M8+5WPD/asAoD6A1t+sVltkJXe1Why1zl9FikzZ1MEKxXQRiA6+rnNYNgE/fr7m5GLirqLVfCKrZWjdKhwvvTDaqv101ED17sDXIgeEOg0zS+MK51ll8UTlMh2HTw=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:17.544209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-006e16e8-de26-4916-b669-cac2145cd3a2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Getting quotas for project 66351b2e6b2840f183aaf8983e6fc128. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:31:17.550800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-006e16e8-de26-4916-b669-cac2145cd3a2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Getting quotas for user 0c9cb06716184ec88816395420d5870e and project 66351b2e6b2840f183aaf8983e6fc128. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:31:17.622110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-04a14f33-b1bd-45b5-ab0f-4990ad04c662 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:17.635546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-04a14f33-b1bd-45b5-ab0f-4990ad04c662 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:17.639834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04a14f33-b1bd-45b5-ab0f-4990ad04c662 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:17.641060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04a14f33-b1bd-45b5-ab0f-4990ad04c662 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:17.646854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04a14f33-b1bd-45b5-ab0f-4990ad04c662 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:17.648131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04a14f33-b1bd-45b5-ab0f-4990ad04c662 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:17.649357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04a14f33-b1bd-45b5-ab0f-4990ad04c662 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:17.649846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04a14f33-b1bd-45b5-ab0f-4990ad04c662 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:17.698740 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-006e16e8-de26-4916-b669-cac2145cd3a2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.342789 Oct 04 21:31:17.698740 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2571/5115] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:31:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:17.791800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-935b9402-5cb3-409c-8131-5a8a5fdc6579 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:17.792495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-935b9402-5cb3-409c-8131-5a8a5fdc6579 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:17.800955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-935b9402-5cb3-409c-8131-5a8a5fdc6579 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:17.801777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-935b9402-5cb3-409c-8131-5a8a5fdc6579 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:17.802425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-935b9402-5cb3-409c-8131-5a8a5fdc6579 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:17.803394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-935b9402-5cb3-409c-8131-5a8a5fdc6579 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:17.803799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-935b9402-5cb3-409c-8131-5a8a5fdc6579 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:17.804370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-935b9402-5cb3-409c-8131-5a8a5fdc6579 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:18.055490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-04a14f33-b1bd-45b5-ab0f-4990ad04c662 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:18.065281 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-04a14f33-b1bd-45b5-ab0f-4990ad04c662 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03" status: 200 len: 1317 microversion: 2.1 time: 0.448503 Oct 04 21:31:18.066046 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2545/5116] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:17 2022] GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:18.103655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-98463c02-631d-4d33-9675-186833927405 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:18.104777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-98463c02-631d-4d33-9675-186833927405 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:18.120782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98463c02-631d-4d33-9675-186833927405 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:18.121543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98463c02-631d-4d33-9675-186833927405 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:18.122168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98463c02-631d-4d33-9675-186833927405 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:18.123724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98463c02-631d-4d33-9675-186833927405 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:18.124371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98463c02-631d-4d33-9675-186833927405 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:18.125061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98463c02-631d-4d33-9675-186833927405 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:18.276839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-935b9402-5cb3-409c-8131-5a8a5fdc6579 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:18.285911 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-935b9402-5cb3-409c-8131-5a8a5fdc6579 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1503 microversion: 2.1 time: 0.502750 Oct 04 21:31:18.295285 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2572/5117] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:17 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1503 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:18.336565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-98463c02-631d-4d33-9675-186833927405 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:18.356147 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-98463c02-631d-4d33-9675-186833927405 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 200 len: 1260 microversion: 2.1 time: 0.283950 Oct 04 21:31:18.357329 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2546/5118] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:18 2022] GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 1260 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:18.572462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-8b253bbc-3433-40f7-b113-81f1ebbe894e req-b6df8d0b-4b78-46cf-aae3-39870f85da7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0246d29-9597-4269-a64b-6daf8bf0cd8f", "name": "network-vif-plugged", "status": "completed", "tag": "06396457-8e5a-4a64-9577-be563f077dc8"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:18.602954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8b253bbc-3433-40f7-b113-81f1ebbe894e req-b6df8d0b-4b78-46cf-aae3-39870f85da7d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:18.602954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8b253bbc-3433-40f7-b113-81f1ebbe894e req-b6df8d0b-4b78-46cf-aae3-39870f85da7d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:18.602954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8b253bbc-3433-40f7-b113-81f1ebbe894e req-b6df8d0b-4b78-46cf-aae3-39870f85da7d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:18.624075 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-8b253bbc-3433-40f7-b113-81f1ebbe894e req-b6df8d0b-4b78-46cf-aae3-39870f85da7d service nova] Creating event network-vif-plugged:06396457-8e5a-4a64-9577-be563f077dc8 for instance e0246d29-9597-4269-a64b-6daf8bf0cd8f on n-h1-860282-1 Oct 04 21:31:18.629777 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-8b253bbc-3433-40f7-b113-81f1ebbe894e req-b6df8d0b-4b78-46cf-aae3-39870f85da7d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061126 Oct 04 21:31:18.630773 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2573/5119] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:19.101653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-80b38124-fb40-4b00-ac9a-61b50a7005a9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:19.103125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-80b38124-fb40-4b00-ac9a-61b50a7005a9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:19.119735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80b38124-fb40-4b00-ac9a-61b50a7005a9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:19.120773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80b38124-fb40-4b00-ac9a-61b50a7005a9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:19.122621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80b38124-fb40-4b00-ac9a-61b50a7005a9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:19.124539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80b38124-fb40-4b00-ac9a-61b50a7005a9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:19.125210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80b38124-fb40-4b00-ac9a-61b50a7005a9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:19.125988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80b38124-fb40-4b00-ac9a-61b50a7005a9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:19.320142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-23848223-ab8f-45bd-97bb-1e3c7e477b04 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:19.322481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-23848223-ab8f-45bd-97bb-1e3c7e477b04 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:19.324333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:19.341676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23848223-ab8f-45bd-97bb-1e3c7e477b04 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:19.342738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23848223-ab8f-45bd-97bb-1e3c7e477b04 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:19.343452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23848223-ab8f-45bd-97bb-1e3c7e477b04 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:19.344043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23848223-ab8f-45bd-97bb-1e3c7e477b04 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:19.344514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23848223-ab8f-45bd-97bb-1e3c7e477b04 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:19.344951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23848223-ab8f-45bd-97bb-1e3c7e477b04 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:19.581960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-80b38124-fb40-4b00-ac9a-61b50a7005a9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:19.602114 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-80b38124-fb40-4b00-ac9a-61b50a7005a9 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03" status: 200 len: 1317 microversion: 2.1 time: 0.511698 Oct 04 21:31:19.625113 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2547/5120] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:19 2022] GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:19.632032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e0114f5e-e4f5-4149-bd98-20c8a64c8fa2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:19.632744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e0114f5e-e4f5-4149-bd98-20c8a64c8fa2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:19.640881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0114f5e-e4f5-4149-bd98-20c8a64c8fa2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:19.641624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0114f5e-e4f5-4149-bd98-20c8a64c8fa2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:19.642778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0114f5e-e4f5-4149-bd98-20c8a64c8fa2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:19.647612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0114f5e-e4f5-4149-bd98-20c8a64c8fa2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:19.648767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0114f5e-e4f5-4149-bd98-20c8a64c8fa2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:19.649442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e0114f5e-e4f5-4149-bd98-20c8a64c8fa2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:20.125661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e0114f5e-e4f5-4149-bd98-20c8a64c8fa2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:20.133018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-23848223-ab8f-45bd-97bb-1e3c7e477b04 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:20.143900 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e0114f5e-e4f5-4149-bd98-20c8a64c8fa2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 200 len: 1266 microversion: 2.1 time: 0.516408 Oct 04 21:31:20.148350 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2548/5121] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:19 2022] GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 1266 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:20.149604 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-23848223-ab8f-45bd-97bb-1e3c7e477b04 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1503 microversion: 2.1 time: 0.831533 Oct 04 21:31:20.152088 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2574/5122] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:19 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1503 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:20.544856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-17353346-c3f1-4b89-8326-07be7ac64355 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:20.545970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-17353346-c3f1-4b89-8326-07be7ac64355 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:20.557134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-8ff283cd-a76b-460f-b0fc-78ac117e557e req-8eb64179-1e6b-44dc-9724-55f2013986a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "090f4719-1122-427c-b849-7c1865ac1ff5", "tag": "d0935e96-259f-4617-85cd-eac52e8c9e52"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:20.557745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17353346-c3f1-4b89-8326-07be7ac64355 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:20.557745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17353346-c3f1-4b89-8326-07be7ac64355 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:20.558190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17353346-c3f1-4b89-8326-07be7ac64355 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:20.563859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17353346-c3f1-4b89-8326-07be7ac64355 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:20.571782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17353346-c3f1-4b89-8326-07be7ac64355 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:20.571782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17353346-c3f1-4b89-8326-07be7ac64355 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:20.589149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8ff283cd-a76b-460f-b0fc-78ac117e557e req-8eb64179-1e6b-44dc-9724-55f2013986a8 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:20.593767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8ff283cd-a76b-460f-b0fc-78ac117e557e req-8eb64179-1e6b-44dc-9724-55f2013986a8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:20.594264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8ff283cd-a76b-460f-b0fc-78ac117e557e req-8eb64179-1e6b-44dc-9724-55f2013986a8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:20.628091 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-8ff283cd-a76b-460f-b0fc-78ac117e557e req-8eb64179-1e6b-44dc-9724-55f2013986a8 service nova] Creating event network-changed:d0935e96-259f-4617-85cd-eac52e8c9e52 for instance 090f4719-1122-427c-b849-7c1865ac1ff5 on n-h2-860282-1 Oct 04 21:31:20.633377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-17353346-c3f1-4b89-8326-07be7ac64355 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:31:20.656328 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-8ff283cd-a76b-460f-b0fc-78ac117e557e req-8eb64179-1e6b-44dc-9724-55f2013986a8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096696 Oct 04 21:31:20.656328 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2575/5123] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:20.656328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ad924e23-9b9c-447c-94e2-8ac54f4d34f4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:20.656834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ad924e23-9b9c-447c-94e2-8ac54f4d34f4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:20.664567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad924e23-9b9c-447c-94e2-8ac54f4d34f4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:20.665329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad924e23-9b9c-447c-94e2-8ac54f4d34f4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:20.666014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad924e23-9b9c-447c-94e2-8ac54f4d34f4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:20.667633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad924e23-9b9c-447c-94e2-8ac54f4d34f4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:20.668346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad924e23-9b9c-447c-94e2-8ac54f4d34f4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:20.669001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad924e23-9b9c-447c-94e2-8ac54f4d34f4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:20.984618 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ad924e23-9b9c-447c-94e2-8ac54f4d34f4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:21.002650 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ad924e23-9b9c-447c-94e2-8ac54f4d34f4 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03" status: 200 len: 1317 microversion: 2.1 time: 0.348986 Oct 04 21:31:21.005855 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2576/5124] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:20 2022] GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:21.179967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-13a4f0e9-822c-4e20-a20a-7a4c5fdc45eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:21.180518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-13a4f0e9-822c-4e20-a20a-7a4c5fdc45eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:21.192405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13a4f0e9-822c-4e20-a20a-7a4c5fdc45eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:21.199345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13a4f0e9-822c-4e20-a20a-7a4c5fdc45eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:21.207878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13a4f0e9-822c-4e20-a20a-7a4c5fdc45eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:21.207878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13a4f0e9-822c-4e20-a20a-7a4c5fdc45eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:21.207878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13a4f0e9-822c-4e20-a20a-7a4c5fdc45eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:21.207878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13a4f0e9-822c-4e20-a20a-7a4c5fdc45eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:21.231313 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-17353346-c3f1-4b89-8326-07be7ac64355 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "DELETE /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 204 len: 0 microversion: 2.1 time: 0.688455 Oct 04 21:31:21.234980 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2549/5125] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:31:20 2022] DELETE /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:31:21.243581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5c77d76e-0c8b-43ac-839e-188503669849 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:21.244603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5c77d76e-0c8b-43ac-839e-188503669849 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:21.253852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c77d76e-0c8b-43ac-839e-188503669849 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:21.254683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c77d76e-0c8b-43ac-839e-188503669849 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:21.260040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c77d76e-0c8b-43ac-839e-188503669849 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:21.260040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c77d76e-0c8b-43ac-839e-188503669849 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:21.260040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c77d76e-0c8b-43ac-839e-188503669849 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:21.260040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c77d76e-0c8b-43ac-839e-188503669849 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:21.668915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-13a4f0e9-822c-4e20-a20a-7a4c5fdc45eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:21.684622 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-13a4f0e9-822c-4e20-a20a-7a4c5fdc45eb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 200 len: 1308 microversion: 2.1 time: 0.508507 Oct 04 21:31:21.686594 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2577/5126] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:21 2022] GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 1308 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:21.695959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-08ba1dc6-775f-4793-a70d-a1de47d4169f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:21.696825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-08ba1dc6-775f-4793-a70d-a1de47d4169f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:21.705741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08ba1dc6-775f-4793-a70d-a1de47d4169f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:21.706988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08ba1dc6-775f-4793-a70d-a1de47d4169f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:21.707671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08ba1dc6-775f-4793-a70d-a1de47d4169f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:21.708585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08ba1dc6-775f-4793-a70d-a1de47d4169f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:21.709353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08ba1dc6-775f-4793-a70d-a1de47d4169f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:21.710002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08ba1dc6-775f-4793-a70d-a1de47d4169f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:21.753251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5c77d76e-0c8b-43ac-839e-188503669849 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:21.761973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:21.765392 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5c77d76e-0c8b-43ac-839e-188503669849 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.527982 Oct 04 21:31:21.776496 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2550/5127] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:21 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:21.790104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-52523234-1d63-4b8d-be47-6b7e1913c2c2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1508752188", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccb62f72-b314-486b-ac69-a6797e725ff7"}], "security_groups": [{"name": "tempest-securitygroup--776244948"}], "key_name": "tempest-keypair-204641264", "user_data": "}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:22.022434 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-52523234-1d63-4b8d-be47-6b7e1913c2c2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] validate_networks() for [('ccb62f72-b314-486b-ac69-a6797e725ff7', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:31:22.071892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-08ba1dc6-775f-4793-a70d-a1de47d4169f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:22.107572 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-08ba1dc6-775f-4793-a70d-a1de47d4169f tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 200 len: 1670 microversion: 2.1 time: 0.417984 Oct 04 21:31:22.117763 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2578/5128] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:21 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 1670 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:22.125818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c87672ca-321b-4213-b48c-4d8b75d22d0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:22.127160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c87672ca-321b-4213-b48c-4d8b75d22d0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:22.141538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c87672ca-321b-4213-b48c-4d8b75d22d0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:22.149065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c87672ca-321b-4213-b48c-4d8b75d22d0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:22.149822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c87672ca-321b-4213-b48c-4d8b75d22d0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:22.150935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c87672ca-321b-4213-b48c-4d8b75d22d0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:22.151880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c87672ca-321b-4213-b48c-4d8b75d22d0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:22.153411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c87672ca-321b-4213-b48c-4d8b75d22d0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:22.174609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:22.566972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c87672ca-321b-4213-b48c-4d8b75d22d0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:22.581129 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c87672ca-321b-4213-b48c-4d8b75d22d0a tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.470687 Oct 04 21:31:22.582278 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2579/5129] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:22 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:22.587037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-aa16617d-850e-42fc-ac07-bbaf5fa93259 req-b676e374-a2d6-434c-b6e6-32104f30c75d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03", "name": "network-vif-plugged", "status": "completed", "tag": "5985f943-f63c-4483-8bee-3953653e940f"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:22.597338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-aa16617d-850e-42fc-ac07-bbaf5fa93259 req-b676e374-a2d6-434c-b6e6-32104f30c75d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:22.598082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-aa16617d-850e-42fc-ac07-bbaf5fa93259 req-b676e374-a2d6-434c-b6e6-32104f30c75d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:22.598704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-aa16617d-850e-42fc-ac07-bbaf5fa93259 req-b676e374-a2d6-434c-b6e6-32104f30c75d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:22.612071 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-aa16617d-850e-42fc-ac07-bbaf5fa93259 req-b676e374-a2d6-434c-b6e6-32104f30c75d service nova] Creating event network-vif-plugged:5985f943-f63c-4483-8bee-3953653e940f for instance 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 on n-h2-860282-1 Oct 04 21:31:22.617722 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-aa16617d-850e-42fc-ac07-bbaf5fa93259 req-b676e374-a2d6-434c-b6e6-32104f30c75d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034051 Oct 04 21:31:22.618531 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2580/5130] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:22.625151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c168705a-92c7-4fbb-a272-9cac4b64d36c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:22.626143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c168705a-92c7-4fbb-a272-9cac4b64d36c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:22.634750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c168705a-92c7-4fbb-a272-9cac4b64d36c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:22.635482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c168705a-92c7-4fbb-a272-9cac4b64d36c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:22.636116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c168705a-92c7-4fbb-a272-9cac4b64d36c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:22.637614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c168705a-92c7-4fbb-a272-9cac4b64d36c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:22.643304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c168705a-92c7-4fbb-a272-9cac4b64d36c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:22.643304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c168705a-92c7-4fbb-a272-9cac4b64d36c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:23.211878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c168705a-92c7-4fbb-a272-9cac4b64d36c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:23.221570 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c168705a-92c7-4fbb-a272-9cac4b64d36c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03" status: 200 len: 1317 microversion: 2.1 time: 0.601616 Oct 04 21:31:23.222451 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2581/5131] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:22 2022] GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 => generated 1317 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:23.227270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f77d2729-0010-4cfd-bab4-6c131a5c28d6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:23.228011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f77d2729-0010-4cfd-bab4-6c131a5c28d6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 46447521-98d0-49c5-b296-04f403b05ce0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:23.234389 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-f77d2729-0010-4cfd-bab4-6c131a5c28d6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance 46447521-98d0-49c5-b296-04f403b05ce0 could not be found. Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f77d2729-0010-4cfd-bab4-6c131a5c28d6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/46447521-98d0-49c5-b296-04f403b05ce0/action HTTP/1.1 Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 15 Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: {"unpause": {}} Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 46447521-98d0-49c5-b296-04f403b05ce0 could not be found. Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '46447521-98d0-49c5-b296-04f403b05ce0', 'body': {'unpause': {}}} Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46447521-98d0-49c5-b296-04f403b05ce0 could not be found. Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46447521-98d0-49c5-b296-04f403b05ce0 could not be found. Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:23.236278 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:23.241292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:23.241292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:23.241292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46447521-98d0-49c5-b296-04f403b05ce0 could not be found. Oct 04 21:31:23.241292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:23.242387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f77d2729-0010-4cfd-bab4-6c131a5c28d6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance 46447521-98d0-49c5-b296-04f403b05ce0 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:23.243417 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f77d2729-0010-4cfd-bab4-6c131a5c28d6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/46447521-98d0-49c5-b296-04f403b05ce0/action" status: 404 len: 111 microversion: 2.1 time: 0.019872 Oct 04 21:31:23.245557 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2582/5132] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:31:23 2022] POST /compute/v2.1/servers/46447521-98d0-49c5-b296-04f403b05ce0/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:31:23.254001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-41cea8e7-2f5d-4982-b57f-b19018ca7caa tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:23.254625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-41cea8e7-2f5d-4982-b57f-b19018ca7caa tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:23.262204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41cea8e7-2f5d-4982-b57f-b19018ca7caa tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:23.262733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41cea8e7-2f5d-4982-b57f-b19018ca7caa tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:23.263183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41cea8e7-2f5d-4982-b57f-b19018ca7caa tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:23.263895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41cea8e7-2f5d-4982-b57f-b19018ca7caa tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:23.264549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41cea8e7-2f5d-4982-b57f-b19018ca7caa tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:23.265053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41cea8e7-2f5d-4982-b57f-b19018ca7caa tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:23.337194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-52523234-1d63-4b8d-be47-6b7e1913c2c2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:31:23.339541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-52523234-1d63-4b8d-be47-6b7e1913c2c2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:31:23.339541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-52523234-1d63-4b8d-be47-6b7e1913c2c2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:31:23.339541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-52523234-1d63-4b8d-be47-6b7e1913c2c2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:31:23.340620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-52523234-1d63-4b8d-be47-6b7e1913c2c2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:31:23.356396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52523234-1d63-4b8d-be47-6b7e1913c2c2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:23.357007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52523234-1d63-4b8d-be47-6b7e1913c2c2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:23.357551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52523234-1d63-4b8d-be47-6b7e1913c2c2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:23.358681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52523234-1d63-4b8d-be47-6b7e1913c2c2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:23.359155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52523234-1d63-4b8d-be47-6b7e1913c2c2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:23.359586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52523234-1d63-4b8d-be47-6b7e1913c2c2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:23.383798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-52523234-1d63-4b8d-be47-6b7e1913c2c2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Getting quotas for project 66351b2e6b2840f183aaf8983e6fc128. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:31:23.390563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-52523234-1d63-4b8d-be47-6b7e1913c2c2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Getting quotas for user 0c9cb06716184ec88816395420d5870e and project 66351b2e6b2840f183aaf8983e6fc128. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:31:23.407268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-52523234-1d63-4b8d-be47-6b7e1913c2c2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:31:23.409113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-52523234-1d63-4b8d-be47-6b7e1913c2c2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:31:23.596061 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-52523234-1d63-4b8d-be47-6b7e1913c2c2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.817498 Oct 04 21:31:23.600971 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2551/5133] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:31:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 1825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:31:23.611508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8914fc7e-49ad-4656-917b-0a1b3c46b8cf tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:23.612539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8914fc7e-49ad-4656-917b-0a1b3c46b8cf tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:23.620388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8914fc7e-49ad-4656-917b-0a1b3c46b8cf tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:23.621260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8914fc7e-49ad-4656-917b-0a1b3c46b8cf tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:23.627208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8914fc7e-49ad-4656-917b-0a1b3c46b8cf tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:23.627208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8914fc7e-49ad-4656-917b-0a1b3c46b8cf tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:23.627208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8914fc7e-49ad-4656-917b-0a1b3c46b8cf tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:23.627208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8914fc7e-49ad-4656-917b-0a1b3c46b8cf tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:23.775390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-41cea8e7-2f5d-4982-b57f-b19018ca7caa tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:23.796194 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-41cea8e7-2f5d-4982-b57f-b19018ca7caa tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 200 len: 1308 microversion: 2.1 time: 0.549119 Oct 04 21:31:23.801395 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2583/5134] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:23 2022] GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 1308 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:23.803091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-abe12149-93d9-443e-a45d-a8d80e334f07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:23.804034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-abe12149-93d9-443e-a45d-a8d80e334f07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:23.811446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abe12149-93d9-443e-a45d-a8d80e334f07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:23.812478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abe12149-93d9-443e-a45d-a8d80e334f07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:23.813149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abe12149-93d9-443e-a45d-a8d80e334f07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:23.814162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abe12149-93d9-443e-a45d-a8d80e334f07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:23.814861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abe12149-93d9-443e-a45d-a8d80e334f07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:23.815492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-abe12149-93d9-443e-a45d-a8d80e334f07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:24.099973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8914fc7e-49ad-4656-917b-0a1b3c46b8cf tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:24.126250 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8914fc7e-49ad-4656-917b-0a1b3c46b8cf tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 200 len: 1551 microversion: 2.1 time: 0.522226 Oct 04 21:31:24.127041 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2552/5135] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:23 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 1551 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:24.146481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9f321509-dd6e-4ab4-9081-a13729d8243a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:24.147516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9f321509-dd6e-4ab4-9081-a13729d8243a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:24.529292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-abe12149-93d9-443e-a45d-a8d80e334f07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:24.560051 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-abe12149-93d9-443e-a45d-a8d80e334f07 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.761691 Oct 04 21:31:24.565539 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2584/5136] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:23 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:24.565860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-4a15679c-e439-4460-9aaa-95d8b1253561 req-6032cdab-7f4c-4bb8-ab08-0dba7f2bb648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad0bd930-32ff-4587-8b22-bb47d1fe061d", "tag": "6a83316d-6559-4953-9aeb-d55e81ed0229"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:24.581099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4a15679c-e439-4460-9aaa-95d8b1253561 req-6032cdab-7f4c-4bb8-ab08-0dba7f2bb648 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:24.581099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4a15679c-e439-4460-9aaa-95d8b1253561 req-6032cdab-7f4c-4bb8-ab08-0dba7f2bb648 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:24.581099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4a15679c-e439-4460-9aaa-95d8b1253561 req-6032cdab-7f4c-4bb8-ab08-0dba7f2bb648 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:24.588331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9f321509-dd6e-4ab4-9081-a13729d8243a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:24.594964 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-4a15679c-e439-4460-9aaa-95d8b1253561 req-6032cdab-7f4c-4bb8-ab08-0dba7f2bb648 service nova] Creating event network-changed:6a83316d-6559-4953-9aeb-d55e81ed0229 for instance ad0bd930-32ff-4587-8b22-bb47d1fe061d on n-h1-860282-1 Oct 04 21:31:24.599223 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9f321509-dd6e-4ab4-9081-a13729d8243a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1237 microversion: 2.1 time: 0.469603 Oct 04 21:31:24.599922 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2553/5137] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:24 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1237 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:24.600239 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-4a15679c-e439-4460-9aaa-95d8b1253561 req-6032cdab-7f4c-4bb8-ab08-0dba7f2bb648 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038027 Oct 04 21:31:24.601448 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2585/5138] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:24.607669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c103de9c-4581-4201-a87f-9c79de726161 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:24.608385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c103de9c-4581-4201-a87f-9c79de726161 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:24.610045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6a428421-5562-4151-a4bb-070ce047fa99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:24.610912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6a428421-5562-4151-a4bb-070ce047fa99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:24.617828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c103de9c-4581-4201-a87f-9c79de726161 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:24.618331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c103de9c-4581-4201-a87f-9c79de726161 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:24.618784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c103de9c-4581-4201-a87f-9c79de726161 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:24.619497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c103de9c-4581-4201-a87f-9c79de726161 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:24.619966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c103de9c-4581-4201-a87f-9c79de726161 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:24.620400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c103de9c-4581-4201-a87f-9c79de726161 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:24.620856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a428421-5562-4151-a4bb-070ce047fa99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:24.622147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a428421-5562-4151-a4bb-070ce047fa99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:24.622592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a428421-5562-4151-a4bb-070ce047fa99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:24.623333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a428421-5562-4151-a4bb-070ce047fa99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:24.623788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a428421-5562-4151-a4bb-070ce047fa99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:24.624209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a428421-5562-4151-a4bb-070ce047fa99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:25.015275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6a428421-5562-4151-a4bb-070ce047fa99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:25.023358 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6a428421-5562-4151-a4bb-070ce047fa99 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03" status: 200 len: 1505 microversion: 2.1 time: 0.421928 Oct 04 21:31:25.024461 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2554/5139] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:24 2022] GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:25.030403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c103de9c-4581-4201-a87f-9c79de726161 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:25.030593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-089c1835-5dbe-467c-936c-40ea3b97353d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:25.031090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-089c1835-5dbe-467c-936c-40ea3b97353d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:25.037486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-089c1835-5dbe-467c-936c-40ea3b97353d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:25.038172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-089c1835-5dbe-467c-936c-40ea3b97353d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:25.038958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-089c1835-5dbe-467c-936c-40ea3b97353d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:25.040570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-089c1835-5dbe-467c-936c-40ea3b97353d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:25.041201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-089c1835-5dbe-467c-936c-40ea3b97353d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:25.041900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-089c1835-5dbe-467c-936c-40ea3b97353d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:25.046211 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c103de9c-4581-4201-a87f-9c79de726161 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.443319 Oct 04 21:31:25.047103 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2586/5140] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:24 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:25.057865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f2d4a354-07db-4ca8-855b-7c5845b03536 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:25.058482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f2d4a354-07db-4ca8-855b-7c5845b03536 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: e0246d29-9597-4269-a64b-6daf8bf0cd8f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:25.066213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2d4a354-07db-4ca8-855b-7c5845b03536 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:25.072044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2d4a354-07db-4ca8-855b-7c5845b03536 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:25.072044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2d4a354-07db-4ca8-855b-7c5845b03536 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:25.072044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2d4a354-07db-4ca8-855b-7c5845b03536 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:25.072044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2d4a354-07db-4ca8-855b-7c5845b03536 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:25.072044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2d4a354-07db-4ca8-855b-7c5845b03536 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:25.381006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f2d4a354-07db-4ca8-855b-7c5845b03536 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:25.383314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-089c1835-5dbe-467c-936c-40ea3b97353d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:25.390959 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f2d4a354-07db-4ca8-855b-7c5845b03536 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/e0246d29-9597-4269-a64b-6daf8bf0cd8f" status: 200 len: 1505 microversion: 2.1 time: 0.342762 Oct 04 21:31:25.391852 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2587/5141] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:25 2022] GET /compute/v2.1/servers/e0246d29-9597-4269-a64b-6daf8bf0cd8f => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:25.395134 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-089c1835-5dbe-467c-936c-40ea3b97353d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 200 len: 1308 microversion: 2.1 time: 0.369084 Oct 04 21:31:25.413831 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2555/5142] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:25 2022] GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 1308 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:25.419873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-639d3982-7b35-4078-96e5-b4b0bb89bff3 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:25.420762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-639d3982-7b35-4078-96e5-b4b0bb89bff3 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:25.427148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ad2652ba-9e66-43c7-b050-ecde5683b0a7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:25.427702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-639d3982-7b35-4078-96e5-b4b0bb89bff3 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:25.428006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ad2652ba-9e66-43c7-b050-ecde5683b0a7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:25.428644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-639d3982-7b35-4078-96e5-b4b0bb89bff3 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:25.429337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-639d3982-7b35-4078-96e5-b4b0bb89bff3 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:25.430494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-639d3982-7b35-4078-96e5-b4b0bb89bff3 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:25.431303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-639d3982-7b35-4078-96e5-b4b0bb89bff3 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:25.431934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-639d3982-7b35-4078-96e5-b4b0bb89bff3 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:25.435766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad2652ba-9e66-43c7-b050-ecde5683b0a7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:25.436511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad2652ba-9e66-43c7-b050-ecde5683b0a7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:25.437206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad2652ba-9e66-43c7-b050-ecde5683b0a7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:25.439000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad2652ba-9e66-43c7-b050-ecde5683b0a7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:25.439571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad2652ba-9e66-43c7-b050-ecde5683b0a7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:25.440272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad2652ba-9e66-43c7-b050-ecde5683b0a7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:25.473777 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-ad2652ba-9e66-43c7-b050-ecde5683b0a7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Cannot 'unpause' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active Oct 04 21:31:25.474104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-639d3982-7b35-4078-96e5-b4b0bb89bff3 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:25.474104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-639d3982-7b35-4078-96e5-b4b0bb89bff3 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ad2652ba-9e66-43c7-b050-ecde5683b0a7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action HTTP/1.1 Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 15 Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: {"unpause": {}} Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: exception: Cannot 'unpause' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '144fff2d-9df3-4a93-833f-7f76acc85185', 'body': {'unpause': {}}} Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 144fff2d-9df3-4a93-833f-7f76acc85185 in vm_state active. Cannot unpause while the instance is in this state. Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:25.474474 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:25.487382 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:25.487382 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:25.487382 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:25.487382 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active Oct 04 21:31:25.487382 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:25.487871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-639d3982-7b35-4078-96e5-b4b0bb89bff3 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:25.487871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-639d3982-7b35-4078-96e5-b4b0bb89bff3 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lazy-loading 'fault' on Instance uuid 090f4719-1122-427c-b849-7c1865ac1ff5 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:31:25.488106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ad2652ba-9e66-43c7-b050-ecde5683b0a7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 409 to user: Cannot 'unpause' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:25.488106 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ad2652ba-9e66-43c7-b050-ecde5683b0a7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action" status: 409 len: 145 microversion: 2.1 time: 0.064898 Oct 04 21:31:25.488106 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2588/5143] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:31:25 2022] POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action => generated 145 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:31:25.488106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5b0ad990-263a-4393-ac09-967bd72d6130 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:25.488106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5b0ad990-263a-4393-ac09-967bd72d6130 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: e0246d29-9597-4269-a64b-6daf8bf0cd8f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:25.492960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b0ad990-263a-4393-ac09-967bd72d6130 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:25.493513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b0ad990-263a-4393-ac09-967bd72d6130 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:25.494038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b0ad990-263a-4393-ac09-967bd72d6130 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:25.494899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b0ad990-263a-4393-ac09-967bd72d6130 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:25.495605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b0ad990-263a-4393-ac09-967bd72d6130 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:25.496026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b0ad990-263a-4393-ac09-967bd72d6130 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:25.530388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5b0ad990-263a-4393-ac09-967bd72d6130 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: e0246d29-9597-4269-a64b-6daf8bf0cd8f] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:31:25.530927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-639d3982-7b35-4078-96e5-b4b0bb89bff3 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933f720fbafe482d95b27cd372934ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74afbd0dc37402fa84ec9d6e2cb53f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:25.541933 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-639d3982-7b35-4078-96e5-b4b0bb89bff3 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 200 len: 1337 microversion: 2.1 time: 0.126603 Oct 04 21:31:25.542874 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2556/5144] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:25 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 1337 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:25.548928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b2252280-5a48-4323-8a8d-a53f55fa18f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:25.549824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b2252280-5a48-4323-8a8d-a53f55fa18f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:25.557448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b2252280-5a48-4323-8a8d-a53f55fa18f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:25.558210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b2252280-5a48-4323-8a8d-a53f55fa18f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:25.558691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b2252280-5a48-4323-8a8d-a53f55fa18f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:25.559419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b2252280-5a48-4323-8a8d-a53f55fa18f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:25.559950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b2252280-5a48-4323-8a8d-a53f55fa18f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:25.560432 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b2252280-5a48-4323-8a8d-a53f55fa18f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:25.696886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b2252280-5a48-4323-8a8d-a53f55fa18f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:25.705596 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b2252280-5a48-4323-8a8d-a53f55fa18f1 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.160959 Oct 04 21:31:25.706176 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2557/5145] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:25 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:25.710648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c1c2856d-16f4-4cf7-9eda-3adf2bf98bc0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:25.711232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c1c2856d-16f4-4cf7-9eda-3adf2bf98bc0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:25.778740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c1c2856d-16f4-4cf7-9eda-3adf2bf98bc0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:25.785705 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c1c2856d-16f4-4cf7-9eda-3adf2bf98bc0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1237 microversion: 2.1 time: 0.078509 Oct 04 21:31:25.789599 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2558/5146] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:25 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:25.795258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-21375838-8e8f-4e4f-8925-038b6cfa2a1d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:25.795791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-21375838-8e8f-4e4f-8925-038b6cfa2a1d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:25.801898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21375838-8e8f-4e4f-8925-038b6cfa2a1d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:25.802489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21375838-8e8f-4e4f-8925-038b6cfa2a1d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:25.802819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21375838-8e8f-4e4f-8925-038b6cfa2a1d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:25.803595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21375838-8e8f-4e4f-8925-038b6cfa2a1d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:25.804215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21375838-8e8f-4e4f-8925-038b6cfa2a1d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:25.804648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21375838-8e8f-4e4f-8925-038b6cfa2a1d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:25.986061 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5b0ad990-263a-4393-ac09-967bd72d6130 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e0246d29-9597-4269-a64b-6daf8bf0cd8f" status: 204 len: 0 microversion: 2.1 time: 0.506772 Oct 04 21:31:25.986696 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2589/5147] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:31:25 2022] DELETE /compute/v2.1/servers/e0246d29-9597-4269-a64b-6daf8bf0cd8f => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:31:25.989412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-21375838-8e8f-4e4f-8925-038b6cfa2a1d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:26.000751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a8792ab4-7dd1-4fc3-aac8-7c5d1b1b8a8c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:26.001655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a8792ab4-7dd1-4fc3-aac8-7c5d1b1b8a8c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:26.008030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8792ab4-7dd1-4fc3-aac8-7c5d1b1b8a8c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.008524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8792ab4-7dd1-4fc3-aac8-7c5d1b1b8a8c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.011511 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-21375838-8e8f-4e4f-8925-038b6cfa2a1d tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.217548 Oct 04 21:31:26.011869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8792ab4-7dd1-4fc3-aac8-7c5d1b1b8a8c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.012491 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2559/5148] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:25 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:26.012600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8792ab4-7dd1-4fc3-aac8-7c5d1b1b8a8c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.012600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8792ab4-7dd1-4fc3-aac8-7c5d1b1b8a8c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.012600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8792ab4-7dd1-4fc3-aac8-7c5d1b1b8a8c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.033907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-65402456-828d-4563-9eb4-de9135ec4dad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:26.034777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-65402456-828d-4563-9eb4-de9135ec4dad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 39b9b040-14cf-404a-a4b0-65dfeeb6677f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:26.045403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a8792ab4-7dd1-4fc3-aac8-7c5d1b1b8a8c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:31:26.045920 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-65402456-828d-4563-9eb4-de9135ec4dad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance 39b9b040-14cf-404a-a4b0-65dfeeb6677f could not be found. Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-65402456-828d-4563-9eb4-de9135ec4dad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/39b9b040-14cf-404a-a4b0-65dfeeb6677f/action HTTP/1.1 Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 18 Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: {"unshelve": null} Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 39b9b040-14cf-404a-a4b0-65dfeeb6677f could not be found. Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '39b9b040-14cf-404a-a4b0-65dfeeb6677f', 'body': {'unshelve': None}} Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39b9b040-14cf-404a-a4b0-65dfeeb6677f could not be found. Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39b9b040-14cf-404a-a4b0-65dfeeb6677f could not be found. Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:26.048035 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:26.057774 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:26.057774 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:26.057774 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:26.057774 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:26.057774 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:26.057774 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:26.057774 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39b9b040-14cf-404a-a4b0-65dfeeb6677f could not be found. Oct 04 21:31:26.057774 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:26.057774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-65402456-828d-4563-9eb4-de9135ec4dad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance 39b9b040-14cf-404a-a4b0-65dfeeb6677f could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:26.057774 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-65402456-828d-4563-9eb4-de9135ec4dad tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/39b9b040-14cf-404a-a4b0-65dfeeb6677f/action" status: 404 len: 111 microversion: 2.1 time: 0.020621 Oct 04 21:31:26.057774 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2560/5149] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:31:26 2022] POST /compute/v2.1/servers/39b9b040-14cf-404a-a4b0-65dfeeb6677f/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:31:26.063504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4de157bd-dcc6-4214-bca7-758e186763e6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:26.065112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4de157bd-dcc6-4214-bca7-758e186763e6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:26.073671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4de157bd-dcc6-4214-bca7-758e186763e6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.075063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4de157bd-dcc6-4214-bca7-758e186763e6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.075768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4de157bd-dcc6-4214-bca7-758e186763e6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.077327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4de157bd-dcc6-4214-bca7-758e186763e6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.078058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4de157bd-dcc6-4214-bca7-758e186763e6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.078772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4de157bd-dcc6-4214-bca7-758e186763e6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.225190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4de157bd-dcc6-4214-bca7-758e186763e6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:26.233942 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4de157bd-dcc6-4214-bca7-758e186763e6 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.176380 Oct 04 21:31:26.234611 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2561/5150] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:26 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:26.256988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4e294fd4-2056-46cb-b4ef-2da1277dff29 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:26.257665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4e294fd4-2056-46cb-b4ef-2da1277dff29 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:26.263687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e294fd4-2056-46cb-b4ef-2da1277dff29 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.264182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e294fd4-2056-46cb-b4ef-2da1277dff29 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.264624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e294fd4-2056-46cb-b4ef-2da1277dff29 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.265321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e294fd4-2056-46cb-b4ef-2da1277dff29 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.265815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e294fd4-2056-46cb-b4ef-2da1277dff29 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.266255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e294fd4-2056-46cb-b4ef-2da1277dff29 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.410834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4e294fd4-2056-46cb-b4ef-2da1277dff29 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:26.419436 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4e294fd4-2056-46cb-b4ef-2da1277dff29 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.166160 Oct 04 21:31:26.420284 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2562/5151] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:26 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:26.428851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bc996a53-bff8-450b-bec4-63ee1920d282 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:26.429496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bc996a53-bff8-450b-bec4-63ee1920d282 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:26.438259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc996a53-bff8-450b-bec4-63ee1920d282 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.438259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc996a53-bff8-450b-bec4-63ee1920d282 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.438259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc996a53-bff8-450b-bec4-63ee1920d282 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.438259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc996a53-bff8-450b-bec4-63ee1920d282 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.438259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc996a53-bff8-450b-bec4-63ee1920d282 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.438883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc996a53-bff8-450b-bec4-63ee1920d282 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.551492 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a8792ab4-7dd1-4fc3-aac8-7c5d1b1b8a8c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03" status: 204 len: 0 microversion: 2.1 time: 0.556666 Oct 04 21:31:26.552161 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2590/5152] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:31:25 2022] DELETE /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:31:26.558187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1aa4f2eb-669c-4273-a007-53ced7e66404 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:26.559591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1aa4f2eb-669c-4273-a007-53ced7e66404 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:26.566587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1aa4f2eb-669c-4273-a007-53ced7e66404 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.567080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1aa4f2eb-669c-4273-a007-53ced7e66404 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.567754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1aa4f2eb-669c-4273-a007-53ced7e66404 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.568692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1aa4f2eb-669c-4273-a007-53ced7e66404 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.569159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1aa4f2eb-669c-4273-a007-53ced7e66404 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.569913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1aa4f2eb-669c-4273-a007-53ced7e66404 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.612197 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-1aa4f2eb-669c-4273-a007-53ced7e66404 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Cannot 'unshelve' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1aa4f2eb-669c-4273-a007-53ced7e66404 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action HTTP/1.1 Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 18 Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: {"unshelve": null} Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: exception: Cannot 'unshelve' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '144fff2d-9df3-4a93-833f-7f76acc85185', 'body': {'unshelve': None}} Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 144fff2d-9df3-4a93-833f-7f76acc85185 in vm_state active. Cannot unshelve while the instance is in this state. Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:31:26.613951 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:31:26.619184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active Oct 04 21:31:26.619184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:26.619184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:26.619184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:26.619184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:26.619184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:26.619184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:26.619184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:26.619184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:26.619184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active Oct 04 21:31:26.619184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:26.619184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1aa4f2eb-669c-4273-a007-53ced7e66404 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 409 to user: Cannot 'unshelve' instance 144fff2d-9df3-4a93-833f-7f76acc85185 while it is in vm_state active {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:26.619184 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1aa4f2eb-669c-4273-a007-53ced7e66404 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action" status: 409 len: 146 microversion: 2.1 time: 0.062238 Oct 04 21:31:26.619184 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2591/5153] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:31:26 2022] POST /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185/action => generated 146 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:31:26.624819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-157819e6-32bb-4321-8e40-ae36775f980b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:26.625465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-157819e6-32bb-4321-8e40-ae36775f980b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: e0246d29-9597-4269-a64b-6daf8bf0cd8f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:26.632402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-157819e6-32bb-4321-8e40-ae36775f980b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.632896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-157819e6-32bb-4321-8e40-ae36775f980b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.633344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-157819e6-32bb-4321-8e40-ae36775f980b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.634074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-157819e6-32bb-4321-8e40-ae36775f980b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.634539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-157819e6-32bb-4321-8e40-ae36775f980b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.634975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-157819e6-32bb-4321-8e40-ae36775f980b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.641911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bc996a53-bff8-450b-bec4-63ee1920d282 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:26.650290 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bc996a53-bff8-450b-bec4-63ee1920d282 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 200 len: 1308 microversion: 2.1 time: 0.225018 Oct 04 21:31:26.668470 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2563/5154] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:26 2022] GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 1308 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:26.671359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-afa8392c-3958-4a89-acd0-ef7ef3916646 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:26.672005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-afa8392c-3958-4a89-acd0-ef7ef3916646 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] [instance: 090f4719-1122-427c-b849-7c1865ac1ff5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:26.678214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afa8392c-3958-4a89-acd0-ef7ef3916646 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.678759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afa8392c-3958-4a89-acd0-ef7ef3916646 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.679163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afa8392c-3958-4a89-acd0-ef7ef3916646 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.680157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afa8392c-3958-4a89-acd0-ef7ef3916646 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.680626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afa8392c-3958-4a89-acd0-ef7ef3916646 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.681252 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afa8392c-3958-4a89-acd0-ef7ef3916646 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.702146 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-afa8392c-3958-4a89-acd0-ef7ef3916646 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] HTTP exception thrown: Instance 090f4719-1122-427c-b849-7c1865ac1ff5 could not be found. Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-afa8392c-3958-4a89-acd0-ef7ef3916646 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Request method failure captured: Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 HTTP/1.1 Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUDTGg7T7VmitVTpKF-9FBNIahULcSg1Wrhgxdvxnw-Guiea8B89zhK-rmHA6jLrq1dY4k5V7smqycj9Wwj4V1XlUTI--J420yQ9x-HG1Yvp0xOQwsH8vGq2YOT5Y5PE_YuJxvI37NIhLHdaKHC_0_Ru-aYkhIjOlmzffo7yTPu4r8 Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f74afbd0dc37402fa84ec9d6e2cb53f4 Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestNetworkBasicOps-1291671602 Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f74afbd0dc37402fa84ec9d6e2cb53f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f74afbd0dc37402fa84ec9d6e2cb53f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f74afbd0dc37402fa84ec9d6e2cb53f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f74afbd0dc37402fa84ec9d6e2cb53f4"}]}] Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestNetworkBasicOps-1291671602 Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f74afbd0dc37402fa84ec9d6e2cb53f4 Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestNetworkBasicOps-1291671602 Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestNetworkBasicOps-1291671602-project Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 933f720fbafe482d95b27cd372934ab6 Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestNetworkBasicOps-1291671602-project Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 090f4719-1122-427c-b849-7c1865ac1ff5 could not be found. Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '090f4719-1122-427c-b849-7c1865ac1ff5'} Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 090f4719-1122-427c-b849-7c1865ac1ff5 could not be found. Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 090f4719-1122-427c-b849-7c1865ac1ff5 could not be found. Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:26.703728 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:26.722132 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:26.722132 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:26.722132 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:26.722132 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:26.722132 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:26.722132 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 090f4719-1122-427c-b849-7c1865ac1ff5 could not be found. Oct 04 21:31:26.722132 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:26.722132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-afa8392c-3958-4a89-acd0-ef7ef3916646 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Returning 404 to user: Instance 090f4719-1122-427c-b849-7c1865ac1ff5 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:26.722132 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-afa8392c-3958-4a89-acd0-ef7ef3916646 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5" status: 404 len: 111 microversion: 2.1 time: 0.037817 Oct 04 21:31:26.722132 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2564/5155] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:26 2022] GET /compute/v2.1/servers/090f4719-1122-427c-b849-7c1865ac1ff5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:31:26.722132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-ee49f5aa-76b7-44dc-9a78-8f5d0faf367e req-ba6a3190-7e2d-460f-bfb2-6323f678925b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "090f4719-1122-427c-b849-7c1865ac1ff5", "name": "network-vif-deleted", "tag": "d0935e96-259f-4617-85cd-eac52e8c9e52"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:26.724030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ee49f5aa-76b7-44dc-9a78-8f5d0faf367e req-ba6a3190-7e2d-460f-bfb2-6323f678925b service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.724523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ee49f5aa-76b7-44dc-9a78-8f5d0faf367e req-ba6a3190-7e2d-460f-bfb2-6323f678925b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.725237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ee49f5aa-76b7-44dc-9a78-8f5d0faf367e req-ba6a3190-7e2d-460f-bfb2-6323f678925b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.738833 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-ee49f5aa-76b7-44dc-9a78-8f5d0faf367e req-ba6a3190-7e2d-460f-bfb2-6323f678925b service nova] Creating event network-vif-deleted:d0935e96-259f-4617-85cd-eac52e8c9e52 for instance 090f4719-1122-427c-b849-7c1865ac1ff5 on n-h2-860282-1 Oct 04 21:31:26.743805 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-ee49f5aa-76b7-44dc-9a78-8f5d0faf367e req-ba6a3190-7e2d-460f-bfb2-6323f678925b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034505 Oct 04 21:31:26.744412 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2565/5156] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:26.750086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0f727e5a-e311-4c67-b725-e827201cce10 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:26.751013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0f727e5a-e311-4c67-b725-e827201cce10 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:26.757213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f727e5a-e311-4c67-b725-e827201cce10 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.757752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f727e5a-e311-4c67-b725-e827201cce10 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.758443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f727e5a-e311-4c67-b725-e827201cce10 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.759342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f727e5a-e311-4c67-b725-e827201cce10 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.759811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f727e5a-e311-4c67-b725-e827201cce10 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.761393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0f727e5a-e311-4c67-b725-e827201cce10 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.963659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-157819e6-32bb-4321-8e40-ae36775f980b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:26.973200 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-157819e6-32bb-4321-8e40-ae36775f980b tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/e0246d29-9597-4269-a64b-6daf8bf0cd8f" status: 200 len: 1511 microversion: 2.1 time: 0.355966 Oct 04 21:31:26.973838 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2592/5157] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:26 2022] GET /compute/v2.1/servers/e0246d29-9597-4269-a64b-6daf8bf0cd8f => generated 1511 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:26.978953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-70f8e0d1-70c3-42bd-bd56-034fb42b57f0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:26.983750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-70f8e0d1-70c3-42bd-bd56-034fb42b57f0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:26.987929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70f8e0d1-70c3-42bd-bd56-034fb42b57f0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.988844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70f8e0d1-70c3-42bd-bd56-034fb42b57f0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.989294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70f8e0d1-70c3-42bd-bd56-034fb42b57f0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.990036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70f8e0d1-70c3-42bd-bd56-034fb42b57f0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.990499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70f8e0d1-70c3-42bd-bd56-034fb42b57f0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.991120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70f8e0d1-70c3-42bd-bd56-034fb42b57f0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.994159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0f727e5a-e311-4c67-b725-e827201cce10 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:27.003596 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0f727e5a-e311-4c67-b725-e827201cce10 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.257658 Oct 04 21:31:27.018399 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2566/5158] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:26 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:27.024557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6db9357d-b603-478f-9ba1-e52072c478e7 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] Calling method '.version_select at 0x7f5790939310>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:27.068399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-70f8e0d1-70c3-42bd-bd56-034fb42b57f0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:27.077674 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-70f8e0d1-70c3-42bd-bd56-034fb42b57f0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1233 microversion: 2.1 time: 0.102685 Oct 04 21:31:27.078240 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2593/5159] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:26 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1233 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:27.089120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f85335fc-29f8-460b-a7b5-29a0990d73cb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:27.089792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f85335fc-29f8-460b-a7b5-29a0990d73cb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:27.096862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f85335fc-29f8-460b-a7b5-29a0990d73cb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:27.097479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f85335fc-29f8-460b-a7b5-29a0990d73cb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:27.097979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f85335fc-29f8-460b-a7b5-29a0990d73cb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:27.098679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f85335fc-29f8-460b-a7b5-29a0990d73cb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:27.099153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f85335fc-29f8-460b-a7b5-29a0990d73cb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:27.099579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f85335fc-29f8-460b-a7b5-29a0990d73cb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:27.142269 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6db9357d-b603-478f-9ba1-e52072c478e7 tempest-TestNetworkBasicOps-1291671602 tempest-TestNetworkBasicOps-1291671602-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-806395857" status: 202 len: 0 microversion: 2.1 time: 0.122490 Oct 04 21:31:27.142869 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2567/5160] 10.222.0.30 () {58 vars in 1254 bytes} [Tue Oct 4 21:31:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-806395857 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:31:27.254084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f85335fc-29f8-460b-a7b5-29a0990d73cb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:27.262608 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f85335fc-29f8-460b-a7b5-29a0990d73cb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.183205 Oct 04 21:31:27.268112 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2594/5161] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:27 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:27.288768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5ae47279-7a7f-487a-abf8-3788b34da740 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-352041202_updated"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:27.291185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5ae47279-7a7f-487a-abf8-3788b34da740 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 627adc8c-1292-4cb3-9c48-6868954a71dd] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:27.299441 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-5ae47279-7a7f-487a-abf8-3788b34da740 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance 627adc8c-1292-4cb3-9c48-6868954a71dd could not be found. Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5ae47279-7a7f-487a-abf8-3788b34da740 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: request: PUT /compute/v2.1/servers/627adc8c-1292-4cb3-9c48-6868954a71dd HTTP/1.1 Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 80 Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-352041202_updated"}} Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 627adc8c-1292-4cb3-9c48-6868954a71dd could not be found. Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '627adc8c-1292-4cb3-9c48-6868954a71dd', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-352041202_updated'}}} Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 627adc8c-1292-4cb3-9c48-6868954a71dd could not be found. Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 21:31:27.301237 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:31:27.306969 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:31:27.306969 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:27.306969 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:27.306969 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 627adc8c-1292-4cb3-9c48-6868954a71dd could not be found. Oct 04 21:31:27.306969 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:27.306969 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:27.306969 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:27.306969 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:27.306969 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:27.306969 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:27.306969 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:27.306969 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:27.306969 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 627adc8c-1292-4cb3-9c48-6868954a71dd could not be found. Oct 04 21:31:27.306969 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:27.306969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5ae47279-7a7f-487a-abf8-3788b34da740 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance 627adc8c-1292-4cb3-9c48-6868954a71dd could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:27.306969 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5ae47279-7a7f-487a-abf8-3788b34da740 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "PUT /compute/v2.1/servers/627adc8c-1292-4cb3-9c48-6868954a71dd" status: 404 len: 111 microversion: 2.1 time: 0.018272 Oct 04 21:31:27.312302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2a53b860-5405-4447-89c6-5d4d4f1a3ac7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:27.313515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2a53b860-5405-4447-89c6-5d4d4f1a3ac7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:27.319937 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2568/5162] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Oct 4 21:31:27 2022] PUT /compute/v2.1/servers/627adc8c-1292-4cb3-9c48-6868954a71dd => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:31:27.320167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a53b860-5405-4447-89c6-5d4d4f1a3ac7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:27.320167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a53b860-5405-4447-89c6-5d4d4f1a3ac7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:27.320167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a53b860-5405-4447-89c6-5d4d4f1a3ac7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:27.320520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a53b860-5405-4447-89c6-5d4d4f1a3ac7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:27.320835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a53b860-5405-4447-89c6-5d4d4f1a3ac7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:27.321265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a53b860-5405-4447-89c6-5d4d4f1a3ac7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:27.340742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:27.468323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2a53b860-5405-4447-89c6-5d4d4f1a3ac7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:27.477719 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2a53b860-5405-4447-89c6-5d4d4f1a3ac7 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.169917 Oct 04 21:31:27.478480 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2595/5163] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:27 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:27.503632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8c263e47-2783-45c0-aef5-823f5d4015a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:27.504440 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8c263e47-2783-45c0-aef5-823f5d4015a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:27.507633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:27.511308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c263e47-2783-45c0-aef5-823f5d4015a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:27.511859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c263e47-2783-45c0-aef5-823f5d4015a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:27.512437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c263e47-2783-45c0-aef5-823f5d4015a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:27.513154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c263e47-2783-45c0-aef5-823f5d4015a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:27.513749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c263e47-2783-45c0-aef5-823f5d4015a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:27.514189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c263e47-2783-45c0-aef5-823f5d4015a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:27.675932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c8505e51-90ab-4ecc-a82d-e462430907d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:27.676404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c8505e51-90ab-4ecc-a82d-e462430907d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:27.678525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=16 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:27.680126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8c263e47-2783-45c0-aef5-823f5d4015a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:27.686261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8505e51-90ab-4ecc-a82d-e462430907d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:27.688689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8505e51-90ab-4ecc-a82d-e462430907d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:27.688689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8505e51-90ab-4ecc-a82d-e462430907d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:27.688689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8505e51-90ab-4ecc-a82d-e462430907d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:27.689242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8505e51-90ab-4ecc-a82d-e462430907d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:27.689951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8505e51-90ab-4ecc-a82d-e462430907d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:27.691422 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8c263e47-2783-45c0-aef5-823f5d4015a0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.191530 Oct 04 21:31:27.695717 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2569/5164] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:27 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:27.718399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-425c910e-65cf-4833-859f-eb7fc7837950 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-425c910e-65cf-4833-859f-eb7fc7837950 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: request: PUT /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 HTTP/1.1 Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 280 Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '144fff2d-9df3-4a93-833f-7f76acc85185', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:27.722961 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-425c910e-65cf-4833-859f-eb7fc7837950 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-425c910e-65cf-4833-859f-eb7fc7837950 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "PUT /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 400 len: 619 microversion: 2.1 time: 0.013870 Oct 04 21:31:27.740454 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2570/5165] 10.222.0.30 () {60 vars in 1257 bytes} [Tue Oct 4 21:31:27 2022] PUT /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:31:27.754611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-17c925ee-5d16-4c0a-a02e-c1049bd90abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:27.755204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-17c925ee-5d16-4c0a-a02e-c1049bd90abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:27.762981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17c925ee-5d16-4c0a-a02e-c1049bd90abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:27.763784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17c925ee-5d16-4c0a-a02e-c1049bd90abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:27.764809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17c925ee-5d16-4c0a-a02e-c1049bd90abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:27.765788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17c925ee-5d16-4c0a-a02e-c1049bd90abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:27.766418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17c925ee-5d16-4c0a-a02e-c1049bd90abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:27.767020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17c925ee-5d16-4c0a-a02e-c1049bd90abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:28.066632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c8505e51-90ab-4ecc-a82d-e462430907d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:28.075639 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c8505e51-90ab-4ecc-a82d-e462430907d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 200 len: 1308 microversion: 2.1 time: 0.403355 Oct 04 21:31:28.076534 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2596/5166] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:27 2022] GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 1308 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:28.081798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7b0502d0-8ba1-44b0-a764-408508946ad0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:28.082681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7b0502d0-8ba1-44b0-a764-408508946ad0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: e0246d29-9597-4269-a64b-6daf8bf0cd8f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:28.093578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-17c925ee-5d16-4c0a-a02e-c1049bd90abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:28.097283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b0502d0-8ba1-44b0-a764-408508946ad0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:28.097283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b0502d0-8ba1-44b0-a764-408508946ad0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:28.097283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b0502d0-8ba1-44b0-a764-408508946ad0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:28.097283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b0502d0-8ba1-44b0-a764-408508946ad0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:28.098346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b0502d0-8ba1-44b0-a764-408508946ad0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:28.098981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b0502d0-8ba1-44b0-a764-408508946ad0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:28.104780 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-17c925ee-5d16-4c0a-a02e-c1049bd90abe tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.357052 Oct 04 21:31:28.105377 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2571/5167] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:27 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:28.130564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-861c8bd9-2d83-44c5-85d0-ff1cbba1ede1 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:28.135512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-861c8bd9-2d83-44c5-85d0-ff1cbba1ede1 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:28.138198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-861c8bd9-2d83-44c5-85d0-ff1cbba1ede1 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:28.138968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-861c8bd9-2d83-44c5-85d0-ff1cbba1ede1 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:28.139633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-861c8bd9-2d83-44c5-85d0-ff1cbba1ede1 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:28.140560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-861c8bd9-2d83-44c5-85d0-ff1cbba1ede1 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:28.141280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-861c8bd9-2d83-44c5-85d0-ff1cbba1ede1 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:28.141981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-861c8bd9-2d83-44c5-85d0-ff1cbba1ede1 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:28.338518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-861c8bd9-2d83-44c5-85d0-ff1cbba1ede1 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:28.342078 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-861c8bd9-2d83-44c5-85d0-ff1cbba1ede1 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1289 microversion: 2.1 time: 0.219190 Oct 04 21:31:28.354414 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2572/5168] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:28 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1289 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:28.363607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ac52abda-bd5d-4064-8e0f-dab5dc2e2ceb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:28.364533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ac52abda-bd5d-4064-8e0f-dab5dc2e2ceb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:28.372912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac52abda-bd5d-4064-8e0f-dab5dc2e2ceb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:28.373706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac52abda-bd5d-4064-8e0f-dab5dc2e2ceb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:28.374317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac52abda-bd5d-4064-8e0f-dab5dc2e2ceb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:28.375202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac52abda-bd5d-4064-8e0f-dab5dc2e2ceb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:28.376034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac52abda-bd5d-4064-8e0f-dab5dc2e2ceb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:28.376643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac52abda-bd5d-4064-8e0f-dab5dc2e2ceb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:28.704523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7b0502d0-8ba1-44b0-a764-408508946ad0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:28.732706 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7b0502d0-8ba1-44b0-a764-408508946ad0 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/e0246d29-9597-4269-a64b-6daf8bf0cd8f" status: 200 len: 1511 microversion: 2.1 time: 0.654543 Oct 04 21:31:28.734285 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2597/5169] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:28 2022] GET /compute/v2.1/servers/e0246d29-9597-4269-a64b-6daf8bf0cd8f => generated 1511 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:28.817741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ac52abda-bd5d-4064-8e0f-dab5dc2e2ceb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:28.827995 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ac52abda-bd5d-4064-8e0f-dab5dc2e2ceb tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.472191 Oct 04 21:31:28.858551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2e1e01ae-1736-4a1c-ba65-81ac08acd0c0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2e1e01ae-1736-4a1c-ba65-81ac08acd0c0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: request: PUT /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 HTTP/1.1 Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 24 Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: {"server": {"name": ""}} Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '144fff2d-9df3-4a93-833f-7f76acc85185', 'body': {'server': {'name': ''}}} Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi '' Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:31:28.862978 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:31:28.868749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:31:28.868749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:28.868749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:28.868749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:28.868749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:28.868749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:28.868749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:28.868749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:31:28.868749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:31:28.868749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:31:28.868749 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:28.875222 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2573/5170] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:28 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:28.876367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2e1e01ae-1736-4a1c-ba65-81ac08acd0c0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:28.877472 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2e1e01ae-1736-4a1c-ba65-81ac08acd0c0 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "PUT /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 400 len: 108 microversion: 2.1 time: 0.026068 Oct 04 21:31:28.884011 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2598/5171] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Oct 4 21:31:28 2022] PUT /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 108 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:31:28.890292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-adb694a3-9315-4bee-86a5-f9c84cb87d86 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:28.890292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-adb694a3-9315-4bee-86a5-f9c84cb87d86 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:28.904968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adb694a3-9315-4bee-86a5-f9c84cb87d86 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:28.905862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adb694a3-9315-4bee-86a5-f9c84cb87d86 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:28.906580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adb694a3-9315-4bee-86a5-f9c84cb87d86 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:28.907521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adb694a3-9315-4bee-86a5-f9c84cb87d86 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:28.908200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adb694a3-9315-4bee-86a5-f9c84cb87d86 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:28.908627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adb694a3-9315-4bee-86a5-f9c84cb87d86 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:29.100464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2934865a-4c99-4dc5-b1db-00395f6b020b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:29.101811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2934865a-4c99-4dc5-b1db-00395f6b020b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:29.124019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2934865a-4c99-4dc5-b1db-00395f6b020b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:29.124724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2934865a-4c99-4dc5-b1db-00395f6b020b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:29.125186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2934865a-4c99-4dc5-b1db-00395f6b020b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:29.126505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2934865a-4c99-4dc5-b1db-00395f6b020b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:29.130639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2934865a-4c99-4dc5-b1db-00395f6b020b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:29.131341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2934865a-4c99-4dc5-b1db-00395f6b020b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:29.415738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-adb694a3-9315-4bee-86a5-f9c84cb87d86 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:29.436385 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-adb694a3-9315-4bee-86a5-f9c84cb87d86 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1506 microversion: 2.1 time: 0.553251 Oct 04 21:31:29.437788 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2574/5172] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:28 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:29.443995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ca9f2456-4ca3-4893-b1ae-7b03078a763e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:29.451608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ca9f2456-4ca3-4893-b1ae-7b03078a763e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:29.458945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca9f2456-4ca3-4893-b1ae-7b03078a763e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:29.459728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca9f2456-4ca3-4893-b1ae-7b03078a763e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:29.463329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca9f2456-4ca3-4893-b1ae-7b03078a763e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:29.466468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca9f2456-4ca3-4893-b1ae-7b03078a763e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:29.470148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca9f2456-4ca3-4893-b1ae-7b03078a763e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:29.471736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca9f2456-4ca3-4893-b1ae-7b03078a763e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:29.481263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:29.663451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ca9f2456-4ca3-4893-b1ae-7b03078a763e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:29.676360 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ca9f2456-4ca3-4893-b1ae-7b03078a763e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1295 microversion: 2.1 time: 0.237079 Oct 04 21:31:29.676966 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2575/5173] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:29 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1295 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:29.690416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-fa5137eb-de08-44bb-86a5-7da2f55f5aa4 req-f37f6ca2-551d-432a-b4d5-b8986fd2531e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0246d29-9597-4269-a64b-6daf8bf0cd8f", "name": "network-vif-deleted", "tag": "06396457-8e5a-4a64-9577-be563f077dc8"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:29.709818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2934865a-4c99-4dc5-b1db-00395f6b020b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:29.712829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-fa5137eb-de08-44bb-86a5-7da2f55f5aa4 req-f37f6ca2-551d-432a-b4d5-b8986fd2531e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:29.713407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-fa5137eb-de08-44bb-86a5-7da2f55f5aa4 req-f37f6ca2-551d-432a-b4d5-b8986fd2531e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:29.714343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-fa5137eb-de08-44bb-86a5-7da2f55f5aa4 req-f37f6ca2-551d-432a-b4d5-b8986fd2531e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:29.721185 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2934865a-4c99-4dc5-b1db-00395f6b020b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 200 len: 1308 microversion: 2.1 time: 0.624641 Oct 04 21:31:29.725898 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2599/5174] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:29 2022] GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 1308 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:29.742897 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-fa5137eb-de08-44bb-86a5-7da2f55f5aa4 req-f37f6ca2-551d-432a-b4d5-b8986fd2531e service nova] Creating event network-vif-deleted:06396457-8e5a-4a64-9577-be563f077dc8 for instance e0246d29-9597-4269-a64b-6daf8bf0cd8f on n-h1-860282-1 Oct 04 21:31:29.750766 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-fa5137eb-de08-44bb-86a5-7da2f55f5aa4 req-f37f6ca2-551d-432a-b4d5-b8986fd2531e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071930 Oct 04 21:31:29.751866 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2576/5175] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:29.763984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8ae4f5bc-f075-4ea6-8fef-017f46db2997 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:29.764822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8ae4f5bc-f075-4ea6-8fef-017f46db2997 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: e0246d29-9597-4269-a64b-6daf8bf0cd8f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:29.773200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ae4f5bc-f075-4ea6-8fef-017f46db2997 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:29.774427 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ae4f5bc-f075-4ea6-8fef-017f46db2997 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:29.781508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ae4f5bc-f075-4ea6-8fef-017f46db2997 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:29.781508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ae4f5bc-f075-4ea6-8fef-017f46db2997 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:29.781508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ae4f5bc-f075-4ea6-8fef-017f46db2997 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:29.781508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ae4f5bc-f075-4ea6-8fef-017f46db2997 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:30.335899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-a4766a1a-3096-4fa3-bf2c-8aa038b2442c req-83c1da92-4dbd-4b73-8fd1-7630f0c6a008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03", "name": "network-vif-deleted", "tag": "5985f943-f63c-4483-8bee-3953653e940f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:30.346244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8ae4f5bc-f075-4ea6-8fef-017f46db2997 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:30.358841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a4766a1a-3096-4fa3-bf2c-8aa038b2442c req-83c1da92-4dbd-4b73-8fd1-7630f0c6a008 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:30.359708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a4766a1a-3096-4fa3-bf2c-8aa038b2442c req-83c1da92-4dbd-4b73-8fd1-7630f0c6a008 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:30.360382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a4766a1a-3096-4fa3-bf2c-8aa038b2442c req-83c1da92-4dbd-4b73-8fd1-7630f0c6a008 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:30.362530 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8ae4f5bc-f075-4ea6-8fef-017f46db2997 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/e0246d29-9597-4269-a64b-6daf8bf0cd8f" status: 200 len: 1469 microversion: 2.1 time: 0.605179 Oct 04 21:31:30.363430 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2600/5176] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:29 2022] GET /compute/v2.1/servers/e0246d29-9597-4269-a64b-6daf8bf0cd8f => generated 1469 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:30.386055 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-a4766a1a-3096-4fa3-bf2c-8aa038b2442c req-83c1da92-4dbd-4b73-8fd1-7630f0c6a008 service nova] Creating event network-vif-deleted:5985f943-f63c-4483-8bee-3953653e940f for instance 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 on n-h2-860282-1 Oct 04 21:31:30.399464 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-a4766a1a-3096-4fa3-bf2c-8aa038b2442c req-83c1da92-4dbd-4b73-8fd1-7630f0c6a008 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068156 Oct 04 21:31:30.401949 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2577/5177] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:31:30.704374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f4dac707-345f-4c11-a1d6-81b6a5475f78 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:30.704908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f4dac707-345f-4c11-a1d6-81b6a5475f78 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:30.717839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4dac707-345f-4c11-a1d6-81b6a5475f78 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:30.719108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4dac707-345f-4c11-a1d6-81b6a5475f78 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:30.719829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4dac707-345f-4c11-a1d6-81b6a5475f78 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:30.720763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4dac707-345f-4c11-a1d6-81b6a5475f78 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:30.721452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4dac707-345f-4c11-a1d6-81b6a5475f78 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:30.722151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4dac707-345f-4c11-a1d6-81b6a5475f78 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:30.749284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a34eb385-3a16-4e6b-a548-4c2022a3a95e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:30.750448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a34eb385-3a16-4e6b-a548-4c2022a3a95e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:30.760796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a34eb385-3a16-4e6b-a548-4c2022a3a95e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:30.766747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a34eb385-3a16-4e6b-a548-4c2022a3a95e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:30.767431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a34eb385-3a16-4e6b-a548-4c2022a3a95e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:30.768212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a34eb385-3a16-4e6b-a548-4c2022a3a95e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:30.768799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a34eb385-3a16-4e6b-a548-4c2022a3a95e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:30.769479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a34eb385-3a16-4e6b-a548-4c2022a3a95e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:30.838706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f4dac707-345f-4c11-a1d6-81b6a5475f78 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:30.856403 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f4dac707-345f-4c11-a1d6-81b6a5475f78 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1295 microversion: 2.1 time: 0.156408 Oct 04 21:31:30.862637 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2601/5178] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:30 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1295 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:31.061900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-3b9084c2-877e-4507-a5f2-352dc21b15f7 req-a885cb21-9906-496c-bc54-55feff2d72a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad0bd930-32ff-4587-8b22-bb47d1fe061d", "name": "network-vif-plugged", "status": "completed", "tag": "6a83316d-6559-4953-9aeb-d55e81ed0229"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:31.103539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3b9084c2-877e-4507-a5f2-352dc21b15f7 req-a885cb21-9906-496c-bc54-55feff2d72a9 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:31.104413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3b9084c2-877e-4507-a5f2-352dc21b15f7 req-a885cb21-9906-496c-bc54-55feff2d72a9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:31.108887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3b9084c2-877e-4507-a5f2-352dc21b15f7 req-a885cb21-9906-496c-bc54-55feff2d72a9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:31.124347 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-3b9084c2-877e-4507-a5f2-352dc21b15f7 req-a885cb21-9906-496c-bc54-55feff2d72a9 service nova] Creating event network-vif-plugged:6a83316d-6559-4953-9aeb-d55e81ed0229 for instance ad0bd930-32ff-4587-8b22-bb47d1fe061d on n-h1-860282-1 Oct 04 21:31:31.131618 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-3b9084c2-877e-4507-a5f2-352dc21b15f7 req-a885cb21-9906-496c-bc54-55feff2d72a9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266401 Oct 04 21:31:31.132510 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2602/5179] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:31.375843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a34eb385-3a16-4e6b-a548-4c2022a3a95e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:31.391787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e06818dd-9d13-41e6-8d6c-8aa2390ef60c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:31.392019 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a34eb385-3a16-4e6b-a548-4c2022a3a95e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 200 len: 1308 microversion: 2.1 time: 0.647457 Oct 04 21:31:31.392494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e06818dd-9d13-41e6-8d6c-8aa2390ef60c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: e0246d29-9597-4269-a64b-6daf8bf0cd8f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:31.392875 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2578/5180] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:30 2022] GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 1308 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:31.407061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e06818dd-9d13-41e6-8d6c-8aa2390ef60c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:31.407828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e06818dd-9d13-41e6-8d6c-8aa2390ef60c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:31.408523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e06818dd-9d13-41e6-8d6c-8aa2390ef60c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:31.415741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e06818dd-9d13-41e6-8d6c-8aa2390ef60c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:31.415741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e06818dd-9d13-41e6-8d6c-8aa2390ef60c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:31.415741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e06818dd-9d13-41e6-8d6c-8aa2390ef60c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:31.454301 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-e06818dd-9d13-41e6-8d6c-8aa2390ef60c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] HTTP exception thrown: Instance e0246d29-9597-4269-a64b-6daf8bf0cd8f could not be found. Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e06818dd-9d13-41e6-8d6c-8aa2390ef60c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Request method failure captured: Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/e0246d29-9597-4269-a64b-6daf8bf0cd8f HTTP/1.1 Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKX0b2FKXIeDAJTXM7UR2fzCfzW0KYc3FYaKMiZFhp1LcFwT1cL3Smxau_FooMvmCduNSPEXtczhW1luTUervei_Nl799L1Zd1oAoteihlnJvGh-E1Jhjxkv0EJihPYB1qw0soO21zaP2-a63DwjiLNXGOyO2ucMW9B3DUvp8SqOlGs Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 12da8c6a64ae484bb779149dca92d2e7 Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-MultipleCreateTestJSON-1293522574 Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/12da8c6a64ae484bb779149dca92d2e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_12da8c6a64ae484bb779149dca92d2e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/12da8c6a64ae484bb779149dca92d2e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/12da8c6a64ae484bb779149dca92d2e7"}]}] Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-MultipleCreateTestJSON-1293522574 Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 12da8c6a64ae484bb779149dca92d2e7 Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1293522574 Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-MultipleCreateTestJSON-1293522574-project Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: e3789d0f886643fb849af4f51838af4d Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-MultipleCreateTestJSON-1293522574-project Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance e0246d29-9597-4269-a64b-6daf8bf0cd8f could not be found. Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'e0246d29-9597-4269-a64b-6daf8bf0cd8f'} Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0246d29-9597-4269-a64b-6daf8bf0cd8f could not be found. Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0246d29-9597-4269-a64b-6daf8bf0cd8f could not be found. Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:31.457033 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:31.462442 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:31.462442 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:31.462442 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:31.462442 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:31.462442 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:31.462442 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0246d29-9597-4269-a64b-6daf8bf0cd8f could not be found. Oct 04 21:31:31.462442 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:31.463936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e06818dd-9d13-41e6-8d6c-8aa2390ef60c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Returning 404 to user: Instance e0246d29-9597-4269-a64b-6daf8bf0cd8f could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:31.468749 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e06818dd-9d13-41e6-8d6c-8aa2390ef60c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/e0246d29-9597-4269-a64b-6daf8bf0cd8f" status: 404 len: 111 microversion: 2.1 time: 0.081877 Oct 04 21:31:31.469545 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2603/5181] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:31 2022] GET /compute/v2.1/servers/e0246d29-9597-4269-a64b-6daf8bf0cd8f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:31:31.478382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-feb712df-97e4-4b1b-922c-d877e6d98e9c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:31.479805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-feb712df-97e4-4b1b-922c-d877e6d98e9c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:31.486512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feb712df-97e4-4b1b-922c-d877e6d98e9c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:31.487352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feb712df-97e4-4b1b-922c-d877e6d98e9c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:31.487992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feb712df-97e4-4b1b-922c-d877e6d98e9c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:31.488897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feb712df-97e4-4b1b-922c-d877e6d98e9c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:31.489564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feb712df-97e4-4b1b-922c-d877e6d98e9c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:31.490512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feb712df-97e4-4b1b-922c-d877e6d98e9c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:31.585985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feb712df-97e4-4b1b-922c-d877e6d98e9c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:31.586484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feb712df-97e4-4b1b-922c-d877e6d98e9c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:31.586933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feb712df-97e4-4b1b-922c-d877e6d98e9c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:31.587399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-feb712df-97e4-4b1b-922c-d877e6d98e9c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lazy-loading 'fault' on Instance uuid 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:31:31.680240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-feb712df-97e4-4b1b-922c-d877e6d98e9c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3789d0f886643fb849af4f51838af4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da8c6a64ae484bb779149dca92d2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:31.690423 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-feb712df-97e4-4b1b-922c-d877e6d98e9c tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03" status: 200 len: 1307 microversion: 2.1 time: 0.216605 Oct 04 21:31:31.695559 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2579/5182] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:31 2022] GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 => generated 1307 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:31.911087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a32c458e-b33e-46d3-8704-0095d1a61a3f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:31.912584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a32c458e-b33e-46d3-8704-0095d1a61a3f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:31.935591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a32c458e-b33e-46d3-8704-0095d1a61a3f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:31.936600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a32c458e-b33e-46d3-8704-0095d1a61a3f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:31.938304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a32c458e-b33e-46d3-8704-0095d1a61a3f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:31.941128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a32c458e-b33e-46d3-8704-0095d1a61a3f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:31.941836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a32c458e-b33e-46d3-8704-0095d1a61a3f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:31.942465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a32c458e-b33e-46d3-8704-0095d1a61a3f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:32.424212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2fc837f1-5a28-4d3e-b254-83c896153fa1 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:32.426644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2fc837f1-5a28-4d3e-b254-83c896153fa1 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:32.432626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a32c458e-b33e-46d3-8704-0095d1a61a3f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:32.443240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fc837f1-5a28-4d3e-b254-83c896153fa1 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:32.445549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fc837f1-5a28-4d3e-b254-83c896153fa1 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:32.446113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fc837f1-5a28-4d3e-b254-83c896153fa1 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:32.446853 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a32c458e-b33e-46d3-8704-0095d1a61a3f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1362 microversion: 2.1 time: 0.543780 Oct 04 21:31:32.448966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fc837f1-5a28-4d3e-b254-83c896153fa1 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:32.450648 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2604/5183] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:31 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1362 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:32.452634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fc837f1-5a28-4d3e-b254-83c896153fa1 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:32.454007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fc837f1-5a28-4d3e-b254-83c896153fa1 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:32.719596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-63e55e7b-ee6f-4bae-9a4c-5938e18dd041 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:32.720227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-63e55e7b-ee6f-4bae-9a4c-5938e18dd041 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] [instance: 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:32.728665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63e55e7b-ee6f-4bae-9a4c-5938e18dd041 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:32.729167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63e55e7b-ee6f-4bae-9a4c-5938e18dd041 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:32.729661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63e55e7b-ee6f-4bae-9a4c-5938e18dd041 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:32.730979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63e55e7b-ee6f-4bae-9a4c-5938e18dd041 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:32.731551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63e55e7b-ee6f-4bae-9a4c-5938e18dd041 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:32.738194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63e55e7b-ee6f-4bae-9a4c-5938e18dd041 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-63e55e7b-ee6f-4bae-9a4c-5938e18dd041 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] HTTP exception thrown: Instance 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 could not be found. Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-63e55e7b-ee6f-4bae-9a4c-5938e18dd041 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Request method failure captured: Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 HTTP/1.1 Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKX0b2FKXIeDAJTXM7UR2fzCfzW0KYc3FYaKMiZFhp1LcFwT1cL3Smxau_FooMvmCduNSPEXtczhW1luTUervei_Nl799L1Zd1oAoteihlnJvGh-E1Jhjxkv0EJihPYB1qw0soO21zaP2-a63DwjiLNXGOyO2ucMW9B3DUvp8SqOlGs Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 12da8c6a64ae484bb779149dca92d2e7 Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-MultipleCreateTestJSON-1293522574 Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/12da8c6a64ae484bb779149dca92d2e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_12da8c6a64ae484bb779149dca92d2e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/12da8c6a64ae484bb779149dca92d2e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/12da8c6a64ae484bb779149dca92d2e7"}]}] Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-MultipleCreateTestJSON-1293522574 Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 12da8c6a64ae484bb779149dca92d2e7 Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1293522574 Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-MultipleCreateTestJSON-1293522574-project Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: e3789d0f886643fb849af4f51838af4d Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-MultipleCreateTestJSON-1293522574-project Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 could not be found. Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03'} Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 could not be found. Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:32.777918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:32.783735 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 could not be found. Oct 04 21:31:32.783735 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:32.783735 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:32.783735 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:32.783735 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:32.783735 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:32.783735 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:32.783735 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:32.783735 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:32.783735 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 could not be found. Oct 04 21:31:32.783735 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:32.783735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-63e55e7b-ee6f-4bae-9a4c-5938e18dd041 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] Returning 404 to user: Instance 9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:32.786446 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-63e55e7b-ee6f-4bae-9a4c-5938e18dd041 tempest-MultipleCreateTestJSON-1293522574 tempest-MultipleCreateTestJSON-1293522574-project] 10.222.0.30 "GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03" status: 404 len: 111 microversion: 2.1 time: 0.071708 Oct 04 21:31:32.787338 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2605/5184] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:32 2022] GET /compute/v2.1/servers/9c7a5262-f2c5-4d6d-8eba-b6b802fd6d03 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:31:32.798699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2fc837f1-5a28-4d3e-b254-83c896153fa1 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:32.806337 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2fc837f1-5a28-4d3e-b254-83c896153fa1 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 200 len: 1308 microversion: 2.1 time: 0.386542 Oct 04 21:31:32.806936 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2580/5185] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:32 2022] GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 1308 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:33.483477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0d93efd9-f393-4d7c-9254-ebf659f74140 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:33.484847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0d93efd9-f393-4d7c-9254-ebf659f74140 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:33.513276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d93efd9-f393-4d7c-9254-ebf659f74140 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:33.513761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d93efd9-f393-4d7c-9254-ebf659f74140 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:33.514465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d93efd9-f393-4d7c-9254-ebf659f74140 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:33.515404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d93efd9-f393-4d7c-9254-ebf659f74140 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:33.516038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d93efd9-f393-4d7c-9254-ebf659f74140 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:33.516659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d93efd9-f393-4d7c-9254-ebf659f74140 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:33.762808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0d93efd9-f393-4d7c-9254-ebf659f74140 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:33.775719 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0d93efd9-f393-4d7c-9254-ebf659f74140 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1362 microversion: 2.1 time: 0.298537 Oct 04 21:31:33.775719 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2606/5186] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:33 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:33.831021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa23ff50-0cf0-4800-b8ff-620546d87737 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:33.831686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aa23ff50-0cf0-4800-b8ff-620546d87737 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:33.843693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:33.848981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa23ff50-0cf0-4800-b8ff-620546d87737 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:33.851136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa23ff50-0cf0-4800-b8ff-620546d87737 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:33.851599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa23ff50-0cf0-4800-b8ff-620546d87737 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:33.852338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa23ff50-0cf0-4800-b8ff-620546d87737 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:33.852809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa23ff50-0cf0-4800-b8ff-620546d87737 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:33.853247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa23ff50-0cf0-4800-b8ff-620546d87737 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:33.876747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-38d3c851-fc30-49cc-8309-bd6249dd667f req-835c9805-1da2-4bd9-b4cb-936d075fc5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f195f612-8d0d-42b7-bd89-5e30477023b4", "tag": "d42dda8d-a200-41b6-945b-9fd7ce65af56"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:33.897686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-38d3c851-fc30-49cc-8309-bd6249dd667f req-835c9805-1da2-4bd9-b4cb-936d075fc5d1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:33.898719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-38d3c851-fc30-49cc-8309-bd6249dd667f req-835c9805-1da2-4bd9-b4cb-936d075fc5d1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:33.899696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-38d3c851-fc30-49cc-8309-bd6249dd667f req-835c9805-1da2-4bd9-b4cb-936d075fc5d1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:33.925162 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-38d3c851-fc30-49cc-8309-bd6249dd667f req-835c9805-1da2-4bd9-b4cb-936d075fc5d1 service nova] Creating event network-changed:d42dda8d-a200-41b6-945b-9fd7ce65af56 for instance f195f612-8d0d-42b7-bd89-5e30477023b4 on n-h2-860282-1 Oct 04 21:31:33.942353 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-38d3c851-fc30-49cc-8309-bd6249dd667f req-835c9805-1da2-4bd9-b4cb-936d075fc5d1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069248 Oct 04 21:31:33.943377 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2607/5187] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:34.227584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aa23ff50-0cf0-4800-b8ff-620546d87737 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:34.256533 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aa23ff50-0cf0-4800-b8ff-620546d87737 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 200 len: 1488 microversion: 2.1 time: 0.430584 Oct 04 21:31:34.259351 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2581/5188] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:33 2022] GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 1488 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:34.485469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ec9ce9fd-5d69-45c4-a338-e3d430670dbb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-832375398", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "f9328395-b63c-4f5a-9d32-23fa7cfe6c6d"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:34.613776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-ec9ce9fd-5d69-45c4-a338-e3d430670dbb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] validate_networks() for [('f9328395-b63c-4f5a-9d32-23fa7cfe6c6d', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:31:34.799574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9743c4d6-d9f9-4937-904a-8d502773fd0c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:34.800499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9743c4d6-d9f9-4937-904a-8d502773fd0c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:34.807677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9743c4d6-d9f9-4937-904a-8d502773fd0c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:34.808464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9743c4d6-d9f9-4937-904a-8d502773fd0c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:34.809122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9743c4d6-d9f9-4937-904a-8d502773fd0c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:34.810352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9743c4d6-d9f9-4937-904a-8d502773fd0c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:34.811014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9743c4d6-d9f9-4937-904a-8d502773fd0c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:34.811958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9743c4d6-d9f9-4937-904a-8d502773fd0c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:35.550282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9743c4d6-d9f9-4937-904a-8d502773fd0c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:35.571942 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9743c4d6-d9f9-4937-904a-8d502773fd0c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1362 microversion: 2.1 time: 0.766259 Oct 04 21:31:35.572929 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2582/5189] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:34 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1362 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:35.854101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ec9ce9fd-5d69-45c4-a338-e3d430670dbb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:31:35.855161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ec9ce9fd-5d69-45c4-a338-e3d430670dbb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:31:35.856513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ec9ce9fd-5d69-45c4-a338-e3d430670dbb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:31:35.857131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ec9ce9fd-5d69-45c4-a338-e3d430670dbb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:31:35.857818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ec9ce9fd-5d69-45c4-a338-e3d430670dbb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:31:35.875858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec9ce9fd-5d69-45c4-a338-e3d430670dbb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:35.885831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec9ce9fd-5d69-45c4-a338-e3d430670dbb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:35.885831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec9ce9fd-5d69-45c4-a338-e3d430670dbb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:35.885831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec9ce9fd-5d69-45c4-a338-e3d430670dbb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:35.885831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec9ce9fd-5d69-45c4-a338-e3d430670dbb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:35.885831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ec9ce9fd-5d69-45c4-a338-e3d430670dbb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:35.963625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-ec9ce9fd-5d69-45c4-a338-e3d430670dbb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Getting quotas for project fde68efb46fc44b5b0d83138b9048f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:31:36.009932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-ec9ce9fd-5d69-45c4-a338-e3d430670dbb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Getting quotas for user b9289c5fa9844ae3bb1c797bdab5c56c and project fde68efb46fc44b5b0d83138b9048f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:31:36.051341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ec9ce9fd-5d69-45c4-a338-e3d430670dbb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:31:36.053879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ec9ce9fd-5d69-45c4-a338-e3d430670dbb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:31:36.200723 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ec9ce9fd-5d69-45c4-a338-e3d430670dbb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.719324 Oct 04 21:31:36.202023 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2608/5190] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:31:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:31:36.213030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-069f6c1a-93ee-4791-b3b3-655d51c9c175 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:36.213942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-069f6c1a-93ee-4791-b3b3-655d51c9c175 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:36.221796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=18 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:36.355260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-069f6c1a-93ee-4791-b3b3-655d51c9c175 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:36.365226 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-069f6c1a-93ee-4791-b3b3-655d51c9c175 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 200 len: 1208 microversion: 2.1 time: 0.156229 Oct 04 21:31:36.370053 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2583/5191] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:36 2022] GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 1208 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:36.600204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6aa6d5cd-38a5-4c9d-b53a-81322a5df6d4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:36.601715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6aa6d5cd-38a5-4c9d-b53a-81322a5df6d4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:36.611415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6aa6d5cd-38a5-4c9d-b53a-81322a5df6d4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:36.615485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6aa6d5cd-38a5-4c9d-b53a-81322a5df6d4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:36.616482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6aa6d5cd-38a5-4c9d-b53a-81322a5df6d4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:36.617842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6aa6d5cd-38a5-4c9d-b53a-81322a5df6d4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:36.618568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6aa6d5cd-38a5-4c9d-b53a-81322a5df6d4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:36.619258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6aa6d5cd-38a5-4c9d-b53a-81322a5df6d4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:36.927944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6aa6d5cd-38a5-4c9d-b53a-81322a5df6d4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:36.937089 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6aa6d5cd-38a5-4c9d-b53a-81322a5df6d4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1362 microversion: 2.1 time: 0.344746 Oct 04 21:31:36.943500 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2609/5192] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:36 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1362 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:37.404291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5fc6e2fe-aa12-4e53-8867-c42f7d48c277 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:37.405683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5fc6e2fe-aa12-4e53-8867-c42f7d48c277 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:37.515205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5fc6e2fe-aa12-4e53-8867-c42f7d48c277 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:37.523854 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5fc6e2fe-aa12-4e53-8867-c42f7d48c277 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 200 len: 1208 microversion: 2.1 time: 0.127242 Oct 04 21:31:37.524996 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2584/5193] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:37 2022] GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 1208 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:37.960847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d3502375-164b-4408-8d71-88440b325652 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:37.962374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d3502375-164b-4408-8d71-88440b325652 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:37.979530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3502375-164b-4408-8d71-88440b325652 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:37.989779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3502375-164b-4408-8d71-88440b325652 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:37.992475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3502375-164b-4408-8d71-88440b325652 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:37.993854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3502375-164b-4408-8d71-88440b325652 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:37.994342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3502375-164b-4408-8d71-88440b325652 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:37.998570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3502375-164b-4408-8d71-88440b325652 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:38.393969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d3502375-164b-4408-8d71-88440b325652 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:38.402721 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d3502375-164b-4408-8d71-88440b325652 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1362 microversion: 2.1 time: 0.446064 Oct 04 21:31:38.419768 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2610/5194] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:37 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1362 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:38.550723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3bf983e7-7f5d-44f7-821d-96749378d780 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:38.551880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3bf983e7-7f5d-44f7-821d-96749378d780 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:38.560839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bf983e7-7f5d-44f7-821d-96749378d780 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:38.561716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bf983e7-7f5d-44f7-821d-96749378d780 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:38.562913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bf983e7-7f5d-44f7-821d-96749378d780 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:38.566771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bf983e7-7f5d-44f7-821d-96749378d780 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:38.566771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bf983e7-7f5d-44f7-821d-96749378d780 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:38.566771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bf983e7-7f5d-44f7-821d-96749378d780 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:38.685294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3bf983e7-7f5d-44f7-821d-96749378d780 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:38.685294 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3bf983e7-7f5d-44f7-821d-96749378d780 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 200 len: 1204 microversion: 2.1 time: 0.132592 Oct 04 21:31:38.685294 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2585/5195] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:38 2022] GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 1204 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:39.240748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2098bfd1-d33c-44a0-8d79-48e6a255f843 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:39.242043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2098bfd1-d33c-44a0-8d79-48e6a255f843 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:39.286636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2098bfd1-d33c-44a0-8d79-48e6a255f843 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:39.287461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2098bfd1-d33c-44a0-8d79-48e6a255f843 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:39.288123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2098bfd1-d33c-44a0-8d79-48e6a255f843 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:39.290837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2098bfd1-d33c-44a0-8d79-48e6a255f843 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:39.291548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2098bfd1-d33c-44a0-8d79-48e6a255f843 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:39.292257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2098bfd1-d33c-44a0-8d79-48e6a255f843 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:39.324442 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-2098bfd1-d33c-44a0-8d79-48e6a255f843 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2098bfd1-d33c-44a0-8d79-48e6a255f843 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 HTTP/1.1 Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'ae649a1e-b6ec-4d6c-9584-7738fff25315'} Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:39.330918 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:39.338445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:31:39.338445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:39.338445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:39.338445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:39.338445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:39.338445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:39.338445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:39.338445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:39.338445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:39.338445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:31:39.338445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:39.338445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2098bfd1-d33c-44a0-8d79-48e6a255f843 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:39.338445 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2098bfd1-d33c-44a0-8d79-48e6a255f843 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 404 len: 111 microversion: 2.1 time: 0.096088 Oct 04 21:31:39.338445 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2611/5196] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:31:39 2022] DELETE /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:31:39.342735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9659f6a7-e16f-4f08-894e-fd43d240c039 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:39.342735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9659f6a7-e16f-4f08-894e-fd43d240c039 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: ae649a1e-b6ec-4d6c-9584-7738fff25315] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:39.355545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9659f6a7-e16f-4f08-894e-fd43d240c039 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:39.361053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9659f6a7-e16f-4f08-894e-fd43d240c039 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:39.361053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9659f6a7-e16f-4f08-894e-fd43d240c039 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:39.361053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9659f6a7-e16f-4f08-894e-fd43d240c039 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:39.361053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9659f6a7-e16f-4f08-894e-fd43d240c039 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:39.361053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9659f6a7-e16f-4f08-894e-fd43d240c039 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:39.390620 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-9659f6a7-e16f-4f08-894e-fd43d240c039 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9659f6a7-e16f-4f08-894e-fd43d240c039 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 HTTP/1.1 Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'ae649a1e-b6ec-4d6c-9584-7738fff25315'} Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:39.396912 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:39.407722 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:39.407722 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:39.407722 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:39.407722 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:39.407722 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:39.407722 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. Oct 04 21:31:39.407722 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:31:39.407722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9659f6a7-e16f-4f08-894e-fd43d240c039 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance ae649a1e-b6ec-4d6c-9584-7738fff25315 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:39.407722 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9659f6a7-e16f-4f08-894e-fd43d240c039 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315" status: 404 len: 111 microversion: 2.1 time: 0.061285 Oct 04 21:31:39.407722 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2586/5197] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:39 2022] GET /compute/v2.1/servers/ae649a1e-b6ec-4d6c-9584-7738fff25315 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:31:39.410267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1f82af90-2516-470f-809f-8db9ca1ad491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:39.410267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1f82af90-2516-470f-809f-8db9ca1ad491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:39.418817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:39.418817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f82af90-2516-470f-809f-8db9ca1ad491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:39.418817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f82af90-2516-470f-809f-8db9ca1ad491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:39.418817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f82af90-2516-470f-809f-8db9ca1ad491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:39.418817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f82af90-2516-470f-809f-8db9ca1ad491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:39.418817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f82af90-2516-470f-809f-8db9ca1ad491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:39.418817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f82af90-2516-470f-809f-8db9ca1ad491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:39.428744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-95eedc87-f579-4cc4-bff1-70c8f8d7a3c6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:39.429360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-95eedc87-f579-4cc4-bff1-70c8f8d7a3c6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:39.449533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95eedc87-f579-4cc4-bff1-70c8f8d7a3c6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:39.456892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95eedc87-f579-4cc4-bff1-70c8f8d7a3c6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:39.457765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95eedc87-f579-4cc4-bff1-70c8f8d7a3c6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:39.458865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95eedc87-f579-4cc4-bff1-70c8f8d7a3c6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:39.459511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95eedc87-f579-4cc4-bff1-70c8f8d7a3c6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:39.460120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95eedc87-f579-4cc4-bff1-70c8f8d7a3c6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:39.500431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1f82af90-2516-470f-809f-8db9ca1ad491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:31:39.853350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-95eedc87-f579-4cc4-bff1-70c8f8d7a3c6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:39.865632 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-95eedc87-f579-4cc4-bff1-70c8f8d7a3c6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1362 microversion: 2.1 time: 0.441304 Oct 04 21:31:39.876292 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2587/5198] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:39 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1362 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:39.888517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9d9ca4f5-52f2-4e16-b7aa-978f90b425c3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:39.896652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9d9ca4f5-52f2-4e16-b7aa-978f90b425c3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:39.913523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d9ca4f5-52f2-4e16-b7aa-978f90b425c3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:39.914039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d9ca4f5-52f2-4e16-b7aa-978f90b425c3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:39.914482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d9ca4f5-52f2-4e16-b7aa-978f90b425c3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:39.915196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d9ca4f5-52f2-4e16-b7aa-978f90b425c3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:39.915656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d9ca4f5-52f2-4e16-b7aa-978f90b425c3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:39.916079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d9ca4f5-52f2-4e16-b7aa-978f90b425c3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:39.984524 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1f82af90-2516-470f-809f-8db9ca1ad491 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "DELETE /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 204 len: 0 microversion: 2.1 time: 0.573704 Oct 04 21:31:39.991357 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2612/5199] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:31:39 2022] DELETE /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:31:40.010360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cca9f9a0-8b77-4880-a7a0-3b24407559b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:40.011577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cca9f9a0-8b77-4880-a7a0-3b24407559b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:40.018594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cca9f9a0-8b77-4880-a7a0-3b24407559b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:40.020282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cca9f9a0-8b77-4880-a7a0-3b24407559b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:40.021159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cca9f9a0-8b77-4880-a7a0-3b24407559b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:40.022161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cca9f9a0-8b77-4880-a7a0-3b24407559b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:40.023305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cca9f9a0-8b77-4880-a7a0-3b24407559b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:40.024079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cca9f9a0-8b77-4880-a7a0-3b24407559b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:40.032400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9d9ca4f5-52f2-4e16-b7aa-978f90b425c3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:40.069516 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9d9ca4f5-52f2-4e16-b7aa-978f90b425c3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 200 len: 1268 microversion: 2.1 time: 0.192027 Oct 04 21:31:40.071622 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2588/5200] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:39 2022] GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 1268 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:40.247448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cca9f9a0-8b77-4880-a7a0-3b24407559b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:40.261018 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cca9f9a0-8b77-4880-a7a0-3b24407559b3 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1512 microversion: 2.1 time: 0.267891 Oct 04 21:31:40.264811 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2613/5201] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:39 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1512 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:40.909737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b90343dd-14b5-48ec-8bf6-74f6bdac0df6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:40.910990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b90343dd-14b5-48ec-8bf6-74f6bdac0df6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:40.919048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b90343dd-14b5-48ec-8bf6-74f6bdac0df6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:40.919912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b90343dd-14b5-48ec-8bf6-74f6bdac0df6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:40.920628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b90343dd-14b5-48ec-8bf6-74f6bdac0df6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:40.921525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b90343dd-14b5-48ec-8bf6-74f6bdac0df6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:40.922055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b90343dd-14b5-48ec-8bf6-74f6bdac0df6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:40.922564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b90343dd-14b5-48ec-8bf6-74f6bdac0df6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:41.104194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c8b88cc3-17a3-4752-b4e7-4d0b3ea8e421 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:41.104832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c8b88cc3-17a3-4752-b4e7-4d0b3ea8e421 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:41.113600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8b88cc3-17a3-4752-b4e7-4d0b3ea8e421 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:41.124994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8b88cc3-17a3-4752-b4e7-4d0b3ea8e421 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:41.125894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8b88cc3-17a3-4752-b4e7-4d0b3ea8e421 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:41.126898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8b88cc3-17a3-4752-b4e7-4d0b3ea8e421 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:41.127542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8b88cc3-17a3-4752-b4e7-4d0b3ea8e421 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:41.128149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8b88cc3-17a3-4752-b4e7-4d0b3ea8e421 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:41.284087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c8b88cc3-17a3-4752-b4e7-4d0b3ea8e421 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:41.299123 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c8b88cc3-17a3-4752-b4e7-4d0b3ea8e421 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 200 len: 1278 microversion: 2.1 time: 0.201524 Oct 04 21:31:41.300464 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2614/5202] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:41 2022] GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 1278 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:41.306791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fdb3783c-838b-4c4c-81fe-32ec6762c1ed tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:41.307630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fdb3783c-838b-4c4c-81fe-32ec6762c1ed tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:41.316507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fdb3783c-838b-4c4c-81fe-32ec6762c1ed tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:41.318451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fdb3783c-838b-4c4c-81fe-32ec6762c1ed tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:41.319147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fdb3783c-838b-4c4c-81fe-32ec6762c1ed tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:41.320249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fdb3783c-838b-4c4c-81fe-32ec6762c1ed tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:41.320887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fdb3783c-838b-4c4c-81fe-32ec6762c1ed tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:41.321616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fdb3783c-838b-4c4c-81fe-32ec6762c1ed tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:41.348784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b90343dd-14b5-48ec-8bf6-74f6bdac0df6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:41.360353 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b90343dd-14b5-48ec-8bf6-74f6bdac0df6 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1362 microversion: 2.1 time: 0.464727 Oct 04 21:31:41.360961 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2589/5203] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:40 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1362 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:41.373701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:41.701970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fdb3783c-838b-4c4c-81fe-32ec6762c1ed tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:41.719367 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fdb3783c-838b-4c4c-81fe-32ec6762c1ed tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1512 microversion: 2.1 time: 0.417413 Oct 04 21:31:41.720426 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2615/5204] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:41 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1512 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:42.265488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-46654d41-6909-4b01-8268-04c0e6e2f4fb req-b16b6428-5a8c-45ce-a0a3-66125ac3d352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f195f612-8d0d-42b7-bd89-5e30477023b4", "name": "network-vif-plugged", "status": "completed", "tag": "d42dda8d-a200-41b6-945b-9fd7ce65af56"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:42.283558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-46654d41-6909-4b01-8268-04c0e6e2f4fb req-b16b6428-5a8c-45ce-a0a3-66125ac3d352 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:42.284323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-46654d41-6909-4b01-8268-04c0e6e2f4fb req-b16b6428-5a8c-45ce-a0a3-66125ac3d352 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:42.284988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-46654d41-6909-4b01-8268-04c0e6e2f4fb req-b16b6428-5a8c-45ce-a0a3-66125ac3d352 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:42.299692 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-46654d41-6909-4b01-8268-04c0e6e2f4fb req-b16b6428-5a8c-45ce-a0a3-66125ac3d352 service nova] Creating event network-vif-plugged:d42dda8d-a200-41b6-945b-9fd7ce65af56 for instance f195f612-8d0d-42b7-bd89-5e30477023b4 on n-h2-860282-1 Oct 04 21:31:42.306797 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-46654d41-6909-4b01-8268-04c0e6e2f4fb req-b16b6428-5a8c-45ce-a0a3-66125ac3d352 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045731 Oct 04 21:31:42.313320 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2590/5205] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:42.328080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4427db7b-d6a7-4d97-a982-6912ae5fb5d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:42.328684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4427db7b-d6a7-4d97-a982-6912ae5fb5d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:42.360949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4427db7b-d6a7-4d97-a982-6912ae5fb5d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:42.370520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4427db7b-d6a7-4d97-a982-6912ae5fb5d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:42.376763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4427db7b-d6a7-4d97-a982-6912ae5fb5d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:42.376763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4427db7b-d6a7-4d97-a982-6912ae5fb5d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:42.376763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4427db7b-d6a7-4d97-a982-6912ae5fb5d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:42.376763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4427db7b-d6a7-4d97-a982-6912ae5fb5d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:42.391892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e7b6b935-33b6-4f3c-9ea8-62686a53cdad tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:42.392621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e7b6b935-33b6-4f3c-9ea8-62686a53cdad tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:42.423559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7b6b935-33b6-4f3c-9ea8-62686a53cdad tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:42.424154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7b6b935-33b6-4f3c-9ea8-62686a53cdad tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:42.424526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7b6b935-33b6-4f3c-9ea8-62686a53cdad tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:42.425265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7b6b935-33b6-4f3c-9ea8-62686a53cdad tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:42.425778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7b6b935-33b6-4f3c-9ea8-62686a53cdad tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:42.426216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7b6b935-33b6-4f3c-9ea8-62686a53cdad tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:42.940663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4427db7b-d6a7-4d97-a982-6912ae5fb5d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:42.948651 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4427db7b-d6a7-4d97-a982-6912ae5fb5d7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 200 len: 1308 microversion: 2.1 time: 0.626019 Oct 04 21:31:42.950047 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2616/5206] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:42 2022] GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 1308 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:42.955548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-416926a0-1765-435c-a2e2-470b16d53c0b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:42.958854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-416926a0-1765-435c-a2e2-470b16d53c0b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:42.963170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-416926a0-1765-435c-a2e2-470b16d53c0b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:42.963943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-416926a0-1765-435c-a2e2-470b16d53c0b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:42.965236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-416926a0-1765-435c-a2e2-470b16d53c0b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:42.966363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-416926a0-1765-435c-a2e2-470b16d53c0b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:42.967055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-416926a0-1765-435c-a2e2-470b16d53c0b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:42.967746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-416926a0-1765-435c-a2e2-470b16d53c0b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:43.022522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e7b6b935-33b6-4f3c-9ea8-62686a53cdad tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:43.034700 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e7b6b935-33b6-4f3c-9ea8-62686a53cdad tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1362 microversion: 2.1 time: 0.647228 Oct 04 21:31:43.036832 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2591/5207] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:42 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1362 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:43.094635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-416926a0-1765-435c-a2e2-470b16d53c0b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3022b1f60e82428482675f26d2621f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177c1fc19f0456dbf217e4582e3eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:43.106975 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-416926a0-1765-435c-a2e2-470b16d53c0b tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 200 len: 1470 microversion: 2.1 time: 0.155411 Oct 04 21:31:43.112443 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2617/5208] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:42 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:43.268371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-42b01f52-61ee-4510-a208-2800bf1e0116 req-3a50096d-b447-4b29-b936-74a8c07bece1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144fff2d-9df3-4a93-833f-7f76acc85185", "name": "network-vif-deleted", "tag": "cef3ff62-fc82-48d3-a981-5cadb2647961"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:43.297825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-42b01f52-61ee-4510-a208-2800bf1e0116 req-3a50096d-b447-4b29-b936-74a8c07bece1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:43.300004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-42b01f52-61ee-4510-a208-2800bf1e0116 req-3a50096d-b447-4b29-b936-74a8c07bece1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:43.300460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-42b01f52-61ee-4510-a208-2800bf1e0116 req-3a50096d-b447-4b29-b936-74a8c07bece1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:43.339093 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-42b01f52-61ee-4510-a208-2800bf1e0116 req-3a50096d-b447-4b29-b936-74a8c07bece1 service nova] Creating event network-vif-deleted:cef3ff62-fc82-48d3-a981-5cadb2647961 for instance 144fff2d-9df3-4a93-833f-7f76acc85185 on n-h2-860282-1 Oct 04 21:31:43.350833 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-42b01f52-61ee-4510-a208-2800bf1e0116 req-3a50096d-b447-4b29-b936-74a8c07bece1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.312311 Oct 04 21:31:43.353412 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2592/5209] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:43.984063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9f895618-a12e-4073-bdb5-cacafc4a6623 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:43.985575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9f895618-a12e-4073-bdb5-cacafc4a6623 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:44.000906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f895618-a12e-4073-bdb5-cacafc4a6623 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:44.001440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f895618-a12e-4073-bdb5-cacafc4a6623 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:44.002038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f895618-a12e-4073-bdb5-cacafc4a6623 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:44.003050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f895618-a12e-4073-bdb5-cacafc4a6623 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:44.004192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f895618-a12e-4073-bdb5-cacafc4a6623 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:44.004638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f895618-a12e-4073-bdb5-cacafc4a6623 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:44.061808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4d1008da-f618-4fec-952e-0128bd1c8410 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:44.062531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4d1008da-f618-4fec-952e-0128bd1c8410 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:44.069251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d1008da-f618-4fec-952e-0128bd1c8410 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:44.069807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d1008da-f618-4fec-952e-0128bd1c8410 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:44.070472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d1008da-f618-4fec-952e-0128bd1c8410 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:44.071185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d1008da-f618-4fec-952e-0128bd1c8410 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:44.071639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d1008da-f618-4fec-952e-0128bd1c8410 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:44.072192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d1008da-f618-4fec-952e-0128bd1c8410 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:44.379655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9f895618-a12e-4073-bdb5-cacafc4a6623 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:44.387462 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9f895618-a12e-4073-bdb5-cacafc4a6623 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 200 len: 1308 microversion: 2.1 time: 0.410692 Oct 04 21:31:44.388599 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2618/5210] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:43 2022] GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 1308 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:44.397812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9de1be1d-d3dd-4a76-8e87-800e624ed251 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:44.398666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9de1be1d-d3dd-4a76-8e87-800e624ed251 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] [instance: 144fff2d-9df3-4a93-833f-7f76acc85185] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:44.410210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9de1be1d-d3dd-4a76-8e87-800e624ed251 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:44.410210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9de1be1d-d3dd-4a76-8e87-800e624ed251 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:44.410210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9de1be1d-d3dd-4a76-8e87-800e624ed251 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:44.410210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9de1be1d-d3dd-4a76-8e87-800e624ed251 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:44.411111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9de1be1d-d3dd-4a76-8e87-800e624ed251 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:44.411501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9de1be1d-d3dd-4a76-8e87-800e624ed251 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:44.434789 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-9de1be1d-d3dd-4a76-8e87-800e624ed251 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] HTTP exception thrown: Instance 144fff2d-9df3-4a93-833f-7f76acc85185 could not be found. Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9de1be1d-d3dd-4a76-8e87-800e624ed251 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Request method failure captured: Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 HTTP/1.1 Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUhEa-HDq-NlpdNPbIlrR-FKuz2thPFfSxkoB-yTzSjaTrkbXPbJmBcHP-xyYb-4rhHqdasSXOgL-8zBMsfFBN_Ef1Hs76dof1cmTHSm3CVwfcefozR6WAUCnzN6XKdbd83Qe-5Ih-Y9DGZPSniBFZHBH6QmluM0WROpIMPqdZn8_4 Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a177c1fc19f0456dbf217e4582e3eb2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a177c1fc19f0456dbf217e4582e3eb2b"}]}] Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a177c1fc19f0456dbf217e4582e3eb2b Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1563321434 Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3022b1f60e82428482675f26d2621f39 Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-1563321434-project Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 144fff2d-9df3-4a93-833f-7f76acc85185 could not be found. Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '144fff2d-9df3-4a93-833f-7f76acc85185'} Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 144fff2d-9df3-4a93-833f-7f76acc85185 could not be found. Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 144fff2d-9df3-4a93-833f-7f76acc85185 could not be found. Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:44.436914 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:44.443715 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:44.443715 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:44.443715 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:44.443715 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:44.443715 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:44.443715 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 144fff2d-9df3-4a93-833f-7f76acc85185 could not be found. Oct 04 21:31:44.443715 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:44.443715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9de1be1d-d3dd-4a76-8e87-800e624ed251 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] Returning 404 to user: Instance 144fff2d-9df3-4a93-833f-7f76acc85185 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:44.443715 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9de1be1d-d3dd-4a76-8e87-800e624ed251 tempest-ServersNegativeTestJSON-1563321434 tempest-ServersNegativeTestJSON-1563321434-project] 10.222.0.30 "GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185" status: 404 len: 111 microversion: 2.1 time: 0.048721 Oct 04 21:31:44.443715 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2619/5211] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:44 2022] GET /compute/v2.1/servers/144fff2d-9df3-4a93-833f-7f76acc85185 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:31:44.512503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4d1008da-f618-4fec-952e-0128bd1c8410 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:44.521000 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4d1008da-f618-4fec-952e-0128bd1c8410 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1362 microversion: 2.1 time: 0.464494 Oct 04 21:31:44.521885 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2593/5212] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:44 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1362 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:45.369835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-11e9fbcb-bd6a-420b-85e2-69386a1e727b req-8a51c634-9d5b-44e8-80e4-6cc3a3883720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12eda487-1501-4d60-84ca-f1fda387068b", "tag": "d4c8f06e-5b7d-48f5-97e8-46a70205d1f3"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:45.388631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-11e9fbcb-bd6a-420b-85e2-69386a1e727b req-8a51c634-9d5b-44e8-80e4-6cc3a3883720 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:45.389153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-11e9fbcb-bd6a-420b-85e2-69386a1e727b req-8a51c634-9d5b-44e8-80e4-6cc3a3883720 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:45.389603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-11e9fbcb-bd6a-420b-85e2-69386a1e727b req-8a51c634-9d5b-44e8-80e4-6cc3a3883720 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:45.403217 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-11e9fbcb-bd6a-420b-85e2-69386a1e727b req-8a51c634-9d5b-44e8-80e4-6cc3a3883720 service nova] Creating event network-changed:d4c8f06e-5b7d-48f5-97e8-46a70205d1f3 for instance 12eda487-1501-4d60-84ca-f1fda387068b on n-h2-860282-1 Oct 04 21:31:45.409468 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-11e9fbcb-bd6a-420b-85e2-69386a1e727b req-8a51c634-9d5b-44e8-80e4-6cc3a3883720 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045324 Oct 04 21:31:45.410884 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2620/5213] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:45.415545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5a6222da-98a4-48eb-9bce-bb250a503ef2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:45.416164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5a6222da-98a4-48eb-9bce-bb250a503ef2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:45.435557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a6222da-98a4-48eb-9bce-bb250a503ef2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:45.437387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a6222da-98a4-48eb-9bce-bb250a503ef2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:45.438684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a6222da-98a4-48eb-9bce-bb250a503ef2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:45.440513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a6222da-98a4-48eb-9bce-bb250a503ef2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:45.440965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a6222da-98a4-48eb-9bce-bb250a503ef2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:45.441404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a6222da-98a4-48eb-9bce-bb250a503ef2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:45.548863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2f23b44a-c569-4a33-92a2-6b66b753e5cc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:45.549546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2f23b44a-c569-4a33-92a2-6b66b753e5cc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:45.559371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f23b44a-c569-4a33-92a2-6b66b753e5cc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:45.564673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f23b44a-c569-4a33-92a2-6b66b753e5cc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:45.565266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f23b44a-c569-4a33-92a2-6b66b753e5cc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:45.567394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f23b44a-c569-4a33-92a2-6b66b753e5cc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:45.568155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f23b44a-c569-4a33-92a2-6b66b753e5cc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:45.570098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f23b44a-c569-4a33-92a2-6b66b753e5cc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:45.912932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:46.036740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:46.579472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5a6222da-98a4-48eb-9bce-bb250a503ef2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:46.588715 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5a6222da-98a4-48eb-9bce-bb250a503ef2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 200 len: 1308 microversion: 2.1 time: 1.179018 Oct 04 21:31:46.589993 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2594/5214] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:45 2022] GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 1308 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:46.643765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2f23b44a-c569-4a33-92a2-6b66b753e5cc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:46.655823 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2f23b44a-c569-4a33-92a2-6b66b753e5cc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1548 microversion: 2.1 time: 1.113418 Oct 04 21:31:46.662964 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2621/5215] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:45 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1548 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:46.686166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5cd3541d-3057-4958-8ccc-9cafebca07b3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:46.687042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5cd3541d-3057-4958-8ccc-9cafebca07b3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:46.697079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd3541d-3057-4958-8ccc-9cafebca07b3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:46.697948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd3541d-3057-4958-8ccc-9cafebca07b3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:46.698660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd3541d-3057-4958-8ccc-9cafebca07b3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:46.699601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd3541d-3057-4958-8ccc-9cafebca07b3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:46.700347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd3541d-3057-4958-8ccc-9cafebca07b3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:46.716537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cd3541d-3057-4958-8ccc-9cafebca07b3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:46.988957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-31fdaeb1-c03f-4c3b-b3c3-f0cceebf7382 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1105683639", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "5643d693-f560-4a03-a031-bdbc28beac5f"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:47.025070 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5cd3541d-3057-4958-8ccc-9cafebca07b3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.332371 Oct 04 21:31:47.025070 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2622/5216] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:31:46 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4/os-interface => generated 284 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:47.126634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-31fdaeb1-c03f-4c3b-b3c3-f0cceebf7382 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] validate_networks() for [('5643d693-f560-4a03-a031-bdbc28beac5f', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:31:47.523466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:47.622899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5ae21ade-7baa-4487-92a1-0f650fda3038 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:47.624533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5ae21ade-7baa-4487-92a1-0f650fda3038 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:47.634306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ae21ade-7baa-4487-92a1-0f650fda3038 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:47.635426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ae21ade-7baa-4487-92a1-0f650fda3038 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:47.636635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ae21ade-7baa-4487-92a1-0f650fda3038 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:47.638007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ae21ade-7baa-4487-92a1-0f650fda3038 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:47.638741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ae21ade-7baa-4487-92a1-0f650fda3038 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:47.639395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ae21ade-7baa-4487-92a1-0f650fda3038 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:48.245285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5ae21ade-7baa-4487-92a1-0f650fda3038 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:48.271456 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5ae21ade-7baa-4487-92a1-0f650fda3038 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 200 len: 1308 microversion: 2.1 time: 0.658833 Oct 04 21:31:48.290103 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2623/5217] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:47 2022] GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 1308 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:48.416672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-31fdaeb1-c03f-4c3b-b3c3-f0cceebf7382 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:31:48.418926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-31fdaeb1-c03f-4c3b-b3c3-f0cceebf7382 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:31:48.419448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-31fdaeb1-c03f-4c3b-b3c3-f0cceebf7382 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:31:48.420108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-31fdaeb1-c03f-4c3b-b3c3-f0cceebf7382 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:31:48.421354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-31fdaeb1-c03f-4c3b-b3c3-f0cceebf7382 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:31:48.435281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31fdaeb1-c03f-4c3b-b3c3-f0cceebf7382 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:48.436056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31fdaeb1-c03f-4c3b-b3c3-f0cceebf7382 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:48.436708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31fdaeb1-c03f-4c3b-b3c3-f0cceebf7382 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:48.437670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31fdaeb1-c03f-4c3b-b3c3-f0cceebf7382 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:48.438320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31fdaeb1-c03f-4c3b-b3c3-f0cceebf7382 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:48.439445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31fdaeb1-c03f-4c3b-b3c3-f0cceebf7382 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:48.463501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-31fdaeb1-c03f-4c3b-b3c3-f0cceebf7382 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Getting quotas for project 07b57c97263048c7b6345042a45d0ffb. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:31:48.484317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-31fdaeb1-c03f-4c3b-b3c3-f0cceebf7382 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Getting quotas for user 17037da82f9942619c02e5744c48a7ae and project 07b57c97263048c7b6345042a45d0ffb. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:31:48.528968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-31fdaeb1-c03f-4c3b-b3c3-f0cceebf7382 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:31:48.531881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-31fdaeb1-c03f-4c3b-b3c3-f0cceebf7382 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:31:48.810521 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-31fdaeb1-c03f-4c3b-b3c3-f0cceebf7382 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.218828 Oct 04 21:31:48.811572 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2595/5218] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:31:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:31:48.824158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-80ca37b3-cd23-46d5-9e61-805515d5bada tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:48.824877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-80ca37b3-cd23-46d5-9e61-805515d5bada tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:49.007213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-80ca37b3-cd23-46d5-9e61-805515d5bada tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:49.015830 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-80ca37b3-cd23-46d5-9e61-805515d5bada tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1215 microversion: 2.1 time: 0.196472 Oct 04 21:31:49.017031 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2624/5219] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:48 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1215 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:49.298055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9230d444-7d38-4963-a52c-a1e15129a672 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:49.298683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9230d444-7d38-4963-a52c-a1e15129a672 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:49.314296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9230d444-7d38-4963-a52c-a1e15129a672 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:49.322027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9230d444-7d38-4963-a52c-a1e15129a672 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:49.322027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9230d444-7d38-4963-a52c-a1e15129a672 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:49.322027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9230d444-7d38-4963-a52c-a1e15129a672 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:49.322027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9230d444-7d38-4963-a52c-a1e15129a672 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:49.322027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9230d444-7d38-4963-a52c-a1e15129a672 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:49.513782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9230d444-7d38-4963-a52c-a1e15129a672 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:49.525415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-4175e0ee-4f61-4f5a-877a-f9121564634d req-9bf4be49-8236-4d77-9a04-aaf22221c695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f195f612-8d0d-42b7-bd89-5e30477023b4", "tag": "d42dda8d-a200-41b6-945b-9fd7ce65af56"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:49.527165 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9230d444-7d38-4963-a52c-a1e15129a672 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 200 len: 1308 microversion: 2.1 time: 0.232998 Oct 04 21:31:49.528299 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2596/5220] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:49 2022] GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 1308 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:49.583022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4175e0ee-4f61-4f5a-877a-f9121564634d req-9bf4be49-8236-4d77-9a04-aaf22221c695 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:49.583857 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4175e0ee-4f61-4f5a-877a-f9121564634d req-9bf4be49-8236-4d77-9a04-aaf22221c695 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:49.584862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4175e0ee-4f61-4f5a-877a-f9121564634d req-9bf4be49-8236-4d77-9a04-aaf22221c695 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:49.628218 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-4175e0ee-4f61-4f5a-877a-f9121564634d req-9bf4be49-8236-4d77-9a04-aaf22221c695 service nova] Creating event network-changed:d42dda8d-a200-41b6-945b-9fd7ce65af56 for instance f195f612-8d0d-42b7-bd89-5e30477023b4 on n-h2-860282-1 Oct 04 21:31:49.640183 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-4175e0ee-4f61-4f5a-877a-f9121564634d req-9bf4be49-8236-4d77-9a04-aaf22221c695 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120357 Oct 04 21:31:49.641598 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2625/5221] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:31:50.044278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5ae0f72d-1e19-4a14-9518-e359c967fc3f tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:50.045304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5ae0f72d-1e19-4a14-9518-e359c967fc3f tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:50.144050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b7a28586-28e5-4b18-89da-033adc8f12ba req-12e85d0d-c895-47f0-95cd-d8123dc5d6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12eda487-1501-4d60-84ca-f1fda387068b", "name": "network-vif-plugged", "status": "completed", "tag": "d4c8f06e-5b7d-48f5-97e8-46a70205d1f3"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:50.163855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b7a28586-28e5-4b18-89da-033adc8f12ba req-12e85d0d-c895-47f0-95cd-d8123dc5d6d6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:50.164360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b7a28586-28e5-4b18-89da-033adc8f12ba req-12e85d0d-c895-47f0-95cd-d8123dc5d6d6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:50.164807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b7a28586-28e5-4b18-89da-033adc8f12ba req-12e85d0d-c895-47f0-95cd-d8123dc5d6d6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:50.220231 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b7a28586-28e5-4b18-89da-033adc8f12ba req-12e85d0d-c895-47f0-95cd-d8123dc5d6d6 service nova] Creating event network-vif-plugged:d4c8f06e-5b7d-48f5-97e8-46a70205d1f3 for instance 12eda487-1501-4d60-84ca-f1fda387068b on n-h2-860282-1 Oct 04 21:31:50.231798 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b7a28586-28e5-4b18-89da-033adc8f12ba req-12e85d0d-c895-47f0-95cd-d8123dc5d6d6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090374 Oct 04 21:31:50.232462 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2626/5222] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:31:50.451231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5ae0f72d-1e19-4a14-9518-e359c967fc3f tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:50.467000 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5ae0f72d-1e19-4a14-9518-e359c967fc3f tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1215 microversion: 2.1 time: 0.427722 Oct 04 21:31:50.474927 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2597/5223] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:50 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1215 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:50.561839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e8886772-0a88-4a2c-a66e-8738ba7d798e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:50.563184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e8886772-0a88-4a2c-a66e-8738ba7d798e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:50.573245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8886772-0a88-4a2c-a66e-8738ba7d798e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:50.574251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8886772-0a88-4a2c-a66e-8738ba7d798e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:50.574898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8886772-0a88-4a2c-a66e-8738ba7d798e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:50.576097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8886772-0a88-4a2c-a66e-8738ba7d798e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:50.576761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8886772-0a88-4a2c-a66e-8738ba7d798e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:50.577370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8886772-0a88-4a2c-a66e-8738ba7d798e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:50.969018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e8886772-0a88-4a2c-a66e-8738ba7d798e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:50.985530 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e8886772-0a88-4a2c-a66e-8738ba7d798e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 200 len: 1308 microversion: 2.1 time: 0.431305 Oct 04 21:31:50.986405 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2627/5224] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:50 2022] GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 1308 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:51.496230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-43114689-0307-414f-8c47-4a21030cf341 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:51.497955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-43114689-0307-414f-8c47-4a21030cf341 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:51.521263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43114689-0307-414f-8c47-4a21030cf341 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:51.524912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43114689-0307-414f-8c47-4a21030cf341 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:51.525920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43114689-0307-414f-8c47-4a21030cf341 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:51.546564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43114689-0307-414f-8c47-4a21030cf341 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:51.547841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43114689-0307-414f-8c47-4a21030cf341 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:51.548373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43114689-0307-414f-8c47-4a21030cf341 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:51.590687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:51.816335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-43114689-0307-414f-8c47-4a21030cf341 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:51.828176 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-43114689-0307-414f-8c47-4a21030cf341 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1267 microversion: 2.1 time: 0.337554 Oct 04 21:31:51.829369 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2598/5225] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:51 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1267 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:52.020475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7f5e0575-a2fa-4878-b010-8c28c737b425 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:52.024623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7f5e0575-a2fa-4878-b010-8c28c737b425 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:52.036235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f5e0575-a2fa-4878-b010-8c28c737b425 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:52.037578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f5e0575-a2fa-4878-b010-8c28c737b425 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:52.038426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f5e0575-a2fa-4878-b010-8c28c737b425 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:52.039166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f5e0575-a2fa-4878-b010-8c28c737b425 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:52.039668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f5e0575-a2fa-4878-b010-8c28c737b425 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:52.040142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f5e0575-a2fa-4878-b010-8c28c737b425 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:52.382948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7f5e0575-a2fa-4878-b010-8c28c737b425 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:52.392441 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7f5e0575-a2fa-4878-b010-8c28c737b425 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 200 len: 1489 microversion: 2.1 time: 0.386761 Oct 04 21:31:52.393380 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2628/5226] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:52 2022] GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 1489 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:52.421772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4c9c38e5-1f39-4c98-a849-8c44185dc1db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:52.422810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4c9c38e5-1f39-4c98-a849-8c44185dc1db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:52.429398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c9c38e5-1f39-4c98-a849-8c44185dc1db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:52.430908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c9c38e5-1f39-4c98-a849-8c44185dc1db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:52.430908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c9c38e5-1f39-4c98-a849-8c44185dc1db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:52.431558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c9c38e5-1f39-4c98-a849-8c44185dc1db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:52.432339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c9c38e5-1f39-4c98-a849-8c44185dc1db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:52.433676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c9c38e5-1f39-4c98-a849-8c44185dc1db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:52.675752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4c9c38e5-1f39-4c98-a849-8c44185dc1db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:52.686388 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4c9c38e5-1f39-4c98-a849-8c44185dc1db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 200 len: 1488 microversion: 2.1 time: 0.271028 Oct 04 21:31:52.702975 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2599/5227] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:52 2022] GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 1488 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:52.721612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9a0930f6-c041-4d7a-9a58-4950bb817de3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:52.734909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9a0930f6-c041-4d7a-9a58-4950bb817de3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:52.746924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a0930f6-c041-4d7a-9a58-4950bb817de3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:52.747579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a0930f6-c041-4d7a-9a58-4950bb817de3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:52.748034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a0930f6-c041-4d7a-9a58-4950bb817de3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:52.748746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a0930f6-c041-4d7a-9a58-4950bb817de3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:52.749202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a0930f6-c041-4d7a-9a58-4950bb817de3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:52.761469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a0930f6-c041-4d7a-9a58-4950bb817de3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:52.852702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ddf6f557-da87-4812-a41e-a4ce64c28588 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:52.853667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ddf6f557-da87-4812-a41e-a4ce64c28588 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:52.862668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddf6f557-da87-4812-a41e-a4ce64c28588 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:52.863545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddf6f557-da87-4812-a41e-a4ce64c28588 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:52.864308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddf6f557-da87-4812-a41e-a4ce64c28588 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:52.865133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddf6f557-da87-4812-a41e-a4ce64c28588 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:52.865681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddf6f557-da87-4812-a41e-a4ce64c28588 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:52.866374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddf6f557-da87-4812-a41e-a4ce64c28588 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:53.083223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ddf6f557-da87-4812-a41e-a4ce64c28588 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:53.093058 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ddf6f557-da87-4812-a41e-a4ce64c28588 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1285 microversion: 2.1 time: 0.244207 Oct 04 21:31:53.106761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9a0930f6-c041-4d7a-9a58-4950bb817de3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:53.111719 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2600/5228] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:52 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1285 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:53.118668 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9a0930f6-c041-4d7a-9a58-4950bb817de3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 200 len: 1489 microversion: 2.1 time: 0.409276 Oct 04 21:31:53.119379 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2629/5229] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:52 2022] GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 1489 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:53.147063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-104f17cf-6ccb-46c6-aa67-cbce44b74e8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:53.147924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-104f17cf-6ccb-46c6-aa67-cbce44b74e8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:53.155954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-104f17cf-6ccb-46c6-aa67-cbce44b74e8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:53.156450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-104f17cf-6ccb-46c6-aa67-cbce44b74e8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:53.157690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-104f17cf-6ccb-46c6-aa67-cbce44b74e8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:53.157889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-104f17cf-6ccb-46c6-aa67-cbce44b74e8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:53.158364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-104f17cf-6ccb-46c6-aa67-cbce44b74e8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:53.158796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-104f17cf-6ccb-46c6-aa67-cbce44b74e8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:53.188903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-104f17cf-6ccb-46c6-aa67-cbce44b74e8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:31:53.516137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b2419c87-dadb-43df-869a-9bff68d67afc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-366908851", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:53.601139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-b2419c87-dadb-43df-869a-9bff68d67afc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] validate_networks() for None {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:31:53.647429 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-104f17cf-6ccb-46c6-aa67-cbce44b74e8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "DELETE /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 204 len: 0 microversion: 2.1 time: 0.508102 Oct 04 21:31:53.651184 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2601/5230] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:31:53 2022] DELETE /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:31:53.664963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-70ff5cf9-2cd1-4e5f-beab-04279b09a482 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:53.668169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-70ff5cf9-2cd1-4e5f-beab-04279b09a482 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:53.684927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70ff5cf9-2cd1-4e5f-beab-04279b09a482 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:53.687707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70ff5cf9-2cd1-4e5f-beab-04279b09a482 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:53.688396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70ff5cf9-2cd1-4e5f-beab-04279b09a482 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:53.692125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70ff5cf9-2cd1-4e5f-beab-04279b09a482 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:53.692943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70ff5cf9-2cd1-4e5f-beab-04279b09a482 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:53.695802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70ff5cf9-2cd1-4e5f-beab-04279b09a482 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:54.081303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-b2419c87-dadb-43df-869a-9bff68d67afc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:31:54.081792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-b2419c87-dadb-43df-869a-9bff68d67afc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:31:54.082277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-b2419c87-dadb-43df-869a-9bff68d67afc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:31:54.082695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-b2419c87-dadb-43df-869a-9bff68d67afc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:31:54.083169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-b2419c87-dadb-43df-869a-9bff68d67afc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:31:54.094154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-70ff5cf9-2cd1-4e5f-beab-04279b09a482 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:54.097410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2419c87-dadb-43df-869a-9bff68d67afc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:54.097956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2419c87-dadb-43df-869a-9bff68d67afc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:54.098396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2419c87-dadb-43df-869a-9bff68d67afc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:54.099171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2419c87-dadb-43df-869a-9bff68d67afc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:54.099634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2419c87-dadb-43df-869a-9bff68d67afc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:54.101629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2419c87-dadb-43df-869a-9bff68d67afc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:54.106990 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-70ff5cf9-2cd1-4e5f-beab-04279b09a482 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 200 len: 1495 microversion: 2.1 time: 0.452068 Oct 04 21:31:54.108893 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2602/5231] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:53 2022] GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 1495 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:54.131184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7e5d4ac2-1c25-44d7-95b4-f279c2b9dfca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:54.132187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7e5d4ac2-1c25-44d7-95b4-f279c2b9dfca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:54.166668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e5d4ac2-1c25-44d7-95b4-f279c2b9dfca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:54.166668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e5d4ac2-1c25-44d7-95b4-f279c2b9dfca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:54.166668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e5d4ac2-1c25-44d7-95b4-f279c2b9dfca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:54.166668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e5d4ac2-1c25-44d7-95b4-f279c2b9dfca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:54.166668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e5d4ac2-1c25-44d7-95b4-f279c2b9dfca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:54.166668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e5d4ac2-1c25-44d7-95b4-f279c2b9dfca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:54.172912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-b2419c87-dadb-43df-869a-9bff68d67afc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Getting quotas for project f2cb61f8190c492d8946116e6e296a76. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:31:54.179471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-b2419c87-dadb-43df-869a-9bff68d67afc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Getting quotas for user e39736b6b74749d5a0ce5f5e79ce0c91 and project f2cb61f8190c492d8946116e6e296a76. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:31:54.193190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b2419c87-dadb-43df-869a-9bff68d67afc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:31:54.197004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b2419c87-dadb-43df-869a-9bff68d67afc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:31:54.347780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7e5d4ac2-1c25-44d7-95b4-f279c2b9dfca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:54.373458 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7e5d4ac2-1c25-44d7-95b4-f279c2b9dfca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1315 microversion: 2.1 time: 0.253119 Oct 04 21:31:54.377946 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b2419c87-dadb-43df-869a-9bff68d67afc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.868092 Oct 04 21:31:54.389228 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2630/5232] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:31:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:31:54.393688 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2603/5233] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:54 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:54.395368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cd601b98-286b-4eb9-a9e5-98ee644a7d40 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:54.396201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cd601b98-286b-4eb9-a9e5-98ee644a7d40 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:54.472436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cd601b98-286b-4eb9-a9e5-98ee644a7d40 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39736b6b74749d5a0ce5f5e79ce0c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cb61f8190c492d8946116e6e296a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:54.479956 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cd601b98-286b-4eb9-a9e5-98ee644a7d40 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa" status: 200 len: 1213 microversion: 2.1 time: 0.089345 Oct 04 21:31:54.492451 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2631/5234] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:54 2022] GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:54.987984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7e5d4ac2-1c25-44d7-95b4-f279c2b9dfca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:54.989023 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7e5d4ac2-1c25-44d7-95b4-f279c2b9dfca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001439 Oct 04 21:31:54.989373 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2604/5235] 10.222.0.30 () {56 vars in 886 bytes} [Tue Oct 4 21:31:54 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 21:31:55.133214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fef39ebf-4d46-436d-9b99-a74d081e7848 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:55.134436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fef39ebf-4d46-436d-9b99-a74d081e7848 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:55.144974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fef39ebf-4d46-436d-9b99-a74d081e7848 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:55.145844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fef39ebf-4d46-436d-9b99-a74d081e7848 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:55.146525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fef39ebf-4d46-436d-9b99-a74d081e7848 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:55.147473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fef39ebf-4d46-436d-9b99-a74d081e7848 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:55.148177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fef39ebf-4d46-436d-9b99-a74d081e7848 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:55.148848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fef39ebf-4d46-436d-9b99-a74d081e7848 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:55.423662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8617f1bf-46bf-429b-9ec6-5c3333d0da80 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:55.423662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8617f1bf-46bf-429b-9ec6-5c3333d0da80 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:55.437154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8617f1bf-46bf-429b-9ec6-5c3333d0da80 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:55.438167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8617f1bf-46bf-429b-9ec6-5c3333d0da80 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:55.439695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8617f1bf-46bf-429b-9ec6-5c3333d0da80 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:55.440698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8617f1bf-46bf-429b-9ec6-5c3333d0da80 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:55.441183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8617f1bf-46bf-429b-9ec6-5c3333d0da80 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:55.445850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8617f1bf-46bf-429b-9ec6-5c3333d0da80 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:55.474275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fef39ebf-4d46-436d-9b99-a74d081e7848 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:55.490969 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fef39ebf-4d46-436d-9b99-a74d081e7848 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 200 len: 1495 microversion: 2.1 time: 0.359468 Oct 04 21:31:55.509150 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2632/5236] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:55 2022] GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 1495 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:55.517210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c8c1d31a-d6bc-423d-bdcb-a265e1719a3f tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:55.517869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c8c1d31a-d6bc-423d-bdcb-a265e1719a3f tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:55.647094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c8c1d31a-d6bc-423d-bdcb-a265e1719a3f tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39736b6b74749d5a0ce5f5e79ce0c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cb61f8190c492d8946116e6e296a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:55.654432 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c8c1d31a-d6bc-423d-bdcb-a265e1719a3f tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa" status: 200 len: 1213 microversion: 2.1 time: 0.147793 Oct 04 21:31:55.655025 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2633/5237] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:55 2022] GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa => generated 1213 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:55.659020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c8c1d31a-d6bc-423d-bdcb-a265e1719a3f tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:55.659959 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c8c1d31a-d6bc-423d-bdcb-a265e1719a3f tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001202 Oct 04 21:31:55.672896 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2634/5238] 10.222.0.30 () {56 vars in 886 bytes} [Tue Oct 4 21:31:55 2022] GET /compute/ => generated 377 bytes in 14 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 21:31:55.782925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8617f1bf-46bf-429b-9ec6-5c3333d0da80 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:55.790941 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8617f1bf-46bf-429b-9ec6-5c3333d0da80 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1315 microversion: 2.1 time: 0.386338 Oct 04 21:31:55.805861 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2605/5239] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:55 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:56.098549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-424da510-2ddc-491f-8224-39828be0a4ac req-48aa192d-a1d6-4cb4-960d-562297ccd146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12eda487-1501-4d60-84ca-f1fda387068b", "name": "network-vif-deleted", "tag": "d4c8f06e-5b7d-48f5-97e8-46a70205d1f3"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:56.121271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-424da510-2ddc-491f-8224-39828be0a4ac req-48aa192d-a1d6-4cb4-960d-562297ccd146 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:56.127562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-424da510-2ddc-491f-8224-39828be0a4ac req-48aa192d-a1d6-4cb4-960d-562297ccd146 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:56.128100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-424da510-2ddc-491f-8224-39828be0a4ac req-48aa192d-a1d6-4cb4-960d-562297ccd146 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:56.180535 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-424da510-2ddc-491f-8224-39828be0a4ac req-48aa192d-a1d6-4cb4-960d-562297ccd146 service nova] Creating event network-vif-deleted:d4c8f06e-5b7d-48f5-97e8-46a70205d1f3 for instance 12eda487-1501-4d60-84ca-f1fda387068b on n-h2-860282-1 Oct 04 21:31:56.190884 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-424da510-2ddc-491f-8224-39828be0a4ac req-48aa192d-a1d6-4cb4-960d-562297ccd146 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095868 Oct 04 21:31:56.191534 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2635/5240] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:56.491102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-856c4d58-5d8b-4944-b951-6d72562c1003 req-8aa1a7e1-8593-412e-bceb-1a9585275c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "841e7266-1e45-49f1-8c5a-8dd479fcf958", "tag": "651c41bb-ced3-4be1-aacd-e2e20677f0d5"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:56.508611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-856c4d58-5d8b-4944-b951-6d72562c1003 req-8aa1a7e1-8593-412e-bceb-1a9585275c55 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:56.509694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-856c4d58-5d8b-4944-b951-6d72562c1003 req-8aa1a7e1-8593-412e-bceb-1a9585275c55 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:56.510419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-856c4d58-5d8b-4944-b951-6d72562c1003 req-8aa1a7e1-8593-412e-bceb-1a9585275c55 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:56.519224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e8b89daf-ee4f-4bff-bd0f-91df32ab51f6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:56.520930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e8b89daf-ee4f-4bff-bd0f-91df32ab51f6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:56.533244 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-856c4d58-5d8b-4944-b951-6d72562c1003 req-8aa1a7e1-8593-412e-bceb-1a9585275c55 service nova] Creating event network-changed:651c41bb-ced3-4be1-aacd-e2e20677f0d5 for instance 841e7266-1e45-49f1-8c5a-8dd479fcf958 on n-h1-860282-1 Oct 04 21:31:56.538790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8b89daf-ee4f-4bff-bd0f-91df32ab51f6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:56.539816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8b89daf-ee4f-4bff-bd0f-91df32ab51f6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:56.540379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8b89daf-ee4f-4bff-bd0f-91df32ab51f6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:56.546559 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-856c4d58-5d8b-4944-b951-6d72562c1003 req-8aa1a7e1-8593-412e-bceb-1a9585275c55 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060916 Oct 04 21:31:56.548059 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2606/5241] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:56.553799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8b89daf-ee4f-4bff-bd0f-91df32ab51f6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:56.554544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8b89daf-ee4f-4bff-bd0f-91df32ab51f6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:56.555340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8b89daf-ee4f-4bff-bd0f-91df32ab51f6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:56.652000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e8b89daf-ee4f-4bff-bd0f-91df32ab51f6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:56.664150 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e8b89daf-ee4f-4bff-bd0f-91df32ab51f6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 200 len: 1293 microversion: 2.1 time: 0.150629 Oct 04 21:31:56.665409 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2636/5242] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:56 2022] GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 1293 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:56.683251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9cae1979-333c-4bbd-8529-e85c3ed86117 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:56.685122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9cae1979-333c-4bbd-8529-e85c3ed86117 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:56.695851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:56.700324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9cae1979-333c-4bbd-8529-e85c3ed86117 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:56.700949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9cae1979-333c-4bbd-8529-e85c3ed86117 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:56.701553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9cae1979-333c-4bbd-8529-e85c3ed86117 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:56.702581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9cae1979-333c-4bbd-8529-e85c3ed86117 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:56.703174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9cae1979-333c-4bbd-8529-e85c3ed86117 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:56.703735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9cae1979-333c-4bbd-8529-e85c3ed86117 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:56.818236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-456e4927-edd1-4b41-8bd8-41177fb8dddc tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:56.820734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-456e4927-edd1-4b41-8bd8-41177fb8dddc tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:56.832673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-456e4927-edd1-4b41-8bd8-41177fb8dddc tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:56.841695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-456e4927-edd1-4b41-8bd8-41177fb8dddc tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:56.844075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-456e4927-edd1-4b41-8bd8-41177fb8dddc tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:56.849533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-456e4927-edd1-4b41-8bd8-41177fb8dddc tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:56.849533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-456e4927-edd1-4b41-8bd8-41177fb8dddc tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:56.849533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-456e4927-edd1-4b41-8bd8-41177fb8dddc tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:57.083467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9cae1979-333c-4bbd-8529-e85c3ed86117 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39736b6b74749d5a0ce5f5e79ce0c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cb61f8190c492d8946116e6e296a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:57.097716 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9cae1979-333c-4bbd-8529-e85c3ed86117 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa" status: 200 len: 1217 microversion: 2.1 time: 0.422113 Oct 04 21:31:57.106682 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2607/5243] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:56 2022] GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa => generated 1217 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:57.228179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-456e4927-edd1-4b41-8bd8-41177fb8dddc tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:57.236952 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-456e4927-edd1-4b41-8bd8-41177fb8dddc tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1315 microversion: 2.1 time: 0.424609 Oct 04 21:31:57.238108 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2637/5244] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:56 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:57.693245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5d0945d4-fb56-4e95-947d-787aa963f532 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:57.694983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5d0945d4-fb56-4e95-947d-787aa963f532 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:57.716462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d0945d4-fb56-4e95-947d-787aa963f532 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:57.721694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d0945d4-fb56-4e95-947d-787aa963f532 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:57.721694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d0945d4-fb56-4e95-947d-787aa963f532 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:57.721694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d0945d4-fb56-4e95-947d-787aa963f532 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:57.721694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d0945d4-fb56-4e95-947d-787aa963f532 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:57.721694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d0945d4-fb56-4e95-947d-787aa963f532 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:57.806785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d0945d4-fb56-4e95-947d-787aa963f532 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:57.807818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d0945d4-fb56-4e95-947d-787aa963f532 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:57.811604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d0945d4-fb56-4e95-947d-787aa963f532 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:57.812416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-5d0945d4-fb56-4e95-947d-787aa963f532 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lazy-loading 'fault' on Instance uuid 12eda487-1501-4d60-84ca-f1fda387068b {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:31:57.922731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5d0945d4-fb56-4e95-947d-787aa963f532 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:57.931070 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5d0945d4-fb56-4e95-947d-787aa963f532 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 200 len: 1298 microversion: 2.1 time: 0.245461 Oct 04 21:31:57.931902 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2608/5245] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:57 2022] GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 1298 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:58.139818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2f1219c1-910a-4003-8842-1526307fd322 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:58.145163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2f1219c1-910a-4003-8842-1526307fd322 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:58.148186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f1219c1-910a-4003-8842-1526307fd322 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:58.157152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f1219c1-910a-4003-8842-1526307fd322 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:58.158517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f1219c1-910a-4003-8842-1526307fd322 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:58.159548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f1219c1-910a-4003-8842-1526307fd322 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:58.160552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f1219c1-910a-4003-8842-1526307fd322 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:58.161201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f1219c1-910a-4003-8842-1526307fd322 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:58.262521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c72510d1-4748-42d8-8e0b-8ea1efe993ca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:58.265561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c72510d1-4748-42d8-8e0b-8ea1efe993ca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:58.270669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c72510d1-4748-42d8-8e0b-8ea1efe993ca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:58.271542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c72510d1-4748-42d8-8e0b-8ea1efe993ca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:58.273393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c72510d1-4748-42d8-8e0b-8ea1efe993ca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:58.274476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c72510d1-4748-42d8-8e0b-8ea1efe993ca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:58.275211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c72510d1-4748-42d8-8e0b-8ea1efe993ca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:58.275855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c72510d1-4748-42d8-8e0b-8ea1efe993ca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:58.331111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2f1219c1-910a-4003-8842-1526307fd322 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39736b6b74749d5a0ce5f5e79ce0c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cb61f8190c492d8946116e6e296a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:58.347605 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2f1219c1-910a-4003-8842-1526307fd322 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa" status: 200 len: 1273 microversion: 2.1 time: 0.211546 Oct 04 21:31:58.349228 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2638/5246] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:58 2022] GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa => generated 1273 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:58.459395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:58.547608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c72510d1-4748-42d8-8e0b-8ea1efe993ca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:58.556936 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c72510d1-4748-42d8-8e0b-8ea1efe993ca tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1315 microversion: 2.1 time: 0.299028 Oct 04 21:31:58.560651 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2609/5247] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:58 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:58.954948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-92658f0f-a8e7-46ed-8d17-18f4da24d55b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:58.956602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-92658f0f-a8e7-46ed-8d17-18f4da24d55b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:58.963349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92658f0f-a8e7-46ed-8d17-18f4da24d55b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:58.964476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92658f0f-a8e7-46ed-8d17-18f4da24d55b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:58.965148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92658f0f-a8e7-46ed-8d17-18f4da24d55b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:58.966446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92658f0f-a8e7-46ed-8d17-18f4da24d55b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:58.967289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92658f0f-a8e7-46ed-8d17-18f4da24d55b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:58.967957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92658f0f-a8e7-46ed-8d17-18f4da24d55b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:58.988813 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-92658f0f-a8e7-46ed-8d17-18f4da24d55b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance 12eda487-1501-4d60-84ca-f1fda387068b could not be found. Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-92658f0f-a8e7-46ed-8d17-18f4da24d55b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b HTTP/1.1 Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 12eda487-1501-4d60-84ca-f1fda387068b could not be found. Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '12eda487-1501-4d60-84ca-f1fda387068b'} Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12eda487-1501-4d60-84ca-f1fda387068b could not be found. Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12eda487-1501-4d60-84ca-f1fda387068b could not be found. Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:58.990734 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:58.995858 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:58.995858 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:58.995858 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:58.995858 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:58.995858 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:58.995858 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12eda487-1501-4d60-84ca-f1fda387068b could not be found. Oct 04 21:31:58.995858 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:31:58.998439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-92658f0f-a8e7-46ed-8d17-18f4da24d55b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance 12eda487-1501-4d60-84ca-f1fda387068b could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:58.999622 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-92658f0f-a8e7-46ed-8d17-18f4da24d55b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 404 len: 111 microversion: 2.1 time: 0.048611 Oct 04 21:31:59.000809 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2639/5248] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:58 2022] GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:31:59.014155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-948a3e80-e49f-4a25-a941-943cb1563ca9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:59.016899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-948a3e80-e49f-4a25-a941-943cb1563ca9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:59.027987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-948a3e80-e49f-4a25-a941-943cb1563ca9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:59.033082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-948a3e80-e49f-4a25-a941-943cb1563ca9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:59.033082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-948a3e80-e49f-4a25-a941-943cb1563ca9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:59.036456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-948a3e80-e49f-4a25-a941-943cb1563ca9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:59.036981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-948a3e80-e49f-4a25-a941-943cb1563ca9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:59.037450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-948a3e80-e49f-4a25-a941-943cb1563ca9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:59.112370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-948a3e80-e49f-4a25-a941-943cb1563ca9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:31:59.384070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5fa3a26c-bea8-4b60-9424-0b936d20cb63 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:59.385653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5fa3a26c-bea8-4b60-9424-0b936d20cb63 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:59.397998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fa3a26c-bea8-4b60-9424-0b936d20cb63 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:59.398514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fa3a26c-bea8-4b60-9424-0b936d20cb63 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:59.400119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fa3a26c-bea8-4b60-9424-0b936d20cb63 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:59.400863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fa3a26c-bea8-4b60-9424-0b936d20cb63 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:59.401366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fa3a26c-bea8-4b60-9424-0b936d20cb63 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:59.402012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fa3a26c-bea8-4b60-9424-0b936d20cb63 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:59.592489 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-948a3e80-e49f-4a25-a941-943cb1563ca9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 204 len: 0 microversion: 2.1 time: 0.586745 Oct 04 21:31:59.594122 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2610/5249] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:31:59 2022] DELETE /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:31:59.601707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9ffda6b3-6f5c-451d-afbc-1910cb5d1d51 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:59.602703 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9ffda6b3-6f5c-451d-afbc-1910cb5d1d51 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:59.610062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ffda6b3-6f5c-451d-afbc-1910cb5d1d51 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:59.611681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ffda6b3-6f5c-451d-afbc-1910cb5d1d51 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:59.612234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ffda6b3-6f5c-451d-afbc-1910cb5d1d51 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:59.614298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ffda6b3-6f5c-451d-afbc-1910cb5d1d51 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:59.617174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ffda6b3-6f5c-451d-afbc-1910cb5d1d51 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:59.617835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ffda6b3-6f5c-451d-afbc-1910cb5d1d51 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:59.674570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5fa3a26c-bea8-4b60-9424-0b936d20cb63 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39736b6b74749d5a0ce5f5e79ce0c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cb61f8190c492d8946116e6e296a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:59.700582 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5fa3a26c-bea8-4b60-9424-0b936d20cb63 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa" status: 200 len: 1283 microversion: 2.1 time: 0.320348 Oct 04 21:31:59.704642 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2640/5250] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:59 2022] GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa => generated 1283 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:59.715589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9c94924b-941c-49ef-9a92-e56bf71c9f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:59.719861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9c94924b-941c-49ef-9a92-e56bf71c9f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:59.740873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c94924b-941c-49ef-9a92-e56bf71c9f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:59.741761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c94924b-941c-49ef-9a92-e56bf71c9f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:59.742833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c94924b-941c-49ef-9a92-e56bf71c9f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:59.743905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c94924b-941c-49ef-9a92-e56bf71c9f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:59.744588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c94924b-941c-49ef-9a92-e56bf71c9f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:59.748424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c94924b-941c-49ef-9a92-e56bf71c9f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:59.760082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:00.189921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9c94924b-941c-49ef-9a92-e56bf71c9f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:00.190260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9ffda6b3-6f5c-451d-afbc-1910cb5d1d51 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:00.199612 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9ffda6b3-6f5c-451d-afbc-1910cb5d1d51 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1315 microversion: 2.1 time: 0.603816 Oct 04 21:32:00.203413 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9c94924b-941c-49ef-9a92-e56bf71c9f99 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 200 len: 1494 microversion: 2.1 time: 0.497267 Oct 04 21:32:00.204971 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2641/5251] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:59 2022] GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 1494 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:00.209165 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2611/5252] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:59 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1315 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:00.741326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6c716079-3d1d-4f93-99bc-c66f35622b26 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:00.743866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6c716079-3d1d-4f93-99bc-c66f35622b26 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:00.759607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c716079-3d1d-4f93-99bc-c66f35622b26 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:00.760467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c716079-3d1d-4f93-99bc-c66f35622b26 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:00.761265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c716079-3d1d-4f93-99bc-c66f35622b26 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:00.764428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c716079-3d1d-4f93-99bc-c66f35622b26 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:00.766347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c716079-3d1d-4f93-99bc-c66f35622b26 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:00.767822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c716079-3d1d-4f93-99bc-c66f35622b26 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:01.233498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-14b6ed9c-2075-4995-bde4-91b76c793022 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:01.239437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-14b6ed9c-2075-4995-bde4-91b76c793022 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:01.239437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:01.257141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14b6ed9c-2075-4995-bde4-91b76c793022 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:01.257966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14b6ed9c-2075-4995-bde4-91b76c793022 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:01.258608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14b6ed9c-2075-4995-bde4-91b76c793022 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:01.259598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14b6ed9c-2075-4995-bde4-91b76c793022 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:01.260240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14b6ed9c-2075-4995-bde4-91b76c793022 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:01.265596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14b6ed9c-2075-4995-bde4-91b76c793022 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:01.350571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6c716079-3d1d-4f93-99bc-c66f35622b26 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39736b6b74749d5a0ce5f5e79ce0c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cb61f8190c492d8946116e6e296a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:01.359656 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6c716079-3d1d-4f93-99bc-c66f35622b26 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa" status: 200 len: 1313 microversion: 2.1 time: 0.633512 Oct 04 21:32:01.377942 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2642/5253] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:00 2022] GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa => generated 1313 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:01.388906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c76d4abc-7f9c-48d3-97be-962da9586f33 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:01.389578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c76d4abc-7f9c-48d3-97be-962da9586f33 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:01.409962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c76d4abc-7f9c-48d3-97be-962da9586f33 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:01.411130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c76d4abc-7f9c-48d3-97be-962da9586f33 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:01.413598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c76d4abc-7f9c-48d3-97be-962da9586f33 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:01.422778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c76d4abc-7f9c-48d3-97be-962da9586f33 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:01.423782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c76d4abc-7f9c-48d3-97be-962da9586f33 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:01.424472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c76d4abc-7f9c-48d3-97be-962da9586f33 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:01.897519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-14b6ed9c-2075-4995-bde4-91b76c793022 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:01.907785 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-14b6ed9c-2075-4995-bde4-91b76c793022 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 200 len: 1494 microversion: 2.1 time: 0.679542 Oct 04 21:32:01.918253 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2612/5254] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:01 2022] GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 1494 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:01.926850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c76d4abc-7f9c-48d3-97be-962da9586f33 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:01.945675 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c76d4abc-7f9c-48d3-97be-962da9586f33 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1315 microversion: 2.1 time: 0.566362 Oct 04 21:32:01.946275 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2643/5255] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:01 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1315 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:02.278539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-d57d0f47-e088-4b5f-8ccf-ff8c83a4810e req-6cba1a9f-3f53-4f8e-90d3-0a4ccc39dcae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad0bd930-32ff-4587-8b22-bb47d1fe061d", "name": "network-vif-deleted", "tag": "6a83316d-6559-4953-9aeb-d55e81ed0229"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:02.298351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d57d0f47-e088-4b5f-8ccf-ff8c83a4810e req-6cba1a9f-3f53-4f8e-90d3-0a4ccc39dcae service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:02.302545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d57d0f47-e088-4b5f-8ccf-ff8c83a4810e req-6cba1a9f-3f53-4f8e-90d3-0a4ccc39dcae service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:02.303142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d57d0f47-e088-4b5f-8ccf-ff8c83a4810e req-6cba1a9f-3f53-4f8e-90d3-0a4ccc39dcae service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:02.318997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:02.329174 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-d57d0f47-e088-4b5f-8ccf-ff8c83a4810e req-6cba1a9f-3f53-4f8e-90d3-0a4ccc39dcae service nova] Creating event network-vif-deleted:6a83316d-6559-4953-9aeb-d55e81ed0229 for instance ad0bd930-32ff-4587-8b22-bb47d1fe061d on n-h1-860282-1 Oct 04 21:32:02.337783 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-d57d0f47-e088-4b5f-8ccf-ff8c83a4810e req-6cba1a9f-3f53-4f8e-90d3-0a4ccc39dcae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063685 Oct 04 21:32:02.341006 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2613/5256] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:02.394496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-69e093fa-995e-45f5-af12-7b4c32be7b9a tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:02.395079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-69e093fa-995e-45f5-af12-7b4c32be7b9a tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:02.403431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69e093fa-995e-45f5-af12-7b4c32be7b9a tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:02.403936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69e093fa-995e-45f5-af12-7b4c32be7b9a tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:02.405076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69e093fa-995e-45f5-af12-7b4c32be7b9a tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:02.406519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69e093fa-995e-45f5-af12-7b4c32be7b9a tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:02.407179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69e093fa-995e-45f5-af12-7b4c32be7b9a tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:02.407932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69e093fa-995e-45f5-af12-7b4c32be7b9a tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:02.749483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-69e093fa-995e-45f5-af12-7b4c32be7b9a tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39736b6b74749d5a0ce5f5e79ce0c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cb61f8190c492d8946116e6e296a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:02.775031 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-69e093fa-995e-45f5-af12-7b4c32be7b9a tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa" status: 200 len: 1313 microversion: 2.1 time: 0.384631 Oct 04 21:32:02.778135 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2644/5257] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:02 2022] GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:02.800271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-51a26ca6-1457-4da8-bbe1-c4027f117930 req-4f0ca7aa-787a-4c9c-99ee-c0b0e48b2209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "841e7266-1e45-49f1-8c5a-8dd479fcf958", "name": "network-vif-plugged", "status": "completed", "tag": "651c41bb-ced3-4be1-aacd-e2e20677f0d5"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:02.811327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-51a26ca6-1457-4da8-bbe1-c4027f117930 req-4f0ca7aa-787a-4c9c-99ee-c0b0e48b2209 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:02.816537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-51a26ca6-1457-4da8-bbe1-c4027f117930 req-4f0ca7aa-787a-4c9c-99ee-c0b0e48b2209 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:02.816537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-51a26ca6-1457-4da8-bbe1-c4027f117930 req-4f0ca7aa-787a-4c9c-99ee-c0b0e48b2209 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:02.827139 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-51a26ca6-1457-4da8-bbe1-c4027f117930 req-4f0ca7aa-787a-4c9c-99ee-c0b0e48b2209 service nova] Creating event network-vif-plugged:651c41bb-ced3-4be1-aacd-e2e20677f0d5 for instance 841e7266-1e45-49f1-8c5a-8dd479fcf958 on n-h1-860282-1 Oct 04 21:32:02.832798 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-51a26ca6-1457-4da8-bbe1-c4027f117930 req-4f0ca7aa-787a-4c9c-99ee-c0b0e48b2209 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037534 Oct 04 21:32:02.834071 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2614/5258] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:02.930281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-f759a69a-bf55-4c07-be60-1fd2af16ef9e req-e480fc66-5509-4abf-ae2e-ea4148edab07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa", "tag": "ce872974-527c-4b60-8abb-787c79c9180b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:02.935499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-eaffa6cb-97ff-460a-a695-2a4ca53850e9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:02.936357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-eaffa6cb-97ff-460a-a695-2a4ca53850e9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:02.942316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f759a69a-bf55-4c07-be60-1fd2af16ef9e req-e480fc66-5509-4abf-ae2e-ea4148edab07 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:02.942877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f759a69a-bf55-4c07-be60-1fd2af16ef9e req-e480fc66-5509-4abf-ae2e-ea4148edab07 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:02.943319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f759a69a-bf55-4c07-be60-1fd2af16ef9e req-e480fc66-5509-4abf-ae2e-ea4148edab07 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:02.947023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eaffa6cb-97ff-460a-a695-2a4ca53850e9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:02.947907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eaffa6cb-97ff-460a-a695-2a4ca53850e9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:02.953696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eaffa6cb-97ff-460a-a695-2a4ca53850e9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:02.953696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eaffa6cb-97ff-460a-a695-2a4ca53850e9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:02.953696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eaffa6cb-97ff-460a-a695-2a4ca53850e9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:02.953696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eaffa6cb-97ff-460a-a695-2a4ca53850e9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:02.972540 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-f759a69a-bf55-4c07-be60-1fd2af16ef9e req-e480fc66-5509-4abf-ae2e-ea4148edab07 service nova] Creating event network-changed:ce872974-527c-4b60-8abb-787c79c9180b for instance 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa on n-h1-860282-1 Oct 04 21:32:02.985744 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-f759a69a-bf55-4c07-be60-1fd2af16ef9e req-e480fc66-5509-4abf-ae2e-ea4148edab07 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061955 Oct 04 21:32:02.987032 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2645/5259] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:03.001310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-37b08e1a-6657-44fe-88fc-3cd7b4797cb1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:03.002337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-37b08e1a-6657-44fe-88fc-3cd7b4797cb1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:03.011371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37b08e1a-6657-44fe-88fc-3cd7b4797cb1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:03.012068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37b08e1a-6657-44fe-88fc-3cd7b4797cb1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:03.012737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37b08e1a-6657-44fe-88fc-3cd7b4797cb1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:03.013719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37b08e1a-6657-44fe-88fc-3cd7b4797cb1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:03.013857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eaffa6cb-97ff-460a-a695-2a4ca53850e9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:03.014727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eaffa6cb-97ff-460a-a695-2a4ca53850e9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:03.015074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37b08e1a-6657-44fe-88fc-3cd7b4797cb1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:03.015573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37b08e1a-6657-44fe-88fc-3cd7b4797cb1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:03.015714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eaffa6cb-97ff-460a-a695-2a4ca53850e9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:03.016319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-eaffa6cb-97ff-460a-a695-2a4ca53850e9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lazy-loading 'fault' on Instance uuid ad0bd930-32ff-4587-8b22-bb47d1fe061d {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:32:03.161854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-eaffa6cb-97ff-460a-a695-2a4ca53850e9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:03.178139 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-eaffa6cb-97ff-460a-a695-2a4ca53850e9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 200 len: 1298 microversion: 2.1 time: 0.248891 Oct 04 21:32:03.179435 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2615/5260] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:02 2022] GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 1298 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:03.306855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-37b08e1a-6657-44fe-88fc-3cd7b4797cb1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:03.320368 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-37b08e1a-6657-44fe-88fc-3cd7b4797cb1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1315 microversion: 2.1 time: 0.329765 Oct 04 21:32:03.321280 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2646/5261] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:02 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:03.799328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f27885b2-26c8-4a2f-8bb8-69ef4cc8361b tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:03.800073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f27885b2-26c8-4a2f-8bb8-69ef4cc8361b tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:03.807114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f27885b2-26c8-4a2f-8bb8-69ef4cc8361b tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:03.808192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f27885b2-26c8-4a2f-8bb8-69ef4cc8361b tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:03.808635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f27885b2-26c8-4a2f-8bb8-69ef4cc8361b tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:03.809323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f27885b2-26c8-4a2f-8bb8-69ef4cc8361b tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:03.809807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f27885b2-26c8-4a2f-8bb8-69ef4cc8361b tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:03.810264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f27885b2-26c8-4a2f-8bb8-69ef4cc8361b tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:04.027289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f27885b2-26c8-4a2f-8bb8-69ef4cc8361b tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39736b6b74749d5a0ce5f5e79ce0c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cb61f8190c492d8946116e6e296a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:04.040117 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f27885b2-26c8-4a2f-8bb8-69ef4cc8361b tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa" status: 200 len: 1313 microversion: 2.1 time: 0.244732 Oct 04 21:32:04.041071 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2616/5262] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:03 2022] GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:04.202678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5fbf9834-289d-4d65-9ef3-5b3b7a6df5a3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:04.203325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5fbf9834-289d-4d65-9ef3-5b3b7a6df5a3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:04.206139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:04.210969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fbf9834-289d-4d65-9ef3-5b3b7a6df5a3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:04.211461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fbf9834-289d-4d65-9ef3-5b3b7a6df5a3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:04.211907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fbf9834-289d-4d65-9ef3-5b3b7a6df5a3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:04.212603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fbf9834-289d-4d65-9ef3-5b3b7a6df5a3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:04.213164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fbf9834-289d-4d65-9ef3-5b3b7a6df5a3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:04.213507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fbf9834-289d-4d65-9ef3-5b3b7a6df5a3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:04.230798 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-5fbf9834-289d-4d65-9ef3-5b3b7a6df5a3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance ad0bd930-32ff-4587-8b22-bb47d1fe061d could not be found. Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5fbf9834-289d-4d65-9ef3-5b3b7a6df5a3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d HTTP/1.1 Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance ad0bd930-32ff-4587-8b22-bb47d1fe061d could not be found. Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'ad0bd930-32ff-4587-8b22-bb47d1fe061d'} Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad0bd930-32ff-4587-8b22-bb47d1fe061d could not be found. Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad0bd930-32ff-4587-8b22-bb47d1fe061d could not be found. Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:32:04.232738 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:32:04.238210 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:32:04.238210 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:32:04.238210 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:32:04.238210 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:32:04.238210 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:32:04.238210 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad0bd930-32ff-4587-8b22-bb47d1fe061d could not be found. Oct 04 21:32:04.238210 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:32:04.239718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5fbf9834-289d-4d65-9ef3-5b3b7a6df5a3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance ad0bd930-32ff-4587-8b22-bb47d1fe061d could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:32:04.240828 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5fbf9834-289d-4d65-9ef3-5b3b7a6df5a3 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 404 len: 111 microversion: 2.1 time: 0.042516 Oct 04 21:32:04.241687 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2647/5263] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:04 2022] GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:32:04.345107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fe1b1244-e4c1-443e-8a32-52d72fb04c9d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:04.345772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fe1b1244-e4c1-443e-8a32-52d72fb04c9d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:04.352192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe1b1244-e4c1-443e-8a32-52d72fb04c9d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:04.352697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe1b1244-e4c1-443e-8a32-52d72fb04c9d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:04.353193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe1b1244-e4c1-443e-8a32-52d72fb04c9d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:04.353948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe1b1244-e4c1-443e-8a32-52d72fb04c9d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:04.354422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe1b1244-e4c1-443e-8a32-52d72fb04c9d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:04.360861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe1b1244-e4c1-443e-8a32-52d72fb04c9d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:04.443125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8020157b-486f-4930-abfe-3c00bb2cc5b5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1291979763", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "f9328395-b63c-4f5a-9d32-23fa7cfe6c6d"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:04.519811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-8020157b-486f-4930-abfe-3c00bb2cc5b5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] validate_networks() for [('f9328395-b63c-4f5a-9d32-23fa7cfe6c6d', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:32:04.663398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fe1b1244-e4c1-443e-8a32-52d72fb04c9d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:04.672278 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fe1b1244-e4c1-443e-8a32-52d72fb04c9d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1315 microversion: 2.1 time: 0.331417 Oct 04 21:32:04.673345 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2617/5264] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:04 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:05.289795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0f6197e6-3511-4273-99e0-ad61d3612e17 tempest-ExtensionsTest-455860599 tempest-ExtensionsTest-455860599-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:05.292449 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0f6197e6-3511-4273-99e0-ad61d3612e17 tempest-ExtensionsTest-455860599 tempest-ExtensionsTest-455860599-project] 10.222.0.30 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.258704 Oct 04 21:32:05.293003 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2618/5265] 10.222.0.30 () {58 vars in 1170 bytes} [Tue Oct 4 21:32:05 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:05.297912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-475d601f-aee2-46a9-9904-0708ac9f57c5 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:05.298532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-475d601f-aee2-46a9-9904-0708ac9f57c5 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:05.299553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-8020157b-486f-4930-abfe-3c00bb2cc5b5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:32:05.300050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-8020157b-486f-4930-abfe-3c00bb2cc5b5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:32:05.300546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-8020157b-486f-4930-abfe-3c00bb2cc5b5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:32:05.300990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-8020157b-486f-4930-abfe-3c00bb2cc5b5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:32:05.301406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-8020157b-486f-4930-abfe-3c00bb2cc5b5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:32:05.304884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-475d601f-aee2-46a9-9904-0708ac9f57c5 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:05.305386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-475d601f-aee2-46a9-9904-0708ac9f57c5 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:05.305864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-475d601f-aee2-46a9-9904-0708ac9f57c5 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:05.306678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-475d601f-aee2-46a9-9904-0708ac9f57c5 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:05.307287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-475d601f-aee2-46a9-9904-0708ac9f57c5 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:05.308344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-475d601f-aee2-46a9-9904-0708ac9f57c5 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:05.312173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8020157b-486f-4930-abfe-3c00bb2cc5b5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:05.315688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8020157b-486f-4930-abfe-3c00bb2cc5b5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:05.315688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8020157b-486f-4930-abfe-3c00bb2cc5b5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:05.315688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8020157b-486f-4930-abfe-3c00bb2cc5b5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:05.315688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8020157b-486f-4930-abfe-3c00bb2cc5b5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:05.315688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8020157b-486f-4930-abfe-3c00bb2cc5b5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:05.331030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:05.336190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-8020157b-486f-4930-abfe-3c00bb2cc5b5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Getting quotas for project fde68efb46fc44b5b0d83138b9048f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:32:05.343020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-8020157b-486f-4930-abfe-3c00bb2cc5b5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Getting quotas for user b9289c5fa9844ae3bb1c797bdab5c56c and project fde68efb46fc44b5b0d83138b9048f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:32:05.360644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8020157b-486f-4930-abfe-3c00bb2cc5b5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:32:05.363413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8020157b-486f-4930-abfe-3c00bb2cc5b5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:32:05.451641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-475d601f-aee2-46a9-9904-0708ac9f57c5 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39736b6b74749d5a0ce5f5e79ce0c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cb61f8190c492d8946116e6e296a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:05.459686 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-475d601f-aee2-46a9-9904-0708ac9f57c5 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa" status: 200 len: 1313 microversion: 2.1 time: 0.165515 Oct 04 21:32:05.460259 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2619/5266] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:05 2022] GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:05.464753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0f8bbcab-21a3-47c6-8b44-e060d0016583 tempest-ExtensionsTest-455860599 tempest-ExtensionsTest-455860599-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:05.466804 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0f8bbcab-21a3-47c6-8b44-e060d0016583 tempest-ExtensionsTest-455860599 tempest-ExtensionsTest-455860599-project] 10.222.0.30 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.005619 Oct 04 21:32:05.467332 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2620/5267] 10.222.0.30 () {58 vars in 1134 bytes} [Tue Oct 4 21:32:05 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:32:05.552338 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8020157b-486f-4930-abfe-3c00bb2cc5b5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.114910 Oct 04 21:32:05.567549 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2648/5268] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:32:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:32:05.572605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-48033825-7ce7-4753-9fb4-bf16cd99e070 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:05.573909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-48033825-7ce7-4753-9fb4-bf16cd99e070 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:05.634927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-48033825-7ce7-4753-9fb4-bf16cd99e070 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:05.643210 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-48033825-7ce7-4753-9fb4-bf16cd99e070 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 200 len: 1209 microversion: 2.1 time: 0.074322 Oct 04 21:32:05.643939 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2621/5269] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:05 2022] GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 1209 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:05.699569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e05a6c73-1d5a-4700-9b85-9a1f983ae55a tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:05.700200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e05a6c73-1d5a-4700-9b85-9a1f983ae55a tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:05.706759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e05a6c73-1d5a-4700-9b85-9a1f983ae55a tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:05.707257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e05a6c73-1d5a-4700-9b85-9a1f983ae55a tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:05.707697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e05a6c73-1d5a-4700-9b85-9a1f983ae55a tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:05.708702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e05a6c73-1d5a-4700-9b85-9a1f983ae55a tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:05.709166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e05a6c73-1d5a-4700-9b85-9a1f983ae55a tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:05.709645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e05a6c73-1d5a-4700-9b85-9a1f983ae55a tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:05.860381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e05a6c73-1d5a-4700-9b85-9a1f983ae55a tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:05.871691 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e05a6c73-1d5a-4700-9b85-9a1f983ae55a tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1502 microversion: 2.1 time: 0.178374 Oct 04 21:32:05.872277 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2649/5270] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:05 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1502 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:05.896001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5ddccbef-37eb-4184-9462-778b1329ef6b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:05.896611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5ddccbef-37eb-4184-9462-778b1329ef6b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:05.903350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ddccbef-37eb-4184-9462-778b1329ef6b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:05.903857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ddccbef-37eb-4184-9462-778b1329ef6b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:05.904289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ddccbef-37eb-4184-9462-778b1329ef6b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:05.904973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ddccbef-37eb-4184-9462-778b1329ef6b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:05.905446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ddccbef-37eb-4184-9462-778b1329ef6b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:05.905882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ddccbef-37eb-4184-9462-778b1329ef6b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:06.049787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5ddccbef-37eb-4184-9462-778b1329ef6b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:06.057792 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5ddccbef-37eb-4184-9462-778b1329ef6b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1502 microversion: 2.1 time: 0.165660 Oct 04 21:32:06.066686 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2622/5271] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:05 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:06.086094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6983dd30-a1bb-424a-9dc7-b614a6eb0ccf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:06.091626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6983dd30-a1bb-424a-9dc7-b614a6eb0ccf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:06.094585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6983dd30-a1bb-424a-9dc7-b614a6eb0ccf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:06.095301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6983dd30-a1bb-424a-9dc7-b614a6eb0ccf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:06.096086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6983dd30-a1bb-424a-9dc7-b614a6eb0ccf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:06.097319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6983dd30-a1bb-424a-9dc7-b614a6eb0ccf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:06.098109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6983dd30-a1bb-424a-9dc7-b614a6eb0ccf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:06.098732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6983dd30-a1bb-424a-9dc7-b614a6eb0ccf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:06.124410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-6983dd30-a1bb-424a-9dc7-b614a6eb0ccf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lazy-loading 'flavor' on Instance uuid 841e7266-1e45-49f1-8c5a-8dd479fcf958 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:32:06.483864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-594c6c30-c8ba-4712-9937-334bd55c91fd tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:06.484619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-594c6c30-c8ba-4712-9937-334bd55c91fd tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:06.491267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-594c6c30-c8ba-4712-9937-334bd55c91fd tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:06.492072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-594c6c30-c8ba-4712-9937-334bd55c91fd tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:06.492499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-594c6c30-c8ba-4712-9937-334bd55c91fd tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:06.493199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-594c6c30-c8ba-4712-9937-334bd55c91fd tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:06.493681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-594c6c30-c8ba-4712-9937-334bd55c91fd tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:06.494202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-594c6c30-c8ba-4712-9937-334bd55c91fd tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:06.545247 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6983dd30-a1bb-424a-9dc7-b614a6eb0ccf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "POST /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958/action" status: 202 len: 0 microversion: 2.1 time: 0.463553 Oct 04 21:32:06.547235 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2650/5272] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:32:06 2022] POST /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:32:06.569150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d670d657-511f-4de6-bc72-c1273b1df357 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:06.569150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d670d657-511f-4de6-bc72-c1273b1df357 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:06.582275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d670d657-511f-4de6-bc72-c1273b1df357 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:06.582835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d670d657-511f-4de6-bc72-c1273b1df357 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:06.583336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d670d657-511f-4de6-bc72-c1273b1df357 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:06.584001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d670d657-511f-4de6-bc72-c1273b1df357 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:06.584485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d670d657-511f-4de6-bc72-c1273b1df357 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:06.585031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d670d657-511f-4de6-bc72-c1273b1df357 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:06.738382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-594c6c30-c8ba-4712-9937-334bd55c91fd tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39736b6b74749d5a0ce5f5e79ce0c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cb61f8190c492d8946116e6e296a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:06.751252 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-594c6c30-c8ba-4712-9937-334bd55c91fd tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa" status: 200 len: 1313 microversion: 2.1 time: 0.271742 Oct 04 21:32:06.765602 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2623/5273] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:06 2022] GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:06.768853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d670d657-511f-4de6-bc72-c1273b1df357 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:06.777528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d7c86ace-7260-4f17-95e9-dc7432ec9cc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:06.778013 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d670d657-511f-4de6-bc72-c1273b1df357 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1510 microversion: 2.1 time: 0.223819 Oct 04 21:32:06.778445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d7c86ace-7260-4f17-95e9-dc7432ec9cc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:06.779324 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2651/5274] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:06 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:06.795579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7c86ace-7260-4f17-95e9-dc7432ec9cc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:06.796074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7c86ace-7260-4f17-95e9-dc7432ec9cc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:06.796517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7c86ace-7260-4f17-95e9-dc7432ec9cc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:06.797226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7c86ace-7260-4f17-95e9-dc7432ec9cc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:06.797720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7c86ace-7260-4f17-95e9-dc7432ec9cc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:06.798159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7c86ace-7260-4f17-95e9-dc7432ec9cc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:06.866523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d7c86ace-7260-4f17-95e9-dc7432ec9cc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:06.878635 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d7c86ace-7260-4f17-95e9-dc7432ec9cc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 200 len: 1213 microversion: 2.1 time: 0.111329 Oct 04 21:32:06.889521 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2624/5275] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:06 2022] GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 1213 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:07.782030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6b0e0a62-940c-4fb0-b9de-0207d67ce77c tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:07.782030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6b0e0a62-940c-4fb0-b9de-0207d67ce77c tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:07.789397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b0e0a62-940c-4fb0-b9de-0207d67ce77c tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:07.789917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b0e0a62-940c-4fb0-b9de-0207d67ce77c tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:07.790366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b0e0a62-940c-4fb0-b9de-0207d67ce77c tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:07.791080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b0e0a62-940c-4fb0-b9de-0207d67ce77c tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:07.791544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b0e0a62-940c-4fb0-b9de-0207d67ce77c tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:07.792073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b0e0a62-940c-4fb0-b9de-0207d67ce77c tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:07.804371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8ae5347a-a978-404f-afd0-a40bee7b68a9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:07.804987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8ae5347a-a978-404f-afd0-a40bee7b68a9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:07.812045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ae5347a-a978-404f-afd0-a40bee7b68a9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:07.812533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ae5347a-a978-404f-afd0-a40bee7b68a9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:07.812974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ae5347a-a978-404f-afd0-a40bee7b68a9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:07.813701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ae5347a-a978-404f-afd0-a40bee7b68a9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:07.814159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ae5347a-a978-404f-afd0-a40bee7b68a9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:07.814591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ae5347a-a978-404f-afd0-a40bee7b68a9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:08.016193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6b0e0a62-940c-4fb0-b9de-0207d67ce77c tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39736b6b74749d5a0ce5f5e79ce0c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cb61f8190c492d8946116e6e296a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:08.016364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8ae5347a-a978-404f-afd0-a40bee7b68a9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:08.022514 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8ae5347a-a978-404f-afd0-a40bee7b68a9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1493 microversion: 2.1 time: 0.222114 Oct 04 21:32:08.023135 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6b0e0a62-940c-4fb0-b9de-0207d67ce77c tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa" status: 200 len: 1313 microversion: 2.1 time: 0.246198 Oct 04 21:32:08.023606 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2625/5276] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:07 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1493 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:08.026721 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2652/5277] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:07 2022] GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:08.028772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-87a43daf-a27a-4839-b17c-4af02928105d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:08.029379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-87a43daf-a27a-4839-b17c-4af02928105d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:08.036364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87a43daf-a27a-4839-b17c-4af02928105d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:08.037078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87a43daf-a27a-4839-b17c-4af02928105d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:08.037713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87a43daf-a27a-4839-b17c-4af02928105d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:08.038655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87a43daf-a27a-4839-b17c-4af02928105d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:08.045789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87a43daf-a27a-4839-b17c-4af02928105d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:08.046567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87a43daf-a27a-4839-b17c-4af02928105d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:08.063931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f49c73c6-af3e-4158-a23d-264ca7e4143c tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:08.064588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f49c73c6-af3e-4158-a23d-264ca7e4143c tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:08.072544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f49c73c6-af3e-4158-a23d-264ca7e4143c tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:08.073095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f49c73c6-af3e-4158-a23d-264ca7e4143c tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:08.074605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f49c73c6-af3e-4158-a23d-264ca7e4143c tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:08.075371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f49c73c6-af3e-4158-a23d-264ca7e4143c tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:08.075847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f49c73c6-af3e-4158-a23d-264ca7e4143c tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:08.076292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f49c73c6-af3e-4158-a23d-264ca7e4143c tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:08.165252 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-87a43daf-a27a-4839-b17c-4af02928105d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:08.180053 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-87a43daf-a27a-4839-b17c-4af02928105d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 200 len: 1269 microversion: 2.1 time: 0.155098 Oct 04 21:32:08.181605 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2626/5278] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:08 2022] GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:08.326303 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f49c73c6-af3e-4158-a23d-264ca7e4143c tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "POST /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958/action" status: 202 len: 0 microversion: 2.1 time: 0.268723 Oct 04 21:32:08.327396 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2653/5279] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:32:08 2022] POST /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:32:08.336093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-722450e5-0010-44b7-ba8e-081d87796c8d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:08.337128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-722450e5-0010-44b7-ba8e-081d87796c8d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:08.344951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-722450e5-0010-44b7-ba8e-081d87796c8d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:08.346298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-722450e5-0010-44b7-ba8e-081d87796c8d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:08.347097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-722450e5-0010-44b7-ba8e-081d87796c8d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:08.348152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-722450e5-0010-44b7-ba8e-081d87796c8d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:08.349046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-722450e5-0010-44b7-ba8e-081d87796c8d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:08.362408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-722450e5-0010-44b7-ba8e-081d87796c8d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:08.617334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-722450e5-0010-44b7-ba8e-081d87796c8d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:08.631289 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-722450e5-0010-44b7-ba8e-081d87796c8d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1499 microversion: 2.1 time: 0.299819 Oct 04 21:32:08.645460 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2627/5280] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:08 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1499 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:08.716222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-4c20db68-2459-449a-b979-4e705222243e req-9096e418-95a7-46b9-9b73-ba7479ba7996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa", "name": "network-vif-plugged", "status": "completed", "tag": "ce872974-527c-4b60-8abb-787c79c9180b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:08.731493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4c20db68-2459-449a-b979-4e705222243e req-9096e418-95a7-46b9-9b73-ba7479ba7996 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:08.732250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4c20db68-2459-449a-b979-4e705222243e req-9096e418-95a7-46b9-9b73-ba7479ba7996 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:08.732917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4c20db68-2459-449a-b979-4e705222243e req-9096e418-95a7-46b9-9b73-ba7479ba7996 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:08.748138 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-4c20db68-2459-449a-b979-4e705222243e req-9096e418-95a7-46b9-9b73-ba7479ba7996 service nova] Creating event network-vif-plugged:ce872974-527c-4b60-8abb-787c79c9180b for instance 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa on n-h1-860282-1 Oct 04 21:32:08.754203 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-4c20db68-2459-449a-b979-4e705222243e req-9096e418-95a7-46b9-9b73-ba7479ba7996 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046252 Oct 04 21:32:08.755083 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2654/5281] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:09.053160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-927dfa37-f56b-46bc-928e-d456df797006 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:09.054651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-927dfa37-f56b-46bc-928e-d456df797006 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:09.063219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-927dfa37-f56b-46bc-928e-d456df797006 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:09.064051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-927dfa37-f56b-46bc-928e-d456df797006 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:09.064833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-927dfa37-f56b-46bc-928e-d456df797006 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:09.066031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-927dfa37-f56b-46bc-928e-d456df797006 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:09.067048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-927dfa37-f56b-46bc-928e-d456df797006 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:09.068021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-927dfa37-f56b-46bc-928e-d456df797006 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:09.206478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-29063685-6c8c-4418-aaf7-c1136b1da3c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:09.207472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-29063685-6c8c-4418-aaf7-c1136b1da3c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:09.214758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29063685-6c8c-4418-aaf7-c1136b1da3c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:09.215232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29063685-6c8c-4418-aaf7-c1136b1da3c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:09.215669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29063685-6c8c-4418-aaf7-c1136b1da3c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:09.216374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29063685-6c8c-4418-aaf7-c1136b1da3c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:09.217046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29063685-6c8c-4418-aaf7-c1136b1da3c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:09.217616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29063685-6c8c-4418-aaf7-c1136b1da3c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:09.330734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-29063685-6c8c-4418-aaf7-c1136b1da3c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:09.339570 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-29063685-6c8c-4418-aaf7-c1136b1da3c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 200 len: 1267 microversion: 2.1 time: 0.137624 Oct 04 21:32:09.340236 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2655/5282] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:09 2022] GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:09.382813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-927dfa37-f56b-46bc-928e-d456df797006 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39736b6b74749d5a0ce5f5e79ce0c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cb61f8190c492d8946116e6e296a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:09.391199 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-927dfa37-f56b-46bc-928e-d456df797006 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa" status: 200 len: 1313 microversion: 2.1 time: 0.342973 Oct 04 21:32:09.391783 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2628/5283] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:09 2022] GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:09.655774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0fff7f93-ab55-4ee4-844f-f07a3251f441 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:09.656641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0fff7f93-ab55-4ee4-844f-f07a3251f441 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:09.663384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fff7f93-ab55-4ee4-844f-f07a3251f441 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:09.668994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fff7f93-ab55-4ee4-844f-f07a3251f441 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:09.668994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fff7f93-ab55-4ee4-844f-f07a3251f441 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:09.668994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fff7f93-ab55-4ee4-844f-f07a3251f441 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:09.668994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fff7f93-ab55-4ee4-844f-f07a3251f441 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:09.668994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fff7f93-ab55-4ee4-844f-f07a3251f441 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:09.877586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0fff7f93-ab55-4ee4-844f-f07a3251f441 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:09.895704 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0fff7f93-ab55-4ee4-844f-f07a3251f441 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1499 microversion: 2.1 time: 0.242512 Oct 04 21:32:09.895704 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2656/5284] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:09 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1499 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:10.363195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bbd7c63c-3a69-47fe-873a-2184fd3140d8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:10.364222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bbd7c63c-3a69-47fe-873a-2184fd3140d8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:10.372299 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbd7c63c-3a69-47fe-873a-2184fd3140d8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:10.373226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbd7c63c-3a69-47fe-873a-2184fd3140d8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:10.374028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbd7c63c-3a69-47fe-873a-2184fd3140d8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:10.375312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbd7c63c-3a69-47fe-873a-2184fd3140d8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:10.379317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbd7c63c-3a69-47fe-873a-2184fd3140d8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:10.379317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbd7c63c-3a69-47fe-873a-2184fd3140d8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:10.415262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bd338867-5eaf-4689-9144-60502e585ccc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:10.416485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bd338867-5eaf-4689-9144-60502e585ccc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:10.425133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd338867-5eaf-4689-9144-60502e585ccc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:10.425965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd338867-5eaf-4689-9144-60502e585ccc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:10.427279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd338867-5eaf-4689-9144-60502e585ccc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:10.428216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd338867-5eaf-4689-9144-60502e585ccc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:10.429183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd338867-5eaf-4689-9144-60502e585ccc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:10.429811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd338867-5eaf-4689-9144-60502e585ccc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:10.632129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bbd7c63c-3a69-47fe-873a-2184fd3140d8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:10.654040 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bbd7c63c-3a69-47fe-873a-2184fd3140d8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 200 len: 1309 microversion: 2.1 time: 0.295060 Oct 04 21:32:10.673088 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2629/5285] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:10 2022] GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 1309 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:10.747592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bd338867-5eaf-4689-9144-60502e585ccc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39736b6b74749d5a0ce5f5e79ce0c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cb61f8190c492d8946116e6e296a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:10.752608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:10.766621 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bd338867-5eaf-4689-9144-60502e585ccc tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa" status: 200 len: 1462 microversion: 2.1 time: 0.355169 Oct 04 21:32:10.767522 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2657/5286] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:10 2022] GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa => generated 1462 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:10.801902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2b85a01e-268b-49aa-91bf-4b54fc745a0c tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9655fa30-406f-4450-87cd-1729a62d2bf3", "device": "/dev/sdb"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:10.805214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2b85a01e-268b-49aa-91bf-4b54fc745a0c tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:10.819865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b85a01e-268b-49aa-91bf-4b54fc745a0c tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:10.821089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b85a01e-268b-49aa-91bf-4b54fc745a0c tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:10.821787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b85a01e-268b-49aa-91bf-4b54fc745a0c tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:10.822695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b85a01e-268b-49aa-91bf-4b54fc745a0c tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:10.825483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b85a01e-268b-49aa-91bf-4b54fc745a0c tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:10.826307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b85a01e-268b-49aa-91bf-4b54fc745a0c tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:10.924168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-09296164-6429-4b03-8e08-93648f8984df tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:10.925091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-09296164-6429-4b03-8e08-93648f8984df tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:10.936970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09296164-6429-4b03-8e08-93648f8984df tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:10.940134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09296164-6429-4b03-8e08-93648f8984df tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:10.940134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09296164-6429-4b03-8e08-93648f8984df tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:10.954294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09296164-6429-4b03-8e08-93648f8984df tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:10.957821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09296164-6429-4b03-8e08-93648f8984df tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:10.961585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09296164-6429-4b03-8e08-93648f8984df tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:11.254096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-09296164-6429-4b03-8e08-93648f8984df tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:11.262474 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-09296164-6429-4b03-8e08-93648f8984df tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1499 microversion: 2.1 time: 0.344115 Oct 04 21:32:11.277693 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2658/5287] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:10 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1499 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:11.405083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-7093d90f-4241-4077-bb04-d54e091f78a5 req-a7005b08-e2f4-4b27-aa14-ae459dacb1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43821a2b-4f04-44d3-8970-18ac72e94470", "tag": "9ca17a81-5b3d-4435-9395-09aa502f24f6"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:11.418116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7093d90f-4241-4077-bb04-d54e091f78a5 req-a7005b08-e2f4-4b27-aa14-ae459dacb1c6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:11.419271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7093d90f-4241-4077-bb04-d54e091f78a5 req-a7005b08-e2f4-4b27-aa14-ae459dacb1c6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:11.419698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7093d90f-4241-4077-bb04-d54e091f78a5 req-a7005b08-e2f4-4b27-aa14-ae459dacb1c6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:11.432198 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-7093d90f-4241-4077-bb04-d54e091f78a5 req-a7005b08-e2f4-4b27-aa14-ae459dacb1c6 service nova] Creating event network-changed:9ca17a81-5b3d-4435-9395-09aa502f24f6 for instance 43821a2b-4f04-44d3-8970-18ac72e94470 on n-h2-860282-1 Oct 04 21:32:11.437635 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-7093d90f-4241-4077-bb04-d54e091f78a5 req-a7005b08-e2f4-4b27-aa14-ae459dacb1c6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040443 Oct 04 21:32:11.438821 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2659/5288] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:32:11.692040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-31fdcc15-7626-4145-9f05-883907e8ed51 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:11.700285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-31fdcc15-7626-4145-9f05-883907e8ed51 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:11.703651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31fdcc15-7626-4145-9f05-883907e8ed51 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:11.704228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31fdcc15-7626-4145-9f05-883907e8ed51 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:11.704751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31fdcc15-7626-4145-9f05-883907e8ed51 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:11.705578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31fdcc15-7626-4145-9f05-883907e8ed51 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:11.706106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31fdcc15-7626-4145-9f05-883907e8ed51 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:11.706721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31fdcc15-7626-4145-9f05-883907e8ed51 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:11.830801 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2b85a01e-268b-49aa-91bf-4b54fc745a0c tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "POST /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.033672 Oct 04 21:32:11.831800 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2630/5289] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 21:32:10 2022] POST /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa/os-volume_attachments => generated 194 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:11.965848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-31fdcc15-7626-4145-9f05-883907e8ed51 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:11.974792 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-31fdcc15-7626-4145-9f05-883907e8ed51 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 200 len: 1309 microversion: 2.1 time: 0.287374 Oct 04 21:32:11.976024 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2660/5290] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:11 2022] GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 1309 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:12.294616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ca10e748-bcd2-475c-9b2a-03cbd070dcaf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:12.295342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ca10e748-bcd2-475c-9b2a-03cbd070dcaf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:12.310817 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca10e748-bcd2-475c-9b2a-03cbd070dcaf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:12.311630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca10e748-bcd2-475c-9b2a-03cbd070dcaf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:12.312523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca10e748-bcd2-475c-9b2a-03cbd070dcaf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:12.314916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca10e748-bcd2-475c-9b2a-03cbd070dcaf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:12.316379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca10e748-bcd2-475c-9b2a-03cbd070dcaf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:12.317156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca10e748-bcd2-475c-9b2a-03cbd070dcaf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:12.591372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ca10e748-bcd2-475c-9b2a-03cbd070dcaf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:12.610906 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ca10e748-bcd2-475c-9b2a-03cbd070dcaf tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1502 microversion: 2.1 time: 0.327108 Oct 04 21:32:12.618711 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2631/5291] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:12 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1502 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:12.648499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3909771d-7289-4d49-ad73-8ec15299f979 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:12.651830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3909771d-7289-4d49-ad73-8ec15299f979 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:12.676990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3909771d-7289-4d49-ad73-8ec15299f979 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:12.677543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3909771d-7289-4d49-ad73-8ec15299f979 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:12.678022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3909771d-7289-4d49-ad73-8ec15299f979 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:12.685797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3909771d-7289-4d49-ad73-8ec15299f979 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:12.686353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3909771d-7289-4d49-ad73-8ec15299f979 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:12.686830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3909771d-7289-4d49-ad73-8ec15299f979 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:12.743049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-3909771d-7289-4d49-ad73-8ec15299f979 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lazy-loading 'flavor' on Instance uuid 841e7266-1e45-49f1-8c5a-8dd479fcf958 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:32:13.002114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-111614ad-d955-499c-8d79-35b7991a292f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:13.003466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-111614ad-d955-499c-8d79-35b7991a292f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:13.011811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-111614ad-d955-499c-8d79-35b7991a292f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:13.012704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-111614ad-d955-499c-8d79-35b7991a292f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:13.013343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-111614ad-d955-499c-8d79-35b7991a292f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:13.014273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-111614ad-d955-499c-8d79-35b7991a292f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:13.014918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-111614ad-d955-499c-8d79-35b7991a292f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:13.015668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-111614ad-d955-499c-8d79-35b7991a292f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:13.038911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:13.124997 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3909771d-7289-4d49-ad73-8ec15299f979 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "POST /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958/action" status: 202 len: 0 microversion: 2.1 time: 0.482000 Oct 04 21:32:13.125886 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2661/5292] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:32:12 2022] POST /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:32:13.137184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f817ca22-31c0-4e7c-a73a-0bceababe12b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:13.137938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f817ca22-31c0-4e7c-a73a-0bceababe12b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:13.145994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f817ca22-31c0-4e7c-a73a-0bceababe12b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:13.146891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f817ca22-31c0-4e7c-a73a-0bceababe12b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:13.147451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f817ca22-31c0-4e7c-a73a-0bceababe12b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:13.148253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f817ca22-31c0-4e7c-a73a-0bceababe12b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:13.148776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f817ca22-31c0-4e7c-a73a-0bceababe12b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:13.149286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f817ca22-31c0-4e7c-a73a-0bceababe12b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:13.605308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-111614ad-d955-499c-8d79-35b7991a292f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:13.618900 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-111614ad-d955-499c-8d79-35b7991a292f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 200 len: 1309 microversion: 2.1 time: 0.621098 Oct 04 21:32:13.619519 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2632/5293] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:12 2022] GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 1309 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:13.661590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f817ca22-31c0-4e7c-a73a-0bceababe12b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:13.673114 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f817ca22-31c0-4e7c-a73a-0bceababe12b tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1510 microversion: 2.1 time: 0.541559 Oct 04 21:32:13.674287 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2662/5294] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:13 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1510 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:14.435086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2b8ed7ee-ce7b-4b5c-b821-e962a7ddf7fd tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:14.435086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2b8ed7ee-ce7b-4b5c-b821-e962a7ddf7fd tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:14.442566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b8ed7ee-ce7b-4b5c-b821-e962a7ddf7fd tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:14.443179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b8ed7ee-ce7b-4b5c-b821-e962a7ddf7fd tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:14.443818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b8ed7ee-ce7b-4b5c-b821-e962a7ddf7fd tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:14.444729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b8ed7ee-ce7b-4b5c-b821-e962a7ddf7fd tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:14.445210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b8ed7ee-ce7b-4b5c-b821-e962a7ddf7fd tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:14.445762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b8ed7ee-ce7b-4b5c-b821-e962a7ddf7fd tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:14.642338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2f2d3d83-d1d4-4fe6-9a4b-6981b525dc9d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:14.642960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2f2d3d83-d1d4-4fe6-9a4b-6981b525dc9d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:14.657742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f2d3d83-d1d4-4fe6-9a4b-6981b525dc9d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:14.659064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f2d3d83-d1d4-4fe6-9a4b-6981b525dc9d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:14.660911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f2d3d83-d1d4-4fe6-9a4b-6981b525dc9d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:14.665996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f2d3d83-d1d4-4fe6-9a4b-6981b525dc9d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:14.682716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f2d3d83-d1d4-4fe6-9a4b-6981b525dc9d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:14.686761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f2d3d83-d1d4-4fe6-9a4b-6981b525dc9d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:14.750557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2b8ed7ee-ce7b-4b5c-b821-e962a7ddf7fd tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:14.767162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2b8ed7ee-ce7b-4b5c-b821-e962a7ddf7fd tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:14.771073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2b8ed7ee-ce7b-4b5c-b821-e962a7ddf7fd tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:14.775385 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2b8ed7ee-ce7b-4b5c-b821-e962a7ddf7fd tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 2945 microversion: 2.42 time: 0.749270 Oct 04 21:32:14.783692 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2633/5295] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:32:14 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 2945 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:32:14.792731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-06030661-0897-42b9-bb5a-f075adb0d971 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:14.794864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-06030661-0897-42b9-bb5a-f075adb0d971 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:14.820309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06030661-0897-42b9-bb5a-f075adb0d971 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:14.821363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06030661-0897-42b9-bb5a-f075adb0d971 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:14.829749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06030661-0897-42b9-bb5a-f075adb0d971 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:14.829749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06030661-0897-42b9-bb5a-f075adb0d971 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:14.829749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06030661-0897-42b9-bb5a-f075adb0d971 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:14.829749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06030661-0897-42b9-bb5a-f075adb0d971 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:15.042665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2f2d3d83-d1d4-4fe6-9a4b-6981b525dc9d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:15.050866 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2f2d3d83-d1d4-4fe6-9a4b-6981b525dc9d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 200 len: 1309 microversion: 2.1 time: 0.412695 Oct 04 21:32:15.054113 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2663/5296] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:14 2022] GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 1309 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:15.069573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-66ccfe1d-1a48-4d9a-939c-073d18f5667f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:15.070468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-66ccfe1d-1a48-4d9a-939c-073d18f5667f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:15.078858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66ccfe1d-1a48-4d9a-939c-073d18f5667f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:15.081270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66ccfe1d-1a48-4d9a-939c-073d18f5667f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:15.082000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66ccfe1d-1a48-4d9a-939c-073d18f5667f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:15.085736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66ccfe1d-1a48-4d9a-939c-073d18f5667f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:15.086464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66ccfe1d-1a48-4d9a-939c-073d18f5667f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:15.090966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-66ccfe1d-1a48-4d9a-939c-073d18f5667f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:15.154284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-06030661-0897-42b9-bb5a-f075adb0d971 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:15.169963 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-06030661-0897-42b9-bb5a-f075adb0d971 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1493 microversion: 2.1 time: 0.385445 Oct 04 21:32:15.170877 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2634/5297] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:14 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1493 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:15.200132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1f24c218-3a98-4a7f-ae9c-5e6aa2f3ce3d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:15.200132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1f24c218-3a98-4a7f-ae9c-5e6aa2f3ce3d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:15.208707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f24c218-3a98-4a7f-ae9c-5e6aa2f3ce3d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:15.210586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f24c218-3a98-4a7f-ae9c-5e6aa2f3ce3d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:15.213204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f24c218-3a98-4a7f-ae9c-5e6aa2f3ce3d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:15.214957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f24c218-3a98-4a7f-ae9c-5e6aa2f3ce3d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:15.216281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f24c218-3a98-4a7f-ae9c-5e6aa2f3ce3d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:15.217963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f24c218-3a98-4a7f-ae9c-5e6aa2f3ce3d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:15.297655 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-66ccfe1d-1a48-4d9a-939c-073d18f5667f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.242080 Oct 04 21:32:15.298483 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2664/5298] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Oct 4 21:32:15 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f/os-interface => generated 1832 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:32:15.518841 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1f24c218-3a98-4a7f-ae9c-5e6aa2f3ce3d tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "POST /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958/action" status: 202 len: 0 microversion: 2.1 time: 0.324995 Oct 04 21:32:15.520307 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2635/5299] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:32:15 2022] POST /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:32:15.526394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:15.540265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=18 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:15.546249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2fa220f1-278d-4440-ac62-2b94154c86d9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:15.547138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2fa220f1-278d-4440-ac62-2b94154c86d9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:15.554901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fa220f1-278d-4440-ac62-2b94154c86d9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:15.555769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fa220f1-278d-4440-ac62-2b94154c86d9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:15.556488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fa220f1-278d-4440-ac62-2b94154c86d9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:15.558598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fa220f1-278d-4440-ac62-2b94154c86d9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:15.559415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fa220f1-278d-4440-ac62-2b94154c86d9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:15.560062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fa220f1-278d-4440-ac62-2b94154c86d9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:15.953086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2fa220f1-278d-4440-ac62-2b94154c86d9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:15.966566 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2fa220f1-278d-4440-ac62-2b94154c86d9 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1499 microversion: 2.1 time: 0.441214 Oct 04 21:32:15.969518 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2665/5300] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:15 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1499 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:16.082377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3f127935-4816-4654-9abe-7ef75feae9d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:16.083096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3f127935-4816-4654-9abe-7ef75feae9d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:16.097803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:16.103808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f127935-4816-4654-9abe-7ef75feae9d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:16.105256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f127935-4816-4654-9abe-7ef75feae9d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:16.105968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f127935-4816-4654-9abe-7ef75feae9d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:16.109666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f127935-4816-4654-9abe-7ef75feae9d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:16.110417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f127935-4816-4654-9abe-7ef75feae9d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:16.111613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f127935-4816-4654-9abe-7ef75feae9d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:16.555641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3f127935-4816-4654-9abe-7ef75feae9d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:16.572249 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3f127935-4816-4654-9abe-7ef75feae9d0 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 200 len: 1309 microversion: 2.1 time: 0.487900 Oct 04 21:32:16.572249 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2636/5301] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:16 2022] GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 1309 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:16.994288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aee9e21c-1d6e-4eee-92df-19f20c35b9b1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:16.994998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aee9e21c-1d6e-4eee-92df-19f20c35b9b1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:17.011597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aee9e21c-1d6e-4eee-92df-19f20c35b9b1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:17.018012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aee9e21c-1d6e-4eee-92df-19f20c35b9b1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:17.018904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aee9e21c-1d6e-4eee-92df-19f20c35b9b1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:17.020030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6d675e9a-64a3-4097-b5f1-f47bd276c336 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Action: 'create', calling method: .version_select at 0x7f578b7abdc0>, body: {"keypair": {"name": "tempest-keypair-1033865774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfVPiB+2OUxmd6QycWFkWaWN1ph7/Yeb59WaV2xjXu+1hLQsiYEy4qaZcW+vqT5pP1uO8uTB8MdHMVYbtzX2ac97M+p0awTBRYN/VabMpvpbC1t0TpWFN/m5CEuNnDuEA=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:17.020593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aee9e21c-1d6e-4eee-92df-19f20c35b9b1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:17.021798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aee9e21c-1d6e-4eee-92df-19f20c35b9b1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:17.022673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aee9e21c-1d6e-4eee-92df-19f20c35b9b1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:17.065202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-6d675e9a-64a3-4097-b5f1-f47bd276c336 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Getting quotas for project e2812d680b26415fb5930200c01cb327. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:32:17.076372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-6d675e9a-64a3-4097-b5f1-f47bd276c336 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Getting quotas for user 18f3a21b780248d0943136e68b4a4536 and project e2812d680b26415fb5930200c01cb327. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:32:17.181033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aee9e21c-1d6e-4eee-92df-19f20c35b9b1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:17.191969 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aee9e21c-1d6e-4eee-92df-19f20c35b9b1 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1499 microversion: 2.1 time: 0.201568 Oct 04 21:32:17.192566 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2637/5302] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:16 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1499 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:17.218098 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6d675e9a-64a3-4097-b5f1-f47bd276c336 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.674431 Oct 04 21:32:17.219601 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2666/5303] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Oct 4 21:32:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 676 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:32:17.606358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8e72bf79-3638-4414-915c-8a3ecfe2b53c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:17.606998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8e72bf79-3638-4414-915c-8a3ecfe2b53c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:17.625705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e72bf79-3638-4414-915c-8a3ecfe2b53c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:17.626663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e72bf79-3638-4414-915c-8a3ecfe2b53c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:17.632680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e72bf79-3638-4414-915c-8a3ecfe2b53c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:17.632680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e72bf79-3638-4414-915c-8a3ecfe2b53c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:17.632680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e72bf79-3638-4414-915c-8a3ecfe2b53c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:17.632680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e72bf79-3638-4414-915c-8a3ecfe2b53c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:17.863661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8e72bf79-3638-4414-915c-8a3ecfe2b53c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:17.876285 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8e72bf79-3638-4414-915c-8a3ecfe2b53c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 200 len: 1309 microversion: 2.1 time: 0.273874 Oct 04 21:32:17.878091 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2638/5304] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:17 2022] GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 1309 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:18.194002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-48b10612-5dc8-4f4b-9635-cddfb838b7e0 req-3cb0a6f1-7f22-4121-8aa6-72c5d4627aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43821a2b-4f04-44d3-8970-18ac72e94470", "name": "network-vif-plugged", "status": "completed", "tag": "9ca17a81-5b3d-4435-9395-09aa502f24f6"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:18.217177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f198f7f1-6bae-422b-ad22-731ac1b3b21f tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:18.218118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f198f7f1-6bae-422b-ad22-731ac1b3b21f tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:18.221818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-48b10612-5dc8-4f4b-9635-cddfb838b7e0 req-3cb0a6f1-7f22-4121-8aa6-72c5d4627aca service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:18.223829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-48b10612-5dc8-4f4b-9635-cddfb838b7e0 req-3cb0a6f1-7f22-4121-8aa6-72c5d4627aca service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:18.229641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-48b10612-5dc8-4f4b-9635-cddfb838b7e0 req-3cb0a6f1-7f22-4121-8aa6-72c5d4627aca service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:18.231676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f198f7f1-6bae-422b-ad22-731ac1b3b21f tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:18.232420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f198f7f1-6bae-422b-ad22-731ac1b3b21f tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:18.234409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f198f7f1-6bae-422b-ad22-731ac1b3b21f tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:18.235344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f198f7f1-6bae-422b-ad22-731ac1b3b21f tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:18.236363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f198f7f1-6bae-422b-ad22-731ac1b3b21f tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:18.239039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f198f7f1-6bae-422b-ad22-731ac1b3b21f tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:18.253547 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-48b10612-5dc8-4f4b-9635-cddfb838b7e0 req-3cb0a6f1-7f22-4121-8aa6-72c5d4627aca service nova] Creating event network-vif-plugged:9ca17a81-5b3d-4435-9395-09aa502f24f6 for instance 43821a2b-4f04-44d3-8970-18ac72e94470 on n-h2-860282-1 Oct 04 21:32:18.281058 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-48b10612-5dc8-4f4b-9635-cddfb838b7e0 req-3cb0a6f1-7f22-4121-8aa6-72c5d4627aca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092790 Oct 04 21:32:18.281959 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2667/5305] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:18.684961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f198f7f1-6bae-422b-ad22-731ac1b3b21f tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:18.699390 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f198f7f1-6bae-422b-ad22-731ac1b3b21f tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1502 microversion: 2.1 time: 0.487081 Oct 04 21:32:18.701998 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2639/5306] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:18 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1502 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:18.727478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ea1db30c-9c0b-49ab-a226-a577dab892ad tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:18.729601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ea1db30c-9c0b-49ab-a226-a577dab892ad tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:18.735376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea1db30c-9c0b-49ab-a226-a577dab892ad tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:18.736103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea1db30c-9c0b-49ab-a226-a577dab892ad tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:18.736543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea1db30c-9c0b-49ab-a226-a577dab892ad tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:18.737245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea1db30c-9c0b-49ab-a226-a577dab892ad tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:18.737732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea1db30c-9c0b-49ab-a226-a577dab892ad tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:18.738163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea1db30c-9c0b-49ab-a226-a577dab892ad tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:18.764654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ea1db30c-9c0b-49ab-a226-a577dab892ad tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:32:18.907553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e47bbe4e-a9b6-4b9c-a729-f901c5d628bc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:18.908473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e47bbe4e-a9b6-4b9c-a729-f901c5d628bc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:18.929647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e47bbe4e-a9b6-4b9c-a729-f901c5d628bc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:18.932489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e47bbe4e-a9b6-4b9c-a729-f901c5d628bc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:18.936071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e47bbe4e-a9b6-4b9c-a729-f901c5d628bc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:18.936951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e47bbe4e-a9b6-4b9c-a729-f901c5d628bc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:18.939705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e47bbe4e-a9b6-4b9c-a729-f901c5d628bc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:18.940268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e47bbe4e-a9b6-4b9c-a729-f901c5d628bc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:19.132461 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ea1db30c-9c0b-49ab-a226-a577dab892ad tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "DELETE /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 204 len: 0 microversion: 2.1 time: 0.408910 Oct 04 21:32:19.133214 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2668/5307] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:32:18 2022] DELETE /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:32:19.142703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-afbc8085-301b-4512-b362-410cdae01070 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:19.143310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-afbc8085-301b-4512-b362-410cdae01070 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:19.157093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afbc8085-301b-4512-b362-410cdae01070 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:19.161322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afbc8085-301b-4512-b362-410cdae01070 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:19.164296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afbc8085-301b-4512-b362-410cdae01070 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:19.164296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afbc8085-301b-4512-b362-410cdae01070 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:19.164296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afbc8085-301b-4512-b362-410cdae01070 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:19.164296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afbc8085-301b-4512-b362-410cdae01070 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:19.228383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e47bbe4e-a9b6-4b9c-a729-f901c5d628bc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:19.240428 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e47bbe4e-a9b6-4b9c-a729-f901c5d628bc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 200 len: 1309 microversion: 2.1 time: 0.344066 Oct 04 21:32:19.241776 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2640/5308] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:18 2022] GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 1309 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:19.420457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-afbc8085-301b-4512-b362-410cdae01070 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:19.429088 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-afbc8085-301b-4512-b362-410cdae01070 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1508 microversion: 2.1 time: 0.290486 Oct 04 21:32:19.429734 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2669/5309] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:19 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1508 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:20.270084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d79e2b2a-6524-4926-871c-db2197f2b21f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:20.271427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d79e2b2a-6524-4926-871c-db2197f2b21f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:20.280509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d79e2b2a-6524-4926-871c-db2197f2b21f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:20.281436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d79e2b2a-6524-4926-871c-db2197f2b21f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:20.282314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d79e2b2a-6524-4926-871c-db2197f2b21f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:20.283201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d79e2b2a-6524-4926-871c-db2197f2b21f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:20.283753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d79e2b2a-6524-4926-871c-db2197f2b21f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:20.284454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d79e2b2a-6524-4926-871c-db2197f2b21f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:20.454743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-59130a05-d83e-4bc7-92ac-a3bb65741cd6 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:20.456543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-59130a05-d83e-4bc7-92ac-a3bb65741cd6 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:20.468221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59130a05-d83e-4bc7-92ac-a3bb65741cd6 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:20.468798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59130a05-d83e-4bc7-92ac-a3bb65741cd6 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:20.469305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59130a05-d83e-4bc7-92ac-a3bb65741cd6 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:20.470136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59130a05-d83e-4bc7-92ac-a3bb65741cd6 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:20.470661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59130a05-d83e-4bc7-92ac-a3bb65741cd6 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:20.471393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59130a05-d83e-4bc7-92ac-a3bb65741cd6 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:20.512984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d79e2b2a-6524-4926-871c-db2197f2b21f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:20.524783 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d79e2b2a-6524-4926-871c-db2197f2b21f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 200 len: 1489 microversion: 2.1 time: 0.259547 Oct 04 21:32:20.526522 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2641/5310] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:20 2022] GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 1489 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:20.560263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b519db93-c6e8-40ed-bbcc-aa6f158b354a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:20.562998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b519db93-c6e8-40ed-bbcc-aa6f158b354a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:20.569514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b519db93-c6e8-40ed-bbcc-aa6f158b354a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:20.570282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b519db93-c6e8-40ed-bbcc-aa6f158b354a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:20.570908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b519db93-c6e8-40ed-bbcc-aa6f158b354a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:20.571824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b519db93-c6e8-40ed-bbcc-aa6f158b354a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:20.572469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b519db93-c6e8-40ed-bbcc-aa6f158b354a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:20.573566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b519db93-c6e8-40ed-bbcc-aa6f158b354a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:20.669313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-59130a05-d83e-4bc7-92ac-a3bb65741cd6 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:20.678601 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-59130a05-d83e-4bc7-92ac-a3bb65741cd6 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1508 microversion: 2.1 time: 0.228361 Oct 04 21:32:20.679130 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2670/5311] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:20 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:20.876826 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b519db93-c6e8-40ed-bbcc-aa6f158b354a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "PUT /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 200 len: 1084 microversion: 2.1 time: 0.321135 Oct 04 21:32:20.878035 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2642/5312] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Oct 4 21:32:20 2022] PUT /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 1084 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:20.906118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3d095025-f86d-4dc8-bc83-1b3b3011c7ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:20.906118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3d095025-f86d-4dc8-bc83-1b3b3011c7ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:20.909906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d095025-f86d-4dc8-bc83-1b3b3011c7ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:20.911016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d095025-f86d-4dc8-bc83-1b3b3011c7ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:20.912001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d095025-f86d-4dc8-bc83-1b3b3011c7ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:20.913595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d095025-f86d-4dc8-bc83-1b3b3011c7ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:20.914646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d095025-f86d-4dc8-bc83-1b3b3011c7ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:20.915450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d095025-f86d-4dc8-bc83-1b3b3011c7ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:21.214929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3d095025-f86d-4dc8-bc83-1b3b3011c7ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:21.227476 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3d095025-f86d-4dc8-bc83-1b3b3011c7ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 200 len: 1510 microversion: 2.1 time: 0.333521 Oct 04 21:32:21.229565 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2671/5313] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:20 2022] GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 1510 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:21.252751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cb39c907-5458-4cb8-bf18-b97144183a7b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:21.253751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cb39c907-5458-4cb8-bf18-b97144183a7b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:21.263396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb39c907-5458-4cb8-bf18-b97144183a7b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:21.269903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb39c907-5458-4cb8-bf18-b97144183a7b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:21.272108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb39c907-5458-4cb8-bf18-b97144183a7b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:21.273590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb39c907-5458-4cb8-bf18-b97144183a7b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:21.274265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb39c907-5458-4cb8-bf18-b97144183a7b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:21.274898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb39c907-5458-4cb8-bf18-b97144183a7b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:21.404448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-36be1a9f-de14-4ac5-9bd1-2af18433c9ff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1838425872", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "00641ee4-fa60-49c2-ab79-499beaf19a7f"}], "security_groups": [{"name": "tempest-securitygroup--662274030"}], "key_name": "tempest-keypair-1033865774", "user_data": "}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:21.537169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cb39c907-5458-4cb8-bf18-b97144183a7b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:21.546632 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cb39c907-5458-4cb8-bf18-b97144183a7b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 200 len: 1510 microversion: 2.1 time: 0.298175 Oct 04 21:32:21.547329 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2643/5314] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:21 2022] GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 1510 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:21.571086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a52262ae-849b-403b-9d1d-d3f33d2f6593 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:21.577662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a52262ae-849b-403b-9d1d-d3f33d2f6593 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:21.579103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a52262ae-849b-403b-9d1d-d3f33d2f6593 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:21.579717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a52262ae-849b-403b-9d1d-d3f33d2f6593 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:21.580191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a52262ae-849b-403b-9d1d-d3f33d2f6593 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:21.580903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a52262ae-849b-403b-9d1d-d3f33d2f6593 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:21.581776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a52262ae-849b-403b-9d1d-d3f33d2f6593 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:21.582390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a52262ae-849b-403b-9d1d-d3f33d2f6593 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:21.617979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-36be1a9f-de14-4ac5-9bd1-2af18433c9ff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] validate_networks() for [('00641ee4-fa60-49c2-ab79-499beaf19a7f', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:32:21.625899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a52262ae-849b-403b-9d1d-d3f33d2f6593 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:32:21.971346 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a52262ae-849b-403b-9d1d-d3f33d2f6593 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "DELETE /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 204 len: 0 microversion: 2.1 time: 0.404515 Oct 04 21:32:21.977052 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2644/5315] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:32:21 2022] DELETE /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:32:21.984718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b1c2bf49-7394-4f98-b617-d25d2b916555 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:21.986085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b1c2bf49-7394-4f98-b617-d25d2b916555 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:21.995358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1c2bf49-7394-4f98-b617-d25d2b916555 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:21.995952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1c2bf49-7394-4f98-b617-d25d2b916555 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:21.996630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1c2bf49-7394-4f98-b617-d25d2b916555 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:21.997940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1c2bf49-7394-4f98-b617-d25d2b916555 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:21.998826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1c2bf49-7394-4f98-b617-d25d2b916555 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:21.999509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1c2bf49-7394-4f98-b617-d25d2b916555 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:22.096137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b1c2bf49-7394-4f98-b617-d25d2b916555 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:22.101672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:22.108098 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b1c2bf49-7394-4f98-b617-d25d2b916555 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1466 microversion: 2.1 time: 0.129197 Oct 04 21:32:22.108686 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2645/5316] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:21 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1466 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:22.119424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a476df52-3063-480f-8843-dca05eb543c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:22.121233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a476df52-3063-480f-8843-dca05eb543c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:22.128263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a476df52-3063-480f-8843-dca05eb543c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:22.132250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a476df52-3063-480f-8843-dca05eb543c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:22.132250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a476df52-3063-480f-8843-dca05eb543c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:22.132250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a476df52-3063-480f-8843-dca05eb543c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:22.132250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a476df52-3063-480f-8843-dca05eb543c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:22.132250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a476df52-3063-480f-8843-dca05eb543c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:22.267293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-36be1a9f-de14-4ac5-9bd1-2af18433c9ff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:32:22.267969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-36be1a9f-de14-4ac5-9bd1-2af18433c9ff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:32:22.270268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-36be1a9f-de14-4ac5-9bd1-2af18433c9ff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:32:22.270268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-36be1a9f-de14-4ac5-9bd1-2af18433c9ff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:32:22.270268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-36be1a9f-de14-4ac5-9bd1-2af18433c9ff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:32:22.280381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36be1a9f-de14-4ac5-9bd1-2af18433c9ff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:22.281199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36be1a9f-de14-4ac5-9bd1-2af18433c9ff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:22.282010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36be1a9f-de14-4ac5-9bd1-2af18433c9ff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:22.283021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36be1a9f-de14-4ac5-9bd1-2af18433c9ff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:22.283711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36be1a9f-de14-4ac5-9bd1-2af18433c9ff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:22.284390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36be1a9f-de14-4ac5-9bd1-2af18433c9ff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:22.312238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-36be1a9f-de14-4ac5-9bd1-2af18433c9ff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Getting quotas for project e2812d680b26415fb5930200c01cb327. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:32:22.323673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-36be1a9f-de14-4ac5-9bd1-2af18433c9ff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Getting quotas for user 18f3a21b780248d0943136e68b4a4536 and project e2812d680b26415fb5930200c01cb327. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:32:22.338012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-36be1a9f-de14-4ac5-9bd1-2af18433c9ff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:32:22.341628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-36be1a9f-de14-4ac5-9bd1-2af18433c9ff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:32:22.362303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a476df52-3063-480f-8843-dca05eb543c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:22.373263 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a476df52-3063-480f-8843-dca05eb543c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 200 len: 1516 microversion: 2.1 time: 0.263514 Oct 04 21:32:22.373912 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2646/5317] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:22 2022] GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 1516 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:22.386774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-63c9b3fb-6b04-46cf-b7a5-b85628b7deca req-43914b90-24d5-4817-acba-b9ea79f5229a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "841e7266-1e45-49f1-8c5a-8dd479fcf958", "name": "network-vif-deleted", "tag": "651c41bb-ced3-4be1-aacd-e2e20677f0d5"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:22.388783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-63c9b3fb-6b04-46cf-b7a5-b85628b7deca req-43914b90-24d5-4817-acba-b9ea79f5229a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:22.389262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-63c9b3fb-6b04-46cf-b7a5-b85628b7deca req-43914b90-24d5-4817-acba-b9ea79f5229a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:22.389756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-63c9b3fb-6b04-46cf-b7a5-b85628b7deca req-43914b90-24d5-4817-acba-b9ea79f5229a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:22.400946 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-63c9b3fb-6b04-46cf-b7a5-b85628b7deca req-43914b90-24d5-4817-acba-b9ea79f5229a service nova] Creating event network-vif-deleted:651c41bb-ced3-4be1-aacd-e2e20677f0d5 for instance 841e7266-1e45-49f1-8c5a-8dd479fcf958 on n-h1-860282-1 Oct 04 21:32:22.405993 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-63c9b3fb-6b04-46cf-b7a5-b85628b7deca req-43914b90-24d5-4817-acba-b9ea79f5229a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030940 Oct 04 21:32:22.406578 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2647/5318] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:22.483382 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-36be1a9f-de14-4ac5-9bd1-2af18433c9ff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.085873 Oct 04 21:32:22.484862 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2672/5319] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Oct 4 21:32:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 21:32:22.504443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0bfa6af9-dc9d-482a-925d-204fc867e40a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:22.505190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0bfa6af9-dc9d-482a-925d-204fc867e40a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:22.597916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0bfa6af9-dc9d-482a-925d-204fc867e40a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:22.601938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0bfa6af9-dc9d-482a-925d-204fc867e40a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:22.602937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0bfa6af9-dc9d-482a-925d-204fc867e40a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:22.604113 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0bfa6af9-dc9d-482a-925d-204fc867e40a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1282 microversion: 2.20 time: 0.109422 Oct 04 21:32:22.605215 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2648/5320] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:32:22 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1282 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:32:23.132749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d1bea93f-1f53-4fc1-8490-0ad872187c49 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:23.133371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d1bea93f-1f53-4fc1-8490-0ad872187c49 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:23.139687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1bea93f-1f53-4fc1-8490-0ad872187c49 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:23.140178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1bea93f-1f53-4fc1-8490-0ad872187c49 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:23.140624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1bea93f-1f53-4fc1-8490-0ad872187c49 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:23.141469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1bea93f-1f53-4fc1-8490-0ad872187c49 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:23.141854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1bea93f-1f53-4fc1-8490-0ad872187c49 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:23.142289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1bea93f-1f53-4fc1-8490-0ad872187c49 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:23.174384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1bea93f-1f53-4fc1-8490-0ad872187c49 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:23.174866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1bea93f-1f53-4fc1-8490-0ad872187c49 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:23.175356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1bea93f-1f53-4fc1-8490-0ad872187c49 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:23.175805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-d1bea93f-1f53-4fc1-8490-0ad872187c49 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lazy-loading 'fault' on Instance uuid 841e7266-1e45-49f1-8c5a-8dd479fcf958 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:32:23.223086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d1bea93f-1f53-4fc1-8490-0ad872187c49 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17037da82f9942619c02e5744c48a7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b57c97263048c7b6345042a45d0ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:23.232049 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d1bea93f-1f53-4fc1-8490-0ad872187c49 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 200 len: 1305 microversion: 2.1 time: 0.103592 Oct 04 21:32:23.232857 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2673/5321] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:23 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:23.400314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c365aa51-d12d-466c-aabb-bfaf96bf855a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:23.401846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c365aa51-d12d-466c-aabb-bfaf96bf855a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:23.406553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:23.412101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c365aa51-d12d-466c-aabb-bfaf96bf855a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:23.412591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c365aa51-d12d-466c-aabb-bfaf96bf855a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:23.413027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c365aa51-d12d-466c-aabb-bfaf96bf855a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:23.413746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c365aa51-d12d-466c-aabb-bfaf96bf855a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:23.414246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c365aa51-d12d-466c-aabb-bfaf96bf855a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:23.418156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c365aa51-d12d-466c-aabb-bfaf96bf855a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:23.633074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7076f062-168c-48ee-a3f0-5cbb2f9f8be3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:23.634005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7076f062-168c-48ee-a3f0-5cbb2f9f8be3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:23.663517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c365aa51-d12d-466c-aabb-bfaf96bf855a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:23.671777 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c365aa51-d12d-466c-aabb-bfaf96bf855a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 200 len: 1516 microversion: 2.1 time: 0.275773 Oct 04 21:32:23.685732 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2649/5322] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:23 2022] GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 1516 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:23.703788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7076f062-168c-48ee-a3f0-5cbb2f9f8be3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:23.713552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7076f062-168c-48ee-a3f0-5cbb2f9f8be3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:23.716915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7076f062-168c-48ee-a3f0-5cbb2f9f8be3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:23.716915 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7076f062-168c-48ee-a3f0-5cbb2f9f8be3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1282 microversion: 2.20 time: 0.087830 Oct 04 21:32:23.724885 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2674/5323] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:32:23 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:32:24.085613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a57a6c1f-3afd-4a0a-828a-163c917d33ae tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:24.086139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a57a6c1f-3afd-4a0a-828a-163c917d33ae tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:24.094907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a57a6c1f-3afd-4a0a-828a-163c917d33ae tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:24.096955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a57a6c1f-3afd-4a0a-828a-163c917d33ae tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:24.100816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a57a6c1f-3afd-4a0a-828a-163c917d33ae tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:24.101707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a57a6c1f-3afd-4a0a-828a-163c917d33ae tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:24.102284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a57a6c1f-3afd-4a0a-828a-163c917d33ae tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:24.102716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a57a6c1f-3afd-4a0a-828a-163c917d33ae tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:24.147729 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a57a6c1f-3afd-4a0a-828a-163c917d33ae tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4/ips" status: 200 len: 145 microversion: 2.1 time: 0.067193 Oct 04 21:32:24.150140 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2650/5324] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Oct 4 21:32:24 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4/ips => generated 145 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:24.261183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e88382a9-6f39-484b-8d46-23d722a76372 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:24.263741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e88382a9-6f39-484b-8d46-23d722a76372 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] [instance: 841e7266-1e45-49f1-8c5a-8dd479fcf958] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:24.270025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:24.274419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e88382a9-6f39-484b-8d46-23d722a76372 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:24.275467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e88382a9-6f39-484b-8d46-23d722a76372 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:24.276842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e88382a9-6f39-484b-8d46-23d722a76372 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:24.277887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e88382a9-6f39-484b-8d46-23d722a76372 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:24.278485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e88382a9-6f39-484b-8d46-23d722a76372 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:24.279028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e88382a9-6f39-484b-8d46-23d722a76372 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:24.282808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:24.297393 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-e88382a9-6f39-484b-8d46-23d722a76372 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] HTTP exception thrown: Instance 841e7266-1e45-49f1-8c5a-8dd479fcf958 could not be found. Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e88382a9-6f39-484b-8d46-23d722a76372 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Request method failure captured: Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 HTTP/1.1 Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKY-wkTfOi35wRjxo4gKcQN00lBM_GyuhjuAjB07LBBSekDBxvL876RLU6F9WkFMTLliAPFmQyrBNSAUUkx48oszXQTKIz5PvINx_5fHl09zbJ_QUTCDnlEJpDf12m4yTTfgrhHMn3_vKy1dADIqX8WeIz3bChTtI6Spy4-DNaizOjg Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 07b57c97263048c7b6345042a45d0ffb Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestServerAdvancedOps-1853404287 Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/07b57c97263048c7b6345042a45d0ffb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_07b57c97263048c7b6345042a45d0ffb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/07b57c97263048c7b6345042a45d0ffb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/07b57c97263048c7b6345042a45d0ffb"}]}] Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestServerAdvancedOps-1853404287 Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 07b57c97263048c7b6345042a45d0ffb Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestServerAdvancedOps-1853404287 Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestServerAdvancedOps-1853404287-project Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 17037da82f9942619c02e5744c48a7ae Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestServerAdvancedOps-1853404287-project Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 841e7266-1e45-49f1-8c5a-8dd479fcf958 could not be found. Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '841e7266-1e45-49f1-8c5a-8dd479fcf958'} Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 841e7266-1e45-49f1-8c5a-8dd479fcf958 could not be found. Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 841e7266-1e45-49f1-8c5a-8dd479fcf958 could not be found. Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:32:24.299367 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:32:24.305443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:32:24.305443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:32:24.305443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:32:24.305443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:32:24.305443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:32:24.305443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 841e7266-1e45-49f1-8c5a-8dd479fcf958 could not be found. Oct 04 21:32:24.305443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:32:24.307358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e88382a9-6f39-484b-8d46-23d722a76372 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] Returning 404 to user: Instance 841e7266-1e45-49f1-8c5a-8dd479fcf958 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:32:24.308549 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e88382a9-6f39-484b-8d46-23d722a76372 tempest-TestServerAdvancedOps-1853404287 tempest-TestServerAdvancedOps-1853404287-project] 10.222.0.30 "GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958" status: 404 len: 111 microversion: 2.1 time: 0.056424 Oct 04 21:32:24.309767 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2675/5325] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:24 2022] GET /compute/v2.1/servers/841e7266-1e45-49f1-8c5a-8dd479fcf958 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:32:24.423298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-94919156-73a1-4d94-a74e-63d2c4b15783 req-9450073d-0724-4e44-815a-beeb63eb6998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43821a2b-4f04-44d3-8970-18ac72e94470", "name": "network-vif-deleted", "tag": "9ca17a81-5b3d-4435-9395-09aa502f24f6"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:24.436902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-94919156-73a1-4d94-a74e-63d2c4b15783 req-9450073d-0724-4e44-815a-beeb63eb6998 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:24.439982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-94919156-73a1-4d94-a74e-63d2c4b15783 req-9450073d-0724-4e44-815a-beeb63eb6998 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:24.439982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-94919156-73a1-4d94-a74e-63d2c4b15783 req-9450073d-0724-4e44-815a-beeb63eb6998 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:24.450049 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-94919156-73a1-4d94-a74e-63d2c4b15783 req-9450073d-0724-4e44-815a-beeb63eb6998 service nova] Creating event network-vif-deleted:9ca17a81-5b3d-4435-9395-09aa502f24f6 for instance 43821a2b-4f04-44d3-8970-18ac72e94470 on n-h2-860282-1 Oct 04 21:32:24.454988 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-94919156-73a1-4d94-a74e-63d2c4b15783 req-9450073d-0724-4e44-815a-beeb63eb6998 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035527 Oct 04 21:32:24.455639 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2651/5326] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:24.696254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-28741ee1-972c-4df0-92e3-943105e7e428 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:24.696884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-28741ee1-972c-4df0-92e3-943105e7e428 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:24.704431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28741ee1-972c-4df0-92e3-943105e7e428 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:24.704921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28741ee1-972c-4df0-92e3-943105e7e428 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:24.705513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28741ee1-972c-4df0-92e3-943105e7e428 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:24.706109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28741ee1-972c-4df0-92e3-943105e7e428 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:24.706690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28741ee1-972c-4df0-92e3-943105e7e428 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:24.707070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28741ee1-972c-4df0-92e3-943105e7e428 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:24.743006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-792d72d9-a0a1-4343-9c7c-195693e642e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:24.744126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28741ee1-972c-4df0-92e3-943105e7e428 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:24.744758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28741ee1-972c-4df0-92e3-943105e7e428 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:24.745304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28741ee1-972c-4df0-92e3-943105e7e428 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:24.745795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-28741ee1-972c-4df0-92e3-943105e7e428 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lazy-loading 'fault' on Instance uuid 43821a2b-4f04-44d3-8970-18ac72e94470 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:32:24.746416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-792d72d9-a0a1-4343-9c7c-195693e642e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:24.763313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-792d72d9-a0a1-4343-9c7c-195693e642e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:24.763313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-792d72d9-a0a1-4343-9c7c-195693e642e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:24.763313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-792d72d9-a0a1-4343-9c7c-195693e642e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:24.763763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-792d72d9-a0a1-4343-9c7c-195693e642e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:24.764225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-792d72d9-a0a1-4343-9c7c-195693e642e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:24.764749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-792d72d9-a0a1-4343-9c7c-195693e642e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:24.816172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-28741ee1-972c-4df0-92e3-943105e7e428 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:24.827959 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-28741ee1-972c-4df0-92e3-943105e7e428 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 200 len: 1320 microversion: 2.1 time: 0.135295 Oct 04 21:32:24.828568 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2676/5327] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:24 2022] GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 1320 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:24.850038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-792d72d9-a0a1-4343-9c7c-195693e642e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:24.859653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-792d72d9-a0a1-4343-9c7c-195693e642e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:24.861607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-792d72d9-a0a1-4343-9c7c-195693e642e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:24.862888 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-792d72d9-a0a1-4343-9c7c-195693e642e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1278 microversion: 2.20 time: 0.124174 Oct 04 21:32:24.863691 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2652/5328] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:32:24 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1278 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:32:25.856218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-febfb265-7406-44fd-adb6-97d4d95556af tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:25.856909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-febfb265-7406-44fd-adb6-97d4d95556af tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:25.866071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-febfb265-7406-44fd-adb6-97d4d95556af tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:25.866643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-febfb265-7406-44fd-adb6-97d4d95556af tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:25.867465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-febfb265-7406-44fd-adb6-97d4d95556af tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:25.868768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-febfb265-7406-44fd-adb6-97d4d95556af tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:25.870019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-febfb265-7406-44fd-adb6-97d4d95556af tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:25.871047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-febfb265-7406-44fd-adb6-97d4d95556af tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:25.887601 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-febfb265-7406-44fd-adb6-97d4d95556af tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance 43821a2b-4f04-44d3-8970-18ac72e94470 could not be found. Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-febfb265-7406-44fd-adb6-97d4d95556af tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 HTTP/1.1 Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 43821a2b-4f04-44d3-8970-18ac72e94470 could not be found. Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '43821a2b-4f04-44d3-8970-18ac72e94470'} Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43821a2b-4f04-44d3-8970-18ac72e94470 could not be found. Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43821a2b-4f04-44d3-8970-18ac72e94470 could not be found. Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:32:25.890172 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:32:25.895730 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:32:25.895730 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:32:25.895730 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:32:25.895730 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:32:25.895730 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:32:25.895730 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43821a2b-4f04-44d3-8970-18ac72e94470 could not be found. Oct 04 21:32:25.895730 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:32:25.896339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d411679c-4092-41e3-a651-034cc286c841 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:25.897009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d411679c-4092-41e3-a651-034cc286c841 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:25.898510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-febfb265-7406-44fd-adb6-97d4d95556af tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance 43821a2b-4f04-44d3-8970-18ac72e94470 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:32:25.899503 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-febfb265-7406-44fd-adb6-97d4d95556af tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 404 len: 111 microversion: 2.1 time: 0.049071 Oct 04 21:32:25.901041 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2677/5329] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:25 2022] GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:32:25.927171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d411679c-4092-41e3-a651-034cc286c841 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:25.927961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d411679c-4092-41e3-a651-034cc286c841 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:25.928601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d411679c-4092-41e3-a651-034cc286c841 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:25.929674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d411679c-4092-41e3-a651-034cc286c841 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:25.930319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d411679c-4092-41e3-a651-034cc286c841 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:25.931079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d411679c-4092-41e3-a651-034cc286c841 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:26.070253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e8e48633-fa16-4437-91c7-f7916a533db2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1941683268", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "f9328395-b63c-4f5a-9d32-23fa7cfe6c6d"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:26.133205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-e8e48633-fa16-4437-91c7-f7916a533db2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] validate_networks() for [('f9328395-b63c-4f5a-9d32-23fa7cfe6c6d', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:32:26.178046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d411679c-4092-41e3-a651-034cc286c841 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:26.187707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d411679c-4092-41e3-a651-034cc286c841 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:26.189313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d411679c-4092-41e3-a651-034cc286c841 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:26.190623 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d411679c-4092-41e3-a651-034cc286c841 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1342 microversion: 2.20 time: 0.305118 Oct 04 21:32:26.191969 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2653/5330] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:32:25 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1342 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:32:26.808125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e8e48633-fa16-4437-91c7-f7916a533db2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:32:26.808647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e8e48633-fa16-4437-91c7-f7916a533db2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:32:26.809214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e8e48633-fa16-4437-91c7-f7916a533db2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:32:26.809951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e8e48633-fa16-4437-91c7-f7916a533db2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:32:26.810480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e8e48633-fa16-4437-91c7-f7916a533db2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:32:26.820071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8e48633-fa16-4437-91c7-f7916a533db2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:26.820908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8e48633-fa16-4437-91c7-f7916a533db2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:26.821637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8e48633-fa16-4437-91c7-f7916a533db2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:26.822899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8e48633-fa16-4437-91c7-f7916a533db2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:26.823795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8e48633-fa16-4437-91c7-f7916a533db2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:26.824473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8e48633-fa16-4437-91c7-f7916a533db2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:26.849900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-e8e48633-fa16-4437-91c7-f7916a533db2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Getting quotas for project fde68efb46fc44b5b0d83138b9048f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:32:26.858319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-e8e48633-fa16-4437-91c7-f7916a533db2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Getting quotas for user b9289c5fa9844ae3bb1c797bdab5c56c and project fde68efb46fc44b5b0d83138b9048f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:32:26.874687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e8e48633-fa16-4437-91c7-f7916a533db2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:32:26.877051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e8e48633-fa16-4437-91c7-f7916a533db2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:32:27.058461 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e8e48633-fa16-4437-91c7-f7916a533db2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.992046 Oct 04 21:32:27.059431 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2678/5331] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:32:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:32:27.080421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b6afc17b-b6a4-4493-aec3-9345ea1ed90a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:27.081748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b6afc17b-b6a4-4493-aec3-9345ea1ed90a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:27.198458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b6afc17b-b6a4-4493-aec3-9345ea1ed90a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:27.206454 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b6afc17b-b6a4-4493-aec3-9345ea1ed90a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1209 microversion: 2.1 time: 0.131780 Oct 04 21:32:27.207133 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2654/5332] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:27 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1209 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:27.224039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2fb633bb-26d6-47bf-b657-25dac85d452e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:27.224676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2fb633bb-26d6-47bf-b657-25dac85d452e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:27.235333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fb633bb-26d6-47bf-b657-25dac85d452e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:27.235980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fb633bb-26d6-47bf-b657-25dac85d452e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:27.236478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fb633bb-26d6-47bf-b657-25dac85d452e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:27.237246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fb633bb-26d6-47bf-b657-25dac85d452e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:27.237983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fb633bb-26d6-47bf-b657-25dac85d452e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:27.238595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2fb633bb-26d6-47bf-b657-25dac85d452e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:27.538318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2fb633bb-26d6-47bf-b657-25dac85d452e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:27.549703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2fb633bb-26d6-47bf-b657-25dac85d452e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:27.551194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2fb633bb-26d6-47bf-b657-25dac85d452e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:27.552384 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2fb633bb-26d6-47bf-b657-25dac85d452e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1407 microversion: 2.20 time: 0.338053 Oct 04 21:32:27.552958 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2679/5333] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:32:27 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:32:28.235857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f0ea4ae0-8e08-4edd-af04-393e4b9a254f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:28.236528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f0ea4ae0-8e08-4edd-af04-393e4b9a254f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:28.277069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-89372b55-4411-43df-91e6-3e5ede8787e7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "268216f4-b2cd-415a-960c-a01e701d19da"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:28.280521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-89372b55-4411-43df-91e6-3e5ede8787e7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:28.292947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89372b55-4411-43df-91e6-3e5ede8787e7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:28.292947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89372b55-4411-43df-91e6-3e5ede8787e7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:28.292947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89372b55-4411-43df-91e6-3e5ede8787e7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:28.292947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89372b55-4411-43df-91e6-3e5ede8787e7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:28.293757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89372b55-4411-43df-91e6-3e5ede8787e7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:28.294441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89372b55-4411-43df-91e6-3e5ede8787e7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:28.402377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f0ea4ae0-8e08-4edd-af04-393e4b9a254f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:28.411945 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f0ea4ae0-8e08-4edd-af04-393e4b9a254f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1209 microversion: 2.1 time: 0.180624 Oct 04 21:32:28.413301 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2655/5334] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:28 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1209 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:28.597298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c50dd52a-5451-40d5-9bbd-9911b7e5bc9b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:28.597966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c50dd52a-5451-40d5-9bbd-9911b7e5bc9b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:28.610619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c50dd52a-5451-40d5-9bbd-9911b7e5bc9b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:28.611127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c50dd52a-5451-40d5-9bbd-9911b7e5bc9b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:28.611569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c50dd52a-5451-40d5-9bbd-9911b7e5bc9b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:28.612287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c50dd52a-5451-40d5-9bbd-9911b7e5bc9b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:28.612761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c50dd52a-5451-40d5-9bbd-9911b7e5bc9b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:28.613401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c50dd52a-5451-40d5-9bbd-9911b7e5bc9b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:28.823369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c50dd52a-5451-40d5-9bbd-9911b7e5bc9b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:28.832833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c50dd52a-5451-40d5-9bbd-9911b7e5bc9b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:28.834097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c50dd52a-5451-40d5-9bbd-9911b7e5bc9b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:28.835206 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c50dd52a-5451-40d5-9bbd-9911b7e5bc9b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1407 microversion: 2.20 time: 0.242270 Oct 04 21:32:28.835777 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2656/5335] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:32:28 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:32:28.843312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-811be4ef-d5f4-42b7-b932-5ea4c9bc6585 req-6aa1991d-bfba-4bcf-bb3b-048e01017ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b27171c-bb6d-43d4-836d-98fa1c3790d8", "tag": "eaa67688-784e-449d-a04b-3ad12dd87fdc"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:28.850090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-811be4ef-d5f4-42b7-b932-5ea4c9bc6585 req-6aa1991d-bfba-4bcf-bb3b-048e01017ca5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:28.853838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-811be4ef-d5f4-42b7-b932-5ea4c9bc6585 req-6aa1991d-bfba-4bcf-bb3b-048e01017ca5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:28.853838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-811be4ef-d5f4-42b7-b932-5ea4c9bc6585 req-6aa1991d-bfba-4bcf-bb3b-048e01017ca5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:28.861970 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-811be4ef-d5f4-42b7-b932-5ea4c9bc6585 req-6aa1991d-bfba-4bcf-bb3b-048e01017ca5 service nova] Creating event network-changed:eaa67688-784e-449d-a04b-3ad12dd87fdc for instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 on n-h1-860282-1 Oct 04 21:32:28.866953 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-811be4ef-d5f4-42b7-b932-5ea4c9bc6585 req-6aa1991d-bfba-4bcf-bb3b-048e01017ca5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029867 Oct 04 21:32:28.867531 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2657/5336] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:29.398525 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-89372b55-4411-43df-91e6-3e5ede8787e7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "POST /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.123479 Oct 04 21:32:29.398525 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2680/5337] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 21:32:28 2022] POST /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4/os-volume_attachments => generated 194 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:32:29.438120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-90975152-ea90-4d33-9cfb-623172a1fd46 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:29.439865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-90975152-ea90-4d33-9cfb-623172a1fd46 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:29.448738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90975152-ea90-4d33-9cfb-623172a1fd46 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:29.449618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90975152-ea90-4d33-9cfb-623172a1fd46 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:29.450316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90975152-ea90-4d33-9cfb-623172a1fd46 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:29.451242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90975152-ea90-4d33-9cfb-623172a1fd46 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:29.451883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90975152-ea90-4d33-9cfb-623172a1fd46 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:29.452536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90975152-ea90-4d33-9cfb-623172a1fd46 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:29.555871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-90975152-ea90-4d33-9cfb-623172a1fd46 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:29.574910 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-90975152-ea90-4d33-9cfb-623172a1fd46 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1261 microversion: 2.1 time: 0.143637 Oct 04 21:32:29.595836 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2658/5338] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:29 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:29.861352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7f4d3bcd-974f-4e23-9825-9049f811d8c0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:29.862365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7f4d3bcd-974f-4e23-9825-9049f811d8c0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:29.870983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f4d3bcd-974f-4e23-9825-9049f811d8c0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:29.871740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f4d3bcd-974f-4e23-9825-9049f811d8c0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:29.873834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f4d3bcd-974f-4e23-9825-9049f811d8c0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:29.873834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f4d3bcd-974f-4e23-9825-9049f811d8c0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:29.874340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f4d3bcd-974f-4e23-9825-9049f811d8c0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:29.874953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f4d3bcd-974f-4e23-9825-9049f811d8c0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:30.046176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7f4d3bcd-974f-4e23-9825-9049f811d8c0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:30.056237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7f4d3bcd-974f-4e23-9825-9049f811d8c0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:30.058591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7f4d3bcd-974f-4e23-9825-9049f811d8c0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:30.059725 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7f4d3bcd-974f-4e23-9825-9049f811d8c0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1407 microversion: 2.20 time: 0.203067 Oct 04 21:32:30.060500 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2681/5339] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:32:29 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:32:30.615563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9b8a7c1e-57ec-4aac-9239-e80ec9ef432e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:30.616186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9b8a7c1e-57ec-4aac-9239-e80ec9ef432e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:30.623948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b8a7c1e-57ec-4aac-9239-e80ec9ef432e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:30.624428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b8a7c1e-57ec-4aac-9239-e80ec9ef432e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:30.624869 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b8a7c1e-57ec-4aac-9239-e80ec9ef432e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:30.625625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b8a7c1e-57ec-4aac-9239-e80ec9ef432e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:30.626104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b8a7c1e-57ec-4aac-9239-e80ec9ef432e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:30.626534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9b8a7c1e-57ec-4aac-9239-e80ec9ef432e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:30.706888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9b8a7c1e-57ec-4aac-9239-e80ec9ef432e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:30.716005 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9b8a7c1e-57ec-4aac-9239-e80ec9ef432e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1279 microversion: 2.1 time: 0.104245 Oct 04 21:32:30.716530 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2659/5340] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:30 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1279 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:31.085946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9546fc39-8416-4534-8b5f-3409cdfaf4fd tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:31.087189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9546fc39-8416-4534-8b5f-3409cdfaf4fd tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:31.095159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9546fc39-8416-4534-8b5f-3409cdfaf4fd tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:31.099864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9546fc39-8416-4534-8b5f-3409cdfaf4fd tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:31.099864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9546fc39-8416-4534-8b5f-3409cdfaf4fd tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:31.099864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9546fc39-8416-4534-8b5f-3409cdfaf4fd tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:31.099864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9546fc39-8416-4534-8b5f-3409cdfaf4fd tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:31.099864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9546fc39-8416-4534-8b5f-3409cdfaf4fd tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:31.380156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9546fc39-8416-4534-8b5f-3409cdfaf4fd tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:31.413562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9546fc39-8416-4534-8b5f-3409cdfaf4fd tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:31.416233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9546fc39-8416-4534-8b5f-3409cdfaf4fd tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:31.422152 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9546fc39-8416-4534-8b5f-3409cdfaf4fd tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1407 microversion: 2.20 time: 0.335888 Oct 04 21:32:31.422842 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2682/5341] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:32:31 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:32:31.739872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a09f0186-1772-4f21-9eef-3ad284fc1fc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:31.740487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a09f0186-1772-4f21-9eef-3ad284fc1fc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:31.747626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a09f0186-1772-4f21-9eef-3ad284fc1fc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:31.748122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a09f0186-1772-4f21-9eef-3ad284fc1fc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:31.748567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a09f0186-1772-4f21-9eef-3ad284fc1fc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:31.749278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a09f0186-1772-4f21-9eef-3ad284fc1fc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:31.749760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a09f0186-1772-4f21-9eef-3ad284fc1fc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:31.750188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a09f0186-1772-4f21-9eef-3ad284fc1fc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:31.995114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a09f0186-1772-4f21-9eef-3ad284fc1fc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:32.030189 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a09f0186-1772-4f21-9eef-3ad284fc1fc5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1309 microversion: 2.1 time: 0.293834 Oct 04 21:32:32.031309 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2660/5342] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:31 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1309 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:32.452811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c6a036de-dd13-4285-8bc9-2e2e0a61f7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:32.453489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c6a036de-dd13-4285-8bc9-2e2e0a61f7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:32.465346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6a036de-dd13-4285-8bc9-2e2e0a61f7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:32.467074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6a036de-dd13-4285-8bc9-2e2e0a61f7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:32.474361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6a036de-dd13-4285-8bc9-2e2e0a61f7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:32.475528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6a036de-dd13-4285-8bc9-2e2e0a61f7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:32.476954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6a036de-dd13-4285-8bc9-2e2e0a61f7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:32.477701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6a036de-dd13-4285-8bc9-2e2e0a61f7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:32.767481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-517be29e-2b30-43e6-a480-2e67ff16da87 req-5ae6185a-ccc2-41ff-96d4-129813234709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d6305f4-2ee9-4b21-8959-d3ce883eea29", "tag": "451d684a-b38b-48f6-979a-0734b8c48fe1"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:32.797240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-517be29e-2b30-43e6-a480-2e67ff16da87 req-5ae6185a-ccc2-41ff-96d4-129813234709 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:32.797762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-517be29e-2b30-43e6-a480-2e67ff16da87 req-5ae6185a-ccc2-41ff-96d4-129813234709 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:32.801537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-517be29e-2b30-43e6-a480-2e67ff16da87 req-5ae6185a-ccc2-41ff-96d4-129813234709 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:32.836740 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-517be29e-2b30-43e6-a480-2e67ff16da87 req-5ae6185a-ccc2-41ff-96d4-129813234709 service nova] Creating event network-changed:451d684a-b38b-48f6-979a-0734b8c48fe1 for instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 on n-h2-860282-1 Oct 04 21:32:32.846475 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-517be29e-2b30-43e6-a480-2e67ff16da87 req-5ae6185a-ccc2-41ff-96d4-129813234709 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082134 Oct 04 21:32:32.849729 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2661/5343] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:32:32.978085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c6a036de-dd13-4285-8bc9-2e2e0a61f7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:32.989191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c6a036de-dd13-4285-8bc9-2e2e0a61f7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:32.991292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c6a036de-dd13-4285-8bc9-2e2e0a61f7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:32.992625 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c6a036de-dd13-4285-8bc9-2e2e0a61f7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1407 microversion: 2.20 time: 0.544055 Oct 04 21:32:33.009019 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2683/5344] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:32:32 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1407 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:32:33.060357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0fab20a6-3e6d-4481-8a50-88f18ddd6d95 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:33.062090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0fab20a6-3e6d-4481-8a50-88f18ddd6d95 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:33.069472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fab20a6-3e6d-4481-8a50-88f18ddd6d95 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:33.070258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fab20a6-3e6d-4481-8a50-88f18ddd6d95 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:33.070951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fab20a6-3e6d-4481-8a50-88f18ddd6d95 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:33.071893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fab20a6-3e6d-4481-8a50-88f18ddd6d95 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:33.073208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fab20a6-3e6d-4481-8a50-88f18ddd6d95 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:33.073896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fab20a6-3e6d-4481-8a50-88f18ddd6d95 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:33.298355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0fab20a6-3e6d-4481-8a50-88f18ddd6d95 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:33.323253 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0fab20a6-3e6d-4481-8a50-88f18ddd6d95 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1309 microversion: 2.1 time: 0.266456 Oct 04 21:32:33.324334 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2662/5345] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:33 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1309 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:34.022320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f2cd533c-4e1e-4e55-84f5-279ca2ab7468 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:34.023044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f2cd533c-4e1e-4e55-84f5-279ca2ab7468 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:34.031497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2cd533c-4e1e-4e55-84f5-279ca2ab7468 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:34.032489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2cd533c-4e1e-4e55-84f5-279ca2ab7468 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:34.033067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2cd533c-4e1e-4e55-84f5-279ca2ab7468 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:34.034208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2cd533c-4e1e-4e55-84f5-279ca2ab7468 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:34.035042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2cd533c-4e1e-4e55-84f5-279ca2ab7468 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:34.035582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2cd533c-4e1e-4e55-84f5-279ca2ab7468 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:34.179635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f2cd533c-4e1e-4e55-84f5-279ca2ab7468 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:34.187882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f2cd533c-4e1e-4e55-84f5-279ca2ab7468 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:34.190880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f2cd533c-4e1e-4e55-84f5-279ca2ab7468 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:34.190880 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f2cd533c-4e1e-4e55-84f5-279ca2ab7468 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1407 microversion: 2.20 time: 0.173297 Oct 04 21:32:34.191354 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2684/5346] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:32:34 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:32:34.349879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4402f917-2eab-48a4-88dd-2d95047c3932 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:34.350501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4402f917-2eab-48a4-88dd-2d95047c3932 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:34.360137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4402f917-2eab-48a4-88dd-2d95047c3932 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:34.360659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4402f917-2eab-48a4-88dd-2d95047c3932 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:34.361102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4402f917-2eab-48a4-88dd-2d95047c3932 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:34.361925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4402f917-2eab-48a4-88dd-2d95047c3932 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:34.362446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4402f917-2eab-48a4-88dd-2d95047c3932 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:34.362871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4402f917-2eab-48a4-88dd-2d95047c3932 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:34.528457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4402f917-2eab-48a4-88dd-2d95047c3932 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:34.565596 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4402f917-2eab-48a4-88dd-2d95047c3932 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1309 microversion: 2.1 time: 0.207714 Oct 04 21:32:34.565596 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2663/5347] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:34 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1309 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:34.815300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-90a0ea6a-ac39-4b34-ad00-de3737761533 req-91d4f85f-3ad6-43fb-945b-c4f970daafea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b27171c-bb6d-43d4-836d-98fa1c3790d8", "name": "network-vif-plugged", "status": "completed", "tag": "eaa67688-784e-449d-a04b-3ad12dd87fdc"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:34.829533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-90a0ea6a-ac39-4b34-ad00-de3737761533 req-91d4f85f-3ad6-43fb-945b-c4f970daafea service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:34.833694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-90a0ea6a-ac39-4b34-ad00-de3737761533 req-91d4f85f-3ad6-43fb-945b-c4f970daafea service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:34.833694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-90a0ea6a-ac39-4b34-ad00-de3737761533 req-91d4f85f-3ad6-43fb-945b-c4f970daafea service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:34.847889 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-90a0ea6a-ac39-4b34-ad00-de3737761533 req-91d4f85f-3ad6-43fb-945b-c4f970daafea service nova] Creating event network-vif-plugged:eaa67688-784e-449d-a04b-3ad12dd87fdc for instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 on n-h1-860282-1 Oct 04 21:32:34.857034 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-90a0ea6a-ac39-4b34-ad00-de3737761533 req-91d4f85f-3ad6-43fb-945b-c4f970daafea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045327 Oct 04 21:32:34.857703 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2685/5348] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:35.220345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-78608d2a-a7e9-46f4-ad2a-4b24c2c8e143 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:35.222502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-78608d2a-a7e9-46f4-ad2a-4b24c2c8e143 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:35.231693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78608d2a-a7e9-46f4-ad2a-4b24c2c8e143 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:35.232704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78608d2a-a7e9-46f4-ad2a-4b24c2c8e143 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:35.233344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78608d2a-a7e9-46f4-ad2a-4b24c2c8e143 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:35.234278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78608d2a-a7e9-46f4-ad2a-4b24c2c8e143 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:35.234811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78608d2a-a7e9-46f4-ad2a-4b24c2c8e143 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:35.235251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-78608d2a-a7e9-46f4-ad2a-4b24c2c8e143 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:35.600628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-607600e8-8b05-4473-84d5-9deb960b03ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:35.602220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-607600e8-8b05-4473-84d5-9deb960b03ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:35.614231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-607600e8-8b05-4473-84d5-9deb960b03ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:35.615122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-607600e8-8b05-4473-84d5-9deb960b03ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:35.615804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-607600e8-8b05-4473-84d5-9deb960b03ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:35.616753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-607600e8-8b05-4473-84d5-9deb960b03ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:35.617482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-607600e8-8b05-4473-84d5-9deb960b03ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:35.618360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-607600e8-8b05-4473-84d5-9deb960b03ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:35.765781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-78608d2a-a7e9-46f4-ad2a-4b24c2c8e143 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:35.773102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-78608d2a-a7e9-46f4-ad2a-4b24c2c8e143 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:35.779239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-78608d2a-a7e9-46f4-ad2a-4b24c2c8e143 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:35.780447 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-78608d2a-a7e9-46f4-ad2a-4b24c2c8e143 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1407 microversion: 2.20 time: 0.564904 Oct 04 21:32:35.781441 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2664/5349] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:32:35 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1407 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:32:35.844082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-607600e8-8b05-4473-84d5-9deb960b03ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:35.853028 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-607600e8-8b05-4473-84d5-9deb960b03ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1309 microversion: 2.1 time: 0.259197 Oct 04 21:32:35.857291 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2686/5350] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:35 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1309 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:36.805913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6e614ef8-c3aa-49ca-8bf2-b3a99fccf639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:36.806767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6e614ef8-c3aa-49ca-8bf2-b3a99fccf639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:36.815113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e614ef8-c3aa-49ca-8bf2-b3a99fccf639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:36.815605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e614ef8-c3aa-49ca-8bf2-b3a99fccf639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:36.816048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e614ef8-c3aa-49ca-8bf2-b3a99fccf639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:36.816743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e614ef8-c3aa-49ca-8bf2-b3a99fccf639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:36.817201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e614ef8-c3aa-49ca-8bf2-b3a99fccf639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:36.817674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e614ef8-c3aa-49ca-8bf2-b3a99fccf639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:36.879919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5ae07712-b7a9-40c0-9717-afee4504b50e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:36.880545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5ae07712-b7a9-40c0-9717-afee4504b50e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:36.884392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:36.885729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=18 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:36.889307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ae07712-b7a9-40c0-9717-afee4504b50e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:36.889818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ae07712-b7a9-40c0-9717-afee4504b50e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:36.890261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ae07712-b7a9-40c0-9717-afee4504b50e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:36.892885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ae07712-b7a9-40c0-9717-afee4504b50e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:36.892885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ae07712-b7a9-40c0-9717-afee4504b50e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:36.892885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ae07712-b7a9-40c0-9717-afee4504b50e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:36.985082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6e614ef8-c3aa-49ca-8bf2-b3a99fccf639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:36.994859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6e614ef8-c3aa-49ca-8bf2-b3a99fccf639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:36.996589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6e614ef8-c3aa-49ca-8bf2-b3a99fccf639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:36.997821 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6e614ef8-c3aa-49ca-8bf2-b3a99fccf639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1598 microversion: 2.20 time: 0.195781 Oct 04 21:32:36.998401 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2665/5351] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:32:36 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1598 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:32:37.022668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7b9ee997-c610-4679-956f-79882db8866e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:37.023265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7b9ee997-c610-4679-956f-79882db8866e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:37.029469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b9ee997-c610-4679-956f-79882db8866e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:37.030627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b9ee997-c610-4679-956f-79882db8866e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:37.030627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b9ee997-c610-4679-956f-79882db8866e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:37.031421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b9ee997-c610-4679-956f-79882db8866e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:37.031958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b9ee997-c610-4679-956f-79882db8866e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:37.032478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b9ee997-c610-4679-956f-79882db8866e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:37.045957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5ae07712-b7a9-40c0-9717-afee4504b50e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:37.056180 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5ae07712-b7a9-40c0-9717-afee4504b50e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1309 microversion: 2.1 time: 0.181279 Oct 04 21:32:37.067712 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2687/5352] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:36 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1309 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:37.114884 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7b9ee997-c610-4679-956f-79882db8866e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096420 Oct 04 21:32:37.115513 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2666/5353] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Oct 4 21:32:37 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:32:38.088803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6431300d-a7e1-4597-a6e2-961fa8e3d765 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:38.089578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6431300d-a7e1-4597-a6e2-961fa8e3d765 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:38.097063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6431300d-a7e1-4597-a6e2-961fa8e3d765 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:38.103888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6431300d-a7e1-4597-a6e2-961fa8e3d765 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:38.103888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6431300d-a7e1-4597-a6e2-961fa8e3d765 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:38.103888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6431300d-a7e1-4597-a6e2-961fa8e3d765 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:38.103888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6431300d-a7e1-4597-a6e2-961fa8e3d765 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:38.103888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6431300d-a7e1-4597-a6e2-961fa8e3d765 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:38.183226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-e847fe5d-610b-4ff9-9bbe-8b62027d6ec0 req-57eb0b1d-2774-4b31-a760-dbbdf302c56f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6305f4-2ee9-4b21-8959-d3ce883eea29", "name": "network-vif-plugged", "status": "completed", "tag": "451d684a-b38b-48f6-979a-0734b8c48fe1"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:38.202078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e847fe5d-610b-4ff9-9bbe-8b62027d6ec0 req-57eb0b1d-2774-4b31-a760-dbbdf302c56f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:38.202839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e847fe5d-610b-4ff9-9bbe-8b62027d6ec0 req-57eb0b1d-2774-4b31-a760-dbbdf302c56f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:38.203334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e847fe5d-610b-4ff9-9bbe-8b62027d6ec0 req-57eb0b1d-2774-4b31-a760-dbbdf302c56f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:38.216353 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-e847fe5d-610b-4ff9-9bbe-8b62027d6ec0 req-57eb0b1d-2774-4b31-a760-dbbdf302c56f service nova] Creating event network-vif-plugged:451d684a-b38b-48f6-979a-0734b8c48fe1 for instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 on n-h2-860282-1 Oct 04 21:32:38.221840 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-e847fe5d-610b-4ff9-9bbe-8b62027d6ec0 req-57eb0b1d-2774-4b31-a760-dbbdf302c56f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043251 Oct 04 21:32:38.222446 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2667/5354] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:38.386727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6431300d-a7e1-4597-a6e2-961fa8e3d765 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:38.392597 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6431300d-a7e1-4597-a6e2-961fa8e3d765 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1309 microversion: 2.1 time: 0.311516 Oct 04 21:32:38.394062 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2688/5355] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:38 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1309 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:38.478095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:38.482774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-11b8f1e7-7496-4cc5-bf0a-a525ceb5acd8 req-70222c78-33a0-4b25-ab73-124dc1c674f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b27171c-bb6d-43d4-836d-98fa1c3790d8", "tag": "eaa67688-784e-449d-a04b-3ad12dd87fdc"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:38.492238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-11b8f1e7-7496-4cc5-bf0a-a525ceb5acd8 req-70222c78-33a0-4b25-ab73-124dc1c674f2 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:38.492729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-11b8f1e7-7496-4cc5-bf0a-a525ceb5acd8 req-70222c78-33a0-4b25-ab73-124dc1c674f2 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:38.493160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-11b8f1e7-7496-4cc5-bf0a-a525ceb5acd8 req-70222c78-33a0-4b25-ab73-124dc1c674f2 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:38.505048 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-11b8f1e7-7496-4cc5-bf0a-a525ceb5acd8 req-70222c78-33a0-4b25-ab73-124dc1c674f2 service nova] Creating event network-changed:eaa67688-784e-449d-a04b-3ad12dd87fdc for instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 on n-h1-860282-1 Oct 04 21:32:38.511118 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-11b8f1e7-7496-4cc5-bf0a-a525ceb5acd8 req-70222c78-33a0-4b25-ab73-124dc1c674f2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032605 Oct 04 21:32:38.511806 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2668/5356] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:39.417506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-16e019d8-9632-4b53-a83f-48e7e2a281d6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:39.418137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-16e019d8-9632-4b53-a83f-48e7e2a281d6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:39.425710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16e019d8-9632-4b53-a83f-48e7e2a281d6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:39.432554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16e019d8-9632-4b53-a83f-48e7e2a281d6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:39.432554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16e019d8-9632-4b53-a83f-48e7e2a281d6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:39.432554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16e019d8-9632-4b53-a83f-48e7e2a281d6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:39.432554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16e019d8-9632-4b53-a83f-48e7e2a281d6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:39.432554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16e019d8-9632-4b53-a83f-48e7e2a281d6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:39.583421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-16e019d8-9632-4b53-a83f-48e7e2a281d6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:39.592424 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-16e019d8-9632-4b53-a83f-48e7e2a281d6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1309 microversion: 2.1 time: 0.179420 Oct 04 21:32:39.598656 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2689/5357] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:39 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1309 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:40.618272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-da049e06-5f9f-4c5c-90d1-8319767f8745 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:40.619533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-da049e06-5f9f-4c5c-90d1-8319767f8745 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:40.626203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-da049e06-5f9f-4c5c-90d1-8319767f8745 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:40.626960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-da049e06-5f9f-4c5c-90d1-8319767f8745 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:40.627402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-da049e06-5f9f-4c5c-90d1-8319767f8745 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:40.628120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-da049e06-5f9f-4c5c-90d1-8319767f8745 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:40.628558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-da049e06-5f9f-4c5c-90d1-8319767f8745 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:40.628989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-da049e06-5f9f-4c5c-90d1-8319767f8745 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:40.764251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-da049e06-5f9f-4c5c-90d1-8319767f8745 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:40.772281 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-da049e06-5f9f-4c5c-90d1-8319767f8745 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1489 microversion: 2.1 time: 0.159660 Oct 04 21:32:40.772867 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2669/5358] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:40 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1489 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:40.795697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6364e9a5-fc0f-46d4-9176-24d65362547a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1106348336"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:40.798230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6364e9a5-fc0f-46d4-9176-24d65362547a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:40.805095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6364e9a5-fc0f-46d4-9176-24d65362547a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:40.805652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6364e9a5-fc0f-46d4-9176-24d65362547a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:40.806103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6364e9a5-fc0f-46d4-9176-24d65362547a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:40.807553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6364e9a5-fc0f-46d4-9176-24d65362547a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:40.808038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6364e9a5-fc0f-46d4-9176-24d65362547a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:40.808483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6364e9a5-fc0f-46d4-9176-24d65362547a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:40.940638 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6364e9a5-fc0f-46d4-9176-24d65362547a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "PUT /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1074 microversion: 2.1 time: 0.148832 Oct 04 21:32:40.943126 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2690/5359] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Oct 4 21:32:40 2022] PUT /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1074 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:40.961563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-659fc558-37b3-4368-a876-e8b980de2d32 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:40.962197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-659fc558-37b3-4368-a876-e8b980de2d32 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:40.970355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-659fc558-37b3-4368-a876-e8b980de2d32 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:40.970945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-659fc558-37b3-4368-a876-e8b980de2d32 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:40.971486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-659fc558-37b3-4368-a876-e8b980de2d32 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:40.972268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-659fc558-37b3-4368-a876-e8b980de2d32 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:40.972901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-659fc558-37b3-4368-a876-e8b980de2d32 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:40.973444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-659fc558-37b3-4368-a876-e8b980de2d32 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:40.976890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:41.121726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-659fc558-37b3-4368-a876-e8b980de2d32 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:41.129460 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-659fc558-37b3-4368-a876-e8b980de2d32 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1500 microversion: 2.1 time: 0.172066 Oct 04 21:32:41.130037 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2670/5360] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:40 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1500 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:41.153918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f2db5432-4476-4848-b831-96267a5b6268 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:41.154474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f2db5432-4476-4848-b831-96267a5b6268 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:41.160777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2db5432-4476-4848-b831-96267a5b6268 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:41.161265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2db5432-4476-4848-b831-96267a5b6268 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:41.161746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2db5432-4476-4848-b831-96267a5b6268 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:41.162451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2db5432-4476-4848-b831-96267a5b6268 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:41.162918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2db5432-4476-4848-b831-96267a5b6268 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:41.163354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2db5432-4476-4848-b831-96267a5b6268 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:41.305646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f2db5432-4476-4848-b831-96267a5b6268 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:41.316156 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f2db5432-4476-4848-b831-96267a5b6268 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1500 microversion: 2.1 time: 0.167379 Oct 04 21:32:41.316799 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2691/5361] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:41 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1500 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:41.338908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-80be3bea-216e-4840-b7e9-7cb9c19d106a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:41.344860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80be3bea-216e-4840-b7e9-7cb9c19d106a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:41.345340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80be3bea-216e-4840-b7e9-7cb9c19d106a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:41.345813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80be3bea-216e-4840-b7e9-7cb9c19d106a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:41.369648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-80be3bea-216e-4840-b7e9-7cb9c19d106a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Going to try to stop instance {{(pid=122758) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:32:41.592096 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-80be3bea-216e-4840-b7e9-7cb9c19d106a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "POST /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29/action" status: 202 len: 0 microversion: 2.1 time: 0.256969 Oct 04 21:32:41.592710 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2671/5362] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:32:41 2022] POST /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:32:41.605212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e19853c6-c44b-4ac4-bf7c-dad793532c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:41.605884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e19853c6-c44b-4ac4-bf7c-dad793532c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:41.611994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e19853c6-c44b-4ac4-bf7c-dad793532c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:41.612482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e19853c6-c44b-4ac4-bf7c-dad793532c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:41.612923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e19853c6-c44b-4ac4-bf7c-dad793532c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:41.613644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e19853c6-c44b-4ac4-bf7c-dad793532c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:41.614108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e19853c6-c44b-4ac4-bf7c-dad793532c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:41.614539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e19853c6-c44b-4ac4-bf7c-dad793532c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:41.617065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:41.756933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e19853c6-c44b-4ac4-bf7c-dad793532c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:41.768231 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e19853c6-c44b-4ac4-bf7c-dad793532c0f tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.167258 Oct 04 21:32:41.768814 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2692/5363] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:41 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:42.579184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-40a366ab-8992-4641-b168-e367956f5050 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:42.585323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40a366ab-8992-4641-b168-e367956f5050 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:42.585842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40a366ab-8992-4641-b168-e367956f5050 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:42.586277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40a366ab-8992-4641-b168-e367956f5050 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:42.610753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-40a366ab-8992-4641-b168-e367956f5050 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Going to try to stop instance {{(pid=122758) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:32:42.793504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3475c847-5497-4f06-850a-624cad9749c6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:42.794073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3475c847-5497-4f06-850a-624cad9749c6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:42.802090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3475c847-5497-4f06-850a-624cad9749c6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:42.802579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3475c847-5497-4f06-850a-624cad9749c6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:42.803022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3475c847-5497-4f06-850a-624cad9749c6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:42.803717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3475c847-5497-4f06-850a-624cad9749c6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:42.804178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3475c847-5497-4f06-850a-624cad9749c6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:42.804609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3475c847-5497-4f06-850a-624cad9749c6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:42.895709 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-40a366ab-8992-4641-b168-e367956f5050 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "POST /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4/action" status: 202 len: 0 microversion: 2.1 time: 0.321374 Oct 04 21:32:42.896455 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2672/5364] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:32:42 2022] POST /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:32:42.921801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c5065896-c225-4c8c-b31c-685a19ebad6f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:42.922509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c5065896-c225-4c8c-b31c-685a19ebad6f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:42.928760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5065896-c225-4c8c-b31c-685a19ebad6f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:42.929252 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5065896-c225-4c8c-b31c-685a19ebad6f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:42.929716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5065896-c225-4c8c-b31c-685a19ebad6f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:42.930420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5065896-c225-4c8c-b31c-685a19ebad6f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:42.930870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5065896-c225-4c8c-b31c-685a19ebad6f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:42.931966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5065896-c225-4c8c-b31c-685a19ebad6f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:42.942701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3475c847-5497-4f06-850a-624cad9749c6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:42.952364 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3475c847-5497-4f06-850a-624cad9749c6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.163694 Oct 04 21:32:42.952951 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2693/5365] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:42 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:43.071383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c5065896-c225-4c8c-b31c-685a19ebad6f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:43.084858 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c5065896-c225-4c8c-b31c-685a19ebad6f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1722 microversion: 2.1 time: 0.167859 Oct 04 21:32:43.085479 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2673/5366] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:42 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:43.976487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-011ba13a-df62-45c7-9abc-91cbc41c1ad7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:43.977376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-011ba13a-df62-45c7-9abc-91cbc41c1ad7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:43.984884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-011ba13a-df62-45c7-9abc-91cbc41c1ad7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:43.985371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-011ba13a-df62-45c7-9abc-91cbc41c1ad7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:43.985841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-011ba13a-df62-45c7-9abc-91cbc41c1ad7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:43.986526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-011ba13a-df62-45c7-9abc-91cbc41c1ad7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:43.986980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-011ba13a-df62-45c7-9abc-91cbc41c1ad7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:43.987429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-011ba13a-df62-45c7-9abc-91cbc41c1ad7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:44.111724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-45e8bea0-3393-4596-8c9f-a1d6f19dd05c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:44.112516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-45e8bea0-3393-4596-8c9f-a1d6f19dd05c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:44.123482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45e8bea0-3393-4596-8c9f-a1d6f19dd05c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:44.123482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45e8bea0-3393-4596-8c9f-a1d6f19dd05c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:44.123482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45e8bea0-3393-4596-8c9f-a1d6f19dd05c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:44.124145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-011ba13a-df62-45c7-9abc-91cbc41c1ad7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:44.124883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45e8bea0-3393-4596-8c9f-a1d6f19dd05c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:44.125676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45e8bea0-3393-4596-8c9f-a1d6f19dd05c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:44.127183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45e8bea0-3393-4596-8c9f-a1d6f19dd05c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:44.133373 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-011ba13a-df62-45c7-9abc-91cbc41c1ad7 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.160200 Oct 04 21:32:44.133518 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2694/5367] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:43 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:44.279801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-45e8bea0-3393-4596-8c9f-a1d6f19dd05c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:44.288612 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-45e8bea0-3393-4596-8c9f-a1d6f19dd05c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1722 microversion: 2.1 time: 0.180855 Oct 04 21:32:44.289188 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2674/5368] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:44 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:45.161092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-93fc40e8-4f50-4f74-b056-a7175a19823e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:45.161803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-93fc40e8-4f50-4f74-b056-a7175a19823e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:45.173348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93fc40e8-4f50-4f74-b056-a7175a19823e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:45.173893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93fc40e8-4f50-4f74-b056-a7175a19823e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:45.175978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93fc40e8-4f50-4f74-b056-a7175a19823e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:45.175978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93fc40e8-4f50-4f74-b056-a7175a19823e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:45.175978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93fc40e8-4f50-4f74-b056-a7175a19823e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:45.175978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93fc40e8-4f50-4f74-b056-a7175a19823e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:45.315794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a8bb476e-5a44-4fb1-93c6-c6882547f073 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:45.316499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a8bb476e-5a44-4fb1-93c6-c6882547f073 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:45.323217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a8bb476e-5a44-4fb1-93c6-c6882547f073 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:45.324079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a8bb476e-5a44-4fb1-93c6-c6882547f073 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:45.325256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a8bb476e-5a44-4fb1-93c6-c6882547f073 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:45.326392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a8bb476e-5a44-4fb1-93c6-c6882547f073 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:45.327381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a8bb476e-5a44-4fb1-93c6-c6882547f073 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:45.328160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a8bb476e-5a44-4fb1-93c6-c6882547f073 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:45.335639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-93fc40e8-4f50-4f74-b056-a7175a19823e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:45.344838 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-93fc40e8-4f50-4f74-b056-a7175a19823e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.188183 Oct 04 21:32:45.345783 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2695/5369] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:45 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:45.472456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a8bb476e-5a44-4fb1-93c6-c6882547f073 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:45.481757 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a8bb476e-5a44-4fb1-93c6-c6882547f073 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1722 microversion: 2.1 time: 0.171670 Oct 04 21:32:45.482350 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2675/5370] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:45 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:46.369589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b1a26442-e869-4e45-a3b7-2c40c62afef8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:46.371652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b1a26442-e869-4e45-a3b7-2c40c62afef8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:46.378780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1a26442-e869-4e45-a3b7-2c40c62afef8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:46.379279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1a26442-e869-4e45-a3b7-2c40c62afef8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:46.379723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1a26442-e869-4e45-a3b7-2c40c62afef8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:46.380437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1a26442-e869-4e45-a3b7-2c40c62afef8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:46.380989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1a26442-e869-4e45-a3b7-2c40c62afef8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:46.381450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1a26442-e869-4e45-a3b7-2c40c62afef8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:46.505277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-488a6551-faf9-4603-b124-857609bbcec4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:46.506015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-488a6551-faf9-4603-b124-857609bbcec4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:46.513496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-488a6551-faf9-4603-b124-857609bbcec4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:46.514002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-488a6551-faf9-4603-b124-857609bbcec4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:46.514840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-488a6551-faf9-4603-b124-857609bbcec4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:46.515583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-488a6551-faf9-4603-b124-857609bbcec4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:46.516044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-488a6551-faf9-4603-b124-857609bbcec4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:46.516477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-488a6551-faf9-4603-b124-857609bbcec4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:46.521737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b1a26442-e869-4e45-a3b7-2c40c62afef8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:46.530949 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b1a26442-e869-4e45-a3b7-2c40c62afef8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.165347 Oct 04 21:32:46.531544 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2696/5371] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:46 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:46.658894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-488a6551-faf9-4603-b124-857609bbcec4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:46.667592 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-488a6551-faf9-4603-b124-857609bbcec4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1722 microversion: 2.1 time: 0.167031 Oct 04 21:32:46.676346 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2676/5372] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:46 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:47.555093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f72c5d88-b4db-46c3-a9f3-2e622ef5a85c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:47.555795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f72c5d88-b4db-46c3-a9f3-2e622ef5a85c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:47.564005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f72c5d88-b4db-46c3-a9f3-2e622ef5a85c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:47.564511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f72c5d88-b4db-46c3-a9f3-2e622ef5a85c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:47.564983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f72c5d88-b4db-46c3-a9f3-2e622ef5a85c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:47.565754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f72c5d88-b4db-46c3-a9f3-2e622ef5a85c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:47.566253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f72c5d88-b4db-46c3-a9f3-2e622ef5a85c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:47.566704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f72c5d88-b4db-46c3-a9f3-2e622ef5a85c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:47.697770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d4467359-3f82-4700-a6d8-9835d9fd2d51 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:47.698692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d4467359-3f82-4700-a6d8-9835d9fd2d51 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:47.700916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f72c5d88-b4db-46c3-a9f3-2e622ef5a85c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:47.705708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4467359-3f82-4700-a6d8-9835d9fd2d51 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:47.706202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4467359-3f82-4700-a6d8-9835d9fd2d51 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:47.706646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4467359-3f82-4700-a6d8-9835d9fd2d51 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:47.707348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4467359-3f82-4700-a6d8-9835d9fd2d51 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:47.707807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4467359-3f82-4700-a6d8-9835d9fd2d51 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:47.708543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4467359-3f82-4700-a6d8-9835d9fd2d51 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:47.708677 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f72c5d88-b4db-46c3-a9f3-2e622ef5a85c tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.157853 Oct 04 21:32:47.717823 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2697/5373] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:47 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:47.848586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d4467359-3f82-4700-a6d8-9835d9fd2d51 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:47.858324 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d4467359-3f82-4700-a6d8-9835d9fd2d51 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1722 microversion: 2.1 time: 0.164379 Oct 04 21:32:47.858917 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2677/5374] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:47 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:48.733082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7fbf8c35-7bf2-4891-aa5a-2e6ca4085cde tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:48.733822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7fbf8c35-7bf2-4891-aa5a-2e6ca4085cde tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:48.740607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fbf8c35-7bf2-4891-aa5a-2e6ca4085cde tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:48.741097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fbf8c35-7bf2-4891-aa5a-2e6ca4085cde tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:48.741560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fbf8c35-7bf2-4891-aa5a-2e6ca4085cde tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:48.742259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fbf8c35-7bf2-4891-aa5a-2e6ca4085cde tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:48.742746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fbf8c35-7bf2-4891-aa5a-2e6ca4085cde tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:48.743173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fbf8c35-7bf2-4891-aa5a-2e6ca4085cde tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:48.877444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7fbf8c35-7bf2-4891-aa5a-2e6ca4085cde tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:48.885814 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7fbf8c35-7bf2-4891-aa5a-2e6ca4085cde tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.157308 Oct 04 21:32:48.897445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3fb72931-f83d-4b20-9094-aa3137e3e383 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:48.897445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3fb72931-f83d-4b20-9094-aa3137e3e383 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:48.898074 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2698/5375] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:48 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:48.898186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fb72931-f83d-4b20-9094-aa3137e3e383 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:48.898186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fb72931-f83d-4b20-9094-aa3137e3e383 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:48.898186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fb72931-f83d-4b20-9094-aa3137e3e383 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:48.898186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fb72931-f83d-4b20-9094-aa3137e3e383 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:48.898533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fb72931-f83d-4b20-9094-aa3137e3e383 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:48.899033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3fb72931-f83d-4b20-9094-aa3137e3e383 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:49.341090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3fb72931-f83d-4b20-9094-aa3137e3e383 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:49.349676 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3fb72931-f83d-4b20-9094-aa3137e3e383 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1722 microversion: 2.1 time: 0.465916 Oct 04 21:32:49.350262 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2678/5376] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:48 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1722 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:49.913579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7ae146c0-98f2-4926-8fb9-d4d6b49c3a6b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:49.916270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7ae146c0-98f2-4926-8fb9-d4d6b49c3a6b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:49.922090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ae146c0-98f2-4926-8fb9-d4d6b49c3a6b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:49.922579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ae146c0-98f2-4926-8fb9-d4d6b49c3a6b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:49.923114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ae146c0-98f2-4926-8fb9-d4d6b49c3a6b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:49.923862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ae146c0-98f2-4926-8fb9-d4d6b49c3a6b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:49.924346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ae146c0-98f2-4926-8fb9-d4d6b49c3a6b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:49.924779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ae146c0-98f2-4926-8fb9-d4d6b49c3a6b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:50.058543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7ae146c0-98f2-4926-8fb9-d4d6b49c3a6b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:50.066862 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7ae146c0-98f2-4926-8fb9-d4d6b49c3a6b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.157781 Oct 04 21:32:50.067748 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2699/5377] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:49 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:50.377959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dc6e970b-c845-4b72-8eab-e1e0e7a3a7eb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:50.378582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dc6e970b-c845-4b72-8eab-e1e0e7a3a7eb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:50.385442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc6e970b-c845-4b72-8eab-e1e0e7a3a7eb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:50.385960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc6e970b-c845-4b72-8eab-e1e0e7a3a7eb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:50.386391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc6e970b-c845-4b72-8eab-e1e0e7a3a7eb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:50.387594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc6e970b-c845-4b72-8eab-e1e0e7a3a7eb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:50.388057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc6e970b-c845-4b72-8eab-e1e0e7a3a7eb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:50.388489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc6e970b-c845-4b72-8eab-e1e0e7a3a7eb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:50.536613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dc6e970b-c845-4b72-8eab-e1e0e7a3a7eb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:50.550235 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dc6e970b-c845-4b72-8eab-e1e0e7a3a7eb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1722 microversion: 2.1 time: 0.175578 Oct 04 21:32:50.551464 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2679/5378] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:50 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:51.090895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-699e20e4-daaa-4766-827c-60312ab2baeb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:51.091513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-699e20e4-daaa-4766-827c-60312ab2baeb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:51.098603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-699e20e4-daaa-4766-827c-60312ab2baeb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:51.099101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-699e20e4-daaa-4766-827c-60312ab2baeb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:51.099530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-699e20e4-daaa-4766-827c-60312ab2baeb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:51.100244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-699e20e4-daaa-4766-827c-60312ab2baeb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:51.100703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-699e20e4-daaa-4766-827c-60312ab2baeb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:51.101135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-699e20e4-daaa-4766-827c-60312ab2baeb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:51.277088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-699e20e4-daaa-4766-827c-60312ab2baeb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:51.285791 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-699e20e4-daaa-4766-827c-60312ab2baeb tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.199364 Oct 04 21:32:51.286496 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2700/5379] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:51 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:51.576551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c1f152a3-96f1-48f6-b1b4-c925fcb25012 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:51.577172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c1f152a3-96f1-48f6-b1b4-c925fcb25012 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:51.584213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1f152a3-96f1-48f6-b1b4-c925fcb25012 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:51.584704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1f152a3-96f1-48f6-b1b4-c925fcb25012 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:51.588630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1f152a3-96f1-48f6-b1b4-c925fcb25012 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:51.588630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1f152a3-96f1-48f6-b1b4-c925fcb25012 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:51.588630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1f152a3-96f1-48f6-b1b4-c925fcb25012 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:51.588630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1f152a3-96f1-48f6-b1b4-c925fcb25012 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:51.738602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c1f152a3-96f1-48f6-b1b4-c925fcb25012 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:51.747811 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c1f152a3-96f1-48f6-b1b4-c925fcb25012 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1722 microversion: 2.1 time: 0.175456 Oct 04 21:32:51.748423 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2680/5380] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:51 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:52.309983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-86b81ab4-5163-42a5-a5d1-8b991b4fcd71 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:52.310860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-86b81ab4-5163-42a5-a5d1-8b991b4fcd71 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:52.318099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86b81ab4-5163-42a5-a5d1-8b991b4fcd71 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:52.318620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86b81ab4-5163-42a5-a5d1-8b991b4fcd71 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:52.319065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86b81ab4-5163-42a5-a5d1-8b991b4fcd71 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:52.319769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86b81ab4-5163-42a5-a5d1-8b991b4fcd71 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:52.320239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86b81ab4-5163-42a5-a5d1-8b991b4fcd71 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:52.320673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86b81ab4-5163-42a5-a5d1-8b991b4fcd71 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:52.468499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-86b81ab4-5163-42a5-a5d1-8b991b4fcd71 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:52.478196 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-86b81ab4-5163-42a5-a5d1-8b991b4fcd71 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.172307 Oct 04 21:32:52.478990 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2701/5381] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:52 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:52.772497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c45039ef-1f60-43ad-9f8e-f40721507ca3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:52.773786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c45039ef-1f60-43ad-9f8e-f40721507ca3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:52.782700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c45039ef-1f60-43ad-9f8e-f40721507ca3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:52.783407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c45039ef-1f60-43ad-9f8e-f40721507ca3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:52.784353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c45039ef-1f60-43ad-9f8e-f40721507ca3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:52.785258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c45039ef-1f60-43ad-9f8e-f40721507ca3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:52.785902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c45039ef-1f60-43ad-9f8e-f40721507ca3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:52.786504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c45039ef-1f60-43ad-9f8e-f40721507ca3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:52.934868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c45039ef-1f60-43ad-9f8e-f40721507ca3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:52.947393 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c45039ef-1f60-43ad-9f8e-f40721507ca3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1722 microversion: 2.1 time: 0.178824 Oct 04 21:32:52.949242 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2681/5382] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:52 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:53.505220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7e3ca90a-137e-41ec-b200-3b530f1143ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:53.505895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7e3ca90a-137e-41ec-b200-3b530f1143ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:53.513241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e3ca90a-137e-41ec-b200-3b530f1143ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:53.513796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e3ca90a-137e-41ec-b200-3b530f1143ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:53.514284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e3ca90a-137e-41ec-b200-3b530f1143ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:53.515032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e3ca90a-137e-41ec-b200-3b530f1143ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:53.515496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e3ca90a-137e-41ec-b200-3b530f1143ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:53.515928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e3ca90a-137e-41ec-b200-3b530f1143ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:53.656772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7e3ca90a-137e-41ec-b200-3b530f1143ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:53.665257 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7e3ca90a-137e-41ec-b200-3b530f1143ca tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.165823 Oct 04 21:32:53.665856 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2702/5383] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:53 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:53.971985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2eef6515-8c26-44f7-9195-99139074a861 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:53.972599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2eef6515-8c26-44f7-9195-99139074a861 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:53.979927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2eef6515-8c26-44f7-9195-99139074a861 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:53.980970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2eef6515-8c26-44f7-9195-99139074a861 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:53.981837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2eef6515-8c26-44f7-9195-99139074a861 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:53.983794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2eef6515-8c26-44f7-9195-99139074a861 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:53.984260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2eef6515-8c26-44f7-9195-99139074a861 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:53.984987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2eef6515-8c26-44f7-9195-99139074a861 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:54.134244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2eef6515-8c26-44f7-9195-99139074a861 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:54.143146 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2eef6515-8c26-44f7-9195-99139074a861 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1722 microversion: 2.1 time: 0.175132 Oct 04 21:32:54.145489 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2682/5384] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:53 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:54.689738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2ee6d419-7518-4da1-9796-c2ea9b42e366 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:54.690572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2ee6d419-7518-4da1-9796-c2ea9b42e366 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:54.697546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ee6d419-7518-4da1-9796-c2ea9b42e366 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:54.698154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ee6d419-7518-4da1-9796-c2ea9b42e366 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:54.698666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ee6d419-7518-4da1-9796-c2ea9b42e366 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:54.699434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ee6d419-7518-4da1-9796-c2ea9b42e366 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:54.699972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ee6d419-7518-4da1-9796-c2ea9b42e366 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:54.700500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ee6d419-7518-4da1-9796-c2ea9b42e366 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:54.903301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2ee6d419-7518-4da1-9796-c2ea9b42e366 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:54.912014 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2ee6d419-7518-4da1-9796-c2ea9b42e366 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.226287 Oct 04 21:32:54.912589 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2703/5385] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:54 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:55.166621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-73193f06-99ed-4479-86f3-68bb4353ad98 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:55.167230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-73193f06-99ed-4479-86f3-68bb4353ad98 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:55.174414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73193f06-99ed-4479-86f3-68bb4353ad98 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:55.175095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73193f06-99ed-4479-86f3-68bb4353ad98 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:55.175535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73193f06-99ed-4479-86f3-68bb4353ad98 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:55.176700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73193f06-99ed-4479-86f3-68bb4353ad98 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:55.177173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73193f06-99ed-4479-86f3-68bb4353ad98 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:55.177761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73193f06-99ed-4479-86f3-68bb4353ad98 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:55.334734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-73193f06-99ed-4479-86f3-68bb4353ad98 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:55.344888 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-73193f06-99ed-4479-86f3-68bb4353ad98 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1722 microversion: 2.1 time: 0.182349 Oct 04 21:32:55.345694 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2683/5386] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:55 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:55.935840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dd86d136-13f3-451f-b205-f09dd3cd8f3d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:55.936461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dd86d136-13f3-451f-b205-f09dd3cd8f3d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:55.944023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd86d136-13f3-451f-b205-f09dd3cd8f3d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:55.944518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd86d136-13f3-451f-b205-f09dd3cd8f3d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:55.944972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd86d136-13f3-451f-b205-f09dd3cd8f3d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:55.945685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd86d136-13f3-451f-b205-f09dd3cd8f3d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:55.946142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd86d136-13f3-451f-b205-f09dd3cd8f3d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:55.946637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd86d136-13f3-451f-b205-f09dd3cd8f3d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:56.127855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dd86d136-13f3-451f-b205-f09dd3cd8f3d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:56.136607 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dd86d136-13f3-451f-b205-f09dd3cd8f3d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.205388 Oct 04 21:32:56.137248 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2704/5387] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:55 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:56.370675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b9be8eeb-ee10-49e0-92ef-f32373630de0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:56.371621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b9be8eeb-ee10-49e0-92ef-f32373630de0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:56.374968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=73 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:56.380036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9be8eeb-ee10-49e0-92ef-f32373630de0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:56.380603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9be8eeb-ee10-49e0-92ef-f32373630de0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:56.381119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9be8eeb-ee10-49e0-92ef-f32373630de0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:56.381958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9be8eeb-ee10-49e0-92ef-f32373630de0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:56.382599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9be8eeb-ee10-49e0-92ef-f32373630de0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:56.383194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9be8eeb-ee10-49e0-92ef-f32373630de0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:56.538167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b9be8eeb-ee10-49e0-92ef-f32373630de0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:56.540388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:56.548366 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b9be8eeb-ee10-49e0-92ef-f32373630de0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1722 microversion: 2.1 time: 0.181993 Oct 04 21:32:56.548941 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2684/5388] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:56 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:57.161549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-058bf653-dd28-47d4-93bd-78e17b0cf650 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:57.162176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-058bf653-dd28-47d4-93bd-78e17b0cf650 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:57.169537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-058bf653-dd28-47d4-93bd-78e17b0cf650 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:57.172848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-058bf653-dd28-47d4-93bd-78e17b0cf650 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:57.172848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-058bf653-dd28-47d4-93bd-78e17b0cf650 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:57.172848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-058bf653-dd28-47d4-93bd-78e17b0cf650 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:57.172848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-058bf653-dd28-47d4-93bd-78e17b0cf650 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:57.172848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-058bf653-dd28-47d4-93bd-78e17b0cf650 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:57.337665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-058bf653-dd28-47d4-93bd-78e17b0cf650 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:57.346993 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-058bf653-dd28-47d4-93bd-78e17b0cf650 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.189511 Oct 04 21:32:57.347583 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2705/5389] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:57 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:57.572542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa8fe462-6aa3-4f8e-9945-506c631d904c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:57.573159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aa8fe462-6aa3-4f8e-9945-506c631d904c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:57.581873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa8fe462-6aa3-4f8e-9945-506c631d904c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:57.582378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa8fe462-6aa3-4f8e-9945-506c631d904c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:57.582818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa8fe462-6aa3-4f8e-9945-506c631d904c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:57.583518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa8fe462-6aa3-4f8e-9945-506c631d904c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:57.583978 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa8fe462-6aa3-4f8e-9945-506c631d904c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:57.584616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa8fe462-6aa3-4f8e-9945-506c631d904c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:57.741593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aa8fe462-6aa3-4f8e-9945-506c631d904c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:57.751826 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aa8fe462-6aa3-4f8e-9945-506c631d904c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1722 microversion: 2.1 time: 0.183861 Oct 04 21:32:57.753085 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2685/5390] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:57 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:58.372568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-625c81e4-5c43-484b-b26d-3bea41e6d244 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:58.405714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-625c81e4-5c43-484b-b26d-3bea41e6d244 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:58.405714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:58.405714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-625c81e4-5c43-484b-b26d-3bea41e6d244 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:58.405714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-625c81e4-5c43-484b-b26d-3bea41e6d244 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:58.405714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-625c81e4-5c43-484b-b26d-3bea41e6d244 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:58.405714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-625c81e4-5c43-484b-b26d-3bea41e6d244 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:58.405714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-625c81e4-5c43-484b-b26d-3bea41e6d244 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:58.405714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-625c81e4-5c43-484b-b26d-3bea41e6d244 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:58.541614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-625c81e4-5c43-484b-b26d-3bea41e6d244 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:58.554406 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-625c81e4-5c43-484b-b26d-3bea41e6d244 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.187342 Oct 04 21:32:58.555195 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2706/5391] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:58 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:58.776674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ff5dfb03-097f-41b6-a517-55420904ef37 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:58.778015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ff5dfb03-097f-41b6-a517-55420904ef37 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:58.785121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff5dfb03-097f-41b6-a517-55420904ef37 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:58.785660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff5dfb03-097f-41b6-a517-55420904ef37 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:58.786113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff5dfb03-097f-41b6-a517-55420904ef37 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:58.786819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff5dfb03-097f-41b6-a517-55420904ef37 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:58.787285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff5dfb03-097f-41b6-a517-55420904ef37 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:58.787720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff5dfb03-097f-41b6-a517-55420904ef37 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:58.923212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ff5dfb03-097f-41b6-a517-55420904ef37 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:58.932479 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ff5dfb03-097f-41b6-a517-55420904ef37 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1699 microversion: 2.1 time: 0.159644 Oct 04 21:32:58.933065 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2686/5392] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:58 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:58.967471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5f943f41-a35e-4ee3-a0dd-385edfaf2b2a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:58.970831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f943f41-a35e-4ee3-a0dd-385edfaf2b2a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:58.971340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f943f41-a35e-4ee3-a0dd-385edfaf2b2a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:58.971998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f943f41-a35e-4ee3-a0dd-385edfaf2b2a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:58.999944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5f943f41-a35e-4ee3-a0dd-385edfaf2b2a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Going to try to start instance {{(pid=122757) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 21:32:59.100359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:59.256756 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5f943f41-a35e-4ee3-a0dd-385edfaf2b2a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "POST /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4/action" status: 202 len: 0 microversion: 2.1 time: 0.298449 Oct 04 21:32:59.258125 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2707/5393] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:32:58 2022] POST /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:32:59.268760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c760f562-5332-4537-892c-37fed527fe7c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:59.270212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c760f562-5332-4537-892c-37fed527fe7c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:59.276387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c760f562-5332-4537-892c-37fed527fe7c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:59.277776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c760f562-5332-4537-892c-37fed527fe7c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:59.278326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c760f562-5332-4537-892c-37fed527fe7c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:59.279197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c760f562-5332-4537-892c-37fed527fe7c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:59.280440 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c760f562-5332-4537-892c-37fed527fe7c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:59.286366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c760f562-5332-4537-892c-37fed527fe7c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:59.486879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c760f562-5332-4537-892c-37fed527fe7c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:59.495623 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c760f562-5332-4537-892c-37fed527fe7c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1708 microversion: 2.1 time: 0.232496 Oct 04 21:32:59.496526 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2687/5394] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:59 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1708 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:59.597706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e08ad2c0-faf8-418f-9889-043ffa4fc753 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:59.598286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e08ad2c0-faf8-418f-9889-043ffa4fc753 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:59.606360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e08ad2c0-faf8-418f-9889-043ffa4fc753 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:59.607325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e08ad2c0-faf8-418f-9889-043ffa4fc753 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:59.607963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e08ad2c0-faf8-418f-9889-043ffa4fc753 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:59.608727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e08ad2c0-faf8-418f-9889-043ffa4fc753 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:59.609282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e08ad2c0-faf8-418f-9889-043ffa4fc753 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:59.609635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e08ad2c0-faf8-418f-9889-043ffa4fc753 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:59.826580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e08ad2c0-faf8-418f-9889-043ffa4fc753 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:59.834526 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e08ad2c0-faf8-418f-9889-043ffa4fc753 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.243210 Oct 04 21:32:59.835107 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2708/5395] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:59 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:00.525668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1dcfd4b4-fa47-47b4-a4bd-5424fcebd675 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:00.526484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1dcfd4b4-fa47-47b4-a4bd-5424fcebd675 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:00.547290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1dcfd4b4-fa47-47b4-a4bd-5424fcebd675 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:00.547802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1dcfd4b4-fa47-47b4-a4bd-5424fcebd675 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:00.548395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1dcfd4b4-fa47-47b4-a4bd-5424fcebd675 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:00.549260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1dcfd4b4-fa47-47b4-a4bd-5424fcebd675 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:00.549960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1dcfd4b4-fa47-47b4-a4bd-5424fcebd675 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:00.550406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1dcfd4b4-fa47-47b4-a4bd-5424fcebd675 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:00.774732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1dcfd4b4-fa47-47b4-a4bd-5424fcebd675 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:00.787312 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1dcfd4b4-fa47-47b4-a4bd-5424fcebd675 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1708 microversion: 2.1 time: 0.265643 Oct 04 21:33:00.787930 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2688/5396] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:00 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1708 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:00.858976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ae0a8ddc-1024-4630-ad80-ca3dd56dee2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:00.861395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ae0a8ddc-1024-4630-ad80-ca3dd56dee2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:00.868777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae0a8ddc-1024-4630-ad80-ca3dd56dee2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:00.869281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae0a8ddc-1024-4630-ad80-ca3dd56dee2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:00.869760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae0a8ddc-1024-4630-ad80-ca3dd56dee2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:00.870484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae0a8ddc-1024-4630-ad80-ca3dd56dee2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:00.871170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae0a8ddc-1024-4630-ad80-ca3dd56dee2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:00.871612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae0a8ddc-1024-4630-ad80-ca3dd56dee2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:01.047743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ae0a8ddc-1024-4630-ad80-ca3dd56dee2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:01.055604 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ae0a8ddc-1024-4630-ad80-ca3dd56dee2d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.200748 Oct 04 21:33:01.056163 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2709/5397] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:00 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:01.812651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7fe5cc92-b11d-4879-9a50-69a2da22efc2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:01.813281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7fe5cc92-b11d-4879-9a50-69a2da22efc2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:01.820866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7fe5cc92-b11d-4879-9a50-69a2da22efc2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:01.821827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7fe5cc92-b11d-4879-9a50-69a2da22efc2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:01.822489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7fe5cc92-b11d-4879-9a50-69a2da22efc2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:01.823446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7fe5cc92-b11d-4879-9a50-69a2da22efc2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:01.824155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7fe5cc92-b11d-4879-9a50-69a2da22efc2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:01.825024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7fe5cc92-b11d-4879-9a50-69a2da22efc2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:02.026335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7fe5cc92-b11d-4879-9a50-69a2da22efc2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:02.036905 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7fe5cc92-b11d-4879-9a50-69a2da22efc2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1712 microversion: 2.1 time: 0.229061 Oct 04 21:33:02.051330 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2689/5398] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:01 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1712 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:02.084995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f63097a2-60f6-458f-8951-44bd7e8eccc2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:02.086359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f63097a2-60f6-458f-8951-44bd7e8eccc2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:02.094925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f63097a2-60f6-458f-8951-44bd7e8eccc2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:02.095520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f63097a2-60f6-458f-8951-44bd7e8eccc2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:02.096035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f63097a2-60f6-458f-8951-44bd7e8eccc2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:02.096759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f63097a2-60f6-458f-8951-44bd7e8eccc2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:02.097221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f63097a2-60f6-458f-8951-44bd7e8eccc2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:02.097714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f63097a2-60f6-458f-8951-44bd7e8eccc2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:02.369076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f63097a2-60f6-458f-8951-44bd7e8eccc2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:02.378271 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f63097a2-60f6-458f-8951-44bd7e8eccc2 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.297703 Oct 04 21:33:02.378952 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2710/5399] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:02 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:03.403260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2c31e7c1-abcb-4b5a-98d8-27ef656547c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:03.408999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2c31e7c1-abcb-4b5a-98d8-27ef656547c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:03.412748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c31e7c1-abcb-4b5a-98d8-27ef656547c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:03.413235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c31e7c1-abcb-4b5a-98d8-27ef656547c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:03.414022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c31e7c1-abcb-4b5a-98d8-27ef656547c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:03.414398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c31e7c1-abcb-4b5a-98d8-27ef656547c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:03.414855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c31e7c1-abcb-4b5a-98d8-27ef656547c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:03.415276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c31e7c1-abcb-4b5a-98d8-27ef656547c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:03.581738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2c31e7c1-abcb-4b5a-98d8-27ef656547c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:03.601494 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2c31e7c1-abcb-4b5a-98d8-27ef656547c9 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.202523 Oct 04 21:33:03.618761 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2690/5400] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:03 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:04.628922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-86d85a8e-0856-42a3-a931-f0e7ec75a5ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:04.629788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-86d85a8e-0856-42a3-a931-f0e7ec75a5ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:04.639223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86d85a8e-0856-42a3-a931-f0e7ec75a5ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:04.640012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86d85a8e-0856-42a3-a931-f0e7ec75a5ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:04.640829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86d85a8e-0856-42a3-a931-f0e7ec75a5ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:04.641744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86d85a8e-0856-42a3-a931-f0e7ec75a5ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:04.642388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86d85a8e-0856-42a3-a931-f0e7ec75a5ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:04.646960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86d85a8e-0856-42a3-a931-f0e7ec75a5ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:04.905161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-86d85a8e-0856-42a3-a931-f0e7ec75a5ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:04.914389 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-86d85a8e-0856-42a3-a931-f0e7ec75a5ad tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.289945 Oct 04 21:33:04.915061 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2711/5401] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:04 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:05.937660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d22fd1b2-6ed0-4c2a-bd25-13c34d6eab69 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:05.938267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d22fd1b2-6ed0-4c2a-bd25-13c34d6eab69 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:05.945018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d22fd1b2-6ed0-4c2a-bd25-13c34d6eab69 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:05.945598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d22fd1b2-6ed0-4c2a-bd25-13c34d6eab69 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:05.946060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d22fd1b2-6ed0-4c2a-bd25-13c34d6eab69 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:05.946727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d22fd1b2-6ed0-4c2a-bd25-13c34d6eab69 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:05.947178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d22fd1b2-6ed0-4c2a-bd25-13c34d6eab69 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:05.947600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d22fd1b2-6ed0-4c2a-bd25-13c34d6eab69 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:06.509828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d22fd1b2-6ed0-4c2a-bd25-13c34d6eab69 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:06.519561 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d22fd1b2-6ed0-4c2a-bd25-13c34d6eab69 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1510 microversion: 2.1 time: 0.585794 Oct 04 21:33:06.520264 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2691/5402] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:05 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1510 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:33:07.545557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-efb03489-ade2-4461-b997-0ff54776b98d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:07.550622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-efb03489-ade2-4461-b997-0ff54776b98d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:07.553471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efb03489-ade2-4461-b997-0ff54776b98d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:07.553963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efb03489-ade2-4461-b997-0ff54776b98d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:07.554401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efb03489-ade2-4461-b997-0ff54776b98d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:07.555098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efb03489-ade2-4461-b997-0ff54776b98d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:07.555554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efb03489-ade2-4461-b997-0ff54776b98d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:07.555980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efb03489-ade2-4461-b997-0ff54776b98d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:07.699812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-efb03489-ade2-4461-b997-0ff54776b98d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:07.707657 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-efb03489-ade2-4461-b997-0ff54776b98d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1487 microversion: 2.1 time: 0.167220 Oct 04 21:33:07.708233 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2712/5403] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:07 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1487 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:33:07.730280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-feb649ad-c569-4a11-a0b9-d904254fc637 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1890562498"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:07.733446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-feb649ad-c569-4a11-a0b9-d904254fc637 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:07.739982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feb649ad-c569-4a11-a0b9-d904254fc637 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:07.745705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feb649ad-c569-4a11-a0b9-d904254fc637 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:07.745705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feb649ad-c569-4a11-a0b9-d904254fc637 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:07.745705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feb649ad-c569-4a11-a0b9-d904254fc637 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:07.745705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feb649ad-c569-4a11-a0b9-d904254fc637 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:07.745705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-feb649ad-c569-4a11-a0b9-d904254fc637 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:07.935452 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-feb649ad-c569-4a11-a0b9-d904254fc637 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "PUT /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1060 microversion: 2.1 time: 0.209258 Oct 04 21:33:07.944545 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2692/5404] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Oct 4 21:33:07 2022] PUT /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1060 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:07.962086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-95d68af7-f0e5-4c7e-bcc4-9d1c157b3963 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:07.962738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-95d68af7-f0e5-4c7e-bcc4-9d1c157b3963 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:07.969231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95d68af7-f0e5-4c7e-bcc4-9d1c157b3963 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:07.969757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95d68af7-f0e5-4c7e-bcc4-9d1c157b3963 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:07.970200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95d68af7-f0e5-4c7e-bcc4-9d1c157b3963 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:07.970898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95d68af7-f0e5-4c7e-bcc4-9d1c157b3963 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:07.971361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95d68af7-f0e5-4c7e-bcc4-9d1c157b3963 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:07.971794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95d68af7-f0e5-4c7e-bcc4-9d1c157b3963 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:08.107608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-95d68af7-f0e5-4c7e-bcc4-9d1c157b3963 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:08.116029 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-95d68af7-f0e5-4c7e-bcc4-9d1c157b3963 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1487 microversion: 2.1 time: 0.157853 Oct 04 21:33:08.116688 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2713/5405] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:07 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1487 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:08.138073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0c6b81fe-cd08-44f5-b8b2-cdbe89c6b70e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:08.138695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0c6b81fe-cd08-44f5-b8b2-cdbe89c6b70e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:08.144684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c6b81fe-cd08-44f5-b8b2-cdbe89c6b70e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:08.145174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c6b81fe-cd08-44f5-b8b2-cdbe89c6b70e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:08.145654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c6b81fe-cd08-44f5-b8b2-cdbe89c6b70e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:08.146361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c6b81fe-cd08-44f5-b8b2-cdbe89c6b70e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:08.146852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c6b81fe-cd08-44f5-b8b2-cdbe89c6b70e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:08.147355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c6b81fe-cd08-44f5-b8b2-cdbe89c6b70e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:08.282844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0c6b81fe-cd08-44f5-b8b2-cdbe89c6b70e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:08.291187 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0c6b81fe-cd08-44f5-b8b2-cdbe89c6b70e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1487 microversion: 2.1 time: 0.157075 Oct 04 21:33:08.291756 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2693/5406] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:08 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1487 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:08.313161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a9bf08f8-7d0d-4f40-933e-7d81a2960c8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:08.313692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a9bf08f8-7d0d-4f40-933e-7d81a2960c8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:08.319967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9bf08f8-7d0d-4f40-933e-7d81a2960c8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:08.322533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9bf08f8-7d0d-4f40-933e-7d81a2960c8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:08.322533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9bf08f8-7d0d-4f40-933e-7d81a2960c8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:08.322533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9bf08f8-7d0d-4f40-933e-7d81a2960c8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:08.322533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9bf08f8-7d0d-4f40-933e-7d81a2960c8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:08.323172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9bf08f8-7d0d-4f40-933e-7d81a2960c8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:08.350074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a9bf08f8-7d0d-4f40-933e-7d81a2960c8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:33:08.743776 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a9bf08f8-7d0d-4f40-933e-7d81a2960c8e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 204 len: 0 microversion: 2.1 time: 0.434082 Oct 04 21:33:08.744468 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2714/5407] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:33:08 2022] DELETE /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:33:08.753727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-474a69e0-1ec9-467d-8579-62cffe06a183 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:08.754338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-474a69e0-1ec9-467d-8579-62cffe06a183 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:08.761100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-474a69e0-1ec9-467d-8579-62cffe06a183 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:08.761626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-474a69e0-1ec9-467d-8579-62cffe06a183 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:08.762061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-474a69e0-1ec9-467d-8579-62cffe06a183 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:08.763340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-474a69e0-1ec9-467d-8579-62cffe06a183 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:08.763793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-474a69e0-1ec9-467d-8579-62cffe06a183 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:08.764213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-474a69e0-1ec9-467d-8579-62cffe06a183 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:08.925580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-474a69e0-1ec9-467d-8579-62cffe06a183 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:08.935312 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-474a69e0-1ec9-467d-8579-62cffe06a183 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1493 microversion: 2.1 time: 0.185457 Oct 04 21:33:08.936141 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2694/5408] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:08 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1493 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:09.960871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-19f15b1c-2ef3-43f2-bbe5-177fcd1d6aed tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:09.961556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-19f15b1c-2ef3-43f2-bbe5-177fcd1d6aed tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:09.978472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19f15b1c-2ef3-43f2-bbe5-177fcd1d6aed tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:09.978977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19f15b1c-2ef3-43f2-bbe5-177fcd1d6aed tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:09.979417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19f15b1c-2ef3-43f2-bbe5-177fcd1d6aed tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:09.980125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19f15b1c-2ef3-43f2-bbe5-177fcd1d6aed tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:09.980582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19f15b1c-2ef3-43f2-bbe5-177fcd1d6aed tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:09.981567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19f15b1c-2ef3-43f2-bbe5-177fcd1d6aed tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:10.143268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-19f15b1c-2ef3-43f2-bbe5-177fcd1d6aed tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:10.151897 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-19f15b1c-2ef3-43f2-bbe5-177fcd1d6aed tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1493 microversion: 2.1 time: 0.195556 Oct 04 21:33:10.156079 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2715/5409] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:09 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1493 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:10.770184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-99c219fa-1264-413a-96d8-4364095237af req-0eccdb2f-36f6-4a4a-92bc-3073ebfc0ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6305f4-2ee9-4b21-8959-d3ce883eea29", "name": "network-vif-deleted", "tag": "451d684a-b38b-48f6-979a-0734b8c48fe1"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:10.785971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-99c219fa-1264-413a-96d8-4364095237af req-0eccdb2f-36f6-4a4a-92bc-3073ebfc0ceb service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:10.786748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-99c219fa-1264-413a-96d8-4364095237af req-0eccdb2f-36f6-4a4a-92bc-3073ebfc0ceb service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:10.787579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-99c219fa-1264-413a-96d8-4364095237af req-0eccdb2f-36f6-4a4a-92bc-3073ebfc0ceb service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:10.815189 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-99c219fa-1264-413a-96d8-4364095237af req-0eccdb2f-36f6-4a4a-92bc-3073ebfc0ceb service nova] Creating event network-vif-deleted:451d684a-b38b-48f6-979a-0734b8c48fe1 for instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 on n-h2-860282-1 Oct 04 21:33:10.822355 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-99c219fa-1264-413a-96d8-4364095237af req-0eccdb2f-36f6-4a4a-92bc-3073ebfc0ceb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055898 Oct 04 21:33:10.823370 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2695/5410] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:33:11.184993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-28ac865c-a6bd-45be-a978-c9eaa6d6e904 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:11.186312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-28ac865c-a6bd-45be-a978-c9eaa6d6e904 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:11.197195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28ac865c-a6bd-45be-a978-c9eaa6d6e904 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:11.197951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28ac865c-a6bd-45be-a978-c9eaa6d6e904 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:11.201275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28ac865c-a6bd-45be-a978-c9eaa6d6e904 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:11.202843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28ac865c-a6bd-45be-a978-c9eaa6d6e904 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:11.203468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28ac865c-a6bd-45be-a978-c9eaa6d6e904 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:11.204118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28ac865c-a6bd-45be-a978-c9eaa6d6e904 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:11.241912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28ac865c-a6bd-45be-a978-c9eaa6d6e904 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:11.242458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28ac865c-a6bd-45be-a978-c9eaa6d6e904 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:11.242900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28ac865c-a6bd-45be-a978-c9eaa6d6e904 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:11.243549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-28ac865c-a6bd-45be-a978-c9eaa6d6e904 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lazy-loading 'fault' on Instance uuid 8d6305f4-2ee9-4b21-8959-d3ce883eea29 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:33:11.305777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-28ac865c-a6bd-45be-a978-c9eaa6d6e904 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:11.320120 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-28ac865c-a6bd-45be-a978-c9eaa6d6e904 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 200 len: 1310 microversion: 2.1 time: 0.140351 Oct 04 21:33:11.321122 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2716/5411] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:11 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 1310 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:12.348384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ec34cf57-c1de-4e19-a5f6-2cd405dd807d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:12.349105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ec34cf57-c1de-4e19-a5f6-2cd405dd807d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:12.355634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec34cf57-c1de-4e19-a5f6-2cd405dd807d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.356259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec34cf57-c1de-4e19-a5f6-2cd405dd807d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.356703 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec34cf57-c1de-4e19-a5f6-2cd405dd807d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.357399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec34cf57-c1de-4e19-a5f6-2cd405dd807d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.357876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec34cf57-c1de-4e19-a5f6-2cd405dd807d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.358300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec34cf57-c1de-4e19-a5f6-2cd405dd807d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.373459 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-ec34cf57-c1de-4e19-a5f6-2cd405dd807d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 could not be found. Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ec34cf57-c1de-4e19-a5f6-2cd405dd807d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 HTTP/1.1 Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 could not be found. Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '8d6305f4-2ee9-4b21-8959-d3ce883eea29'} Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 could not be found. Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 could not be found. Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.374866 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.381642 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.381642 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.381642 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.381642 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:12.381642 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:12.381642 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 could not be found. Oct 04 21:33:12.381642 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.381642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ec34cf57-c1de-4e19-a5f6-2cd405dd807d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:12.381642 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ec34cf57-c1de-4e19-a5f6-2cd405dd807d tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 404 len: 111 microversion: 2.1 time: 0.035709 Oct 04 21:33:12.381642 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2696/5412] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:12 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:33:12.392643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f9b9ae99-7f76-4cd3-a848-b9b4a2b1a45a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:12.393468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f9b9ae99-7f76-4cd3-a848-b9b4a2b1a45a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:12.400887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9b9ae99-7f76-4cd3-a848-b9b4a2b1a45a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.401386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9b9ae99-7f76-4cd3-a848-b9b4a2b1a45a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.401856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9b9ae99-7f76-4cd3-a848-b9b4a2b1a45a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.402569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9b9ae99-7f76-4cd3-a848-b9b4a2b1a45a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.403061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9b9ae99-7f76-4cd3-a848-b9b4a2b1a45a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.403494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9b9ae99-7f76-4cd3-a848-b9b4a2b1a45a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.419155 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-f9b9ae99-7f76-4cd3-a848-b9b4a2b1a45a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 could not be found. Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f9b9ae99-7f76-4cd3-a848-b9b4a2b1a45a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 HTTP/1.1 Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 could not be found. Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '8d6305f4-2ee9-4b21-8959-d3ce883eea29'} Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 could not be found. Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:12.420866 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 could not be found. Oct 04 21:33:12.426118 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.426118 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.426118 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.426118 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.426118 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.426118 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.426118 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:12.426118 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:12.426118 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 could not be found. Oct 04 21:33:12.426118 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.426118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f9b9ae99-7f76-4cd3-a848-b9b4a2b1a45a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:12.426118 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f9b9ae99-7f76-4cd3-a848-b9b4a2b1a45a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 404 len: 111 microversion: 2.1 time: 0.033796 Oct 04 21:33:12.426118 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2717/5413] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:33:12 2022] DELETE /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:33:12.432672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fcedd30d-0572-4a8e-8148-307add632395 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:12.433338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fcedd30d-0572-4a8e-8148-307add632395 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 8d6305f4-2ee9-4b21-8959-d3ce883eea29] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:12.440492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcedd30d-0572-4a8e-8148-307add632395 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.440983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcedd30d-0572-4a8e-8148-307add632395 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.441719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcedd30d-0572-4a8e-8148-307add632395 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.442431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcedd30d-0572-4a8e-8148-307add632395 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.442886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcedd30d-0572-4a8e-8148-307add632395 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.443325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcedd30d-0572-4a8e-8148-307add632395 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.460166 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-fcedd30d-0572-4a8e-8148-307add632395 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 could not be found. Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fcedd30d-0572-4a8e-8148-307add632395 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 HTTP/1.1 Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 could not be found. Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '8d6305f4-2ee9-4b21-8959-d3ce883eea29'} Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 could not be found. Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 could not be found. Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.461904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.472650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.472650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.472650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.472650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:12.472650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:12.472650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 could not be found. Oct 04 21:33:12.472650 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.472650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fcedd30d-0572-4a8e-8148-307add632395 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance 8d6305f4-2ee9-4b21-8959-d3ce883eea29 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:12.472650 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fcedd30d-0572-4a8e-8148-307add632395 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29" status: 404 len: 111 microversion: 2.1 time: 0.034822 Oct 04 21:33:12.472650 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2697/5414] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:12 2022] GET /compute/v2.1/servers/8d6305f4-2ee9-4b21-8959-d3ce883eea29 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:33:12.474139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2d6bffa9-46d4-4bfd-ab93-657e29e4adfc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:12.474139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2d6bffa9-46d4-4bfd-ab93-657e29e4adfc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:12.479540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d6bffa9-46d4-4bfd-ab93-657e29e4adfc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.480330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d6bffa9-46d4-4bfd-ab93-657e29e4adfc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.480984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d6bffa9-46d4-4bfd-ab93-657e29e4adfc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.481892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d6bffa9-46d4-4bfd-ab93-657e29e4adfc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.482543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d6bffa9-46d4-4bfd-ab93-657e29e4adfc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.483137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d6bffa9-46d4-4bfd-ab93-657e29e4adfc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.503769 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-2d6bffa9-46d4-4bfd-ab93-657e29e4adfc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance 43821a2b-4f04-44d3-8970-18ac72e94470 could not be found. Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2d6bffa9-46d4-4bfd-ab93-657e29e4adfc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 HTTP/1.1 Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 43821a2b-4f04-44d3-8970-18ac72e94470 could not be found. Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '43821a2b-4f04-44d3-8970-18ac72e94470'} Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43821a2b-4f04-44d3-8970-18ac72e94470 could not be found. Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:12.505355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43821a2b-4f04-44d3-8970-18ac72e94470 could not be found. Oct 04 21:33:12.512864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.512864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.512864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.512864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.512864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.512864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.512864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:12.512864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:12.512864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43821a2b-4f04-44d3-8970-18ac72e94470 could not be found. Oct 04 21:33:12.512864 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.512864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2d6bffa9-46d4-4bfd-ab93-657e29e4adfc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance 43821a2b-4f04-44d3-8970-18ac72e94470 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:12.512864 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2d6bffa9-46d4-4bfd-ab93-657e29e4adfc tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "DELETE /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 404 len: 111 microversion: 2.1 time: 0.038652 Oct 04 21:33:12.512864 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2718/5415] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:33:12 2022] DELETE /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:33:12.518139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ff2121e2-f2dd-47d8-a102-250c4d99065a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:12.518858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ff2121e2-f2dd-47d8-a102-250c4d99065a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 43821a2b-4f04-44d3-8970-18ac72e94470] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:12.525593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff2121e2-f2dd-47d8-a102-250c4d99065a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.526180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff2121e2-f2dd-47d8-a102-250c4d99065a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.526710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff2121e2-f2dd-47d8-a102-250c4d99065a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.533277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff2121e2-f2dd-47d8-a102-250c4d99065a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.533277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff2121e2-f2dd-47d8-a102-250c4d99065a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.533277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff2121e2-f2dd-47d8-a102-250c4d99065a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.545412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d7f47959-c516-4a05-8800-eff96e8b92c4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:12.546043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d7f47959-c516-4a05-8800-eff96e8b92c4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:12.553448 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-ff2121e2-f2dd-47d8-a102-250c4d99065a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance 43821a2b-4f04-44d3-8970-18ac72e94470 could not be found. Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ff2121e2-f2dd-47d8-a102-250c4d99065a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 HTTP/1.1 Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 43821a2b-4f04-44d3-8970-18ac72e94470 could not be found. Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '43821a2b-4f04-44d3-8970-18ac72e94470'} Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43821a2b-4f04-44d3-8970-18ac72e94470 could not be found. Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43821a2b-4f04-44d3-8970-18ac72e94470 could not be found. Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.555173 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.561259 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.561259 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.561259 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.561259 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:12.561259 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:12.561259 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43821a2b-4f04-44d3-8970-18ac72e94470 could not be found. Oct 04 21:33:12.561259 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.561259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ff2121e2-f2dd-47d8-a102-250c4d99065a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance 43821a2b-4f04-44d3-8970-18ac72e94470 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:12.562247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7f47959-c516-4a05-8800-eff96e8b92c4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.562375 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ff2121e2-f2dd-47d8-a102-250c4d99065a tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470" status: 404 len: 111 microversion: 2.1 time: 0.043271 Oct 04 21:33:12.562375 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2698/5416] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:12 2022] GET /compute/v2.1/servers/43821a2b-4f04-44d3-8970-18ac72e94470 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:33:12.562570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7f47959-c516-4a05-8800-eff96e8b92c4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.565647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7f47959-c516-4a05-8800-eff96e8b92c4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.566431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7f47959-c516-4a05-8800-eff96e8b92c4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.566910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7f47959-c516-4a05-8800-eff96e8b92c4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.567378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7f47959-c516-4a05-8800-eff96e8b92c4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.571436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-809e0ff7-cb6d-4ea5-b262-663804d2c916 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:12.572143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-809e0ff7-cb6d-4ea5-b262-663804d2c916 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:12.579233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-809e0ff7-cb6d-4ea5-b262-663804d2c916 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.579908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-809e0ff7-cb6d-4ea5-b262-663804d2c916 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.580645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-809e0ff7-cb6d-4ea5-b262-663804d2c916 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.581686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-809e0ff7-cb6d-4ea5-b262-663804d2c916 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.582391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-809e0ff7-cb6d-4ea5-b262-663804d2c916 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.583085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-809e0ff7-cb6d-4ea5-b262-663804d2c916 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.598879 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-809e0ff7-cb6d-4ea5-b262-663804d2c916 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance 12eda487-1501-4d60-84ca-f1fda387068b could not be found. Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-809e0ff7-cb6d-4ea5-b262-663804d2c916 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b HTTP/1.1 Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 12eda487-1501-4d60-84ca-f1fda387068b could not be found. Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '12eda487-1501-4d60-84ca-f1fda387068b'} Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12eda487-1501-4d60-84ca-f1fda387068b could not be found. Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:12.602928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12eda487-1501-4d60-84ca-f1fda387068b could not be found. Oct 04 21:33:12.608879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.608879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.608879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.608879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.608879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.608879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.608879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:12.608879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:12.608879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12eda487-1501-4d60-84ca-f1fda387068b could not be found. Oct 04 21:33:12.608879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.608879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-809e0ff7-cb6d-4ea5-b262-663804d2c916 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance 12eda487-1501-4d60-84ca-f1fda387068b could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:12.608879 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-809e0ff7-cb6d-4ea5-b262-663804d2c916 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "DELETE /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 404 len: 111 microversion: 2.1 time: 0.038704 Oct 04 21:33:12.608879 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2699/5417] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:33:12 2022] DELETE /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:33:12.613934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d797c71b-94a2-4833-b7cf-08909dfce6c4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:12.614542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d797c71b-94a2-4833-b7cf-08909dfce6c4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 12eda487-1501-4d60-84ca-f1fda387068b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:12.623000 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d7f47959-c516-4a05-8800-eff96e8b92c4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/ips" status: 200 len: 151 microversion: 2.20 time: 0.082187 Oct 04 21:33:12.623943 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2719/5418] 10.222.0.30 () {60 vars in 1289 bytes} [Tue Oct 4 21:33:12 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/ips => generated 151 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:33:12.633546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d797c71b-94a2-4833-b7cf-08909dfce6c4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.634022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d797c71b-94a2-4833-b7cf-08909dfce6c4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.634533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d797c71b-94a2-4833-b7cf-08909dfce6c4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.635670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d797c71b-94a2-4833-b7cf-08909dfce6c4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.636212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d797c71b-94a2-4833-b7cf-08909dfce6c4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.636716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d797c71b-94a2-4833-b7cf-08909dfce6c4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-d797c71b-94a2-4833-b7cf-08909dfce6c4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance 12eda487-1501-4d60-84ca-f1fda387068b could not be found. Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d797c71b-94a2-4833-b7cf-08909dfce6c4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b HTTP/1.1 Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 12eda487-1501-4d60-84ca-f1fda387068b could not be found. Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '12eda487-1501-4d60-84ca-f1fda387068b'} Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12eda487-1501-4d60-84ca-f1fda387068b could not be found. Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:12.669186 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:12.674855 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12eda487-1501-4d60-84ca-f1fda387068b could not be found. Oct 04 21:33:12.674855 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.674855 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.674855 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.674855 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.674855 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.674855 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.674855 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:12.674855 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:12.674855 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12eda487-1501-4d60-84ca-f1fda387068b could not be found. Oct 04 21:33:12.674855 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.674855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d797c71b-94a2-4833-b7cf-08909dfce6c4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance 12eda487-1501-4d60-84ca-f1fda387068b could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:12.674855 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d797c71b-94a2-4833-b7cf-08909dfce6c4 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b" status: 404 len: 111 microversion: 2.1 time: 0.057857 Oct 04 21:33:12.674855 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2700/5419] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:12 2022] GET /compute/v2.1/servers/12eda487-1501-4d60-84ca-f1fda387068b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:33:12.676589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-28fca4be-0fd5-4441-8299-5558860bf942 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:12.677123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-28fca4be-0fd5-4441-8299-5558860bf942 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:12.685366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28fca4be-0fd5-4441-8299-5558860bf942 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.686288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28fca4be-0fd5-4441-8299-5558860bf942 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.686738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28fca4be-0fd5-4441-8299-5558860bf942 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.687905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28fca4be-0fd5-4441-8299-5558860bf942 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.688560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28fca4be-0fd5-4441-8299-5558860bf942 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.689437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28fca4be-0fd5-4441-8299-5558860bf942 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.712958 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-28fca4be-0fd5-4441-8299-5558860bf942 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance ad0bd930-32ff-4587-8b22-bb47d1fe061d could not be found. Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-28fca4be-0fd5-4441-8299-5558860bf942 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d HTTP/1.1 Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance ad0bd930-32ff-4587-8b22-bb47d1fe061d could not be found. Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'ad0bd930-32ff-4587-8b22-bb47d1fe061d'} Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad0bd930-32ff-4587-8b22-bb47d1fe061d could not be found. Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:12.714498 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad0bd930-32ff-4587-8b22-bb47d1fe061d could not be found. Oct 04 21:33:12.723048 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.723048 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.723048 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.723048 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.723048 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.723048 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.723048 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:12.723048 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:12.723048 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad0bd930-32ff-4587-8b22-bb47d1fe061d could not be found. Oct 04 21:33:12.723048 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.723048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-28fca4be-0fd5-4441-8299-5558860bf942 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance ad0bd930-32ff-4587-8b22-bb47d1fe061d could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:12.723048 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-28fca4be-0fd5-4441-8299-5558860bf942 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 404 len: 111 microversion: 2.1 time: 0.043658 Oct 04 21:33:12.723048 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2720/5420] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:33:12 2022] DELETE /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:33:12.730293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0e0f064f-e8ed-4f3c-88ff-c2b43e9d7dab tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:12.731763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0e0f064f-e8ed-4f3c-88ff-c2b43e9d7dab tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: ad0bd930-32ff-4587-8b22-bb47d1fe061d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:12.738354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e0f064f-e8ed-4f3c-88ff-c2b43e9d7dab tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.739230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e0f064f-e8ed-4f3c-88ff-c2b43e9d7dab tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.739854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e0f064f-e8ed-4f3c-88ff-c2b43e9d7dab tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.740776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e0f064f-e8ed-4f3c-88ff-c2b43e9d7dab tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.741434 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e0f064f-e8ed-4f3c-88ff-c2b43e9d7dab tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.742048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e0f064f-e8ed-4f3c-88ff-c2b43e9d7dab tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.759377 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-0e0f064f-e8ed-4f3c-88ff-c2b43e9d7dab tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance ad0bd930-32ff-4587-8b22-bb47d1fe061d could not be found. Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0e0f064f-e8ed-4f3c-88ff-c2b43e9d7dab tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d HTTP/1.1 Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance ad0bd930-32ff-4587-8b22-bb47d1fe061d could not be found. Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'ad0bd930-32ff-4587-8b22-bb47d1fe061d'} Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad0bd930-32ff-4587-8b22-bb47d1fe061d could not be found. Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad0bd930-32ff-4587-8b22-bb47d1fe061d could not be found. Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.761174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.766753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.766753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.766753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.766753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:12.766753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:12.766753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad0bd930-32ff-4587-8b22-bb47d1fe061d could not be found. Oct 04 21:33:12.766753 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.773880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0e0f064f-e8ed-4f3c-88ff-c2b43e9d7dab tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance ad0bd930-32ff-4587-8b22-bb47d1fe061d could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:12.775656 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0e0f064f-e8ed-4f3c-88ff-c2b43e9d7dab tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d" status: 404 len: 111 microversion: 2.1 time: 0.049528 Oct 04 21:33:12.777392 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2701/5421] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:12 2022] GET /compute/v2.1/servers/ad0bd930-32ff-4587-8b22-bb47d1fe061d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:33:12.786012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-88fe025e-5094-4e9c-971c-db2be4995750 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:12.786555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-88fe025e-5094-4e9c-971c-db2be4995750 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:12.792673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88fe025e-5094-4e9c-971c-db2be4995750 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.801229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88fe025e-5094-4e9c-971c-db2be4995750 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.801229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88fe025e-5094-4e9c-971c-db2be4995750 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.801229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88fe025e-5094-4e9c-971c-db2be4995750 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.801229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88fe025e-5094-4e9c-971c-db2be4995750 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.801229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88fe025e-5094-4e9c-971c-db2be4995750 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.810775 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-88fe025e-5094-4e9c-971c-db2be4995750 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e could not be found. Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-88fe025e-5094-4e9c-971c-db2be4995750 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e HTTP/1.1 Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e could not be found. Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'e21bf0e6-f7df-4150-aa24-150a14fe3c4e'} Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e could not be found. Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:12.812352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e could not be found. Oct 04 21:33:12.824755 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.824755 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.824755 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.824755 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.824755 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.824755 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.824755 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:12.824755 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:12.824755 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e could not be found. Oct 04 21:33:12.824755 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.824755 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-88fe025e-5094-4e9c-971c-db2be4995750 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:12.824755 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-88fe025e-5094-4e9c-971c-db2be4995750 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 404 len: 111 microversion: 2.1 time: 0.032001 Oct 04 21:33:12.824755 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2721/5422] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:33:12 2022] DELETE /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:33:12.826287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-64508c66-722a-4212-92c7-cbabda1bc598 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:12.826287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-64508c66-722a-4212-92c7-cbabda1bc598 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: e21bf0e6-f7df-4150-aa24-150a14fe3c4e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:12.830996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64508c66-722a-4212-92c7-cbabda1bc598 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.831479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64508c66-722a-4212-92c7-cbabda1bc598 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.831912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64508c66-722a-4212-92c7-cbabda1bc598 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.832600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64508c66-722a-4212-92c7-cbabda1bc598 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.833049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64508c66-722a-4212-92c7-cbabda1bc598 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.833519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64508c66-722a-4212-92c7-cbabda1bc598 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.847968 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-64508c66-722a-4212-92c7-cbabda1bc598 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e could not be found. Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-64508c66-722a-4212-92c7-cbabda1bc598 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e HTTP/1.1 Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e could not be found. Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'e21bf0e6-f7df-4150-aa24-150a14fe3c4e'} Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e could not be found. Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e could not be found. Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.849583 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.855170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.855170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.855170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.855170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:12.855170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:12.855170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e could not be found. Oct 04 21:33:12.855170 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.855170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-64508c66-722a-4212-92c7-cbabda1bc598 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance e21bf0e6-f7df-4150-aa24-150a14fe3c4e could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:12.855170 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-64508c66-722a-4212-92c7-cbabda1bc598 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e" status: 404 len: 111 microversion: 2.1 time: 0.032401 Oct 04 21:33:12.855170 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2702/5423] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:12 2022] GET /compute/v2.1/servers/e21bf0e6-f7df-4150-aa24-150a14fe3c4e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:33:12.861170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e1791083-ef1c-47fc-9bc9-b5f05339162e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:12.864477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e1791083-ef1c-47fc-9bc9-b5f05339162e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:12.867727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1791083-ef1c-47fc-9bc9-b5f05339162e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.868227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1791083-ef1c-47fc-9bc9-b5f05339162e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.868708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1791083-ef1c-47fc-9bc9-b5f05339162e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.869412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1791083-ef1c-47fc-9bc9-b5f05339162e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.869907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1791083-ef1c-47fc-9bc9-b5f05339162e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.870331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1791083-ef1c-47fc-9bc9-b5f05339162e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.884564 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-e1791083-ef1c-47fc-9bc9-b5f05339162e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance dd27d01e-c242-427c-bed3-52c8711a5f41 could not be found. Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e1791083-ef1c-47fc-9bc9-b5f05339162e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 HTTP/1.1 Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance dd27d01e-c242-427c-bed3-52c8711a5f41 could not be found. Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'dd27d01e-c242-427c-bed3-52c8711a5f41'} Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd27d01e-c242-427c-bed3-52c8711a5f41 could not be found. Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:12.886171 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd27d01e-c242-427c-bed3-52c8711a5f41 could not be found. Oct 04 21:33:12.892104 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.892104 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.892104 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.892104 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.892104 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.892104 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.892104 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:12.892104 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:12.892104 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd27d01e-c242-427c-bed3-52c8711a5f41 could not be found. Oct 04 21:33:12.892104 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.892104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e1791083-ef1c-47fc-9bc9-b5f05339162e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance dd27d01e-c242-427c-bed3-52c8711a5f41 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:12.892104 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e1791083-ef1c-47fc-9bc9-b5f05339162e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41" status: 404 len: 111 microversion: 2.1 time: 0.031963 Oct 04 21:33:12.892104 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2722/5424] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:33:12 2022] DELETE /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:33:12.896174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e6e57248-0236-4805-8d62-b1d7cab5c8db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:12.896828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e6e57248-0236-4805-8d62-b1d7cab5c8db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: dd27d01e-c242-427c-bed3-52c8711a5f41] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:12.902924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6e57248-0236-4805-8d62-b1d7cab5c8db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.903487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6e57248-0236-4805-8d62-b1d7cab5c8db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.903926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6e57248-0236-4805-8d62-b1d7cab5c8db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.904743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6e57248-0236-4805-8d62-b1d7cab5c8db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.905207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6e57248-0236-4805-8d62-b1d7cab5c8db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.905670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6e57248-0236-4805-8d62-b1d7cab5c8db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.920294 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-e6e57248-0236-4805-8d62-b1d7cab5c8db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance dd27d01e-c242-427c-bed3-52c8711a5f41 could not be found. Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e6e57248-0236-4805-8d62-b1d7cab5c8db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 HTTP/1.1 Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance dd27d01e-c242-427c-bed3-52c8711a5f41 could not be found. Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'dd27d01e-c242-427c-bed3-52c8711a5f41'} Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd27d01e-c242-427c-bed3-52c8711a5f41 could not be found. Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd27d01e-c242-427c-bed3-52c8711a5f41 could not be found. Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.921879 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.929407 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.929407 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.929407 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.929407 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:12.929407 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:12.929407 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd27d01e-c242-427c-bed3-52c8711a5f41 could not be found. Oct 04 21:33:12.929407 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.929407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e6e57248-0236-4805-8d62-b1d7cab5c8db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance dd27d01e-c242-427c-bed3-52c8711a5f41 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:12.929407 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e6e57248-0236-4805-8d62-b1d7cab5c8db tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41" status: 404 len: 111 microversion: 2.1 time: 0.030905 Oct 04 21:33:12.929407 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2703/5425] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:12 2022] GET /compute/v2.1/servers/dd27d01e-c242-427c-bed3-52c8711a5f41 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:33:12.938460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-19af40af-1c19-4e0f-82f0-7f18a02b9123 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:12.938969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-19af40af-1c19-4e0f-82f0-7f18a02b9123 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:12.944753 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-19af40af-1c19-4e0f-82f0-7f18a02b9123 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 could not be found. Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-19af40af-1c19-4e0f-82f0-7f18a02b9123 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 HTTP/1.1 Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 could not be found. Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '341c02c4-69e6-4e78-a51b-7e8b40fcf3b5'} Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 could not be found. Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 could not be found. Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.946310 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.952390 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.952390 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.952390 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.952390 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:12.952390 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:12.952390 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 could not be found. Oct 04 21:33:12.952390 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.952390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-19af40af-1c19-4e0f-82f0-7f18a02b9123 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:12.952390 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-19af40af-1c19-4e0f-82f0-7f18a02b9123 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "DELETE /compute/v2.1/servers/341c02c4-69e6-4e78-a51b-7e8b40fcf3b5" status: 404 len: 111 microversion: 2.1 time: 0.014196 Oct 04 21:33:12.952390 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2723/5426] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:33:12 2022] DELETE /compute/v2.1/servers/341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:33:12.957285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8c0fc539-6654-4edd-a012-29b98e32f3a6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:12.957928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8c0fc539-6654-4edd-a012-29b98e32f3a6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:12.963947 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-8c0fc539-6654-4edd-a012-29b98e32f3a6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 could not be found. Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8c0fc539-6654-4edd-a012-29b98e32f3a6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 HTTP/1.1 Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 could not be found. Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '341c02c4-69e6-4e78-a51b-7e8b40fcf3b5'} Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 could not be found. Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 could not be found. Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:12.966335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:12.971675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:12.971675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:12.971675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:12.971675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 could not be found. Oct 04 21:33:12.971675 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:12.971675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8c0fc539-6654-4edd-a012-29b98e32f3a6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance 341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:12.971675 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8c0fc539-6654-4edd-a012-29b98e32f3a6 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/341c02c4-69e6-4e78-a51b-7e8b40fcf3b5" status: 404 len: 111 microversion: 2.1 time: 0.015054 Oct 04 21:33:12.971675 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2704/5427] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:12 2022] GET /compute/v2.1/servers/341c02c4-69e6-4e78-a51b-7e8b40fcf3b5 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:33:12.976954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c67839f7-940a-4935-9e23-f1f9a5f8c6c8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:12.977492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c67839f7-940a-4935-9e23-f1f9a5f8c6c8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 35db7403-53d9-4c74-8512-1bae943a086f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:12.986098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c67839f7-940a-4935-9e23-f1f9a5f8c6c8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.993505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c67839f7-940a-4935-9e23-f1f9a5f8c6c8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.993505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c67839f7-940a-4935-9e23-f1f9a5f8c6c8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.993505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c67839f7-940a-4935-9e23-f1f9a5f8c6c8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.993505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c67839f7-940a-4935-9e23-f1f9a5f8c6c8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.993505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c67839f7-940a-4935-9e23-f1f9a5f8c6c8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:13.020887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c67839f7-940a-4935-9e23-f1f9a5f8c6c8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 35db7403-53d9-4c74-8512-1bae943a086f] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:33:13.611494 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c67839f7-940a-4935-9e23-f1f9a5f8c6c8 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "DELETE /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f" status: 204 len: 0 microversion: 2.1 time: 0.637791 Oct 04 21:33:13.612922 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2724/5428] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:33:12 2022] DELETE /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f => generated 0 bytes in 640 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:33:13.623289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a71dcb64-f830-4544-88ff-ee736d26f219 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:13.626148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a71dcb64-f830-4544-88ff-ee736d26f219 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 35db7403-53d9-4c74-8512-1bae943a086f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:13.636632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a71dcb64-f830-4544-88ff-ee736d26f219 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:13.637847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a71dcb64-f830-4544-88ff-ee736d26f219 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:13.638384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a71dcb64-f830-4544-88ff-ee736d26f219 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:13.639221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a71dcb64-f830-4544-88ff-ee736d26f219 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:13.639986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a71dcb64-f830-4544-88ff-ee736d26f219 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:13.640514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a71dcb64-f830-4544-88ff-ee736d26f219 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:13.819019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a71dcb64-f830-4544-88ff-ee736d26f219 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:13.829581 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a71dcb64-f830-4544-88ff-ee736d26f219 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f" status: 200 len: 1480 microversion: 2.1 time: 0.212471 Oct 04 21:33:13.833511 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2705/5429] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:13 2022] GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f => generated 1480 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:14.860831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-340c455b-eed2-4ebe-b757-69fbf654488b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:14.862189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-340c455b-eed2-4ebe-b757-69fbf654488b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 35db7403-53d9-4c74-8512-1bae943a086f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:14.878206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-340c455b-eed2-4ebe-b757-69fbf654488b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:14.879030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-340c455b-eed2-4ebe-b757-69fbf654488b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:14.879742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-340c455b-eed2-4ebe-b757-69fbf654488b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:14.880611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-340c455b-eed2-4ebe-b757-69fbf654488b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:14.881226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-340c455b-eed2-4ebe-b757-69fbf654488b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:14.881853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-340c455b-eed2-4ebe-b757-69fbf654488b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:14.901873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:15.126161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-340c455b-eed2-4ebe-b757-69fbf654488b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:15.135286 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-340c455b-eed2-4ebe-b757-69fbf654488b tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f" status: 200 len: 1480 microversion: 2.1 time: 0.283180 Oct 04 21:33:15.135877 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2725/5430] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:14 2022] GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f => generated 1480 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:15.610566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-224c2f59-d3c5-437a-ad58-deed5f01f947 req-e6cdb0ab-7e65-4ddd-ae85-7965e45e3fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35db7403-53d9-4c74-8512-1bae943a086f", "name": "network-vif-deleted", "tag": "c4f8b3f0-6dc7-45b6-95d6-2ac1592501bc"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:15.622027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-224c2f59-d3c5-437a-ad58-deed5f01f947 req-e6cdb0ab-7e65-4ddd-ae85-7965e45e3fb1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:15.622741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-224c2f59-d3c5-437a-ad58-deed5f01f947 req-e6cdb0ab-7e65-4ddd-ae85-7965e45e3fb1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:15.623292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-224c2f59-d3c5-437a-ad58-deed5f01f947 req-e6cdb0ab-7e65-4ddd-ae85-7965e45e3fb1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:15.634501 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-224c2f59-d3c5-437a-ad58-deed5f01f947 req-e6cdb0ab-7e65-4ddd-ae85-7965e45e3fb1 service nova] Creating event network-vif-deleted:c4f8b3f0-6dc7-45b6-95d6-2ac1592501bc for instance 35db7403-53d9-4c74-8512-1bae943a086f on n-h1-860282-1 Oct 04 21:33:15.639982 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-224c2f59-d3c5-437a-ad58-deed5f01f947 req-e6cdb0ab-7e65-4ddd-ae85-7965e45e3fb1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033340 Oct 04 21:33:15.640581 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2706/5431] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:33:16.164214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1c99048f-4514-43fb-89e7-257bdec796f5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:16.164838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1c99048f-4514-43fb-89e7-257bdec796f5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 35db7403-53d9-4c74-8512-1bae943a086f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:16.175600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c99048f-4514-43fb-89e7-257bdec796f5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:16.176103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c99048f-4514-43fb-89e7-257bdec796f5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:16.176547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c99048f-4514-43fb-89e7-257bdec796f5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:16.177249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c99048f-4514-43fb-89e7-257bdec796f5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:16.177729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c99048f-4514-43fb-89e7-257bdec796f5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:16.178155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c99048f-4514-43fb-89e7-257bdec796f5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:16.214286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c99048f-4514-43fb-89e7-257bdec796f5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:16.214680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c99048f-4514-43fb-89e7-257bdec796f5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:16.215786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c99048f-4514-43fb-89e7-257bdec796f5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:16.216255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-1c99048f-4514-43fb-89e7-257bdec796f5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lazy-loading 'fault' on Instance uuid 35db7403-53d9-4c74-8512-1bae943a086f {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:33:16.276871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1c99048f-4514-43fb-89e7-257bdec796f5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9289c5fa9844ae3bb1c797bdab5c56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde68efb46fc44b5b0d83138b9048f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:16.287910 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1c99048f-4514-43fb-89e7-257bdec796f5 tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f" status: 200 len: 1283 microversion: 2.1 time: 0.127822 Oct 04 21:33:16.289440 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2726/5432] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:16 2022] GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f => generated 1283 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:16.312833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-923e31b4-455b-44b5-a5c7-44749d21fad1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:16.313895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-923e31b4-455b-44b5-a5c7-44749d21fad1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:16.321835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-923e31b4-455b-44b5-a5c7-44749d21fad1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:16.322809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-923e31b4-455b-44b5-a5c7-44749d21fad1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:16.328689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-923e31b4-455b-44b5-a5c7-44749d21fad1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:16.328689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-923e31b4-455b-44b5-a5c7-44749d21fad1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:16.337532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-923e31b4-455b-44b5-a5c7-44749d21fad1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:16.338172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-923e31b4-455b-44b5-a5c7-44749d21fad1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:16.378599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-923e31b4-455b-44b5-a5c7-44749d21fad1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lazy-loading 'flavor' on Instance uuid 1b27171c-bb6d-43d4-836d-98fa1c3790d8 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:33:16.487471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:16.948777 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-923e31b4-455b-44b5-a5c7-44749d21fad1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "POST /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/action" status: 202 len: 0 microversion: 2.20 time: 0.642442 Oct 04 21:33:16.949521 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2707/5433] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Oct 4 21:33:16 2022] POST /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:33:16.958564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-73f263c9-77a4-4e5c-a0f8-29f1b47a895c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:16.962918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-73f263c9-77a4-4e5c-a0f8-29f1b47a895c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:16.965335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73f263c9-77a4-4e5c-a0f8-29f1b47a895c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:16.965864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73f263c9-77a4-4e5c-a0f8-29f1b47a895c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:16.966306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73f263c9-77a4-4e5c-a0f8-29f1b47a895c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:16.967007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73f263c9-77a4-4e5c-a0f8-29f1b47a895c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:16.967469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73f263c9-77a4-4e5c-a0f8-29f1b47a895c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:16.967905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73f263c9-77a4-4e5c-a0f8-29f1b47a895c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:17.112284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-73f263c9-77a4-4e5c-a0f8-29f1b47a895c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:17.121936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-73f263c9-77a4-4e5c-a0f8-29f1b47a895c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:17.124059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-73f263c9-77a4-4e5c-a0f8-29f1b47a895c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:17.125330 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-73f263c9-77a4-4e5c-a0f8-29f1b47a895c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1723 microversion: 2.20 time: 0.170736 Oct 04 21:33:17.138024 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2727/5434] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:16 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:17.318095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6d1ed579-e6ec-413c-8dea-f3aa659d050e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:17.318838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6d1ed579-e6ec-413c-8dea-f3aa659d050e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] [instance: 35db7403-53d9-4c74-8512-1bae943a086f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:17.326149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d1ed579-e6ec-413c-8dea-f3aa659d050e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:17.326647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d1ed579-e6ec-413c-8dea-f3aa659d050e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:17.327146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d1ed579-e6ec-413c-8dea-f3aa659d050e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:17.327773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d1ed579-e6ec-413c-8dea-f3aa659d050e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:17.328365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d1ed579-e6ec-413c-8dea-f3aa659d050e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:17.328795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d1ed579-e6ec-413c-8dea-f3aa659d050e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:17.344290 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-6d1ed579-e6ec-413c-8dea-f3aa659d050e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] HTTP exception thrown: Instance 35db7403-53d9-4c74-8512-1bae943a086f could not be found. Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6d1ed579-e6ec-413c-8dea-f3aa659d050e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Request method failure captured: Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f HTTP/1.1 Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKW_czLrW3w_S5iuaDM8BiHdto9i-B7Rcsklur_0ww_mg-Aw0O0tChaT5DEMzKkLHEPhFdb1VfrCY6kOG-n4bSFudG3KQ4QnRjU2cZQGjFnivomXp2poQSspCI6glbHU0AC8HABpbp3I6Tml1fswEt5UBgkT_hCNVJf4CBV-ayJwHaQ Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fde68efb46fc44b5b0d83138b9048f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fde68efb46fc44b5b0d83138b9048f46"}]}] Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersTestJSON-1377832271 Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: fde68efb46fc44b5b0d83138b9048f46 Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersTestJSON-1377832271 Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: b9289c5fa9844ae3bb1c797bdab5c56c Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersTestJSON-1377832271-project Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 35db7403-53d9-4c74-8512-1bae943a086f could not be found. Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '35db7403-53d9-4c74-8512-1bae943a086f'} Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35db7403-53d9-4c74-8512-1bae943a086f could not be found. Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35db7403-53d9-4c74-8512-1bae943a086f could not be found. Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:17.345997 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:17.355336 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:17.355336 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:17.355336 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:17.355336 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:17.355336 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:17.355336 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35db7403-53d9-4c74-8512-1bae943a086f could not be found. Oct 04 21:33:17.355336 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:33:17.355336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6d1ed579-e6ec-413c-8dea-f3aa659d050e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] Returning 404 to user: Instance 35db7403-53d9-4c74-8512-1bae943a086f could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:17.355336 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6d1ed579-e6ec-413c-8dea-f3aa659d050e tempest-ServersTestJSON-1377832271 tempest-ServersTestJSON-1377832271-project] 10.222.0.30 "GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f" status: 404 len: 111 microversion: 2.1 time: 0.035497 Oct 04 21:33:17.355336 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2708/5435] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:17 2022] GET /compute/v2.1/servers/35db7403-53d9-4c74-8512-1bae943a086f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:33:18.152330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0b24a51a-0a58-4b84-9374-585d36a8d94b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:18.154337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0b24a51a-0a58-4b84-9374-585d36a8d94b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:18.161358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b24a51a-0a58-4b84-9374-585d36a8d94b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:18.162102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b24a51a-0a58-4b84-9374-585d36a8d94b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:18.162722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b24a51a-0a58-4b84-9374-585d36a8d94b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:18.163615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b24a51a-0a58-4b84-9374-585d36a8d94b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:18.164252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b24a51a-0a58-4b84-9374-585d36a8d94b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:18.164883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0b24a51a-0a58-4b84-9374-585d36a8d94b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:18.364631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0b24a51a-0a58-4b84-9374-585d36a8d94b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:18.373721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0b24a51a-0a58-4b84-9374-585d36a8d94b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:18.375181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0b24a51a-0a58-4b84-9374-585d36a8d94b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:18.376595 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0b24a51a-0a58-4b84-9374-585d36a8d94b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1723 microversion: 2.20 time: 0.228335 Oct 04 21:33:18.377154 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2728/5436] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:18 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:19.406569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-16562fae-49c4-4cc7-9b28-36903950d8d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:19.408836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-16562fae-49c4-4cc7-9b28-36903950d8d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:19.419621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16562fae-49c4-4cc7-9b28-36903950d8d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:19.426926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16562fae-49c4-4cc7-9b28-36903950d8d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:19.426926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16562fae-49c4-4cc7-9b28-36903950d8d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:19.426926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16562fae-49c4-4cc7-9b28-36903950d8d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:19.426926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16562fae-49c4-4cc7-9b28-36903950d8d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:19.426926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-16562fae-49c4-4cc7-9b28-36903950d8d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:19.620123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-16562fae-49c4-4cc7-9b28-36903950d8d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:19.632528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-16562fae-49c4-4cc7-9b28-36903950d8d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:19.634535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-16562fae-49c4-4cc7-9b28-36903950d8d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:19.635886 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-16562fae-49c4-4cc7-9b28-36903950d8d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1723 microversion: 2.20 time: 0.236809 Oct 04 21:33:19.636794 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2709/5437] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:19 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:20.669015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-92992fb3-89fe-420e-bd30-09ba8317f639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:20.670848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-92992fb3-89fe-420e-bd30-09ba8317f639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:20.678701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92992fb3-89fe-420e-bd30-09ba8317f639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:20.679191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92992fb3-89fe-420e-bd30-09ba8317f639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:20.679631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92992fb3-89fe-420e-bd30-09ba8317f639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:20.680372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92992fb3-89fe-420e-bd30-09ba8317f639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:20.681028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92992fb3-89fe-420e-bd30-09ba8317f639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:20.681481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92992fb3-89fe-420e-bd30-09ba8317f639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:20.887929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-92992fb3-89fe-420e-bd30-09ba8317f639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:20.896826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-92992fb3-89fe-420e-bd30-09ba8317f639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:20.898650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-92992fb3-89fe-420e-bd30-09ba8317f639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:20.900102 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-92992fb3-89fe-420e-bd30-09ba8317f639 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1723 microversion: 2.20 time: 0.235872 Oct 04 21:33:20.919491 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2729/5438] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:20 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:21.926741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2bd05bbd-fae1-4f9b-84c1-370a752cdca4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:21.927361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2bd05bbd-fae1-4f9b-84c1-370a752cdca4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:21.936878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bd05bbd-fae1-4f9b-84c1-370a752cdca4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:21.937513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bd05bbd-fae1-4f9b-84c1-370a752cdca4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:21.938229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bd05bbd-fae1-4f9b-84c1-370a752cdca4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:21.939705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bd05bbd-fae1-4f9b-84c1-370a752cdca4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:21.940261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bd05bbd-fae1-4f9b-84c1-370a752cdca4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:21.940899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bd05bbd-fae1-4f9b-84c1-370a752cdca4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:22.112542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2bd05bbd-fae1-4f9b-84c1-370a752cdca4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:22.121343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2bd05bbd-fae1-4f9b-84c1-370a752cdca4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:22.128080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2bd05bbd-fae1-4f9b-84c1-370a752cdca4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:22.129299 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2bd05bbd-fae1-4f9b-84c1-370a752cdca4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1723 microversion: 2.20 time: 0.206423 Oct 04 21:33:22.129909 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2710/5439] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:21 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:23.156596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-58b1aad8-49c5-44d8-b842-dc4b643460d9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:23.158482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-58b1aad8-49c5-44d8-b842-dc4b643460d9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:23.166913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58b1aad8-49c5-44d8-b842-dc4b643460d9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:23.170606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58b1aad8-49c5-44d8-b842-dc4b643460d9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:23.170606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58b1aad8-49c5-44d8-b842-dc4b643460d9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:23.170606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58b1aad8-49c5-44d8-b842-dc4b643460d9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:23.170606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58b1aad8-49c5-44d8-b842-dc4b643460d9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:23.175315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58b1aad8-49c5-44d8-b842-dc4b643460d9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:23.399416 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-58b1aad8-49c5-44d8-b842-dc4b643460d9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:23.432902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-58b1aad8-49c5-44d8-b842-dc4b643460d9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:23.435888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-58b1aad8-49c5-44d8-b842-dc4b643460d9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:23.437998 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-58b1aad8-49c5-44d8-b842-dc4b643460d9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1723 microversion: 2.20 time: 0.286091 Oct 04 21:33:23.452273 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2730/5440] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:23 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:24.054134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-77482f71-be71-4ce8-b9e2-acfd21e1c81a tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1525512058", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": "none"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:24.129799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-77482f71-be71-4ce8-b9e2-acfd21e1c81a tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:33:24.130438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-77482f71-be71-4ce8-b9e2-acfd21e1c81a tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:33:24.130920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-77482f71-be71-4ce8-b9e2-acfd21e1c81a tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:33:24.131327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-77482f71-be71-4ce8-b9e2-acfd21e1c81a tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:33:24.132322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-77482f71-be71-4ce8-b9e2-acfd21e1c81a tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:33:24.141829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77482f71-be71-4ce8-b9e2-acfd21e1c81a tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:24.142379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77482f71-be71-4ce8-b9e2-acfd21e1c81a tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:24.142818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77482f71-be71-4ce8-b9e2-acfd21e1c81a tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:24.143539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77482f71-be71-4ce8-b9e2-acfd21e1c81a tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:24.143990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77482f71-be71-4ce8-b9e2-acfd21e1c81a tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:24.144438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-77482f71-be71-4ce8-b9e2-acfd21e1c81a tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:24.164167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-77482f71-be71-4ce8-b9e2-acfd21e1c81a tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Getting quotas for project 2cb17355d0e643b1bc1c410b014ee101. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:33:24.169734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-77482f71-be71-4ce8-b9e2-acfd21e1c81a tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Getting quotas for user 8f7648ce64494efdaf3029d4201dabf0 and project 2cb17355d0e643b1bc1c410b014ee101. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:33:24.182541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-77482f71-be71-4ce8-b9e2-acfd21e1c81a tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:33:24.184724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-77482f71-be71-4ce8-b9e2-acfd21e1c81a tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:33:24.614175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5bf98b20-3119-4ad0-8532-39023b424b0a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:24.614175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5bf98b20-3119-4ad0-8532-39023b424b0a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:24.614175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5bf98b20-3119-4ad0-8532-39023b424b0a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:24.614175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5bf98b20-3119-4ad0-8532-39023b424b0a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:24.614175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5bf98b20-3119-4ad0-8532-39023b424b0a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:24.614175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5bf98b20-3119-4ad0-8532-39023b424b0a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:24.614175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5bf98b20-3119-4ad0-8532-39023b424b0a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:24.614175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5bf98b20-3119-4ad0-8532-39023b424b0a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:24.615330 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-77482f71-be71-4ce8-b9e2-acfd21e1c81a tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.780232 Oct 04 21:33:24.615330 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2711/5441] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Oct 4 21:33:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:33:24.615330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ccb75ec5-e1e1-407f-bfbf-2051ad68d4d9 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:24.615330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ccb75ec5-e1e1-407f-bfbf-2051ad68d4d9 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:24.629692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5bf98b20-3119-4ad0-8532-39023b424b0a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:24.639884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5bf98b20-3119-4ad0-8532-39023b424b0a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:24.644159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5bf98b20-3119-4ad0-8532-39023b424b0a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:24.645602 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5bf98b20-3119-4ad0-8532-39023b424b0a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1723 microversion: 2.20 time: 0.185048 Oct 04 21:33:24.646699 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2731/5442] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:24 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:33:24.703180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ccb75ec5-e1e1-407f-bfbf-2051ad68d4d9 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:24.714402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ccb75ec5-e1e1-407f-bfbf-2051ad68d4d9 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:24.714402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ccb75ec5-e1e1-407f-bfbf-2051ad68d4d9 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:24.715705 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ccb75ec5-e1e1-407f-bfbf-2051ad68d4d9 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1278 microversion: 2.54 time: 0.108378 Oct 04 21:33:24.716676 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2712/5443] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:24 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1278 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:33:25.678660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4fc95b47-7497-49d1-b87a-493c93205a1f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:25.680318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4fc95b47-7497-49d1-b87a-493c93205a1f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:25.690148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fc95b47-7497-49d1-b87a-493c93205a1f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:25.690638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fc95b47-7497-49d1-b87a-493c93205a1f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:25.691076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fc95b47-7497-49d1-b87a-493c93205a1f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:25.691966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fc95b47-7497-49d1-b87a-493c93205a1f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:25.692423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fc95b47-7497-49d1-b87a-493c93205a1f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:25.693021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4fc95b47-7497-49d1-b87a-493c93205a1f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:25.741843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e341544f-ca93-4584-9ea9-0c512d582cac tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:25.743114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e341544f-ca93-4584-9ea9-0c512d582cac tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:26.135606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e341544f-ca93-4584-9ea9-0c512d582cac tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:26.144171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e341544f-ca93-4584-9ea9-0c512d582cac tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:26.149373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e341544f-ca93-4584-9ea9-0c512d582cac tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:26.152831 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e341544f-ca93-4584-9ea9-0c512d582cac tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1278 microversion: 2.54 time: 0.414156 Oct 04 21:33:26.152831 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2713/5444] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:25 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1278 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:26.213137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4fc95b47-7497-49d1-b87a-493c93205a1f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:26.221784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4fc95b47-7497-49d1-b87a-493c93205a1f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:26.223291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4fc95b47-7497-49d1-b87a-493c93205a1f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:26.224514 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4fc95b47-7497-49d1-b87a-493c93205a1f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1723 microversion: 2.20 time: 0.550802 Oct 04 21:33:26.225118 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2732/5445] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:25 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1723 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:27.178560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-258973d3-76b1-4105-93a4-9b2d85e713a9 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:27.179973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-258973d3-76b1-4105-93a4-9b2d85e713a9 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:27.185561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:27.191115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-258973d3-76b1-4105-93a4-9b2d85e713a9 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:27.191607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-258973d3-76b1-4105-93a4-9b2d85e713a9 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:27.192042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-258973d3-76b1-4105-93a4-9b2d85e713a9 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:27.192740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-258973d3-76b1-4105-93a4-9b2d85e713a9 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:27.193192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-258973d3-76b1-4105-93a4-9b2d85e713a9 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:27.193854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-258973d3-76b1-4105-93a4-9b2d85e713a9 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:27.250868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a0c7f24c-6bc9-498e-88f3-69e891757fcb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:27.251643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a0c7f24c-6bc9-498e-88f3-69e891757fcb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:27.259178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0c7f24c-6bc9-498e-88f3-69e891757fcb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:27.259677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0c7f24c-6bc9-498e-88f3-69e891757fcb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:27.260599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-258973d3-76b1-4105-93a4-9b2d85e713a9 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:27.263854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0c7f24c-6bc9-498e-88f3-69e891757fcb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:27.265401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0c7f24c-6bc9-498e-88f3-69e891757fcb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:27.266108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0c7f24c-6bc9-498e-88f3-69e891757fcb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:27.266725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0c7f24c-6bc9-498e-88f3-69e891757fcb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:27.270478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-258973d3-76b1-4105-93a4-9b2d85e713a9 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:27.272933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-258973d3-76b1-4105-93a4-9b2d85e713a9 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:27.273826 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-258973d3-76b1-4105-93a4-9b2d85e713a9 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1330 microversion: 2.54 time: 0.099358 Oct 04 21:33:27.274550 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2714/5446] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:27 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:27.411562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a0c7f24c-6bc9-498e-88f3-69e891757fcb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:27.420452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a0c7f24c-6bc9-498e-88f3-69e891757fcb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:27.421987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a0c7f24c-6bc9-498e-88f3-69e891757fcb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:27.423166 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a0c7f24c-6bc9-498e-88f3-69e891757fcb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1723 microversion: 2.20 time: 0.176426 Oct 04 21:33:27.423733 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2733/5447] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:27 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:33:28.303813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8ab002a8-a600-4fdd-88a4-7c10c4e407f4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:28.304433 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8ab002a8-a600-4fdd-88a4-7c10c4e407f4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:28.311784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ab002a8-a600-4fdd-88a4-7c10c4e407f4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:28.312282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ab002a8-a600-4fdd-88a4-7c10c4e407f4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:28.312726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ab002a8-a600-4fdd-88a4-7c10c4e407f4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:28.313451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ab002a8-a600-4fdd-88a4-7c10c4e407f4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:28.313929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ab002a8-a600-4fdd-88a4-7c10c4e407f4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:28.314359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ab002a8-a600-4fdd-88a4-7c10c4e407f4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:28.389291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8ab002a8-a600-4fdd-88a4-7c10c4e407f4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:28.398534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8ab002a8-a600-4fdd-88a4-7c10c4e407f4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:28.400010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8ab002a8-a600-4fdd-88a4-7c10c4e407f4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:28.401245 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8ab002a8-a600-4fdd-88a4-7c10c4e407f4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1336 microversion: 2.54 time: 0.101775 Oct 04 21:33:28.402037 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2715/5448] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:28 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1336 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:28.451295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cf86277e-2f66-4436-9290-3a679db85510 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:28.451917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cf86277e-2f66-4436-9290-3a679db85510 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:28.458938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf86277e-2f66-4436-9290-3a679db85510 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:28.459371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf86277e-2f66-4436-9290-3a679db85510 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:28.459832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf86277e-2f66-4436-9290-3a679db85510 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:28.460605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf86277e-2f66-4436-9290-3a679db85510 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:28.461070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf86277e-2f66-4436-9290-3a679db85510 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:28.461537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf86277e-2f66-4436-9290-3a679db85510 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:28.644072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cf86277e-2f66-4436-9290-3a679db85510 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:28.654505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cf86277e-2f66-4436-9290-3a679db85510 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:28.657153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cf86277e-2f66-4436-9290-3a679db85510 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:28.657842 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cf86277e-2f66-4436-9290-3a679db85510 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1744 microversion: 2.20 time: 0.210750 Oct 04 21:33:28.658675 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2734/5449] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:28 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1744 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:29.430262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-47e89227-e219-44f5-82f2-be31d7d5eff2 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:29.430894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-47e89227-e219-44f5-82f2-be31d7d5eff2 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:29.439211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47e89227-e219-44f5-82f2-be31d7d5eff2 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:29.439732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47e89227-e219-44f5-82f2-be31d7d5eff2 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:29.440434 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47e89227-e219-44f5-82f2-be31d7d5eff2 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:29.441150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47e89227-e219-44f5-82f2-be31d7d5eff2 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:29.441644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47e89227-e219-44f5-82f2-be31d7d5eff2 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:29.442080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47e89227-e219-44f5-82f2-be31d7d5eff2 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:29.515670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-47e89227-e219-44f5-82f2-be31d7d5eff2 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:29.524449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-47e89227-e219-44f5-82f2-be31d7d5eff2 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:29.525927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-47e89227-e219-44f5-82f2-be31d7d5eff2 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:29.527334 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-47e89227-e219-44f5-82f2-be31d7d5eff2 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1336 microversion: 2.54 time: 0.101142 Oct 04 21:33:29.528019 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2716/5450] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:29 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1336 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:33:29.689350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e5757308-15a2-453f-8e11-4a56a04ea574 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:29.690743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e5757308-15a2-453f-8e11-4a56a04ea574 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:29.693798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:29.699149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5757308-15a2-453f-8e11-4a56a04ea574 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:29.699655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5757308-15a2-453f-8e11-4a56a04ea574 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:29.700103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5757308-15a2-453f-8e11-4a56a04ea574 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:29.700892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5757308-15a2-453f-8e11-4a56a04ea574 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:29.701264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5757308-15a2-453f-8e11-4a56a04ea574 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:29.701728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5757308-15a2-453f-8e11-4a56a04ea574 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:29.852543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e5757308-15a2-453f-8e11-4a56a04ea574 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:29.862251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e5757308-15a2-453f-8e11-4a56a04ea574 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:29.864884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e5757308-15a2-453f-8e11-4a56a04ea574 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:29.866135 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e5757308-15a2-453f-8e11-4a56a04ea574 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1739 microversion: 2.20 time: 0.181788 Oct 04 21:33:29.866714 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2735/5451] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:29 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:30.556145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8566b267-55d8-4424-8d54-f8f44f121263 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:30.556763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8566b267-55d8-4424-8d54-f8f44f121263 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:30.565972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8566b267-55d8-4424-8d54-f8f44f121263 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:30.571045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8566b267-55d8-4424-8d54-f8f44f121263 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:30.571045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8566b267-55d8-4424-8d54-f8f44f121263 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:30.571045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8566b267-55d8-4424-8d54-f8f44f121263 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:30.571045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8566b267-55d8-4424-8d54-f8f44f121263 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:30.571045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8566b267-55d8-4424-8d54-f8f44f121263 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:30.649579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8566b267-55d8-4424-8d54-f8f44f121263 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:30.673436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8566b267-55d8-4424-8d54-f8f44f121263 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:30.673436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8566b267-55d8-4424-8d54-f8f44f121263 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:30.673436 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8566b267-55d8-4424-8d54-f8f44f121263 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1357 microversion: 2.54 time: 0.115593 Oct 04 21:33:30.673436 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2717/5452] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:30 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1357 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:30.705184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a31b2320-af65-4d4d-b8b7-e7bde305e0e2 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Action: 'create', calling method: .version_select at 0x7f5790604d30>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-380488003", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgPf7tAOl0JGkd9xH6NQ6ckG1H+BAJ8IvpQO0/6jbGcLbcVfp9vMnui6HfUm5EopuKwLqLwZe2ANb972ZG0+BtmeCD3NawiF4g32qVd7ynoV1zLkn5L+J0X0hQ+WrHgQw=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:30.728416 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-a31b2320-af65-4d4d-b8b7-e7bde305e0e2 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Getting quotas for project 2cb17355d0e643b1bc1c410b014ee101. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:33:30.735470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-a31b2320-af65-4d4d-b8b7-e7bde305e0e2 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Getting quotas for user 8f7648ce64494efdaf3029d4201dabf0 and project 2cb17355d0e643b1bc1c410b014ee101. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:33:30.852139 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a31b2320-af65-4d4d-b8b7-e7bde305e0e2 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.150777 Oct 04 21:33:30.857561 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2736/5453] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Oct 4 21:33:30 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 153 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 04 21:33:30.871320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-380488003", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:30.874816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:30.885905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:30.893129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8b18e933-2f2c-4c6b-aac7-abc15f6186b5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:30.894117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8b18e933-2f2c-4c6b-aac7-abc15f6186b5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:30.897572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:30.899481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:30.903193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:30.903975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:30.904774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:30.910017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b18e933-2f2c-4c6b-aac7-abc15f6186b5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:30.911126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b18e933-2f2c-4c6b-aac7-abc15f6186b5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:30.911769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b18e933-2f2c-4c6b-aac7-abc15f6186b5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:30.923169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b18e933-2f2c-4c6b-aac7-abc15f6186b5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:30.924166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b18e933-2f2c-4c6b-aac7-abc15f6186b5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:30.924860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b18e933-2f2c-4c6b-aac7-abc15f6186b5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:31.076679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:33:31.077358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:33:31.077861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:33:31.078471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:33:31.079062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:33:31.156494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8b18e933-2f2c-4c6b-aac7-abc15f6186b5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:31.168451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8b18e933-2f2c-4c6b-aac7-abc15f6186b5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:31.169954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8b18e933-2f2c-4c6b-aac7-abc15f6186b5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:31.171153 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8b18e933-2f2c-4c6b-aac7-abc15f6186b5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1739 microversion: 2.20 time: 0.282784 Oct 04 21:33:31.171729 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2737/5454] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:30 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:33:31.459654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-dd66c7fa-aba9-4948-abcc-130ca237d306 req-372bafb3-3da5-4459-a275-7f1dafa335ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b27171c-bb6d-43d4-836d-98fa1c3790d8", "name": "network-vif-plugged", "status": "completed", "tag": "eaa67688-784e-449d-a04b-3ad12dd87fdc"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:31.459654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-dd66c7fa-aba9-4948-abcc-130ca237d306 req-372bafb3-3da5-4459-a275-7f1dafa335ab service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:31.459654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-dd66c7fa-aba9-4948-abcc-130ca237d306 req-372bafb3-3da5-4459-a275-7f1dafa335ab service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:31.459654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-dd66c7fa-aba9-4948-abcc-130ca237d306 req-372bafb3-3da5-4459-a275-7f1dafa335ab service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:31.459654 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-dd66c7fa-aba9-4948-abcc-130ca237d306 req-372bafb3-3da5-4459-a275-7f1dafa335ab service nova] Creating event network-vif-plugged:eaa67688-784e-449d-a04b-3ad12dd87fdc for instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 on n-h1-860282-1 Oct 04 21:33:31.459654 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-dd66c7fa-aba9-4948-abcc-130ca237d306 req-372bafb3-3da5-4459-a275-7f1dafa335ab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036578 Oct 04 21:33:31.459654 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2738/5455] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:33:31.471157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:31.481839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:31.482744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:31.483234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:31.484081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:31.484756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:31.485355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:31.533486 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4b8415ed-fae0-4bb9-9b01-a21cb739634e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "POST /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581/action" status: 202 len: 1139 microversion: 2.54 time: 0.666215 Oct 04 21:33:31.534550 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2718/5456] 10.222.0.30 () {62 vars in 1320 bytes} [Tue Oct 4 21:33:30 2022] POST /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581/action => generated 1139 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 04 21:33:31.725508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6a5beed4-b9f6-4861-ae8c-22a6a02de9ca tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:31.725508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6a5beed4-b9f6-4861-ae8c-22a6a02de9ca tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:31.725508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a5beed4-b9f6-4861-ae8c-22a6a02de9ca tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:31.725508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a5beed4-b9f6-4861-ae8c-22a6a02de9ca tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:31.725508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a5beed4-b9f6-4861-ae8c-22a6a02de9ca tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:31.725508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a5beed4-b9f6-4861-ae8c-22a6a02de9ca tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:31.725508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a5beed4-b9f6-4861-ae8c-22a6a02de9ca tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:31.725508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a5beed4-b9f6-4861-ae8c-22a6a02de9ca tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:31.725508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6a5beed4-b9f6-4861-ae8c-22a6a02de9ca tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:31.725508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6a5beed4-b9f6-4861-ae8c-22a6a02de9ca tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:31.725508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6a5beed4-b9f6-4861-ae8c-22a6a02de9ca tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:31.727578 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6a5beed4-b9f6-4861-ae8c-22a6a02de9ca tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.132259 Oct 04 21:33:31.727578 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2739/5457] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:31 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:32.197798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7bf3cdc8-9455-4b2e-839d-c56eb5ce7c18 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:32.198528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7bf3cdc8-9455-4b2e-839d-c56eb5ce7c18 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:32.210125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bf3cdc8-9455-4b2e-839d-c56eb5ce7c18 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:32.211694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bf3cdc8-9455-4b2e-839d-c56eb5ce7c18 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:32.211694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bf3cdc8-9455-4b2e-839d-c56eb5ce7c18 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:32.212292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bf3cdc8-9455-4b2e-839d-c56eb5ce7c18 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:32.212848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bf3cdc8-9455-4b2e-839d-c56eb5ce7c18 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:32.213337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bf3cdc8-9455-4b2e-839d-c56eb5ce7c18 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:32.390902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7bf3cdc8-9455-4b2e-839d-c56eb5ce7c18 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:32.410794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7bf3cdc8-9455-4b2e-839d-c56eb5ce7c18 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:32.412958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7bf3cdc8-9455-4b2e-839d-c56eb5ce7c18 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:32.414394 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7bf3cdc8-9455-4b2e-839d-c56eb5ce7c18 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1739 microversion: 2.20 time: 0.220936 Oct 04 21:33:32.440303 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2719/5458] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:32 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:32.758239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9bf1e609-f557-4ae2-8f8e-7156e4c38975 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:32.758872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9bf1e609-f557-4ae2-8f8e-7156e4c38975 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:32.772504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9bf1e609-f557-4ae2-8f8e-7156e4c38975 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:32.773016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9bf1e609-f557-4ae2-8f8e-7156e4c38975 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:32.774045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9bf1e609-f557-4ae2-8f8e-7156e4c38975 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:32.779889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9bf1e609-f557-4ae2-8f8e-7156e4c38975 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:32.779889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9bf1e609-f557-4ae2-8f8e-7156e4c38975 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:32.779889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9bf1e609-f557-4ae2-8f8e-7156e4c38975 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:32.863450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9bf1e609-f557-4ae2-8f8e-7156e4c38975 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:32.874591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9bf1e609-f557-4ae2-8f8e-7156e4c38975 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:32.885796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9bf1e609-f557-4ae2-8f8e-7156e4c38975 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:32.887951 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9bf1e609-f557-4ae2-8f8e-7156e4c38975 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.133785 Oct 04 21:33:32.889014 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2740/5459] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:32 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:33.440793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-401ff8f6-e959-40cb-bff2-1458c0060385 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:33.442320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-401ff8f6-e959-40cb-bff2-1458c0060385 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:33.452916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-401ff8f6-e959-40cb-bff2-1458c0060385 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:33.453591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-401ff8f6-e959-40cb-bff2-1458c0060385 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:33.454294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-401ff8f6-e959-40cb-bff2-1458c0060385 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:33.455087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-401ff8f6-e959-40cb-bff2-1458c0060385 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:33.455758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-401ff8f6-e959-40cb-bff2-1458c0060385 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:33.456375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-401ff8f6-e959-40cb-bff2-1458c0060385 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:33.689932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-401ff8f6-e959-40cb-bff2-1458c0060385 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:33.705530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-401ff8f6-e959-40cb-bff2-1458c0060385 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:33.710076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-401ff8f6-e959-40cb-bff2-1458c0060385 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:33.710076 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-401ff8f6-e959-40cb-bff2-1458c0060385 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1739 microversion: 2.20 time: 0.271623 Oct 04 21:33:33.713917 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2720/5460] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:33 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1739 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:33.916602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-11aa0630-439e-4f27-b99f-c5a7121507d4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:33.917371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-11aa0630-439e-4f27-b99f-c5a7121507d4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:33.924941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-11aa0630-439e-4f27-b99f-c5a7121507d4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:33.925478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-11aa0630-439e-4f27-b99f-c5a7121507d4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:33.926100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-11aa0630-439e-4f27-b99f-c5a7121507d4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:33.926962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-11aa0630-439e-4f27-b99f-c5a7121507d4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:33.927585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-11aa0630-439e-4f27-b99f-c5a7121507d4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:33.928209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-11aa0630-439e-4f27-b99f-c5a7121507d4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:34.015884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-11aa0630-439e-4f27-b99f-c5a7121507d4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:34.033139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-11aa0630-439e-4f27-b99f-c5a7121507d4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:34.034908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-11aa0630-439e-4f27-b99f-c5a7121507d4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:34.036324 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-11aa0630-439e-4f27-b99f-c5a7121507d4 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.123673 Oct 04 21:33:34.037372 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2741/5461] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:33 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:34.742301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-27cf4a83-6f56-45f0-9a09-81adb93e51b4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:34.743976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-27cf4a83-6f56-45f0-9a09-81adb93e51b4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:34.752634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:34.755281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27cf4a83-6f56-45f0-9a09-81adb93e51b4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:34.755773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27cf4a83-6f56-45f0-9a09-81adb93e51b4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:34.756218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27cf4a83-6f56-45f0-9a09-81adb93e51b4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:34.756931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27cf4a83-6f56-45f0-9a09-81adb93e51b4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:34.757388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27cf4a83-6f56-45f0-9a09-81adb93e51b4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:34.757845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27cf4a83-6f56-45f0-9a09-81adb93e51b4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:34.971037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-27cf4a83-6f56-45f0-9a09-81adb93e51b4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:34.984581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-27cf4a83-6f56-45f0-9a09-81adb93e51b4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:34.987558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-27cf4a83-6f56-45f0-9a09-81adb93e51b4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:34.993381 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-27cf4a83-6f56-45f0-9a09-81adb93e51b4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1739 microversion: 2.20 time: 0.250721 Oct 04 21:33:34.993381 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2721/5462] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:34 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:33:35.065541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-47e9d5de-69c1-4460-93ea-d93b1f5c6071 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:35.069507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-47e9d5de-69c1-4460-93ea-d93b1f5c6071 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:35.083038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47e9d5de-69c1-4460-93ea-d93b1f5c6071 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:35.089761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47e9d5de-69c1-4460-93ea-d93b1f5c6071 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:35.090475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47e9d5de-69c1-4460-93ea-d93b1f5c6071 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:35.091338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47e9d5de-69c1-4460-93ea-d93b1f5c6071 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:35.091821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47e9d5de-69c1-4460-93ea-d93b1f5c6071 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:35.092257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47e9d5de-69c1-4460-93ea-d93b1f5c6071 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:35.159857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-93b0bbd2-c5f8-41ab-bf97-b38170496883 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:35.160358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-93b0bbd2-c5f8-41ab-bf97-b38170496883 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:35.182226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93b0bbd2-c5f8-41ab-bf97-b38170496883 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:35.182648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93b0bbd2-c5f8-41ab-bf97-b38170496883 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:35.183096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93b0bbd2-c5f8-41ab-bf97-b38170496883 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:35.184396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93b0bbd2-c5f8-41ab-bf97-b38170496883 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:35.184872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93b0bbd2-c5f8-41ab-bf97-b38170496883 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:35.185309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93b0bbd2-c5f8-41ab-bf97-b38170496883 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:35.202835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-47e9d5de-69c1-4460-93ea-d93b1f5c6071 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:35.214645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-47e9d5de-69c1-4460-93ea-d93b1f5c6071 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:35.216983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-47e9d5de-69c1-4460-93ea-d93b1f5c6071 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:35.219525 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-47e9d5de-69c1-4460-93ea-d93b1f5c6071 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.157584 Oct 04 21:33:35.220849 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2742/5463] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:35 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:35.373728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-93b0bbd2-c5f8-41ab-bf97-b38170496883 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lazy-loading 'services' on Instance uuid f195f612-8d0d-42b7-bd89-5e30477023b4 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:33:35.733001 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-93b0bbd2-c5f8-41ab-bf97-b38170496883 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4/os-volume_attachments/268216f4-b2cd-415a-960c-a01e701d19da" status: 202 len: 0 microversion: 2.1 time: 0.577781 Oct 04 21:33:35.733624 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2722/5464] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 21:33:35 2022] DELETE /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4/os-volume_attachments/268216f4-b2cd-415a-960c-a01e701d19da => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:33:36.021555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-40b792d5-76c8-420a-af95-a318d5b73ad6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:36.022816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-40b792d5-76c8-420a-af95-a318d5b73ad6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:36.031168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40b792d5-76c8-420a-af95-a318d5b73ad6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:36.031676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40b792d5-76c8-420a-af95-a318d5b73ad6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:36.032121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40b792d5-76c8-420a-af95-a318d5b73ad6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:36.033098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40b792d5-76c8-420a-af95-a318d5b73ad6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:36.033595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40b792d5-76c8-420a-af95-a318d5b73ad6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:36.034112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40b792d5-76c8-420a-af95-a318d5b73ad6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:36.059562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:36.237856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-40b792d5-76c8-420a-af95-a318d5b73ad6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:36.250152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ceeaba8f-d891-444f-b4b1-193925fccf48 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:36.253221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ceeaba8f-d891-444f-b4b1-193925fccf48 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:36.260296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=10 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:36.267083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-40b792d5-76c8-420a-af95-a318d5b73ad6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:36.269587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-40b792d5-76c8-420a-af95-a318d5b73ad6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:36.272111 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-40b792d5-76c8-420a-af95-a318d5b73ad6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1739 microversion: 2.20 time: 0.254517 Oct 04 21:33:36.272916 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2743/5465] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:36 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:36.274538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ceeaba8f-d891-444f-b4b1-193925fccf48 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:36.281045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ceeaba8f-d891-444f-b4b1-193925fccf48 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:36.281045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ceeaba8f-d891-444f-b4b1-193925fccf48 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:36.281045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ceeaba8f-d891-444f-b4b1-193925fccf48 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:36.281045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ceeaba8f-d891-444f-b4b1-193925fccf48 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:36.281045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ceeaba8f-d891-444f-b4b1-193925fccf48 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:36.312144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:36.414553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ceeaba8f-d891-444f-b4b1-193925fccf48 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:36.429651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ceeaba8f-d891-444f-b4b1-193925fccf48 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:36.431939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ceeaba8f-d891-444f-b4b1-193925fccf48 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:36.440350 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ceeaba8f-d891-444f-b4b1-193925fccf48 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.193445 Oct 04 21:33:36.441542 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2723/5466] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:36 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:37.311143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-93f134f0-8a37-479f-b228-fb38484718b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:37.312863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-93f134f0-8a37-479f-b228-fb38484718b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:37.333202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93f134f0-8a37-479f-b228-fb38484718b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:37.334393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93f134f0-8a37-479f-b228-fb38484718b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:37.335034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93f134f0-8a37-479f-b228-fb38484718b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:37.336012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93f134f0-8a37-479f-b228-fb38484718b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:37.336679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93f134f0-8a37-479f-b228-fb38484718b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:37.337282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93f134f0-8a37-479f-b228-fb38484718b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:37.472757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-21a23f59-810b-4492-a0af-193e5b0fef75 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:37.473385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-21a23f59-810b-4492-a0af-193e5b0fef75 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:37.488154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21a23f59-810b-4492-a0af-193e5b0fef75 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:37.488932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21a23f59-810b-4492-a0af-193e5b0fef75 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:37.493650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21a23f59-810b-4492-a0af-193e5b0fef75 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:37.494705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21a23f59-810b-4492-a0af-193e5b0fef75 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:37.495437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21a23f59-810b-4492-a0af-193e5b0fef75 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:37.496827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21a23f59-810b-4492-a0af-193e5b0fef75 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:37.593999 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-93f134f0-8a37-479f-b228-fb38484718b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:37.608428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-93f134f0-8a37-479f-b228-fb38484718b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:37.609521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-21a23f59-810b-4492-a0af-193e5b0fef75 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:37.610763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-93f134f0-8a37-479f-b228-fb38484718b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:37.612162 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-93f134f0-8a37-479f-b228-fb38484718b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1739 microversion: 2.20 time: 0.307588 Oct 04 21:33:37.613405 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2744/5467] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:37 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:37.618935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-21a23f59-810b-4492-a0af-193e5b0fef75 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:37.620691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-21a23f59-810b-4492-a0af-193e5b0fef75 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:37.623650 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-21a23f59-810b-4492-a0af-193e5b0fef75 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.154610 Oct 04 21:33:37.624730 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2724/5468] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:37 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:38.642708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9fb19659-ceaf-4a20-a59d-5dcf9f8456c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:38.644049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9fb19659-ceaf-4a20-a59d-5dcf9f8456c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:38.651653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9fb19659-ceaf-4a20-a59d-5dcf9f8456c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:38.652478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9fb19659-ceaf-4a20-a59d-5dcf9f8456c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:38.653346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9fb19659-ceaf-4a20-a59d-5dcf9f8456c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:38.654336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9fb19659-ceaf-4a20-a59d-5dcf9f8456c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:38.655321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9fb19659-ceaf-4a20-a59d-5dcf9f8456c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:38.655910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9fb19659-ceaf-4a20-a59d-5dcf9f8456c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:38.665995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-908b4114-95fd-48e4-8f83-64680a650c5e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:38.666816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-908b4114-95fd-48e4-8f83-64680a650c5e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:38.674669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-908b4114-95fd-48e4-8f83-64680a650c5e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:38.675176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-908b4114-95fd-48e4-8f83-64680a650c5e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:38.675889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-908b4114-95fd-48e4-8f83-64680a650c5e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:38.676771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-908b4114-95fd-48e4-8f83-64680a650c5e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:38.677235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-908b4114-95fd-48e4-8f83-64680a650c5e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:38.677870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-908b4114-95fd-48e4-8f83-64680a650c5e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:38.828471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9fb19659-ceaf-4a20-a59d-5dcf9f8456c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:38.838740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9fb19659-ceaf-4a20-a59d-5dcf9f8456c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:38.842144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9fb19659-ceaf-4a20-a59d-5dcf9f8456c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:38.861088 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9fb19659-ceaf-4a20-a59d-5dcf9f8456c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1739 microversion: 2.20 time: 0.207547 Oct 04 21:33:38.861088 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2745/5469] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:38 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:39.059089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-908b4114-95fd-48e4-8f83-64680a650c5e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:39.070359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-908b4114-95fd-48e4-8f83-64680a650c5e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:39.075652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-908b4114-95fd-48e4-8f83-64680a650c5e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:39.078811 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-908b4114-95fd-48e4-8f83-64680a650c5e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.415879 Oct 04 21:33:39.083759 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2725/5470] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:38 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:39.878275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2ac04b54-bd69-433f-9dec-b600ccabc4be tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:39.879158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2ac04b54-bd69-433f-9dec-b600ccabc4be tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:39.889371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ac04b54-bd69-433f-9dec-b600ccabc4be tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:39.890271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ac04b54-bd69-433f-9dec-b600ccabc4be tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:39.890938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ac04b54-bd69-433f-9dec-b600ccabc4be tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:39.892349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ac04b54-bd69-433f-9dec-b600ccabc4be tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:39.893488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ac04b54-bd69-433f-9dec-b600ccabc4be tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:39.894155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ac04b54-bd69-433f-9dec-b600ccabc4be tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:40.111982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f719b27b-da0f-4b42-882b-f6d667492d20 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:40.112658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f719b27b-da0f-4b42-882b-f6d667492d20 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:40.129032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f719b27b-da0f-4b42-882b-f6d667492d20 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:40.129587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f719b27b-da0f-4b42-882b-f6d667492d20 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:40.136239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f719b27b-da0f-4b42-882b-f6d667492d20 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:40.139556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f719b27b-da0f-4b42-882b-f6d667492d20 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:40.140643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f719b27b-da0f-4b42-882b-f6d667492d20 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:40.142181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f719b27b-da0f-4b42-882b-f6d667492d20 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:40.147465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2ac04b54-bd69-433f-9dec-b600ccabc4be tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:40.183570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2ac04b54-bd69-433f-9dec-b600ccabc4be tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:40.194698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2ac04b54-bd69-433f-9dec-b600ccabc4be tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:40.201474 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2ac04b54-bd69-433f-9dec-b600ccabc4be tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1739 microversion: 2.20 time: 0.328321 Oct 04 21:33:40.202471 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2746/5471] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:39 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1739 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:40.333060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f719b27b-da0f-4b42-882b-f6d667492d20 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:40.344684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f719b27b-da0f-4b42-882b-f6d667492d20 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:40.346219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f719b27b-da0f-4b42-882b-f6d667492d20 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:40.347422 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f719b27b-da0f-4b42-882b-f6d667492d20 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.240463 Oct 04 21:33:40.356595 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2726/5472] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:40 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:33:41.231782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3a28153f-7412-4e8c-a614-50f3212b09ad tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:41.232323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3a28153f-7412-4e8c-a614-50f3212b09ad tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:41.249331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:41.249616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a28153f-7412-4e8c-a614-50f3212b09ad tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:41.250413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a28153f-7412-4e8c-a614-50f3212b09ad tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:41.252039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a28153f-7412-4e8c-a614-50f3212b09ad tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:41.255401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a28153f-7412-4e8c-a614-50f3212b09ad tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:41.256110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a28153f-7412-4e8c-a614-50f3212b09ad tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:41.256700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a28153f-7412-4e8c-a614-50f3212b09ad tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:41.377638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c94e52f9-a153-419a-901c-70c7c63430ae tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:41.389449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c94e52f9-a153-419a-901c-70c7c63430ae tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:41.389449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c94e52f9-a153-419a-901c-70c7c63430ae tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:41.389449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c94e52f9-a153-419a-901c-70c7c63430ae tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:41.389449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c94e52f9-a153-419a-901c-70c7c63430ae tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:41.402809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c94e52f9-a153-419a-901c-70c7c63430ae tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:41.403464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c94e52f9-a153-419a-901c-70c7c63430ae tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:41.404068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c94e52f9-a153-419a-901c-70c7c63430ae tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:41.542010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c94e52f9-a153-419a-901c-70c7c63430ae tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:41.556071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c94e52f9-a153-419a-901c-70c7c63430ae tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:41.559747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c94e52f9-a153-419a-901c-70c7c63430ae tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:41.563063 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c94e52f9-a153-419a-901c-70c7c63430ae tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.189717 Oct 04 21:33:41.568613 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2727/5473] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:41 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:41.633739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3a28153f-7412-4e8c-a614-50f3212b09ad tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:41.646770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3a28153f-7412-4e8c-a614-50f3212b09ad tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:41.648888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3a28153f-7412-4e8c-a614-50f3212b09ad tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:41.650569 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3a28153f-7412-4e8c-a614-50f3212b09ad tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1739 microversion: 2.20 time: 0.424413 Oct 04 21:33:41.652406 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2747/5474] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:41 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1739 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:42.600839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c2ef821b-d60b-46b8-8738-a4b8e044e3a7 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:42.601462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c2ef821b-d60b-46b8-8738-a4b8e044e3a7 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:42.617876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2ef821b-d60b-46b8-8738-a4b8e044e3a7 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:42.617876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2ef821b-d60b-46b8-8738-a4b8e044e3a7 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:42.617876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2ef821b-d60b-46b8-8738-a4b8e044e3a7 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:42.617876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2ef821b-d60b-46b8-8738-a4b8e044e3a7 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:42.617876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2ef821b-d60b-46b8-8738-a4b8e044e3a7 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:42.617876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2ef821b-d60b-46b8-8738-a4b8e044e3a7 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:42.684898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-500238fc-ea56-48da-a30c-7ef7082821d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:42.685557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-500238fc-ea56-48da-a30c-7ef7082821d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:42.698437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-500238fc-ea56-48da-a30c-7ef7082821d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:42.699775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-500238fc-ea56-48da-a30c-7ef7082821d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:42.700354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-500238fc-ea56-48da-a30c-7ef7082821d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:42.701229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-500238fc-ea56-48da-a30c-7ef7082821d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:42.701844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-500238fc-ea56-48da-a30c-7ef7082821d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:42.702373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-500238fc-ea56-48da-a30c-7ef7082821d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:42.725014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c2ef821b-d60b-46b8-8738-a4b8e044e3a7 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:42.735168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c2ef821b-d60b-46b8-8738-a4b8e044e3a7 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:42.736846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c2ef821b-d60b-46b8-8738-a4b8e044e3a7 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:42.738264 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c2ef821b-d60b-46b8-8738-a4b8e044e3a7 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.141352 Oct 04 21:33:42.739121 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2728/5475] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:42 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:42.910266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-500238fc-ea56-48da-a30c-7ef7082821d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:42.919209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-500238fc-ea56-48da-a30c-7ef7082821d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:42.920868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-500238fc-ea56-48da-a30c-7ef7082821d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:42.922435 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-500238fc-ea56-48da-a30c-7ef7082821d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1739 microversion: 2.20 time: 0.242326 Oct 04 21:33:42.923008 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2748/5476] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:42 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:33:43.686073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4dba0055-545a-4f45-93ea-2370ba8df8cc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:43.693257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4dba0055-545a-4f45-93ea-2370ba8df8cc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:43.693796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4dba0055-545a-4f45-93ea-2370ba8df8cc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:43.694237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4dba0055-545a-4f45-93ea-2370ba8df8cc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:43.717821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4dba0055-545a-4f45-93ea-2370ba8df8cc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Going to try to stop instance {{(pid=122758) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:33:43.772753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4970abf6-71c5-40f6-aa32-c9a7489aaf79 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:43.772753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4970abf6-71c5-40f6-aa32-c9a7489aaf79 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:43.778040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4970abf6-71c5-40f6-aa32-c9a7489aaf79 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:43.778874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4970abf6-71c5-40f6-aa32-c9a7489aaf79 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:43.779389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4970abf6-71c5-40f6-aa32-c9a7489aaf79 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:43.780284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4970abf6-71c5-40f6-aa32-c9a7489aaf79 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:43.780813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4970abf6-71c5-40f6-aa32-c9a7489aaf79 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:43.781412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4970abf6-71c5-40f6-aa32-c9a7489aaf79 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:43.853720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4970abf6-71c5-40f6-aa32-c9a7489aaf79 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:43.863453 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4970abf6-71c5-40f6-aa32-c9a7489aaf79 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:43.865009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4970abf6-71c5-40f6-aa32-c9a7489aaf79 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:43.866222 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4970abf6-71c5-40f6-aa32-c9a7489aaf79 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.101056 Oct 04 21:33:43.866794 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2749/5477] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:43 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:33:43.947957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-780317c4-6ea5-43a8-a611-d6220bcb8107 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:43.949179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-780317c4-6ea5-43a8-a611-d6220bcb8107 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:43.955532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-780317c4-6ea5-43a8-a611-d6220bcb8107 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:43.956028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-780317c4-6ea5-43a8-a611-d6220bcb8107 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:43.956452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-780317c4-6ea5-43a8-a611-d6220bcb8107 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:43.957146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-780317c4-6ea5-43a8-a611-d6220bcb8107 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:43.957625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-780317c4-6ea5-43a8-a611-d6220bcb8107 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:43.958054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-780317c4-6ea5-43a8-a611-d6220bcb8107 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:43.985107 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4dba0055-545a-4f45-93ea-2370ba8df8cc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "POST /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4/action" status: 202 len: 0 microversion: 2.1 time: 0.303039 Oct 04 21:33:43.989157 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2729/5478] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:33:43 2022] POST /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:33:43.995949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-75281308-4e81-49ea-bb4d-b49445a2fc63 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:43.996930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-75281308-4e81-49ea-bb4d-b49445a2fc63 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:44.003646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75281308-4e81-49ea-bb4d-b49445a2fc63 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:44.004156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75281308-4e81-49ea-bb4d-b49445a2fc63 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:44.004599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75281308-4e81-49ea-bb4d-b49445a2fc63 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:44.005571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75281308-4e81-49ea-bb4d-b49445a2fc63 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:44.006040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75281308-4e81-49ea-bb4d-b49445a2fc63 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:44.006472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75281308-4e81-49ea-bb4d-b49445a2fc63 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:44.151022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-780317c4-6ea5-43a8-a611-d6220bcb8107 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:44.162281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-780317c4-6ea5-43a8-a611-d6220bcb8107 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:44.164491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-780317c4-6ea5-43a8-a611-d6220bcb8107 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:44.165737 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-780317c4-6ea5-43a8-a611-d6220bcb8107 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1739 microversion: 2.20 time: 0.221808 Oct 04 21:33:44.166313 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2750/5479] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:43 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:33:44.180657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-75281308-4e81-49ea-bb4d-b49445a2fc63 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:44.188284 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-75281308-4e81-49ea-bb4d-b49445a2fc63 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1676 microversion: 2.1 time: 0.197108 Oct 04 21:33:44.188887 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2730/5480] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:43 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1676 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:44.893014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e152b67a-ca46-4204-a631-8ffa5fd0516e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:44.893684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e152b67a-ca46-4204-a631-8ffa5fd0516e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:44.900682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e152b67a-ca46-4204-a631-8ffa5fd0516e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:44.901191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e152b67a-ca46-4204-a631-8ffa5fd0516e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:44.902322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e152b67a-ca46-4204-a631-8ffa5fd0516e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:44.910074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e152b67a-ca46-4204-a631-8ffa5fd0516e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:44.910074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e152b67a-ca46-4204-a631-8ffa5fd0516e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:44.910074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e152b67a-ca46-4204-a631-8ffa5fd0516e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:45.000131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e152b67a-ca46-4204-a631-8ffa5fd0516e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:45.008296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e152b67a-ca46-4204-a631-8ffa5fd0516e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:45.009813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e152b67a-ca46-4204-a631-8ffa5fd0516e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:45.011657 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e152b67a-ca46-4204-a631-8ffa5fd0516e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.122237 Oct 04 21:33:45.014097 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2751/5481] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:44 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:45.192569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0de6b232-a9f3-494c-a104-636f4d35c0ae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:45.193224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0de6b232-a9f3-494c-a104-636f4d35c0ae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:45.204449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0de6b232-a9f3-494c-a104-636f4d35c0ae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:45.204977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0de6b232-a9f3-494c-a104-636f4d35c0ae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:45.205452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0de6b232-a9f3-494c-a104-636f4d35c0ae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:45.206186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0de6b232-a9f3-494c-a104-636f4d35c0ae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:45.206987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0de6b232-a9f3-494c-a104-636f4d35c0ae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:45.207425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0de6b232-a9f3-494c-a104-636f4d35c0ae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:45.216610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-605e3398-7567-4f6f-abb5-27ef8023e4ca tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:45.217596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-605e3398-7567-4f6f-abb5-27ef8023e4ca tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:45.228716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-605e3398-7567-4f6f-abb5-27ef8023e4ca tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:45.229222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-605e3398-7567-4f6f-abb5-27ef8023e4ca tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:45.229737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-605e3398-7567-4f6f-abb5-27ef8023e4ca tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:45.230537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-605e3398-7567-4f6f-abb5-27ef8023e4ca tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:45.230996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-605e3398-7567-4f6f-abb5-27ef8023e4ca tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:45.231428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-605e3398-7567-4f6f-abb5-27ef8023e4ca tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:45.520248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0de6b232-a9f3-494c-a104-636f4d35c0ae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:45.530215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0de6b232-a9f3-494c-a104-636f4d35c0ae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:45.533956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0de6b232-a9f3-494c-a104-636f4d35c0ae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:45.533956 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0de6b232-a9f3-494c-a104-636f4d35c0ae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1721 microversion: 2.20 time: 0.345170 Oct 04 21:33:45.534599 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2731/5482] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:45 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1721 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:33:45.587876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-605e3398-7567-4f6f-abb5-27ef8023e4ca tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:45.596577 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-605e3398-7567-4f6f-abb5-27ef8023e4ca tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1676 microversion: 2.1 time: 0.385461 Oct 04 21:33:45.597248 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2752/5483] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:45 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1676 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:33:46.044932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-52c45489-6e6b-4415-ba37-ff769c2fda14 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:46.045885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-52c45489-6e6b-4415-ba37-ff769c2fda14 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:46.052171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52c45489-6e6b-4415-ba37-ff769c2fda14 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:46.052636 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52c45489-6e6b-4415-ba37-ff769c2fda14 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:46.053082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52c45489-6e6b-4415-ba37-ff769c2fda14 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:46.053809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52c45489-6e6b-4415-ba37-ff769c2fda14 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:46.054545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52c45489-6e6b-4415-ba37-ff769c2fda14 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:46.054837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52c45489-6e6b-4415-ba37-ff769c2fda14 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:46.133605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-52c45489-6e6b-4415-ba37-ff769c2fda14 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:46.144622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-52c45489-6e6b-4415-ba37-ff769c2fda14 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:46.146139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-52c45489-6e6b-4415-ba37-ff769c2fda14 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:46.147329 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-52c45489-6e6b-4415-ba37-ff769c2fda14 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.107044 Oct 04 21:33:46.147927 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2732/5484] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:46 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:46.564343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-688611bd-5c2b-4fe3-93bf-5011b5a215bf tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:46.564343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-688611bd-5c2b-4fe3-93bf-5011b5a215bf tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:46.572667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-688611bd-5c2b-4fe3-93bf-5011b5a215bf tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:46.574284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-688611bd-5c2b-4fe3-93bf-5011b5a215bf tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:46.574284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-688611bd-5c2b-4fe3-93bf-5011b5a215bf tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:46.574787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-688611bd-5c2b-4fe3-93bf-5011b5a215bf tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:46.575257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-688611bd-5c2b-4fe3-93bf-5011b5a215bf tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:46.575826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-688611bd-5c2b-4fe3-93bf-5011b5a215bf tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:46.620906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c5400661-ac67-4fdc-9b32-e6c8773a1477 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:46.621634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c5400661-ac67-4fdc-9b32-e6c8773a1477 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:46.641726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5400661-ac67-4fdc-9b32-e6c8773a1477 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:46.642351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5400661-ac67-4fdc-9b32-e6c8773a1477 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:46.642938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5400661-ac67-4fdc-9b32-e6c8773a1477 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:46.643838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5400661-ac67-4fdc-9b32-e6c8773a1477 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:46.644461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5400661-ac67-4fdc-9b32-e6c8773a1477 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:46.644917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5400661-ac67-4fdc-9b32-e6c8773a1477 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:46.791178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-688611bd-5c2b-4fe3-93bf-5011b5a215bf tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:46.800277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-688611bd-5c2b-4fe3-93bf-5011b5a215bf tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:46.801806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-688611bd-5c2b-4fe3-93bf-5011b5a215bf tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:46.803023 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-688611bd-5c2b-4fe3-93bf-5011b5a215bf tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1721 microversion: 2.20 time: 0.246533 Oct 04 21:33:46.804118 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2753/5485] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:46 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:46.829298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c5400661-ac67-4fdc-9b32-e6c8773a1477 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:46.837213 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c5400661-ac67-4fdc-9b32-e6c8773a1477 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1676 microversion: 2.1 time: 0.220750 Oct 04 21:33:46.837835 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2733/5486] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:46 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1676 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:47.174680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-76af7c67-5d6f-4313-9eae-5fbf729233d0 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:47.175303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-76af7c67-5d6f-4313-9eae-5fbf729233d0 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:47.181255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76af7c67-5d6f-4313-9eae-5fbf729233d0 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:47.181778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76af7c67-5d6f-4313-9eae-5fbf729233d0 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:47.182225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76af7c67-5d6f-4313-9eae-5fbf729233d0 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:47.182918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76af7c67-5d6f-4313-9eae-5fbf729233d0 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:47.183381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76af7c67-5d6f-4313-9eae-5fbf729233d0 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:47.183813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76af7c67-5d6f-4313-9eae-5fbf729233d0 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:47.247963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-76af7c67-5d6f-4313-9eae-5fbf729233d0 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:47.256279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-76af7c67-5d6f-4313-9eae-5fbf729233d0 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:47.257786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-76af7c67-5d6f-4313-9eae-5fbf729233d0 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:47.258968 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-76af7c67-5d6f-4313-9eae-5fbf729233d0 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.088347 Oct 04 21:33:47.259538 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2754/5487] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:47 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:47.832294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b83cb884-3b1d-413a-9b5f-4455842ac3c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:47.832907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b83cb884-3b1d-413a-9b5f-4455842ac3c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:47.840034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b83cb884-3b1d-413a-9b5f-4455842ac3c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:47.840518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b83cb884-3b1d-413a-9b5f-4455842ac3c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:47.840950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b83cb884-3b1d-413a-9b5f-4455842ac3c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:47.841665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b83cb884-3b1d-413a-9b5f-4455842ac3c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:47.842120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b83cb884-3b1d-413a-9b5f-4455842ac3c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:47.842542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b83cb884-3b1d-413a-9b5f-4455842ac3c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:47.860645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cc5651cd-13d9-4699-bbc5-a1b1fddfffb9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:47.861254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cc5651cd-13d9-4699-bbc5-a1b1fddfffb9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:47.868122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc5651cd-13d9-4699-bbc5-a1b1fddfffb9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:47.872716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc5651cd-13d9-4699-bbc5-a1b1fddfffb9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:47.873359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc5651cd-13d9-4699-bbc5-a1b1fddfffb9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:47.876311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc5651cd-13d9-4699-bbc5-a1b1fddfffb9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:47.876963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc5651cd-13d9-4699-bbc5-a1b1fddfffb9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:47.877605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc5651cd-13d9-4699-bbc5-a1b1fddfffb9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:48.065872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b83cb884-3b1d-413a-9b5f-4455842ac3c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:48.077845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cc5651cd-13d9-4699-bbc5-a1b1fddfffb9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:48.090555 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cc5651cd-13d9-4699-bbc5-a1b1fddfffb9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1676 microversion: 2.1 time: 0.229148 Oct 04 21:33:48.090555 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2755/5488] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:47 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1676 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:33:48.092745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b83cb884-3b1d-413a-9b5f-4455842ac3c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:48.094246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b83cb884-3b1d-413a-9b5f-4455842ac3c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:48.095447 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b83cb884-3b1d-413a-9b5f-4455842ac3c7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1724 microversion: 2.20 time: 0.267104 Oct 04 21:33:48.096015 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2734/5489] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:47 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:48.138108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-21073baa-89fe-475f-89f8-052f431f2986 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dad872e4-4f4a-4d0e-9c97-4173ac1e5ade"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:48.142072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-21073baa-89fe-475f-89f8-052f431f2986 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:48.151138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21073baa-89fe-475f-89f8-052f431f2986 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:48.151659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21073baa-89fe-475f-89f8-052f431f2986 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:48.152116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21073baa-89fe-475f-89f8-052f431f2986 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:48.153018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21073baa-89fe-475f-89f8-052f431f2986 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:48.153765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21073baa-89fe-475f-89f8-052f431f2986 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:48.154381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21073baa-89fe-475f-89f8-052f431f2986 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:48.286024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f2d874e7-901d-4b19-907a-5fa3d1989a6f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:48.286768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f2d874e7-901d-4b19-907a-5fa3d1989a6f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:48.293509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2d874e7-901d-4b19-907a-5fa3d1989a6f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:48.294008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2d874e7-901d-4b19-907a-5fa3d1989a6f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:48.294453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2d874e7-901d-4b19-907a-5fa3d1989a6f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:48.295173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2d874e7-901d-4b19-907a-5fa3d1989a6f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:48.295682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2d874e7-901d-4b19-907a-5fa3d1989a6f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:48.296118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2d874e7-901d-4b19-907a-5fa3d1989a6f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:48.383613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f2d874e7-901d-4b19-907a-5fa3d1989a6f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:48.392956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f2d874e7-901d-4b19-907a-5fa3d1989a6f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:48.394520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f2d874e7-901d-4b19-907a-5fa3d1989a6f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:48.395886 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f2d874e7-901d-4b19-907a-5fa3d1989a6f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.114127 Oct 04 21:33:48.396564 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2735/5490] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:48 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:33:48.982341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-dc197292-8caf-4398-b696-bc6e8e7e1364 req-b5de50f2-ce2c-4e48-9c35-0b8a3c0048da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b27171c-bb6d-43d4-836d-98fa1c3790d8", "name": "network-vif-unplugged", "status": "completed", "tag": "eaa67688-784e-449d-a04b-3ad12dd87fdc"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:48.993885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-dc197292-8caf-4398-b696-bc6e8e7e1364 req-b5de50f2-ce2c-4e48-9c35-0b8a3c0048da service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:48.994572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-dc197292-8caf-4398-b696-bc6e8e7e1364 req-b5de50f2-ce2c-4e48-9c35-0b8a3c0048da service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:48.995163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-dc197292-8caf-4398-b696-bc6e8e7e1364 req-b5de50f2-ce2c-4e48-9c35-0b8a3c0048da service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:49.018101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.compute.server_external_events [req-dc197292-8caf-4398-b696-bc6e8e7e1364 req-b5de50f2-ce2c-4e48-9c35-0b8a3c0048da service nova] Unable to find a host for instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8. Dropping event network-vif-unplugged {{(pid=122758) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 21:33:49.021633 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-dc197292-8caf-4398-b696-bc6e8e7e1364 req-b5de50f2-ce2c-4e48-9c35-0b8a3c0048da service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040651 Oct 04 21:33:49.021633 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2736/5491] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 04 21:33:49.112494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-346fd5b8-3085-46f8-83a2-3995b600a17c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:49.112903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-346fd5b8-3085-46f8-83a2-3995b600a17c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:49.120085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-346fd5b8-3085-46f8-83a2-3995b600a17c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:49.121357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-346fd5b8-3085-46f8-83a2-3995b600a17c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:49.121841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-346fd5b8-3085-46f8-83a2-3995b600a17c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:49.123762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-346fd5b8-3085-46f8-83a2-3995b600a17c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:49.125688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-346fd5b8-3085-46f8-83a2-3995b600a17c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:49.128070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-346fd5b8-3085-46f8-83a2-3995b600a17c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:49.278655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-346fd5b8-3085-46f8-83a2-3995b600a17c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:49.287047 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-346fd5b8-3085-46f8-83a2-3995b600a17c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1676 microversion: 2.1 time: 0.180513 Oct 04 21:33:49.287638 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2737/5492] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:49 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:49.423173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3c5587c0-1d58-496b-8e66-9e6096d35fee tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:49.423847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3c5587c0-1d58-496b-8e66-9e6096d35fee tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:49.432067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c5587c0-1d58-496b-8e66-9e6096d35fee tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:49.432567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c5587c0-1d58-496b-8e66-9e6096d35fee tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:49.433697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c5587c0-1d58-496b-8e66-9e6096d35fee tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:49.434502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c5587c0-1d58-496b-8e66-9e6096d35fee tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:49.434967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c5587c0-1d58-496b-8e66-9e6096d35fee tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:49.435405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c5587c0-1d58-496b-8e66-9e6096d35fee tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:49.483791 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-21073baa-89fe-475f-89f8-052f431f2986 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "POST /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.360404 Oct 04 21:33:49.484426 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2756/5493] 10.222.0.30 () {62 vars in 1364 bytes} [Tue Oct 4 21:33:48 2022] POST /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments => generated 188 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:33:49.514699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3c5587c0-1d58-496b-8e66-9e6096d35fee tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:49.530372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3c5587c0-1d58-496b-8e66-9e6096d35fee tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:49.532106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3c5587c0-1d58-496b-8e66-9e6096d35fee tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:49.533695 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3c5587c0-1d58-496b-8e66-9e6096d35fee tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.114512 Oct 04 21:33:49.546148 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2738/5494] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:49 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:33:49.673030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f5e25e79-1dc6-4c07-bf9a-34f99e0c1bf4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:49.674861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f5e25e79-1dc6-4c07-bf9a-34f99e0c1bf4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:49.686664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5e25e79-1dc6-4c07-bf9a-34f99e0c1bf4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:49.687160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5e25e79-1dc6-4c07-bf9a-34f99e0c1bf4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:49.687603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5e25e79-1dc6-4c07-bf9a-34f99e0c1bf4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:49.690480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5e25e79-1dc6-4c07-bf9a-34f99e0c1bf4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:49.691135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5e25e79-1dc6-4c07-bf9a-34f99e0c1bf4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:49.691723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5e25e79-1dc6-4c07-bf9a-34f99e0c1bf4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:49.718073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:49.737466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f5e25e79-1dc6-4c07-bf9a-34f99e0c1bf4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122757) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 21:33:50.120374 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f5e25e79-1dc6-4c07-bf9a-34f99e0c1bf4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "POST /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/action" status: 202 len: 0 microversion: 2.20 time: 0.461475 Oct 04 21:33:50.124347 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2757/5495] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Oct 4 21:33:49 2022] POST /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:33:50.129580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f5dd6691-0ef3-47e3-ab24-07d4812cf97d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:50.130324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f5dd6691-0ef3-47e3-ab24-07d4812cf97d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:50.137978 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5dd6691-0ef3-47e3-ab24-07d4812cf97d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:50.138481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5dd6691-0ef3-47e3-ab24-07d4812cf97d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:50.138924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5dd6691-0ef3-47e3-ab24-07d4812cf97d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:50.139627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5dd6691-0ef3-47e3-ab24-07d4812cf97d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:50.140089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5dd6691-0ef3-47e3-ab24-07d4812cf97d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:50.140516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5dd6691-0ef3-47e3-ab24-07d4812cf97d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:50.310445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-52d6a36b-6ba5-495b-a381-2fc850b56094 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:50.310607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f5dd6691-0ef3-47e3-ab24-07d4812cf97d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:50.311092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-52d6a36b-6ba5-495b-a381-2fc850b56094 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:50.312842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:50.322244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f5dd6691-0ef3-47e3-ab24-07d4812cf97d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:50.324527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f5dd6691-0ef3-47e3-ab24-07d4812cf97d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:50.325836 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f5dd6691-0ef3-47e3-ab24-07d4812cf97d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1750 microversion: 2.20 time: 0.200427 Oct 04 21:33:50.326680 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2739/5496] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:50 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1750 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:33:50.335445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52d6a36b-6ba5-495b-a381-2fc850b56094 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:50.335563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52d6a36b-6ba5-495b-a381-2fc850b56094 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:50.335990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52d6a36b-6ba5-495b-a381-2fc850b56094 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:50.336717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52d6a36b-6ba5-495b-a381-2fc850b56094 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:50.337181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52d6a36b-6ba5-495b-a381-2fc850b56094 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:50.337650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52d6a36b-6ba5-495b-a381-2fc850b56094 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:50.522428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-52d6a36b-6ba5-495b-a381-2fc850b56094 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:50.532008 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-52d6a36b-6ba5-495b-a381-2fc850b56094 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1676 microversion: 2.1 time: 0.225486 Oct 04 21:33:50.532869 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2758/5497] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:50 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1676 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:50.567492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fe230b46-dee3-4030-ab8e-940db0e500b8 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:50.568577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fe230b46-dee3-4030-ab8e-940db0e500b8 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:50.576816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe230b46-dee3-4030-ab8e-940db0e500b8 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:50.577330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe230b46-dee3-4030-ab8e-940db0e500b8 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:50.581567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe230b46-dee3-4030-ab8e-940db0e500b8 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:50.581567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe230b46-dee3-4030-ab8e-940db0e500b8 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:50.581567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe230b46-dee3-4030-ab8e-940db0e500b8 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:50.581567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe230b46-dee3-4030-ab8e-940db0e500b8 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:50.668352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fe230b46-dee3-4030-ab8e-940db0e500b8 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:50.680362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fe230b46-dee3-4030-ab8e-940db0e500b8 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:50.683800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fe230b46-dee3-4030-ab8e-940db0e500b8 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:50.685139 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fe230b46-dee3-4030-ab8e-940db0e500b8 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.127208 Oct 04 21:33:50.685771 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2740/5498] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:50 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:51.355759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eac77f80-dd62-4301-86ab-3fcc7e193fd7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:51.356660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eac77f80-dd62-4301-86ab-3fcc7e193fd7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:51.370511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eac77f80-dd62-4301-86ab-3fcc7e193fd7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:51.371007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eac77f80-dd62-4301-86ab-3fcc7e193fd7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:51.371451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eac77f80-dd62-4301-86ab-3fcc7e193fd7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:51.372158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eac77f80-dd62-4301-86ab-3fcc7e193fd7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:51.373129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eac77f80-dd62-4301-86ab-3fcc7e193fd7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:51.375108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eac77f80-dd62-4301-86ab-3fcc7e193fd7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:51.555328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eac77f80-dd62-4301-86ab-3fcc7e193fd7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:51.561042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6e4f33a5-c2fa-4af6-a8dd-e1a8b3bbed15 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:51.562466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6e4f33a5-c2fa-4af6-a8dd-e1a8b3bbed15 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:51.580791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e4f33a5-c2fa-4af6-a8dd-e1a8b3bbed15 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:51.581293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eac77f80-dd62-4301-86ab-3fcc7e193fd7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:51.585139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e4f33a5-c2fa-4af6-a8dd-e1a8b3bbed15 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:51.586615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e4f33a5-c2fa-4af6-a8dd-e1a8b3bbed15 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:51.586963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eac77f80-dd62-4301-86ab-3fcc7e193fd7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:51.588042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e4f33a5-c2fa-4af6-a8dd-e1a8b3bbed15 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:51.590507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e4f33a5-c2fa-4af6-a8dd-e1a8b3bbed15 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:51.591617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e4f33a5-c2fa-4af6-a8dd-e1a8b3bbed15 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:51.591897 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eac77f80-dd62-4301-86ab-3fcc7e193fd7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1750 microversion: 2.20 time: 0.238897 Oct 04 21:33:51.592604 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2759/5499] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:51 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1750 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:51.712980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d51b4708-bc24-4dd3-876f-4891ae9d1495 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:51.715761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d51b4708-bc24-4dd3-876f-4891ae9d1495 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:51.724287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d51b4708-bc24-4dd3-876f-4891ae9d1495 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:51.724893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d51b4708-bc24-4dd3-876f-4891ae9d1495 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:51.725569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d51b4708-bc24-4dd3-876f-4891ae9d1495 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:51.726510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d51b4708-bc24-4dd3-876f-4891ae9d1495 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:51.727084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d51b4708-bc24-4dd3-876f-4891ae9d1495 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:51.728208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d51b4708-bc24-4dd3-876f-4891ae9d1495 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:51.771047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6e4f33a5-c2fa-4af6-a8dd-e1a8b3bbed15 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:51.780370 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6e4f33a5-c2fa-4af6-a8dd-e1a8b3bbed15 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1676 microversion: 2.1 time: 0.227907 Oct 04 21:33:51.781552 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2741/5500] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:51 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1676 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:33:51.827455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d51b4708-bc24-4dd3-876f-4891ae9d1495 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:51.837470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d51b4708-bc24-4dd3-876f-4891ae9d1495 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:51.840071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d51b4708-bc24-4dd3-876f-4891ae9d1495 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:51.843463 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d51b4708-bc24-4dd3-876f-4891ae9d1495 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.133412 Oct 04 21:33:51.857488 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2760/5501] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:51 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:52.625791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c2a2c7f9-1840-4bcc-a95e-6bf3403671ac tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:52.626982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c2a2c7f9-1840-4bcc-a95e-6bf3403671ac tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:52.641555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2a2c7f9-1840-4bcc-a95e-6bf3403671ac tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:52.642279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2a2c7f9-1840-4bcc-a95e-6bf3403671ac tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:52.642888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2a2c7f9-1840-4bcc-a95e-6bf3403671ac tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:52.643749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2a2c7f9-1840-4bcc-a95e-6bf3403671ac tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:52.644349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2a2c7f9-1840-4bcc-a95e-6bf3403671ac tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:52.645121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2a2c7f9-1840-4bcc-a95e-6bf3403671ac tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:52.804539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f22fdf4b-6d59-4012-bd0c-4b641143ed7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:52.805813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f22fdf4b-6d59-4012-bd0c-4b641143ed7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:52.814079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f22fdf4b-6d59-4012-bd0c-4b641143ed7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:52.814780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f22fdf4b-6d59-4012-bd0c-4b641143ed7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:52.815452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f22fdf4b-6d59-4012-bd0c-4b641143ed7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:52.816359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f22fdf4b-6d59-4012-bd0c-4b641143ed7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:52.816972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f22fdf4b-6d59-4012-bd0c-4b641143ed7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:52.817593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f22fdf4b-6d59-4012-bd0c-4b641143ed7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:52.836137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c2a2c7f9-1840-4bcc-a95e-6bf3403671ac tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:52.847628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c2a2c7f9-1840-4bcc-a95e-6bf3403671ac tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:52.850463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c2a2c7f9-1840-4bcc-a95e-6bf3403671ac tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:52.851880 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c2a2c7f9-1840-4bcc-a95e-6bf3403671ac tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1752 microversion: 2.20 time: 0.229966 Oct 04 21:33:52.852709 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2742/5502] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:52 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1752 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:52.874045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a5e5e1eb-7dc1-422c-8d4f-e305e0b4f050 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:52.875351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a5e5e1eb-7dc1-422c-8d4f-e305e0b4f050 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:52.884063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a5e5e1eb-7dc1-422c-8d4f-e305e0b4f050 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:52.884734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a5e5e1eb-7dc1-422c-8d4f-e305e0b4f050 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:52.885291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a5e5e1eb-7dc1-422c-8d4f-e305e0b4f050 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:52.886317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a5e5e1eb-7dc1-422c-8d4f-e305e0b4f050 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:52.887043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a5e5e1eb-7dc1-422c-8d4f-e305e0b4f050 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:52.887550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a5e5e1eb-7dc1-422c-8d4f-e305e0b4f050 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:52.991551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a5e5e1eb-7dc1-422c-8d4f-e305e0b4f050 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:53.005517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a5e5e1eb-7dc1-422c-8d4f-e305e0b4f050 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:53.012362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a5e5e1eb-7dc1-422c-8d4f-e305e0b4f050 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:53.012362 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a5e5e1eb-7dc1-422c-8d4f-e305e0b4f050 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.142239 Oct 04 21:33:53.016598 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2743/5503] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:52 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:53.032859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f22fdf4b-6d59-4012-bd0c-4b641143ed7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:53.045272 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f22fdf4b-6d59-4012-bd0c-4b641143ed7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1676 microversion: 2.1 time: 0.244192 Oct 04 21:33:53.049232 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2761/5504] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:52 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1676 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:53.881639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-089e5295-84c8-4c85-b63f-59a7defe33af tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:53.884003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-089e5295-84c8-4c85-b63f-59a7defe33af tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:53.894241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-089e5295-84c8-4c85-b63f-59a7defe33af tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:53.894923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-089e5295-84c8-4c85-b63f-59a7defe33af tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:53.896017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-089e5295-84c8-4c85-b63f-59a7defe33af tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:53.897267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-089e5295-84c8-4c85-b63f-59a7defe33af tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:53.897994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-089e5295-84c8-4c85-b63f-59a7defe33af tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:53.898721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-089e5295-84c8-4c85-b63f-59a7defe33af tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:54.046326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bbee7dc7-378a-40a1-8167-4638ae3407ce tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:54.047554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bbee7dc7-378a-40a1-8167-4638ae3407ce tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:54.055612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bbee7dc7-378a-40a1-8167-4638ae3407ce tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:54.056336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bbee7dc7-378a-40a1-8167-4638ae3407ce tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:54.056940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bbee7dc7-378a-40a1-8167-4638ae3407ce tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:54.058448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bbee7dc7-378a-40a1-8167-4638ae3407ce tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:54.059123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bbee7dc7-378a-40a1-8167-4638ae3407ce tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:54.060407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bbee7dc7-378a-40a1-8167-4638ae3407ce tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:54.109720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-089e5295-84c8-4c85-b63f-59a7defe33af tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:54.119234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-089e5295-84c8-4c85-b63f-59a7defe33af tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:54.129353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-089e5295-84c8-4c85-b63f-59a7defe33af tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:54.131876 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-089e5295-84c8-4c85-b63f-59a7defe33af tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1752 microversion: 2.20 time: 0.255436 Oct 04 21:33:54.133033 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2744/5505] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:53 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1752 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:54.138901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-86aa96e0-90b8-4c00-b1e0-cfb01bc86ff0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:54.139952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-86aa96e0-90b8-4c00-b1e0-cfb01bc86ff0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:54.142804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bbee7dc7-378a-40a1-8167-4638ae3407ce tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:54.148073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86aa96e0-90b8-4c00-b1e0-cfb01bc86ff0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:54.148863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86aa96e0-90b8-4c00-b1e0-cfb01bc86ff0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:54.149528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86aa96e0-90b8-4c00-b1e0-cfb01bc86ff0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:54.150439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86aa96e0-90b8-4c00-b1e0-cfb01bc86ff0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:54.151107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86aa96e0-90b8-4c00-b1e0-cfb01bc86ff0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:54.151315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bbee7dc7-378a-40a1-8167-4638ae3407ce tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:54.151960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86aa96e0-90b8-4c00-b1e0-cfb01bc86ff0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:54.153201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bbee7dc7-378a-40a1-8167-4638ae3407ce tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:54.154435 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bbee7dc7-378a-40a1-8167-4638ae3407ce tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.112839 Oct 04 21:33:54.164019 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2762/5506] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:54 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:54.329793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-86aa96e0-90b8-4c00-b1e0-cfb01bc86ff0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:54.349071 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-86aa96e0-90b8-4c00-b1e0-cfb01bc86ff0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1676 microversion: 2.1 time: 0.214635 Oct 04 21:33:54.368285 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2745/5507] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:54 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1676 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:55.170761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bb313984-4789-4d79-8630-87127e7fc4cc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:55.171418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bb313984-4789-4d79-8630-87127e7fc4cc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:55.178951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb313984-4789-4d79-8630-87127e7fc4cc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:55.179438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb313984-4789-4d79-8630-87127e7fc4cc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:55.179875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb313984-4789-4d79-8630-87127e7fc4cc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:55.180574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb313984-4789-4d79-8630-87127e7fc4cc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:55.181029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb313984-4789-4d79-8630-87127e7fc4cc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:55.181477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bb313984-4789-4d79-8630-87127e7fc4cc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:55.193024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7bd5ef4a-97ba-438e-af7a-dd8e95ec8a4e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:55.193743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7bd5ef4a-97ba-438e-af7a-dd8e95ec8a4e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:55.201710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bd5ef4a-97ba-438e-af7a-dd8e95ec8a4e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:55.202195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bd5ef4a-97ba-438e-af7a-dd8e95ec8a4e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:55.202860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bd5ef4a-97ba-438e-af7a-dd8e95ec8a4e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:55.204020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bd5ef4a-97ba-438e-af7a-dd8e95ec8a4e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:55.204805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bd5ef4a-97ba-438e-af7a-dd8e95ec8a4e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:55.205450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bd5ef4a-97ba-438e-af7a-dd8e95ec8a4e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:55.299871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7bd5ef4a-97ba-438e-af7a-dd8e95ec8a4e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:55.314041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7bd5ef4a-97ba-438e-af7a-dd8e95ec8a4e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:55.315741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7bd5ef4a-97ba-438e-af7a-dd8e95ec8a4e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:55.317045 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7bd5ef4a-97ba-438e-af7a-dd8e95ec8a4e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.128292 Oct 04 21:33:55.317938 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2746/5508] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:55 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:55.356254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bb313984-4789-4d79-8630-87127e7fc4cc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:55.366656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bb313984-4789-4d79-8630-87127e7fc4cc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:55.368094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bb313984-4789-4d79-8630-87127e7fc4cc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:55.369583 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bb313984-4789-4d79-8630-87127e7fc4cc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1752 microversion: 2.20 time: 0.203248 Oct 04 21:33:55.371350 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2763/5509] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:55 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1752 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:55.379152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-64664919-ca50-441e-afd9-d6a8431db955 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:55.379832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-64664919-ca50-441e-afd9-d6a8431db955 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:55.390445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64664919-ca50-441e-afd9-d6a8431db955 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:55.390954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64664919-ca50-441e-afd9-d6a8431db955 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:55.391391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64664919-ca50-441e-afd9-d6a8431db955 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:55.392764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64664919-ca50-441e-afd9-d6a8431db955 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:55.393221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64664919-ca50-441e-afd9-d6a8431db955 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:55.393676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64664919-ca50-441e-afd9-d6a8431db955 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:55.536619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-64664919-ca50-441e-afd9-d6a8431db955 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:55.551145 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-64664919-ca50-441e-afd9-d6a8431db955 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1653 microversion: 2.1 time: 0.178684 Oct 04 21:33:55.552595 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2747/5510] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:55 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1653 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:55.576603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-79ac24a2-fca3-478a-8fff-d49d843dfcc4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:55.583258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79ac24a2-fca3-478a-8fff-d49d843dfcc4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:55.584465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79ac24a2-fca3-478a-8fff-d49d843dfcc4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:55.584465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79ac24a2-fca3-478a-8fff-d49d843dfcc4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:55.609026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-79ac24a2-fca3-478a-8fff-d49d843dfcc4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Going to try to start instance {{(pid=122757) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 21:33:55.893780 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-79ac24a2-fca3-478a-8fff-d49d843dfcc4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "POST /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4/action" status: 202 len: 0 microversion: 2.1 time: 0.322597 Oct 04 21:33:55.894484 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2764/5511] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:33:55 2022] POST /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:33:55.904350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-33d5b17e-bbc9-4729-8813-15f34c7130d0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:55.905636 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-33d5b17e-bbc9-4729-8813-15f34c7130d0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:55.911243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33d5b17e-bbc9-4729-8813-15f34c7130d0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:55.911751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33d5b17e-bbc9-4729-8813-15f34c7130d0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:55.912197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33d5b17e-bbc9-4729-8813-15f34c7130d0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:55.912902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33d5b17e-bbc9-4729-8813-15f34c7130d0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:55.913365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33d5b17e-bbc9-4729-8813-15f34c7130d0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:55.913859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33d5b17e-bbc9-4729-8813-15f34c7130d0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:56.095614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-33d5b17e-bbc9-4729-8813-15f34c7130d0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:56.105950 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-33d5b17e-bbc9-4729-8813-15f34c7130d0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1662 microversion: 2.1 time: 0.206954 Oct 04 21:33:56.108484 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2748/5512] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:55 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1662 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:56.351396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f3be6d46-f48a-48c2-a983-0018246e249e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:56.352139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f3be6d46-f48a-48c2-a983-0018246e249e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:56.359776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3be6d46-f48a-48c2-a983-0018246e249e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:56.360349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3be6d46-f48a-48c2-a983-0018246e249e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:56.360850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3be6d46-f48a-48c2-a983-0018246e249e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:56.361717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3be6d46-f48a-48c2-a983-0018246e249e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:56.362203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3be6d46-f48a-48c2-a983-0018246e249e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:56.362728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3be6d46-f48a-48c2-a983-0018246e249e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:56.401079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b0b5aa5a-5db6-4a1c-9f7b-ed2962e42042 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:56.402272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b0b5aa5a-5db6-4a1c-9f7b-ed2962e42042 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:56.412412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0b5aa5a-5db6-4a1c-9f7b-ed2962e42042 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:56.413082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0b5aa5a-5db6-4a1c-9f7b-ed2962e42042 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:56.413700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0b5aa5a-5db6-4a1c-9f7b-ed2962e42042 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:56.428511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0b5aa5a-5db6-4a1c-9f7b-ed2962e42042 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:56.429324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0b5aa5a-5db6-4a1c-9f7b-ed2962e42042 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:56.429958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b0b5aa5a-5db6-4a1c-9f7b-ed2962e42042 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:56.503804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f3be6d46-f48a-48c2-a983-0018246e249e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:56.514991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f3be6d46-f48a-48c2-a983-0018246e249e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:56.516510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f3be6d46-f48a-48c2-a983-0018246e249e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:56.517738 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f3be6d46-f48a-48c2-a983-0018246e249e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.171649 Oct 04 21:33:56.518348 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2765/5513] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:56 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:33:56.692502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b0b5aa5a-5db6-4a1c-9f7b-ed2962e42042 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:56.706553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b0b5aa5a-5db6-4a1c-9f7b-ed2962e42042 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:56.708017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b0b5aa5a-5db6-4a1c-9f7b-ed2962e42042 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:56.709230 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b0b5aa5a-5db6-4a1c-9f7b-ed2962e42042 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1752 microversion: 2.20 time: 0.316345 Oct 04 21:33:56.710423 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2749/5514] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:56 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1752 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:33:57.131102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1211b3af-4d16-4432-914d-7b61fc464a7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:57.131984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1211b3af-4d16-4432-914d-7b61fc464a7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:57.143848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1211b3af-4d16-4432-914d-7b61fc464a7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:57.144528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1211b3af-4d16-4432-914d-7b61fc464a7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:57.145394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1211b3af-4d16-4432-914d-7b61fc464a7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:57.146299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1211b3af-4d16-4432-914d-7b61fc464a7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:57.147008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1211b3af-4d16-4432-914d-7b61fc464a7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:57.147572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1211b3af-4d16-4432-914d-7b61fc464a7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:57.544915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f1268f24-fa58-48e9-9fb9-1fadf4c45d73 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:57.545694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f1268f24-fa58-48e9-9fb9-1fadf4c45d73 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:57.554338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1268f24-fa58-48e9-9fb9-1fadf4c45d73 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:57.558467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1268f24-fa58-48e9-9fb9-1fadf4c45d73 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:57.558467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1268f24-fa58-48e9-9fb9-1fadf4c45d73 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:57.558467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1268f24-fa58-48e9-9fb9-1fadf4c45d73 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:57.558467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1268f24-fa58-48e9-9fb9-1fadf4c45d73 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:57.558467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1268f24-fa58-48e9-9fb9-1fadf4c45d73 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:57.663886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f1268f24-fa58-48e9-9fb9-1fadf4c45d73 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:57.676056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1211b3af-4d16-4432-914d-7b61fc464a7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:57.688879 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1211b3af-4d16-4432-914d-7b61fc464a7a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1662 microversion: 2.1 time: 0.561365 Oct 04 21:33:57.725517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f1268f24-fa58-48e9-9fb9-1fadf4c45d73 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:57.725517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f1268f24-fa58-48e9-9fb9-1fadf4c45d73 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:57.725517 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f1268f24-fa58-48e9-9fb9-1fadf4c45d73 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.157439 Oct 04 21:33:57.725517 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2750/5515] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:57 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:33:57.725944 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2766/5516] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:57 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1662 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:57.737483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a98c2d6e-bdc6-4475-9392-2c8234d9f7d8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:57.738429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a98c2d6e-bdc6-4475-9392-2c8234d9f7d8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:57.752560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a98c2d6e-bdc6-4475-9392-2c8234d9f7d8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:57.753216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a98c2d6e-bdc6-4475-9392-2c8234d9f7d8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:57.753727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a98c2d6e-bdc6-4475-9392-2c8234d9f7d8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:57.754531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a98c2d6e-bdc6-4475-9392-2c8234d9f7d8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:57.754941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a98c2d6e-bdc6-4475-9392-2c8234d9f7d8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:57.755398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a98c2d6e-bdc6-4475-9392-2c8234d9f7d8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:57.981482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a98c2d6e-bdc6-4475-9392-2c8234d9f7d8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:57.998705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a98c2d6e-bdc6-4475-9392-2c8234d9f7d8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:58.011126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a98c2d6e-bdc6-4475-9392-2c8234d9f7d8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:58.021170 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a98c2d6e-bdc6-4475-9392-2c8234d9f7d8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1752 microversion: 2.20 time: 0.288321 Oct 04 21:33:58.021654 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2751/5517] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:57 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1752 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:58.714073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2e306d94-4467-4d78-a746-30a6674ca773 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:58.714574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2e306d94-4467-4d78-a746-30a6674ca773 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:58.722083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e306d94-4467-4d78-a746-30a6674ca773 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:58.722576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e306d94-4467-4d78-a746-30a6674ca773 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:58.728229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e306d94-4467-4d78-a746-30a6674ca773 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:58.728229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e306d94-4467-4d78-a746-30a6674ca773 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:58.728229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e306d94-4467-4d78-a746-30a6674ca773 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:58.728229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e306d94-4467-4d78-a746-30a6674ca773 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:58.743686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6db509ed-0f90-4d1e-b8eb-58e882eee5ed tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:58.744672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6db509ed-0f90-4d1e-b8eb-58e882eee5ed tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:58.757183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6db509ed-0f90-4d1e-b8eb-58e882eee5ed tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:58.757713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6db509ed-0f90-4d1e-b8eb-58e882eee5ed tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:58.758248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6db509ed-0f90-4d1e-b8eb-58e882eee5ed tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:58.759019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6db509ed-0f90-4d1e-b8eb-58e882eee5ed tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:58.759711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6db509ed-0f90-4d1e-b8eb-58e882eee5ed tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:58.760076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6db509ed-0f90-4d1e-b8eb-58e882eee5ed tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:58.854408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6db509ed-0f90-4d1e-b8eb-58e882eee5ed tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:58.865303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6db509ed-0f90-4d1e-b8eb-58e882eee5ed tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:58.866795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6db509ed-0f90-4d1e-b8eb-58e882eee5ed tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:58.868142 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6db509ed-0f90-4d1e-b8eb-58e882eee5ed tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1408 microversion: 2.54 time: 0.128424 Oct 04 21:33:58.868912 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2752/5518] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:58 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1408 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:58.897876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2e306d94-4467-4d78-a746-30a6674ca773 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:58.907945 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2e306d94-4467-4d78-a746-30a6674ca773 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1666 microversion: 2.1 time: 0.197006 Oct 04 21:33:58.908891 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2767/5519] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:58 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1666 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:59.048599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-84cb7552-45e1-4a25-90a8-e7a6a6b953e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:59.049330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-84cb7552-45e1-4a25-90a8-e7a6a6b953e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:59.055618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84cb7552-45e1-4a25-90a8-e7a6a6b953e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:59.056118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84cb7552-45e1-4a25-90a8-e7a6a6b953e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:59.056561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84cb7552-45e1-4a25-90a8-e7a6a6b953e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:59.057268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84cb7552-45e1-4a25-90a8-e7a6a6b953e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:59.057762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84cb7552-45e1-4a25-90a8-e7a6a6b953e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:59.058199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84cb7552-45e1-4a25-90a8-e7a6a6b953e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:59.220722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-84cb7552-45e1-4a25-90a8-e7a6a6b953e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:59.236096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-84cb7552-45e1-4a25-90a8-e7a6a6b953e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:59.238597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-84cb7552-45e1-4a25-90a8-e7a6a6b953e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:59.240807 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-84cb7552-45e1-4a25-90a8-e7a6a6b953e6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1752 microversion: 2.20 time: 0.196194 Oct 04 21:33:59.241516 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2753/5520] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:59 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1752 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:33:59.895090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3d971e5e-ba47-4880-9cbf-7fa6e65d54f1 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:59.895804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3d971e5e-ba47-4880-9cbf-7fa6e65d54f1 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:59.903835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d971e5e-ba47-4880-9cbf-7fa6e65d54f1 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:59.904615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d971e5e-ba47-4880-9cbf-7fa6e65d54f1 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:59.905300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d971e5e-ba47-4880-9cbf-7fa6e65d54f1 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:59.906450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d971e5e-ba47-4880-9cbf-7fa6e65d54f1 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:59.907476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d971e5e-ba47-4880-9cbf-7fa6e65d54f1 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:59.907963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d971e5e-ba47-4880-9cbf-7fa6e65d54f1 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:59.975406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3d971e5e-ba47-4880-9cbf-7fa6e65d54f1 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:59.985085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3d971e5e-ba47-4880-9cbf-7fa6e65d54f1 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:59.986782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3d971e5e-ba47-4880-9cbf-7fa6e65d54f1 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:59.988050 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3d971e5e-ba47-4880-9cbf-7fa6e65d54f1 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1414 microversion: 2.54 time: 0.097490 Oct 04 21:33:59.988622 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2768/5521] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:33:59 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:00.266920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c0d314df-7036-4172-9409-90f4177b6d88 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:00.267554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c0d314df-7036-4172-9409-90f4177b6d88 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:00.270307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=86 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:00.276243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0d314df-7036-4172-9409-90f4177b6d88 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:00.276743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0d314df-7036-4172-9409-90f4177b6d88 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:00.277196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0d314df-7036-4172-9409-90f4177b6d88 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:00.277933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0d314df-7036-4172-9409-90f4177b6d88 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:00.278392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0d314df-7036-4172-9409-90f4177b6d88 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:00.278864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0d314df-7036-4172-9409-90f4177b6d88 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:00.620170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c0d314df-7036-4172-9409-90f4177b6d88 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:00.630453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c0d314df-7036-4172-9409-90f4177b6d88 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:00.641610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c0d314df-7036-4172-9409-90f4177b6d88 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:00.641610 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c0d314df-7036-4172-9409-90f4177b6d88 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1752 microversion: 2.20 time: 0.370079 Oct 04 21:34:00.641610 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2754/5522] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:00 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1752 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:01.016807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a5f56141-cd5f-4911-b978-64ec920f7b28 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:01.017686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a5f56141-cd5f-4911-b978-64ec920f7b28 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:01.020707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:01.025816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5f56141-cd5f-4911-b978-64ec920f7b28 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:01.026928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5f56141-cd5f-4911-b978-64ec920f7b28 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:01.027524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5f56141-cd5f-4911-b978-64ec920f7b28 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:01.028448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5f56141-cd5f-4911-b978-64ec920f7b28 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:01.028982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5f56141-cd5f-4911-b978-64ec920f7b28 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:01.029524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5f56141-cd5f-4911-b978-64ec920f7b28 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:01.103493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a5f56141-cd5f-4911-b978-64ec920f7b28 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:01.113625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a5f56141-cd5f-4911-b978-64ec920f7b28 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:01.115218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a5f56141-cd5f-4911-b978-64ec920f7b28 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:01.116487 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a5f56141-cd5f-4911-b978-64ec920f7b28 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1414 microversion: 2.54 time: 0.103782 Oct 04 21:34:01.117755 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2769/5523] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:01 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:01.664681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0d98a885-ef40-4baa-8dea-1210a911a464 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:01.665311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0d98a885-ef40-4baa-8dea-1210a911a464 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:01.687196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d98a885-ef40-4baa-8dea-1210a911a464 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:01.688023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d98a885-ef40-4baa-8dea-1210a911a464 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:01.689150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d98a885-ef40-4baa-8dea-1210a911a464 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:01.690732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d98a885-ef40-4baa-8dea-1210a911a464 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:01.691552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d98a885-ef40-4baa-8dea-1210a911a464 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:01.692211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d98a885-ef40-4baa-8dea-1210a911a464 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:01.954615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0d98a885-ef40-4baa-8dea-1210a911a464 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:01.963822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0d98a885-ef40-4baa-8dea-1210a911a464 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:01.965264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0d98a885-ef40-4baa-8dea-1210a911a464 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:01.966572 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0d98a885-ef40-4baa-8dea-1210a911a464 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1752 microversion: 2.20 time: 0.305980 Oct 04 21:34:01.967042 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2755/5524] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:01 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1752 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:02.144367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-01d65df3-b49e-441f-8004-4154798eca1c tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:02.145604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-01d65df3-b49e-441f-8004-4154798eca1c tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:02.152525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01d65df3-b49e-441f-8004-4154798eca1c tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:02.153238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01d65df3-b49e-441f-8004-4154798eca1c tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:02.153850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01d65df3-b49e-441f-8004-4154798eca1c tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:02.154796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01d65df3-b49e-441f-8004-4154798eca1c tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:02.155395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01d65df3-b49e-441f-8004-4154798eca1c tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:02.155968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01d65df3-b49e-441f-8004-4154798eca1c tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:02.287824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-01d65df3-b49e-441f-8004-4154798eca1c tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:02.298528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-01d65df3-b49e-441f-8004-4154798eca1c tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:02.300210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-01d65df3-b49e-441f-8004-4154798eca1c tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:02.302171 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-01d65df3-b49e-441f-8004-4154798eca1c tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1399 microversion: 2.54 time: 0.161483 Oct 04 21:34:02.302349 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2770/5525] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:02 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1399 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:34:02.329534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ec83b19a-69ad-4cb0-82db-7805d12efdb1 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '.version_select at 0x7f578b6088b0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:02.473015 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ec83b19a-69ad-4cb0-82db-7805d12efdb1 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-380488003" status: 204 len: 0 microversion: 2.54 time: 0.148418 Oct 04 21:34:02.474836 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2756/5526] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Oct 4 21:34:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-380488003 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:34:02.492657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-74a5e1ec-13f4-4f74-9874-e6e1e7cabf00 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:02.493393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-74a5e1ec-13f4-4f74-9874-e6e1e7cabf00 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:02.500204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74a5e1ec-13f4-4f74-9874-e6e1e7cabf00 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:02.500905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74a5e1ec-13f4-4f74-9874-e6e1e7cabf00 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:02.501524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74a5e1ec-13f4-4f74-9874-e6e1e7cabf00 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:02.503817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74a5e1ec-13f4-4f74-9874-e6e1e7cabf00 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:02.503817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74a5e1ec-13f4-4f74-9874-e6e1e7cabf00 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:02.508200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74a5e1ec-13f4-4f74-9874-e6e1e7cabf00 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:02.569880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-74a5e1ec-13f4-4f74-9874-e6e1e7cabf00 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:34:02.585034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:02.993924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-57f4c80a-3048-45de-ab7d-0f0dbab7f30a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:02.994810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-57f4c80a-3048-45de-ab7d-0f0dbab7f30a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:03.007170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57f4c80a-3048-45de-ab7d-0f0dbab7f30a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:03.009246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57f4c80a-3048-45de-ab7d-0f0dbab7f30a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:03.009246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57f4c80a-3048-45de-ab7d-0f0dbab7f30a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:03.009246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57f4c80a-3048-45de-ab7d-0f0dbab7f30a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:03.009707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57f4c80a-3048-45de-ab7d-0f0dbab7f30a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:03.010252 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57f4c80a-3048-45de-ab7d-0f0dbab7f30a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:03.027308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:03.036522 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-74a5e1ec-13f4-4f74-9874-e6e1e7cabf00 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "DELETE /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 204 len: 0 microversion: 2.54 time: 0.547851 Oct 04 21:34:03.037796 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2771/5527] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:34:02 2022] DELETE /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:34:03.048679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b443b035-d7e8-4ef3-bffe-38b0dee3a05f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:03.050335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b443b035-d7e8-4ef3-bffe-38b0dee3a05f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:03.059808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b443b035-d7e8-4ef3-bffe-38b0dee3a05f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:03.060539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b443b035-d7e8-4ef3-bffe-38b0dee3a05f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:03.061261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b443b035-d7e8-4ef3-bffe-38b0dee3a05f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:03.062244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b443b035-d7e8-4ef3-bffe-38b0dee3a05f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:03.062817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b443b035-d7e8-4ef3-bffe-38b0dee3a05f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:03.063379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b443b035-d7e8-4ef3-bffe-38b0dee3a05f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:03.270595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b443b035-d7e8-4ef3-bffe-38b0dee3a05f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:03.279822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b443b035-d7e8-4ef3-bffe-38b0dee3a05f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:03.281551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b443b035-d7e8-4ef3-bffe-38b0dee3a05f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:03.283235 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b443b035-d7e8-4ef3-bffe-38b0dee3a05f tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1405 microversion: 2.54 time: 0.240327 Oct 04 21:34:03.283888 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2772/5528] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:03 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1405 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:34:03.524375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-57f4c80a-3048-45de-ab7d-0f0dbab7f30a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:03.554510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-57f4c80a-3048-45de-ab7d-0f0dbab7f30a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:03.559475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-57f4c80a-3048-45de-ab7d-0f0dbab7f30a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:03.560707 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-57f4c80a-3048-45de-ab7d-0f0dbab7f30a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1808 microversion: 2.20 time: 0.572248 Oct 04 21:34:03.561777 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2757/5529] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:02 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1808 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:04.312936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d4d234cf-3413-4f94-8b93-21cc712b757e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:04.313718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d4d234cf-3413-4f94-8b93-21cc712b757e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:04.321570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4d234cf-3413-4f94-8b93-21cc712b757e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:04.322061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4d234cf-3413-4f94-8b93-21cc712b757e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:04.322506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4d234cf-3413-4f94-8b93-21cc712b757e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:04.323539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4d234cf-3413-4f94-8b93-21cc712b757e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:04.324140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4d234cf-3413-4f94-8b93-21cc712b757e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:04.324579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4d234cf-3413-4f94-8b93-21cc712b757e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:04.392308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d4d234cf-3413-4f94-8b93-21cc712b757e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:04.404393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d4d234cf-3413-4f94-8b93-21cc712b757e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:04.407355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d4d234cf-3413-4f94-8b93-21cc712b757e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:04.408423 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d4d234cf-3413-4f94-8b93-21cc712b757e tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1405 microversion: 2.54 time: 0.102086 Oct 04 21:34:04.408992 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2773/5530] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:04 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1405 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:04.587541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-905e95ed-0992-45fe-807a-f5c3cdd15c30 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:04.588154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-905e95ed-0992-45fe-807a-f5c3cdd15c30 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:04.596555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-905e95ed-0992-45fe-807a-f5c3cdd15c30 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:04.597009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-905e95ed-0992-45fe-807a-f5c3cdd15c30 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:04.597463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-905e95ed-0992-45fe-807a-f5c3cdd15c30 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:04.598328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-905e95ed-0992-45fe-807a-f5c3cdd15c30 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:04.598963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-905e95ed-0992-45fe-807a-f5c3cdd15c30 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:04.599390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-905e95ed-0992-45fe-807a-f5c3cdd15c30 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:04.788024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-905e95ed-0992-45fe-807a-f5c3cdd15c30 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:04.801160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-905e95ed-0992-45fe-807a-f5c3cdd15c30 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:04.801160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-905e95ed-0992-45fe-807a-f5c3cdd15c30 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:04.804965 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-905e95ed-0992-45fe-807a-f5c3cdd15c30 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1808 microversion: 2.20 time: 0.217831 Oct 04 21:34:04.804965 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2758/5531] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:04 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:05.440552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9c403444-e5de-4dfb-ac0d-5c25b26945df tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:05.441215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9c403444-e5de-4dfb-ac0d-5c25b26945df tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:05.450834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c403444-e5de-4dfb-ac0d-5c25b26945df tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:05.451791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c403444-e5de-4dfb-ac0d-5c25b26945df tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:05.452402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c403444-e5de-4dfb-ac0d-5c25b26945df tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:05.454496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c403444-e5de-4dfb-ac0d-5c25b26945df tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:05.455156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c403444-e5de-4dfb-ac0d-5c25b26945df tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:05.455743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c403444-e5de-4dfb-ac0d-5c25b26945df tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:05.563092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c403444-e5de-4dfb-ac0d-5c25b26945df tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:05.564353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c403444-e5de-4dfb-ac0d-5c25b26945df tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:05.564836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c403444-e5de-4dfb-ac0d-5c25b26945df tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:05.565343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-9c403444-e5de-4dfb-ac0d-5c25b26945df tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lazy-loading 'fault' on Instance uuid 300a78b6-08f4-47b5-a6e5-912ca65f5581 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:34:05.664400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9c403444-e5de-4dfb-ac0d-5c25b26945df tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:05.675577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9c403444-e5de-4dfb-ac0d-5c25b26945df tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:05.677057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9c403444-e5de-4dfb-ac0d-5c25b26945df tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f7648ce64494efdaf3029d4201dabf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb17355d0e643b1bc1c410b014ee101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:05.678687 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9c403444-e5de-4dfb-ac0d-5c25b26945df tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 200 len: 1410 microversion: 2.54 time: 0.243019 Oct 04 21:34:05.696855 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2774/5532] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:05 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 1410 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:05.828672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-40b05710-2199-41a5-a599-4b3c5704a73c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:05.835610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-40b05710-2199-41a5-a599-4b3c5704a73c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:05.858381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40b05710-2199-41a5-a599-4b3c5704a73c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:05.860545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40b05710-2199-41a5-a599-4b3c5704a73c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:05.870585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40b05710-2199-41a5-a599-4b3c5704a73c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:05.870585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40b05710-2199-41a5-a599-4b3c5704a73c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:05.870585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40b05710-2199-41a5-a599-4b3c5704a73c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:05.870585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-40b05710-2199-41a5-a599-4b3c5704a73c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:06.184013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-40b05710-2199-41a5-a599-4b3c5704a73c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:06.214891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-40b05710-2199-41a5-a599-4b3c5704a73c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:06.222658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-40b05710-2199-41a5-a599-4b3c5704a73c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:06.232411 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-40b05710-2199-41a5-a599-4b3c5704a73c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1808 microversion: 2.20 time: 0.409509 Oct 04 21:34:06.233857 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2759/5533] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:05 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1808 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:06.710504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d99f22a4-e04f-475b-bc50-8ac013617526 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:06.711792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d99f22a4-e04f-475b-bc50-8ac013617526 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] [instance: 300a78b6-08f4-47b5-a6e5-912ca65f5581] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:06.720754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d99f22a4-e04f-475b-bc50-8ac013617526 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:06.721774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d99f22a4-e04f-475b-bc50-8ac013617526 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:06.722704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d99f22a4-e04f-475b-bc50-8ac013617526 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:06.723581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d99f22a4-e04f-475b-bc50-8ac013617526 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:06.724391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d99f22a4-e04f-475b-bc50-8ac013617526 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:06.725016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d99f22a4-e04f-475b-bc50-8ac013617526 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:06.743407 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-d99f22a4-e04f-475b-bc50-8ac013617526 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] HTTP exception thrown: Instance 300a78b6-08f4-47b5-a6e5-912ca65f5581 could not be found. Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d99f22a4-e04f-475b-bc50-8ac013617526 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Request method failure captured: Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 HTTP/1.1 Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKajC2SnTz2NO0SdvP6-bi6TUrNdMfH5yMLNVFEWcHriIF54bEBBSiRNzIe0feleLh-bH8A7sEgwtYLAVcU67QrXnXEGXCPC3lJEhLJeJQPbLf-ohQEOvpII7ZjA6qkbBS3IhvOcxYjquXicGvSojUxpX36rXEdd_Vs8SxXyMrGLJIE Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.54 Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 2cb17355d0e643b1bc1c410b014ee101 Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerShowV254Test-564610466 Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2cb17355d0e643b1bc1c410b014ee101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2cb17355d0e643b1bc1c410b014ee101"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2cb17355d0e643b1bc1c410b014ee101"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2cb17355d0e643b1bc1c410b014ee101"}]}] Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerShowV254Test-564610466 Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 2cb17355d0e643b1bc1c410b014ee101 Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerShowV254Test-564610466 Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerShowV254Test-564610466-project Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 8f7648ce64494efdaf3029d4201dabf0 Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerShowV254Test-564610466-project Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 300a78b6-08f4-47b5-a6e5-912ca65f5581 could not be found. Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '300a78b6-08f4-47b5-a6e5-912ca65f5581'} Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 300a78b6-08f4-47b5-a6e5-912ca65f5581 could not be found. Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 300a78b6-08f4-47b5-a6e5-912ca65f5581 could not be found. Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:06.746090 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:06.749919 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:06.749919 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:06.749919 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:06.749919 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:34:06.749919 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:34:06.749919 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 300a78b6-08f4-47b5-a6e5-912ca65f5581 could not be found. Oct 04 21:34:06.749919 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:06.751340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d99f22a4-e04f-475b-bc50-8ac013617526 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] Returning 404 to user: Instance 300a78b6-08f4-47b5-a6e5-912ca65f5581 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:34:06.752409 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d99f22a4-e04f-475b-bc50-8ac013617526 tempest-ServerShowV254Test-564610466 tempest-ServerShowV254Test-564610466-project] 10.222.0.30 "GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581" status: 404 len: 111 microversion: 2.54 time: 0.046725 Oct 04 21:34:06.756791 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2775/5534] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:06 2022] GET /compute/v2.1/servers/300a78b6-08f4-47b5-a6e5-912ca65f5581 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:34:07.261109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cfbdcb2f-c2d2-43c1-bb09-8f85895154c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:07.265437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cfbdcb2f-c2d2-43c1-bb09-8f85895154c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:07.274700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfbdcb2f-c2d2-43c1-bb09-8f85895154c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:07.275992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfbdcb2f-c2d2-43c1-bb09-8f85895154c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:07.277788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfbdcb2f-c2d2-43c1-bb09-8f85895154c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:07.278938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfbdcb2f-c2d2-43c1-bb09-8f85895154c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:07.279736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfbdcb2f-c2d2-43c1-bb09-8f85895154c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:07.280454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfbdcb2f-c2d2-43c1-bb09-8f85895154c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:07.644157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cfbdcb2f-c2d2-43c1-bb09-8f85895154c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:07.655953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cfbdcb2f-c2d2-43c1-bb09-8f85895154c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:07.664854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cfbdcb2f-c2d2-43c1-bb09-8f85895154c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:07.664854 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cfbdcb2f-c2d2-43c1-bb09-8f85895154c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1808 microversion: 2.20 time: 0.403972 Oct 04 21:34:07.664854 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2760/5535] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:07 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1808 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:08.699424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a13b0f2d-3576-4345-b271-5f133e087f03 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:08.700980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a13b0f2d-3576-4345-b271-5f133e087f03 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:08.710690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a13b0f2d-3576-4345-b271-5f133e087f03 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:08.711180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a13b0f2d-3576-4345-b271-5f133e087f03 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:08.711651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a13b0f2d-3576-4345-b271-5f133e087f03 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:08.712523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a13b0f2d-3576-4345-b271-5f133e087f03 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:08.712982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a13b0f2d-3576-4345-b271-5f133e087f03 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:08.718202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a13b0f2d-3576-4345-b271-5f133e087f03 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:08.923801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a13b0f2d-3576-4345-b271-5f133e087f03 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:08.938454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a13b0f2d-3576-4345-b271-5f133e087f03 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:08.940280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a13b0f2d-3576-4345-b271-5f133e087f03 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:08.948000 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a13b0f2d-3576-4345-b271-5f133e087f03 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1808 microversion: 2.20 time: 0.252963 Oct 04 21:34:08.948000 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2776/5536] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:08 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1808 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:09.976570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-39ebc59b-4475-42da-a61c-96ccbe6a4b9f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:09.977195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-39ebc59b-4475-42da-a61c-96ccbe6a4b9f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:09.989015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39ebc59b-4475-42da-a61c-96ccbe6a4b9f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:09.991242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39ebc59b-4475-42da-a61c-96ccbe6a4b9f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:09.994193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39ebc59b-4475-42da-a61c-96ccbe6a4b9f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:09.995736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39ebc59b-4475-42da-a61c-96ccbe6a4b9f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:09.997144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39ebc59b-4475-42da-a61c-96ccbe6a4b9f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:10.000450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39ebc59b-4475-42da-a61c-96ccbe6a4b9f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:10.291131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-39ebc59b-4475-42da-a61c-96ccbe6a4b9f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:10.301269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-39ebc59b-4475-42da-a61c-96ccbe6a4b9f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:10.304967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-39ebc59b-4475-42da-a61c-96ccbe6a4b9f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:10.306425 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-39ebc59b-4475-42da-a61c-96ccbe6a4b9f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1808 microversion: 2.20 time: 0.335201 Oct 04 21:34:10.307711 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2761/5537] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:09 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1808 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:11.332924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3bc1808d-de85-43d3-a121-4d430bb4ece9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:11.334551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3bc1808d-de85-43d3-a121-4d430bb4ece9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:11.343319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bc1808d-de85-43d3-a121-4d430bb4ece9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:11.344390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bc1808d-de85-43d3-a121-4d430bb4ece9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:11.345071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bc1808d-de85-43d3-a121-4d430bb4ece9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:11.346439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bc1808d-de85-43d3-a121-4d430bb4ece9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:11.347381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bc1808d-de85-43d3-a121-4d430bb4ece9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:11.348066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bc1808d-de85-43d3-a121-4d430bb4ece9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:11.538549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3bc1808d-de85-43d3-a121-4d430bb4ece9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:11.558263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3bc1808d-de85-43d3-a121-4d430bb4ece9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:11.566817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3bc1808d-de85-43d3-a121-4d430bb4ece9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:11.568577 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3bc1808d-de85-43d3-a121-4d430bb4ece9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1808 microversion: 2.20 time: 0.239962 Oct 04 21:34:11.600198 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2777/5538] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:11 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1808 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:12.607732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cacc225b-b7ec-45a0-b2f9-ddd0ccb52839 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:12.608482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cacc225b-b7ec-45a0-b2f9-ddd0ccb52839 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:12.618144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cacc225b-b7ec-45a0-b2f9-ddd0ccb52839 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:12.629606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cacc225b-b7ec-45a0-b2f9-ddd0ccb52839 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:12.631111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cacc225b-b7ec-45a0-b2f9-ddd0ccb52839 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:12.632641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cacc225b-b7ec-45a0-b2f9-ddd0ccb52839 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:12.633337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cacc225b-b7ec-45a0-b2f9-ddd0ccb52839 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:12.634482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cacc225b-b7ec-45a0-b2f9-ddd0ccb52839 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:12.858191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cacc225b-b7ec-45a0-b2f9-ddd0ccb52839 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:12.870265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cacc225b-b7ec-45a0-b2f9-ddd0ccb52839 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:12.872503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cacc225b-b7ec-45a0-b2f9-ddd0ccb52839 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:12.874117 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cacc225b-b7ec-45a0-b2f9-ddd0ccb52839 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1808 microversion: 2.20 time: 0.272058 Oct 04 21:34:12.902021 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2762/5539] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:12 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1808 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:13.907569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-53fdaab8-382f-4d04-b9d5-05f9ed9e6ad4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:13.908287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-53fdaab8-382f-4d04-b9d5-05f9ed9e6ad4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:13.919851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53fdaab8-382f-4d04-b9d5-05f9ed9e6ad4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:13.920349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53fdaab8-382f-4d04-b9d5-05f9ed9e6ad4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:13.920980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53fdaab8-382f-4d04-b9d5-05f9ed9e6ad4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:13.922198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53fdaab8-382f-4d04-b9d5-05f9ed9e6ad4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:13.922806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53fdaab8-382f-4d04-b9d5-05f9ed9e6ad4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:13.923485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53fdaab8-382f-4d04-b9d5-05f9ed9e6ad4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:14.183097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-53fdaab8-382f-4d04-b9d5-05f9ed9e6ad4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:14.193491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-53fdaab8-382f-4d04-b9d5-05f9ed9e6ad4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:14.200402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-53fdaab8-382f-4d04-b9d5-05f9ed9e6ad4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:14.200402 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-53fdaab8-382f-4d04-b9d5-05f9ed9e6ad4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1808 microversion: 2.20 time: 0.293402 Oct 04 21:34:14.210655 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2778/5540] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:13 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1808 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:15.237406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bc07332a-9a2b-485e-8ad6-745c89aa230f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:15.238794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bc07332a-9a2b-485e-8ad6-745c89aa230f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:15.285551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc07332a-9a2b-485e-8ad6-745c89aa230f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:15.287112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc07332a-9a2b-485e-8ad6-745c89aa230f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:15.305053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc07332a-9a2b-485e-8ad6-745c89aa230f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:15.311593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc07332a-9a2b-485e-8ad6-745c89aa230f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:15.312699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc07332a-9a2b-485e-8ad6-745c89aa230f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:15.314196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc07332a-9a2b-485e-8ad6-745c89aa230f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:15.992725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bc07332a-9a2b-485e-8ad6-745c89aa230f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:16.002598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bc07332a-9a2b-485e-8ad6-745c89aa230f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:16.004731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bc07332a-9a2b-485e-8ad6-745c89aa230f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:16.007953 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bc07332a-9a2b-485e-8ad6-745c89aa230f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1808 microversion: 2.20 time: 0.785240 Oct 04 21:34:16.023845 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2763/5541] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:15 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1808 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:17.038210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3a4677d3-e3a8-4cad-9174-59aabecf7397 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:17.038870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3a4677d3-e3a8-4cad-9174-59aabecf7397 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:17.051981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a4677d3-e3a8-4cad-9174-59aabecf7397 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:17.060046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a4677d3-e3a8-4cad-9174-59aabecf7397 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:17.060313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a4677d3-e3a8-4cad-9174-59aabecf7397 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:17.061794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a4677d3-e3a8-4cad-9174-59aabecf7397 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:17.062267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a4677d3-e3a8-4cad-9174-59aabecf7397 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:17.062697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a4677d3-e3a8-4cad-9174-59aabecf7397 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:17.387959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3a4677d3-e3a8-4cad-9174-59aabecf7397 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:17.402442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3a4677d3-e3a8-4cad-9174-59aabecf7397 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:17.405056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3a4677d3-e3a8-4cad-9174-59aabecf7397 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:17.407800 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3a4677d3-e3a8-4cad-9174-59aabecf7397 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1808 microversion: 2.20 time: 0.374815 Oct 04 21:34:17.433814 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2779/5542] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:17 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1808 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:18.295182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-55609e1d-47c5-4d8f-8765-339afe6cd200 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Action: 'create', calling method: .version_select at 0x7f578add7670>, body: {"keypair": {"name": "tempest-keypair-333072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbVYTvzi/gSJT2cKcaguGPCVJiMpzJdByL42VI8AhMtWQ/hixtiaTlRQEAzq9GEpVU3smS/+fgXWjw2esqb69bQOBJO46wTJF24lRKrwnLvTP1o7Hv+XLRx+q4zl+O1RQ=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:18.311423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-55609e1d-47c5-4d8f-8765-339afe6cd200 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Getting quotas for project f7a12e438f0e4e9a83b0ab95f50c791c. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:34:18.321662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-55609e1d-47c5-4d8f-8765-339afe6cd200 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Getting quotas for user 68a2203c15fe41d8ae410f31ba1e1301 and project f7a12e438f0e4e9a83b0ab95f50c791c. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:34:18.447090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4d4cc3f9-6aea-4a00-b6ee-aeff73eb3906 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:18.447090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4d4cc3f9-6aea-4a00-b6ee-aeff73eb3906 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:18.447090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d4cc3f9-6aea-4a00-b6ee-aeff73eb3906 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:18.447090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d4cc3f9-6aea-4a00-b6ee-aeff73eb3906 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:18.447090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d4cc3f9-6aea-4a00-b6ee-aeff73eb3906 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:18.447090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d4cc3f9-6aea-4a00-b6ee-aeff73eb3906 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:18.447090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d4cc3f9-6aea-4a00-b6ee-aeff73eb3906 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:18.447090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d4cc3f9-6aea-4a00-b6ee-aeff73eb3906 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:18.468917 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-55609e1d-47c5-4d8f-8765-339afe6cd200 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.299522 Oct 04 21:34:18.469809 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2764/5543] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:34:18 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:18.643095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4d4cc3f9-6aea-4a00-b6ee-aeff73eb3906 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:18.656917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4d4cc3f9-6aea-4a00-b6ee-aeff73eb3906 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:18.656917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4d4cc3f9-6aea-4a00-b6ee-aeff73eb3906 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:18.658385 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4d4cc3f9-6aea-4a00-b6ee-aeff73eb3906 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1808 microversion: 2.20 time: 0.225171 Oct 04 21:34:18.659263 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2780/5544] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:18 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:19.689558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-309dc665-cf27-465b-b147-6ee39497820e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:19.690274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-309dc665-cf27-465b-b147-6ee39497820e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:19.699976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-309dc665-cf27-465b-b147-6ee39497820e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:19.700493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-309dc665-cf27-465b-b147-6ee39497820e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:19.707852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-309dc665-cf27-465b-b147-6ee39497820e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:19.707852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-309dc665-cf27-465b-b147-6ee39497820e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:19.707852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-309dc665-cf27-465b-b147-6ee39497820e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:19.707852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-309dc665-cf27-465b-b147-6ee39497820e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:19.951576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-309dc665-cf27-465b-b147-6ee39497820e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:19.963689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-309dc665-cf27-465b-b147-6ee39497820e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:19.966009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-309dc665-cf27-465b-b147-6ee39497820e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:19.967317 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-309dc665-cf27-465b-b147-6ee39497820e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1808 microversion: 2.20 time: 0.286804 Oct 04 21:34:19.967993 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2765/5545] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:19 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:20.374919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1a115d0b-237b-43c5-8201-439d3efb5740 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:20.375426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1a115d0b-237b-43c5-8201-439d3efb5740 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:20.382812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a115d0b-237b-43c5-8201-439d3efb5740 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:20.383552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a115d0b-237b-43c5-8201-439d3efb5740 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:20.384729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a115d0b-237b-43c5-8201-439d3efb5740 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:20.386436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a115d0b-237b-43c5-8201-439d3efb5740 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:20.387043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a115d0b-237b-43c5-8201-439d3efb5740 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:20.387632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a115d0b-237b-43c5-8201-439d3efb5740 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:20.436895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1a115d0b-237b-43c5-8201-439d3efb5740 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:34:20.894868 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1a115d0b-237b-43c5-8201-439d3efb5740 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "DELETE /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 204 len: 0 microversion: 2.42 time: 0.523589 Oct 04 21:34:20.895728 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2781/5546] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:34:20 2022] DELETE /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 21:34:20.905555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-108d1f46-922b-44f4-a47a-cb02dca59406 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:20.905994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-108d1f46-922b-44f4-a47a-cb02dca59406 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:20.921165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-108d1f46-922b-44f4-a47a-cb02dca59406 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:20.921714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-108d1f46-922b-44f4-a47a-cb02dca59406 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:20.922166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-108d1f46-922b-44f4-a47a-cb02dca59406 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:20.923090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-108d1f46-922b-44f4-a47a-cb02dca59406 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:20.923753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-108d1f46-922b-44f4-a47a-cb02dca59406 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:20.924199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-108d1f46-922b-44f4-a47a-cb02dca59406 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:20.995957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-578436a4-fe17-48ad-b0ec-1e71856af2b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:20.996954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-578436a4-fe17-48ad-b0ec-1e71856af2b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:21.005009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-578436a4-fe17-48ad-b0ec-1e71856af2b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:21.006157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-578436a4-fe17-48ad-b0ec-1e71856af2b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:21.007053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-578436a4-fe17-48ad-b0ec-1e71856af2b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:21.008041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-578436a4-fe17-48ad-b0ec-1e71856af2b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:21.008754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-578436a4-fe17-48ad-b0ec-1e71856af2b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:21.010425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-578436a4-fe17-48ad-b0ec-1e71856af2b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:21.308324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-108d1f46-922b-44f4-a47a-cb02dca59406 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:21.327457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-108d1f46-922b-44f4-a47a-cb02dca59406 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:21.331319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-108d1f46-922b-44f4-a47a-cb02dca59406 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:21.331900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-578436a4-fe17-48ad-b0ec-1e71856af2b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:21.335726 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-108d1f46-922b-44f4-a47a-cb02dca59406 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 2951 microversion: 2.42 time: 0.435209 Oct 04 21:34:21.337331 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2766/5547] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:20 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 2951 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:21.342403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-578436a4-fe17-48ad-b0ec-1e71856af2b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:21.350533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-578436a4-fe17-48ad-b0ec-1e71856af2b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:21.356085 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-578436a4-fe17-48ad-b0ec-1e71856af2b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1808 microversion: 2.20 time: 0.361349 Oct 04 21:34:21.356085 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2782/5548] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:20 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1808 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:21.420359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7be78595-6b3a-4f22-9cf7-fca3ac0026af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1305930125", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "105a9abe-09eb-4bdd-87f3-fda198194481"}], "security_groups": [{"name": "tempest-securitygroup--2062616281"}], "key_name": "tempest-keypair-333072", "user_data": "}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:21.546154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-7be78595-6b3a-4f22-9cf7-fca3ac0026af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] validate_networks() for [('105a9abe-09eb-4bdd-87f3-fda198194481', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:34:22.039051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7be78595-6b3a-4f22-9cf7-fca3ac0026af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:34:22.039627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7be78595-6b3a-4f22-9cf7-fca3ac0026af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:34:22.040029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7be78595-6b3a-4f22-9cf7-fca3ac0026af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:34:22.041341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7be78595-6b3a-4f22-9cf7-fca3ac0026af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:34:22.041341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-7be78595-6b3a-4f22-9cf7-fca3ac0026af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:34:22.050362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7be78595-6b3a-4f22-9cf7-fca3ac0026af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:22.050855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7be78595-6b3a-4f22-9cf7-fca3ac0026af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:22.051404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7be78595-6b3a-4f22-9cf7-fca3ac0026af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:22.052158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7be78595-6b3a-4f22-9cf7-fca3ac0026af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:22.052619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7be78595-6b3a-4f22-9cf7-fca3ac0026af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:22.053050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7be78595-6b3a-4f22-9cf7-fca3ac0026af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:22.070668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7be78595-6b3a-4f22-9cf7-fca3ac0026af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Getting quotas for project f7a12e438f0e4e9a83b0ab95f50c791c. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:34:22.076638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-7be78595-6b3a-4f22-9cf7-fca3ac0026af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Getting quotas for user 68a2203c15fe41d8ae410f31ba1e1301 and project f7a12e438f0e4e9a83b0ab95f50c791c. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:34:22.089362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7be78595-6b3a-4f22-9cf7-fca3ac0026af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:34:22.091713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7be78595-6b3a-4f22-9cf7-fca3ac0026af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:34:22.256876 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7be78595-6b3a-4f22-9cf7-fca3ac0026af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.840937 Oct 04 21:34:22.258330 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2767/5549] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:34:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:34:22.269106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7d5ff746-f2ed-4402-a7e7-fddaff5744e7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:22.282565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7d5ff746-f2ed-4402-a7e7-fddaff5744e7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:22.344973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7d5ff746-f2ed-4402-a7e7-fddaff5744e7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:22.352337 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7d5ff746-f2ed-4402-a7e7-fddaff5744e7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 200 len: 1238 microversion: 2.1 time: 0.087041 Oct 04 21:34:22.354090 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2783/5550] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:22 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:22.400712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-786f9c63-a224-4fd1-8a20-99a26adec097 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:22.401466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-786f9c63-a224-4fd1-8a20-99a26adec097 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:22.414333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-786f9c63-a224-4fd1-8a20-99a26adec097 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:22.414994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-786f9c63-a224-4fd1-8a20-99a26adec097 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:22.415487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-786f9c63-a224-4fd1-8a20-99a26adec097 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:22.416972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-786f9c63-a224-4fd1-8a20-99a26adec097 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:22.417647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-786f9c63-a224-4fd1-8a20-99a26adec097 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:22.418085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-786f9c63-a224-4fd1-8a20-99a26adec097 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:22.433614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-95a6ca2d-edb3-42ec-96dc-1f82ac87f659 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:22.434585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-95a6ca2d-edb3-42ec-96dc-1f82ac87f659 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:22.444478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95a6ca2d-edb3-42ec-96dc-1f82ac87f659 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:22.446250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95a6ca2d-edb3-42ec-96dc-1f82ac87f659 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:22.446722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95a6ca2d-edb3-42ec-96dc-1f82ac87f659 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:22.447452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95a6ca2d-edb3-42ec-96dc-1f82ac87f659 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:22.447920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95a6ca2d-edb3-42ec-96dc-1f82ac87f659 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:22.449472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95a6ca2d-edb3-42ec-96dc-1f82ac87f659 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:22.778772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-786f9c63-a224-4fd1-8a20-99a26adec097 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:22.788811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-786f9c63-a224-4fd1-8a20-99a26adec097 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:22.790541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-786f9c63-a224-4fd1-8a20-99a26adec097 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:22.792912 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-786f9c63-a224-4fd1-8a20-99a26adec097 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1808 microversion: 2.20 time: 0.399367 Oct 04 21:34:22.794107 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2768/5551] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:22 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1808 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:34:22.800020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ddfc8975-a28c-4638-9636-e72499bde443 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:22.802031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ddfc8975-a28c-4638-9636-e72499bde443 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:22.807363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddfc8975-a28c-4638-9636-e72499bde443 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:22.808034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddfc8975-a28c-4638-9636-e72499bde443 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:22.808630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddfc8975-a28c-4638-9636-e72499bde443 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:22.809535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddfc8975-a28c-4638-9636-e72499bde443 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:22.810143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddfc8975-a28c-4638-9636-e72499bde443 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:22.810724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddfc8975-a28c-4638-9636-e72499bde443 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:22.816038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-95a6ca2d-edb3-42ec-96dc-1f82ac87f659 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:22.830767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-95a6ca2d-edb3-42ec-96dc-1f82ac87f659 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:22.832423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-95a6ca2d-edb3-42ec-96dc-1f82ac87f659 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:22.833980 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-95a6ca2d-edb3-42ec-96dc-1f82ac87f659 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 2951 microversion: 2.42 time: 0.422574 Oct 04 21:34:22.835080 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2784/5552] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:22 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 2951 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:22.930100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-ddfc8975-a28c-4638-9636-e72499bde443 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lazy-loading 'services' on Instance uuid 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:34:23.166913 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ddfc8975-a28c-4638-9636-e72499bde443 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa/os-volume_attachments/9655fa30-406f-4450-87cd-1729a62d2bf3" status: 202 len: 0 microversion: 2.1 time: 0.370933 Oct 04 21:34:23.179411 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2769/5553] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 21:34:22 2022] DELETE /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa/os-volume_attachments/9655fa30-406f-4450-87cd-1729a62d2bf3 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:34:23.376967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-724815d1-cc85-4cb4-9e73-e117de4e06b7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:23.377811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-724815d1-cc85-4cb4-9e73-e117de4e06b7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:23.435841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-724815d1-cc85-4cb4-9e73-e117de4e06b7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:23.442829 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-724815d1-cc85-4cb4-9e73-e117de4e06b7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 200 len: 1238 microversion: 2.1 time: 0.070435 Oct 04 21:34:23.443405 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2785/5554] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:23 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:23.820343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dd0b793e-9dba-4799-aa0a-bf8fa7dbd62c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:23.821022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dd0b793e-9dba-4799-aa0a-bf8fa7dbd62c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:23.827804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd0b793e-9dba-4799-aa0a-bf8fa7dbd62c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:23.828294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd0b793e-9dba-4799-aa0a-bf8fa7dbd62c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:23.828778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd0b793e-9dba-4799-aa0a-bf8fa7dbd62c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:23.829515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd0b793e-9dba-4799-aa0a-bf8fa7dbd62c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:23.829987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd0b793e-9dba-4799-aa0a-bf8fa7dbd62c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:23.830422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd0b793e-9dba-4799-aa0a-bf8fa7dbd62c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:23.864352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-22b35f2b-8718-4e6b-be31-ccea58d6b2e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:23.865145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-22b35f2b-8718-4e6b-be31-ccea58d6b2e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:23.883235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22b35f2b-8718-4e6b-be31-ccea58d6b2e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:23.883740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22b35f2b-8718-4e6b-be31-ccea58d6b2e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:23.884184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22b35f2b-8718-4e6b-be31-ccea58d6b2e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:23.885088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22b35f2b-8718-4e6b-be31-ccea58d6b2e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:23.885693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22b35f2b-8718-4e6b-be31-ccea58d6b2e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:23.886122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-22b35f2b-8718-4e6b-be31-ccea58d6b2e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:24.038252 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dd0b793e-9dba-4799-aa0a-bf8fa7dbd62c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:24.049453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dd0b793e-9dba-4799-aa0a-bf8fa7dbd62c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:24.050979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dd0b793e-9dba-4799-aa0a-bf8fa7dbd62c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:24.052196 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dd0b793e-9dba-4799-aa0a-bf8fa7dbd62c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1808 microversion: 2.20 time: 0.236833 Oct 04 21:34:24.065245 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2770/5555] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:23 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:24.159658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-22b35f2b-8718-4e6b-be31-ccea58d6b2e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:24.184782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-22b35f2b-8718-4e6b-be31-ccea58d6b2e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:24.186694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-22b35f2b-8718-4e6b-be31-ccea58d6b2e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:24.189710 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-22b35f2b-8718-4e6b-be31-ccea58d6b2e3 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 2951 microversion: 2.42 time: 0.330179 Oct 04 21:34:24.190539 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2786/5556] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:23 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 2951 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:24.467350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c0ca3b7a-6de8-4727-b98a-bf6ab4240569 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:24.468279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c0ca3b7a-6de8-4727-b98a-bf6ab4240569 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:24.475657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0ca3b7a-6de8-4727-b98a-bf6ab4240569 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:24.476531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0ca3b7a-6de8-4727-b98a-bf6ab4240569 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:24.477218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0ca3b7a-6de8-4727-b98a-bf6ab4240569 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:24.479272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0ca3b7a-6de8-4727-b98a-bf6ab4240569 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:24.479944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0ca3b7a-6de8-4727-b98a-bf6ab4240569 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:24.480540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c0ca3b7a-6de8-4727-b98a-bf6ab4240569 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:24.585407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c0ca3b7a-6de8-4727-b98a-bf6ab4240569 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:24.597290 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c0ca3b7a-6de8-4727-b98a-bf6ab4240569 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 200 len: 1290 microversion: 2.1 time: 0.134703 Oct 04 21:34:24.598017 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2771/5557] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:24 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 1290 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:25.089661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8c33cbda-ebe7-4562-929b-9496fbd4c2df tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:25.090704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8c33cbda-ebe7-4562-929b-9496fbd4c2df tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:25.108933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c33cbda-ebe7-4562-929b-9496fbd4c2df tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:25.110360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c33cbda-ebe7-4562-929b-9496fbd4c2df tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:25.112229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c33cbda-ebe7-4562-929b-9496fbd4c2df tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:25.113102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c33cbda-ebe7-4562-929b-9496fbd4c2df tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:25.114013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c33cbda-ebe7-4562-929b-9496fbd4c2df tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:25.114701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c33cbda-ebe7-4562-929b-9496fbd4c2df tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:25.221876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fb855526-86d8-4d30-82c4-97d9ae652b74 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:25.236636 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fb855526-86d8-4d30-82c4-97d9ae652b74 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:25.263397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb855526-86d8-4d30-82c4-97d9ae652b74 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:25.266969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb855526-86d8-4d30-82c4-97d9ae652b74 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:25.268021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb855526-86d8-4d30-82c4-97d9ae652b74 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:25.271381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb855526-86d8-4d30-82c4-97d9ae652b74 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:25.273144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb855526-86d8-4d30-82c4-97d9ae652b74 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:25.274337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb855526-86d8-4d30-82c4-97d9ae652b74 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:25.805341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8c33cbda-ebe7-4562-929b-9496fbd4c2df tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:25.808244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:25.820045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8c33cbda-ebe7-4562-929b-9496fbd4c2df tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:25.821999 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8c33cbda-ebe7-4562-929b-9496fbd4c2df tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:25.827037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fb855526-86d8-4d30-82c4-97d9ae652b74 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:25.837093 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8c33cbda-ebe7-4562-929b-9496fbd4c2df tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1808 microversion: 2.20 time: 0.741955 Oct 04 21:34:25.839802 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2787/5558] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:25 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1808 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:25.847674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fb855526-86d8-4d30-82c4-97d9ae652b74 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:25.851219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fb855526-86d8-4d30-82c4-97d9ae652b74 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:25.854323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-5caae7d1-8770-40d8-a195-a0bd2e5f53df req-75fd6f41-e709-416d-b613-2ebda8a42cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b27171c-bb6d-43d4-836d-98fa1c3790d8", "name": "network-vif-plugged", "status": "completed", "tag": "eaa67688-784e-449d-a04b-3ad12dd87fdc"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:25.858075 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fb855526-86d8-4d30-82c4-97d9ae652b74 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 2951 microversion: 2.42 time: 0.642206 Oct 04 21:34:25.879418 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2772/5559] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:25 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 2951 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:25.898709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-33e56720-7297-469c-9173-18e25d8aa481 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:25.903255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-33e56720-7297-469c-9173-18e25d8aa481 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:25.910959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-5caae7d1-8770-40d8-a195-a0bd2e5f53df req-75fd6f41-e709-416d-b613-2ebda8a42cc8 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:25.911458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-5caae7d1-8770-40d8-a195-a0bd2e5f53df req-75fd6f41-e709-416d-b613-2ebda8a42cc8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:25.913888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-5caae7d1-8770-40d8-a195-a0bd2e5f53df req-75fd6f41-e709-416d-b613-2ebda8a42cc8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:25.920078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33e56720-7297-469c-9173-18e25d8aa481 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:25.920859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33e56720-7297-469c-9173-18e25d8aa481 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:25.921506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33e56720-7297-469c-9173-18e25d8aa481 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:25.922501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33e56720-7297-469c-9173-18e25d8aa481 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:25.924265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33e56720-7297-469c-9173-18e25d8aa481 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:25.924859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33e56720-7297-469c-9173-18e25d8aa481 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:25.944572 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-5caae7d1-8770-40d8-a195-a0bd2e5f53df req-75fd6f41-e709-416d-b613-2ebda8a42cc8 service nova] Creating event network-vif-plugged:eaa67688-784e-449d-a04b-3ad12dd87fdc for instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 on n-h1-860282-1 Oct 04 21:34:25.957203 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-5caae7d1-8770-40d8-a195-a0bd2e5f53df req-75fd6f41-e709-416d-b613-2ebda8a42cc8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115759 Oct 04 21:34:25.965564 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2788/5560] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:26.064650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-33e56720-7297-469c-9173-18e25d8aa481 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:26.080669 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-33e56720-7297-469c-9173-18e25d8aa481 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 200 len: 1296 microversion: 2.1 time: 0.199207 Oct 04 21:34:26.093640 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2773/5561] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:25 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 1296 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:26.873218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-89cf7bb9-664f-4048-bc90-202f543ef054 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:26.874669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-89cf7bb9-664f-4048-bc90-202f543ef054 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:26.894462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89cf7bb9-664f-4048-bc90-202f543ef054 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:26.895208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89cf7bb9-664f-4048-bc90-202f543ef054 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:26.895799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89cf7bb9-664f-4048-bc90-202f543ef054 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:26.896674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89cf7bb9-664f-4048-bc90-202f543ef054 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:26.897288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89cf7bb9-664f-4048-bc90-202f543ef054 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:26.897895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-89cf7bb9-664f-4048-bc90-202f543ef054 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:26.909124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b5fb7ede-7641-41c4-a2dc-da56ed85c3ea tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:26.909889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b5fb7ede-7641-41c4-a2dc-da56ed85c3ea tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:26.929729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5fb7ede-7641-41c4-a2dc-da56ed85c3ea tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:26.930324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5fb7ede-7641-41c4-a2dc-da56ed85c3ea tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:26.934187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5fb7ede-7641-41c4-a2dc-da56ed85c3ea tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:26.935138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5fb7ede-7641-41c4-a2dc-da56ed85c3ea tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:26.936133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5fb7ede-7641-41c4-a2dc-da56ed85c3ea tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:26.937659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5fb7ede-7641-41c4-a2dc-da56ed85c3ea tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:27.438187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-89cf7bb9-664f-4048-bc90-202f543ef054 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:27.452773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-89cf7bb9-664f-4048-bc90-202f543ef054 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:27.458576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-89cf7bb9-664f-4048-bc90-202f543ef054 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:27.461715 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-89cf7bb9-664f-4048-bc90-202f543ef054 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1808 microversion: 2.20 time: 0.595441 Oct 04 21:34:27.464151 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2789/5562] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:26 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1808 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:27.469774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ac56d857-3bf8-437a-b3d4-7d5f4ba87cc4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:27.473201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ac56d857-3bf8-437a-b3d4-7d5f4ba87cc4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:27.482445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b5fb7ede-7641-41c4-a2dc-da56ed85c3ea tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:27.494870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac56d857-3bf8-437a-b3d4-7d5f4ba87cc4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:27.495352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac56d857-3bf8-437a-b3d4-7d5f4ba87cc4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:27.495991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac56d857-3bf8-437a-b3d4-7d5f4ba87cc4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:27.496933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac56d857-3bf8-437a-b3d4-7d5f4ba87cc4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:27.497963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac56d857-3bf8-437a-b3d4-7d5f4ba87cc4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:27.498612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac56d857-3bf8-437a-b3d4-7d5f4ba87cc4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:27.512087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b5fb7ede-7641-41c4-a2dc-da56ed85c3ea tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:27.513899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b5fb7ede-7641-41c4-a2dc-da56ed85c3ea tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:27.515228 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b5fb7ede-7641-41c4-a2dc-da56ed85c3ea tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 2930 microversion: 2.42 time: 0.620258 Oct 04 21:34:27.520945 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2774/5563] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:26 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 2930 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:27.984990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-fd6520a3-7df3-4806-8084-28576f7b8e86 req-2942a6f7-6da8-47eb-abf9-4a0251128640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "name": "network-vif-unplugged", "status": "completed", "tag": "ce41b261-1a55-4261-a0af-98d834d3178a"}, {"server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "name": "network-vif-unplugged", "status": "completed", "tag": "7be12e96-c1eb-431c-880c-1656a2d42226"}, {"server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "name": "network-vif-unplugged", "status": "completed", "tag": "02286074-41e4-4d16-8a7a-59c1ece211dc"}, {"server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "name": "network-vif-unplugged", "status": "completed", "tag": "462dd518-2956-4aa9-94c8-c6a32d3a0b42"}, {"server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "name": "network-vif-unplugged", "status": "completed", "tag": "3f36f0e8-027a-49e9-b359-7053dd5e96b7"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:27.999238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-fd6520a3-7df3-4806-8084-28576f7b8e86 req-2942a6f7-6da8-47eb-abf9-4a0251128640 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:27.999959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-fd6520a3-7df3-4806-8084-28576f7b8e86 req-2942a6f7-6da8-47eb-abf9-4a0251128640 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:28.000552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-fd6520a3-7df3-4806-8084-28576f7b8e86 req-2942a6f7-6da8-47eb-abf9-4a0251128640 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:28.004988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:28.015124 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-fd6520a3-7df3-4806-8084-28576f7b8e86 req-2942a6f7-6da8-47eb-abf9-4a0251128640 service nova] Creating event network-vif-unplugged:ce41b261-1a55-4261-a0af-98d834d3178a for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:34:28.025687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ac56d857-3bf8-437a-b3d4-7d5f4ba87cc4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:28.026653 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-fd6520a3-7df3-4806-8084-28576f7b8e86 req-2942a6f7-6da8-47eb-abf9-4a0251128640 service nova] Creating event network-vif-unplugged:7be12e96-c1eb-431c-880c-1656a2d42226 for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:34:28.031852 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-fd6520a3-7df3-4806-8084-28576f7b8e86 req-2942a6f7-6da8-47eb-abf9-4a0251128640 service nova] Creating event network-vif-unplugged:02286074-41e4-4d16-8a7a-59c1ece211dc for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:34:28.032571 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-fd6520a3-7df3-4806-8084-28576f7b8e86 req-2942a6f7-6da8-47eb-abf9-4a0251128640 service nova] Creating event network-vif-unplugged:462dd518-2956-4aa9-94c8-c6a32d3a0b42 for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:34:28.033386 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-fd6520a3-7df3-4806-8084-28576f7b8e86 req-2942a6f7-6da8-47eb-abf9-4a0251128640 service nova] Creating event network-vif-unplugged:3f36f0e8-027a-49e9-b359-7053dd5e96b7 for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:34:28.033919 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ac56d857-3bf8-437a-b3d4-7d5f4ba87cc4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 200 len: 1364 microversion: 2.1 time: 0.566418 Oct 04 21:34:28.034705 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2790/5564] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:27 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 1364 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:28.040698 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-fd6520a3-7df3-4806-8084-28576f7b8e86 req-2942a6f7-6da8-47eb-abf9-4a0251128640 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.059330 Oct 04 21:34:28.041544 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2775/5565] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:34:28.491152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-264114ca-fa38-4eb9-9820-d1d15c94cfae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:28.492169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-264114ca-fa38-4eb9-9820-d1d15c94cfae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:28.503776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-264114ca-fa38-4eb9-9820-d1d15c94cfae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:28.503776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-264114ca-fa38-4eb9-9820-d1d15c94cfae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:28.504573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-264114ca-fa38-4eb9-9820-d1d15c94cfae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:28.506200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-264114ca-fa38-4eb9-9820-d1d15c94cfae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:28.506904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-264114ca-fa38-4eb9-9820-d1d15c94cfae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:28.507581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-264114ca-fa38-4eb9-9820-d1d15c94cfae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:28.580085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f937be07-2cf9-441c-9dc4-48c4f728b85e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:28.583201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f937be07-2cf9-441c-9dc4-48c4f728b85e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:28.597616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f937be07-2cf9-441c-9dc4-48c4f728b85e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:28.599507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f937be07-2cf9-441c-9dc4-48c4f728b85e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:28.602555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f937be07-2cf9-441c-9dc4-48c4f728b85e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:28.605844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f937be07-2cf9-441c-9dc4-48c4f728b85e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:28.606582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f937be07-2cf9-441c-9dc4-48c4f728b85e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:28.607335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f937be07-2cf9-441c-9dc4-48c4f728b85e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:28.943455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-264114ca-fa38-4eb9-9820-d1d15c94cfae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:28.956378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-264114ca-fa38-4eb9-9820-d1d15c94cfae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:28.959058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-264114ca-fa38-4eb9-9820-d1d15c94cfae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:28.968494 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-264114ca-fa38-4eb9-9820-d1d15c94cfae tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1808 microversion: 2.20 time: 0.481490 Oct 04 21:34:28.980034 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2791/5566] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:28 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1808 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:28.994647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-83a070f6-3291-452f-b469-5a481afc3844 req-1bc0ace6-4a56-4b3a-8cb4-bb40fcb2ded7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "name": "network-vif-deleted", "tag": "02286074-41e4-4d16-8a7a-59c1ece211dc"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:29.004982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-83a070f6-3291-452f-b469-5a481afc3844 req-1bc0ace6-4a56-4b3a-8cb4-bb40fcb2ded7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:29.005739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-83a070f6-3291-452f-b469-5a481afc3844 req-1bc0ace6-4a56-4b3a-8cb4-bb40fcb2ded7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:29.012438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-83a070f6-3291-452f-b469-5a481afc3844 req-1bc0ace6-4a56-4b3a-8cb4-bb40fcb2ded7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:29.036360 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-83a070f6-3291-452f-b469-5a481afc3844 req-1bc0ace6-4a56-4b3a-8cb4-bb40fcb2ded7 service nova] Creating event network-vif-deleted:02286074-41e4-4d16-8a7a-59c1ece211dc for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:34:29.045502 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-83a070f6-3291-452f-b469-5a481afc3844 req-1bc0ace6-4a56-4b3a-8cb4-bb40fcb2ded7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054301 Oct 04 21:34:29.046632 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2792/5567] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:29.066454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8f04d4ab-80f5-4d35-a520-6340c5d1e772 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:29.067960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8f04d4ab-80f5-4d35-a520-6340c5d1e772 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:29.077652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f04d4ab-80f5-4d35-a520-6340c5d1e772 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:29.078736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f04d4ab-80f5-4d35-a520-6340c5d1e772 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:29.079196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f04d4ab-80f5-4d35-a520-6340c5d1e772 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:29.079921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f04d4ab-80f5-4d35-a520-6340c5d1e772 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:29.080550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f04d4ab-80f5-4d35-a520-6340c5d1e772 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:29.081138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f04d4ab-80f5-4d35-a520-6340c5d1e772 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:29.166366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f937be07-2cf9-441c-9dc4-48c4f728b85e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:29.181867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f937be07-2cf9-441c-9dc4-48c4f728b85e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:29.189016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f937be07-2cf9-441c-9dc4-48c4f728b85e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:29.191880 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f937be07-2cf9-441c-9dc4-48c4f728b85e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 2864 microversion: 2.42 time: 0.637996 Oct 04 21:34:29.193843 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2776/5568] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:28 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 2864 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:29.340482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c74a79d4-76ae-4fa6-bb8a-515efce8ee9e tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:29.341496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c74a79d4-76ae-4fa6-bb8a-515efce8ee9e tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:29.348944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c74a79d4-76ae-4fa6-bb8a-515efce8ee9e tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:29.354956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c74a79d4-76ae-4fa6-bb8a-515efce8ee9e tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:29.354956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c74a79d4-76ae-4fa6-bb8a-515efce8ee9e tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:29.354956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c74a79d4-76ae-4fa6-bb8a-515efce8ee9e tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:29.354956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c74a79d4-76ae-4fa6-bb8a-515efce8ee9e tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:29.354956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c74a79d4-76ae-4fa6-bb8a-515efce8ee9e tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:29.383420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c74a79d4-76ae-4fa6-bb8a-515efce8ee9e tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:34:29.465551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8f04d4ab-80f5-4d35-a520-6340c5d1e772 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:29.473506 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8f04d4ab-80f5-4d35-a520-6340c5d1e772 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 200 len: 1364 microversion: 2.1 time: 0.412250 Oct 04 21:34:29.474175 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2793/5569] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:29 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 1364 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:29.727919 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c74a79d4-76ae-4fa6-bb8a-515efce8ee9e tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa" status: 204 len: 0 microversion: 2.1 time: 0.391632 Oct 04 21:34:29.729218 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2777/5570] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:34:29 2022] DELETE /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:34:29.738236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e96fa92c-c554-4436-9f31-13f4205036ee tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:29.738863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e96fa92c-c554-4436-9f31-13f4205036ee tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:29.746402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e96fa92c-c554-4436-9f31-13f4205036ee tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:29.746987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e96fa92c-c554-4436-9f31-13f4205036ee tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:29.747537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e96fa92c-c554-4436-9f31-13f4205036ee tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:29.748301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e96fa92c-c554-4436-9f31-13f4205036ee tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:29.748796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e96fa92c-c554-4436-9f31-13f4205036ee tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:29.749235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e96fa92c-c554-4436-9f31-13f4205036ee tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:29.998511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4a6c0a93-db80-4a29-a0c6-9b92437611e1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:30.000057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4a6c0a93-db80-4a29-a0c6-9b92437611e1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:30.006510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a6c0a93-db80-4a29-a0c6-9b92437611e1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:30.007005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a6c0a93-db80-4a29-a0c6-9b92437611e1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:30.007449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a6c0a93-db80-4a29-a0c6-9b92437611e1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:30.008150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a6c0a93-db80-4a29-a0c6-9b92437611e1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:30.008607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a6c0a93-db80-4a29-a0c6-9b92437611e1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:30.009037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a6c0a93-db80-4a29-a0c6-9b92437611e1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:30.036860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e96fa92c-c554-4436-9f31-13f4205036ee tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39736b6b74749d5a0ce5f5e79ce0c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cb61f8190c492d8946116e6e296a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:30.046367 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e96fa92c-c554-4436-9f31-13f4205036ee tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa" status: 200 len: 1468 microversion: 2.1 time: 0.312010 Oct 04 21:34:30.046984 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2794/5571] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:29 2022] GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa => generated 1468 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:30.223866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-230b1b22-da65-49c5-b22f-af23331d70a8 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:30.225247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-230b1b22-da65-49c5-b22f-af23331d70a8 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:30.237596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-230b1b22-da65-49c5-b22f-af23331d70a8 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:30.238363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-230b1b22-da65-49c5-b22f-af23331d70a8 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:30.238971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-230b1b22-da65-49c5-b22f-af23331d70a8 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:30.239696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-230b1b22-da65-49c5-b22f-af23331d70a8 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:30.240318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-230b1b22-da65-49c5-b22f-af23331d70a8 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:30.240753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-230b1b22-da65-49c5-b22f-af23331d70a8 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:30.636816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4a6c0a93-db80-4a29-a0c6-9b92437611e1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:30.646073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4a6c0a93-db80-4a29-a0c6-9b92437611e1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:30.647574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4a6c0a93-db80-4a29-a0c6-9b92437611e1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:30.648757 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4a6c0a93-db80-4a29-a0c6-9b92437611e1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1795 microversion: 2.20 time: 0.654588 Oct 04 21:34:30.657052 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2778/5572] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:29 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1795 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:34:30.657052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a19c047a-fc1e-4485-a776-77fedd0fa563 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:30.657052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a19c047a-fc1e-4485-a776-77fedd0fa563 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:30.661908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:30.664730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a19c047a-fc1e-4485-a776-77fedd0fa563 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:30.665217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a19c047a-fc1e-4485-a776-77fedd0fa563 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:30.665682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a19c047a-fc1e-4485-a776-77fedd0fa563 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:30.666386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a19c047a-fc1e-4485-a776-77fedd0fa563 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:30.666838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a19c047a-fc1e-4485-a776-77fedd0fa563 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:30.667257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a19c047a-fc1e-4485-a776-77fedd0fa563 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:30.849756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-230b1b22-da65-49c5-b22f-af23331d70a8 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:30.859545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-230b1b22-da65-49c5-b22f-af23331d70a8 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:30.861039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-230b1b22-da65-49c5-b22f-af23331d70a8 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:30.862339 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-230b1b22-da65-49c5-b22f-af23331d70a8 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 2705 microversion: 2.42 time: 0.642671 Oct 04 21:34:30.877445 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2795/5573] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:30 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 2705 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:34:30.940386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a19c047a-fc1e-4485-a776-77fedd0fa563 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:30.948950 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a19c047a-fc1e-4485-a776-77fedd0fa563 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 200 len: 1364 microversion: 2.1 time: 0.297514 Oct 04 21:34:30.949538 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2779/5574] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:30 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 1364 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:31.063364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-81225b40-5cad-4d87-aa20-2f4d4bb35dd3 req-ea1c1ed3-a299-4101-a1ec-d4c2b8cf44f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60148f18-dd52-4a9a-8d23-12cb5ebbd7c4", "tag": "1c4a8457-2b84-4180-8f0c-4097c6670f56"}, {"server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "name": "network-vif-deleted", "tag": "462dd518-2956-4aa9-94c8-c6a32d3a0b42"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:31.069094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-24a7dad0-e759-431e-8386-5d42b2c89bd7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:31.069747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-24a7dad0-e759-431e-8386-5d42b2c89bd7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:31.076057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-81225b40-5cad-4d87-aa20-2f4d4bb35dd3 req-ea1c1ed3-a299-4101-a1ec-d4c2b8cf44f3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:31.076543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-81225b40-5cad-4d87-aa20-2f4d4bb35dd3 req-ea1c1ed3-a299-4101-a1ec-d4c2b8cf44f3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:31.076982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-81225b40-5cad-4d87-aa20-2f4d4bb35dd3 req-ea1c1ed3-a299-4101-a1ec-d4c2b8cf44f3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:31.078132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24a7dad0-e759-431e-8386-5d42b2c89bd7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:31.078715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24a7dad0-e759-431e-8386-5d42b2c89bd7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:31.079239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24a7dad0-e759-431e-8386-5d42b2c89bd7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:31.080107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24a7dad0-e759-431e-8386-5d42b2c89bd7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:31.080583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24a7dad0-e759-431e-8386-5d42b2c89bd7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:31.081181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24a7dad0-e759-431e-8386-5d42b2c89bd7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:31.091379 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-81225b40-5cad-4d87-aa20-2f4d4bb35dd3 req-ea1c1ed3-a299-4101-a1ec-d4c2b8cf44f3 service nova] Creating event network-changed:1c4a8457-2b84-4180-8f0c-4097c6670f56 for instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 on n-h1-860282-1 Oct 04 21:34:31.091901 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-81225b40-5cad-4d87-aa20-2f4d4bb35dd3 req-ea1c1ed3-a299-4101-a1ec-d4c2b8cf44f3 service nova] Creating event network-vif-deleted:462dd518-2956-4aa9-94c8-c6a32d3a0b42 for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:34:31.101724 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-81225b40-5cad-4d87-aa20-2f4d4bb35dd3 req-ea1c1ed3-a299-4101-a1ec-d4c2b8cf44f3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.040987 Oct 04 21:34:31.101724 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2796/5575] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:31.435892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-24a7dad0-e759-431e-8386-5d42b2c89bd7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39736b6b74749d5a0ce5f5e79ce0c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cb61f8190c492d8946116e6e296a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:31.447377 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-24a7dad0-e759-431e-8386-5d42b2c89bd7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa" status: 200 len: 1468 microversion: 2.1 time: 0.381875 Oct 04 21:34:31.448905 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2780/5576] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:31 2022] GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa => generated 1468 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:34:31.884121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-44da1edf-daeb-45f7-8582-3e3cf9c86156 req-4f30b302-469a-4317-aa47-ac39c704eddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa", "name": "network-vif-deleted", "tag": "ce872974-527c-4b60-8abb-787c79c9180b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:31.892847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-79117475-74d6-49f6-b0ca-2ceb4f1a6f32 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:31.894441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-79117475-74d6-49f6-b0ca-2ceb4f1a6f32 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:31.902395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79117475-74d6-49f6-b0ca-2ceb4f1a6f32 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:31.903192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79117475-74d6-49f6-b0ca-2ceb4f1a6f32 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:31.904151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79117475-74d6-49f6-b0ca-2ceb4f1a6f32 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:31.905170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79117475-74d6-49f6-b0ca-2ceb4f1a6f32 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:31.905819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79117475-74d6-49f6-b0ca-2ceb4f1a6f32 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:31.906854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79117475-74d6-49f6-b0ca-2ceb4f1a6f32 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:31.909225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-44da1edf-daeb-45f7-8582-3e3cf9c86156 req-4f30b302-469a-4317-aa47-ac39c704eddf service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:31.909748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-44da1edf-daeb-45f7-8582-3e3cf9c86156 req-4f30b302-469a-4317-aa47-ac39c704eddf service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:31.910185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-44da1edf-daeb-45f7-8582-3e3cf9c86156 req-4f30b302-469a-4317-aa47-ac39c704eddf service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:31.930083 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-44da1edf-daeb-45f7-8582-3e3cf9c86156 req-4f30b302-469a-4317-aa47-ac39c704eddf service nova] Creating event network-vif-deleted:ce872974-527c-4b60-8abb-787c79c9180b for instance 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa on n-h1-860282-1 Oct 04 21:34:31.937379 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-44da1edf-daeb-45f7-8582-3e3cf9c86156 req-4f30b302-469a-4317-aa47-ac39c704eddf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162624 Oct 04 21:34:31.943402 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2797/5577] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:31.973305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6643a396-bfc6-4770-b2c8-bef1067a6080 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:31.974400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6643a396-bfc6-4770-b2c8-bef1067a6080 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:31.982992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6643a396-bfc6-4770-b2c8-bef1067a6080 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:31.983913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6643a396-bfc6-4770-b2c8-bef1067a6080 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:31.984518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6643a396-bfc6-4770-b2c8-bef1067a6080 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:31.985217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6643a396-bfc6-4770-b2c8-bef1067a6080 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:31.985850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6643a396-bfc6-4770-b2c8-bef1067a6080 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:31.986586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6643a396-bfc6-4770-b2c8-bef1067a6080 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:32.060098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:32.083784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=10 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:32.268021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-79117475-74d6-49f6-b0ca-2ceb4f1a6f32 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:32.278187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-79117475-74d6-49f6-b0ca-2ceb4f1a6f32 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:32.279772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-79117475-74d6-49f6-b0ca-2ceb4f1a6f32 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:32.281103 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-79117475-74d6-49f6-b0ca-2ceb4f1a6f32 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 2546 microversion: 2.42 time: 0.392866 Oct 04 21:34:32.296187 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2781/5578] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:31 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 2546 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:34:32.297036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6643a396-bfc6-4770-b2c8-bef1067a6080 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:32.307228 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6643a396-bfc6-4770-b2c8-bef1067a6080 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 200 len: 1364 microversion: 2.1 time: 0.337215 Oct 04 21:34:32.307228 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2798/5579] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:31 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 1364 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:32.474766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aafdab03-53c1-46e0-81dc-695845d35406 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:32.475519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aafdab03-53c1-46e0-81dc-695845d35406 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:32.482071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aafdab03-53c1-46e0-81dc-695845d35406 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:32.482563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aafdab03-53c1-46e0-81dc-695845d35406 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:32.482998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aafdab03-53c1-46e0-81dc-695845d35406 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:32.483734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aafdab03-53c1-46e0-81dc-695845d35406 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:32.484253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aafdab03-53c1-46e0-81dc-695845d35406 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:32.484677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aafdab03-53c1-46e0-81dc-695845d35406 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:32.570308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aafdab03-53c1-46e0-81dc-695845d35406 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39736b6b74749d5a0ce5f5e79ce0c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cb61f8190c492d8946116e6e296a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:32.579952 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aafdab03-53c1-46e0-81dc-695845d35406 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa" status: 200 len: 1298 microversion: 2.1 time: 0.109283 Oct 04 21:34:32.580742 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2782/5580] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:32 2022] GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa => generated 1298 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:34:33.198133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b5cf6e20-f583-4931-8c8b-b7860c04f5db req-4090911c-0815-490e-bdbc-2e2c351ba70e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "name": "network-vif-deleted", "tag": "3f36f0e8-027a-49e9-b359-7053dd5e96b7"}, {"server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "name": "network-vif-deleted", "tag": "7be12e96-c1eb-431c-880c-1656a2d42226"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:33.204711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:33.219982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b5cf6e20-f583-4931-8c8b-b7860c04f5db req-4090911c-0815-490e-bdbc-2e2c351ba70e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:33.220748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b5cf6e20-f583-4931-8c8b-b7860c04f5db req-4090911c-0815-490e-bdbc-2e2c351ba70e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:33.221202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b5cf6e20-f583-4931-8c8b-b7860c04f5db req-4090911c-0815-490e-bdbc-2e2c351ba70e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:33.252933 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b5cf6e20-f583-4931-8c8b-b7860c04f5db req-4090911c-0815-490e-bdbc-2e2c351ba70e service nova] Creating event network-vif-deleted:3f36f0e8-027a-49e9-b359-7053dd5e96b7 for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:34:33.253262 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b5cf6e20-f583-4931-8c8b-b7860c04f5db req-4090911c-0815-490e-bdbc-2e2c351ba70e service nova] Creating event network-vif-deleted:7be12e96-c1eb-431c-880c-1656a2d42226 for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:34:33.260763 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b5cf6e20-f583-4931-8c8b-b7860c04f5db req-4090911c-0815-490e-bdbc-2e2c351ba70e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066157 Oct 04 21:34:33.262902 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2799/5581] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:33.311889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e68af0d5-629c-42d4-9196-0a255dbae9c9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:33.312520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e68af0d5-629c-42d4-9196-0a255dbae9c9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:33.322264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e68af0d5-629c-42d4-9196-0a255dbae9c9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:33.322762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e68af0d5-629c-42d4-9196-0a255dbae9c9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:33.323202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e68af0d5-629c-42d4-9196-0a255dbae9c9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:33.323907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e68af0d5-629c-42d4-9196-0a255dbae9c9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:33.324772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e68af0d5-629c-42d4-9196-0a255dbae9c9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:33.331821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e68af0d5-629c-42d4-9196-0a255dbae9c9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:33.335421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-28d04b54-0192-4914-8d8e-20f7bf55efbc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:33.338151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-28d04b54-0192-4914-8d8e-20f7bf55efbc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:33.352454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28d04b54-0192-4914-8d8e-20f7bf55efbc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:33.353796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28d04b54-0192-4914-8d8e-20f7bf55efbc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:33.354651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28d04b54-0192-4914-8d8e-20f7bf55efbc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:33.355377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28d04b54-0192-4914-8d8e-20f7bf55efbc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:33.355831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28d04b54-0192-4914-8d8e-20f7bf55efbc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:33.362522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-28d04b54-0192-4914-8d8e-20f7bf55efbc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:33.441453 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:33.442555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e68af0d5-629c-42d4-9196-0a255dbae9c9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:33.457141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e68af0d5-629c-42d4-9196-0a255dbae9c9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:33.463973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e68af0d5-629c-42d4-9196-0a255dbae9c9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:33.465243 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e68af0d5-629c-42d4-9196-0a255dbae9c9 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 2435 microversion: 2.42 time: 0.160307 Oct 04 21:34:33.470545 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2783/5582] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:33 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 2435 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:33.602536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-28d04b54-0192-4914-8d8e-20f7bf55efbc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:33.605221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-03237de3-0e77-44c2-ad38-10e0ac9671e1 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:33.605880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-03237de3-0e77-44c2-ad38-10e0ac9671e1 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:33.612055 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-28d04b54-0192-4914-8d8e-20f7bf55efbc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 200 len: 1364 microversion: 2.1 time: 0.284070 Oct 04 21:34:33.613858 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2800/5583] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:33 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 1364 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:33.620499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03237de3-0e77-44c2-ad38-10e0ac9671e1 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:33.623469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03237de3-0e77-44c2-ad38-10e0ac9671e1 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:33.625527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03237de3-0e77-44c2-ad38-10e0ac9671e1 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:33.628659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03237de3-0e77-44c2-ad38-10e0ac9671e1 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:33.629345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03237de3-0e77-44c2-ad38-10e0ac9671e1 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:33.629838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03237de3-0e77-44c2-ad38-10e0ac9671e1 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:33.684294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03237de3-0e77-44c2-ad38-10e0ac9671e1 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:33.684873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03237de3-0e77-44c2-ad38-10e0ac9671e1 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:33.685336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03237de3-0e77-44c2-ad38-10e0ac9671e1 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:33.685964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-03237de3-0e77-44c2-ad38-10e0ac9671e1 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lazy-loading 'fault' on Instance uuid 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:34:33.769590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-03237de3-0e77-44c2-ad38-10e0ac9671e1 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39736b6b74749d5a0ce5f5e79ce0c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cb61f8190c492d8946116e6e296a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:33.779870 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-03237de3-0e77-44c2-ad38-10e0ac9671e1 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa" status: 200 len: 1303 microversion: 2.1 time: 0.179729 Oct 04 21:34:33.790120 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2784/5584] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:33 2022] GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa => generated 1303 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:34.498345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7a88aa51-2068-40a0-bc4c-8e4aef9ab301 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:34.499518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7a88aa51-2068-40a0-bc4c-8e4aef9ab301 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:34.506523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7a88aa51-2068-40a0-bc4c-8e4aef9ab301 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:34.507019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7a88aa51-2068-40a0-bc4c-8e4aef9ab301 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:34.507461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7a88aa51-2068-40a0-bc4c-8e4aef9ab301 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:34.508152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7a88aa51-2068-40a0-bc4c-8e4aef9ab301 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:34.508611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7a88aa51-2068-40a0-bc4c-8e4aef9ab301 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:34.509107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7a88aa51-2068-40a0-bc4c-8e4aef9ab301 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:34.583059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7a88aa51-2068-40a0-bc4c-8e4aef9ab301 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:34.593796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7a88aa51-2068-40a0-bc4c-8e4aef9ab301 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:34.595267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7a88aa51-2068-40a0-bc4c-8e4aef9ab301 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:34.596652 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7a88aa51-2068-40a0-bc4c-8e4aef9ab301 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1986 microversion: 2.42 time: 0.102906 Oct 04 21:34:34.597231 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2801/5585] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:34 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1986 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:34.642771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-68f9e46c-53cb-43ca-a6fb-006d468961d5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:34.643385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-68f9e46c-53cb-43ca-a6fb-006d468961d5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:34.651530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68f9e46c-53cb-43ca-a6fb-006d468961d5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:34.652024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68f9e46c-53cb-43ca-a6fb-006d468961d5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:34.652463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68f9e46c-53cb-43ca-a6fb-006d468961d5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:34.653165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68f9e46c-53cb-43ca-a6fb-006d468961d5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:34.653731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68f9e46c-53cb-43ca-a6fb-006d468961d5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:34.654159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68f9e46c-53cb-43ca-a6fb-006d468961d5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:34.792199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-68f9e46c-53cb-43ca-a6fb-006d468961d5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:34.803547 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-68f9e46c-53cb-43ca-a6fb-006d468961d5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 200 len: 1364 microversion: 2.1 time: 0.164797 Oct 04 21:34:34.805099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-411b749c-4e1b-4409-b538-af6134588ab7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:34.805989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-411b749c-4e1b-4409-b538-af6134588ab7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] [instance: 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:34.813150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-411b749c-4e1b-4409-b538-af6134588ab7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:34.814541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-411b749c-4e1b-4409-b538-af6134588ab7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:34.815196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-411b749c-4e1b-4409-b538-af6134588ab7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:34.816192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-411b749c-4e1b-4409-b538-af6134588ab7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:34.816876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-411b749c-4e1b-4409-b538-af6134588ab7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:34.817566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-411b749c-4e1b-4409-b538-af6134588ab7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:34.820495 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2785/5586] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:34 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:34.834338 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-411b749c-4e1b-4409-b538-af6134588ab7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] HTTP exception thrown: Instance 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa could not be found. Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-411b749c-4e1b-4409-b538-af6134588ab7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Request method failure captured: Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa HTTP/1.1 Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKZFkN8lw--SleZXlYlp4EB8s1jWDGJIfzvAsXRnd0CTMhFILLr1GZBioRv-Hgc-Mh84Uo6or4rSZgp9sBHir7vaBNrkT8tDBm-e8o82Do1MDOcZ4MlSIonoCxsFdVlITBCYC6UQQvW5jp1_z4MZ4vX4134ClVs4w8jmY15PkNDKyvI Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f2cb61f8190c492d8946116e6e296a76 Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-VolumesBackupsTest-1616639005 Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2cb61f8190c492d8946116e6e296a76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2cb61f8190c492d8946116e6e296a76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2cb61f8190c492d8946116e6e296a76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2cb61f8190c492d8946116e6e296a76"}]}] Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-VolumesBackupsTest-1616639005 Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f2cb61f8190c492d8946116e6e296a76 Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-VolumesBackupsTest-1616639005 Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-VolumesBackupsTest-1616639005-project Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: e39736b6b74749d5a0ce5f5e79ce0c91 Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-VolumesBackupsTest-1616639005-project Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa could not be found. Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa'} Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa could not be found. Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa could not be found. Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:34.836324 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:34.845393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:34.845393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:34.845393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:34.845393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:34:34.845393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:34:34.845393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa could not be found. Oct 04 21:34:34.845393 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:34.845393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-411b749c-4e1b-4409-b538-af6134588ab7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] Returning 404 to user: Instance 3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:34:34.845393 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-411b749c-4e1b-4409-b538-af6134588ab7 tempest-VolumesBackupsTest-1616639005 tempest-VolumesBackupsTest-1616639005-project] 10.222.0.30 "GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa" status: 404 len: 111 microversion: 2.1 time: 0.039364 Oct 04 21:34:34.845393 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2802/5587] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:34 2022] GET /compute/v2.1/servers/3a0ba2a6-4bcb-46e6-b527-cb2994f0c1aa => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:34:35.280241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-289e94e2-f3d1-4239-beba-24100204a449 req-cd58c7a8-dd84-4162-8855-846e1c11bd4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067dcc1c-2c94-41dd-8084-92d33e0f2d2f", "name": "network-vif-deleted", "tag": "ce41b261-1a55-4261-a0af-98d834d3178a"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:35.290780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-289e94e2-f3d1-4239-beba-24100204a449 req-cd58c7a8-dd84-4162-8855-846e1c11bd4d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:35.291424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-289e94e2-f3d1-4239-beba-24100204a449 req-cd58c7a8-dd84-4162-8855-846e1c11bd4d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:35.291864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-289e94e2-f3d1-4239-beba-24100204a449 req-cd58c7a8-dd84-4162-8855-846e1c11bd4d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:35.304152 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-289e94e2-f3d1-4239-beba-24100204a449 req-cd58c7a8-dd84-4162-8855-846e1c11bd4d service nova] Creating event network-vif-deleted:ce41b261-1a55-4261-a0af-98d834d3178a for instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f on n-h2-860282-1 Oct 04 21:34:35.310391 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-289e94e2-f3d1-4239-beba-24100204a449 req-cd58c7a8-dd84-4162-8855-846e1c11bd4d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033975 Oct 04 21:34:35.311115 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2786/5588] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:35.405279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-d88d76cf-07fb-450c-8585-2c18be72f97e req-1b4c4a73-ff56-4cea-b40a-4f5c499297ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60148f18-dd52-4a9a-8d23-12cb5ebbd7c4", "name": "network-vif-plugged", "status": "completed", "tag": "1c4a8457-2b84-4180-8f0c-4097c6670f56"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:35.428159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d88d76cf-07fb-450c-8585-2c18be72f97e req-1b4c4a73-ff56-4cea-b40a-4f5c499297ed service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:35.428651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d88d76cf-07fb-450c-8585-2c18be72f97e req-1b4c4a73-ff56-4cea-b40a-4f5c499297ed service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:35.430228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d88d76cf-07fb-450c-8585-2c18be72f97e req-1b4c4a73-ff56-4cea-b40a-4f5c499297ed service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:35.443573 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-d88d76cf-07fb-450c-8585-2c18be72f97e req-1b4c4a73-ff56-4cea-b40a-4f5c499297ed service nova] Creating event network-vif-plugged:1c4a8457-2b84-4180-8f0c-4097c6670f56 for instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 on n-h1-860282-1 Oct 04 21:34:35.457047 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-d88d76cf-07fb-450c-8585-2c18be72f97e req-1b4c4a73-ff56-4cea-b40a-4f5c499297ed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065069 Oct 04 21:34:35.457953 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2803/5589] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:35.626099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9ef08c58-86ab-4664-903d-eaa6c6835c2e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:35.626843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9ef08c58-86ab-4664-903d-eaa6c6835c2e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:35.636855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ef08c58-86ab-4664-903d-eaa6c6835c2e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:35.637366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ef08c58-86ab-4664-903d-eaa6c6835c2e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:35.637849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ef08c58-86ab-4664-903d-eaa6c6835c2e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:35.650018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ef08c58-86ab-4664-903d-eaa6c6835c2e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:35.652425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ef08c58-86ab-4664-903d-eaa6c6835c2e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:35.653083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ef08c58-86ab-4664-903d-eaa6c6835c2e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:35.749051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9ef08c58-86ab-4664-903d-eaa6c6835c2e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:35.758459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9ef08c58-86ab-4664-903d-eaa6c6835c2e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:35.759956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9ef08c58-86ab-4664-903d-eaa6c6835c2e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:35.761177 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9ef08c58-86ab-4664-903d-eaa6c6835c2e tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1872 microversion: 2.42 time: 0.139951 Oct 04 21:34:35.761822 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2787/5590] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:35 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1872 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:35.833287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f39cc8bf-ca5d-4766-b989-dc35fd9d5c98 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:35.833945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f39cc8bf-ca5d-4766-b989-dc35fd9d5c98 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:35.841785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f39cc8bf-ca5d-4766-b989-dc35fd9d5c98 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:35.842375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f39cc8bf-ca5d-4766-b989-dc35fd9d5c98 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:35.843021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f39cc8bf-ca5d-4766-b989-dc35fd9d5c98 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:35.843739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f39cc8bf-ca5d-4766-b989-dc35fd9d5c98 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:35.844281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f39cc8bf-ca5d-4766-b989-dc35fd9d5c98 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:35.845054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f39cc8bf-ca5d-4766-b989-dc35fd9d5c98 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:36.014531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f39cc8bf-ca5d-4766-b989-dc35fd9d5c98 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:36.022767 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f39cc8bf-ca5d-4766-b989-dc35fd9d5c98 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 200 len: 1364 microversion: 2.1 time: 0.197335 Oct 04 21:34:36.023358 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2804/5591] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:35 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:36.788622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dad6c016-1fa1-439e-ae8e-9a29c45ee441 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:36.789261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dad6c016-1fa1-439e-ae8e-9a29c45ee441 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:36.798276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dad6c016-1fa1-439e-ae8e-9a29c45ee441 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:36.798276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dad6c016-1fa1-439e-ae8e-9a29c45ee441 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:36.798276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dad6c016-1fa1-439e-ae8e-9a29c45ee441 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:36.798276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dad6c016-1fa1-439e-ae8e-9a29c45ee441 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:36.798276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dad6c016-1fa1-439e-ae8e-9a29c45ee441 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:36.798794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dad6c016-1fa1-439e-ae8e-9a29c45ee441 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:36.889318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dad6c016-1fa1-439e-ae8e-9a29c45ee441 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:36.902042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dad6c016-1fa1-439e-ae8e-9a29c45ee441 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:36.903747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dad6c016-1fa1-439e-ae8e-9a29c45ee441 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:36.905081 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dad6c016-1fa1-439e-ae8e-9a29c45ee441 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1872 microversion: 2.42 time: 0.120633 Oct 04 21:34:36.905942 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2788/5592] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:36 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1872 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:34:37.047958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c2d87ec6-c8bc-4226-9516-8757f5110a11 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:37.048631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c2d87ec6-c8bc-4226-9516-8757f5110a11 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:37.055547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2d87ec6-c8bc-4226-9516-8757f5110a11 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:37.056043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2d87ec6-c8bc-4226-9516-8757f5110a11 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:37.056986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2d87ec6-c8bc-4226-9516-8757f5110a11 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:37.060850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2d87ec6-c8bc-4226-9516-8757f5110a11 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:37.061339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2d87ec6-c8bc-4226-9516-8757f5110a11 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:37.061822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2d87ec6-c8bc-4226-9516-8757f5110a11 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:37.211943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c2d87ec6-c8bc-4226-9516-8757f5110a11 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:37.220462 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c2d87ec6-c8bc-4226-9516-8757f5110a11 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 200 len: 1554 microversion: 2.1 time: 0.176827 Oct 04 21:34:37.221040 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2805/5593] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:37 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:37.243561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-668a8198-18bd-45f1-8ab1-e66499f8b293 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:37.244691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-668a8198-18bd-45f1-8ab1-e66499f8b293 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:37.251031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-668a8198-18bd-45f1-8ab1-e66499f8b293 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:37.251517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-668a8198-18bd-45f1-8ab1-e66499f8b293 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:37.252129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-668a8198-18bd-45f1-8ab1-e66499f8b293 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:37.252822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-668a8198-18bd-45f1-8ab1-e66499f8b293 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:37.253444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-668a8198-18bd-45f1-8ab1-e66499f8b293 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:37.254016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-668a8198-18bd-45f1-8ab1-e66499f8b293 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:37.337395 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-668a8198-18bd-45f1-8ab1-e66499f8b293 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097617 Oct 04 21:34:37.347364 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2789/5594] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:34:37 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:37.505358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9567ebc1-7d2f-4b27-9bf5-bb44349c5ae1 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:37.507608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9567ebc1-7d2f-4b27-9bf5-bb44349c5ae1 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:37.516842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9567ebc1-7d2f-4b27-9bf5-bb44349c5ae1 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:37.517352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9567ebc1-7d2f-4b27-9bf5-bb44349c5ae1 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:37.517826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9567ebc1-7d2f-4b27-9bf5-bb44349c5ae1 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:37.518543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9567ebc1-7d2f-4b27-9bf5-bb44349c5ae1 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:37.519167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9567ebc1-7d2f-4b27-9bf5-bb44349c5ae1 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:37.521203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9567ebc1-7d2f-4b27-9bf5-bb44349c5ae1 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:37.566404 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9567ebc1-7d2f-4b27-9bf5-bb44349c5ae1 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065058 Oct 04 21:34:37.573985 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2806/5595] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:34:37 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:34:37.660866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fda68e78-ce80-488c-8132-e804496b110c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:37.661382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fda68e78-ce80-488c-8132-e804496b110c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:37.668992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fda68e78-ce80-488c-8132-e804496b110c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:37.669714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fda68e78-ce80-488c-8132-e804496b110c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:37.670169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fda68e78-ce80-488c-8132-e804496b110c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:37.670916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fda68e78-ce80-488c-8132-e804496b110c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:37.671384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fda68e78-ce80-488c-8132-e804496b110c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:37.671821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fda68e78-ce80-488c-8132-e804496b110c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:37.700170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fda68e78-ce80-488c-8132-e804496b110c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:34:37.818645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:37.944697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a67aae68-edef-4ef1-9929-9e8e9873ad52 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:37.945336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a67aae68-edef-4ef1-9929-9e8e9873ad52 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:37.953914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a67aae68-edef-4ef1-9929-9e8e9873ad52 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:37.954734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a67aae68-edef-4ef1-9929-9e8e9873ad52 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:37.955326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a67aae68-edef-4ef1-9929-9e8e9873ad52 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:37.956084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a67aae68-edef-4ef1-9929-9e8e9873ad52 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:37.956549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a67aae68-edef-4ef1-9929-9e8e9873ad52 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:37.957026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a67aae68-edef-4ef1-9929-9e8e9873ad52 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:38.035388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a67aae68-edef-4ef1-9929-9e8e9873ad52 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:38.046180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a67aae68-edef-4ef1-9929-9e8e9873ad52 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:38.047629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a67aae68-edef-4ef1-9929-9e8e9873ad52 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:38.048855 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a67aae68-edef-4ef1-9929-9e8e9873ad52 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1872 microversion: 2.42 time: 0.120535 Oct 04 21:34:38.049796 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2807/5596] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:37 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1872 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:38.184165 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fda68e78-ce80-488c-8132-e804496b110c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 204 len: 0 microversion: 2.1 time: 0.525844 Oct 04 21:34:38.185518 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2790/5597] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:34:37 2022] DELETE /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:34:38.197325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ac184574-2d8b-470e-81cb-69a1ef82d06f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:38.198617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ac184574-2d8b-470e-81cb-69a1ef82d06f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:38.214493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac184574-2d8b-470e-81cb-69a1ef82d06f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:38.218849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac184574-2d8b-470e-81cb-69a1ef82d06f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:38.218849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac184574-2d8b-470e-81cb-69a1ef82d06f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:38.218849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac184574-2d8b-470e-81cb-69a1ef82d06f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:38.218849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac184574-2d8b-470e-81cb-69a1ef82d06f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:38.218849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac184574-2d8b-470e-81cb-69a1ef82d06f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:38.793130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ac184574-2d8b-470e-81cb-69a1ef82d06f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:38.802821 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ac184574-2d8b-470e-81cb-69a1ef82d06f tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1672 microversion: 2.1 time: 0.612706 Oct 04 21:34:38.803958 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2808/5598] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:38 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1672 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:39.054764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-86a66b59-d62c-455d-ba3b-10facef9207d req-12890d98-2850-4ef1-917d-965eca2cca47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60148f18-dd52-4a9a-8d23-12cb5ebbd7c4", "tag": "1c4a8457-2b84-4180-8f0c-4097c6670f56"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:39.069855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-86a66b59-d62c-455d-ba3b-10facef9207d req-12890d98-2850-4ef1-917d-965eca2cca47 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:39.070588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-86a66b59-d62c-455d-ba3b-10facef9207d req-12890d98-2850-4ef1-917d-965eca2cca47 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:39.071204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-86a66b59-d62c-455d-ba3b-10facef9207d req-12890d98-2850-4ef1-917d-965eca2cca47 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:39.077120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c37c2f39-0650-4b94-9ddf-c71401c279e2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:39.077790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c37c2f39-0650-4b94-9ddf-c71401c279e2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:39.087128 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-86a66b59-d62c-455d-ba3b-10facef9207d req-12890d98-2850-4ef1-917d-965eca2cca47 service nova] Creating event network-changed:1c4a8457-2b84-4180-8f0c-4097c6670f56 for instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 on n-h1-860282-1 Oct 04 21:34:39.087804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c37c2f39-0650-4b94-9ddf-c71401c279e2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:39.088306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c37c2f39-0650-4b94-9ddf-c71401c279e2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:39.088748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c37c2f39-0650-4b94-9ddf-c71401c279e2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:39.089486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c37c2f39-0650-4b94-9ddf-c71401c279e2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:39.089952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c37c2f39-0650-4b94-9ddf-c71401c279e2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:39.090385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c37c2f39-0650-4b94-9ddf-c71401c279e2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:39.095978 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-86a66b59-d62c-455d-ba3b-10facef9207d req-12890d98-2850-4ef1-917d-965eca2cca47 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044460 Oct 04 21:34:39.099395 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2791/5599] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:39.106199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:39.216385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c37c2f39-0650-4b94-9ddf-c71401c279e2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:39.234169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c37c2f39-0650-4b94-9ddf-c71401c279e2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:39.235873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c37c2f39-0650-4b94-9ddf-c71401c279e2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:39.237396 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c37c2f39-0650-4b94-9ddf-c71401c279e2 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1872 microversion: 2.42 time: 0.166252 Oct 04 21:34:39.238475 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2809/5600] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:39 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1872 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:34:39.828992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-27288b05-8227-4898-8957-d64d67fdb054 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:39.830242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-27288b05-8227-4898-8957-d64d67fdb054 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:39.847298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27288b05-8227-4898-8957-d64d67fdb054 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:39.848301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27288b05-8227-4898-8957-d64d67fdb054 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:39.849415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27288b05-8227-4898-8957-d64d67fdb054 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:39.852503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27288b05-8227-4898-8957-d64d67fdb054 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:39.855213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27288b05-8227-4898-8957-d64d67fdb054 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:39.855746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-27288b05-8227-4898-8957-d64d67fdb054 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:40.043759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-27288b05-8227-4898-8957-d64d67fdb054 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:40.053709 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-27288b05-8227-4898-8957-d64d67fdb054 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1672 microversion: 2.1 time: 0.229943 Oct 04 21:34:40.055239 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2792/5601] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:39 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1672 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:40.271587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-26e4deaf-1d09-4d84-b0fe-a545f7ca541f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:40.273327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-26e4deaf-1d09-4d84-b0fe-a545f7ca541f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:40.289037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26e4deaf-1d09-4d84-b0fe-a545f7ca541f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:40.290238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26e4deaf-1d09-4d84-b0fe-a545f7ca541f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:40.291477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26e4deaf-1d09-4d84-b0fe-a545f7ca541f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:40.292816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26e4deaf-1d09-4d84-b0fe-a545f7ca541f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:40.293548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26e4deaf-1d09-4d84-b0fe-a545f7ca541f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:40.294129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26e4deaf-1d09-4d84-b0fe-a545f7ca541f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:40.429259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-26e4deaf-1d09-4d84-b0fe-a545f7ca541f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:40.439798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-26e4deaf-1d09-4d84-b0fe-a545f7ca541f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:40.445478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-26e4deaf-1d09-4d84-b0fe-a545f7ca541f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:40.450832 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-26e4deaf-1d09-4d84-b0fe-a545f7ca541f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1872 microversion: 2.42 time: 0.185652 Oct 04 21:34:40.451685 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2810/5602] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:40 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1872 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:41.081136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-79937dbf-7bc3-4d36-994d-465a0c9ef93c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:41.082193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-79937dbf-7bc3-4d36-994d-465a0c9ef93c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:41.106130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79937dbf-7bc3-4d36-994d-465a0c9ef93c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:41.106638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79937dbf-7bc3-4d36-994d-465a0c9ef93c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:41.107081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79937dbf-7bc3-4d36-994d-465a0c9ef93c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:41.107800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79937dbf-7bc3-4d36-994d-465a0c9ef93c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:41.108258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79937dbf-7bc3-4d36-994d-465a0c9ef93c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:41.108690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79937dbf-7bc3-4d36-994d-465a0c9ef93c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:41.312905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-79937dbf-7bc3-4d36-994d-465a0c9ef93c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:41.322697 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-79937dbf-7bc3-4d36-994d-465a0c9ef93c tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1605 microversion: 2.1 time: 0.246300 Oct 04 21:34:41.325907 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2793/5603] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:41 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1605 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:41.481070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8ea01024-c3fd-416b-ba5a-d0a1af64db1f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:41.481819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8ea01024-c3fd-416b-ba5a-d0a1af64db1f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:41.489187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ea01024-c3fd-416b-ba5a-d0a1af64db1f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:41.489778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ea01024-c3fd-416b-ba5a-d0a1af64db1f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:41.490412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ea01024-c3fd-416b-ba5a-d0a1af64db1f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:41.491353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ea01024-c3fd-416b-ba5a-d0a1af64db1f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:41.491995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ea01024-c3fd-416b-ba5a-d0a1af64db1f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:41.492609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ea01024-c3fd-416b-ba5a-d0a1af64db1f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:41.592621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8ea01024-c3fd-416b-ba5a-d0a1af64db1f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:41.602811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8ea01024-c3fd-416b-ba5a-d0a1af64db1f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:41.605128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8ea01024-c3fd-416b-ba5a-d0a1af64db1f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:41.606627 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8ea01024-c3fd-416b-ba5a-d0a1af64db1f tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1872 microversion: 2.42 time: 0.130372 Oct 04 21:34:41.607734 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2811/5604] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:41 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1872 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:41.776924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-5ff57798-cf75-4785-86ff-d076bac853b7 req-0061a600-2fe5-4c35-b9b3-e21f54840f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f195f612-8d0d-42b7-bd89-5e30477023b4", "name": "network-vif-deleted", "tag": "d42dda8d-a200-41b6-945b-9fd7ce65af56"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:41.794062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5ff57798-cf75-4785-86ff-d076bac853b7 req-0061a600-2fe5-4c35-b9b3-e21f54840f46 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:41.794793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5ff57798-cf75-4785-86ff-d076bac853b7 req-0061a600-2fe5-4c35-b9b3-e21f54840f46 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:41.795415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5ff57798-cf75-4785-86ff-d076bac853b7 req-0061a600-2fe5-4c35-b9b3-e21f54840f46 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:41.821096 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-5ff57798-cf75-4785-86ff-d076bac853b7 req-0061a600-2fe5-4c35-b9b3-e21f54840f46 service nova] Creating event network-vif-deleted:d42dda8d-a200-41b6-945b-9fd7ce65af56 for instance f195f612-8d0d-42b7-bd89-5e30477023b4 on n-h2-860282-1 Oct 04 21:34:41.839962 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-5ff57798-cf75-4785-86ff-d076bac853b7 req-0061a600-2fe5-4c35-b9b3-e21f54840f46 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066550 Oct 04 21:34:41.841213 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2794/5605] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:42.358577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2841add9-e297-4671-9255-128689cb26bb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:42.359362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2841add9-e297-4671-9255-128689cb26bb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:42.374765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2841add9-e297-4671-9255-128689cb26bb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:42.376449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2841add9-e297-4671-9255-128689cb26bb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:42.378803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2841add9-e297-4671-9255-128689cb26bb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:42.379874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2841add9-e297-4671-9255-128689cb26bb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:42.381563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2841add9-e297-4671-9255-128689cb26bb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:42.383382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2841add9-e297-4671-9255-128689cb26bb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:42.501465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2841add9-e297-4671-9255-128689cb26bb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:42.502073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2841add9-e297-4671-9255-128689cb26bb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:42.502411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2841add9-e297-4671-9255-128689cb26bb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:42.502873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-2841add9-e297-4671-9255-128689cb26bb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lazy-loading 'fault' on Instance uuid f195f612-8d0d-42b7-bd89-5e30477023b4 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:34:42.570066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2841add9-e297-4671-9255-128689cb26bb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:42.578962 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2841add9-e297-4671-9255-128689cb26bb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 200 len: 1327 microversion: 2.1 time: 0.230406 Oct 04 21:34:42.579795 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2812/5606] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:42 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 1327 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:42.675765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-67ca67cf-3bd5-4ffd-a194-2365871aa054 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:42.678359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-67ca67cf-3bd5-4ffd-a194-2365871aa054 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:42.695452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67ca67cf-3bd5-4ffd-a194-2365871aa054 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:42.696189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67ca67cf-3bd5-4ffd-a194-2365871aa054 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:42.696764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67ca67cf-3bd5-4ffd-a194-2365871aa054 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:42.698342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67ca67cf-3bd5-4ffd-a194-2365871aa054 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:42.699488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67ca67cf-3bd5-4ffd-a194-2365871aa054 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:42.700539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67ca67cf-3bd5-4ffd-a194-2365871aa054 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:42.815337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67ca67cf-3bd5-4ffd-a194-2365871aa054 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:42.828833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67ca67cf-3bd5-4ffd-a194-2365871aa054 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:42.840303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67ca67cf-3bd5-4ffd-a194-2365871aa054 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:42.842956 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-67ca67cf-3bd5-4ffd-a194-2365871aa054 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1872 microversion: 2.42 time: 0.209334 Oct 04 21:34:42.844207 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2795/5607] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:42 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1872 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:43.604201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-70584533-c357-4c16-a975-270a8b69a478 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:43.604945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-70584533-c357-4c16-a975-270a8b69a478 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:43.617090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70584533-c357-4c16-a975-270a8b69a478 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:43.622070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70584533-c357-4c16-a975-270a8b69a478 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:43.622754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70584533-c357-4c16-a975-270a8b69a478 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:43.623762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70584533-c357-4c16-a975-270a8b69a478 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:43.624424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70584533-c357-4c16-a975-270a8b69a478 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:43.625058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70584533-c357-4c16-a975-270a8b69a478 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:43.644493 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-70584533-c357-4c16-a975-270a8b69a478 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] HTTP exception thrown: Instance f195f612-8d0d-42b7-bd89-5e30477023b4 could not be found. Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-70584533-c357-4c16-a975-270a8b69a478 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Request method failure captured: Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 HTTP/1.1 Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKYlXHR8I8wRQFODrOVWlUYl-ahlxwIFsYKfV_R4wsakZqpR88jBTNtqNOtBTWqFpnUV0Hun8uqJl71sct-kwDxnitHrojNaCyV5EUsapk-o8TAAL4uaGaysfjjZ9aJOYpwW5gfZixLDk-9rhKNXEbVtOi0ktISjTZ5KpyUZgOnAe30 Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 66351b2e6b2840f183aaf8983e6fc128 Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AttachVolumeTestJSON-1015759103 Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66351b2e6b2840f183aaf8983e6fc128"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66351b2e6b2840f183aaf8983e6fc128"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66351b2e6b2840f183aaf8983e6fc128"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66351b2e6b2840f183aaf8983e6fc128"}]}] Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AttachVolumeTestJSON-1015759103 Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 66351b2e6b2840f183aaf8983e6fc128 Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1015759103 Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AttachVolumeTestJSON-1015759103-project Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 0c9cb06716184ec88816395420d5870e Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AttachVolumeTestJSON-1015759103-project Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance f195f612-8d0d-42b7-bd89-5e30477023b4 could not be found. Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'f195f612-8d0d-42b7-bd89-5e30477023b4'} Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f195f612-8d0d-42b7-bd89-5e30477023b4 could not be found. Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f195f612-8d0d-42b7-bd89-5e30477023b4 could not be found. Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:43.646443 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:43.652047 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:43.652047 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:43.652047 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:43.652047 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:34:43.652047 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:34:43.652047 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f195f612-8d0d-42b7-bd89-5e30477023b4 could not be found. Oct 04 21:34:43.652047 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:43.653755 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-70584533-c357-4c16-a975-270a8b69a478 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Returning 404 to user: Instance f195f612-8d0d-42b7-bd89-5e30477023b4 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:34:43.654871 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-70584533-c357-4c16-a975-270a8b69a478 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 404 len: 111 microversion: 2.1 time: 0.055903 Oct 04 21:34:43.655805 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2813/5608] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:43 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:34:43.664628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-84427d0f-fd98-4aa3-8f95-1b5b27bf32a2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '.version_select at 0x7f578b41cd30>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:43.746892 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-84427d0f-fd98-4aa3-8f95-1b5b27bf32a2 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-204641264" status: 202 len: 0 microversion: 2.1 time: 0.086098 Oct 04 21:34:43.747827 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2796/5609] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Oct 4 21:34:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-204641264 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:34:43.875394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d6a5d1bd-4092-4b1c-b4ab-0fa599762a7c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:43.876400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d6a5d1bd-4092-4b1c-b4ab-0fa599762a7c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:43.886195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6a5d1bd-4092-4b1c-b4ab-0fa599762a7c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:43.887925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6a5d1bd-4092-4b1c-b4ab-0fa599762a7c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:43.889371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6a5d1bd-4092-4b1c-b4ab-0fa599762a7c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:43.890276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6a5d1bd-4092-4b1c-b4ab-0fa599762a7c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:43.890960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6a5d1bd-4092-4b1c-b4ab-0fa599762a7c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:43.892038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6a5d1bd-4092-4b1c-b4ab-0fa599762a7c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:44.049712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d6a5d1bd-4092-4b1c-b4ab-0fa599762a7c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:44.088707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d6a5d1bd-4092-4b1c-b4ab-0fa599762a7c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:44.095305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d6a5d1bd-4092-4b1c-b4ab-0fa599762a7c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:44.096909 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d6a5d1bd-4092-4b1c-b4ab-0fa599762a7c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1872 microversion: 2.42 time: 0.228276 Oct 04 21:34:44.101735 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2814/5610] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:43 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1872 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:44.779460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f2a47973-c926-47a8-8e72-61c197e11586 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Action: 'create', calling method: .version_select at 0x7f578b678f70>, body: {"keypair": {"name": "tempest-keypair-1863004533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOO3zp3A/EfuxWhhsuUffyVyN3ldCiwn2OA17JH/viV9nl/B851zekf7rnx3uQLLpjNnec+Kon8sLz+Vo6sfoS3f6WzK5aGyKQS/AwaY1JQRxoM7VrI9GdQWHmQ9WbzgfQ=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:44.807272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-f2a47973-c926-47a8-8e72-61c197e11586 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Getting quotas for project 66351b2e6b2840f183aaf8983e6fc128. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:34:44.815382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-f2a47973-c926-47a8-8e72-61c197e11586 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Getting quotas for user 0c9cb06716184ec88816395420d5870e and project 66351b2e6b2840f183aaf8983e6fc128. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:34:44.905127 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f2a47973-c926-47a8-8e72-61c197e11586 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.135116 Oct 04 21:34:44.906350 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2797/5611] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:34:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:45.132557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-97e7a66b-2b1b-4c3c-b134-8370bffcb1b0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:45.133190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-97e7a66b-2b1b-4c3c-b134-8370bffcb1b0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:45.142232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97e7a66b-2b1b-4c3c-b134-8370bffcb1b0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:45.143062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97e7a66b-2b1b-4c3c-b134-8370bffcb1b0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:45.143721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97e7a66b-2b1b-4c3c-b134-8370bffcb1b0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:45.144524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97e7a66b-2b1b-4c3c-b134-8370bffcb1b0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:45.147637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97e7a66b-2b1b-4c3c-b134-8370bffcb1b0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:45.148399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97e7a66b-2b1b-4c3c-b134-8370bffcb1b0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:45.230197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-97e7a66b-2b1b-4c3c-b134-8370bffcb1b0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:45.242349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-97e7a66b-2b1b-4c3c-b134-8370bffcb1b0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:45.244465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-97e7a66b-2b1b-4c3c-b134-8370bffcb1b0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:45.246014 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-97e7a66b-2b1b-4c3c-b134-8370bffcb1b0 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1872 microversion: 2.42 time: 0.117551 Oct 04 21:34:45.246649 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2815/5612] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:45 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1872 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:46.275025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f413c3ba-602a-4744-a92e-5ed20b90f869 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:46.275875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f413c3ba-602a-4744-a92e-5ed20b90f869 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:46.283761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f413c3ba-602a-4744-a92e-5ed20b90f869 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:46.284392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f413c3ba-602a-4744-a92e-5ed20b90f869 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:46.285038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f413c3ba-602a-4744-a92e-5ed20b90f869 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:46.286003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f413c3ba-602a-4744-a92e-5ed20b90f869 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:46.294193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f413c3ba-602a-4744-a92e-5ed20b90f869 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:46.294193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f413c3ba-602a-4744-a92e-5ed20b90f869 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:46.361104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f413c3ba-602a-4744-a92e-5ed20b90f869 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:46.372838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f413c3ba-602a-4744-a92e-5ed20b90f869 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:46.374609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f413c3ba-602a-4744-a92e-5ed20b90f869 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:46.376039 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f413c3ba-602a-4744-a92e-5ed20b90f869 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1872 microversion: 2.42 time: 0.105676 Oct 04 21:34:46.377031 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2798/5613] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:46 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1872 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:47.404735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-33c44431-37ad-4929-b407-953194ab6481 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:47.405271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-33c44431-37ad-4929-b407-953194ab6481 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:47.413744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33c44431-37ad-4929-b407-953194ab6481 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:47.414504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33c44431-37ad-4929-b407-953194ab6481 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:47.414949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33c44431-37ad-4929-b407-953194ab6481 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:47.415796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33c44431-37ad-4929-b407-953194ab6481 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:47.416514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33c44431-37ad-4929-b407-953194ab6481 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:47.418011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33c44431-37ad-4929-b407-953194ab6481 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:47.514850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-33c44431-37ad-4929-b407-953194ab6481 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:47.534877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-33c44431-37ad-4929-b407-953194ab6481 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:47.536493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-33c44431-37ad-4929-b407-953194ab6481 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:47.540646 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-33c44431-37ad-4929-b407-953194ab6481 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1872 microversion: 2.42 time: 0.140156 Oct 04 21:34:47.542063 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2816/5614] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:47 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1872 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:47.568204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-56d1fa3c-ad63-4af3-99da-52defe510da3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1219454830", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccb62f72-b314-486b-ac69-a6797e725ff7"}], "security_groups": [{"name": "tempest-securitygroup--2119890432"}], "key_name": "tempest-keypair-1863004533", "user_data": "}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:47.704028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-56d1fa3c-ad63-4af3-99da-52defe510da3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] validate_networks() for [('ccb62f72-b314-486b-ac69-a6797e725ff7', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:34:48.180299 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-56d1fa3c-ad63-4af3-99da-52defe510da3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:34:48.181881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-56d1fa3c-ad63-4af3-99da-52defe510da3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:34:48.182765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-56d1fa3c-ad63-4af3-99da-52defe510da3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:34:48.183386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-56d1fa3c-ad63-4af3-99da-52defe510da3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:34:48.184031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-56d1fa3c-ad63-4af3-99da-52defe510da3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:34:48.194956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56d1fa3c-ad63-4af3-99da-52defe510da3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:48.195918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56d1fa3c-ad63-4af3-99da-52defe510da3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:48.197593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56d1fa3c-ad63-4af3-99da-52defe510da3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:48.198615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56d1fa3c-ad63-4af3-99da-52defe510da3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:48.199462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56d1fa3c-ad63-4af3-99da-52defe510da3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:48.200067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56d1fa3c-ad63-4af3-99da-52defe510da3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:48.224642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-56d1fa3c-ad63-4af3-99da-52defe510da3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Getting quotas for project 66351b2e6b2840f183aaf8983e6fc128. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:34:48.231820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-56d1fa3c-ad63-4af3-99da-52defe510da3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Getting quotas for user 0c9cb06716184ec88816395420d5870e and project 66351b2e6b2840f183aaf8983e6fc128. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:34:48.254878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-56d1fa3c-ad63-4af3-99da-52defe510da3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:34:48.258841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-56d1fa3c-ad63-4af3-99da-52defe510da3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:34:48.419675 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-56d1fa3c-ad63-4af3-99da-52defe510da3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.856039 Oct 04 21:34:48.423086 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2799/5615] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:34:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:34:48.433827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bef64b2b-1656-4bb2-a351-3bead8b4dafa tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:48.434572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bef64b2b-1656-4bb2-a351-3bead8b4dafa tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:48.500771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bef64b2b-1656-4bb2-a351-3bead8b4dafa tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:48.514668 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bef64b2b-1656-4bb2-a351-3bead8b4dafa tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 200 len: 1238 microversion: 2.1 time: 0.080108 Oct 04 21:34:48.517769 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2817/5616] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:48 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:48.573044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-26887c5c-cd27-483c-acb3-1c8f64c8e001 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:48.574379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-26887c5c-cd27-483c-acb3-1c8f64c8e001 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:48.587648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26887c5c-cd27-483c-acb3-1c8f64c8e001 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:48.588149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26887c5c-cd27-483c-acb3-1c8f64c8e001 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:48.588593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26887c5c-cd27-483c-acb3-1c8f64c8e001 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:48.590297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26887c5c-cd27-483c-acb3-1c8f64c8e001 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:48.591592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26887c5c-cd27-483c-acb3-1c8f64c8e001 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:48.592940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26887c5c-cd27-483c-acb3-1c8f64c8e001 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:48.754773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-26887c5c-cd27-483c-acb3-1c8f64c8e001 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:48.770334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-26887c5c-cd27-483c-acb3-1c8f64c8e001 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:48.772605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-26887c5c-cd27-483c-acb3-1c8f64c8e001 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:48.773800 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-26887c5c-cd27-483c-acb3-1c8f64c8e001 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1872 microversion: 2.42 time: 0.205509 Oct 04 21:34:48.775557 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2800/5617] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:48 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1872 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:49.549641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5c60c7a0-3818-4334-b24c-2d850f85a18a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:49.551265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5c60c7a0-3818-4334-b24c-2d850f85a18a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:49.561829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c60c7a0-3818-4334-b24c-2d850f85a18a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:49.562663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c60c7a0-3818-4334-b24c-2d850f85a18a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:49.563376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c60c7a0-3818-4334-b24c-2d850f85a18a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:49.564288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c60c7a0-3818-4334-b24c-2d850f85a18a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:49.565346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c60c7a0-3818-4334-b24c-2d850f85a18a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:49.567250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c60c7a0-3818-4334-b24c-2d850f85a18a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:49.670946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5c60c7a0-3818-4334-b24c-2d850f85a18a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:49.679688 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5c60c7a0-3818-4334-b24c-2d850f85a18a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 200 len: 1242 microversion: 2.1 time: 0.144437 Oct 04 21:34:49.684625 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2818/5618] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:49 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 1242 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:49.804550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-344ba3dd-8b4e-499f-9246-b07a322604ec tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:49.805495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-344ba3dd-8b4e-499f-9246-b07a322604ec tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:49.818647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-344ba3dd-8b4e-499f-9246-b07a322604ec tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:49.819162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-344ba3dd-8b4e-499f-9246-b07a322604ec tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:49.820340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-344ba3dd-8b4e-499f-9246-b07a322604ec tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:49.822885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-344ba3dd-8b4e-499f-9246-b07a322604ec tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:49.823584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-344ba3dd-8b4e-499f-9246-b07a322604ec tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:49.824185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-344ba3dd-8b4e-499f-9246-b07a322604ec tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:49.918034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-344ba3dd-8b4e-499f-9246-b07a322604ec tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:49.928638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-344ba3dd-8b4e-499f-9246-b07a322604ec tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:49.930134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-344ba3dd-8b4e-499f-9246-b07a322604ec tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:49.935300 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-344ba3dd-8b4e-499f-9246-b07a322604ec tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1872 microversion: 2.42 time: 0.132327 Oct 04 21:34:49.935300 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2801/5619] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:49 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1872 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:50.703972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-605261ec-15f2-4a61-aa9e-35f731c1ae96 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:50.704770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-605261ec-15f2-4a61-aa9e-35f731c1ae96 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:50.713811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-605261ec-15f2-4a61-aa9e-35f731c1ae96 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:50.714496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-605261ec-15f2-4a61-aa9e-35f731c1ae96 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:50.715042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-605261ec-15f2-4a61-aa9e-35f731c1ae96 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:50.715982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-605261ec-15f2-4a61-aa9e-35f731c1ae96 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:50.716676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-605261ec-15f2-4a61-aa9e-35f731c1ae96 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:50.717724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-605261ec-15f2-4a61-aa9e-35f731c1ae96 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:50.792796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-605261ec-15f2-4a61-aa9e-35f731c1ae96 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:50.800885 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-605261ec-15f2-4a61-aa9e-35f731c1ae96 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 200 len: 1290 microversion: 2.1 time: 0.100984 Oct 04 21:34:50.801491 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2819/5620] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:50 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 1290 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:50.960114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c6771f15-46e7-40fb-9e99-2bad2aaebfb6 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:50.961401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c6771f15-46e7-40fb-9e99-2bad2aaebfb6 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:50.990838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6771f15-46e7-40fb-9e99-2bad2aaebfb6 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:50.991660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6771f15-46e7-40fb-9e99-2bad2aaebfb6 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:50.992297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6771f15-46e7-40fb-9e99-2bad2aaebfb6 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:50.993058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6771f15-46e7-40fb-9e99-2bad2aaebfb6 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:50.997678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6771f15-46e7-40fb-9e99-2bad2aaebfb6 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:50.998135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6771f15-46e7-40fb-9e99-2bad2aaebfb6 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:51.078723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6771f15-46e7-40fb-9e99-2bad2aaebfb6 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:51.079230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6771f15-46e7-40fb-9e99-2bad2aaebfb6 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:51.079686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c6771f15-46e7-40fb-9e99-2bad2aaebfb6 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:51.080153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-c6771f15-46e7-40fb-9e99-2bad2aaebfb6 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lazy-loading 'fault' on Instance uuid 067dcc1c-2c94-41dd-8084-92d33e0f2d2f {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:34:51.142273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c6771f15-46e7-40fb-9e99-2bad2aaebfb6 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:51.152581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c6771f15-46e7-40fb-9e99-2bad2aaebfb6 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:51.154133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c6771f15-46e7-40fb-9e99-2bad2aaebfb6 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e97fbecf827246dc8dd8ab24e418cff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8479b5f07f048e6ac713898fa3ad78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:51.155366 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c6771f15-46e7-40fb-9e99-2bad2aaebfb6 tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 200 len: 1877 microversion: 2.42 time: 0.200207 Oct 04 21:34:51.156475 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2802/5621] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:50 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 1877 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:34:51.834529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6b3b644d-5090-405a-b3ac-501fb446afb3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:51.835083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6b3b644d-5090-405a-b3ac-501fb446afb3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:51.846018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b3b644d-5090-405a-b3ac-501fb446afb3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:51.846530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b3b644d-5090-405a-b3ac-501fb446afb3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:51.849581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b3b644d-5090-405a-b3ac-501fb446afb3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:51.849581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b3b644d-5090-405a-b3ac-501fb446afb3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:51.849581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b3b644d-5090-405a-b3ac-501fb446afb3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:51.849581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6b3b644d-5090-405a-b3ac-501fb446afb3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:51.942299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6b3b644d-5090-405a-b3ac-501fb446afb3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:51.954249 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6b3b644d-5090-405a-b3ac-501fb446afb3 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 200 len: 1296 microversion: 2.1 time: 0.123785 Oct 04 21:34:51.964776 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2820/5622] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:51 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 1296 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:52.187323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0c50a0e9-4164-4b1f-ab7c-0235468c28be tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:52.187947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0c50a0e9-4164-4b1f-ab7c-0235468c28be tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:52.203985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c50a0e9-4164-4b1f-ab7c-0235468c28be tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:52.203985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c50a0e9-4164-4b1f-ab7c-0235468c28be tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:52.203985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c50a0e9-4164-4b1f-ab7c-0235468c28be tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:52.203985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c50a0e9-4164-4b1f-ab7c-0235468c28be tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:52.217954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c50a0e9-4164-4b1f-ab7c-0235468c28be tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:52.217954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c50a0e9-4164-4b1f-ab7c-0235468c28be tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:52.239658 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-0c50a0e9-4164-4b1f-ab7c-0235468c28be tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] HTTP exception thrown: Instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f could not be found. Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0c50a0e9-4164-4b1f-ab7c-0235468c28be tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Request method failure captured: Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f HTTP/1.1 Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUdmcDt9Dk4wgFuMyv0FgQ-kcUTWeXReRVJcNlFoec2IJPGb0dmwEFT4L06q_Fhl7KAp4pXGpo-QgiOoi5t1kF0N3lSfQZT1UuGbEnQkNrZF4U_XVXobqHrFreKXa-Dk4o0ZCpTRXX-g_4wCNB49p4gqsaOyzz8sfgTDeXi8_trsrQ Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a8479b5f07f048e6ac713898fa3ad78d Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1097259032 Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8479b5f07f048e6ac713898fa3ad78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a8479b5f07f048e6ac713898fa3ad78d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a8479b5f07f048e6ac713898fa3ad78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8479b5f07f048e6ac713898fa3ad78d"}]}] Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1097259032 Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a8479b5f07f048e6ac713898fa3ad78d Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1097259032 Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TaggedBootDevicesTest_v242-1097259032-project Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: e97fbecf827246dc8dd8ab24e418cff3 Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1097259032-project Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f could not be found. Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '067dcc1c-2c94-41dd-8084-92d33e0f2d2f'} Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f could not be found. Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f could not be found. Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:34:52.240096 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:52.245224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:34:52.245224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:52.245224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:52.245224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:52.245224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:34:52.245224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:34:52.245224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f could not be found. Oct 04 21:34:52.245224 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:34:52.245224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0c50a0e9-4164-4b1f-ab7c-0235468c28be tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Returning 404 to user: Instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:34:52.245224 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0c50a0e9-4164-4b1f-ab7c-0235468c28be tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 404 len: 111 microversion: 2.42 time: 0.058251 Oct 04 21:34:52.245224 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2803/5623] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:52 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:34:52.251143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ac65633f-6a77-4691-8174-23fed504cc4b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '.version_select at 0x7f578b77b160>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:52.357551 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ac65633f-6a77-4691-8174-23fed504cc4b tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1290707702" status: 204 len: 0 microversion: 2.42 time: 0.110301 Oct 04 21:34:52.358075 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2821/5624] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Oct 4 21:34:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1290707702 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:34:52.986419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2ccb4874-13f9-4b21-8732-f8a5857f4b3b tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:52.987862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2ccb4874-13f9-4b21-8732-f8a5857f4b3b tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:52.996425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ccb4874-13f9-4b21-8732-f8a5857f4b3b tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:52.996993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ccb4874-13f9-4b21-8732-f8a5857f4b3b tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:52.997765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ccb4874-13f9-4b21-8732-f8a5857f4b3b tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:53.002509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ccb4874-13f9-4b21-8732-f8a5857f4b3b tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:53.002509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ccb4874-13f9-4b21-8732-f8a5857f4b3b tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:53.002509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ccb4874-13f9-4b21-8732-f8a5857f4b3b tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:53.251991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2ccb4874-13f9-4b21-8732-f8a5857f4b3b tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:53.272150 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2ccb4874-13f9-4b21-8732-f8a5857f4b3b tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 200 len: 1364 microversion: 2.1 time: 0.295671 Oct 04 21:34:53.281145 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2804/5625] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:52 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 1364 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:53.529734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-90666feb-677d-4350-a86f-f4aca16577db req-6de36c90-e56e-439b-bd58-0a786538e739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27cc7b20-edb9-468f-9262-252c2a3a5509", "tag": "794bbe14-6b37-4945-bb2d-c860a82fe5ac"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:53.560714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-90666feb-677d-4350-a86f-f4aca16577db req-6de36c90-e56e-439b-bd58-0a786538e739 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:53.561581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-90666feb-677d-4350-a86f-f4aca16577db req-6de36c90-e56e-439b-bd58-0a786538e739 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:53.562295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-90666feb-677d-4350-a86f-f4aca16577db req-6de36c90-e56e-439b-bd58-0a786538e739 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:53.593489 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-90666feb-677d-4350-a86f-f4aca16577db req-6de36c90-e56e-439b-bd58-0a786538e739 service nova] Creating event network-changed:794bbe14-6b37-4945-bb2d-c860a82fe5ac for instance 27cc7b20-edb9-468f-9262-252c2a3a5509 on n-h2-860282-1 Oct 04 21:34:53.599508 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-90666feb-677d-4350-a86f-f4aca16577db req-6de36c90-e56e-439b-bd58-0a786538e739 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073390 Oct 04 21:34:53.601020 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2822/5626] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:54.308712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2583ff42-dc88-4d06-8cf8-8c718e1ff6e7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:54.310505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2583ff42-dc88-4d06-8cf8-8c718e1ff6e7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:54.329914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2583ff42-dc88-4d06-8cf8-8c718e1ff6e7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:54.333515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2583ff42-dc88-4d06-8cf8-8c718e1ff6e7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:54.333515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2583ff42-dc88-4d06-8cf8-8c718e1ff6e7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:54.333515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2583ff42-dc88-4d06-8cf8-8c718e1ff6e7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:54.333515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2583ff42-dc88-4d06-8cf8-8c718e1ff6e7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:54.333515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2583ff42-dc88-4d06-8cf8-8c718e1ff6e7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:54.686858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2583ff42-dc88-4d06-8cf8-8c718e1ff6e7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:54.696037 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2583ff42-dc88-4d06-8cf8-8c718e1ff6e7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 200 len: 1364 microversion: 2.1 time: 0.392711 Oct 04 21:34:54.697319 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2805/5627] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:54 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 1364 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:55.722201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3f4487c1-8b44-47ee-990e-bc5e5b8315fa tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:55.733897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3f4487c1-8b44-47ee-990e-bc5e5b8315fa tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:55.733897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f4487c1-8b44-47ee-990e-bc5e5b8315fa tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:55.733897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f4487c1-8b44-47ee-990e-bc5e5b8315fa tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:55.733897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f4487c1-8b44-47ee-990e-bc5e5b8315fa tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:55.733897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f4487c1-8b44-47ee-990e-bc5e5b8315fa tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:55.733897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f4487c1-8b44-47ee-990e-bc5e5b8315fa tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:55.733897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f4487c1-8b44-47ee-990e-bc5e5b8315fa tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:55.967777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3f4487c1-8b44-47ee-990e-bc5e5b8315fa tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:55.983288 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3f4487c1-8b44-47ee-990e-bc5e5b8315fa tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 200 len: 1364 microversion: 2.1 time: 0.266088 Oct 04 21:34:55.987891 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2823/5628] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:55 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 1364 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:57.007356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-db6a94e5-9f95-4eca-976e-ac44fb6978b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:57.008166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-db6a94e5-9f95-4eca-976e-ac44fb6978b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:57.016438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db6a94e5-9f95-4eca-976e-ac44fb6978b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:57.016928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db6a94e5-9f95-4eca-976e-ac44fb6978b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:57.017409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db6a94e5-9f95-4eca-976e-ac44fb6978b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:57.018197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db6a94e5-9f95-4eca-976e-ac44fb6978b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:57.018643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db6a94e5-9f95-4eca-976e-ac44fb6978b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:57.019096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db6a94e5-9f95-4eca-976e-ac44fb6978b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:57.183313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-db6a94e5-9f95-4eca-976e-ac44fb6978b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:57.191172 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-db6a94e5-9f95-4eca-976e-ac44fb6978b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 200 len: 1364 microversion: 2.1 time: 0.188570 Oct 04 21:34:57.191917 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2806/5629] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:57 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:57.355552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-234ba634-95e8-4821-8fd8-856db68ca9cf tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:57.356550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-234ba634-95e8-4821-8fd8-856db68ca9cf tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:57.364536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-234ba634-95e8-4821-8fd8-856db68ca9cf tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:57.365208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-234ba634-95e8-4821-8fd8-856db68ca9cf tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:57.365697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-234ba634-95e8-4821-8fd8-856db68ca9cf tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:57.366419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-234ba634-95e8-4821-8fd8-856db68ca9cf tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:57.366854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-234ba634-95e8-4821-8fd8-856db68ca9cf tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:57.367285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-234ba634-95e8-4821-8fd8-856db68ca9cf tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:57.384201 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-234ba634-95e8-4821-8fd8-856db68ca9cf tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] HTTP exception thrown: Instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f could not be found. Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-234ba634-95e8-4821-8fd8-856db68ca9cf tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Request method failure captured: Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f HTTP/1.1 Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKUdmcDt9Dk4wgFuMyv0FgQ-kcUTWeXReRVJcNlFoec2IJPGb0dmwEFT4L06q_Fhl7KAp4pXGpo-QgiOoi5t1kF0N3lSfQZT1UuGbEnQkNrZF4U_XVXobqHrFreKXa-Dk4o0ZCpTRXX-g_4wCNB49p4gqsaOyzz8sfgTDeXi8_trsrQ Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a8479b5f07f048e6ac713898fa3ad78d Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1097259032 Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8479b5f07f048e6ac713898fa3ad78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a8479b5f07f048e6ac713898fa3ad78d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a8479b5f07f048e6ac713898fa3ad78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8479b5f07f048e6ac713898fa3ad78d"}]}] Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1097259032 Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a8479b5f07f048e6ac713898fa3ad78d Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1097259032 Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TaggedBootDevicesTest_v242-1097259032-project Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: e97fbecf827246dc8dd8ab24e418cff3 Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1097259032-project Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f could not be found. Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '067dcc1c-2c94-41dd-8084-92d33e0f2d2f'} Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f could not be found. Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:34:57.386211 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:34:57.395687 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f could not be found. Oct 04 21:34:57.395687 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:57.395687 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:57.395687 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:57.395687 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:57.395687 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:57.395687 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:57.395687 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:34:57.395687 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:34:57.395687 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f could not be found. Oct 04 21:34:57.395687 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:34:57.395687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-234ba634-95e8-4821-8fd8-856db68ca9cf tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Returning 404 to user: Instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:34:57.395687 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-234ba634-95e8-4821-8fd8-856db68ca9cf tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "DELETE /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 404 len: 111 microversion: 2.42 time: 0.038959 Oct 04 21:34:57.395687 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2824/5630] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:34:57 2022] DELETE /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:34:57.400118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cb1227f8-9816-4baa-b597-e5c0c154187c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:57.400762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cb1227f8-9816-4baa-b597-e5c0c154187c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] [instance: 067dcc1c-2c94-41dd-8084-92d33e0f2d2f] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:57.407285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb1227f8-9816-4baa-b597-e5c0c154187c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:57.407814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb1227f8-9816-4baa-b597-e5c0c154187c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:57.408257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb1227f8-9816-4baa-b597-e5c0c154187c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:57.408963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb1227f8-9816-4baa-b597-e5c0c154187c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:57.409445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb1227f8-9816-4baa-b597-e5c0c154187c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:57.409944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb1227f8-9816-4baa-b597-e5c0c154187c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:57.429412 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-cb1227f8-9816-4baa-b597-e5c0c154187c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] HTTP exception thrown: Instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f could not be found. Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cb1227f8-9816-4baa-b597-e5c0c154187c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Request method failure captured: Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f HTTP/1.1 Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKUdmcDt9Dk4wgFuMyv0FgQ-kcUTWeXReRVJcNlFoec2IJPGb0dmwEFT4L06q_Fhl7KAp4pXGpo-QgiOoi5t1kF0N3lSfQZT1UuGbEnQkNrZF4U_XVXobqHrFreKXa-Dk4o0ZCpTRXX-g_4wCNB49p4gqsaOyzz8sfgTDeXi8_trsrQ Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: a8479b5f07f048e6ac713898fa3ad78d Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1097259032 Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8479b5f07f048e6ac713898fa3ad78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a8479b5f07f048e6ac713898fa3ad78d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a8479b5f07f048e6ac713898fa3ad78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8479b5f07f048e6ac713898fa3ad78d"}]}] Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1097259032 Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: a8479b5f07f048e6ac713898fa3ad78d Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1097259032 Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TaggedBootDevicesTest_v242-1097259032-project Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: e97fbecf827246dc8dd8ab24e418cff3 Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1097259032-project Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f could not be found. Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '067dcc1c-2c94-41dd-8084-92d33e0f2d2f'} Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f could not be found. Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f could not be found. Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:34:57.431804 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:57.437621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:34:57.437621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:57.437621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:57.437621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:57.437621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:34:57.437621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:34:57.437621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f could not be found. Oct 04 21:34:57.437621 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:34:57.437621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cb1227f8-9816-4baa-b597-e5c0c154187c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] Returning 404 to user: Instance 067dcc1c-2c94-41dd-8084-92d33e0f2d2f could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:34:57.437621 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cb1227f8-9816-4baa-b597-e5c0c154187c tempest-TaggedBootDevicesTest_v242-1097259032 tempest-TaggedBootDevicesTest_v242-1097259032-project] 10.222.0.30 "GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f" status: 404 len: 111 microversion: 2.42 time: 0.038080 Oct 04 21:34:57.437621 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2807/5631] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:34:57 2022] GET /compute/v2.1/servers/067dcc1c-2c94-41dd-8084-92d33e0f2d2f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:34:58.216132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6e77cc9d-8378-4b53-bf13-5445452db5ab tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:58.217247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6e77cc9d-8378-4b53-bf13-5445452db5ab tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:58.249531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e77cc9d-8378-4b53-bf13-5445452db5ab tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:58.250374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e77cc9d-8378-4b53-bf13-5445452db5ab tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:58.252214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e77cc9d-8378-4b53-bf13-5445452db5ab tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:58.256329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e77cc9d-8378-4b53-bf13-5445452db5ab tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:58.256998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e77cc9d-8378-4b53-bf13-5445452db5ab tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:58.257671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e77cc9d-8378-4b53-bf13-5445452db5ab tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:58.438438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6e77cc9d-8378-4b53-bf13-5445452db5ab tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:58.450447 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6e77cc9d-8378-4b53-bf13-5445452db5ab tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 200 len: 1364 microversion: 2.1 time: 0.238750 Oct 04 21:34:58.456646 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2825/5632] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:58 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:59.481082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-db5a9bb5-81b9-4258-8a69-a135e0061d04 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:59.482012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-db5a9bb5-81b9-4258-8a69-a135e0061d04 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:59.485808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:59.486494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=10 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:59.492123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db5a9bb5-81b9-4258-8a69-a135e0061d04 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:59.492628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db5a9bb5-81b9-4258-8a69-a135e0061d04 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:59.494708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db5a9bb5-81b9-4258-8a69-a135e0061d04 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:59.495679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db5a9bb5-81b9-4258-8a69-a135e0061d04 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:59.496210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db5a9bb5-81b9-4258-8a69-a135e0061d04 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:59.496697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db5a9bb5-81b9-4258-8a69-a135e0061d04 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:59.676167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-db5a9bb5-81b9-4258-8a69-a135e0061d04 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:59.685762 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-db5a9bb5-81b9-4258-8a69-a135e0061d04 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 200 len: 1364 microversion: 2.1 time: 0.209077 Oct 04 21:34:59.686340 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2808/5633] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:59 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:00.708884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-75798975-950e-4f5f-9a78-9107858bd050 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:00.709618 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-75798975-950e-4f5f-9a78-9107858bd050 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:00.711716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:00.718096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75798975-950e-4f5f-9a78-9107858bd050 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:00.718671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75798975-950e-4f5f-9a78-9107858bd050 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:00.719186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75798975-950e-4f5f-9a78-9107858bd050 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:00.720568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75798975-950e-4f5f-9a78-9107858bd050 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:00.721109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75798975-950e-4f5f-9a78-9107858bd050 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:00.721642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75798975-950e-4f5f-9a78-9107858bd050 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:00.884786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-75798975-950e-4f5f-9a78-9107858bd050 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:00.898624 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-75798975-950e-4f5f-9a78-9107858bd050 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 200 len: 1364 microversion: 2.1 time: 0.193501 Oct 04 21:35:00.899612 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2826/5634] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:00 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:01.048392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-9cc67cde-93e9-48e3-850f-1dc8c949d7dc req-125cc244-8660-4f67-9aaf-8dabd76c5513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27cc7b20-edb9-468f-9262-252c2a3a5509", "name": "network-vif-plugged", "status": "completed", "tag": "794bbe14-6b37-4945-bb2d-c860a82fe5ac"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:01.055011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:01.068578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9cc67cde-93e9-48e3-850f-1dc8c949d7dc req-125cc244-8660-4f67-9aaf-8dabd76c5513 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:01.069072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9cc67cde-93e9-48e3-850f-1dc8c949d7dc req-125cc244-8660-4f67-9aaf-8dabd76c5513 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:01.071531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9cc67cde-93e9-48e3-850f-1dc8c949d7dc req-125cc244-8660-4f67-9aaf-8dabd76c5513 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:01.086822 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-9cc67cde-93e9-48e3-850f-1dc8c949d7dc req-125cc244-8660-4f67-9aaf-8dabd76c5513 service nova] Creating event network-vif-plugged:794bbe14-6b37-4945-bb2d-c860a82fe5ac for instance 27cc7b20-edb9-468f-9262-252c2a3a5509 on n-h2-860282-1 Oct 04 21:35:01.096554 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-9cc67cde-93e9-48e3-850f-1dc8c949d7dc req-125cc244-8660-4f67-9aaf-8dabd76c5513 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055285 Oct 04 21:35:01.097862 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2809/5635] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:01.923388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d951a3f9-7b4c-4fd3-bf5d-f739865416dd tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:01.926129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d951a3f9-7b4c-4fd3-bf5d-f739865416dd tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:01.936770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d951a3f9-7b4c-4fd3-bf5d-f739865416dd tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:01.937922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d951a3f9-7b4c-4fd3-bf5d-f739865416dd tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:01.938579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d951a3f9-7b4c-4fd3-bf5d-f739865416dd tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:01.939580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d951a3f9-7b4c-4fd3-bf5d-f739865416dd tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:01.940527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d951a3f9-7b4c-4fd3-bf5d-f739865416dd tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:01.941350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d951a3f9-7b4c-4fd3-bf5d-f739865416dd tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:02.145370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d951a3f9-7b4c-4fd3-bf5d-f739865416dd tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:02.157576 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d951a3f9-7b4c-4fd3-bf5d-f739865416dd tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 200 len: 1364 microversion: 2.1 time: 0.238520 Oct 04 21:35:02.173083 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2827/5636] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:01 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:02.542674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d7ad50cc-02e5-4431-80cd-6d26c43ffecb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:02.546342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d7ad50cc-02e5-4431-80cd-6d26c43ffecb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:02.558658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7ad50cc-02e5-4431-80cd-6d26c43ffecb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:02.559404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7ad50cc-02e5-4431-80cd-6d26c43ffecb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:02.560008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7ad50cc-02e5-4431-80cd-6d26c43ffecb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:02.561015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7ad50cc-02e5-4431-80cd-6d26c43ffecb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:02.561657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7ad50cc-02e5-4431-80cd-6d26c43ffecb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:02.562292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d7ad50cc-02e5-4431-80cd-6d26c43ffecb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:02.603480 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d7ad50cc-02e5-4431-80cd-6d26c43ffecb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments/dad872e4-4f4a-4d0e-9c97-4173ac1e5ade" status: 200 len: 194 microversion: 2.20 time: 0.065842 Oct 04 21:35:02.605007 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2810/5637] 10.222.0.30 () {60 vars in 1454 bytes} [Tue Oct 4 21:35:02 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments/dad872e4-4f4a-4d0e-9c97-4173ac1e5ade => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:35:02.779917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b35d8f31-2b37-4efa-862b-8a1fb0c6e59c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:02.781004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b35d8f31-2b37-4efa-862b-8a1fb0c6e59c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:02.788724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b35d8f31-2b37-4efa-862b-8a1fb0c6e59c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:02.789358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b35d8f31-2b37-4efa-862b-8a1fb0c6e59c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:02.789974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b35d8f31-2b37-4efa-862b-8a1fb0c6e59c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:02.790715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b35d8f31-2b37-4efa-862b-8a1fb0c6e59c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:02.791745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b35d8f31-2b37-4efa-862b-8a1fb0c6e59c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:02.792186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b35d8f31-2b37-4efa-862b-8a1fb0c6e59c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:02.889755 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-b35d8f31-2b37-4efa-862b-8a1fb0c6e59c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lazy-loading 'services' on Instance uuid 1b27171c-bb6d-43d4-836d-98fa1c3790d8 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:35:03.094906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:03.180569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fa9733eb-7990-47ef-bb15-486d738257f7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:03.181274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fa9733eb-7990-47ef-bb15-486d738257f7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:03.190357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa9733eb-7990-47ef-bb15-486d738257f7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:03.190597 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b35d8f31-2b37-4efa-862b-8a1fb0c6e59c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments/dad872e4-4f4a-4d0e-9c97-4173ac1e5ade" status: 202 len: 0 microversion: 2.20 time: 0.414902 Oct 04 21:35:03.191325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa9733eb-7990-47ef-bb15-486d738257f7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:03.194916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa9733eb-7990-47ef-bb15-486d738257f7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:03.194916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa9733eb-7990-47ef-bb15-486d738257f7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:03.194916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa9733eb-7990-47ef-bb15-486d738257f7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:03.194916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa9733eb-7990-47ef-bb15-486d738257f7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:03.195822 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2828/5638] 10.222.0.30 () {60 vars in 1457 bytes} [Tue Oct 4 21:35:02 2022] DELETE /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments/dad872e4-4f4a-4d0e-9c97-4173ac1e5ade => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:35:03.202597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-92b1e65f-d117-4e98-837a-49c0fe78422c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:03.205435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-92b1e65f-d117-4e98-837a-49c0fe78422c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:03.212048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92b1e65f-d117-4e98-837a-49c0fe78422c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:03.212627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92b1e65f-d117-4e98-837a-49c0fe78422c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:03.213324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92b1e65f-d117-4e98-837a-49c0fe78422c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:03.214421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92b1e65f-d117-4e98-837a-49c0fe78422c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:03.215070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92b1e65f-d117-4e98-837a-49c0fe78422c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:03.215695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92b1e65f-d117-4e98-837a-49c0fe78422c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:03.285523 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-92b1e65f-d117-4e98-837a-49c0fe78422c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082988 Oct 04 21:35:03.285523 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2829/5639] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Oct 4 21:35:03 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:35:03.375014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fa9733eb-7990-47ef-bb15-486d738257f7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:03.423799 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fa9733eb-7990-47ef-bb15-486d738257f7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 200 len: 1550 microversion: 2.1 time: 0.245288 Oct 04 21:35:03.426772 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2811/5640] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:03 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 1550 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:35:03.453628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6e0c6f98-da67-401d-b3a8-0cee6a78d9eb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:03.453628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6e0c6f98-da67-401d-b3a8-0cee6a78d9eb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:03.458166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:03.460363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e0c6f98-da67-401d-b3a8-0cee6a78d9eb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:03.461048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e0c6f98-da67-401d-b3a8-0cee6a78d9eb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:03.461584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e0c6f98-da67-401d-b3a8-0cee6a78d9eb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:03.471385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e0c6f98-da67-401d-b3a8-0cee6a78d9eb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:03.471961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e0c6f98-da67-401d-b3a8-0cee6a78d9eb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:03.472419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e0c6f98-da67-401d-b3a8-0cee6a78d9eb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:03.630370 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6e0c6f98-da67-401d-b3a8-0cee6a78d9eb tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185739 Oct 04 21:35:03.631484 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2830/5641] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:35:03 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:04.294822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-60c62016-d4d6-46d3-b0da-75234212ca75 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:04.297319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-60c62016-d4d6-46d3-b0da-75234212ca75 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:04.314147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60c62016-d4d6-46d3-b0da-75234212ca75 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:04.314856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60c62016-d4d6-46d3-b0da-75234212ca75 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:04.318222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60c62016-d4d6-46d3-b0da-75234212ca75 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:04.319278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60c62016-d4d6-46d3-b0da-75234212ca75 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:04.319757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60c62016-d4d6-46d3-b0da-75234212ca75 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:04.324406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60c62016-d4d6-46d3-b0da-75234212ca75 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:04.327482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:04.391954 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-60c62016-d4d6-46d3-b0da-75234212ca75 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102380 Oct 04 21:35:04.393146 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2812/5642] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Oct 4 21:35:04 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:35:05.408159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1e34bdcd-d89d-444a-8b16-577b88aa5904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:05.412441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1e34bdcd-d89d-444a-8b16-577b88aa5904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:05.422850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e34bdcd-d89d-444a-8b16-577b88aa5904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:05.423606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e34bdcd-d89d-444a-8b16-577b88aa5904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:05.424218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e34bdcd-d89d-444a-8b16-577b88aa5904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:05.425201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e34bdcd-d89d-444a-8b16-577b88aa5904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:05.425847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e34bdcd-d89d-444a-8b16-577b88aa5904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:05.426430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e34bdcd-d89d-444a-8b16-577b88aa5904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:05.454526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-07fb6029-b67a-47e0-a83f-a49b47600f71 req-d5f6b872-90b6-497d-a3b6-96b1433c5c10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27cc7b20-edb9-468f-9262-252c2a3a5509", "tag": "794bbe14-6b37-4945-bb2d-c860a82fe5ac"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:05.476440 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-07fb6029-b67a-47e0-a83f-a49b47600f71 req-d5f6b872-90b6-497d-a3b6-96b1433c5c10 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:05.476932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-07fb6029-b67a-47e0-a83f-a49b47600f71 req-d5f6b872-90b6-497d-a3b6-96b1433c5c10 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:05.477372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-07fb6029-b67a-47e0-a83f-a49b47600f71 req-d5f6b872-90b6-497d-a3b6-96b1433c5c10 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:05.496603 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1e34bdcd-d89d-444a-8b16-577b88aa5904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094607 Oct 04 21:35:05.503023 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2831/5643] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Oct 4 21:35:05 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:35:05.509279 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-07fb6029-b67a-47e0-a83f-a49b47600f71 req-d5f6b872-90b6-497d-a3b6-96b1433c5c10 service nova] Creating event network-changed:794bbe14-6b37-4945-bb2d-c860a82fe5ac for instance 27cc7b20-edb9-468f-9262-252c2a3a5509 on n-h2-860282-1 Oct 04 21:35:05.529234 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-07fb6029-b67a-47e0-a83f-a49b47600f71 req-d5f6b872-90b6-497d-a3b6-96b1433c5c10 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076315 Oct 04 21:35:05.532082 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2813/5644] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:35:06.510703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3e5fd7cd-084b-45e2-8abf-52ad5598639d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:06.513054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3e5fd7cd-084b-45e2-8abf-52ad5598639d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:06.521689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e5fd7cd-084b-45e2-8abf-52ad5598639d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:06.522189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e5fd7cd-084b-45e2-8abf-52ad5598639d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:06.522641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e5fd7cd-084b-45e2-8abf-52ad5598639d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:06.523359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e5fd7cd-084b-45e2-8abf-52ad5598639d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:06.523824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e5fd7cd-084b-45e2-8abf-52ad5598639d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:06.524866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e5fd7cd-084b-45e2-8abf-52ad5598639d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:06.654801 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3e5fd7cd-084b-45e2-8abf-52ad5598639d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.148476 Oct 04 21:35:06.655764 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2832/5645] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Oct 4 21:35:06 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:35:07.670387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c4b30818-bb98-4865-994e-b0978ea0e900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:07.673506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c4b30818-bb98-4865-994e-b0978ea0e900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:07.681352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4b30818-bb98-4865-994e-b0978ea0e900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:07.682567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4b30818-bb98-4865-994e-b0978ea0e900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:07.683112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4b30818-bb98-4865-994e-b0978ea0e900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:07.684228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4b30818-bb98-4865-994e-b0978ea0e900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:07.684793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4b30818-bb98-4865-994e-b0978ea0e900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:07.685334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4b30818-bb98-4865-994e-b0978ea0e900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:07.722781 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c4b30818-bb98-4865-994e-b0978ea0e900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058611 Oct 04 21:35:07.723540 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2814/5646] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Oct 4 21:35:07 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:35:08.738362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0f862e03-ccff-4a5e-ab3c-43c45cb656f6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:08.740564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0f862e03-ccff-4a5e-ab3c-43c45cb656f6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:08.748028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f862e03-ccff-4a5e-ab3c-43c45cb656f6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:08.754923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f862e03-ccff-4a5e-ab3c-43c45cb656f6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:08.754923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f862e03-ccff-4a5e-ab3c-43c45cb656f6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:08.754923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f862e03-ccff-4a5e-ab3c-43c45cb656f6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:08.754923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f862e03-ccff-4a5e-ab3c-43c45cb656f6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:08.754923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f862e03-ccff-4a5e-ab3c-43c45cb656f6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:08.782896 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0f862e03-ccff-4a5e-ab3c-43c45cb656f6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048626 Oct 04 21:35:08.793650 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2833/5647] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Oct 4 21:35:08 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:35:09.801174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d51f9c61-fcf3-475d-bc51-39035d2c4140 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:09.803383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d51f9c61-fcf3-475d-bc51-39035d2c4140 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:09.811751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d51f9c61-fcf3-475d-bc51-39035d2c4140 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:09.812219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d51f9c61-fcf3-475d-bc51-39035d2c4140 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:09.812663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d51f9c61-fcf3-475d-bc51-39035d2c4140 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:09.813371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d51f9c61-fcf3-475d-bc51-39035d2c4140 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:09.814023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d51f9c61-fcf3-475d-bc51-39035d2c4140 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:09.814467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d51f9c61-fcf3-475d-bc51-39035d2c4140 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:09.851629 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d51f9c61-fcf3-475d-bc51-39035d2c4140 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054846 Oct 04 21:35:09.852242 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2815/5648] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Oct 4 21:35:09 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:35:09.927335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1748a82d-d087-4ee3-9511-4bba3ca3a94f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:09.928713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1748a82d-d087-4ee3-9511-4bba3ca3a94f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:09.935704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1748a82d-d087-4ee3-9511-4bba3ca3a94f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:09.936540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1748a82d-d087-4ee3-9511-4bba3ca3a94f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:09.936971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1748a82d-d087-4ee3-9511-4bba3ca3a94f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:09.937716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1748a82d-d087-4ee3-9511-4bba3ca3a94f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:09.938176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1748a82d-d087-4ee3-9511-4bba3ca3a94f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:09.938775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1748a82d-d087-4ee3-9511-4bba3ca3a94f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:09.968449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1748a82d-d087-4ee3-9511-4bba3ca3a94f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:35:10.337134 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1748a82d-d087-4ee3-9511-4bba3ca3a94f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 204 len: 0 microversion: 2.20 time: 0.414330 Oct 04 21:35:10.338815 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2834/5649] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:35:09 2022] DELETE /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:35:10.348260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a4f391e4-68b4-49c5-adb8-cc0e05b40d7f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:10.349026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a4f391e4-68b4-49c5-adb8-cc0e05b40d7f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:10.356110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4f391e4-68b4-49c5-adb8-cc0e05b40d7f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:10.356767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4f391e4-68b4-49c5-adb8-cc0e05b40d7f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:10.357311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4f391e4-68b4-49c5-adb8-cc0e05b40d7f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:10.358341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4f391e4-68b4-49c5-adb8-cc0e05b40d7f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:10.358882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4f391e4-68b4-49c5-adb8-cc0e05b40d7f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:10.359403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4f391e4-68b4-49c5-adb8-cc0e05b40d7f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:10.547157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a4f391e4-68b4-49c5-adb8-cc0e05b40d7f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:10.560621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a4f391e4-68b4-49c5-adb8-cc0e05b40d7f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:10.562730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a4f391e4-68b4-49c5-adb8-cc0e05b40d7f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:10.564920 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a4f391e4-68b4-49c5-adb8-cc0e05b40d7f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1723 microversion: 2.20 time: 0.221108 Oct 04 21:35:10.565831 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2816/5650] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:35:10 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:35:11.592869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-532e46e4-f7e3-4cb9-8702-256872939e23 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:11.593650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-532e46e4-f7e3-4cb9-8702-256872939e23 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:11.601367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-532e46e4-f7e3-4cb9-8702-256872939e23 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:11.601986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-532e46e4-f7e3-4cb9-8702-256872939e23 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:11.602525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-532e46e4-f7e3-4cb9-8702-256872939e23 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:11.603358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-532e46e4-f7e3-4cb9-8702-256872939e23 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:11.603887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-532e46e4-f7e3-4cb9-8702-256872939e23 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:11.604467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-532e46e4-f7e3-4cb9-8702-256872939e23 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:11.755039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-532e46e4-f7e3-4cb9-8702-256872939e23 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:11.764716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-532e46e4-f7e3-4cb9-8702-256872939e23 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:11.766223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-532e46e4-f7e3-4cb9-8702-256872939e23 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:11.767422 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-532e46e4-f7e3-4cb9-8702-256872939e23 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1723 microversion: 2.20 time: 0.179744 Oct 04 21:35:11.768002 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2835/5651] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:35:11 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:35:12.800359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-52f0800f-2f3b-4757-bf4f-242075e1825d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:12.801664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-52f0800f-2f3b-4757-bf4f-242075e1825d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:12.829137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52f0800f-2f3b-4757-bf4f-242075e1825d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:12.829137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52f0800f-2f3b-4757-bf4f-242075e1825d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:12.829137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52f0800f-2f3b-4757-bf4f-242075e1825d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:12.829137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52f0800f-2f3b-4757-bf4f-242075e1825d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:12.829137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52f0800f-2f3b-4757-bf4f-242075e1825d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:12.831594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-52f0800f-2f3b-4757-bf4f-242075e1825d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:13.225218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-52f0800f-2f3b-4757-bf4f-242075e1825d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:13.238926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-52f0800f-2f3b-4757-bf4f-242075e1825d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:13.240536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-52f0800f-2f3b-4757-bf4f-242075e1825d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:13.242501 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-52f0800f-2f3b-4757-bf4f-242075e1825d tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1723 microversion: 2.20 time: 0.451280 Oct 04 21:35:13.251442 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2817/5652] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:35:12 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1723 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:35:13.571350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-5f029f5c-c989-4bbb-a5f7-b2ffdc087322 req-ab9efde1-3cd1-4676-b806-e59f60390103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b27171c-bb6d-43d4-836d-98fa1c3790d8", "name": "network-vif-deleted", "tag": "eaa67688-784e-449d-a04b-3ad12dd87fdc"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:13.612282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-5f029f5c-c989-4bbb-a5f7-b2ffdc087322 req-ab9efde1-3cd1-4676-b806-e59f60390103 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:13.621193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-5f029f5c-c989-4bbb-a5f7-b2ffdc087322 req-ab9efde1-3cd1-4676-b806-e59f60390103 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:13.621865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-5f029f5c-c989-4bbb-a5f7-b2ffdc087322 req-ab9efde1-3cd1-4676-b806-e59f60390103 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:13.657697 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-5f029f5c-c989-4bbb-a5f7-b2ffdc087322 req-ab9efde1-3cd1-4676-b806-e59f60390103 service nova] Creating event network-vif-deleted:eaa67688-784e-449d-a04b-3ad12dd87fdc for instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 on n-h1-860282-1 Oct 04 21:35:13.691279 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-5f029f5c-c989-4bbb-a5f7-b2ffdc087322 req-ab9efde1-3cd1-4676-b806-e59f60390103 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123839 Oct 04 21:35:13.694039 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2836/5653] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:14.274235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b19a3a19-649e-4bf2-8c04-05267548c294 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:14.277821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b19a3a19-649e-4bf2-8c04-05267548c294 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:14.288772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b19a3a19-649e-4bf2-8c04-05267548c294 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:14.289326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b19a3a19-649e-4bf2-8c04-05267548c294 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:14.289743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b19a3a19-649e-4bf2-8c04-05267548c294 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:14.290469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b19a3a19-649e-4bf2-8c04-05267548c294 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:14.291518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b19a3a19-649e-4bf2-8c04-05267548c294 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:14.292193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b19a3a19-649e-4bf2-8c04-05267548c294 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:14.354797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b19a3a19-649e-4bf2-8c04-05267548c294 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:14.355318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b19a3a19-649e-4bf2-8c04-05267548c294 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:14.355818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b19a3a19-649e-4bf2-8c04-05267548c294 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:14.356286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-b19a3a19-649e-4bf2-8c04-05267548c294 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lazy-loading 'fault' on Instance uuid 1b27171c-bb6d-43d4-836d-98fa1c3790d8 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:35:14.435055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b19a3a19-649e-4bf2-8c04-05267548c294 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:14.445596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b19a3a19-649e-4bf2-8c04-05267548c294 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:14.453842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b19a3a19-649e-4bf2-8c04-05267548c294 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:14.455387 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b19a3a19-649e-4bf2-8c04-05267548c294 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 200 len: 1372 microversion: 2.20 time: 0.185830 Oct 04 21:35:14.465035 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2818/5654] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:35:14 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:35:15.493382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-205b0299-bd1e-4d26-a839-5bc5436b3daa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:15.494962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-205b0299-bd1e-4d26-a839-5bc5436b3daa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:15.508462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-205b0299-bd1e-4d26-a839-5bc5436b3daa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:15.508462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-205b0299-bd1e-4d26-a839-5bc5436b3daa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:15.508462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-205b0299-bd1e-4d26-a839-5bc5436b3daa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:15.508462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-205b0299-bd1e-4d26-a839-5bc5436b3daa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:15.510285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-205b0299-bd1e-4d26-a839-5bc5436b3daa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:15.510285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-205b0299-bd1e-4d26-a839-5bc5436b3daa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:15.533086 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-205b0299-bd1e-4d26-a839-5bc5436b3daa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] HTTP exception thrown: Instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 could not be found. Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-205b0299-bd1e-4d26-a839-5bc5436b3daa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Request method failure captured: Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 HTTP/1.1 Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKZgyJyR7VmgdJLEkwR5b1trzvCrMRVE0S_5kujKYuisXPTH0PySulsZuRNbmG3WvslVrCsoSWnMgpf-657L1tXvTNLwRznlPhAUYg9ID68MS5klN-NTQOWU_PdwOm2JVB2dv_uKL7wuXgdZ824SlPUgTR8Di4X_u_iCw_zbcdP4iVo Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: e2812d680b26415fb5930200c01cb327 Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-474320935 Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2812d680b26415fb5930200c01cb327"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e2812d680b26415fb5930200c01cb327"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e2812d680b26415fb5930200c01cb327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2812d680b26415fb5930200c01cb327"}]}] Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AttachVolumeShelveTestJSON-474320935 Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: e2812d680b26415fb5930200c01cb327 Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-474320935 Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AttachVolumeShelveTestJSON-474320935-project Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 18f3a21b780248d0943136e68b4a4536 Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AttachVolumeShelveTestJSON-474320935-project Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 could not be found. Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '1b27171c-bb6d-43d4-836d-98fa1c3790d8'} Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 could not be found. Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 could not be found. Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:35:15.541970 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:35:15.546580 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:35:15.546580 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:15.546580 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:15.546580 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:15.546580 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:35:15.546580 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:35:15.546580 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 could not be found. Oct 04 21:35:15.546580 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:35:15.546580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-205b0299-bd1e-4d26-a839-5bc5436b3daa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Returning 404 to user: Instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:35:15.546580 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-205b0299-bd1e-4d26-a839-5bc5436b3daa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 404 len: 111 microversion: 2.20 time: 0.050956 Oct 04 21:35:15.546580 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2837/5655] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:35:15 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:35:15.549364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d7a966ee-0b37-4669-a265-791134c6a750 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '.version_select at 0x7f578b6781f0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:15.649954 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d7a966ee-0b37-4669-a265-791134c6a750 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1033865774" status: 204 len: 0 microversion: 2.20 time: 0.103590 Oct 04 21:35:15.652844 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2819/5656] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Oct 4 21:35:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1033865774 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 21:35:15.746969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0fa71d94-a01a-49d5-a690-44b56bbcd682 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:15.746969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0fa71d94-a01a-49d5-a690-44b56bbcd682 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:15.756620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fa71d94-a01a-49d5-a690-44b56bbcd682 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:15.757125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fa71d94-a01a-49d5-a690-44b56bbcd682 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:15.757617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fa71d94-a01a-49d5-a690-44b56bbcd682 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:15.758535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fa71d94-a01a-49d5-a690-44b56bbcd682 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:15.759364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fa71d94-a01a-49d5-a690-44b56bbcd682 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:15.760770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fa71d94-a01a-49d5-a690-44b56bbcd682 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:15.794902 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0fa71d94-a01a-49d5-a690-44b56bbcd682 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/ips" status: 200 len: 149 microversion: 2.1 time: 0.049248 Oct 04 21:35:15.796163 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2838/5657] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Oct 4 21:35:15 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/ips => generated 149 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:17.179902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-53a27a88-f593-46d3-a597-2521831b593f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Action: 'create', calling method: .version_select at 0x7f5794561280>, body: {"keypair": {"name": "tempest-keypair-2054899522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8+HovyaYLdJpZWNvbE+o/FF7lBMhj7pe8KBrSdfqMvTsvVTf7mf+F21pmhwmxCWmT8xAi5rnnRyuF0klnTkL0D4cGGosDlw0NRz28ZIQHUkzlSuB98FmAzzrlfOc9vVQ=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:17.200344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-53a27a88-f593-46d3-a597-2521831b593f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Getting quotas for project e2812d680b26415fb5930200c01cb327. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:35:17.206656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-53a27a88-f593-46d3-a597-2521831b593f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Getting quotas for user 18f3a21b780248d0943136e68b4a4536 and project e2812d680b26415fb5930200c01cb327. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:35:17.313113 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-53a27a88-f593-46d3-a597-2521831b593f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.143277 Oct 04 21:35:17.320036 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2820/5658] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Oct 4 21:35:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:35:18.893046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cf9e8061-a129-4cdb-8b84-5cbb50335d80 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c9408d4-9dba-4611-a11c-045ddf60534e"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:18.895451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cf9e8061-a129-4cdb-8b84-5cbb50335d80 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:18.903552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf9e8061-a129-4cdb-8b84-5cbb50335d80 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:18.904271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf9e8061-a129-4cdb-8b84-5cbb50335d80 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:18.911634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf9e8061-a129-4cdb-8b84-5cbb50335d80 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:18.911634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf9e8061-a129-4cdb-8b84-5cbb50335d80 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:18.911634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf9e8061-a129-4cdb-8b84-5cbb50335d80 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:18.911634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf9e8061-a129-4cdb-8b84-5cbb50335d80 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:19.847180 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cf9e8061-a129-4cdb-8b84-5cbb50335d80 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "POST /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.957640 Oct 04 21:35:19.869464 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2839/5659] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 21:35:18 2022] POST /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-volume_attachments => generated 194 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:21.442370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f1e129f8-90d1-4ceb-addb-22f5371aa804 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1659738447", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "00641ee4-fa60-49c2-ab79-499beaf19a7f"}], "security_groups": [{"name": "tempest-securitygroup--1360415370"}], "key_name": "tempest-keypair-2054899522", "user_data": "}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:21.620218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-f1e129f8-90d1-4ceb-addb-22f5371aa804 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] validate_networks() for [('00641ee4-fa60-49c2-ab79-499beaf19a7f', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:35:22.173367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f1e129f8-90d1-4ceb-addb-22f5371aa804 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:35:22.173824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f1e129f8-90d1-4ceb-addb-22f5371aa804 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:35:22.175266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f1e129f8-90d1-4ceb-addb-22f5371aa804 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:35:22.175684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f1e129f8-90d1-4ceb-addb-22f5371aa804 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:35:22.176453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-f1e129f8-90d1-4ceb-addb-22f5371aa804 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:35:22.195653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1e129f8-90d1-4ceb-addb-22f5371aa804 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:22.195653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1e129f8-90d1-4ceb-addb-22f5371aa804 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:22.195653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1e129f8-90d1-4ceb-addb-22f5371aa804 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:22.195653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1e129f8-90d1-4ceb-addb-22f5371aa804 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:22.195653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1e129f8-90d1-4ceb-addb-22f5371aa804 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:22.195653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f1e129f8-90d1-4ceb-addb-22f5371aa804 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:22.220789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-f1e129f8-90d1-4ceb-addb-22f5371aa804 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Getting quotas for project e2812d680b26415fb5930200c01cb327. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:35:22.226613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-f1e129f8-90d1-4ceb-addb-22f5371aa804 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Getting quotas for user 18f3a21b780248d0943136e68b4a4536 and project e2812d680b26415fb5930200c01cb327. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:35:22.244290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f1e129f8-90d1-4ceb-addb-22f5371aa804 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:35:22.247634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f1e129f8-90d1-4ceb-addb-22f5371aa804 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:35:22.429345 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f1e129f8-90d1-4ceb-addb-22f5371aa804 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.992440 Oct 04 21:35:22.430034 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2821/5660] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Oct 4 21:35:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:35:22.443556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2f239b5c-311f-4820-9084-1518fd4d2eff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:22.444209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2f239b5c-311f-4820-9084-1518fd4d2eff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:22.578266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2f239b5c-311f-4820-9084-1518fd4d2eff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:22.590148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2f239b5c-311f-4820-9084-1518fd4d2eff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:22.592288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2f239b5c-311f-4820-9084-1518fd4d2eff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:22.601598 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2f239b5c-311f-4820-9084-1518fd4d2eff tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1282 microversion: 2.20 time: 0.155372 Oct 04 21:35:22.602747 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2840/5661] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:35:22 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:35:23.632595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-489fd738-ca1b-41df-bf4b-23c8e0670bde tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:23.636544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-489fd738-ca1b-41df-bf4b-23c8e0670bde tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:23.725076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-489fd738-ca1b-41df-bf4b-23c8e0670bde tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:23.740776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-489fd738-ca1b-41df-bf4b-23c8e0670bde tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:23.742527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-489fd738-ca1b-41df-bf4b-23c8e0670bde tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:23.743891 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-489fd738-ca1b-41df-bf4b-23c8e0670bde tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1282 microversion: 2.20 time: 0.116013 Oct 04 21:35:23.744940 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2822/5662] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:35:23 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1282 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:35:24.772973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1a8424c5-7b7c-4e3b-b72a-a26881c4b6fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:24.774492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1a8424c5-7b7c-4e3b-b72a-a26881c4b6fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:24.787352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a8424c5-7b7c-4e3b-b72a-a26881c4b6fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:24.791692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a8424c5-7b7c-4e3b-b72a-a26881c4b6fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:24.791692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a8424c5-7b7c-4e3b-b72a-a26881c4b6fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:24.791692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a8424c5-7b7c-4e3b-b72a-a26881c4b6fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:24.791692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a8424c5-7b7c-4e3b-b72a-a26881c4b6fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:24.791692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a8424c5-7b7c-4e3b-b72a-a26881c4b6fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:24.934371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1a8424c5-7b7c-4e3b-b72a-a26881c4b6fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:24.949773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1a8424c5-7b7c-4e3b-b72a-a26881c4b6fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:24.952785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1a8424c5-7b7c-4e3b-b72a-a26881c4b6fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:24.954169 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1a8424c5-7b7c-4e3b-b72a-a26881c4b6fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1334 microversion: 2.20 time: 0.185927 Oct 04 21:35:24.966838 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2841/5663] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:35:24 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1334 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:35:25.985479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-29fa83ca-5208-4c1b-ab48-bba97adeb1cb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:25.988565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-29fa83ca-5208-4c1b-ab48-bba97adeb1cb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:26.007231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29fa83ca-5208-4c1b-ab48-bba97adeb1cb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:26.008107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29fa83ca-5208-4c1b-ab48-bba97adeb1cb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:26.008841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29fa83ca-5208-4c1b-ab48-bba97adeb1cb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:26.010335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29fa83ca-5208-4c1b-ab48-bba97adeb1cb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:26.010812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29fa83ca-5208-4c1b-ab48-bba97adeb1cb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:26.011257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-29fa83ca-5208-4c1b-ab48-bba97adeb1cb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:26.213049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-29fa83ca-5208-4c1b-ab48-bba97adeb1cb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:26.223115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-29fa83ca-5208-4c1b-ab48-bba97adeb1cb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:26.225223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-29fa83ca-5208-4c1b-ab48-bba97adeb1cb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:26.228740 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-29fa83ca-5208-4c1b-ab48-bba97adeb1cb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1352 microversion: 2.20 time: 0.248019 Oct 04 21:35:26.230210 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2823/5664] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:35:25 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1352 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:35:27.258134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a8e464a3-5356-47a7-89f0-27b6351c094a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:27.259342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a8e464a3-5356-47a7-89f0-27b6351c094a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:27.272806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8e464a3-5356-47a7-89f0-27b6351c094a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:27.273620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8e464a3-5356-47a7-89f0-27b6351c094a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:27.276404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8e464a3-5356-47a7-89f0-27b6351c094a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:27.277163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8e464a3-5356-47a7-89f0-27b6351c094a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:27.277671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8e464a3-5356-47a7-89f0-27b6351c094a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:27.278217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a8e464a3-5356-47a7-89f0-27b6351c094a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:27.524225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a8e464a3-5356-47a7-89f0-27b6351c094a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:27.534566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a8e464a3-5356-47a7-89f0-27b6351c094a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:27.536576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a8e464a3-5356-47a7-89f0-27b6351c094a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:27.537942 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a8e464a3-5356-47a7-89f0-27b6351c094a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1408 microversion: 2.20 time: 0.283787 Oct 04 21:35:27.551443 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2842/5665] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:35:27 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1408 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:35:28.287619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-4faa4a40-8a2a-4cf8-897f-13e9988d9f56 req-78f2af80-2bce-47c0-9267-d555f767d2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa024b1-e789-4226-b10a-07bf3ca97ecc", "tag": "f058e4a1-c25d-417e-8d41-b82e64725e18"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:28.304699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4faa4a40-8a2a-4cf8-897f-13e9988d9f56 req-78f2af80-2bce-47c0-9267-d555f767d2a6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:28.305492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4faa4a40-8a2a-4cf8-897f-13e9988d9f56 req-78f2af80-2bce-47c0-9267-d555f767d2a6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:28.306509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4faa4a40-8a2a-4cf8-897f-13e9988d9f56 req-78f2af80-2bce-47c0-9267-d555f767d2a6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:28.324815 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-4faa4a40-8a2a-4cf8-897f-13e9988d9f56 req-78f2af80-2bce-47c0-9267-d555f767d2a6 service nova] Creating event network-changed:f058e4a1-c25d-417e-8d41-b82e64725e18 for instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc on n-h1-860282-1 Oct 04 21:35:28.330572 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-4faa4a40-8a2a-4cf8-897f-13e9988d9f56 req-78f2af80-2bce-47c0-9267-d555f767d2a6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048659 Oct 04 21:35:28.336863 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2824/5666] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:28.568300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-83b97f2b-e49a-4ba3-bc44-082cf35f80fe tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:28.569067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-83b97f2b-e49a-4ba3-bc44-082cf35f80fe tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:28.578649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83b97f2b-e49a-4ba3-bc44-082cf35f80fe tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:28.579554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83b97f2b-e49a-4ba3-bc44-082cf35f80fe tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:28.580333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83b97f2b-e49a-4ba3-bc44-082cf35f80fe tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:28.581252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83b97f2b-e49a-4ba3-bc44-082cf35f80fe tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:28.582022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83b97f2b-e49a-4ba3-bc44-082cf35f80fe tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:28.583265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83b97f2b-e49a-4ba3-bc44-082cf35f80fe tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:28.760480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-83b97f2b-e49a-4ba3-bc44-082cf35f80fe tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:28.770053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-83b97f2b-e49a-4ba3-bc44-082cf35f80fe tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:28.771517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-83b97f2b-e49a-4ba3-bc44-082cf35f80fe tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:28.772643 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-83b97f2b-e49a-4ba3-bc44-082cf35f80fe tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1408 microversion: 2.20 time: 0.212399 Oct 04 21:35:28.773210 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2843/5667] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:35:28 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:35:29.800689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-83507dfc-583a-4695-9569-323dd600c0d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:29.801849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-83507dfc-583a-4695-9569-323dd600c0d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:29.810147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83507dfc-583a-4695-9569-323dd600c0d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:29.811353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83507dfc-583a-4695-9569-323dd600c0d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:29.812005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83507dfc-583a-4695-9569-323dd600c0d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:29.812822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83507dfc-583a-4695-9569-323dd600c0d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:29.814149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83507dfc-583a-4695-9569-323dd600c0d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:29.815044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83507dfc-583a-4695-9569-323dd600c0d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:30.013534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-83507dfc-583a-4695-9569-323dd600c0d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:30.023374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-83507dfc-583a-4695-9569-323dd600c0d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:30.025388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-83507dfc-583a-4695-9569-323dd600c0d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:30.027241 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-83507dfc-583a-4695-9569-323dd600c0d5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1408 microversion: 2.20 time: 0.232183 Oct 04 21:35:30.028183 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2825/5668] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:35:29 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:35:31.056700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-088e613b-912a-4b5a-98bd-aa3c6f18b2db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:31.059198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-088e613b-912a-4b5a-98bd-aa3c6f18b2db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:31.067317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-088e613b-912a-4b5a-98bd-aa3c6f18b2db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:31.068209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-088e613b-912a-4b5a-98bd-aa3c6f18b2db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:31.069173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-088e613b-912a-4b5a-98bd-aa3c6f18b2db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:31.070104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-088e613b-912a-4b5a-98bd-aa3c6f18b2db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:31.070747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-088e613b-912a-4b5a-98bd-aa3c6f18b2db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:31.071425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-088e613b-912a-4b5a-98bd-aa3c6f18b2db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:31.248317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-088e613b-912a-4b5a-98bd-aa3c6f18b2db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:31.257727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-088e613b-912a-4b5a-98bd-aa3c6f18b2db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:31.259473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-088e613b-912a-4b5a-98bd-aa3c6f18b2db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:31.262665 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-088e613b-912a-4b5a-98bd-aa3c6f18b2db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1408 microversion: 2.20 time: 0.213387 Oct 04 21:35:31.263949 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2844/5669] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:35:31 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:35:32.295972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-20b3af0d-bfa5-4430-b417-107ff0eb596f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:32.299358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-20b3af0d-bfa5-4430-b417-107ff0eb596f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:32.321642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:32.324522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20b3af0d-bfa5-4430-b417-107ff0eb596f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:32.325214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20b3af0d-bfa5-4430-b417-107ff0eb596f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:32.325891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20b3af0d-bfa5-4430-b417-107ff0eb596f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:32.326888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20b3af0d-bfa5-4430-b417-107ff0eb596f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:32.328240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20b3af0d-bfa5-4430-b417-107ff0eb596f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:32.328697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20b3af0d-bfa5-4430-b417-107ff0eb596f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:32.502993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-20b3af0d-bfa5-4430-b417-107ff0eb596f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:32.515651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-20b3af0d-bfa5-4430-b417-107ff0eb596f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:32.519162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-20b3af0d-bfa5-4430-b417-107ff0eb596f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:32.520826 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-20b3af0d-bfa5-4430-b417-107ff0eb596f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1408 microversion: 2.20 time: 0.234076 Oct 04 21:35:32.534765 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2826/5670] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:35:32 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1408 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:35:33.550925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f5b79077-4476-497a-8371-833c08d7989f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:33.557545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f5b79077-4476-497a-8371-833c08d7989f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:33.566967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:33.570182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:33.575767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5b79077-4476-497a-8371-833c08d7989f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:33.576289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5b79077-4476-497a-8371-833c08d7989f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:33.576746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5b79077-4476-497a-8371-833c08d7989f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:33.583922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5b79077-4476-497a-8371-833c08d7989f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:33.586052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5b79077-4476-497a-8371-833c08d7989f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:33.591941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f5b79077-4476-497a-8371-833c08d7989f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:33.598408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=92,nova_cell1:UPDATE=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:33.805170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-8b2e366e-2db7-4c46-bfa9-f3a1ce284cc6 req-a670927f-de3b-4b13-a9ea-52c5d08732e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa024b1-e789-4226-b10a-07bf3ca97ecc", "name": "network-vif-plugged", "status": "completed", "tag": "f058e4a1-c25d-417e-8d41-b82e64725e18"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:33.820255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=12 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:33.825164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:33.836454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8b2e366e-2db7-4c46-bfa9-f3a1ce284cc6 req-a670927f-de3b-4b13-a9ea-52c5d08732e1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:33.836957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8b2e366e-2db7-4c46-bfa9-f3a1ce284cc6 req-a670927f-de3b-4b13-a9ea-52c5d08732e1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:33.847616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8b2e366e-2db7-4c46-bfa9-f3a1ce284cc6 req-a670927f-de3b-4b13-a9ea-52c5d08732e1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:33.888595 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-8b2e366e-2db7-4c46-bfa9-f3a1ce284cc6 req-a670927f-de3b-4b13-a9ea-52c5d08732e1 service nova] Creating event network-vif-plugged:f058e4a1-c25d-417e-8d41-b82e64725e18 for instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc on n-h1-860282-1 Oct 04 21:35:33.906308 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-8b2e366e-2db7-4c46-bfa9-f3a1ce284cc6 req-a670927f-de3b-4b13-a9ea-52c5d08732e1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108909 Oct 04 21:35:33.906950 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2827/5671] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 21:35:34.010372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f5b79077-4476-497a-8371-833c08d7989f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:34.021995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f5b79077-4476-497a-8371-833c08d7989f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:34.023713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f5b79077-4476-497a-8371-833c08d7989f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:34.028417 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f5b79077-4476-497a-8371-833c08d7989f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1408 microversion: 2.20 time: 0.480650 Oct 04 21:35:34.029542 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2845/5672] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:35:33 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1408 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:35:34.634934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-028e8ff4-5d15-4999-9d77-85b6578bf98b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Action: 'create', calling method: .version_select at 0x7f578b488d30>, body: {"keypair": {"name": "tempest-keypair-349696836", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1p3FMrYkjlapXYNMdchSi6VrisEfxVX6ACeSlF+wzDs/5/AmG+JddH/612uWtbSzWIILmqpD4d8CgsR7BgWlZ8YOmXt/Owk9JGgsZwieK2zYgmPoIKQSIJAQEez0ANBw=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:34.694086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-028e8ff4-5d15-4999-9d77-85b6578bf98b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Getting quotas for project f7a12e438f0e4e9a83b0ab95f50c791c. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:35:34.709095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-028e8ff4-5d15-4999-9d77-85b6578bf98b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Getting quotas for user 68a2203c15fe41d8ae410f31ba1e1301 and project f7a12e438f0e4e9a83b0ab95f50c791c. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:35:34.830928 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-028e8ff4-5d15-4999-9d77-85b6578bf98b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.200423 Oct 04 21:35:34.837078 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2828/5673] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:35:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:35.057600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1a1038b2-032c-46fc-a973-4d13d71a16f7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:35.058252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1a1038b2-032c-46fc-a973-4d13d71a16f7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:35.073767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a1038b2-032c-46fc-a973-4d13d71a16f7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:35.074283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a1038b2-032c-46fc-a973-4d13d71a16f7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:35.074744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a1038b2-032c-46fc-a973-4d13d71a16f7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:35.077296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a1038b2-032c-46fc-a973-4d13d71a16f7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:35.077850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a1038b2-032c-46fc-a973-4d13d71a16f7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:35.078302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a1038b2-032c-46fc-a973-4d13d71a16f7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:35.625156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1a1038b2-032c-46fc-a973-4d13d71a16f7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:35.637465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1a1038b2-032c-46fc-a973-4d13d71a16f7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:35.639239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1a1038b2-032c-46fc-a973-4d13d71a16f7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:35.640578 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1a1038b2-032c-46fc-a973-4d13d71a16f7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1408 microversion: 2.20 time: 0.589335 Oct 04 21:35:35.646372 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2846/5674] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:35:35 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1408 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:35:36.668638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-933b6470-676b-427b-b063-cbf3b81f4e92 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:36.675246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-933b6470-676b-427b-b063-cbf3b81f4e92 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:36.697018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-933b6470-676b-427b-b063-cbf3b81f4e92 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:36.699309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-933b6470-676b-427b-b063-cbf3b81f4e92 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:36.699805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-933b6470-676b-427b-b063-cbf3b81f4e92 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:36.700563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-933b6470-676b-427b-b063-cbf3b81f4e92 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:36.704185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-933b6470-676b-427b-b063-cbf3b81f4e92 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:36.708061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-933b6470-676b-427b-b063-cbf3b81f4e92 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:36.711456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=64 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:37.362338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-933b6470-676b-427b-b063-cbf3b81f4e92 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:37.376360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-933b6470-676b-427b-b063-cbf3b81f4e92 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:37.379220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-933b6470-676b-427b-b063-cbf3b81f4e92 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:37.381055 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-933b6470-676b-427b-b063-cbf3b81f4e92 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1599 microversion: 2.20 time: 0.718607 Oct 04 21:35:37.398306 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2829/5675] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:35:36 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1599 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:35:37.416484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9b57866b-9196-4406-94cb-f52a25dc5af9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:37.417232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9b57866b-9196-4406-94cb-f52a25dc5af9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:37.424892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b57866b-9196-4406-94cb-f52a25dc5af9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:37.427680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b57866b-9196-4406-94cb-f52a25dc5af9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:37.428377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b57866b-9196-4406-94cb-f52a25dc5af9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:37.429379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b57866b-9196-4406-94cb-f52a25dc5af9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:37.430087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b57866b-9196-4406-94cb-f52a25dc5af9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:37.431519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b57866b-9196-4406-94cb-f52a25dc5af9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:37.609144 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9b57866b-9196-4406-94cb-f52a25dc5af9 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.198526 Oct 04 21:35:37.613909 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2847/5676] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Oct 4 21:35:37 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc/os-interface => generated 284 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:35:37.949593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6ad2197b-08f0-4b02-b6e8-a08048724899 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1022195786", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "371caa48-e590-42e2-9436-299e2bd6c03e"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:38.017849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-6ad2197b-08f0-4b02-b6e8-a08048724899 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] validate_networks() for [('371caa48-e590-42e2-9436-299e2bd6c03e', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:35:38.767657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-769e1bbe-8aea-4dd3-bcf6-36b4187621c0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1923439539", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "105a9abe-09eb-4bdd-87f3-fda198194481"}], "security_groups": [{"name": "tempest-securitygroup--1364684884"}], "key_name": "tempest-keypair-349696836", "user_data": "}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:39.173611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-769e1bbe-8aea-4dd3-bcf6-36b4187621c0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] validate_networks() for [('105a9abe-09eb-4bdd-87f3-fda198194481', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:35:39.442406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6ad2197b-08f0-4b02-b6e8-a08048724899 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:35:39.443315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6ad2197b-08f0-4b02-b6e8-a08048724899 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:35:39.443990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6ad2197b-08f0-4b02-b6e8-a08048724899 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:35:39.444605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6ad2197b-08f0-4b02-b6e8-a08048724899 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:35:39.445189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6ad2197b-08f0-4b02-b6e8-a08048724899 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:35:39.471646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ad2197b-08f0-4b02-b6e8-a08048724899 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:39.476206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ad2197b-08f0-4b02-b6e8-a08048724899 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:39.478940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ad2197b-08f0-4b02-b6e8-a08048724899 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:39.479934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ad2197b-08f0-4b02-b6e8-a08048724899 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:39.480560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ad2197b-08f0-4b02-b6e8-a08048724899 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:39.481337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ad2197b-08f0-4b02-b6e8-a08048724899 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:39.531636 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-6ad2197b-08f0-4b02-b6e8-a08048724899 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Getting quotas for project 7b1ffdba159a463997ca2acdd690db86. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:35:39.549388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-6ad2197b-08f0-4b02-b6e8-a08048724899 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Getting quotas for user 60b6b86c487643aea5693c887981dfb5 and project 7b1ffdba159a463997ca2acdd690db86. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:35:39.584871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6ad2197b-08f0-4b02-b6e8-a08048724899 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:35:39.590624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6ad2197b-08f0-4b02-b6e8-a08048724899 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:35:39.757736 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6ad2197b-08f0-4b02-b6e8-a08048724899 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.070652 Oct 04 21:35:39.758954 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2830/5677] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:35:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:35:39.770285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0b7c8d1c-87c4-41fe-b9d1-c81a2da0066c tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:39.775480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0b7c8d1c-87c4-41fe-b9d1-c81a2da0066c tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:39.948894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0b7c8d1c-87c4-41fe-b9d1-c81a2da0066c tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b6b86c487643aea5693c887981dfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1ffdba159a463997ca2acdd690db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:39.963615 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0b7c8d1c-87c4-41fe-b9d1-c81a2da0066c tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 200 len: 1225 microversion: 2.1 time: 0.197188 Oct 04 21:35:39.964219 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2831/5678] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:39 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 1225 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:35:40.112241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-d263ee6f-4a82-41a4-b78a-474a1ddb54f9 req-a9339005-fb07-4545-8c4e-8239ae29b636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa024b1-e789-4226-b10a-07bf3ca97ecc", "tag": "f058e4a1-c25d-417e-8d41-b82e64725e18"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:40.137749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d263ee6f-4a82-41a4-b78a-474a1ddb54f9 req-a9339005-fb07-4545-8c4e-8239ae29b636 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:40.138269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d263ee6f-4a82-41a4-b78a-474a1ddb54f9 req-a9339005-fb07-4545-8c4e-8239ae29b636 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:40.138713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d263ee6f-4a82-41a4-b78a-474a1ddb54f9 req-a9339005-fb07-4545-8c4e-8239ae29b636 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:40.170323 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-d263ee6f-4a82-41a4-b78a-474a1ddb54f9 req-a9339005-fb07-4545-8c4e-8239ae29b636 service nova] Creating event network-changed:f058e4a1-c25d-417e-8d41-b82e64725e18 for instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc on n-h1-860282-1 Oct 04 21:35:40.180251 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-d263ee6f-4a82-41a4-b78a-474a1ddb54f9 req-a9339005-fb07-4545-8c4e-8239ae29b636 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070371 Oct 04 21:35:40.180920 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2832/5679] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:40.386909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-769e1bbe-8aea-4dd3-bcf6-36b4187621c0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:35:40.387402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-769e1bbe-8aea-4dd3-bcf6-36b4187621c0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:35:40.387813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-769e1bbe-8aea-4dd3-bcf6-36b4187621c0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:35:40.388231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-769e1bbe-8aea-4dd3-bcf6-36b4187621c0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:35:40.388649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-769e1bbe-8aea-4dd3-bcf6-36b4187621c0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:35:40.407637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-769e1bbe-8aea-4dd3-bcf6-36b4187621c0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:40.414363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-769e1bbe-8aea-4dd3-bcf6-36b4187621c0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:40.414363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-769e1bbe-8aea-4dd3-bcf6-36b4187621c0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:40.414363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-769e1bbe-8aea-4dd3-bcf6-36b4187621c0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:40.414363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-769e1bbe-8aea-4dd3-bcf6-36b4187621c0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:40.414363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-769e1bbe-8aea-4dd3-bcf6-36b4187621c0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:40.450085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-769e1bbe-8aea-4dd3-bcf6-36b4187621c0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Getting quotas for project f7a12e438f0e4e9a83b0ab95f50c791c. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:35:40.466631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-769e1bbe-8aea-4dd3-bcf6-36b4187621c0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Getting quotas for user 68a2203c15fe41d8ae410f31ba1e1301 and project f7a12e438f0e4e9a83b0ab95f50c791c. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:35:40.499717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-769e1bbe-8aea-4dd3-bcf6-36b4187621c0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:35:40.505960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-769e1bbe-8aea-4dd3-bcf6-36b4187621c0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:35:40.743575 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-769e1bbe-8aea-4dd3-bcf6-36b4187621c0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.980207 Oct 04 21:35:40.744948 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2848/5680] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:35:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:35:40.757447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-70117664-4704-4f1f-a96a-565a7cc0c122 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:40.759491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-70117664-4704-4f1f-a96a-565a7cc0c122 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:40.870522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-70117664-4704-4f1f-a96a-565a7cc0c122 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:40.895110 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-70117664-4704-4f1f-a96a-565a7cc0c122 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1241 microversion: 2.1 time: 0.137127 Oct 04 21:35:40.902775 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2833/5681] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:40 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:40.995339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c6ed31c3-c3e7-420f-baf2-edab953d4bf9 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:40.996101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c6ed31c3-c3e7-420f-baf2-edab953d4bf9 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:41.102340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c6ed31c3-c3e7-420f-baf2-edab953d4bf9 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b6b86c487643aea5693c887981dfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1ffdba159a463997ca2acdd690db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:41.113323 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c6ed31c3-c3e7-420f-baf2-edab953d4bf9 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 200 len: 1225 microversion: 2.1 time: 0.126218 Oct 04 21:35:41.115202 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2849/5682] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:40 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 1225 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:35:41.929034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1737809d-29c4-4a23-9af7-e50d64b2812e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:41.933038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1737809d-29c4-4a23-9af7-e50d64b2812e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:42.050067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1737809d-29c4-4a23-9af7-e50d64b2812e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:42.050217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0fe81d81-f0db-45f5-83d5-f84798943dba tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:42.050680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0fe81d81-f0db-45f5-83d5-f84798943dba tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:42.064768 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1737809d-29c4-4a23-9af7-e50d64b2812e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1241 microversion: 2.1 time: 0.141949 Oct 04 21:35:42.066325 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2834/5683] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:41 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1241 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:42.068965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fe81d81-f0db-45f5-83d5-f84798943dba tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:42.069686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fe81d81-f0db-45f5-83d5-f84798943dba tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:42.070292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fe81d81-f0db-45f5-83d5-f84798943dba tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:42.071502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fe81d81-f0db-45f5-83d5-f84798943dba tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:42.072093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fe81d81-f0db-45f5-83d5-f84798943dba tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:42.079672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fe81d81-f0db-45f5-83d5-f84798943dba tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:42.123005 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0fe81d81-f0db-45f5-83d5-f84798943dba tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/ips" status: 200 len: 146 microversion: 2.1 time: 0.074701 Oct 04 21:35:42.123005 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2850/5684] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Oct 4 21:35:42 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/ips => generated 146 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:35:42.157356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-88dcf027-3232-4a95-90e6-35d8284f4ba3 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:42.157356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-88dcf027-3232-4a95-90e6-35d8284f4ba3 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:42.170759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88dcf027-3232-4a95-90e6-35d8284f4ba3 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:42.173842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88dcf027-3232-4a95-90e6-35d8284f4ba3 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:42.174757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88dcf027-3232-4a95-90e6-35d8284f4ba3 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:42.175802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88dcf027-3232-4a95-90e6-35d8284f4ba3 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:42.176283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88dcf027-3232-4a95-90e6-35d8284f4ba3 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:42.178205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88dcf027-3232-4a95-90e6-35d8284f4ba3 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:42.293186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-88dcf027-3232-4a95-90e6-35d8284f4ba3 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b6b86c487643aea5693c887981dfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1ffdba159a463997ca2acdd690db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:42.316049 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-88dcf027-3232-4a95-90e6-35d8284f4ba3 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 200 len: 1221 microversion: 2.1 time: 0.162990 Oct 04 21:35:42.317589 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2835/5685] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:42 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 1221 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:43.099028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b755eea5-0b01-40e1-a8ba-214054d37145 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:43.099890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b755eea5-0b01-40e1-a8ba-214054d37145 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:43.107429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b755eea5-0b01-40e1-a8ba-214054d37145 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:43.110133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b755eea5-0b01-40e1-a8ba-214054d37145 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:43.110133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b755eea5-0b01-40e1-a8ba-214054d37145 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:43.110133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b755eea5-0b01-40e1-a8ba-214054d37145 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:43.110133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b755eea5-0b01-40e1-a8ba-214054d37145 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:43.110421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b755eea5-0b01-40e1-a8ba-214054d37145 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:43.195466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b755eea5-0b01-40e1-a8ba-214054d37145 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:43.204680 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b755eea5-0b01-40e1-a8ba-214054d37145 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1237 microversion: 2.1 time: 0.120087 Oct 04 21:35:43.205273 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2851/5686] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:43 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1237 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:35:43.358845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b66a09e8-efd2-442e-9b3c-9b78be84dc6f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:43.359483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b66a09e8-efd2-442e-9b3c-9b78be84dc6f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:43.367991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b66a09e8-efd2-442e-9b3c-9b78be84dc6f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:43.368803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b66a09e8-efd2-442e-9b3c-9b78be84dc6f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:43.369454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b66a09e8-efd2-442e-9b3c-9b78be84dc6f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:43.370350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b66a09e8-efd2-442e-9b3c-9b78be84dc6f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:43.371047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b66a09e8-efd2-442e-9b3c-9b78be84dc6f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:43.371683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b66a09e8-efd2-442e-9b3c-9b78be84dc6f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:43.485003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b66a09e8-efd2-442e-9b3c-9b78be84dc6f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b6b86c487643aea5693c887981dfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1ffdba159a463997ca2acdd690db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:43.494313 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b66a09e8-efd2-442e-9b3c-9b78be84dc6f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 200 len: 1285 microversion: 2.1 time: 0.147874 Oct 04 21:35:43.511137 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2836/5687] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:43 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 1285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:44.235079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4691e3da-9c3a-4ab9-8b56-c32c7777825f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:44.236351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4691e3da-9c3a-4ab9-8b56-c32c7777825f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:44.249439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4691e3da-9c3a-4ab9-8b56-c32c7777825f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:44.250044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4691e3da-9c3a-4ab9-8b56-c32c7777825f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:44.250611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4691e3da-9c3a-4ab9-8b56-c32c7777825f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:44.251409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4691e3da-9c3a-4ab9-8b56-c32c7777825f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:44.252045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4691e3da-9c3a-4ab9-8b56-c32c7777825f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:44.252469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4691e3da-9c3a-4ab9-8b56-c32c7777825f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:44.416552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4691e3da-9c3a-4ab9-8b56-c32c7777825f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:44.428216 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4691e3da-9c3a-4ab9-8b56-c32c7777825f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1301 microversion: 2.1 time: 0.200337 Oct 04 21:35:44.437615 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2852/5688] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:44 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1301 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:44.523229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-513a828a-8a3e-4e24-be03-692a9a9860c1 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:44.523996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-513a828a-8a3e-4e24-be03-692a9a9860c1 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:44.537370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-513a828a-8a3e-4e24-be03-692a9a9860c1 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:44.542354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-513a828a-8a3e-4e24-be03-692a9a9860c1 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:44.550367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-513a828a-8a3e-4e24-be03-692a9a9860c1 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:44.551439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-513a828a-8a3e-4e24-be03-692a9a9860c1 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:44.553632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-513a828a-8a3e-4e24-be03-692a9a9860c1 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:44.554375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-513a828a-8a3e-4e24-be03-692a9a9860c1 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:45.260241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-513a828a-8a3e-4e24-be03-692a9a9860c1 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b6b86c487643aea5693c887981dfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1ffdba159a463997ca2acdd690db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:45.262909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c7ce2e9d-dba6-445f-8dfb-53d06343f594 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d6104b9-8a28-4ca2-aeb2-bbfd521f791e"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:45.269325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c7ce2e9d-dba6-445f-8dfb-53d06343f594 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:45.272398 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-513a828a-8a3e-4e24-be03-692a9a9860c1 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 200 len: 1325 microversion: 2.1 time: 0.753682 Oct 04 21:35:45.278014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7ce2e9d-dba6-445f-8dfb-53d06343f594 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:45.279321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7ce2e9d-dba6-445f-8dfb-53d06343f594 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:45.293458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7ce2e9d-dba6-445f-8dfb-53d06343f594 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:45.293885 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2837/5689] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:44 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 1325 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:45.293983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7ce2e9d-dba6-445f-8dfb-53d06343f594 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:45.293983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7ce2e9d-dba6-445f-8dfb-53d06343f594 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:45.293983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7ce2e9d-dba6-445f-8dfb-53d06343f594 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:45.472160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b5b46b16-7f82-4ebc-a634-e44248a50d75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:45.473044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b5b46b16-7f82-4ebc-a634-e44248a50d75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:45.487937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5b46b16-7f82-4ebc-a634-e44248a50d75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:45.487937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5b46b16-7f82-4ebc-a634-e44248a50d75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:45.487937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5b46b16-7f82-4ebc-a634-e44248a50d75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:45.487937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5b46b16-7f82-4ebc-a634-e44248a50d75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:45.487937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5b46b16-7f82-4ebc-a634-e44248a50d75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:45.487937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5b46b16-7f82-4ebc-a634-e44248a50d75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:45.568137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b5b46b16-7f82-4ebc-a634-e44248a50d75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:45.578530 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b5b46b16-7f82-4ebc-a634-e44248a50d75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1299 microversion: 2.1 time: 0.110453 Oct 04 21:35:45.579797 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2838/5690] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:45 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:35:46.312762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ce8d0b22-4e40-465f-ba42-908c6f471e3a tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:46.313397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ce8d0b22-4e40-465f-ba42-908c6f471e3a tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:46.319899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce8d0b22-4e40-465f-ba42-908c6f471e3a tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:46.320690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce8d0b22-4e40-465f-ba42-908c6f471e3a tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:46.322070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce8d0b22-4e40-465f-ba42-908c6f471e3a tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:46.323027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce8d0b22-4e40-465f-ba42-908c6f471e3a tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:46.323700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce8d0b22-4e40-465f-ba42-908c6f471e3a tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:46.324344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce8d0b22-4e40-465f-ba42-908c6f471e3a tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:46.385588 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c7ce2e9d-dba6-445f-8dfb-53d06343f594 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "POST /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.128137 Oct 04 21:35:46.401551 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2853/5691] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 21:35:45 2022] POST /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments => generated 194 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:46.604166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-59a074a6-c840-44f2-ade7-e64db1641469 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:46.605227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-59a074a6-c840-44f2-ade7-e64db1641469 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:46.615914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59a074a6-c840-44f2-ade7-e64db1641469 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:46.617821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59a074a6-c840-44f2-ade7-e64db1641469 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:46.619243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59a074a6-c840-44f2-ade7-e64db1641469 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:46.620214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59a074a6-c840-44f2-ade7-e64db1641469 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:46.622657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59a074a6-c840-44f2-ade7-e64db1641469 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:46.623306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59a074a6-c840-44f2-ade7-e64db1641469 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:46.663796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ce8d0b22-4e40-465f-ba42-908c6f471e3a tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b6b86c487643aea5693c887981dfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1ffdba159a463997ca2acdd690db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:46.682566 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ce8d0b22-4e40-465f-ba42-908c6f471e3a tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 200 len: 1325 microversion: 2.1 time: 0.375025 Oct 04 21:35:46.683710 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2839/5692] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:46 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 1325 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:47.087394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-59a074a6-c840-44f2-ade7-e64db1641469 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:47.095609 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-59a074a6-c840-44f2-ade7-e64db1641469 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1367 microversion: 2.1 time: 0.496245 Oct 04 21:35:47.096637 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2854/5693] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:46 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1367 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:35:47.205158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-3d83127b-423d-4f05-8ebd-df96c376284d req-830ba1ac-ccc7-4896-a6b5-c3eb67e8c812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9", "tag": "c9d5549a-9b09-4c98-aba7-031c9fccb4d9"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:47.224408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3d83127b-423d-4f05-8ebd-df96c376284d req-830ba1ac-ccc7-4896-a6b5-c3eb67e8c812 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:47.225903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3d83127b-423d-4f05-8ebd-df96c376284d req-830ba1ac-ccc7-4896-a6b5-c3eb67e8c812 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:47.226550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3d83127b-423d-4f05-8ebd-df96c376284d req-830ba1ac-ccc7-4896-a6b5-c3eb67e8c812 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:47.247140 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-3d83127b-423d-4f05-8ebd-df96c376284d req-830ba1ac-ccc7-4896-a6b5-c3eb67e8c812 service nova] Creating event network-changed:c9d5549a-9b09-4c98-aba7-031c9fccb4d9 for instance cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 on n-h2-860282-1 Oct 04 21:35:47.253386 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-3d83127b-423d-4f05-8ebd-df96c376284d req-830ba1ac-ccc7-4896-a6b5-c3eb67e8c812 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054250 Oct 04 21:35:47.263115 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2840/5694] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:47.706485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-058faaec-0677-46b3-bc2a-9eec6ec543ee tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:47.707810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-058faaec-0677-46b3-bc2a-9eec6ec543ee tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:47.719990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-058faaec-0677-46b3-bc2a-9eec6ec543ee tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:47.721893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-058faaec-0677-46b3-bc2a-9eec6ec543ee tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:47.722859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-058faaec-0677-46b3-bc2a-9eec6ec543ee tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:47.726189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-058faaec-0677-46b3-bc2a-9eec6ec543ee tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:47.726928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-058faaec-0677-46b3-bc2a-9eec6ec543ee tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:47.730455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-058faaec-0677-46b3-bc2a-9eec6ec543ee tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:48.103632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-058faaec-0677-46b3-bc2a-9eec6ec543ee tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b6b86c487643aea5693c887981dfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1ffdba159a463997ca2acdd690db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:48.117146 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-058faaec-0677-46b3-bc2a-9eec6ec543ee tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 200 len: 1325 microversion: 2.1 time: 0.414627 Oct 04 21:35:48.118141 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2855/5695] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:47 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 1325 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:48.132504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-89ef9358-85de-480b-a5a3-d7da96ea0f7a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:48.134533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-89ef9358-85de-480b-a5a3-d7da96ea0f7a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:48.147988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89ef9358-85de-480b-a5a3-d7da96ea0f7a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:48.148820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89ef9358-85de-480b-a5a3-d7da96ea0f7a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:48.150089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89ef9358-85de-480b-a5a3-d7da96ea0f7a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:48.158815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89ef9358-85de-480b-a5a3-d7da96ea0f7a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:48.159700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89ef9358-85de-480b-a5a3-d7da96ea0f7a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:48.161494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89ef9358-85de-480b-a5a3-d7da96ea0f7a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:48.505772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-89ef9358-85de-480b-a5a3-d7da96ea0f7a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:48.519414 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-89ef9358-85de-480b-a5a3-d7da96ea0f7a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1367 microversion: 2.1 time: 0.392130 Oct 04 21:35:48.520028 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2841/5696] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:48 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1367 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:49.141237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5a546935-0d8e-40b6-8a59-fb8b76b2369b tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:49.142661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5a546935-0d8e-40b6-8a59-fb8b76b2369b tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:49.150988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a546935-0d8e-40b6-8a59-fb8b76b2369b tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:49.151531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a546935-0d8e-40b6-8a59-fb8b76b2369b tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:49.152010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a546935-0d8e-40b6-8a59-fb8b76b2369b tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:49.152765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a546935-0d8e-40b6-8a59-fb8b76b2369b tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:49.153233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a546935-0d8e-40b6-8a59-fb8b76b2369b tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:49.153694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a546935-0d8e-40b6-8a59-fb8b76b2369b tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:49.290888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-5e56ed15-0045-455b-a772-10b6c7423128 req-f7ece063-c0a4-40b9-aeaa-d5b876efedac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8c5b825-6552-42c9-b652-2b7eff7bffce", "tag": "dcce473b-6130-4116-99ec-a361a4bb8721"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:49.301594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5e56ed15-0045-455b-a772-10b6c7423128 req-f7ece063-c0a4-40b9-aeaa-d5b876efedac service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:49.302320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5e56ed15-0045-455b-a772-10b6c7423128 req-f7ece063-c0a4-40b9-aeaa-d5b876efedac service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:49.302926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5e56ed15-0045-455b-a772-10b6c7423128 req-f7ece063-c0a4-40b9-aeaa-d5b876efedac service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:49.315831 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-5e56ed15-0045-455b-a772-10b6c7423128 req-f7ece063-c0a4-40b9-aeaa-d5b876efedac service nova] Creating event network-changed:dcce473b-6130-4116-99ec-a361a4bb8721 for instance f8c5b825-6552-42c9-b652-2b7eff7bffce on n-h2-860282-1 Oct 04 21:35:49.322073 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-5e56ed15-0045-455b-a772-10b6c7423128 req-f7ece063-c0a4-40b9-aeaa-d5b876efedac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034580 Oct 04 21:35:49.323303 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2842/5697] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:35:49.354360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5a546935-0d8e-40b6-8a59-fb8b76b2369b tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b6b86c487643aea5693c887981dfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1ffdba159a463997ca2acdd690db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:49.367539 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5a546935-0d8e-40b6-8a59-fb8b76b2369b tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 200 len: 1325 microversion: 2.1 time: 0.231158 Oct 04 21:35:49.371592 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2856/5698] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:49 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 1325 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:49.547567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:49.552412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-02acd723-40ca-403f-ba54-703270fcb4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:49.554357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-02acd723-40ca-403f-ba54-703270fcb4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:49.562408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02acd723-40ca-403f-ba54-703270fcb4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:49.563081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02acd723-40ca-403f-ba54-703270fcb4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:49.563593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02acd723-40ca-403f-ba54-703270fcb4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:49.564551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02acd723-40ca-403f-ba54-703270fcb4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:49.565119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02acd723-40ca-403f-ba54-703270fcb4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:49.565675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02acd723-40ca-403f-ba54-703270fcb4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:49.725841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-02acd723-40ca-403f-ba54-703270fcb4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:49.735985 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-02acd723-40ca-403f-ba54-703270fcb4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1367 microversion: 2.1 time: 0.190182 Oct 04 21:35:49.736791 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2843/5699] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:49 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:50.398738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8196e573-25fd-4aeb-b6c2-229981026450 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:50.399950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8196e573-25fd-4aeb-b6c2-229981026450 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:50.410854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8196e573-25fd-4aeb-b6c2-229981026450 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:50.411354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8196e573-25fd-4aeb-b6c2-229981026450 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:50.411794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8196e573-25fd-4aeb-b6c2-229981026450 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:50.412506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8196e573-25fd-4aeb-b6c2-229981026450 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:50.413101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8196e573-25fd-4aeb-b6c2-229981026450 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:50.413569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8196e573-25fd-4aeb-b6c2-229981026450 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:50.436344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:50.604161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8196e573-25fd-4aeb-b6c2-229981026450 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b6b86c487643aea5693c887981dfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1ffdba159a463997ca2acdd690db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:50.612501 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8196e573-25fd-4aeb-b6c2-229981026450 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 200 len: 1325 microversion: 2.1 time: 0.218166 Oct 04 21:35:50.613375 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2857/5700] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:50 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 1325 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:50.762854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1afbfec2-7618-4650-8f44-fbb86096dac2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:50.763544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1afbfec2-7618-4650-8f44-fbb86096dac2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:50.776052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1afbfec2-7618-4650-8f44-fbb86096dac2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:50.776749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1afbfec2-7618-4650-8f44-fbb86096dac2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:50.777390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1afbfec2-7618-4650-8f44-fbb86096dac2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:50.778352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1afbfec2-7618-4650-8f44-fbb86096dac2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:50.799406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1afbfec2-7618-4650-8f44-fbb86096dac2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:50.801208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1afbfec2-7618-4650-8f44-fbb86096dac2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:50.961296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1afbfec2-7618-4650-8f44-fbb86096dac2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:50.980535 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1afbfec2-7618-4650-8f44-fbb86096dac2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1367 microversion: 2.1 time: 0.222193 Oct 04 21:35:50.983245 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2844/5701] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:50 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:51.641206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-454aaa75-36c3-41f4-a0d1-7915cb5479aa tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:51.642947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-454aaa75-36c3-41f4-a0d1-7915cb5479aa tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:51.650027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:51.654651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454aaa75-36c3-41f4-a0d1-7915cb5479aa tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:51.655357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454aaa75-36c3-41f4-a0d1-7915cb5479aa tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:51.655967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454aaa75-36c3-41f4-a0d1-7915cb5479aa tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:51.657285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454aaa75-36c3-41f4-a0d1-7915cb5479aa tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:51.658145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454aaa75-36c3-41f4-a0d1-7915cb5479aa tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:51.658782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454aaa75-36c3-41f4-a0d1-7915cb5479aa tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:51.910708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-454aaa75-36c3-41f4-a0d1-7915cb5479aa tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b6b86c487643aea5693c887981dfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1ffdba159a463997ca2acdd690db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:51.919098 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-454aaa75-36c3-41f4-a0d1-7915cb5479aa tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 200 len: 1325 microversion: 2.1 time: 0.286684 Oct 04 21:35:51.919646 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2858/5702] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:51 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 1325 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:52.004327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ff07a57a-c501-4058-ad36-a1917ad07a37 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:52.005713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ff07a57a-c501-4058-ad36-a1917ad07a37 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:52.026152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff07a57a-c501-4058-ad36-a1917ad07a37 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:52.027862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff07a57a-c501-4058-ad36-a1917ad07a37 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:52.028320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff07a57a-c501-4058-ad36-a1917ad07a37 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:52.030062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff07a57a-c501-4058-ad36-a1917ad07a37 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:52.030540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff07a57a-c501-4058-ad36-a1917ad07a37 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:52.030977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff07a57a-c501-4058-ad36-a1917ad07a37 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:52.058516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=16 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:52.317603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ff07a57a-c501-4058-ad36-a1917ad07a37 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:52.326065 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ff07a57a-c501-4058-ad36-a1917ad07a37 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1367 microversion: 2.1 time: 0.325767 Oct 04 21:35:52.326729 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2845/5703] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:51 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:52.943638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-51563e08-c953-4d95-bcb5-8c2c1c6240da tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:52.947130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-51563e08-c953-4d95-bcb5-8c2c1c6240da tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:52.956048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51563e08-c953-4d95-bcb5-8c2c1c6240da tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:52.956981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51563e08-c953-4d95-bcb5-8c2c1c6240da tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:52.957824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51563e08-c953-4d95-bcb5-8c2c1c6240da tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:52.958721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51563e08-c953-4d95-bcb5-8c2c1c6240da tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:52.959402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51563e08-c953-4d95-bcb5-8c2c1c6240da tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:52.960222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51563e08-c953-4d95-bcb5-8c2c1c6240da tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:53.127806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-51563e08-c953-4d95-bcb5-8c2c1c6240da tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b6b86c487643aea5693c887981dfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1ffdba159a463997ca2acdd690db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:53.137113 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-51563e08-c953-4d95-bcb5-8c2c1c6240da tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 200 len: 1325 microversion: 2.1 time: 0.198202 Oct 04 21:35:53.145498 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2859/5704] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:52 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 1325 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:53.354777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-762331ce-fc3a-4172-96eb-043f53aa7431 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:53.355504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-762331ce-fc3a-4172-96eb-043f53aa7431 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:53.362625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-762331ce-fc3a-4172-96eb-043f53aa7431 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:53.363139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-762331ce-fc3a-4172-96eb-043f53aa7431 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:53.363656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-762331ce-fc3a-4172-96eb-043f53aa7431 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:53.364431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-762331ce-fc3a-4172-96eb-043f53aa7431 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:53.364968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-762331ce-fc3a-4172-96eb-043f53aa7431 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:53.365520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-762331ce-fc3a-4172-96eb-043f53aa7431 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:53.506135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-762331ce-fc3a-4172-96eb-043f53aa7431 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:53.514359 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-762331ce-fc3a-4172-96eb-043f53aa7431 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1367 microversion: 2.1 time: 0.164316 Oct 04 21:35:53.514932 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2846/5705] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:53 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:54.168540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3a51afac-7b72-4fa2-bdc1-d52796bc8bae tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:54.169333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3a51afac-7b72-4fa2-bdc1-d52796bc8bae tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:54.176034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a51afac-7b72-4fa2-bdc1-d52796bc8bae tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:54.176644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a51afac-7b72-4fa2-bdc1-d52796bc8bae tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:54.177218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a51afac-7b72-4fa2-bdc1-d52796bc8bae tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:54.178138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a51afac-7b72-4fa2-bdc1-d52796bc8bae tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:54.178602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a51afac-7b72-4fa2-bdc1-d52796bc8bae tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:54.179035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a51afac-7b72-4fa2-bdc1-d52796bc8bae tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:54.333197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3a51afac-7b72-4fa2-bdc1-d52796bc8bae tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b6b86c487643aea5693c887981dfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1ffdba159a463997ca2acdd690db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:54.355539 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3a51afac-7b72-4fa2-bdc1-d52796bc8bae tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 200 len: 1325 microversion: 2.1 time: 0.190864 Oct 04 21:35:54.356708 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2860/5706] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:54 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 1325 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:54.538956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d1f4a653-cc18-418e-9585-08deeec679eb tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:54.540051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d1f4a653-cc18-418e-9585-08deeec679eb tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:54.547592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1f4a653-cc18-418e-9585-08deeec679eb tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:54.548252 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1f4a653-cc18-418e-9585-08deeec679eb tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:54.548697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1f4a653-cc18-418e-9585-08deeec679eb tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:54.549452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1f4a653-cc18-418e-9585-08deeec679eb tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:54.550196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1f4a653-cc18-418e-9585-08deeec679eb tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:54.550839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1f4a653-cc18-418e-9585-08deeec679eb tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:54.698191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d1f4a653-cc18-418e-9585-08deeec679eb tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:54.706539 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d1f4a653-cc18-418e-9585-08deeec679eb tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1367 microversion: 2.1 time: 0.171508 Oct 04 21:35:54.707127 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2847/5707] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:54 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:54.923703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-fd960cf9-ac21-43c9-b429-6845c2a186de req-f2658471-5c95-446e-9da2-efad97a59c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9", "name": "network-vif-plugged", "status": "completed", "tag": "c9d5549a-9b09-4c98-aba7-031c9fccb4d9"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:54.935267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-fd960cf9-ac21-43c9-b429-6845c2a186de req-f2658471-5c95-446e-9da2-efad97a59c40 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:54.948121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-fd960cf9-ac21-43c9-b429-6845c2a186de req-f2658471-5c95-446e-9da2-efad97a59c40 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:54.948121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-fd960cf9-ac21-43c9-b429-6845c2a186de req-f2658471-5c95-446e-9da2-efad97a59c40 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:54.949186 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-fd960cf9-ac21-43c9-b429-6845c2a186de req-f2658471-5c95-446e-9da2-efad97a59c40 service nova] Creating event network-vif-plugged:c9d5549a-9b09-4c98-aba7-031c9fccb4d9 for instance cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 on n-h2-860282-1 Oct 04 21:35:54.954247 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-fd960cf9-ac21-43c9-b429-6845c2a186de req-f2658471-5c95-446e-9da2-efad97a59c40 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034262 Oct 04 21:35:54.954930 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2861/5708] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:55.380074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a59e6847-505a-42ec-89f0-249fd9c428a0 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:55.380714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a59e6847-505a-42ec-89f0-249fd9c428a0 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:55.387955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a59e6847-505a-42ec-89f0-249fd9c428a0 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:55.388483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a59e6847-505a-42ec-89f0-249fd9c428a0 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:55.388988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a59e6847-505a-42ec-89f0-249fd9c428a0 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:55.389809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a59e6847-505a-42ec-89f0-249fd9c428a0 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:55.390382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a59e6847-505a-42ec-89f0-249fd9c428a0 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:55.391237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a59e6847-505a-42ec-89f0-249fd9c428a0 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:55.619345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a59e6847-505a-42ec-89f0-249fd9c428a0 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b6b86c487643aea5693c887981dfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1ffdba159a463997ca2acdd690db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:55.627068 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a59e6847-505a-42ec-89f0-249fd9c428a0 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 200 len: 1325 microversion: 2.1 time: 0.250864 Oct 04 21:35:55.635956 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2848/5709] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:55 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 1325 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:55.735184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bfdbe63c-4308-413c-9772-7623191d9702 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:55.735895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bfdbe63c-4308-413c-9772-7623191d9702 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:55.742437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfdbe63c-4308-413c-9772-7623191d9702 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:55.743447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfdbe63c-4308-413c-9772-7623191d9702 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:55.743883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfdbe63c-4308-413c-9772-7623191d9702 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:55.744569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfdbe63c-4308-413c-9772-7623191d9702 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:55.745027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfdbe63c-4308-413c-9772-7623191d9702 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:55.745465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfdbe63c-4308-413c-9772-7623191d9702 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:55.883679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bfdbe63c-4308-413c-9772-7623191d9702 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:55.893201 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bfdbe63c-4308-413c-9772-7623191d9702 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1367 microversion: 2.1 time: 0.162885 Oct 04 21:35:55.894426 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2862/5710] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:55 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:56.651209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a65ee56b-a969-4a17-86ef-04a98d0042ca tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:56.652436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a65ee56b-a969-4a17-86ef-04a98d0042ca tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:56.660245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a65ee56b-a969-4a17-86ef-04a98d0042ca tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:56.672936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a65ee56b-a969-4a17-86ef-04a98d0042ca tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:56.672936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a65ee56b-a969-4a17-86ef-04a98d0042ca tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:56.672936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a65ee56b-a969-4a17-86ef-04a98d0042ca tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:56.672936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a65ee56b-a969-4a17-86ef-04a98d0042ca tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:56.672936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a65ee56b-a969-4a17-86ef-04a98d0042ca tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:56.845789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a65ee56b-a969-4a17-86ef-04a98d0042ca tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b6b86c487643aea5693c887981dfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1ffdba159a463997ca2acdd690db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:56.861606 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a65ee56b-a969-4a17-86ef-04a98d0042ca tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 200 len: 1523 microversion: 2.1 time: 0.215111 Oct 04 21:35:56.862221 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2849/5711] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:56 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:56.887268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d432657b-66df-4948-b73f-c4783e0e99e7 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:56.888422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d432657b-66df-4948-b73f-c4783e0e99e7 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:56.895507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d432657b-66df-4948-b73f-c4783e0e99e7 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:56.896196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d432657b-66df-4948-b73f-c4783e0e99e7 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:56.896802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d432657b-66df-4948-b73f-c4783e0e99e7 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:56.897709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d432657b-66df-4948-b73f-c4783e0e99e7 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:56.898310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d432657b-66df-4948-b73f-c4783e0e99e7 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:56.899447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d432657b-66df-4948-b73f-c4783e0e99e7 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:56.914970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:56.920864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-df31b232-eed9-47c4-b31c-1994827661aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:56.921543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-df31b232-eed9-47c4-b31c-1994827661aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:56.927821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df31b232-eed9-47c4-b31c-1994827661aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:56.932087 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-d432657b-66df-4948-b73f-c4783e0e99e7 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] HTTP exception thrown: Action 999 not found Oct 04 21:35:56.932738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df31b232-eed9-47c4-b31c-1994827661aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:56.933394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df31b232-eed9-47c4-b31c-1994827661aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:56.934184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df31b232-eed9-47c4-b31c-1994827661aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:56.934655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df31b232-eed9-47c4-b31c-1994827661aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:56.935182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df31b232-eed9-47c4-b31c-1994827661aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d432657b-66df-4948-b73f-c4783e0e99e7 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Request method failure captured: Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9/os-instance-actions/999 HTTP/1.1 Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKcpRvPjoXjii_umuNzanDSGI4xo7XMC2Bgfae8yi2DZ9KC9lbs1QD_4UNLzCnoOZXl_gK6SX1VUooeOVOAjRRClzRPuuGRF77c-HidU1FZhNrD41g8sDTA4SP9fkh4m7m-xkoLjhHLQMdwezM31qAjD_5YZ-OYtJWsiq1e4oaP3WyE Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 7b1ffdba159a463997ca2acdd690db86 Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-322089496 Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b1ffdba159a463997ca2acdd690db86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7b1ffdba159a463997ca2acdd690db86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7b1ffdba159a463997ca2acdd690db86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b1ffdba159a463997ca2acdd690db86"}]}] Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-322089496 Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 7b1ffdba159a463997ca2acdd690db86 Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-322089496 Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-InstanceActionsNegativeTestJSON-322089496-project Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 60b6b86c487643aea5693c887981dfb5 Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-322089496-project Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: exception: Action 999 not found Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'server_id': 'cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9', 'id': '999'} Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 04 21:35:56.941767 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:35:56.946406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d432657b-66df-4948-b73f-c4783e0e99e7 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Returning 404 to user: Action 999 not found {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:35:56.946406 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d432657b-66df-4948-b73f-c4783e0e99e7 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.062460 Oct 04 21:35:56.947901 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2863/5712] 10.222.0.30 () {58 vars in 1308 bytes} [Tue Oct 4 21:35:56 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9/os-instance-actions/999 => generated 66 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:35:56.957253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0e2d8a1f-28e6-4f01-b948-a7b1109e9082 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '.version_select at 0x7f578b514ee0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:56.962324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0e2d8a1f-28e6-4f01-b948-a7b1109e9082 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: 11d6abe7-0f47-4e93-935a-0a15672fa4be] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:56.969845 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-0e2d8a1f-28e6-4f01-b948-a7b1109e9082 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] HTTP exception thrown: Instance 11d6abe7-0f47-4e93-935a-0a15672fa4be could not be found. Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0e2d8a1f-28e6-4f01-b948-a7b1109e9082 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Request method failure captured: Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/11d6abe7-0f47-4e93-935a-0a15672fa4be/os-instance-actions HTTP/1.1 Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKcpRvPjoXjii_umuNzanDSGI4xo7XMC2Bgfae8yi2DZ9KC9lbs1QD_4UNLzCnoOZXl_gK6SX1VUooeOVOAjRRClzRPuuGRF77c-HidU1FZhNrD41g8sDTA4SP9fkh4m7m-xkoLjhHLQMdwezM31qAjD_5YZ-OYtJWsiq1e4oaP3WyE Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 7b1ffdba159a463997ca2acdd690db86 Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-322089496 Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b1ffdba159a463997ca2acdd690db86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7b1ffdba159a463997ca2acdd690db86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7b1ffdba159a463997ca2acdd690db86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b1ffdba159a463997ca2acdd690db86"}]}] Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-322089496 Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 7b1ffdba159a463997ca2acdd690db86 Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-322089496 Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-InstanceActionsNegativeTestJSON-322089496-project Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 60b6b86c487643aea5693c887981dfb5 Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-322089496-project Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 11d6abe7-0f47-4e93-935a-0a15672fa4be could not be found. Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'server_id': '11d6abe7-0f47-4e93-935a-0a15672fa4be'} Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11d6abe7-0f47-4e93-935a-0a15672fa4be could not be found. Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:35:56.971428 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:35:56.975760 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11d6abe7-0f47-4e93-935a-0a15672fa4be could not be found. Oct 04 21:35:56.975760 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:35:56.975760 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:35:56.975760 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:35:56.975760 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:56.975760 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:56.975760 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:56.975760 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:35:56.975760 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:35:56.975760 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11d6abe7-0f47-4e93-935a-0a15672fa4be could not be found. Oct 04 21:35:56.975760 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:35:56.975760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0e2d8a1f-28e6-4f01-b948-a7b1109e9082 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Returning 404 to user: Instance 11d6abe7-0f47-4e93-935a-0a15672fa4be could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:35:56.975760 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0e2d8a1f-28e6-4f01-b948-a7b1109e9082 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/11d6abe7-0f47-4e93-935a-0a15672fa4be/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.019568 Oct 04 21:35:56.978771 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2864/5713] 10.222.0.30 () {58 vars in 1296 bytes} [Tue Oct 4 21:35:56 2022] GET /compute/v2.1/servers/11d6abe7-0f47-4e93-935a-0a15672fa4be/os-instance-actions => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:35:56.986840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-86dd3a77-c7bc-4170-8e49-f2702f3b8d58 req-83ad1b57-7fc3-4389-a792-4ebb557f432b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8c5b825-6552-42c9-b652-2b7eff7bffce", "name": "network-vif-plugged", "status": "completed", "tag": "dcce473b-6130-4116-99ec-a361a4bb8721"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:57.003516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-86dd3a77-c7bc-4170-8e49-f2702f3b8d58 req-83ad1b57-7fc3-4389-a792-4ebb557f432b service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:57.004020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-86dd3a77-c7bc-4170-8e49-f2702f3b8d58 req-83ad1b57-7fc3-4389-a792-4ebb557f432b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:57.004489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-86dd3a77-c7bc-4170-8e49-f2702f3b8d58 req-83ad1b57-7fc3-4389-a792-4ebb557f432b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:57.020345 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-86dd3a77-c7bc-4170-8e49-f2702f3b8d58 req-83ad1b57-7fc3-4389-a792-4ebb557f432b service nova] Creating event network-vif-plugged:dcce473b-6130-4116-99ec-a361a4bb8721 for instance f8c5b825-6552-42c9-b652-2b7eff7bffce on n-h2-860282-1 Oct 04 21:35:57.037968 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-86dd3a77-c7bc-4170-8e49-f2702f3b8d58 req-83ad1b57-7fc3-4389-a792-4ebb557f432b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057824 Oct 04 21:35:57.038587 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2865/5714] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:57.058074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-716b5371-0311-42cd-817c-946662c31326 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:57.058682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-716b5371-0311-42cd-817c-946662c31326 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:57.071425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-716b5371-0311-42cd-817c-946662c31326 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:57.072684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-716b5371-0311-42cd-817c-946662c31326 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:57.075075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-716b5371-0311-42cd-817c-946662c31326 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:57.076020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-716b5371-0311-42cd-817c-946662c31326 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:57.076720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-716b5371-0311-42cd-817c-946662c31326 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:57.078667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-716b5371-0311-42cd-817c-946662c31326 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:57.155942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-716b5371-0311-42cd-817c-946662c31326 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:35:57.211077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-df31b232-eed9-47c4-b31c-1994827661aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:57.230765 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-df31b232-eed9-47c4-b31c-1994827661aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1367 microversion: 2.1 time: 0.316157 Oct 04 21:35:57.233061 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2850/5715] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:56 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:35:57.576833 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-716b5371-0311-42cd-817c-946662c31326 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 204 len: 0 microversion: 2.1 time: 0.536802 Oct 04 21:35:57.577535 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2866/5716] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:35:57 2022] DELETE /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:35:57.585907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fa7c3b17-7345-4796-a502-41a947835781 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:57.587607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fa7c3b17-7345-4796-a502-41a947835781 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:57.599579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa7c3b17-7345-4796-a502-41a947835781 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:57.600378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa7c3b17-7345-4796-a502-41a947835781 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:57.600999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa7c3b17-7345-4796-a502-41a947835781 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:57.602024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa7c3b17-7345-4796-a502-41a947835781 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:57.603055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa7c3b17-7345-4796-a502-41a947835781 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:57.603651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa7c3b17-7345-4796-a502-41a947835781 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:57.630575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:57.762321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fa7c3b17-7345-4796-a502-41a947835781 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b6b86c487643aea5693c887981dfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1ffdba159a463997ca2acdd690db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:57.770758 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fa7c3b17-7345-4796-a502-41a947835781 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 200 len: 1529 microversion: 2.1 time: 0.189167 Oct 04 21:35:57.771483 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2851/5717] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:57 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 1529 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:58.258199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-44632cc8-c83e-4681-9efd-4e3930ea7280 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:58.258926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-44632cc8-c83e-4681-9efd-4e3930ea7280 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:58.266747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44632cc8-c83e-4681-9efd-4e3930ea7280 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:58.267656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44632cc8-c83e-4681-9efd-4e3930ea7280 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:58.268345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44632cc8-c83e-4681-9efd-4e3930ea7280 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:58.269285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44632cc8-c83e-4681-9efd-4e3930ea7280 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:58.269829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44632cc8-c83e-4681-9efd-4e3930ea7280 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:58.270265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-44632cc8-c83e-4681-9efd-4e3930ea7280 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:58.437464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-44632cc8-c83e-4681-9efd-4e3930ea7280 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:58.446260 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-44632cc8-c83e-4681-9efd-4e3930ea7280 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1367 microversion: 2.1 time: 0.192558 Oct 04 21:35:58.447524 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2867/5718] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:58 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:58.796913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8501ba10-e5dc-4b14-b789-7a841f389a20 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:58.797486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8501ba10-e5dc-4b14-b789-7a841f389a20 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:58.804557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8501ba10-e5dc-4b14-b789-7a841f389a20 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:58.805047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8501ba10-e5dc-4b14-b789-7a841f389a20 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:58.805512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8501ba10-e5dc-4b14-b789-7a841f389a20 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:58.806847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8501ba10-e5dc-4b14-b789-7a841f389a20 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:58.807301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8501ba10-e5dc-4b14-b789-7a841f389a20 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:58.807723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8501ba10-e5dc-4b14-b789-7a841f389a20 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:58.941449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8501ba10-e5dc-4b14-b789-7a841f389a20 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b6b86c487643aea5693c887981dfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1ffdba159a463997ca2acdd690db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:58.949722 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8501ba10-e5dc-4b14-b789-7a841f389a20 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 200 len: 1529 microversion: 2.1 time: 0.156809 Oct 04 21:35:58.950294 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2852/5719] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:58 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 1529 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:59.471565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b9b79a4a-e72f-425e-8248-8f218427e5cd tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:59.472402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b9b79a4a-e72f-425e-8248-8f218427e5cd tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:59.480166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9b79a4a-e72f-425e-8248-8f218427e5cd tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:59.480675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9b79a4a-e72f-425e-8248-8f218427e5cd tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:59.481122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9b79a4a-e72f-425e-8248-8f218427e5cd tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:59.481902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9b79a4a-e72f-425e-8248-8f218427e5cd tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:59.482587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9b79a4a-e72f-425e-8248-8f218427e5cd tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:59.483033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9b79a4a-e72f-425e-8248-8f218427e5cd tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:59.651280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b9b79a4a-e72f-425e-8248-8f218427e5cd tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:59.661331 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b9b79a4a-e72f-425e-8248-8f218427e5cd tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1367 microversion: 2.1 time: 0.194467 Oct 04 21:35:59.671738 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2868/5720] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:59 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:59.973550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0245a5d5-83ab-45ac-b9ba-7155329ea841 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:59.974763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0245a5d5-83ab-45ac-b9ba-7155329ea841 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:59.997010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0245a5d5-83ab-45ac-b9ba-7155329ea841 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:59.997965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0245a5d5-83ab-45ac-b9ba-7155329ea841 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:59.998414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0245a5d5-83ab-45ac-b9ba-7155329ea841 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:59.999130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0245a5d5-83ab-45ac-b9ba-7155329ea841 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:59.999594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0245a5d5-83ab-45ac-b9ba-7155329ea841 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:00.000028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0245a5d5-83ab-45ac-b9ba-7155329ea841 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:00.600173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0245a5d5-83ab-45ac-b9ba-7155329ea841 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b6b86c487643aea5693c887981dfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1ffdba159a463997ca2acdd690db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:00.610574 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0245a5d5-83ab-45ac-b9ba-7155329ea841 tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 200 len: 1529 microversion: 2.1 time: 0.641640 Oct 04 21:36:00.612041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-69de35d5-c01c-4e48-903b-d8a74b385f3d tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:00.612862 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2853/5721] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:59 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 1529 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:00.615446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-69de35d5-c01c-4e48-903b-d8a74b385f3d tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:00.625835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69de35d5-c01c-4e48-903b-d8a74b385f3d tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:00.626666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69de35d5-c01c-4e48-903b-d8a74b385f3d tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:00.627354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69de35d5-c01c-4e48-903b-d8a74b385f3d tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:00.628286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69de35d5-c01c-4e48-903b-d8a74b385f3d tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:00.628891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69de35d5-c01c-4e48-903b-d8a74b385f3d tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:00.629561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69de35d5-c01c-4e48-903b-d8a74b385f3d tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:00.663812 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-69de35d5-c01c-4e48-903b-d8a74b385f3d tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057013 Oct 04 21:36:00.664647 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2869/5722] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:36:00 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:36:00.677092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f446f849-965f-455a-acd1-cb36f9ccc842 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:00.677650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f446f849-965f-455a-acd1-cb36f9ccc842 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:00.685967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f446f849-965f-455a-acd1-cb36f9ccc842 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:00.686464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f446f849-965f-455a-acd1-cb36f9ccc842 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:00.686906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f446f849-965f-455a-acd1-cb36f9ccc842 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:00.687613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f446f849-965f-455a-acd1-cb36f9ccc842 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:00.688072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f446f849-965f-455a-acd1-cb36f9ccc842 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:00.688637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f446f849-965f-455a-acd1-cb36f9ccc842 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:00.689161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-944252a9-8548-4b69-80cb-97d8663e9339 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:00.689815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-944252a9-8548-4b69-80cb-97d8663e9339 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:00.697592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-944252a9-8548-4b69-80cb-97d8663e9339 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:00.698085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-944252a9-8548-4b69-80cb-97d8663e9339 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:00.698536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-944252a9-8548-4b69-80cb-97d8663e9339 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:00.699247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-944252a9-8548-4b69-80cb-97d8663e9339 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:00.699785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-944252a9-8548-4b69-80cb-97d8663e9339 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:00.700224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-944252a9-8548-4b69-80cb-97d8663e9339 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:00.724798 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f446f849-965f-455a-acd1-cb36f9ccc842 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments/5d6104b9-8a28-4ca2-aeb2-bbfd521f791e" status: 200 len: 194 microversion: 2.1 time: 0.051534 Oct 04 21:36:00.732360 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2854/5723] 10.222.0.30 () {58 vars in 1413 bytes} [Tue Oct 4 21:36:00 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments/5d6104b9-8a28-4ca2-aeb2-bbfd521f791e => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:00.936823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-4f5b5a18-ff32-4d2c-af85-1d931b4adb5d req-db68a37e-1ccb-4c03-a2d5-d95ade66f3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9", "name": "network-vif-deleted", "tag": "c9d5549a-9b09-4c98-aba7-031c9fccb4d9"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:00.950063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4f5b5a18-ff32-4d2c-af85-1d931b4adb5d req-db68a37e-1ccb-4c03-a2d5-d95ade66f3c3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:00.952075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4f5b5a18-ff32-4d2c-af85-1d931b4adb5d req-db68a37e-1ccb-4c03-a2d5-d95ade66f3c3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:00.952851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4f5b5a18-ff32-4d2c-af85-1d931b4adb5d req-db68a37e-1ccb-4c03-a2d5-d95ade66f3c3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:00.969706 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-4f5b5a18-ff32-4d2c-af85-1d931b4adb5d req-db68a37e-1ccb-4c03-a2d5-d95ade66f3c3 service nova] Creating event network-vif-deleted:c9d5549a-9b09-4c98-aba7-031c9fccb4d9 for instance cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 on n-h2-860282-1 Oct 04 21:36:00.976264 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-4f5b5a18-ff32-4d2c-af85-1d931b4adb5d req-db68a37e-1ccb-4c03-a2d5-d95ade66f3c3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043969 Oct 04 21:36:00.978881 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2855/5724] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:36:01.000546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-944252a9-8548-4b69-80cb-97d8663e9339 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:01.009295 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-944252a9-8548-4b69-80cb-97d8663e9339 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1556 microversion: 2.1 time: 0.326314 Oct 04 21:36:01.010783 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2870/5725] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:00 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1556 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:01.043196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-601a7425-c99e-4d26-9536-29b22a2dd248 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:01.043807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-601a7425-c99e-4d26-9536-29b22a2dd248 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:01.052290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-601a7425-c99e-4d26-9536-29b22a2dd248 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:01.052778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-601a7425-c99e-4d26-9536-29b22a2dd248 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:01.053242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-601a7425-c99e-4d26-9536-29b22a2dd248 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:01.053975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-601a7425-c99e-4d26-9536-29b22a2dd248 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:01.054435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-601a7425-c99e-4d26-9536-29b22a2dd248 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:01.055172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-601a7425-c99e-4d26-9536-29b22a2dd248 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:01.293293 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-601a7425-c99e-4d26-9536-29b22a2dd248 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.256602 Oct 04 21:36:01.294227 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2856/5726] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:36:01 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce/os-interface => generated 284 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:01.636716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-23b33785-5868-4a8c-ad77-7e4f2a0c527d tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:01.638451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-23b33785-5868-4a8c-ad77-7e4f2a0c527d tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:01.650330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23b33785-5868-4a8c-ad77-7e4f2a0c527d tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:01.654388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23b33785-5868-4a8c-ad77-7e4f2a0c527d tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:01.656304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23b33785-5868-4a8c-ad77-7e4f2a0c527d tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:01.658659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23b33785-5868-4a8c-ad77-7e4f2a0c527d tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:01.660553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23b33785-5868-4a8c-ad77-7e4f2a0c527d tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:01.661416 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23b33785-5868-4a8c-ad77-7e4f2a0c527d tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:01.754577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23b33785-5868-4a8c-ad77-7e4f2a0c527d tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:01.758074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23b33785-5868-4a8c-ad77-7e4f2a0c527d tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:01.758473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23b33785-5868-4a8c-ad77-7e4f2a0c527d tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:01.758956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-23b33785-5868-4a8c-ad77-7e4f2a0c527d tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lazy-loading 'fault' on Instance uuid cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:36:01.838187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-23b33785-5868-4a8c-ad77-7e4f2a0c527d tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b6b86c487643aea5693c887981dfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1ffdba159a463997ca2acdd690db86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:01.864485 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-23b33785-5868-4a8c-ad77-7e4f2a0c527d tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 200 len: 1315 microversion: 2.1 time: 0.232998 Oct 04 21:36:01.865602 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2871/5727] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:01 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:02.841958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-4ab5c4ae-588a-4dff-9042-99795b2205ab req-2d9314d2-5828-4754-a6ef-a570f9b5675a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8c5b825-6552-42c9-b652-2b7eff7bffce", "tag": "dcce473b-6130-4116-99ec-a361a4bb8721"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:02.851588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4ab5c4ae-588a-4dff-9042-99795b2205ab req-2d9314d2-5828-4754-a6ef-a570f9b5675a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:02.852069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4ab5c4ae-588a-4dff-9042-99795b2205ab req-2d9314d2-5828-4754-a6ef-a570f9b5675a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:02.852674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4ab5c4ae-588a-4dff-9042-99795b2205ab req-2d9314d2-5828-4754-a6ef-a570f9b5675a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:02.871236 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-4ab5c4ae-588a-4dff-9042-99795b2205ab req-2d9314d2-5828-4754-a6ef-a570f9b5675a service nova] Creating event network-changed:dcce473b-6130-4116-99ec-a361a4bb8721 for instance f8c5b825-6552-42c9-b652-2b7eff7bffce on n-h2-860282-1 Oct 04 21:36:02.876415 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-4ab5c4ae-588a-4dff-9042-99795b2205ab req-2d9314d2-5828-4754-a6ef-a570f9b5675a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040219 Oct 04 21:36:02.877297 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2857/5728] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:02.890473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1848c13d-b143-4b6d-9a29-c673723cc96f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:02.907118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1848c13d-b143-4b6d-9a29-c673723cc96f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] [instance: cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:02.949571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1848c13d-b143-4b6d-9a29-c673723cc96f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:02.953564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1848c13d-b143-4b6d-9a29-c673723cc96f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:02.954172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1848c13d-b143-4b6d-9a29-c673723cc96f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:02.954927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1848c13d-b143-4b6d-9a29-c673723cc96f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:02.960912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1848c13d-b143-4b6d-9a29-c673723cc96f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:02.961493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1848c13d-b143-4b6d-9a29-c673723cc96f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:02.998623 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-1848c13d-b143-4b6d-9a29-c673723cc96f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] HTTP exception thrown: Instance cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 could not be found. Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1848c13d-b143-4b6d-9a29-c673723cc96f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Request method failure captured: Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 HTTP/1.1 Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKcpRvPjoXjii_umuNzanDSGI4xo7XMC2Bgfae8yi2DZ9KC9lbs1QD_4UNLzCnoOZXl_gK6SX1VUooeOVOAjRRClzRPuuGRF77c-HidU1FZhNrD41g8sDTA4SP9fkh4m7m-xkoLjhHLQMdwezM31qAjD_5YZ-OYtJWsiq1e4oaP3WyE Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 7b1ffdba159a463997ca2acdd690db86 Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-322089496 Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b1ffdba159a463997ca2acdd690db86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7b1ffdba159a463997ca2acdd690db86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7b1ffdba159a463997ca2acdd690db86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b1ffdba159a463997ca2acdd690db86"}]}] Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-322089496 Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 7b1ffdba159a463997ca2acdd690db86 Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-322089496 Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-InstanceActionsNegativeTestJSON-322089496-project Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 60b6b86c487643aea5693c887981dfb5 Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-322089496-project Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 could not be found. Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9'} Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 could not be found. Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 could not be found. Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:03.000658 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:03.005001 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:03.005001 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:03.005001 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:03.005001 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:03.005001 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:36:03.005001 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:36:03.005001 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 could not be found. Oct 04 21:36:03.005001 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:03.010909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1848c13d-b143-4b6d-9a29-c673723cc96f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] Returning 404 to user: Instance cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:36:03.011804 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1848c13d-b143-4b6d-9a29-c673723cc96f tempest-InstanceActionsNegativeTestJSON-322089496 tempest-InstanceActionsNegativeTestJSON-322089496-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9" status: 404 len: 111 microversion: 2.1 time: 0.126668 Oct 04 21:36:03.012380 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2872/5729] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:02 2022] GET /compute/v2.1/servers/cfbb539c-cfa5-4f18-ae9b-cb754d56d6c9 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:36:03.926598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e553eb54-6640-4569-8f63-3fef5a435dd9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10d36023-e4fa-473f-8fbd-ea9f374fe5ea"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:03.929163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e553eb54-6640-4569-8f63-3fef5a435dd9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:03.948265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e553eb54-6640-4569-8f63-3fef5a435dd9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:03.948808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e553eb54-6640-4569-8f63-3fef5a435dd9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:03.949262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e553eb54-6640-4569-8f63-3fef5a435dd9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:03.950008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e553eb54-6640-4569-8f63-3fef5a435dd9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:03.950808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e553eb54-6640-4569-8f63-3fef5a435dd9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:03.951517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e553eb54-6640-4569-8f63-3fef5a435dd9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:04.937986 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e553eb54-6640-4569-8f63-3fef5a435dd9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "POST /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.014797 Oct 04 21:36:04.944069 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2858/5730] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 21:36:03 2022] POST /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments => generated 194 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:12.966482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c01f3ba3-0603-420f-9169-d9b675a12081 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:12.967095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c01f3ba3-0603-420f-9169-d9b675a12081 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:12.972911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:12.984327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c01f3ba3-0603-420f-9169-d9b675a12081 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:12.986142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c01f3ba3-0603-420f-9169-d9b675a12081 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:12.988564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c01f3ba3-0603-420f-9169-d9b675a12081 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:12.989563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c01f3ba3-0603-420f-9169-d9b675a12081 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:12.991750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c01f3ba3-0603-420f-9169-d9b675a12081 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:12.992662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c01f3ba3-0603-420f-9169-d9b675a12081 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:12.995449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:13.030748 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c01f3ba3-0603-420f-9169-d9b675a12081 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc/ips" status: 200 len: 151 microversion: 2.20 time: 0.069586 Oct 04 21:36:13.031779 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2873/5731] 10.222.0.30 () {60 vars in 1289 bytes} [Tue Oct 4 21:36:12 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc/ips => generated 151 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:36:16.506505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-33ec4736-211d-46fa-ae33-50f1825eedaa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:16.513173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-33ec4736-211d-46fa-ae33-50f1825eedaa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:16.517726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:16.519168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:16.521341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33ec4736-211d-46fa-ae33-50f1825eedaa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:16.522313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33ec4736-211d-46fa-ae33-50f1825eedaa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:16.523310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33ec4736-211d-46fa-ae33-50f1825eedaa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:16.525015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33ec4736-211d-46fa-ae33-50f1825eedaa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:16.525777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33ec4736-211d-46fa-ae33-50f1825eedaa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:16.526405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33ec4736-211d-46fa-ae33-50f1825eedaa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:16.586163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-33ec4736-211d-46fa-ae33-50f1825eedaa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lazy-loading 'flavor' on Instance uuid 7aa024b1-e789-4226-b10a-07bf3ca97ecc {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:36:17.193927 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-33ec4736-211d-46fa-ae33-50f1825eedaa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "POST /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc/action" status: 202 len: 0 microversion: 2.20 time: 0.694699 Oct 04 21:36:17.194542 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2859/5732] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Oct 4 21:36:16 2022] POST /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc/action => generated 0 bytes in 697 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:36:17.205349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-963be46d-e7ed-4098-9bc6-2a1935868061 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:17.208187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-963be46d-e7ed-4098-9bc6-2a1935868061 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:17.246130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-963be46d-e7ed-4098-9bc6-2a1935868061 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:17.246732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-963be46d-e7ed-4098-9bc6-2a1935868061 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:17.247348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-963be46d-e7ed-4098-9bc6-2a1935868061 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:17.248246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-963be46d-e7ed-4098-9bc6-2a1935868061 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:17.248799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-963be46d-e7ed-4098-9bc6-2a1935868061 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:17.256491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-963be46d-e7ed-4098-9bc6-2a1935868061 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:17.597902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-963be46d-e7ed-4098-9bc6-2a1935868061 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:17.609994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-963be46d-e7ed-4098-9bc6-2a1935868061 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:17.609994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-963be46d-e7ed-4098-9bc6-2a1935868061 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:17.611834 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-963be46d-e7ed-4098-9bc6-2a1935868061 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1724 microversion: 2.20 time: 0.412378 Oct 04 21:36:17.613494 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2874/5733] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:17 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1724 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:18.397873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1044636982", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "21bd6fac-318c-4278-ac74-6ea140105f41"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:18.478633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] validate_networks() for [('21bd6fac-318c-4278-ac74-6ea140105f41', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:36:18.639279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-04f152f9-478c-413f-8409-98d63968b31c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:18.639959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-04f152f9-478c-413f-8409-98d63968b31c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:18.656370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04f152f9-478c-413f-8409-98d63968b31c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:18.656870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04f152f9-478c-413f-8409-98d63968b31c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:18.657318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04f152f9-478c-413f-8409-98d63968b31c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:18.658075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04f152f9-478c-413f-8409-98d63968b31c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:18.658544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04f152f9-478c-413f-8409-98d63968b31c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:18.658978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04f152f9-478c-413f-8409-98d63968b31c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:18.990392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-04f152f9-478c-413f-8409-98d63968b31c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:19.000035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-04f152f9-478c-413f-8409-98d63968b31c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:19.001712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-04f152f9-478c-413f-8409-98d63968b31c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:19.003326 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-04f152f9-478c-413f-8409-98d63968b31c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1724 microversion: 2.20 time: 0.367682 Oct 04 21:36:19.003675 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2875/5734] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:18 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1724 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:19.010307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-391e0abb-ed31-4e97-8293-4c95d7345235 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:19.012778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-391e0abb-ed31-4e97-8293-4c95d7345235 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:19.041586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-391e0abb-ed31-4e97-8293-4c95d7345235 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:19.042324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-391e0abb-ed31-4e97-8293-4c95d7345235 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:19.042967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-391e0abb-ed31-4e97-8293-4c95d7345235 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:19.044199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-391e0abb-ed31-4e97-8293-4c95d7345235 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:19.044199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-391e0abb-ed31-4e97-8293-4c95d7345235 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:19.044644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-391e0abb-ed31-4e97-8293-4c95d7345235 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:19.103965 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-391e0abb-ed31-4e97-8293-4c95d7345235 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.099176 Oct 04 21:36:19.104829 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2876/5735] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:36:19 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments => generated 371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:19.143227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:36:19.144134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:36:19.144864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:36:19.145534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:36:19.146328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:36:19.161158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:19.162423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:19.163120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:19.164091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:19.164917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:19.165743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:19.185622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Getting quotas for project 10b578dbd53946c2977352366a12279b. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:36:19.191700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Getting quotas for user 902608697c894535b0e8a1bafd225d59 and project 10b578dbd53946c2977352366a12279b. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:36:19.205458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Going to run 3 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:36:19.208253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: af293754-4522-4c34-9e22-cd3d8d626365] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:36:19.263172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4939bb4d-7368-4292-af34-e63529689103 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:19.263671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4939bb4d-7368-4292-af34-e63529689103 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:19.271005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4939bb4d-7368-4292-af34-e63529689103 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:19.271682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4939bb4d-7368-4292-af34-e63529689103 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:19.272128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4939bb4d-7368-4292-af34-e63529689103 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:19.272818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4939bb4d-7368-4292-af34-e63529689103 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:19.273275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4939bb4d-7368-4292-af34-e63529689103 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:19.273726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4939bb4d-7368-4292-af34-e63529689103 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:19.309000 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4939bb4d-7368-4292-af34-e63529689103 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments/5d6104b9-8a28-4ca2-aeb2-bbfd521f791e" status: 200 len: 194 microversion: 2.1 time: 0.050469 Oct 04 21:36:19.310271 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2877/5736] 10.222.0.30 () {58 vars in 1413 bytes} [Tue Oct 4 21:36:19 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments/5d6104b9-8a28-4ca2-aeb2-bbfd521f791e => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:36:19.335492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7fbe0104-13bf-4694-b79c-4911df0947b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:19.336399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7fbe0104-13bf-4694-b79c-4911df0947b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:19.347229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fbe0104-13bf-4694-b79c-4911df0947b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:19.347836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fbe0104-13bf-4694-b79c-4911df0947b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:19.348352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fbe0104-13bf-4694-b79c-4911df0947b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:19.349064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fbe0104-13bf-4694-b79c-4911df0947b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:19.349611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fbe0104-13bf-4694-b79c-4911df0947b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:19.350212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7fbe0104-13bf-4694-b79c-4911df0947b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:19.424726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 248223cc-90a5-49d8-a86a-23e6305e2903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=af293754-4522-4c34-9e22-cd3d8d626365,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:36:19.445623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-7fbe0104-13bf-4694-b79c-4911df0947b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lazy-loading 'services' on Instance uuid 27cc7b20-edb9-468f-9262-252c2a3a5509 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:36:19.518273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=248223cc-90a5-49d8-a86a-23e6305e2903,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:36:19.649982 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7fbe0104-13bf-4694-b79c-4911df0947b4 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "DELETE /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments/5d6104b9-8a28-4ca2-aeb2-bbfd521f791e" status: 202 len: 0 microversion: 2.1 time: 0.318984 Oct 04 21:36:19.651013 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2878/5737] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 21:36:19 2022] DELETE /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments/5d6104b9-8a28-4ca2-aeb2-bbfd521f791e => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:36:19.661837 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6ae45519-3a49-4bbb-9cda-c7568e4ec87c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.443341 Oct 04 21:36:19.668961 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2860/5738] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:36:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:36:19.696840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7876b38e-c166-4dce-812e-8108ddc30e7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:19.720887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7876b38e-c166-4dce-812e-8108ddc30e7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:19.721860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7876b38e-c166-4dce-812e-8108ddc30e7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Searching by: {'deleted': False, 'project_id': '10b578dbd53946c2977352366a12279b'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:36:19.752849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7876b38e-c166-4dce-812e-8108ddc30e7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:19.753346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7876b38e-c166-4dce-812e-8108ddc30e7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:19.753820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7876b38e-c166-4dce-812e-8108ddc30e7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:19.754561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7876b38e-c166-4dce-812e-8108ddc30e7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:19.755020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7876b38e-c166-4dce-812e-8108ddc30e7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:19.755451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7876b38e-c166-4dce-812e-8108ddc30e7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:19.782556 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7876b38e-c166-4dce-812e-8108ddc30e7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.106639 Oct 04 21:36:19.783151 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2879/5739] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Oct 4 21:36:19 2022] GET /compute/v2.1/servers => generated 1018 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:19.797389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-892c30f2-8c02-4a19-8b4d-429e5d11508a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:19.798225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-892c30f2-8c02-4a19-8b4d-429e5d11508a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:19.882571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-892c30f2-8c02-4a19-8b4d-429e5d11508a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:19.892878 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-892c30f2-8c02-4a19-8b4d-429e5d11508a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 200 len: 1223 microversion: 2.1 time: 0.100132 Oct 04 21:36:19.913316 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2861/5740] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:19 2022] GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 1223 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:20.030311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6f21f4f6-dfb9-48be-96eb-b2a10b682411 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:20.031057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6f21f4f6-dfb9-48be-96eb-b2a10b682411 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:20.037369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6f21f4f6-dfb9-48be-96eb-b2a10b682411 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:20.037887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6f21f4f6-dfb9-48be-96eb-b2a10b682411 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:20.038331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6f21f4f6-dfb9-48be-96eb-b2a10b682411 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:20.039039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6f21f4f6-dfb9-48be-96eb-b2a10b682411 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:20.039505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6f21f4f6-dfb9-48be-96eb-b2a10b682411 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:20.040630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6f21f4f6-dfb9-48be-96eb-b2a10b682411 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:20.193304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6f21f4f6-dfb9-48be-96eb-b2a10b682411 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:20.203366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6f21f4f6-dfb9-48be-96eb-b2a10b682411 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:20.204933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6f21f4f6-dfb9-48be-96eb-b2a10b682411 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:20.206454 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6f21f4f6-dfb9-48be-96eb-b2a10b682411 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1724 microversion: 2.20 time: 0.180444 Oct 04 21:36:20.207028 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2880/5741] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:20 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:20.921360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-376e2817-6f84-4179-846e-8ae764afe031 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:20.926727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-376e2817-6f84-4179-846e-8ae764afe031 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:21.064344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-376e2817-6f84-4179-846e-8ae764afe031 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:21.073983 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-376e2817-6f84-4179-846e-8ae764afe031 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 200 len: 1223 microversion: 2.1 time: 0.157943 Oct 04 21:36:21.075076 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2862/5742] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:20 2022] GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 1223 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:21.233870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-10869bdb-ea38-4ab3-9962-3f10eb3034fa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:21.235682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-10869bdb-ea38-4ab3-9962-3f10eb3034fa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:21.252765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10869bdb-ea38-4ab3-9962-3f10eb3034fa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:21.270315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10869bdb-ea38-4ab3-9962-3f10eb3034fa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:21.272507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10869bdb-ea38-4ab3-9962-3f10eb3034fa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:21.275305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10869bdb-ea38-4ab3-9962-3f10eb3034fa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:21.279908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10869bdb-ea38-4ab3-9962-3f10eb3034fa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:21.280664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10869bdb-ea38-4ab3-9962-3f10eb3034fa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:21.538132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-10869bdb-ea38-4ab3-9962-3f10eb3034fa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:21.548583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-10869bdb-ea38-4ab3-9962-3f10eb3034fa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:21.551509 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-10869bdb-ea38-4ab3-9962-3f10eb3034fa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:21.552969 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-10869bdb-ea38-4ab3-9962-3f10eb3034fa tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1724 microversion: 2.20 time: 0.323903 Oct 04 21:36:21.553953 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2881/5743] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:21 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:22.096227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0019ea5a-bbf6-46b6-affc-54cf7994415c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:22.096841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0019ea5a-bbf6-46b6-affc-54cf7994415c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:22.175027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0019ea5a-bbf6-46b6-affc-54cf7994415c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:22.189533 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0019ea5a-bbf6-46b6-affc-54cf7994415c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 200 len: 1223 microversion: 2.1 time: 0.096933 Oct 04 21:36:22.200505 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2863/5744] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:22 2022] GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:22.583452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4da2c132-01a2-4088-b831-7a35b87057a5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:22.585182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4da2c132-01a2-4088-b831-7a35b87057a5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:22.620563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4da2c132-01a2-4088-b831-7a35b87057a5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:22.621496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4da2c132-01a2-4088-b831-7a35b87057a5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:22.621496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4da2c132-01a2-4088-b831-7a35b87057a5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:22.622229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4da2c132-01a2-4088-b831-7a35b87057a5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:22.622690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4da2c132-01a2-4088-b831-7a35b87057a5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:22.623167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4da2c132-01a2-4088-b831-7a35b87057a5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:22.868589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4da2c132-01a2-4088-b831-7a35b87057a5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:22.881800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4da2c132-01a2-4088-b831-7a35b87057a5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:22.881800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4da2c132-01a2-4088-b831-7a35b87057a5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:22.884065 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4da2c132-01a2-4088-b831-7a35b87057a5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1724 microversion: 2.20 time: 0.304355 Oct 04 21:36:22.884840 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2882/5745] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:22 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:23.217318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa4dbb59-4fe7-47ef-8936-0fd8c2c92619 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:23.217318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aa4dbb59-4fe7-47ef-8936-0fd8c2c92619 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:23.224385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa4dbb59-4fe7-47ef-8936-0fd8c2c92619 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:23.224892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa4dbb59-4fe7-47ef-8936-0fd8c2c92619 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:23.225332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa4dbb59-4fe7-47ef-8936-0fd8c2c92619 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:23.230376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa4dbb59-4fe7-47ef-8936-0fd8c2c92619 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:23.230852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa4dbb59-4fe7-47ef-8936-0fd8c2c92619 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:23.231507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa4dbb59-4fe7-47ef-8936-0fd8c2c92619 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:23.317550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aa4dbb59-4fe7-47ef-8936-0fd8c2c92619 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:23.333228 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aa4dbb59-4fe7-47ef-8936-0fd8c2c92619 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 200 len: 1227 microversion: 2.1 time: 0.119576 Oct 04 21:36:23.333228 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2864/5746] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:23 2022] GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 1227 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:23.917355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4691afb0-4338-4dab-90b2-2d81c373bfd4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:23.918552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4691afb0-4338-4dab-90b2-2d81c373bfd4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:23.931093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4691afb0-4338-4dab-90b2-2d81c373bfd4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:23.931874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4691afb0-4338-4dab-90b2-2d81c373bfd4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:23.933959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4691afb0-4338-4dab-90b2-2d81c373bfd4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:23.936259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4691afb0-4338-4dab-90b2-2d81c373bfd4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:23.938001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4691afb0-4338-4dab-90b2-2d81c373bfd4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:23.942036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4691afb0-4338-4dab-90b2-2d81c373bfd4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:24.285231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4691afb0-4338-4dab-90b2-2d81c373bfd4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:24.306979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4691afb0-4338-4dab-90b2-2d81c373bfd4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:24.311722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4691afb0-4338-4dab-90b2-2d81c373bfd4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:24.321531 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4691afb0-4338-4dab-90b2-2d81c373bfd4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1724 microversion: 2.20 time: 0.407449 Oct 04 21:36:24.328059 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2883/5747] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:23 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1724 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:24.358335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8a9ea878-99cc-4345-9fc1-379a46862d4f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:24.362870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8a9ea878-99cc-4345-9fc1-379a46862d4f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:24.373778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a9ea878-99cc-4345-9fc1-379a46862d4f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:24.374191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a9ea878-99cc-4345-9fc1-379a46862d4f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:24.374643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a9ea878-99cc-4345-9fc1-379a46862d4f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:24.375365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a9ea878-99cc-4345-9fc1-379a46862d4f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:24.378712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a9ea878-99cc-4345-9fc1-379a46862d4f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:24.380449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a9ea878-99cc-4345-9fc1-379a46862d4f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:24.580771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8a9ea878-99cc-4345-9fc1-379a46862d4f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:24.589752 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8a9ea878-99cc-4345-9fc1-379a46862d4f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 200 len: 1275 microversion: 2.1 time: 0.235645 Oct 04 21:36:24.625941 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2865/5748] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:24 2022] GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 1275 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:25.356675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4f43f419-c14c-4a47-a3e5-470e9a5909d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:25.357297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4f43f419-c14c-4a47-a3e5-470e9a5909d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:25.377080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f43f419-c14c-4a47-a3e5-470e9a5909d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:25.377630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f43f419-c14c-4a47-a3e5-470e9a5909d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:25.378139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f43f419-c14c-4a47-a3e5-470e9a5909d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:25.378855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f43f419-c14c-4a47-a3e5-470e9a5909d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:25.379314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f43f419-c14c-4a47-a3e5-470e9a5909d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:25.379746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f43f419-c14c-4a47-a3e5-470e9a5909d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:25.615592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7f53c2da-8c92-4b45-86da-f46936411248 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:25.616826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7f53c2da-8c92-4b45-86da-f46936411248 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:25.624357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f53c2da-8c92-4b45-86da-f46936411248 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:25.625033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f53c2da-8c92-4b45-86da-f46936411248 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:25.625684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f53c2da-8c92-4b45-86da-f46936411248 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:25.626556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f53c2da-8c92-4b45-86da-f46936411248 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:25.627173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f53c2da-8c92-4b45-86da-f46936411248 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:25.627888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f53c2da-8c92-4b45-86da-f46936411248 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:25.901992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7f53c2da-8c92-4b45-86da-f46936411248 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:25.917576 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7f53c2da-8c92-4b45-86da-f46936411248 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 200 len: 1281 microversion: 2.1 time: 0.305679 Oct 04 21:36:25.934230 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2866/5749] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:25 2022] GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 1281 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:36:25.937716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4f43f419-c14c-4a47-a3e5-470e9a5909d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:25.955339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4f43f419-c14c-4a47-a3e5-470e9a5909d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:25.962690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4f43f419-c14c-4a47-a3e5-470e9a5909d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:25.968296 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4f43f419-c14c-4a47-a3e5-470e9a5909d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1724 microversion: 2.20 time: 0.613255 Oct 04 21:36:25.984978 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2884/5750] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:25 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1724 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:26.946508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8f8dc655-ea45-4104-99c5-b2673c993f88 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:26.948860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8f8dc655-ea45-4104-99c5-b2673c993f88 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:26.961233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f8dc655-ea45-4104-99c5-b2673c993f88 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:26.962450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f8dc655-ea45-4104-99c5-b2673c993f88 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:26.972365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f8dc655-ea45-4104-99c5-b2673c993f88 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:26.973392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f8dc655-ea45-4104-99c5-b2673c993f88 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:26.974132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f8dc655-ea45-4104-99c5-b2673c993f88 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:26.975042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f8dc655-ea45-4104-99c5-b2673c993f88 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:27.000355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eec3f131-773b-4dd8-aa28-1e3b2c5044b0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:27.001591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eec3f131-773b-4dd8-aa28-1e3b2c5044b0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:27.015522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eec3f131-773b-4dd8-aa28-1e3b2c5044b0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:27.016268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eec3f131-773b-4dd8-aa28-1e3b2c5044b0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:27.016927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eec3f131-773b-4dd8-aa28-1e3b2c5044b0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:27.017911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eec3f131-773b-4dd8-aa28-1e3b2c5044b0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:27.018534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eec3f131-773b-4dd8-aa28-1e3b2c5044b0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:27.022772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eec3f131-773b-4dd8-aa28-1e3b2c5044b0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:27.242136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8f8dc655-ea45-4104-99c5-b2673c993f88 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:27.251442 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8f8dc655-ea45-4104-99c5-b2673c993f88 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 200 len: 1281 microversion: 2.1 time: 0.309366 Oct 04 21:36:27.273806 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2867/5751] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:26 2022] GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 1281 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:27.279547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-942f9e24-7d89-470d-937f-1dec55d6efc3 req-733ff0d2-3743-4937-9e56-cec943492a93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af293754-4522-4c34-9e22-cd3d8d626365", "tag": "2090e29a-7719-49b0-9884-c75d92fdeed4"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:27.307340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-942f9e24-7d89-470d-937f-1dec55d6efc3 req-733ff0d2-3743-4937-9e56-cec943492a93 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:27.308495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-942f9e24-7d89-470d-937f-1dec55d6efc3 req-733ff0d2-3743-4937-9e56-cec943492a93 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:27.309166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-942f9e24-7d89-470d-937f-1dec55d6efc3 req-733ff0d2-3743-4937-9e56-cec943492a93 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:27.346445 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-942f9e24-7d89-470d-937f-1dec55d6efc3 req-733ff0d2-3743-4937-9e56-cec943492a93 service nova] Creating event network-changed:2090e29a-7719-49b0-9884-c75d92fdeed4 for instance af293754-4522-4c34-9e22-cd3d8d626365 on n-h1-860282-1 Oct 04 21:36:27.353091 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-942f9e24-7d89-470d-937f-1dec55d6efc3 req-733ff0d2-3743-4937-9e56-cec943492a93 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076824 Oct 04 21:36:27.354191 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2868/5752] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:27.855311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eec3f131-773b-4dd8-aa28-1e3b2c5044b0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:27.866306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eec3f131-773b-4dd8-aa28-1e3b2c5044b0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:27.871029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eec3f131-773b-4dd8-aa28-1e3b2c5044b0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:27.873232 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eec3f131-773b-4dd8-aa28-1e3b2c5044b0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1724 microversion: 2.20 time: 0.877497 Oct 04 21:36:27.898050 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2885/5753] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:26 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1724 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:28.283944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-291b7634-3379-4381-9356-7976939f43be tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:28.285252 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-291b7634-3379-4381-9356-7976939f43be tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:28.297093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-291b7634-3379-4381-9356-7976939f43be tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:28.310275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-291b7634-3379-4381-9356-7976939f43be tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:28.310758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-291b7634-3379-4381-9356-7976939f43be tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:28.311526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-291b7634-3379-4381-9356-7976939f43be tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:28.312007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-291b7634-3379-4381-9356-7976939f43be tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:28.312458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-291b7634-3379-4381-9356-7976939f43be tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:28.574049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-291b7634-3379-4381-9356-7976939f43be tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:28.584136 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-291b7634-3379-4381-9356-7976939f43be tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 200 len: 1323 microversion: 2.1 time: 0.306051 Oct 04 21:36:28.585952 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2869/5754] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:28 2022] GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 1323 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:28.674103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2d85b2b1-1ec2-4b68-80a5-28350965a7b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:28.674797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2d85b2b1-1ec2-4b68-80a5-28350965a7b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:28.692612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d85b2b1-1ec2-4b68-80a5-28350965a7b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:28.697562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d85b2b1-1ec2-4b68-80a5-28350965a7b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:28.698330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d85b2b1-1ec2-4b68-80a5-28350965a7b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:28.701690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d85b2b1-1ec2-4b68-80a5-28350965a7b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:28.702289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d85b2b1-1ec2-4b68-80a5-28350965a7b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:28.702826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d85b2b1-1ec2-4b68-80a5-28350965a7b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:28.736198 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2d85b2b1-1ec2-4b68-80a5-28350965a7b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments/10d36023-e4fa-473f-8fbd-ea9f374fe5ea" status: 200 len: 194 microversion: 2.1 time: 0.069645 Oct 04 21:36:28.736925 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2886/5755] 10.222.0.30 () {58 vars in 1413 bytes} [Tue Oct 4 21:36:28 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments/10d36023-e4fa-473f-8fbd-ea9f374fe5ea => generated 194 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:28.747779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f4629652-b480-432d-9aa6-ee3d3537f5c7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:28.748355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f4629652-b480-432d-9aa6-ee3d3537f5c7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:28.754814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f4629652-b480-432d-9aa6-ee3d3537f5c7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:28.755598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f4629652-b480-432d-9aa6-ee3d3537f5c7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:28.756145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f4629652-b480-432d-9aa6-ee3d3537f5c7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:28.756835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f4629652-b480-432d-9aa6-ee3d3537f5c7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:28.759906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f4629652-b480-432d-9aa6-ee3d3537f5c7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:28.759906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f4629652-b480-432d-9aa6-ee3d3537f5c7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:28.864292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-f4629652-b480-432d-9aa6-ee3d3537f5c7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lazy-loading 'services' on Instance uuid 27cc7b20-edb9-468f-9262-252c2a3a5509 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:36:28.911320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e1af0bf7-fdc2-4da8-b890-fb111b7c1937 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:28.911985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e1af0bf7-fdc2-4da8-b890-fb111b7c1937 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:28.919087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1af0bf7-fdc2-4da8-b890-fb111b7c1937 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:28.919667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1af0bf7-fdc2-4da8-b890-fb111b7c1937 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:28.920080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1af0bf7-fdc2-4da8-b890-fb111b7c1937 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:28.920802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1af0bf7-fdc2-4da8-b890-fb111b7c1937 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:28.921265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1af0bf7-fdc2-4da8-b890-fb111b7c1937 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:28.921791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1af0bf7-fdc2-4da8-b890-fb111b7c1937 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:29.152226 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f4629652-b480-432d-9aa6-ee3d3537f5c7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "DELETE /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments/10d36023-e4fa-473f-8fbd-ea9f374fe5ea" status: 202 len: 0 microversion: 2.1 time: 0.408312 Oct 04 21:36:29.153163 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2870/5756] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 21:36:28 2022] DELETE /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments/10d36023-e4fa-473f-8fbd-ea9f374fe5ea => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:36:29.207974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:29.215408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-902fb46b-fb01-46e6-87fd-63059aae2c0c req-4c47b1d6-fe6f-496a-9e5d-9d08e67b0817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "248223cc-90a5-49d8-a86a-23e6305e2903", "tag": "eac6b243-f82e-4f56-b480-20d2e2e300e3"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:29.217680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e1af0bf7-fdc2-4da8-b890-fb111b7c1937 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:29.233891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e1af0bf7-fdc2-4da8-b890-fb111b7c1937 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:29.238780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-902fb46b-fb01-46e6-87fd-63059aae2c0c req-4c47b1d6-fe6f-496a-9e5d-9d08e67b0817 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:29.239210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e1af0bf7-fdc2-4da8-b890-fb111b7c1937 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:29.241288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-902fb46b-fb01-46e6-87fd-63059aae2c0c req-4c47b1d6-fe6f-496a-9e5d-9d08e67b0817 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:29.242426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-902fb46b-fb01-46e6-87fd-63059aae2c0c req-4c47b1d6-fe6f-496a-9e5d-9d08e67b0817 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:29.243828 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e1af0bf7-fdc2-4da8-b890-fb111b7c1937 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1745 microversion: 2.20 time: 0.335240 Oct 04 21:36:29.244999 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2887/5757] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:28 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1745 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:29.278906 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-902fb46b-fb01-46e6-87fd-63059aae2c0c req-4c47b1d6-fe6f-496a-9e5d-9d08e67b0817 service nova] Creating event network-changed:eac6b243-f82e-4f56-b480-20d2e2e300e3 for instance 248223cc-90a5-49d8-a86a-23e6305e2903 on n-h2-860282-1 Oct 04 21:36:29.294924 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-902fb46b-fb01-46e6-87fd-63059aae2c0c req-4c47b1d6-fe6f-496a-9e5d-9d08e67b0817 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087466 Oct 04 21:36:29.297779 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2871/5758] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:36:29.608822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-97538e97-63f1-4f7f-b291-a767e04453db tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:29.609467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-97538e97-63f1-4f7f-b291-a767e04453db tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:29.618622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97538e97-63f1-4f7f-b291-a767e04453db tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:29.619572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97538e97-63f1-4f7f-b291-a767e04453db tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:29.620271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97538e97-63f1-4f7f-b291-a767e04453db tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:29.621622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97538e97-63f1-4f7f-b291-a767e04453db tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:29.622747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97538e97-63f1-4f7f-b291-a767e04453db tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:29.634924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-97538e97-63f1-4f7f-b291-a767e04453db tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:29.767274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:30.266089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-97538e97-63f1-4f7f-b291-a767e04453db tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:30.276073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-962b804e-c68b-421f-ac0e-2b5900445cd1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:30.276923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-962b804e-c68b-421f-ac0e-2b5900445cd1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:30.278307 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-97538e97-63f1-4f7f-b291-a767e04453db tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 200 len: 1323 microversion: 2.1 time: 0.673277 Oct 04 21:36:30.280929 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2888/5759] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:29 2022] GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 1323 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:30.301520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-962b804e-c68b-421f-ac0e-2b5900445cd1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:30.302052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-962b804e-c68b-421f-ac0e-2b5900445cd1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:30.305719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-962b804e-c68b-421f-ac0e-2b5900445cd1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:30.307267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-962b804e-c68b-421f-ac0e-2b5900445cd1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:30.310012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-962b804e-c68b-421f-ac0e-2b5900445cd1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:30.310715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-962b804e-c68b-421f-ac0e-2b5900445cd1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:30.807884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-962b804e-c68b-421f-ac0e-2b5900445cd1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:30.831184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-962b804e-c68b-421f-ac0e-2b5900445cd1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:30.835884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-962b804e-c68b-421f-ac0e-2b5900445cd1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:30.839778 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-962b804e-c68b-421f-ac0e-2b5900445cd1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1740 microversion: 2.20 time: 0.568847 Oct 04 21:36:30.866503 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2872/5760] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:30 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1740 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:31.311887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-358c847c-d212-4499-b043-7e1f8d96df8d req-b18612b2-805a-44dc-ac3f-34c53c11af35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ed51db6-79cb-4486-aaa5-8eb15f7234a4", "tag": "c84d49e9-e62a-4ae9-b985-f3e7248dcb69"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:31.312507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-98f6b451-d8d8-4b2c-9a31-9dc355cbdf33 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:31.313333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-98f6b451-d8d8-4b2c-9a31-9dc355cbdf33 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:31.324006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-358c847c-d212-4499-b043-7e1f8d96df8d req-b18612b2-805a-44dc-ac3f-34c53c11af35 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:31.325072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-358c847c-d212-4499-b043-7e1f8d96df8d req-b18612b2-805a-44dc-ac3f-34c53c11af35 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:31.325690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-358c847c-d212-4499-b043-7e1f8d96df8d req-b18612b2-805a-44dc-ac3f-34c53c11af35 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:31.333411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98f6b451-d8d8-4b2c-9a31-9dc355cbdf33 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:31.338973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98f6b451-d8d8-4b2c-9a31-9dc355cbdf33 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:31.347367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98f6b451-d8d8-4b2c-9a31-9dc355cbdf33 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:31.347668 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-358c847c-d212-4499-b043-7e1f8d96df8d req-b18612b2-805a-44dc-ac3f-34c53c11af35 service nova] Creating event network-changed:c84d49e9-e62a-4ae9-b985-f3e7248dcb69 for instance 4ed51db6-79cb-4486-aaa5-8eb15f7234a4 on n-h1-860282-1 Oct 04 21:36:31.347959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98f6b451-d8d8-4b2c-9a31-9dc355cbdf33 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:31.347959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98f6b451-d8d8-4b2c-9a31-9dc355cbdf33 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:31.347959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98f6b451-d8d8-4b2c-9a31-9dc355cbdf33 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:31.348380 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-358c847c-d212-4499-b043-7e1f8d96df8d req-b18612b2-805a-44dc-ac3f-34c53c11af35 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039331 Oct 04 21:36:31.349589 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2873/5761] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:31.838364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-98f6b451-d8d8-4b2c-9a31-9dc355cbdf33 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:31.841826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:31.852105 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-98f6b451-d8d8-4b2c-9a31-9dc355cbdf33 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 200 len: 1323 microversion: 2.1 time: 0.547021 Oct 04 21:36:31.857396 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2889/5762] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:31 2022] GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 1323 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:31.867732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-712c14e6-4da6-4c89-b08c-31f648ff0344 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:31.868605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-712c14e6-4da6-4c89-b08c-31f648ff0344 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:31.888486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-712c14e6-4da6-4c89-b08c-31f648ff0344 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:31.889452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-712c14e6-4da6-4c89-b08c-31f648ff0344 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:31.890139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-712c14e6-4da6-4c89-b08c-31f648ff0344 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:31.891045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-712c14e6-4da6-4c89-b08c-31f648ff0344 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:31.891658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-712c14e6-4da6-4c89-b08c-31f648ff0344 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:31.892267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-712c14e6-4da6-4c89-b08c-31f648ff0344 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:32.185275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=12 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:32.746365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-712c14e6-4da6-4c89-b08c-31f648ff0344 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:32.757084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-712c14e6-4da6-4c89-b08c-31f648ff0344 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:32.781722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-712c14e6-4da6-4c89-b08c-31f648ff0344 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:32.789636 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-712c14e6-4da6-4c89-b08c-31f648ff0344 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1740 microversion: 2.20 time: 0.925337 Oct 04 21:36:32.798792 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2874/5763] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:31 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1740 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:32.879674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b6036def-f60a-4af2-8805-6dfc23992b66 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:32.881290 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b6036def-f60a-4af2-8805-6dfc23992b66 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:32.906204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6036def-f60a-4af2-8805-6dfc23992b66 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:32.912116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6036def-f60a-4af2-8805-6dfc23992b66 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:32.915169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6036def-f60a-4af2-8805-6dfc23992b66 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:32.917950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6036def-f60a-4af2-8805-6dfc23992b66 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:32.918605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6036def-f60a-4af2-8805-6dfc23992b66 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:32.920516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6036def-f60a-4af2-8805-6dfc23992b66 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:33.544997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b6036def-f60a-4af2-8805-6dfc23992b66 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:33.561120 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b6036def-f60a-4af2-8805-6dfc23992b66 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 200 len: 1323 microversion: 2.1 time: 0.685984 Oct 04 21:36:33.566637 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2890/5764] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:32 2022] GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 1323 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:33.818768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6a1bf255-4959-4c4e-97c8-2df5545cd1c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:33.820007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6a1bf255-4959-4c4e-97c8-2df5545cd1c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:33.839786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a1bf255-4959-4c4e-97c8-2df5545cd1c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:33.840601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a1bf255-4959-4c4e-97c8-2df5545cd1c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:33.843079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a1bf255-4959-4c4e-97c8-2df5545cd1c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:33.846815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a1bf255-4959-4c4e-97c8-2df5545cd1c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:33.848980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a1bf255-4959-4c4e-97c8-2df5545cd1c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:33.851960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a1bf255-4959-4c4e-97c8-2df5545cd1c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:34.377911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6a1bf255-4959-4c4e-97c8-2df5545cd1c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:34.397865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6a1bf255-4959-4c4e-97c8-2df5545cd1c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:34.401350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6a1bf255-4959-4c4e-97c8-2df5545cd1c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:34.406748 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6a1bf255-4959-4c4e-97c8-2df5545cd1c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1740 microversion: 2.20 time: 0.592224 Oct 04 21:36:34.417742 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2875/5765] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:33 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1740 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:34.600607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-579709b8-fadc-4beb-9aec-b92474836cef tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:34.600607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-579709b8-fadc-4beb-9aec-b92474836cef tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:34.611251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-579709b8-fadc-4beb-9aec-b92474836cef tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:34.612874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-579709b8-fadc-4beb-9aec-b92474836cef tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:34.615874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-579709b8-fadc-4beb-9aec-b92474836cef tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:34.619600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-579709b8-fadc-4beb-9aec-b92474836cef tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:34.621219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-579709b8-fadc-4beb-9aec-b92474836cef tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:34.622733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-579709b8-fadc-4beb-9aec-b92474836cef tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:34.987666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-2060156e-6556-4a11-ac12-ef3cff22ea27 req-7375b240-81fd-4eab-8c10-f1c3aea6252d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af293754-4522-4c34-9e22-cd3d8d626365", "name": "network-vif-plugged", "status": "completed", "tag": "2090e29a-7719-49b0-9884-c75d92fdeed4"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:35.010075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2060156e-6556-4a11-ac12-ef3cff22ea27 req-7375b240-81fd-4eab-8c10-f1c3aea6252d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:35.012144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2060156e-6556-4a11-ac12-ef3cff22ea27 req-7375b240-81fd-4eab-8c10-f1c3aea6252d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:35.014191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2060156e-6556-4a11-ac12-ef3cff22ea27 req-7375b240-81fd-4eab-8c10-f1c3aea6252d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:35.041528 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-2060156e-6556-4a11-ac12-ef3cff22ea27 req-7375b240-81fd-4eab-8c10-f1c3aea6252d service nova] Creating event network-vif-plugged:2090e29a-7719-49b0-9884-c75d92fdeed4 for instance af293754-4522-4c34-9e22-cd3d8d626365 on n-h1-860282-1 Oct 04 21:36:35.065971 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-2060156e-6556-4a11-ac12-ef3cff22ea27 req-7375b240-81fd-4eab-8c10-f1c3aea6252d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.593194 Oct 04 21:36:35.067203 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2891/5766] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:35.312328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-579709b8-fadc-4beb-9aec-b92474836cef tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:35.326075 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-579709b8-fadc-4beb-9aec-b92474836cef tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 200 len: 1323 microversion: 2.1 time: 0.738868 Oct 04 21:36:35.329785 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2876/5767] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:34 2022] GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 1323 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:35.471900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-095f92be-f342-47d2-92a8-446e41eeb1fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:35.473304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-095f92be-f342-47d2-92a8-446e41eeb1fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:35.487814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-095f92be-f342-47d2-92a8-446e41eeb1fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:35.488786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-095f92be-f342-47d2-92a8-446e41eeb1fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:35.491921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-095f92be-f342-47d2-92a8-446e41eeb1fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:35.493850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-095f92be-f342-47d2-92a8-446e41eeb1fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:35.495549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-095f92be-f342-47d2-92a8-446e41eeb1fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:35.513224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-095f92be-f342-47d2-92a8-446e41eeb1fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:35.901533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-095f92be-f342-47d2-92a8-446e41eeb1fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:35.943289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-095f92be-f342-47d2-92a8-446e41eeb1fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:35.945026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-095f92be-f342-47d2-92a8-446e41eeb1fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:35.946592 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-095f92be-f342-47d2-92a8-446e41eeb1fb tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1740 microversion: 2.20 time: 0.480358 Oct 04 21:36:35.952716 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2892/5768] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:35 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1740 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:36.356107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ed278882-63bf-4b26-af3c-be5072f8c196 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:36.356107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ed278882-63bf-4b26-af3c-be5072f8c196 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:36.369220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed278882-63bf-4b26-af3c-be5072f8c196 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:36.381839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed278882-63bf-4b26-af3c-be5072f8c196 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:36.382508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed278882-63bf-4b26-af3c-be5072f8c196 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:36.387389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed278882-63bf-4b26-af3c-be5072f8c196 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:36.388020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed278882-63bf-4b26-af3c-be5072f8c196 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:36.388547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed278882-63bf-4b26-af3c-be5072f8c196 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:36.854643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ed278882-63bf-4b26-af3c-be5072f8c196 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:36.867383 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ed278882-63bf-4b26-af3c-be5072f8c196 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 200 len: 1323 microversion: 2.1 time: 0.517072 Oct 04 21:36:36.869217 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2877/5769] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:36 2022] GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 1323 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:36.981005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c1b54da5-93bf-4c71-8f78-a955f51ee56c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:36.982117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c1b54da5-93bf-4c71-8f78-a955f51ee56c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:36.997989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1b54da5-93bf-4c71-8f78-a955f51ee56c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:36.998514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1b54da5-93bf-4c71-8f78-a955f51ee56c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:36.998975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1b54da5-93bf-4c71-8f78-a955f51ee56c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:36.999718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1b54da5-93bf-4c71-8f78-a955f51ee56c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:37.000189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1b54da5-93bf-4c71-8f78-a955f51ee56c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:37.000628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1b54da5-93bf-4c71-8f78-a955f51ee56c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:37.301242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-23af4827-0044-4836-a85b-4f7a4fe4eea7 req-d459556a-185f-47d7-b2c6-ce4d0367d53f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa024b1-e789-4226-b10a-07bf3ca97ecc", "name": "network-vif-plugged", "status": "completed", "tag": "f058e4a1-c25d-417e-8d41-b82e64725e18"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:37.334315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-23af4827-0044-4836-a85b-4f7a4fe4eea7 req-d459556a-185f-47d7-b2c6-ce4d0367d53f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:37.336118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-23af4827-0044-4836-a85b-4f7a4fe4eea7 req-d459556a-185f-47d7-b2c6-ce4d0367d53f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:37.337358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-23af4827-0044-4836-a85b-4f7a4fe4eea7 req-d459556a-185f-47d7-b2c6-ce4d0367d53f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:37.361085 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-23af4827-0044-4836-a85b-4f7a4fe4eea7 req-d459556a-185f-47d7-b2c6-ce4d0367d53f service nova] Creating event network-vif-plugged:f058e4a1-c25d-417e-8d41-b82e64725e18 for instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc on n-h1-860282-1 Oct 04 21:36:37.379219 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-23af4827-0044-4836-a85b-4f7a4fe4eea7 req-d459556a-185f-47d7-b2c6-ce4d0367d53f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083348 Oct 04 21:36:37.380393 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2878/5770] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:36:37.397351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c1b54da5-93bf-4c71-8f78-a955f51ee56c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:37.407674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c1b54da5-93bf-4c71-8f78-a955f51ee56c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:37.409222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c1b54da5-93bf-4c71-8f78-a955f51ee56c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:37.410818 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c1b54da5-93bf-4c71-8f78-a955f51ee56c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1740 microversion: 2.20 time: 0.434551 Oct 04 21:36:37.423768 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2893/5771] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:36 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1740 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:37.897784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9f292f30-b607-4867-b845-398e9bba447c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:37.899565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9f292f30-b607-4867-b845-398e9bba447c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:37.912098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f292f30-b607-4867-b845-398e9bba447c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:37.912098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f292f30-b607-4867-b845-398e9bba447c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:37.912098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f292f30-b607-4867-b845-398e9bba447c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:37.912098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f292f30-b607-4867-b845-398e9bba447c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:37.912098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f292f30-b607-4867-b845-398e9bba447c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:37.912754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f292f30-b607-4867-b845-398e9bba447c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:37.976025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:38.143357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9f292f30-b607-4867-b845-398e9bba447c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:38.157998 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9f292f30-b607-4867-b845-398e9bba447c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 200 len: 1323 microversion: 2.1 time: 0.267356 Oct 04 21:36:38.158955 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2879/5772] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:37 2022] GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 1323 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:36:38.445050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2eb60acb-ef22-4bf5-b0ca-8a4db3bd348a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:38.446487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2eb60acb-ef22-4bf5-b0ca-8a4db3bd348a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:38.476241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2eb60acb-ef22-4bf5-b0ca-8a4db3bd348a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:38.478243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2eb60acb-ef22-4bf5-b0ca-8a4db3bd348a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:38.485965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2eb60acb-ef22-4bf5-b0ca-8a4db3bd348a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:38.487762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2eb60acb-ef22-4bf5-b0ca-8a4db3bd348a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:38.487762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2eb60acb-ef22-4bf5-b0ca-8a4db3bd348a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:38.488067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2eb60acb-ef22-4bf5-b0ca-8a4db3bd348a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:38.605082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-05708c72-5573-4b54-bfc9-d4bac92556c9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:38.608575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-05708c72-5573-4b54-bfc9-d4bac92556c9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:38.620576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05708c72-5573-4b54-bfc9-d4bac92556c9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:38.622307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05708c72-5573-4b54-bfc9-d4bac92556c9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:38.623891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05708c72-5573-4b54-bfc9-d4bac92556c9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:38.625333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05708c72-5573-4b54-bfc9-d4bac92556c9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:38.626088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05708c72-5573-4b54-bfc9-d4bac92556c9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:38.627081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05708c72-5573-4b54-bfc9-d4bac92556c9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:38.666746 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-05708c72-5573-4b54-bfc9-d4bac92556c9 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067896 Oct 04 21:36:38.669969 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2880/5773] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:36:38 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:36:38.810196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4e547de8-0b17-4549-a1db-d4b97c261ca0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:38.812926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4e547de8-0b17-4549-a1db-d4b97c261ca0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:38.820008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e547de8-0b17-4549-a1db-d4b97c261ca0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:38.825040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e547de8-0b17-4549-a1db-d4b97c261ca0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:38.825040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e547de8-0b17-4549-a1db-d4b97c261ca0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:38.825040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e547de8-0b17-4549-a1db-d4b97c261ca0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:38.825040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e547de8-0b17-4549-a1db-d4b97c261ca0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:38.825040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e547de8-0b17-4549-a1db-d4b97c261ca0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:38.864064 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4e547de8-0b17-4549-a1db-d4b97c261ca0 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057990 Oct 04 21:36:38.864801 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2881/5774] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:36:38 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:36:38.937351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5f8f9570-a9ff-473b-acc5-dad1c2084331 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:38.937906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5f8f9570-a9ff-473b-acc5-dad1c2084331 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:38.945384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f8f9570-a9ff-473b-acc5-dad1c2084331 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:38.953073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f8f9570-a9ff-473b-acc5-dad1c2084331 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:38.953073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f8f9570-a9ff-473b-acc5-dad1c2084331 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:38.953073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f8f9570-a9ff-473b-acc5-dad1c2084331 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:38.953073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f8f9570-a9ff-473b-acc5-dad1c2084331 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:38.953073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f8f9570-a9ff-473b-acc5-dad1c2084331 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:38.982232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5f8f9570-a9ff-473b-acc5-dad1c2084331 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:36:39.113508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2eb60acb-ef22-4bf5-b0ca-8a4db3bd348a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:39.127721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2eb60acb-ef22-4bf5-b0ca-8a4db3bd348a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:39.143147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2eb60acb-ef22-4bf5-b0ca-8a4db3bd348a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:39.143147 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2eb60acb-ef22-4bf5-b0ca-8a4db3bd348a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1740 microversion: 2.20 time: 0.689387 Oct 04 21:36:39.143147 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2894/5775] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:38 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1740 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:39.181581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-16f3457b-cb50-47e0-8eb9-898319dba084 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:39.182496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-16f3457b-cb50-47e0-8eb9-898319dba084 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:39.194220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16f3457b-cb50-47e0-8eb9-898319dba084 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:39.194220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16f3457b-cb50-47e0-8eb9-898319dba084 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:39.194220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16f3457b-cb50-47e0-8eb9-898319dba084 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:39.197151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16f3457b-cb50-47e0-8eb9-898319dba084 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:39.197880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16f3457b-cb50-47e0-8eb9-898319dba084 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:39.199034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16f3457b-cb50-47e0-8eb9-898319dba084 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:39.399313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-16f3457b-cb50-47e0-8eb9-898319dba084 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:39.408706 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-16f3457b-cb50-47e0-8eb9-898319dba084 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 200 len: 1323 microversion: 2.1 time: 0.231118 Oct 04 21:36:39.422949 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2895/5776] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:39 2022] GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 1323 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:39.432939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-51bc7d82-bd42-486b-a554-7c6092c69c65 req-773e8178-2c0d-4429-bac6-8bf75c1dbc40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248223cc-90a5-49d8-a86a-23e6305e2903", "name": "network-vif-plugged", "status": "completed", "tag": "eac6b243-f82e-4f56-b480-20d2e2e300e3"}, {"server_uuid": "4ed51db6-79cb-4486-aaa5-8eb15f7234a4", "name": "network-vif-plugged", "status": "completed", "tag": "c84d49e9-e62a-4ae9-b985-f3e7248dcb69"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:39.439251 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5f8f9570-a9ff-473b-acc5-dad1c2084331 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "DELETE /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 204 len: 0 microversion: 2.1 time: 0.506600 Oct 04 21:36:39.439857 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2882/5777] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:36:38 2022] DELETE /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:36:39.445281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-51bc7d82-bd42-486b-a554-7c6092c69c65 req-773e8178-2c0d-4429-bac6-8bf75c1dbc40 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:39.446764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-51bc7d82-bd42-486b-a554-7c6092c69c65 req-773e8178-2c0d-4429-bac6-8bf75c1dbc40 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:39.446764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-51bc7d82-bd42-486b-a554-7c6092c69c65 req-773e8178-2c0d-4429-bac6-8bf75c1dbc40 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:39.451759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-147b0cd0-88f6-4995-92f4-08ba0e9cd037 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:39.452587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-147b0cd0-88f6-4995-92f4-08ba0e9cd037 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:39.463604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-147b0cd0-88f6-4995-92f4-08ba0e9cd037 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:39.463604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-147b0cd0-88f6-4995-92f4-08ba0e9cd037 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:39.463604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-147b0cd0-88f6-4995-92f4-08ba0e9cd037 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:39.463604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-147b0cd0-88f6-4995-92f4-08ba0e9cd037 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:39.464151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-147b0cd0-88f6-4995-92f4-08ba0e9cd037 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:39.464795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-147b0cd0-88f6-4995-92f4-08ba0e9cd037 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:39.466802 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-51bc7d82-bd42-486b-a554-7c6092c69c65 req-773e8178-2c0d-4429-bac6-8bf75c1dbc40 service nova] Creating event network-vif-plugged:eac6b243-f82e-4f56-b480-20d2e2e300e3 for instance 248223cc-90a5-49d8-a86a-23e6305e2903 on n-h2-860282-1 Oct 04 21:36:39.467328 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-51bc7d82-bd42-486b-a554-7c6092c69c65 req-773e8178-2c0d-4429-bac6-8bf75c1dbc40 service nova] Creating event network-vif-plugged:c84d49e9-e62a-4ae9-b985-f3e7248dcb69 for instance 4ed51db6-79cb-4486-aaa5-8eb15f7234a4 on n-h1-860282-1 Oct 04 21:36:39.476445 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-51bc7d82-bd42-486b-a554-7c6092c69c65 req-773e8178-2c0d-4429-bac6-8bf75c1dbc40 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051504 Oct 04 21:36:39.477775 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2896/5778] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:39.617170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f8f712ea-bc78-4ef3-98d8-acca746714ea tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:39.620622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f8f712ea-bc78-4ef3-98d8-acca746714ea tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:39.630703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8f712ea-bc78-4ef3-98d8-acca746714ea tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:39.631373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8f712ea-bc78-4ef3-98d8-acca746714ea tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:39.632161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8f712ea-bc78-4ef3-98d8-acca746714ea tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:39.634172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8f712ea-bc78-4ef3-98d8-acca746714ea tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:39.634790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8f712ea-bc78-4ef3-98d8-acca746714ea tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:39.635380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8f712ea-bc78-4ef3-98d8-acca746714ea tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:39.687827 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f8f712ea-bc78-4ef3-98d8-acca746714ea tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce/ips" status: 200 len: 149 microversion: 2.1 time: 0.076252 Oct 04 21:36:39.688739 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2897/5779] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Oct 4 21:36:39 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce/ips => generated 149 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:36:39.701242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-679ae9e9-b40c-4493-9a32-38f8c3c2e2ef tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c9408d4-9dba-4611-a11c-045ddf60534e"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:39.704701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-679ae9e9-b40c-4493-9a32-38f8c3c2e2ef tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:39.715393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-679ae9e9-b40c-4493-9a32-38f8c3c2e2ef tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:39.716093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-679ae9e9-b40c-4493-9a32-38f8c3c2e2ef tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:39.717184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-679ae9e9-b40c-4493-9a32-38f8c3c2e2ef tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:39.718102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-679ae9e9-b40c-4493-9a32-38f8c3c2e2ef tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:39.718718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-679ae9e9-b40c-4493-9a32-38f8c3c2e2ef tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:39.719787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-679ae9e9-b40c-4493-9a32-38f8c3c2e2ef tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:39.781173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-147b0cd0-88f6-4995-92f4-08ba0e9cd037 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:39.789329 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-147b0cd0-88f6-4995-92f4-08ba0e9cd037 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 200 len: 1675 microversion: 2.1 time: 0.342489 Oct 04 21:36:39.789958 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2883/5780] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:39 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 1675 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:39.881797 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-679ae9e9-b40c-4493-9a32-38f8c3c2e2ef tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] HTTP exception thrown: Invalid volume: volume 0c9408d4-9dba-4611-a11c-045ddf60534e is already attached to instances: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-679ae9e9-b40c-4493-9a32-38f8c3c2e2ef tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Request method failure captured: Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce/os-volume_attachments HTTP/1.1 Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 74 Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKbagiGypEfWhrQ_0lE94AP27Qoh0E4iGeIB2v7-1zLRFZVlQCLRG0FD49h9EoPD55kuiioz0fPU1oTFLY5Kkl3L3vqChLMTEe1In4MGHbsFa7Gm-matpM3wFwyWA19l96bcqrryYQdSr6oZRwmQgAqc6hQhUAbifVGqqLh8bVE-KBY Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}] Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 68a2203c15fe41d8ae410f31ba1e1301 Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: {"volumeAttachment": {"volumeId": "0c9408d4-9dba-4611-a11c-045ddf60534e"}} Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid volume: volume 0c9408d4-9dba-4611-a11c-045ddf60534e is already attached to instances: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'server_id': 'f8c5b825-6552-42c9-b652-2b7eff7bffce', 'body': {'volumeAttachment': {'volumeId': '0c9408d4-9dba-4611-a11c-045ddf60534e'}}} Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0c9408d4-9dba-4611-a11c-045ddf60534e is already attached to instances: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:36:39.884333 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:36:39.888989 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:36:39.888989 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:36:39.888989 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 21:36:39.888989 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 21:36:39.888989 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0c9408d4-9dba-4611-a11c-045ddf60534e is already attached to instances: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 Oct 04 21:36:39.888989 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:39.888989 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:39.888989 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:39.888989 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:39.888989 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:39.888989 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:39.888989 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:36:39.888989 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:36:39.888989 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0c9408d4-9dba-4611-a11c-045ddf60534e is already attached to instances: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 Oct 04 21:36:39.888989 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:39.888989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-679ae9e9-b40c-4493-9a32-38f8c3c2e2ef tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Returning 400 to user: Invalid volume: volume 0c9408d4-9dba-4611-a11c-045ddf60534e is already attached to instances: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:36:39.888989 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-679ae9e9-b40c-4493-9a32-38f8c3c2e2ef tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "POST /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.188707 Oct 04 21:36:39.888989 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2898/5781] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 21:36:39 2022] POST /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce/os-volume_attachments => generated 174 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:36:39.900183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f94b1d7e-aaa6-49f1-be8d-7362122dfa65 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:39.901115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f94b1d7e-aaa6-49f1-be8d-7362122dfa65 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:39.908563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f94b1d7e-aaa6-49f1-be8d-7362122dfa65 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:39.909064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f94b1d7e-aaa6-49f1-be8d-7362122dfa65 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:39.909931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f94b1d7e-aaa6-49f1-be8d-7362122dfa65 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:39.910846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f94b1d7e-aaa6-49f1-be8d-7362122dfa65 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:39.912622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f94b1d7e-aaa6-49f1-be8d-7362122dfa65 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:39.913551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f94b1d7e-aaa6-49f1-be8d-7362122dfa65 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:39.957124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f94b1d7e-aaa6-49f1-be8d-7362122dfa65 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:36:40.182875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9f63c5f5-2461-4052-9a85-a9ccbb82a183 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:40.183779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9f63c5f5-2461-4052-9a85-a9ccbb82a183 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:40.197413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f63c5f5-2461-4052-9a85-a9ccbb82a183 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:40.198225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f63c5f5-2461-4052-9a85-a9ccbb82a183 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:40.198848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f63c5f5-2461-4052-9a85-a9ccbb82a183 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:40.199722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f63c5f5-2461-4052-9a85-a9ccbb82a183 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:40.200359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f63c5f5-2461-4052-9a85-a9ccbb82a183 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:40.200800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f63c5f5-2461-4052-9a85-a9ccbb82a183 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:40.339742 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f94b1d7e-aaa6-49f1-be8d-7362122dfa65 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 204 len: 0 microversion: 2.1 time: 0.447356 Oct 04 21:36:40.343997 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2884/5782] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:36:39 2022] DELETE /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:36:40.354076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e8396eb6-1239-4e03-98f7-8bf6e8a3b5aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:40.354076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e8396eb6-1239-4e03-98f7-8bf6e8a3b5aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:40.363423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8396eb6-1239-4e03-98f7-8bf6e8a3b5aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:40.366024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8396eb6-1239-4e03-98f7-8bf6e8a3b5aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:40.366465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8396eb6-1239-4e03-98f7-8bf6e8a3b5aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:40.367218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8396eb6-1239-4e03-98f7-8bf6e8a3b5aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:40.367829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8396eb6-1239-4e03-98f7-8bf6e8a3b5aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:40.368261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8396eb6-1239-4e03-98f7-8bf6e8a3b5aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:40.396485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9f63c5f5-2461-4052-9a85-a9ccbb82a183 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:40.407306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9f63c5f5-2461-4052-9a85-a9ccbb82a183 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:40.409110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9f63c5f5-2461-4052-9a85-a9ccbb82a183 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:40.410788 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9f63c5f5-2461-4052-9a85-a9ccbb82a183 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1740 microversion: 2.20 time: 0.232449 Oct 04 21:36:40.411931 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2899/5783] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:40 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1740 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:36:40.438252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dab6f519-a8ea-4dde-ac31-3f787ae88dc2 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:40.439332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dab6f519-a8ea-4dde-ac31-3f787ae88dc2 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:40.448113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dab6f519-a8ea-4dde-ac31-3f787ae88dc2 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:40.449305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dab6f519-a8ea-4dde-ac31-3f787ae88dc2 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:40.450033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dab6f519-a8ea-4dde-ac31-3f787ae88dc2 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:40.451036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dab6f519-a8ea-4dde-ac31-3f787ae88dc2 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:40.451720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dab6f519-a8ea-4dde-ac31-3f787ae88dc2 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:40.452376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dab6f519-a8ea-4dde-ac31-3f787ae88dc2 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:40.809353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e8396eb6-1239-4e03-98f7-8bf6e8a3b5aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:40.837194 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e8396eb6-1239-4e03-98f7-8bf6e8a3b5aa tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1681 microversion: 2.1 time: 0.490817 Oct 04 21:36:40.857706 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2885/5784] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:40 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1681 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:40.865742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-efbd74ae-0ddf-425c-b8c6-f807ea3a32ee tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:40.871888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-efbd74ae-0ddf-425c-b8c6-f807ea3a32ee tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:40.874322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dab6f519-a8ea-4dde-ac31-3f787ae88dc2 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:40.879169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efbd74ae-0ddf-425c-b8c6-f807ea3a32ee tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:40.879790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efbd74ae-0ddf-425c-b8c6-f807ea3a32ee tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:40.880358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efbd74ae-0ddf-425c-b8c6-f807ea3a32ee tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:40.882028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efbd74ae-0ddf-425c-b8c6-f807ea3a32ee tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:40.882799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efbd74ae-0ddf-425c-b8c6-f807ea3a32ee tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:40.883442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efbd74ae-0ddf-425c-b8c6-f807ea3a32ee tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:40.885202 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dab6f519-a8ea-4dde-ac31-3f787ae88dc2 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 200 len: 1323 microversion: 2.1 time: 0.450890 Oct 04 21:36:40.905069 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2900/5785] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:40 2022] GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 1323 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:41.084143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-efbd74ae-0ddf-425c-b8c6-f807ea3a32ee tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:41.095429 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-efbd74ae-0ddf-425c-b8c6-f807ea3a32ee tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 200 len: 1675 microversion: 2.1 time: 0.236190 Oct 04 21:36:41.105495 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2886/5786] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:40 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 1675 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:41.441251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bc473ef9-bb77-4a79-91ca-7ba84e83354f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:41.442282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bc473ef9-bb77-4a79-91ca-7ba84e83354f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:41.450333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc473ef9-bb77-4a79-91ca-7ba84e83354f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:41.452365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc473ef9-bb77-4a79-91ca-7ba84e83354f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:41.453412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc473ef9-bb77-4a79-91ca-7ba84e83354f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:41.459357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc473ef9-bb77-4a79-91ca-7ba84e83354f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:41.459357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc473ef9-bb77-4a79-91ca-7ba84e83354f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:41.459357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc473ef9-bb77-4a79-91ca-7ba84e83354f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:41.630320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bc473ef9-bb77-4a79-91ca-7ba84e83354f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:41.640335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bc473ef9-bb77-4a79-91ca-7ba84e83354f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:41.641941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bc473ef9-bb77-4a79-91ca-7ba84e83354f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:41.643563 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bc473ef9-bb77-4a79-91ca-7ba84e83354f tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1740 microversion: 2.20 time: 0.206123 Oct 04 21:36:41.644203 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2901/5787] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:41 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:41.892020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ea7e9133-5c32-4585-848c-bbd634c9346b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:41.892020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ea7e9133-5c32-4585-848c-bbd634c9346b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:41.913596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-05bf968d-f320-4afe-9ed1-9204166042c0 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:41.915220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-05bf968d-f320-4afe-9ed1-9204166042c0 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:41.924242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea7e9133-5c32-4585-848c-bbd634c9346b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:41.924758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea7e9133-5c32-4585-848c-bbd634c9346b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:41.925177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea7e9133-5c32-4585-848c-bbd634c9346b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:41.926112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea7e9133-5c32-4585-848c-bbd634c9346b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:41.926692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05bf968d-f320-4afe-9ed1-9204166042c0 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:41.926914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea7e9133-5c32-4585-848c-bbd634c9346b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:41.927209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05bf968d-f320-4afe-9ed1-9204166042c0 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:41.927663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05bf968d-f320-4afe-9ed1-9204166042c0 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:41.927816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea7e9133-5c32-4585-848c-bbd634c9346b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:41.928538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05bf968d-f320-4afe-9ed1-9204166042c0 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:41.930558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05bf968d-f320-4afe-9ed1-9204166042c0 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:41.931128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05bf968d-f320-4afe-9ed1-9204166042c0 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:42.209267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-05bf968d-f320-4afe-9ed1-9204166042c0 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:42.225118 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-05bf968d-f320-4afe-9ed1-9204166042c0 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 200 len: 1515 microversion: 2.1 time: 0.315262 Oct 04 21:36:42.225746 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2902/5788] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:41 2022] GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 1515 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:36:42.238662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4591d389-eea0-4cb9-affb-2b65a782129d tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:42.242550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4591d389-eea0-4cb9-affb-2b65a782129d tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:42.249929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4591d389-eea0-4cb9-affb-2b65a782129d tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:42.250848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ea7e9133-5c32-4585-848c-bbd634c9346b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:42.251002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4591d389-eea0-4cb9-affb-2b65a782129d tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:42.251550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4591d389-eea0-4cb9-affb-2b65a782129d tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:42.252543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4591d389-eea0-4cb9-affb-2b65a782129d tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:42.253161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4591d389-eea0-4cb9-affb-2b65a782129d tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:42.253796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4591d389-eea0-4cb9-affb-2b65a782129d tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:42.260864 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ea7e9133-5c32-4585-848c-bbd634c9346b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1681 microversion: 2.1 time: 0.396987 Oct 04 21:36:42.265644 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2887/5789] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:41 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1681 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:42.279622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-22565e30-262d-490a-9584-0d94c1752fd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:42.282683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-22565e30-262d-490a-9584-0d94c1752fd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 248223cc-90a5-49d8-a86a-23e6305e2903] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:42.286562 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:42.291065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22565e30-262d-490a-9584-0d94c1752fd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:42.291948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22565e30-262d-490a-9584-0d94c1752fd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:42.292759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22565e30-262d-490a-9584-0d94c1752fd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:42.294354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22565e30-262d-490a-9584-0d94c1752fd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:42.295004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22565e30-262d-490a-9584-0d94c1752fd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:42.295837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22565e30-262d-490a-9584-0d94c1752fd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:42.775008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-22565e30-262d-490a-9584-0d94c1752fd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:42.785903 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-22565e30-262d-490a-9584-0d94c1752fd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/248223cc-90a5-49d8-a86a-23e6305e2903" status: 200 len: 1323 microversion: 2.1 time: 0.518124 Oct 04 21:36:42.797139 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2888/5790] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:42 2022] GET /compute/v2.1/servers/248223cc-90a5-49d8-a86a-23e6305e2903 => generated 1323 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:42.797139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6b896939-d618-476f-8923-ed6c76cafa3b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:42.797139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6b896939-d618-476f-8923-ed6c76cafa3b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:42.806183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b896939-d618-476f-8923-ed6c76cafa3b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:42.807452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b896939-d618-476f-8923-ed6c76cafa3b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:42.807979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b896939-d618-476f-8923-ed6c76cafa3b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:42.809445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b896939-d618-476f-8923-ed6c76cafa3b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:42.810221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4591d389-eea0-4cb9-affb-2b65a782129d tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:42.811296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b896939-d618-476f-8923-ed6c76cafa3b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:42.812541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b896939-d618-476f-8923-ed6c76cafa3b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:42.826065 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4591d389-eea0-4cb9-affb-2b65a782129d tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 200 len: 1675 microversion: 2.1 time: 0.599063 Oct 04 21:36:42.829808 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2903/5791] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:42 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 1675 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:43.291467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f230089c-d8a6-441c-8812-ba1afcdc8728 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:43.292536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f230089c-d8a6-441c-8812-ba1afcdc8728 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:43.296477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6b896939-d618-476f-8923-ed6c76cafa3b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:43.301460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f230089c-d8a6-441c-8812-ba1afcdc8728 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:43.303868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f230089c-d8a6-441c-8812-ba1afcdc8728 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:43.304416 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f230089c-d8a6-441c-8812-ba1afcdc8728 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:43.305443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f230089c-d8a6-441c-8812-ba1afcdc8728 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:43.306138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f230089c-d8a6-441c-8812-ba1afcdc8728 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:43.306804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f230089c-d8a6-441c-8812-ba1afcdc8728 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:43.316926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6b896939-d618-476f-8923-ed6c76cafa3b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:43.323024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6b896939-d618-476f-8923-ed6c76cafa3b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:43.324678 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6b896939-d618-476f-8923-ed6c76cafa3b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1740 microversion: 2.20 time: 0.535172 Oct 04 21:36:43.327139 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2889/5792] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:42 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1740 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:43.571895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f230089c-d8a6-441c-8812-ba1afcdc8728 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:43.595383 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f230089c-d8a6-441c-8812-ba1afcdc8728 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1681 microversion: 2.1 time: 0.308835 Oct 04 21:36:43.595984 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2904/5793] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:43 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1681 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:36:43.811518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-138d8fe9-9581-4fb9-ad58-5634de46eb08 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:43.812383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-138d8fe9-9581-4fb9-ad58-5634de46eb08 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 248223cc-90a5-49d8-a86a-23e6305e2903] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:43.819664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-138d8fe9-9581-4fb9-ad58-5634de46eb08 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:43.824001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-138d8fe9-9581-4fb9-ad58-5634de46eb08 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:43.824719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-138d8fe9-9581-4fb9-ad58-5634de46eb08 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:43.826837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-138d8fe9-9581-4fb9-ad58-5634de46eb08 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:43.828743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-138d8fe9-9581-4fb9-ad58-5634de46eb08 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:43.829379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-138d8fe9-9581-4fb9-ad58-5634de46eb08 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:43.850161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a4194bb0-a387-43c5-a80e-c61415c47b99 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:43.851406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a4194bb0-a387-43c5-a80e-c61415c47b99 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:43.863658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a4194bb0-a387-43c5-a80e-c61415c47b99 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:43.864159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a4194bb0-a387-43c5-a80e-c61415c47b99 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:43.864603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a4194bb0-a387-43c5-a80e-c61415c47b99 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:43.865315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a4194bb0-a387-43c5-a80e-c61415c47b99 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:43.865808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a4194bb0-a387-43c5-a80e-c61415c47b99 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:43.866347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a4194bb0-a387-43c5-a80e-c61415c47b99 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:44.123203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a4194bb0-a387-43c5-a80e-c61415c47b99 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:44.141317 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a4194bb0-a387-43c5-a80e-c61415c47b99 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 200 len: 1607 microversion: 2.1 time: 0.295240 Oct 04 21:36:44.141944 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2905/5794] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:43 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 1607 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:44.356770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d9280c7d-5f18-481c-94e4-7ea936303a2b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:44.357604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d9280c7d-5f18-481c-94e4-7ea936303a2b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:44.368695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-138d8fe9-9581-4fb9-ad58-5634de46eb08 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:44.376999 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-138d8fe9-9581-4fb9-ad58-5634de46eb08 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/248223cc-90a5-49d8-a86a-23e6305e2903" status: 200 len: 1323 microversion: 2.1 time: 0.570704 Oct 04 21:36:44.381389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9280c7d-5f18-481c-94e4-7ea936303a2b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:44.381931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9280c7d-5f18-481c-94e4-7ea936303a2b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:44.382372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9280c7d-5f18-481c-94e4-7ea936303a2b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:44.383190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9280c7d-5f18-481c-94e4-7ea936303a2b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:44.383648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9280c7d-5f18-481c-94e4-7ea936303a2b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:44.384078 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9280c7d-5f18-481c-94e4-7ea936303a2b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:44.417871 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2890/5795] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:43 2022] GET /compute/v2.1/servers/248223cc-90a5-49d8-a86a-23e6305e2903 => generated 1323 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:44.556378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-f24e4879-083c-4e32-99d6-172db08572e1 req-2b6b0c0b-3923-46be-8b83-ad5afb401c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8c5b825-6552-42c9-b652-2b7eff7bffce", "name": "network-vif-deleted", "tag": "dcce473b-6130-4116-99ec-a361a4bb8721"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:44.579674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f24e4879-083c-4e32-99d6-172db08572e1 req-2b6b0c0b-3923-46be-8b83-ad5afb401c4b service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:44.580164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f24e4879-083c-4e32-99d6-172db08572e1 req-2b6b0c0b-3923-46be-8b83-ad5afb401c4b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:44.580599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f24e4879-083c-4e32-99d6-172db08572e1 req-2b6b0c0b-3923-46be-8b83-ad5afb401c4b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:44.629439 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-f24e4879-083c-4e32-99d6-172db08572e1 req-2b6b0c0b-3923-46be-8b83-ad5afb401c4b service nova] Creating event network-vif-deleted:dcce473b-6130-4116-99ec-a361a4bb8721 for instance f8c5b825-6552-42c9-b652-2b7eff7bffce on n-h2-860282-1 Oct 04 21:36:44.667714 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-f24e4879-083c-4e32-99d6-172db08572e1 req-2b6b0c0b-3923-46be-8b83-ad5afb401c4b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119517 Oct 04 21:36:44.674662 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2891/5796] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:44.699202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-26707443-7d5e-49bf-8b5e-65b3dca46b24 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:44.699928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-26707443-7d5e-49bf-8b5e-65b3dca46b24 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:44.744583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26707443-7d5e-49bf-8b5e-65b3dca46b24 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:44.752185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26707443-7d5e-49bf-8b5e-65b3dca46b24 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:44.752185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26707443-7d5e-49bf-8b5e-65b3dca46b24 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:44.752185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26707443-7d5e-49bf-8b5e-65b3dca46b24 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:44.758367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26707443-7d5e-49bf-8b5e-65b3dca46b24 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:44.758816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26707443-7d5e-49bf-8b5e-65b3dca46b24 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:44.987432 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-26707443-7d5e-49bf-8b5e-65b3dca46b24 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:44.992541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d9280c7d-5f18-481c-94e4-7ea936303a2b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:45.001084 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-26707443-7d5e-49bf-8b5e-65b3dca46b24 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1326 microversion: 2.1 time: 0.324979 Oct 04 21:36:45.001731 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2892/5797] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:44 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1326 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:45.003264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d9280c7d-5f18-481c-94e4-7ea936303a2b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:45.004768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d9280c7d-5f18-481c-94e4-7ea936303a2b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:45.009573 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d9280c7d-5f18-481c-94e4-7ea936303a2b tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1740 microversion: 2.20 time: 0.658269 Oct 04 21:36:45.010350 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2906/5798] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:44 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1740 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:45.168993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-00f24b50-223c-43c3-9a66-d4d4d7b69816 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:45.169937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-00f24b50-223c-43c3-9a66-d4d4d7b69816 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:45.183452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00f24b50-223c-43c3-9a66-d4d4d7b69816 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:45.190374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00f24b50-223c-43c3-9a66-d4d4d7b69816 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:45.192991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00f24b50-223c-43c3-9a66-d4d4d7b69816 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:45.193957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00f24b50-223c-43c3-9a66-d4d4d7b69816 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:45.197314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00f24b50-223c-43c3-9a66-d4d4d7b69816 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:45.199379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00f24b50-223c-43c3-9a66-d4d4d7b69816 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:45.385543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-00f24b50-223c-43c3-9a66-d4d4d7b69816 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:45.394516 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-00f24b50-223c-43c3-9a66-d4d4d7b69816 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 200 len: 1607 microversion: 2.1 time: 0.230762 Oct 04 21:36:45.395105 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2907/5799] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:45 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 1607 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:45.417854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-5d854d27-2675-4dfa-a534-b88463ef2720 req-78361456-1ab7-4e8b-ae75-53e9f45f2fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27cc7b20-edb9-468f-9262-252c2a3a5509", "name": "network-vif-deleted", "tag": "794bbe14-6b37-4945-bb2d-c860a82fe5ac"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:45.446622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0cc4731a-f4d7-40d1-aadf-2f7bf9e47215 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:45.447687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0cc4731a-f4d7-40d1-aadf-2f7bf9e47215 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 248223cc-90a5-49d8-a86a-23e6305e2903] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:45.462749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5d854d27-2675-4dfa-a534-b88463ef2720 req-78361456-1ab7-4e8b-ae75-53e9f45f2fd3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:45.464321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5d854d27-2675-4dfa-a534-b88463ef2720 req-78361456-1ab7-4e8b-ae75-53e9f45f2fd3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:45.467916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cc4731a-f4d7-40d1-aadf-2f7bf9e47215 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:45.468343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5d854d27-2675-4dfa-a534-b88463ef2720 req-78361456-1ab7-4e8b-ae75-53e9f45f2fd3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:45.468510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cc4731a-f4d7-40d1-aadf-2f7bf9e47215 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:45.468974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cc4731a-f4d7-40d1-aadf-2f7bf9e47215 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:45.469772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cc4731a-f4d7-40d1-aadf-2f7bf9e47215 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:45.479676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cc4731a-f4d7-40d1-aadf-2f7bf9e47215 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:45.482697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0cc4731a-f4d7-40d1-aadf-2f7bf9e47215 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:45.499345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:45.505341 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-5d854d27-2675-4dfa-a534-b88463ef2720 req-78361456-1ab7-4e8b-ae75-53e9f45f2fd3 service nova] Creating event network-vif-deleted:794bbe14-6b37-4945-bb2d-c860a82fe5ac for instance 27cc7b20-edb9-468f-9262-252c2a3a5509 on n-h2-860282-1 Oct 04 21:36:45.507480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:45.514810 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-5d854d27-2675-4dfa-a534-b88463ef2720 req-78361456-1ab7-4e8b-ae75-53e9f45f2fd3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.483791 Oct 04 21:36:45.515487 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2893/5800] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:45.896656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0cc4731a-f4d7-40d1-aadf-2f7bf9e47215 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:45.906641 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0cc4731a-f4d7-40d1-aadf-2f7bf9e47215 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/248223cc-90a5-49d8-a86a-23e6305e2903" status: 200 len: 1515 microversion: 2.1 time: 0.466612 Oct 04 21:36:45.909836 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2908/5801] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:45 2022] GET /compute/v2.1/servers/248223cc-90a5-49d8-a86a-23e6305e2903 => generated 1515 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:36:45.942248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4b3f8593-ddec-4fb8-b7ab-181a145dfa48 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:45.943114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4b3f8593-ddec-4fb8-b7ab-181a145dfa48 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: af293754-4522-4c34-9e22-cd3d8d626365] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:45.959588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b3f8593-ddec-4fb8-b7ab-181a145dfa48 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:45.976212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b3f8593-ddec-4fb8-b7ab-181a145dfa48 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:45.978015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b3f8593-ddec-4fb8-b7ab-181a145dfa48 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:45.981461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b3f8593-ddec-4fb8-b7ab-181a145dfa48 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:45.982211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b3f8593-ddec-4fb8-b7ab-181a145dfa48 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:45.984097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4b3f8593-ddec-4fb8-b7ab-181a145dfa48 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:46.038370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-528794bf-0b74-4526-9958-a036a617775b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:46.039354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-528794bf-0b74-4526-9958-a036a617775b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:46.063125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-528794bf-0b74-4526-9958-a036a617775b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:46.063637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-528794bf-0b74-4526-9958-a036a617775b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:46.064087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-528794bf-0b74-4526-9958-a036a617775b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:46.064812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-528794bf-0b74-4526-9958-a036a617775b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:46.065407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-528794bf-0b74-4526-9958-a036a617775b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:46.065764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-528794bf-0b74-4526-9958-a036a617775b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:46.172876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-528794bf-0b74-4526-9958-a036a617775b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:46.173385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-528794bf-0b74-4526-9958-a036a617775b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:46.178846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-528794bf-0b74-4526-9958-a036a617775b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:46.179344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-528794bf-0b74-4526-9958-a036a617775b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lazy-loading 'fault' on Instance uuid f8c5b825-6552-42c9-b652-2b7eff7bffce {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:36:46.335198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-528794bf-0b74-4526-9958-a036a617775b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:46.350880 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-528794bf-0b74-4526-9958-a036a617775b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 200 len: 1331 microversion: 2.1 time: 0.325844 Oct 04 21:36:46.354506 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2909/5802] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:46 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 1331 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:46.366780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ebeadf99-24f7-470c-b2dd-edb28a1f6ae7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:46.368836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ebeadf99-24f7-470c-b2dd-edb28a1f6ae7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:46.390733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ebeadf99-24f7-470c-b2dd-edb28a1f6ae7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:46.394955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ebeadf99-24f7-470c-b2dd-edb28a1f6ae7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:46.394955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ebeadf99-24f7-470c-b2dd-edb28a1f6ae7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:46.394955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ebeadf99-24f7-470c-b2dd-edb28a1f6ae7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:46.394955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ebeadf99-24f7-470c-b2dd-edb28a1f6ae7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:46.395792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ebeadf99-24f7-470c-b2dd-edb28a1f6ae7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:46.488950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4b3f8593-ddec-4fb8-b7ab-181a145dfa48 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:46.507335 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4b3f8593-ddec-4fb8-b7ab-181a145dfa48 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365" status: 200 len: 1516 microversion: 2.1 time: 0.570369 Oct 04 21:36:46.520268 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2894/5803] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:45 2022] GET /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365 => generated 1516 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:46.552234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-998e7d89-6e01-4e2c-8981-2616c4dd0aa7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:46.552863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-998e7d89-6e01-4e2c-8981-2616c4dd0aa7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:46.566295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998e7d89-6e01-4e2c-8981-2616c4dd0aa7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:46.567183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998e7d89-6e01-4e2c-8981-2616c4dd0aa7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:46.568140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998e7d89-6e01-4e2c-8981-2616c4dd0aa7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:46.569191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998e7d89-6e01-4e2c-8981-2616c4dd0aa7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:46.569752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998e7d89-6e01-4e2c-8981-2616c4dd0aa7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:46.571170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998e7d89-6e01-4e2c-8981-2616c4dd0aa7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:46.667025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998e7d89-6e01-4e2c-8981-2616c4dd0aa7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:46.667025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998e7d89-6e01-4e2c-8981-2616c4dd0aa7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:46.667025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-998e7d89-6e01-4e2c-8981-2616c4dd0aa7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:46.667025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-998e7d89-6e01-4e2c-8981-2616c4dd0aa7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lazy-loading 'fault' on Instance uuid 27cc7b20-edb9-468f-9262-252c2a3a5509 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:36:46.759001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-998e7d89-6e01-4e2c-8981-2616c4dd0aa7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9cb06716184ec88816395420d5870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66351b2e6b2840f183aaf8983e6fc128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:46.774576 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-998e7d89-6e01-4e2c-8981-2616c4dd0aa7 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 200 len: 1328 microversion: 2.1 time: 0.251153 Oct 04 21:36:46.775206 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2895/5804] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:46 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 1328 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:46.785241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2b57c882-505e-4998-a156-1b50bbdde6ed tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:46.791080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2b57c882-505e-4998-a156-1b50bbdde6ed tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: af293754-4522-4c34-9e22-cd3d8d626365] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:46.805883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ebeadf99-24f7-470c-b2dd-edb28a1f6ae7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:46.819820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ebeadf99-24f7-470c-b2dd-edb28a1f6ae7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:46.829509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b57c882-505e-4998-a156-1b50bbdde6ed tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:46.830316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b57c882-505e-4998-a156-1b50bbdde6ed tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:46.830779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ebeadf99-24f7-470c-b2dd-edb28a1f6ae7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:46.832250 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ebeadf99-24f7-470c-b2dd-edb28a1f6ae7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1740 microversion: 2.20 time: 0.476562 Oct 04 21:36:46.835123 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2910/5805] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:46 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1740 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:46.852912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b57c882-505e-4998-a156-1b50bbdde6ed tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:46.876477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b57c882-505e-4998-a156-1b50bbdde6ed tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:46.877385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b57c882-505e-4998-a156-1b50bbdde6ed tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:46.879164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b57c882-505e-4998-a156-1b50bbdde6ed tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:46.957532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2b57c882-505e-4998-a156-1b50bbdde6ed tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: af293754-4522-4c34-9e22-cd3d8d626365] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:36:47.375547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e46b3b8c-b973-4759-bd65-6d4330bd45a8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:47.376869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e46b3b8c-b973-4759-bd65-6d4330bd45a8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:47.384134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e46b3b8c-b973-4759-bd65-6d4330bd45a8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:47.384853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e46b3b8c-b973-4759-bd65-6d4330bd45a8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:47.385499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e46b3b8c-b973-4759-bd65-6d4330bd45a8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:47.386376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e46b3b8c-b973-4759-bd65-6d4330bd45a8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:47.387025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e46b3b8c-b973-4759-bd65-6d4330bd45a8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:47.387620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e46b3b8c-b973-4759-bd65-6d4330bd45a8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:47.406900 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-e46b3b8c-b973-4759-bd65-6d4330bd45a8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] HTTP exception thrown: Instance f8c5b825-6552-42c9-b652-2b7eff7bffce could not be found. Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e46b3b8c-b973-4759-bd65-6d4330bd45a8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Request method failure captured: Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce HTTP/1.1 Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKbagiGypEfWhrQ_0lE94AP27Qoh0E4iGeIB2v7-1zLRFZVlQCLRG0FD49h9EoPD55kuiioz0fPU1oTFLY5Kkl3L3vqChLMTEe1In4MGHbsFa7Gm-matpM3wFwyWA19l96bcqrryYQdSr6oZRwmQgAqc6hQhUAbifVGqqLh8bVE-KBY Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}] Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 68a2203c15fe41d8ae410f31ba1e1301 Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance f8c5b825-6552-42c9-b652-2b7eff7bffce could not be found. Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'f8c5b825-6552-42c9-b652-2b7eff7bffce'} Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8c5b825-6552-42c9-b652-2b7eff7bffce could not be found. Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8c5b825-6552-42c9-b652-2b7eff7bffce could not be found. Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:47.409161 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:47.413194 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:47.413194 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:47.413194 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:47.413194 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:36:47.413194 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:36:47.413194 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8c5b825-6552-42c9-b652-2b7eff7bffce could not be found. Oct 04 21:36:47.413194 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:47.415966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e46b3b8c-b973-4759-bd65-6d4330bd45a8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Returning 404 to user: Instance f8c5b825-6552-42c9-b652-2b7eff7bffce could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:36:47.417154 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e46b3b8c-b973-4759-bd65-6d4330bd45a8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 404 len: 111 microversion: 2.1 time: 0.046027 Oct 04 21:36:47.421579 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2911/5806] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:47 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:36:47.445613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fe914118-7570-415b-bdca-b26855daa56f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '.version_select at 0x7f578b049430>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:47.493645 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2b57c882-505e-4998-a156-1b50bbdde6ed tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "DELETE /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365" status: 204 len: 0 microversion: 2.1 time: 0.696118 Oct 04 21:36:47.493645 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2896/5807] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:36:46 2022] DELETE /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:36:47.493645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0b476c33-8ff5-4bb6-a899-306afe8de93a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:47.493645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0b476c33-8ff5-4bb6-a899-306afe8de93a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: af293754-4522-4c34-9e22-cd3d8d626365] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:47.516356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b476c33-8ff5-4bb6-a899-306afe8de93a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:47.516880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b476c33-8ff5-4bb6-a899-306afe8de93a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:47.517324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b476c33-8ff5-4bb6-a899-306afe8de93a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:47.527457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b476c33-8ff5-4bb6-a899-306afe8de93a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:47.531375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b476c33-8ff5-4bb6-a899-306afe8de93a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:47.535922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b476c33-8ff5-4bb6-a899-306afe8de93a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:47.691437 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fe914118-7570-415b-bdca-b26855daa56f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-349696836" status: 202 len: 0 microversion: 2.1 time: 0.267847 Oct 04 21:36:47.691790 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2912/5808] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Oct 4 21:36:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-349696836 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:36:47.766026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0b476c33-8ff5-4bb6-a899-306afe8de93a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:47.771645 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0b476c33-8ff5-4bb6-a899-306afe8de93a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365" status: 200 len: 1522 microversion: 2.1 time: 0.288368 Oct 04 21:36:47.773348 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2897/5809] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:47 2022] GET /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:36:47.803677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ccd4d39c-8cde-4bfd-aa21-1a4310069d7e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:47.804326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ccd4d39c-8cde-4bfd-aa21-1a4310069d7e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:47.806361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:47.827214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccd4d39c-8cde-4bfd-aa21-1a4310069d7e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:47.828067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccd4d39c-8cde-4bfd-aa21-1a4310069d7e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:47.828534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccd4d39c-8cde-4bfd-aa21-1a4310069d7e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:47.829278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccd4d39c-8cde-4bfd-aa21-1a4310069d7e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:47.834276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccd4d39c-8cde-4bfd-aa21-1a4310069d7e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:47.848558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccd4d39c-8cde-4bfd-aa21-1a4310069d7e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:47.861196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8e5faa95-8a64-447c-93bb-a7612050f3d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:47.862193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8e5faa95-8a64-447c-93bb-a7612050f3d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:47.873843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e5faa95-8a64-447c-93bb-a7612050f3d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:47.873843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e5faa95-8a64-447c-93bb-a7612050f3d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:47.873843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e5faa95-8a64-447c-93bb-a7612050f3d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:47.873843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e5faa95-8a64-447c-93bb-a7612050f3d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:47.873843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e5faa95-8a64-447c-93bb-a7612050f3d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:47.873843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e5faa95-8a64-447c-93bb-a7612050f3d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:47.894410 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-ccd4d39c-8cde-4bfd-aa21-1a4310069d7e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] HTTP exception thrown: Instance 27cc7b20-edb9-468f-9262-252c2a3a5509 could not be found. Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ccd4d39c-8cde-4bfd-aa21-1a4310069d7e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Request method failure captured: Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 HTTP/1.1 Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKYlXHR8I8wRQFODrOVWlUYl-ahlxwIFsYKfV_R4wsakZqpR88jBTNtqNOtBTWqFpnUV0Hun8uqJl71sct-kwDxnitHrojNaCyV5EUsapk-o8TAAL4uaGaysfjjZ9aJOYpwW5gfZixLDk-9rhKNXEbVtOi0ktISjTZ5KpyUZgOnAe30 Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 66351b2e6b2840f183aaf8983e6fc128 Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AttachVolumeTestJSON-1015759103 Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66351b2e6b2840f183aaf8983e6fc128"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66351b2e6b2840f183aaf8983e6fc128"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66351b2e6b2840f183aaf8983e6fc128"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66351b2e6b2840f183aaf8983e6fc128"}]}] Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AttachVolumeTestJSON-1015759103 Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 66351b2e6b2840f183aaf8983e6fc128 Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1015759103 Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AttachVolumeTestJSON-1015759103-project Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 0c9cb06716184ec88816395420d5870e Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AttachVolumeTestJSON-1015759103-project Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 27cc7b20-edb9-468f-9262-252c2a3a5509 could not be found. Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '27cc7b20-edb9-468f-9262-252c2a3a5509'} Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27cc7b20-edb9-468f-9262-252c2a3a5509 could not be found. Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27cc7b20-edb9-468f-9262-252c2a3a5509 could not be found. Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:47.896929 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:47.902874 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:47.902874 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:47.902874 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:47.902874 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:36:47.902874 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:36:47.902874 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27cc7b20-edb9-468f-9262-252c2a3a5509 could not be found. Oct 04 21:36:47.902874 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:47.902874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ccd4d39c-8cde-4bfd-aa21-1a4310069d7e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Returning 404 to user: Instance 27cc7b20-edb9-468f-9262-252c2a3a5509 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:36:47.916657 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ccd4d39c-8cde-4bfd-aa21-1a4310069d7e tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 404 len: 111 microversion: 2.1 time: 0.116884 Oct 04 21:36:47.921409 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2913/5810] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:47 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:36:47.928883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4a038d02-1852-4153-92f0-7fbc5f478b26 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '.version_select at 0x7f578b049c10>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:48.084532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8e5faa95-8a64-447c-93bb-a7612050f3d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:48.097133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8e5faa95-8a64-447c-93bb-a7612050f3d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:48.104009 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4a038d02-1852-4153-92f0-7fbc5f478b26 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863004533" status: 202 len: 0 microversion: 2.1 time: 0.178872 Oct 04 21:36:48.108067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8e5faa95-8a64-447c-93bb-a7612050f3d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:48.109542 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2914/5811] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Oct 4 21:36:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863004533 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:36:48.129936 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8e5faa95-8a64-447c-93bb-a7612050f3d4 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1740 microversion: 2.20 time: 0.266998 Oct 04 21:36:48.133210 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2898/5812] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:47 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1740 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:48.815754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c9b2dbc6-a689-4652-93c5-3dda28294707 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:48.816387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c9b2dbc6-a689-4652-93c5-3dda28294707 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: af293754-4522-4c34-9e22-cd3d8d626365] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:48.830830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9b2dbc6-a689-4652-93c5-3dda28294707 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:48.831345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9b2dbc6-a689-4652-93c5-3dda28294707 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:48.836720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9b2dbc6-a689-4652-93c5-3dda28294707 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:48.837959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9b2dbc6-a689-4652-93c5-3dda28294707 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:48.838623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9b2dbc6-a689-4652-93c5-3dda28294707 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:48.840263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9b2dbc6-a689-4652-93c5-3dda28294707 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:49.157153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5e761325-333b-4db3-bc1e-1eb2914ad707 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:49.157865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5e761325-333b-4db3-bc1e-1eb2914ad707 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:49.179326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e761325-333b-4db3-bc1e-1eb2914ad707 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:49.182133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e761325-333b-4db3-bc1e-1eb2914ad707 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:49.182929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e761325-333b-4db3-bc1e-1eb2914ad707 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:49.190547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e761325-333b-4db3-bc1e-1eb2914ad707 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:49.197736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e761325-333b-4db3-bc1e-1eb2914ad707 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:49.206223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5e761325-333b-4db3-bc1e-1eb2914ad707 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:49.559206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c9b2dbc6-a689-4652-93c5-3dda28294707 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:49.606935 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c9b2dbc6-a689-4652-93c5-3dda28294707 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365" status: 200 len: 1522 microversion: 2.1 time: 0.806693 Oct 04 21:36:49.618568 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2915/5813] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:48 2022] GET /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365 => generated 1522 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:49.685157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5e761325-333b-4db3-bc1e-1eb2914ad707 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:49.726027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5e761325-333b-4db3-bc1e-1eb2914ad707 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:49.730148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5e761325-333b-4db3-bc1e-1eb2914ad707 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:49.737508 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5e761325-333b-4db3-bc1e-1eb2914ad707 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1740 microversion: 2.20 time: 0.582202 Oct 04 21:36:49.740447 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2899/5814] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:49 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1740 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:36:49.876480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d1ff24c5-df21-43d8-8e97-afd3c89ce223 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:49.877323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d1ff24c5-df21-43d8-8e97-afd3c89ce223 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:49.914022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1ff24c5-df21-43d8-8e97-afd3c89ce223 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:49.921129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1ff24c5-df21-43d8-8e97-afd3c89ce223 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:49.921708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1ff24c5-df21-43d8-8e97-afd3c89ce223 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:49.924480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1ff24c5-df21-43d8-8e97-afd3c89ce223 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:49.925701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1ff24c5-df21-43d8-8e97-afd3c89ce223 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:49.931271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1ff24c5-df21-43d8-8e97-afd3c89ce223 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:50.110244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-d1ff24c5-df21-43d8-8e97-afd3c89ce223 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lazy-loading 'services' on Instance uuid 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:36:50.396321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-ce6ef075-7251-4128-918c-c239f968861f req-9a973a65-49ec-4010-963e-cc994b8e88ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af293754-4522-4c34-9e22-cd3d8d626365", "name": "network-vif-deleted", "tag": "2090e29a-7719-49b0-9884-c75d92fdeed4"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:50.415205 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d1ff24c5-df21-43d8-8e97-afd3c89ce223 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "DELETE /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-volume_attachments/0c9408d4-9dba-4611-a11c-045ddf60534e" status: 202 len: 0 microversion: 2.1 time: 0.558677 Oct 04 21:36:50.416947 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2916/5815] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 21:36:49 2022] DELETE /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-volume_attachments/0c9408d4-9dba-4611-a11c-045ddf60534e => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:36:50.446026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-71fe08ed-0742-4ef4-84a6-f8223f646f26 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:50.453954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-71fe08ed-0742-4ef4-84a6-f8223f646f26 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:50.455206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ce6ef075-7251-4128-918c-c239f968861f req-9a973a65-49ec-4010-963e-cc994b8e88ce service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:50.455895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ce6ef075-7251-4128-918c-c239f968861f req-9a973a65-49ec-4010-963e-cc994b8e88ce service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:50.474316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ce6ef075-7251-4128-918c-c239f968861f req-9a973a65-49ec-4010-963e-cc994b8e88ce service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:50.478061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71fe08ed-0742-4ef4-84a6-f8223f646f26 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:50.480391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71fe08ed-0742-4ef4-84a6-f8223f646f26 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:50.481599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71fe08ed-0742-4ef4-84a6-f8223f646f26 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:50.484753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71fe08ed-0742-4ef4-84a6-f8223f646f26 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:50.485450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71fe08ed-0742-4ef4-84a6-f8223f646f26 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:50.486087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71fe08ed-0742-4ef4-84a6-f8223f646f26 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:50.490317 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-ce6ef075-7251-4128-918c-c239f968861f req-9a973a65-49ec-4010-963e-cc994b8e88ce service nova] Creating event network-vif-deleted:2090e29a-7719-49b0-9884-c75d92fdeed4 for instance af293754-4522-4c34-9e22-cd3d8d626365 on n-h1-860282-1 Oct 04 21:36:50.506215 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-ce6ef075-7251-4128-918c-c239f968861f req-9a973a65-49ec-4010-963e-cc994b8e88ce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112848 Oct 04 21:36:50.513190 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2900/5816] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:50.565954 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-71fe08ed-0742-4ef4-84a6-f8223f646f26 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134486 Oct 04 21:36:50.568968 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2917/5817] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:36:50 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:50.632031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6b82b104-ebfe-4bc8-baf2-a7f9c124087b tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:50.633468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6b82b104-ebfe-4bc8-baf2-a7f9c124087b tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: af293754-4522-4c34-9e22-cd3d8d626365] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:50.657632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b82b104-ebfe-4bc8-baf2-a7f9c124087b tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:50.659188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b82b104-ebfe-4bc8-baf2-a7f9c124087b tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:50.659752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b82b104-ebfe-4bc8-baf2-a7f9c124087b tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:50.660410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b82b104-ebfe-4bc8-baf2-a7f9c124087b tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:50.661907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b82b104-ebfe-4bc8-baf2-a7f9c124087b tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:50.662799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b82b104-ebfe-4bc8-baf2-a7f9c124087b tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:50.768904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d991401e-c0bf-4352-8f42-5dcde667c7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:50.769557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d991401e-c0bf-4352-8f42-5dcde667c7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:50.786484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d991401e-c0bf-4352-8f42-5dcde667c7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:50.787680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d991401e-c0bf-4352-8f42-5dcde667c7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:50.790403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d991401e-c0bf-4352-8f42-5dcde667c7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:50.791349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d991401e-c0bf-4352-8f42-5dcde667c7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:50.792511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d991401e-c0bf-4352-8f42-5dcde667c7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:50.794729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d991401e-c0bf-4352-8f42-5dcde667c7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:50.885439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6b82b104-ebfe-4bc8-baf2-a7f9c124087b tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:50.899197 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6b82b104-ebfe-4bc8-baf2-a7f9c124087b tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365" status: 200 len: 1308 microversion: 2.1 time: 0.267487 Oct 04 21:36:50.915830 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2901/5818] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:50 2022] GET /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365 => generated 1308 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:51.177364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d991401e-c0bf-4352-8f42-5dcde667c7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:51.187346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d991401e-c0bf-4352-8f42-5dcde667c7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:51.188819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d991401e-c0bf-4352-8f42-5dcde667c7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:51.190066 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d991401e-c0bf-4352-8f42-5dcde667c7b1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1740 microversion: 2.20 time: 0.425777 Oct 04 21:36:51.190641 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2918/5819] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:50 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1740 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:51.583842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0fc25ec1-958a-4306-9d78-9d85a8494fbf tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:51.592196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0fc25ec1-958a-4306-9d78-9d85a8494fbf tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:51.605311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fc25ec1-958a-4306-9d78-9d85a8494fbf tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:51.637980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fc25ec1-958a-4306-9d78-9d85a8494fbf tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:51.638954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fc25ec1-958a-4306-9d78-9d85a8494fbf tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:51.639983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fc25ec1-958a-4306-9d78-9d85a8494fbf tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:51.640677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fc25ec1-958a-4306-9d78-9d85a8494fbf tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:51.641585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fc25ec1-958a-4306-9d78-9d85a8494fbf tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:51.710581 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0fc25ec1-958a-4306-9d78-9d85a8494fbf tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131952 Oct 04 21:36:51.711869 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2902/5820] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:36:51 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:51.926803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-73dfbb34-834e-412d-9d4d-7df4afa24922 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:51.927554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-73dfbb34-834e-412d-9d4d-7df4afa24922 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: af293754-4522-4c34-9e22-cd3d8d626365] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:51.936047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73dfbb34-834e-412d-9d4d-7df4afa24922 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:51.936610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73dfbb34-834e-412d-9d4d-7df4afa24922 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:51.937122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73dfbb34-834e-412d-9d4d-7df4afa24922 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:51.938014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73dfbb34-834e-412d-9d4d-7df4afa24922 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:51.938702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73dfbb34-834e-412d-9d4d-7df4afa24922 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:51.939330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73dfbb34-834e-412d-9d4d-7df4afa24922 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:51.978091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73dfbb34-834e-412d-9d4d-7df4afa24922 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:51.978708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73dfbb34-834e-412d-9d4d-7df4afa24922 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:51.979162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73dfbb34-834e-412d-9d4d-7df4afa24922 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:51.979636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-73dfbb34-834e-412d-9d4d-7df4afa24922 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lazy-loading 'fault' on Instance uuid af293754-4522-4c34-9e22-cd3d8d626365 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:36:52.042975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-73dfbb34-834e-412d-9d4d-7df4afa24922 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:52.065764 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-73dfbb34-834e-412d-9d4d-7df4afa24922 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365" status: 200 len: 1313 microversion: 2.1 time: 0.142715 Oct 04 21:36:52.066318 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2919/5821] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:51 2022] GET /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365 => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:52.219595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d613709c-1b47-475e-a4f1-1f3662bf044c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:52.220213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d613709c-1b47-475e-a4f1-1f3662bf044c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:52.234159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d613709c-1b47-475e-a4f1-1f3662bf044c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:52.234519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d613709c-1b47-475e-a4f1-1f3662bf044c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:52.234958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d613709c-1b47-475e-a4f1-1f3662bf044c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:52.235719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d613709c-1b47-475e-a4f1-1f3662bf044c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:52.236173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d613709c-1b47-475e-a4f1-1f3662bf044c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:52.236603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d613709c-1b47-475e-a4f1-1f3662bf044c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:52.727396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dd3bf7f8-46eb-45e9-9fb1-ded29f0c9f59 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:52.730437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dd3bf7f8-46eb-45e9-9fb1-ded29f0c9f59 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:52.742899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd3bf7f8-46eb-45e9-9fb1-ded29f0c9f59 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:52.745346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd3bf7f8-46eb-45e9-9fb1-ded29f0c9f59 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:52.747783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd3bf7f8-46eb-45e9-9fb1-ded29f0c9f59 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:52.749815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd3bf7f8-46eb-45e9-9fb1-ded29f0c9f59 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:52.751537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd3bf7f8-46eb-45e9-9fb1-ded29f0c9f59 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:52.752344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd3bf7f8-46eb-45e9-9fb1-ded29f0c9f59 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:52.853006 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dd3bf7f8-46eb-45e9-9fb1-ded29f0c9f59 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132046 Oct 04 21:36:52.858338 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2920/5822] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:36:52 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:52.908278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d613709c-1b47-475e-a4f1-1f3662bf044c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:52.918398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d613709c-1b47-475e-a4f1-1f3662bf044c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:52.920416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d613709c-1b47-475e-a4f1-1f3662bf044c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:52.922458 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d613709c-1b47-475e-a4f1-1f3662bf044c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1722 microversion: 2.20 time: 0.706776 Oct 04 21:36:52.924046 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2903/5823] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:52 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1722 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:53.092550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3d86ffbb-0c2c-47fc-848b-17a363e9682a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:53.093450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3d86ffbb-0c2c-47fc-848b-17a363e9682a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: af293754-4522-4c34-9e22-cd3d8d626365] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:53.127478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d86ffbb-0c2c-47fc-848b-17a363e9682a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:53.128015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d86ffbb-0c2c-47fc-848b-17a363e9682a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:53.128491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d86ffbb-0c2c-47fc-848b-17a363e9682a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:53.129223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d86ffbb-0c2c-47fc-848b-17a363e9682a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:53.134767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d86ffbb-0c2c-47fc-848b-17a363e9682a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:53.135262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d86ffbb-0c2c-47fc-848b-17a363e9682a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:53.169241 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-3d86ffbb-0c2c-47fc-848b-17a363e9682a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] HTTP exception thrown: Instance af293754-4522-4c34-9e22-cd3d8d626365 could not be found. Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3d86ffbb-0c2c-47fc-848b-17a363e9682a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Request method failure captured: Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365 HTTP/1.1 Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKdSgLYmTSpTdOGDn_6DyMY3ItyTAYDcOJuSk5-ePgT9vCy0nrmX5-ywlX6we1IDUhpVuuuEnL9OqhniuFxZd-QOVIImx7byHNDT7MIDa16YnXcAsEiw_Ef0AzxIpc8vRP1ivDQBXRVgtYzInmAphEbsuJD9gOwawvAsIUDJ8SjNDzQ Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 10b578dbd53946c2977352366a12279b Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10b578dbd53946c2977352366a12279b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10b578dbd53946c2977352366a12279b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10b578dbd53946c2977352366a12279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10b578dbd53946c2977352366a12279b"}]}] Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 10b578dbd53946c2977352366a12279b Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ListServersNegativeTestJSON-1136792717-project Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 902608697c894535b0e8a1bafd225d59 Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ListServersNegativeTestJSON-1136792717-project Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance af293754-4522-4c34-9e22-cd3d8d626365 could not be found. Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'af293754-4522-4c34-9e22-cd3d8d626365'} Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af293754-4522-4c34-9e22-cd3d8d626365 could not be found. Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af293754-4522-4c34-9e22-cd3d8d626365 could not be found. Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.171003 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:53.180096 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.180096 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:53.180096 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:53.180096 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:53.180096 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:36:53.180096 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:36:53.180096 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af293754-4522-4c34-9e22-cd3d8d626365 could not be found. Oct 04 21:36:53.180096 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.180096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3d86ffbb-0c2c-47fc-848b-17a363e9682a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Returning 404 to user: Instance af293754-4522-4c34-9e22-cd3d8d626365 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:36:53.180096 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3d86ffbb-0c2c-47fc-848b-17a363e9682a tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365" status: 404 len: 111 microversion: 2.1 time: 0.088087 Oct 04 21:36:53.181165 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2921/5824] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:53 2022] GET /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:36:53.188741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-02541bf5-7014-4168-aac4-a087f5b39a19 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:53.194597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-02541bf5-7014-4168-aac4-a087f5b39a19 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:53.195982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-02541bf5-7014-4168-aac4-a087f5b39a19 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '10b578dbd53946c2977352366a12279b'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:36:53.217749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02541bf5-7014-4168-aac4-a087f5b39a19 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:53.217749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02541bf5-7014-4168-aac4-a087f5b39a19 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:53.217749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02541bf5-7014-4168-aac4-a087f5b39a19 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:53.217749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02541bf5-7014-4168-aac4-a087f5b39a19 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:53.222523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02541bf5-7014-4168-aac4-a087f5b39a19 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:53.223190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02541bf5-7014-4168-aac4-a087f5b39a19 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:53.362396 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-02541bf5-7014-4168-aac4-a087f5b39a19 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.178401 Oct 04 21:36:53.378646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c6ecbd18-256a-4e99-b6c1-b3c8453cdd73 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:53.382041 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2904/5825] 10.222.0.30 () {58 vars in 1230 bytes} [Tue Oct 4 21:36:53 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c6ecbd18-256a-4e99-b6c1-b3c8453cdd73 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Request method failure captured: Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKdSgLYmTSpTdOGDn_6DyMY3ItyTAYDcOJuSk5-ePgT9vCy0nrmX5-ywlX6we1IDUhpVuuuEnL9OqhniuFxZd-QOVIImx7byHNDT7MIDa16YnXcAsEiw_Ef0AzxIpc8vRP1ivDQBXRVgtYzInmAphEbsuJD9gOwawvAsIUDJ8SjNDzQ Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 10b578dbd53946c2977352366a12279b Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10b578dbd53946c2977352366a12279b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10b578dbd53946c2977352366a12279b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10b578dbd53946c2977352366a12279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10b578dbd53946c2977352366a12279b"}]}] Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 10b578dbd53946c2977352366a12279b Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ListServersNegativeTestJSON-1136792717-project Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 902608697c894535b0e8a1bafd225d59 Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ListServersNegativeTestJSON-1136792717-project Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: action_args: {} Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 21:36:53.383739 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:36:53.389000 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:36:53.389000 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:36:53.389000 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:36:53.389000 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 21:36:53.389000 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.389000 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:53.389000 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.389000 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:53.389000 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:53.389000 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:53.389000 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:36:53.389000 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:36:53.389000 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 21:36:53.389000 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.389000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c6ecbd18-256a-4e99-b6c1-b3c8453cdd73 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:36:53.389000 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c6ecbd18-256a-4e99-b6c1-b3c8453cdd73 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.011495 Oct 04 21:36:53.390862 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2922/5826] 10.222.0.30 () {58 vars in 1182 bytes} [Tue Oct 4 21:36:53 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:36:53.400660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4379d4dd-01c7-4f03-acd9-89a5bcbaadd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:53.407561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4379d4dd-01c7-4f03-acd9-89a5bcbaadd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:53.408496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4379d4dd-01c7-4f03-acd9-89a5bcbaadd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Searching by: {'deleted': False, 'project_id': '10b578dbd53946c2977352366a12279b'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:36:53.416660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4379d4dd-01c7-4f03-acd9-89a5bcbaadd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:53.417527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4379d4dd-01c7-4f03-acd9-89a5bcbaadd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:53.418187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4379d4dd-01c7-4f03-acd9-89a5bcbaadd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:53.431905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4379d4dd-01c7-4f03-acd9-89a5bcbaadd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:53.431905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4379d4dd-01c7-4f03-acd9-89a5bcbaadd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:53.431905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4379d4dd-01c7-4f03-acd9-89a5bcbaadd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:53.452578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.multi_cell_list [None req-4379d4dd-01c7-4f03-acd9-89a5bcbaadd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:36:53.492069 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4379d4dd-01c7-4f03-acd9-89a5bcbaadd5 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.099180 Oct 04 21:36:53.504794 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2905/5827] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Oct 4 21:36:53 2022] GET /compute/v2.1/servers => generated 683 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:53.509469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b477505c-f874-47f8-88e0-d610c763940d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:53.526297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b477505c-f874-47f8-88e0-d610c763940d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:53.531112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.compute.servers [None req-b477505c-f874-47f8-88e0-d610c763940d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Removing options 'limit' from query {{(pid=122757) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 21:36:53.532176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b477505c-f874-47f8-88e0-d610c763940d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Searching by: {'deleted': False, 'project_id': '10b578dbd53946c2977352366a12279b'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:36:53.561091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b477505c-f874-47f8-88e0-d610c763940d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:53.562264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b477505c-f874-47f8-88e0-d610c763940d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:53.565788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b477505c-f874-47f8-88e0-d610c763940d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:53.570716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b477505c-f874-47f8-88e0-d610c763940d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:53.571567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b477505c-f874-47f8-88e0-d610c763940d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:53.574367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b477505c-f874-47f8-88e0-d610c763940d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:53.628363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-b477505c-f874-47f8-88e0-d610c763940d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:36:53.678587 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b477505c-f874-47f8-88e0-d610c763940d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.176151 Oct 04 21:36:53.702759 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2923/5828] 10.222.0.30 () {58 vars in 1144 bytes} [Tue Oct 4 21:36:53 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-502a5471-c816-4568-b51e-96d3dcb5da8b tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-502a5471-c816-4568-b51e-96d3dcb5da8b tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Request method failure captured: Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKdSgLYmTSpTdOGDn_6DyMY3ItyTAYDcOJuSk5-ePgT9vCy0nrmX5-ywlX6we1IDUhpVuuuEnL9OqhniuFxZd-QOVIImx7byHNDT7MIDa16YnXcAsEiw_Ef0AzxIpc8vRP1ivDQBXRVgtYzInmAphEbsuJD9gOwawvAsIUDJ8SjNDzQ Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 10b578dbd53946c2977352366a12279b Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10b578dbd53946c2977352366a12279b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10b578dbd53946c2977352366a12279b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10b578dbd53946c2977352366a12279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10b578dbd53946c2977352366a12279b"}]}] Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 10b578dbd53946c2977352366a12279b Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ListServersNegativeTestJSON-1136792717-project Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 902608697c894535b0e8a1bafd225d59 Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ListServersNegativeTestJSON-1136792717-project Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: action_args: {} Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi '-1' Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:36:53.702926 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-502a5471-c816-4568-b51e-96d3dcb5da8b tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-502a5471-c816-4568-b51e-96d3dcb5da8b tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.012549 Oct 04 21:36:53.707634 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2906/5829] 10.222.0.30 () {58 vars in 1142 bytes} [Tue Oct 4 21:36:53 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:36:53.715877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b6f58bee-08fe-4cf1-9530-e665354e855f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b6f58bee-08fe-4cf1-9530-e665354e855f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Request method failure captured: Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKdSgLYmTSpTdOGDn_6DyMY3ItyTAYDcOJuSk5-ePgT9vCy0nrmX5-ywlX6we1IDUhpVuuuEnL9OqhniuFxZd-QOVIImx7byHNDT7MIDa16YnXcAsEiw_Ef0AzxIpc8vRP1ivDQBXRVgtYzInmAphEbsuJD9gOwawvAsIUDJ8SjNDzQ Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 10b578dbd53946c2977352366a12279b Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10b578dbd53946c2977352366a12279b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10b578dbd53946c2977352366a12279b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10b578dbd53946c2977352366a12279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10b578dbd53946c2977352366a12279b"}]}] Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 10b578dbd53946c2977352366a12279b Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ListServersNegativeTestJSON-1136792717-project Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 902608697c894535b0e8a1bafd225d59 Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ListServersNegativeTestJSON-1136792717-project Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: action_args: {} Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi 'testing' Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 21:36:53.720561 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 21:36:53.725407 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:36:53.725407 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:36:53.725407 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:36:53.725407 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:36:53.725407 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 21:36:53.725407 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.725407 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:53.725407 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.725407 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:53.725407 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:53.725407 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:53.725407 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:36:53.725407 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:36:53.725407 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 21:36:53.725407 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:53.727446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b6f58bee-08fe-4cf1-9530-e665354e855f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:36:53.729053 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b6f58bee-08fe-4cf1-9530-e665354e855f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.017492 Oct 04 21:36:53.729053 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2924/5830] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:36:53 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:36:53.739644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d4b04dd9-ebfe-4c89-9f19-6b30fca17eaa tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:53.749453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d4b04dd9-ebfe-4c89-9f19-6b30fca17eaa tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:53.752664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d4b04dd9-ebfe-4c89-9f19-6b30fca17eaa tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '10b578dbd53946c2977352366a12279b'} {{(pid=122758) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:36:53.763733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.compute.servers [None req-d4b04dd9-ebfe-4c89-9f19-6b30fca17eaa tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Flavor 'non_existing_flavor' could not be found {{(pid=122758) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 04 21:36:53.764707 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d4b04dd9-ebfe-4c89-9f19-6b30fca17eaa tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.030609 Oct 04 21:36:53.765301 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2907/5831] 10.222.0.30 () {58 vars in 1178 bytes} [Tue Oct 4 21:36:53 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:36:53.779848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-917f82b7-6fe9-49d9-8aa5-dc5766f6d4f9 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:53.785590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-917f82b7-6fe9-49d9-8aa5-dc5766f6d4f9 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:53.786389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-917f82b7-6fe9-49d9-8aa5-dc5766f6d4f9 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '10b578dbd53946c2977352366a12279b'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:36:53.798817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-917f82b7-6fe9-49d9-8aa5-dc5766f6d4f9 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:53.798817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-917f82b7-6fe9-49d9-8aa5-dc5766f6d4f9 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:53.798817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-917f82b7-6fe9-49d9-8aa5-dc5766f6d4f9 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:53.798817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-917f82b7-6fe9-49d9-8aa5-dc5766f6d4f9 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:53.798817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-917f82b7-6fe9-49d9-8aa5-dc5766f6d4f9 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:53.798817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-917f82b7-6fe9-49d9-8aa5-dc5766f6d4f9 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:53.866908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-36d7365b-a836-49ee-a87c-1e0662def43e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:53.869099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-36d7365b-a836-49ee-a87c-1e0662def43e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:53.894783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36d7365b-a836-49ee-a87c-1e0662def43e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:53.895603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36d7365b-a836-49ee-a87c-1e0662def43e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:53.896396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36d7365b-a836-49ee-a87c-1e0662def43e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:53.899139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36d7365b-a836-49ee-a87c-1e0662def43e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:53.900851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36d7365b-a836-49ee-a87c-1e0662def43e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:53.901174 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-917f82b7-6fe9-49d9-8aa5-dc5766f6d4f9 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.125338 Oct 04 21:36:53.902115 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2925/5832] 10.222.0.30 () {58 vars in 1174 bytes} [Tue Oct 4 21:36:53 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:36:53.903059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36d7365b-a836-49ee-a87c-1e0662def43e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:53.919218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b10bfaf9-5c60-4503-bd02-64f63e9552de tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:53.925974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b10bfaf9-5c60-4503-bd02-64f63e9552de tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:53.926985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b10bfaf9-5c60-4503-bd02-64f63e9552de tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '10b578dbd53946c2977352366a12279b'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:36:53.934722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b10bfaf9-5c60-4503-bd02-64f63e9552de tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:53.935732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b10bfaf9-5c60-4503-bd02-64f63e9552de tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:53.936410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b10bfaf9-5c60-4503-bd02-64f63e9552de tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:53.937400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b10bfaf9-5c60-4503-bd02-64f63e9552de tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:53.938136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b10bfaf9-5c60-4503-bd02-64f63e9552de tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:53.938795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b10bfaf9-5c60-4503-bd02-64f63e9552de tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:53.950531 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-36d7365b-a836-49ee-a87c-1e0662def43e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087631 Oct 04 21:36:53.956859 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2908/5833] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:36:53 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:53.961515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-108a3199-4c40-4b32-9fa2-ca0cf8a2ff1c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:53.962335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-108a3199-4c40-4b32-9fa2-ca0cf8a2ff1c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:53.968897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-108a3199-4c40-4b32-9fa2-ca0cf8a2ff1c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:53.969657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-108a3199-4c40-4b32-9fa2-ca0cf8a2ff1c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:53.970259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-108a3199-4c40-4b32-9fa2-ca0cf8a2ff1c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:53.971122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-108a3199-4c40-4b32-9fa2-ca0cf8a2ff1c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:53.971741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-108a3199-4c40-4b32-9fa2-ca0cf8a2ff1c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:53.972318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-108a3199-4c40-4b32-9fa2-ca0cf8a2ff1c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:54.070421 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b10bfaf9-5c60-4503-bd02-64f63e9552de tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.155101 Oct 04 21:36:54.072144 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2926/5834] 10.222.0.30 () {58 vars in 1184 bytes} [Tue Oct 4 21:36:53 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:36:54.087135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bffb2084-ac38-47b4-af85-1a7add878349 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:54.098139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bffb2084-ac38-47b4-af85-1a7add878349 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:54.099276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bffb2084-ac38-47b4-af85-1a7add878349 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Searching by: {'deleted': False, 'project_id': '10b578dbd53946c2977352366a12279b'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:36:54.106814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bffb2084-ac38-47b4-af85-1a7add878349 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:54.107519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bffb2084-ac38-47b4-af85-1a7add878349 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:54.108075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bffb2084-ac38-47b4-af85-1a7add878349 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:54.109391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bffb2084-ac38-47b4-af85-1a7add878349 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:54.113024 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bffb2084-ac38-47b4-af85-1a7add878349 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:54.113024 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bffb2084-ac38-47b4-af85-1a7add878349 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:54.142327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-bffb2084-ac38-47b4-af85-1a7add878349 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:36:54.194656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bffb2084-ac38-47b4-af85-1a7add878349 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:54.203044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bffb2084-ac38-47b4-af85-1a7add878349 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:54.203785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bffb2084-ac38-47b4-af85-1a7add878349 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:54.204496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bffb2084-ac38-47b4-af85-1a7add878349 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:54.310728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-108a3199-4c40-4b32-9fa2-ca0cf8a2ff1c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:54.325937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-108a3199-4c40-4b32-9fa2-ca0cf8a2ff1c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:54.327425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-108a3199-4c40-4b32-9fa2-ca0cf8a2ff1c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:54.331412 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-108a3199-4c40-4b32-9fa2-ca0cf8a2ff1c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1722 microversion: 2.20 time: 0.373682 Oct 04 21:36:54.349385 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2909/5835] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:53 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1722 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:54.417236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-315b00d1-b0d4-4094-91f4-366e7dbfda8e req-88f5c026-697f-4d64-a750-7f0d11ddb8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa024b1-e789-4226-b10a-07bf3ca97ecc", "name": "network-vif-unplugged", "status": "completed", "tag": "f058e4a1-c25d-417e-8d41-b82e64725e18"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:54.425818 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bffb2084-ac38-47b4-af85-1a7add878349 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.342826 Oct 04 21:36:54.434587 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2927/5836] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:36:54 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:54.440237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-315b00d1-b0d4-4094-91f4-366e7dbfda8e req-88f5c026-697f-4d64-a750-7f0d11ddb8f8 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:54.440237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-315b00d1-b0d4-4094-91f4-366e7dbfda8e req-88f5c026-697f-4d64-a750-7f0d11ddb8f8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:54.440237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-315b00d1-b0d4-4094-91f4-366e7dbfda8e req-88f5c026-697f-4d64-a750-7f0d11ddb8f8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:54.457106 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-315b00d1-b0d4-4094-91f4-366e7dbfda8e req-88f5c026-697f-4d64-a750-7f0d11ddb8f8 service nova] Creating event network-vif-unplugged:f058e4a1-c25d-417e-8d41-b82e64725e18 for instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc on n-h1-860282-1 Oct 04 21:36:54.459995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3c0e47c4-cdd4-4cbe-9813-3a26e6de176b tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:54.481745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3c0e47c4-cdd4-4cbe-9813-3a26e6de176b tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:54.481745 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3c0e47c4-cdd4-4cbe-9813-3a26e6de176b tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.017616 Oct 04 21:36:54.481745 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2928/5837] 10.222.0.30 () {58 vars in 1178 bytes} [Tue Oct 4 21:36:54 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:36:54.482422 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-315b00d1-b0d4-4094-91f4-366e7dbfda8e req-88f5c026-697f-4d64-a750-7f0d11ddb8f8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067567 Oct 04 21:36:54.482422 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2910/5838] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:36:54.482608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-10e38c29-6090-4fb1-97b5-29251937bd7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:54.486400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-10e38c29-6090-4fb1-97b5-29251937bd7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:54.487210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-10e38c29-6090-4fb1-97b5-29251937bd7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Searching by: {'deleted': False, 'project_id': '10b578dbd53946c2977352366a12279b'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:36:54.493101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10e38c29-6090-4fb1-97b5-29251937bd7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:54.493772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10e38c29-6090-4fb1-97b5-29251937bd7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:54.494281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10e38c29-6090-4fb1-97b5-29251937bd7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:54.495076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10e38c29-6090-4fb1-97b5-29251937bd7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:54.495627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10e38c29-6090-4fb1-97b5-29251937bd7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:54.496131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10e38c29-6090-4fb1-97b5-29251937bd7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:54.533672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-10e38c29-6090-4fb1-97b5-29251937bd7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:36:54.567509 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-10e38c29-6090-4fb1-97b5-29251937bd7c tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.091024 Oct 04 21:36:54.568105 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2929/5839] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Oct 4 21:36:54 2022] GET /compute/v2.1/servers => generated 683 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:54.582463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7e282bb1-e4d2-4f59-93f9-e097f267b54d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:54.583113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7e282bb1-e4d2-4f59-93f9-e097f267b54d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: af293754-4522-4c34-9e22-cd3d8d626365] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:54.590611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e282bb1-e4d2-4f59-93f9-e097f267b54d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:54.591203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e282bb1-e4d2-4f59-93f9-e097f267b54d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:54.591729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e282bb1-e4d2-4f59-93f9-e097f267b54d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:54.592546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e282bb1-e4d2-4f59-93f9-e097f267b54d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:54.593099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e282bb1-e4d2-4f59-93f9-e097f267b54d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:54.593646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e282bb1-e4d2-4f59-93f9-e097f267b54d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:54.608569 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-7e282bb1-e4d2-4f59-93f9-e097f267b54d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] HTTP exception thrown: Instance af293754-4522-4c34-9e22-cd3d8d626365 could not be found. Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7e282bb1-e4d2-4f59-93f9-e097f267b54d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Request method failure captured: Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365 HTTP/1.1 Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKdSgLYmTSpTdOGDn_6DyMY3ItyTAYDcOJuSk5-ePgT9vCy0nrmX5-ywlX6we1IDUhpVuuuEnL9OqhniuFxZd-QOVIImx7byHNDT7MIDa16YnXcAsEiw_Ef0AzxIpc8vRP1ivDQBXRVgtYzInmAphEbsuJD9gOwawvAsIUDJ8SjNDzQ Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 10b578dbd53946c2977352366a12279b Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10b578dbd53946c2977352366a12279b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10b578dbd53946c2977352366a12279b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10b578dbd53946c2977352366a12279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10b578dbd53946c2977352366a12279b"}]}] Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 10b578dbd53946c2977352366a12279b Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ListServersNegativeTestJSON-1136792717-project Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 902608697c894535b0e8a1bafd225d59 Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ListServersNegativeTestJSON-1136792717-project Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance af293754-4522-4c34-9e22-cd3d8d626365 could not be found. Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'af293754-4522-4c34-9e22-cd3d8d626365'} Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af293754-4522-4c34-9e22-cd3d8d626365 could not be found. Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:36:54.610807 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:36:54.614529 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af293754-4522-4c34-9e22-cd3d8d626365 could not be found. Oct 04 21:36:54.614529 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:36:54.614529 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:54.614529 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:36:54.614529 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:54.614529 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:54.614529 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:54.614529 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:36:54.614529 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:36:54.614529 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af293754-4522-4c34-9e22-cd3d8d626365 could not be found. Oct 04 21:36:54.614529 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:36:54.614529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7e282bb1-e4d2-4f59-93f9-e097f267b54d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Returning 404 to user: Instance af293754-4522-4c34-9e22-cd3d8d626365 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:36:54.614529 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7e282bb1-e4d2-4f59-93f9-e097f267b54d tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "DELETE /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365" status: 404 len: 111 microversion: 2.1 time: 0.034328 Oct 04 21:36:54.614529 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2911/5840] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:36:54 2022] DELETE /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:36:54.620625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-afac501e-dc61-4458-bad8-2308da12d233 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:54.621132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-afac501e-dc61-4458-bad8-2308da12d233 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 248223cc-90a5-49d8-a86a-23e6305e2903] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:54.627460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afac501e-dc61-4458-bad8-2308da12d233 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:54.627981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afac501e-dc61-4458-bad8-2308da12d233 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:54.628403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afac501e-dc61-4458-bad8-2308da12d233 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:54.629115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afac501e-dc61-4458-bad8-2308da12d233 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:54.629607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afac501e-dc61-4458-bad8-2308da12d233 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:54.630034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-afac501e-dc61-4458-bad8-2308da12d233 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:54.650423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:54.658894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-afac501e-dc61-4458-bad8-2308da12d233 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 248223cc-90a5-49d8-a86a-23e6305e2903] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:36:54.963894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-408cba3c-76fa-4d06-bd5c-39b581f562d1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:54.966528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-408cba3c-76fa-4d06-bd5c-39b581f562d1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:54.973852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-408cba3c-76fa-4d06-bd5c-39b581f562d1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:54.974504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-408cba3c-76fa-4d06-bd5c-39b581f562d1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:54.975150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-408cba3c-76fa-4d06-bd5c-39b581f562d1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:54.975981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-408cba3c-76fa-4d06-bd5c-39b581f562d1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:54.976572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-408cba3c-76fa-4d06-bd5c-39b581f562d1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:54.977195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-408cba3c-76fa-4d06-bd5c-39b581f562d1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:55.005728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:55.011759 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-afac501e-dc61-4458-bad8-2308da12d233 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "DELETE /compute/v2.1/servers/248223cc-90a5-49d8-a86a-23e6305e2903" status: 204 len: 0 microversion: 2.1 time: 0.394955 Oct 04 21:36:55.012602 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2930/5841] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:36:54 2022] DELETE /compute/v2.1/servers/248223cc-90a5-49d8-a86a-23e6305e2903 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:36:55.013297 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-408cba3c-76fa-4d06-bd5c-39b581f562d1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053374 Oct 04 21:36:55.014151 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2912/5842] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:36:54 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:36:55.021244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c3f92536-295e-48f9-bb13-d9ff6768e761 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:55.021994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c3f92536-295e-48f9-bb13-d9ff6768e761 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:55.028852 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3f92536-295e-48f9-bb13-d9ff6768e761 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:55.033693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3f92536-295e-48f9-bb13-d9ff6768e761 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:55.033693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3f92536-295e-48f9-bb13-d9ff6768e761 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:55.033693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3f92536-295e-48f9-bb13-d9ff6768e761 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:55.033693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3f92536-295e-48f9-bb13-d9ff6768e761 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:55.033693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3f92536-295e-48f9-bb13-d9ff6768e761 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:55.060078 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c3f92536-295e-48f9-bb13-d9ff6768e761 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:36:55.366270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ad001d3a-0427-4bf3-9d78-955416fa2f73 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:55.368139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ad001d3a-0427-4bf3-9d78-955416fa2f73 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:55.376063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad001d3a-0427-4bf3-9d78-955416fa2f73 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:55.376702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad001d3a-0427-4bf3-9d78-955416fa2f73 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:55.378320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad001d3a-0427-4bf3-9d78-955416fa2f73 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:55.378320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad001d3a-0427-4bf3-9d78-955416fa2f73 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:55.378507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad001d3a-0427-4bf3-9d78-955416fa2f73 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:55.378881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad001d3a-0427-4bf3-9d78-955416fa2f73 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:55.441480 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c3f92536-295e-48f9-bb13-d9ff6768e761 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 204 len: 0 microversion: 2.1 time: 0.423126 Oct 04 21:36:55.442321 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2931/5843] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:36:55 2022] DELETE /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:36:55.451729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-61b0a8c4-b966-4552-bede-098318151964 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:55.452535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-61b0a8c4-b966-4552-bede-098318151964 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: af293754-4522-4c34-9e22-cd3d8d626365] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:55.463487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61b0a8c4-b966-4552-bede-098318151964 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:55.463987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61b0a8c4-b966-4552-bede-098318151964 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:55.464431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61b0a8c4-b966-4552-bede-098318151964 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:55.471802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61b0a8c4-b966-4552-bede-098318151964 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:55.472376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61b0a8c4-b966-4552-bede-098318151964 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:55.472824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61b0a8c4-b966-4552-bede-098318151964 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:55.521060 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-61b0a8c4-b966-4552-bede-098318151964 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] HTTP exception thrown: Instance af293754-4522-4c34-9e22-cd3d8d626365 could not be found. Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-61b0a8c4-b966-4552-bede-098318151964 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Request method failure captured: Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365 HTTP/1.1 Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKdSgLYmTSpTdOGDn_6DyMY3ItyTAYDcOJuSk5-ePgT9vCy0nrmX5-ywlX6we1IDUhpVuuuEnL9OqhniuFxZd-QOVIImx7byHNDT7MIDa16YnXcAsEiw_Ef0AzxIpc8vRP1ivDQBXRVgtYzInmAphEbsuJD9gOwawvAsIUDJ8SjNDzQ Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 10b578dbd53946c2977352366a12279b Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10b578dbd53946c2977352366a12279b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10b578dbd53946c2977352366a12279b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10b578dbd53946c2977352366a12279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10b578dbd53946c2977352366a12279b"}]}] Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 10b578dbd53946c2977352366a12279b Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ListServersNegativeTestJSON-1136792717-project Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 902608697c894535b0e8a1bafd225d59 Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ListServersNegativeTestJSON-1136792717-project Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance af293754-4522-4c34-9e22-cd3d8d626365 could not be found. Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'af293754-4522-4c34-9e22-cd3d8d626365'} Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af293754-4522-4c34-9e22-cd3d8d626365 could not be found. Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af293754-4522-4c34-9e22-cd3d8d626365 could not be found. Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:55.522831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:55.526860 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:55.526860 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:55.526860 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:55.526860 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:55.526860 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:36:55.526860 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:36:55.526860 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af293754-4522-4c34-9e22-cd3d8d626365 could not be found. Oct 04 21:36:55.526860 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:36:55.526860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-61b0a8c4-b966-4552-bede-098318151964 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Returning 404 to user: Instance af293754-4522-4c34-9e22-cd3d8d626365 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:36:55.529321 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-61b0a8c4-b966-4552-bede-098318151964 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365" status: 404 len: 111 microversion: 2.1 time: 0.080085 Oct 04 21:36:55.529977 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2932/5844] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:55 2022] GET /compute/v2.1/servers/af293754-4522-4c34-9e22-cd3d8d626365 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:36:55.545140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e767408d-9a70-489a-8789-368629a74aa3 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:55.545671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e767408d-9a70-489a-8789-368629a74aa3 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 248223cc-90a5-49d8-a86a-23e6305e2903] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:55.559976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e767408d-9a70-489a-8789-368629a74aa3 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:55.560980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e767408d-9a70-489a-8789-368629a74aa3 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:55.562866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e767408d-9a70-489a-8789-368629a74aa3 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:55.562866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e767408d-9a70-489a-8789-368629a74aa3 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:55.563401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e767408d-9a70-489a-8789-368629a74aa3 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:55.564141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e767408d-9a70-489a-8789-368629a74aa3 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:55.673202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ad001d3a-0427-4bf3-9d78-955416fa2f73 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:55.686241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ad001d3a-0427-4bf3-9d78-955416fa2f73 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:55.689619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ad001d3a-0427-4bf3-9d78-955416fa2f73 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:55.691671 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ad001d3a-0427-4bf3-9d78-955416fa2f73 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1722 microversion: 2.20 time: 0.331536 Oct 04 21:36:55.699145 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2913/5845] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:55 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1722 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:36:55.787690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e767408d-9a70-489a-8789-368629a74aa3 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:55.806486 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e767408d-9a70-489a-8789-368629a74aa3 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/248223cc-90a5-49d8-a86a-23e6305e2903" status: 200 len: 1521 microversion: 2.1 time: 0.268460 Oct 04 21:36:55.821999 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2933/5846] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:55 2022] GET /compute/v2.1/servers/248223cc-90a5-49d8-a86a-23e6305e2903 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:36:56.026962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a03da777-bd64-47ef-bd27-e67e259ccc3a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:56.030339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a03da777-bd64-47ef-bd27-e67e259ccc3a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:56.039747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a03da777-bd64-47ef-bd27-e67e259ccc3a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:56.040792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a03da777-bd64-47ef-bd27-e67e259ccc3a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:56.042017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a03da777-bd64-47ef-bd27-e67e259ccc3a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:56.043205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a03da777-bd64-47ef-bd27-e67e259ccc3a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:56.043639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a03da777-bd64-47ef-bd27-e67e259ccc3a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:56.044081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a03da777-bd64-47ef-bd27-e67e259ccc3a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:56.079611 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a03da777-bd64-47ef-bd27-e67e259ccc3a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056973 Oct 04 21:36:56.080281 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2914/5847] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:36:56 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:56.729840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2467923e-f83b-49c3-b2c2-b53586c9c2a2 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:56.731029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2467923e-f83b-49c3-b2c2-b53586c9c2a2 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:56.749962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2467923e-f83b-49c3-b2c2-b53586c9c2a2 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:56.750462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2467923e-f83b-49c3-b2c2-b53586c9c2a2 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:56.750903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2467923e-f83b-49c3-b2c2-b53586c9c2a2 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:56.751612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2467923e-f83b-49c3-b2c2-b53586c9c2a2 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:56.752069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2467923e-f83b-49c3-b2c2-b53586c9c2a2 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:56.752494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2467923e-f83b-49c3-b2c2-b53586c9c2a2 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:56.833543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fbb02290-906a-4db2-a41b-9bcccc03df18 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:56.834161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fbb02290-906a-4db2-a41b-9bcccc03df18 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 248223cc-90a5-49d8-a86a-23e6305e2903] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:56.841262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fbb02290-906a-4db2-a41b-9bcccc03df18 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:56.841836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fbb02290-906a-4db2-a41b-9bcccc03df18 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:56.842283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fbb02290-906a-4db2-a41b-9bcccc03df18 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:56.842984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fbb02290-906a-4db2-a41b-9bcccc03df18 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:56.843439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fbb02290-906a-4db2-a41b-9bcccc03df18 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:56.843867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fbb02290-906a-4db2-a41b-9bcccc03df18 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:57.463037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2467923e-f83b-49c3-b2c2-b53586c9c2a2 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:57.476304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2467923e-f83b-49c3-b2c2-b53586c9c2a2 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:57.477706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2467923e-f83b-49c3-b2c2-b53586c9c2a2 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:57.478882 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2467923e-f83b-49c3-b2c2-b53586c9c2a2 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1725 microversion: 2.20 time: 0.754460 Oct 04 21:36:57.479670 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2934/5848] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:36:56 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1725 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:36:57.510222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-61c5cf14-563b-4bfd-99c6-080bd6c7e7af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:57.512076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-61c5cf14-563b-4bfd-99c6-080bd6c7e7af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:57.529861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61c5cf14-563b-4bfd-99c6-080bd6c7e7af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:57.534782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61c5cf14-563b-4bfd-99c6-080bd6c7e7af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:57.535465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61c5cf14-563b-4bfd-99c6-080bd6c7e7af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:57.536368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61c5cf14-563b-4bfd-99c6-080bd6c7e7af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:57.536984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61c5cf14-563b-4bfd-99c6-080bd6c7e7af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:57.544798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61c5cf14-563b-4bfd-99c6-080bd6c7e7af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:57.625759 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-61c5cf14-563b-4bfd-99c6-080bd6c7e7af tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.145216 Oct 04 21:36:57.636461 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2935/5849] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:36:57 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4/os-volume_attachments => generated 25 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:36:57.669763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-74c1fa18-051b-439d-a728-43769adb6bd5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4559a1d3-2764-44a6-80cc-5d8bb362f65c"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:57.671257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-74c1fa18-051b-439d-a728-43769adb6bd5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:57.678883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74c1fa18-051b-439d-a728-43769adb6bd5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:57.680674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74c1fa18-051b-439d-a728-43769adb6bd5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:57.681555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74c1fa18-051b-439d-a728-43769adb6bd5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:57.682603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74c1fa18-051b-439d-a728-43769adb6bd5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:57.684578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74c1fa18-051b-439d-a728-43769adb6bd5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:57.686704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-74c1fa18-051b-439d-a728-43769adb6bd5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:57.758414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fbb02290-906a-4db2-a41b-9bcccc03df18 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:57.768694 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fbb02290-906a-4db2-a41b-9bcccc03df18 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/248223cc-90a5-49d8-a86a-23e6305e2903" status: 200 len: 1521 microversion: 2.1 time: 0.939107 Oct 04 21:36:57.783660 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2915/5850] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:56 2022] GET /compute/v2.1/servers/248223cc-90a5-49d8-a86a-23e6305e2903 => generated 1521 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:36:57.785082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-1a512bb4-2bbc-43e9-8f17-2be6cd13cf78 req-e5f7518f-c302-43e7-ac09-992b3e490201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248223cc-90a5-49d8-a86a-23e6305e2903", "name": "network-vif-deleted", "tag": "eac6b243-f82e-4f56-b480-20d2e2e300e3"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:57.831223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1a512bb4-2bbc-43e9-8f17-2be6cd13cf78 req-e5f7518f-c302-43e7-ac09-992b3e490201 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:57.832028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1a512bb4-2bbc-43e9-8f17-2be6cd13cf78 req-e5f7518f-c302-43e7-ac09-992b3e490201 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:57.832661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1a512bb4-2bbc-43e9-8f17-2be6cd13cf78 req-e5f7518f-c302-43e7-ac09-992b3e490201 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:57.858006 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-1a512bb4-2bbc-43e9-8f17-2be6cd13cf78 req-e5f7518f-c302-43e7-ac09-992b3e490201 service nova] Creating event network-vif-deleted:eac6b243-f82e-4f56-b480-20d2e2e300e3 for instance 248223cc-90a5-49d8-a86a-23e6305e2903 on n-h2-860282-1 Oct 04 21:36:57.864537 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-1a512bb4-2bbc-43e9-8f17-2be6cd13cf78 req-e5f7518f-c302-43e7-ac09-992b3e490201 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084120 Oct 04 21:36:57.865725 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2916/5851] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:57.872105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3437c6aa-f718-4536-a249-4aa9da536cb8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:57.872995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3437c6aa-f718-4536-a249-4aa9da536cb8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:57.881363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3437c6aa-f718-4536-a249-4aa9da536cb8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:57.882248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3437c6aa-f718-4536-a249-4aa9da536cb8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:57.883543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3437c6aa-f718-4536-a249-4aa9da536cb8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:57.884453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3437c6aa-f718-4536-a249-4aa9da536cb8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:57.885131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3437c6aa-f718-4536-a249-4aa9da536cb8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:57.885909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3437c6aa-f718-4536-a249-4aa9da536cb8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:57.964085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3437c6aa-f718-4536-a249-4aa9da536cb8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:36:58.508840 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3437c6aa-f718-4536-a249-4aa9da536cb8 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "DELETE /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 204 len: 0 microversion: 2.1 time: 0.640635 Oct 04 21:36:58.510073 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2917/5852] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:36:57 2022] DELETE /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:36:58.518918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7e6be569-6e6b-4700-b4db-0aa292081c02 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:58.520389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7e6be569-6e6b-4700-b4db-0aa292081c02 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:58.562522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e6be569-6e6b-4700-b4db-0aa292081c02 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:58.563288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e6be569-6e6b-4700-b4db-0aa292081c02 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:58.563999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e6be569-6e6b-4700-b4db-0aa292081c02 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:58.565102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e6be569-6e6b-4700-b4db-0aa292081c02 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:58.565823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e6be569-6e6b-4700-b4db-0aa292081c02 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:58.566489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e6be569-6e6b-4700-b4db-0aa292081c02 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:58.940582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7e6be569-6e6b-4700-b4db-0aa292081c02 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:58.954328 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7e6be569-6e6b-4700-b4db-0aa292081c02 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 200 len: 1678 microversion: 2.1 time: 0.439597 Oct 04 21:36:58.954818 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2918/5853] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:58 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 1678 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:36:58.965290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4aa594df-5267-4ba6-ae60-b8f96367ffaa tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:58.965963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4aa594df-5267-4ba6-ae60-b8f96367ffaa tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 248223cc-90a5-49d8-a86a-23e6305e2903] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:58.983522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4aa594df-5267-4ba6-ae60-b8f96367ffaa tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:58.983522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4aa594df-5267-4ba6-ae60-b8f96367ffaa tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:58.983522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4aa594df-5267-4ba6-ae60-b8f96367ffaa tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:58.983522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4aa594df-5267-4ba6-ae60-b8f96367ffaa tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:58.983946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4aa594df-5267-4ba6-ae60-b8f96367ffaa tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:58.984609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4aa594df-5267-4ba6-ae60-b8f96367ffaa tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:59.036463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4aa594df-5267-4ba6-ae60-b8f96367ffaa tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:59.037292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4aa594df-5267-4ba6-ae60-b8f96367ffaa tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:59.037957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4aa594df-5267-4ba6-ae60-b8f96367ffaa tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:59.039225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-4aa594df-5267-4ba6-ae60-b8f96367ffaa tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lazy-loading 'fault' on Instance uuid 248223cc-90a5-49d8-a86a-23e6305e2903 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:36:59.122686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4aa594df-5267-4ba6-ae60-b8f96367ffaa tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:59.132215 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4aa594df-5267-4ba6-ae60-b8f96367ffaa tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/248223cc-90a5-49d8-a86a-23e6305e2903" status: 200 len: 1313 microversion: 2.1 time: 0.176313 Oct 04 21:36:59.133091 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2919/5854] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:58 2022] GET /compute/v2.1/servers/248223cc-90a5-49d8-a86a-23e6305e2903 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:59.204565 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-74c1fa18-051b-439d-a728-43769adb6bd5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "POST /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.572319 Oct 04 21:36:59.206141 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2936/5855] 10.222.0.30 () {62 vars in 1364 bytes} [Tue Oct 4 21:36:57 2022] POST /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc/os-volume_attachments => generated 188 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:36:59.432258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e6136af2-6de0-4fa8-956d-73ab3a20e0b3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:59.433181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e6136af2-6de0-4fa8-956d-73ab3a20e0b3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:59.441115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6136af2-6de0-4fa8-956d-73ab3a20e0b3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:59.442275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6136af2-6de0-4fa8-956d-73ab3a20e0b3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:59.451756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6136af2-6de0-4fa8-956d-73ab3a20e0b3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:59.451756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6136af2-6de0-4fa8-956d-73ab3a20e0b3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:59.451756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6136af2-6de0-4fa8-956d-73ab3a20e0b3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:59.451756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6136af2-6de0-4fa8-956d-73ab3a20e0b3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:59.982215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-208e62d9-185c-4096-acbf-6e4b3a263b70 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:59.984369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-208e62d9-185c-4096-acbf-6e4b3a263b70 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:00.001892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-208e62d9-185c-4096-acbf-6e4b3a263b70 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:00.002405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-208e62d9-185c-4096-acbf-6e4b3a263b70 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:00.002856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-208e62d9-185c-4096-acbf-6e4b3a263b70 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:00.004694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-208e62d9-185c-4096-acbf-6e4b3a263b70 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:00.008502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-208e62d9-185c-4096-acbf-6e4b3a263b70 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:00.009268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-208e62d9-185c-4096-acbf-6e4b3a263b70 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:00.329889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-208e62d9-185c-4096-acbf-6e4b3a263b70 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:00.363405 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-208e62d9-185c-4096-acbf-6e4b3a263b70 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 200 len: 1678 microversion: 2.1 time: 0.385261 Oct 04 21:37:00.381691 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2937/5856] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:59 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 1678 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:37:00.388351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-e8468dd9-2cd3-49dc-85ee-38731190a862 req-c3a0dd9f-5ba2-4ce1-9ae0-9b4426f6149f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed51db6-79cb-4486-aaa5-8eb15f7234a4", "name": "network-vif-deleted", "tag": "c84d49e9-e62a-4ae9-b985-f3e7248dcb69"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:00.392396 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e6136af2-6de0-4fa8-956d-73ab3a20e0b3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc/os-volume_attachments/4559a1d3-2764-44a6-80cc-5d8bb362f65c" status: 202 len: 0 microversion: 2.20 time: 0.965794 Oct 04 21:37:00.396842 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2920/5857] 10.222.0.30 () {60 vars in 1457 bytes} [Tue Oct 4 21:36:59 2022] DELETE /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc/os-volume_attachments/4559a1d3-2764-44a6-80cc-5d8bb362f65c => generated 0 bytes in 968 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:37:00.400502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3465c4cb-7df2-48a1-a65d-fb97b64a4270 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:00.402060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3465c4cb-7df2-48a1-a65d-fb97b64a4270 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 248223cc-90a5-49d8-a86a-23e6305e2903] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:00.449910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3465c4cb-7df2-48a1-a65d-fb97b64a4270 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:00.450426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3465c4cb-7df2-48a1-a65d-fb97b64a4270 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:00.450879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3465c4cb-7df2-48a1-a65d-fb97b64a4270 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:00.451646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3465c4cb-7df2-48a1-a65d-fb97b64a4270 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:00.452115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3465c4cb-7df2-48a1-a65d-fb97b64a4270 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:00.460338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e8468dd9-2cd3-49dc-85ee-38731190a862 req-c3a0dd9f-5ba2-4ce1-9ae0-9b4426f6149f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:00.465007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3465c4cb-7df2-48a1-a65d-fb97b64a4270 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:00.467408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e8468dd9-2cd3-49dc-85ee-38731190a862 req-c3a0dd9f-5ba2-4ce1-9ae0-9b4426f6149f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:00.467887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e8468dd9-2cd3-49dc-85ee-38731190a862 req-c3a0dd9f-5ba2-4ce1-9ae0-9b4426f6149f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:00.545906 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-e8468dd9-2cd3-49dc-85ee-38731190a862 req-c3a0dd9f-5ba2-4ce1-9ae0-9b4426f6149f service nova] Creating event network-vif-deleted:c84d49e9-e62a-4ae9-b985-f3e7248dcb69 for instance 4ed51db6-79cb-4486-aaa5-8eb15f7234a4 on n-h1-860282-1 Oct 04 21:37:00.556602 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-3465c4cb-7df2-48a1-a65d-fb97b64a4270 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] HTTP exception thrown: Instance 248223cc-90a5-49d8-a86a-23e6305e2903 could not be found. Oct 04 21:37:00.566876 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-e8468dd9-2cd3-49dc-85ee-38731190a862 req-c3a0dd9f-5ba2-4ce1-9ae0-9b4426f6149f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193960 Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3465c4cb-7df2-48a1-a65d-fb97b64a4270 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Request method failure captured: Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/248223cc-90a5-49d8-a86a-23e6305e2903 HTTP/1.1 Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKdSgLYmTSpTdOGDn_6DyMY3ItyTAYDcOJuSk5-ePgT9vCy0nrmX5-ywlX6we1IDUhpVuuuEnL9OqhniuFxZd-QOVIImx7byHNDT7MIDa16YnXcAsEiw_Ef0AzxIpc8vRP1ivDQBXRVgtYzInmAphEbsuJD9gOwawvAsIUDJ8SjNDzQ Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 10b578dbd53946c2977352366a12279b Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10b578dbd53946c2977352366a12279b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10b578dbd53946c2977352366a12279b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10b578dbd53946c2977352366a12279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10b578dbd53946c2977352366a12279b"}]}] Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 10b578dbd53946c2977352366a12279b Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ListServersNegativeTestJSON-1136792717-project Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 902608697c894535b0e8a1bafd225d59 Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ListServersNegativeTestJSON-1136792717-project Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 248223cc-90a5-49d8-a86a-23e6305e2903 could not be found. Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '248223cc-90a5-49d8-a86a-23e6305e2903'} Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 248223cc-90a5-49d8-a86a-23e6305e2903 could not be found. Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 248223cc-90a5-49d8-a86a-23e6305e2903 could not be found. Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:00.571542 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:00.576146 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:00.576146 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:00.576146 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:00.576146 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:00.576146 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:37:00.576146 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:37:00.576146 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 248223cc-90a5-49d8-a86a-23e6305e2903 could not be found. Oct 04 21:37:00.576146 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:00.576648 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2938/5858] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:00.576730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3465c4cb-7df2-48a1-a65d-fb97b64a4270 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Returning 404 to user: Instance 248223cc-90a5-49d8-a86a-23e6305e2903 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:37:00.576730 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3465c4cb-7df2-48a1-a65d-fb97b64a4270 tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/248223cc-90a5-49d8-a86a-23e6305e2903" status: 404 len: 111 microversion: 2.1 time: 0.179717 Oct 04 21:37:00.576730 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2921/5859] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:00 2022] GET /compute/v2.1/servers/248223cc-90a5-49d8-a86a-23e6305e2903 => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:37:00.588633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-91c84a8d-a4bd-4e51-9330-8c72d2d15f4e tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:00.589931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-352637c0-7cb7-4129-921d-6dd6fb8ac9b8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:00.595563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-352637c0-7cb7-4129-921d-6dd6fb8ac9b8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:00.597160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-91c84a8d-a4bd-4e51-9330-8c72d2d15f4e tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:00.616655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-352637c0-7cb7-4129-921d-6dd6fb8ac9b8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:00.618893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-352637c0-7cb7-4129-921d-6dd6fb8ac9b8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:00.619759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91c84a8d-a4bd-4e51-9330-8c72d2d15f4e tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:00.620253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-352637c0-7cb7-4129-921d-6dd6fb8ac9b8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:00.620958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91c84a8d-a4bd-4e51-9330-8c72d2d15f4e tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:00.621395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-352637c0-7cb7-4129-921d-6dd6fb8ac9b8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:00.621943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91c84a8d-a4bd-4e51-9330-8c72d2d15f4e tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:00.622310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-352637c0-7cb7-4129-921d-6dd6fb8ac9b8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:00.622939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-352637c0-7cb7-4129-921d-6dd6fb8ac9b8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:00.623621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91c84a8d-a4bd-4e51-9330-8c72d2d15f4e tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:00.624703 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91c84a8d-a4bd-4e51-9330-8c72d2d15f4e tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:00.626692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91c84a8d-a4bd-4e51-9330-8c72d2d15f4e tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:00.690292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-352637c0-7cb7-4129-921d-6dd6fb8ac9b8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122757) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 21:37:00.732122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91c84a8d-a4bd-4e51-9330-8c72d2d15f4e tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:00.732637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91c84a8d-a4bd-4e51-9330-8c72d2d15f4e tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:00.733755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91c84a8d-a4bd-4e51-9330-8c72d2d15f4e tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:00.734238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-91c84a8d-a4bd-4e51-9330-8c72d2d15f4e tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lazy-loading 'fault' on Instance uuid 4ed51db6-79cb-4486-aaa5-8eb15f7234a4 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:37:00.825412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-91c84a8d-a4bd-4e51-9330-8c72d2d15f4e tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902608697c894535b0e8a1bafd225d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b578dbd53946c2977352366a12279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:00.835023 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-91c84a8d-a4bd-4e51-9330-8c72d2d15f4e tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 200 len: 1313 microversion: 2.1 time: 0.254742 Oct 04 21:37:00.836862 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2922/5860] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:00 2022] GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:01.128133 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-352637c0-7cb7-4129-921d-6dd6fb8ac9b8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "POST /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc/action" status: 202 len: 0 microversion: 2.20 time: 0.554065 Oct 04 21:37:01.129091 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2939/5861] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Oct 4 21:37:00 2022] POST /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:37:01.137408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b3de6810-23ae-4c24-a80c-cde1716784db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:01.138198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b3de6810-23ae-4c24-a80c-cde1716784db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:01.146876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3de6810-23ae-4c24-a80c-cde1716784db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:01.147369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3de6810-23ae-4c24-a80c-cde1716784db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:01.147841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3de6810-23ae-4c24-a80c-cde1716784db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:01.148546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3de6810-23ae-4c24-a80c-cde1716784db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:01.149004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3de6810-23ae-4c24-a80c-cde1716784db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:01.149456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3de6810-23ae-4c24-a80c-cde1716784db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:01.395850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ea761fbf-e968-4116-beff-7d9a03a255ac tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:01.397263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ea761fbf-e968-4116-beff-7d9a03a255ac tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:01.417164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea761fbf-e968-4116-beff-7d9a03a255ac tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:01.417164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea761fbf-e968-4116-beff-7d9a03a255ac tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:01.417164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea761fbf-e968-4116-beff-7d9a03a255ac tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:01.417164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea761fbf-e968-4116-beff-7d9a03a255ac tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:01.417164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea761fbf-e968-4116-beff-7d9a03a255ac tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:01.417164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea761fbf-e968-4116-beff-7d9a03a255ac tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:01.505312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b3de6810-23ae-4c24-a80c-cde1716784db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:01.519435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b3de6810-23ae-4c24-a80c-cde1716784db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:01.527018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b3de6810-23ae-4c24-a80c-cde1716784db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:01.558849 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b3de6810-23ae-4c24-a80c-cde1716784db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1673 microversion: 2.20 time: 0.425324 Oct 04 21:37:01.561028 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2923/5862] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:01 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1673 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:01.588764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ea761fbf-e968-4116-beff-7d9a03a255ac tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:01.600146 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ea761fbf-e968-4116-beff-7d9a03a255ac tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 200 len: 1610 microversion: 2.1 time: 0.207237 Oct 04 21:37:01.602284 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2940/5863] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:01 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 1610 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:37:01.864141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ca184d5c-ad1a-428b-84a9-9b7ef2791f2f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:01.864772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ca184d5c-ad1a-428b-84a9-9b7ef2791f2f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] [instance: 4ed51db6-79cb-4486-aaa5-8eb15f7234a4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:01.888568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca184d5c-ad1a-428b-84a9-9b7ef2791f2f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:01.892016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca184d5c-ad1a-428b-84a9-9b7ef2791f2f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:01.896211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca184d5c-ad1a-428b-84a9-9b7ef2791f2f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:01.897215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca184d5c-ad1a-428b-84a9-9b7ef2791f2f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:01.898575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca184d5c-ad1a-428b-84a9-9b7ef2791f2f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:01.904953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ca184d5c-ad1a-428b-84a9-9b7ef2791f2f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:01.990657 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-ca184d5c-ad1a-428b-84a9-9b7ef2791f2f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] HTTP exception thrown: Instance 4ed51db6-79cb-4486-aaa5-8eb15f7234a4 could not be found. Oct 04 21:37:01.995527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-7e8e14fe-2086-4e31-a70f-a73bd89fbfbf req-f6d4c095-5e82-4bed-885e-28f51650a343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60148f18-dd52-4a9a-8d23-12cb5ebbd7c4", "name": "network-vif-deleted", "tag": "1c4a8457-2b84-4180-8f0c-4097c6670f56"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ca184d5c-ad1a-428b-84a9-9b7ef2791f2f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Request method failure captured: Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 HTTP/1.1 Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKdSgLYmTSpTdOGDn_6DyMY3ItyTAYDcOJuSk5-ePgT9vCy0nrmX5-ywlX6we1IDUhpVuuuEnL9OqhniuFxZd-QOVIImx7byHNDT7MIDa16YnXcAsEiw_Ef0AzxIpc8vRP1ivDQBXRVgtYzInmAphEbsuJD9gOwawvAsIUDJ8SjNDzQ Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 10b578dbd53946c2977352366a12279b Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10b578dbd53946c2977352366a12279b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10b578dbd53946c2977352366a12279b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10b578dbd53946c2977352366a12279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10b578dbd53946c2977352366a12279b"}]}] Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 10b578dbd53946c2977352366a12279b Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1136792717 Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ListServersNegativeTestJSON-1136792717-project Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 902608697c894535b0e8a1bafd225d59 Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ListServersNegativeTestJSON-1136792717-project Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 4ed51db6-79cb-4486-aaa5-8eb15f7234a4 could not be found. Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '4ed51db6-79cb-4486-aaa5-8eb15f7234a4'} Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ed51db6-79cb-4486-aaa5-8eb15f7234a4 could not be found. Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ed51db6-79cb-4486-aaa5-8eb15f7234a4 could not be found. Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:01.999685 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:02.008283 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:02.008283 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:02.008283 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:02.008283 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:02.008283 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:37:02.008283 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:37:02.008283 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ed51db6-79cb-4486-aaa5-8eb15f7234a4 could not be found. Oct 04 21:37:02.008283 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:02.008283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ca184d5c-ad1a-428b-84a9-9b7ef2791f2f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] Returning 404 to user: Instance 4ed51db6-79cb-4486-aaa5-8eb15f7234a4 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:37:02.008283 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ca184d5c-ad1a-428b-84a9-9b7ef2791f2f tempest-ListServersNegativeTestJSON-1136792717 tempest-ListServersNegativeTestJSON-1136792717-project] 10.222.0.30 "GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4" status: 404 len: 111 microversion: 2.1 time: 0.143025 Oct 04 21:37:02.008283 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2924/5864] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:01 2022] GET /compute/v2.1/servers/4ed51db6-79cb-4486-aaa5-8eb15f7234a4 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:37:02.016120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7e8e14fe-2086-4e31-a70f-a73bd89fbfbf req-f6d4c095-5e82-4bed-885e-28f51650a343 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:02.016805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7e8e14fe-2086-4e31-a70f-a73bd89fbfbf req-f6d4c095-5e82-4bed-885e-28f51650a343 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:02.017389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7e8e14fe-2086-4e31-a70f-a73bd89fbfbf req-f6d4c095-5e82-4bed-885e-28f51650a343 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:02.032458 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-7e8e14fe-2086-4e31-a70f-a73bd89fbfbf req-f6d4c095-5e82-4bed-885e-28f51650a343 service nova] Creating event network-vif-deleted:1c4a8457-2b84-4180-8f0c-4097c6670f56 for instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 on n-h1-860282-1 Oct 04 21:37:02.038272 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-7e8e14fe-2086-4e31-a70f-a73bd89fbfbf req-f6d4c095-5e82-4bed-885e-28f51650a343 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047910 Oct 04 21:37:02.040859 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2941/5865] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:37:02.588659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6fe938a8-1aac-4859-8cce-153704ec4d21 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:02.590016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6fe938a8-1aac-4859-8cce-153704ec4d21 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:02.600207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fe938a8-1aac-4859-8cce-153704ec4d21 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:02.600712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fe938a8-1aac-4859-8cce-153704ec4d21 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:02.601401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fe938a8-1aac-4859-8cce-153704ec4d21 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:02.611224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fe938a8-1aac-4859-8cce-153704ec4d21 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:02.611741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fe938a8-1aac-4859-8cce-153704ec4d21 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:02.613171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fe938a8-1aac-4859-8cce-153704ec4d21 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:02.626593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4c8eccbb-eae7-4653-9a63-2ef7d0e475e5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:02.627324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4c8eccbb-eae7-4653-9a63-2ef7d0e475e5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:02.643628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c8eccbb-eae7-4653-9a63-2ef7d0e475e5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:02.644939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c8eccbb-eae7-4653-9a63-2ef7d0e475e5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:02.644939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c8eccbb-eae7-4653-9a63-2ef7d0e475e5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:02.645300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c8eccbb-eae7-4653-9a63-2ef7d0e475e5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:02.645798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c8eccbb-eae7-4653-9a63-2ef7d0e475e5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:02.646235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c8eccbb-eae7-4653-9a63-2ef7d0e475e5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:02.668453 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=7,nova_cell1:INSERT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:03.107822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6fe938a8-1aac-4859-8cce-153704ec4d21 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:03.117368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6fe938a8-1aac-4859-8cce-153704ec4d21 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:03.124573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6fe938a8-1aac-4859-8cce-153704ec4d21 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:03.126142 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6fe938a8-1aac-4859-8cce-153704ec4d21 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1673 microversion: 2.20 time: 0.541978 Oct 04 21:37:03.129051 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2925/5866] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:02 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1673 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:03.276776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7da15826-8f63-49f9-8c3e-331c682576bc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:03.281055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7da15826-8f63-49f9-8c3e-331c682576bc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:03.296928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7da15826-8f63-49f9-8c3e-331c682576bc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:03.298252 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7da15826-8f63-49f9-8c3e-331c682576bc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:03.299876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7da15826-8f63-49f9-8c3e-331c682576bc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:03.304140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7da15826-8f63-49f9-8c3e-331c682576bc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:03.304140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7da15826-8f63-49f9-8c3e-331c682576bc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:03.304140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7da15826-8f63-49f9-8c3e-331c682576bc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:03.333084 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-7da15826-8f63-49f9-8c3e-331c682576bc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] HTTP exception thrown: Instance 27cc7b20-edb9-468f-9262-252c2a3a5509 could not be found. Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7da15826-8f63-49f9-8c3e-331c682576bc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Request method failure captured: Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 HTTP/1.1 Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKYlXHR8I8wRQFODrOVWlUYl-ahlxwIFsYKfV_R4wsakZqpR88jBTNtqNOtBTWqFpnUV0Hun8uqJl71sct-kwDxnitHrojNaCyV5EUsapk-o8TAAL4uaGaysfjjZ9aJOYpwW5gfZixLDk-9rhKNXEbVtOi0ktISjTZ5KpyUZgOnAe30 Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 66351b2e6b2840f183aaf8983e6fc128 Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AttachVolumeTestJSON-1015759103 Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66351b2e6b2840f183aaf8983e6fc128"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66351b2e6b2840f183aaf8983e6fc128"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66351b2e6b2840f183aaf8983e6fc128"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66351b2e6b2840f183aaf8983e6fc128"}]}] Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AttachVolumeTestJSON-1015759103 Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 66351b2e6b2840f183aaf8983e6fc128 Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1015759103 Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AttachVolumeTestJSON-1015759103-project Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 0c9cb06716184ec88816395420d5870e Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AttachVolumeTestJSON-1015759103-project Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 27cc7b20-edb9-468f-9262-252c2a3a5509 could not be found. Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '27cc7b20-edb9-468f-9262-252c2a3a5509'} Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27cc7b20-edb9-468f-9262-252c2a3a5509 could not be found. Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:37:03.345565 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:37:03.349313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27cc7b20-edb9-468f-9262-252c2a3a5509 could not be found. Oct 04 21:37:03.349313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:03.349313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:03.349313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:03.349313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:03.349313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:03.349313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:03.349313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:37:03.349313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:37:03.349313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27cc7b20-edb9-468f-9262-252c2a3a5509 could not be found. Oct 04 21:37:03.349313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:03.354583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7da15826-8f63-49f9-8c3e-331c682576bc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Returning 404 to user: Instance 27cc7b20-edb9-468f-9262-252c2a3a5509 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:37:03.355823 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7da15826-8f63-49f9-8c3e-331c682576bc tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "DELETE /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 404 len: 111 microversion: 2.1 time: 0.085798 Oct 04 21:37:03.361492 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2926/5867] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:37:03 2022] DELETE /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:37:03.379129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0c04a2e7-cf45-4d8f-8e56-ada0e17de3b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:03.380761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0c04a2e7-cf45-4d8f-8e56-ada0e17de3b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: 27cc7b20-edb9-468f-9262-252c2a3a5509] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:03.407546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c04a2e7-cf45-4d8f-8e56-ada0e17de3b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:03.408058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c04a2e7-cf45-4d8f-8e56-ada0e17de3b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:03.408716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c04a2e7-cf45-4d8f-8e56-ada0e17de3b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:03.412253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c04a2e7-cf45-4d8f-8e56-ada0e17de3b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:03.412995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c04a2e7-cf45-4d8f-8e56-ada0e17de3b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:03.413791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c04a2e7-cf45-4d8f-8e56-ada0e17de3b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:03.427786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:03.501380 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-0c04a2e7-cf45-4d8f-8e56-ada0e17de3b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] HTTP exception thrown: Instance 27cc7b20-edb9-468f-9262-252c2a3a5509 could not be found. Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0c04a2e7-cf45-4d8f-8e56-ada0e17de3b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Request method failure captured: Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 HTTP/1.1 Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKYlXHR8I8wRQFODrOVWlUYl-ahlxwIFsYKfV_R4wsakZqpR88jBTNtqNOtBTWqFpnUV0Hun8uqJl71sct-kwDxnitHrojNaCyV5EUsapk-o8TAAL4uaGaysfjjZ9aJOYpwW5gfZixLDk-9rhKNXEbVtOi0ktISjTZ5KpyUZgOnAe30 Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 66351b2e6b2840f183aaf8983e6fc128 Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AttachVolumeTestJSON-1015759103 Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66351b2e6b2840f183aaf8983e6fc128"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66351b2e6b2840f183aaf8983e6fc128"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66351b2e6b2840f183aaf8983e6fc128"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66351b2e6b2840f183aaf8983e6fc128"}]}] Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AttachVolumeTestJSON-1015759103 Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 66351b2e6b2840f183aaf8983e6fc128 Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1015759103 Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AttachVolumeTestJSON-1015759103-project Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 0c9cb06716184ec88816395420d5870e Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AttachVolumeTestJSON-1015759103-project Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 27cc7b20-edb9-468f-9262-252c2a3a5509 could not be found. Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '27cc7b20-edb9-468f-9262-252c2a3a5509'} Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27cc7b20-edb9-468f-9262-252c2a3a5509 could not be found. Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27cc7b20-edb9-468f-9262-252c2a3a5509 could not be found. Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:03.503082 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:03.508198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:03.508198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:03.508198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:03.508198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:37:03.508198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:37:03.508198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27cc7b20-edb9-468f-9262-252c2a3a5509 could not be found. Oct 04 21:37:03.508198 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:03.508198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0c04a2e7-cf45-4d8f-8e56-ada0e17de3b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Returning 404 to user: Instance 27cc7b20-edb9-468f-9262-252c2a3a5509 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:37:03.508198 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0c04a2e7-cf45-4d8f-8e56-ada0e17de3b8 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509" status: 404 len: 111 microversion: 2.1 time: 0.141602 Oct 04 21:37:03.533834 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2927/5868] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:03 2022] GET /compute/v2.1/servers/27cc7b20-edb9-468f-9262-252c2a3a5509 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:37:03.655983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c8eccbb-eae7-4653-9a63-2ef7d0e475e5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:03.657073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c8eccbb-eae7-4653-9a63-2ef7d0e475e5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:03.657707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4c8eccbb-eae7-4653-9a63-2ef7d0e475e5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:03.661798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-4c8eccbb-eae7-4653-9a63-2ef7d0e475e5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lazy-loading 'fault' on Instance uuid 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:37:03.756273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4c8eccbb-eae7-4653-9a63-2ef7d0e475e5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:03.766972 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4c8eccbb-eae7-4653-9a63-2ef7d0e475e5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 200 len: 1328 microversion: 2.1 time: 1.144659 Oct 04 21:37:03.768248 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2942/5869] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:02 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 1328 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:37:04.153061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0e4954c7-d423-4566-9b88-c150015bfb27 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:04.153805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0e4954c7-d423-4566-9b88-c150015bfb27 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:04.171083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e4954c7-d423-4566-9b88-c150015bfb27 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:04.171592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e4954c7-d423-4566-9b88-c150015bfb27 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:04.172059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e4954c7-d423-4566-9b88-c150015bfb27 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:04.172785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e4954c7-d423-4566-9b88-c150015bfb27 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:04.173250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e4954c7-d423-4566-9b88-c150015bfb27 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:04.173723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e4954c7-d423-4566-9b88-c150015bfb27 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:04.176749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:04.437210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0e4954c7-d423-4566-9b88-c150015bfb27 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:04.462655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0e4954c7-d423-4566-9b88-c150015bfb27 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:04.467933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0e4954c7-d423-4566-9b88-c150015bfb27 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:04.470636 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0e4954c7-d423-4566-9b88-c150015bfb27 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1673 microversion: 2.20 time: 0.322584 Oct 04 21:37:04.477232 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2928/5870] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:04 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1673 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:04.796111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-efa9953b-7baf-4cd4-8645-b41207cf0e75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:04.798176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-efa9953b-7baf-4cd4-8645-b41207cf0e75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:04.812034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:04.812034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=10 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:04.833199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efa9953b-7baf-4cd4-8645-b41207cf0e75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:04.834208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efa9953b-7baf-4cd4-8645-b41207cf0e75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:04.834678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efa9953b-7baf-4cd4-8645-b41207cf0e75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:04.835468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efa9953b-7baf-4cd4-8645-b41207cf0e75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:04.835948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efa9953b-7baf-4cd4-8645-b41207cf0e75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:04.836390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efa9953b-7baf-4cd4-8645-b41207cf0e75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:04.878323 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-efa9953b-7baf-4cd4-8645-b41207cf0e75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] HTTP exception thrown: Instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 could not be found. Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-efa9953b-7baf-4cd4-8645-b41207cf0e75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Request method failure captured: Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 HTTP/1.1 Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKbagiGypEfWhrQ_0lE94AP27Qoh0E4iGeIB2v7-1zLRFZVlQCLRG0FD49h9EoPD55kuiioz0fPU1oTFLY5Kkl3L3vqChLMTEe1In4MGHbsFa7Gm-matpM3wFwyWA19l96bcqrryYQdSr6oZRwmQgAqc6hQhUAbifVGqqLh8bVE-KBY Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}] Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 68a2203c15fe41d8ae410f31ba1e1301 Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 could not be found. Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '60148f18-dd52-4a9a-8d23-12cb5ebbd7c4'} Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 could not be found. Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 could not be found. Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:04.879933 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:37:04.885376 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:04.885376 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:04.885376 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:04.885376 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:37:04.885376 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:37:04.885376 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 could not be found. Oct 04 21:37:04.885376 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:37:04.895868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-efa9953b-7baf-4cd4-8645-b41207cf0e75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Returning 404 to user: Instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:37:04.897110 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-efa9953b-7baf-4cd4-8645-b41207cf0e75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 404 len: 111 microversion: 2.1 time: 0.104805 Oct 04 21:37:04.901571 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2943/5871] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:04 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:37:04.907548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-297018e1-ae9e-4276-ae53-802b6361d0a5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '.version_select at 0x7f5790d95a60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:04.987455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:05.128964 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-297018e1-ae9e-4276-ae53-802b6361d0a5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-333072" status: 202 len: 0 microversion: 2.1 time: 0.226016 Oct 04 21:37:05.129878 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2929/5872] 10.222.0.30 () {58 vars in 1209 bytes} [Tue Oct 4 21:37:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-333072 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:37:05.504928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5dc004b4-5937-4947-b7f7-a810f4642015 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:05.506014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5dc004b4-5937-4947-b7f7-a810f4642015 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:05.513760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5dc004b4-5937-4947-b7f7-a810f4642015 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:05.514568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5dc004b4-5937-4947-b7f7-a810f4642015 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:05.515256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5dc004b4-5937-4947-b7f7-a810f4642015 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:05.516146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5dc004b4-5937-4947-b7f7-a810f4642015 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:05.516787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5dc004b4-5937-4947-b7f7-a810f4642015 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:05.517451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5dc004b4-5937-4947-b7f7-a810f4642015 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:06.402172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c1c3696c-6761-4bb5-a8d3-fa126feb61ab tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Action: 'create', calling method: .version_select at 0x7f57907ca3a0>, body: {"keypair": {"name": "tempest-keypair-1967054943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4yJZKECBnTa9D5Ji7VeUxJQJB4GKVoFDr0yMTVBy1hBnL6W++KRG6C4Pw7tkpRql+5btDHBAslRIFOrlaGCBZ6VQCPb2wd4iDrlsPIeWLmKNgWIEgbTSwaTqc6jF9lLw=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:06.480611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-c1c3696c-6761-4bb5-a8d3-fa126feb61ab tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Getting quotas for project f7a12e438f0e4e9a83b0ab95f50c791c. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:37:06.496194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-c1c3696c-6761-4bb5-a8d3-fa126feb61ab tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Getting quotas for user 68a2203c15fe41d8ae410f31ba1e1301 and project f7a12e438f0e4e9a83b0ab95f50c791c. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:37:06.532908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5dc004b4-5937-4947-b7f7-a810f4642015 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:06.548117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5dc004b4-5937-4947-b7f7-a810f4642015 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:06.549917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5dc004b4-5937-4947-b7f7-a810f4642015 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:06.551610 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5dc004b4-5937-4947-b7f7-a810f4642015 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1731 microversion: 2.20 time: 1.051234 Oct 04 21:37:06.552872 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2944/5873] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:05 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1731 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:06.633612 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c1c3696c-6761-4bb5-a8d3-fa126feb61ab tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.240041 Oct 04 21:37:06.634693 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2930/5874] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:37:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:07.588373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-17526408-1f63-4969-bbdc-f8950cba7568 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:07.588739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-17526408-1f63-4969-bbdc-f8950cba7568 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:07.606802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17526408-1f63-4969-bbdc-f8950cba7568 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:07.607318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17526408-1f63-4969-bbdc-f8950cba7568 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:07.610228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17526408-1f63-4969-bbdc-f8950cba7568 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:07.610997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17526408-1f63-4969-bbdc-f8950cba7568 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:07.611434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17526408-1f63-4969-bbdc-f8950cba7568 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:07.613698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17526408-1f63-4969-bbdc-f8950cba7568 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:08.062335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-17526408-1f63-4969-bbdc-f8950cba7568 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:08.082004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-17526408-1f63-4969-bbdc-f8950cba7568 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:08.086805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-17526408-1f63-4969-bbdc-f8950cba7568 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:08.090302 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-17526408-1f63-4969-bbdc-f8950cba7568 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1731 microversion: 2.20 time: 0.509997 Oct 04 21:37:08.106451 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2945/5875] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:07 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1731 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:08.196508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-41244a37-61ad-4341-bbcb-7b00c8ae4635 req-05f4767c-3839-4936-a36b-e6109518295d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa024b1-e789-4226-b10a-07bf3ca97ecc", "tag": "f058e4a1-c25d-417e-8d41-b82e64725e18"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:08.218700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-41244a37-61ad-4341-bbcb-7b00c8ae4635 req-05f4767c-3839-4936-a36b-e6109518295d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:08.219590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-41244a37-61ad-4341-bbcb-7b00c8ae4635 req-05f4767c-3839-4936-a36b-e6109518295d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:08.220490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-41244a37-61ad-4341-bbcb-7b00c8ae4635 req-05f4767c-3839-4936-a36b-e6109518295d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:08.235832 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-41244a37-61ad-4341-bbcb-7b00c8ae4635 req-05f4767c-3839-4936-a36b-e6109518295d service nova] Creating event network-changed:f058e4a1-c25d-417e-8d41-b82e64725e18 for instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc on n-h2-860282-1 Oct 04 21:37:08.244222 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-41244a37-61ad-4341-bbcb-7b00c8ae4635 req-05f4767c-3839-4936-a36b-e6109518295d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062107 Oct 04 21:37:08.244835 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2931/5876] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:09.131457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a110666b-7c7d-44ab-b748-421da9090297 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:09.133210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a110666b-7c7d-44ab-b748-421da9090297 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:09.148148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a110666b-7c7d-44ab-b748-421da9090297 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:09.148148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a110666b-7c7d-44ab-b748-421da9090297 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:09.148148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a110666b-7c7d-44ab-b748-421da9090297 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:09.149745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a110666b-7c7d-44ab-b748-421da9090297 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:09.150789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a110666b-7c7d-44ab-b748-421da9090297 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:09.151733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a110666b-7c7d-44ab-b748-421da9090297 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:09.838394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a110666b-7c7d-44ab-b748-421da9090297 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:09.851232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a110666b-7c7d-44ab-b748-421da9090297 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:09.859539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a110666b-7c7d-44ab-b748-421da9090297 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:09.869405 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a110666b-7c7d-44ab-b748-421da9090297 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1731 microversion: 2.20 time: 0.742678 Oct 04 21:37:09.870733 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2946/5877] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:09 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1731 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:10.905832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6173188a-c540-4401-9857-7859052f58dc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:10.907607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6173188a-c540-4401-9857-7859052f58dc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:10.919564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6173188a-c540-4401-9857-7859052f58dc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:10.924371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6173188a-c540-4401-9857-7859052f58dc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:10.930831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6173188a-c540-4401-9857-7859052f58dc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:10.930831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6173188a-c540-4401-9857-7859052f58dc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:10.930831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6173188a-c540-4401-9857-7859052f58dc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:10.930831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6173188a-c540-4401-9857-7859052f58dc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:11.581029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6173188a-c540-4401-9857-7859052f58dc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:11.596828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6173188a-c540-4401-9857-7859052f58dc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:11.599961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6173188a-c540-4401-9857-7859052f58dc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:11.601615 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6173188a-c540-4401-9857-7859052f58dc tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1731 microversion: 2.20 time: 0.700141 Oct 04 21:37:11.626152 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2932/5878] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:10 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1731 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:12.472364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0970750f-2e65-4144-aaed-77e89e79704d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1669078411", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "105a9abe-09eb-4bdd-87f3-fda198194481"}], "security_groups": [{"name": "tempest-securitygroup--249896617"}], "key_name": "tempest-keypair-1967054943", "user_data": "}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:12.643039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ddeb2533-087f-4e1d-85d3-31c95294f900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:12.649398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ddeb2533-087f-4e1d-85d3-31c95294f900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:12.684064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddeb2533-087f-4e1d-85d3-31c95294f900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:12.704470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddeb2533-087f-4e1d-85d3-31c95294f900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:12.705061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddeb2533-087f-4e1d-85d3-31c95294f900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:12.705968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddeb2533-087f-4e1d-85d3-31c95294f900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:12.706484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddeb2533-087f-4e1d-85d3-31c95294f900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:12.706966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddeb2533-087f-4e1d-85d3-31c95294f900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:12.771692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-0970750f-2e65-4144-aaed-77e89e79704d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] validate_networks() for [('105a9abe-09eb-4bdd-87f3-fda198194481', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:37:13.297403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ddeb2533-087f-4e1d-85d3-31c95294f900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:13.309576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ddeb2533-087f-4e1d-85d3-31c95294f900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:13.311455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ddeb2533-087f-4e1d-85d3-31c95294f900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:13.313164 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ddeb2533-087f-4e1d-85d3-31c95294f900 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1731 microversion: 2.20 time: 0.677814 Oct 04 21:37:13.320092 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2933/5879] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:12 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1731 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:13.324812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-87fe8439-50ff-40a2-b890-ae2abae1d136 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:13.325314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-87fe8439-50ff-40a2-b890-ae2abae1d136 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:13.341842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87fe8439-50ff-40a2-b890-ae2abae1d136 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:13.342775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87fe8439-50ff-40a2-b890-ae2abae1d136 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:13.343513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87fe8439-50ff-40a2-b890-ae2abae1d136 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:13.344455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87fe8439-50ff-40a2-b890-ae2abae1d136 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:13.345341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87fe8439-50ff-40a2-b890-ae2abae1d136 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:13.346090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-87fe8439-50ff-40a2-b890-ae2abae1d136 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:13.365786 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-87fe8439-50ff-40a2-b890-ae2abae1d136 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] HTTP exception thrown: Instance f195f612-8d0d-42b7-bd89-5e30477023b4 could not be found. Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-87fe8439-50ff-40a2-b890-ae2abae1d136 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Request method failure captured: Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 HTTP/1.1 Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKYlXHR8I8wRQFODrOVWlUYl-ahlxwIFsYKfV_R4wsakZqpR88jBTNtqNOtBTWqFpnUV0Hun8uqJl71sct-kwDxnitHrojNaCyV5EUsapk-o8TAAL4uaGaysfjjZ9aJOYpwW5gfZixLDk-9rhKNXEbVtOi0ktISjTZ5KpyUZgOnAe30 Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 66351b2e6b2840f183aaf8983e6fc128 Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AttachVolumeTestJSON-1015759103 Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66351b2e6b2840f183aaf8983e6fc128"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66351b2e6b2840f183aaf8983e6fc128"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66351b2e6b2840f183aaf8983e6fc128"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66351b2e6b2840f183aaf8983e6fc128"}]}] Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AttachVolumeTestJSON-1015759103 Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 66351b2e6b2840f183aaf8983e6fc128 Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1015759103 Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AttachVolumeTestJSON-1015759103-project Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 0c9cb06716184ec88816395420d5870e Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AttachVolumeTestJSON-1015759103-project Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance f195f612-8d0d-42b7-bd89-5e30477023b4 could not be found. Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'f195f612-8d0d-42b7-bd89-5e30477023b4'} Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f195f612-8d0d-42b7-bd89-5e30477023b4 could not be found. Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:37:13.368598 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:37:13.372925 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f195f612-8d0d-42b7-bd89-5e30477023b4 could not be found. Oct 04 21:37:13.372925 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:13.372925 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:13.372925 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:13.372925 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:13.372925 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:13.372925 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:13.372925 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:37:13.372925 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:37:13.372925 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f195f612-8d0d-42b7-bd89-5e30477023b4 could not be found. Oct 04 21:37:13.372925 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:13.376000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-87fe8439-50ff-40a2-b890-ae2abae1d136 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Returning 404 to user: Instance f195f612-8d0d-42b7-bd89-5e30477023b4 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:37:13.377479 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-87fe8439-50ff-40a2-b890-ae2abae1d136 tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 404 len: 111 microversion: 2.1 time: 0.056289 Oct 04 21:37:13.382583 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2934/5880] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:37:13 2022] DELETE /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:37:13.388948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c04f6899-281c-49c6-997e-11519d5b4d5a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:13.390050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c04f6899-281c-49c6-997e-11519d5b4d5a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] [instance: f195f612-8d0d-42b7-bd89-5e30477023b4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:13.414764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c04f6899-281c-49c6-997e-11519d5b4d5a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:13.415912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c04f6899-281c-49c6-997e-11519d5b4d5a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:13.417346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c04f6899-281c-49c6-997e-11519d5b4d5a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:13.420462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c04f6899-281c-49c6-997e-11519d5b4d5a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:13.421853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c04f6899-281c-49c6-997e-11519d5b4d5a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:13.423734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c04f6899-281c-49c6-997e-11519d5b4d5a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:13.492964 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-c04f6899-281c-49c6-997e-11519d5b4d5a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] HTTP exception thrown: Instance f195f612-8d0d-42b7-bd89-5e30477023b4 could not be found. Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c04f6899-281c-49c6-997e-11519d5b4d5a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Request method failure captured: Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 HTTP/1.1 Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKYlXHR8I8wRQFODrOVWlUYl-ahlxwIFsYKfV_R4wsakZqpR88jBTNtqNOtBTWqFpnUV0Hun8uqJl71sct-kwDxnitHrojNaCyV5EUsapk-o8TAAL4uaGaysfjjZ9aJOYpwW5gfZixLDk-9rhKNXEbVtOi0ktISjTZ5KpyUZgOnAe30 Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 66351b2e6b2840f183aaf8983e6fc128 Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AttachVolumeTestJSON-1015759103 Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66351b2e6b2840f183aaf8983e6fc128"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66351b2e6b2840f183aaf8983e6fc128"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66351b2e6b2840f183aaf8983e6fc128"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66351b2e6b2840f183aaf8983e6fc128"}]}] Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AttachVolumeTestJSON-1015759103 Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 66351b2e6b2840f183aaf8983e6fc128 Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1015759103 Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AttachVolumeTestJSON-1015759103-project Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 0c9cb06716184ec88816395420d5870e Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AttachVolumeTestJSON-1015759103-project Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance f195f612-8d0d-42b7-bd89-5e30477023b4 could not be found. Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'f195f612-8d0d-42b7-bd89-5e30477023b4'} Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f195f612-8d0d-42b7-bd89-5e30477023b4 could not be found. Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f195f612-8d0d-42b7-bd89-5e30477023b4 could not be found. Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:13.499906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:13.512379 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:13.512379 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:13.512379 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:13.512379 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:37:13.512379 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:37:13.512379 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f195f612-8d0d-42b7-bd89-5e30477023b4 could not be found. Oct 04 21:37:13.512379 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:37:13.514663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c04f6899-281c-49c6-997e-11519d5b4d5a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] Returning 404 to user: Instance f195f612-8d0d-42b7-bd89-5e30477023b4 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:37:13.518661 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c04f6899-281c-49c6-997e-11519d5b4d5a tempest-AttachVolumeTestJSON-1015759103 tempest-AttachVolumeTestJSON-1015759103-project] 10.222.0.30 "GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4" status: 404 len: 111 microversion: 2.1 time: 0.134505 Oct 04 21:37:13.521957 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2935/5881] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:13 2022] GET /compute/v2.1/servers/f195f612-8d0d-42b7-bd89-5e30477023b4 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:37:14.059059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-0970750f-2e65-4144-aaed-77e89e79704d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:37:14.060437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-0970750f-2e65-4144-aaed-77e89e79704d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:37:14.061160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-0970750f-2e65-4144-aaed-77e89e79704d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:37:14.061817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-0970750f-2e65-4144-aaed-77e89e79704d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:37:14.062652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-0970750f-2e65-4144-aaed-77e89e79704d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:37:14.092251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0970750f-2e65-4144-aaed-77e89e79704d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:14.094926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0970750f-2e65-4144-aaed-77e89e79704d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:14.097451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0970750f-2e65-4144-aaed-77e89e79704d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:14.105712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0970750f-2e65-4144-aaed-77e89e79704d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:14.107653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0970750f-2e65-4144-aaed-77e89e79704d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:14.109529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0970750f-2e65-4144-aaed-77e89e79704d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:14.187922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-0970750f-2e65-4144-aaed-77e89e79704d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Getting quotas for project f7a12e438f0e4e9a83b0ab95f50c791c. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:37:14.221800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-0970750f-2e65-4144-aaed-77e89e79704d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Getting quotas for user 68a2203c15fe41d8ae410f31ba1e1301 and project f7a12e438f0e4e9a83b0ab95f50c791c. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:37:14.289329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:14.291083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0970750f-2e65-4144-aaed-77e89e79704d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:37:14.309649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0970750f-2e65-4144-aaed-77e89e79704d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:37:14.343025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-85d489b0-7e2c-4124-82a1-afd203ca3ba3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:14.345108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-85d489b0-7e2c-4124-82a1-afd203ca3ba3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:14.367432 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85d489b0-7e2c-4124-82a1-afd203ca3ba3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:14.375592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85d489b0-7e2c-4124-82a1-afd203ca3ba3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:14.376979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85d489b0-7e2c-4124-82a1-afd203ca3ba3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:14.379649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85d489b0-7e2c-4124-82a1-afd203ca3ba3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:14.380531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85d489b0-7e2c-4124-82a1-afd203ca3ba3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:14.383320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-85d489b0-7e2c-4124-82a1-afd203ca3ba3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:14.568935 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0970750f-2e65-4144-aaed-77e89e79704d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.100948 Oct 04 21:37:14.574243 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2947/5882] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:37:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 2107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:37:14.589231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-93faab90-adfb-407b-90eb-112dde83b0bb tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:14.590206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-93faab90-adfb-407b-90eb-112dde83b0bb tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:14.801068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-93faab90-adfb-407b-90eb-112dde83b0bb tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:14.812764 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-93faab90-adfb-407b-90eb-112dde83b0bb tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1242 microversion: 2.1 time: 0.228535 Oct 04 21:37:14.822761 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2948/5883] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:14 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1242 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:37:15.261376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-85d489b0-7e2c-4124-82a1-afd203ca3ba3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:15.283640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-85d489b0-7e2c-4124-82a1-afd203ca3ba3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:15.292593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-85d489b0-7e2c-4124-82a1-afd203ca3ba3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:15.299327 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-85d489b0-7e2c-4124-82a1-afd203ca3ba3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1731 microversion: 2.20 time: 0.958245 Oct 04 21:37:15.303299 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2936/5884] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:14 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1731 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:15.852325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-41bfb366-08c4-4f5e-a1d3-c2907b599a5e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:15.852965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-41bfb366-08c4-4f5e-a1d3-c2907b599a5e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:15.986902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-41bfb366-08c4-4f5e-a1d3-c2907b599a5e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:16.000531 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-41bfb366-08c4-4f5e-a1d3-c2907b599a5e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1242 microversion: 2.1 time: 0.154411 Oct 04 21:37:16.001254 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2949/5885] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:15 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1242 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:37:16.331146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0beff638-804d-486a-a39a-8c86bb174fb5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:16.333349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0beff638-804d-486a-a39a-8c86bb174fb5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:16.386112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0beff638-804d-486a-a39a-8c86bb174fb5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:16.417956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0beff638-804d-486a-a39a-8c86bb174fb5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:16.418520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0beff638-804d-486a-a39a-8c86bb174fb5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:16.429448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0beff638-804d-486a-a39a-8c86bb174fb5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:16.429448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0beff638-804d-486a-a39a-8c86bb174fb5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:16.429448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0beff638-804d-486a-a39a-8c86bb174fb5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:16.515568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:17.033876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a3f9bbe4-4e4f-48a5-b69e-5f986434abb9 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:17.035173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a3f9bbe4-4e4f-48a5-b69e-5f986434abb9 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:17.058524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3f9bbe4-4e4f-48a5-b69e-5f986434abb9 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:17.059233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3f9bbe4-4e4f-48a5-b69e-5f986434abb9 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:17.059677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3f9bbe4-4e4f-48a5-b69e-5f986434abb9 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:17.060433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3f9bbe4-4e4f-48a5-b69e-5f986434abb9 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:17.060904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3f9bbe4-4e4f-48a5-b69e-5f986434abb9 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:17.061345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3f9bbe4-4e4f-48a5-b69e-5f986434abb9 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:17.783811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a3f9bbe4-4e4f-48a5-b69e-5f986434abb9 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:17.795545 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a3f9bbe4-4e4f-48a5-b69e-5f986434abb9 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1238 microversion: 2.1 time: 0.766554 Oct 04 21:37:17.796103 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2950/5886] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:17 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1238 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:17.995382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0beff638-804d-486a-a39a-8c86bb174fb5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:18.009854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0beff638-804d-486a-a39a-8c86bb174fb5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:18.027937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0beff638-804d-486a-a39a-8c86bb174fb5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:18.029337 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0beff638-804d-486a-a39a-8c86bb174fb5 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1731 microversion: 2.20 time: 1.703824 Oct 04 21:37:18.049922 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2937/5887] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:16 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1731 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:18.825987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7a3493d4-2edd-43ae-972c-58e4a9de8146 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:18.826668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7a3493d4-2edd-43ae-972c-58e4a9de8146 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:18.851700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7a3493d4-2edd-43ae-972c-58e4a9de8146 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:18.852368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7a3493d4-2edd-43ae-972c-58e4a9de8146 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:18.852835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7a3493d4-2edd-43ae-972c-58e4a9de8146 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:18.853626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7a3493d4-2edd-43ae-972c-58e4a9de8146 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:18.854105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7a3493d4-2edd-43ae-972c-58e4a9de8146 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:18.854543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7a3493d4-2edd-43ae-972c-58e4a9de8146 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:19.064737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6d97201d-946f-4e58-b329-a0d2a04d2d35 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:19.065367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6d97201d-946f-4e58-b329-a0d2a04d2d35 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:19.093182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d97201d-946f-4e58-b329-a0d2a04d2d35 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:19.098172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d97201d-946f-4e58-b329-a0d2a04d2d35 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:19.098712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d97201d-946f-4e58-b329-a0d2a04d2d35 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:19.101444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d97201d-946f-4e58-b329-a0d2a04d2d35 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:19.103433 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d97201d-946f-4e58-b329-a0d2a04d2d35 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:19.105597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d97201d-946f-4e58-b329-a0d2a04d2d35 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:19.150177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7a3493d4-2edd-43ae-972c-58e4a9de8146 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:19.187186 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7a3493d4-2edd-43ae-972c-58e4a9de8146 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1312 microversion: 2.1 time: 0.366040 Oct 04 21:37:19.193005 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2951/5888] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:18 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1312 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:37:19.693538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6d97201d-946f-4e58-b329-a0d2a04d2d35 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:19.704427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6d97201d-946f-4e58-b329-a0d2a04d2d35 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:19.711746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6d97201d-946f-4e58-b329-a0d2a04d2d35 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:19.713125 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6d97201d-946f-4e58-b329-a0d2a04d2d35 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1731 microversion: 2.20 time: 0.652846 Oct 04 21:37:19.738046 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2938/5889] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:19 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1731 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:37:20.225208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f4a64146-409a-4fa0-ba2f-b58d8d20af52 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:20.227641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f4a64146-409a-4fa0-ba2f-b58d8d20af52 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:20.240394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4a64146-409a-4fa0-ba2f-b58d8d20af52 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:20.243290 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4a64146-409a-4fa0-ba2f-b58d8d20af52 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:20.246085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4a64146-409a-4fa0-ba2f-b58d8d20af52 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:20.247302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4a64146-409a-4fa0-ba2f-b58d8d20af52 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:20.248267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4a64146-409a-4fa0-ba2f-b58d8d20af52 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:20.249987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4a64146-409a-4fa0-ba2f-b58d8d20af52 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:20.459134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f4a64146-409a-4fa0-ba2f-b58d8d20af52 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:20.465229 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f4a64146-409a-4fa0-ba2f-b58d8d20af52 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1300 microversion: 2.1 time: 0.245418 Oct 04 21:37:20.469731 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2952/5890] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:20 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1300 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:20.748935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6f3de411-4955-48b7-a731-d10bc7701e12 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:20.749895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6f3de411-4955-48b7-a731-d10bc7701e12 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:20.771310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f3de411-4955-48b7-a731-d10bc7701e12 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:20.775966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f3de411-4955-48b7-a731-d10bc7701e12 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:20.776440 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f3de411-4955-48b7-a731-d10bc7701e12 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:20.782257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f3de411-4955-48b7-a731-d10bc7701e12 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:20.783646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f3de411-4955-48b7-a731-d10bc7701e12 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:20.787726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f3de411-4955-48b7-a731-d10bc7701e12 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:21.304213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6f3de411-4955-48b7-a731-d10bc7701e12 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:21.333234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6f3de411-4955-48b7-a731-d10bc7701e12 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:21.336754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6f3de411-4955-48b7-a731-d10bc7701e12 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:21.338507 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6f3de411-4955-48b7-a731-d10bc7701e12 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1731 microversion: 2.20 time: 0.595641 Oct 04 21:37:21.339706 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2939/5891] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:20 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1731 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:21.501008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a3a390b2-97c9-4d4c-b465-56aeb4cfc63d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:21.501668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a3a390b2-97c9-4d4c-b465-56aeb4cfc63d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:21.514051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3a390b2-97c9-4d4c-b465-56aeb4cfc63d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:21.520405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3a390b2-97c9-4d4c-b465-56aeb4cfc63d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:21.521289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3a390b2-97c9-4d4c-b465-56aeb4cfc63d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:21.525485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3a390b2-97c9-4d4c-b465-56aeb4cfc63d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:21.526041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3a390b2-97c9-4d4c-b465-56aeb4cfc63d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:21.526472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3a390b2-97c9-4d4c-b465-56aeb4cfc63d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:21.731008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a3a390b2-97c9-4d4c-b465-56aeb4cfc63d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:21.740350 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a3a390b2-97c9-4d4c-b465-56aeb4cfc63d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1300 microversion: 2.1 time: 0.243449 Oct 04 21:37:21.744167 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2953/5892] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:21 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1300 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:22.367678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-480797d0-cb65-449a-a0d9-7befd2a59c90 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:22.368298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-480797d0-cb65-449a-a0d9-7befd2a59c90 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:22.386369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-480797d0-cb65-449a-a0d9-7befd2a59c90 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:22.387097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-480797d0-cb65-449a-a0d9-7befd2a59c90 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:22.387770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-480797d0-cb65-449a-a0d9-7befd2a59c90 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:22.388691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-480797d0-cb65-449a-a0d9-7befd2a59c90 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:22.389323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-480797d0-cb65-449a-a0d9-7befd2a59c90 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:22.389945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-480797d0-cb65-449a-a0d9-7befd2a59c90 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:22.769029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d5055d96-00e1-4cc6-8bb0-b248d3d66c75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:22.770545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d5055d96-00e1-4cc6-8bb0-b248d3d66c75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:22.778702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d5055d96-00e1-4cc6-8bb0-b248d3d66c75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:22.781283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d5055d96-00e1-4cc6-8bb0-b248d3d66c75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:22.781283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d5055d96-00e1-4cc6-8bb0-b248d3d66c75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:22.781283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d5055d96-00e1-4cc6-8bb0-b248d3d66c75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:22.781698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d5055d96-00e1-4cc6-8bb0-b248d3d66c75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:22.782301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d5055d96-00e1-4cc6-8bb0-b248d3d66c75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:23.149004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-480797d0-cb65-449a-a0d9-7befd2a59c90 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:23.167733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-480797d0-cb65-449a-a0d9-7befd2a59c90 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:23.169183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-480797d0-cb65-449a-a0d9-7befd2a59c90 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:23.170422 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-480797d0-cb65-449a-a0d9-7befd2a59c90 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1731 microversion: 2.20 time: 0.807250 Oct 04 21:37:23.202673 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2940/5893] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:22 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1731 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:23.269701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d5055d96-00e1-4cc6-8bb0-b248d3d66c75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:23.289307 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d5055d96-00e1-4cc6-8bb0-b248d3d66c75 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1367 microversion: 2.1 time: 0.518312 Oct 04 21:37:23.297847 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2954/5894] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:22 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1367 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:24.204418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-45fd4044-9927-4f86-addb-0903d64b2904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:24.206000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-45fd4044-9927-4f86-addb-0903d64b2904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:24.220688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45fd4044-9927-4f86-addb-0903d64b2904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:24.220688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45fd4044-9927-4f86-addb-0903d64b2904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:24.220688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45fd4044-9927-4f86-addb-0903d64b2904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:24.220688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45fd4044-9927-4f86-addb-0903d64b2904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:24.220688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45fd4044-9927-4f86-addb-0903d64b2904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:24.239417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45fd4044-9927-4f86-addb-0903d64b2904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:24.323286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1f53ef73-be12-4f72-b37f-1120f9720275 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:24.324499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1f53ef73-be12-4f72-b37f-1120f9720275 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:24.332204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:24.334175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f53ef73-be12-4f72-b37f-1120f9720275 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:24.358409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f53ef73-be12-4f72-b37f-1120f9720275 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:24.358409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f53ef73-be12-4f72-b37f-1120f9720275 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:24.358409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f53ef73-be12-4f72-b37f-1120f9720275 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:24.358409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f53ef73-be12-4f72-b37f-1120f9720275 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:24.358409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f53ef73-be12-4f72-b37f-1120f9720275 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:24.649268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-45fd4044-9927-4f86-addb-0903d64b2904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:24.663429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-45fd4044-9927-4f86-addb-0903d64b2904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:24.665546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-45fd4044-9927-4f86-addb-0903d64b2904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:24.667144 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-45fd4044-9927-4f86-addb-0903d64b2904 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1731 microversion: 2.20 time: 0.468436 Oct 04 21:37:24.687256 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2941/5895] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:24 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1731 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:24.706853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1f53ef73-be12-4f72-b37f-1120f9720275 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:24.716418 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1f53ef73-be12-4f72-b37f-1120f9720275 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1367 microversion: 2.1 time: 0.396325 Oct 04 21:37:24.719067 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2955/5896] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:24 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:25.904072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-551a0901-2524-4e75-bf2c-326904c2382e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:25.904072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-551a0901-2524-4e75-bf2c-326904c2382e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:25.904072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-551a0901-2524-4e75-bf2c-326904c2382e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:25.904072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-551a0901-2524-4e75-bf2c-326904c2382e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:25.904072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-551a0901-2524-4e75-bf2c-326904c2382e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:25.904072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-551a0901-2524-4e75-bf2c-326904c2382e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:25.904072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-551a0901-2524-4e75-bf2c-326904c2382e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:25.904072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-551a0901-2524-4e75-bf2c-326904c2382e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:25.916744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f9fb9fbc-af28-44f3-8213-e0f24f9733b7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:25.916744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f9fb9fbc-af28-44f3-8213-e0f24f9733b7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:25.916744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9fb9fbc-af28-44f3-8213-e0f24f9733b7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:25.916744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9fb9fbc-af28-44f3-8213-e0f24f9733b7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:25.916744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9fb9fbc-af28-44f3-8213-e0f24f9733b7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:25.916744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9fb9fbc-af28-44f3-8213-e0f24f9733b7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:25.916744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9fb9fbc-af28-44f3-8213-e0f24f9733b7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:25.916744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9fb9fbc-af28-44f3-8213-e0f24f9733b7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:25.977244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-551a0901-2524-4e75-bf2c-326904c2382e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:25.994584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-551a0901-2524-4e75-bf2c-326904c2382e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:25.995888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=10 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:25.996210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-551a0901-2524-4e75-bf2c-326904c2382e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:25.997521 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-551a0901-2524-4e75-bf2c-326904c2382e tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1731 microversion: 2.20 time: 0.297727 Oct 04 21:37:26.010967 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2942/5897] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:25 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1731 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:26.099060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f9fb9fbc-af28-44f3-8213-e0f24f9733b7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:26.121334 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f9fb9fbc-af28-44f3-8213-e0f24f9733b7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1367 microversion: 2.1 time: 0.377148 Oct 04 21:37:26.122655 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2956/5898] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:25 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1367 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:26.742091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-77e29a3e-d05b-4028-a44b-b5c48e24aa9f req-4bde72ee-3737-4d73-9a8e-bffedf2c588c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836e5756-eb0c-40c6-9581-60a5c270241d", "tag": "6e1667b3-0579-44a9-a051-cb48711b0b8d"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:26.767398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-77e29a3e-d05b-4028-a44b-b5c48e24aa9f req-4bde72ee-3737-4d73-9a8e-bffedf2c588c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:26.767886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-77e29a3e-d05b-4028-a44b-b5c48e24aa9f req-4bde72ee-3737-4d73-9a8e-bffedf2c588c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:26.768314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-77e29a3e-d05b-4028-a44b-b5c48e24aa9f req-4bde72ee-3737-4d73-9a8e-bffedf2c588c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:26.783058 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-77e29a3e-d05b-4028-a44b-b5c48e24aa9f req-4bde72ee-3737-4d73-9a8e-bffedf2c588c service nova] Creating event network-changed:6e1667b3-0579-44a9-a051-cb48711b0b8d for instance 836e5756-eb0c-40c6-9581-60a5c270241d on n-h1-860282-1 Oct 04 21:37:26.789047 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-77e29a3e-d05b-4028-a44b-b5c48e24aa9f req-4bde72ee-3737-4d73-9a8e-bffedf2c588c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053324 Oct 04 21:37:26.790230 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2943/5899] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:27.028437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ceb60ab3-3cda-4d06-8f5b-967f08374594 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:27.029859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ceb60ab3-3cda-4d06-8f5b-967f08374594 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:27.052957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ceb60ab3-3cda-4d06-8f5b-967f08374594 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:27.053615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ceb60ab3-3cda-4d06-8f5b-967f08374594 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:27.054073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ceb60ab3-3cda-4d06-8f5b-967f08374594 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:27.058907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ceb60ab3-3cda-4d06-8f5b-967f08374594 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:27.059470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ceb60ab3-3cda-4d06-8f5b-967f08374594 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:27.065805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ceb60ab3-3cda-4d06-8f5b-967f08374594 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:27.160439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-75448041-5177-4002-bcae-76a28d517b3c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:27.167401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-75448041-5177-4002-bcae-76a28d517b3c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:27.188186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75448041-5177-4002-bcae-76a28d517b3c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:27.192864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75448041-5177-4002-bcae-76a28d517b3c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:27.193405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75448041-5177-4002-bcae-76a28d517b3c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:27.197827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75448041-5177-4002-bcae-76a28d517b3c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:27.198502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75448041-5177-4002-bcae-76a28d517b3c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:27.199030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75448041-5177-4002-bcae-76a28d517b3c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:27.307963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ceb60ab3-3cda-4d06-8f5b-967f08374594 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:27.319574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ceb60ab3-3cda-4d06-8f5b-967f08374594 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:27.329184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ceb60ab3-3cda-4d06-8f5b-967f08374594 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:27.333706 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ceb60ab3-3cda-4d06-8f5b-967f08374594 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1731 microversion: 2.20 time: 0.310565 Oct 04 21:37:27.335122 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2957/5900] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:27 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1731 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:27.457934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-75448041-5177-4002-bcae-76a28d517b3c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:27.474771 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-75448041-5177-4002-bcae-76a28d517b3c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1367 microversion: 2.1 time: 0.318415 Oct 04 21:37:27.476211 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2944/5901] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:27 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:28.384186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-60d0d407-400f-43e8-844a-808b4f8e6f05 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:28.384810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-60d0d407-400f-43e8-844a-808b4f8e6f05 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:28.409228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60d0d407-400f-43e8-844a-808b4f8e6f05 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:28.414147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60d0d407-400f-43e8-844a-808b4f8e6f05 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:28.414920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60d0d407-400f-43e8-844a-808b4f8e6f05 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:28.416718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60d0d407-400f-43e8-844a-808b4f8e6f05 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:28.419445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60d0d407-400f-43e8-844a-808b4f8e6f05 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:28.420729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60d0d407-400f-43e8-844a-808b4f8e6f05 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:28.514814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-07ec7190-d496-4b1c-aa20-0c4b383b89fc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:28.515452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-07ec7190-d496-4b1c-aa20-0c4b383b89fc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:28.537136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07ec7190-d496-4b1c-aa20-0c4b383b89fc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:28.562554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07ec7190-d496-4b1c-aa20-0c4b383b89fc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:28.568442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07ec7190-d496-4b1c-aa20-0c4b383b89fc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:28.572401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07ec7190-d496-4b1c-aa20-0c4b383b89fc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:28.575110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07ec7190-d496-4b1c-aa20-0c4b383b89fc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:28.575726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07ec7190-d496-4b1c-aa20-0c4b383b89fc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:28.848113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-60d0d407-400f-43e8-844a-808b4f8e6f05 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:28.860092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-60d0d407-400f-43e8-844a-808b4f8e6f05 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:28.883334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-60d0d407-400f-43e8-844a-808b4f8e6f05 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:28.887511 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-60d0d407-400f-43e8-844a-808b4f8e6f05 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1731 microversion: 2.20 time: 0.507404 Oct 04 21:37:28.902631 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2958/5902] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:28 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1731 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:28.910893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-07ec7190-d496-4b1c-aa20-0c4b383b89fc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:28.921771 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-07ec7190-d496-4b1c-aa20-0c4b383b89fc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1367 microversion: 2.1 time: 0.419611 Oct 04 21:37:28.922931 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2945/5903] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:28 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1367 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:29.237829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-83db3806-8f60-4ba5-bcee-1e59b0d00e22 tempest-ServerGroup264TestJSON-974407098 tempest-ServerGroup264TestJSON-974407098-project] Action: 'create', calling method: .version_select at 0x7f578b5d9310>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:29.271655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-83db3806-8f60-4ba5-bcee-1e59b0d00e22 tempest-ServerGroup264TestJSON-974407098 tempest-ServerGroup264TestJSON-974407098-project] Getting quotas for project 8eeeb26e39b04c25af4121f20f3b621d. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:37:29.280539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-83db3806-8f60-4ba5-bcee-1e59b0d00e22 tempest-ServerGroup264TestJSON-974407098 tempest-ServerGroup264TestJSON-974407098-project] Getting quotas for user c46d1d0a89e04f95a1588a9c467f545e and project 8eeeb26e39b04c25af4121f20f3b621d. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:37:29.491447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-83db3806-8f60-4ba5-bcee-1e59b0d00e22 tempest-ServerGroup264TestJSON-974407098 tempest-ServerGroup264TestJSON-974407098-project] Getting quotas for project 8eeeb26e39b04c25af4121f20f3b621d. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:37:29.509918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-83db3806-8f60-4ba5-bcee-1e59b0d00e22 tempest-ServerGroup264TestJSON-974407098 tempest-ServerGroup264TestJSON-974407098-project] Getting quotas for user c46d1d0a89e04f95a1588a9c467f545e and project 8eeeb26e39b04c25af4121f20f3b621d. Resources: {'server_groups'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:37:29.560562 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-83db3806-8f60-4ba5-bcee-1e59b0d00e22 tempest-ServerGroup264TestJSON-974407098 tempest-ServerGroup264TestJSON-974407098-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.656686 Oct 04 21:37:29.562260 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2959/5904] 10.222.0.30 () {62 vars in 1214 bytes} [Tue Oct 4 21:37:28 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:37:29.579491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4f87d67d-e62d-432c-8a93-39b02573749a tempest-ServerGroup264TestJSON-974407098 tempest-ServerGroup264TestJSON-974407098-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:29.619911 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4f87d67d-e62d-432c-8a93-39b02573749a tempest-ServerGroup264TestJSON-974407098 tempest-ServerGroup264TestJSON-974407098-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.044121 Oct 04 21:37:29.626580 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2946/5905] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Oct 4 21:37:29 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:37:29.637009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bafd926e-8d11-410b-9e26-e8b16a721a0c tempest-ServerGroup264TestJSON-974407098 tempest-ServerGroup264TestJSON-974407098-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:29.662888 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bafd926e-8d11-410b-9e26-e8b16a721a0c tempest-ServerGroup264TestJSON-974407098 tempest-ServerGroup264TestJSON-974407098-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/c4b2d7ce-4594-42da-b57f-cef3783c004f" status: 200 len: 235 microversion: 2.64 time: 0.033763 Oct 04 21:37:29.676026 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2960/5906] 10.222.0.30 () {60 vars in 1304 bytes} [Tue Oct 4 21:37:29 2022] GET /compute/v2.1/os-server-groups/c4b2d7ce-4594-42da-b57f-cef3783c004f => generated 235 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:37:29.687218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8863d831-602b-4c2e-88e5-bbcaffc6b291 tempest-ServerGroup264TestJSON-974407098 tempest-ServerGroup264TestJSON-974407098-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:29.821130 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8863d831-602b-4c2e-88e5-bbcaffc6b291 tempest-ServerGroup264TestJSON-974407098 tempest-ServerGroup264TestJSON-974407098-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/c4b2d7ce-4594-42da-b57f-cef3783c004f" status: 204 len: 0 microversion: 2.64 time: 0.132657 Oct 04 21:37:29.821130 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2947/5907] 10.222.0.30 () {60 vars in 1307 bytes} [Tue Oct 4 21:37:29 2022] DELETE /compute/v2.1/os-server-groups/c4b2d7ce-4594-42da-b57f-cef3783c004f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:37:29.828344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e2d19b08-82a8-4575-936c-bba03edcd98c tempest-ServerGroup264TestJSON-974407098 tempest-ServerGroup264TestJSON-974407098-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:29.839471 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-e2d19b08-82a8-4575-936c-bba03edcd98c tempest-ServerGroup264TestJSON-974407098 tempest-ServerGroup264TestJSON-974407098-project] HTTP exception thrown: Instance group c4b2d7ce-4594-42da-b57f-cef3783c004f could not be found. Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e2d19b08-82a8-4575-936c-bba03edcd98c tempest-ServerGroup264TestJSON-974407098 tempest-ServerGroup264TestJSON-974407098-project] Request method failure captured: Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/os-server-groups/c4b2d7ce-4594-42da-b57f-cef3783c004f HTTP/1.1 Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKeYkeXt-_KYJC4e6ddDamjx-Y-qnUmgQojn_re84Yr4Mm0dpG_QeJJwU_lArolvF6Zq4wX6iK3eBCYb_We1HCMNWAQEl5XOszwHSZ_OnEAAWs2D7fkn_bIya6AlcCQr2M0yVCq7TPutXG4e6cQOs-F8nZJ_ATvX-x5EVNRTXfi7Yyc Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.64 Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 8eeeb26e39b04c25af4121f20f3b621d Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerGroup264TestJSON-974407098 Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8eeeb26e39b04c25af4121f20f3b621d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8eeeb26e39b04c25af4121f20f3b621d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8eeeb26e39b04c25af4121f20f3b621d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8eeeb26e39b04c25af4121f20f3b621d"}]}] Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerGroup264TestJSON-974407098 Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 8eeeb26e39b04c25af4121f20f3b621d Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerGroup264TestJSON-974407098 Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerGroup264TestJSON-974407098-project Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c46d1d0a89e04f95a1588a9c467f545e Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerGroup264TestJSON-974407098-project Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance group c4b2d7ce-4594-42da-b57f-cef3783c004f could not be found. Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'c4b2d7ce-4594-42da-b57f-cef3783c004f'} Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c4b2d7ce-4594-42da-b57f-cef3783c004f could not be found. Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c4b2d7ce-4594-42da-b57f-cef3783c004f could not be found. Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:37:29.841098 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:29.845221 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:29.845221 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:29.845221 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:37:29.845221 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:37:29.845221 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c4b2d7ce-4594-42da-b57f-cef3783c004f could not be found. Oct 04 21:37:29.845221 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:37:29.847907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e2d19b08-82a8-4575-936c-bba03edcd98c tempest-ServerGroup264TestJSON-974407098 tempest-ServerGroup264TestJSON-974407098-project] Returning 404 to user: Instance group c4b2d7ce-4594-42da-b57f-cef3783c004f could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:37:29.848871 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e2d19b08-82a8-4575-936c-bba03edcd98c tempest-ServerGroup264TestJSON-974407098 tempest-ServerGroup264TestJSON-974407098-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/c4b2d7ce-4594-42da-b57f-cef3783c004f" status: 404 len: 117 microversion: 2.64 time: 0.026033 Oct 04 21:37:29.849619 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2961/5908] 10.222.0.30 () {60 vars in 1307 bytes} [Tue Oct 4 21:37:29 2022] DELETE /compute/v2.1/os-server-groups/c4b2d7ce-4594-42da-b57f-cef3783c004f => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:37:29.920475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-67d26fe1-92ee-4d5c-b3ef-ba50df8219b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:29.921171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-67d26fe1-92ee-4d5c-b3ef-ba50df8219b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:29.928674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d26fe1-92ee-4d5c-b3ef-ba50df8219b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:29.932253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d26fe1-92ee-4d5c-b3ef-ba50df8219b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:29.932727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d26fe1-92ee-4d5c-b3ef-ba50df8219b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:29.933498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d26fe1-92ee-4d5c-b3ef-ba50df8219b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:29.933977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d26fe1-92ee-4d5c-b3ef-ba50df8219b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:29.934418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d26fe1-92ee-4d5c-b3ef-ba50df8219b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:29.946602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7080d34a-f3a3-4f89-abf0-d097c97aca88 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:29.947231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7080d34a-f3a3-4f89-abf0-d097c97aca88 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:29.965256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7080d34a-f3a3-4f89-abf0-d097c97aca88 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:29.970656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7080d34a-f3a3-4f89-abf0-d097c97aca88 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:29.971536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7080d34a-f3a3-4f89-abf0-d097c97aca88 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:29.973750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7080d34a-f3a3-4f89-abf0-d097c97aca88 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:29.975461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7080d34a-f3a3-4f89-abf0-d097c97aca88 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:29.976270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7080d34a-f3a3-4f89-abf0-d097c97aca88 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:30.303754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67d26fe1-92ee-4d5c-b3ef-ba50df8219b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:30.314231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67d26fe1-92ee-4d5c-b3ef-ba50df8219b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:30.322029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7080d34a-f3a3-4f89-abf0-d097c97aca88 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:30.330494 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7080d34a-f3a3-4f89-abf0-d097c97aca88 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1367 microversion: 2.1 time: 0.388519 Oct 04 21:37:30.332493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67d26fe1-92ee-4d5c-b3ef-ba50df8219b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:30.334705 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-67d26fe1-92ee-4d5c-b3ef-ba50df8219b7 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1731 microversion: 2.20 time: 0.418695 Oct 04 21:37:30.349463 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2962/5909] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:29 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:37:30.351516 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2948/5910] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:29 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1731 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:31.365659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-290ea226-2520-4c69-9880-bb6d14ac3e78 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:31.366438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-290ea226-2520-4c69-9880-bb6d14ac3e78 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:31.376845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-290ea226-2520-4c69-9880-bb6d14ac3e78 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:31.377386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-290ea226-2520-4c69-9880-bb6d14ac3e78 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:31.377832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-290ea226-2520-4c69-9880-bb6d14ac3e78 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:31.378558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-290ea226-2520-4c69-9880-bb6d14ac3e78 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:31.379075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-290ea226-2520-4c69-9880-bb6d14ac3e78 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:31.379684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-290ea226-2520-4c69-9880-bb6d14ac3e78 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:31.380315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c11ee05b-6739-41c7-b2f3-638e6dbbe49c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:31.380944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c11ee05b-6739-41c7-b2f3-638e6dbbe49c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:31.402762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c11ee05b-6739-41c7-b2f3-638e6dbbe49c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:31.403409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c11ee05b-6739-41c7-b2f3-638e6dbbe49c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:31.403931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c11ee05b-6739-41c7-b2f3-638e6dbbe49c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:31.404842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c11ee05b-6739-41c7-b2f3-638e6dbbe49c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:31.405569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c11ee05b-6739-41c7-b2f3-638e6dbbe49c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:31.406091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c11ee05b-6739-41c7-b2f3-638e6dbbe49c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:31.967436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-290ea226-2520-4c69-9880-bb6d14ac3e78 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:31.977814 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-290ea226-2520-4c69-9880-bb6d14ac3e78 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1367 microversion: 2.1 time: 0.617998 Oct 04 21:37:31.979615 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2963/5911] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:31 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1367 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:31.996441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c11ee05b-6739-41c7-b2f3-638e6dbbe49c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:32.005462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-847449f1-2a13-4817-a6ab-9f9d924f25d6 req-89250d33-aab7-4ca1-a39b-e1500139503d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa024b1-e789-4226-b10a-07bf3ca97ecc", "name": "network-vif-plugged", "status": "completed", "tag": "f058e4a1-c25d-417e-8d41-b82e64725e18"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:32.018098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c11ee05b-6739-41c7-b2f3-638e6dbbe49c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:32.042736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c11ee05b-6739-41c7-b2f3-638e6dbbe49c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:32.044472 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c11ee05b-6739-41c7-b2f3-638e6dbbe49c tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1731 microversion: 2.20 time: 0.668302 Oct 04 21:37:32.048592 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2949/5912] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:31 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1731 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:32.050916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-847449f1-2a13-4817-a6ab-9f9d924f25d6 req-89250d33-aab7-4ca1-a39b-e1500139503d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:32.051851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-847449f1-2a13-4817-a6ab-9f9d924f25d6 req-89250d33-aab7-4ca1-a39b-e1500139503d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:32.052496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-847449f1-2a13-4817-a6ab-9f9d924f25d6 req-89250d33-aab7-4ca1-a39b-e1500139503d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:32.077457 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-847449f1-2a13-4817-a6ab-9f9d924f25d6 req-89250d33-aab7-4ca1-a39b-e1500139503d service nova] Creating event network-vif-plugged:f058e4a1-c25d-417e-8d41-b82e64725e18 for instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc on n-h2-860282-1 Oct 04 21:37:32.088699 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-847449f1-2a13-4817-a6ab-9f9d924f25d6 req-89250d33-aab7-4ca1-a39b-e1500139503d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107602 Oct 04 21:37:32.089976 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2964/5913] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:33.007805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2128d841-9629-44e0-a4f4-bbf7acc5d7a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:33.007805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2128d841-9629-44e0-a4f4-bbf7acc5d7a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:33.027854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2128d841-9629-44e0-a4f4-bbf7acc5d7a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:33.032656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2128d841-9629-44e0-a4f4-bbf7acc5d7a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:33.033714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2128d841-9629-44e0-a4f4-bbf7acc5d7a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:33.036154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2128d841-9629-44e0-a4f4-bbf7acc5d7a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:33.039526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2128d841-9629-44e0-a4f4-bbf7acc5d7a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:33.040120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2128d841-9629-44e0-a4f4-bbf7acc5d7a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:33.078171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e873a1e0-9615-4aec-aad7-b751874fb527 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:33.078171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e873a1e0-9615-4aec-aad7-b751874fb527 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:33.088228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e873a1e0-9615-4aec-aad7-b751874fb527 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:33.088733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e873a1e0-9615-4aec-aad7-b751874fb527 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:33.089172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e873a1e0-9615-4aec-aad7-b751874fb527 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:33.095242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e873a1e0-9615-4aec-aad7-b751874fb527 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:33.095974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e873a1e0-9615-4aec-aad7-b751874fb527 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:33.098168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e873a1e0-9615-4aec-aad7-b751874fb527 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:33.158122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:33.497638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2128d841-9629-44e0-a4f4-bbf7acc5d7a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:33.506796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e873a1e0-9615-4aec-aad7-b751874fb527 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:33.518740 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2128d841-9629-44e0-a4f4-bbf7acc5d7a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1367 microversion: 2.1 time: 0.508818 Oct 04 21:37:33.518740 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2950/5914] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:33 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1367 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:37:33.519219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e873a1e0-9615-4aec-aad7-b751874fb527 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:33.521163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e873a1e0-9615-4aec-aad7-b751874fb527 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:33.523341 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e873a1e0-9615-4aec-aad7-b751874fb527 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1731 microversion: 2.20 time: 0.452159 Oct 04 21:37:33.525519 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2965/5915] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:33 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1731 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:34.172065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-1117066b-0440-4104-968f-54f19072183a req-598d0cc7-09c9-4577-8889-5bd2b9844bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836e5756-eb0c-40c6-9581-60a5c270241d", "name": "network-vif-plugged", "status": "completed", "tag": "6e1667b3-0579-44a9-a051-cb48711b0b8d"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:34.191818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1117066b-0440-4104-968f-54f19072183a req-598d0cc7-09c9-4577-8889-5bd2b9844bc4 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:34.194703 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1117066b-0440-4104-968f-54f19072183a req-598d0cc7-09c9-4577-8889-5bd2b9844bc4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:34.196838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1117066b-0440-4104-968f-54f19072183a req-598d0cc7-09c9-4577-8889-5bd2b9844bc4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:34.236770 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-1117066b-0440-4104-968f-54f19072183a req-598d0cc7-09c9-4577-8889-5bd2b9844bc4 service nova] Creating event network-vif-plugged:6e1667b3-0579-44a9-a051-cb48711b0b8d for instance 836e5756-eb0c-40c6-9581-60a5c270241d on n-h1-860282-1 Oct 04 21:37:34.254112 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-1117066b-0440-4104-968f-54f19072183a req-598d0cc7-09c9-4577-8889-5bd2b9844bc4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083955 Oct 04 21:37:34.254759 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2951/5916] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:37:34.544892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-99ecdb71-3221-4d66-a1c9-aff2e037582c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:34.546117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-99ecdb71-3221-4d66-a1c9-aff2e037582c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:34.554224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1ed84fde-42ae-45cd-b90a-305aa6547cc3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:34.557702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1ed84fde-42ae-45cd-b90a-305aa6547cc3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:34.574852 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99ecdb71-3221-4d66-a1c9-aff2e037582c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:34.575359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99ecdb71-3221-4d66-a1c9-aff2e037582c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:34.575807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99ecdb71-3221-4d66-a1c9-aff2e037582c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:34.576529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99ecdb71-3221-4d66-a1c9-aff2e037582c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:34.577003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99ecdb71-3221-4d66-a1c9-aff2e037582c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:34.577437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99ecdb71-3221-4d66-a1c9-aff2e037582c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:34.582371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ed84fde-42ae-45cd-b90a-305aa6547cc3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:34.582875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ed84fde-42ae-45cd-b90a-305aa6547cc3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:34.583316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ed84fde-42ae-45cd-b90a-305aa6547cc3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:34.590396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ed84fde-42ae-45cd-b90a-305aa6547cc3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:34.591025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ed84fde-42ae-45cd-b90a-305aa6547cc3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:34.591485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ed84fde-42ae-45cd-b90a-305aa6547cc3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:34.597579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:34.855749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1ed84fde-42ae-45cd-b90a-305aa6547cc3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:34.860066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-99ecdb71-3221-4d66-a1c9-aff2e037582c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:34.867290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1ed84fde-42ae-45cd-b90a-305aa6547cc3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:34.868857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1ed84fde-42ae-45cd-b90a-305aa6547cc3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:34.871415 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1ed84fde-42ae-45cd-b90a-305aa6547cc3 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1731 microversion: 2.20 time: 0.323201 Oct 04 21:37:34.872197 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2952/5917] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:34 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1731 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:37:34.879788 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-99ecdb71-3221-4d66-a1c9-aff2e037582c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1367 microversion: 2.1 time: 0.344817 Oct 04 21:37:34.880963 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2966/5918] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:34 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1367 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:35.905123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3a9011b5-89ae-4911-a784-68d1eadc3083 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:35.905998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3a9011b5-89ae-4911-a784-68d1eadc3083 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:35.907536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4823168d-50f9-4576-89ca-70d8cc5136ed tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:35.908566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4823168d-50f9-4576-89ca-70d8cc5136ed tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:35.938741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a9011b5-89ae-4911-a784-68d1eadc3083 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:35.941141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a9011b5-89ae-4911-a784-68d1eadc3083 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:35.942532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a9011b5-89ae-4911-a784-68d1eadc3083 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:35.947254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4823168d-50f9-4576-89ca-70d8cc5136ed tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:35.950389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a9011b5-89ae-4911-a784-68d1eadc3083 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:35.950877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a9011b5-89ae-4911-a784-68d1eadc3083 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:35.951208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4823168d-50f9-4576-89ca-70d8cc5136ed tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:35.951324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3a9011b5-89ae-4911-a784-68d1eadc3083 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:35.952697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4823168d-50f9-4576-89ca-70d8cc5136ed tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:35.957845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4823168d-50f9-4576-89ca-70d8cc5136ed tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:35.962389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4823168d-50f9-4576-89ca-70d8cc5136ed tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:35.968332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4823168d-50f9-4576-89ca-70d8cc5136ed tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:37.030950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4823168d-50f9-4576-89ca-70d8cc5136ed tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:37.042396 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4823168d-50f9-4576-89ca-70d8cc5136ed tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1557 microversion: 2.1 time: 1.140566 Oct 04 21:37:37.044410 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2967/5919] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:35 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1557 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:37.066427 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-746cdb95-327c-4677-a0ed-aed751f1cfbc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:37.067323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-746cdb95-327c-4677-a0ed-aed751f1cfbc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:37.074672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-746cdb95-327c-4677-a0ed-aed751f1cfbc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:37.075516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-746cdb95-327c-4677-a0ed-aed751f1cfbc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:37.076214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-746cdb95-327c-4677-a0ed-aed751f1cfbc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:37.077183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-746cdb95-327c-4677-a0ed-aed751f1cfbc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:37.077929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-746cdb95-327c-4677-a0ed-aed751f1cfbc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:37.078987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-746cdb95-327c-4677-a0ed-aed751f1cfbc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:37.102036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3a9011b5-89ae-4911-a784-68d1eadc3083 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:37.162884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3a9011b5-89ae-4911-a784-68d1eadc3083 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:37.170666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3a9011b5-89ae-4911-a784-68d1eadc3083 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:37.180766 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3a9011b5-89ae-4911-a784-68d1eadc3083 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1731 microversion: 2.20 time: 1.285019 Oct 04 21:37:37.203643 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2953/5920] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:35 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1731 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:37.244999 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-746cdb95-327c-4677-a0ed-aed751f1cfbc tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.181832 Oct 04 21:37:37.245660 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2968/5921] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:37:37 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:37:38.218229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1ef9784c-8280-46b6-b963-5de93e0c09d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:38.232607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1ef9784c-8280-46b6-b963-5de93e0c09d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:38.242843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:38.247705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ef9784c-8280-46b6-b963-5de93e0c09d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:38.250935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ef9784c-8280-46b6-b963-5de93e0c09d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:38.252167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ef9784c-8280-46b6-b963-5de93e0c09d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:38.252932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ef9784c-8280-46b6-b963-5de93e0c09d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:38.253414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ef9784c-8280-46b6-b963-5de93e0c09d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:38.254272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ef9784c-8280-46b6-b963-5de93e0c09d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:38.619563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1ef9784c-8280-46b6-b963-5de93e0c09d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:38.641315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1ef9784c-8280-46b6-b963-5de93e0c09d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:38.650602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1ef9784c-8280-46b6-b963-5de93e0c09d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:38.653842 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1ef9784c-8280-46b6-b963-5de93e0c09d1 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1718 microversion: 2.20 time: 0.439288 Oct 04 21:37:38.655105 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2954/5922] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:37:38 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1718 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:37:39.032913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-2820a356-0388-4753-9537-5cdec501270c req-86ac3257-7a15-49fa-8d42-c54c29cdc993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836e5756-eb0c-40c6-9581-60a5c270241d", "tag": "6e1667b3-0579-44a9-a051-cb48711b0b8d"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:39.048419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2820a356-0388-4753-9537-5cdec501270c req-86ac3257-7a15-49fa-8d42-c54c29cdc993 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:39.048585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2820a356-0388-4753-9537-5cdec501270c req-86ac3257-7a15-49fa-8d42-c54c29cdc993 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:39.049018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2820a356-0388-4753-9537-5cdec501270c req-86ac3257-7a15-49fa-8d42-c54c29cdc993 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:39.062075 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-2820a356-0388-4753-9537-5cdec501270c req-86ac3257-7a15-49fa-8d42-c54c29cdc993 service nova] Creating event network-changed:6e1667b3-0579-44a9-a051-cb48711b0b8d for instance 836e5756-eb0c-40c6-9581-60a5c270241d on n-h1-860282-1 Oct 04 21:37:39.071446 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-2820a356-0388-4753-9537-5cdec501270c req-86ac3257-7a15-49fa-8d42-c54c29cdc993 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044052 Oct 04 21:37:39.073245 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2969/5923] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:50.069179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=17 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:50.510155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9ec6b524-4a44-4018-87fd-a01eda452376 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-69108557", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "4a7a3a45-3cee-4c6c-8a1c-927a93759f0b"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:50.658985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-9ec6b524-4a44-4018-87fd-a01eda452376 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] validate_networks() for [('4a7a3a45-3cee-4c6c-8a1c-927a93759f0b', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:37:51.524594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-9ec6b524-4a44-4018-87fd-a01eda452376 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:37:51.525320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-9ec6b524-4a44-4018-87fd-a01eda452376 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:37:51.526011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-9ec6b524-4a44-4018-87fd-a01eda452376 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:37:51.526811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-9ec6b524-4a44-4018-87fd-a01eda452376 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:37:51.527378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-9ec6b524-4a44-4018-87fd-a01eda452376 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:37:51.553240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ec6b524-4a44-4018-87fd-a01eda452376 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:51.556013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ec6b524-4a44-4018-87fd-a01eda452376 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:51.557594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ec6b524-4a44-4018-87fd-a01eda452376 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:51.570518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ec6b524-4a44-4018-87fd-a01eda452376 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:51.570518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ec6b524-4a44-4018-87fd-a01eda452376 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:51.570518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ec6b524-4a44-4018-87fd-a01eda452376 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:51.603820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-9ec6b524-4a44-4018-87fd-a01eda452376 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Getting quotas for project 322dd60f56de4ecaabbb7fb245c46389. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:37:51.612953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-9ec6b524-4a44-4018-87fd-a01eda452376 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Getting quotas for user 30d3fb0a23fc4e89a1b747d2590451ad and project 322dd60f56de4ecaabbb7fb245c46389. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:37:51.630184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9ec6b524-4a44-4018-87fd-a01eda452376 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:37:51.634663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9ec6b524-4a44-4018-87fd-a01eda452376 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:37:52.126621 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9ec6b524-4a44-4018-87fd-a01eda452376 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.063489 Oct 04 21:37:52.127993 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2955/5924] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:37:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:37:52.153782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:52.159671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=5 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:52.166819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=20 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:52.190585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-92ea784f-2cc6-4a59-b81a-d1d3eeca6303 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:52.191706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-92ea784f-2cc6-4a59-b81a-d1d3eeca6303 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:52.358027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-92ea784f-2cc6-4a59-b81a-d1d3eeca6303 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d3fb0a23fc4e89a1b747d2590451ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322dd60f56de4ecaabbb7fb245c46389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:52.371795 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-92ea784f-2cc6-4a59-b81a-d1d3eeca6303 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 200 len: 1214 microversion: 2.1 time: 0.234086 Oct 04 21:37:52.376168 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2970/5925] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:52 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 1214 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:52.430339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-517a64a2-de65-4272-a1a4-48050bc98503 tempest-PortsAdminExtendedAttrsTestJSON-748277503 tempest-PortsAdminExtendedAttrsTestJSON-748277503-project-admin] Calling method '.version_select at 0x7f57906dc0d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:52.432130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-517a64a2-de65-4272-a1a4-48050bc98503 tempest-PortsAdminExtendedAttrsTestJSON-748277503 tempest-PortsAdminExtendedAttrsTestJSON-748277503-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:52.432803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-517a64a2-de65-4272-a1a4-48050bc98503 tempest-PortsAdminExtendedAttrsTestJSON-748277503 tempest-PortsAdminExtendedAttrsTestJSON-748277503-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:52.433613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-517a64a2-de65-4272-a1a4-48050bc98503 tempest-PortsAdminExtendedAttrsTestJSON-748277503 tempest-PortsAdminExtendedAttrsTestJSON-748277503-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:52.472730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-517a64a2-de65-4272-a1a4-48050bc98503 tempest-PortsAdminExtendedAttrsTestJSON-748277503 tempest-PortsAdminExtendedAttrsTestJSON-748277503-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:52.472730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-517a64a2-de65-4272-a1a4-48050bc98503 tempest-PortsAdminExtendedAttrsTestJSON-748277503 tempest-PortsAdminExtendedAttrsTestJSON-748277503-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:52.472730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-517a64a2-de65-4272-a1a4-48050bc98503 tempest-PortsAdminExtendedAttrsTestJSON-748277503 tempest-PortsAdminExtendedAttrsTestJSON-748277503-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:52.482782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-517a64a2-de65-4272-a1a4-48050bc98503 tempest-PortsAdminExtendedAttrsTestJSON-748277503 tempest-PortsAdminExtendedAttrsTestJSON-748277503-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:52.483501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-517a64a2-de65-4272-a1a4-48050bc98503 tempest-PortsAdminExtendedAttrsTestJSON-748277503 tempest-PortsAdminExtendedAttrsTestJSON-748277503-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:52.484112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-517a64a2-de65-4272-a1a4-48050bc98503 tempest-PortsAdminExtendedAttrsTestJSON-748277503 tempest-PortsAdminExtendedAttrsTestJSON-748277503-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:52.493649 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-517a64a2-de65-4272-a1a4-48050bc98503 tempest-PortsAdminExtendedAttrsTestJSON-748277503 tempest-PortsAdminExtendedAttrsTestJSON-748277503-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.336634 Oct 04 21:37:52.497639 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2956/5926] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 21:37:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:53.400314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6e914a0d-e21c-4ca3-8b73-fe9285d53462 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:53.400982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6e914a0d-e21c-4ca3-8b73-fe9285d53462 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:53.560346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6e914a0d-e21c-4ca3-8b73-fe9285d53462 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d3fb0a23fc4e89a1b747d2590451ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322dd60f56de4ecaabbb7fb245c46389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:53.594674 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6e914a0d-e21c-4ca3-8b73-fe9285d53462 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 200 len: 1214 microversion: 2.1 time: 0.195425 Oct 04 21:37:53.594674 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2971/5927] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:53 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 1214 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:54.621144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9e0374e8-4ea6-4356-ada0-27d2f4b4931c tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:54.622261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9e0374e8-4ea6-4356-ada0-27d2f4b4931c tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:54.629851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e0374e8-4ea6-4356-ada0-27d2f4b4931c tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:54.632886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e0374e8-4ea6-4356-ada0-27d2f4b4931c tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:54.632886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e0374e8-4ea6-4356-ada0-27d2f4b4931c tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:54.632886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e0374e8-4ea6-4356-ada0-27d2f4b4931c tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:54.633717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e0374e8-4ea6-4356-ada0-27d2f4b4931c tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:54.634394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e0374e8-4ea6-4356-ada0-27d2f4b4931c tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:54.750043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9e0374e8-4ea6-4356-ada0-27d2f4b4931c tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d3fb0a23fc4e89a1b747d2590451ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322dd60f56de4ecaabbb7fb245c46389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:54.780068 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9e0374e8-4ea6-4356-ada0-27d2f4b4931c tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 200 len: 1210 microversion: 2.1 time: 0.161955 Oct 04 21:37:54.781922 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2957/5928] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:54 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 1210 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:55.804634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a05d7ab0-2638-4032-884d-2b6f79a3e23e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:55.805907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a05d7ab0-2638-4032-884d-2b6f79a3e23e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:55.821837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a05d7ab0-2638-4032-884d-2b6f79a3e23e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:55.832254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a05d7ab0-2638-4032-884d-2b6f79a3e23e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:55.832968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a05d7ab0-2638-4032-884d-2b6f79a3e23e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:55.834854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a05d7ab0-2638-4032-884d-2b6f79a3e23e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:55.842217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a05d7ab0-2638-4032-884d-2b6f79a3e23e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:55.842683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a05d7ab0-2638-4032-884d-2b6f79a3e23e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:55.988823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a05d7ab0-2638-4032-884d-2b6f79a3e23e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d3fb0a23fc4e89a1b747d2590451ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322dd60f56de4ecaabbb7fb245c46389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:56.000607 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a05d7ab0-2638-4032-884d-2b6f79a3e23e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 200 len: 1274 microversion: 2.1 time: 0.200198 Oct 04 21:37:56.002428 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2972/5929] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:55 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 1274 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:57.030429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-96565a60-11cc-4b96-b297-f632f229f9cc tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:57.031187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-96565a60-11cc-4b96-b297-f632f229f9cc tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:57.049295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96565a60-11cc-4b96-b297-f632f229f9cc tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:57.049996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96565a60-11cc-4b96-b297-f632f229f9cc tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:57.050669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96565a60-11cc-4b96-b297-f632f229f9cc tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:57.051617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96565a60-11cc-4b96-b297-f632f229f9cc tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:57.052286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96565a60-11cc-4b96-b297-f632f229f9cc tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:57.053079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96565a60-11cc-4b96-b297-f632f229f9cc tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:57.966772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-96565a60-11cc-4b96-b297-f632f229f9cc tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d3fb0a23fc4e89a1b747d2590451ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322dd60f56de4ecaabbb7fb245c46389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:57.980184 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-96565a60-11cc-4b96-b297-f632f229f9cc tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 200 len: 1314 microversion: 2.1 time: 0.954740 Oct 04 21:37:57.980784 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2958/5930] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:57 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 1314 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:59.012334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9097dc9c-7982-430c-a995-c4d1ef8b22e7 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:59.018914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9097dc9c-7982-430c-a995-c4d1ef8b22e7 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:59.031349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9097dc9c-7982-430c-a995-c4d1ef8b22e7 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:59.032764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9097dc9c-7982-430c-a995-c4d1ef8b22e7 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:59.034320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9097dc9c-7982-430c-a995-c4d1ef8b22e7 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:59.035746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9097dc9c-7982-430c-a995-c4d1ef8b22e7 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:59.036966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9097dc9c-7982-430c-a995-c4d1ef8b22e7 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:59.038759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9097dc9c-7982-430c-a995-c4d1ef8b22e7 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:59.517808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9097dc9c-7982-430c-a995-c4d1ef8b22e7 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d3fb0a23fc4e89a1b747d2590451ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322dd60f56de4ecaabbb7fb245c46389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:59.535991 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9097dc9c-7982-430c-a995-c4d1ef8b22e7 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 200 len: 1314 microversion: 2.1 time: 0.528795 Oct 04 21:37:59.538167 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2973/5931] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:59 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:59.874716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-91d75012-b737-4e57-b509-8a0bae19a720 req-0f0913f2-a2f1-4acd-a129-ef43029d71e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60024e84-e8c6-4ca6-b8d9-3bc140aafccb", "tag": "307eaebc-d78d-4b04-bcbd-c7df91b551e1"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:59.892960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-91d75012-b737-4e57-b509-8a0bae19a720 req-0f0913f2-a2f1-4acd-a129-ef43029d71e9 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:59.894141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-91d75012-b737-4e57-b509-8a0bae19a720 req-0f0913f2-a2f1-4acd-a129-ef43029d71e9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:59.896538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-91d75012-b737-4e57-b509-8a0bae19a720 req-0f0913f2-a2f1-4acd-a129-ef43029d71e9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:59.918193 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-91d75012-b737-4e57-b509-8a0bae19a720 req-0f0913f2-a2f1-4acd-a129-ef43029d71e9 service nova] Creating event network-changed:307eaebc-d78d-4b04-bcbd-c7df91b551e1 for instance 60024e84-e8c6-4ca6-b8d9-3bc140aafccb on n-h2-860282-1 Oct 04 21:37:59.939115 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-91d75012-b737-4e57-b509-8a0bae19a720 req-0f0913f2-a2f1-4acd-a129-ef43029d71e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068590 Oct 04 21:37:59.940475 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2959/5932] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:00.562079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3df4536e-90a5-4c4e-b922-373964ce18aa tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:00.562721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3df4536e-90a5-4c4e-b922-373964ce18aa tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:00.578748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3df4536e-90a5-4c4e-b922-373964ce18aa tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:00.579541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3df4536e-90a5-4c4e-b922-373964ce18aa tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:00.580191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3df4536e-90a5-4c4e-b922-373964ce18aa tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:00.581092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3df4536e-90a5-4c4e-b922-373964ce18aa tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:00.581609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3df4536e-90a5-4c4e-b922-373964ce18aa tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:00.582059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3df4536e-90a5-4c4e-b922-373964ce18aa tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:01.056401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3df4536e-90a5-4c4e-b922-373964ce18aa tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d3fb0a23fc4e89a1b747d2590451ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322dd60f56de4ecaabbb7fb245c46389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:01.085226 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3df4536e-90a5-4c4e-b922-373964ce18aa tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 200 len: 1314 microversion: 2.1 time: 0.521921 Oct 04 21:38:01.085226 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2974/5933] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:00 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:02.109036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6ecd0071-8299-4ec8-9796-757abddfe6a6 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:02.110006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6ecd0071-8299-4ec8-9796-757abddfe6a6 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:02.113089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:02.113981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:02.121131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ecd0071-8299-4ec8-9796-757abddfe6a6 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:02.121776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ecd0071-8299-4ec8-9796-757abddfe6a6 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:02.122222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ecd0071-8299-4ec8-9796-757abddfe6a6 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:02.123160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ecd0071-8299-4ec8-9796-757abddfe6a6 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:02.123680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ecd0071-8299-4ec8-9796-757abddfe6a6 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:02.124308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ecd0071-8299-4ec8-9796-757abddfe6a6 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:02.807199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6ecd0071-8299-4ec8-9796-757abddfe6a6 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d3fb0a23fc4e89a1b747d2590451ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322dd60f56de4ecaabbb7fb245c46389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:02.815823 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6ecd0071-8299-4ec8-9796-757abddfe6a6 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 200 len: 1314 microversion: 2.1 time: 0.711330 Oct 04 21:38:02.816420 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2960/5934] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:02 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 1314 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:03.840370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-379ebb10-c1dc-4bf6-9199-95cb0ba1a528 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:03.840998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-379ebb10-c1dc-4bf6-9199-95cb0ba1a528 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:03.847927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:03.850332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-379ebb10-c1dc-4bf6-9199-95cb0ba1a528 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:03.854005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-379ebb10-c1dc-4bf6-9199-95cb0ba1a528 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:03.854550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-379ebb10-c1dc-4bf6-9199-95cb0ba1a528 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:03.855740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-379ebb10-c1dc-4bf6-9199-95cb0ba1a528 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:03.856692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-379ebb10-c1dc-4bf6-9199-95cb0ba1a528 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:03.861400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-379ebb10-c1dc-4bf6-9199-95cb0ba1a528 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:04.265169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-379ebb10-c1dc-4bf6-9199-95cb0ba1a528 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d3fb0a23fc4e89a1b747d2590451ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322dd60f56de4ecaabbb7fb245c46389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:04.276754 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-379ebb10-c1dc-4bf6-9199-95cb0ba1a528 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 200 len: 1314 microversion: 2.1 time: 0.439834 Oct 04 21:38:04.288655 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2975/5935] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:03 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:05.303986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-af764c5f-a37e-496a-a907-4759f52816c8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:05.304594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-af764c5f-a37e-496a-a907-4759f52816c8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:05.326926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af764c5f-a37e-496a-a907-4759f52816c8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:05.327929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af764c5f-a37e-496a-a907-4759f52816c8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:05.328456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af764c5f-a37e-496a-a907-4759f52816c8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:05.329508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af764c5f-a37e-496a-a907-4759f52816c8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:05.330061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af764c5f-a37e-496a-a907-4759f52816c8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:05.330571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af764c5f-a37e-496a-a907-4759f52816c8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:05.565024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-af764c5f-a37e-496a-a907-4759f52816c8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d3fb0a23fc4e89a1b747d2590451ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322dd60f56de4ecaabbb7fb245c46389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:05.575287 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-af764c5f-a37e-496a-a907-4759f52816c8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 200 len: 1314 microversion: 2.1 time: 0.276817 Oct 04 21:38:05.577485 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2961/5936] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:05 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:05.761317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c14053f8-aa3b-40c0-ad53-4f87713a6ab0 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:05.763206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c14053f8-aa3b-40c0-ad53-4f87713a6ab0 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:05.763885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c14053f8-aa3b-40c0-ad53-4f87713a6ab0 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:05.764603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c14053f8-aa3b-40c0-ad53-4f87713a6ab0 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:05.765649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c14053f8-aa3b-40c0-ad53-4f87713a6ab0 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:05.766333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c14053f8-aa3b-40c0-ad53-4f87713a6ab0 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:05.766994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c14053f8-aa3b-40c0-ad53-4f87713a6ab0 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:05.796777 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c14053f8-aa3b-40c0-ad53-4f87713a6ab0 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.201768 Oct 04 21:38:05.805775 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2976/5937] 10.222.0.30 () {58 vars in 1185 bytes} [Tue Oct 4 21:38:05 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:05.911243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cf8b7d6a-e6ad-4ac1-8e22-0db3e526bccc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1853231797", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "availability_zone": "nova:n-h2-860282-1", "networks": [{"uuid": "391ad45e-8ae8-4b96-95da-edc17d6bcfde"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:05.997084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-cf8b7d6a-e6ad-4ac1-8e22-0db3e526bccc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] validate_networks() for [('391ad45e-8ae8-4b96-95da-edc17d6bcfde', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:38:06.542021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-cf8b7d6a-e6ad-4ac1-8e22-0db3e526bccc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:38:06.542603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-cf8b7d6a-e6ad-4ac1-8e22-0db3e526bccc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:38:06.543262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-cf8b7d6a-e6ad-4ac1-8e22-0db3e526bccc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:38:06.543779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-cf8b7d6a-e6ad-4ac1-8e22-0db3e526bccc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:38:06.544295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-cf8b7d6a-e6ad-4ac1-8e22-0db3e526bccc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:38:06.565959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf8b7d6a-e6ad-4ac1-8e22-0db3e526bccc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:06.566515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf8b7d6a-e6ad-4ac1-8e22-0db3e526bccc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:06.566968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf8b7d6a-e6ad-4ac1-8e22-0db3e526bccc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:06.568253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf8b7d6a-e6ad-4ac1-8e22-0db3e526bccc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:06.569062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf8b7d6a-e6ad-4ac1-8e22-0db3e526bccc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:06.569570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf8b7d6a-e6ad-4ac1-8e22-0db3e526bccc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:06.589949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-cf8b7d6a-e6ad-4ac1-8e22-0db3e526bccc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Getting quotas for project 4f4953f2d41748c1b0dd0e12adaf29f0. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:38:06.602368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-796bda7b-1c4a-47a9-9213-091cb1d66066 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:06.603004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-796bda7b-1c4a-47a9-9213-091cb1d66066 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:06.610938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-cf8b7d6a-e6ad-4ac1-8e22-0db3e526bccc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Getting quotas for user c78027172b1c42458dc720d404a26d1e and project 4f4953f2d41748c1b0dd0e12adaf29f0. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:38:06.614017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-796bda7b-1c4a-47a9-9213-091cb1d66066 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:06.614593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-796bda7b-1c4a-47a9-9213-091cb1d66066 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:06.615062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-796bda7b-1c4a-47a9-9213-091cb1d66066 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:06.622160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-796bda7b-1c4a-47a9-9213-091cb1d66066 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:06.622160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-796bda7b-1c4a-47a9-9213-091cb1d66066 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:06.622160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-796bda7b-1c4a-47a9-9213-091cb1d66066 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:06.643065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cf8b7d6a-e6ad-4ac1-8e22-0db3e526bccc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:38:06.649382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cf8b7d6a-e6ad-4ac1-8e22-0db3e526bccc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:38:06.824885 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cf8b7d6a-e6ad-4ac1-8e22-0db3e526bccc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.917389 Oct 04 21:38:06.826083 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2962/5938] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:38:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:38:06.837208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d309bb91-aa93-4247-83aa-22305ee4d93f tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:06.838147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d309bb91-aa93-4247-83aa-22305ee4d93f tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:06.939598 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d309bb91-aa93-4247-83aa-22305ee4d93f tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1329 microversion: 2.1 time: 0.106895 Oct 04 21:38:06.943908 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2963/5939] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:06 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1329 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:06.991624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-796bda7b-1c4a-47a9-9213-091cb1d66066 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d3fb0a23fc4e89a1b747d2590451ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322dd60f56de4ecaabbb7fb245c46389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:06.999739 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-796bda7b-1c4a-47a9-9213-091cb1d66066 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 200 len: 1314 microversion: 2.1 time: 0.402077 Oct 04 21:38:07.003352 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2977/5940] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:06 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:07.822378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-8e0acaa7-683a-42df-ba13-c5f6e461d569 req-d86fbe38-61a9-4198-87c4-e81025b0b794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60024e84-e8c6-4ca6-b8d9-3bc140aafccb", "name": "network-vif-plugged", "status": "completed", "tag": "307eaebc-d78d-4b04-bcbd-c7df91b551e1"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:07.836734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8e0acaa7-683a-42df-ba13-c5f6e461d569 req-d86fbe38-61a9-4198-87c4-e81025b0b794 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:07.837314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8e0acaa7-683a-42df-ba13-c5f6e461d569 req-d86fbe38-61a9-4198-87c4-e81025b0b794 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:07.837845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-8e0acaa7-683a-42df-ba13-c5f6e461d569 req-d86fbe38-61a9-4198-87c4-e81025b0b794 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:07.854576 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-8e0acaa7-683a-42df-ba13-c5f6e461d569 req-d86fbe38-61a9-4198-87c4-e81025b0b794 service nova] Creating event network-vif-plugged:307eaebc-d78d-4b04-bcbd-c7df91b551e1 for instance 60024e84-e8c6-4ca6-b8d9-3bc140aafccb on n-h2-860282-1 Oct 04 21:38:07.861203 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-8e0acaa7-683a-42df-ba13-c5f6e461d569 req-d86fbe38-61a9-4198-87c4-e81025b0b794 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044555 Oct 04 21:38:07.870205 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2964/5941] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:07.968012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d94b8d8b-4c78-44ba-9f8b-3d9bd248adbe tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:07.968643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d94b8d8b-4c78-44ba-9f8b-3d9bd248adbe tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:08.028918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f609920d-00b8-40fb-9d55-d39c4499318f tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:08.033441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f609920d-00b8-40fb-9d55-d39c4499318f tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:08.047022 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d94b8d8b-4c78-44ba-9f8b-3d9bd248adbe tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1329 microversion: 2.1 time: 0.082392 Oct 04 21:38:08.047629 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2978/5942] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:07 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1329 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:08.068039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f609920d-00b8-40fb-9d55-d39c4499318f tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:08.068039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f609920d-00b8-40fb-9d55-d39c4499318f tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:08.068039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f609920d-00b8-40fb-9d55-d39c4499318f tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:08.068039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f609920d-00b8-40fb-9d55-d39c4499318f tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:08.068039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f609920d-00b8-40fb-9d55-d39c4499318f tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:08.068039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f609920d-00b8-40fb-9d55-d39c4499318f tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:08.239150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f609920d-00b8-40fb-9d55-d39c4499318f tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d3fb0a23fc4e89a1b747d2590451ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322dd60f56de4ecaabbb7fb245c46389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:08.247454 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f609920d-00b8-40fb-9d55-d39c4499318f tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 200 len: 1314 microversion: 2.1 time: 0.223405 Oct 04 21:38:08.248160 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2965/5943] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:08 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:09.071486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3b91ba3d-5f54-41d1-9443-ddd85d9f3324 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:09.072183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3b91ba3d-5f54-41d1-9443-ddd85d9f3324 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:09.080607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b91ba3d-5f54-41d1-9443-ddd85d9f3324 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:09.081102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b91ba3d-5f54-41d1-9443-ddd85d9f3324 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:09.081593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b91ba3d-5f54-41d1-9443-ddd85d9f3324 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:09.082338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b91ba3d-5f54-41d1-9443-ddd85d9f3324 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:09.082801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b91ba3d-5f54-41d1-9443-ddd85d9f3324 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:09.083284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b91ba3d-5f54-41d1-9443-ddd85d9f3324 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:09.170143 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3b91ba3d-5f54-41d1-9443-ddd85d9f3324 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1338 microversion: 2.1 time: 0.103165 Oct 04 21:38:09.173461 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2979/5944] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:09 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:09.277301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-443259c0-d1a2-45fd-982d-8007d23ac7a4 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:09.278045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-443259c0-d1a2-45fd-982d-8007d23ac7a4 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:09.285380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-443259c0-d1a2-45fd-982d-8007d23ac7a4 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:09.285988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-443259c0-d1a2-45fd-982d-8007d23ac7a4 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:09.287072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-443259c0-d1a2-45fd-982d-8007d23ac7a4 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:09.287867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-443259c0-d1a2-45fd-982d-8007d23ac7a4 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:09.288599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-443259c0-d1a2-45fd-982d-8007d23ac7a4 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:09.289155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-443259c0-d1a2-45fd-982d-8007d23ac7a4 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:09.464031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-443259c0-d1a2-45fd-982d-8007d23ac7a4 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d3fb0a23fc4e89a1b747d2590451ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322dd60f56de4ecaabbb7fb245c46389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:09.471931 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-443259c0-d1a2-45fd-982d-8007d23ac7a4 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 200 len: 1314 microversion: 2.1 time: 0.203475 Oct 04 21:38:09.472526 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2966/5945] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:09 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:09.682174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a07c0c39-f71f-41be-91a6-366a414ba90a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:09.686507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a07c0c39-f71f-41be-91a6-366a414ba90a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:09.701563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a07c0c39-f71f-41be-91a6-366a414ba90a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:09.702070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a07c0c39-f71f-41be-91a6-366a414ba90a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:09.702523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a07c0c39-f71f-41be-91a6-366a414ba90a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:09.703242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a07c0c39-f71f-41be-91a6-366a414ba90a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:09.703708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a07c0c39-f71f-41be-91a6-366a414ba90a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:09.704153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a07c0c39-f71f-41be-91a6-366a414ba90a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:09.749603 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a07c0c39-f71f-41be-91a6-366a414ba90a tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.066886 Oct 04 21:38:09.749603 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2980/5946] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Oct 4 21:38:09 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:09.835830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6ecfd99b-313f-40b2-b683-83d29f28d4ca tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:09.840051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6ecfd99b-313f-40b2-b683-83d29f28d4ca tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:09.842967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ecfd99b-313f-40b2-b683-83d29f28d4ca tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:09.843485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ecfd99b-313f-40b2-b683-83d29f28d4ca tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:09.843922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ecfd99b-313f-40b2-b683-83d29f28d4ca tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:09.844629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ecfd99b-313f-40b2-b683-83d29f28d4ca tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:09.845125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ecfd99b-313f-40b2-b683-83d29f28d4ca tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:09.845585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ecfd99b-313f-40b2-b683-83d29f28d4ca tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:09.877127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6ecfd99b-313f-40b2-b683-83d29f28d4ca tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:38:10.199398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ba6c704f-84a3-4182-ac2a-7973a0171657 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:10.200020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ba6c704f-84a3-4182-ac2a-7973a0171657 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:10.207106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba6c704f-84a3-4182-ac2a-7973a0171657 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:10.207610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba6c704f-84a3-4182-ac2a-7973a0171657 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:10.208736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba6c704f-84a3-4182-ac2a-7973a0171657 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:10.209792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba6c704f-84a3-4182-ac2a-7973a0171657 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:10.214044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba6c704f-84a3-4182-ac2a-7973a0171657 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:10.214502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba6c704f-84a3-4182-ac2a-7973a0171657 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:10.299544 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ba6c704f-84a3-4182-ac2a-7973a0171657 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1416 microversion: 2.1 time: 0.103867 Oct 04 21:38:10.300135 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2981/5947] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:10 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1416 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:10.309923 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6ecfd99b-313f-40b2-b683-83d29f28d4ca tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 204 len: 0 microversion: 2.20 time: 0.478936 Oct 04 21:38:10.310520 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2967/5948] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:38:09 2022] DELETE /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 21:38:10.318708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3edfcc6a-f337-4132-9fbe-1b14154b2278 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:10.319639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3edfcc6a-f337-4132-9fbe-1b14154b2278 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:10.325815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3edfcc6a-f337-4132-9fbe-1b14154b2278 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:10.326301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3edfcc6a-f337-4132-9fbe-1b14154b2278 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:10.326738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3edfcc6a-f337-4132-9fbe-1b14154b2278 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:10.327428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3edfcc6a-f337-4132-9fbe-1b14154b2278 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:10.327918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3edfcc6a-f337-4132-9fbe-1b14154b2278 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:10.328344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3edfcc6a-f337-4132-9fbe-1b14154b2278 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:10.484868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3edfcc6a-f337-4132-9fbe-1b14154b2278 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:10.490496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3edfcc6a-f337-4132-9fbe-1b14154b2278 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:10.492158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3edfcc6a-f337-4132-9fbe-1b14154b2278 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:10.493550 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3edfcc6a-f337-4132-9fbe-1b14154b2278 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1724 microversion: 2.20 time: 0.178658 Oct 04 21:38:10.494377 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2982/5949] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:38:10 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:38:10.504768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-80a15e75-ed89-4621-91f1-6febbede45ac tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:10.507322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-80a15e75-ed89-4621-91f1-6febbede45ac tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:10.522220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80a15e75-ed89-4621-91f1-6febbede45ac tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:10.522791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80a15e75-ed89-4621-91f1-6febbede45ac tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:10.523240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80a15e75-ed89-4621-91f1-6febbede45ac tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:10.523987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80a15e75-ed89-4621-91f1-6febbede45ac tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:10.524459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80a15e75-ed89-4621-91f1-6febbede45ac tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:10.524894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-80a15e75-ed89-4621-91f1-6febbede45ac tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:10.687760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-80a15e75-ed89-4621-91f1-6febbede45ac tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d3fb0a23fc4e89a1b747d2590451ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322dd60f56de4ecaabbb7fb245c46389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:10.697333 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-80a15e75-ed89-4621-91f1-6febbede45ac tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 200 len: 1501 microversion: 2.1 time: 0.204271 Oct 04 21:38:10.701498 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2968/5950] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:10 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 1501 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:10.722823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8d4bac53-57e9-4726-9a2d-ab3e93f4f175 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:10.723454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8d4bac53-57e9-4726-9a2d-ab3e93f4f175 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:10.731737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d4bac53-57e9-4726-9a2d-ab3e93f4f175 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:10.732299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d4bac53-57e9-4726-9a2d-ab3e93f4f175 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:10.732809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d4bac53-57e9-4726-9a2d-ab3e93f4f175 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:10.733705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d4bac53-57e9-4726-9a2d-ab3e93f4f175 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:10.734251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d4bac53-57e9-4726-9a2d-ab3e93f4f175 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:10.734838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d4bac53-57e9-4726-9a2d-ab3e93f4f175 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:10.930830 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8d4bac53-57e9-4726-9a2d-ab3e93f4f175 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "DELETE /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.212747 Oct 04 21:38:10.931560 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2983/5951] 10.222.0.30 () {58 vars in 1296 bytes} [Tue Oct 4 21:38:10 2022] DELETE /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb/os-server-password => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:38:10.941251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5b7d598a-1220-4d2f-9584-5ea1906203a9 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:10.941958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5b7d598a-1220-4d2f-9584-5ea1906203a9 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:10.950715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5b7d598a-1220-4d2f-9584-5ea1906203a9 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:10.950715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5b7d598a-1220-4d2f-9584-5ea1906203a9 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:10.950715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5b7d598a-1220-4d2f-9584-5ea1906203a9 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:10.951207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5b7d598a-1220-4d2f-9584-5ea1906203a9 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:10.951957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5b7d598a-1220-4d2f-9584-5ea1906203a9 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:10.952509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5b7d598a-1220-4d2f-9584-5ea1906203a9 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:10.978783 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5b7d598a-1220-4d2f-9584-5ea1906203a9 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.041574 Oct 04 21:38:10.979408 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2969/5952] 10.222.0.30 () {58 vars in 1293 bytes} [Tue Oct 4 21:38:10 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb/os-server-password => generated 16 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:38:10.991280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cd3d59ae-aa3a-4089-9404-b00d849eed1d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:10.991786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cd3d59ae-aa3a-4089-9404-b00d849eed1d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:10.998089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd3d59ae-aa3a-4089-9404-b00d849eed1d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:10.998584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd3d59ae-aa3a-4089-9404-b00d849eed1d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:10.999033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd3d59ae-aa3a-4089-9404-b00d849eed1d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:10.999748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd3d59ae-aa3a-4089-9404-b00d849eed1d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:11.000207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd3d59ae-aa3a-4089-9404-b00d849eed1d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:11.000641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd3d59ae-aa3a-4089-9404-b00d849eed1d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:11.026563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cd3d59ae-aa3a-4089-9404-b00d849eed1d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:38:11.323533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7f836f04-7ea9-4297-9c7d-0db238eb47cc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:11.324147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7f836f04-7ea9-4297-9c7d-0db238eb47cc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:11.331180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f836f04-7ea9-4297-9c7d-0db238eb47cc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:11.334087 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cd3d59ae-aa3a-4089-9404-b00d849eed1d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "DELETE /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 204 len: 0 microversion: 2.1 time: 0.344708 Oct 04 21:38:11.334552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f836f04-7ea9-4297-9c7d-0db238eb47cc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:11.334641 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2984/5953] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:38:10 2022] DELETE /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:38:11.334721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f836f04-7ea9-4297-9c7d-0db238eb47cc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:11.334721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f836f04-7ea9-4297-9c7d-0db238eb47cc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:11.334721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f836f04-7ea9-4297-9c7d-0db238eb47cc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:11.334975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f836f04-7ea9-4297-9c7d-0db238eb47cc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:11.341886 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-92cee9fd-7961-440e-bde0-ea9dd390139e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:11.342816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-92cee9fd-7961-440e-bde0-ea9dd390139e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:11.349684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92cee9fd-7961-440e-bde0-ea9dd390139e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:11.350187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92cee9fd-7961-440e-bde0-ea9dd390139e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:11.351313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92cee9fd-7961-440e-bde0-ea9dd390139e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:11.352538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92cee9fd-7961-440e-bde0-ea9dd390139e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:11.353017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92cee9fd-7961-440e-bde0-ea9dd390139e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:11.354531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-92cee9fd-7961-440e-bde0-ea9dd390139e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:11.540808 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7f836f04-7ea9-4297-9c7d-0db238eb47cc tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1424 microversion: 2.1 time: 0.220910 Oct 04 21:38:11.544623 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2970/5954] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:11 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1424 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:11.555400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-34a6cfa7-91b1-48b0-954f-bdd56d2702c8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:11.562928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-34a6cfa7-91b1-48b0-954f-bdd56d2702c8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:11.573342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-34a6cfa7-91b1-48b0-954f-bdd56d2702c8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:11.574143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-34a6cfa7-91b1-48b0-954f-bdd56d2702c8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:11.575040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-34a6cfa7-91b1-48b0-954f-bdd56d2702c8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:11.575966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-34a6cfa7-91b1-48b0-954f-bdd56d2702c8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:11.576595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-34a6cfa7-91b1-48b0-954f-bdd56d2702c8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:11.577371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-34a6cfa7-91b1-48b0-954f-bdd56d2702c8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:11.686883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-92cee9fd-7961-440e-bde0-ea9dd390139e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d3fb0a23fc4e89a1b747d2590451ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322dd60f56de4ecaabbb7fb245c46389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:11.697997 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-92cee9fd-7961-440e-bde0-ea9dd390139e tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 200 len: 1507 microversion: 2.1 time: 0.360250 Oct 04 21:38:11.698868 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2985/5955] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:11 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 1507 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:11.752095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-34a6cfa7-91b1-48b0-954f-bdd56d2702c8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:11.760487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-34a6cfa7-91b1-48b0-954f-bdd56d2702c8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:11.761977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-34a6cfa7-91b1-48b0-954f-bdd56d2702c8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:11.763166 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-34a6cfa7-91b1-48b0-954f-bdd56d2702c8 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1724 microversion: 2.20 time: 0.212400 Oct 04 21:38:11.763735 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2971/5956] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:38:11 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:38:12.529510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e8a4960c-5222-497e-9f7d-62d001ab3618 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:12.530061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e8a4960c-5222-497e-9f7d-62d001ab3618 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:12.541945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8a4960c-5222-497e-9f7d-62d001ab3618 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:12.541945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8a4960c-5222-497e-9f7d-62d001ab3618 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:12.541945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8a4960c-5222-497e-9f7d-62d001ab3618 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:12.541945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8a4960c-5222-497e-9f7d-62d001ab3618 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:12.543695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8a4960c-5222-497e-9f7d-62d001ab3618 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:12.544179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e8a4960c-5222-497e-9f7d-62d001ab3618 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:12.570093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-88bd3a52-3951-43fa-a54e-aaecf6d02775 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:12.570646 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e8a4960c-5222-497e-9f7d-62d001ab3618 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/ips" status: 200 len: 150 microversion: 2.1 time: 0.045142 Oct 04 21:38:12.571626 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2986/5957] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Oct 4 21:38:12 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:12.572295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-88bd3a52-3951-43fa-a54e-aaecf6d02775 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:12.581515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88bd3a52-3951-43fa-a54e-aaecf6d02775 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:12.582031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88bd3a52-3951-43fa-a54e-aaecf6d02775 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:12.582666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88bd3a52-3951-43fa-a54e-aaecf6d02775 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:12.584390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88bd3a52-3951-43fa-a54e-aaecf6d02775 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:12.587942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88bd3a52-3951-43fa-a54e-aaecf6d02775 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:12.587942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88bd3a52-3951-43fa-a54e-aaecf6d02775 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:12.695504 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-88bd3a52-3951-43fa-a54e-aaecf6d02775 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1434 microversion: 2.1 time: 0.132259 Oct 04 21:38:12.699541 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2972/5958] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:12 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1434 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:12.724452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4b721389-c82c-4aad-9892-1e02b476cd6d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:12.725081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4b721389-c82c-4aad-9892-1e02b476cd6d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:12.733163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b721389-c82c-4aad-9892-1e02b476cd6d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:12.733704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b721389-c82c-4aad-9892-1e02b476cd6d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:12.734160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b721389-c82c-4aad-9892-1e02b476cd6d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:12.734874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b721389-c82c-4aad-9892-1e02b476cd6d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:12.735344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b721389-c82c-4aad-9892-1e02b476cd6d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:12.735775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b721389-c82c-4aad-9892-1e02b476cd6d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:12.765366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:12.789333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-14457ead-d755-4bb8-8c27-fd4e0b18c481 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:12.790071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-14457ead-d755-4bb8-8c27-fd4e0b18c481 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:12.796632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14457ead-d755-4bb8-8c27-fd4e0b18c481 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:12.797128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14457ead-d755-4bb8-8c27-fd4e0b18c481 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:12.797678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14457ead-d755-4bb8-8c27-fd4e0b18c481 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:12.798426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14457ead-d755-4bb8-8c27-fd4e0b18c481 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:12.798850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14457ead-d755-4bb8-8c27-fd4e0b18c481 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:12.799289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14457ead-d755-4bb8-8c27-fd4e0b18c481 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:13.668744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4b721389-c82c-4aad-9892-1e02b476cd6d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d3fb0a23fc4e89a1b747d2590451ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322dd60f56de4ecaabbb7fb245c46389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:13.677651 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4b721389-c82c-4aad-9892-1e02b476cd6d tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 200 len: 1507 microversion: 2.1 time: 0.957494 Oct 04 21:38:13.690279 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2987/5959] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:12 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 1507 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:13.702979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-14457ead-d755-4bb8-8c27-fd4e0b18c481 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:13.707317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:13.718309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-14457ead-d755-4bb8-8c27-fd4e0b18c481 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:13.720563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-48650b31-6fd8-451a-9303-37c2a67abe69 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:13.721384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-48650b31-6fd8-451a-9303-37c2a67abe69 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:13.732578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48650b31-6fd8-451a-9303-37c2a67abe69 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:13.734421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48650b31-6fd8-451a-9303-37c2a67abe69 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:13.734979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48650b31-6fd8-451a-9303-37c2a67abe69 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:13.737880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48650b31-6fd8-451a-9303-37c2a67abe69 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:13.738479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48650b31-6fd8-451a-9303-37c2a67abe69 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:13.740400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48650b31-6fd8-451a-9303-37c2a67abe69 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:13.741061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-14457ead-d755-4bb8-8c27-fd4e0b18c481 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:13.759073 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-14457ead-d755-4bb8-8c27-fd4e0b18c481 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1724 microversion: 2.20 time: 0.961611 Oct 04 21:38:13.759073 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2973/5960] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:38:12 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1724 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:38:13.828892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-9b9002d0-f0f9-42ba-8462-7edb4cb6ec44 req-8a58f9e0-1dc8-47f4-93b2-f7abe22462cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa024b1-e789-4226-b10a-07bf3ca97ecc", "name": "network-vif-deleted", "tag": "f058e4a1-c25d-417e-8d41-b82e64725e18"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:13.849373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9b9002d0-f0f9-42ba-8462-7edb4cb6ec44 req-8a58f9e0-1dc8-47f4-93b2-f7abe22462cb service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:13.855305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9b9002d0-f0f9-42ba-8462-7edb4cb6ec44 req-8a58f9e0-1dc8-47f4-93b2-f7abe22462cb service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:13.855305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9b9002d0-f0f9-42ba-8462-7edb4cb6ec44 req-8a58f9e0-1dc8-47f4-93b2-f7abe22462cb service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:13.891416 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-9b9002d0-f0f9-42ba-8462-7edb4cb6ec44 req-8a58f9e0-1dc8-47f4-93b2-f7abe22462cb service nova] Creating event network-vif-deleted:f058e4a1-c25d-417e-8d41-b82e64725e18 for instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc on n-h2-860282-1 Oct 04 21:38:13.904801 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-9b9002d0-f0f9-42ba-8462-7edb4cb6ec44 req-8a58f9e0-1dc8-47f4-93b2-f7abe22462cb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077996 Oct 04 21:38:13.906001 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2974/5961] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:14.091467 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-48650b31-6fd8-451a-9303-37c2a67abe69 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1422 microversion: 2.1 time: 0.375049 Oct 04 21:38:14.092977 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2988/5962] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:13 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1422 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:14.722003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d2aaf839-1092-446e-af53-04ea2e0c0e11 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:14.723311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d2aaf839-1092-446e-af53-04ea2e0c0e11 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:14.731642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2aaf839-1092-446e-af53-04ea2e0c0e11 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:14.732395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2aaf839-1092-446e-af53-04ea2e0c0e11 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:14.733046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2aaf839-1092-446e-af53-04ea2e0c0e11 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:14.733863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2aaf839-1092-446e-af53-04ea2e0c0e11 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:14.734524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2aaf839-1092-446e-af53-04ea2e0c0e11 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:14.735687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2aaf839-1092-446e-af53-04ea2e0c0e11 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:14.772086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-18edbabf-0c7f-4964-b291-5e1a6475b1a6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:14.773380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-18edbabf-0c7f-4964-b291-5e1a6475b1a6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:14.782563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18edbabf-0c7f-4964-b291-5e1a6475b1a6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:14.783268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18edbabf-0c7f-4964-b291-5e1a6475b1a6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:14.783972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18edbabf-0c7f-4964-b291-5e1a6475b1a6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:14.784849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18edbabf-0c7f-4964-b291-5e1a6475b1a6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:14.785565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18edbabf-0c7f-4964-b291-5e1a6475b1a6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:14.786225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18edbabf-0c7f-4964-b291-5e1a6475b1a6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:14.877260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18edbabf-0c7f-4964-b291-5e1a6475b1a6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:14.877447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18edbabf-0c7f-4964-b291-5e1a6475b1a6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:14.878056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18edbabf-0c7f-4964-b291-5e1a6475b1a6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:14.878692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-18edbabf-0c7f-4964-b291-5e1a6475b1a6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lazy-loading 'fault' on Instance uuid 7aa024b1-e789-4226-b10a-07bf3ca97ecc {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:38:15.054838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-18edbabf-0c7f-4964-b291-5e1a6475b1a6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:15.068730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-18edbabf-0c7f-4964-b291-5e1a6475b1a6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:15.070455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-18edbabf-0c7f-4964-b291-5e1a6475b1a6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18f3a21b780248d0943136e68b4a4536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2812d680b26415fb5930200c01cb327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:15.071850 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-18edbabf-0c7f-4964-b291-5e1a6475b1a6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 200 len: 1372 microversion: 2.20 time: 0.304539 Oct 04 21:38:15.081220 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2989/5963] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:38:14 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 1372 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:38:15.122490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3188f2ec-09eb-4935-8450-64badac31936 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:15.123177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3188f2ec-09eb-4935-8450-64badac31936 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:15.134095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3188f2ec-09eb-4935-8450-64badac31936 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:15.135093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3188f2ec-09eb-4935-8450-64badac31936 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:15.135605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3188f2ec-09eb-4935-8450-64badac31936 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:15.136529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3188f2ec-09eb-4935-8450-64badac31936 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:15.137305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3188f2ec-09eb-4935-8450-64badac31936 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:15.137921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3188f2ec-09eb-4935-8450-64badac31936 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:15.186947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d2aaf839-1092-446e-af53-04ea2e0c0e11 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d3fb0a23fc4e89a1b747d2590451ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322dd60f56de4ecaabbb7fb245c46389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:15.197962 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d2aaf839-1092-446e-af53-04ea2e0c0e11 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 200 len: 1507 microversion: 2.1 time: 0.485423 Oct 04 21:38:15.199424 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2975/5964] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:14 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 1507 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:15.487936 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3188f2ec-09eb-4935-8450-64badac31936 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1464 microversion: 2.1 time: 0.371771 Oct 04 21:38:15.490225 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2990/5965] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:15 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1464 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:15.507508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a01a4061-4c9b-4107-8ab4-252c48fb3c1a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0b68a0a-9a61-400e-b83d-0e6f5a42ac10"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:15.510849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a01a4061-4c9b-4107-8ab4-252c48fb3c1a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:15.519065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a01a4061-4c9b-4107-8ab4-252c48fb3c1a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:15.519955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a01a4061-4c9b-4107-8ab4-252c48fb3c1a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:15.520735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a01a4061-4c9b-4107-8ab4-252c48fb3c1a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:15.521897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a01a4061-4c9b-4107-8ab4-252c48fb3c1a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:15.522656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a01a4061-4c9b-4107-8ab4-252c48fb3c1a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:15.523669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a01a4061-4c9b-4107-8ab4-252c48fb3c1a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:15.570574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-989d255e-cc35-4216-9db3-0a37f021b363 req-85994c2c-7a39-48dd-aa36-5f960aaaf98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60024e84-e8c6-4ca6-b8d9-3bc140aafccb", "name": "network-vif-deleted", "tag": "307eaebc-d78d-4b04-bcbd-c7df91b551e1"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:15.592380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-989d255e-cc35-4216-9db3-0a37f021b363 req-85994c2c-7a39-48dd-aa36-5f960aaaf98d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:15.594094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-989d255e-cc35-4216-9db3-0a37f021b363 req-85994c2c-7a39-48dd-aa36-5f960aaaf98d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:15.600327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-989d255e-cc35-4216-9db3-0a37f021b363 req-85994c2c-7a39-48dd-aa36-5f960aaaf98d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:15.613291 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-989d255e-cc35-4216-9db3-0a37f021b363 req-85994c2c-7a39-48dd-aa36-5f960aaaf98d service nova] Creating event network-vif-deleted:307eaebc-d78d-4b04-bcbd-c7df91b551e1 for instance 60024e84-e8c6-4ca6-b8d9-3bc140aafccb on n-h2-860282-1 Oct 04 21:38:15.620108 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-989d255e-cc35-4216-9db3-0a37f021b363 req-85994c2c-7a39-48dd-aa36-5f960aaaf98d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063592 Oct 04 21:38:15.622631 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2991/5966] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:38:16.098990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b3f8c2b4-1ba9-4c9d-9f62-0b49d72040db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:16.100015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b3f8c2b4-1ba9-4c9d-9f62-0b49d72040db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:16.102591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:16.108972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3f8c2b4-1ba9-4c9d-9f62-0b49d72040db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:16.109701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3f8c2b4-1ba9-4c9d-9f62-0b49d72040db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:16.110658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3f8c2b4-1ba9-4c9d-9f62-0b49d72040db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:16.111531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3f8c2b4-1ba9-4c9d-9f62-0b49d72040db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:16.111982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3f8c2b4-1ba9-4c9d-9f62-0b49d72040db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:16.112655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3f8c2b4-1ba9-4c9d-9f62-0b49d72040db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:16.127208 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-b3f8c2b4-1ba9-4c9d-9f62-0b49d72040db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] HTTP exception thrown: Instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc could not be found. Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b3f8c2b4-1ba9-4c9d-9f62-0b49d72040db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Request method failure captured: Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc HTTP/1.1 Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKZgyJyR7VmgdJLEkwR5b1trzvCrMRVE0S_5kujKYuisXPTH0PySulsZuRNbmG3WvslVrCsoSWnMgpf-657L1tXvTNLwRznlPhAUYg9ID68MS5klN-NTQOWU_PdwOm2JVB2dv_uKL7wuXgdZ824SlPUgTR8Di4X_u_iCw_zbcdP4iVo Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: e2812d680b26415fb5930200c01cb327 Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-474320935 Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2812d680b26415fb5930200c01cb327"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e2812d680b26415fb5930200c01cb327"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e2812d680b26415fb5930200c01cb327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2812d680b26415fb5930200c01cb327"}]}] Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AttachVolumeShelveTestJSON-474320935 Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: e2812d680b26415fb5930200c01cb327 Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-474320935 Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AttachVolumeShelveTestJSON-474320935-project Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 18f3a21b780248d0943136e68b4a4536 Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AttachVolumeShelveTestJSON-474320935-project Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc could not be found. Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '7aa024b1-e789-4226-b10a-07bf3ca97ecc'} Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc could not be found. Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc could not be found. Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:16.128910 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:16.137124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:16.137124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:16.137124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:16.137124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:16.137124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:38:16.137124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:38:16.137124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc could not be found. Oct 04 21:38:16.137124 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:16.137124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b3f8c2b4-1ba9-4c9d-9f62-0b49d72040db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Returning 404 to user: Instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:38:16.137124 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b3f8c2b4-1ba9-4c9d-9f62-0b49d72040db tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 404 len: 111 microversion: 2.20 time: 0.037184 Oct 04 21:38:16.137124 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2992/5967] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:38:16 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:38:16.140943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7900a644-e722-49b0-9a7c-e2f00e0e80b0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '.version_select at 0x7f578b49f700>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:16.249258 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7900a644-e722-49b0-9a7c-e2f00e0e80b0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054899522" status: 204 len: 0 microversion: 2.20 time: 0.112933 Oct 04 21:38:16.249933 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2993/5968] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Oct 4 21:38:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054899522 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:38:16.254872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7c3034f1-f9e6-4550-8523-6c8a86432ae8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:16.255509 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7c3034f1-f9e6-4550-8523-6c8a86432ae8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:16.262585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c3034f1-f9e6-4550-8523-6c8a86432ae8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:16.263093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c3034f1-f9e6-4550-8523-6c8a86432ae8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:16.263571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c3034f1-f9e6-4550-8523-6c8a86432ae8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:16.264350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c3034f1-f9e6-4550-8523-6c8a86432ae8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:16.264820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c3034f1-f9e6-4550-8523-6c8a86432ae8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:16.265254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c3034f1-f9e6-4550-8523-6c8a86432ae8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:16.310275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c3034f1-f9e6-4550-8523-6c8a86432ae8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:16.311189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c3034f1-f9e6-4550-8523-6c8a86432ae8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:16.311643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c3034f1-f9e6-4550-8523-6c8a86432ae8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:16.312112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-7c3034f1-f9e6-4550-8523-6c8a86432ae8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lazy-loading 'fault' on Instance uuid 60024e84-e8c6-4ca6-b8d9-3bc140aafccb {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:38:16.445799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7c3034f1-f9e6-4550-8523-6c8a86432ae8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d3fb0a23fc4e89a1b747d2590451ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322dd60f56de4ecaabbb7fb245c46389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:16.455100 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7c3034f1-f9e6-4550-8523-6c8a86432ae8 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 200 len: 1304 microversion: 2.1 time: 0.204097 Oct 04 21:38:16.455846 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2994/5969] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:16 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 1304 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:16.474593 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a01a4061-4c9b-4107-8ab4-252c48fb3c1a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "POST /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.980067 Oct 04 21:38:16.475470 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2976/5970] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 21:38:15 2022] POST /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments => generated 194 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:16.516478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1a66c2e6-594d-4920-a0e3-fff087233570 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:16.517104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1a66c2e6-594d-4920-a0e3-fff087233570 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:16.524584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a66c2e6-594d-4920-a0e3-fff087233570 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:16.525535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a66c2e6-594d-4920-a0e3-fff087233570 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:16.527381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a66c2e6-594d-4920-a0e3-fff087233570 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:16.529109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a66c2e6-594d-4920-a0e3-fff087233570 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:16.529821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a66c2e6-594d-4920-a0e3-fff087233570 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:16.531231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a66c2e6-594d-4920-a0e3-fff087233570 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:16.861283 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1a66c2e6-594d-4920-a0e3-fff087233570 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1464 microversion: 2.1 time: 0.348500 Oct 04 21:38:16.862048 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2995/5971] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:16 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1464 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:17.477547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:17.481600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:17.487378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-63377c86-e30a-4e82-99a8-f14e8ff00456 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:17.488406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-63377c86-e30a-4e82-99a8-f14e8ff00456 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] [instance: 60024e84-e8c6-4ca6-b8d9-3bc140aafccb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:17.498584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63377c86-e30a-4e82-99a8-f14e8ff00456 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:17.499868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63377c86-e30a-4e82-99a8-f14e8ff00456 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:17.500403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63377c86-e30a-4e82-99a8-f14e8ff00456 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:17.501323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63377c86-e30a-4e82-99a8-f14e8ff00456 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:17.501861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63377c86-e30a-4e82-99a8-f14e8ff00456 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:17.502292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-63377c86-e30a-4e82-99a8-f14e8ff00456 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:17.518671 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-63377c86-e30a-4e82-99a8-f14e8ff00456 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] HTTP exception thrown: Instance 60024e84-e8c6-4ca6-b8d9-3bc140aafccb could not be found. Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-63377c86-e30a-4e82-99a8-f14e8ff00456 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Request method failure captured: Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb HTTP/1.1 Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKetwloJccpNMN6kWDLhyW-yo5mRBnAKE-Pc8llGjZ4FGLEY5qnNiF7bhe_PnloHq2KAnt9K0A--Rd5fRyqWeVFtqu4vF_npowYqp_4t7w3lbBcKxG-r__MRXyW1Y1K5LFLICMczkWKAfJocxqHzHXOI78KaYnMCx3jETlxfOFC2dxY Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 322dd60f56de4ecaabbb7fb245c46389 Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerPasswordTestJSON-959926738 Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/322dd60f56de4ecaabbb7fb245c46389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_322dd60f56de4ecaabbb7fb245c46389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/322dd60f56de4ecaabbb7fb245c46389"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/322dd60f56de4ecaabbb7fb245c46389"}]}] Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerPasswordTestJSON-959926738 Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 322dd60f56de4ecaabbb7fb245c46389 Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerPasswordTestJSON-959926738 Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerPasswordTestJSON-959926738-project Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 30d3fb0a23fc4e89a1b747d2590451ad Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerPasswordTestJSON-959926738-project Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 60024e84-e8c6-4ca6-b8d9-3bc140aafccb could not be found. Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '60024e84-e8c6-4ca6-b8d9-3bc140aafccb'} Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60024e84-e8c6-4ca6-b8d9-3bc140aafccb could not be found. Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60024e84-e8c6-4ca6-b8d9-3bc140aafccb could not be found. Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:17.523365 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:17.541694 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:17.541694 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:17.541694 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:17.541694 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:38:17.541694 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:38:17.541694 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60024e84-e8c6-4ca6-b8d9-3bc140aafccb could not be found. Oct 04 21:38:17.541694 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:17.541694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-63377c86-e30a-4e82-99a8-f14e8ff00456 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] Returning 404 to user: Instance 60024e84-e8c6-4ca6-b8d9-3bc140aafccb could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:38:17.541694 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-63377c86-e30a-4e82-99a8-f14e8ff00456 tempest-ServerPasswordTestJSON-959926738 tempest-ServerPasswordTestJSON-959926738-project] 10.222.0.30 "GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb" status: 404 len: 111 microversion: 2.1 time: 0.046641 Oct 04 21:38:17.541694 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2977/5972] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:17 2022] GET /compute/v2.1/servers/60024e84-e8c6-4ca6-b8d9-3bc140aafccb => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:38:17.683428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-6d5dc8b7-565f-4781-ba61-d5372c5493c8 req-6a866bf7-a821-40b1-8fc8-68b58ab34768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eb6e551-dbd2-4f01-9e8b-8bee2bb43258", "tag": "32a720d8-d47e-4681-97a7-7ceeca59ad8b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:17.715535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6d5dc8b7-565f-4781-ba61-d5372c5493c8 req-6a866bf7-a821-40b1-8fc8-68b58ab34768 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:17.717661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6d5dc8b7-565f-4781-ba61-d5372c5493c8 req-6a866bf7-a821-40b1-8fc8-68b58ab34768 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:17.717661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6d5dc8b7-565f-4781-ba61-d5372c5493c8 req-6a866bf7-a821-40b1-8fc8-68b58ab34768 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:17.739357 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-6d5dc8b7-565f-4781-ba61-d5372c5493c8 req-6a866bf7-a821-40b1-8fc8-68b58ab34768 service nova] Creating event network-changed:32a720d8-d47e-4681-97a7-7ceeca59ad8b for instance 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 on n-h2-860282-1 Oct 04 21:38:17.747479 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-6d5dc8b7-565f-4781-ba61-d5372c5493c8 req-6a866bf7-a821-40b1-8fc8-68b58ab34768 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069380 Oct 04 21:38:17.752241 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2996/5973] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:17.930456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-954fdacc-9edd-4a3c-96e9-a4df780bbefb tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:17.931404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-954fdacc-9edd-4a3c-96e9-a4df780bbefb tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:17.946300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-954fdacc-9edd-4a3c-96e9-a4df780bbefb tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:17.949481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-954fdacc-9edd-4a3c-96e9-a4df780bbefb tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:17.953219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-954fdacc-9edd-4a3c-96e9-a4df780bbefb tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:17.953219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-954fdacc-9edd-4a3c-96e9-a4df780bbefb tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:17.953219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-954fdacc-9edd-4a3c-96e9-a4df780bbefb tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:17.964291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-954fdacc-9edd-4a3c-96e9-a4df780bbefb tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:18.604227 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-954fdacc-9edd-4a3c-96e9-a4df780bbefb tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1464 microversion: 2.1 time: 0.679624 Oct 04 21:38:18.606980 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2978/5974] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:17 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1464 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:19.630555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1ade50f1-fb41-4f7e-b2d3-abcd6e92ff9e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:19.631414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1ade50f1-fb41-4f7e-b2d3-abcd6e92ff9e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:19.634099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:19.651167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ade50f1-fb41-4f7e-b2d3-abcd6e92ff9e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:19.652059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ade50f1-fb41-4f7e-b2d3-abcd6e92ff9e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:19.653592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ade50f1-fb41-4f7e-b2d3-abcd6e92ff9e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:19.659083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ade50f1-fb41-4f7e-b2d3-abcd6e92ff9e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:19.659819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ade50f1-fb41-4f7e-b2d3-abcd6e92ff9e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:19.660461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1ade50f1-fb41-4f7e-b2d3-abcd6e92ff9e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:19.914958 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1ade50f1-fb41-4f7e-b2d3-abcd6e92ff9e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1464 microversion: 2.1 time: 0.290265 Oct 04 21:38:19.917105 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2997/5975] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:19 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1464 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:20.945399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c9961066-e5a1-4f13-bc10-ee7b97856672 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:20.946857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c9961066-e5a1-4f13-bc10-ee7b97856672 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:20.972215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:20.974519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c9961066-e5a1-4f13-bc10-ee7b97856672 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:20.977594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c9961066-e5a1-4f13-bc10-ee7b97856672 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:20.977594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c9961066-e5a1-4f13-bc10-ee7b97856672 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:20.987469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c9961066-e5a1-4f13-bc10-ee7b97856672 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:20.988388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c9961066-e5a1-4f13-bc10-ee7b97856672 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:20.989843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c9961066-e5a1-4f13-bc10-ee7b97856672 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:21.322286 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c9961066-e5a1-4f13-bc10-ee7b97856672 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1464 microversion: 2.1 time: 0.385297 Oct 04 21:38:21.338018 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2979/5976] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:20 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1464 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:22.112070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-38719f04-95c1-43e9-b222-8e202da241c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:22.113520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-38719f04-95c1-43e9-b222-8e202da241c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:22.130071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38719f04-95c1-43e9-b222-8e202da241c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:22.136179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38719f04-95c1-43e9-b222-8e202da241c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:22.138122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38719f04-95c1-43e9-b222-8e202da241c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:22.139494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38719f04-95c1-43e9-b222-8e202da241c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:22.142784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38719f04-95c1-43e9-b222-8e202da241c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:22.146340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38719f04-95c1-43e9-b222-8e202da241c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:22.200803 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-38719f04-95c1-43e9-b222-8e202da241c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] HTTP exception thrown: Instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc could not be found. Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-38719f04-95c1-43e9-b222-8e202da241c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Request method failure captured: Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc HTTP/1.1 Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKZgyJyR7VmgdJLEkwR5b1trzvCrMRVE0S_5kujKYuisXPTH0PySulsZuRNbmG3WvslVrCsoSWnMgpf-657L1tXvTNLwRznlPhAUYg9ID68MS5klN-NTQOWU_PdwOm2JVB2dv_uKL7wuXgdZ824SlPUgTR8Di4X_u_iCw_zbcdP4iVo Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: e2812d680b26415fb5930200c01cb327 Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-474320935 Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2812d680b26415fb5930200c01cb327"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e2812d680b26415fb5930200c01cb327"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e2812d680b26415fb5930200c01cb327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2812d680b26415fb5930200c01cb327"}]}] Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AttachVolumeShelveTestJSON-474320935 Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: e2812d680b26415fb5930200c01cb327 Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-474320935 Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AttachVolumeShelveTestJSON-474320935-project Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 18f3a21b780248d0943136e68b4a4536 Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AttachVolumeShelveTestJSON-474320935-project Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc could not be found. Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '7aa024b1-e789-4226-b10a-07bf3ca97ecc'} Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc could not be found. Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:38:22.203276 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:38:22.223042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc could not be found. Oct 04 21:38:22.223042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:22.223042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:22.223042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:22.223042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:22.223042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:22.223042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:22.223042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:38:22.223042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:38:22.223042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc could not be found. Oct 04 21:38:22.223042 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:22.223042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-38719f04-95c1-43e9-b222-8e202da241c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Returning 404 to user: Instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:38:22.223042 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-38719f04-95c1-43e9-b222-8e202da241c6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 404 len: 111 microversion: 2.20 time: 0.097815 Oct 04 21:38:22.223042 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2998/5977] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:38:22 2022] DELETE /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:38:22.229156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3f46de01-87a5-4024-9e83-87df809d00b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:22.229845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3f46de01-87a5-4024-9e83-87df809d00b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 7aa024b1-e789-4226-b10a-07bf3ca97ecc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:22.252005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f46de01-87a5-4024-9e83-87df809d00b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:22.252512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f46de01-87a5-4024-9e83-87df809d00b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:22.252959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f46de01-87a5-4024-9e83-87df809d00b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:22.253694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f46de01-87a5-4024-9e83-87df809d00b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:22.254153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f46de01-87a5-4024-9e83-87df809d00b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:22.254613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f46de01-87a5-4024-9e83-87df809d00b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:22.303401 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-3f46de01-87a5-4024-9e83-87df809d00b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] HTTP exception thrown: Instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc could not be found. Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3f46de01-87a5-4024-9e83-87df809d00b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Request method failure captured: Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc HTTP/1.1 Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKZgyJyR7VmgdJLEkwR5b1trzvCrMRVE0S_5kujKYuisXPTH0PySulsZuRNbmG3WvslVrCsoSWnMgpf-657L1tXvTNLwRznlPhAUYg9ID68MS5klN-NTQOWU_PdwOm2JVB2dv_uKL7wuXgdZ824SlPUgTR8Di4X_u_iCw_zbcdP4iVo Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: e2812d680b26415fb5930200c01cb327 Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-474320935 Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2812d680b26415fb5930200c01cb327"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e2812d680b26415fb5930200c01cb327"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e2812d680b26415fb5930200c01cb327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2812d680b26415fb5930200c01cb327"}]}] Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AttachVolumeShelveTestJSON-474320935 Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: e2812d680b26415fb5930200c01cb327 Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-474320935 Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AttachVolumeShelveTestJSON-474320935-project Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 18f3a21b780248d0943136e68b4a4536 Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AttachVolumeShelveTestJSON-474320935-project Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc could not be found. Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '7aa024b1-e789-4226-b10a-07bf3ca97ecc'} Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc could not be found. Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc could not be found. Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:22.322078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:22.326204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:22.326204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:22.326204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:22.326204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:22.326204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:38:22.326204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:38:22.326204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc could not be found. Oct 04 21:38:22.326204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:22.326204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3f46de01-87a5-4024-9e83-87df809d00b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Returning 404 to user: Instance 7aa024b1-e789-4226-b10a-07bf3ca97ecc could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:38:22.326204 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3f46de01-87a5-4024-9e83-87df809d00b6 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc" status: 404 len: 111 microversion: 2.20 time: 0.103476 Oct 04 21:38:22.329925 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2980/5978] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:38:22 2022] GET /compute/v2.1/servers/7aa024b1-e789-4226-b10a-07bf3ca97ecc => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:38:22.349801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-481a4753-002d-4085-bf82-b3c39dbc1a96 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:22.350908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-481a4753-002d-4085-bf82-b3c39dbc1a96 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:22.358076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-481a4753-002d-4085-bf82-b3c39dbc1a96 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:22.358863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-481a4753-002d-4085-bf82-b3c39dbc1a96 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:22.359742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-481a4753-002d-4085-bf82-b3c39dbc1a96 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:22.360718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-481a4753-002d-4085-bf82-b3c39dbc1a96 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:22.361407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-481a4753-002d-4085-bf82-b3c39dbc1a96 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:22.362149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-481a4753-002d-4085-bf82-b3c39dbc1a96 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:22.570506 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-481a4753-002d-4085-bf82-b3c39dbc1a96 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1464 microversion: 2.1 time: 0.225711 Oct 04 21:38:22.574656 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 2999/5979] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:22 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1464 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:23.596919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b42cc8b4-11f1-4e36-8927-9fc589ba67ee tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:23.598580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b42cc8b4-11f1-4e36-8927-9fc589ba67ee tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:23.613871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b42cc8b4-11f1-4e36-8927-9fc589ba67ee tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:23.614371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b42cc8b4-11f1-4e36-8927-9fc589ba67ee tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:23.625931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b42cc8b4-11f1-4e36-8927-9fc589ba67ee tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:23.626880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b42cc8b4-11f1-4e36-8927-9fc589ba67ee tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:23.627514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b42cc8b4-11f1-4e36-8927-9fc589ba67ee tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:23.628148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b42cc8b4-11f1-4e36-8927-9fc589ba67ee tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:23.996038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-ca529b69-5c2e-478c-a4dd-ccebbe76c425 req-63c13bc3-9225-4abd-b729-630688b5d324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb6e551-dbd2-4f01-9e8b-8bee2bb43258", "name": "network-vif-plugged", "status": "completed", "tag": "32a720d8-d47e-4681-97a7-7ceeca59ad8b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:24.047079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ca529b69-5c2e-478c-a4dd-ccebbe76c425 req-63c13bc3-9225-4abd-b729-630688b5d324 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:24.049962 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b42cc8b4-11f1-4e36-8927-9fc589ba67ee tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1464 microversion: 2.1 time: 0.457585 Oct 04 21:38:24.050492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ca529b69-5c2e-478c-a4dd-ccebbe76c425 req-63c13bc3-9225-4abd-b729-630688b5d324 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:24.051075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ca529b69-5c2e-478c-a4dd-ccebbe76c425 req-63c13bc3-9225-4abd-b729-630688b5d324 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:24.054677 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2981/5980] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:23 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1464 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:24.083790 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-ca529b69-5c2e-478c-a4dd-ccebbe76c425 req-63c13bc3-9225-4abd-b729-630688b5d324 service nova] Creating event network-vif-plugged:32a720d8-d47e-4681-97a7-7ceeca59ad8b for instance 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 on n-h2-860282-1 Oct 04 21:38:24.102504 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-ca529b69-5c2e-478c-a4dd-ccebbe76c425 req-63c13bc3-9225-4abd-b729-630688b5d324 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106302 Oct 04 21:38:24.103644 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3000/5981] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:38:25.080819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ff9edbaf-e830-40e0-a11a-80966a095d09 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:25.081689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ff9edbaf-e830-40e0-a11a-80966a095d09 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:25.089517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff9edbaf-e830-40e0-a11a-80966a095d09 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:25.098873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff9edbaf-e830-40e0-a11a-80966a095d09 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:25.098873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff9edbaf-e830-40e0-a11a-80966a095d09 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:25.098873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff9edbaf-e830-40e0-a11a-80966a095d09 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:25.098873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff9edbaf-e830-40e0-a11a-80966a095d09 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:25.098873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff9edbaf-e830-40e0-a11a-80966a095d09 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:25.259968 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ff9edbaf-e830-40e0-a11a-80966a095d09 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1464 microversion: 2.1 time: 0.183558 Oct 04 21:38:25.273589 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2982/5982] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:25 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1464 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:26.287706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c34fc37d-2245-4642-bdb8-9626cfacb342 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:26.288419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c34fc37d-2245-4642-bdb8-9626cfacb342 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:26.290408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:26.299451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c34fc37d-2245-4642-bdb8-9626cfacb342 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:26.299954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c34fc37d-2245-4642-bdb8-9626cfacb342 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:26.300397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c34fc37d-2245-4642-bdb8-9626cfacb342 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:26.301625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c34fc37d-2245-4642-bdb8-9626cfacb342 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:26.302331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c34fc37d-2245-4642-bdb8-9626cfacb342 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:26.302954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c34fc37d-2245-4642-bdb8-9626cfacb342 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:26.475832 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c34fc37d-2245-4642-bdb8-9626cfacb342 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1648 microversion: 2.1 time: 0.193115 Oct 04 21:38:26.489460 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3001/5983] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:26 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1648 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:26.499822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6adff9df-d3b8-4812-a676-3573b6d1ad29 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:26.500815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6adff9df-d3b8-4812-a676-3573b6d1ad29 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:26.509547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6adff9df-d3b8-4812-a676-3573b6d1ad29 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:26.510543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6adff9df-d3b8-4812-a676-3573b6d1ad29 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:26.511177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6adff9df-d3b8-4812-a676-3573b6d1ad29 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:26.511894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6adff9df-d3b8-4812-a676-3573b6d1ad29 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:26.512357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6adff9df-d3b8-4812-a676-3573b6d1ad29 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:26.512791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6adff9df-d3b8-4812-a676-3573b6d1ad29 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:26.685394 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6adff9df-d3b8-4812-a676-3573b6d1ad29 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1648 microversion: 2.1 time: 0.189321 Oct 04 21:38:26.698739 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2983/5984] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:26 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1648 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:26.713372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-96ea1d74-4f18-4160-8fa9-23e8cc3d1985 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:26.718981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-96ea1d74-4f18-4160-8fa9-23e8cc3d1985 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:26.727871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96ea1d74-4f18-4160-8fa9-23e8cc3d1985 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:26.728595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96ea1d74-4f18-4160-8fa9-23e8cc3d1985 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:26.729240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96ea1d74-4f18-4160-8fa9-23e8cc3d1985 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:26.730343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96ea1d74-4f18-4160-8fa9-23e8cc3d1985 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:26.730804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96ea1d74-4f18-4160-8fa9-23e8cc3d1985 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:26.731236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96ea1d74-4f18-4160-8fa9-23e8cc3d1985 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:26.967686 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-96ea1d74-4f18-4160-8fa9-23e8cc3d1985 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1648 microversion: 2.1 time: 0.261823 Oct 04 21:38:26.968279 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3002/5985] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:26 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1648 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:27.132510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-67ff127d-dfb7-4e6b-b2b6-afc31b4b7c6d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1129061468", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "availability_zone": "nova:n-h1-860282-1", "networks": [{"uuid": "391ad45e-8ae8-4b96-95da-edc17d6bcfde"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:27.226308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-67ff127d-dfb7-4e6b-b2b6-afc31b4b7c6d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] validate_networks() for [('391ad45e-8ae8-4b96-95da-edc17d6bcfde', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:38:27.501965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-08c90879-41da-4552-8178-dd06f08b99c9 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] Action: 'create', calling method: .version_select at 0x7f578b0b5790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2000630981", "metadata": {"Type": "work"}}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-08c90879-41da-4552-8178-dd06f08b99c9 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] Request method failure captured: Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 122 Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKfTbhuWs2B-8pxi0qgX0oT9BcqdxouE9bX85Vtk_RN-s6P_bexK-Uq0tDhvVJsUPLE4lXa-J_giPXZtspA-6iRVo-EbT0QglsCuyynrA10ALJY7fx5wjWYJYjFoZ8XypZCr41VwLKZBFC06VEs-JlQyFjLCWVmsy_EpzMFSjN_lmkU Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a34cd1dae0a349edbd3ec53dd4cab383 Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-VolumesNegativeTest-998821528 Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a34cd1dae0a349edbd3ec53dd4cab383"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a34cd1dae0a349edbd3ec53dd4cab383"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a34cd1dae0a349edbd3ec53dd4cab383"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a34cd1dae0a349edbd3ec53dd4cab383"}]}] Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-VolumesNegativeTest-998821528 Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a34cd1dae0a349edbd3ec53dd4cab383 Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-VolumesNegativeTest-998821528 Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-VolumesNegativeTest-998821528-project Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: e9a4c686313b4176b28803764cfea626 Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-VolumesNegativeTest-998821528-project Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2000630981", "metadata": {"Type": "work"}}} Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2000630981', 'metadata': {'Type': 'work'}}}} Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:38:27.506819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:38:27.511524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 21:38:27.511524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.511524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:27.511524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.511524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.511524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:27.511524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:27.511524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:38:27.511524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:38:27.511524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 21:38:27.511524 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.511524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-08c90879-41da-4552-8178-dd06f08b99c9 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:38:27.511524 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-08c90879-41da-4552-8178-dd06f08b99c9 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.252879 Oct 04 21:38:27.511524 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3003/5986] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Oct 4 21:38:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 254 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:38:27.518802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-13cb1d06-a7bd-4932-abc3-a90badeb0489 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] Action: 'create', calling method: .version_select at 0x7f578b7803a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1675391107", "metadata": {"Type": "work"}}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-13cb1d06-a7bd-4932-abc3-a90badeb0489 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] Request method failure captured: Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 120 Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKfTbhuWs2B-8pxi0qgX0oT9BcqdxouE9bX85Vtk_RN-s6P_bexK-Uq0tDhvVJsUPLE4lXa-J_giPXZtspA-6iRVo-EbT0QglsCuyynrA10ALJY7fx5wjWYJYjFoZ8XypZCr41VwLKZBFC06VEs-JlQyFjLCWVmsy_EpzMFSjN_lmkU Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a34cd1dae0a349edbd3ec53dd4cab383 Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-VolumesNegativeTest-998821528 Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a34cd1dae0a349edbd3ec53dd4cab383"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a34cd1dae0a349edbd3ec53dd4cab383"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a34cd1dae0a349edbd3ec53dd4cab383"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a34cd1dae0a349edbd3ec53dd4cab383"}]}] Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-VolumesNegativeTest-998821528 Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a34cd1dae0a349edbd3ec53dd4cab383 Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-VolumesNegativeTest-998821528 Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-VolumesNegativeTest-998821528-project Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: e9a4c686313b4176b28803764cfea626 Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-VolumesNegativeTest-998821528-project Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1675391107", "metadata": {"Type": "work"}}} Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1675391107', 'metadata': {'Type': 'work'}}}} Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi '0' Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:38:27.524534 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:38:27.535037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 21:38:27.535037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.535037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:27.535037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.535037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.535037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:27.535037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:27.535037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:38:27.535037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:38:27.535037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 21:38:27.535037 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.535037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-13cb1d06-a7bd-4932-abc3-a90badeb0489 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:38:27.535037 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-13cb1d06-a7bd-4932-abc3-a90badeb0489 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011350 Oct 04 21:38:27.535037 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3004/5987] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Oct 4 21:38:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:38:27.550060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fa254fb2-5143-4bd3-842f-b407cf59c983 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] Action: 'create', calling method: .version_select at 0x7f578b0b5940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-602958774", "metadata": {"Type": "work"}}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fa254fb2-5143-4bd3-842f-b407cf59c983 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] Request method failure captured: Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 118 Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKfTbhuWs2B-8pxi0qgX0oT9BcqdxouE9bX85Vtk_RN-s6P_bexK-Uq0tDhvVJsUPLE4lXa-J_giPXZtspA-6iRVo-EbT0QglsCuyynrA10ALJY7fx5wjWYJYjFoZ8XypZCr41VwLKZBFC06VEs-JlQyFjLCWVmsy_EpzMFSjN_lmkU Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a34cd1dae0a349edbd3ec53dd4cab383 Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-VolumesNegativeTest-998821528 Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a34cd1dae0a349edbd3ec53dd4cab383"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a34cd1dae0a349edbd3ec53dd4cab383"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a34cd1dae0a349edbd3ec53dd4cab383"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a34cd1dae0a349edbd3ec53dd4cab383"}]}] Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-VolumesNegativeTest-998821528 Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a34cd1dae0a349edbd3ec53dd4cab383 Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-VolumesNegativeTest-998821528 Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-VolumesNegativeTest-998821528-project Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: e9a4c686313b4176b28803764cfea626 Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-VolumesNegativeTest-998821528-project Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-602958774", "metadata": {"Type": "work"}}} Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-602958774', 'metadata': {'Type': 'work'}}}} Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi '' Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:38:27.554180 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:38:27.559261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 21:38:27.559261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.559261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:27.559261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.559261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.559261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:27.559261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:27.559261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:38:27.559261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:38:27.559261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 21:38:27.559261 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.559261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fa254fb2-5143-4bd3-842f-b407cf59c983 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:38:27.559261 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fa254fb2-5143-4bd3-842f-b407cf59c983 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012243 Oct 04 21:38:27.563093 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3005/5988] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Oct 4 21:38:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:38:27.590173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bc099846-1cd6-44e4-b887-b0d7d6a729cf tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] Calling method '.version_select at 0x7f578b97c550>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:27.638341 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-bc099846-1cd6-44e4-b887-b0d7d6a729cf tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] HTTP exception thrown: Volume tempest-invalid-1802473176 could not be found. Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bc099846-1cd6-44e4-b887-b0d7d6a729cf tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] Request method failure captured: Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1802473176 HTTP/1.1 Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKfTbhuWs2B-8pxi0qgX0oT9BcqdxouE9bX85Vtk_RN-s6P_bexK-Uq0tDhvVJsUPLE4lXa-J_giPXZtspA-6iRVo-EbT0QglsCuyynrA10ALJY7fx5wjWYJYjFoZ8XypZCr41VwLKZBFC06VEs-JlQyFjLCWVmsy_EpzMFSjN_lmkU Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a34cd1dae0a349edbd3ec53dd4cab383 Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-VolumesNegativeTest-998821528 Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a34cd1dae0a349edbd3ec53dd4cab383"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a34cd1dae0a349edbd3ec53dd4cab383"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a34cd1dae0a349edbd3ec53dd4cab383"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a34cd1dae0a349edbd3ec53dd4cab383"}]}] Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-VolumesNegativeTest-998821528 Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a34cd1dae0a349edbd3ec53dd4cab383 Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-VolumesNegativeTest-998821528 Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-VolumesNegativeTest-998821528-project Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: e9a4c686313b4176b28803764cfea626 Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-VolumesNegativeTest-998821528-project Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: exception: Volume tempest-invalid-1802473176 could not be found. Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'tempest-invalid-1802473176'} Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1802473176 could not be found. (HTTP 404) (Request-ID: req-eb7f4069-47b5-4137-8073-1e014fb75df1) Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:38:27.640765 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1802473176 could not be found. Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1802473176 could not be found. Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1802473176 could not be found. Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bc099846-1cd6-44e4-b887-b0d7d6a729cf tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] Returning 404 to user: Volume tempest-invalid-1802473176 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bc099846-1cd6-44e4-b887-b0d7d6a729cf tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1802473176" status: 404 len: 99 microversion: 2.1 time: 0.066256 Oct 04 21:38:27.649610 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3006/5989] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Oct 4 21:38:27 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1802473176 => generated 99 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:38:27.655214 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eeedf180-30f9-4b4c-8e7b-4c0f877e3792 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004585 Oct 04 21:38:27.656955 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3007/5990] 10.222.0.30 () {58 vars in 1140 bytes} [Tue Oct 4 21:38:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 21:38:27.667052 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bd6861b7-8c6f-4772-9110-03d5f5ffed94 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004213 Oct 04 21:38:27.667579 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3008/5991] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Oct 4 21:38:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 04 21:38:27.679698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8b5f085f-b24f-4786-9718-17c98569d3e5 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] Calling method '.version_select at 0x7f578b780790>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:27.717489 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-8b5f085f-b24f-4786-9718-17c98569d3e5 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] HTTP exception thrown: Volume e2d1c531-f2bf-4a57-be8b-dc9cc379975d could not be found. Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8b5f085f-b24f-4786-9718-17c98569d3e5 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] Request method failure captured: Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/os-volumes/e2d1c531-f2bf-4a57-be8b-dc9cc379975d HTTP/1.1 Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKfTbhuWs2B-8pxi0qgX0oT9BcqdxouE9bX85Vtk_RN-s6P_bexK-Uq0tDhvVJsUPLE4lXa-J_giPXZtspA-6iRVo-EbT0QglsCuyynrA10ALJY7fx5wjWYJYjFoZ8XypZCr41VwLKZBFC06VEs-JlQyFjLCWVmsy_EpzMFSjN_lmkU Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a34cd1dae0a349edbd3ec53dd4cab383 Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-VolumesNegativeTest-998821528 Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a34cd1dae0a349edbd3ec53dd4cab383"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a34cd1dae0a349edbd3ec53dd4cab383"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a34cd1dae0a349edbd3ec53dd4cab383"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a34cd1dae0a349edbd3ec53dd4cab383"}]}] Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-VolumesNegativeTest-998821528 Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a34cd1dae0a349edbd3ec53dd4cab383 Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-VolumesNegativeTest-998821528 Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-VolumesNegativeTest-998821528-project Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: e9a4c686313b4176b28803764cfea626 Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-VolumesNegativeTest-998821528-project Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: exception: Volume e2d1c531-f2bf-4a57-be8b-dc9cc379975d could not be found. Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'e2d1c531-f2bf-4a57-be8b-dc9cc379975d'} Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e2d1c531-f2bf-4a57-be8b-dc9cc379975d could not be found. (HTTP 404) (Request-ID: req-c909e3ed-b357-4b5a-959e-6ffc8c7c7698) Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:38:27.719624 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e2d1c531-f2bf-4a57-be8b-dc9cc379975d could not be found. Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e2d1c531-f2bf-4a57-be8b-dc9cc379975d could not be found. Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e2d1c531-f2bf-4a57-be8b-dc9cc379975d could not be found. Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8b5f085f-b24f-4786-9718-17c98569d3e5 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] Returning 404 to user: Volume e2d1c531-f2bf-4a57-be8b-dc9cc379975d could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8b5f085f-b24f-4786-9718-17c98569d3e5 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/e2d1c531-f2bf-4a57-be8b-dc9cc379975d" status: 404 len: 109 microversion: 2.1 time: 0.046116 Oct 04 21:38:27.723833 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3009/5992] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Oct 4 21:38:27 2022] DELETE /compute/v2.1/os-volumes/e2d1c531-f2bf-4a57-be8b-dc9cc379975d => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:38:27.731534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-341df1ea-2afc-472d-b9e5-c5e427dc5b40 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] Calling method '.version_select at 0x7f578b54f940>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:27.765480 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-341df1ea-2afc-472d-b9e5-c5e427dc5b40 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] HTTP exception thrown: Volume 1f2a0d38-2354-4fd3-9f8f-1d73cdbb6187 could not be found. Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-341df1ea-2afc-472d-b9e5-c5e427dc5b40 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] Request method failure captured: Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-volumes/1f2a0d38-2354-4fd3-9f8f-1d73cdbb6187 HTTP/1.1 Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKfTbhuWs2B-8pxi0qgX0oT9BcqdxouE9bX85Vtk_RN-s6P_bexK-Uq0tDhvVJsUPLE4lXa-J_giPXZtspA-6iRVo-EbT0QglsCuyynrA10ALJY7fx5wjWYJYjFoZ8XypZCr41VwLKZBFC06VEs-JlQyFjLCWVmsy_EpzMFSjN_lmkU Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: a34cd1dae0a349edbd3ec53dd4cab383 Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-VolumesNegativeTest-998821528 Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a34cd1dae0a349edbd3ec53dd4cab383"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a34cd1dae0a349edbd3ec53dd4cab383"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a34cd1dae0a349edbd3ec53dd4cab383"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a34cd1dae0a349edbd3ec53dd4cab383"}]}] Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-VolumesNegativeTest-998821528 Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: a34cd1dae0a349edbd3ec53dd4cab383 Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-VolumesNegativeTest-998821528 Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-VolumesNegativeTest-998821528-project Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: e9a4c686313b4176b28803764cfea626 Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-VolumesNegativeTest-998821528-project Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: exception: Volume 1f2a0d38-2354-4fd3-9f8f-1d73cdbb6187 could not be found. Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '1f2a0d38-2354-4fd3-9f8f-1d73cdbb6187'} Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f2a0d38-2354-4fd3-9f8f-1d73cdbb6187 could not be found. (HTTP 404) (Request-ID: req-c9b6c141-8357-47cb-adc3-23919a9b28df) Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:38:27.768097 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f2a0d38-2354-4fd3-9f8f-1d73cdbb6187 could not be found. Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f2a0d38-2354-4fd3-9f8f-1d73cdbb6187 could not be found. Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f2a0d38-2354-4fd3-9f8f-1d73cdbb6187 could not be found. Oct 04 21:38:27.772445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:27.777059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-341df1ea-2afc-472d-b9e5-c5e427dc5b40 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] Returning 404 to user: Volume 1f2a0d38-2354-4fd3-9f8f-1d73cdbb6187 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:38:27.778318 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-341df1ea-2afc-472d-b9e5-c5e427dc5b40 tempest-VolumesNegativeTest-998821528 tempest-VolumesNegativeTest-998821528-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/1f2a0d38-2354-4fd3-9f8f-1d73cdbb6187" status: 404 len: 109 microversion: 2.1 time: 0.051416 Oct 04 21:38:27.779101 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3010/5993] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:38:27 2022] GET /compute/v2.1/os-volumes/1f2a0d38-2354-4fd3-9f8f-1d73cdbb6187 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:38:27.811375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-67ff127d-dfb7-4e6b-b2b6-afc31b4b7c6d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:38:27.811375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-67ff127d-dfb7-4e6b-b2b6-afc31b4b7c6d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:38:27.811375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-67ff127d-dfb7-4e6b-b2b6-afc31b4b7c6d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:38:27.811375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-67ff127d-dfb7-4e6b-b2b6-afc31b4b7c6d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:38:27.811375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-67ff127d-dfb7-4e6b-b2b6-afc31b4b7c6d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:38:27.833835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67ff127d-dfb7-4e6b-b2b6-afc31b4b7c6d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:27.834346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67ff127d-dfb7-4e6b-b2b6-afc31b4b7c6d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:27.838024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67ff127d-dfb7-4e6b-b2b6-afc31b4b7c6d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:27.843872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67ff127d-dfb7-4e6b-b2b6-afc31b4b7c6d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:27.843872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67ff127d-dfb7-4e6b-b2b6-afc31b4b7c6d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:27.843872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67ff127d-dfb7-4e6b-b2b6-afc31b4b7c6d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:27.876069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-67ff127d-dfb7-4e6b-b2b6-afc31b4b7c6d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Getting quotas for project 4f4953f2d41748c1b0dd0e12adaf29f0. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:38:27.883263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-67ff127d-dfb7-4e6b-b2b6-afc31b4b7c6d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Getting quotas for user c78027172b1c42458dc720d404a26d1e and project 4f4953f2d41748c1b0dd0e12adaf29f0. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:38:27.899180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-67ff127d-dfb7-4e6b-b2b6-afc31b4b7c6d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:38:27.907536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-67ff127d-dfb7-4e6b-b2b6-afc31b4b7c6d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:38:28.127663 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-67ff127d-dfb7-4e6b-b2b6-afc31b4b7c6d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.998809 Oct 04 21:38:28.137547 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2984/5994] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:38:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:38:28.141316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f5a80678-b07e-404c-accd-1d10c3fdf2d7 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:28.142191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f5a80678-b07e-404c-accd-1d10c3fdf2d7 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:28.257492 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f5a80678-b07e-404c-accd-1d10c3fdf2d7 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab" status: 200 len: 1329 microversion: 2.1 time: 0.121774 Oct 04 21:38:28.281159 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3011/5995] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:28 2022] GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab => generated 1329 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:28.959832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-214103bd-56fe-4793-b1d2-7d8440085334 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:28.960492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-214103bd-56fe-4793-b1d2-7d8440085334 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:28.973541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-214103bd-56fe-4793-b1d2-7d8440085334 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:28.975011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-214103bd-56fe-4793-b1d2-7d8440085334 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:28.977945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-214103bd-56fe-4793-b1d2-7d8440085334 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:28.979085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-214103bd-56fe-4793-b1d2-7d8440085334 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:28.979575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-214103bd-56fe-4793-b1d2-7d8440085334 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:28.980019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-214103bd-56fe-4793-b1d2-7d8440085334 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:29.012180 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-214103bd-56fe-4793-b1d2-7d8440085334 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] HTTP exception thrown: Instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 could not be found. Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-214103bd-56fe-4793-b1d2-7d8440085334 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Request method failure captured: Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 HTTP/1.1 Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKZgyJyR7VmgdJLEkwR5b1trzvCrMRVE0S_5kujKYuisXPTH0PySulsZuRNbmG3WvslVrCsoSWnMgpf-657L1tXvTNLwRznlPhAUYg9ID68MS5klN-NTQOWU_PdwOm2JVB2dv_uKL7wuXgdZ824SlPUgTR8Di4X_u_iCw_zbcdP4iVo Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: e2812d680b26415fb5930200c01cb327 Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-474320935 Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2812d680b26415fb5930200c01cb327"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e2812d680b26415fb5930200c01cb327"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e2812d680b26415fb5930200c01cb327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2812d680b26415fb5930200c01cb327"}]}] Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AttachVolumeShelveTestJSON-474320935 Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: e2812d680b26415fb5930200c01cb327 Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-474320935 Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AttachVolumeShelveTestJSON-474320935-project Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 18f3a21b780248d0943136e68b4a4536 Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AttachVolumeShelveTestJSON-474320935-project Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 could not be found. Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '1b27171c-bb6d-43d4-836d-98fa1c3790d8'} Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 could not be found. Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:38:29.014423 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:38:29.018798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 could not be found. Oct 04 21:38:29.018798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:29.018798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:29.018798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:29.018798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:29.018798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:29.018798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:29.018798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:38:29.018798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:38:29.018798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 could not be found. Oct 04 21:38:29.018798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:29.025933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-214103bd-56fe-4793-b1d2-7d8440085334 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Returning 404 to user: Instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:38:29.026830 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-214103bd-56fe-4793-b1d2-7d8440085334 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 404 len: 111 microversion: 2.20 time: 0.072407 Oct 04 21:38:29.033563 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2985/5996] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Oct 4 21:38:28 2022] DELETE /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:38:29.040160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bffe5084-ad4e-4eb2-9bac-55d0f188e8e0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:29.042975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bffe5084-ad4e-4eb2-9bac-55d0f188e8e0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] [instance: 1b27171c-bb6d-43d4-836d-98fa1c3790d8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:29.055993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bffe5084-ad4e-4eb2-9bac-55d0f188e8e0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:29.056890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bffe5084-ad4e-4eb2-9bac-55d0f188e8e0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:29.061693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bffe5084-ad4e-4eb2-9bac-55d0f188e8e0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:29.062472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bffe5084-ad4e-4eb2-9bac-55d0f188e8e0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:29.062958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bffe5084-ad4e-4eb2-9bac-55d0f188e8e0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:29.063403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bffe5084-ad4e-4eb2-9bac-55d0f188e8e0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:29.081357 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-bffe5084-ad4e-4eb2-9bac-55d0f188e8e0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] HTTP exception thrown: Instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 could not be found. Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bffe5084-ad4e-4eb2-9bac-55d0f188e8e0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Request method failure captured: Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 HTTP/1.1 Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKZgyJyR7VmgdJLEkwR5b1trzvCrMRVE0S_5kujKYuisXPTH0PySulsZuRNbmG3WvslVrCsoSWnMgpf-657L1tXvTNLwRznlPhAUYg9ID68MS5klN-NTQOWU_PdwOm2JVB2dv_uKL7wuXgdZ824SlPUgTR8Di4X_u_iCw_zbcdP4iVo Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: e2812d680b26415fb5930200c01cb327 Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-474320935 Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2812d680b26415fb5930200c01cb327"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e2812d680b26415fb5930200c01cb327"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e2812d680b26415fb5930200c01cb327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2812d680b26415fb5930200c01cb327"}]}] Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AttachVolumeShelveTestJSON-474320935 Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: e2812d680b26415fb5930200c01cb327 Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-474320935 Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AttachVolumeShelveTestJSON-474320935-project Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 18f3a21b780248d0943136e68b4a4536 Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AttachVolumeShelveTestJSON-474320935-project Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 could not be found. Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '1b27171c-bb6d-43d4-836d-98fa1c3790d8'} Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 could not be found. Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 could not be found. Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:29.086946 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:29.093304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:29.093304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:29.093304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:29.093304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:29.093304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:38:29.093304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:38:29.093304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 could not be found. Oct 04 21:38:29.093304 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:29.095667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bffe5084-ad4e-4eb2-9bac-55d0f188e8e0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] Returning 404 to user: Instance 1b27171c-bb6d-43d4-836d-98fa1c3790d8 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:38:29.096656 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bffe5084-ad4e-4eb2-9bac-55d0f188e8e0 tempest-AttachVolumeShelveTestJSON-474320935 tempest-AttachVolumeShelveTestJSON-474320935-project] 10.222.0.30 "GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8" status: 404 len: 111 microversion: 2.20 time: 0.062843 Oct 04 21:38:29.097235 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3012/5997] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Oct 4 21:38:29 2022] GET /compute/v2.1/servers/1b27171c-bb6d-43d4-836d-98fa1c3790d8 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:38:29.284469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-875e12d8-d11b-4775-8595-bbe7ece34019 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:29.286496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-875e12d8-d11b-4775-8595-bbe7ece34019 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:29.559339 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-875e12d8-d11b-4775-8595-bbe7ece34019 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab" status: 200 len: 1329 microversion: 2.1 time: 0.278472 Oct 04 21:38:29.559951 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2986/5998] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:29 2022] GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab => generated 1329 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:30.592040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9bc3110b-fda2-46d6-83eb-d369828d2eba tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:30.593609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9bc3110b-fda2-46d6-83eb-d369828d2eba tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:30.606599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9bc3110b-fda2-46d6-83eb-d369828d2eba tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:30.607490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9bc3110b-fda2-46d6-83eb-d369828d2eba tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:30.608565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9bc3110b-fda2-46d6-83eb-d369828d2eba tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:30.609602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9bc3110b-fda2-46d6-83eb-d369828d2eba tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:30.610245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9bc3110b-fda2-46d6-83eb-d369828d2eba tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:30.610855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9bc3110b-fda2-46d6-83eb-d369828d2eba tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:31.262401 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9bc3110b-fda2-46d6-83eb-d369828d2eba tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab" status: 200 len: 1338 microversion: 2.1 time: 0.676026 Oct 04 21:38:31.263580 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3013/5999] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:30 2022] GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab => generated 1338 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:31.305509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-118021e2-9c25-4717-93e5-598aa0b30d16 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0b68a0a-9a61-400e-b83d-0e6f5a42ac10"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:31.308420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-118021e2-9c25-4717-93e5-598aa0b30d16 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:31.334785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-118021e2-9c25-4717-93e5-598aa0b30d16 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:31.335589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-118021e2-9c25-4717-93e5-598aa0b30d16 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:31.336719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-118021e2-9c25-4717-93e5-598aa0b30d16 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:31.340117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-118021e2-9c25-4717-93e5-598aa0b30d16 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:31.340786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-118021e2-9c25-4717-93e5-598aa0b30d16 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:31.341406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-118021e2-9c25-4717-93e5-598aa0b30d16 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:31.529172 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-118021e2-9c25-4717-93e5-598aa0b30d16 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] HTTP exception thrown: Invalid volume: volume e0b68a0a-9a61-400e-b83d-0e6f5a42ac10 is already attached to instances: 836e5756-eb0c-40c6-9581-60a5c270241d Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-118021e2-9c25-4717-93e5-598aa0b30d16 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Request method failure captured: Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments HTTP/1.1 Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 74 Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKbagiGypEfWhrQ_0lE94AP27Qoh0E4iGeIB2v7-1zLRFZVlQCLRG0FD49h9EoPD55kuiioz0fPU1oTFLY5Kkl3L3vqChLMTEe1In4MGHbsFa7Gm-matpM3wFwyWA19l96bcqrryYQdSr6oZRwmQgAqc6hQhUAbifVGqqLh8bVE-KBY Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}] Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 68a2203c15fe41d8ae410f31ba1e1301 Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: {"volumeAttachment": {"volumeId": "e0b68a0a-9a61-400e-b83d-0e6f5a42ac10"}} Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid volume: volume e0b68a0a-9a61-400e-b83d-0e6f5a42ac10 is already attached to instances: 836e5756-eb0c-40c6-9581-60a5c270241d Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'server_id': '836e5756-eb0c-40c6-9581-60a5c270241d', 'body': {'volumeAttachment': {'volumeId': 'e0b68a0a-9a61-400e-b83d-0e6f5a42ac10'}}} Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e0b68a0a-9a61-400e-b83d-0e6f5a42ac10 is already attached to instances: 836e5756-eb0c-40c6-9581-60a5c270241d Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:38:31.539309 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:38:31.549569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:38:31.549569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:38:31.549569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 21:38:31.549569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 21:38:31.549569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e0b68a0a-9a61-400e-b83d-0e6f5a42ac10 is already attached to instances: 836e5756-eb0c-40c6-9581-60a5c270241d Oct 04 21:38:31.549569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:31.549569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:31.549569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:31.549569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:31.549569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:31.549569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:31.549569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:38:31.549569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:38:31.549569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e0b68a0a-9a61-400e-b83d-0e6f5a42ac10 is already attached to instances: 836e5756-eb0c-40c6-9581-60a5c270241d Oct 04 21:38:31.549569 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:31.549569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-118021e2-9c25-4717-93e5-598aa0b30d16 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Returning 400 to user: Invalid volume: volume e0b68a0a-9a61-400e-b83d-0e6f5a42ac10 is already attached to instances: 836e5756-eb0c-40c6-9581-60a5c270241d {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:38:31.549569 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-118021e2-9c25-4717-93e5-598aa0b30d16 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "POST /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.240424 Oct 04 21:38:31.549569 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2987/6000] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 21:38:31 2022] POST /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments => generated 174 bytes in 242 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:38:31.642478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2f861b34-ae54-424a-9417-d3ee3d2ebf71 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:31.642478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2f861b34-ae54-424a-9417-d3ee3d2ebf71 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:31.648559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f861b34-ae54-424a-9417-d3ee3d2ebf71 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:31.649410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f861b34-ae54-424a-9417-d3ee3d2ebf71 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:31.650052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f861b34-ae54-424a-9417-d3ee3d2ebf71 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:31.654128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f861b34-ae54-424a-9417-d3ee3d2ebf71 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:31.654621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f861b34-ae54-424a-9417-d3ee3d2ebf71 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:31.655069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f861b34-ae54-424a-9417-d3ee3d2ebf71 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:31.820625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-2f861b34-ae54-424a-9417-d3ee3d2ebf71 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lazy-loading 'services' on Instance uuid 836e5756-eb0c-40c6-9581-60a5c270241d {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:38:32.074434 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2f861b34-ae54-424a-9417-d3ee3d2ebf71 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "DELETE /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments/e0b68a0a-9a61-400e-b83d-0e6f5a42ac10" status: 202 len: 0 microversion: 2.1 time: 0.439155 Oct 04 21:38:32.075131 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3014/6001] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 21:38:31 2022] DELETE /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments/e0b68a0a-9a61-400e-b83d-0e6f5a42ac10 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:38:32.086672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c4131369-cf46-44ab-b899-2bfe3c01066c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:32.089716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c4131369-cf46-44ab-b899-2bfe3c01066c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:32.105134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4131369-cf46-44ab-b899-2bfe3c01066c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:32.110712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4131369-cf46-44ab-b899-2bfe3c01066c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:32.110712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4131369-cf46-44ab-b899-2bfe3c01066c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:32.110712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4131369-cf46-44ab-b899-2bfe3c01066c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:32.111096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4131369-cf46-44ab-b899-2bfe3c01066c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:32.112717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4131369-cf46-44ab-b899-2bfe3c01066c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:32.186563 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c4131369-cf46-44ab-b899-2bfe3c01066c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105083 Oct 04 21:38:32.193295 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2988/6002] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:38:32 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:32.304202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-952c5bbc-b5f1-40f6-b41d-2b3907b0a98d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:32.305307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-952c5bbc-b5f1-40f6-b41d-2b3907b0a98d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:32.322175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-952c5bbc-b5f1-40f6-b41d-2b3907b0a98d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:32.324255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-952c5bbc-b5f1-40f6-b41d-2b3907b0a98d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:32.326865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-952c5bbc-b5f1-40f6-b41d-2b3907b0a98d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:32.331633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-952c5bbc-b5f1-40f6-b41d-2b3907b0a98d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:32.338811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-952c5bbc-b5f1-40f6-b41d-2b3907b0a98d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:32.339442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-952c5bbc-b5f1-40f6-b41d-2b3907b0a98d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:32.656500 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-952c5bbc-b5f1-40f6-b41d-2b3907b0a98d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab" status: 200 len: 1422 microversion: 2.1 time: 0.355485 Oct 04 21:38:32.659602 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3015/6003] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:32 2022] GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab => generated 1422 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:33.202049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8d9e4189-c846-4d44-8f04-6a7f1209e912 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:33.207084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8d9e4189-c846-4d44-8f04-6a7f1209e912 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:33.244493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d9e4189-c846-4d44-8f04-6a7f1209e912 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:33.244493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d9e4189-c846-4d44-8f04-6a7f1209e912 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:33.244493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d9e4189-c846-4d44-8f04-6a7f1209e912 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:33.244493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d9e4189-c846-4d44-8f04-6a7f1209e912 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:33.244493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d9e4189-c846-4d44-8f04-6a7f1209e912 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:33.244493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d9e4189-c846-4d44-8f04-6a7f1209e912 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:33.316227 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8d9e4189-c846-4d44-8f04-6a7f1209e912 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121179 Oct 04 21:38:33.318578 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2989/6004] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:38:33 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:33.684253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e0ff9986-7338-4d21-adcc-f826a105e686 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:33.685511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e0ff9986-7338-4d21-adcc-f826a105e686 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:33.697198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0ff9986-7338-4d21-adcc-f826a105e686 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:33.698020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0ff9986-7338-4d21-adcc-f826a105e686 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:33.700817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0ff9986-7338-4d21-adcc-f826a105e686 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:33.702127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0ff9986-7338-4d21-adcc-f826a105e686 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:33.702831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0ff9986-7338-4d21-adcc-f826a105e686 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:33.705063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0ff9986-7338-4d21-adcc-f826a105e686 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:34.336723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ff469e03-91c4-466a-bf24-2884acb82824 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:34.343644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ff469e03-91c4-466a-bf24-2884acb82824 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:34.350035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff469e03-91c4-466a-bf24-2884acb82824 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:34.354106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff469e03-91c4-466a-bf24-2884acb82824 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:34.354814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff469e03-91c4-466a-bf24-2884acb82824 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:34.355769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff469e03-91c4-466a-bf24-2884acb82824 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:34.358198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff469e03-91c4-466a-bf24-2884acb82824 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:34.358915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff469e03-91c4-466a-bf24-2884acb82824 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:34.431339 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ff469e03-91c4-466a-bf24-2884acb82824 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104521 Oct 04 21:38:34.436995 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2990/6005] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:38:34 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:34.449477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:34.490180 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e0ff9986-7338-4d21-adcc-f826a105e686 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab" status: 200 len: 1464 microversion: 2.1 time: 0.779355 Oct 04 21:38:34.490180 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3016/6006] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:33 2022] GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab => generated 1464 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:35.315313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-62483b0b-9024-4210-b37d-b96af27ab80e req-d14957f4-234f-4904-bc07-dcf6c013c94a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3df6593-609d-4778-a942-1620d932bdab", "tag": "ffbe2070-17ea-4d95-8fce-e8003fd49f7a"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:35.340401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-62483b0b-9024-4210-b37d-b96af27ab80e req-d14957f4-234f-4904-bc07-dcf6c013c94a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:35.340985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-62483b0b-9024-4210-b37d-b96af27ab80e req-d14957f4-234f-4904-bc07-dcf6c013c94a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:35.343545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-62483b0b-9024-4210-b37d-b96af27ab80e req-d14957f4-234f-4904-bc07-dcf6c013c94a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:35.405985 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-62483b0b-9024-4210-b37d-b96af27ab80e req-d14957f4-234f-4904-bc07-dcf6c013c94a service nova] Creating event network-changed:ffbe2070-17ea-4d95-8fce-e8003fd49f7a for instance b3df6593-609d-4778-a942-1620d932bdab on n-h1-860282-1 Oct 04 21:38:35.423440 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-62483b0b-9024-4210-b37d-b96af27ab80e req-d14957f4-234f-4904-bc07-dcf6c013c94a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107950 Oct 04 21:38:35.429467 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2991/6007] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:35.446968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-53a07c39-80e2-4d99-97e3-914e0e5a0393 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:35.450443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-53a07c39-80e2-4d99-97e3-914e0e5a0393 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:35.465642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53a07c39-80e2-4d99-97e3-914e0e5a0393 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:35.466394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53a07c39-80e2-4d99-97e3-914e0e5a0393 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:35.467013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53a07c39-80e2-4d99-97e3-914e0e5a0393 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:35.468146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53a07c39-80e2-4d99-97e3-914e0e5a0393 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:35.468927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53a07c39-80e2-4d99-97e3-914e0e5a0393 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:35.469567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53a07c39-80e2-4d99-97e3-914e0e5a0393 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:35.494103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1b6cf0a5-7460-49f8-ab8c-5c5fc8a91246 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:35.494820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1b6cf0a5-7460-49f8-ab8c-5c5fc8a91246 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:35.508982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b6cf0a5-7460-49f8-ab8c-5c5fc8a91246 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:35.509779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b6cf0a5-7460-49f8-ab8c-5c5fc8a91246 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:35.524680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b6cf0a5-7460-49f8-ab8c-5c5fc8a91246 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:35.525818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b6cf0a5-7460-49f8-ab8c-5c5fc8a91246 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:35.526319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b6cf0a5-7460-49f8-ab8c-5c5fc8a91246 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:35.526763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b6cf0a5-7460-49f8-ab8c-5c5fc8a91246 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:35.536846 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-53a07c39-80e2-4d99-97e3-914e0e5a0393 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096419 Oct 04 21:38:35.538765 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3017/6008] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:38:35 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:35.981071 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1b6cf0a5-7460-49f8-ab8c-5c5fc8a91246 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab" status: 200 len: 1464 microversion: 2.1 time: 0.491162 Oct 04 21:38:35.981842 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2992/6009] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:35 2022] GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab => generated 1464 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:36.559326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bf2d043c-b7da-455a-b61b-eb9642a27c8f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:36.563524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bf2d043c-b7da-455a-b61b-eb9642a27c8f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:36.602299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf2d043c-b7da-455a-b61b-eb9642a27c8f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:36.609258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf2d043c-b7da-455a-b61b-eb9642a27c8f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:36.609873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf2d043c-b7da-455a-b61b-eb9642a27c8f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:36.614663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf2d043c-b7da-455a-b61b-eb9642a27c8f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:36.615457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf2d043c-b7da-455a-b61b-eb9642a27c8f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:36.623104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf2d043c-b7da-455a-b61b-eb9642a27c8f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:36.686744 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bf2d043c-b7da-455a-b61b-eb9642a27c8f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138925 Oct 04 21:38:36.692328 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3018/6010] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:38:36 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:37.012131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b7ae5c3f-0e41-442a-ad59-4f9cb56356b9 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:37.021456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b7ae5c3f-0e41-442a-ad59-4f9cb56356b9 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:37.045203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7ae5c3f-0e41-442a-ad59-4f9cb56356b9 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:37.053971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7ae5c3f-0e41-442a-ad59-4f9cb56356b9 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:37.055925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7ae5c3f-0e41-442a-ad59-4f9cb56356b9 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:37.056808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7ae5c3f-0e41-442a-ad59-4f9cb56356b9 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:37.057397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7ae5c3f-0e41-442a-ad59-4f9cb56356b9 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:37.057974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7ae5c3f-0e41-442a-ad59-4f9cb56356b9 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:37.702907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ef855dd9-118e-4f92-bbc6-f595eee5233d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:37.705977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ef855dd9-118e-4f92-bbc6-f595eee5233d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:37.732274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef855dd9-118e-4f92-bbc6-f595eee5233d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:37.749468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef855dd9-118e-4f92-bbc6-f595eee5233d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:37.749468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef855dd9-118e-4f92-bbc6-f595eee5233d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:37.749468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef855dd9-118e-4f92-bbc6-f595eee5233d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:37.749468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef855dd9-118e-4f92-bbc6-f595eee5233d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:37.749468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef855dd9-118e-4f92-bbc6-f595eee5233d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:37.855768 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ef855dd9-118e-4f92-bbc6-f595eee5233d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159838 Oct 04 21:38:37.865512 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3019/6011] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:38:37 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:37.867769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:38.056817 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b7ae5c3f-0e41-442a-ad59-4f9cb56356b9 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab" status: 200 len: 1464 microversion: 2.1 time: 1.048269 Oct 04 21:38:38.058578 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2993/6012] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:37 2022] GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab => generated 1464 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:38.879524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-77486a2f-2cd6-4a69-9c88-d52fb5107faf tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:38.879524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-77486a2f-2cd6-4a69-9c88-d52fb5107faf tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:38.882907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:38.888076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77486a2f-2cd6-4a69-9c88-d52fb5107faf tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:38.888707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77486a2f-2cd6-4a69-9c88-d52fb5107faf tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:38.889111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77486a2f-2cd6-4a69-9c88-d52fb5107faf tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:38.890338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77486a2f-2cd6-4a69-9c88-d52fb5107faf tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:38.890955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77486a2f-2cd6-4a69-9c88-d52fb5107faf tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:38.891614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77486a2f-2cd6-4a69-9c88-d52fb5107faf tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:38.958124 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-77486a2f-2cd6-4a69-9c88-d52fb5107faf tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088943 Oct 04 21:38:38.961068 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3020/6013] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:38:38 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:39.086012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c777b5f2-2e8b-410f-b3fb-2ec4c21825b1 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:39.086826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c777b5f2-2e8b-410f-b3fb-2ec4c21825b1 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:39.094879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c777b5f2-2e8b-410f-b3fb-2ec4c21825b1 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:39.095668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c777b5f2-2e8b-410f-b3fb-2ec4c21825b1 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:39.096353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c777b5f2-2e8b-410f-b3fb-2ec4c21825b1 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:39.097290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c777b5f2-2e8b-410f-b3fb-2ec4c21825b1 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:39.098706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c777b5f2-2e8b-410f-b3fb-2ec4c21825b1 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:39.099434 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c777b5f2-2e8b-410f-b3fb-2ec4c21825b1 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:39.125180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:39.464712 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c777b5f2-2e8b-410f-b3fb-2ec4c21825b1 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab" status: 200 len: 1464 microversion: 2.1 time: 0.383015 Oct 04 21:38:39.469162 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2994/6014] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:39 2022] GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab => generated 1464 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:39.979168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b2161d36-a5b6-4f52-8641-6dd798807eba tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:39.984963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b2161d36-a5b6-4f52-8641-6dd798807eba tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:40.012844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2161d36-a5b6-4f52-8641-6dd798807eba tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:40.013356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2161d36-a5b6-4f52-8641-6dd798807eba tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:40.013837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2161d36-a5b6-4f52-8641-6dd798807eba tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:40.014559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2161d36-a5b6-4f52-8641-6dd798807eba tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:40.026683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2161d36-a5b6-4f52-8641-6dd798807eba tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:40.026683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2161d36-a5b6-4f52-8641-6dd798807eba tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:40.098250 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b2161d36-a5b6-4f52-8641-6dd798807eba tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129448 Oct 04 21:38:40.101639 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3021/6015] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:38:39 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:40.493696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-20500156-1a78-4bed-b514-f5130810bace tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:40.494464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-20500156-1a78-4bed-b514-f5130810bace tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:40.498918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:40.525453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20500156-1a78-4bed-b514-f5130810bace tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:40.543462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20500156-1a78-4bed-b514-f5130810bace tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:40.544068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20500156-1a78-4bed-b514-f5130810bace tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:40.546185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20500156-1a78-4bed-b514-f5130810bace tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:40.546763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20500156-1a78-4bed-b514-f5130810bace tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:40.549331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20500156-1a78-4bed-b514-f5130810bace tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:40.850161 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-20500156-1a78-4bed-b514-f5130810bace tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab" status: 200 len: 1464 microversion: 2.1 time: 0.359865 Oct 04 21:38:40.850783 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2995/6016] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:40 2022] GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab => generated 1464 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:41.005602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-12004729-45ef-4e25-b88b-90b096c901ad req-32e9b1cf-e36d-4286-b083-149a57984ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3df6593-609d-4778-a942-1620d932bdab", "name": "network-vif-plugged", "status": "completed", "tag": "ffbe2070-17ea-4d95-8fce-e8003fd49f7a"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:41.020266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-12004729-45ef-4e25-b88b-90b096c901ad req-32e9b1cf-e36d-4286-b083-149a57984ff4 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:41.021363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-12004729-45ef-4e25-b88b-90b096c901ad req-32e9b1cf-e36d-4286-b083-149a57984ff4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:41.021958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-12004729-45ef-4e25-b88b-90b096c901ad req-32e9b1cf-e36d-4286-b083-149a57984ff4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:41.034298 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-12004729-45ef-4e25-b88b-90b096c901ad req-32e9b1cf-e36d-4286-b083-149a57984ff4 service nova] Creating event network-vif-plugged:ffbe2070-17ea-4d95-8fce-e8003fd49f7a for instance b3df6593-609d-4778-a942-1620d932bdab on n-h1-860282-1 Oct 04 21:38:41.040904 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-12004729-45ef-4e25-b88b-90b096c901ad req-32e9b1cf-e36d-4286-b083-149a57984ff4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040145 Oct 04 21:38:41.042562 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3022/6017] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:41.114327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-88eae98f-64d8-41bf-a04a-9a430b2f8ee0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:41.117711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-88eae98f-64d8-41bf-a04a-9a430b2f8ee0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:41.124851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88eae98f-64d8-41bf-a04a-9a430b2f8ee0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:41.125921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88eae98f-64d8-41bf-a04a-9a430b2f8ee0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:41.126704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88eae98f-64d8-41bf-a04a-9a430b2f8ee0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:41.128448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88eae98f-64d8-41bf-a04a-9a430b2f8ee0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:41.129492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88eae98f-64d8-41bf-a04a-9a430b2f8ee0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:41.130240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88eae98f-64d8-41bf-a04a-9a430b2f8ee0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:41.173674 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-88eae98f-64d8-41bf-a04a-9a430b2f8ee0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064356 Oct 04 21:38:41.175156 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2996/6018] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:38:41 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:41.881923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5cc2fc51-842c-4e62-87e7-d36db9c56174 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:41.883344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5cc2fc51-842c-4e62-87e7-d36db9c56174 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:41.903949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cc2fc51-842c-4e62-87e7-d36db9c56174 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:41.907389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cc2fc51-842c-4e62-87e7-d36db9c56174 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:41.907833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cc2fc51-842c-4e62-87e7-d36db9c56174 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:41.909815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cc2fc51-842c-4e62-87e7-d36db9c56174 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:41.914800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cc2fc51-842c-4e62-87e7-d36db9c56174 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:41.915366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5cc2fc51-842c-4e62-87e7-d36db9c56174 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:42.131256 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5cc2fc51-842c-4e62-87e7-d36db9c56174 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab" status: 200 len: 1464 microversion: 2.1 time: 0.257010 Oct 04 21:38:42.149639 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3023/6019] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:41 2022] GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab => generated 1464 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:42.188674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3e57dae5-9607-4b7d-be1a-5524862ba72d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:42.191697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3e57dae5-9607-4b7d-be1a-5524862ba72d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:42.202673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e57dae5-9607-4b7d-be1a-5524862ba72d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:42.203292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e57dae5-9607-4b7d-be1a-5524862ba72d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:42.203952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e57dae5-9607-4b7d-be1a-5524862ba72d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:42.204866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e57dae5-9607-4b7d-be1a-5524862ba72d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:42.205547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e57dae5-9607-4b7d-be1a-5524862ba72d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:42.206204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e57dae5-9607-4b7d-be1a-5524862ba72d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:42.246454 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3e57dae5-9607-4b7d-be1a-5524862ba72d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063703 Oct 04 21:38:42.247590 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2997/6020] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:38:42 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:38:42.356994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d124ce0b-f345-494b-aca3-5c734d57c6e6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:42.370377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d124ce0b-f345-494b-aca3-5c734d57c6e6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:42.379413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d124ce0b-f345-494b-aca3-5c734d57c6e6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:42.386810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d124ce0b-f345-494b-aca3-5c734d57c6e6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:42.386810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d124ce0b-f345-494b-aca3-5c734d57c6e6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:42.386810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d124ce0b-f345-494b-aca3-5c734d57c6e6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:42.390315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d124ce0b-f345-494b-aca3-5c734d57c6e6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:42.390773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d124ce0b-f345-494b-aca3-5c734d57c6e6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:42.477520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d124ce0b-f345-494b-aca3-5c734d57c6e6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:38:42.949169 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d124ce0b-f345-494b-aca3-5c734d57c6e6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "DELETE /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 204 len: 0 microversion: 2.1 time: 0.604284 Oct 04 21:38:42.950325 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3024/6021] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:38:42 2022] DELETE /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 0 bytes in 606 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:38:42.958676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5b478796-dab8-4965-b8ce-4f6c6353b549 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:42.964739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5b478796-dab8-4965-b8ce-4f6c6353b549 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:42.965849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5b478796-dab8-4965-b8ce-4f6c6353b549 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:42.966505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5b478796-dab8-4965-b8ce-4f6c6353b549 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:42.967090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5b478796-dab8-4965-b8ce-4f6c6353b549 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:42.968090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5b478796-dab8-4965-b8ce-4f6c6353b549 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:42.968698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5b478796-dab8-4965-b8ce-4f6c6353b549 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:42.969275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5b478796-dab8-4965-b8ce-4f6c6353b549 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:43.162549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-69b00a85-127c-4d9a-a26f-4439a299cff4 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:43.163858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-69b00a85-127c-4d9a-a26f-4439a299cff4 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:43.172160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69b00a85-127c-4d9a-a26f-4439a299cff4 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:43.172880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69b00a85-127c-4d9a-a26f-4439a299cff4 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:43.178287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69b00a85-127c-4d9a-a26f-4439a299cff4 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:43.179492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69b00a85-127c-4d9a-a26f-4439a299cff4 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:43.180184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69b00a85-127c-4d9a-a26f-4439a299cff4 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:43.180847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69b00a85-127c-4d9a-a26f-4439a299cff4 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:43.309253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5b478796-dab8-4965-b8ce-4f6c6353b549 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:43.318268 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5b478796-dab8-4965-b8ce-4f6c6353b549 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1682 microversion: 2.1 time: 0.363574 Oct 04 21:38:43.318841 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2998/6022] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:42 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1682 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:43.428156 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-69b00a85-127c-4d9a-a26f-4439a299cff4 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab" status: 200 len: 1649 microversion: 2.1 time: 0.273618 Oct 04 21:38:43.448727 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3025/6023] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:43 2022] GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab => generated 1649 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:43.456106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2bd5ea72-ba1a-48ab-9620-d75f5556f0ff tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:43.457117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2bd5ea72-ba1a-48ab-9620-d75f5556f0ff tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:43.469854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bd5ea72-ba1a-48ab-9620-d75f5556f0ff tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:43.471326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bd5ea72-ba1a-48ab-9620-d75f5556f0ff tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:43.471962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bd5ea72-ba1a-48ab-9620-d75f5556f0ff tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:43.480267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bd5ea72-ba1a-48ab-9620-d75f5556f0ff tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:43.481000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bd5ea72-ba1a-48ab-9620-d75f5556f0ff tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:43.484455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bd5ea72-ba1a-48ab-9620-d75f5556f0ff tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:43.717817 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2bd5ea72-ba1a-48ab-9620-d75f5556f0ff tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab" status: 200 len: 1649 microversion: 2.1 time: 0.268251 Oct 04 21:38:43.719275 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 2999/6024] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:43 2022] GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab => generated 1649 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:43.741590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bfc61e12-c876-4f41-b946-3049d85c4e5d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:43.742404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bfc61e12-c876-4f41-b946-3049d85c4e5d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:43.748667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfc61e12-c876-4f41-b946-3049d85c4e5d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:43.749819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfc61e12-c876-4f41-b946-3049d85c4e5d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:43.750268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfc61e12-c876-4f41-b946-3049d85c4e5d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:43.751481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfc61e12-c876-4f41-b946-3049d85c4e5d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:43.752236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfc61e12-c876-4f41-b946-3049d85c4e5d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:43.752668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfc61e12-c876-4f41-b946-3049d85c4e5d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:44.021688 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bfc61e12-c876-4f41-b946-3049d85c4e5d tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab" status: 200 len: 1649 microversion: 2.1 time: 0.284595 Oct 04 21:38:44.022968 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3026/6025] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:43 2022] GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab => generated 1649 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:44.047125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-18c87718-55ff-420f-b924-72b718b6ee4e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:44.047965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-18c87718-55ff-420f-b924-72b718b6ee4e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:44.054353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18c87718-55ff-420f-b924-72b718b6ee4e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:44.055094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18c87718-55ff-420f-b924-72b718b6ee4e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:44.055721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18c87718-55ff-420f-b924-72b718b6ee4e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:44.056651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18c87718-55ff-420f-b924-72b718b6ee4e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:44.057265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18c87718-55ff-420f-b924-72b718b6ee4e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:44.057865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-18c87718-55ff-420f-b924-72b718b6ee4e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:44.088207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-18c87718-55ff-420f-b924-72b718b6ee4e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:38:44.345873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a5d5e01c-8b93-4bbc-a987-b09efa024c1f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:44.345873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a5d5e01c-8b93-4bbc-a987-b09efa024c1f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:44.355979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5d5e01c-8b93-4bbc-a987-b09efa024c1f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:44.357518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5d5e01c-8b93-4bbc-a987-b09efa024c1f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:44.358034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5d5e01c-8b93-4bbc-a987-b09efa024c1f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:44.359146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5d5e01c-8b93-4bbc-a987-b09efa024c1f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:44.359623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5d5e01c-8b93-4bbc-a987-b09efa024c1f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:44.362322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5d5e01c-8b93-4bbc-a987-b09efa024c1f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:44.470991 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-18c87718-55ff-420f-b924-72b718b6ee4e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab" status: 204 len: 0 microversion: 2.1 time: 0.420682 Oct 04 21:38:44.470991 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3000/6026] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:38:44 2022] DELETE /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:38:44.477813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f739f885-90d1-4ede-a2dd-cd6c131d595c tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:44.478874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f739f885-90d1-4ede-a2dd-cd6c131d595c tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:44.491642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f739f885-90d1-4ede-a2dd-cd6c131d595c tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:44.494535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f739f885-90d1-4ede-a2dd-cd6c131d595c tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:44.495154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f739f885-90d1-4ede-a2dd-cd6c131d595c tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:44.497490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f739f885-90d1-4ede-a2dd-cd6c131d595c tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:44.502190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f739f885-90d1-4ede-a2dd-cd6c131d595c tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:44.504602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f739f885-90d1-4ede-a2dd-cd6c131d595c tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:44.714466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a5d5e01c-8b93-4bbc-a987-b09efa024c1f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:44.722621 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a5d5e01c-8b93-4bbc-a987-b09efa024c1f tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1682 microversion: 2.1 time: 0.382979 Oct 04 21:38:44.723271 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3027/6027] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:44 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1682 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:44.793866 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f739f885-90d1-4ede-a2dd-cd6c131d595c tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab" status: 200 len: 1655 microversion: 2.1 time: 0.323234 Oct 04 21:38:44.813939 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3001/6028] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:44 2022] GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab => generated 1655 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:45.751311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1127e49e-6f2d-4100-8b97-e0a619d57375 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:45.752071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1127e49e-6f2d-4100-8b97-e0a619d57375 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:45.764939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1127e49e-6f2d-4100-8b97-e0a619d57375 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:45.767901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1127e49e-6f2d-4100-8b97-e0a619d57375 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:45.768483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1127e49e-6f2d-4100-8b97-e0a619d57375 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:45.769953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1127e49e-6f2d-4100-8b97-e0a619d57375 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:45.772596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1127e49e-6f2d-4100-8b97-e0a619d57375 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:45.773780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1127e49e-6f2d-4100-8b97-e0a619d57375 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:45.821734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-93992360-1992-4bf2-95d2-17eeb8b7f33e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:45.823211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-93992360-1992-4bf2-95d2-17eeb8b7f33e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:45.840172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93992360-1992-4bf2-95d2-17eeb8b7f33e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:45.845036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93992360-1992-4bf2-95d2-17eeb8b7f33e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:45.846727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93992360-1992-4bf2-95d2-17eeb8b7f33e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:45.847676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93992360-1992-4bf2-95d2-17eeb8b7f33e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:45.848495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93992360-1992-4bf2-95d2-17eeb8b7f33e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:45.855336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93992360-1992-4bf2-95d2-17eeb8b7f33e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:46.573619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1127e49e-6f2d-4100-8b97-e0a619d57375 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:46.580175 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-93992360-1992-4bf2-95d2-17eeb8b7f33e tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab" status: 200 len: 1655 microversion: 2.1 time: 0.763543 Oct 04 21:38:46.582972 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3002/6029] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:45 2022] GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab => generated 1655 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:46.607747 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1127e49e-6f2d-4100-8b97-e0a619d57375 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1682 microversion: 2.1 time: 0.861764 Oct 04 21:38:46.608348 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3028/6030] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:45 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1682 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:47.214388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-abcee5d3-d509-4a7a-a819-72c47ec34f1d req-9fb13ea2-0d07-4fc7-8a14-0cffca5869ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3df6593-609d-4778-a942-1620d932bdab", "name": "network-vif-deleted", "tag": "ffbe2070-17ea-4d95-8fce-e8003fd49f7a"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:47.226701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-abcee5d3-d509-4a7a-a819-72c47ec34f1d req-9fb13ea2-0d07-4fc7-8a14-0cffca5869ea service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:47.227186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-abcee5d3-d509-4a7a-a819-72c47ec34f1d req-9fb13ea2-0d07-4fc7-8a14-0cffca5869ea service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:47.230094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-abcee5d3-d509-4a7a-a819-72c47ec34f1d req-9fb13ea2-0d07-4fc7-8a14-0cffca5869ea service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:47.250609 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-abcee5d3-d509-4a7a-a819-72c47ec34f1d req-9fb13ea2-0d07-4fc7-8a14-0cffca5869ea service nova] Creating event network-vif-deleted:ffbe2070-17ea-4d95-8fce-e8003fd49f7a for instance b3df6593-609d-4778-a942-1620d932bdab on n-h1-860282-1 Oct 04 21:38:47.259083 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-abcee5d3-d509-4a7a-a819-72c47ec34f1d req-9fb13ea2-0d07-4fc7-8a14-0cffca5869ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048580 Oct 04 21:38:47.261898 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3003/6031] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:47.621693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-de05e092-81b4-4498-aa7e-3f296e351477 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:47.621693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-de05e092-81b4-4498-aa7e-3f296e351477 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:47.638359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de05e092-81b4-4498-aa7e-3f296e351477 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:47.639047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1363be74-944e-4d70-893a-b0f008cb5f97 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:47.639961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1363be74-944e-4d70-893a-b0f008cb5f97 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:47.640130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de05e092-81b4-4498-aa7e-3f296e351477 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:47.641523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de05e092-81b4-4498-aa7e-3f296e351477 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:47.645136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de05e092-81b4-4498-aa7e-3f296e351477 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:47.645136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de05e092-81b4-4498-aa7e-3f296e351477 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:47.646029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de05e092-81b4-4498-aa7e-3f296e351477 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:47.653565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1363be74-944e-4d70-893a-b0f008cb5f97 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:47.654137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1363be74-944e-4d70-893a-b0f008cb5f97 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:47.654575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1363be74-944e-4d70-893a-b0f008cb5f97 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:47.655463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1363be74-944e-4d70-893a-b0f008cb5f97 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:47.657028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1363be74-944e-4d70-893a-b0f008cb5f97 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:47.657815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1363be74-944e-4d70-893a-b0f008cb5f97 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:47.723212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de05e092-81b4-4498-aa7e-3f296e351477 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:47.723888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de05e092-81b4-4498-aa7e-3f296e351477 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:47.725128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de05e092-81b4-4498-aa7e-3f296e351477 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:47.726135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-de05e092-81b4-4498-aa7e-3f296e351477 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lazy-loading 'fault' on Instance uuid b3df6593-609d-4778-a942-1620d932bdab {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:38:47.788392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1363be74-944e-4d70-893a-b0f008cb5f97 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:47.908580 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1363be74-944e-4d70-893a-b0f008cb5f97 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1615 microversion: 2.1 time: 0.166106 Oct 04 21:38:47.908580 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3004/6032] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:47 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1615 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:47.908580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-e334f282-846a-48c8-affa-b9911106dd00 req-225d8624-3ad4-48d7-85a8-a06fcc15352f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836e5756-eb0c-40c6-9581-60a5c270241d", "name": "network-vif-deleted", "tag": "6e1667b3-0579-44a9-a051-cb48711b0b8d"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:47.908580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e334f282-846a-48c8-affa-b9911106dd00 req-225d8624-3ad4-48d7-85a8-a06fcc15352f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:47.908580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e334f282-846a-48c8-affa-b9911106dd00 req-225d8624-3ad4-48d7-85a8-a06fcc15352f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:47.908580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e334f282-846a-48c8-affa-b9911106dd00 req-225d8624-3ad4-48d7-85a8-a06fcc15352f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:47.908580 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-e334f282-846a-48c8-affa-b9911106dd00 req-225d8624-3ad4-48d7-85a8-a06fcc15352f service nova] Creating event network-vif-deleted:6e1667b3-0579-44a9-a051-cb48711b0b8d for instance 836e5756-eb0c-40c6-9581-60a5c270241d on n-h1-860282-1 Oct 04 21:38:47.908580 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-e334f282-846a-48c8-affa-b9911106dd00 req-225d8624-3ad4-48d7-85a8-a06fcc15352f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062515 Oct 04 21:38:47.908580 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3005/6033] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:38:47.911119 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-de05e092-81b4-4498-aa7e-3f296e351477 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab" status: 200 len: 1454 microversion: 2.1 time: 0.287902 Oct 04 21:38:47.911119 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3029/6034] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:47 2022] GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab => generated 1454 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:48.833293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-60832bc2-63cb-4493-9256-f4564a9d072a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:48.835409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-60832bc2-63cb-4493-9256-f4564a9d072a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:48.856196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60832bc2-63cb-4493-9256-f4564a9d072a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:48.859175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60832bc2-63cb-4493-9256-f4564a9d072a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:48.859738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60832bc2-63cb-4493-9256-f4564a9d072a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:48.862275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60832bc2-63cb-4493-9256-f4564a9d072a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:48.863656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60832bc2-63cb-4493-9256-f4564a9d072a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:48.873166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60832bc2-63cb-4493-9256-f4564a9d072a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:48.924179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9f62986c-d1e7-4683-9ceb-bdbc071dfcd7 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:48.924769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9f62986c-d1e7-4683-9ceb-bdbc071dfcd7 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: b3df6593-609d-4778-a942-1620d932bdab] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:48.934160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60832bc2-63cb-4493-9256-f4564a9d072a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:48.934921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60832bc2-63cb-4493-9256-f4564a9d072a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:48.935581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60832bc2-63cb-4493-9256-f4564a9d072a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:48.935927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f62986c-d1e7-4683-9ceb-bdbc071dfcd7 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:48.936433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f62986c-d1e7-4683-9ceb-bdbc071dfcd7 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:48.936739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-60832bc2-63cb-4493-9256-f4564a9d072a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lazy-loading 'fault' on Instance uuid 836e5756-eb0c-40c6-9581-60a5c270241d {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:38:48.936878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f62986c-d1e7-4683-9ceb-bdbc071dfcd7 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:48.937613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f62986c-d1e7-4683-9ceb-bdbc071dfcd7 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:48.938082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f62986c-d1e7-4683-9ceb-bdbc071dfcd7 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:48.938523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f62986c-d1e7-4683-9ceb-bdbc071dfcd7 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:48.970304 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-9f62986c-d1e7-4683-9ceb-bdbc071dfcd7 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] HTTP exception thrown: Instance b3df6593-609d-4778-a942-1620d932bdab could not be found. Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9f62986c-d1e7-4683-9ceb-bdbc071dfcd7 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Request method failure captured: Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab HTTP/1.1 Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKe9FBvevC1yA_j_JapFMBUmSDIK3XrSKKk4pUY0zHrW_L-cPkLnPZ1jn0G0qoIZvUb6AHaWLtHtj_wa4W4jRneTBOdinj6F557NddGvINQ1abWvutxPed9vjRxbjWCpdyHpUGZ_Wyt9xxoQ54C5ErxfLBDX3QxWLk3rjaUOgN-GVcE Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 4f4953f2d41748c1b0dd0e12adaf29f0 Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestServerMultinode-1385573186 Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4f4953f2d41748c1b0dd0e12adaf29f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4f4953f2d41748c1b0dd0e12adaf29f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4f4953f2d41748c1b0dd0e12adaf29f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4f4953f2d41748c1b0dd0e12adaf29f0"}]}] Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestServerMultinode-1385573186 Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 4f4953f2d41748c1b0dd0e12adaf29f0 Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestServerMultinode-1385573186 Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestServerMultinode-1385573186-project-admin Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c78027172b1c42458dc720d404a26d1e Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestServerMultinode-1385573186-project-admin Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance b3df6593-609d-4778-a942-1620d932bdab could not be found. Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'b3df6593-609d-4778-a942-1620d932bdab'} Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3df6593-609d-4778-a942-1620d932bdab could not be found. Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3df6593-609d-4778-a942-1620d932bdab could not be found. Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:48.985503 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:48.991352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:48.991352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:48.991352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:48.991352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:38:48.991352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:38:48.991352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3df6593-609d-4778-a942-1620d932bdab could not be found. Oct 04 21:38:48.991352 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:48.991352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9f62986c-d1e7-4683-9ceb-bdbc071dfcd7 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Returning 404 to user: Instance b3df6593-609d-4778-a942-1620d932bdab could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:38:48.991352 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9f62986c-d1e7-4683-9ceb-bdbc071dfcd7 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab" status: 404 len: 111 microversion: 2.1 time: 0.066788 Oct 04 21:38:48.992683 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3030/6035] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:48 2022] GET /compute/v2.1/servers/b3df6593-609d-4778-a942-1620d932bdab => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:38:48.999781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e52648f2-adb0-4f9b-9e4a-39dc9ab77f36 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:49.000298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e52648f2-adb0-4f9b-9e4a-39dc9ab77f36 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:49.007886 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e52648f2-adb0-4f9b-9e4a-39dc9ab77f36 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:49.009764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e52648f2-adb0-4f9b-9e4a-39dc9ab77f36 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:49.009764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e52648f2-adb0-4f9b-9e4a-39dc9ab77f36 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:49.010294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e52648f2-adb0-4f9b-9e4a-39dc9ab77f36 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:49.010932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e52648f2-adb0-4f9b-9e4a-39dc9ab77f36 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:49.011630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e52648f2-adb0-4f9b-9e4a-39dc9ab77f36 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:49.025385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-60832bc2-63cb-4493-9256-f4564a9d072a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:49.044776 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-60832bc2-63cb-4493-9256-f4564a9d072a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 200 len: 1332 microversion: 2.1 time: 0.217069 Oct 04 21:38:49.049262 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3006/6036] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:48 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 1332 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:49.063737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e52648f2-adb0-4f9b-9e4a-39dc9ab77f36 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:38:49.171109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:49.581409 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e52648f2-adb0-4f9b-9e4a-39dc9ab77f36 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 204 len: 0 microversion: 2.1 time: 0.588328 Oct 04 21:38:49.582937 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3031/6037] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:38:48 2022] DELETE /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:38:49.598207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f6c51dc1-7417-481d-af04-c2fb34b6d668 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:49.599150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f6c51dc1-7417-481d-af04-c2fb34b6d668 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:49.611542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6c51dc1-7417-481d-af04-c2fb34b6d668 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:49.614036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6c51dc1-7417-481d-af04-c2fb34b6d668 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:49.622322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6c51dc1-7417-481d-af04-c2fb34b6d668 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:49.622322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6c51dc1-7417-481d-af04-c2fb34b6d668 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:49.622322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6c51dc1-7417-481d-af04-c2fb34b6d668 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:49.622322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6c51dc1-7417-481d-af04-c2fb34b6d668 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:49.833842 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f6c51dc1-7417-481d-af04-c2fb34b6d668 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1654 microversion: 2.1 time: 0.240800 Oct 04 21:38:49.834795 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3007/6038] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:49 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1654 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:50.083873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eb569df1-274d-47c0-88ce-d3ea2ab8d4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:50.085655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eb569df1-274d-47c0-88ce-d3ea2ab8d4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:50.098944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb569df1-274d-47c0-88ce-d3ea2ab8d4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:50.101063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb569df1-274d-47c0-88ce-d3ea2ab8d4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:50.102667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb569df1-274d-47c0-88ce-d3ea2ab8d4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:50.104331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb569df1-274d-47c0-88ce-d3ea2ab8d4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:50.120908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb569df1-274d-47c0-88ce-d3ea2ab8d4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:50.121714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb569df1-274d-47c0-88ce-d3ea2ab8d4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:50.150261 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-eb569df1-274d-47c0-88ce-d3ea2ab8d4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] HTTP exception thrown: Instance 836e5756-eb0c-40c6-9581-60a5c270241d could not be found. Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eb569df1-274d-47c0-88ce-d3ea2ab8d4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Request method failure captured: Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d HTTP/1.1 Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKbagiGypEfWhrQ_0lE94AP27Qoh0E4iGeIB2v7-1zLRFZVlQCLRG0FD49h9EoPD55kuiioz0fPU1oTFLY5Kkl3L3vqChLMTEe1In4MGHbsFa7Gm-matpM3wFwyWA19l96bcqrryYQdSr6oZRwmQgAqc6hQhUAbifVGqqLh8bVE-KBY Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}] Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 68a2203c15fe41d8ae410f31ba1e1301 Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 836e5756-eb0c-40c6-9581-60a5c270241d could not be found. Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '836e5756-eb0c-40c6-9581-60a5c270241d'} Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 836e5756-eb0c-40c6-9581-60a5c270241d could not be found. Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 836e5756-eb0c-40c6-9581-60a5c270241d could not be found. Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:50.151975 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:50.158308 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:50.158308 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:50.158308 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:50.158308 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:38:50.158308 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:38:50.158308 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 836e5756-eb0c-40c6-9581-60a5c270241d could not be found. Oct 04 21:38:50.158308 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:38:50.158308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eb569df1-274d-47c0-88ce-d3ea2ab8d4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Returning 404 to user: Instance 836e5756-eb0c-40c6-9581-60a5c270241d could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:38:50.158308 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eb569df1-274d-47c0-88ce-d3ea2ab8d4a2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 404 len: 111 microversion: 2.1 time: 0.076957 Oct 04 21:38:50.158308 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3032/6039] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:50 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:38:50.165697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ec0f6a4b-3a9c-4de1-b374-1ae9e1af01d9 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '.version_select at 0x7f5794478d30>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:50.286146 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ec0f6a4b-3a9c-4de1-b374-1ae9e1af01d9 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1967054943" status: 202 len: 0 microversion: 2.1 time: 0.124825 Oct 04 21:38:50.286750 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3008/6040] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Oct 4 21:38:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1967054943 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:38:50.857749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-498a5a9f-3e7e-474b-8673-94f6d4240272 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:50.861953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-498a5a9f-3e7e-474b-8673-94f6d4240272 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:50.865545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-498a5a9f-3e7e-474b-8673-94f6d4240272 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:50.866829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-498a5a9f-3e7e-474b-8673-94f6d4240272 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:50.867396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-498a5a9f-3e7e-474b-8673-94f6d4240272 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:50.868247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-498a5a9f-3e7e-474b-8673-94f6d4240272 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:50.868842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-498a5a9f-3e7e-474b-8673-94f6d4240272 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:50.869380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-498a5a9f-3e7e-474b-8673-94f6d4240272 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:51.075990 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-498a5a9f-3e7e-474b-8673-94f6d4240272 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1654 microversion: 2.1 time: 0.221925 Oct 04 21:38:51.078266 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3033/6041] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:50 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1654 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:51.739978 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-21bcd17e-9ac7-40a4-965d-4e4604685d97 req-e1a005ab-24bb-40a9-a756-3f7b5671c0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb6e551-dbd2-4f01-9e8b-8bee2bb43258", "name": "network-vif-deleted", "tag": "32a720d8-d47e-4681-97a7-7ceeca59ad8b"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:51.783181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:51.788722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-21bcd17e-9ac7-40a4-965d-4e4604685d97 req-e1a005ab-24bb-40a9-a756-3f7b5671c0c5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:51.789458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-21bcd17e-9ac7-40a4-965d-4e4604685d97 req-e1a005ab-24bb-40a9-a756-3f7b5671c0c5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:51.790125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-21bcd17e-9ac7-40a4-965d-4e4604685d97 req-e1a005ab-24bb-40a9-a756-3f7b5671c0c5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:51.818266 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-21bcd17e-9ac7-40a4-965d-4e4604685d97 req-e1a005ab-24bb-40a9-a756-3f7b5671c0c5 service nova] Creating event network-vif-deleted:32a720d8-d47e-4681-97a7-7ceeca59ad8b for instance 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 on n-h2-860282-1 Oct 04 21:38:51.826258 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-21bcd17e-9ac7-40a4-965d-4e4604685d97 req-e1a005ab-24bb-40a9-a756-3f7b5671c0c5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093706 Oct 04 21:38:51.827667 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3009/6042] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:51.994067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f286bdc2-a0a9-4669-809f-3b2b093c61ab tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Action: 'create', calling method: .version_select at 0x7f57900794c0>, body: {"keypair": {"name": "tempest-keypair-1893373306", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/rm4xAhiOOKK44Moa4nCX47hCnWqxOBSXCdkRBU8QLXOxSbjad2yPTDJv2eJHL27IQJGnD5KsW3PetAA4bGgh+V91cLj3o+daJ5E+FbfiozFHDnCSt1OkTRJirBafdSw=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:52.017793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-f286bdc2-a0a9-4669-809f-3b2b093c61ab tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Getting quotas for project f7a12e438f0e4e9a83b0ab95f50c791c. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:38:52.034604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-f286bdc2-a0a9-4669-809f-3b2b093c61ab tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Getting quotas for user 68a2203c15fe41d8ae410f31ba1e1301 and project f7a12e438f0e4e9a83b0ab95f50c791c. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:38:52.109459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ac4c7cf0-5515-4eed-816d-19e2d476c033 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:52.111735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ac4c7cf0-5515-4eed-816d-19e2d476c033 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:52.119179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac4c7cf0-5515-4eed-816d-19e2d476c033 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:52.119781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac4c7cf0-5515-4eed-816d-19e2d476c033 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:52.120395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac4c7cf0-5515-4eed-816d-19e2d476c033 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:52.121105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac4c7cf0-5515-4eed-816d-19e2d476c033 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:52.121672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac4c7cf0-5515-4eed-816d-19e2d476c033 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:52.122047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac4c7cf0-5515-4eed-816d-19e2d476c033 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:52.161402 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f286bdc2-a0a9-4669-809f-3b2b093c61ab tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.171288 Oct 04 21:38:52.162736 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3034/6043] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:38:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:52.230997 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ac4c7cf0-5515-4eed-816d-19e2d476c033 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1449 microversion: 2.1 time: 0.129162 Oct 04 21:38:52.232429 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3010/6044] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:52 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1449 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:53.257895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-39c08ea6-1c5d-44a6-b80a-c76b829f1052 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:53.258511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-39c08ea6-1c5d-44a6-b80a-c76b829f1052 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:53.277698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c08ea6-1c5d-44a6-b80a-c76b829f1052 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:53.278464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c08ea6-1c5d-44a6-b80a-c76b829f1052 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:53.279117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c08ea6-1c5d-44a6-b80a-c76b829f1052 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:53.279823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c08ea6-1c5d-44a6-b80a-c76b829f1052 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:53.280483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c08ea6-1c5d-44a6-b80a-c76b829f1052 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:53.281249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c08ea6-1c5d-44a6-b80a-c76b829f1052 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:53.319732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c08ea6-1c5d-44a6-b80a-c76b829f1052 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:53.320737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c08ea6-1c5d-44a6-b80a-c76b829f1052 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:53.321375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39c08ea6-1c5d-44a6-b80a-c76b829f1052 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:53.322050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-39c08ea6-1c5d-44a6-b80a-c76b829f1052 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lazy-loading 'fault' on Instance uuid 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:38:53.409349 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-39c08ea6-1c5d-44a6-b80a-c76b829f1052 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 200 len: 1454 microversion: 2.1 time: 0.155659 Oct 04 21:38:53.410242 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3035/6045] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:53 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:54.437610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4a58b5ee-7f9c-4364-9a7e-a59d743a3a55 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:54.438106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4a58b5ee-7f9c-4364-9a7e-a59d743a3a55 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] [instance: 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:54.452210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a58b5ee-7f9c-4364-9a7e-a59d743a3a55 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:54.452210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a58b5ee-7f9c-4364-9a7e-a59d743a3a55 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:54.453283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a58b5ee-7f9c-4364-9a7e-a59d743a3a55 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:54.454196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a58b5ee-7f9c-4364-9a7e-a59d743a3a55 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:54.454775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a58b5ee-7f9c-4364-9a7e-a59d743a3a55 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:54.455314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a58b5ee-7f9c-4364-9a7e-a59d743a3a55 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:54.471571 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-4a58b5ee-7f9c-4364-9a7e-a59d743a3a55 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] HTTP exception thrown: Instance 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 could not be found. Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4a58b5ee-7f9c-4364-9a7e-a59d743a3a55 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Request method failure captured: Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 HTTP/1.1 Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKe9FBvevC1yA_j_JapFMBUmSDIK3XrSKKk4pUY0zHrW_L-cPkLnPZ1jn0G0qoIZvUb6AHaWLtHtj_wa4W4jRneTBOdinj6F557NddGvINQ1abWvutxPed9vjRxbjWCpdyHpUGZ_Wyt9xxoQ54C5ErxfLBDX3QxWLk3rjaUOgN-GVcE Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 4f4953f2d41748c1b0dd0e12adaf29f0 Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestServerMultinode-1385573186 Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4f4953f2d41748c1b0dd0e12adaf29f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4f4953f2d41748c1b0dd0e12adaf29f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4f4953f2d41748c1b0dd0e12adaf29f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4f4953f2d41748c1b0dd0e12adaf29f0"}]}] Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestServerMultinode-1385573186 Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 4f4953f2d41748c1b0dd0e12adaf29f0 Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestServerMultinode-1385573186 Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestServerMultinode-1385573186-project-admin Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c78027172b1c42458dc720d404a26d1e Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestServerMultinode-1385573186-project-admin Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 could not be found. Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '2eb6e551-dbd2-4f01-9e8b-8bee2bb43258'} Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 could not be found. Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 could not be found. Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:54.473548 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:54.477766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:54.477766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:54.477766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:54.477766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:38:54.477766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:38:54.477766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 could not be found. Oct 04 21:38:54.477766 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:38:54.480323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4a58b5ee-7f9c-4364-9a7e-a59d743a3a55 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] Returning 404 to user: Instance 2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:38:54.481306 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4a58b5ee-7f9c-4364-9a7e-a59d743a3a55 tempest-TestServerMultinode-1385573186 tempest-TestServerMultinode-1385573186-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258" status: 404 len: 111 microversion: 2.1 time: 0.047795 Oct 04 21:38:54.482123 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3011/6046] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:54 2022] GET /compute/v2.1/servers/2eb6e551-dbd2-4f01-9e8b-8bee2bb43258 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:38:56.279233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aab0512c-0215-4c43-8cfc-27c4b96e19a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-168483979", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "105a9abe-09eb-4bdd-87f3-fda198194481"}], "security_groups": [{"name": "tempest-securitygroup--197898118"}], "key_name": "tempest-keypair-1893373306", "user_data": "}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:56.527430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-aab0512c-0215-4c43-8cfc-27c4b96e19a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] validate_networks() for [('105a9abe-09eb-4bdd-87f3-fda198194481', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:38:56.958373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:57.791757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-aab0512c-0215-4c43-8cfc-27c4b96e19a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:38:57.792442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-aab0512c-0215-4c43-8cfc-27c4b96e19a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:38:57.792651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-aab0512c-0215-4c43-8cfc-27c4b96e19a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:38:57.793271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-aab0512c-0215-4c43-8cfc-27c4b96e19a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:38:57.796191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-aab0512c-0215-4c43-8cfc-27c4b96e19a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:38:57.810049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aab0512c-0215-4c43-8cfc-27c4b96e19a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:57.810546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aab0512c-0215-4c43-8cfc-27c4b96e19a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:57.810992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aab0512c-0215-4c43-8cfc-27c4b96e19a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:57.811805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aab0512c-0215-4c43-8cfc-27c4b96e19a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:57.818124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aab0512c-0215-4c43-8cfc-27c4b96e19a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:57.818606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aab0512c-0215-4c43-8cfc-27c4b96e19a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:57.901370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-aab0512c-0215-4c43-8cfc-27c4b96e19a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Getting quotas for project f7a12e438f0e4e9a83b0ab95f50c791c. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:38:57.926485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-aab0512c-0215-4c43-8cfc-27c4b96e19a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Getting quotas for user 68a2203c15fe41d8ae410f31ba1e1301 and project f7a12e438f0e4e9a83b0ab95f50c791c. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:38:57.956871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-aab0512c-0215-4c43-8cfc-27c4b96e19a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:38:57.963213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-aab0512c-0215-4c43-8cfc-27c4b96e19a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:38:58.176639 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-aab0512c-0215-4c43-8cfc-27c4b96e19a7 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.902808 Oct 04 21:38:58.178002 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3036/6047] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:38:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:38:58.191315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-17910c24-7e39-464b-96d5-12b314dfde62 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:58.192656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-17910c24-7e39-464b-96d5-12b314dfde62 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:58.294859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-17910c24-7e39-464b-96d5-12b314dfde62 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:58.309264 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-17910c24-7e39-464b-96d5-12b314dfde62 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 200 len: 1241 microversion: 2.1 time: 0.122271 Oct 04 21:38:58.310788 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3012/6048] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:58 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 1241 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:59.336072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-26644502-234b-48c1-99ab-858b40cc51c2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:59.337170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-26644502-234b-48c1-99ab-858b40cc51c2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:59.418687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-26644502-234b-48c1-99ab-858b40cc51c2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:59.425788 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-26644502-234b-48c1-99ab-858b40cc51c2 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 200 len: 1241 microversion: 2.1 time: 0.095371 Oct 04 21:38:59.426386 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3037/6049] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:59 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:00.451220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-030b922b-1530-4d9a-853f-15c4550fd52e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:00.453702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-030b922b-1530-4d9a-853f-15c4550fd52e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:00.463333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-030b922b-1530-4d9a-853f-15c4550fd52e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:00.464324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-030b922b-1530-4d9a-853f-15c4550fd52e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:00.464985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-030b922b-1530-4d9a-853f-15c4550fd52e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:00.466215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-030b922b-1530-4d9a-853f-15c4550fd52e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:00.466944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-030b922b-1530-4d9a-853f-15c4550fd52e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:00.467589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-030b922b-1530-4d9a-853f-15c4550fd52e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:00.491699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:00.643453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-030b922b-1530-4d9a-853f-15c4550fd52e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:00.661110 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-030b922b-1530-4d9a-853f-15c4550fd52e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 200 len: 1237 microversion: 2.1 time: 0.214727 Oct 04 21:39:00.665272 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3013/6050] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:00 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 1237 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:01.690374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4f9b4d61-19ab-4e3a-abb9-c9951fa7b1ec tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:01.691768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4f9b4d61-19ab-4e3a-abb9-c9951fa7b1ec tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:01.702741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f9b4d61-19ab-4e3a-abb9-c9951fa7b1ec tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:01.703331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f9b4d61-19ab-4e3a-abb9-c9951fa7b1ec tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:01.703845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f9b4d61-19ab-4e3a-abb9-c9951fa7b1ec tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:01.704569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f9b4d61-19ab-4e3a-abb9-c9951fa7b1ec tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:01.705144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f9b4d61-19ab-4e3a-abb9-c9951fa7b1ec tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:01.705752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f9b4d61-19ab-4e3a-abb9-c9951fa7b1ec tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:01.801071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4f9b4d61-19ab-4e3a-abb9-c9951fa7b1ec tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:01.812840 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4f9b4d61-19ab-4e3a-abb9-c9951fa7b1ec tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 200 len: 1311 microversion: 2.1 time: 0.127506 Oct 04 21:39:01.831413 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3038/6051] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:01 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 1311 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:02.843734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c05c7d7d-2603-494b-9978-798925bc5db6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:02.844359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c05c7d7d-2603-494b-9978-798925bc5db6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:02.857344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c05c7d7d-2603-494b-9978-798925bc5db6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:02.866457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c05c7d7d-2603-494b-9978-798925bc5db6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:02.866983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c05c7d7d-2603-494b-9978-798925bc5db6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:02.868345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c05c7d7d-2603-494b-9978-798925bc5db6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:02.868345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c05c7d7d-2603-494b-9978-798925bc5db6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:02.868687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c05c7d7d-2603-494b-9978-798925bc5db6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:03.204875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c05c7d7d-2603-494b-9978-798925bc5db6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:03.221876 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c05c7d7d-2603-494b-9978-798925bc5db6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 200 len: 1366 microversion: 2.1 time: 0.382880 Oct 04 21:39:03.223506 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3014/6052] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:02 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:03.931715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-c12249ff-052e-414f-b94c-fcdfda5cbb17 req-3740f016-ef3a-4cc0-b217-57dd0595df4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7adeab45-7c8f-4c50-8018-934a76f76e22", "tag": "1eda41ac-e408-497d-95f4-04ad129f40ed"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:03.952565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c12249ff-052e-414f-b94c-fcdfda5cbb17 req-3740f016-ef3a-4cc0-b217-57dd0595df4a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:03.957414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c12249ff-052e-414f-b94c-fcdfda5cbb17 req-3740f016-ef3a-4cc0-b217-57dd0595df4a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:03.958110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c12249ff-052e-414f-b94c-fcdfda5cbb17 req-3740f016-ef3a-4cc0-b217-57dd0595df4a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:03.983912 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-c12249ff-052e-414f-b94c-fcdfda5cbb17 req-3740f016-ef3a-4cc0-b217-57dd0595df4a service nova] Creating event network-changed:1eda41ac-e408-497d-95f4-04ad129f40ed for instance 7adeab45-7c8f-4c50-8018-934a76f76e22 on n-h1-860282-1 Oct 04 21:39:03.998610 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-c12249ff-052e-414f-b94c-fcdfda5cbb17 req-3740f016-ef3a-4cc0-b217-57dd0595df4a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070570 Oct 04 21:39:03.999592 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3039/6053] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:04.250930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9f9d971e-74e9-44fd-8b37-d740dd09aa72 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:04.251550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9f9d971e-74e9-44fd-8b37-d740dd09aa72 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:04.271445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f9d971e-74e9-44fd-8b37-d740dd09aa72 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:04.278016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f9d971e-74e9-44fd-8b37-d740dd09aa72 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:04.278016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f9d971e-74e9-44fd-8b37-d740dd09aa72 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:04.278016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f9d971e-74e9-44fd-8b37-d740dd09aa72 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:04.278016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f9d971e-74e9-44fd-8b37-d740dd09aa72 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:04.278016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f9d971e-74e9-44fd-8b37-d740dd09aa72 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:04.556732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9f9d971e-74e9-44fd-8b37-d740dd09aa72 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:04.567650 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9f9d971e-74e9-44fd-8b37-d740dd09aa72 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 200 len: 1366 microversion: 2.1 time: 0.320640 Oct 04 21:39:04.569012 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3015/6054] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:04 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:05.593249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6156c346-0707-4d1c-b40e-bc5594ee9bf0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:05.593907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6156c346-0707-4d1c-b40e-bc5594ee9bf0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:05.606129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6156c346-0707-4d1c-b40e-bc5594ee9bf0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:05.607035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6156c346-0707-4d1c-b40e-bc5594ee9bf0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:05.607799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6156c346-0707-4d1c-b40e-bc5594ee9bf0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:05.609612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6156c346-0707-4d1c-b40e-bc5594ee9bf0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:05.610658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6156c346-0707-4d1c-b40e-bc5594ee9bf0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:05.611388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6156c346-0707-4d1c-b40e-bc5594ee9bf0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:06.233961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6156c346-0707-4d1c-b40e-bc5594ee9bf0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:06.260542 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6156c346-0707-4d1c-b40e-bc5594ee9bf0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 200 len: 1366 microversion: 2.1 time: 0.672736 Oct 04 21:39:06.273959 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3040/6055] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:05 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 1366 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:07.300346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-365a7733-3099-4428-9cb8-0e58cdbfab0b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:07.301015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-365a7733-3099-4428-9cb8-0e58cdbfab0b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:07.312183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-365a7733-3099-4428-9cb8-0e58cdbfab0b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:07.312685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-365a7733-3099-4428-9cb8-0e58cdbfab0b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:07.313127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-365a7733-3099-4428-9cb8-0e58cdbfab0b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:07.313867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-365a7733-3099-4428-9cb8-0e58cdbfab0b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:07.314325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-365a7733-3099-4428-9cb8-0e58cdbfab0b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:07.314955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-365a7733-3099-4428-9cb8-0e58cdbfab0b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:07.750270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-365a7733-3099-4428-9cb8-0e58cdbfab0b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:07.764398 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-365a7733-3099-4428-9cb8-0e58cdbfab0b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 200 len: 1366 microversion: 2.1 time: 0.467959 Oct 04 21:39:07.775435 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3016/6056] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:07 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 1366 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:08.790530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a54ba343-5f37-460a-be39-e4d6269af35e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:08.791190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a54ba343-5f37-460a-be39-e4d6269af35e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:08.794361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:08.811317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a54ba343-5f37-460a-be39-e4d6269af35e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:08.811317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a54ba343-5f37-460a-be39-e4d6269af35e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:08.811317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a54ba343-5f37-460a-be39-e4d6269af35e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:08.811317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a54ba343-5f37-460a-be39-e4d6269af35e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:08.813737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a54ba343-5f37-460a-be39-e4d6269af35e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:08.814238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a54ba343-5f37-460a-be39-e4d6269af35e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:09.079181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a54ba343-5f37-460a-be39-e4d6269af35e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:09.089124 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a54ba343-5f37-460a-be39-e4d6269af35e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 200 len: 1366 microversion: 2.1 time: 0.302593 Oct 04 21:39:09.092620 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3041/6057] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:08 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:09.143239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-521901e1-8497-406a-9740-34fd791f50c8 req-2aa5c426-3bee-4bd7-ac24-e16c76a38885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7adeab45-7c8f-4c50-8018-934a76f76e22", "name": "network-vif-plugged", "status": "completed", "tag": "1eda41ac-e408-497d-95f4-04ad129f40ed"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:09.148715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:09.168833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-521901e1-8497-406a-9740-34fd791f50c8 req-2aa5c426-3bee-4bd7-ac24-e16c76a38885 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:09.169583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-521901e1-8497-406a-9740-34fd791f50c8 req-2aa5c426-3bee-4bd7-ac24-e16c76a38885 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:09.170023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-521901e1-8497-406a-9740-34fd791f50c8 req-2aa5c426-3bee-4bd7-ac24-e16c76a38885 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:09.188087 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-521901e1-8497-406a-9740-34fd791f50c8 req-2aa5c426-3bee-4bd7-ac24-e16c76a38885 service nova] Creating event network-vif-plugged:1eda41ac-e408-497d-95f4-04ad129f40ed for instance 7adeab45-7c8f-4c50-8018-934a76f76e22 on n-h1-860282-1 Oct 04 21:39:09.205580 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-521901e1-8497-406a-9740-34fd791f50c8 req-2aa5c426-3bee-4bd7-ac24-e16c76a38885 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064876 Oct 04 21:39:09.207582 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3017/6058] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:10.119123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0f7c2519-8ae1-44f7-af5e-6d022a23323a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:10.120091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0f7c2519-8ae1-44f7-af5e-6d022a23323a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:10.126144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=12 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:10.129723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f7c2519-8ae1-44f7-af5e-6d022a23323a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:10.130633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f7c2519-8ae1-44f7-af5e-6d022a23323a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:10.131576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f7c2519-8ae1-44f7-af5e-6d022a23323a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:10.133781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f7c2519-8ae1-44f7-af5e-6d022a23323a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:10.134413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f7c2519-8ae1-44f7-af5e-6d022a23323a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:10.135018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f7c2519-8ae1-44f7-af5e-6d022a23323a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:10.334774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0f7c2519-8ae1-44f7-af5e-6d022a23323a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:10.351526 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0f7c2519-8ae1-44f7-af5e-6d022a23323a tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 200 len: 1366 microversion: 2.1 time: 0.238424 Oct 04 21:39:10.352125 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3042/6059] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:10 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:11.390417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c080e8a1-6451-4ffd-a91d-9479ec1af7ba tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:11.391155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c080e8a1-6451-4ffd-a91d-9479ec1af7ba tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:11.398901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c080e8a1-6451-4ffd-a91d-9479ec1af7ba tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:11.399668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c080e8a1-6451-4ffd-a91d-9479ec1af7ba tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:11.400112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c080e8a1-6451-4ffd-a91d-9479ec1af7ba tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:11.401190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c080e8a1-6451-4ffd-a91d-9479ec1af7ba tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:11.401295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c080e8a1-6451-4ffd-a91d-9479ec1af7ba tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:11.401689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c080e8a1-6451-4ffd-a91d-9479ec1af7ba tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:11.605783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c080e8a1-6451-4ffd-a91d-9479ec1af7ba tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:11.615903 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c080e8a1-6451-4ffd-a91d-9479ec1af7ba tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 200 len: 1555 microversion: 2.1 time: 0.230695 Oct 04 21:39:11.617167 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3018/6060] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:11 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 1555 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:11.639848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9d4f620f-3559-4087-89bf-a023c0152a8d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:11.640514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9d4f620f-3559-4087-89bf-a023c0152a8d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:11.648614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d4f620f-3559-4087-89bf-a023c0152a8d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:11.653713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d4f620f-3559-4087-89bf-a023c0152a8d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:11.653713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d4f620f-3559-4087-89bf-a023c0152a8d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:11.653713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d4f620f-3559-4087-89bf-a023c0152a8d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:11.653713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d4f620f-3559-4087-89bf-a023c0152a8d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:11.653713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d4f620f-3559-4087-89bf-a023c0152a8d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:11.756445 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9d4f620f-3559-4087-89bf-a023c0152a8d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120987 Oct 04 21:39:11.757232 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3043/6061] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 21:39:11 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:13.246082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-2db1497c-411d-4cc3-bdcd-306a144cd6a0 req-4edd31d6-6a4b-449b-b1ce-ade8b060dff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7adeab45-7c8f-4c50-8018-934a76f76e22", "tag": "1eda41ac-e408-497d-95f4-04ad129f40ed"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:13.260131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2db1497c-411d-4cc3-bdcd-306a144cd6a0 req-4edd31d6-6a4b-449b-b1ce-ade8b060dff1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:13.260668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2db1497c-411d-4cc3-bdcd-306a144cd6a0 req-4edd31d6-6a4b-449b-b1ce-ade8b060dff1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:13.261309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2db1497c-411d-4cc3-bdcd-306a144cd6a0 req-4edd31d6-6a4b-449b-b1ce-ade8b060dff1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:13.278450 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-2db1497c-411d-4cc3-bdcd-306a144cd6a0 req-4edd31d6-6a4b-449b-b1ce-ade8b060dff1 service nova] Creating event network-changed:1eda41ac-e408-497d-95f4-04ad129f40ed for instance 7adeab45-7c8f-4c50-8018-934a76f76e22 on n-h1-860282-1 Oct 04 21:39:13.285206 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-2db1497c-411d-4cc3-bdcd-306a144cd6a0 req-4edd31d6-6a4b-449b-b1ce-ade8b060dff1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044439 Oct 04 21:39:13.292707 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3019/6062] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:38.446568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:38.447617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:38.452100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5c20db14-c307-4b1e-a502-33119763e99e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1360989072", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "42b89608-9fe7-452b-8839-51662659809d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b7f4cca9-cdc1-49bd-97e7-bd6739547eb6"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:38.610128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-5c20db14-c307-4b1e-a502-33119763e99e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] validate_networks() for [('b7f4cca9-cdc1-49bd-97e7-bd6739547eb6', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:39:39.475623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5c20db14-c307-4b1e-a502-33119763e99e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:39:39.476715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5c20db14-c307-4b1e-a502-33119763e99e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:39:39.477207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5c20db14-c307-4b1e-a502-33119763e99e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:39:39.477712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5c20db14-c307-4b1e-a502-33119763e99e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:39:39.478138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5c20db14-c307-4b1e-a502-33119763e99e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:39:39.490927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c20db14-c307-4b1e-a502-33119763e99e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:39.491563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c20db14-c307-4b1e-a502-33119763e99e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:39.492057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c20db14-c307-4b1e-a502-33119763e99e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:39.492959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c20db14-c307-4b1e-a502-33119763e99e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:39.493542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c20db14-c307-4b1e-a502-33119763e99e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:39.494058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c20db14-c307-4b1e-a502-33119763e99e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:39.516039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5c20db14-c307-4b1e-a502-33119763e99e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Getting quotas for project 68208d23fd2f40479ba279566a819933. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:39:39.521820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5c20db14-c307-4b1e-a502-33119763e99e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Getting quotas for user 15748f41da9f49fca3e7eec1fda3b245 and project 68208d23fd2f40479ba279566a819933. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:39:39.595160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5c20db14-c307-4b1e-a502-33119763e99e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:39:39.603037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5c20db14-c307-4b1e-a502-33119763e99e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='42b89608-9fe7-452b-8839-51662659809d',volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:39:40.209958 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5c20db14-c307-4b1e-a502-33119763e99e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.765060 Oct 04 21:39:40.211232 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3044/6063] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:39:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:39:40.222486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=23 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:40.223251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=30 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:40.244517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-91502c17-0358-477d-9aed-5558a2eca54f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:40.244517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-91502c17-0358-477d-9aed-5558a2eca54f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:40.363905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-91502c17-0358-477d-9aed-5558a2eca54f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:40.377568 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-91502c17-0358-477d-9aed-5558a2eca54f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1057 microversion: 2.1 time: 0.157383 Oct 04 21:39:40.398313 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3020/6064] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:40 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1057 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:41.405219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fd28181a-39f2-4aa4-a673-85acf7663474 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:41.405935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fd28181a-39f2-4aa4-a673-85acf7663474 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:41.495894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fd28181a-39f2-4aa4-a673-85acf7663474 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:41.505780 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fd28181a-39f2-4aa4-a673-85acf7663474 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1057 microversion: 2.1 time: 0.103508 Oct 04 21:39:41.507107 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3045/6065] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:41 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1057 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:39:42.537628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6e194cbb-afe8-4c36-82aa-962b47c7817d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:42.544816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6e194cbb-afe8-4c36-82aa-962b47c7817d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:42.561447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e194cbb-afe8-4c36-82aa-962b47c7817d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:42.562284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e194cbb-afe8-4c36-82aa-962b47c7817d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:42.562796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e194cbb-afe8-4c36-82aa-962b47c7817d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:42.563696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e194cbb-afe8-4c36-82aa-962b47c7817d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:42.564276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e194cbb-afe8-4c36-82aa-962b47c7817d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:42.565172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e194cbb-afe8-4c36-82aa-962b47c7817d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:42.646486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6e194cbb-afe8-4c36-82aa-962b47c7817d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:42.655784 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6e194cbb-afe8-4c36-82aa-962b47c7817d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1155 microversion: 2.1 time: 0.124644 Oct 04 21:39:42.656356 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3021/6066] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:42 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1155 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:43.681471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-36bb2519-4e72-4c27-b2a0-2ebc228043e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:43.686614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-36bb2519-4e72-4c27-b2a0-2ebc228043e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:43.695968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36bb2519-4e72-4c27-b2a0-2ebc228043e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:43.696550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36bb2519-4e72-4c27-b2a0-2ebc228043e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:43.696929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36bb2519-4e72-4c27-b2a0-2ebc228043e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:43.697686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36bb2519-4e72-4c27-b2a0-2ebc228043e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:43.700592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36bb2519-4e72-4c27-b2a0-2ebc228043e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:43.702045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36bb2519-4e72-4c27-b2a0-2ebc228043e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:43.823530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-36bb2519-4e72-4c27-b2a0-2ebc228043e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:43.836378 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-36bb2519-4e72-4c27-b2a0-2ebc228043e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1173 microversion: 2.1 time: 0.157672 Oct 04 21:39:43.837254 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3046/6067] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:43 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1173 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:44.865363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-46ffc9a2-920b-4581-8fb6-c94afd8aa44d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:44.867162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-46ffc9a2-920b-4581-8fb6-c94afd8aa44d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:44.878743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46ffc9a2-920b-4581-8fb6-c94afd8aa44d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:44.878743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46ffc9a2-920b-4581-8fb6-c94afd8aa44d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:44.878743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46ffc9a2-920b-4581-8fb6-c94afd8aa44d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:44.878743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46ffc9a2-920b-4581-8fb6-c94afd8aa44d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:44.878743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46ffc9a2-920b-4581-8fb6-c94afd8aa44d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:44.878743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46ffc9a2-920b-4581-8fb6-c94afd8aa44d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:45.685837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-46ffc9a2-920b-4581-8fb6-c94afd8aa44d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:45.702952 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-46ffc9a2-920b-4581-8fb6-c94afd8aa44d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1215 microversion: 2.1 time: 0.841471 Oct 04 21:39:45.715700 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3022/6068] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:44 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1215 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:46.593155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-0489ebc3-2d79-48c4-8a8e-e4217c926fab req-37e8c58d-ea18-4c1b-ac90-53d8b878ac9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85", "tag": "72d873c0-5700-4a60-82cf-20df564b99f5"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:46.604132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0489ebc3-2d79-48c4-8a8e-e4217c926fab req-37e8c58d-ea18-4c1b-ac90-53d8b878ac9c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:46.604855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0489ebc3-2d79-48c4-8a8e-e4217c926fab req-37e8c58d-ea18-4c1b-ac90-53d8b878ac9c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:46.605480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0489ebc3-2d79-48c4-8a8e-e4217c926fab req-37e8c58d-ea18-4c1b-ac90-53d8b878ac9c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:46.618604 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-0489ebc3-2d79-48c4-8a8e-e4217c926fab req-37e8c58d-ea18-4c1b-ac90-53d8b878ac9c service nova] Creating event network-changed:72d873c0-5700-4a60-82cf-20df564b99f5 for instance e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 on n-h2-860282-1 Oct 04 21:39:46.624847 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-0489ebc3-2d79-48c4-8a8e-e4217c926fab req-37e8c58d-ea18-4c1b-ac90-53d8b878ac9c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035561 Oct 04 21:39:46.625836 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3047/6069] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:46.736937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cf647044-7069-44d3-ad6b-a3f988170590 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:46.737947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cf647044-7069-44d3-ad6b-a3f988170590 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:46.747846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf647044-7069-44d3-ad6b-a3f988170590 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:46.752622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf647044-7069-44d3-ad6b-a3f988170590 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:46.755668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf647044-7069-44d3-ad6b-a3f988170590 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:46.756013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf647044-7069-44d3-ad6b-a3f988170590 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:46.756818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf647044-7069-44d3-ad6b-a3f988170590 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:46.759223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf647044-7069-44d3-ad6b-a3f988170590 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:47.322729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1bd59b10-f113-41d0-b07c-a6e4f2fbf5f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:47.323331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1bd59b10-f113-41d0-b07c-a6e4f2fbf5f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:47.346195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bd59b10-f113-41d0-b07c-a6e4f2fbf5f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:47.346726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bd59b10-f113-41d0-b07c-a6e4f2fbf5f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:47.347184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bd59b10-f113-41d0-b07c-a6e4f2fbf5f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:47.347928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bd59b10-f113-41d0-b07c-a6e4f2fbf5f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:47.348397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bd59b10-f113-41d0-b07c-a6e4f2fbf5f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:47.348834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bd59b10-f113-41d0-b07c-a6e4f2fbf5f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:47.424075 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1bd59b10-f113-41d0-b07c-a6e4f2fbf5f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/ips" status: 200 len: 149 microversion: 2.1 time: 0.548120 Oct 04 21:39:47.425591 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3048/6070] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Oct 4 21:39:46 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/ips => generated 149 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:39:47.677025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cf647044-7069-44d3-ad6b-a3f988170590 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:47.686127 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cf647044-7069-44d3-ad6b-a3f988170590 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1215 microversion: 2.1 time: 0.953794 Oct 04 21:39:47.689938 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3023/6071] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:46 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1215 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:48.714509 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-00955fbc-61cd-484c-8241-f2114f892dee tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:48.715851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-00955fbc-61cd-484c-8241-f2114f892dee tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:48.731970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00955fbc-61cd-484c-8241-f2114f892dee tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:48.732876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00955fbc-61cd-484c-8241-f2114f892dee tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:48.736284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00955fbc-61cd-484c-8241-f2114f892dee tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:48.737407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00955fbc-61cd-484c-8241-f2114f892dee tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:48.738131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00955fbc-61cd-484c-8241-f2114f892dee tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:48.738752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00955fbc-61cd-484c-8241-f2114f892dee tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:49.294092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-00955fbc-61cd-484c-8241-f2114f892dee tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:49.308451 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-00955fbc-61cd-484c-8241-f2114f892dee tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1215 microversion: 2.1 time: 0.599032 Oct 04 21:39:49.313280 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3049/6072] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:48 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1215 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:50.336130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a4914a29-acff-4cc3-8783-7f91739510e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:50.336736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a4914a29-acff-4cc3-8783-7f91739510e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:50.343807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4914a29-acff-4cc3-8783-7f91739510e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:50.349804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4914a29-acff-4cc3-8783-7f91739510e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:50.350367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4914a29-acff-4cc3-8783-7f91739510e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.351132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4914a29-acff-4cc3-8783-7f91739510e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:50.351617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4914a29-acff-4cc3-8783-7f91739510e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:50.352053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4914a29-acff-4cc3-8783-7f91739510e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.374003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:50.684517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a4914a29-acff-4cc3-8783-7f91739510e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:50.696989 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a4914a29-acff-4cc3-8783-7f91739510e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1215 microversion: 2.1 time: 0.363644 Oct 04 21:39:50.719285 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3024/6073] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:50 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1215 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:51.723184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c3c6bf25-19af-4a47-9623-bd6694af4d1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:51.724542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c3c6bf25-19af-4a47-9623-bd6694af4d1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:51.727124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:51.730492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:51.742602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3c6bf25-19af-4a47-9623-bd6694af4d1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:51.745021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3c6bf25-19af-4a47-9623-bd6694af4d1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:51.745932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3c6bf25-19af-4a47-9623-bd6694af4d1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:51.746940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3c6bf25-19af-4a47-9623-bd6694af4d1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:51.749091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3c6bf25-19af-4a47-9623-bd6694af4d1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:51.750080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3c6bf25-19af-4a47-9623-bd6694af4d1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:51.776605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1017290f-7931-452b-aa1c-abd8b42c4f00 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c555a4f-2157-4efe-a35e-f6714356d92d"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:51.780284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1017290f-7931-452b-aa1c-abd8b42c4f00 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:51.800504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1017290f-7931-452b-aa1c-abd8b42c4f00 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:51.803176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1017290f-7931-452b-aa1c-abd8b42c4f00 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:51.805599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1017290f-7931-452b-aa1c-abd8b42c4f00 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:51.805599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1017290f-7931-452b-aa1c-abd8b42c4f00 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:51.805599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1017290f-7931-452b-aa1c-abd8b42c4f00 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:51.805599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1017290f-7931-452b-aa1c-abd8b42c4f00 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:52.134598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c3c6bf25-19af-4a47-9623-bd6694af4d1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:52.156853 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c3c6bf25-19af-4a47-9623-bd6694af4d1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1215 microversion: 2.1 time: 0.438160 Oct 04 21:39:52.160508 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3050/6074] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:51 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1215 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:52.944392 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1017290f-7931-452b-aa1c-abd8b42c4f00 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "POST /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.172226 Oct 04 21:39:52.963631 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3025/6075] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 21:39:51 2022] POST /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-volume_attachments => generated 194 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:53.184535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bfb6b278-e808-45a3-aa67-040fcbbae653 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:53.185311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bfb6b278-e808-45a3-aa67-040fcbbae653 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:53.197775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfb6b278-e808-45a3-aa67-040fcbbae653 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:53.198546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfb6b278-e808-45a3-aa67-040fcbbae653 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:53.199217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfb6b278-e808-45a3-aa67-040fcbbae653 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:53.200466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfb6b278-e808-45a3-aa67-040fcbbae653 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:53.201219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfb6b278-e808-45a3-aa67-040fcbbae653 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:53.202709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bfb6b278-e808-45a3-aa67-040fcbbae653 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:53.719888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bfb6b278-e808-45a3-aa67-040fcbbae653 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:53.731219 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bfb6b278-e808-45a3-aa67-040fcbbae653 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1215 microversion: 2.1 time: 0.551716 Oct 04 21:39:53.732060 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3051/6076] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:53 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1215 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:54.758727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-921529c6-cd3a-4b9b-ab59-22f30984ad4e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:54.760115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-921529c6-cd3a-4b9b-ab59-22f30984ad4e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:54.768373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-921529c6-cd3a-4b9b-ab59-22f30984ad4e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:54.772865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-921529c6-cd3a-4b9b-ab59-22f30984ad4e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:54.772865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-921529c6-cd3a-4b9b-ab59-22f30984ad4e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:54.772865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-921529c6-cd3a-4b9b-ab59-22f30984ad4e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:54.772865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-921529c6-cd3a-4b9b-ab59-22f30984ad4e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:54.772865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-921529c6-cd3a-4b9b-ab59-22f30984ad4e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:55.081231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-921529c6-cd3a-4b9b-ab59-22f30984ad4e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:55.108479 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-921529c6-cd3a-4b9b-ab59-22f30984ad4e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1215 microversion: 2.1 time: 0.354190 Oct 04 21:39:55.109082 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3026/6077] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:54 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1215 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:39:56.140569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e587d262-9258-4e33-a55b-b8a7e6f2b617 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:56.144240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e587d262-9258-4e33-a55b-b8a7e6f2b617 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:56.162485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e587d262-9258-4e33-a55b-b8a7e6f2b617 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:56.164199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e587d262-9258-4e33-a55b-b8a7e6f2b617 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:56.165074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e587d262-9258-4e33-a55b-b8a7e6f2b617 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:56.167810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e587d262-9258-4e33-a55b-b8a7e6f2b617 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:56.168679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e587d262-9258-4e33-a55b-b8a7e6f2b617 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:56.171280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e587d262-9258-4e33-a55b-b8a7e6f2b617 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:56.557406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e587d262-9258-4e33-a55b-b8a7e6f2b617 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:56.600663 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e587d262-9258-4e33-a55b-b8a7e6f2b617 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1203 microversion: 2.1 time: 0.472000 Oct 04 21:39:56.605271 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3052/6078] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:56 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1203 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:57.633187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e40397ee-4a1f-42ce-a387-4e6029b54c68 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:57.633990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e40397ee-4a1f-42ce-a387-4e6029b54c68 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:57.651323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e40397ee-4a1f-42ce-a387-4e6029b54c68 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:57.662559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e40397ee-4a1f-42ce-a387-4e6029b54c68 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:57.663627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e40397ee-4a1f-42ce-a387-4e6029b54c68 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:57.674777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e40397ee-4a1f-42ce-a387-4e6029b54c68 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:57.677386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e40397ee-4a1f-42ce-a387-4e6029b54c68 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:57.693722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e40397ee-4a1f-42ce-a387-4e6029b54c68 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:58.249348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e40397ee-4a1f-42ce-a387-4e6029b54c68 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:58.261900 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e40397ee-4a1f-42ce-a387-4e6029b54c68 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1203 microversion: 2.1 time: 0.633147 Oct 04 21:39:58.263024 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3027/6079] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:57 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1203 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:59.286145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d53aa9df-3a5d-4049-9c3b-6c76d3d42882 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:59.287951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d53aa9df-3a5d-4049-9c3b-6c76d3d42882 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:59.302374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d53aa9df-3a5d-4049-9c3b-6c76d3d42882 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:59.302977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d53aa9df-3a5d-4049-9c3b-6c76d3d42882 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:59.303434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d53aa9df-3a5d-4049-9c3b-6c76d3d42882 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:59.304165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d53aa9df-3a5d-4049-9c3b-6c76d3d42882 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:59.306729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d53aa9df-3a5d-4049-9c3b-6c76d3d42882 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:59.308695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d53aa9df-3a5d-4049-9c3b-6c76d3d42882 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:00.572725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d53aa9df-3a5d-4049-9c3b-6c76d3d42882 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:00.590697 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d53aa9df-3a5d-4049-9c3b-6c76d3d42882 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1203 microversion: 2.1 time: 1.310263 Oct 04 21:40:00.592277 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3053/6080] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:59 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1203 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:01.617518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f5a08044-ef81-499b-a5a4-0c83c957e329 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:01.622757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f5a08044-ef81-499b-a5a4-0c83c957e329 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:01.631407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5a08044-ef81-499b-a5a4-0c83c957e329 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:01.631914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5a08044-ef81-499b-a5a4-0c83c957e329 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:01.632367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5a08044-ef81-499b-a5a4-0c83c957e329 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:01.633098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5a08044-ef81-499b-a5a4-0c83c957e329 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:01.633603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5a08044-ef81-499b-a5a4-0c83c957e329 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:01.634040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5a08044-ef81-499b-a5a4-0c83c957e329 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:02.059932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f5a08044-ef81-499b-a5a4-0c83c957e329 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:02.068633 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f5a08044-ef81-499b-a5a4-0c83c957e329 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1203 microversion: 2.1 time: 0.454985 Oct 04 21:40:02.069235 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3028/6081] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:01 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1203 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:03.092940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-279af2c0-f6aa-4f09-9ba5-b2996a7cc986 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:03.094593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-279af2c0-f6aa-4f09-9ba5-b2996a7cc986 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:03.105381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-279af2c0-f6aa-4f09-9ba5-b2996a7cc986 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:03.106106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-279af2c0-f6aa-4f09-9ba5-b2996a7cc986 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:03.106566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-279af2c0-f6aa-4f09-9ba5-b2996a7cc986 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:03.107567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-279af2c0-f6aa-4f09-9ba5-b2996a7cc986 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:03.108234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-279af2c0-f6aa-4f09-9ba5-b2996a7cc986 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:03.108679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-279af2c0-f6aa-4f09-9ba5-b2996a7cc986 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:03.406968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-279af2c0-f6aa-4f09-9ba5-b2996a7cc986 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:03.417893 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-279af2c0-f6aa-4f09-9ba5-b2996a7cc986 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1203 microversion: 2.1 time: 0.329430 Oct 04 21:40:03.418963 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3054/6082] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:03 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1203 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:04.445870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-af70a816-fb85-4056-b392-be8d3ebb4ab8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:04.446811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-af70a816-fb85-4056-b392-be8d3ebb4ab8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:04.461779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af70a816-fb85-4056-b392-be8d3ebb4ab8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:04.475959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af70a816-fb85-4056-b392-be8d3ebb4ab8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:04.475959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af70a816-fb85-4056-b392-be8d3ebb4ab8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:04.475959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af70a816-fb85-4056-b392-be8d3ebb4ab8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:04.475959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af70a816-fb85-4056-b392-be8d3ebb4ab8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:04.475959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af70a816-fb85-4056-b392-be8d3ebb4ab8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:04.672065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-af70a816-fb85-4056-b392-be8d3ebb4ab8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:04.681359 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-af70a816-fb85-4056-b392-be8d3ebb4ab8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1203 microversion: 2.1 time: 0.243758 Oct 04 21:40:04.685529 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3029/6083] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:04 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1203 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:05.712477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6e44be0d-6db0-45f9-b545-e03636f41684 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:05.713141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6e44be0d-6db0-45f9-b545-e03636f41684 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:05.721850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e44be0d-6db0-45f9-b545-e03636f41684 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:05.722370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e44be0d-6db0-45f9-b545-e03636f41684 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:05.723208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e44be0d-6db0-45f9-b545-e03636f41684 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:05.724370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e44be0d-6db0-45f9-b545-e03636f41684 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:05.725000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e44be0d-6db0-45f9-b545-e03636f41684 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:05.725464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e44be0d-6db0-45f9-b545-e03636f41684 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:05.869908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6e44be0d-6db0-45f9-b545-e03636f41684 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:05.888544 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6e44be0d-6db0-45f9-b545-e03636f41684 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1203 microversion: 2.1 time: 0.180429 Oct 04 21:40:05.889808 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3055/6084] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:05 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1203 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:06.114072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-19b742fa-9400-4709-95ce-e4343bc3ecf1 req-b031043c-e1f7-4c1e-a84c-fa84d3249287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85", "name": "network-vif-plugged", "status": "completed", "tag": "72d873c0-5700-4a60-82cf-20df564b99f5"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:06.126861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-19b742fa-9400-4709-95ce-e4343bc3ecf1 req-b031043c-e1f7-4c1e-a84c-fa84d3249287 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:06.127655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-19b742fa-9400-4709-95ce-e4343bc3ecf1 req-b031043c-e1f7-4c1e-a84c-fa84d3249287 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:06.128450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-19b742fa-9400-4709-95ce-e4343bc3ecf1 req-b031043c-e1f7-4c1e-a84c-fa84d3249287 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:06.144997 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-19b742fa-9400-4709-95ce-e4343bc3ecf1 req-b031043c-e1f7-4c1e-a84c-fa84d3249287 service nova] Creating event network-vif-plugged:72d873c0-5700-4a60-82cf-20df564b99f5 for instance e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 on n-h2-860282-1 Oct 04 21:40:06.151640 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-19b742fa-9400-4709-95ce-e4343bc3ecf1 req-b031043c-e1f7-4c1e-a84c-fa84d3249287 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041207 Oct 04 21:40:06.152810 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3030/6085] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:06.917897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5b41a9d6-1adc-4487-975d-6c85aaac8ce5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:06.918622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5b41a9d6-1adc-4487-975d-6c85aaac8ce5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:06.932174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b41a9d6-1adc-4487-975d-6c85aaac8ce5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:06.937452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b41a9d6-1adc-4487-975d-6c85aaac8ce5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:06.937452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b41a9d6-1adc-4487-975d-6c85aaac8ce5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:06.937452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b41a9d6-1adc-4487-975d-6c85aaac8ce5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:06.937452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b41a9d6-1adc-4487-975d-6c85aaac8ce5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:06.937452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b41a9d6-1adc-4487-975d-6c85aaac8ce5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:07.230037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5b41a9d6-1adc-4487-975d-6c85aaac8ce5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:07.247598 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5b41a9d6-1adc-4487-975d-6c85aaac8ce5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1203 microversion: 2.1 time: 0.336069 Oct 04 21:40:07.248567 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3056/6086] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:06 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1203 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:08.124868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ea49bbb3-7bd1-4da5-bdba-49ff598e5089 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:08.126578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ea49bbb3-7bd1-4da5-bdba-49ff598e5089 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:08.136445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea49bbb3-7bd1-4da5-bdba-49ff598e5089 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:08.136962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea49bbb3-7bd1-4da5-bdba-49ff598e5089 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:08.137677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea49bbb3-7bd1-4da5-bdba-49ff598e5089 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:08.144305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea49bbb3-7bd1-4da5-bdba-49ff598e5089 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:08.144305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea49bbb3-7bd1-4da5-bdba-49ff598e5089 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:08.144305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea49bbb3-7bd1-4da5-bdba-49ff598e5089 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:08.259530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-ea49bbb3-7bd1-4da5-bdba-49ff598e5089 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lazy-loading 'services' on Instance uuid 7adeab45-7c8f-4c50-8018-934a76f76e22 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:40:08.282881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5a778de9-1bda-4de5-838d-bdafc1688cf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:08.282881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5a778de9-1bda-4de5-838d-bdafc1688cf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:08.289222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a778de9-1bda-4de5-838d-bdafc1688cf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:08.290077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a778de9-1bda-4de5-838d-bdafc1688cf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:08.291289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a778de9-1bda-4de5-838d-bdafc1688cf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:08.292186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a778de9-1bda-4de5-838d-bdafc1688cf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:08.292653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a778de9-1bda-4de5-838d-bdafc1688cf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:08.293085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a778de9-1bda-4de5-838d-bdafc1688cf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:08.542199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5a778de9-1bda-4de5-838d-bdafc1688cf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:08.555494 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5a778de9-1bda-4de5-838d-bdafc1688cf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1389 microversion: 2.1 time: 0.281833 Oct 04 21:40:08.556576 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3057/6087] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:08 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1389 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:08.563945 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ea49bbb3-7bd1-4da5-bdba-49ff598e5089 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-volume_attachments/5c555a4f-2157-4efe-a35e-f6714356d92d" status: 202 len: 0 microversion: 2.1 time: 0.444807 Oct 04 21:40:08.565284 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3031/6088] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 21:40:08 2022] DELETE /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-volume_attachments/5c555a4f-2157-4efe-a35e-f6714356d92d => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:40:08.583753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-95b09d8f-1387-494a-9d02-e6256a8888f0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:08.586932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-95b09d8f-1387-494a-9d02-e6256a8888f0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:08.593684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f82f9c77-a7f3-4f01-b1a5-4c352358de96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:08.593684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f82f9c77-a7f3-4f01-b1a5-4c352358de96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:08.594567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95b09d8f-1387-494a-9d02-e6256a8888f0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:08.595167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95b09d8f-1387-494a-9d02-e6256a8888f0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:08.595763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95b09d8f-1387-494a-9d02-e6256a8888f0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:08.596603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95b09d8f-1387-494a-9d02-e6256a8888f0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:08.597247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95b09d8f-1387-494a-9d02-e6256a8888f0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:08.597865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95b09d8f-1387-494a-9d02-e6256a8888f0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:08.599530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f82f9c77-a7f3-4f01-b1a5-4c352358de96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:08.600774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f82f9c77-a7f3-4f01-b1a5-4c352358de96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:08.601383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f82f9c77-a7f3-4f01-b1a5-4c352358de96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:08.602507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f82f9c77-a7f3-4f01-b1a5-4c352358de96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:08.603182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f82f9c77-a7f3-4f01-b1a5-4c352358de96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:08.603786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f82f9c77-a7f3-4f01-b1a5-4c352358de96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:08.655247 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-95b09d8f-1387-494a-9d02-e6256a8888f0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076884 Oct 04 21:40:08.669013 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3058/6089] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:40:08 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:08.948063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f82f9c77-a7f3-4f01-b1a5-4c352358de96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:08.956745 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f82f9c77-a7f3-4f01-b1a5-4c352358de96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1389 microversion: 2.1 time: 0.374777 Oct 04 21:40:08.961460 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3032/6090] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:08 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1389 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:08.983292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4b28e52b-ea0f-4753-814d-216863cc845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:08.983918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4b28e52b-ea0f-4753-814d-216863cc845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:08.993225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b28e52b-ea0f-4753-814d-216863cc845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:08.998953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b28e52b-ea0f-4753-814d-216863cc845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:08.998953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b28e52b-ea0f-4753-814d-216863cc845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:08.998953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b28e52b-ea0f-4753-814d-216863cc845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:08.998953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b28e52b-ea0f-4753-814d-216863cc845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:08.998953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b28e52b-ea0f-4753-814d-216863cc845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:09.161255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4b28e52b-ea0f-4753-814d-216863cc845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:09.172587 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4b28e52b-ea0f-4753-814d-216863cc845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1389 microversion: 2.1 time: 0.193500 Oct 04 21:40:09.173292 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3059/6091] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:08 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1389 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:09.197324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a59ebe82-aec6-4b2d-b14d-c5ebbf6b6afd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:09.198262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a59ebe82-aec6-4b2d-b14d-c5ebbf6b6afd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:09.205718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a59ebe82-aec6-4b2d-b14d-c5ebbf6b6afd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:09.207096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a59ebe82-aec6-4b2d-b14d-c5ebbf6b6afd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:09.207682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a59ebe82-aec6-4b2d-b14d-c5ebbf6b6afd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:09.208267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a59ebe82-aec6-4b2d-b14d-c5ebbf6b6afd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:09.208909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a59ebe82-aec6-4b2d-b14d-c5ebbf6b6afd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:09.209551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a59ebe82-aec6-4b2d-b14d-c5ebbf6b6afd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:09.248161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a59ebe82-aec6-4b2d-b14d-c5ebbf6b6afd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:40:09.668408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7d1ea58b-a196-4c88-bbf5-a291487ea764 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:09.670764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7d1ea58b-a196-4c88-bbf5-a291487ea764 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:09.676186 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a59ebe82-aec6-4b2d-b14d-c5ebbf6b6afd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 204 len: 0 microversion: 2.1 time: 0.482744 Oct 04 21:40:09.678586 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3033/6092] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:40:09 2022] DELETE /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:40:09.679197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:09.684625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d1ea58b-a196-4c88-bbf5-a291487ea764 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:09.685325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d1ea58b-a196-4c88-bbf5-a291487ea764 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:09.685984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d1ea58b-a196-4c88-bbf5-a291487ea764 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:09.687142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d1ea58b-a196-4c88-bbf5-a291487ea764 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:09.687769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d1ea58b-a196-4c88-bbf5-a291487ea764 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:09.688533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d1ea58b-a196-4c88-bbf5-a291487ea764 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:09.692842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3efb5381-d131-47ab-a725-e6b96f2f7b9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:09.693787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3efb5381-d131-47ab-a725-e6b96f2f7b9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:09.700285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3efb5381-d131-47ab-a725-e6b96f2f7b9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:09.700988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3efb5381-d131-47ab-a725-e6b96f2f7b9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:09.701625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3efb5381-d131-47ab-a725-e6b96f2f7b9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:09.702484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3efb5381-d131-47ab-a725-e6b96f2f7b9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:09.703099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3efb5381-d131-47ab-a725-e6b96f2f7b9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:09.703685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3efb5381-d131-47ab-a725-e6b96f2f7b9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:09.724013 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7d1ea58b-a196-4c88-bbf5-a291487ea764 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059572 Oct 04 21:40:09.724780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:09.724996 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3060/6093] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:40:09 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:09.904016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3efb5381-d131-47ab-a725-e6b96f2f7b9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:09.913547 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3efb5381-d131-47ab-a725-e6b96f2f7b9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1395 microversion: 2.1 time: 0.224872 Oct 04 21:40:09.914968 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3034/6094] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:09 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1395 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:40:10.737194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-04b29a68-8853-4222-a6d1-022c864d8c3b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:10.746478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-04b29a68-8853-4222-a6d1-022c864d8c3b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:10.754214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04b29a68-8853-4222-a6d1-022c864d8c3b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:10.754704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04b29a68-8853-4222-a6d1-022c864d8c3b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:10.755162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04b29a68-8853-4222-a6d1-022c864d8c3b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:10.758269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04b29a68-8853-4222-a6d1-022c864d8c3b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:10.758751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04b29a68-8853-4222-a6d1-022c864d8c3b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:10.759183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-04b29a68-8853-4222-a6d1-022c864d8c3b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:10.763320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=87 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:10.798773 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-04b29a68-8853-4222-a6d1-022c864d8c3b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066157 Oct 04 21:40:10.802448 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3061/6095] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:40:10 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:10.945119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9e0e773-4a05-408d-85c0-5151c62e6a11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:10.945779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d9e0e773-4a05-408d-85c0-5151c62e6a11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:10.959713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9e0e773-4a05-408d-85c0-5151c62e6a11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:10.959713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9e0e773-4a05-408d-85c0-5151c62e6a11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:10.959713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9e0e773-4a05-408d-85c0-5151c62e6a11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:10.959713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9e0e773-4a05-408d-85c0-5151c62e6a11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:10.959713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9e0e773-4a05-408d-85c0-5151c62e6a11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:10.959713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9e0e773-4a05-408d-85c0-5151c62e6a11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:11.206189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d9e0e773-4a05-408d-85c0-5151c62e6a11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:11.219698 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d9e0e773-4a05-408d-85c0-5151c62e6a11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1395 microversion: 2.1 time: 0.278142 Oct 04 21:40:11.221062 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3035/6096] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:10 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1395 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:11.811787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0e938dd4-1f52-430e-9af4-807e8ddd4ae0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:11.815663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0e938dd4-1f52-430e-9af4-807e8ddd4ae0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:11.823278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e938dd4-1f52-430e-9af4-807e8ddd4ae0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:11.824049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e938dd4-1f52-430e-9af4-807e8ddd4ae0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:11.824717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e938dd4-1f52-430e-9af4-807e8ddd4ae0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:11.825694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e938dd4-1f52-430e-9af4-807e8ddd4ae0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:11.826393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e938dd4-1f52-430e-9af4-807e8ddd4ae0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:11.827028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e938dd4-1f52-430e-9af4-807e8ddd4ae0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:11.862055 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0e938dd4-1f52-430e-9af4-807e8ddd4ae0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054516 Oct 04 21:40:11.866959 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3062/6097] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:40:11 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:12.256428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d8714b16-10c5-4740-8a60-6d2247c625f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:12.256428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d8714b16-10c5-4740-8a60-6d2247c625f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:12.267993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8714b16-10c5-4740-8a60-6d2247c625f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:12.268507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8714b16-10c5-4740-8a60-6d2247c625f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:12.268966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8714b16-10c5-4740-8a60-6d2247c625f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:12.269730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8714b16-10c5-4740-8a60-6d2247c625f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:12.270209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8714b16-10c5-4740-8a60-6d2247c625f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:12.279323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8714b16-10c5-4740-8a60-6d2247c625f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:12.493070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d8714b16-10c5-4740-8a60-6d2247c625f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:12.525318 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d8714b16-10c5-4740-8a60-6d2247c625f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1353 microversion: 2.1 time: 0.272104 Oct 04 21:40:12.527105 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3036/6098] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:12 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1353 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:12.561841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-a6f25a1b-5924-4482-8a8c-e9974bef853f req-6f987520-5c05-46c0-ba8a-c4ac03ffb040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85", "name": "network-vif-deleted", "tag": "72d873c0-5700-4a60-82cf-20df564b99f5"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:12.574994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a6f25a1b-5924-4482-8a8c-e9974bef853f req-6f987520-5c05-46c0-ba8a-c4ac03ffb040 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:12.575622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a6f25a1b-5924-4482-8a8c-e9974bef853f req-6f987520-5c05-46c0-ba8a-c4ac03ffb040 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:12.576403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a6f25a1b-5924-4482-8a8c-e9974bef853f req-6f987520-5c05-46c0-ba8a-c4ac03ffb040 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:12.611888 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-a6f25a1b-5924-4482-8a8c-e9974bef853f req-6f987520-5c05-46c0-ba8a-c4ac03ffb040 service nova] Creating event network-vif-deleted:72d873c0-5700-4a60-82cf-20df564b99f5 for instance e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 on n-h2-860282-1 Oct 04 21:40:12.624597 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-a6f25a1b-5924-4482-8a8c-e9974bef853f req-6f987520-5c05-46c0-ba8a-c4ac03ffb040 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065909 Oct 04 21:40:12.625594 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3063/6099] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:12.877496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3eb2439b-ba35-4103-8495-d4892223deda tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:12.891749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3eb2439b-ba35-4103-8495-d4892223deda tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:12.906597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:12.916291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3eb2439b-ba35-4103-8495-d4892223deda tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:12.916798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3eb2439b-ba35-4103-8495-d4892223deda tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:12.917244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3eb2439b-ba35-4103-8495-d4892223deda tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:12.917985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3eb2439b-ba35-4103-8495-d4892223deda tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:12.918442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3eb2439b-ba35-4103-8495-d4892223deda tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:12.918873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3eb2439b-ba35-4103-8495-d4892223deda tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:12.978840 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3eb2439b-ba35-4103-8495-d4892223deda tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107353 Oct 04 21:40:12.979726 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3037/6100] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:40:12 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:13.557015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6a397168-32bd-4bf4-a0ea-60e545591732 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:13.557762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6a397168-32bd-4bf4-a0ea-60e545591732 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:13.565355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a397168-32bd-4bf4-a0ea-60e545591732 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:13.565982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a397168-32bd-4bf4-a0ea-60e545591732 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:13.566718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a397168-32bd-4bf4-a0ea-60e545591732 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:13.567749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a397168-32bd-4bf4-a0ea-60e545591732 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:13.568471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a397168-32bd-4bf4-a0ea-60e545591732 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:13.569121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a397168-32bd-4bf4-a0ea-60e545591732 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:13.686631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6a397168-32bd-4bf4-a0ea-60e545591732 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:13.699653 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6a397168-32bd-4bf4-a0ea-60e545591732 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1188 microversion: 2.1 time: 0.145880 Oct 04 21:40:13.701005 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3064/6101] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:13 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1188 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:13.992457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e7c4bc54-53f8-4b3b-95a7-0c94fcd510a0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:13.995708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e7c4bc54-53f8-4b3b-95a7-0c94fcd510a0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:14.003656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7c4bc54-53f8-4b3b-95a7-0c94fcd510a0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:14.004355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7c4bc54-53f8-4b3b-95a7-0c94fcd510a0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:14.005288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7c4bc54-53f8-4b3b-95a7-0c94fcd510a0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:14.006318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7c4bc54-53f8-4b3b-95a7-0c94fcd510a0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:14.007257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7c4bc54-53f8-4b3b-95a7-0c94fcd510a0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:14.007845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7c4bc54-53f8-4b3b-95a7-0c94fcd510a0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:14.070436 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e7c4bc54-53f8-4b3b-95a7-0c94fcd510a0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082065 Oct 04 21:40:14.071038 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3038/6102] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:40:13 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:14.724572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fee15873-2405-4539-a31f-ba79818b23a8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:14.725571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fee15873-2405-4539-a31f-ba79818b23a8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:14.739742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fee15873-2405-4539-a31f-ba79818b23a8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:14.740401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fee15873-2405-4539-a31f-ba79818b23a8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:14.741990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fee15873-2405-4539-a31f-ba79818b23a8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:14.743109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fee15873-2405-4539-a31f-ba79818b23a8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:14.743312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fee15873-2405-4539-a31f-ba79818b23a8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:14.743931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fee15873-2405-4539-a31f-ba79818b23a8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:14.919779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fee15873-2405-4539-a31f-ba79818b23a8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:14.931212 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fee15873-2405-4539-a31f-ba79818b23a8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1188 microversion: 2.1 time: 0.211528 Oct 04 21:40:14.934427 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3065/6103] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:14 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1188 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:15.087065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f2e16361-2d64-4c6f-9df6-70536d20b152 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:15.090341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f2e16361-2d64-4c6f-9df6-70536d20b152 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:15.099511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2e16361-2d64-4c6f-9df6-70536d20b152 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:15.102449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2e16361-2d64-4c6f-9df6-70536d20b152 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:15.102449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2e16361-2d64-4c6f-9df6-70536d20b152 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:15.102449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2e16361-2d64-4c6f-9df6-70536d20b152 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:15.102449 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2e16361-2d64-4c6f-9df6-70536d20b152 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:15.103307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2e16361-2d64-4c6f-9df6-70536d20b152 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:15.144970 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f2e16361-2d64-4c6f-9df6-70536d20b152 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065890 Oct 04 21:40:15.146728 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3039/6104] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 21:40:15 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:40:15.225148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dba1f1f7-698e-45c8-b94e-01f50c93fd07 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:15.229893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dba1f1f7-698e-45c8-b94e-01f50c93fd07 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:15.231920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dba1f1f7-698e-45c8-b94e-01f50c93fd07 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:15.232429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dba1f1f7-698e-45c8-b94e-01f50c93fd07 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:15.232882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dba1f1f7-698e-45c8-b94e-01f50c93fd07 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:15.233747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dba1f1f7-698e-45c8-b94e-01f50c93fd07 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:15.234217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dba1f1f7-698e-45c8-b94e-01f50c93fd07 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:15.234656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dba1f1f7-698e-45c8-b94e-01f50c93fd07 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:15.261224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dba1f1f7-698e-45c8-b94e-01f50c93fd07 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:40:15.663596 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dba1f1f7-698e-45c8-b94e-01f50c93fd07 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 204 len: 0 microversion: 2.1 time: 0.442687 Oct 04 21:40:15.665214 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3066/6105] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:40:15 2022] DELETE /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:40:15.675212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8c83e915-e2f1-417f-a543-5bff981a81b4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:15.676538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8c83e915-e2f1-417f-a543-5bff981a81b4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:15.686826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c83e915-e2f1-417f-a543-5bff981a81b4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:15.687547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c83e915-e2f1-417f-a543-5bff981a81b4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:15.688164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c83e915-e2f1-417f-a543-5bff981a81b4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:15.689706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c83e915-e2f1-417f-a543-5bff981a81b4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:15.690672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c83e915-e2f1-417f-a543-5bff981a81b4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:15.691665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c83e915-e2f1-417f-a543-5bff981a81b4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:15.954519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8c83e915-e2f1-417f-a543-5bff981a81b4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:15.957675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f190cc9d-751b-4aef-b468-f7c3cbd5fe36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:15.959215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f190cc9d-751b-4aef-b468-f7c3cbd5fe36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:15.963807 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8c83e915-e2f1-417f-a543-5bff981a81b4 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 200 len: 1680 microversion: 2.1 time: 0.294112 Oct 04 21:40:15.975646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f190cc9d-751b-4aef-b468-f7c3cbd5fe36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:15.975646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f190cc9d-751b-4aef-b468-f7c3cbd5fe36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:15.975646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f190cc9d-751b-4aef-b468-f7c3cbd5fe36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:15.975646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f190cc9d-751b-4aef-b468-f7c3cbd5fe36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:15.975646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f190cc9d-751b-4aef-b468-f7c3cbd5fe36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:15.975646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f190cc9d-751b-4aef-b468-f7c3cbd5fe36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:15.980431 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3040/6106] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:15 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 1680 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:16.114160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f190cc9d-751b-4aef-b468-f7c3cbd5fe36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:16.135773 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f190cc9d-751b-4aef-b468-f7c3cbd5fe36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1188 microversion: 2.1 time: 0.183055 Oct 04 21:40:16.157946 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3067/6107] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:15 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1188 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:16.992572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8c19739b-fe4e-4625-b51d-dfeacc676d13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:16.994078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8c19739b-fe4e-4625-b51d-dfeacc676d13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:17.009958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c19739b-fe4e-4625-b51d-dfeacc676d13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:17.011072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c19739b-fe4e-4625-b51d-dfeacc676d13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:17.013319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c19739b-fe4e-4625-b51d-dfeacc676d13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:17.014806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c19739b-fe4e-4625-b51d-dfeacc676d13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:17.021407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c19739b-fe4e-4625-b51d-dfeacc676d13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:17.023556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c19739b-fe4e-4625-b51d-dfeacc676d13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:17.171062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2806e454-c655-4136-918b-19869c44ae75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:17.172601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2806e454-c655-4136-918b-19869c44ae75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:17.185960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2806e454-c655-4136-918b-19869c44ae75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:17.186684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2806e454-c655-4136-918b-19869c44ae75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:17.189291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2806e454-c655-4136-918b-19869c44ae75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:17.189291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2806e454-c655-4136-918b-19869c44ae75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:17.189291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2806e454-c655-4136-918b-19869c44ae75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:17.190853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2806e454-c655-4136-918b-19869c44ae75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:17.415271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2806e454-c655-4136-918b-19869c44ae75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:17.424990 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2806e454-c655-4136-918b-19869c44ae75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1188 microversion: 2.1 time: 0.260419 Oct 04 21:40:17.432584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8c19739b-fe4e-4625-b51d-dfeacc676d13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:17.442304 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3068/6108] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:17 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1188 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:40:17.445052 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8c19739b-fe4e-4625-b51d-dfeacc676d13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 200 len: 1680 microversion: 2.1 time: 0.460828 Oct 04 21:40:17.448199 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3041/6109] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:16 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 1680 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:18.450228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cdeb9843-5647-4d7f-86ec-e67f90e061f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:18.452226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cdeb9843-5647-4d7f-86ec-e67f90e061f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:18.471727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cdeb9843-5647-4d7f-86ec-e67f90e061f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:18.474415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cdeb9843-5647-4d7f-86ec-e67f90e061f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:18.475569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c2e4ca1e-36c3-45f7-98e2-36de06fce70c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:18.476198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c2e4ca1e-36c3-45f7-98e2-36de06fce70c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:18.476820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cdeb9843-5647-4d7f-86ec-e67f90e061f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:18.478264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cdeb9843-5647-4d7f-86ec-e67f90e061f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:18.482186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cdeb9843-5647-4d7f-86ec-e67f90e061f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:18.483109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cdeb9843-5647-4d7f-86ec-e67f90e061f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:18.489916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2e4ca1e-36c3-45f7-98e2-36de06fce70c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:18.494079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2e4ca1e-36c3-45f7-98e2-36de06fce70c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:18.495756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2e4ca1e-36c3-45f7-98e2-36de06fce70c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:18.496941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2e4ca1e-36c3-45f7-98e2-36de06fce70c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:18.504324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2e4ca1e-36c3-45f7-98e2-36de06fce70c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:18.505047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c2e4ca1e-36c3-45f7-98e2-36de06fce70c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:18.683321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cdeb9843-5647-4d7f-86ec-e67f90e061f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:18.701127 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cdeb9843-5647-4d7f-86ec-e67f90e061f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1188 microversion: 2.1 time: 0.256397 Oct 04 21:40:18.702347 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3069/6110] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:18 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1188 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:18.730004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c2e4ca1e-36c3-45f7-98e2-36de06fce70c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:18.743606 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c2e4ca1e-36c3-45f7-98e2-36de06fce70c tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 200 len: 1613 microversion: 2.1 time: 0.273960 Oct 04 21:40:18.744134 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3042/6111] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:18 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 1613 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:40:19.743271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-81cf44ed-ea96-497a-8a31-1eef66a0b802 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:19.744169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-81cf44ed-ea96-497a-8a31-1eef66a0b802 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:19.755069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81cf44ed-ea96-497a-8a31-1eef66a0b802 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:19.760781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81cf44ed-ea96-497a-8a31-1eef66a0b802 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:19.763293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81cf44ed-ea96-497a-8a31-1eef66a0b802 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:19.768580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81cf44ed-ea96-497a-8a31-1eef66a0b802 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:19.768870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-44096572-1b6c-4760-b34d-0d94964c926d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:19.771658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-44096572-1b6c-4760-b34d-0d94964c926d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:19.771776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81cf44ed-ea96-497a-8a31-1eef66a0b802 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:19.771776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81cf44ed-ea96-497a-8a31-1eef66a0b802 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:19.787811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44096572-1b6c-4760-b34d-0d94964c926d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:19.789076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44096572-1b6c-4760-b34d-0d94964c926d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:19.789562 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44096572-1b6c-4760-b34d-0d94964c926d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:19.791932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44096572-1b6c-4760-b34d-0d94964c926d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:19.797606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44096572-1b6c-4760-b34d-0d94964c926d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:19.800384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44096572-1b6c-4760-b34d-0d94964c926d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:20.063782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-81cf44ed-ea96-497a-8a31-1eef66a0b802 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:20.073114 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-81cf44ed-ea96-497a-8a31-1eef66a0b802 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1188 microversion: 2.1 time: 0.334732 Oct 04 21:40:20.079716 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3070/6112] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:19 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1188 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:20.122867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-44096572-1b6c-4760-b34d-0d94964c926d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:20.134970 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-44096572-1b6c-4760-b34d-0d94964c926d tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 200 len: 1613 microversion: 2.1 time: 0.371196 Oct 04 21:40:20.136134 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3043/6113] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:19 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 1613 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:21.020666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-fb63be21-0520-4e8b-86c7-e7afa90e42d3 req-1fb007e1-ee96-432c-be2d-ac88c5d9ae83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7adeab45-7c8f-4c50-8018-934a76f76e22", "name": "network-vif-deleted", "tag": "1eda41ac-e408-497d-95f4-04ad129f40ed"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:21.048345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-fb63be21-0520-4e8b-86c7-e7afa90e42d3 req-1fb007e1-ee96-432c-be2d-ac88c5d9ae83 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:21.049470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-fb63be21-0520-4e8b-86c7-e7afa90e42d3 req-1fb007e1-ee96-432c-be2d-ac88c5d9ae83 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:21.049934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-fb63be21-0520-4e8b-86c7-e7afa90e42d3 req-1fb007e1-ee96-432c-be2d-ac88c5d9ae83 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:21.076847 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-fb63be21-0520-4e8b-86c7-e7afa90e42d3 req-1fb007e1-ee96-432c-be2d-ac88c5d9ae83 service nova] Creating event network-vif-deleted:1eda41ac-e408-497d-95f4-04ad129f40ed for instance 7adeab45-7c8f-4c50-8018-934a76f76e22 on n-h1-860282-1 Oct 04 21:40:21.093971 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-fb63be21-0520-4e8b-86c7-e7afa90e42d3 req-1fb007e1-ee96-432c-be2d-ac88c5d9ae83 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.708917 Oct 04 21:40:21.095590 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3071/6114] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:21.107638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-484978a5-eb06-43ca-bcb8-8426d1ecb053 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:21.108562 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-484978a5-eb06-43ca-bcb8-8426d1ecb053 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:21.124508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-484978a5-eb06-43ca-bcb8-8426d1ecb053 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:21.125023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-484978a5-eb06-43ca-bcb8-8426d1ecb053 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:21.125501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-484978a5-eb06-43ca-bcb8-8426d1ecb053 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:21.126295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-484978a5-eb06-43ca-bcb8-8426d1ecb053 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:21.127107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-484978a5-eb06-43ca-bcb8-8426d1ecb053 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:21.127558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-484978a5-eb06-43ca-bcb8-8426d1ecb053 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:21.163094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4a6cefbe-1e20-4125-8678-abd0a7d9d9b3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:21.164335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4a6cefbe-1e20-4125-8678-abd0a7d9d9b3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:21.181188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a6cefbe-1e20-4125-8678-abd0a7d9d9b3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:21.182181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a6cefbe-1e20-4125-8678-abd0a7d9d9b3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:21.183237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a6cefbe-1e20-4125-8678-abd0a7d9d9b3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:21.184848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a6cefbe-1e20-4125-8678-abd0a7d9d9b3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:21.187553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a6cefbe-1e20-4125-8678-abd0a7d9d9b3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:21.188801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a6cefbe-1e20-4125-8678-abd0a7d9d9b3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:21.197076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-484978a5-eb06-43ca-bcb8-8426d1ecb053 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:21.197937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-484978a5-eb06-43ca-bcb8-8426d1ecb053 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:21.198772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-484978a5-eb06-43ca-bcb8-8426d1ecb053 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:21.199429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-484978a5-eb06-43ca-bcb8-8426d1ecb053 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lazy-loading 'fault' on Instance uuid e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:40:21.272832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a6cefbe-1e20-4125-8678-abd0a7d9d9b3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:21.275109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a6cefbe-1e20-4125-8678-abd0a7d9d9b3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:21.276725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a6cefbe-1e20-4125-8678-abd0a7d9d9b3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:21.279198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-4a6cefbe-1e20-4125-8678-abd0a7d9d9b3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lazy-loading 'fault' on Instance uuid 7adeab45-7c8f-4c50-8018-934a76f76e22 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:40:21.437056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-484978a5-eb06-43ca-bcb8-8426d1ecb053 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:21.451700 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-484978a5-eb06-43ca-bcb8-8426d1ecb053 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 200 len: 1193 microversion: 2.1 time: 0.349074 Oct 04 21:40:21.455708 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3044/6115] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:21 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 1193 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:21.490254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4a6cefbe-1e20-4125-8678-abd0a7d9d9b3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2203c15fe41d8ae410f31ba1e1301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a12e438f0e4e9a83b0ab95f50c791c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:21.508640 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4a6cefbe-1e20-4125-8678-abd0a7d9d9b3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 200 len: 1331 microversion: 2.1 time: 0.350550 Oct 04 21:40:21.509269 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3072/6116] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:21 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 1331 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:22.482215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-987ebe49-50f1-4ab2-8860-9cca03dd0ada tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:22.483745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-987ebe49-50f1-4ab2-8860-9cca03dd0ada tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:22.502779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-987ebe49-50f1-4ab2-8860-9cca03dd0ada tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:22.504114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-987ebe49-50f1-4ab2-8860-9cca03dd0ada tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:22.506765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-987ebe49-50f1-4ab2-8860-9cca03dd0ada tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:22.511963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-987ebe49-50f1-4ab2-8860-9cca03dd0ada tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:22.514511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-987ebe49-50f1-4ab2-8860-9cca03dd0ada tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:22.515277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-987ebe49-50f1-4ab2-8860-9cca03dd0ada tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:22.542888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b047fc1f-895a-4f63-b890-649fca5388f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:22.544247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b047fc1f-895a-4f63-b890-649fca5388f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:22.555779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b047fc1f-895a-4f63-b890-649fca5388f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:22.556643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b047fc1f-895a-4f63-b890-649fca5388f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:22.557242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b047fc1f-895a-4f63-b890-649fca5388f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:22.557786 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-987ebe49-50f1-4ab2-8860-9cca03dd0ada tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] HTTP exception thrown: Instance e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 could not be found. Oct 04 21:40:22.558492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b047fc1f-895a-4f63-b890-649fca5388f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:22.560035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b047fc1f-895a-4f63-b890-649fca5388f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-987ebe49-50f1-4ab2-8860-9cca03dd0ada tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Request method failure captured: Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 HTTP/1.1 Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKgKHoOaT8uqO1KoOPn24xM7P0ylwdbLFlP7NxtckxX5YVgkQXQgvdk_pv_DRrXpTR_A9RTrhRjboZG7XPsaIwCmuey_7FqshLEW4wp7-ccvS6GHij-f3j-K3O_9tzU_63L01blifBD1TcCBZnKNp1OdTYkzGEDdJ0DY_B_XNHTjspY Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68208d23fd2f40479ba279566a819933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68208d23fd2f40479ba279566a819933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}] Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 15748f41da9f49fca3e7eec1fda3b245 Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 could not be found. Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85'} Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 could not be found. Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 could not be found. Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:22.560329 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.567568 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:22.567568 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:22.567568 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:22.567568 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:22.567568 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:22.567568 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 could not be found. Oct 04 21:40:22.567568 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.568577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-987ebe49-50f1-4ab2-8860-9cca03dd0ada tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Returning 404 to user: Instance e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:22.569046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b047fc1f-895a-4f63-b890-649fca5388f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:22.570150 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-987ebe49-50f1-4ab2-8860-9cca03dd0ada tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85" status: 404 len: 111 microversion: 2.1 time: 0.096511 Oct 04 21:40:22.574182 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3045/6117] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:22 2022] GET /compute/v2.1/servers/e07b1db7-cf7f-49f6-be7f-8e5b3c4a3a85 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:40:22.616396 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-b047fc1f-895a-4f63-b890-649fca5388f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] HTTP exception thrown: Instance 7adeab45-7c8f-4c50-8018-934a76f76e22 could not be found. Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b047fc1f-895a-4f63-b890-649fca5388f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Request method failure captured: Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 HTTP/1.1 Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKbagiGypEfWhrQ_0lE94AP27Qoh0E4iGeIB2v7-1zLRFZVlQCLRG0FD49h9EoPD55kuiioz0fPU1oTFLY5Kkl3L3vqChLMTEe1In4MGHbsFa7Gm-matpM3wFwyWA19l96bcqrryYQdSr6oZRwmQgAqc6hQhUAbifVGqqLh8bVE-KBY Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}] Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 68a2203c15fe41d8ae410f31ba1e1301 Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 7adeab45-7c8f-4c50-8018-934a76f76e22 could not be found. Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '7adeab45-7c8f-4c50-8018-934a76f76e22'} Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adeab45-7c8f-4c50-8018-934a76f76e22 could not be found. Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adeab45-7c8f-4c50-8018-934a76f76e22 could not be found. Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:22.618525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.630922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:22.630922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:22.630922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:22.630922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:22.630922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:22.630922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adeab45-7c8f-4c50-8018-934a76f76e22 could not be found. Oct 04 21:40:22.630922 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.630922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b047fc1f-895a-4f63-b890-649fca5388f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Returning 404 to user: Instance 7adeab45-7c8f-4c50-8018-934a76f76e22 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:22.630922 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b047fc1f-895a-4f63-b890-649fca5388f5 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 404 len: 111 microversion: 2.1 time: 0.085016 Oct 04 21:40:22.630922 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3073/6118] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:22 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:40:22.633710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bc43e370-3a2b-44d5-8e3b-3f52070f9977 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '.version_select at 0x7f578b26d160>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:22.746082 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bc43e370-3a2b-44d5-8e3b-3f52070f9977 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893373306" status: 202 len: 0 microversion: 2.1 time: 0.116948 Oct 04 21:40:22.747422 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3046/6119] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Oct 4 21:40:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893373306 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:40:31.359200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-95485be7-ea5c-41f2-93a9-0c36a9e898a6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:31.360299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-95485be7-ea5c-41f2-93a9-0c36a9e898a6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:31.370125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95485be7-ea5c-41f2-93a9-0c36a9e898a6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:31.370876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95485be7-ea5c-41f2-93a9-0c36a9e898a6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:31.371517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95485be7-ea5c-41f2-93a9-0c36a9e898a6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:31.372430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95485be7-ea5c-41f2-93a9-0c36a9e898a6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:31.373522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95485be7-ea5c-41f2-93a9-0c36a9e898a6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:31.374730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95485be7-ea5c-41f2-93a9-0c36a9e898a6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:31.406447 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-95485be7-ea5c-41f2-93a9-0c36a9e898a6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] HTTP exception thrown: Instance 7adeab45-7c8f-4c50-8018-934a76f76e22 could not be found. Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-95485be7-ea5c-41f2-93a9-0c36a9e898a6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Request method failure captured: Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 HTTP/1.1 Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKbagiGypEfWhrQ_0lE94AP27Qoh0E4iGeIB2v7-1zLRFZVlQCLRG0FD49h9EoPD55kuiioz0fPU1oTFLY5Kkl3L3vqChLMTEe1In4MGHbsFa7Gm-matpM3wFwyWA19l96bcqrryYQdSr6oZRwmQgAqc6hQhUAbifVGqqLh8bVE-KBY Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}] Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 68a2203c15fe41d8ae410f31ba1e1301 Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 7adeab45-7c8f-4c50-8018-934a76f76e22 could not be found. Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '7adeab45-7c8f-4c50-8018-934a76f76e22'} Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adeab45-7c8f-4c50-8018-934a76f76e22 could not be found. Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:40:31.409891 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:31.415778 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adeab45-7c8f-4c50-8018-934a76f76e22 could not be found. Oct 04 21:40:31.415778 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:40:31.415778 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:31.415778 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:40:31.415778 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:31.415778 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:31.415778 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:31.415778 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:31.415778 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:31.415778 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adeab45-7c8f-4c50-8018-934a76f76e22 could not be found. Oct 04 21:40:31.415778 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:40:31.415778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-95485be7-ea5c-41f2-93a9-0c36a9e898a6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Returning 404 to user: Instance 7adeab45-7c8f-4c50-8018-934a76f76e22 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:31.415778 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-95485be7-ea5c-41f2-93a9-0c36a9e898a6 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 404 len: 111 microversion: 2.1 time: 0.057216 Oct 04 21:40:31.451297 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3074/6120] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:40:31 2022] DELETE /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:40:31.458577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ff73c055-f86d-4645-9511-8e6e12031be1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:31.459831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ff73c055-f86d-4645-9511-8e6e12031be1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 7adeab45-7c8f-4c50-8018-934a76f76e22] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:31.480245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff73c055-f86d-4645-9511-8e6e12031be1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:31.481197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff73c055-f86d-4645-9511-8e6e12031be1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:31.483390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff73c055-f86d-4645-9511-8e6e12031be1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:31.487076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff73c055-f86d-4645-9511-8e6e12031be1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:31.489601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff73c055-f86d-4645-9511-8e6e12031be1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:31.490254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff73c055-f86d-4645-9511-8e6e12031be1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:31.535115 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-ff73c055-f86d-4645-9511-8e6e12031be1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] HTTP exception thrown: Instance 7adeab45-7c8f-4c50-8018-934a76f76e22 could not be found. Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ff73c055-f86d-4645-9511-8e6e12031be1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Request method failure captured: Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 HTTP/1.1 Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKbagiGypEfWhrQ_0lE94AP27Qoh0E4iGeIB2v7-1zLRFZVlQCLRG0FD49h9EoPD55kuiioz0fPU1oTFLY5Kkl3L3vqChLMTEe1In4MGHbsFa7Gm-matpM3wFwyWA19l96bcqrryYQdSr6oZRwmQgAqc6hQhUAbifVGqqLh8bVE-KBY Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}] Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 68a2203c15fe41d8ae410f31ba1e1301 Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 7adeab45-7c8f-4c50-8018-934a76f76e22 could not be found. Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '7adeab45-7c8f-4c50-8018-934a76f76e22'} Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adeab45-7c8f-4c50-8018-934a76f76e22 could not be found. Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adeab45-7c8f-4c50-8018-934a76f76e22 could not be found. Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:31.541817 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:31.548882 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:31.548882 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:31.548882 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:31.548882 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:31.548882 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:31.548882 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adeab45-7c8f-4c50-8018-934a76f76e22 could not be found. Oct 04 21:40:31.548882 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:31.556900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ff73c055-f86d-4645-9511-8e6e12031be1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Returning 404 to user: Instance 7adeab45-7c8f-4c50-8018-934a76f76e22 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:31.558664 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ff73c055-f86d-4645-9511-8e6e12031be1 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22" status: 404 len: 111 microversion: 2.1 time: 0.106010 Oct 04 21:40:31.559791 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3047/6121] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:31 2022] GET /compute/v2.1/servers/7adeab45-7c8f-4c50-8018-934a76f76e22 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:40:38.670785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2a821474-f261-4600-906e-3a62391eabb6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1401013594", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "11fd3cb6-9fb4-4046-bffb-c242e962f71f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b7f4cca9-cdc1-49bd-97e7-bd6739547eb6"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:38.808469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-2a821474-f261-4600-906e-3a62391eabb6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] validate_networks() for [('b7f4cca9-cdc1-49bd-97e7-bd6739547eb6', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:40:39.880677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-2a821474-f261-4600-906e-3a62391eabb6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:40:39.881655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-2a821474-f261-4600-906e-3a62391eabb6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:40:39.885458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-2a821474-f261-4600-906e-3a62391eabb6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:40:39.891908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-2a821474-f261-4600-906e-3a62391eabb6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:40:39.892790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-2a821474-f261-4600-906e-3a62391eabb6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:40:39.908934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a821474-f261-4600-906e-3a62391eabb6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:39.910038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a821474-f261-4600-906e-3a62391eabb6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:39.910486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a821474-f261-4600-906e-3a62391eabb6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:39.911422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a821474-f261-4600-906e-3a62391eabb6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:39.911894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a821474-f261-4600-906e-3a62391eabb6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:39.912332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a821474-f261-4600-906e-3a62391eabb6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:39.966274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-2a821474-f261-4600-906e-3a62391eabb6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Getting quotas for project 68208d23fd2f40479ba279566a819933. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:40:39.975263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bb9c4bfe-73a5-40be-be20-0939d402cf13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:39.976766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bb9c4bfe-73a5-40be-be20-0939d402cf13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:39.979035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-2a821474-f261-4600-906e-3a62391eabb6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Getting quotas for user 15748f41da9f49fca3e7eec1fda3b245 and project 68208d23fd2f40479ba279566a819933. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:40:39.986653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb9c4bfe-73a5-40be-be20-0939d402cf13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:39.989089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb9c4bfe-73a5-40be-be20-0939d402cf13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:39.989089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb9c4bfe-73a5-40be-be20-0939d402cf13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:39.989904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb9c4bfe-73a5-40be-be20-0939d402cf13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:39.990618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb9c4bfe-73a5-40be-be20-0939d402cf13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:39.991316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb9c4bfe-73a5-40be-be20-0939d402cf13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:40.013353 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-bb9c4bfe-73a5-40be-be20-0939d402cf13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] HTTP exception thrown: Instance 836e5756-eb0c-40c6-9581-60a5c270241d could not be found. Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bb9c4bfe-73a5-40be-be20-0939d402cf13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Request method failure captured: Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d HTTP/1.1 Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKbagiGypEfWhrQ_0lE94AP27Qoh0E4iGeIB2v7-1zLRFZVlQCLRG0FD49h9EoPD55kuiioz0fPU1oTFLY5Kkl3L3vqChLMTEe1In4MGHbsFa7Gm-matpM3wFwyWA19l96bcqrryYQdSr6oZRwmQgAqc6hQhUAbifVGqqLh8bVE-KBY Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}] Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 68a2203c15fe41d8ae410f31ba1e1301 Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 836e5756-eb0c-40c6-9581-60a5c270241d could not be found. Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '836e5756-eb0c-40c6-9581-60a5c270241d'} Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 836e5756-eb0c-40c6-9581-60a5c270241d could not be found. Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:40:40.015696 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:40.022098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 836e5756-eb0c-40c6-9581-60a5c270241d could not be found. Oct 04 21:40:40.022098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.022098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:40.022098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.022098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:40.022098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:40.022098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:40.022098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:40.022098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:40.022098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 836e5756-eb0c-40c6-9581-60a5c270241d could not be found. Oct 04 21:40:40.022098 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.026772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bb9c4bfe-73a5-40be-be20-0939d402cf13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Returning 404 to user: Instance 836e5756-eb0c-40c6-9581-60a5c270241d could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:40.027901 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bb9c4bfe-73a5-40be-be20-0939d402cf13 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "DELETE /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 404 len: 111 microversion: 2.1 time: 0.058833 Oct 04 21:40:40.029271 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3048/6122] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:40:39 2022] DELETE /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:40:40.043018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4895e018-d16c-4c50-b3b2-27b0495d0eb0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:40.043944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4895e018-d16c-4c50-b3b2-27b0495d0eb0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 836e5756-eb0c-40c6-9581-60a5c270241d] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:40.052948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4895e018-d16c-4c50-b3b2-27b0495d0eb0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:40.053856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4895e018-d16c-4c50-b3b2-27b0495d0eb0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:40.054675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4895e018-d16c-4c50-b3b2-27b0495d0eb0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:40.055781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4895e018-d16c-4c50-b3b2-27b0495d0eb0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:40.056837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4895e018-d16c-4c50-b3b2-27b0495d0eb0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:40.058348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4895e018-d16c-4c50-b3b2-27b0495d0eb0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:40.098072 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-4895e018-d16c-4c50-b3b2-27b0495d0eb0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] HTTP exception thrown: Instance 836e5756-eb0c-40c6-9581-60a5c270241d could not be found. Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4895e018-d16c-4c50-b3b2-27b0495d0eb0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Request method failure captured: Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d HTTP/1.1 Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKbagiGypEfWhrQ_0lE94AP27Qoh0E4iGeIB2v7-1zLRFZVlQCLRG0FD49h9EoPD55kuiioz0fPU1oTFLY5Kkl3L3vqChLMTEe1In4MGHbsFa7Gm-matpM3wFwyWA19l96bcqrryYQdSr6oZRwmQgAqc6hQhUAbifVGqqLh8bVE-KBY Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}] Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 68a2203c15fe41d8ae410f31ba1e1301 Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 836e5756-eb0c-40c6-9581-60a5c270241d could not be found. Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '836e5756-eb0c-40c6-9581-60a5c270241d'} Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 836e5756-eb0c-40c6-9581-60a5c270241d could not be found. Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 836e5756-eb0c-40c6-9581-60a5c270241d could not be found. Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:40.099721 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.116923 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:40.116923 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:40.116923 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:40.116923 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:40.116923 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:40.116923 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 836e5756-eb0c-40c6-9581-60a5c270241d could not be found. Oct 04 21:40:40.116923 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.116923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4895e018-d16c-4c50-b3b2-27b0495d0eb0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Returning 404 to user: Instance 836e5756-eb0c-40c6-9581-60a5c270241d could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:40.116923 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4895e018-d16c-4c50-b3b2-27b0495d0eb0 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d" status: 404 len: 111 microversion: 2.1 time: 0.066180 Oct 04 21:40:40.116923 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3049/6123] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:40 2022] GET /compute/v2.1/servers/836e5756-eb0c-40c6-9581-60a5c270241d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:40:40.118473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2a821474-f261-4600-906e-3a62391eabb6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:40:40.118473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2a821474-f261-4600-906e-3a62391eabb6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='11fd3cb6-9fb4-4046-bffb-c242e962f71f',volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:40:40.119264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-655eeba0-fe20-4c20-9002-9e96ae9e99d3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:40.119264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-655eeba0-fe20-4c20-9002-9e96ae9e99d3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:40.128828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-655eeba0-fe20-4c20-9002-9e96ae9e99d3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:40.129630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-655eeba0-fe20-4c20-9002-9e96ae9e99d3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:40.130339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-655eeba0-fe20-4c20-9002-9e96ae9e99d3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:40.131237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-655eeba0-fe20-4c20-9002-9e96ae9e99d3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:40.132439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-655eeba0-fe20-4c20-9002-9e96ae9e99d3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:40.133066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-655eeba0-fe20-4c20-9002-9e96ae9e99d3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:40.170746 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-655eeba0-fe20-4c20-9002-9e96ae9e99d3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] HTTP exception thrown: Instance f8c5b825-6552-42c9-b652-2b7eff7bffce could not be found. Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-655eeba0-fe20-4c20-9002-9e96ae9e99d3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Request method failure captured: Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce HTTP/1.1 Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKbagiGypEfWhrQ_0lE94AP27Qoh0E4iGeIB2v7-1zLRFZVlQCLRG0FD49h9EoPD55kuiioz0fPU1oTFLY5Kkl3L3vqChLMTEe1In4MGHbsFa7Gm-matpM3wFwyWA19l96bcqrryYQdSr6oZRwmQgAqc6hQhUAbifVGqqLh8bVE-KBY Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}] Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 68a2203c15fe41d8ae410f31ba1e1301 Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance f8c5b825-6552-42c9-b652-2b7eff7bffce could not be found. Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'f8c5b825-6552-42c9-b652-2b7eff7bffce'} Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8c5b825-6552-42c9-b652-2b7eff7bffce could not be found. Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:40:40.172612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:40.179470 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8c5b825-6552-42c9-b652-2b7eff7bffce could not be found. Oct 04 21:40:40.179470 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.179470 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:40.179470 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.179470 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:40.179470 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:40.179470 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:40.179470 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:40.179470 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:40.179470 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8c5b825-6552-42c9-b652-2b7eff7bffce could not be found. Oct 04 21:40:40.179470 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.188235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-655eeba0-fe20-4c20-9002-9e96ae9e99d3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Returning 404 to user: Instance f8c5b825-6552-42c9-b652-2b7eff7bffce could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:40.188235 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-655eeba0-fe20-4c20-9002-9e96ae9e99d3 tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 404 len: 111 microversion: 2.1 time: 0.074572 Oct 04 21:40:40.188235 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3050/6124] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:40:40 2022] DELETE /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:40:40.202763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-08c8b41f-40d1-45c5-9652-e698bc21fe8e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:40.204153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-08c8b41f-40d1-45c5-9652-e698bc21fe8e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: f8c5b825-6552-42c9-b652-2b7eff7bffce] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:40.212891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08c8b41f-40d1-45c5-9652-e698bc21fe8e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:40.213394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08c8b41f-40d1-45c5-9652-e698bc21fe8e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:40.213861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08c8b41f-40d1-45c5-9652-e698bc21fe8e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:40.216831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08c8b41f-40d1-45c5-9652-e698bc21fe8e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:40.216831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08c8b41f-40d1-45c5-9652-e698bc21fe8e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:40.216831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08c8b41f-40d1-45c5-9652-e698bc21fe8e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:40.234134 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-08c8b41f-40d1-45c5-9652-e698bc21fe8e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] HTTP exception thrown: Instance f8c5b825-6552-42c9-b652-2b7eff7bffce could not be found. Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-08c8b41f-40d1-45c5-9652-e698bc21fe8e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Request method failure captured: Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce HTTP/1.1 Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKbagiGypEfWhrQ_0lE94AP27Qoh0E4iGeIB2v7-1zLRFZVlQCLRG0FD49h9EoPD55kuiioz0fPU1oTFLY5Kkl3L3vqChLMTEe1In4MGHbsFa7Gm-matpM3wFwyWA19l96bcqrryYQdSr6oZRwmQgAqc6hQhUAbifVGqqLh8bVE-KBY Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}] Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 68a2203c15fe41d8ae410f31ba1e1301 Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance f8c5b825-6552-42c9-b652-2b7eff7bffce could not be found. Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'f8c5b825-6552-42c9-b652-2b7eff7bffce'} Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8c5b825-6552-42c9-b652-2b7eff7bffce could not be found. Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8c5b825-6552-42c9-b652-2b7eff7bffce could not be found. Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:40.236078 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.245612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:40.245612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:40.245612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:40.245612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:40.245612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:40.245612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8c5b825-6552-42c9-b652-2b7eff7bffce could not be found. Oct 04 21:40:40.245612 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:40.245612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-08c8b41f-40d1-45c5-9652-e698bc21fe8e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Returning 404 to user: Instance f8c5b825-6552-42c9-b652-2b7eff7bffce could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:40.263554 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-08c8b41f-40d1-45c5-9652-e698bc21fe8e tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce" status: 404 len: 111 microversion: 2.1 time: 0.064557 Oct 04 21:40:40.265247 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3051/6125] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:40 2022] GET /compute/v2.1/servers/f8c5b825-6552-42c9-b652-2b7eff7bffce => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:40:40.759531 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2a821474-f261-4600-906e-3a62391eabb6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.095087 Oct 04 21:40:40.765836 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3075/6126] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:40:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:40:40.771697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-de70667f-50a1-46ad-8381-4aaf063a0377 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:40.774840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-de70667f-50a1-46ad-8381-4aaf063a0377 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:40.928475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-de70667f-50a1-46ad-8381-4aaf063a0377 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:40.938773 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-de70667f-50a1-46ad-8381-4aaf063a0377 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1057 microversion: 2.1 time: 0.170868 Oct 04 21:40:40.955709 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3052/6127] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:40 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1057 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:41.989181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-13898ccc-a80c-41c4-9510-715bce4f1699 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:41.990090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-13898ccc-a80c-41c4-9510-715bce4f1699 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:41.996479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:42.299205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-13898ccc-a80c-41c4-9510-715bce4f1699 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:42.324343 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-13898ccc-a80c-41c4-9510-715bce4f1699 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1057 microversion: 2.1 time: 0.326351 Oct 04 21:40:42.324343 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3076/6128] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:41 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1057 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:43.334584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5acaf409-abec-4b9b-856d-303f2f6eee84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:43.335226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5acaf409-abec-4b9b-856d-303f2f6eee84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:43.354208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5acaf409-abec-4b9b-856d-303f2f6eee84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:43.354716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5acaf409-abec-4b9b-856d-303f2f6eee84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:43.357925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5acaf409-abec-4b9b-856d-303f2f6eee84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:43.359633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5acaf409-abec-4b9b-856d-303f2f6eee84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:43.360516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5acaf409-abec-4b9b-856d-303f2f6eee84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:43.371833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5acaf409-abec-4b9b-856d-303f2f6eee84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:43.379140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=77 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:43.462317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5acaf409-abec-4b9b-856d-303f2f6eee84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:43.471343 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5acaf409-abec-4b9b-856d-303f2f6eee84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1155 microversion: 2.1 time: 0.142002 Oct 04 21:40:43.471934 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3053/6129] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:43 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1155 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:44.497897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1b9c219e-b011-4620-9cd7-977a4d6e0c45 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:44.498534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1b9c219e-b011-4620-9cd7-977a4d6e0c45 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:44.511829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1b9c219e-b011-4620-9cd7-977a4d6e0c45 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:44.512343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1b9c219e-b011-4620-9cd7-977a4d6e0c45 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:44.512799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1b9c219e-b011-4620-9cd7-977a4d6e0c45 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:44.513553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1b9c219e-b011-4620-9cd7-977a4d6e0c45 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:44.514008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1b9c219e-b011-4620-9cd7-977a4d6e0c45 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:44.514444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1b9c219e-b011-4620-9cd7-977a4d6e0c45 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:44.527946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:44.708190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1b9c219e-b011-4620-9cd7-977a4d6e0c45 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:44.728205 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1b9c219e-b011-4620-9cd7-977a4d6e0c45 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1173 microversion: 2.1 time: 0.235648 Oct 04 21:40:44.728921 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3077/6130] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:44 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1173 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:44.997591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ab3655d2-1379-4280-8fa3-0e16fb556fca tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:44.998102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ab3655d2-1379-4280-8fa3-0e16fb556fca tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:45.017515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab3655d2-1379-4280-8fa3-0e16fb556fca tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:45.019663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab3655d2-1379-4280-8fa3-0e16fb556fca tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:45.020124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab3655d2-1379-4280-8fa3-0e16fb556fca tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:45.020854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab3655d2-1379-4280-8fa3-0e16fb556fca tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:45.021880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab3655d2-1379-4280-8fa3-0e16fb556fca tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:45.022334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab3655d2-1379-4280-8fa3-0e16fb556fca tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:45.057151 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-ab3655d2-1379-4280-8fa3-0e16fb556fca tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] HTTP exception thrown: Instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 could not be found. Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ab3655d2-1379-4280-8fa3-0e16fb556fca tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Request method failure captured: Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 HTTP/1.1 Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKbagiGypEfWhrQ_0lE94AP27Qoh0E4iGeIB2v7-1zLRFZVlQCLRG0FD49h9EoPD55kuiioz0fPU1oTFLY5Kkl3L3vqChLMTEe1In4MGHbsFa7Gm-matpM3wFwyWA19l96bcqrryYQdSr6oZRwmQgAqc6hQhUAbifVGqqLh8bVE-KBY Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}] Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 68a2203c15fe41d8ae410f31ba1e1301 Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 could not be found. Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '60148f18-dd52-4a9a-8d23-12cb5ebbd7c4'} Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 could not be found. Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:40:45.059247 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:45.065230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 could not be found. Oct 04 21:40:45.065230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:45.065230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:45.065230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:45.065230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:45.065230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:45.065230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:45.065230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:45.065230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:45.065230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 could not be found. Oct 04 21:40:45.065230 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:40:45.070522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ab3655d2-1379-4280-8fa3-0e16fb556fca tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Returning 404 to user: Instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:45.075462 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ab3655d2-1379-4280-8fa3-0e16fb556fca tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "DELETE /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 404 len: 111 microversion: 2.1 time: 0.080673 Oct 04 21:40:45.075462 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3054/6131] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:40:44 2022] DELETE /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:40:45.081478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1943e977-a24b-497a-bae8-71de5f6ee28b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:45.081660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1943e977-a24b-497a-bae8-71de5f6ee28b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] [instance: 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:45.104373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1943e977-a24b-497a-bae8-71de5f6ee28b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:45.104373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1943e977-a24b-497a-bae8-71de5f6ee28b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:45.104373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1943e977-a24b-497a-bae8-71de5f6ee28b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:45.104373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1943e977-a24b-497a-bae8-71de5f6ee28b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:45.104373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1943e977-a24b-497a-bae8-71de5f6ee28b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:45.104373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1943e977-a24b-497a-bae8-71de5f6ee28b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:45.142809 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-1943e977-a24b-497a-bae8-71de5f6ee28b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] HTTP exception thrown: Instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 could not be found. Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1943e977-a24b-497a-bae8-71de5f6ee28b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Request method failure captured: Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 HTTP/1.1 Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKbagiGypEfWhrQ_0lE94AP27Qoh0E4iGeIB2v7-1zLRFZVlQCLRG0FD49h9EoPD55kuiioz0fPU1oTFLY5Kkl3L3vqChLMTEe1In4MGHbsFa7Gm-matpM3wFwyWA19l96bcqrryYQdSr6oZRwmQgAqc6hQhUAbifVGqqLh8bVE-KBY Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7a12e438f0e4e9a83b0ab95f50c791c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7a12e438f0e4e9a83b0ab95f50c791c"}]}] Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: f7a12e438f0e4e9a83b0ab95f50c791c Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1295426092 Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 68a2203c15fe41d8ae410f31ba1e1301 Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-AttachVolumeNegativeTest-1295426092-project Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 could not be found. Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '60148f18-dd52-4a9a-8d23-12cb5ebbd7c4'} Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 could not be found. Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 could not be found. Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:45.144880 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:40:45.165692 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:45.165692 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:45.165692 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:45.165692 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:45.165692 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:45.165692 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 could not be found. Oct 04 21:40:45.165692 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:40:45.165692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1943e977-a24b-497a-bae8-71de5f6ee28b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] Returning 404 to user: Instance 60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:45.165692 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1943e977-a24b-497a-bae8-71de5f6ee28b tempest-AttachVolumeNegativeTest-1295426092 tempest-AttachVolumeNegativeTest-1295426092-project] 10.222.0.30 "GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4" status: 404 len: 111 microversion: 2.1 time: 0.072133 Oct 04 21:40:45.165692 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3078/6132] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:45 2022] GET /compute/v2.1/servers/60148f18-dd52-4a9a-8d23-12cb5ebbd7c4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:40:45.756409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-66f752eb-5623-4b93-b00e-703e33b615e6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:45.757265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-66f752eb-5623-4b93-b00e-703e33b615e6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:45.773666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:45.775631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66f752eb-5623-4b93-b00e-703e33b615e6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:45.778771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66f752eb-5623-4b93-b00e-703e33b615e6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:45.780506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66f752eb-5623-4b93-b00e-703e33b615e6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:45.781250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66f752eb-5623-4b93-b00e-703e33b615e6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:45.781745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66f752eb-5623-4b93-b00e-703e33b615e6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:45.782191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66f752eb-5623-4b93-b00e-703e33b615e6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:46.480089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-66f752eb-5623-4b93-b00e-703e33b615e6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:46.493346 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-66f752eb-5623-4b93-b00e-703e33b615e6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1173 microversion: 2.1 time: 0.740710 Oct 04 21:40:46.494837 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3055/6133] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:45 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1173 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:40:47.526306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bc8378a9-aa1a-48e2-97c0-7cbec747f5e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:47.526951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bc8378a9-aa1a-48e2-97c0-7cbec747f5e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:47.537729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc8378a9-aa1a-48e2-97c0-7cbec747f5e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:47.540719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc8378a9-aa1a-48e2-97c0-7cbec747f5e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:47.550323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc8378a9-aa1a-48e2-97c0-7cbec747f5e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:47.550323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc8378a9-aa1a-48e2-97c0-7cbec747f5e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:47.550323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc8378a9-aa1a-48e2-97c0-7cbec747f5e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:47.550323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc8378a9-aa1a-48e2-97c0-7cbec747f5e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:48.916417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bc8378a9-aa1a-48e2-97c0-7cbec747f5e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:48.926206 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bc8378a9-aa1a-48e2-97c0-7cbec747f5e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1215 microversion: 2.1 time: 1.407641 Oct 04 21:40:48.933693 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3079/6134] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:47 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1215 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:49.961460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0629d23a-0437-4eac-a1e5-fdf5c133e09c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:49.963220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0629d23a-0437-4eac-a1e5-fdf5c133e09c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:49.973047 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:40:49.976434 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 21:40:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 (ip 10.222.0.30) !!! Oct 04 21:40:49.978802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0629d23a-0437-4eac-a1e5-fdf5c133e09c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:49.989512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0629d23a-0437-4eac-a1e5-fdf5c133e09c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:49.990790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0629d23a-0437-4eac-a1e5-fdf5c133e09c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:49.991769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0629d23a-0437-4eac-a1e5-fdf5c133e09c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:49.992419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0629d23a-0437-4eac-a1e5-fdf5c133e09c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:49.993027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0629d23a-0437-4eac-a1e5-fdf5c133e09c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:50.688060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0629d23a-0437-4eac-a1e5-fdf5c133e09c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:50.697565 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0629d23a-0437-4eac-a1e5-fdf5c133e09c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1215 microversion: 2.1 time: 0.740017 Oct 04 21:40:50.698194 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3056/6135] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:49 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1215 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:51.722847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-689645f3-a752-4630-90dd-2ba60b04d933 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:51.723484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-689645f3-a752-4630-90dd-2ba60b04d933 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:51.731191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:51.732772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-689645f3-a752-4630-90dd-2ba60b04d933 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:51.733277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-689645f3-a752-4630-90dd-2ba60b04d933 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:51.733767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-689645f3-a752-4630-90dd-2ba60b04d933 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:51.734489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-689645f3-a752-4630-90dd-2ba60b04d933 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:51.734960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-689645f3-a752-4630-90dd-2ba60b04d933 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:51.741839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-689645f3-a752-4630-90dd-2ba60b04d933 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:52.248140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-a2923856-4fe7-4cb2-a262-91945d4af631 req-2c48f7e2-a043-4e61-97ce-654e2d98321a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2d30ff-44b5-40b9-870d-ba446ef68934", "tag": "8c0e7a9e-cda7-4426-ba50-9f42a9f04e51"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:52.255218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:52.275890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a2923856-4fe7-4cb2-a262-91945d4af631 req-2c48f7e2-a043-4e61-97ce-654e2d98321a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:52.275890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a2923856-4fe7-4cb2-a262-91945d4af631 req-2c48f7e2-a043-4e61-97ce-654e2d98321a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:52.276231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a2923856-4fe7-4cb2-a262-91945d4af631 req-2c48f7e2-a043-4e61-97ce-654e2d98321a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:52.308023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:52.310625 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-a2923856-4fe7-4cb2-a262-91945d4af631 req-2c48f7e2-a043-4e61-97ce-654e2d98321a service nova] Creating event network-changed:8c0e7a9e-cda7-4426-ba50-9f42a9f04e51 for instance 0a2d30ff-44b5-40b9-870d-ba446ef68934 on n-h2-860282-1 Oct 04 21:40:52.318075 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-a2923856-4fe7-4cb2-a262-91945d4af631 req-2c48f7e2-a043-4e61-97ce-654e2d98321a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073886 Oct 04 21:40:52.318798 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3057/6136] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:40:52.557020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-689645f3-a752-4630-90dd-2ba60b04d933 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:52.565793 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-689645f3-a752-4630-90dd-2ba60b04d933 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1215 microversion: 2.1 time: 0.846870 Oct 04 21:40:52.574691 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3080/6137] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:51 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1215 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:53.603646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6fcdec09-8b47-421e-8c62-3933ccd2295a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:53.604843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6fcdec09-8b47-421e-8c62-3933ccd2295a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:53.617603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fcdec09-8b47-421e-8c62-3933ccd2295a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:53.619712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fcdec09-8b47-421e-8c62-3933ccd2295a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:53.623316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fcdec09-8b47-421e-8c62-3933ccd2295a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:53.624685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fcdec09-8b47-421e-8c62-3933ccd2295a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:53.626420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fcdec09-8b47-421e-8c62-3933ccd2295a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:53.630188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fcdec09-8b47-421e-8c62-3933ccd2295a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:53.904522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6fcdec09-8b47-421e-8c62-3933ccd2295a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:53.919559 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6fcdec09-8b47-421e-8c62-3933ccd2295a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1215 microversion: 2.1 time: 0.324621 Oct 04 21:40:53.920171 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3058/6138] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:53 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1215 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:54.948097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fd678021-a5ee-4d27-9a90-26380e4ed3e9 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:54.949324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fd678021-a5ee-4d27-9a90-26380e4ed3e9 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:54.960352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd678021-a5ee-4d27-9a90-26380e4ed3e9 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:54.970115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd678021-a5ee-4d27-9a90-26380e4ed3e9 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:54.971164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd678021-a5ee-4d27-9a90-26380e4ed3e9 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:54.974677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd678021-a5ee-4d27-9a90-26380e4ed3e9 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:54.977725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd678021-a5ee-4d27-9a90-26380e4ed3e9 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:54.978504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fd678021-a5ee-4d27-9a90-26380e4ed3e9 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:55.330189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fd678021-a5ee-4d27-9a90-26380e4ed3e9 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:55.352614 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fd678021-a5ee-4d27-9a90-26380e4ed3e9 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1215 microversion: 2.1 time: 0.410060 Oct 04 21:40:55.365447 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3081/6139] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:54 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1215 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:56.390786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3be395be-7732-4902-8763-b8f408cb9284 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:56.392339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3be395be-7732-4902-8763-b8f408cb9284 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:56.400541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3be395be-7732-4902-8763-b8f408cb9284 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:56.405063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3be395be-7732-4902-8763-b8f408cb9284 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:56.406308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3be395be-7732-4902-8763-b8f408cb9284 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:56.407303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3be395be-7732-4902-8763-b8f408cb9284 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:56.408045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3be395be-7732-4902-8763-b8f408cb9284 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:56.409919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3be395be-7732-4902-8763-b8f408cb9284 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:57.353400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b7a72840-b50b-4696-a133-bc2344b4f15b tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] Action: 'create', calling method: .version_select at 0x7f5790747670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1830343723", "metadata": {"Type": "work"}}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:58.229072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3be395be-7732-4902-8763-b8f408cb9284 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:58.244670 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3be395be-7732-4902-8763-b8f408cb9284 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1203 microversion: 2.1 time: 1.857898 Oct 04 21:40:58.258517 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3059/6140] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:56 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1203 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:58.415022 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b7a72840-b50b-4696-a133-bc2344b4f15b tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.312364 Oct 04 21:40:58.422982 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3082/6141] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Oct 4 21:40:57 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1321 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 21:40:58.429859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-217db27e-1604-4974-8219-e7df2a166fb9 tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] Calling method '.version_select at 0x7f578becaa60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:58.550617 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-217db27e-1604-4974-8219-e7df2a166fb9 tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6" status: 200 len: 353 microversion: 2.1 time: 0.124126 Oct 04 21:40:58.551282 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3060/6142] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:40:58 2022] GET /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:59.276005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f7d706a9-acb5-402e-9376-103fe70b845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:59.276908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f7d706a9-acb5-402e-9376-103fe70b845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:59.288783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7d706a9-acb5-402e-9376-103fe70b845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:59.290378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7d706a9-acb5-402e-9376-103fe70b845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:59.293688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7d706a9-acb5-402e-9376-103fe70b845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:59.294692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7d706a9-acb5-402e-9376-103fe70b845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:59.295347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7d706a9-acb5-402e-9376-103fe70b845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:59.295967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f7d706a9-acb5-402e-9376-103fe70b845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:59.569289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-22cb1b90-de50-41fa-8dbc-71cd34e97a56 tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] Calling method '.version_select at 0x7f57907c5550>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:59.686850 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-22cb1b90-de50-41fa-8dbc-71cd34e97a56 tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6" status: 200 len: 353 microversion: 2.1 time: 0.122870 Oct 04 21:40:59.687703 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3061/6143] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:40:59 2022] GET /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6 => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:59.786387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f7d706a9-acb5-402e-9376-103fe70b845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:59.798710 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f7d706a9-acb5-402e-9376-103fe70b845f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1203 microversion: 2.1 time: 0.525833 Oct 04 21:40:59.802332 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3083/6144] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:59 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1203 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:00.703637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e2b7d5b4-3e40-440b-9b56-c19cba128bb2 tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] Calling method '.version_select at 0x7f578b26da60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:00.809331 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e2b7d5b4-3e40-440b-9b56-c19cba128bb2 tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6" status: 200 len: 354 microversion: 2.1 time: 0.109469 Oct 04 21:41:00.810595 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3062/6145] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:41:00 2022] GET /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6 => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:00.823956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-01cdba91-b980-44a8-b779-a65bf7523a14 tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] Calling method '.version_select at 0x7f579072e670>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:00.826879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9a38d594-30b8-4804-9a70-44c0fefa5495 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:00.827809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9a38d594-30b8-4804-9a70-44c0fefa5495 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:00.836645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a38d594-30b8-4804-9a70-44c0fefa5495 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:00.837618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a38d594-30b8-4804-9a70-44c0fefa5495 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:00.838332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a38d594-30b8-4804-9a70-44c0fefa5495 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:00.839466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a38d594-30b8-4804-9a70-44c0fefa5495 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:00.840163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a38d594-30b8-4804-9a70-44c0fefa5495 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:00.841814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a38d594-30b8-4804-9a70-44c0fefa5495 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:00.913522 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-01cdba91-b980-44a8-b779-a65bf7523a14 tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6" status: 200 len: 354 microversion: 2.1 time: 0.093361 Oct 04 21:41:00.914382 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3084/6146] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:41:00 2022] GET /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:00.940230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3437df9c-00c9-4e72-b7a9-179921f02c77 tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] Calling method '.version_select at 0x7f5790035d30>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:01.161331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9a38d594-30b8-4804-9a70-44c0fefa5495 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:01.180218 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9a38d594-30b8-4804-9a70-44c0fefa5495 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1203 microversion: 2.1 time: 0.355379 Oct 04 21:41:01.191562 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3063/6147] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:00 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1203 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:41:01.223327 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3437df9c-00c9-4e72-b7a9-179921f02c77 tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6" status: 202 len: 0 microversion: 2.1 time: 0.286686 Oct 04 21:41:01.224502 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3085/6148] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Oct 4 21:41:00 2022] DELETE /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:41:01.232794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-409e6d97-8110-4957-bf20-dd4572b0d422 tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] Calling method '.version_select at 0x7f578b6b3160>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:01.329047 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-409e6d97-8110-4957-bf20-dd4572b0d422 tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6" status: 200 len: 353 microversion: 2.1 time: 0.100717 Oct 04 21:41:01.329964 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3064/6149] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:41:01 2022] GET /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6 => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:02.207653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-61361e6d-43c3-4198-8065-503e4990bef8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:02.208342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-61361e6d-43c3-4198-8065-503e4990bef8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:02.225671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61361e6d-43c3-4198-8065-503e4990bef8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:02.226507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61361e6d-43c3-4198-8065-503e4990bef8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:02.227146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61361e6d-43c3-4198-8065-503e4990bef8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:02.229113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61361e6d-43c3-4198-8065-503e4990bef8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:02.233137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61361e6d-43c3-4198-8065-503e4990bef8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:02.234484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61361e6d-43c3-4198-8065-503e4990bef8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:02.346791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-45f6bd87-d914-4301-a90c-dcfb34bcee64 tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] Calling method '.version_select at 0x7f57907c5dc0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:02.436404 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-45f6bd87-d914-4301-a90c-dcfb34bcee64 tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6" status: 200 len: 353 microversion: 2.1 time: 0.095065 Oct 04 21:41:02.437316 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3065/6150] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:41:02 2022] GET /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:02.599817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-61361e6d-43c3-4198-8065-503e4990bef8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:02.608331 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-61361e6d-43c3-4198-8065-503e4990bef8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1203 microversion: 2.1 time: 0.407807 Oct 04 21:41:02.610775 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3086/6151] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:02 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1203 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:03.453357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8379ec10-aac0-4725-aa1f-7e7e9bd1a073 tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] Calling method '.version_select at 0x7f578b432dc0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:03.512947 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8379ec10-aac0-4725-aa1f-7e7e9bd1a073 tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6" status: 200 len: 353 microversion: 2.1 time: 0.064906 Oct 04 21:41:03.514152 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3066/6152] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:41:03 2022] GET /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:03.641225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-07b63a0b-17c2-4fce-93ad-1c30fe546105 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:03.642438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-07b63a0b-17c2-4fce-93ad-1c30fe546105 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:03.657603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-07b63a0b-17c2-4fce-93ad-1c30fe546105 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:03.658109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-07b63a0b-17c2-4fce-93ad-1c30fe546105 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:03.660442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-07b63a0b-17c2-4fce-93ad-1c30fe546105 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:03.660442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-07b63a0b-17c2-4fce-93ad-1c30fe546105 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:03.661157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-07b63a0b-17c2-4fce-93ad-1c30fe546105 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:03.667324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-07b63a0b-17c2-4fce-93ad-1c30fe546105 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:04.242720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-07b63a0b-17c2-4fce-93ad-1c30fe546105 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:04.259681 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-07b63a0b-17c2-4fce-93ad-1c30fe546105 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1203 microversion: 2.1 time: 0.628753 Oct 04 21:41:04.262775 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3087/6153] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:03 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1203 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:04.545809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-af198417-39f9-4b88-8700-f6e9bc5602cb tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] Calling method '.version_select at 0x7f57943bba60>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:04.584637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-8748faa4-1a04-4c64-8c71-818f1c516fe3 req-849dedf6-4dd3-4a2a-9b88-de9993bad5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2d30ff-44b5-40b9-870d-ba446ef68934", "name": "network-vif-plugged", "status": "completed", "tag": "8c0e7a9e-cda7-4426-ba50-9f42a9f04e51"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:04.602793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8748faa4-1a04-4c64-8c71-818f1c516fe3 req-849dedf6-4dd3-4a2a-9b88-de9993bad5a0 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:04.603289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8748faa4-1a04-4c64-8c71-818f1c516fe3 req-849dedf6-4dd3-4a2a-9b88-de9993bad5a0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:04.603731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8748faa4-1a04-4c64-8c71-818f1c516fe3 req-849dedf6-4dd3-4a2a-9b88-de9993bad5a0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:04.614904 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-af198417-39f9-4b88-8700-f6e9bc5602cb tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6" status: 200 len: 353 microversion: 2.1 time: 0.089527 Oct 04 21:41:04.621540 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3067/6154] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:41:04 2022] GET /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:04.634865 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-8748faa4-1a04-4c64-8c71-818f1c516fe3 req-849dedf6-4dd3-4a2a-9b88-de9993bad5a0 service nova] Creating event network-vif-plugged:8c0e7a9e-cda7-4426-ba50-9f42a9f04e51 for instance 0a2d30ff-44b5-40b9-870d-ba446ef68934 on n-h2-860282-1 Oct 04 21:41:04.643991 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-8748faa4-1a04-4c64-8c71-818f1c516fe3 req-849dedf6-4dd3-4a2a-9b88-de9993bad5a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062144 Oct 04 21:41:04.643991 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3088/6155] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:41:05.287363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-938c6b65-fdcb-48a5-b40b-5aea4660524a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:05.289055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-938c6b65-fdcb-48a5-b40b-5aea4660524a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:05.311289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-938c6b65-fdcb-48a5-b40b-5aea4660524a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:05.314218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-938c6b65-fdcb-48a5-b40b-5aea4660524a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:05.314218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-938c6b65-fdcb-48a5-b40b-5aea4660524a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:05.315665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-938c6b65-fdcb-48a5-b40b-5aea4660524a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:05.318695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-938c6b65-fdcb-48a5-b40b-5aea4660524a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:05.319404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-938c6b65-fdcb-48a5-b40b-5aea4660524a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:05.590458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-938c6b65-fdcb-48a5-b40b-5aea4660524a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:05.601994 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-938c6b65-fdcb-48a5-b40b-5aea4660524a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1203 microversion: 2.1 time: 0.319785 Oct 04 21:41:05.602595 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3068/6156] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:05 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1203 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:05.631789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2af09eaf-b1a4-4284-ae75-12f3b9c5890b tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] Calling method '.version_select at 0x7f579086d940>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:05.699343 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-2af09eaf-b1a4-4284-ae75-12f3b9c5890b tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] HTTP exception thrown: Volume a4aa92db-1b71-4305-b7aa-2c79291483a6 could not be found. Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2af09eaf-b1a4-4284-ae75-12f3b9c5890b tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] Request method failure captured: Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6 HTTP/1.1 Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKhoPjTxEm2PCuAzerRHK2GP6T1A0agiugQE9HAu3qqmEiLbqlK4J0hwQ0HtEvKmdYRwqkUE6gL42eCZiLKFqzvWWucfOqae5eN3Dt54ROUHN8HHK3dMQahU_LhFHmC-8TFqGzaxslCbHN4zIfE-3Hj9JA9pT_hiQhc2yFytr4fOOyI Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 6f75133c2f144977baf330a3d1d00654 Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-VolumesGetTestJSON-527802541 Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6f75133c2f144977baf330a3d1d00654"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6f75133c2f144977baf330a3d1d00654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6f75133c2f144977baf330a3d1d00654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6f75133c2f144977baf330a3d1d00654"}]}] Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-VolumesGetTestJSON-527802541 Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 6f75133c2f144977baf330a3d1d00654 Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-VolumesGetTestJSON-527802541 Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-VolumesGetTestJSON-527802541-project Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c9b3262d36ce4844a8162dfcb98c4bbd Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-VolumesGetTestJSON-527802541-project Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: method: Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: exception: Volume a4aa92db-1b71-4305-b7aa-2c79291483a6 could not be found. Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'a4aa92db-1b71-4305-b7aa-2c79291483a6'} Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a4aa92db-1b71-4305-b7aa-2c79291483a6 could not be found. (HTTP 404) (Request-ID: req-214803ab-ab82-44dc-b267-fd740760abe9) Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:41:05.702355 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a4aa92db-1b71-4305-b7aa-2c79291483a6 could not be found. Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a4aa92db-1b71-4305-b7aa-2c79291483a6 could not be found. Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a4aa92db-1b71-4305-b7aa-2c79291483a6 could not be found. Oct 04 21:41:05.708184 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:41:05.716475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2af09eaf-b1a4-4284-ae75-12f3b9c5890b tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] Returning 404 to user: Volume a4aa92db-1b71-4305-b7aa-2c79291483a6 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:41:05.716475 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2af09eaf-b1a4-4284-ae75-12f3b9c5890b tempest-VolumesGetTestJSON-527802541 tempest-VolumesGetTestJSON-527802541-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6" status: 404 len: 109 microversion: 2.1 time: 0.087648 Oct 04 21:41:05.716475 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3089/6157] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:41:05 2022] GET /compute/v2.1/os-volumes/a4aa92db-1b71-4305-b7aa-2c79291483a6 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:41:06.631695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b798a462-4365-4e03-af5a-4d5a8ab879e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:06.631695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b798a462-4365-4e03-af5a-4d5a8ab879e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:06.645098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b798a462-4365-4e03-af5a-4d5a8ab879e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:06.645903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b798a462-4365-4e03-af5a-4d5a8ab879e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:06.646529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b798a462-4365-4e03-af5a-4d5a8ab879e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:06.647825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b798a462-4365-4e03-af5a-4d5a8ab879e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:06.648670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b798a462-4365-4e03-af5a-4d5a8ab879e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:06.650062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b798a462-4365-4e03-af5a-4d5a8ab879e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:07.464593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b798a462-4365-4e03-af5a-4d5a8ab879e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:07.487770 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b798a462-4365-4e03-af5a-4d5a8ab879e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1390 microversion: 2.1 time: 0.864021 Oct 04 21:41:07.502672 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3069/6158] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:06 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1390 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:07.515034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-be58298c-6cc6-4115-a47a-842683f8250b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:07.517382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-be58298c-6cc6-4115-a47a-842683f8250b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:07.532165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be58298c-6cc6-4115-a47a-842683f8250b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:07.533047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be58298c-6cc6-4115-a47a-842683f8250b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:07.534800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be58298c-6cc6-4115-a47a-842683f8250b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:07.535840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be58298c-6cc6-4115-a47a-842683f8250b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:07.536551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be58298c-6cc6-4115-a47a-842683f8250b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:07.537318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be58298c-6cc6-4115-a47a-842683f8250b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:07.875156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-be58298c-6cc6-4115-a47a-842683f8250b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:07.893378 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-be58298c-6cc6-4115-a47a-842683f8250b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1390 microversion: 2.1 time: 0.382572 Oct 04 21:41:07.894381 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3090/6159] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:07 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1390 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:07.921699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e9004608-8701-4d70-ad66-432cdbac4bd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:07.922968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e9004608-8701-4d70-ad66-432cdbac4bd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:07.941750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9004608-8701-4d70-ad66-432cdbac4bd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:07.942554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9004608-8701-4d70-ad66-432cdbac4bd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:07.943180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9004608-8701-4d70-ad66-432cdbac4bd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:07.944106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9004608-8701-4d70-ad66-432cdbac4bd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:07.944744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9004608-8701-4d70-ad66-432cdbac4bd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:07.948564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9004608-8701-4d70-ad66-432cdbac4bd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:08.156761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e9004608-8701-4d70-ad66-432cdbac4bd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:08.167543 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e9004608-8701-4d70-ad66-432cdbac4bd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1390 microversion: 2.1 time: 0.251248 Oct 04 21:41:08.182197 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3070/6160] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:07 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1390 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:08.197510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fac78815-1a39-4db0-856a-cf8eeb414176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:08.198037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fac78815-1a39-4db0-856a-cf8eeb414176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:08.210596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fac78815-1a39-4db0-856a-cf8eeb414176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:08.212882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fac78815-1a39-4db0-856a-cf8eeb414176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:08.217411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fac78815-1a39-4db0-856a-cf8eeb414176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:08.217411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fac78815-1a39-4db0-856a-cf8eeb414176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:08.217411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fac78815-1a39-4db0-856a-cf8eeb414176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:08.217411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fac78815-1a39-4db0-856a-cf8eeb414176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:08.248749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fac78815-1a39-4db0-856a-cf8eeb414176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:41:08.610706 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fac78815-1a39-4db0-856a-cf8eeb414176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 204 len: 0 microversion: 2.1 time: 0.421139 Oct 04 21:41:08.616175 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3091/6161] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:41:08 2022] DELETE /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:41:08.621313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5990f326-35c7-4354-b813-c52766226cc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:08.622012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5990f326-35c7-4354-b813-c52766226cc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:08.630598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5990f326-35c7-4354-b813-c52766226cc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:08.631106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5990f326-35c7-4354-b813-c52766226cc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:08.631559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5990f326-35c7-4354-b813-c52766226cc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:08.632280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5990f326-35c7-4354-b813-c52766226cc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:08.632747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5990f326-35c7-4354-b813-c52766226cc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:08.633185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5990f326-35c7-4354-b813-c52766226cc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:08.943456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5990f326-35c7-4354-b813-c52766226cc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:08.963685 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5990f326-35c7-4354-b813-c52766226cc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1396 microversion: 2.1 time: 0.346281 Oct 04 21:41:08.964613 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3071/6162] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:08 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1396 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:09.992097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5ae122c8-5d9b-4693-98d8-5d770a15ee96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:09.993479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5ae122c8-5d9b-4693-98d8-5d770a15ee96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:10.008268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ae122c8-5d9b-4693-98d8-5d770a15ee96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:10.014079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ae122c8-5d9b-4693-98d8-5d770a15ee96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:10.014560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ae122c8-5d9b-4693-98d8-5d770a15ee96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:10.015322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ae122c8-5d9b-4693-98d8-5d770a15ee96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:10.015796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ae122c8-5d9b-4693-98d8-5d770a15ee96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:10.026259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ae122c8-5d9b-4693-98d8-5d770a15ee96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:10.596849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5ae122c8-5d9b-4693-98d8-5d770a15ee96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:10.613326 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5ae122c8-5d9b-4693-98d8-5d770a15ee96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1396 microversion: 2.1 time: 0.625368 Oct 04 21:41:10.616544 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3092/6163] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:09 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1396 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:11.639240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f9748d26-87e1-49c2-851b-b315cc6853e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:11.644337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f9748d26-87e1-49c2-851b-b315cc6853e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:11.652203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9748d26-87e1-49c2-851b-b315cc6853e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:11.653737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9748d26-87e1-49c2-851b-b315cc6853e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:11.654400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9748d26-87e1-49c2-851b-b315cc6853e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:11.655391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9748d26-87e1-49c2-851b-b315cc6853e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:11.656079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9748d26-87e1-49c2-851b-b315cc6853e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:11.656716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9748d26-87e1-49c2-851b-b315cc6853e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:11.762548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-c3e3676c-00e1-4611-9ad6-4ffd5674bb06 req-6690f24b-b051-400f-9945-28342d6e4e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2d30ff-44b5-40b9-870d-ba446ef68934", "name": "network-vif-deleted", "tag": "8c0e7a9e-cda7-4426-ba50-9f42a9f04e51"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:11.840341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f9748d26-87e1-49c2-851b-b315cc6853e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:11.862276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c3e3676c-00e1-4611-9ad6-4ffd5674bb06 req-6690f24b-b051-400f-9945-28342d6e4e2d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:11.862615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c3e3676c-00e1-4611-9ad6-4ffd5674bb06 req-6690f24b-b051-400f-9945-28342d6e4e2d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:11.863962 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f9748d26-87e1-49c2-851b-b315cc6853e3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1354 microversion: 2.1 time: 0.228907 Oct 04 21:41:11.864287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c3e3676c-00e1-4611-9ad6-4ffd5674bb06 req-6690f24b-b051-400f-9945-28342d6e4e2d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:11.865828 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3072/6164] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:11 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1354 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:11.883680 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-c3e3676c-00e1-4611-9ad6-4ffd5674bb06 req-6690f24b-b051-400f-9945-28342d6e4e2d service nova] Creating event network-vif-deleted:8c0e7a9e-cda7-4426-ba50-9f42a9f04e51 for instance 0a2d30ff-44b5-40b9-870d-ba446ef68934 on n-h2-860282-1 Oct 04 21:41:11.902152 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-c3e3676c-00e1-4611-9ad6-4ffd5674bb06 req-6690f24b-b051-400f-9945-28342d6e4e2d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150343 Oct 04 21:41:11.903448 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3093/6165] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:12.891463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-388fe6c8-beb6-4d75-b39f-e400d642bf79 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:12.893025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-388fe6c8-beb6-4d75-b39f-e400d642bf79 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:12.904411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-388fe6c8-beb6-4d75-b39f-e400d642bf79 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:12.907407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-388fe6c8-beb6-4d75-b39f-e400d642bf79 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:12.910095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-388fe6c8-beb6-4d75-b39f-e400d642bf79 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:12.911203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-388fe6c8-beb6-4d75-b39f-e400d642bf79 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:12.914198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-388fe6c8-beb6-4d75-b39f-e400d642bf79 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:12.914867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-388fe6c8-beb6-4d75-b39f-e400d642bf79 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:13.204421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-388fe6c8-beb6-4d75-b39f-e400d642bf79 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:13.224460 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-388fe6c8-beb6-4d75-b39f-e400d642bf79 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1188 microversion: 2.1 time: 0.337156 Oct 04 21:41:13.233590 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3073/6166] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:12 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1188 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:14.250596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9893a55b-4bc4-45da-ab8c-8816e8208806 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:14.252838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9893a55b-4bc4-45da-ab8c-8816e8208806 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:14.265774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9893a55b-4bc4-45da-ab8c-8816e8208806 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:14.267108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9893a55b-4bc4-45da-ab8c-8816e8208806 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:14.268864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9893a55b-4bc4-45da-ab8c-8816e8208806 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:14.269859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9893a55b-4bc4-45da-ab8c-8816e8208806 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:14.270500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9893a55b-4bc4-45da-ab8c-8816e8208806 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:14.271139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9893a55b-4bc4-45da-ab8c-8816e8208806 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:14.306792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e17f2477-8a36-490d-a23b-98015ce1416f tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] Calling method '.version_select at 0x7f5790d953a0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:14.389888 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e17f2477-8a36-490d-a23b-98015ce1416f tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/ffacc522-f8d7-4389-9d96-ed2f5d2f9520" status: 200 len: 351 microversion: 2.1 time: 0.087479 Oct 04 21:41:14.391073 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3074/6167] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:41:14 2022] GET /compute/v2.1/os-volumes/ffacc522-f8d7-4389-9d96-ed2f5d2f9520 => generated 351 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:41:14.425113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9893a55b-4bc4-45da-ab8c-8816e8208806 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:14.437001 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9893a55b-4bc4-45da-ab8c-8816e8208806 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1188 microversion: 2.1 time: 0.190382 Oct 04 21:41:14.455389 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3094/6168] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:14 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1188 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:15.472072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b67cf3a0-8be6-4242-b1b9-5bce3ba2931c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:15.473289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b67cf3a0-8be6-4242-b1b9-5bce3ba2931c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:15.485678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b67cf3a0-8be6-4242-b1b9-5bce3ba2931c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:15.494136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b67cf3a0-8be6-4242-b1b9-5bce3ba2931c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:15.494136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b67cf3a0-8be6-4242-b1b9-5bce3ba2931c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:15.494136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b67cf3a0-8be6-4242-b1b9-5bce3ba2931c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:15.494136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b67cf3a0-8be6-4242-b1b9-5bce3ba2931c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:15.494136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b67cf3a0-8be6-4242-b1b9-5bce3ba2931c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:15.547495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=76 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:15.653187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b67cf3a0-8be6-4242-b1b9-5bce3ba2931c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:15.664506 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b67cf3a0-8be6-4242-b1b9-5bce3ba2931c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1188 microversion: 2.1 time: 0.201049 Oct 04 21:41:15.720054 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3075/6169] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:15 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1188 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:16.693578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2f0095bc-c74e-42b7-98c3-57d5b4a804b7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:16.693578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2f0095bc-c74e-42b7-98c3-57d5b4a804b7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:16.711904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f0095bc-c74e-42b7-98c3-57d5b4a804b7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:16.713556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f0095bc-c74e-42b7-98c3-57d5b4a804b7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:16.717664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f0095bc-c74e-42b7-98c3-57d5b4a804b7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:16.718558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f0095bc-c74e-42b7-98c3-57d5b4a804b7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:16.725485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f0095bc-c74e-42b7-98c3-57d5b4a804b7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:16.725944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f0095bc-c74e-42b7-98c3-57d5b4a804b7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:17.030120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2f0095bc-c74e-42b7-98c3-57d5b4a804b7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:17.039148 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2f0095bc-c74e-42b7-98c3-57d5b4a804b7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1188 microversion: 2.1 time: 0.350685 Oct 04 21:41:17.047753 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3095/6170] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:16 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1188 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:17.414110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9950e585-3557-4e63-ba76-21dbff842b8e tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] Calling method '.version_select at 0x7f57944e7280>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:17.556631 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9950e585-3557-4e63-ba76-21dbff842b8e tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0b025ad7-e46b-492a-9754-66d7de3d3c77" status: 200 len: 351 microversion: 2.1 time: 0.146648 Oct 04 21:41:17.565404 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3076/6171] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:41:17 2022] GET /compute/v2.1/os-volumes/0b025ad7-e46b-492a-9754-66d7de3d3c77 => generated 351 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:18.065739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3fa5f062-9843-42e2-8164-ed413dd1fa9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:18.068776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3fa5f062-9843-42e2-8164-ed413dd1fa9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:18.089607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:18.097915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fa5f062-9843-42e2-8164-ed413dd1fa9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:18.097915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fa5f062-9843-42e2-8164-ed413dd1fa9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:18.097915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fa5f062-9843-42e2-8164-ed413dd1fa9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:18.100706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fa5f062-9843-42e2-8164-ed413dd1fa9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:18.100706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fa5f062-9843-42e2-8164-ed413dd1fa9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:18.101169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fa5f062-9843-42e2-8164-ed413dd1fa9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:18.104249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:18.257627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3fa5f062-9843-42e2-8164-ed413dd1fa9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:18.275915 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3fa5f062-9843-42e2-8164-ed413dd1fa9d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1188 microversion: 2.1 time: 0.215596 Oct 04 21:41:18.276932 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3096/6172] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:18 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1188 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:19.304782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1e3a0ca3-1b74-4a08-9307-151106b8bd09 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:19.305955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1e3a0ca3-1b74-4a08-9307-151106b8bd09 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:19.309681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=26 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:19.315381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e3a0ca3-1b74-4a08-9307-151106b8bd09 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:19.322724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e3a0ca3-1b74-4a08-9307-151106b8bd09 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:19.323421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e3a0ca3-1b74-4a08-9307-151106b8bd09 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:19.324340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e3a0ca3-1b74-4a08-9307-151106b8bd09 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:19.324968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e3a0ca3-1b74-4a08-9307-151106b8bd09 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:19.325637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e3a0ca3-1b74-4a08-9307-151106b8bd09 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:19.485224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1e3a0ca3-1b74-4a08-9307-151106b8bd09 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:19.494897 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1e3a0ca3-1b74-4a08-9307-151106b8bd09 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1188 microversion: 2.1 time: 0.194508 Oct 04 21:41:19.499157 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3077/6173] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:19 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1188 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:20.526373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-56edb4ab-b70d-4b8c-a3dd-24dcab484bfb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:20.526959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-56edb4ab-b70d-4b8c-a3dd-24dcab484bfb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:20.562209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56edb4ab-b70d-4b8c-a3dd-24dcab484bfb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:20.563093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56edb4ab-b70d-4b8c-a3dd-24dcab484bfb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:20.564403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56edb4ab-b70d-4b8c-a3dd-24dcab484bfb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:20.568877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56edb4ab-b70d-4b8c-a3dd-24dcab484bfb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:20.569265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56edb4ab-b70d-4b8c-a3dd-24dcab484bfb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:20.569762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-56edb4ab-b70d-4b8c-a3dd-24dcab484bfb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:20.737546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0acf41d6-1fe9-4b8f-8605-ab3825f82594 tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] Calling method '.version_select at 0x7f57900e6940>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:20.738164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-56edb4ab-b70d-4b8c-a3dd-24dcab484bfb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:20.753289 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-56edb4ab-b70d-4b8c-a3dd-24dcab484bfb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1188 microversion: 2.1 time: 0.231055 Oct 04 21:41:20.769469 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3097/6174] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:20 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1188 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:20.840961 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0acf41d6-1fe9-4b8f-8605-ab3825f82594 tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/7d5f5f83-aba2-42ed-9c42-376634f2dfd2" status: 200 len: 350 microversion: 2.1 time: 0.110510 Oct 04 21:41:20.850342 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3078/6175] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Oct 4 21:41:20 2022] GET /compute/v2.1/os-volumes/7d5f5f83-aba2-42ed-9c42-376634f2dfd2 => generated 350 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:20.871672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f22439ce-0d50-4c5c-a47b-77d2fc6167ba tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] Calling method '.version_select at 0x7f57923bfd30>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:20.969720 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f22439ce-0d50-4c5c-a47b-77d2fc6167ba tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.116722 Oct 04 21:41:20.970314 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3098/6176] 10.222.0.30 () {58 vars in 1134 bytes} [Tue Oct 4 21:41:20 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:20.984972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e272c0c1-8990-47a2-9540-10a2b41e2570 tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] Calling method '.version_select at 0x7f578b3b3c10>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:21.083779 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e272c0c1-8990-47a2-9540-10a2b41e2570 tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.102570 Oct 04 21:41:21.094059 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3079/6177] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Oct 4 21:41:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:21.099404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4ad12449-4789-4f4e-985d-d79cac03f038 tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] Calling method '.version_select at 0x7f579450caf0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:21.229021 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4ad12449-4789-4f4e-985d-d79cac03f038 tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.133367 Oct 04 21:41:21.230292 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3099/6178] 10.222.0.30 () {58 vars in 1134 bytes} [Tue Oct 4 21:41:21 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:21.245309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fa929455-8b6e-4a82-9846-51c09dde6fe7 tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] Calling method '.version_select at 0x7f57943c8f70>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:21.383518 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fa929455-8b6e-4a82-9846-51c09dde6fe7 tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.142884 Oct 04 21:41:21.384275 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3080/6179] 10.222.0.30 () {58 vars in 1167 bytes} [Tue Oct 4 21:41:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:41:21.398116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-04b41580-4685-47c3-973f-df79df1a2441 tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] Calling method '.version_select at 0x7f57905b4040>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:21.511347 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-04b41580-4685-47c3-973f-df79df1a2441 tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.116885 Oct 04 21:41:21.518329 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3100/6180] 10.222.0.30 () {58 vars in 1170 bytes} [Tue Oct 4 21:41:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:21.526595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f048196e-afb0-4c57-8949-f9ad33e7bc35 tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] Calling method '.version_select at 0x7f579443dd30>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:21.624530 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f048196e-afb0-4c57-8949-f9ad33e7bc35 tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.102261 Oct 04 21:41:21.625115 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3081/6181] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Oct 4 21:41:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:21.638928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0a5b0090-b381-4fa8-8eba-2f8d8fae8cee tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] Calling method '.version_select at 0x7f5790035790>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:21.782346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cf41d177-aec9-4f25-b5b7-c2021b12a3d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:21.784470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cf41d177-aec9-4f25-b5b7-c2021b12a3d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:21.805876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf41d177-aec9-4f25-b5b7-c2021b12a3d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:21.806647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf41d177-aec9-4f25-b5b7-c2021b12a3d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:21.807284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf41d177-aec9-4f25-b5b7-c2021b12a3d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:21.808232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf41d177-aec9-4f25-b5b7-c2021b12a3d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:21.808865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf41d177-aec9-4f25-b5b7-c2021b12a3d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:21.809517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf41d177-aec9-4f25-b5b7-c2021b12a3d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:21.893507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf41d177-aec9-4f25-b5b7-c2021b12a3d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:21.894304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf41d177-aec9-4f25-b5b7-c2021b12a3d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:21.894962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf41d177-aec9-4f25-b5b7-c2021b12a3d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:21.895966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-cf41d177-aec9-4f25-b5b7-c2021b12a3d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lazy-loading 'fault' on Instance uuid 0a2d30ff-44b5-40b9-870d-ba446ef68934 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:41:22.124522 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0a5b0090-b381-4fa8-8eba-2f8d8fae8cee tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.489058 Oct 04 21:41:22.133224 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3101/6182] 10.222.0.30 () {58 vars in 1188 bytes} [Tue Oct 4 21:41:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:22.133331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cf41d177-aec9-4f25-b5b7-c2021b12a3d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:22.141765 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cf41d177-aec9-4f25-b5b7-c2021b12a3d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 200 len: 1147 microversion: 2.1 time: 0.365412 Oct 04 21:41:22.149776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ff3ac6b3-0604-4d86-b0ed-3de9a8efed0f tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] Calling method '.version_select at 0x7f57906313a0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:22.163787 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3082/6183] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:21 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 1147 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:22.339273 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ff3ac6b3-0604-4d86-b0ed-3de9a8efed0f tempest-VolumesTestJSON-511996078 tempest-VolumesTestJSON-511996078-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.198424 Oct 04 21:41:22.340511 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3102/6184] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Oct 4 21:41:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:23.170589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7262501d-688d-40ee-96ab-b266b4d9d38f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:23.171208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7262501d-688d-40ee-96ab-b266b4d9d38f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 0a2d30ff-44b5-40b9-870d-ba446ef68934] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:23.187868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7262501d-688d-40ee-96ab-b266b4d9d38f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:23.188641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7262501d-688d-40ee-96ab-b266b4d9d38f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:23.189255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7262501d-688d-40ee-96ab-b266b4d9d38f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:23.194658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7262501d-688d-40ee-96ab-b266b4d9d38f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:23.195386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7262501d-688d-40ee-96ab-b266b4d9d38f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:23.196547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7262501d-688d-40ee-96ab-b266b4d9d38f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:23.238796 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-7262501d-688d-40ee-96ab-b266b4d9d38f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] HTTP exception thrown: Instance 0a2d30ff-44b5-40b9-870d-ba446ef68934 could not be found. Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7262501d-688d-40ee-96ab-b266b4d9d38f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Request method failure captured: Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 HTTP/1.1 Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKgKHoOaT8uqO1KoOPn24xM7P0ylwdbLFlP7NxtckxX5YVgkQXQgvdk_pv_DRrXpTR_A9RTrhRjboZG7XPsaIwCmuey_7FqshLEW4wp7-ccvS6GHij-f3j-K3O_9tzU_63L01blifBD1TcCBZnKNp1OdTYkzGEDdJ0DY_B_XNHTjspY Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68208d23fd2f40479ba279566a819933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68208d23fd2f40479ba279566a819933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}] Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 15748f41da9f49fca3e7eec1fda3b245 Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 0a2d30ff-44b5-40b9-870d-ba446ef68934 could not be found. Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '0a2d30ff-44b5-40b9-870d-ba446ef68934'} Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a2d30ff-44b5-40b9-870d-ba446ef68934 could not be found. Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a2d30ff-44b5-40b9-870d-ba446ef68934 could not be found. Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:41:23.240768 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:41:23.246465 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:23.246465 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:41:23.246465 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:41:23.246465 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:41:23.246465 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:41:23.246465 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a2d30ff-44b5-40b9-870d-ba446ef68934 could not be found. Oct 04 21:41:23.246465 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:41:23.254463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7262501d-688d-40ee-96ab-b266b4d9d38f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Returning 404 to user: Instance 0a2d30ff-44b5-40b9-870d-ba446ef68934 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:41:23.255370 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7262501d-688d-40ee-96ab-b266b4d9d38f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934" status: 404 len: 111 microversion: 2.1 time: 0.088718 Oct 04 21:41:23.256288 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3083/6185] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:23 2022] GET /compute/v2.1/servers/0a2d30ff-44b5-40b9-870d-ba446ef68934 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:42:16.579170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:16.580668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=11 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:16.586359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-39f76d90-a201-4238-b6d8-10a8f0d79f12 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-905474147", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f1f50810-a197-4cca-9995-7d8666c923c6", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b7f4cca9-cdc1-49bd-97e7-bd6739547eb6"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:42:16.752075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-39f76d90-a201-4238-b6d8-10a8f0d79f12 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] validate_networks() for [('b7f4cca9-cdc1-49bd-97e7-bd6739547eb6', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:42:17.422281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-39f76d90-a201-4238-b6d8-10a8f0d79f12 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:42:17.422773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-39f76d90-a201-4238-b6d8-10a8f0d79f12 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:42:17.423309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-39f76d90-a201-4238-b6d8-10a8f0d79f12 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:42:17.423729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-39f76d90-a201-4238-b6d8-10a8f0d79f12 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:42:17.424177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-39f76d90-a201-4238-b6d8-10a8f0d79f12 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:42:17.435478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39f76d90-a201-4238-b6d8-10a8f0d79f12 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:17.435968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39f76d90-a201-4238-b6d8-10a8f0d79f12 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:17.436602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39f76d90-a201-4238-b6d8-10a8f0d79f12 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:17.437406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39f76d90-a201-4238-b6d8-10a8f0d79f12 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:17.437948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39f76d90-a201-4238-b6d8-10a8f0d79f12 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:17.438383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39f76d90-a201-4238-b6d8-10a8f0d79f12 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:17.457200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-39f76d90-a201-4238-b6d8-10a8f0d79f12 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Getting quotas for project 68208d23fd2f40479ba279566a819933. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:42:17.462716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-39f76d90-a201-4238-b6d8-10a8f0d79f12 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Getting quotas for user 15748f41da9f49fca3e7eec1fda3b245 and project 68208d23fd2f40479ba279566a819933. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:42:17.475887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-39f76d90-a201-4238-b6d8-10a8f0d79f12 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:42:17.478020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-39f76d90-a201-4238-b6d8-10a8f0d79f12 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f1f50810-a197-4cca-9995-7d8666c923c6',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:42:17.660630 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-39f76d90-a201-4238-b6d8-10a8f0d79f12 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.084178 Oct 04 21:42:17.668549 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3103/6186] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:42:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:42:17.673813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2eee9daa-b33d-494f-9192-f8fe18cd6ec7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:17.674439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2eee9daa-b33d-494f-9192-f8fe18cd6ec7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:17.676723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=7 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:17.677549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=21 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:17.915468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2eee9daa-b33d-494f-9192-f8fe18cd6ec7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:17.925626 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2eee9daa-b33d-494f-9192-f8fe18cd6ec7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1056 microversion: 2.1 time: 0.255049 Oct 04 21:42:17.930141 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3084/6187] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:17 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1056 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:18.952333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4fbbea37-f9e7-4998-8ab8-aa08a1208e11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:18.956416 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4fbbea37-f9e7-4998-8ab8-aa08a1208e11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:19.030670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4fbbea37-f9e7-4998-8ab8-aa08a1208e11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:19.038890 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4fbbea37-f9e7-4998-8ab8-aa08a1208e11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1056 microversion: 2.1 time: 0.091590 Oct 04 21:42:19.039507 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3104/6188] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:18 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1056 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:20.063623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6ee55058-ec3e-45c0-8d67-953f2af67817 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:20.064291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6ee55058-ec3e-45c0-8d67-953f2af67817 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:20.193035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6ee55058-ec3e-45c0-8d67-953f2af67817 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:20.204046 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6ee55058-ec3e-45c0-8d67-953f2af67817 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1056 microversion: 2.1 time: 0.144549 Oct 04 21:42:20.229718 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3085/6189] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:20 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1056 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:21.232259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-07f87312-341d-4eec-b73a-8c028919efa7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:21.233196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-07f87312-341d-4eec-b73a-8c028919efa7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:21.332131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-07f87312-341d-4eec-b73a-8c028919efa7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:21.341375 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-07f87312-341d-4eec-b73a-8c028919efa7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1056 microversion: 2.1 time: 0.113075 Oct 04 21:42:21.355461 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3105/6190] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:21 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1056 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:22.370420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9ccead00-33a9-4a18-8d52-4f9c4a555777 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:22.371151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9ccead00-33a9-4a18-8d52-4f9c4a555777 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:22.493748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9ccead00-33a9-4a18-8d52-4f9c4a555777 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:22.507770 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9ccead00-33a9-4a18-8d52-4f9c4a555777 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1056 microversion: 2.1 time: 0.142122 Oct 04 21:42:22.508990 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3086/6191] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:22 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1056 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:23.542064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f091c896-eb9a-46c8-9b13-d43ee3886beb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:23.542693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f091c896-eb9a-46c8-9b13-d43ee3886beb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:23.552559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f091c896-eb9a-46c8-9b13-d43ee3886beb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:23.552845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f091c896-eb9a-46c8-9b13-d43ee3886beb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:23.553295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f091c896-eb9a-46c8-9b13-d43ee3886beb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:23.554498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f091c896-eb9a-46c8-9b13-d43ee3886beb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:23.554498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f091c896-eb9a-46c8-9b13-d43ee3886beb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:23.554901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f091c896-eb9a-46c8-9b13-d43ee3886beb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:23.704968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f091c896-eb9a-46c8-9b13-d43ee3886beb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:23.733329 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f091c896-eb9a-46c8-9b13-d43ee3886beb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1060 microversion: 2.1 time: 0.194678 Oct 04 21:42:23.737229 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3106/6192] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:23 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1060 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:24.761067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6b5250ed-9c30-4974-9640-79a5da230b30 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:24.761067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6b5250ed-9c30-4974-9640-79a5da230b30 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:24.773826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b5250ed-9c30-4974-9640-79a5da230b30 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:24.776078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b5250ed-9c30-4974-9640-79a5da230b30 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:24.776078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b5250ed-9c30-4974-9640-79a5da230b30 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:24.776078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b5250ed-9c30-4974-9640-79a5da230b30 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:24.776078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b5250ed-9c30-4974-9640-79a5da230b30 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:24.776780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b5250ed-9c30-4974-9640-79a5da230b30 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:24.955531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6b5250ed-9c30-4974-9640-79a5da230b30 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:24.976299 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6b5250ed-9c30-4974-9640-79a5da230b30 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1052 microversion: 2.1 time: 0.219667 Oct 04 21:42:24.977028 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3087/6193] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:24 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1052 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:26.006742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-59f4e894-e70e-4a0f-ad63-8583a0bdb311 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:26.008841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-59f4e894-e70e-4a0f-ad63-8583a0bdb311 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:26.017348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59f4e894-e70e-4a0f-ad63-8583a0bdb311 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:26.018931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59f4e894-e70e-4a0f-ad63-8583a0bdb311 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:26.020152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59f4e894-e70e-4a0f-ad63-8583a0bdb311 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:26.021180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59f4e894-e70e-4a0f-ad63-8583a0bdb311 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:26.021912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59f4e894-e70e-4a0f-ad63-8583a0bdb311 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:26.022576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59f4e894-e70e-4a0f-ad63-8583a0bdb311 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:26.097192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-59f4e894-e70e-4a0f-ad63-8583a0bdb311 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:26.108198 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-59f4e894-e70e-4a0f-ad63-8583a0bdb311 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1116 microversion: 2.1 time: 0.106397 Oct 04 21:42:26.122926 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3107/6194] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:26 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1116 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:27.138100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4513f290-7ec3-4f50-b53e-b55dac5feec1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:27.139662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4513f290-7ec3-4f50-b53e-b55dac5feec1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:27.152920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4513f290-7ec3-4f50-b53e-b55dac5feec1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:27.157886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4513f290-7ec3-4f50-b53e-b55dac5feec1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:27.160658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4513f290-7ec3-4f50-b53e-b55dac5feec1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:27.161711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4513f290-7ec3-4f50-b53e-b55dac5feec1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:27.166310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4513f290-7ec3-4f50-b53e-b55dac5feec1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:27.167074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4513f290-7ec3-4f50-b53e-b55dac5feec1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:27.410964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4513f290-7ec3-4f50-b53e-b55dac5feec1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:27.476270 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4513f290-7ec3-4f50-b53e-b55dac5feec1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1126 microversion: 2.1 time: 0.334114 Oct 04 21:42:27.476946 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3088/6195] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:27 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1126 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:28.501407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0a37900a-cf54-44de-951e-60a127d40af8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:28.502751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0a37900a-cf54-44de-951e-60a127d40af8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:28.513126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:28.520379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a37900a-cf54-44de-951e-60a127d40af8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:28.521320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a37900a-cf54-44de-951e-60a127d40af8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:28.522094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a37900a-cf54-44de-951e-60a127d40af8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:28.527310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a37900a-cf54-44de-951e-60a127d40af8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:28.528173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a37900a-cf54-44de-951e-60a127d40af8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:28.529189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0a37900a-cf54-44de-951e-60a127d40af8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:29.182074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0a37900a-cf54-44de-951e-60a127d40af8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:29.202117 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0a37900a-cf54-44de-951e-60a127d40af8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.705599 Oct 04 21:42:29.203428 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3108/6196] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:28 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:30.226627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c1f7e345-7690-4ef4-a05e-4cf6b41b63cf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:30.228340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c1f7e345-7690-4ef4-a05e-4cf6b41b63cf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:30.244078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1f7e345-7690-4ef4-a05e-4cf6b41b63cf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:30.249035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1f7e345-7690-4ef4-a05e-4cf6b41b63cf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:30.249641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1f7e345-7690-4ef4-a05e-4cf6b41b63cf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:30.252265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1f7e345-7690-4ef4-a05e-4cf6b41b63cf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:30.255104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1f7e345-7690-4ef4-a05e-4cf6b41b63cf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:30.255731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1f7e345-7690-4ef4-a05e-4cf6b41b63cf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:30.859994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c1f7e345-7690-4ef4-a05e-4cf6b41b63cf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:30.876102 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c1f7e345-7690-4ef4-a05e-4cf6b41b63cf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.652782 Oct 04 21:42:30.878313 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3089/6197] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:30 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:31.906188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2a586424-9802-4166-be6f-5e5359d139c6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:31.912681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2a586424-9802-4166-be6f-5e5359d139c6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:31.922454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=10 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:31.928289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a586424-9802-4166-be6f-5e5359d139c6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:31.929165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a586424-9802-4166-be6f-5e5359d139c6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:31.932713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a586424-9802-4166-be6f-5e5359d139c6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:31.934102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a586424-9802-4166-be6f-5e5359d139c6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:31.935267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a586424-9802-4166-be6f-5e5359d139c6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:31.935954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a586424-9802-4166-be6f-5e5359d139c6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:32.514419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2a586424-9802-4166-be6f-5e5359d139c6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:32.544108 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2a586424-9802-4166-be6f-5e5359d139c6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.643818 Oct 04 21:42:32.557202 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3109/6198] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:31 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:33.573552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-485c245d-1807-4ce8-a859-bdd07352f39c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:33.574086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-485c245d-1807-4ce8-a859-bdd07352f39c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:33.582179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:33.583811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-485c245d-1807-4ce8-a859-bdd07352f39c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:33.584303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-485c245d-1807-4ce8-a859-bdd07352f39c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:33.584739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-485c245d-1807-4ce8-a859-bdd07352f39c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:33.585454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-485c245d-1807-4ce8-a859-bdd07352f39c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:33.585972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-485c245d-1807-4ce8-a859-bdd07352f39c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:33.586399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-485c245d-1807-4ce8-a859-bdd07352f39c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:33.884922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b568e1ec-f1e5-4f77-8351-3678cfabad1b req-4ed4677f-0a00-4689-8ed4-b23321e763ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbee10f0-c5f2-437b-95d8-b9a8e379b167", "tag": "dc3baf5c-c701-412e-a05f-a655c4e98fb8"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:42:33.914410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b568e1ec-f1e5-4f77-8351-3678cfabad1b req-4ed4677f-0a00-4689-8ed4-b23321e763ad service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:33.915594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b568e1ec-f1e5-4f77-8351-3678cfabad1b req-4ed4677f-0a00-4689-8ed4-b23321e763ad service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:33.917790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b568e1ec-f1e5-4f77-8351-3678cfabad1b req-4ed4677f-0a00-4689-8ed4-b23321e763ad service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:33.945900 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b568e1ec-f1e5-4f77-8351-3678cfabad1b req-4ed4677f-0a00-4689-8ed4-b23321e763ad service nova] Creating event network-changed:dc3baf5c-c701-412e-a05f-a655c4e98fb8 for instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 on n-h1-860282-1 Oct 04 21:42:33.967446 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b568e1ec-f1e5-4f77-8351-3678cfabad1b req-4ed4677f-0a00-4689-8ed4-b23321e763ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109337 Oct 04 21:42:33.968540 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3110/6199] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:42:34.278582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-485c245d-1807-4ce8-a859-bdd07352f39c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:34.292462 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-485c245d-1807-4ce8-a859-bdd07352f39c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.722959 Oct 04 21:42:34.293698 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3090/6200] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:33 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:35.327277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5da7e46f-f3a1-4092-9a4c-5ef9d9262fdd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:35.328589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5da7e46f-f3a1-4092-9a4c-5ef9d9262fdd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:35.337038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5da7e46f-f3a1-4092-9a4c-5ef9d9262fdd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:35.337879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5da7e46f-f3a1-4092-9a4c-5ef9d9262fdd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:35.338525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5da7e46f-f3a1-4092-9a4c-5ef9d9262fdd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:35.339424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5da7e46f-f3a1-4092-9a4c-5ef9d9262fdd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:35.340063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5da7e46f-f3a1-4092-9a4c-5ef9d9262fdd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:35.340672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5da7e46f-f3a1-4092-9a4c-5ef9d9262fdd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:35.562778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5da7e46f-f3a1-4092-9a4c-5ef9d9262fdd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:35.572602 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5da7e46f-f3a1-4092-9a4c-5ef9d9262fdd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.254146 Oct 04 21:42:35.585460 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3111/6201] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:35 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:36.598880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6f3e41cb-90dc-4a93-80e5-3e96e728799c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:36.600000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6f3e41cb-90dc-4a93-80e5-3e96e728799c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:36.615213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f3e41cb-90dc-4a93-80e5-3e96e728799c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:36.616780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f3e41cb-90dc-4a93-80e5-3e96e728799c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:36.617396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f3e41cb-90dc-4a93-80e5-3e96e728799c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:36.622640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f3e41cb-90dc-4a93-80e5-3e96e728799c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:36.623529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f3e41cb-90dc-4a93-80e5-3e96e728799c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:36.624345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f3e41cb-90dc-4a93-80e5-3e96e728799c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:37.111702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6f3e41cb-90dc-4a93-80e5-3e96e728799c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:37.120225 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6f3e41cb-90dc-4a93-80e5-3e96e728799c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.528276 Oct 04 21:42:37.120959 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3091/6202] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:36 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:38.146338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c85de0b7-d7a5-4b9e-8360-22ce2eba215a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:38.147838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c85de0b7-d7a5-4b9e-8360-22ce2eba215a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:38.158646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c85de0b7-d7a5-4b9e-8360-22ce2eba215a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:38.159693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c85de0b7-d7a5-4b9e-8360-22ce2eba215a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:38.160311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c85de0b7-d7a5-4b9e-8360-22ce2eba215a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:38.161221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c85de0b7-d7a5-4b9e-8360-22ce2eba215a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:38.161886 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c85de0b7-d7a5-4b9e-8360-22ce2eba215a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:38.162514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c85de0b7-d7a5-4b9e-8360-22ce2eba215a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:38.466060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c85de0b7-d7a5-4b9e-8360-22ce2eba215a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:38.483284 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c85de0b7-d7a5-4b9e-8360-22ce2eba215a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.342538 Oct 04 21:42:38.514476 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3112/6203] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:38 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:39.508915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ff4d1112-62a2-42d1-80dd-79d32fcc449c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:39.510248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ff4d1112-62a2-42d1-80dd-79d32fcc449c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:39.518317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff4d1112-62a2-42d1-80dd-79d32fcc449c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:39.519753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff4d1112-62a2-42d1-80dd-79d32fcc449c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:39.520583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff4d1112-62a2-42d1-80dd-79d32fcc449c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:39.521512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff4d1112-62a2-42d1-80dd-79d32fcc449c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:39.522174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff4d1112-62a2-42d1-80dd-79d32fcc449c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:39.522763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff4d1112-62a2-42d1-80dd-79d32fcc449c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:39.730440 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ff4d1112-62a2-42d1-80dd-79d32fcc449c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:39.741111 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ff4d1112-62a2-42d1-80dd-79d32fcc449c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.236366 Oct 04 21:42:39.750636 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3092/6204] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:39 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:40.775267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3bfdb13a-1a41-429b-8008-1affa96f0a5b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:40.776951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3bfdb13a-1a41-429b-8008-1affa96f0a5b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:40.788576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bfdb13a-1a41-429b-8008-1affa96f0a5b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:40.791520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bfdb13a-1a41-429b-8008-1affa96f0a5b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:40.792277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bfdb13a-1a41-429b-8008-1affa96f0a5b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:40.800759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bfdb13a-1a41-429b-8008-1affa96f0a5b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:40.801710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bfdb13a-1a41-429b-8008-1affa96f0a5b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:40.802367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bfdb13a-1a41-429b-8008-1affa96f0a5b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:41.099979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3bfdb13a-1a41-429b-8008-1affa96f0a5b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:41.111023 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3bfdb13a-1a41-429b-8008-1affa96f0a5b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.339807 Oct 04 21:42:41.111853 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3113/6205] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:40 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:42.135712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8f50a631-891d-4f0f-b8d2-38babfabf944 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:42.136356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8f50a631-891d-4f0f-b8d2-38babfabf944 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:42.143809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f50a631-891d-4f0f-b8d2-38babfabf944 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:42.146652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f50a631-891d-4f0f-b8d2-38babfabf944 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:42.146652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f50a631-891d-4f0f-b8d2-38babfabf944 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:42.146652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f50a631-891d-4f0f-b8d2-38babfabf944 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:42.146652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f50a631-891d-4f0f-b8d2-38babfabf944 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:42.146652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f50a631-891d-4f0f-b8d2-38babfabf944 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:42.468803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8f50a631-891d-4f0f-b8d2-38babfabf944 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:42.492283 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8f50a631-891d-4f0f-b8d2-38babfabf944 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.358135 Oct 04 21:42:42.502766 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3093/6206] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:42 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:43.525326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f749acb3-4d5d-499a-bae2-36584b6253bb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:43.526162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f749acb3-4d5d-499a-bae2-36584b6253bb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:43.559224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f749acb3-4d5d-499a-bae2-36584b6253bb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:43.559523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f749acb3-4d5d-499a-bae2-36584b6253bb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:43.560841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f749acb3-4d5d-499a-bae2-36584b6253bb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:43.562383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f749acb3-4d5d-499a-bae2-36584b6253bb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:43.563508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f749acb3-4d5d-499a-bae2-36584b6253bb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:43.564220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f749acb3-4d5d-499a-bae2-36584b6253bb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:44.001023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f749acb3-4d5d-499a-bae2-36584b6253bb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:44.015995 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f749acb3-4d5d-499a-bae2-36584b6253bb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.494669 Oct 04 21:42:44.017941 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3114/6207] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:43 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:42:45.053664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a3d40ef0-130a-4505-b57c-149b2241fd1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:45.055150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a3d40ef0-130a-4505-b57c-149b2241fd1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:45.075648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3d40ef0-130a-4505-b57c-149b2241fd1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:45.076613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3d40ef0-130a-4505-b57c-149b2241fd1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:45.088834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3d40ef0-130a-4505-b57c-149b2241fd1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:45.097906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3d40ef0-130a-4505-b57c-149b2241fd1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:45.099258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3d40ef0-130a-4505-b57c-149b2241fd1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:45.102969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3d40ef0-130a-4505-b57c-149b2241fd1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:45.521370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a3d40ef0-130a-4505-b57c-149b2241fd1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:45.559792 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a3d40ef0-130a-4505-b57c-149b2241fd1a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.513455 Oct 04 21:42:45.564826 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3094/6208] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:45 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:46.586869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-300375a2-f55c-410c-922a-d2adf7678410 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:46.587684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-300375a2-f55c-410c-922a-d2adf7678410 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:46.601615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-300375a2-f55c-410c-922a-d2adf7678410 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:46.602452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-300375a2-f55c-410c-922a-d2adf7678410 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:46.603091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-300375a2-f55c-410c-922a-d2adf7678410 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:46.603990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-300375a2-f55c-410c-922a-d2adf7678410 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:46.604997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-300375a2-f55c-410c-922a-d2adf7678410 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:46.605708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-300375a2-f55c-410c-922a-d2adf7678410 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:47.147440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-300375a2-f55c-410c-922a-d2adf7678410 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:47.155138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=57 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:47.158349 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-300375a2-f55c-410c-922a-d2adf7678410 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.576997 Oct 04 21:42:47.159780 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3115/6209] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:46 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:48.187061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3e3f1c11-9da8-45c9-a8d9-7d12f546959b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:48.187712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3e3f1c11-9da8-45c9-a8d9-7d12f546959b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:48.201126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3f1c11-9da8-45c9-a8d9-7d12f546959b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:48.201645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3f1c11-9da8-45c9-a8d9-7d12f546959b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:48.204528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3f1c11-9da8-45c9-a8d9-7d12f546959b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:48.208109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3f1c11-9da8-45c9-a8d9-7d12f546959b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:48.208654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3f1c11-9da8-45c9-a8d9-7d12f546959b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:48.209149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3e3f1c11-9da8-45c9-a8d9-7d12f546959b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:49.086123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3e3f1c11-9da8-45c9-a8d9-7d12f546959b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:49.097266 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3e3f1c11-9da8-45c9-a8d9-7d12f546959b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.913362 Oct 04 21:42:49.099077 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3095/6210] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:48 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:50.124254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-efef6fec-3561-41f1-a8e6-7d2f0ebae958 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:50.126257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-efef6fec-3561-41f1-a8e6-7d2f0ebae958 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:50.131461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:50.136350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efef6fec-3561-41f1-a8e6-7d2f0ebae958 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:50.138108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efef6fec-3561-41f1-a8e6-7d2f0ebae958 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:50.138108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efef6fec-3561-41f1-a8e6-7d2f0ebae958 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:50.138470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efef6fec-3561-41f1-a8e6-7d2f0ebae958 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:50.138940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efef6fec-3561-41f1-a8e6-7d2f0ebae958 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:50.139564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efef6fec-3561-41f1-a8e6-7d2f0ebae958 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:50.332488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-efef6fec-3561-41f1-a8e6-7d2f0ebae958 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:50.340414 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-efef6fec-3561-41f1-a8e6-7d2f0ebae958 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.220804 Oct 04 21:42:50.341001 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3116/6211] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:50 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:51.390046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4fdfbf40-6573-4633-8f89-7772e7812a57 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:51.391450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4fdfbf40-6573-4633-8f89-7772e7812a57 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:51.402737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=31 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:51.404894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fdfbf40-6573-4633-8f89-7772e7812a57 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:51.405656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fdfbf40-6573-4633-8f89-7772e7812a57 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:51.407215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fdfbf40-6573-4633-8f89-7772e7812a57 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:51.409227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fdfbf40-6573-4633-8f89-7772e7812a57 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:51.410496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fdfbf40-6573-4633-8f89-7772e7812a57 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:51.414132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fdfbf40-6573-4633-8f89-7772e7812a57 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:51.458341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=55 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:52.549180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4fdfbf40-6573-4633-8f89-7772e7812a57 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:52.561561 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4fdfbf40-6573-4633-8f89-7772e7812a57 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 1.184084 Oct 04 21:42:52.562273 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3096/6212] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:51 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:53.588726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c1f98607-e44b-4fc6-a1d8-bf953511dea8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:53.589972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c1f98607-e44b-4fc6-a1d8-bf953511dea8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:53.616542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1f98607-e44b-4fc6-a1d8-bf953511dea8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:53.617165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1f98607-e44b-4fc6-a1d8-bf953511dea8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:53.617725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1f98607-e44b-4fc6-a1d8-bf953511dea8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:53.618655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1f98607-e44b-4fc6-a1d8-bf953511dea8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:53.620476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1f98607-e44b-4fc6-a1d8-bf953511dea8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:53.621207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1f98607-e44b-4fc6-a1d8-bf953511dea8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:54.018602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c1f98607-e44b-4fc6-a1d8-bf953511dea8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:54.032883 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c1f98607-e44b-4fc6-a1d8-bf953511dea8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.451735 Oct 04 21:42:54.034501 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3117/6213] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:53 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:55.058663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-59330152-13c3-4a4d-8ec3-9fff2a8c2fc3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:55.060098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-59330152-13c3-4a4d-8ec3-9fff2a8c2fc3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:55.085117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59330152-13c3-4a4d-8ec3-9fff2a8c2fc3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:55.085117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59330152-13c3-4a4d-8ec3-9fff2a8c2fc3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:55.085117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59330152-13c3-4a4d-8ec3-9fff2a8c2fc3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:55.085117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59330152-13c3-4a4d-8ec3-9fff2a8c2fc3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:55.085117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59330152-13c3-4a4d-8ec3-9fff2a8c2fc3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:55.085117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59330152-13c3-4a4d-8ec3-9fff2a8c2fc3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:55.543075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-59330152-13c3-4a4d-8ec3-9fff2a8c2fc3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:55.562896 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-59330152-13c3-4a4d-8ec3-9fff2a8c2fc3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.509132 Oct 04 21:42:55.564360 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3097/6214] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:55 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:56.601719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dcff24f9-04a7-4d6f-9b2a-84d8eec9804c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:56.603016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dcff24f9-04a7-4d6f-9b2a-84d8eec9804c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:56.614674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcff24f9-04a7-4d6f-9b2a-84d8eec9804c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:56.614674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcff24f9-04a7-4d6f-9b2a-84d8eec9804c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:56.614674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcff24f9-04a7-4d6f-9b2a-84d8eec9804c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:56.622169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcff24f9-04a7-4d6f-9b2a-84d8eec9804c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:56.622831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcff24f9-04a7-4d6f-9b2a-84d8eec9804c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:56.623804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcff24f9-04a7-4d6f-9b2a-84d8eec9804c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:56.959055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dcff24f9-04a7-4d6f-9b2a-84d8eec9804c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:56.973898 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dcff24f9-04a7-4d6f-9b2a-84d8eec9804c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.386248 Oct 04 21:42:56.974498 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3118/6215] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:56 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:58.002236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5afef4b1-b134-4be3-a0d6-a81c450c547e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:58.004990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5afef4b1-b134-4be3-a0d6-a81c450c547e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:58.018446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5afef4b1-b134-4be3-a0d6-a81c450c547e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:58.018957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5afef4b1-b134-4be3-a0d6-a81c450c547e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:58.021989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5afef4b1-b134-4be3-a0d6-a81c450c547e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:58.024249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5afef4b1-b134-4be3-a0d6-a81c450c547e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:58.025039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5afef4b1-b134-4be3-a0d6-a81c450c547e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:58.030067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5afef4b1-b134-4be3-a0d6-a81c450c547e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:58.935654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5afef4b1-b134-4be3-a0d6-a81c450c547e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:58.963801 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5afef4b1-b134-4be3-a0d6-a81c450c547e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.965431 Oct 04 21:42:58.966734 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3098/6216] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:57 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:00.000338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-322f11f0-9212-4ff8-89c9-2aa00ae07009 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:00.008563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-322f11f0-9212-4ff8-89c9-2aa00ae07009 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:00.049497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-322f11f0-9212-4ff8-89c9-2aa00ae07009 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:00.050311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-322f11f0-9212-4ff8-89c9-2aa00ae07009 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:00.051166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-322f11f0-9212-4ff8-89c9-2aa00ae07009 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:00.054022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-322f11f0-9212-4ff8-89c9-2aa00ae07009 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:00.054658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-322f11f0-9212-4ff8-89c9-2aa00ae07009 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:00.060473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-322f11f0-9212-4ff8-89c9-2aa00ae07009 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:00.578422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-322f11f0-9212-4ff8-89c9-2aa00ae07009 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:00.626373 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-322f11f0-9212-4ff8-89c9-2aa00ae07009 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.629477 Oct 04 21:43:00.628441 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3119/6217] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:59 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:01.653908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-423b2b96-5b99-4233-ab9e-7d330d1eae33 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:01.654681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-423b2b96-5b99-4233-ab9e-7d330d1eae33 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:01.672654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-423b2b96-5b99-4233-ab9e-7d330d1eae33 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:01.673204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-423b2b96-5b99-4233-ab9e-7d330d1eae33 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:01.673714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-423b2b96-5b99-4233-ab9e-7d330d1eae33 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:01.679303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-423b2b96-5b99-4233-ab9e-7d330d1eae33 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:01.679881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-423b2b96-5b99-4233-ab9e-7d330d1eae33 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:01.680338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-423b2b96-5b99-4233-ab9e-7d330d1eae33 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:02.823250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-423b2b96-5b99-4233-ab9e-7d330d1eae33 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:02.833205 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-423b2b96-5b99-4233-ab9e-7d330d1eae33 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 1.183597 Oct 04 21:43:02.838106 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3099/6218] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:01 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:03.861641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-07211026-4392-4c61-9b4c-432a04077652 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:03.862419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-07211026-4392-4c61-9b4c-432a04077652 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:03.876649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-07211026-4392-4c61-9b4c-432a04077652 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:03.877160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-07211026-4392-4c61-9b4c-432a04077652 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:03.877728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-07211026-4392-4c61-9b4c-432a04077652 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:03.883203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-07211026-4392-4c61-9b4c-432a04077652 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:03.883694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-07211026-4392-4c61-9b4c-432a04077652 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:03.884140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-07211026-4392-4c61-9b4c-432a04077652 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:04.797872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-07211026-4392-4c61-9b4c-432a04077652 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:04.814340 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-07211026-4392-4c61-9b4c-432a04077652 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.958001 Oct 04 21:43:04.815546 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3120/6219] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:03 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:05.845887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-19a3d58f-502a-4458-a278-b4faffd45ffb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:05.848721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-19a3d58f-502a-4458-a278-b4faffd45ffb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:05.866517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19a3d58f-502a-4458-a278-b4faffd45ffb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:05.867475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19a3d58f-502a-4458-a278-b4faffd45ffb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:05.868138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19a3d58f-502a-4458-a278-b4faffd45ffb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:05.869117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19a3d58f-502a-4458-a278-b4faffd45ffb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:05.869983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19a3d58f-502a-4458-a278-b4faffd45ffb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:05.870604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19a3d58f-502a-4458-a278-b4faffd45ffb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:06.216310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-19a3d58f-502a-4458-a278-b4faffd45ffb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:06.238562 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-19a3d58f-502a-4458-a278-b4faffd45ffb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.402355 Oct 04 21:43:06.239565 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3100/6220] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:05 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:07.263149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-95f52c8f-d2f1-4404-8b6d-0c929fdf4392 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:07.263793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-95f52c8f-d2f1-4404-8b6d-0c929fdf4392 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:07.281645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95f52c8f-d2f1-4404-8b6d-0c929fdf4392 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:07.282391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95f52c8f-d2f1-4404-8b6d-0c929fdf4392 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:07.283029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95f52c8f-d2f1-4404-8b6d-0c929fdf4392 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:07.284025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95f52c8f-d2f1-4404-8b6d-0c929fdf4392 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:07.284647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95f52c8f-d2f1-4404-8b6d-0c929fdf4392 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:07.285453 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95f52c8f-d2f1-4404-8b6d-0c929fdf4392 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:07.865011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-95f52c8f-d2f1-4404-8b6d-0c929fdf4392 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:07.876280 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-95f52c8f-d2f1-4404-8b6d-0c929fdf4392 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.616457 Oct 04 21:43:07.896435 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3121/6221] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:07 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:08.909195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cf4ce2fe-3581-4d8e-a042-2265c1fc7f31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:08.914958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cf4ce2fe-3581-4d8e-a042-2265c1fc7f31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:08.924990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf4ce2fe-3581-4d8e-a042-2265c1fc7f31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:08.927548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf4ce2fe-3581-4d8e-a042-2265c1fc7f31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:08.928211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf4ce2fe-3581-4d8e-a042-2265c1fc7f31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:08.929202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf4ce2fe-3581-4d8e-a042-2265c1fc7f31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:08.931038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf4ce2fe-3581-4d8e-a042-2265c1fc7f31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:08.931643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf4ce2fe-3581-4d8e-a042-2265c1fc7f31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:09.294526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cf4ce2fe-3581-4d8e-a042-2265c1fc7f31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:09.326740 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cf4ce2fe-3581-4d8e-a042-2265c1fc7f31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1168 microversion: 2.1 time: 0.418741 Oct 04 21:43:09.331691 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3101/6222] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:08 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1168 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:10.358215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1f803a88-8439-40e8-9d1b-a90ed14f5dcb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:10.358936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1f803a88-8439-40e8-9d1b-a90ed14f5dcb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:10.379533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f803a88-8439-40e8-9d1b-a90ed14f5dcb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:10.382494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f803a88-8439-40e8-9d1b-a90ed14f5dcb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:10.383172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f803a88-8439-40e8-9d1b-a90ed14f5dcb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:10.385018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f803a88-8439-40e8-9d1b-a90ed14f5dcb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:10.386859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f803a88-8439-40e8-9d1b-a90ed14f5dcb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:10.387310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1f803a88-8439-40e8-9d1b-a90ed14f5dcb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:10.942965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1f803a88-8439-40e8-9d1b-a90ed14f5dcb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:10.955631 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1f803a88-8439-40e8-9d1b-a90ed14f5dcb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1214 microversion: 2.1 time: 0.600278 Oct 04 21:43:10.956761 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3122/6223] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:10 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1214 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:11.993795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a975c73-029c-48a9-9d69-3ebbbacf6f2f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:11.994488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7a975c73-029c-48a9-9d69-3ebbbacf6f2f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:12.001725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a975c73-029c-48a9-9d69-3ebbbacf6f2f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:12.002226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a975c73-029c-48a9-9d69-3ebbbacf6f2f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:12.002670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a975c73-029c-48a9-9d69-3ebbbacf6f2f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:12.004577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a975c73-029c-48a9-9d69-3ebbbacf6f2f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:12.005242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a975c73-029c-48a9-9d69-3ebbbacf6f2f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:12.005702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a975c73-029c-48a9-9d69-3ebbbacf6f2f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:12.456376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7a975c73-029c-48a9-9d69-3ebbbacf6f2f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:12.464593 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7a975c73-029c-48a9-9d69-3ebbbacf6f2f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1202 microversion: 2.1 time: 0.484539 Oct 04 21:43:12.465193 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3102/6224] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:11 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1202 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:13.490378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-80a433a0-c592-4801-ab06-b6aa3653dfa7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:13.491104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-80a433a0-c592-4801-ab06-b6aa3653dfa7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:13.498978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80a433a0-c592-4801-ab06-b6aa3653dfa7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:13.506315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80a433a0-c592-4801-ab06-b6aa3653dfa7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:13.506905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80a433a0-c592-4801-ab06-b6aa3653dfa7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:13.507974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80a433a0-c592-4801-ab06-b6aa3653dfa7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:13.509041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80a433a0-c592-4801-ab06-b6aa3653dfa7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:13.509784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80a433a0-c592-4801-ab06-b6aa3653dfa7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:13.811667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-80a433a0-c592-4801-ab06-b6aa3653dfa7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:13.824408 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-80a433a0-c592-4801-ab06-b6aa3653dfa7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1202 microversion: 2.1 time: 0.339444 Oct 04 21:43:13.849524 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3123/6225] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:13 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1202 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:14.853291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b01281ba-fd6f-4219-b1ef-97bdefe2e0bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:14.854633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b01281ba-fd6f-4219-b1ef-97bdefe2e0bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:14.869881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b01281ba-fd6f-4219-b1ef-97bdefe2e0bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:14.871509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b01281ba-fd6f-4219-b1ef-97bdefe2e0bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:14.872555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b01281ba-fd6f-4219-b1ef-97bdefe2e0bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:14.876724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b01281ba-fd6f-4219-b1ef-97bdefe2e0bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:14.877600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b01281ba-fd6f-4219-b1ef-97bdefe2e0bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:14.879426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b01281ba-fd6f-4219-b1ef-97bdefe2e0bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:15.366841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b01281ba-fd6f-4219-b1ef-97bdefe2e0bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:15.382450 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b01281ba-fd6f-4219-b1ef-97bdefe2e0bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1202 microversion: 2.1 time: 0.534150 Oct 04 21:43:15.383049 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3103/6226] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:14 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1202 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:16.412611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f76890fa-febb-4ef3-bfb7-d27508f61333 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:16.413985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f76890fa-febb-4ef3-bfb7-d27508f61333 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:16.425239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76890fa-febb-4ef3-bfb7-d27508f61333 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:16.427059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76890fa-febb-4ef3-bfb7-d27508f61333 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:16.427717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76890fa-febb-4ef3-bfb7-d27508f61333 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:16.429047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76890fa-febb-4ef3-bfb7-d27508f61333 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:16.430710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76890fa-febb-4ef3-bfb7-d27508f61333 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:16.431426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f76890fa-febb-4ef3-bfb7-d27508f61333 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:16.791830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f76890fa-febb-4ef3-bfb7-d27508f61333 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:16.815465 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f76890fa-febb-4ef3-bfb7-d27508f61333 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1202 microversion: 2.1 time: 0.409321 Oct 04 21:43:16.819205 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3124/6227] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:16 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1202 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:17.869015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f3b5e187-1b82-4d04-ad47-c7f04c200fff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:17.870208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f3b5e187-1b82-4d04-ad47-c7f04c200fff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:17.892800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3b5e187-1b82-4d04-ad47-c7f04c200fff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:17.903385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3b5e187-1b82-4d04-ad47-c7f04c200fff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:17.903948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3b5e187-1b82-4d04-ad47-c7f04c200fff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:17.906654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3b5e187-1b82-4d04-ad47-c7f04c200fff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:17.909551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3b5e187-1b82-4d04-ad47-c7f04c200fff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:17.913734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f3b5e187-1b82-4d04-ad47-c7f04c200fff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:18.412655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f3b5e187-1b82-4d04-ad47-c7f04c200fff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:18.427141 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f3b5e187-1b82-4d04-ad47-c7f04c200fff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1202 microversion: 2.1 time: 0.576527 Oct 04 21:43:18.432914 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3104/6228] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:17 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1202 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:19.458353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a5ef245a-6890-4468-bf89-96d285d4998f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:19.458988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a5ef245a-6890-4468-bf89-96d285d4998f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:19.470354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5ef245a-6890-4468-bf89-96d285d4998f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:19.470871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5ef245a-6890-4468-bf89-96d285d4998f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:19.471328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5ef245a-6890-4468-bf89-96d285d4998f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:19.472067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5ef245a-6890-4468-bf89-96d285d4998f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:19.472571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5ef245a-6890-4468-bf89-96d285d4998f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:19.478492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5ef245a-6890-4468-bf89-96d285d4998f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:20.071875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a5ef245a-6890-4468-bf89-96d285d4998f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:20.086062 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a5ef245a-6890-4468-bf89-96d285d4998f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1202 microversion: 2.1 time: 0.629455 Oct 04 21:43:20.094579 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3125/6229] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:19 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1202 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:21.110974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8118b0ae-54b2-4b9c-bd07-e0966890b834 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:21.112120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8118b0ae-54b2-4b9c-bd07-e0966890b834 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:21.129896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8118b0ae-54b2-4b9c-bd07-e0966890b834 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:21.130500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8118b0ae-54b2-4b9c-bd07-e0966890b834 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:21.130951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8118b0ae-54b2-4b9c-bd07-e0966890b834 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:21.131698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8118b0ae-54b2-4b9c-bd07-e0966890b834 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:21.132151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8118b0ae-54b2-4b9c-bd07-e0966890b834 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:21.132574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8118b0ae-54b2-4b9c-bd07-e0966890b834 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:21.609530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8118b0ae-54b2-4b9c-bd07-e0966890b834 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:21.620401 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8118b0ae-54b2-4b9c-bd07-e0966890b834 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1202 microversion: 2.1 time: 0.513315 Oct 04 21:43:21.634065 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3105/6230] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:21 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1202 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:22.645180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-e024939e-755c-4938-9193-abd08c9ea86c req-8cf77a85-453d-4b6e-a7fb-13022380e7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbee10f0-c5f2-437b-95d8-b9a8e379b167", "name": "network-vif-plugged", "status": "completed", "tag": "dc3baf5c-c701-412e-a05f-a655c4e98fb8"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:22.645180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e024939e-755c-4938-9193-abd08c9ea86c req-8cf77a85-453d-4b6e-a7fb-13022380e7da service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:22.645180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e024939e-755c-4938-9193-abd08c9ea86c req-8cf77a85-453d-4b6e-a7fb-13022380e7da service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:22.645180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e024939e-755c-4938-9193-abd08c9ea86c req-8cf77a85-453d-4b6e-a7fb-13022380e7da service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:22.645180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=62 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:22.645180 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-e024939e-755c-4938-9193-abd08c9ea86c req-8cf77a85-453d-4b6e-a7fb-13022380e7da service nova] Creating event network-vif-plugged:dc3baf5c-c701-412e-a05f-a655c4e98fb8 for instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 on n-h1-860282-1 Oct 04 21:43:22.645180 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-e024939e-755c-4938-9193-abd08c9ea86c req-8cf77a85-453d-4b6e-a7fb-13022380e7da service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.320585 Oct 04 21:43:22.645180 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3126/6231] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:22.647810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fcf432b4-1a25-4971-af5c-e4b4a91852d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:22.647810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fcf432b4-1a25-4971-af5c-e4b4a91852d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:22.653299 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=20 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:22.655144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcf432b4-1a25-4971-af5c-e4b4a91852d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:22.655630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcf432b4-1a25-4971-af5c-e4b4a91852d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:22.656066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcf432b4-1a25-4971-af5c-e4b4a91852d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:22.656767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcf432b4-1a25-4971-af5c-e4b4a91852d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:22.657519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcf432b4-1a25-4971-af5c-e4b4a91852d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:22.657895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcf432b4-1a25-4971-af5c-e4b4a91852d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:22.662256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=60 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:22.812941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fcf432b4-1a25-4971-af5c-e4b4a91852d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:22.823710 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fcf432b4-1a25-4971-af5c-e4b4a91852d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1202 microversion: 2.1 time: 0.181559 Oct 04 21:43:22.824369 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3106/6232] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:22 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1202 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:23.851355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f82d2e0b-9a85-4f3a-893e-185fd4649974 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:23.852111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f82d2e0b-9a85-4f3a-893e-185fd4649974 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:23.869140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f82d2e0b-9a85-4f3a-893e-185fd4649974 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:23.870256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f82d2e0b-9a85-4f3a-893e-185fd4649974 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:23.870924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f82d2e0b-9a85-4f3a-893e-185fd4649974 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:23.872126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f82d2e0b-9a85-4f3a-893e-185fd4649974 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:23.873299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f82d2e0b-9a85-4f3a-893e-185fd4649974 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:23.874558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f82d2e0b-9a85-4f3a-893e-185fd4649974 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:24.420741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f82d2e0b-9a85-4f3a-893e-185fd4649974 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:24.432530 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f82d2e0b-9a85-4f3a-893e-185fd4649974 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1202 microversion: 2.1 time: 0.588408 Oct 04 21:43:24.533736 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3127/6233] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:23 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1202 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:25.467266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d1bdcbbc-c296-48e5-9f59-c2efb53e8a94 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:25.468583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d1bdcbbc-c296-48e5-9f59-c2efb53e8a94 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:25.491022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1bdcbbc-c296-48e5-9f59-c2efb53e8a94 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:25.491522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1bdcbbc-c296-48e5-9f59-c2efb53e8a94 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:25.492409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1bdcbbc-c296-48e5-9f59-c2efb53e8a94 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:25.498425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1bdcbbc-c296-48e5-9f59-c2efb53e8a94 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:25.498933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1bdcbbc-c296-48e5-9f59-c2efb53e8a94 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:25.499383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1bdcbbc-c296-48e5-9f59-c2efb53e8a94 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:25.869851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d1bdcbbc-c296-48e5-9f59-c2efb53e8a94 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:25.882195 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d1bdcbbc-c296-48e5-9f59-c2efb53e8a94 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1389 microversion: 2.1 time: 0.421467 Oct 04 21:43:25.895926 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3107/6234] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:25 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1389 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:25.909270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5953683b-fc9f-47f4-8c4a-e0964cad9aad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:25.911073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5953683b-fc9f-47f4-8c4a-e0964cad9aad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:25.919192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5953683b-fc9f-47f4-8c4a-e0964cad9aad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:25.919971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5953683b-fc9f-47f4-8c4a-e0964cad9aad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:25.920805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5953683b-fc9f-47f4-8c4a-e0964cad9aad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:25.921817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5953683b-fc9f-47f4-8c4a-e0964cad9aad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:25.922428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5953683b-fc9f-47f4-8c4a-e0964cad9aad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:25.923017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5953683b-fc9f-47f4-8c4a-e0964cad9aad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.204527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5953683b-fc9f-47f4-8c4a-e0964cad9aad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:26.213350 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5953683b-fc9f-47f4-8c4a-e0964cad9aad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1389 microversion: 2.1 time: 0.308317 Oct 04 21:43:26.214252 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3128/6235] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:25 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1389 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:26.256135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1803adb0-3ccc-43b4-9446-7fbd1725f3d6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:26.258169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1803adb0-3ccc-43b4-9446-7fbd1725f3d6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:26.273508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1803adb0-3ccc-43b4-9446-7fbd1725f3d6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.274723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1803adb0-3ccc-43b4-9446-7fbd1725f3d6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.276801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1803adb0-3ccc-43b4-9446-7fbd1725f3d6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.282773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1803adb0-3ccc-43b4-9446-7fbd1725f3d6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.283407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1803adb0-3ccc-43b4-9446-7fbd1725f3d6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.284096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1803adb0-3ccc-43b4-9446-7fbd1725f3d6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.604122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1803adb0-3ccc-43b4-9446-7fbd1725f3d6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:26.616681 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1803adb0-3ccc-43b4-9446-7fbd1725f3d6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1389 microversion: 2.1 time: 0.379230 Oct 04 21:43:26.624250 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3108/6236] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:26 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1389 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:26.736445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-84bcd433-031b-4e29-b190-96cfd9919e64 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:26.740784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-84bcd433-031b-4e29-b190-96cfd9919e64 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:26.740784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=26 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:26.744547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84bcd433-031b-4e29-b190-96cfd9919e64 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.745048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84bcd433-031b-4e29-b190-96cfd9919e64 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.745530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84bcd433-031b-4e29-b190-96cfd9919e64 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.747035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84bcd433-031b-4e29-b190-96cfd9919e64 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.747662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84bcd433-031b-4e29-b190-96cfd9919e64 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.748254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84bcd433-031b-4e29-b190-96cfd9919e64 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.807196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-84bcd433-031b-4e29-b190-96cfd9919e64 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:43:27.176957 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-84bcd433-031b-4e29-b190-96cfd9919e64 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 204 len: 0 microversion: 2.1 time: 0.444299 Oct 04 21:43:27.182629 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3129/6237] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:43:26 2022] DELETE /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:43:27.190135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bc6abb03-0871-4c06-9b19-51f2263975d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:27.190988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bc6abb03-0871-4c06-9b19-51f2263975d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:27.204499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc6abb03-0871-4c06-9b19-51f2263975d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:27.210274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc6abb03-0871-4c06-9b19-51f2263975d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:27.210274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc6abb03-0871-4c06-9b19-51f2263975d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:27.210274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc6abb03-0871-4c06-9b19-51f2263975d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:27.210758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc6abb03-0871-4c06-9b19-51f2263975d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:27.210852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bc6abb03-0871-4c06-9b19-51f2263975d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:27.572094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bc6abb03-0871-4c06-9b19-51f2263975d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:27.590196 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bc6abb03-0871-4c06-9b19-51f2263975d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1395 microversion: 2.1 time: 0.404335 Oct 04 21:43:27.591267 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3109/6238] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:27 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1395 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:28.621342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f92fd744-e0fb-4364-a5be-826db83b95e1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:28.622111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f92fd744-e0fb-4364-a5be-826db83b95e1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:28.642963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f92fd744-e0fb-4364-a5be-826db83b95e1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:28.643478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f92fd744-e0fb-4364-a5be-826db83b95e1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:28.643952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f92fd744-e0fb-4364-a5be-826db83b95e1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:28.645638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f92fd744-e0fb-4364-a5be-826db83b95e1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:28.646123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f92fd744-e0fb-4364-a5be-826db83b95e1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:28.646749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f92fd744-e0fb-4364-a5be-826db83b95e1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:29.385884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f92fd744-e0fb-4364-a5be-826db83b95e1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:29.403872 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f92fd744-e0fb-4364-a5be-826db83b95e1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1395 microversion: 2.1 time: 0.786677 Oct 04 21:43:29.414999 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3130/6239] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:28 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1395 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:29.688243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-d0afc361-e355-4c02-a756-4501e9171780 req-7e206957-d873-41d4-b18c-c37b5b39cc25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbee10f0-c5f2-437b-95d8-b9a8e379b167", "name": "network-vif-deleted", "tag": "dc3baf5c-c701-412e-a05f-a655c4e98fb8"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:29.715176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d0afc361-e355-4c02-a756-4501e9171780 req-7e206957-d873-41d4-b18c-c37b5b39cc25 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:29.718384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d0afc361-e355-4c02-a756-4501e9171780 req-7e206957-d873-41d4-b18c-c37b5b39cc25 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:29.719089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d0afc361-e355-4c02-a756-4501e9171780 req-7e206957-d873-41d4-b18c-c37b5b39cc25 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:29.743429 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-d0afc361-e355-4c02-a756-4501e9171780 req-7e206957-d873-41d4-b18c-c37b5b39cc25 service nova] Creating event network-vif-deleted:dc3baf5c-c701-412e-a05f-a655c4e98fb8 for instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 on n-h1-860282-1 Oct 04 21:43:29.754244 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-d0afc361-e355-4c02-a756-4501e9171780 req-7e206957-d873-41d4-b18c-c37b5b39cc25 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069633 Oct 04 21:43:29.771188 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3110/6240] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:30.438899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-18241079-3040-46fd-8205-151377d06f20 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:30.439571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-18241079-3040-46fd-8205-151377d06f20 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:30.454798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18241079-3040-46fd-8205-151377d06f20 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:30.455379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18241079-3040-46fd-8205-151377d06f20 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:30.455829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18241079-3040-46fd-8205-151377d06f20 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:30.456559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18241079-3040-46fd-8205-151377d06f20 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:30.457129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18241079-3040-46fd-8205-151377d06f20 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:30.457617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-18241079-3040-46fd-8205-151377d06f20 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:30.653801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-18241079-3040-46fd-8205-151377d06f20 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:30.674016 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-18241079-3040-46fd-8205-151377d06f20 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1187 microversion: 2.1 time: 0.229067 Oct 04 21:43:30.676199 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3131/6241] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:30 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1187 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:31.693079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-50ddcacb-3422-4a72-a740-aa6dd98cb87d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:31.693888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-50ddcacb-3422-4a72-a740-aa6dd98cb87d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:31.711955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50ddcacb-3422-4a72-a740-aa6dd98cb87d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:31.713687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50ddcacb-3422-4a72-a740-aa6dd98cb87d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:31.718066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50ddcacb-3422-4a72-a740-aa6dd98cb87d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:31.722142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50ddcacb-3422-4a72-a740-aa6dd98cb87d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:31.724932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50ddcacb-3422-4a72-a740-aa6dd98cb87d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:31.724932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50ddcacb-3422-4a72-a740-aa6dd98cb87d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:31.956184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-50ddcacb-3422-4a72-a740-aa6dd98cb87d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:31.965583 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-50ddcacb-3422-4a72-a740-aa6dd98cb87d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1187 microversion: 2.1 time: 0.280726 Oct 04 21:43:31.969810 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3111/6242] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:31 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1187 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:32.993252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d32eaad5-084e-4130-b1ac-661746bb0a93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:32.994338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d32eaad5-084e-4130-b1ac-661746bb0a93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:33.009403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d32eaad5-084e-4130-b1ac-661746bb0a93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:33.011234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d32eaad5-084e-4130-b1ac-661746bb0a93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:33.012401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d32eaad5-084e-4130-b1ac-661746bb0a93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:33.030568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d32eaad5-084e-4130-b1ac-661746bb0a93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:33.032808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d32eaad5-084e-4130-b1ac-661746bb0a93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:33.032808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d32eaad5-084e-4130-b1ac-661746bb0a93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:33.183497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d32eaad5-084e-4130-b1ac-661746bb0a93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:33.201308 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d32eaad5-084e-4130-b1ac-661746bb0a93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1187 microversion: 2.1 time: 0.214606 Oct 04 21:43:33.202538 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3132/6243] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:32 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1187 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:34.234802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-41c163de-985c-461a-a69e-37f7a2a03122 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:34.234802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-41c163de-985c-461a-a69e-37f7a2a03122 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:34.241896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bd85008e-1f05-4d4d-a76e-2938b0d107d5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1123253710", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "7470c2c9-e763-451b-979d-629e167a2187"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:34.242405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41c163de-985c-461a-a69e-37f7a2a03122 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:34.242405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41c163de-985c-461a-a69e-37f7a2a03122 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:34.242837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41c163de-985c-461a-a69e-37f7a2a03122 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:34.243656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41c163de-985c-461a-a69e-37f7a2a03122 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:34.244122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41c163de-985c-461a-a69e-37f7a2a03122 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:34.244592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41c163de-985c-461a-a69e-37f7a2a03122 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:34.329560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-bd85008e-1f05-4d4d-a76e-2938b0d107d5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] validate_networks() for [('7470c2c9-e763-451b-979d-629e167a2187', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:43:34.378286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-41c163de-985c-461a-a69e-37f7a2a03122 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:34.396285 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-41c163de-985c-461a-a69e-37f7a2a03122 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1187 microversion: 2.1 time: 0.171955 Oct 04 21:43:34.420040 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3112/6244] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:34 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1187 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:35.279181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-bd85008e-1f05-4d4d-a76e-2938b0d107d5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:43:35.280880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-bd85008e-1f05-4d4d-a76e-2938b0d107d5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:43:35.281562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-bd85008e-1f05-4d4d-a76e-2938b0d107d5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:43:35.282242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-bd85008e-1f05-4d4d-a76e-2938b0d107d5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:43:35.282897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-bd85008e-1f05-4d4d-a76e-2938b0d107d5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:43:35.303493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd85008e-1f05-4d4d-a76e-2938b0d107d5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:35.306635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd85008e-1f05-4d4d-a76e-2938b0d107d5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:35.307376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd85008e-1f05-4d4d-a76e-2938b0d107d5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:35.313880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd85008e-1f05-4d4d-a76e-2938b0d107d5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:35.314845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd85008e-1f05-4d4d-a76e-2938b0d107d5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:35.316283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd85008e-1f05-4d4d-a76e-2938b0d107d5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:35.367170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-bd85008e-1f05-4d4d-a76e-2938b0d107d5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Getting quotas for project dace97a17e0b4ff69a81c51fe9cbbad2. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:43:35.383131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-bd85008e-1f05-4d4d-a76e-2938b0d107d5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Getting quotas for user 8489539e7c9c4039ac1168acab3a3ed5 and project dace97a17e0b4ff69a81c51fe9cbbad2. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:43:35.424525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bd85008e-1f05-4d4d-a76e-2938b0d107d5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:43:35.425644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a13d598c-f249-43f7-9541-3c817fafde28 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:35.429047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a13d598c-f249-43f7-9541-3c817fafde28 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:35.433227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bd85008e-1f05-4d4d-a76e-2938b0d107d5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:43:35.449619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a13d598c-f249-43f7-9541-3c817fafde28 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:35.450439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a13d598c-f249-43f7-9541-3c817fafde28 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:35.451059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a13d598c-f249-43f7-9541-3c817fafde28 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:35.452320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a13d598c-f249-43f7-9541-3c817fafde28 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:35.467272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a13d598c-f249-43f7-9541-3c817fafde28 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:35.467272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a13d598c-f249-43f7-9541-3c817fafde28 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:35.601770 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bd85008e-1f05-4d4d-a76e-2938b0d107d5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.364156 Oct 04 21:43:35.606858 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3133/6245] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:43:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:43:35.628070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8ec814fb-4c87-49a0-8649-1c4074ede02c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:35.628705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8ec814fb-4c87-49a0-8649-1c4074ede02c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:35.764416 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8ec814fb-4c87-49a0-8649-1c4074ede02c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:35.766093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a13d598c-f249-43f7-9541-3c817fafde28 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:35.779171 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a13d598c-f249-43f7-9541-3c817fafde28 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1187 microversion: 2.1 time: 0.359442 Oct 04 21:43:35.779790 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3113/6246] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:35 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1187 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:43:35.782629 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8ec814fb-4c87-49a0-8649-1c4074ede02c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 200 len: 1219 microversion: 2.1 time: 0.158436 Oct 04 21:43:35.786611 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3134/6247] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:35 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 1219 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:36.819689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-729b56cf-9f10-4259-afe3-da6810756364 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:36.823847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f4a2d21c-d931-4a61-a119-3a173c5cabf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:36.825438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-729b56cf-9f10-4259-afe3-da6810756364 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:36.827189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f4a2d21c-d931-4a61-a119-3a173c5cabf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:36.871933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f4a2d21c-d931-4a61-a119-3a173c5cabf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:36.871933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f4a2d21c-d931-4a61-a119-3a173c5cabf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:36.871933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f4a2d21c-d931-4a61-a119-3a173c5cabf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:36.871933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f4a2d21c-d931-4a61-a119-3a173c5cabf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:36.871933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f4a2d21c-d931-4a61-a119-3a173c5cabf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:36.871933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f4a2d21c-d931-4a61-a119-3a173c5cabf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:37.030159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-729b56cf-9f10-4259-afe3-da6810756364 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:37.034754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f4a2d21c-d931-4a61-a119-3a173c5cabf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:37.044366 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f4a2d21c-d931-4a61-a119-3a173c5cabf3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1187 microversion: 2.1 time: 0.239886 Oct 04 21:43:37.056602 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-729b56cf-9f10-4259-afe3-da6810756364 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 200 len: 1219 microversion: 2.1 time: 0.243311 Oct 04 21:43:37.056602 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3135/6248] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:36 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 1219 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:37.056792 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3114/6249] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:36 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1187 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:38.076777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1deb4113-3d03-4d79-b64f-8486b2c3e1d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:38.077442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1deb4113-3d03-4d79-b64f-8486b2c3e1d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:38.089759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-751d8622-9542-42c4-b60a-704f3ff5edb1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:38.092121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-751d8622-9542-42c4-b60a-704f3ff5edb1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:38.092326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1deb4113-3d03-4d79-b64f-8486b2c3e1d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:38.092326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1deb4113-3d03-4d79-b64f-8486b2c3e1d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:38.092558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1deb4113-3d03-4d79-b64f-8486b2c3e1d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:38.093767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1deb4113-3d03-4d79-b64f-8486b2c3e1d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:38.093767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1deb4113-3d03-4d79-b64f-8486b2c3e1d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:38.094207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1deb4113-3d03-4d79-b64f-8486b2c3e1d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:38.105843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-751d8622-9542-42c4-b60a-704f3ff5edb1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:38.106342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-751d8622-9542-42c4-b60a-704f3ff5edb1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:38.113076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-751d8622-9542-42c4-b60a-704f3ff5edb1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:38.114649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-751d8622-9542-42c4-b60a-704f3ff5edb1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:38.116257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-751d8622-9542-42c4-b60a-704f3ff5edb1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:38.117296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-751d8622-9542-42c4-b60a-704f3ff5edb1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:38.213070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1deb4113-3d03-4d79-b64f-8486b2c3e1d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:38.213804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1deb4113-3d03-4d79-b64f-8486b2c3e1d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:38.214415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1deb4113-3d03-4d79-b64f-8486b2c3e1d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:38.215027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-1deb4113-3d03-4d79-b64f-8486b2c3e1d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lazy-loading 'fault' on Instance uuid fbee10f0-c5f2-437b-95d8-b9a8e379b167 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:43:38.887462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-751d8622-9542-42c4-b60a-704f3ff5edb1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:38.908038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1deb4113-3d03-4d79-b64f-8486b2c3e1d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:38.917268 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1deb4113-3d03-4d79-b64f-8486b2c3e1d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 200 len: 1192 microversion: 2.1 time: 0.844985 Oct 04 21:43:38.924134 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3136/6250] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:38 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 1192 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:38.938803 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-751d8622-9542-42c4-b60a-704f3ff5edb1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 200 len: 1271 microversion: 2.1 time: 0.830626 Oct 04 21:43:38.942909 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3115/6251] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:38 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 1271 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:39.944955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8ba65a67-69fd-421f-a5c8-ca1826363e2e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:39.945615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8ba65a67-69fd-421f-a5c8-ca1826363e2e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:39.952932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ba65a67-69fd-421f-a5c8-ca1826363e2e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:39.953304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ba65a67-69fd-421f-a5c8-ca1826363e2e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:39.953774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ba65a67-69fd-421f-a5c8-ca1826363e2e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:39.954486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ba65a67-69fd-421f-a5c8-ca1826363e2e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:39.954949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ba65a67-69fd-421f-a5c8-ca1826363e2e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:39.955420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8ba65a67-69fd-421f-a5c8-ca1826363e2e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:39.976422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-adcddbda-a1c4-4052-bd02-989a5cd723de tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:39.977095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-adcddbda-a1c4-4052-bd02-989a5cd723de tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:39.990772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adcddbda-a1c4-4052-bd02-989a5cd723de tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:39.991444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adcddbda-a1c4-4052-bd02-989a5cd723de tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:39.992380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adcddbda-a1c4-4052-bd02-989a5cd723de tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:39.993151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adcddbda-a1c4-4052-bd02-989a5cd723de tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:39.993819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adcddbda-a1c4-4052-bd02-989a5cd723de tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:39.994410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adcddbda-a1c4-4052-bd02-989a5cd723de tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:39.995603 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-8ba65a67-69fd-421f-a5c8-ca1826363e2e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] HTTP exception thrown: Instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 could not be found. Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8ba65a67-69fd-421f-a5c8-ca1826363e2e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Request method failure captured: Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 HTTP/1.1 Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKgKHoOaT8uqO1KoOPn24xM7P0ylwdbLFlP7NxtckxX5YVgkQXQgvdk_pv_DRrXpTR_A9RTrhRjboZG7XPsaIwCmuey_7FqshLEW4wp7-ccvS6GHij-f3j-K3O_9tzU_63L01blifBD1TcCBZnKNp1OdTYkzGEDdJ0DY_B_XNHTjspY Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68208d23fd2f40479ba279566a819933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68208d23fd2f40479ba279566a819933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}] Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 15748f41da9f49fca3e7eec1fda3b245 Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 could not be found. Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'fbee10f0-c5f2-437b-95d8-b9a8e379b167'} Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 could not be found. Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 could not be found. Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:39.999499 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:43:40.003956 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:40.003956 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:40.003956 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:40.003956 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:43:40.003956 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:43:40.003956 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 could not be found. Oct 04 21:43:40.003956 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:43:40.003956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8ba65a67-69fd-421f-a5c8-ca1826363e2e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Returning 404 to user: Instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:40.003956 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8ba65a67-69fd-421f-a5c8-ca1826363e2e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 404 len: 111 microversion: 2.1 time: 0.060685 Oct 04 21:43:40.009779 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3137/6252] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:39 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:40.148150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-adcddbda-a1c4-4052-bd02-989a5cd723de tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:40.159355 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-adcddbda-a1c4-4052-bd02-989a5cd723de tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 200 len: 1277 microversion: 2.1 time: 0.187088 Oct 04 21:43:40.160447 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3116/6253] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:39 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:41.195540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4d26af98-247a-4924-8918-4c9c131f9e18 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:41.195540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4d26af98-247a-4924-8918-4c9c131f9e18 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:41.211795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d26af98-247a-4924-8918-4c9c131f9e18 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:41.215154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d26af98-247a-4924-8918-4c9c131f9e18 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:41.216090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d26af98-247a-4924-8918-4c9c131f9e18 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:41.217909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d26af98-247a-4924-8918-4c9c131f9e18 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:41.223509 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d26af98-247a-4924-8918-4c9c131f9e18 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:41.223509 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d26af98-247a-4924-8918-4c9c131f9e18 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:41.681300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4d26af98-247a-4924-8918-4c9c131f9e18 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:41.691065 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4d26af98-247a-4924-8918-4c9c131f9e18 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.503756 Oct 04 21:43:41.692693 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3138/6254] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:41 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 1319 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:42.240098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-15e51a2a-0dff-459b-b348-7ae5a07185ea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:42.241274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-15e51a2a-0dff-459b-b348-7ae5a07185ea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:42.251547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15e51a2a-0dff-459b-b348-7ae5a07185ea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:42.252146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15e51a2a-0dff-459b-b348-7ae5a07185ea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:42.253100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15e51a2a-0dff-459b-b348-7ae5a07185ea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:42.255037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15e51a2a-0dff-459b-b348-7ae5a07185ea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:42.256696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15e51a2a-0dff-459b-b348-7ae5a07185ea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:42.260109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15e51a2a-0dff-459b-b348-7ae5a07185ea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:42.297128 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-15e51a2a-0dff-459b-b348-7ae5a07185ea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] HTTP exception thrown: Instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 could not be found. Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-15e51a2a-0dff-459b-b348-7ae5a07185ea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Request method failure captured: Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 HTTP/1.1 Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKgKHoOaT8uqO1KoOPn24xM7P0ylwdbLFlP7NxtckxX5YVgkQXQgvdk_pv_DRrXpTR_A9RTrhRjboZG7XPsaIwCmuey_7FqshLEW4wp7-ccvS6GHij-f3j-K3O_9tzU_63L01blifBD1TcCBZnKNp1OdTYkzGEDdJ0DY_B_XNHTjspY Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68208d23fd2f40479ba279566a819933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68208d23fd2f40479ba279566a819933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}] Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 15748f41da9f49fca3e7eec1fda3b245 Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 could not be found. Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'fbee10f0-c5f2-437b-95d8-b9a8e379b167'} Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 could not be found. Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:43:42.299253 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:43:42.303554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 could not be found. Oct 04 21:43:42.303554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:43:42.303554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:42.303554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:43:42.303554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:42.303554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:42.303554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:42.303554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:43:42.303554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:43:42.303554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 could not be found. Oct 04 21:43:42.303554 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:43:42.303554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-15e51a2a-0dff-459b-b348-7ae5a07185ea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Returning 404 to user: Instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:42.303554 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-15e51a2a-0dff-459b-b348-7ae5a07185ea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 404 len: 111 microversion: 2.1 time: 0.065892 Oct 04 21:43:42.311904 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3117/6255] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:43:42 2022] DELETE /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:42.312082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aaf4b832-b253-4746-bd24-e9601eb9b846 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:42.312082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-aaf4b832-b253-4746-bd24-e9601eb9b846 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: fbee10f0-c5f2-437b-95d8-b9a8e379b167] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:42.322837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aaf4b832-b253-4746-bd24-e9601eb9b846 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:42.323342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aaf4b832-b253-4746-bd24-e9601eb9b846 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:42.323787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aaf4b832-b253-4746-bd24-e9601eb9b846 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:42.324511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aaf4b832-b253-4746-bd24-e9601eb9b846 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:42.324975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aaf4b832-b253-4746-bd24-e9601eb9b846 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:42.325410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aaf4b832-b253-4746-bd24-e9601eb9b846 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:42.344307 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-aaf4b832-b253-4746-bd24-e9601eb9b846 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] HTTP exception thrown: Instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 could not be found. Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aaf4b832-b253-4746-bd24-e9601eb9b846 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Request method failure captured: Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 HTTP/1.1 Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKgKHoOaT8uqO1KoOPn24xM7P0ylwdbLFlP7NxtckxX5YVgkQXQgvdk_pv_DRrXpTR_A9RTrhRjboZG7XPsaIwCmuey_7FqshLEW4wp7-ccvS6GHij-f3j-K3O_9tzU_63L01blifBD1TcCBZnKNp1OdTYkzGEDdJ0DY_B_XNHTjspY Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68208d23fd2f40479ba279566a819933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68208d23fd2f40479ba279566a819933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}] Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 15748f41da9f49fca3e7eec1fda3b245 Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 could not be found. Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'fbee10f0-c5f2-437b-95d8-b9a8e379b167'} Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 could not be found. Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 could not be found. Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:43:42.345955 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:43:42.350306 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:43:42.350306 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:43:42.350306 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:43:42.350306 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:43:42.350306 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:43:42.350306 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 could not be found. Oct 04 21:43:42.350306 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:43:42.350306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aaf4b832-b253-4746-bd24-e9601eb9b846 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Returning 404 to user: Instance fbee10f0-c5f2-437b-95d8-b9a8e379b167 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:43:42.358297 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-aaf4b832-b253-4746-bd24-e9601eb9b846 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167" status: 404 len: 111 microversion: 2.1 time: 0.052288 Oct 04 21:43:42.359301 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3139/6256] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:42 2022] GET /compute/v2.1/servers/fbee10f0-c5f2-437b-95d8-b9a8e379b167 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:43:42.717160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-42b1ba62-5821-4f2b-936d-8bcd5c3e27c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:42.718750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-42b1ba62-5821-4f2b-936d-8bcd5c3e27c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:42.731637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42b1ba62-5821-4f2b-936d-8bcd5c3e27c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:42.737415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42b1ba62-5821-4f2b-936d-8bcd5c3e27c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:42.740454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42b1ba62-5821-4f2b-936d-8bcd5c3e27c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:42.743690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42b1ba62-5821-4f2b-936d-8bcd5c3e27c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:42.747567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42b1ba62-5821-4f2b-936d-8bcd5c3e27c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:42.749301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42b1ba62-5821-4f2b-936d-8bcd5c3e27c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:43.174685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-42b1ba62-5821-4f2b-936d-8bcd5c3e27c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:43.195113 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-42b1ba62-5821-4f2b-936d-8bcd5c3e27c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.482825 Oct 04 21:43:43.198994 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3118/6257] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:42 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 1319 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:44.101319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-a520ee59-6be0-46bd-b3d4-2ca8eabf2989 req-6911c1c0-af9d-4512-85d2-45e65fd03964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e17627c-075e-497f-9819-311e6a44c3e8", "tag": "30801044-4e0f-4373-835a-41d4754c6e5b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:44.131814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a520ee59-6be0-46bd-b3d4-2ca8eabf2989 req-6911c1c0-af9d-4512-85d2-45e65fd03964 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:44.133778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a520ee59-6be0-46bd-b3d4-2ca8eabf2989 req-6911c1c0-af9d-4512-85d2-45e65fd03964 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:44.137363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a520ee59-6be0-46bd-b3d4-2ca8eabf2989 req-6911c1c0-af9d-4512-85d2-45e65fd03964 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:44.158495 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-a520ee59-6be0-46bd-b3d4-2ca8eabf2989 req-6911c1c0-af9d-4512-85d2-45e65fd03964 service nova] Creating event network-changed:30801044-4e0f-4373-835a-41d4754c6e5b for instance 2e17627c-075e-497f-9819-311e6a44c3e8 on n-h2-860282-1 Oct 04 21:43:44.174037 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-a520ee59-6be0-46bd-b3d4-2ca8eabf2989 req-6911c1c0-af9d-4512-85d2-45e65fd03964 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.428375 Oct 04 21:43:44.177807 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3140/6258] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:44.234453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e4e4c5bf-e617-4d89-9d7d-c364db8449d1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:44.235871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e4e4c5bf-e617-4d89-9d7d-c364db8449d1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:44.254726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4e4c5bf-e617-4d89-9d7d-c364db8449d1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:44.255535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4e4c5bf-e617-4d89-9d7d-c364db8449d1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:44.256171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4e4c5bf-e617-4d89-9d7d-c364db8449d1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:44.257274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4e4c5bf-e617-4d89-9d7d-c364db8449d1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:44.257711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4e4c5bf-e617-4d89-9d7d-c364db8449d1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:44.258151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4e4c5bf-e617-4d89-9d7d-c364db8449d1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:45.109411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e4e4c5bf-e617-4d89-9d7d-c364db8449d1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:45.121971 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e4e4c5bf-e617-4d89-9d7d-c364db8449d1 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.895468 Oct 04 21:43:45.135318 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3119/6259] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:44 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 1319 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:46.144341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:46.149216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-63166749-2262-4919-b578-57dd726a6122 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:46.149953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-63166749-2262-4919-b578-57dd726a6122 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:46.162138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63166749-2262-4919-b578-57dd726a6122 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:46.164481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63166749-2262-4919-b578-57dd726a6122 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:46.165095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63166749-2262-4919-b578-57dd726a6122 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:46.166216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63166749-2262-4919-b578-57dd726a6122 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:46.170278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63166749-2262-4919-b578-57dd726a6122 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:46.170982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63166749-2262-4919-b578-57dd726a6122 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:46.552965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-63166749-2262-4919-b578-57dd726a6122 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:46.579310 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-63166749-2262-4919-b578-57dd726a6122 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.436605 Oct 04 21:43:46.596909 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3141/6260] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:46 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 1319 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:47.605037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-00e86eef-a54b-4722-a0c7-53b1a2a191c9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:47.606562 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-00e86eef-a54b-4722-a0c7-53b1a2a191c9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:47.625777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00e86eef-a54b-4722-a0c7-53b1a2a191c9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:47.626559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00e86eef-a54b-4722-a0c7-53b1a2a191c9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:47.630238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00e86eef-a54b-4722-a0c7-53b1a2a191c9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:47.631259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00e86eef-a54b-4722-a0c7-53b1a2a191c9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:47.631965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00e86eef-a54b-4722-a0c7-53b1a2a191c9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:47.632618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00e86eef-a54b-4722-a0c7-53b1a2a191c9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:47.975849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-00e86eef-a54b-4722-a0c7-53b1a2a191c9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:47.990565 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-00e86eef-a54b-4722-a0c7-53b1a2a191c9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.387908 Oct 04 21:43:47.994431 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3120/6261] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:47 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 1319 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:49.021789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3fbe9823-7b24-48e6-a764-6db7c183030c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:49.022422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3fbe9823-7b24-48e6-a764-6db7c183030c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:49.025155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=10 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:49.039302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fbe9823-7b24-48e6-a764-6db7c183030c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:49.040068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fbe9823-7b24-48e6-a764-6db7c183030c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:49.040760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fbe9823-7b24-48e6-a764-6db7c183030c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:49.041892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fbe9823-7b24-48e6-a764-6db7c183030c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:49.042590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fbe9823-7b24-48e6-a764-6db7c183030c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:49.043036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3fbe9823-7b24-48e6-a764-6db7c183030c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:49.282390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3fbe9823-7b24-48e6-a764-6db7c183030c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:49.291349 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3fbe9823-7b24-48e6-a764-6db7c183030c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.274847 Oct 04 21:43:49.292749 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3142/6262] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:49 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:50.319257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ed7fbed6-e847-4b49-a971-54ad26ca5e05 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:50.319257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ed7fbed6-e847-4b49-a971-54ad26ca5e05 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:50.335385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed7fbed6-e847-4b49-a971-54ad26ca5e05 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:50.339499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed7fbed6-e847-4b49-a971-54ad26ca5e05 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:50.340242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed7fbed6-e847-4b49-a971-54ad26ca5e05 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:50.341365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed7fbed6-e847-4b49-a971-54ad26ca5e05 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:50.341803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed7fbed6-e847-4b49-a971-54ad26ca5e05 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:50.345572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ed7fbed6-e847-4b49-a971-54ad26ca5e05 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:50.746567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ed7fbed6-e847-4b49-a971-54ad26ca5e05 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:50.789829 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ed7fbed6-e847-4b49-a971-54ad26ca5e05 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.477678 Oct 04 21:43:50.793355 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3121/6263] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:50 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 1319 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:51.817072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-26a33316-a0e3-4690-bd05-7cc0ec9f31c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:51.817865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-26a33316-a0e3-4690-bd05-7cc0ec9f31c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:51.829332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26a33316-a0e3-4690-bd05-7cc0ec9f31c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:51.830226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26a33316-a0e3-4690-bd05-7cc0ec9f31c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:51.834002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26a33316-a0e3-4690-bd05-7cc0ec9f31c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:51.834789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26a33316-a0e3-4690-bd05-7cc0ec9f31c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:51.835273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26a33316-a0e3-4690-bd05-7cc0ec9f31c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:51.835716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26a33316-a0e3-4690-bd05-7cc0ec9f31c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:52.243708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-26a33316-a0e3-4690-bd05-7cc0ec9f31c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:52.259762 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-26a33316-a0e3-4690-bd05-7cc0ec9f31c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.448512 Oct 04 21:43:52.263845 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3143/6264] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:51 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:53.278570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-73961dfa-1f7d-4737-b332-b178ef428647 req-5378a8cf-6ffb-4441-b874-4b26b8f8c847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e17627c-075e-497f-9819-311e6a44c3e8", "name": "network-vif-plugged", "status": "completed", "tag": "30801044-4e0f-4373-835a-41d4754c6e5b"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:53.291337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-34e03457-0c0d-4490-8788-b47ab2e79ac7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:53.292962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-34e03457-0c0d-4490-8788-b47ab2e79ac7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:53.305222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-73961dfa-1f7d-4737-b332-b178ef428647 req-5378a8cf-6ffb-4441-b874-4b26b8f8c847 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:53.305222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-73961dfa-1f7d-4737-b332-b178ef428647 req-5378a8cf-6ffb-4441-b874-4b26b8f8c847 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:53.309702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-73961dfa-1f7d-4737-b332-b178ef428647 req-5378a8cf-6ffb-4441-b874-4b26b8f8c847 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:53.311458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34e03457-0c0d-4490-8788-b47ab2e79ac7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:53.313765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34e03457-0c0d-4490-8788-b47ab2e79ac7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:53.314304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34e03457-0c0d-4490-8788-b47ab2e79ac7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:53.317084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34e03457-0c0d-4490-8788-b47ab2e79ac7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:53.318846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34e03457-0c0d-4490-8788-b47ab2e79ac7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:53.322430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34e03457-0c0d-4490-8788-b47ab2e79ac7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:53.339481 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-73961dfa-1f7d-4737-b332-b178ef428647 req-5378a8cf-6ffb-4441-b874-4b26b8f8c847 service nova] Creating event network-vif-plugged:30801044-4e0f-4373-835a-41d4754c6e5b for instance 2e17627c-075e-497f-9819-311e6a44c3e8 on n-h2-860282-1 Oct 04 21:43:53.371836 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-73961dfa-1f7d-4737-b332-b178ef428647 req-5378a8cf-6ffb-4441-b874-4b26b8f8c847 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100560 Oct 04 21:43:53.372667 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3122/6265] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:54.303302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-34e03457-0c0d-4490-8788-b47ab2e79ac7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:54.310787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:54.353599 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-34e03457-0c0d-4490-8788-b47ab2e79ac7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 200 len: 1319 microversion: 2.1 time: 1.061642 Oct 04 21:43:54.355454 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3144/6266] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:53 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 1319 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:55.385077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-72946414-f8fd-4c30-af6c-16f636ed3f86 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:55.399271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-72946414-f8fd-4c30-af6c-16f636ed3f86 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:55.437946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-72946414-f8fd-4c30-af6c-16f636ed3f86 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:55.438803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-72946414-f8fd-4c30-af6c-16f636ed3f86 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:55.443050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-72946414-f8fd-4c30-af6c-16f636ed3f86 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:55.443942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-72946414-f8fd-4c30-af6c-16f636ed3f86 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:55.444502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-72946414-f8fd-4c30-af6c-16f636ed3f86 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:55.445022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-72946414-f8fd-4c30-af6c-16f636ed3f86 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:55.484258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=93 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:55.786084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-72946414-f8fd-4c30-af6c-16f636ed3f86 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:55.796495 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-72946414-f8fd-4c30-af6c-16f636ed3f86 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.417695 Oct 04 21:43:55.813249 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3123/6267] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:55 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 1319 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:56.822736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-46d8eed4-2d58-490e-bb98-495c4eec30f7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:56.823547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-46d8eed4-2d58-490e-bb98-495c4eec30f7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:56.837713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46d8eed4-2d58-490e-bb98-495c4eec30f7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:56.838544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46d8eed4-2d58-490e-bb98-495c4eec30f7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:56.841586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46d8eed4-2d58-490e-bb98-495c4eec30f7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:56.844225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46d8eed4-2d58-490e-bb98-495c4eec30f7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:56.844675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46d8eed4-2d58-490e-bb98-495c4eec30f7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:56.845184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-46d8eed4-2d58-490e-bb98-495c4eec30f7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:57.108592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-46d8eed4-2d58-490e-bb98-495c4eec30f7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:57.124707 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-46d8eed4-2d58-490e-bb98-495c4eec30f7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 200 len: 1509 microversion: 2.1 time: 0.308244 Oct 04 21:43:57.126894 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3145/6268] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:56 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 1509 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:44:16.176526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=35 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:16.178287 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:44:16.178425 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 21:44:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Oct 04 21:44:16.419148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-82b5a0c0-65da-4946-9152-5aebe8ff6317 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1795057758", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "fe7e66f8-f183-4712-a7d3-26f51c70ce2a"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:19.584940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-82b5a0c0-65da-4946-9152-5aebe8ff6317 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] validate_networks() for [('fe7e66f8-f183-4712-a7d3-26f51c70ce2a', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:44:20.949292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-82b5a0c0-65da-4946-9152-5aebe8ff6317 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:44:20.950494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-82b5a0c0-65da-4946-9152-5aebe8ff6317 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:44:20.951134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-82b5a0c0-65da-4946-9152-5aebe8ff6317 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:44:20.951805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-82b5a0c0-65da-4946-9152-5aebe8ff6317 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:44:20.952377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-82b5a0c0-65da-4946-9152-5aebe8ff6317 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:44:20.964184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82b5a0c0-65da-4946-9152-5aebe8ff6317 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:20.965056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82b5a0c0-65da-4946-9152-5aebe8ff6317 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:20.965530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82b5a0c0-65da-4946-9152-5aebe8ff6317 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:20.966639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82b5a0c0-65da-4946-9152-5aebe8ff6317 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:20.967107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82b5a0c0-65da-4946-9152-5aebe8ff6317 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:20.967534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82b5a0c0-65da-4946-9152-5aebe8ff6317 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:20.988394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-82b5a0c0-65da-4946-9152-5aebe8ff6317 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Getting quotas for project 5229b6aecaeb4989aed73aab7c8eb3e7. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:20.994904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-82b5a0c0-65da-4946-9152-5aebe8ff6317 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Getting quotas for user 2b179faa3d2741f1b65e32b3da6ebaa4 and project 5229b6aecaeb4989aed73aab7c8eb3e7. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:21.010476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-82b5a0c0-65da-4946-9152-5aebe8ff6317 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:44:21.013163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-82b5a0c0-65da-4946-9152-5aebe8ff6317 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:44:21.184454 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-82b5a0c0-65da-4946-9152-5aebe8ff6317 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.012805 Oct 04 21:44:21.185630 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3124/6269] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:44:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 5015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:44:21.202080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-389678d4-9264-47d6-b38a-1f08073de968 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:21.211345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-389678d4-9264-47d6-b38a-1f08073de968 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:21.211345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:21.211345 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:44:21.211345 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 21:44:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf (ip 10.222.0.30) !!! Oct 04 21:44:21.705110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-389678d4-9264-47d6-b38a-1f08073de968 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b179faa3d2741f1b65e32b3da6ebaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5229b6aecaeb4989aed73aab7c8eb3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:21.713169 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-389678d4-9264-47d6-b38a-1f08073de968 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf" status: 200 len: 1214 microversion: 2.1 time: 0.518911 Oct 04 21:44:21.716787 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3146/6270] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:21 2022] GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf => generated 1214 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:22.739223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8e9be18d-60a3-4ea6-bb70-cc89b176acac tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:22.741572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8e9be18d-60a3-4ea6-bb70-cc89b176acac tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:22.869709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8e9be18d-60a3-4ea6-bb70-cc89b176acac tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b179faa3d2741f1b65e32b3da6ebaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5229b6aecaeb4989aed73aab7c8eb3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:22.894403 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8e9be18d-60a3-4ea6-bb70-cc89b176acac tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf" status: 200 len: 1214 microversion: 2.1 time: 0.160750 Oct 04 21:44:22.898903 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3125/6271] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:22 2022] GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:23.921838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c70674c8-54db-47b9-b7d4-77c2886ce339 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:23.922466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c70674c8-54db-47b9-b7d4-77c2886ce339 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:23.932622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c70674c8-54db-47b9-b7d4-77c2886ce339 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:23.933227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c70674c8-54db-47b9-b7d4-77c2886ce339 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:23.938808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c70674c8-54db-47b9-b7d4-77c2886ce339 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:23.938808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c70674c8-54db-47b9-b7d4-77c2886ce339 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:23.938808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c70674c8-54db-47b9-b7d4-77c2886ce339 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:23.938808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c70674c8-54db-47b9-b7d4-77c2886ce339 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:24.056831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c70674c8-54db-47b9-b7d4-77c2886ce339 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b179faa3d2741f1b65e32b3da6ebaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5229b6aecaeb4989aed73aab7c8eb3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:24.066236 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c70674c8-54db-47b9-b7d4-77c2886ce339 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf" status: 200 len: 1266 microversion: 2.1 time: 0.148535 Oct 04 21:44:24.068673 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3147/6272] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:23 2022] GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:25.102123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-79201a8b-3b20-4cde-979f-ba0e87494895 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:25.107857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-79201a8b-3b20-4cde-979f-ba0e87494895 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:25.127833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79201a8b-3b20-4cde-979f-ba0e87494895 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:25.135729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79201a8b-3b20-4cde-979f-ba0e87494895 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:25.136778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79201a8b-3b20-4cde-979f-ba0e87494895 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:25.138053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79201a8b-3b20-4cde-979f-ba0e87494895 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:25.141648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79201a8b-3b20-4cde-979f-ba0e87494895 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:25.142317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79201a8b-3b20-4cde-979f-ba0e87494895 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:25.355259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-79201a8b-3b20-4cde-979f-ba0e87494895 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b179faa3d2741f1b65e32b3da6ebaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5229b6aecaeb4989aed73aab7c8eb3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:25.368744 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-79201a8b-3b20-4cde-979f-ba0e87494895 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf" status: 200 len: 1272 microversion: 2.1 time: 0.279455 Oct 04 21:44:25.371210 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3126/6273] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:25 2022] GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf => generated 1272 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:26.399168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b542dfc6-58db-43a9-98f4-a861aedafddd tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:26.399883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b542dfc6-58db-43a9-98f4-a861aedafddd tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:26.412589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b542dfc6-58db-43a9-98f4-a861aedafddd tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:26.413495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b542dfc6-58db-43a9-98f4-a861aedafddd tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:26.414147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b542dfc6-58db-43a9-98f4-a861aedafddd tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:26.415086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b542dfc6-58db-43a9-98f4-a861aedafddd tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:26.415796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b542dfc6-58db-43a9-98f4-a861aedafddd tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:26.416817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b542dfc6-58db-43a9-98f4-a861aedafddd tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:26.516698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b542dfc6-58db-43a9-98f4-a861aedafddd tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b179faa3d2741f1b65e32b3da6ebaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5229b6aecaeb4989aed73aab7c8eb3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:26.556592 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b542dfc6-58db-43a9-98f4-a861aedafddd tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf" status: 200 len: 1272 microversion: 2.1 time: 0.164624 Oct 04 21:44:26.573700 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3148/6274] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:26 2022] GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf => generated 1272 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:27.592572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ad0ac685-2a05-4e1c-9450-4c633caf8a5a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:27.600671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ad0ac685-2a05-4e1c-9450-4c633caf8a5a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:27.611452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad0ac685-2a05-4e1c-9450-4c633caf8a5a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:27.612410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad0ac685-2a05-4e1c-9450-4c633caf8a5a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:27.613210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad0ac685-2a05-4e1c-9450-4c633caf8a5a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:27.616962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad0ac685-2a05-4e1c-9450-4c633caf8a5a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:27.618135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad0ac685-2a05-4e1c-9450-4c633caf8a5a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:27.619497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad0ac685-2a05-4e1c-9450-4c633caf8a5a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:28.066317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ad0ac685-2a05-4e1c-9450-4c633caf8a5a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b179faa3d2741f1b65e32b3da6ebaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5229b6aecaeb4989aed73aab7c8eb3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:28.079241 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ad0ac685-2a05-4e1c-9450-4c633caf8a5a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf" status: 200 len: 1314 microversion: 2.1 time: 0.491849 Oct 04 21:44:28.080416 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3127/6275] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:27 2022] GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:29.113257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-066ead7a-e0c3-46fa-8547-724a0d678e0b tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:29.114143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-066ead7a-e0c3-46fa-8547-724a0d678e0b tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:29.127962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-066ead7a-e0c3-46fa-8547-724a0d678e0b tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:29.130609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-066ead7a-e0c3-46fa-8547-724a0d678e0b tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:29.131379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-066ead7a-e0c3-46fa-8547-724a0d678e0b tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:29.132443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-066ead7a-e0c3-46fa-8547-724a0d678e0b tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:29.136539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-066ead7a-e0c3-46fa-8547-724a0d678e0b tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:29.136539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-066ead7a-e0c3-46fa-8547-724a0d678e0b tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:29.399122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-54d8d6e6-810a-481b-aa47-8c97a3326605 req-e6ddcdd1-b4a7-401b-8fa2-0b03d87a4ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19f7db9a-7eba-4c50-84fa-e9a1459be4cf", "tag": "53c05577-6bce-4bab-b485-90ce8cc47124"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:29.405998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-066ead7a-e0c3-46fa-8547-724a0d678e0b tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b179faa3d2741f1b65e32b3da6ebaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5229b6aecaeb4989aed73aab7c8eb3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:29.420077 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-066ead7a-e0c3-46fa-8547-724a0d678e0b tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf" status: 200 len: 1314 microversion: 2.1 time: 0.312760 Oct 04 21:44:29.423323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-54d8d6e6-810a-481b-aa47-8c97a3326605 req-e6ddcdd1-b4a7-401b-8fa2-0b03d87a4ca7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:29.423928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-54d8d6e6-810a-481b-aa47-8c97a3326605 req-e6ddcdd1-b4a7-401b-8fa2-0b03d87a4ca7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:29.424497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-54d8d6e6-810a-481b-aa47-8c97a3326605 req-e6ddcdd1-b4a7-401b-8fa2-0b03d87a4ca7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:29.443947 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3149/6276] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:29 2022] GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:29.454003 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-54d8d6e6-810a-481b-aa47-8c97a3326605 req-e6ddcdd1-b4a7-401b-8fa2-0b03d87a4ca7 service nova] Creating event network-changed:53c05577-6bce-4bab-b485-90ce8cc47124 for instance 19f7db9a-7eba-4c50-84fa-e9a1459be4cf on n-h1-860282-1 Oct 04 21:44:29.468722 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-54d8d6e6-810a-481b-aa47-8c97a3326605 req-e6ddcdd1-b4a7-401b-8fa2-0b03d87a4ca7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072268 Oct 04 21:44:29.469603 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3128/6277] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:44:30.453895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ea6be20d-c88a-4b93-a171-7fc282b12a35 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:30.455836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ea6be20d-c88a-4b93-a171-7fc282b12a35 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:30.470371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea6be20d-c88a-4b93-a171-7fc282b12a35 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:30.471226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea6be20d-c88a-4b93-a171-7fc282b12a35 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:30.476636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea6be20d-c88a-4b93-a171-7fc282b12a35 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:30.476636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea6be20d-c88a-4b93-a171-7fc282b12a35 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:30.476636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea6be20d-c88a-4b93-a171-7fc282b12a35 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:30.476636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea6be20d-c88a-4b93-a171-7fc282b12a35 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:31.232455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ea6be20d-c88a-4b93-a171-7fc282b12a35 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b179faa3d2741f1b65e32b3da6ebaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5229b6aecaeb4989aed73aab7c8eb3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:31.252353 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ea6be20d-c88a-4b93-a171-7fc282b12a35 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf" status: 200 len: 1314 microversion: 2.1 time: 0.797176 Oct 04 21:44:31.253480 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3150/6278] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:30 2022] GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf => generated 1314 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:32.279016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:32.281353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f9e8bcbe-c914-42d2-a953-00bff85a6c24 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:32.282745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f9e8bcbe-c914-42d2-a953-00bff85a6c24 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:32.300489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9e8bcbe-c914-42d2-a953-00bff85a6c24 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.301060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9e8bcbe-c914-42d2-a953-00bff85a6c24 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.304451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9e8bcbe-c914-42d2-a953-00bff85a6c24 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.305504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9e8bcbe-c914-42d2-a953-00bff85a6c24 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.306439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9e8bcbe-c914-42d2-a953-00bff85a6c24 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.307011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9e8bcbe-c914-42d2-a953-00bff85a6c24 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.795478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f9e8bcbe-c914-42d2-a953-00bff85a6c24 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b179faa3d2741f1b65e32b3da6ebaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5229b6aecaeb4989aed73aab7c8eb3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:32.814393 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f9e8bcbe-c914-42d2-a953-00bff85a6c24 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf" status: 200 len: 1314 microversion: 2.1 time: 0.534427 Oct 04 21:44:32.816664 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3129/6279] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:32 2022] GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:33.846109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0e83bae6-2d40-4bcc-821d-526806377690 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:33.849052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0e83bae6-2d40-4bcc-821d-526806377690 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:33.864262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:33.867268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e83bae6-2d40-4bcc-821d-526806377690 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:33.868731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e83bae6-2d40-4bcc-821d-526806377690 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:33.869607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e83bae6-2d40-4bcc-821d-526806377690 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:33.870365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e83bae6-2d40-4bcc-821d-526806377690 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:33.870858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e83bae6-2d40-4bcc-821d-526806377690 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:33.871275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0e83bae6-2d40-4bcc-821d-526806377690 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:34.362923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0e83bae6-2d40-4bcc-821d-526806377690 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b179faa3d2741f1b65e32b3da6ebaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5229b6aecaeb4989aed73aab7c8eb3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:34.377782 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0e83bae6-2d40-4bcc-821d-526806377690 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf" status: 200 len: 1314 microversion: 2.1 time: 0.538115 Oct 04 21:44:34.381545 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3151/6280] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:33 2022] GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:35.404842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d0e99053-0ab2-4cd4-83e7-d44a2831565a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:35.406192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d0e99053-0ab2-4cd4-83e7-d44a2831565a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:35.408261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:35.419813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0e99053-0ab2-4cd4-83e7-d44a2831565a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:35.421253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0e99053-0ab2-4cd4-83e7-d44a2831565a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:35.422256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0e99053-0ab2-4cd4-83e7-d44a2831565a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:35.425930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0e99053-0ab2-4cd4-83e7-d44a2831565a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:35.426581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0e99053-0ab2-4cd4-83e7-d44a2831565a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:35.427229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d0e99053-0ab2-4cd4-83e7-d44a2831565a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:36.079816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d0e99053-0ab2-4cd4-83e7-d44a2831565a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b179faa3d2741f1b65e32b3da6ebaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5229b6aecaeb4989aed73aab7c8eb3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:36.093456 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d0e99053-0ab2-4cd4-83e7-d44a2831565a tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf" status: 200 len: 1314 microversion: 2.1 time: 0.692910 Oct 04 21:44:36.095004 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3130/6281] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:35 2022] GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf => generated 1314 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:36.631859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-ee3eb364-e172-40de-b972-e596a44c4f86 req-692b89a9-ba93-42e8-b0cc-10914bd635fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19f7db9a-7eba-4c50-84fa-e9a1459be4cf", "name": "network-vif-plugged", "status": "completed", "tag": "53c05577-6bce-4bab-b485-90ce8cc47124"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:36.678218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ee3eb364-e172-40de-b972-e596a44c4f86 req-692b89a9-ba93-42e8-b0cc-10914bd635fe service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:36.679185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ee3eb364-e172-40de-b972-e596a44c4f86 req-692b89a9-ba93-42e8-b0cc-10914bd635fe service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:36.680025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ee3eb364-e172-40de-b972-e596a44c4f86 req-692b89a9-ba93-42e8-b0cc-10914bd635fe service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:36.714061 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-ee3eb364-e172-40de-b972-e596a44c4f86 req-692b89a9-ba93-42e8-b0cc-10914bd635fe service nova] Creating event network-vif-plugged:53c05577-6bce-4bab-b485-90ce8cc47124 for instance 19f7db9a-7eba-4c50-84fa-e9a1459be4cf on n-h1-860282-1 Oct 04 21:44:36.756647 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-ee3eb364-e172-40de-b972-e596a44c4f86 req-692b89a9-ba93-42e8-b0cc-10914bd635fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095692 Oct 04 21:44:36.774937 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3152/6282] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:37.126807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-57ec82ec-4bb5-4139-9418-8d1be7bb90ab tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:37.128533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-57ec82ec-4bb5-4139-9418-8d1be7bb90ab tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:37.138781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57ec82ec-4bb5-4139-9418-8d1be7bb90ab tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:37.139335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57ec82ec-4bb5-4139-9418-8d1be7bb90ab tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:37.139791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57ec82ec-4bb5-4139-9418-8d1be7bb90ab tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:37.140511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57ec82ec-4bb5-4139-9418-8d1be7bb90ab tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:37.141001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57ec82ec-4bb5-4139-9418-8d1be7bb90ab tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:37.141679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57ec82ec-4bb5-4139-9418-8d1be7bb90ab tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:37.420485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8fcc524c-7b09-4692-a2b9-c3a603889d75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-311925023", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "fabbef79-f1b3-497d-a126-61991e50441c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b7f4cca9-cdc1-49bd-97e7-bd6739547eb6"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:37.422648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-57ec82ec-4bb5-4139-9418-8d1be7bb90ab tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b179faa3d2741f1b65e32b3da6ebaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5229b6aecaeb4989aed73aab7c8eb3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:37.438660 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-57ec82ec-4bb5-4139-9418-8d1be7bb90ab tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf" status: 200 len: 1314 microversion: 2.1 time: 0.320096 Oct 04 21:44:37.445484 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3131/6283] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:37 2022] GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:37.514451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-8fcc524c-7b09-4692-a2b9-c3a603889d75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] validate_networks() for [('b7f4cca9-cdc1-49bd-97e7-bd6739547eb6', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:44:38.259982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-8fcc524c-7b09-4692-a2b9-c3a603889d75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:44:38.260606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-8fcc524c-7b09-4692-a2b9-c3a603889d75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:44:38.260973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-8fcc524c-7b09-4692-a2b9-c3a603889d75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:44:38.262696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-8fcc524c-7b09-4692-a2b9-c3a603889d75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:44:38.263214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-8fcc524c-7b09-4692-a2b9-c3a603889d75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:44:38.274476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fcc524c-7b09-4692-a2b9-c3a603889d75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:38.274973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fcc524c-7b09-4692-a2b9-c3a603889d75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:38.275415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fcc524c-7b09-4692-a2b9-c3a603889d75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:38.276370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fcc524c-7b09-4692-a2b9-c3a603889d75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:38.276833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fcc524c-7b09-4692-a2b9-c3a603889d75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:38.277485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8fcc524c-7b09-4692-a2b9-c3a603889d75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:38.297649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-8fcc524c-7b09-4692-a2b9-c3a603889d75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Getting quotas for project 68208d23fd2f40479ba279566a819933. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:38.304202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-8fcc524c-7b09-4692-a2b9-c3a603889d75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Getting quotas for user 15748f41da9f49fca3e7eec1fda3b245 and project 68208d23fd2f40479ba279566a819933. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:38.370441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8fcc524c-7b09-4692-a2b9-c3a603889d75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:44:38.372943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8fcc524c-7b09-4692-a2b9-c3a603889d75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fabbef79-f1b3-497d-a126-61991e50441c',volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:44:38.488113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-54745176-260a-42da-b76d-41fc01fd7199 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:38.489968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-54745176-260a-42da-b76d-41fc01fd7199 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:38.504913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54745176-260a-42da-b76d-41fc01fd7199 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:38.507505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54745176-260a-42da-b76d-41fc01fd7199 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:38.509212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54745176-260a-42da-b76d-41fc01fd7199 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:38.510660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54745176-260a-42da-b76d-41fc01fd7199 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:38.511878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54745176-260a-42da-b76d-41fc01fd7199 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:38.512513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54745176-260a-42da-b76d-41fc01fd7199 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:38.845014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-54745176-260a-42da-b76d-41fc01fd7199 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b179faa3d2741f1b65e32b3da6ebaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5229b6aecaeb4989aed73aab7c8eb3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:38.860981 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-54745176-260a-42da-b76d-41fc01fd7199 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf" status: 200 len: 1498 microversion: 2.1 time: 0.400232 Oct 04 21:44:38.861825 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3132/6284] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:38 2022] GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf => generated 1498 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:44:39.004413 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8fcc524c-7b09-4692-a2b9-c3a603889d75 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.601524 Oct 04 21:44:39.030877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d0bc1cc8-770d-4896-9cad-e7186ada8164 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:39.031607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d0bc1cc8-770d-4896-9cad-e7186ada8164 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:39.033299 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3153/6285] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:44:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:44:39.136919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d0bc1cc8-770d-4896-9cad-e7186ada8164 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:39.159578 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d0bc1cc8-770d-4896-9cad-e7186ada8164 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1070 microversion: 2.1 time: 0.139908 Oct 04 21:44:39.160217 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3133/6286] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:39 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1070 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:44:40.186944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b74ecca8-6b8b-42a6-b6f1-e7ca85ca3a17 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:40.187739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b74ecca8-6b8b-42a6-b6f1-e7ca85ca3a17 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:40.294732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b74ecca8-6b8b-42a6-b6f1-e7ca85ca3a17 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:40.307685 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b74ecca8-6b8b-42a6-b6f1-e7ca85ca3a17 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1070 microversion: 2.1 time: 0.125128 Oct 04 21:44:40.308288 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3154/6287] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:40 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1070 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:41.331895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3ce960a4-49a9-46bf-93c8-3493239e2983 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:41.333112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3ce960a4-49a9-46bf-93c8-3493239e2983 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:41.356341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ce960a4-49a9-46bf-93c8-3493239e2983 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:41.357093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ce960a4-49a9-46bf-93c8-3493239e2983 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:41.357766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ce960a4-49a9-46bf-93c8-3493239e2983 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:41.358627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ce960a4-49a9-46bf-93c8-3493239e2983 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:41.359238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ce960a4-49a9-46bf-93c8-3493239e2983 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:41.360176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ce960a4-49a9-46bf-93c8-3493239e2983 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:41.459987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3ce960a4-49a9-46bf-93c8-3493239e2983 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:41.472929 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3ce960a4-49a9-46bf-93c8-3493239e2983 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1112 microversion: 2.1 time: 0.144310 Oct 04 21:44:41.474771 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3134/6288] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:41 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1112 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:42.499981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7e98a4fa-222a-4aaa-af9a-efd5bab5774c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:42.500595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7e98a4fa-222a-4aaa-af9a-efd5bab5774c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:42.520097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e98a4fa-222a-4aaa-af9a-efd5bab5774c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:42.520874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e98a4fa-222a-4aaa-af9a-efd5bab5774c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:42.521681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e98a4fa-222a-4aaa-af9a-efd5bab5774c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:42.522768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e98a4fa-222a-4aaa-af9a-efd5bab5774c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:42.523395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e98a4fa-222a-4aaa-af9a-efd5bab5774c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:42.523987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7e98a4fa-222a-4aaa-af9a-efd5bab5774c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:42.724784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7e98a4fa-222a-4aaa-af9a-efd5bab5774c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:42.735014 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7e98a4fa-222a-4aaa-af9a-efd5bab5774c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1168 microversion: 2.1 time: 0.239357 Oct 04 21:44:42.735793 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3155/6289] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:42 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1168 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:43.764439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7d6b8efe-f64a-4b08-bcd3-671bd386ef27 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:43.766806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7d6b8efe-f64a-4b08-bcd3-671bd386ef27 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:43.794532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d6b8efe-f64a-4b08-bcd3-671bd386ef27 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:43.801578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d6b8efe-f64a-4b08-bcd3-671bd386ef27 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:43.801578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d6b8efe-f64a-4b08-bcd3-671bd386ef27 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:43.801578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d6b8efe-f64a-4b08-bcd3-671bd386ef27 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:43.801578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d6b8efe-f64a-4b08-bcd3-671bd386ef27 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:43.801578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d6b8efe-f64a-4b08-bcd3-671bd386ef27 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:43.965158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7d6b8efe-f64a-4b08-bcd3-671bd386ef27 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:43.979619 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7d6b8efe-f64a-4b08-bcd3-671bd386ef27 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1186 microversion: 2.1 time: 0.225175 Oct 04 21:44:44.002449 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3135/6290] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:43 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1186 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:45.013715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ad0a17f0-1af7-4bca-a53a-82a4b790af6b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:45.013715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ad0a17f0-1af7-4bca-a53a-82a4b790af6b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:45.028807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad0a17f0-1af7-4bca-a53a-82a4b790af6b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:45.032199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad0a17f0-1af7-4bca-a53a-82a4b790af6b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:45.033389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad0a17f0-1af7-4bca-a53a-82a4b790af6b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:45.034601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad0a17f0-1af7-4bca-a53a-82a4b790af6b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:45.044928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad0a17f0-1af7-4bca-a53a-82a4b790af6b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:45.045702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad0a17f0-1af7-4bca-a53a-82a4b790af6b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:45.340106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ad0a17f0-1af7-4bca-a53a-82a4b790af6b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:45.350172 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ad0a17f0-1af7-4bca-a53a-82a4b790af6b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1228 microversion: 2.1 time: 0.349153 Oct 04 21:44:45.353691 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3156/6291] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:44 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1228 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:46.380027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4e61c8c2-7887-4b0b-bdc6-5103e5113f65 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:46.381192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4e61c8c2-7887-4b0b-bdc6-5103e5113f65 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:46.392906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e61c8c2-7887-4b0b-bdc6-5103e5113f65 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:46.394451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e61c8c2-7887-4b0b-bdc6-5103e5113f65 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:46.396396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e61c8c2-7887-4b0b-bdc6-5103e5113f65 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:46.397631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e61c8c2-7887-4b0b-bdc6-5103e5113f65 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:46.404242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e61c8c2-7887-4b0b-bdc6-5103e5113f65 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:46.404951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e61c8c2-7887-4b0b-bdc6-5103e5113f65 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:46.432834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=55 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:46.917112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ccae72b9-321e-418e-90ca-22d3d60cd9cb tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:46.918980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ccae72b9-321e-418e-90ca-22d3d60cd9cb tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:46.936617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccae72b9-321e-418e-90ca-22d3d60cd9cb tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:46.936617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccae72b9-321e-418e-90ca-22d3d60cd9cb tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:46.937663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccae72b9-321e-418e-90ca-22d3d60cd9cb tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:46.939294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccae72b9-321e-418e-90ca-22d3d60cd9cb tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:46.941256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccae72b9-321e-418e-90ca-22d3d60cd9cb tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:46.945991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccae72b9-321e-418e-90ca-22d3d60cd9cb tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:47.010936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ccae72b9-321e-418e-90ca-22d3d60cd9cb tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:44:47.207547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4e61c8c2-7887-4b0b-bdc6-5103e5113f65 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:47.228222 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4e61c8c2-7887-4b0b-bdc6-5103e5113f65 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1228 microversion: 2.1 time: 0.852756 Oct 04 21:44:47.229443 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3136/6292] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:46 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1228 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:47.449177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2b76980a-61fc-43bd-b173-ffde9761ffba tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a19d5bc1-227d-4f3a-858e-9efe77e5cd06", "device": "/dev/sdb"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:47.451821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2b76980a-61fc-43bd-b173-ffde9761ffba tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:47.458598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:47.475180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b76980a-61fc-43bd-b173-ffde9761ffba tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:47.479980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b76980a-61fc-43bd-b173-ffde9761ffba tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:47.479980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b76980a-61fc-43bd-b173-ffde9761ffba tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:47.479980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b76980a-61fc-43bd-b173-ffde9761ffba tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:47.479980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b76980a-61fc-43bd-b173-ffde9761ffba tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:47.479980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2b76980a-61fc-43bd-b173-ffde9761ffba tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:47.546341 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ccae72b9-321e-418e-90ca-22d3d60cd9cb tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "DELETE /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf" status: 204 len: 0 microversion: 2.1 time: 0.632602 Oct 04 21:44:47.554921 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3157/6293] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:44:46 2022] DELETE /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf => generated 0 bytes in 639 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:44:47.568990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ba8a9cfc-b053-48e2-b8df-ca20bcfe840e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:47.573020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ba8a9cfc-b053-48e2-b8df-ca20bcfe840e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:47.600763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba8a9cfc-b053-48e2-b8df-ca20bcfe840e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:47.600763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba8a9cfc-b053-48e2-b8df-ca20bcfe840e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:47.600763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba8a9cfc-b053-48e2-b8df-ca20bcfe840e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:47.600763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba8a9cfc-b053-48e2-b8df-ca20bcfe840e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:47.600763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba8a9cfc-b053-48e2-b8df-ca20bcfe840e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:47.603747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba8a9cfc-b053-48e2-b8df-ca20bcfe840e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:48.098960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ba8a9cfc-b053-48e2-b8df-ca20bcfe840e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b179faa3d2741f1b65e32b3da6ebaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5229b6aecaeb4989aed73aab7c8eb3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:48.110511 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ba8a9cfc-b053-48e2-b8df-ca20bcfe840e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf" status: 200 len: 1504 microversion: 2.1 time: 0.553241 Oct 04 21:44:48.111094 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3158/6294] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:47 2022] GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf => generated 1504 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:48.128852 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-bab84792-1466-4086-91ac-bee944bb1a9c req-14876833-52cd-4a1a-87a4-64f13281a464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab2aae9-7934-4d73-9ed9-21218879fac0", "tag": "c47f6e88-3f4a-42c9-b9f4-31806a5d7067"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:48.154881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bab84792-1466-4086-91ac-bee944bb1a9c req-14876833-52cd-4a1a-87a4-64f13281a464 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:48.156165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bab84792-1466-4086-91ac-bee944bb1a9c req-14876833-52cd-4a1a-87a4-64f13281a464 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:48.157022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bab84792-1466-4086-91ac-bee944bb1a9c req-14876833-52cd-4a1a-87a4-64f13281a464 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:48.186626 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-bab84792-1466-4086-91ac-bee944bb1a9c req-14876833-52cd-4a1a-87a4-64f13281a464 service nova] Creating event network-changed:c47f6e88-3f4a-42c9-b9f4-31806a5d7067 for instance aab2aae9-7934-4d73-9ed9-21218879fac0 on n-h2-860282-1 Oct 04 21:44:48.199292 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-bab84792-1466-4086-91ac-bee944bb1a9c req-14876833-52cd-4a1a-87a4-64f13281a464 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075809 Oct 04 21:44:48.202345 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3159/6295] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:48.258902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d61aef17-8319-4481-9dac-711bae2bd301 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:48.259841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d61aef17-8319-4481-9dac-711bae2bd301 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:48.278217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d61aef17-8319-4481-9dac-711bae2bd301 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:48.279309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d61aef17-8319-4481-9dac-711bae2bd301 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:48.280337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d61aef17-8319-4481-9dac-711bae2bd301 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:48.281244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d61aef17-8319-4481-9dac-711bae2bd301 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:48.281910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d61aef17-8319-4481-9dac-711bae2bd301 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:48.282529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d61aef17-8319-4481-9dac-711bae2bd301 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:48.291723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:48.489323 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2b76980a-61fc-43bd-b173-ffde9761ffba tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "POST /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.044058 Oct 04 21:44:48.490763 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3137/6296] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 21:44:47 2022] POST /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8/os-volume_attachments => generated 194 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:48.656072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d61aef17-8319-4481-9dac-711bae2bd301 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:48.676506 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d61aef17-8319-4481-9dac-711bae2bd301 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1228 microversion: 2.1 time: 0.424171 Oct 04 21:44:48.685313 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3160/6297] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:48 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1228 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:49.137925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1c655d4f-7ea9-4524-933a-88d23112d28e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:49.138751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1c655d4f-7ea9-4524-933a-88d23112d28e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:49.147748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:49.151997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c655d4f-7ea9-4524-933a-88d23112d28e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:49.159451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c655d4f-7ea9-4524-933a-88d23112d28e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:49.160072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c655d4f-7ea9-4524-933a-88d23112d28e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:49.160917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c655d4f-7ea9-4524-933a-88d23112d28e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:49.161517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c655d4f-7ea9-4524-933a-88d23112d28e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:49.163014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c655d4f-7ea9-4524-933a-88d23112d28e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:49.469825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1c655d4f-7ea9-4524-933a-88d23112d28e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b179faa3d2741f1b65e32b3da6ebaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5229b6aecaeb4989aed73aab7c8eb3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:49.477133 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1c655d4f-7ea9-4524-933a-88d23112d28e tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf" status: 200 len: 1504 microversion: 2.1 time: 0.343956 Oct 04 21:44:49.482432 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3138/6298] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:49 2022] GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf => generated 1504 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:49.711401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-09fffff7-2fc5-4319-9a25-70f81fc827be tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:49.714079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-09fffff7-2fc5-4319-9a25-70f81fc827be tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:49.730830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09fffff7-2fc5-4319-9a25-70f81fc827be tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:49.733127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09fffff7-2fc5-4319-9a25-70f81fc827be tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:49.739493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09fffff7-2fc5-4319-9a25-70f81fc827be tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:49.741854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09fffff7-2fc5-4319-9a25-70f81fc827be tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:49.742603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09fffff7-2fc5-4319-9a25-70f81fc827be tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:49.744278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09fffff7-2fc5-4319-9a25-70f81fc827be tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:49.980299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-09fffff7-2fc5-4319-9a25-70f81fc827be tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:49.991688 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-09fffff7-2fc5-4319-9a25-70f81fc827be tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1228 microversion: 2.1 time: 0.286721 Oct 04 21:44:49.993217 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3161/6299] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:49 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1228 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:50.507645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-225b5119-2771-4082-bb70-7dffd95f99b2 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:50.509077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-225b5119-2771-4082-bb70-7dffd95f99b2 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:50.531373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-225b5119-2771-4082-bb70-7dffd95f99b2 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:50.531884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-225b5119-2771-4082-bb70-7dffd95f99b2 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:50.532332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-225b5119-2771-4082-bb70-7dffd95f99b2 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:50.533055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-225b5119-2771-4082-bb70-7dffd95f99b2 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:50.533547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-225b5119-2771-4082-bb70-7dffd95f99b2 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:50.534143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-225b5119-2771-4082-bb70-7dffd95f99b2 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:50.952584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-a2acc87d-06b8-4990-842b-5bd253aab1f7 req-6aa0fd3a-417f-4894-baf5-b9bcf983155c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19f7db9a-7eba-4c50-84fa-e9a1459be4cf", "name": "network-vif-deleted", "tag": "53c05577-6bce-4bab-b485-90ce8cc47124"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:50.971804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:50.975446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-225b5119-2771-4082-bb70-7dffd95f99b2 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b179faa3d2741f1b65e32b3da6ebaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5229b6aecaeb4989aed73aab7c8eb3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:50.986192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a2acc87d-06b8-4990-842b-5bd253aab1f7 req-6aa0fd3a-417f-4894-baf5-b9bcf983155c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:50.986945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a2acc87d-06b8-4990-842b-5bd253aab1f7 req-6aa0fd3a-417f-4894-baf5-b9bcf983155c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:50.988943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a2acc87d-06b8-4990-842b-5bd253aab1f7 req-6aa0fd3a-417f-4894-baf5-b9bcf983155c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:50.994857 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-225b5119-2771-4082-bb70-7dffd95f99b2 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf" status: 200 len: 1504 microversion: 2.1 time: 0.493183 Oct 04 21:44:50.997364 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3139/6300] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:50 2022] GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf => generated 1504 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:51.022207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5aedd660-e9c1-45b7-b069-1d62a70ccdab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:51.023163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5aedd660-e9c1-45b7-b069-1d62a70ccdab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:51.034371 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-a2acc87d-06b8-4990-842b-5bd253aab1f7 req-6aa0fd3a-417f-4894-baf5-b9bcf983155c service nova] Creating event network-vif-deleted:53c05577-6bce-4bab-b485-90ce8cc47124 for instance 19f7db9a-7eba-4c50-84fa-e9a1459be4cf on n-h1-860282-1 Oct 04 21:44:51.039760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5aedd660-e9c1-45b7-b069-1d62a70ccdab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:51.040589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5aedd660-e9c1-45b7-b069-1d62a70ccdab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:51.041108 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-a2acc87d-06b8-4990-842b-5bd253aab1f7 req-6aa0fd3a-417f-4894-baf5-b9bcf983155c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093961 Oct 04 21:44:51.041670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5aedd660-e9c1-45b7-b069-1d62a70ccdab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:51.042476 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3162/6301] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:51.044585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5aedd660-e9c1-45b7-b069-1d62a70ccdab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:51.045866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5aedd660-e9c1-45b7-b069-1d62a70ccdab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:51.047265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5aedd660-e9c1-45b7-b069-1d62a70ccdab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:51.389992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5aedd660-e9c1-45b7-b069-1d62a70ccdab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:51.403412 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5aedd660-e9c1-45b7-b069-1d62a70ccdab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1228 microversion: 2.1 time: 0.385385 Oct 04 21:44:51.406086 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3140/6302] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:51 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1228 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:52.025588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-50187c82-2e30-4ee5-be2e-d07317449e64 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:52.026937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-50187c82-2e30-4ee5-be2e-d07317449e64 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:52.042958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:52.044718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50187c82-2e30-4ee5-be2e-d07317449e64 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:52.045224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50187c82-2e30-4ee5-be2e-d07317449e64 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:52.045695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50187c82-2e30-4ee5-be2e-d07317449e64 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:52.046411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50187c82-2e30-4ee5-be2e-d07317449e64 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:52.046879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50187c82-2e30-4ee5-be2e-d07317449e64 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:52.047297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50187c82-2e30-4ee5-be2e-d07317449e64 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:52.050624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:52.124055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50187c82-2e30-4ee5-be2e-d07317449e64 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:52.124553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50187c82-2e30-4ee5-be2e-d07317449e64 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:52.124997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-50187c82-2e30-4ee5-be2e-d07317449e64 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:52.125478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-50187c82-2e30-4ee5-be2e-d07317449e64 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lazy-loading 'fault' on Instance uuid 19f7db9a-7eba-4c50-84fa-e9a1459be4cf {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:44:52.216699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-50187c82-2e30-4ee5-be2e-d07317449e64 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b179faa3d2741f1b65e32b3da6ebaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5229b6aecaeb4989aed73aab7c8eb3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:52.226314 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-50187c82-2e30-4ee5-be2e-d07317449e64 tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf" status: 200 len: 1304 microversion: 2.1 time: 0.206568 Oct 04 21:44:52.227257 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3163/6303] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:52 2022] GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf => generated 1304 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:52.427832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c80105f8-bae3-4ef7-bb6d-bf78a9d808d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:52.429254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c80105f8-bae3-4ef7-bb6d-bf78a9d808d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:52.437400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c80105f8-bae3-4ef7-bb6d-bf78a9d808d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:52.438144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c80105f8-bae3-4ef7-bb6d-bf78a9d808d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:52.438854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c80105f8-bae3-4ef7-bb6d-bf78a9d808d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:52.439823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c80105f8-bae3-4ef7-bb6d-bf78a9d808d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:52.440804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c80105f8-bae3-4ef7-bb6d-bf78a9d808d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:52.441981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c80105f8-bae3-4ef7-bb6d-bf78a9d808d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:52.663705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c80105f8-bae3-4ef7-bb6d-bf78a9d808d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:52.678460 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c80105f8-bae3-4ef7-bb6d-bf78a9d808d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1216 microversion: 2.1 time: 0.254126 Oct 04 21:44:52.683020 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3141/6304] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:52 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1216 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:53.256806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3a8ebe28-44a8-4a80-8b4d-5d42ba9c2bca tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:53.258164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3a8ebe28-44a8-4a80-8b4d-5d42ba9c2bca tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] [instance: 19f7db9a-7eba-4c50-84fa-e9a1459be4cf] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:53.268973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a8ebe28-44a8-4a80-8b4d-5d42ba9c2bca tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:53.280537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a8ebe28-44a8-4a80-8b4d-5d42ba9c2bca tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:53.281352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a8ebe28-44a8-4a80-8b4d-5d42ba9c2bca tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:53.282396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a8ebe28-44a8-4a80-8b4d-5d42ba9c2bca tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:53.284230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a8ebe28-44a8-4a80-8b4d-5d42ba9c2bca tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:53.284230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a8ebe28-44a8-4a80-8b4d-5d42ba9c2bca tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:53.324914 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-3a8ebe28-44a8-4a80-8b4d-5d42ba9c2bca tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] HTTP exception thrown: Instance 19f7db9a-7eba-4c50-84fa-e9a1459be4cf could not be found. Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3a8ebe28-44a8-4a80-8b4d-5d42ba9c2bca tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Request method failure captured: Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf HTTP/1.1 Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKkrDJbVbBIYK49v3Kv92sZLj768I6xFqR0Zui8Sy9-TUrvmhvSfnNygEJx4ctP8StzfqijihVJbdhR4B6NMYUn1lm8auuJkglegyKKwiFdDYupUeGz3AyHqbQYPpahpk_0IxbzhWGo36gclkh7PGg048BRIGeUGjMdYZV1jukROrt8 Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 5229b6aecaeb4989aed73aab7c8eb3e7 Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-VolumesActionsTest-136994794 Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5229b6aecaeb4989aed73aab7c8eb3e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5229b6aecaeb4989aed73aab7c8eb3e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5229b6aecaeb4989aed73aab7c8eb3e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5229b6aecaeb4989aed73aab7c8eb3e7"}]}] Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-VolumesActionsTest-136994794 Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 5229b6aecaeb4989aed73aab7c8eb3e7 Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-VolumesActionsTest-136994794 Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-VolumesActionsTest-136994794-project Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 2b179faa3d2741f1b65e32b3da6ebaa4 Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-VolumesActionsTest-136994794-project Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 19f7db9a-7eba-4c50-84fa-e9a1459be4cf could not be found. Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '19f7db9a-7eba-4c50-84fa-e9a1459be4cf'} Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19f7db9a-7eba-4c50-84fa-e9a1459be4cf could not be found. Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19f7db9a-7eba-4c50-84fa-e9a1459be4cf could not be found. Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:53.327141 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:44:53.330808 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:53.330808 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:53.330808 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:53.330808 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:53.330808 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:53.330808 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19f7db9a-7eba-4c50-84fa-e9a1459be4cf could not be found. Oct 04 21:44:53.330808 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:44:53.333004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3a8ebe28-44a8-4a80-8b4d-5d42ba9c2bca tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] Returning 404 to user: Instance 19f7db9a-7eba-4c50-84fa-e9a1459be4cf could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:53.356833 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3a8ebe28-44a8-4a80-8b4d-5d42ba9c2bca tempest-VolumesActionsTest-136994794 tempest-VolumesActionsTest-136994794-project] 10.222.0.30 "GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf" status: 404 len: 111 microversion: 2.1 time: 0.083088 Oct 04 21:44:53.357745 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3164/6305] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:53 2022] GET /compute/v2.1/servers/19f7db9a-7eba-4c50-84fa-e9a1459be4cf => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:53.712702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f5a4dc2e-dfad-410b-add2-9d2424821dd8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:53.712702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f5a4dc2e-dfad-410b-add2-9d2424821dd8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:53.718499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5a4dc2e-dfad-410b-add2-9d2424821dd8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:53.719202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5a4dc2e-dfad-410b-add2-9d2424821dd8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:53.719744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5a4dc2e-dfad-410b-add2-9d2424821dd8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:53.720568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5a4dc2e-dfad-410b-add2-9d2424821dd8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:53.721408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5a4dc2e-dfad-410b-add2-9d2424821dd8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:53.721999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f5a4dc2e-dfad-410b-add2-9d2424821dd8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:54.054178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f5a4dc2e-dfad-410b-add2-9d2424821dd8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:54.066581 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f5a4dc2e-dfad-410b-add2-9d2424821dd8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1216 microversion: 2.1 time: 0.363229 Oct 04 21:44:54.067154 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3142/6306] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:53 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1216 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:55.091069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cd5de68d-1048-4cea-a7f7-42282eef0fd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:55.092419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cd5de68d-1048-4cea-a7f7-42282eef0fd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:55.103655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd5de68d-1048-4cea-a7f7-42282eef0fd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:55.104522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd5de68d-1048-4cea-a7f7-42282eef0fd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:55.105277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd5de68d-1048-4cea-a7f7-42282eef0fd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:55.106298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd5de68d-1048-4cea-a7f7-42282eef0fd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:55.107009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd5de68d-1048-4cea-a7f7-42282eef0fd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:55.107666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd5de68d-1048-4cea-a7f7-42282eef0fd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:55.617145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cd5de68d-1048-4cea-a7f7-42282eef0fd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:55.626038 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cd5de68d-1048-4cea-a7f7-42282eef0fd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1216 microversion: 2.1 time: 0.540171 Oct 04 21:44:55.642390 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3165/6307] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:55 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1216 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:56.665308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-becea8a5-0a13-4c56-b0d2-801bc279ce99 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:56.666141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-becea8a5-0a13-4c56-b0d2-801bc279ce99 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:56.684266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-becea8a5-0a13-4c56-b0d2-801bc279ce99 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:56.691651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-becea8a5-0a13-4c56-b0d2-801bc279ce99 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:56.697375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-becea8a5-0a13-4c56-b0d2-801bc279ce99 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:56.698635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-becea8a5-0a13-4c56-b0d2-801bc279ce99 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:56.698797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-becea8a5-0a13-4c56-b0d2-801bc279ce99 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:56.699899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-becea8a5-0a13-4c56-b0d2-801bc279ce99 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:57.029118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-becea8a5-0a13-4c56-b0d2-801bc279ce99 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:57.047416 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-becea8a5-0a13-4c56-b0d2-801bc279ce99 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1216 microversion: 2.1 time: 0.386768 Oct 04 21:44:57.055762 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3143/6308] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:56 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1216 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:58.075479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6c6933f6-1760-4386-90af-977acbdb2dd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:58.076311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6c6933f6-1760-4386-90af-977acbdb2dd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:58.091043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c6933f6-1760-4386-90af-977acbdb2dd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:58.091566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c6933f6-1760-4386-90af-977acbdb2dd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:58.093996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c6933f6-1760-4386-90af-977acbdb2dd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:58.095245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c6933f6-1760-4386-90af-977acbdb2dd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:58.100111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c6933f6-1760-4386-90af-977acbdb2dd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:58.100765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c6933f6-1760-4386-90af-977acbdb2dd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:58.335362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6c6933f6-1760-4386-90af-977acbdb2dd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:58.351029 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6c6933f6-1760-4386-90af-977acbdb2dd2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1216 microversion: 2.1 time: 0.279939 Oct 04 21:44:58.353110 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3166/6309] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:58 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1216 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:59.376923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6fda6b7e-f504-40fa-b1cb-330156b5ef38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:59.376923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6fda6b7e-f504-40fa-b1cb-330156b5ef38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:59.393102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fda6b7e-f504-40fa-b1cb-330156b5ef38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:59.394774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fda6b7e-f504-40fa-b1cb-330156b5ef38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:59.395550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fda6b7e-f504-40fa-b1cb-330156b5ef38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:59.403974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fda6b7e-f504-40fa-b1cb-330156b5ef38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:59.404641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fda6b7e-f504-40fa-b1cb-330156b5ef38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:59.408085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6fda6b7e-f504-40fa-b1cb-330156b5ef38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:59.792971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6fda6b7e-f504-40fa-b1cb-330156b5ef38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:59.795837 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6fda6b7e-f504-40fa-b1cb-330156b5ef38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1216 microversion: 2.1 time: 0.423885 Oct 04 21:44:59.799880 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3144/6310] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:59 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1216 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:00.822289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f69a9070-e387-4bfc-8e68-dc9c12713183 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:00.822920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f69a9070-e387-4bfc-8e68-dc9c12713183 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:00.834367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f69a9070-e387-4bfc-8e68-dc9c12713183 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:00.834961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f69a9070-e387-4bfc-8e68-dc9c12713183 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:00.835418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f69a9070-e387-4bfc-8e68-dc9c12713183 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:00.836167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f69a9070-e387-4bfc-8e68-dc9c12713183 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:00.836623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f69a9070-e387-4bfc-8e68-dc9c12713183 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:00.845079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f69a9070-e387-4bfc-8e68-dc9c12713183 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:01.168266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f69a9070-e387-4bfc-8e68-dc9c12713183 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:01.227453 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f69a9070-e387-4bfc-8e68-dc9c12713183 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1216 microversion: 2.1 time: 0.404941 Oct 04 21:45:01.232249 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3167/6311] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:00 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1216 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:02.265843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3c82e293-8901-4ef6-8be4-cc18073b3302 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:02.267867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3c82e293-8901-4ef6-8be4-cc18073b3302 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:02.291855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c82e293-8901-4ef6-8be4-cc18073b3302 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:02.294219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c82e293-8901-4ef6-8be4-cc18073b3302 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:02.296137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c82e293-8901-4ef6-8be4-cc18073b3302 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:02.297129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c82e293-8901-4ef6-8be4-cc18073b3302 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:02.299144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c82e293-8901-4ef6-8be4-cc18073b3302 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:02.300086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3c82e293-8901-4ef6-8be4-cc18073b3302 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:02.606360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3c82e293-8901-4ef6-8be4-cc18073b3302 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:02.620976 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3c82e293-8901-4ef6-8be4-cc18073b3302 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1216 microversion: 2.1 time: 0.370904 Oct 04 21:45:02.623081 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3145/6312] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:02 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1216 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:03.655448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ebb35dfe-31f8-4364-a4d0-233345da29fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:03.655448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ebb35dfe-31f8-4364-a4d0-233345da29fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:03.670085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ebb35dfe-31f8-4364-a4d0-233345da29fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:03.671895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ebb35dfe-31f8-4364-a4d0-233345da29fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:03.673065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ebb35dfe-31f8-4364-a4d0-233345da29fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:03.675910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ebb35dfe-31f8-4364-a4d0-233345da29fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:03.676603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ebb35dfe-31f8-4364-a4d0-233345da29fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:03.680311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ebb35dfe-31f8-4364-a4d0-233345da29fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:03.697870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-57560ff0-2bb9-4b11-bb08-df7e812c7506 req-2c892304-30d8-4ec9-a511-7af08e68fb7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab2aae9-7934-4d73-9ed9-21218879fac0", "name": "network-vif-plugged", "status": "completed", "tag": "c47f6e88-3f4a-42c9-b9f4-31806a5d7067"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:03.720185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-57560ff0-2bb9-4b11-bb08-df7e812c7506 req-2c892304-30d8-4ec9-a511-7af08e68fb7e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:03.720667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-57560ff0-2bb9-4b11-bb08-df7e812c7506 req-2c892304-30d8-4ec9-a511-7af08e68fb7e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:03.721291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-57560ff0-2bb9-4b11-bb08-df7e812c7506 req-2c892304-30d8-4ec9-a511-7af08e68fb7e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:03.745492 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-57560ff0-2bb9-4b11-bb08-df7e812c7506 req-2c892304-30d8-4ec9-a511-7af08e68fb7e service nova] Creating event network-vif-plugged:c47f6e88-3f4a-42c9-b9f4-31806a5d7067 for instance aab2aae9-7934-4d73-9ed9-21218879fac0 on n-h2-860282-1 Oct 04 21:45:03.760006 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-57560ff0-2bb9-4b11-bb08-df7e812c7506 req-2c892304-30d8-4ec9-a511-7af08e68fb7e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067020 Oct 04 21:45:03.762547 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3146/6313] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:04.172822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ebb35dfe-31f8-4364-a4d0-233345da29fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:04.209496 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ebb35dfe-31f8-4364-a4d0-233345da29fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1216 microversion: 2.1 time: 0.539953 Oct 04 21:45:04.209496 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3168/6314] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:03 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1216 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:05.225118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b922e43c-9d87-4dd9-ac90-64512e34d610 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:05.226045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b922e43c-9d87-4dd9-ac90-64512e34d610 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:05.240329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b922e43c-9d87-4dd9-ac90-64512e34d610 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:05.240329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b922e43c-9d87-4dd9-ac90-64512e34d610 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:05.240784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b922e43c-9d87-4dd9-ac90-64512e34d610 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:05.244572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b922e43c-9d87-4dd9-ac90-64512e34d610 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:05.245497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b922e43c-9d87-4dd9-ac90-64512e34d610 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:05.246102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b922e43c-9d87-4dd9-ac90-64512e34d610 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:05.599985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b922e43c-9d87-4dd9-ac90-64512e34d610 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:05.611678 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b922e43c-9d87-4dd9-ac90-64512e34d610 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1216 microversion: 2.1 time: 0.392360 Oct 04 21:45:05.612862 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3147/6315] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:05 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1216 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:06.636376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5002791f-126c-4e84-a78c-042895ea8387 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:06.637003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5002791f-126c-4e84-a78c-042895ea8387 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:06.661900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5002791f-126c-4e84-a78c-042895ea8387 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:06.662703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5002791f-126c-4e84-a78c-042895ea8387 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:06.663373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5002791f-126c-4e84-a78c-042895ea8387 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:06.664339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5002791f-126c-4e84-a78c-042895ea8387 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:06.665035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5002791f-126c-4e84-a78c-042895ea8387 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:06.665848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5002791f-126c-4e84-a78c-042895ea8387 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:07.043595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5002791f-126c-4e84-a78c-042895ea8387 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:07.059063 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5002791f-126c-4e84-a78c-042895ea8387 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1402 microversion: 2.1 time: 0.426539 Oct 04 21:45:07.059913 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3169/6316] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:06 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1402 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:07.087383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0b6a2d94-6971-4bf1-aef7-586b559c50c5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:07.087383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0b6a2d94-6971-4bf1-aef7-586b559c50c5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:07.094427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b6a2d94-6971-4bf1-aef7-586b559c50c5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:07.095985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b6a2d94-6971-4bf1-aef7-586b559c50c5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:07.098267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b6a2d94-6971-4bf1-aef7-586b559c50c5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:07.100297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b6a2d94-6971-4bf1-aef7-586b559c50c5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:07.101268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b6a2d94-6971-4bf1-aef7-586b559c50c5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:07.102157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0b6a2d94-6971-4bf1-aef7-586b559c50c5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:07.531983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0b6a2d94-6971-4bf1-aef7-586b559c50c5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:07.566245 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0b6a2d94-6971-4bf1-aef7-586b559c50c5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1402 microversion: 2.1 time: 0.487202 Oct 04 21:45:07.577887 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3148/6317] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:07 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1402 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:07.607255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-86244c63-b508-4af3-904b-8d3b4556936c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1560565847"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:07.610183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-86244c63-b508-4af3-904b-8d3b4556936c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:07.623712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86244c63-b508-4af3-904b-8d3b4556936c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:07.628514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86244c63-b508-4af3-904b-8d3b4556936c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:07.628514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86244c63-b508-4af3-904b-8d3b4556936c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:07.629950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86244c63-b508-4af3-904b-8d3b4556936c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:07.644019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86244c63-b508-4af3-904b-8d3b4556936c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:07.645210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86244c63-b508-4af3-904b-8d3b4556936c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:07.850698 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.compute.api [None req-86244c63-b508-4af3-904b-8d3b4556936c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Attempting to quiesce instance before volume snapshot. Oct 04 21:45:07.914686 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.compute.api [None req-86244c63-b508-4af3-904b-8d3b4556936c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 04 21:45:08.214241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-86244c63-b508-4af3-904b-8d3b4556936c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Creating snapshot from volume fabbef79-f1b3-497d-a126-61991e50441c. {{(pid=122757) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 04 21:45:11.238238 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-86244c63-b508-4af3-904b-8d3b4556936c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "POST /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0/action" status: 202 len: 0 microversion: 2.1 time: 3.636352 Oct 04 21:45:11.238864 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3170/6318] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:45:07 2022] POST /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0/action => generated 0 bytes in 3638 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 21:45:12.595424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a4cbf475-c07c-4d6b-a5c8-b233221b801d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-888227199", "imageRef": "7f572d39-5fae-4e68-966e-fe4824d9502e", "flavorRef": "452", "networks": [{"uuid": "b7f4cca9-cdc1-49bd-97e7-bd6739547eb6"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:12.696254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-a4cbf475-c07c-4d6b-a5c8-b233221b801d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] validate_networks() for [('b7f4cca9-cdc1-49bd-97e7-bd6739547eb6', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:45:15.020632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a4cbf475-c07c-4d6b-a5c8-b233221b801d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:45:15.023892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a4cbf475-c07c-4d6b-a5c8-b233221b801d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:45:15.026251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a4cbf475-c07c-4d6b-a5c8-b233221b801d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:45:15.027757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a4cbf475-c07c-4d6b-a5c8-b233221b801d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:45:15.030938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-a4cbf475-c07c-4d6b-a5c8-b233221b801d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:45:15.058849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4cbf475-c07c-4d6b-a5c8-b233221b801d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:15.061934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4cbf475-c07c-4d6b-a5c8-b233221b801d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:15.064062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4cbf475-c07c-4d6b-a5c8-b233221b801d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:15.067004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4cbf475-c07c-4d6b-a5c8-b233221b801d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:15.068490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4cbf475-c07c-4d6b-a5c8-b233221b801d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:15.070330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4cbf475-c07c-4d6b-a5c8-b233221b801d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:15.113851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-a4cbf475-c07c-4d6b-a5c8-b233221b801d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Getting quotas for project 68208d23fd2f40479ba279566a819933. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:45:15.125235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-a4cbf475-c07c-4d6b-a5c8-b233221b801d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Getting quotas for user 15748f41da9f49fca3e7eec1fda3b245 and project 68208d23fd2f40479ba279566a819933. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:45:15.154686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a4cbf475-c07c-4d6b-a5c8-b233221b801d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:45:15.159445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a4cbf475-c07c-4d6b-a5c8-b233221b801d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b45fe41c-4b5b-4e98-960b-9aa0ea4a155e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:45:15.314851 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a4cbf475-c07c-4d6b-a5c8-b233221b801d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.724090 Oct 04 21:45:15.316031 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3149/6319] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:45:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:45:15.329559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ee4bd066-6d32-4b64-8cdf-67de8d1f9f87 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:15.332519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ee4bd066-6d32-4b64-8cdf-67de8d1f9f87 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:15.531735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ee4bd066-6d32-4b64-8cdf-67de8d1f9f87 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:15.549310 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ee4bd066-6d32-4b64-8cdf-67de8d1f9f87 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1229 microversion: 2.1 time: 0.225478 Oct 04 21:45:15.554362 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3171/6320] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:15 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1229 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:16.577792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6507488f-d0ff-4cc2-92f3-d906e6a2af84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:16.578565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6507488f-d0ff-4cc2-92f3-d906e6a2af84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:16.770031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6507488f-d0ff-4cc2-92f3-d906e6a2af84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:16.801853 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6507488f-d0ff-4cc2-92f3-d906e6a2af84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1229 microversion: 2.1 time: 0.213070 Oct 04 21:45:16.801853 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3150/6321] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:16 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1229 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:17.823396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-33300f99-b252-4d55-8204-ce5fb01888dd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:17.827355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-33300f99-b252-4d55-8204-ce5fb01888dd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:17.848129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33300f99-b252-4d55-8204-ce5fb01888dd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:17.851988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33300f99-b252-4d55-8204-ce5fb01888dd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:17.852692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33300f99-b252-4d55-8204-ce5fb01888dd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:17.859832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33300f99-b252-4d55-8204-ce5fb01888dd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:17.859832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33300f99-b252-4d55-8204-ce5fb01888dd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:17.860164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-33300f99-b252-4d55-8204-ce5fb01888dd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:18.561220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-33300f99-b252-4d55-8204-ce5fb01888dd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:18.590420 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-33300f99-b252-4d55-8204-ce5fb01888dd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1281 microversion: 2.1 time: 0.769697 Oct 04 21:45:18.592074 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3172/6322] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:17 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1281 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:19.623604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dfc13dbd-8b0e-44eb-9162-58256e8d07f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:19.624619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dfc13dbd-8b0e-44eb-9162-58256e8d07f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:19.634644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:19.651371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfc13dbd-8b0e-44eb-9162-58256e8d07f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:19.654170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfc13dbd-8b0e-44eb-9162-58256e8d07f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:19.661835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfc13dbd-8b0e-44eb-9162-58256e8d07f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:19.663037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfc13dbd-8b0e-44eb-9162-58256e8d07f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:19.663874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfc13dbd-8b0e-44eb-9162-58256e8d07f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:19.664548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfc13dbd-8b0e-44eb-9162-58256e8d07f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:19.705190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:19.858795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dfc13dbd-8b0e-44eb-9162-58256e8d07f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:19.869845 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dfc13dbd-8b0e-44eb-9162-58256e8d07f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1299 microversion: 2.1 time: 0.255061 Oct 04 21:45:19.887442 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3151/6323] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:19 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1299 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:20.904199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7b54f268-e3a4-44d8-8086-63efcf3c6ed5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:20.906351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7b54f268-e3a4-44d8-8086-63efcf3c6ed5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:20.931592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b54f268-e3a4-44d8-8086-63efcf3c6ed5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:20.933164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b54f268-e3a4-44d8-8086-63efcf3c6ed5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:20.933918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b54f268-e3a4-44d8-8086-63efcf3c6ed5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:20.941629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b54f268-e3a4-44d8-8086-63efcf3c6ed5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:20.942604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b54f268-e3a4-44d8-8086-63efcf3c6ed5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:20.948561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7b54f268-e3a4-44d8-8086-63efcf3c6ed5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:21.887442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7b54f268-e3a4-44d8-8086-63efcf3c6ed5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:21.927134 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7b54f268-e3a4-44d8-8086-63efcf3c6ed5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 1.037874 Oct 04 21:45:21.931021 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3173/6324] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:20 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:22.957785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-38551523-194d-4c93-8198-991ad2d3ae5e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:22.958358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-38551523-194d-4c93-8198-991ad2d3ae5e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:23.001974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38551523-194d-4c93-8198-991ad2d3ae5e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:23.008496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38551523-194d-4c93-8198-991ad2d3ae5e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:23.009800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38551523-194d-4c93-8198-991ad2d3ae5e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:23.016095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38551523-194d-4c93-8198-991ad2d3ae5e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:23.019729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38551523-194d-4c93-8198-991ad2d3ae5e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:23.022806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38551523-194d-4c93-8198-991ad2d3ae5e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:23.616427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-38551523-194d-4c93-8198-991ad2d3ae5e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:23.630028 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-38551523-194d-4c93-8198-991ad2d3ae5e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.672365 Oct 04 21:45:23.631334 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3152/6325] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:22 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:24.044885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-81c333c3-8c31-4a17-a6e7-82c229d1b503 req-55c50ae7-8d78-41e6-9990-9c700536a480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512622af-42ea-4b00-a527-d513faeb9da5", "tag": "290d30b5-d42c-4628-ba22-c931e03a3d63"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:24.086288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-81c333c3-8c31-4a17-a6e7-82c229d1b503 req-55c50ae7-8d78-41e6-9990-9c700536a480 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:24.087989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-81c333c3-8c31-4a17-a6e7-82c229d1b503 req-55c50ae7-8d78-41e6-9990-9c700536a480 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:24.094320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-81c333c3-8c31-4a17-a6e7-82c229d1b503 req-55c50ae7-8d78-41e6-9990-9c700536a480 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:24.148487 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-81c333c3-8c31-4a17-a6e7-82c229d1b503 req-55c50ae7-8d78-41e6-9990-9c700536a480 service nova] Creating event network-changed:290d30b5-d42c-4628-ba22-c931e03a3d63 for instance 512622af-42ea-4b00-a527-d513faeb9da5 on n-h1-860282-1 Oct 04 21:45:24.166385 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-81c333c3-8c31-4a17-a6e7-82c229d1b503 req-55c50ae7-8d78-41e6-9990-9c700536a480 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.593520 Oct 04 21:45:24.170338 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3174/6326] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:24.653715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ee00561b-8941-4d40-b40e-71c5dd8738fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:24.654776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ee00561b-8941-4d40-b40e-71c5dd8738fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:24.670782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ee00561b-8941-4d40-b40e-71c5dd8738fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:24.671711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ee00561b-8941-4d40-b40e-71c5dd8738fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:24.672379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ee00561b-8941-4d40-b40e-71c5dd8738fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:24.673612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ee00561b-8941-4d40-b40e-71c5dd8738fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:24.674287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ee00561b-8941-4d40-b40e-71c5dd8738fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:24.674932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ee00561b-8941-4d40-b40e-71c5dd8738fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:25.093639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:25.230872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ee00561b-8941-4d40-b40e-71c5dd8738fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:25.238859 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ee00561b-8941-4d40-b40e-71c5dd8738fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.587955 Oct 04 21:45:25.241742 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3153/6327] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:24 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:26.272304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5fe4c054-32aa-4516-9459-6414bdfe6216 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:26.273519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5fe4c054-32aa-4516-9459-6414bdfe6216 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:26.292346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:26.293289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=28 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:26.295747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fe4c054-32aa-4516-9459-6414bdfe6216 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:26.300344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fe4c054-32aa-4516-9459-6414bdfe6216 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:26.301228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fe4c054-32aa-4516-9459-6414bdfe6216 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:26.303762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fe4c054-32aa-4516-9459-6414bdfe6216 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:26.305836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fe4c054-32aa-4516-9459-6414bdfe6216 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:26.310180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fe4c054-32aa-4516-9459-6414bdfe6216 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:26.429779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:26.895474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5fe4c054-32aa-4516-9459-6414bdfe6216 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:26.914989 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5fe4c054-32aa-4516-9459-6414bdfe6216 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.645213 Oct 04 21:45:26.919406 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3175/6328] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:26 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:27.942463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a49e4dfc-a8b9-4793-910b-b7561279fd5a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:27.944272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a49e4dfc-a8b9-4793-910b-b7561279fd5a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:27.947341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:27.953209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a49e4dfc-a8b9-4793-910b-b7561279fd5a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:27.959646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a49e4dfc-a8b9-4793-910b-b7561279fd5a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:27.960451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a49e4dfc-a8b9-4793-910b-b7561279fd5a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:27.961405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a49e4dfc-a8b9-4793-910b-b7561279fd5a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:27.962086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a49e4dfc-a8b9-4793-910b-b7561279fd5a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:27.962690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a49e4dfc-a8b9-4793-910b-b7561279fd5a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:29.109857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a49e4dfc-a8b9-4793-910b-b7561279fd5a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:29.130326 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a49e4dfc-a8b9-4793-910b-b7561279fd5a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 1.191684 Oct 04 21:45:29.133678 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3154/6329] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:27 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:29.438465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-10da0675-afc3-48ef-94a9-64d7031c8049 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:29.439055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-10da0675-afc3-48ef-94a9-64d7031c8049 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:29.466843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10da0675-afc3-48ef-94a9-64d7031c8049 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:29.468084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10da0675-afc3-48ef-94a9-64d7031c8049 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:29.468473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10da0675-afc3-48ef-94a9-64d7031c8049 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:29.469342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10da0675-afc3-48ef-94a9-64d7031c8049 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:29.472304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10da0675-afc3-48ef-94a9-64d7031c8049 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:29.476176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10da0675-afc3-48ef-94a9-64d7031c8049 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:29.680043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-10da0675-afc3-48ef-94a9-64d7031c8049 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lazy-loading 'services' on Instance uuid 2e17627c-075e-497f-9819-311e6a44c3e8 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:45:30.014448 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-10da0675-afc3-48ef-94a9-64d7031c8049 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8/os-volume_attachments/a19d5bc1-227d-4f3a-858e-9efe77e5cd06" status: 202 len: 0 microversion: 2.1 time: 0.580167 Oct 04 21:45:30.015854 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3176/6330] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 21:45:29 2022] DELETE /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8/os-volume_attachments/a19d5bc1-227d-4f3a-858e-9efe77e5cd06 => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:45:30.161777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-434eb5d2-553c-4864-8474-000b1cb9b3e5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:30.162232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-434eb5d2-553c-4864-8474-000b1cb9b3e5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:30.173270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-434eb5d2-553c-4864-8474-000b1cb9b3e5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:30.173773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-434eb5d2-553c-4864-8474-000b1cb9b3e5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:30.174213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-434eb5d2-553c-4864-8474-000b1cb9b3e5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:30.174923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-434eb5d2-553c-4864-8474-000b1cb9b3e5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:30.175375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-434eb5d2-553c-4864-8474-000b1cb9b3e5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:30.175920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-434eb5d2-553c-4864-8474-000b1cb9b3e5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:30.453334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-434eb5d2-553c-4864-8474-000b1cb9b3e5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:30.464767 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-434eb5d2-553c-4864-8474-000b1cb9b3e5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.307930 Oct 04 21:45:30.466125 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3155/6331] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:30 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:31.491801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d370f96d-7091-422f-8bbb-e6ee155dcdc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:31.493118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d370f96d-7091-422f-8bbb-e6ee155dcdc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:31.499954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d370f96d-7091-422f-8bbb-e6ee155dcdc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:31.500462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d370f96d-7091-422f-8bbb-e6ee155dcdc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:31.501027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d370f96d-7091-422f-8bbb-e6ee155dcdc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:31.502233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d370f96d-7091-422f-8bbb-e6ee155dcdc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:31.502649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d370f96d-7091-422f-8bbb-e6ee155dcdc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:31.503093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d370f96d-7091-422f-8bbb-e6ee155dcdc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:31.877491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d370f96d-7091-422f-8bbb-e6ee155dcdc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:31.887750 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d370f96d-7091-422f-8bbb-e6ee155dcdc2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.401192 Oct 04 21:45:31.889361 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3177/6332] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:31 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:32.917573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0e0292a9-0191-4c8a-98b4-fbecbb97a7d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:32.918885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0e0292a9-0191-4c8a-98b4-fbecbb97a7d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:32.926981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e0292a9-0191-4c8a-98b4-fbecbb97a7d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:32.928465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e0292a9-0191-4c8a-98b4-fbecbb97a7d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:32.929181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e0292a9-0191-4c8a-98b4-fbecbb97a7d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:32.930536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e0292a9-0191-4c8a-98b4-fbecbb97a7d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:32.931198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e0292a9-0191-4c8a-98b4-fbecbb97a7d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:32.931785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e0292a9-0191-4c8a-98b4-fbecbb97a7d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:33.213719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0e0292a9-0191-4c8a-98b4-fbecbb97a7d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:33.231865 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0e0292a9-0191-4c8a-98b4-fbecbb97a7d5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.322272 Oct 04 21:45:33.236222 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3156/6333] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:32 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:34.264617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fb4fd4ff-1ade-4333-88a9-6443503d9404 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:34.267469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fb4fd4ff-1ade-4333-88a9-6443503d9404 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:34.279659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb4fd4ff-1ade-4333-88a9-6443503d9404 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:34.283426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb4fd4ff-1ade-4333-88a9-6443503d9404 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:34.285633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb4fd4ff-1ade-4333-88a9-6443503d9404 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:34.286728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb4fd4ff-1ade-4333-88a9-6443503d9404 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:34.290944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb4fd4ff-1ade-4333-88a9-6443503d9404 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:34.293989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb4fd4ff-1ade-4333-88a9-6443503d9404 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:34.877166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fb4fd4ff-1ade-4333-88a9-6443503d9404 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:34.902662 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fb4fd4ff-1ade-4333-88a9-6443503d9404 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.643387 Oct 04 21:45:34.905913 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3178/6334] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:34 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:35.929250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e6603029-5b9a-4e3c-b24e-788b0c178b35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:35.930508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e6603029-5b9a-4e3c-b24e-788b0c178b35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:35.946795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6603029-5b9a-4e3c-b24e-788b0c178b35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:35.947488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6603029-5b9a-4e3c-b24e-788b0c178b35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:35.948098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6603029-5b9a-4e3c-b24e-788b0c178b35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:35.949151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6603029-5b9a-4e3c-b24e-788b0c178b35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:35.954928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6603029-5b9a-4e3c-b24e-788b0c178b35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:35.955598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e6603029-5b9a-4e3c-b24e-788b0c178b35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:37.156335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e6603029-5b9a-4e3c-b24e-788b0c178b35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:37.166696 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e6603029-5b9a-4e3c-b24e-788b0c178b35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 1.242209 Oct 04 21:45:37.175129 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3157/6335] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:35 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:38.200652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-24fa25bc-2d49-46ed-8cf3-f7db64b6c09a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:38.201340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-24fa25bc-2d49-46ed-8cf3-f7db64b6c09a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:38.211876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24fa25bc-2d49-46ed-8cf3-f7db64b6c09a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:38.212396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24fa25bc-2d49-46ed-8cf3-f7db64b6c09a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:38.212851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24fa25bc-2d49-46ed-8cf3-f7db64b6c09a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:38.213606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24fa25bc-2d49-46ed-8cf3-f7db64b6c09a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:38.224182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24fa25bc-2d49-46ed-8cf3-f7db64b6c09a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:38.236459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24fa25bc-2d49-46ed-8cf3-f7db64b6c09a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:39.451997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-697c1f66-fffc-4d5b-8bc1-eaf10f19251b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:39.453392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-697c1f66-fffc-4d5b-8bc1-eaf10f19251b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:39.465858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-697c1f66-fffc-4d5b-8bc1-eaf10f19251b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:39.466351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-697c1f66-fffc-4d5b-8bc1-eaf10f19251b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:39.466791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-697c1f66-fffc-4d5b-8bc1-eaf10f19251b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:39.468475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-697c1f66-fffc-4d5b-8bc1-eaf10f19251b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:39.469109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-697c1f66-fffc-4d5b-8bc1-eaf10f19251b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:39.472799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-697c1f66-fffc-4d5b-8bc1-eaf10f19251b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:39.500651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-697c1f66-fffc-4d5b-8bc1-eaf10f19251b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:45:39.529793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-24fa25bc-2d49-46ed-8cf3-f7db64b6c09a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:39.544053 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-24fa25bc-2d49-46ed-8cf3-f7db64b6c09a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 1.348903 Oct 04 21:45:39.589688 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3179/6336] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:38 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:40.013958 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-697c1f66-fffc-4d5b-8bc1-eaf10f19251b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 204 len: 0 microversion: 2.1 time: 0.563830 Oct 04 21:45:40.014891 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3158/6337] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:45:39 2022] DELETE /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:45:40.025186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-20695e81-8fa3-4cdc-9e0a-1997cc6f7859 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:40.026534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-20695e81-8fa3-4cdc-9e0a-1997cc6f7859 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:40.039409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20695e81-8fa3-4cdc-9e0a-1997cc6f7859 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:40.047405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20695e81-8fa3-4cdc-9e0a-1997cc6f7859 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:40.048180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20695e81-8fa3-4cdc-9e0a-1997cc6f7859 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:40.049374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20695e81-8fa3-4cdc-9e0a-1997cc6f7859 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:40.050143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20695e81-8fa3-4cdc-9e0a-1997cc6f7859 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:40.050867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20695e81-8fa3-4cdc-9e0a-1997cc6f7859 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:40.595270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8277ea82-2560-4a91-bc09-b25bdce8b9ae tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:40.595270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8277ea82-2560-4a91-bc09-b25bdce8b9ae tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:40.595922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-20695e81-8fa3-4cdc-9e0a-1997cc6f7859 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:40.603092 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-20695e81-8fa3-4cdc-9e0a-1997cc6f7859 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 200 len: 1515 microversion: 2.1 time: 0.583033 Oct 04 21:45:40.604488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8277ea82-2560-4a91-bc09-b25bdce8b9ae tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:40.605166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8277ea82-2560-4a91-bc09-b25bdce8b9ae tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:40.605905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8277ea82-2560-4a91-bc09-b25bdce8b9ae tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:40.606897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8277ea82-2560-4a91-bc09-b25bdce8b9ae tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:40.607601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8277ea82-2560-4a91-bc09-b25bdce8b9ae tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:40.608186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8277ea82-2560-4a91-bc09-b25bdce8b9ae tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:40.614632 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3180/6338] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:40 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 1515 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:40.909664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8277ea82-2560-4a91-bc09-b25bdce8b9ae tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:40.918685 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8277ea82-2560-4a91-bc09-b25bdce8b9ae tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.331665 Oct 04 21:45:40.919393 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3159/6339] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:40 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:41.629191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-de7c79b2-b6c1-4b78-aeb3-bdb826d3e58a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:41.630474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-de7c79b2-b6c1-4b78-aeb3-bdb826d3e58a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:41.652108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de7c79b2-b6c1-4b78-aeb3-bdb826d3e58a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:41.658108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de7c79b2-b6c1-4b78-aeb3-bdb826d3e58a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:41.658599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de7c79b2-b6c1-4b78-aeb3-bdb826d3e58a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:41.664518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de7c79b2-b6c1-4b78-aeb3-bdb826d3e58a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:41.665068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de7c79b2-b6c1-4b78-aeb3-bdb826d3e58a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:41.665579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de7c79b2-b6c1-4b78-aeb3-bdb826d3e58a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:41.949048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c414d675-79ab-4a34-8d62-402b1a22b6cb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:41.950375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c414d675-79ab-4a34-8d62-402b1a22b6cb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:41.961061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c414d675-79ab-4a34-8d62-402b1a22b6cb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:41.961838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c414d675-79ab-4a34-8d62-402b1a22b6cb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:41.962433 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c414d675-79ab-4a34-8d62-402b1a22b6cb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:41.963372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c414d675-79ab-4a34-8d62-402b1a22b6cb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:41.963981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c414d675-79ab-4a34-8d62-402b1a22b6cb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:41.964715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c414d675-79ab-4a34-8d62-402b1a22b6cb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:42.400308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-de7c79b2-b6c1-4b78-aeb3-bdb826d3e58a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:42.419348 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-de7c79b2-b6c1-4b78-aeb3-bdb826d3e58a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 200 len: 1515 microversion: 2.1 time: 0.793781 Oct 04 21:45:42.420527 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3181/6340] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:41 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 1515 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:42.731900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c414d675-79ab-4a34-8d62-402b1a22b6cb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:42.741052 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c414d675-79ab-4a34-8d62-402b1a22b6cb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.800719 Oct 04 21:45:42.774117 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3160/6341] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:41 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:43.448690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6afc7db8-593d-4b6a-9e35-8da9ae2c4e02 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:43.450035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6afc7db8-593d-4b6a-9e35-8da9ae2c4e02 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:43.463854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6afc7db8-593d-4b6a-9e35-8da9ae2c4e02 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:43.465000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6afc7db8-593d-4b6a-9e35-8da9ae2c4e02 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:43.465674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6afc7db8-593d-4b6a-9e35-8da9ae2c4e02 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:43.466466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6afc7db8-593d-4b6a-9e35-8da9ae2c4e02 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:43.467127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6afc7db8-593d-4b6a-9e35-8da9ae2c4e02 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:43.467580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6afc7db8-593d-4b6a-9e35-8da9ae2c4e02 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:43.767775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6afc7db8-593d-4b6a-9e35-8da9ae2c4e02 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:43.774230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d8d4088b-d2e3-402b-956b-e8d57d36784f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:43.777179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d8d4088b-d2e3-402b-956b-e8d57d36784f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:43.793467 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6afc7db8-593d-4b6a-9e35-8da9ae2c4e02 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 200 len: 1515 microversion: 2.1 time: 0.352488 Oct 04 21:45:43.800183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8d4088b-d2e3-402b-956b-e8d57d36784f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:43.800957 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3182/6342] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:43 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 1515 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:43.801764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8d4088b-d2e3-402b-956b-e8d57d36784f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:43.802727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8d4088b-d2e3-402b-956b-e8d57d36784f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:43.806386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8d4088b-d2e3-402b-956b-e8d57d36784f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:43.807717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8d4088b-d2e3-402b-956b-e8d57d36784f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:43.809143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8d4088b-d2e3-402b-956b-e8d57d36784f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:43.845876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-ec0e5d0a-8429-4a13-a35e-855e21bb044b req-2eb896c7-f815-4b8a-92d9-ffc5f72b78ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e17627c-075e-497f-9819-311e6a44c3e8", "name": "network-vif-deleted", "tag": "30801044-4e0f-4373-835a-41d4754c6e5b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:43.871585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ec0e5d0a-8429-4a13-a35e-855e21bb044b req-2eb896c7-f815-4b8a-92d9-ffc5f72b78ee service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:43.875286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ec0e5d0a-8429-4a13-a35e-855e21bb044b req-2eb896c7-f815-4b8a-92d9-ffc5f72b78ee service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:43.878381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ec0e5d0a-8429-4a13-a35e-855e21bb044b req-2eb896c7-f815-4b8a-92d9-ffc5f72b78ee service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:43.909829 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-ec0e5d0a-8429-4a13-a35e-855e21bb044b req-2eb896c7-f815-4b8a-92d9-ffc5f72b78ee service nova] Creating event network-vif-deleted:30801044-4e0f-4373-835a-41d4754c6e5b for instance 2e17627c-075e-497f-9819-311e6a44c3e8 on n-h2-860282-1 Oct 04 21:45:43.921184 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-ec0e5d0a-8429-4a13-a35e-855e21bb044b req-2eb896c7-f815-4b8a-92d9-ffc5f72b78ee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088122 Oct 04 21:45:43.922279 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3183/6343] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:44.080884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d8d4088b-d2e3-402b-956b-e8d57d36784f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:44.090023 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d8d4088b-d2e3-402b-956b-e8d57d36784f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.328499 Oct 04 21:45:44.100082 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3161/6344] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:43 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:44.829687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b1072119-aa5e-4273-afa5-2667907c258c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:44.831800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b1072119-aa5e-4273-afa5-2667907c258c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:44.848871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1072119-aa5e-4273-afa5-2667907c258c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:44.849511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1072119-aa5e-4273-afa5-2667907c258c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:44.853699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1072119-aa5e-4273-afa5-2667907c258c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:44.854603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1072119-aa5e-4273-afa5-2667907c258c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:44.855000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1072119-aa5e-4273-afa5-2667907c258c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:44.855454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1072119-aa5e-4273-afa5-2667907c258c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:44.905978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1072119-aa5e-4273-afa5-2667907c258c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:44.906794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1072119-aa5e-4273-afa5-2667907c258c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:44.907421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1072119-aa5e-4273-afa5-2667907c258c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:44.908109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-b1072119-aa5e-4273-afa5-2667907c258c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lazy-loading 'fault' on Instance uuid 2e17627c-075e-497f-9819-311e6a44c3e8 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:45:44.965123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b1072119-aa5e-4273-afa5-2667907c258c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:44.974450 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b1072119-aa5e-4273-afa5-2667907c258c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 200 len: 1309 microversion: 2.1 time: 0.152682 Oct 04 21:45:44.975590 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3184/6345] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:44 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 1309 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:45.134716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f6986bf4-4401-4537-b072-5bd73f5cb031 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:45.137389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f6986bf4-4401-4537-b072-5bd73f5cb031 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:45.147258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6986bf4-4401-4537-b072-5bd73f5cb031 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:45.148185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6986bf4-4401-4537-b072-5bd73f5cb031 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:45.149286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6986bf4-4401-4537-b072-5bd73f5cb031 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:45.151339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6986bf4-4401-4537-b072-5bd73f5cb031 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:45.152163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6986bf4-4401-4537-b072-5bd73f5cb031 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:45.162582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f6986bf4-4401-4537-b072-5bd73f5cb031 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:45.379327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f6986bf4-4401-4537-b072-5bd73f5cb031 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:45.402064 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f6986bf4-4401-4537-b072-5bd73f5cb031 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.289611 Oct 04 21:45:45.405793 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3162/6346] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:45 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:46.000901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2c56b469-d706-47d5-ac46-64669105c17a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:46.001652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2c56b469-d706-47d5-ac46-64669105c17a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 2e17627c-075e-497f-9819-311e6a44c3e8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:46.016877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c56b469-d706-47d5-ac46-64669105c17a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:46.028336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c56b469-d706-47d5-ac46-64669105c17a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:46.028336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c56b469-d706-47d5-ac46-64669105c17a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:46.028336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c56b469-d706-47d5-ac46-64669105c17a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:46.028336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c56b469-d706-47d5-ac46-64669105c17a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:46.028336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c56b469-d706-47d5-ac46-64669105c17a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-2c56b469-d706-47d5-ac46-64669105c17a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] HTTP exception thrown: Instance 2e17627c-075e-497f-9819-311e6a44c3e8 could not be found. Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2c56b469-d706-47d5-ac46-64669105c17a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Request method failure captured: Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 HTTP/1.1 Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKiBQEQCh15vb1e3yqhEHMW0ClXtoo06msD9mBztExCZhdxWSZDMa-Xy5aGjafEwyEAWw_W8e9DH0z1uKHnqGvGh6oKgOxU3seriiIMZDb831wrb2duVdM43NeQ0AIedXR20t3eaqvaRO7hkuyBtu22RI-Sjbksunlwvfh092LnzKX8 Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: dace97a17e0b4ff69a81c51fe9cbbad2 Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-VolumesSnapshotTestJSON-272117851 Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dace97a17e0b4ff69a81c51fe9cbbad2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dace97a17e0b4ff69a81c51fe9cbbad2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dace97a17e0b4ff69a81c51fe9cbbad2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dace97a17e0b4ff69a81c51fe9cbbad2"}]}] Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-VolumesSnapshotTestJSON-272117851 Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: dace97a17e0b4ff69a81c51fe9cbbad2 Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-272117851 Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-VolumesSnapshotTestJSON-272117851-project Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 8489539e7c9c4039ac1168acab3a3ed5 Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-VolumesSnapshotTestJSON-272117851-project Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 2e17627c-075e-497f-9819-311e6a44c3e8 could not be found. Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '2e17627c-075e-497f-9819-311e6a44c3e8'} Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e17627c-075e-497f-9819-311e6a44c3e8 could not be found. Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:45:46.061181 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:45:46.065292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e17627c-075e-497f-9819-311e6a44c3e8 could not be found. Oct 04 21:45:46.065292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:45:46.065292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:46.065292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:45:46.065292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:46.065292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:46.065292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:46.065292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:45:46.065292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:45:46.065292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e17627c-075e-497f-9819-311e6a44c3e8 could not be found. Oct 04 21:45:46.065292 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:45:46.065292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2c56b469-d706-47d5-ac46-64669105c17a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Returning 404 to user: Instance 2e17627c-075e-497f-9819-311e6a44c3e8 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:45:46.065292 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2c56b469-d706-47d5-ac46-64669105c17a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8" status: 404 len: 111 microversion: 2.1 time: 0.057829 Oct 04 21:45:46.065292 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3185/6347] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:45 2022] GET /compute/v2.1/servers/2e17627c-075e-497f-9819-311e6a44c3e8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:45:46.429201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-50b6ec12-688c-43aa-99be-e9bcfe4b0642 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:46.431078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-50b6ec12-688c-43aa-99be-e9bcfe4b0642 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:46.444716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50b6ec12-688c-43aa-99be-e9bcfe4b0642 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:46.448959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50b6ec12-688c-43aa-99be-e9bcfe4b0642 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:46.449936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50b6ec12-688c-43aa-99be-e9bcfe4b0642 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:46.452325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50b6ec12-688c-43aa-99be-e9bcfe4b0642 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:46.454066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50b6ec12-688c-43aa-99be-e9bcfe4b0642 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:46.455072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50b6ec12-688c-43aa-99be-e9bcfe4b0642 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:47.179688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-50b6ec12-688c-43aa-99be-e9bcfe4b0642 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:47.200410 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-50b6ec12-688c-43aa-99be-e9bcfe4b0642 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.776865 Oct 04 21:45:47.210292 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3163/6348] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:46 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:48.229351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7dfa58bb-50f9-4048-9103-0b82b3e0ca06 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:48.230445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7dfa58bb-50f9-4048-9103-0b82b3e0ca06 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:48.236861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7dfa58bb-50f9-4048-9103-0b82b3e0ca06 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:48.237462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7dfa58bb-50f9-4048-9103-0b82b3e0ca06 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:48.238009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7dfa58bb-50f9-4048-9103-0b82b3e0ca06 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:48.238805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7dfa58bb-50f9-4048-9103-0b82b3e0ca06 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:48.239466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7dfa58bb-50f9-4048-9103-0b82b3e0ca06 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:48.241018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7dfa58bb-50f9-4048-9103-0b82b3e0ca06 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:48.906838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7dfa58bb-50f9-4048-9103-0b82b3e0ca06 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:48.917834 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7dfa58bb-50f9-4048-9103-0b82b3e0ca06 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.694967 Oct 04 21:45:48.919928 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3186/6349] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:48 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:49.944792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-472086f2-b32b-4659-a64e-cf5a9ac08f29 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:49.945523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-472086f2-b32b-4659-a64e-cf5a9ac08f29 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:49.975249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-472086f2-b32b-4659-a64e-cf5a9ac08f29 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:49.975249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-472086f2-b32b-4659-a64e-cf5a9ac08f29 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:49.975249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-472086f2-b32b-4659-a64e-cf5a9ac08f29 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:49.975249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-472086f2-b32b-4659-a64e-cf5a9ac08f29 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:49.975249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-472086f2-b32b-4659-a64e-cf5a9ac08f29 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:49.975249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-472086f2-b32b-4659-a64e-cf5a9ac08f29 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:50.491494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-472086f2-b32b-4659-a64e-cf5a9ac08f29 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:50.503183 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-472086f2-b32b-4659-a64e-cf5a9ac08f29 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.562540 Oct 04 21:45:50.504517 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3164/6350] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:49 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:51.527272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8cc220fe-9a82-458c-8b91-ea64015ccb46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:51.540431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8cc220fe-9a82-458c-8b91-ea64015ccb46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:51.556994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8cc220fe-9a82-458c-8b91-ea64015ccb46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:51.558446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8cc220fe-9a82-458c-8b91-ea64015ccb46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:51.559088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8cc220fe-9a82-458c-8b91-ea64015ccb46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:51.560022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8cc220fe-9a82-458c-8b91-ea64015ccb46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:51.561450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8cc220fe-9a82-458c-8b91-ea64015ccb46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:51.562080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8cc220fe-9a82-458c-8b91-ea64015ccb46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:51.841915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8cc220fe-9a82-458c-8b91-ea64015ccb46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:51.857913 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8cc220fe-9a82-458c-8b91-ea64015ccb46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.330648 Oct 04 21:45:51.859371 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3187/6351] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:51 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:52.885145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e9f1152b-06ee-4106-b1de-9aacbfe3854f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:52.886488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e9f1152b-06ee-4106-b1de-9aacbfe3854f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:52.898259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9f1152b-06ee-4106-b1de-9aacbfe3854f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:52.898764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9f1152b-06ee-4106-b1de-9aacbfe3854f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:52.899205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9f1152b-06ee-4106-b1de-9aacbfe3854f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:52.901290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9f1152b-06ee-4106-b1de-9aacbfe3854f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:52.901290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9f1152b-06ee-4106-b1de-9aacbfe3854f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:52.901600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9f1152b-06ee-4106-b1de-9aacbfe3854f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:53.060814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e9f1152b-06ee-4106-b1de-9aacbfe3854f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:53.069625 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e9f1152b-06ee-4106-b1de-9aacbfe3854f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.188628 Oct 04 21:45:53.074545 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3165/6352] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:52 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:54.098730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9a3d8442-e38d-4669-aedc-c7205c24c505 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:54.100673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9a3d8442-e38d-4669-aedc-c7205c24c505 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:54.108681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a3d8442-e38d-4669-aedc-c7205c24c505 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:54.109488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a3d8442-e38d-4669-aedc-c7205c24c505 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:54.109957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a3d8442-e38d-4669-aedc-c7205c24c505 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:54.110829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a3d8442-e38d-4669-aedc-c7205c24c505 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:54.111463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a3d8442-e38d-4669-aedc-c7205c24c505 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:54.112068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a3d8442-e38d-4669-aedc-c7205c24c505 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:54.328626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9a3d8442-e38d-4669-aedc-c7205c24c505 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:54.341593 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9a3d8442-e38d-4669-aedc-c7205c24c505 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.250695 Oct 04 21:45:54.356258 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3188/6353] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:54 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:55.381320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4e95c47b-214b-4c9d-b1d0-665cf30e860f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:55.382528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4e95c47b-214b-4c9d-b1d0-665cf30e860f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:55.394806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:55.397487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e95c47b-214b-4c9d-b1d0-665cf30e860f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:55.397965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e95c47b-214b-4c9d-b1d0-665cf30e860f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:55.398424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e95c47b-214b-4c9d-b1d0-665cf30e860f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:55.399194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e95c47b-214b-4c9d-b1d0-665cf30e860f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:55.399765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e95c47b-214b-4c9d-b1d0-665cf30e860f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:55.400418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e95c47b-214b-4c9d-b1d0-665cf30e860f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:55.405341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:55.699020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4e95c47b-214b-4c9d-b1d0-665cf30e860f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:55.711971 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4e95c47b-214b-4c9d-b1d0-665cf30e860f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.345315 Oct 04 21:45:55.712372 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3166/6354] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:55 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:56.743515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-81768196-d660-4099-b1e8-7c2aaa330d07 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:56.744166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-81768196-d660-4099-b1e8-7c2aaa330d07 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:56.749304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=30 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:56.758615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81768196-d660-4099-b1e8-7c2aaa330d07 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:56.759154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81768196-d660-4099-b1e8-7c2aaa330d07 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:56.759616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81768196-d660-4099-b1e8-7c2aaa330d07 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:56.761292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81768196-d660-4099-b1e8-7c2aaa330d07 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:56.761954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81768196-d660-4099-b1e8-7c2aaa330d07 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:56.762452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81768196-d660-4099-b1e8-7c2aaa330d07 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:57.641776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-81768196-d660-4099-b1e8-7c2aaa330d07 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:57.652574 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-81768196-d660-4099-b1e8-7c2aaa330d07 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.917412 Oct 04 21:45:57.684167 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3189/6355] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:56 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:57.967686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8e2bbde2-fddb-41a5-8571-1439fc564a5c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-589949536", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "7470c2c9-e763-451b-979d-629e167a2187"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:57.991290 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:45:57.991730 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 21:45:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Oct 04 21:45:58.282475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-8e2bbde2-fddb-41a5-8571-1439fc564a5c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] validate_networks() for [('7470c2c9-e763-451b-979d-629e167a2187', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:45:58.680649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a65930b9-872a-40fa-b80c-1d35243e8514 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:58.682115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a65930b9-872a-40fa-b80c-1d35243e8514 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:58.691908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a65930b9-872a-40fa-b80c-1d35243e8514 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:58.692939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a65930b9-872a-40fa-b80c-1d35243e8514 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:58.693944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a65930b9-872a-40fa-b80c-1d35243e8514 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:58.695116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a65930b9-872a-40fa-b80c-1d35243e8514 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:58.695796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a65930b9-872a-40fa-b80c-1d35243e8514 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:58.696478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a65930b9-872a-40fa-b80c-1d35243e8514 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:59.215314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a65930b9-872a-40fa-b80c-1d35243e8514 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:59.231665 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a65930b9-872a-40fa-b80c-1d35243e8514 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.555196 Oct 04 21:45:59.232931 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3190/6356] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:58 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:59.358735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-8e2bbde2-fddb-41a5-8571-1439fc564a5c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:45:59.360000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-8e2bbde2-fddb-41a5-8571-1439fc564a5c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:45:59.360761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-8e2bbde2-fddb-41a5-8571-1439fc564a5c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:45:59.361346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-8e2bbde2-fddb-41a5-8571-1439fc564a5c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:45:59.361810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-8e2bbde2-fddb-41a5-8571-1439fc564a5c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:45:59.378773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e2bbde2-fddb-41a5-8571-1439fc564a5c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:59.379691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e2bbde2-fddb-41a5-8571-1439fc564a5c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:59.380277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e2bbde2-fddb-41a5-8571-1439fc564a5c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:59.383830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e2bbde2-fddb-41a5-8571-1439fc564a5c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:59.384575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e2bbde2-fddb-41a5-8571-1439fc564a5c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:59.386177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8e2bbde2-fddb-41a5-8571-1439fc564a5c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:59.420621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-8e2bbde2-fddb-41a5-8571-1439fc564a5c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Getting quotas for project dace97a17e0b4ff69a81c51fe9cbbad2. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:45:59.426292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-8e2bbde2-fddb-41a5-8571-1439fc564a5c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Getting quotas for user 8489539e7c9c4039ac1168acab3a3ed5 and project dace97a17e0b4ff69a81c51fe9cbbad2. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:45:59.448900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8e2bbde2-fddb-41a5-8571-1439fc564a5c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:45:59.448900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8e2bbde2-fddb-41a5-8571-1439fc564a5c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:45:59.683103 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8e2bbde2-fddb-41a5-8571-1439fc564a5c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.720144 Oct 04 21:45:59.684768 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3167/6357] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:45:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:45:59.698141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f0f5644c-8f0a-43c1-9470-14a91dc895ec tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:59.700059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f0f5644c-8f0a-43c1-9470-14a91dc895ec tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:59.873912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f0f5644c-8f0a-43c1-9470-14a91dc895ec tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:59.885530 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f0f5644c-8f0a-43c1-9470-14a91dc895ec tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 200 len: 1218 microversion: 2.1 time: 0.193582 Oct 04 21:45:59.886756 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3191/6358] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:59 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 1218 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:00.258316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b339a95b-e6d1-4acb-bfcb-47612b32f68d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:00.259145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b339a95b-e6d1-4acb-bfcb-47612b32f68d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:00.270952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b339a95b-e6d1-4acb-bfcb-47612b32f68d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:00.271707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b339a95b-e6d1-4acb-bfcb-47612b32f68d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:00.272390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b339a95b-e6d1-4acb-bfcb-47612b32f68d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:00.273339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b339a95b-e6d1-4acb-bfcb-47612b32f68d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:00.274007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b339a95b-e6d1-4acb-bfcb-47612b32f68d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:00.274541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b339a95b-e6d1-4acb-bfcb-47612b32f68d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:00.739242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b339a95b-e6d1-4acb-bfcb-47612b32f68d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:00.758204 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b339a95b-e6d1-4acb-bfcb-47612b32f68d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.505696 Oct 04 21:46:00.780061 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3168/6359] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:00 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:00.909963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-99e87e73-4417-4d30-a507-6fcb1479e883 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:00.910728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-99e87e73-4417-4d30-a507-6fcb1479e883 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:01.046549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-99e87e73-4417-4d30-a507-6fcb1479e883 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:01.056526 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-99e87e73-4417-4d30-a507-6fcb1479e883 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 200 len: 1218 microversion: 2.1 time: 0.151974 Oct 04 21:46:01.063800 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3192/6360] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:00 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 1218 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:01.795655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d361f9ef-9203-4d95-a337-078f8ea22b6f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:01.796374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d361f9ef-9203-4d95-a337-078f8ea22b6f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:01.812188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d361f9ef-9203-4d95-a337-078f8ea22b6f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:01.817334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d361f9ef-9203-4d95-a337-078f8ea22b6f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:01.819372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d361f9ef-9203-4d95-a337-078f8ea22b6f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:01.820723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d361f9ef-9203-4d95-a337-078f8ea22b6f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:01.824854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d361f9ef-9203-4d95-a337-078f8ea22b6f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:01.825734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d361f9ef-9203-4d95-a337-078f8ea22b6f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:02.095397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5e368991-048d-48e8-81a7-cf65f659882f tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:02.095397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5e368991-048d-48e8-81a7-cf65f659882f tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:02.114041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e368991-048d-48e8-81a7-cf65f659882f tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:02.114572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e368991-048d-48e8-81a7-cf65f659882f tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:02.115591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e368991-048d-48e8-81a7-cf65f659882f tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:02.116652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e368991-048d-48e8-81a7-cf65f659882f tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:02.117142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e368991-048d-48e8-81a7-cf65f659882f tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:02.120667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e368991-048d-48e8-81a7-cf65f659882f tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:02.132733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:02.312128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5e368991-048d-48e8-81a7-cf65f659882f tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:02.321152 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5e368991-048d-48e8-81a7-cf65f659882f tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 200 len: 1222 microversion: 2.1 time: 0.234446 Oct 04 21:46:02.341520 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3193/6361] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:02 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 1222 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:02.413893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d361f9ef-9203-4d95-a337-078f8ea22b6f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:02.431187 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d361f9ef-9203-4d95-a337-078f8ea22b6f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.646831 Oct 04 21:46:02.431798 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3169/6362] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:01 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:03.356456 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4e6b7621-b1e4-496e-b6bf-22b4cff662e9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:03.360623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4e6b7621-b1e4-496e-b6bf-22b4cff662e9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:03.366741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e6b7621-b1e4-496e-b6bf-22b4cff662e9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:03.367250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e6b7621-b1e4-496e-b6bf-22b4cff662e9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:03.367702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e6b7621-b1e4-496e-b6bf-22b4cff662e9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:03.368420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e6b7621-b1e4-496e-b6bf-22b4cff662e9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:03.368916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e6b7621-b1e4-496e-b6bf-22b4cff662e9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:03.369598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e6b7621-b1e4-496e-b6bf-22b4cff662e9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:03.448065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4e6b7621-b1e4-496e-b6bf-22b4cff662e9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:03.455624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-adbb21a5-5eac-4ff8-baf6-167e81763456 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:03.461660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-adbb21a5-5eac-4ff8-baf6-167e81763456 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:03.462024 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4e6b7621-b1e4-496e-b6bf-22b4cff662e9 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 200 len: 1270 microversion: 2.1 time: 0.107080 Oct 04 21:46:03.462024 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3194/6363] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:03 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:03.465469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adbb21a5-5eac-4ff8-baf6-167e81763456 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:03.466135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adbb21a5-5eac-4ff8-baf6-167e81763456 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:03.466803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adbb21a5-5eac-4ff8-baf6-167e81763456 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:03.467669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adbb21a5-5eac-4ff8-baf6-167e81763456 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:03.468128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adbb21a5-5eac-4ff8-baf6-167e81763456 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:03.468736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-adbb21a5-5eac-4ff8-baf6-167e81763456 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:03.679693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-adbb21a5-5eac-4ff8-baf6-167e81763456 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:03.684856 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-adbb21a5-5eac-4ff8-baf6-167e81763456 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.233257 Oct 04 21:46:03.685651 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3170/6364] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:03 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:04.492126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e58141a5-b2b2-4fff-a407-54c8159ed0e4 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:04.493645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e58141a5-b2b2-4fff-a407-54c8159ed0e4 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:04.514018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e58141a5-b2b2-4fff-a407-54c8159ed0e4 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:04.514573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e58141a5-b2b2-4fff-a407-54c8159ed0e4 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:04.515047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e58141a5-b2b2-4fff-a407-54c8159ed0e4 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:04.515787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e58141a5-b2b2-4fff-a407-54c8159ed0e4 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:04.516274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e58141a5-b2b2-4fff-a407-54c8159ed0e4 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:04.516729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e58141a5-b2b2-4fff-a407-54c8159ed0e4 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:04.615272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e58141a5-b2b2-4fff-a407-54c8159ed0e4 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:04.625957 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e58141a5-b2b2-4fff-a407-54c8159ed0e4 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 200 len: 1276 microversion: 2.1 time: 0.143912 Oct 04 21:46:04.654924 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3195/6365] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:04 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 1276 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:04.715978 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9dceaf39-50c4-4c95-8ac1-4fc9ac488435 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:04.718616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9dceaf39-50c4-4c95-8ac1-4fc9ac488435 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:04.733898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dceaf39-50c4-4c95-8ac1-4fc9ac488435 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:04.735866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dceaf39-50c4-4c95-8ac1-4fc9ac488435 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:04.737550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dceaf39-50c4-4c95-8ac1-4fc9ac488435 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:04.738515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dceaf39-50c4-4c95-8ac1-4fc9ac488435 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:04.739145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dceaf39-50c4-4c95-8ac1-4fc9ac488435 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:04.739793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dceaf39-50c4-4c95-8ac1-4fc9ac488435 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:04.987378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9dceaf39-50c4-4c95-8ac1-4fc9ac488435 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:05.002178 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9dceaf39-50c4-4c95-8ac1-4fc9ac488435 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.296727 Oct 04 21:46:05.017575 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3171/6366] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:04 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:05.661649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d4ea2736-8a48-4127-9275-532f2db1c968 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:05.662844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d4ea2736-8a48-4127-9275-532f2db1c968 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:05.674795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4ea2736-8a48-4127-9275-532f2db1c968 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:05.676607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4ea2736-8a48-4127-9275-532f2db1c968 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:05.677212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4ea2736-8a48-4127-9275-532f2db1c968 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:05.678421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4ea2736-8a48-4127-9275-532f2db1c968 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:05.679010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4ea2736-8a48-4127-9275-532f2db1c968 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:05.682869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4ea2736-8a48-4127-9275-532f2db1c968 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:06.036344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-baeecb43-03e4-4de9-a257-9b6e8b77ed8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:06.038737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-baeecb43-03e4-4de9-a257-9b6e8b77ed8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:06.054322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-baeecb43-03e4-4de9-a257-9b6e8b77ed8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:06.055081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-baeecb43-03e4-4de9-a257-9b6e8b77ed8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:06.058602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-baeecb43-03e4-4de9-a257-9b6e8b77ed8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:06.059887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-baeecb43-03e4-4de9-a257-9b6e8b77ed8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:06.061340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-baeecb43-03e4-4de9-a257-9b6e8b77ed8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:06.062460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-baeecb43-03e4-4de9-a257-9b6e8b77ed8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:06.215030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d4ea2736-8a48-4127-9275-532f2db1c968 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:06.223196 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d4ea2736-8a48-4127-9275-532f2db1c968 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 200 len: 1318 microversion: 2.1 time: 0.568957 Oct 04 21:46:06.225022 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3196/6367] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:05 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 1318 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:06.497292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-baeecb43-03e4-4de9-a257-9b6e8b77ed8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:06.549187 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-baeecb43-03e4-4de9-a257-9b6e8b77ed8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.524084 Oct 04 21:46:06.554832 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3172/6368] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:06 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:07.255949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9b367e42-3f4f-4121-9885-d36b7f1bf9db tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:07.256603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9b367e42-3f4f-4121-9885-d36b7f1bf9db tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:07.272146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b367e42-3f4f-4121-9885-d36b7f1bf9db tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.272660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b367e42-3f4f-4121-9885-d36b7f1bf9db tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.273958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b367e42-3f4f-4121-9885-d36b7f1bf9db tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.274712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b367e42-3f4f-4121-9885-d36b7f1bf9db tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.275192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b367e42-3f4f-4121-9885-d36b7f1bf9db tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.278910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b367e42-3f4f-4121-9885-d36b7f1bf9db tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.577190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b65c82ec-50c8-489a-8caf-74dd46938ba7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:07.577972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b65c82ec-50c8-489a-8caf-74dd46938ba7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:07.589486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b65c82ec-50c8-489a-8caf-74dd46938ba7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.589909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b65c82ec-50c8-489a-8caf-74dd46938ba7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.590531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b65c82ec-50c8-489a-8caf-74dd46938ba7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.591254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b65c82ec-50c8-489a-8caf-74dd46938ba7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:07.591717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b65c82ec-50c8-489a-8caf-74dd46938ba7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:07.592152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b65c82ec-50c8-489a-8caf-74dd46938ba7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:07.630720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9b367e42-3f4f-4121-9885-d36b7f1bf9db tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:07.640896 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9b367e42-3f4f-4121-9885-d36b7f1bf9db tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 200 len: 1318 microversion: 2.1 time: 0.393634 Oct 04 21:46:07.651000 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3197/6369] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:07 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:07.976859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b65c82ec-50c8-489a-8caf-74dd46938ba7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:07.988700 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b65c82ec-50c8-489a-8caf-74dd46938ba7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.415262 Oct 04 21:46:07.996607 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3173/6370] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:07 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:08.667688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-03047015-8392-4115-a8d8-4c3efc8fd3b7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:08.668419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-03047015-8392-4115-a8d8-4c3efc8fd3b7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:08.679930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03047015-8392-4115-a8d8-4c3efc8fd3b7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:08.680513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03047015-8392-4115-a8d8-4c3efc8fd3b7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:08.688105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03047015-8392-4115-a8d8-4c3efc8fd3b7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:08.689142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03047015-8392-4115-a8d8-4c3efc8fd3b7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:08.689893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03047015-8392-4115-a8d8-4c3efc8fd3b7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:08.690531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03047015-8392-4115-a8d8-4c3efc8fd3b7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:08.943662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-03047015-8392-4115-a8d8-4c3efc8fd3b7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:08.947148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-90b7e316-d263-4a0d-aca2-b3b1499a694c req-df044d13-ce7e-4c09-9178-1df0efb00ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31308c42-b5ea-4019-a5e8-8b02dfdea368", "tag": "5051c8db-389d-472f-a009-d33937767690"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:08.959199 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-03047015-8392-4115-a8d8-4c3efc8fd3b7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 200 len: 1318 microversion: 2.1 time: 0.295292 Oct 04 21:46:08.959810 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3198/6371] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:08 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:08.977201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-90b7e316-d263-4a0d-aca2-b3b1499a694c req-df044d13-ce7e-4c09-9178-1df0efb00ff8 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:08.977905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-90b7e316-d263-4a0d-aca2-b3b1499a694c req-df044d13-ce7e-4c09-9178-1df0efb00ff8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:08.978499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-90b7e316-d263-4a0d-aca2-b3b1499a694c req-df044d13-ce7e-4c09-9178-1df0efb00ff8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:08.994366 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-90b7e316-d263-4a0d-aca2-b3b1499a694c req-df044d13-ce7e-4c09-9178-1df0efb00ff8 service nova] Creating event network-changed:5051c8db-389d-472f-a009-d33937767690 for instance 31308c42-b5ea-4019-a5e8-8b02dfdea368 on n-h1-860282-1 Oct 04 21:46:09.004444 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-90b7e316-d263-4a0d-aca2-b3b1499a694c req-df044d13-ce7e-4c09-9178-1df0efb00ff8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061510 Oct 04 21:46:09.005648 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3174/6372] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:09.019168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-43452beb-1afd-4544-af86-eb97f8ff97cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:09.021756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-43452beb-1afd-4544-af86-eb97f8ff97cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:09.030724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43452beb-1afd-4544-af86-eb97f8ff97cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:09.031574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43452beb-1afd-4544-af86-eb97f8ff97cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:09.032237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43452beb-1afd-4544-af86-eb97f8ff97cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:09.033932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43452beb-1afd-4544-af86-eb97f8ff97cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:09.034621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43452beb-1afd-4544-af86-eb97f8ff97cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:09.035272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43452beb-1afd-4544-af86-eb97f8ff97cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:09.521795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-43452beb-1afd-4544-af86-eb97f8ff97cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:09.536247 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-43452beb-1afd-4544-af86-eb97f8ff97cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.518415 Oct 04 21:46:09.540982 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3199/6373] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:09 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:09.991530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-392d3ecb-b2fc-4985-9055-f5bb54f0b02b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:09.993309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-392d3ecb-b2fc-4985-9055-f5bb54f0b02b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:09.997394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:09.998507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:10.004589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-392d3ecb-b2fc-4985-9055-f5bb54f0b02b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:10.005522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-392d3ecb-b2fc-4985-9055-f5bb54f0b02b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:10.006744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-392d3ecb-b2fc-4985-9055-f5bb54f0b02b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:10.007838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-392d3ecb-b2fc-4985-9055-f5bb54f0b02b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:10.008872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-392d3ecb-b2fc-4985-9055-f5bb54f0b02b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:10.010412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-392d3ecb-b2fc-4985-9055-f5bb54f0b02b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:10.437555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-392d3ecb-b2fc-4985-9055-f5bb54f0b02b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:10.447435 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-392d3ecb-b2fc-4985-9055-f5bb54f0b02b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 200 len: 1318 microversion: 2.1 time: 0.468353 Oct 04 21:46:10.448815 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3175/6374] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:09 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 1318 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:10.567514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d3c38f96-dac6-44c7-aed6-6116de233408 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:10.576985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d3c38f96-dac6-44c7-aed6-6116de233408 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:10.582839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3c38f96-dac6-44c7-aed6-6116de233408 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:10.583373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3c38f96-dac6-44c7-aed6-6116de233408 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:10.584425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3c38f96-dac6-44c7-aed6-6116de233408 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:10.585445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3c38f96-dac6-44c7-aed6-6116de233408 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:10.585941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3c38f96-dac6-44c7-aed6-6116de233408 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:10.592100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3c38f96-dac6-44c7-aed6-6116de233408 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:10.856254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d3c38f96-dac6-44c7-aed6-6116de233408 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:10.877080 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d3c38f96-dac6-44c7-aed6-6116de233408 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.311280 Oct 04 21:46:10.878637 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3200/6375] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:10 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:11.473325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fa05380a-b44e-4a45-b9b2-5544b43105e5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:11.473989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fa05380a-b44e-4a45-b9b2-5544b43105e5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:11.483023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa05380a-b44e-4a45-b9b2-5544b43105e5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:11.483520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa05380a-b44e-4a45-b9b2-5544b43105e5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:11.483964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa05380a-b44e-4a45-b9b2-5544b43105e5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:11.484679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa05380a-b44e-4a45-b9b2-5544b43105e5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:11.485144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa05380a-b44e-4a45-b9b2-5544b43105e5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:11.497245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa05380a-b44e-4a45-b9b2-5544b43105e5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:11.791617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fa05380a-b44e-4a45-b9b2-5544b43105e5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:11.801315 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fa05380a-b44e-4a45-b9b2-5544b43105e5 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 200 len: 1318 microversion: 2.1 time: 0.332145 Oct 04 21:46:11.802347 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3176/6376] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:11 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:11.903060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5e38bfa9-3259-435e-95ea-8382f1c8bfd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:11.903833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5e38bfa9-3259-435e-95ea-8382f1c8bfd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:11.917066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:11.923148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e38bfa9-3259-435e-95ea-8382f1c8bfd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:11.923943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e38bfa9-3259-435e-95ea-8382f1c8bfd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:11.924597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e38bfa9-3259-435e-95ea-8382f1c8bfd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:11.925705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e38bfa9-3259-435e-95ea-8382f1c8bfd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:11.926421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e38bfa9-3259-435e-95ea-8382f1c8bfd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:11.928013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e38bfa9-3259-435e-95ea-8382f1c8bfd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:12.244394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5e38bfa9-3259-435e-95ea-8382f1c8bfd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:12.253140 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5e38bfa9-3259-435e-95ea-8382f1c8bfd3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.355253 Oct 04 21:46:12.254269 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3201/6377] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:11 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:12.830101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-927781f0-679d-4f77-af8e-8559fba2ca7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:12.831479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-927781f0-679d-4f77-af8e-8559fba2ca7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:12.854220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-927781f0-679d-4f77-af8e-8559fba2ca7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:12.858090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-927781f0-679d-4f77-af8e-8559fba2ca7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:12.859537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-927781f0-679d-4f77-af8e-8559fba2ca7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:12.864056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-927781f0-679d-4f77-af8e-8559fba2ca7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:12.866829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-927781f0-679d-4f77-af8e-8559fba2ca7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:12.867438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-927781f0-679d-4f77-af8e-8559fba2ca7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:13.086866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-927781f0-679d-4f77-af8e-8559fba2ca7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:13.095290 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-927781f0-679d-4f77-af8e-8559fba2ca7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 200 len: 1318 microversion: 2.1 time: 0.270742 Oct 04 21:46:13.106278 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3177/6378] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:12 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:13.278420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6d5dc26a-701e-4ed7-92d3-d5e5c89a6fbd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:13.280463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6d5dc26a-701e-4ed7-92d3-d5e5c89a6fbd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:13.330390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d5dc26a-701e-4ed7-92d3-d5e5c89a6fbd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:13.331130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d5dc26a-701e-4ed7-92d3-d5e5c89a6fbd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:13.331782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d5dc26a-701e-4ed7-92d3-d5e5c89a6fbd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:13.332698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d5dc26a-701e-4ed7-92d3-d5e5c89a6fbd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:13.333343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d5dc26a-701e-4ed7-92d3-d5e5c89a6fbd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:13.334009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d5dc26a-701e-4ed7-92d3-d5e5c89a6fbd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:13.741904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6d5dc26a-701e-4ed7-92d3-d5e5c89a6fbd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:13.756855 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6d5dc26a-701e-4ed7-92d3-d5e5c89a6fbd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.484084 Oct 04 21:46:13.757753 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3202/6379] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:13 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:14.127374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d425a6d8-3c98-47cb-aaff-a3779e2bae3a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:14.127932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d425a6d8-3c98-47cb-aaff-a3779e2bae3a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:14.136756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d425a6d8-3c98-47cb-aaff-a3779e2bae3a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:14.137557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d425a6d8-3c98-47cb-aaff-a3779e2bae3a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:14.138001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d425a6d8-3c98-47cb-aaff-a3779e2bae3a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:14.138920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d425a6d8-3c98-47cb-aaff-a3779e2bae3a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:14.139539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d425a6d8-3c98-47cb-aaff-a3779e2bae3a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:14.139975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d425a6d8-3c98-47cb-aaff-a3779e2bae3a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:14.439445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d425a6d8-3c98-47cb-aaff-a3779e2bae3a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:14.450909 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d425a6d8-3c98-47cb-aaff-a3779e2bae3a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 200 len: 1318 microversion: 2.1 time: 0.330744 Oct 04 21:46:14.452227 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3178/6380] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:14 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:14.783672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a9671ab6-7542-4dbd-8c91-a6e9191487e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:14.784318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a9671ab6-7542-4dbd-8c91-a6e9191487e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:14.796107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9671ab6-7542-4dbd-8c91-a6e9191487e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:14.796630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9671ab6-7542-4dbd-8c91-a6e9191487e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:14.797099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9671ab6-7542-4dbd-8c91-a6e9191487e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:14.798254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9671ab6-7542-4dbd-8c91-a6e9191487e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:14.799389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9671ab6-7542-4dbd-8c91-a6e9191487e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:14.799862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a9671ab6-7542-4dbd-8c91-a6e9191487e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:15.170391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a9671ab6-7542-4dbd-8c91-a6e9191487e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:15.170391 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a9671ab6-7542-4dbd-8c91-a6e9191487e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.364989 Oct 04 21:46:15.170391 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3203/6381] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:14 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:15.479023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c3e1507e-6aec-46c1-a6f0-887b48cd154b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:15.479023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c3e1507e-6aec-46c1-a6f0-887b48cd154b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:15.505057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3e1507e-6aec-46c1-a6f0-887b48cd154b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:15.508145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3e1507e-6aec-46c1-a6f0-887b48cd154b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:15.508669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3e1507e-6aec-46c1-a6f0-887b48cd154b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:15.511693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3e1507e-6aec-46c1-a6f0-887b48cd154b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:15.512200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3e1507e-6aec-46c1-a6f0-887b48cd154b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:15.513812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c3e1507e-6aec-46c1-a6f0-887b48cd154b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:15.815597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c3e1507e-6aec-46c1-a6f0-887b48cd154b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:15.831825 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c3e1507e-6aec-46c1-a6f0-887b48cd154b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 200 len: 1318 microversion: 2.1 time: 0.360707 Oct 04 21:46:15.833017 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3179/6382] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:15 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:16.197172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-19d3c7a1-420c-4705-83e3-029e841d6e38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:16.197853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-19d3c7a1-420c-4705-83e3-029e841d6e38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:16.205245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19d3c7a1-420c-4705-83e3-029e841d6e38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:16.208388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19d3c7a1-420c-4705-83e3-029e841d6e38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:16.208388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19d3c7a1-420c-4705-83e3-029e841d6e38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:16.208388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19d3c7a1-420c-4705-83e3-029e841d6e38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:16.208388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19d3c7a1-420c-4705-83e3-029e841d6e38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:16.208388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19d3c7a1-420c-4705-83e3-029e841d6e38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:16.441902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-19d3c7a1-420c-4705-83e3-029e841d6e38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:16.453068 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-19d3c7a1-420c-4705-83e3-029e841d6e38 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.260552 Oct 04 21:46:16.465783 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3204/6383] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:16 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:16.864444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f97517ff-ca21-4af6-be57-2e35ff8244ca tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:16.865750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f97517ff-ca21-4af6-be57-2e35ff8244ca tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:16.879545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f97517ff-ca21-4af6-be57-2e35ff8244ca tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:16.883172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f97517ff-ca21-4af6-be57-2e35ff8244ca tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:16.883172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f97517ff-ca21-4af6-be57-2e35ff8244ca tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:16.887794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f97517ff-ca21-4af6-be57-2e35ff8244ca tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:16.888517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f97517ff-ca21-4af6-be57-2e35ff8244ca tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:16.889313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f97517ff-ca21-4af6-be57-2e35ff8244ca tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:17.042573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-981dbb9a-f3d0-40ee-a8ad-2f72339462a1 req-116c3c21-04ce-4ffc-bb44-046a0e8c60f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31308c42-b5ea-4019-a5e8-8b02dfdea368", "name": "network-vif-plugged", "status": "completed", "tag": "5051c8db-389d-472f-a009-d33937767690"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:17.064999 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-981dbb9a-f3d0-40ee-a8ad-2f72339462a1 req-116c3c21-04ce-4ffc-bb44-046a0e8c60f6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:17.065557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-981dbb9a-f3d0-40ee-a8ad-2f72339462a1 req-116c3c21-04ce-4ffc-bb44-046a0e8c60f6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:17.068611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-981dbb9a-f3d0-40ee-a8ad-2f72339462a1 req-116c3c21-04ce-4ffc-bb44-046a0e8c60f6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:17.101552 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-981dbb9a-f3d0-40ee-a8ad-2f72339462a1 req-116c3c21-04ce-4ffc-bb44-046a0e8c60f6 service nova] Creating event network-vif-plugged:5051c8db-389d-472f-a009-d33937767690 for instance 31308c42-b5ea-4019-a5e8-8b02dfdea368 on n-h1-860282-1 Oct 04 21:46:17.112632 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-981dbb9a-f3d0-40ee-a8ad-2f72339462a1 req-116c3c21-04ce-4ffc-bb44-046a0e8c60f6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074397 Oct 04 21:46:17.114241 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3205/6384] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:17.194433 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f97517ff-ca21-4af6-be57-2e35ff8244ca tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:17.205126 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f97517ff-ca21-4af6-be57-2e35ff8244ca tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 200 len: 1318 microversion: 2.1 time: 0.345138 Oct 04 21:46:17.226065 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3180/6385] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:16 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:17.481911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2132b1f5-4227-4670-afee-de448731ae31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:17.483274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2132b1f5-4227-4670-afee-de448731ae31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:17.490637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2132b1f5-4227-4670-afee-de448731ae31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:17.491157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2132b1f5-4227-4670-afee-de448731ae31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:17.491759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2132b1f5-4227-4670-afee-de448731ae31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:17.492501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2132b1f5-4227-4670-afee-de448731ae31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:17.492985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2132b1f5-4227-4670-afee-de448731ae31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:17.493452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2132b1f5-4227-4670-afee-de448731ae31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:17.762742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2132b1f5-4227-4670-afee-de448731ae31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:17.772552 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2132b1f5-4227-4670-afee-de448731ae31 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1341 microversion: 2.1 time: 0.296376 Oct 04 21:46:17.773234 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3206/6386] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:17 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1341 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:18.229992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a1eac023-dc71-430a-8fe0-c3b50a364e40 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:18.231805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a1eac023-dc71-430a-8fe0-c3b50a364e40 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:18.241310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1eac023-dc71-430a-8fe0-c3b50a364e40 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:18.242045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1eac023-dc71-430a-8fe0-c3b50a364e40 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:18.242806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1eac023-dc71-430a-8fe0-c3b50a364e40 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:18.243718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1eac023-dc71-430a-8fe0-c3b50a364e40 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:18.244595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1eac023-dc71-430a-8fe0-c3b50a364e40 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:18.245208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a1eac023-dc71-430a-8fe0-c3b50a364e40 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:18.501362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a1eac023-dc71-430a-8fe0-c3b50a364e40 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:18.518642 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a1eac023-dc71-430a-8fe0-c3b50a364e40 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 200 len: 1318 microversion: 2.1 time: 0.292443 Oct 04 21:46:18.519327 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3181/6387] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:18 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:18.803485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-63394703-d824-48bd-8417-c2ad13888736 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:18.805523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-63394703-d824-48bd-8417-c2ad13888736 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:18.828697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63394703-d824-48bd-8417-c2ad13888736 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:18.835277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63394703-d824-48bd-8417-c2ad13888736 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:18.836988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63394703-d824-48bd-8417-c2ad13888736 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:18.837820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63394703-d824-48bd-8417-c2ad13888736 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:18.838322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63394703-d824-48bd-8417-c2ad13888736 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:18.838784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63394703-d824-48bd-8417-c2ad13888736 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:19.127649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-63394703-d824-48bd-8417-c2ad13888736 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:19.141362 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-63394703-d824-48bd-8417-c2ad13888736 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1387 microversion: 2.1 time: 0.342605 Oct 04 21:46:19.142199 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3207/6388] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:18 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1387 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:19.544485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0dbf7bd9-08f8-43aa-aef8-413d7f0941f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:19.545093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0dbf7bd9-08f8-43aa-aef8-413d7f0941f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:19.552616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dbf7bd9-08f8-43aa-aef8-413d7f0941f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:19.556106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dbf7bd9-08f8-43aa-aef8-413d7f0941f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:19.556106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dbf7bd9-08f8-43aa-aef8-413d7f0941f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:19.556106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dbf7bd9-08f8-43aa-aef8-413d7f0941f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:19.556106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dbf7bd9-08f8-43aa-aef8-413d7f0941f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:19.556106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dbf7bd9-08f8-43aa-aef8-413d7f0941f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:19.776379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0dbf7bd9-08f8-43aa-aef8-413d7f0941f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:19.785925 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0dbf7bd9-08f8-43aa-aef8-413d7f0941f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 200 len: 1507 microversion: 2.1 time: 0.245754 Oct 04 21:46:19.786958 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3182/6389] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:19 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 1507 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:19.809663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-de41ddd6-3c79-4a5c-a0ca-340f6e3cca74 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dde0a222-c0ac-4b94-a045-f63b80441bf3", "device": "/dev/sdb"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:19.813652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-de41ddd6-3c79-4a5c-a0ca-340f6e3cca74 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:19.822092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de41ddd6-3c79-4a5c-a0ca-340f6e3cca74 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:19.823129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de41ddd6-3c79-4a5c-a0ca-340f6e3cca74 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:19.823756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de41ddd6-3c79-4a5c-a0ca-340f6e3cca74 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:19.824644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de41ddd6-3c79-4a5c-a0ca-340f6e3cca74 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:19.825349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de41ddd6-3c79-4a5c-a0ca-340f6e3cca74 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:19.825994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de41ddd6-3c79-4a5c-a0ca-340f6e3cca74 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:20.165149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1464c0b4-aa63-407c-b17a-1acb26a57f15 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:20.166404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1464c0b4-aa63-407c-b17a-1acb26a57f15 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:20.173603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1464c0b4-aa63-407c-b17a-1acb26a57f15 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:20.174355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1464c0b4-aa63-407c-b17a-1acb26a57f15 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:20.175685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1464c0b4-aa63-407c-b17a-1acb26a57f15 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:20.176637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1464c0b4-aa63-407c-b17a-1acb26a57f15 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:20.177852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1464c0b4-aa63-407c-b17a-1acb26a57f15 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:20.178458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1464c0b4-aa63-407c-b17a-1acb26a57f15 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:20.424554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1464c0b4-aa63-407c-b17a-1acb26a57f15 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:20.435665 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1464c0b4-aa63-407c-b17a-1acb26a57f15 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1375 microversion: 2.1 time: 0.275523 Oct 04 21:46:20.441017 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3183/6390] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:20 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1375 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:20.866116 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-de41ddd6-3c79-4a5c-a0ca-340f6e3cca74 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "POST /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.059902 Oct 04 21:46:20.866964 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3208/6391] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 21:46:19 2022] POST /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368/os-volume_attachments => generated 194 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:21.483676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dbf39cc2-33b4-4c95-bd07-bec893349893 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:21.485634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dbf39cc2-33b4-4c95-bd07-bec893349893 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:21.513007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbf39cc2-33b4-4c95-bd07-bec893349893 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:21.514056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbf39cc2-33b4-4c95-bd07-bec893349893 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:21.514928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbf39cc2-33b4-4c95-bd07-bec893349893 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:21.523812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbf39cc2-33b4-4c95-bd07-bec893349893 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:21.524744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbf39cc2-33b4-4c95-bd07-bec893349893 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:21.570981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbf39cc2-33b4-4c95-bd07-bec893349893 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.046s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:21.582213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=100 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:21.962115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dbf39cc2-33b4-4c95-bd07-bec893349893 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:21.978239 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dbf39cc2-33b4-4c95-bd07-bec893349893 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1375 microversion: 2.1 time: 0.505369 Oct 04 21:46:22.006463 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3184/6392] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:21 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1375 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:23.013902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6a87f36b-2f17-496f-8917-7d411b26a0d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:23.014635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6a87f36b-2f17-496f-8917-7d411b26a0d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:23.044722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a87f36b-2f17-496f-8917-7d411b26a0d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:23.045246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a87f36b-2f17-496f-8917-7d411b26a0d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:23.045734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a87f36b-2f17-496f-8917-7d411b26a0d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:23.046471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a87f36b-2f17-496f-8917-7d411b26a0d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:23.046950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a87f36b-2f17-496f-8917-7d411b26a0d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:23.047400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6a87f36b-2f17-496f-8917-7d411b26a0d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:23.085699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:23.351011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6a87f36b-2f17-496f-8917-7d411b26a0d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:23.359001 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6a87f36b-2f17-496f-8917-7d411b26a0d2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1375 microversion: 2.1 time: 0.354438 Oct 04 21:46:23.360577 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3209/6393] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:23 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1375 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:24.382355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fce52a51-e3c6-4a84-8746-25329a92a31a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:24.387573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fce52a51-e3c6-4a84-8746-25329a92a31a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:24.395206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fce52a51-e3c6-4a84-8746-25329a92a31a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:24.404789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fce52a51-e3c6-4a84-8746-25329a92a31a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:24.409932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fce52a51-e3c6-4a84-8746-25329a92a31a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:24.409932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fce52a51-e3c6-4a84-8746-25329a92a31a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:24.409932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fce52a51-e3c6-4a84-8746-25329a92a31a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:24.409932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fce52a51-e3c6-4a84-8746-25329a92a31a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:24.772953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fce52a51-e3c6-4a84-8746-25329a92a31a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:24.778910 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fce52a51-e3c6-4a84-8746-25329a92a31a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1375 microversion: 2.1 time: 0.400875 Oct 04 21:46:24.795658 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3185/6394] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:24 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1375 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:25.803262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-832cfee7-069c-4b88-92f7-e4782cbaa523 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:25.803898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-832cfee7-069c-4b88-92f7-e4782cbaa523 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:25.813251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-832cfee7-069c-4b88-92f7-e4782cbaa523 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:25.814204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-832cfee7-069c-4b88-92f7-e4782cbaa523 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:25.814660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-832cfee7-069c-4b88-92f7-e4782cbaa523 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:25.815445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-832cfee7-069c-4b88-92f7-e4782cbaa523 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:25.815888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-832cfee7-069c-4b88-92f7-e4782cbaa523 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:25.816267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-832cfee7-069c-4b88-92f7-e4782cbaa523 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:26.300912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-832cfee7-069c-4b88-92f7-e4782cbaa523 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:26.313988 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-832cfee7-069c-4b88-92f7-e4782cbaa523 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1375 microversion: 2.1 time: 0.514536 Oct 04 21:46:26.315472 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3210/6395] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:25 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1375 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:27.342188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9816158f-64d0-473d-9b9c-08c2aec4a444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:27.347355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9816158f-64d0-473d-9b9c-08c2aec4a444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:27.376117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9816158f-64d0-473d-9b9c-08c2aec4a444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:27.376117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9816158f-64d0-473d-9b9c-08c2aec4a444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:27.376117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9816158f-64d0-473d-9b9c-08c2aec4a444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:27.376117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9816158f-64d0-473d-9b9c-08c2aec4a444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:27.376117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9816158f-64d0-473d-9b9c-08c2aec4a444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:27.376117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9816158f-64d0-473d-9b9c-08c2aec4a444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:27.713567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9816158f-64d0-473d-9b9c-08c2aec4a444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:27.721831 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9816158f-64d0-473d-9b9c-08c2aec4a444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1375 microversion: 2.1 time: 0.383470 Oct 04 21:46:27.733456 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3186/6396] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:27 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1375 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:28.748465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-81a48117-e744-4cf6-996f-ff35b4adc861 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:28.749086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-81a48117-e744-4cf6-996f-ff35b4adc861 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:28.752337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=48 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:28.771887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81a48117-e744-4cf6-996f-ff35b4adc861 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:28.772565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81a48117-e744-4cf6-996f-ff35b4adc861 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:28.773029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81a48117-e744-4cf6-996f-ff35b4adc861 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:28.773809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81a48117-e744-4cf6-996f-ff35b4adc861 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:28.774341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81a48117-e744-4cf6-996f-ff35b4adc861 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:28.774795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81a48117-e744-4cf6-996f-ff35b4adc861 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:29.056085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-94c3ff33-bcb3-4338-be4e-ac704ac353c8 req-7959ac70-75e5-48a3-952d-d79f0a0328d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512622af-42ea-4b00-a527-d513faeb9da5", "name": "network-vif-plugged", "status": "completed", "tag": "290d30b5-d42c-4628-ba22-c931e03a3d63"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:29.069482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:29.080623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-94c3ff33-bcb3-4338-be4e-ac704ac353c8 req-7959ac70-75e5-48a3-952d-d79f0a0328d7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:29.083698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-94c3ff33-bcb3-4338-be4e-ac704ac353c8 req-7959ac70-75e5-48a3-952d-d79f0a0328d7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:29.083698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-94c3ff33-bcb3-4338-be4e-ac704ac353c8 req-7959ac70-75e5-48a3-952d-d79f0a0328d7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:29.102236 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-94c3ff33-bcb3-4338-be4e-ac704ac353c8 req-7959ac70-75e5-48a3-952d-d79f0a0328d7 service nova] Creating event network-vif-plugged:290d30b5-d42c-4628-ba22-c931e03a3d63 for instance 512622af-42ea-4b00-a527-d513faeb9da5 on n-h1-860282-1 Oct 04 21:46:29.122400 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-94c3ff33-bcb3-4338-be4e-ac704ac353c8 req-7959ac70-75e5-48a3-952d-d79f0a0328d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071549 Oct 04 21:46:29.125706 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3187/6397] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 21:46:29.156887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-81a48117-e744-4cf6-996f-ff35b4adc861 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:29.167615 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-81a48117-e744-4cf6-996f-ff35b4adc861 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1375 microversion: 2.1 time: 0.423056 Oct 04 21:46:29.168214 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3211/6398] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:28 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1375 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:30.193958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-24ecbe60-4b65-4bd3-af9f-836bf8912504 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:30.194679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-24ecbe60-4b65-4bd3-af9f-836bf8912504 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:30.207135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24ecbe60-4b65-4bd3-af9f-836bf8912504 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:30.207426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24ecbe60-4b65-4bd3-af9f-836bf8912504 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:30.211615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24ecbe60-4b65-4bd3-af9f-836bf8912504 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:30.211615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24ecbe60-4b65-4bd3-af9f-836bf8912504 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:30.215709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24ecbe60-4b65-4bd3-af9f-836bf8912504 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:30.216578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24ecbe60-4b65-4bd3-af9f-836bf8912504 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:30.455279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-24ecbe60-4b65-4bd3-af9f-836bf8912504 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:30.466630 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-24ecbe60-4b65-4bd3-af9f-836bf8912504 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1375 microversion: 2.1 time: 0.279171 Oct 04 21:46:30.467962 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3188/6399] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:30 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1375 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:31.502100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-09953bad-b5f9-46fc-8e3f-6c16b77f7c4a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:31.502740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-09953bad-b5f9-46fc-8e3f-6c16b77f7c4a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:31.514800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09953bad-b5f9-46fc-8e3f-6c16b77f7c4a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:31.515506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09953bad-b5f9-46fc-8e3f-6c16b77f7c4a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:31.516167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09953bad-b5f9-46fc-8e3f-6c16b77f7c4a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:31.517053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09953bad-b5f9-46fc-8e3f-6c16b77f7c4a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:31.517582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09953bad-b5f9-46fc-8e3f-6c16b77f7c4a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:31.518194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09953bad-b5f9-46fc-8e3f-6c16b77f7c4a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:31.743857 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-09953bad-b5f9-46fc-8e3f-6c16b77f7c4a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:31.759455 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-09953bad-b5f9-46fc-8e3f-6c16b77f7c4a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1562 microversion: 2.1 time: 0.261649 Oct 04 21:46:31.759455 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3212/6400] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:31 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1562 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:31.789441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9831442-f60a-4c52-8e91-48c74372aba3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:31.790719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d9831442-f60a-4c52-8e91-48c74372aba3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:31.806216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9831442-f60a-4c52-8e91-48c74372aba3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:31.806325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9831442-f60a-4c52-8e91-48c74372aba3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:31.806737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9831442-f60a-4c52-8e91-48c74372aba3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:31.807457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9831442-f60a-4c52-8e91-48c74372aba3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:31.807967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9831442-f60a-4c52-8e91-48c74372aba3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:31.808407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9831442-f60a-4c52-8e91-48c74372aba3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:32.051898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d9831442-f60a-4c52-8e91-48c74372aba3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:32.065593 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d9831442-f60a-4c52-8e91-48c74372aba3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1562 microversion: 2.1 time: 0.283307 Oct 04 21:46:32.065593 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3189/6401] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:31 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1562 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:32.163661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a02bb0d5-3ff3-4076-961f-cd08ab4ae114 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:32.164188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a02bb0d5-3ff3-4076-961f-cd08ab4ae114 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:32.171505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a02bb0d5-3ff3-4076-961f-cd08ab4ae114 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:32.171864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a02bb0d5-3ff3-4076-961f-cd08ab4ae114 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:32.172325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a02bb0d5-3ff3-4076-961f-cd08ab4ae114 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:32.173051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a02bb0d5-3ff3-4076-961f-cd08ab4ae114 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:32.173589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a02bb0d5-3ff3-4076-961f-cd08ab4ae114 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:32.174036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a02bb0d5-3ff3-4076-961f-cd08ab4ae114 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:32.211671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a02bb0d5-3ff3-4076-961f-cd08ab4ae114 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:46:32.623689 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a02bb0d5-3ff3-4076-961f-cd08ab4ae114 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "DELETE /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 204 len: 0 microversion: 2.1 time: 0.464626 Oct 04 21:46:32.627096 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3213/6402] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:46:32 2022] DELETE /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:46:32.635485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-db5d60ed-b342-430e-8698-336835fcc34f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:32.636290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-db5d60ed-b342-430e-8698-336835fcc34f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:32.642845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db5d60ed-b342-430e-8698-336835fcc34f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:32.643457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db5d60ed-b342-430e-8698-336835fcc34f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:32.643973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db5d60ed-b342-430e-8698-336835fcc34f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:32.644850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db5d60ed-b342-430e-8698-336835fcc34f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:32.646016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db5d60ed-b342-430e-8698-336835fcc34f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:32.646016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-db5d60ed-b342-430e-8698-336835fcc34f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:32.801628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-db5d60ed-b342-430e-8698-336835fcc34f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:32.809752 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-db5d60ed-b342-430e-8698-336835fcc34f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1568 microversion: 2.1 time: 0.178376 Oct 04 21:46:32.810323 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3190/6403] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:32 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:33.837691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f4c8ef75-bb8d-4cce-b4d0-415c8d3d6ea2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:33.838865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f4c8ef75-bb8d-4cce-b4d0-415c8d3d6ea2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:33.850115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4c8ef75-bb8d-4cce-b4d0-415c8d3d6ea2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:33.850115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4c8ef75-bb8d-4cce-b4d0-415c8d3d6ea2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:33.850115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4c8ef75-bb8d-4cce-b4d0-415c8d3d6ea2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:33.850115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4c8ef75-bb8d-4cce-b4d0-415c8d3d6ea2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:33.851348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4c8ef75-bb8d-4cce-b4d0-415c8d3d6ea2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:33.852037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4c8ef75-bb8d-4cce-b4d0-415c8d3d6ea2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:34.089806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f4c8ef75-bb8d-4cce-b4d0-415c8d3d6ea2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:34.098665 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f4c8ef75-bb8d-4cce-b4d0-415c8d3d6ea2 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1568 microversion: 2.1 time: 0.266083 Oct 04 21:46:34.099477 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3214/6404] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:33 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:34.926512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-1b8b47e7-084e-42ac-804d-de1ea9161a87 req-408534c5-2bd2-4118-95b6-7b64d64ff4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512622af-42ea-4b00-a527-d513faeb9da5", "name": "network-vif-deleted", "tag": "290d30b5-d42c-4628-ba22-c931e03a3d63"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:34.948945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1b8b47e7-084e-42ac-804d-de1ea9161a87 req-408534c5-2bd2-4118-95b6-7b64d64ff4c0 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:34.950706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1b8b47e7-084e-42ac-804d-de1ea9161a87 req-408534c5-2bd2-4118-95b6-7b64d64ff4c0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:34.951267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1b8b47e7-084e-42ac-804d-de1ea9161a87 req-408534c5-2bd2-4118-95b6-7b64d64ff4c0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:34.991682 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-1b8b47e7-084e-42ac-804d-de1ea9161a87 req-408534c5-2bd2-4118-95b6-7b64d64ff4c0 service nova] Creating event network-vif-deleted:290d30b5-d42c-4628-ba22-c931e03a3d63 for instance 512622af-42ea-4b00-a527-d513faeb9da5 on n-h1-860282-1 Oct 04 21:46:35.007930 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-1b8b47e7-084e-42ac-804d-de1ea9161a87 req-408534c5-2bd2-4118-95b6-7b64d64ff4c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094530 Oct 04 21:46:35.020321 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3191/6405] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 21:46:35.122761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3e5c8a33-6075-460f-9aaf-afb27c3e9503 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:35.123345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3e5c8a33-6075-460f-9aaf-afb27c3e9503 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:35.143396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e5c8a33-6075-460f-9aaf-afb27c3e9503 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:35.143932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e5c8a33-6075-460f-9aaf-afb27c3e9503 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:35.144398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e5c8a33-6075-460f-9aaf-afb27c3e9503 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:35.145145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e5c8a33-6075-460f-9aaf-afb27c3e9503 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:35.145665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e5c8a33-6075-460f-9aaf-afb27c3e9503 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:35.146738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e5c8a33-6075-460f-9aaf-afb27c3e9503 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:35.346691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3e5c8a33-6075-460f-9aaf-afb27c3e9503 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:35.371412 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3e5c8a33-6075-460f-9aaf-afb27c3e9503 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1360 microversion: 2.1 time: 0.244008 Oct 04 21:46:35.371412 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3215/6406] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:35 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1360 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:36.395355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b3937573-71eb-466e-a61b-b6479304016f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:36.397842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b3937573-71eb-466e-a61b-b6479304016f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:36.410726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3937573-71eb-466e-a61b-b6479304016f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:36.414059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3937573-71eb-466e-a61b-b6479304016f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:36.416284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3937573-71eb-466e-a61b-b6479304016f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:36.420660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3937573-71eb-466e-a61b-b6479304016f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:36.420660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3937573-71eb-466e-a61b-b6479304016f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:36.420660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3937573-71eb-466e-a61b-b6479304016f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:36.594849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b3937573-71eb-466e-a61b-b6479304016f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:36.612324 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b3937573-71eb-466e-a61b-b6479304016f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1360 microversion: 2.1 time: 0.221451 Oct 04 21:46:36.612964 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3192/6407] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:36 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1360 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:37.637572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2ab21f7b-631e-41e8-afd5-8b1de150e6d4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:37.638241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2ab21f7b-631e-41e8-afd5-8b1de150e6d4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:37.652957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ab21f7b-631e-41e8-afd5-8b1de150e6d4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:37.654374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ab21f7b-631e-41e8-afd5-8b1de150e6d4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:37.655157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ab21f7b-631e-41e8-afd5-8b1de150e6d4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:37.656057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ab21f7b-631e-41e8-afd5-8b1de150e6d4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:37.660496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ab21f7b-631e-41e8-afd5-8b1de150e6d4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:37.660496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2ab21f7b-631e-41e8-afd5-8b1de150e6d4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:37.971061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2ab21f7b-631e-41e8-afd5-8b1de150e6d4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:37.980405 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2ab21f7b-631e-41e8-afd5-8b1de150e6d4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1360 microversion: 2.1 time: 0.347309 Oct 04 21:46:37.984325 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3216/6408] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:37 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1360 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:39.010336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-839f47f0-7971-404b-8402-1b5904115118 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:39.013008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-839f47f0-7971-404b-8402-1b5904115118 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:39.035208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-839f47f0-7971-404b-8402-1b5904115118 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:39.035859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-839f47f0-7971-404b-8402-1b5904115118 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:39.036396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-839f47f0-7971-404b-8402-1b5904115118 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:39.038407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-839f47f0-7971-404b-8402-1b5904115118 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:39.039185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-839f47f0-7971-404b-8402-1b5904115118 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:39.039931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-839f47f0-7971-404b-8402-1b5904115118 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:39.498301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-839f47f0-7971-404b-8402-1b5904115118 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:39.510475 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-839f47f0-7971-404b-8402-1b5904115118 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1360 microversion: 2.1 time: 0.506019 Oct 04 21:46:39.511074 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3193/6409] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:39 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1360 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:40.543757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5e1b6621-299b-40d0-8fe9-d93906bd4665 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:40.545025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5e1b6621-299b-40d0-8fe9-d93906bd4665 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:40.556400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e1b6621-299b-40d0-8fe9-d93906bd4665 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:40.560582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e1b6621-299b-40d0-8fe9-d93906bd4665 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:40.561410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e1b6621-299b-40d0-8fe9-d93906bd4665 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:40.566157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e1b6621-299b-40d0-8fe9-d93906bd4665 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:40.566157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e1b6621-299b-40d0-8fe9-d93906bd4665 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:40.566157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e1b6621-299b-40d0-8fe9-d93906bd4665 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:40.724612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5e1b6621-299b-40d0-8fe9-d93906bd4665 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:40.765799 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5e1b6621-299b-40d0-8fe9-d93906bd4665 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1360 microversion: 2.1 time: 0.228352 Oct 04 21:46:40.766487 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3217/6410] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:40 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1360 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:41.791182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4227d1b5-c7ed-41dd-8da1-3be6cd27fc40 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:41.793014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4227d1b5-c7ed-41dd-8da1-3be6cd27fc40 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:41.809438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4227d1b5-c7ed-41dd-8da1-3be6cd27fc40 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:41.809438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4227d1b5-c7ed-41dd-8da1-3be6cd27fc40 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:41.809438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4227d1b5-c7ed-41dd-8da1-3be6cd27fc40 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:41.809438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4227d1b5-c7ed-41dd-8da1-3be6cd27fc40 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:41.809438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4227d1b5-c7ed-41dd-8da1-3be6cd27fc40 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:41.809438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4227d1b5-c7ed-41dd-8da1-3be6cd27fc40 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:41.960584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4227d1b5-c7ed-41dd-8da1-3be6cd27fc40 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:41.974320 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4227d1b5-c7ed-41dd-8da1-3be6cd27fc40 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1360 microversion: 2.1 time: 0.187120 Oct 04 21:46:41.975757 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3194/6411] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:41 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1360 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:42.998241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e5b1f134-f8d5-491d-b69c-7abcc7e66581 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:42.999641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e5b1f134-f8d5-491d-b69c-7abcc7e66581 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:43.008360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5b1f134-f8d5-491d-b69c-7abcc7e66581 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.012515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5b1f134-f8d5-491d-b69c-7abcc7e66581 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.021526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5b1f134-f8d5-491d-b69c-7abcc7e66581 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.021526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5b1f134-f8d5-491d-b69c-7abcc7e66581 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.021526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5b1f134-f8d5-491d-b69c-7abcc7e66581 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.021526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e5b1f134-f8d5-491d-b69c-7abcc7e66581 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.128395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e5b1f134-f8d5-491d-b69c-7abcc7e66581 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:43.143269 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e5b1f134-f8d5-491d-b69c-7abcc7e66581 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1360 microversion: 2.1 time: 0.147385 Oct 04 21:46:43.146672 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3218/6412] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:42 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:44.171494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-04ecfd63-f307-4bba-a621-5db474c3ec96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:44.172113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-04ecfd63-f307-4bba-a621-5db474c3ec96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:44.186411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04ecfd63-f307-4bba-a621-5db474c3ec96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.187332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04ecfd63-f307-4bba-a621-5db474c3ec96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.204870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04ecfd63-f307-4bba-a621-5db474c3ec96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.223564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04ecfd63-f307-4bba-a621-5db474c3ec96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.223564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04ecfd63-f307-4bba-a621-5db474c3ec96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.223564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04ecfd63-f307-4bba-a621-5db474c3ec96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.313206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04ecfd63-f307-4bba-a621-5db474c3ec96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.313917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04ecfd63-f307-4bba-a621-5db474c3ec96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.314585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-04ecfd63-f307-4bba-a621-5db474c3ec96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.315285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-04ecfd63-f307-4bba-a621-5db474c3ec96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lazy-loading 'fault' on Instance uuid 512622af-42ea-4b00-a527-d513faeb9da5 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:46:44.471812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-04ecfd63-f307-4bba-a621-5db474c3ec96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:44.480150 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-04ecfd63-f307-4bba-a621-5db474c3ec96 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 200 len: 1319 microversion: 2.1 time: 0.313350 Oct 04 21:46:44.483931 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3195/6413] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:44 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:45.513853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-569a8cbf-c35a-4ad3-bbee-ff5d4f4e21ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:45.515015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-569a8cbf-c35a-4ad3-bbee-ff5d4f4e21ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:45.532393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-569a8cbf-c35a-4ad3-bbee-ff5d4f4e21ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:45.533167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-569a8cbf-c35a-4ad3-bbee-ff5d4f4e21ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:45.533837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-569a8cbf-c35a-4ad3-bbee-ff5d4f4e21ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:45.535289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-569a8cbf-c35a-4ad3-bbee-ff5d4f4e21ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:45.535919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-569a8cbf-c35a-4ad3-bbee-ff5d4f4e21ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:45.537076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-569a8cbf-c35a-4ad3-bbee-ff5d4f4e21ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:45.566104 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-569a8cbf-c35a-4ad3-bbee-ff5d4f4e21ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] HTTP exception thrown: Instance 512622af-42ea-4b00-a527-d513faeb9da5 could not be found. Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-569a8cbf-c35a-4ad3-bbee-ff5d4f4e21ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Request method failure captured: Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 HTTP/1.1 Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKgKHoOaT8uqO1KoOPn24xM7P0ylwdbLFlP7NxtckxX5YVgkQXQgvdk_pv_DRrXpTR_A9RTrhRjboZG7XPsaIwCmuey_7FqshLEW4wp7-ccvS6GHij-f3j-K3O_9tzU_63L01blifBD1TcCBZnKNp1OdTYkzGEDdJ0DY_B_XNHTjspY Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68208d23fd2f40479ba279566a819933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68208d23fd2f40479ba279566a819933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}] Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 15748f41da9f49fca3e7eec1fda3b245 Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 512622af-42ea-4b00-a527-d513faeb9da5 could not be found. Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '512622af-42ea-4b00-a527-d513faeb9da5'} Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512622af-42ea-4b00-a527-d513faeb9da5 could not be found. Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512622af-42ea-4b00-a527-d513faeb9da5 could not be found. Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:45.568445 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:46:45.573790 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:45.573790 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:45.573790 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:45.573790 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:46:45.573790 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:46:45.573790 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512622af-42ea-4b00-a527-d513faeb9da5 could not be found. Oct 04 21:46:45.573790 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:46:45.576762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-569a8cbf-c35a-4ad3-bbee-ff5d4f4e21ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Returning 404 to user: Instance 512622af-42ea-4b00-a527-d513faeb9da5 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:46:45.577940 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-569a8cbf-c35a-4ad3-bbee-ff5d4f4e21ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 404 len: 111 microversion: 2.1 time: 0.069764 Oct 04 21:46:45.581845 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3219/6414] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:45 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:46:53.403984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f7a8ea4d-9249-4133-bcd2-55ebd8c58d46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:53.405415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f7a8ea4d-9249-4133-bcd2-55ebd8c58d46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:53.427578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7a8ea4d-9249-4133-bcd2-55ebd8c58d46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:53.436686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7a8ea4d-9249-4133-bcd2-55ebd8c58d46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:53.436686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7a8ea4d-9249-4133-bcd2-55ebd8c58d46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:53.436686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7a8ea4d-9249-4133-bcd2-55ebd8c58d46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:53.436686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7a8ea4d-9249-4133-bcd2-55ebd8c58d46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:53.436686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7a8ea4d-9249-4133-bcd2-55ebd8c58d46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:53.461032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f7a8ea4d-9249-4133-bcd2-55ebd8c58d46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:46:53.914902 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f7a8ea4d-9249-4133-bcd2-55ebd8c58d46 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 204 len: 0 microversion: 2.1 time: 0.520262 Oct 04 21:46:53.917203 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3196/6415] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:46:53 2022] DELETE /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:46:53.926419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b13b294a-12f0-4065-99d3-843214139fef tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:53.929324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b13b294a-12f0-4065-99d3-843214139fef tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:53.938563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b13b294a-12f0-4065-99d3-843214139fef tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:53.940347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b13b294a-12f0-4065-99d3-843214139fef tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:53.941042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b13b294a-12f0-4065-99d3-843214139fef tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:53.942040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b13b294a-12f0-4065-99d3-843214139fef tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:53.943001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b13b294a-12f0-4065-99d3-843214139fef tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:53.943652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b13b294a-12f0-4065-99d3-843214139fef tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:54.209325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b13b294a-12f0-4065-99d3-843214139fef tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:54.227838 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b13b294a-12f0-4065-99d3-843214139fef tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1408 microversion: 2.1 time: 0.305003 Oct 04 21:46:54.232311 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3220/6416] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:53 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1408 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:55.257265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5ff780ef-0392-42ff-b109-27782fa40ac5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:55.258565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5ff780ef-0392-42ff-b109-27782fa40ac5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:55.274698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ff780ef-0392-42ff-b109-27782fa40ac5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:55.276719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ff780ef-0392-42ff-b109-27782fa40ac5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:55.276719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ff780ef-0392-42ff-b109-27782fa40ac5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:55.276719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ff780ef-0392-42ff-b109-27782fa40ac5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:55.276719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ff780ef-0392-42ff-b109-27782fa40ac5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:55.277204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ff780ef-0392-42ff-b109-27782fa40ac5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:55.333615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:55.607394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5ff780ef-0392-42ff-b109-27782fa40ac5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:55.616843 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5ff780ef-0392-42ff-b109-27782fa40ac5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1408 microversion: 2.1 time: 0.363790 Oct 04 21:46:55.622522 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3197/6417] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:55 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1408 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:56.624707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-05c8bb46-d902-4bbe-900d-8f1284d49dca req-1b6cd8f0-2c8e-42e9-b71d-7497163ab87e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab2aae9-7934-4d73-9ed9-21218879fac0", "name": "network-vif-deleted", "tag": "c47f6e88-3f4a-42c9-b9f4-31806a5d7067"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:56.641910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-540d5a00-59f3-4f1e-b512-d663f7af8f21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:56.643116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-540d5a00-59f3-4f1e-b512-d663f7af8f21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:56.669506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-05c8bb46-d902-4bbe-900d-8f1284d49dca req-1b6cd8f0-2c8e-42e9-b71d-7497163ab87e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.671129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-05c8bb46-d902-4bbe-900d-8f1284d49dca req-1b6cd8f0-2c8e-42e9-b71d-7497163ab87e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.672555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-540d5a00-59f3-4f1e-b512-d663f7af8f21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.673449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-05c8bb46-d902-4bbe-900d-8f1284d49dca req-1b6cd8f0-2c8e-42e9-b71d-7497163ab87e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.676930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-540d5a00-59f3-4f1e-b512-d663f7af8f21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.680384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-540d5a00-59f3-4f1e-b512-d663f7af8f21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.686799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-540d5a00-59f3-4f1e-b512-d663f7af8f21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.689501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-540d5a00-59f3-4f1e-b512-d663f7af8f21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.689973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-540d5a00-59f3-4f1e-b512-d663f7af8f21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.713634 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-05c8bb46-d902-4bbe-900d-8f1284d49dca req-1b6cd8f0-2c8e-42e9-b71d-7497163ab87e service nova] Creating event network-vif-deleted:c47f6e88-3f4a-42c9-b9f4-31806a5d7067 for instance aab2aae9-7934-4d73-9ed9-21218879fac0 on n-h2-860282-1 Oct 04 21:46:56.727437 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-05c8bb46-d902-4bbe-900d-8f1284d49dca req-1b6cd8f0-2c8e-42e9-b71d-7497163ab87e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107673 Oct 04 21:46:56.728393 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3221/6418] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:56.857207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-540d5a00-59f3-4f1e-b512-d663f7af8f21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:56.871981 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-540d5a00-59f3-4f1e-b512-d663f7af8f21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1366 microversion: 2.1 time: 0.234124 Oct 04 21:46:56.873759 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3198/6419] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:56 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:56.947053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4ef30b64-e024-4bd1-b9f0-e93e5b9529f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:56.947739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4ef30b64-e024-4bd1-b9f0-e93e5b9529f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:56.964019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ef30b64-e024-4bd1-b9f0-e93e5b9529f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.964552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ef30b64-e024-4bd1-b9f0-e93e5b9529f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.968680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ef30b64-e024-4bd1-b9f0-e93e5b9529f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.969794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ef30b64-e024-4bd1-b9f0-e93e5b9529f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.970317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ef30b64-e024-4bd1-b9f0-e93e5b9529f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.973410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ef30b64-e024-4bd1-b9f0-e93e5b9529f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:57.339595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-4ef30b64-e024-4bd1-b9f0-e93e5b9529f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lazy-loading 'services' on Instance uuid 31308c42-b5ea-4019-a5e8-8b02dfdea368 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:46:57.619650 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4ef30b64-e024-4bd1-b9f0-e93e5b9529f2 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "DELETE /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368/os-volume_attachments/dde0a222-c0ac-4b94-a045-f63b80441bf3" status: 202 len: 0 microversion: 2.1 time: 0.679226 Oct 04 21:46:57.620297 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3222/6420] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 21:46:56 2022] DELETE /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368/os-volume_attachments/dde0a222-c0ac-4b94-a045-f63b80441bf3 => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:46:57.902778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e1e98e1b-bef2-4df9-8871-1f8de6473def tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:57.904339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e1e98e1b-bef2-4df9-8871-1f8de6473def tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:57.915010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1e98e1b-bef2-4df9-8871-1f8de6473def tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:57.915890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1e98e1b-bef2-4df9-8871-1f8de6473def tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:57.918000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1e98e1b-bef2-4df9-8871-1f8de6473def tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:57.920663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1e98e1b-bef2-4df9-8871-1f8de6473def tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:57.922001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1e98e1b-bef2-4df9-8871-1f8de6473def tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:57.924563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1e98e1b-bef2-4df9-8871-1f8de6473def tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:58.088005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e1e98e1b-bef2-4df9-8871-1f8de6473def tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:58.098922 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e1e98e1b-bef2-4df9-8871-1f8de6473def tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1201 microversion: 2.1 time: 0.201833 Oct 04 21:46:58.108773 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3199/6421] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:57 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1201 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:59.135588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5bec3a97-52b3-418d-8cc8-2f0e639ecfba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:59.137187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5bec3a97-52b3-418d-8cc8-2f0e639ecfba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:59.144742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:59.148119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5bec3a97-52b3-418d-8cc8-2f0e639ecfba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.148846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5bec3a97-52b3-418d-8cc8-2f0e639ecfba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.149668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5bec3a97-52b3-418d-8cc8-2f0e639ecfba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:59.150575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5bec3a97-52b3-418d-8cc8-2f0e639ecfba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.151216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5bec3a97-52b3-418d-8cc8-2f0e639ecfba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.152027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5bec3a97-52b3-418d-8cc8-2f0e639ecfba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:59.304437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5bec3a97-52b3-418d-8cc8-2f0e639ecfba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:59.314455 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5bec3a97-52b3-418d-8cc8-2f0e639ecfba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1201 microversion: 2.1 time: 0.186623 Oct 04 21:46:59.318228 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3223/6422] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:59 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1201 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:00.347960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9093c6d8-0fc3-48d9-b45e-f631089db5a7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:00.350235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9093c6d8-0fc3-48d9-b45e-f631089db5a7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:00.364659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9093c6d8-0fc3-48d9-b45e-f631089db5a7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:00.366684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9093c6d8-0fc3-48d9-b45e-f631089db5a7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:00.367205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9093c6d8-0fc3-48d9-b45e-f631089db5a7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:00.368009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9093c6d8-0fc3-48d9-b45e-f631089db5a7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:00.377592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9093c6d8-0fc3-48d9-b45e-f631089db5a7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:00.378459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9093c6d8-0fc3-48d9-b45e-f631089db5a7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:00.586049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9093c6d8-0fc3-48d9-b45e-f631089db5a7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:00.607081 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9093c6d8-0fc3-48d9-b45e-f631089db5a7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1201 microversion: 2.1 time: 0.270432 Oct 04 21:47:00.662940 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3200/6423] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:00 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1201 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:01.634540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0f17a686-97aa-452a-8c0f-d6fec2025513 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:01.636924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0f17a686-97aa-452a-8c0f-d6fec2025513 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:01.651615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f17a686-97aa-452a-8c0f-d6fec2025513 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:01.652474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f17a686-97aa-452a-8c0f-d6fec2025513 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:01.653170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f17a686-97aa-452a-8c0f-d6fec2025513 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:01.660930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f17a686-97aa-452a-8c0f-d6fec2025513 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:01.660930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f17a686-97aa-452a-8c0f-d6fec2025513 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:01.660930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f17a686-97aa-452a-8c0f-d6fec2025513 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:01.660930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:01.754916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0f17a686-97aa-452a-8c0f-d6fec2025513 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:01.765447 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0f17a686-97aa-452a-8c0f-d6fec2025513 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1201 microversion: 2.1 time: 0.134964 Oct 04 21:47:01.766894 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3224/6424] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:01 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1201 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:02.794997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-24746f8b-2360-4569-9ccc-00c2859b9833 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:02.794997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-24746f8b-2360-4569-9ccc-00c2859b9833 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:02.803244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:02.804934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24746f8b-2360-4569-9ccc-00c2859b9833 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:02.805469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24746f8b-2360-4569-9ccc-00c2859b9833 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:02.805928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24746f8b-2360-4569-9ccc-00c2859b9833 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:02.806944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24746f8b-2360-4569-9ccc-00c2859b9833 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:02.807414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24746f8b-2360-4569-9ccc-00c2859b9833 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:02.808096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24746f8b-2360-4569-9ccc-00c2859b9833 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:02.880758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-24746f8b-2360-4569-9ccc-00c2859b9833 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:02.891265 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-24746f8b-2360-4569-9ccc-00c2859b9833 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1201 microversion: 2.1 time: 0.104834 Oct 04 21:47:02.892972 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3201/6425] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:02 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1201 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:03.924786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ce0814bf-1bea-41b8-8e26-14a4bb832194 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:03.926814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ce0814bf-1bea-41b8-8e26-14a4bb832194 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:03.952142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce0814bf-1bea-41b8-8e26-14a4bb832194 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:03.952674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce0814bf-1bea-41b8-8e26-14a4bb832194 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:03.953136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce0814bf-1bea-41b8-8e26-14a4bb832194 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:03.954006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce0814bf-1bea-41b8-8e26-14a4bb832194 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:03.954473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce0814bf-1bea-41b8-8e26-14a4bb832194 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:03.962404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce0814bf-1bea-41b8-8e26-14a4bb832194 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:04.018346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce0814bf-1bea-41b8-8e26-14a4bb832194 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:04.020278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce0814bf-1bea-41b8-8e26-14a4bb832194 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:04.020801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce0814bf-1bea-41b8-8e26-14a4bb832194 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:04.023595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-ce0814bf-1bea-41b8-8e26-14a4bb832194 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lazy-loading 'fault' on Instance uuid aab2aae9-7934-4d73-9ed9-21218879fac0 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:47:04.108046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ce0814bf-1bea-41b8-8e26-14a4bb832194 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:04.118406 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ce0814bf-1bea-41b8-8e26-14a4bb832194 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 200 len: 1206 microversion: 2.1 time: 0.203817 Oct 04 21:47:04.122671 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3225/6426] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:03 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 1206 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:05.148742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8187a032-8dd7-4f27-8065-fc131a2004ab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:05.150089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8187a032-8dd7-4f27-8065-fc131a2004ab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:05.189399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8187a032-8dd7-4f27-8065-fc131a2004ab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.190107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8187a032-8dd7-4f27-8065-fc131a2004ab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.190567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8187a032-8dd7-4f27-8065-fc131a2004ab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:05.191299 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8187a032-8dd7-4f27-8065-fc131a2004ab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.191769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8187a032-8dd7-4f27-8065-fc131a2004ab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.192204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8187a032-8dd7-4f27-8065-fc131a2004ab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:05.240590 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-8187a032-8dd7-4f27-8065-fc131a2004ab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] HTTP exception thrown: Instance aab2aae9-7934-4d73-9ed9-21218879fac0 could not be found. Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8187a032-8dd7-4f27-8065-fc131a2004ab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Request method failure captured: Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 HTTP/1.1 Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKgKHoOaT8uqO1KoOPn24xM7P0ylwdbLFlP7NxtckxX5YVgkQXQgvdk_pv_DRrXpTR_A9RTrhRjboZG7XPsaIwCmuey_7FqshLEW4wp7-ccvS6GHij-f3j-K3O_9tzU_63L01blifBD1TcCBZnKNp1OdTYkzGEDdJ0DY_B_XNHTjspY Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68208d23fd2f40479ba279566a819933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68208d23fd2f40479ba279566a819933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}] Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 15748f41da9f49fca3e7eec1fda3b245 Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance aab2aae9-7934-4d73-9ed9-21218879fac0 could not be found. Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'aab2aae9-7934-4d73-9ed9-21218879fac0'} Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab2aae9-7934-4d73-9ed9-21218879fac0 could not be found. Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab2aae9-7934-4d73-9ed9-21218879fac0 could not be found. Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:05.242709 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:05.246932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:05.246932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:05.246932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:05.246932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:47:05.246932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:47:05.246932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab2aae9-7934-4d73-9ed9-21218879fac0 could not be found. Oct 04 21:47:05.246932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:05.246932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8187a032-8dd7-4f27-8065-fc131a2004ab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Returning 404 to user: Instance aab2aae9-7934-4d73-9ed9-21218879fac0 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:05.251494 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8187a032-8dd7-4f27-8065-fc131a2004ab tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 404 len: 111 microversion: 2.1 time: 0.101256 Oct 04 21:47:05.254925 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3202/6427] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:05 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:47:10.113917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ce12f7bf-f336-4c91-9c69-3e2814008d7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:10.117827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ce12f7bf-f336-4c91-9c69-3e2814008d7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:10.136548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce12f7bf-f336-4c91-9c69-3e2814008d7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:10.140234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce12f7bf-f336-4c91-9c69-3e2814008d7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:10.142620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce12f7bf-f336-4c91-9c69-3e2814008d7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:10.146999 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce12f7bf-f336-4c91-9c69-3e2814008d7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:10.148719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce12f7bf-f336-4c91-9c69-3e2814008d7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:10.150957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce12f7bf-f336-4c91-9c69-3e2814008d7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:10.249053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ce12f7bf-f336-4c91-9c69-3e2814008d7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:47:10.693933 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ce12f7bf-f336-4c91-9c69-3e2814008d7c tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "DELETE /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 204 len: 0 microversion: 2.1 time: 0.584862 Oct 04 21:47:10.698054 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3226/6428] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:47:10 2022] DELETE /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:47:10.703545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d64eb283-f89f-4f5e-9017-a325c0cec2c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:10.704066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d64eb283-f89f-4f5e-9017-a325c0cec2c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:10.717925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d64eb283-f89f-4f5e-9017-a325c0cec2c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:10.718582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d64eb283-f89f-4f5e-9017-a325c0cec2c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:10.721947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d64eb283-f89f-4f5e-9017-a325c0cec2c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:10.725673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d64eb283-f89f-4f5e-9017-a325c0cec2c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:10.725673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d64eb283-f89f-4f5e-9017-a325c0cec2c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:10.725673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d64eb283-f89f-4f5e-9017-a325c0cec2c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:10.938701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d64eb283-f89f-4f5e-9017-a325c0cec2c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:10.949031 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d64eb283-f89f-4f5e-9017-a325c0cec2c7 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 200 len: 1513 microversion: 2.1 time: 0.249554 Oct 04 21:47:10.966010 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3203/6429] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:10 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 1513 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:11.985127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bf7d8afe-a023-41d1-9d7b-a94a2275f5c8 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:11.988555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bf7d8afe-a023-41d1-9d7b-a94a2275f5c8 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:12.005160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf7d8afe-a023-41d1-9d7b-a94a2275f5c8 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:12.006756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf7d8afe-a023-41d1-9d7b-a94a2275f5c8 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:12.007420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf7d8afe-a023-41d1-9d7b-a94a2275f5c8 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:12.008358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf7d8afe-a023-41d1-9d7b-a94a2275f5c8 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:12.009060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf7d8afe-a023-41d1-9d7b-a94a2275f5c8 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:12.009706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf7d8afe-a023-41d1-9d7b-a94a2275f5c8 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:12.572998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bf7d8afe-a023-41d1-9d7b-a94a2275f5c8 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:12.587402 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bf7d8afe-a023-41d1-9d7b-a94a2275f5c8 tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 200 len: 1513 microversion: 2.1 time: 0.611216 Oct 04 21:47:12.588006 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3227/6430] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:11 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 1513 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:13.308222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-d59cf8ab-08ae-48a2-a5dc-2207900d625a req-d216c1f2-9e82-4bc8-a324-6a2412ae81cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31308c42-b5ea-4019-a5e8-8b02dfdea368", "name": "network-vif-deleted", "tag": "5051c8db-389d-472f-a009-d33937767690"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:13.336990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d59cf8ab-08ae-48a2-a5dc-2207900d625a req-d216c1f2-9e82-4bc8-a324-6a2412ae81cc service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:13.348094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d59cf8ab-08ae-48a2-a5dc-2207900d625a req-d216c1f2-9e82-4bc8-a324-6a2412ae81cc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:13.348578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d59cf8ab-08ae-48a2-a5dc-2207900d625a req-d216c1f2-9e82-4bc8-a324-6a2412ae81cc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:13.384856 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-d59cf8ab-08ae-48a2-a5dc-2207900d625a req-d216c1f2-9e82-4bc8-a324-6a2412ae81cc service nova] Creating event network-vif-deleted:5051c8db-389d-472f-a009-d33937767690 for instance 31308c42-b5ea-4019-a5e8-8b02dfdea368 on n-h1-860282-1 Oct 04 21:47:13.399479 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-d59cf8ab-08ae-48a2-a5dc-2207900d625a req-d216c1f2-9e82-4bc8-a324-6a2412ae81cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093971 Oct 04 21:47:13.406375 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3204/6431] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:47:13.611205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c88b977b-86e1-43d3-96c7-d5810ab54d7b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:13.611973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c88b977b-86e1-43d3-96c7-d5810ab54d7b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:13.624402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c88b977b-86e1-43d3-96c7-d5810ab54d7b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:13.625238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c88b977b-86e1-43d3-96c7-d5810ab54d7b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:13.629317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c88b977b-86e1-43d3-96c7-d5810ab54d7b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:13.630480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c88b977b-86e1-43d3-96c7-d5810ab54d7b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:13.631253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c88b977b-86e1-43d3-96c7-d5810ab54d7b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:13.631867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c88b977b-86e1-43d3-96c7-d5810ab54d7b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:13.759099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c88b977b-86e1-43d3-96c7-d5810ab54d7b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8489539e7c9c4039ac1168acab3a3ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dace97a17e0b4ff69a81c51fe9cbbad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:13.784921 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c88b977b-86e1-43d3-96c7-d5810ab54d7b tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 200 len: 1303 microversion: 2.1 time: 0.177581 Oct 04 21:47:13.787104 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3228/6432] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:13 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 1303 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:14.819052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-20872612-b87d-4514-9c79-e45a76c66e7a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:14.820471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-20872612-b87d-4514-9c79-e45a76c66e7a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] [instance: 31308c42-b5ea-4019-a5e8-8b02dfdea368] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:14.827521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20872612-b87d-4514-9c79-e45a76c66e7a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:14.829338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20872612-b87d-4514-9c79-e45a76c66e7a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:14.829338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20872612-b87d-4514-9c79-e45a76c66e7a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:14.829338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20872612-b87d-4514-9c79-e45a76c66e7a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:14.829853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20872612-b87d-4514-9c79-e45a76c66e7a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:14.830333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-20872612-b87d-4514-9c79-e45a76c66e7a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:14.902898 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-20872612-b87d-4514-9c79-e45a76c66e7a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] HTTP exception thrown: Instance 31308c42-b5ea-4019-a5e8-8b02dfdea368 could not be found. Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-20872612-b87d-4514-9c79-e45a76c66e7a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Request method failure captured: Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 HTTP/1.1 Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKiBQEQCh15vb1e3yqhEHMW0ClXtoo06msD9mBztExCZhdxWSZDMa-Xy5aGjafEwyEAWw_W8e9DH0z1uKHnqGvGh6oKgOxU3seriiIMZDb831wrb2duVdM43NeQ0AIedXR20t3eaqvaRO7hkuyBtu22RI-Sjbksunlwvfh092LnzKX8 Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: dace97a17e0b4ff69a81c51fe9cbbad2 Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-VolumesSnapshotTestJSON-272117851 Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dace97a17e0b4ff69a81c51fe9cbbad2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dace97a17e0b4ff69a81c51fe9cbbad2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dace97a17e0b4ff69a81c51fe9cbbad2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dace97a17e0b4ff69a81c51fe9cbbad2"}]}] Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-VolumesSnapshotTestJSON-272117851 Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: dace97a17e0b4ff69a81c51fe9cbbad2 Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-272117851 Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-VolumesSnapshotTestJSON-272117851-project Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 8489539e7c9c4039ac1168acab3a3ed5 Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-VolumesSnapshotTestJSON-272117851-project Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 31308c42-b5ea-4019-a5e8-8b02dfdea368 could not be found. Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '31308c42-b5ea-4019-a5e8-8b02dfdea368'} Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31308c42-b5ea-4019-a5e8-8b02dfdea368 could not be found. Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31308c42-b5ea-4019-a5e8-8b02dfdea368 could not be found. Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:14.910743 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:14.920145 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:14.920145 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:14.920145 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:14.920145 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:47:14.920145 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:47:14.920145 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31308c42-b5ea-4019-a5e8-8b02dfdea368 could not be found. Oct 04 21:47:14.920145 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:14.920145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-20872612-b87d-4514-9c79-e45a76c66e7a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] Returning 404 to user: Instance 31308c42-b5ea-4019-a5e8-8b02dfdea368 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:14.920145 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-20872612-b87d-4514-9c79-e45a76c66e7a tempest-VolumesSnapshotTestJSON-272117851 tempest-VolumesSnapshotTestJSON-272117851-project] 10.222.0.30 "GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368" status: 404 len: 111 microversion: 2.1 time: 0.107925 Oct 04 21:47:14.920145 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3205/6433] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:14 2022] GET /compute/v2.1/servers/31308c42-b5ea-4019-a5e8-8b02dfdea368 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:47:15.744167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-88ba53d1-5827-4421-b896-a59e42bd5008 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:15.746331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-88ba53d1-5827-4421-b896-a59e42bd5008 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:15.761905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88ba53d1-5827-4421-b896-a59e42bd5008 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:15.770836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88ba53d1-5827-4421-b896-a59e42bd5008 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:15.771789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88ba53d1-5827-4421-b896-a59e42bd5008 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:15.775525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88ba53d1-5827-4421-b896-a59e42bd5008 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:15.776213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88ba53d1-5827-4421-b896-a59e42bd5008 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:15.776867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88ba53d1-5827-4421-b896-a59e42bd5008 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:15.837671 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-88ba53d1-5827-4421-b896-a59e42bd5008 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] HTTP exception thrown: Instance 512622af-42ea-4b00-a527-d513faeb9da5 could not be found. Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-88ba53d1-5827-4421-b896-a59e42bd5008 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Request method failure captured: Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 HTTP/1.1 Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKgKHoOaT8uqO1KoOPn24xM7P0ylwdbLFlP7NxtckxX5YVgkQXQgvdk_pv_DRrXpTR_A9RTrhRjboZG7XPsaIwCmuey_7FqshLEW4wp7-ccvS6GHij-f3j-K3O_9tzU_63L01blifBD1TcCBZnKNp1OdTYkzGEDdJ0DY_B_XNHTjspY Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68208d23fd2f40479ba279566a819933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68208d23fd2f40479ba279566a819933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}] Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 15748f41da9f49fca3e7eec1fda3b245 Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 512622af-42ea-4b00-a527-d513faeb9da5 could not be found. Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '512622af-42ea-4b00-a527-d513faeb9da5'} Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512622af-42ea-4b00-a527-d513faeb9da5 could not be found. Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:47:15.847976 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:47:15.852370 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512622af-42ea-4b00-a527-d513faeb9da5 could not be found. Oct 04 21:47:15.852370 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:47:15.852370 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:15.852370 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:47:15.852370 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:15.852370 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:15.852370 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:15.852370 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:47:15.852370 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:47:15.852370 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512622af-42ea-4b00-a527-d513faeb9da5 could not be found. Oct 04 21:47:15.852370 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:47:15.852370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-88ba53d1-5827-4421-b896-a59e42bd5008 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Returning 404 to user: Instance 512622af-42ea-4b00-a527-d513faeb9da5 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:15.852370 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-88ba53d1-5827-4421-b896-a59e42bd5008 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "DELETE /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 404 len: 111 microversion: 2.1 time: 0.108866 Oct 04 21:47:15.854865 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3229/6434] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:47:15 2022] DELETE /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:47:15.859941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bb09b0ae-6fd3-42e5-a2cb-6585485504d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:15.860599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bb09b0ae-6fd3-42e5-a2cb-6585485504d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 512622af-42ea-4b00-a527-d513faeb9da5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:15.877956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb09b0ae-6fd3-42e5-a2cb-6585485504d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:15.881980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb09b0ae-6fd3-42e5-a2cb-6585485504d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:15.883945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb09b0ae-6fd3-42e5-a2cb-6585485504d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:15.884724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb09b0ae-6fd3-42e5-a2cb-6585485504d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:15.885211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb09b0ae-6fd3-42e5-a2cb-6585485504d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:15.885691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb09b0ae-6fd3-42e5-a2cb-6585485504d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:15.909039 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-bb09b0ae-6fd3-42e5-a2cb-6585485504d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] HTTP exception thrown: Instance 512622af-42ea-4b00-a527-d513faeb9da5 could not be found. Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bb09b0ae-6fd3-42e5-a2cb-6585485504d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Request method failure captured: Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 HTTP/1.1 Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKgKHoOaT8uqO1KoOPn24xM7P0ylwdbLFlP7NxtckxX5YVgkQXQgvdk_pv_DRrXpTR_A9RTrhRjboZG7XPsaIwCmuey_7FqshLEW4wp7-ccvS6GHij-f3j-K3O_9tzU_63L01blifBD1TcCBZnKNp1OdTYkzGEDdJ0DY_B_XNHTjspY Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68208d23fd2f40479ba279566a819933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68208d23fd2f40479ba279566a819933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}] Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 15748f41da9f49fca3e7eec1fda3b245 Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 512622af-42ea-4b00-a527-d513faeb9da5 could not be found. Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '512622af-42ea-4b00-a527-d513faeb9da5'} Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512622af-42ea-4b00-a527-d513faeb9da5 could not be found. Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512622af-42ea-4b00-a527-d513faeb9da5 could not be found. Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:15.911054 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:15.920932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:15.920932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:15.920932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:15.920932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:47:15.920932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:47:15.920932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512622af-42ea-4b00-a527-d513faeb9da5 could not be found. Oct 04 21:47:15.920932 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:15.923264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bb09b0ae-6fd3-42e5-a2cb-6585485504d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Returning 404 to user: Instance 512622af-42ea-4b00-a527-d513faeb9da5 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:15.924432 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bb09b0ae-6fd3-42e5-a2cb-6585485504d8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5" status: 404 len: 111 microversion: 2.1 time: 0.068598 Oct 04 21:47:15.925601 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3206/6435] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:15 2022] GET /compute/v2.1/servers/512622af-42ea-4b00-a527-d513faeb9da5 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:47:17.611157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3bd1ef0e-e441-4ae2-a33d-98e26aaf1b91 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:17.623117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3bd1ef0e-e441-4ae2-a33d-98e26aaf1b91 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:17.637021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bd1ef0e-e441-4ae2-a33d-98e26aaf1b91 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:17.637714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bd1ef0e-e441-4ae2-a33d-98e26aaf1b91 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:17.638129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bd1ef0e-e441-4ae2-a33d-98e26aaf1b91 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:17.643365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bd1ef0e-e441-4ae2-a33d-98e26aaf1b91 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:17.647009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bd1ef0e-e441-4ae2-a33d-98e26aaf1b91 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:17.647691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3bd1ef0e-e441-4ae2-a33d-98e26aaf1b91 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:17.685843 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-3bd1ef0e-e441-4ae2-a33d-98e26aaf1b91 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] HTTP exception thrown: Instance aab2aae9-7934-4d73-9ed9-21218879fac0 could not be found. Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3bd1ef0e-e441-4ae2-a33d-98e26aaf1b91 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Request method failure captured: Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 HTTP/1.1 Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKgKHoOaT8uqO1KoOPn24xM7P0ylwdbLFlP7NxtckxX5YVgkQXQgvdk_pv_DRrXpTR_A9RTrhRjboZG7XPsaIwCmuey_7FqshLEW4wp7-ccvS6GHij-f3j-K3O_9tzU_63L01blifBD1TcCBZnKNp1OdTYkzGEDdJ0DY_B_XNHTjspY Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68208d23fd2f40479ba279566a819933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68208d23fd2f40479ba279566a819933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}] Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 15748f41da9f49fca3e7eec1fda3b245 Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance aab2aae9-7934-4d73-9ed9-21218879fac0 could not be found. Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'aab2aae9-7934-4d73-9ed9-21218879fac0'} Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab2aae9-7934-4d73-9ed9-21218879fac0 could not be found. Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:47:17.691819 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:47:17.696893 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab2aae9-7934-4d73-9ed9-21218879fac0 could not be found. Oct 04 21:47:17.696893 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:47:17.696893 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:17.696893 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:47:17.696893 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:17.696893 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:17.696893 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:17.696893 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:47:17.696893 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:47:17.696893 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab2aae9-7934-4d73-9ed9-21218879fac0 could not be found. Oct 04 21:47:17.696893 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:47:17.698811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3bd1ef0e-e441-4ae2-a33d-98e26aaf1b91 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Returning 404 to user: Instance aab2aae9-7934-4d73-9ed9-21218879fac0 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:17.700635 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3bd1ef0e-e441-4ae2-a33d-98e26aaf1b91 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 404 len: 111 microversion: 2.1 time: 0.094147 Oct 04 21:47:17.701720 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3230/6436] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:47:17 2022] DELETE /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:47:17.713086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5d38588d-cd90-45a8-b37b-c825e72848f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:17.713701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5d38588d-cd90-45a8-b37b-c825e72848f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: aab2aae9-7934-4d73-9ed9-21218879fac0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:17.733072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d38588d-cd90-45a8-b37b-c825e72848f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:17.739869 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d38588d-cd90-45a8-b37b-c825e72848f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:17.740459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d38588d-cd90-45a8-b37b-c825e72848f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:17.741254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d38588d-cd90-45a8-b37b-c825e72848f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:17.746335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d38588d-cd90-45a8-b37b-c825e72848f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:17.746871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d38588d-cd90-45a8-b37b-c825e72848f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:17.776477 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-5d38588d-cd90-45a8-b37b-c825e72848f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] HTTP exception thrown: Instance aab2aae9-7934-4d73-9ed9-21218879fac0 could not be found. Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5d38588d-cd90-45a8-b37b-c825e72848f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Request method failure captured: Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 HTTP/1.1 Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKgKHoOaT8uqO1KoOPn24xM7P0ylwdbLFlP7NxtckxX5YVgkQXQgvdk_pv_DRrXpTR_A9RTrhRjboZG7XPsaIwCmuey_7FqshLEW4wp7-ccvS6GHij-f3j-K3O_9tzU_63L01blifBD1TcCBZnKNp1OdTYkzGEDdJ0DY_B_XNHTjspY Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68208d23fd2f40479ba279566a819933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68208d23fd2f40479ba279566a819933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}] Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 15748f41da9f49fca3e7eec1fda3b245 Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance aab2aae9-7934-4d73-9ed9-21218879fac0 could not be found. Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'aab2aae9-7934-4d73-9ed9-21218879fac0'} Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab2aae9-7934-4d73-9ed9-21218879fac0 could not be found. Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab2aae9-7934-4d73-9ed9-21218879fac0 could not be found. Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:17.780245 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:17.784269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:17.784269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:17.784269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:17.784269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:47:17.784269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:47:17.784269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab2aae9-7934-4d73-9ed9-21218879fac0 could not be found. Oct 04 21:47:17.784269 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:47:17.784269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5d38588d-cd90-45a8-b37b-c825e72848f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Returning 404 to user: Instance aab2aae9-7934-4d73-9ed9-21218879fac0 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:17.786336 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5d38588d-cd90-45a8-b37b-c825e72848f8 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0" status: 404 len: 111 microversion: 2.1 time: 0.073694 Oct 04 21:47:17.790296 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3207/6437] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:17 2022] GET /compute/v2.1/servers/aab2aae9-7934-4d73-9ed9-21218879fac0 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:47:17.917726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fa89d027-9dc4-4167-9e1a-9800bc4d3ab3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Action: 'create', calling method: .version_select at 0x7f57905b4ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-793500675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7K0Em2FKb5JSKYjKA487XgGM5NDxEsJv7IX2Uh3Gge33QI772lJoXz75o7JyF8Of1+5gAJXvyhBew+3YB13mOGMXlUyyRqtPprhliDSopZ2hklQ1laoow99dhCeRpvDQ=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:17.944928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-fa89d027-9dc4-4167-9e1a-9800bc4d3ab3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Getting quotas for project 68208d23fd2f40479ba279566a819933. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:47:17.951202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-fa89d027-9dc4-4167-9e1a-9800bc4d3ab3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Getting quotas for user 15748f41da9f49fca3e7eec1fda3b245 and project 68208d23fd2f40479ba279566a819933. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:47:18.065939 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fa89d027-9dc4-4167-9e1a-9800bc4d3ab3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.150816 Oct 04 21:47:18.067325 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3231/6438] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:47:17 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:48:09.825605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5f4ece33-3b86-42fe-ad9d-7ea9e40c18f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-207410977", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-793500675", "security_groups": [{"name": "tempest-secgroup-smoke-419452248"}], "block_device_mapping_v2": [{"uuid": "9365616f-40f5-4878-a7fc-5b262728ca01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b7f4cca9-cdc1-49bd-97e7-bd6739547eb6"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:09.852031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=13 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:09.853232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=45 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:10.013059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-5f4ece33-3b86-42fe-ad9d-7ea9e40c18f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] validate_networks() for [('b7f4cca9-cdc1-49bd-97e7-bd6739547eb6', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:48:10.672795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-5f4ece33-3b86-42fe-ad9d-7ea9e40c18f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:48:10.674542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-5f4ece33-3b86-42fe-ad9d-7ea9e40c18f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:48:10.675956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-5f4ece33-3b86-42fe-ad9d-7ea9e40c18f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:48:10.675956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-5f4ece33-3b86-42fe-ad9d-7ea9e40c18f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:48:10.676412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-5f4ece33-3b86-42fe-ad9d-7ea9e40c18f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:48:10.690739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f4ece33-3b86-42fe-ad9d-7ea9e40c18f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:10.691589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f4ece33-3b86-42fe-ad9d-7ea9e40c18f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:10.692287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f4ece33-3b86-42fe-ad9d-7ea9e40c18f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:10.693959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f4ece33-3b86-42fe-ad9d-7ea9e40c18f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:10.694670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f4ece33-3b86-42fe-ad9d-7ea9e40c18f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:10.695276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f4ece33-3b86-42fe-ad9d-7ea9e40c18f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:10.715649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-5f4ece33-3b86-42fe-ad9d-7ea9e40c18f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Getting quotas for project 68208d23fd2f40479ba279566a819933. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:48:10.722139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-5f4ece33-3b86-42fe-ad9d-7ea9e40c18f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Getting quotas for user 15748f41da9f49fca3e7eec1fda3b245 and project 68208d23fd2f40479ba279566a819933. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:48:10.836401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5f4ece33-3b86-42fe-ad9d-7ea9e40c18f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:48:10.840908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5f4ece33-3b86-42fe-ad9d-7ea9e40c18f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9365616f-40f5-4878-a7fc-5b262728ca01',volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:48:11.554035 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5f4ece33-3b86-42fe-ad9d-7ea9e40c18f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.729702 Oct 04 21:48:11.560038 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3208/6439] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:48:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:48:11.561964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:11.563417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:11.564634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:11.565915 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:48:11.566263 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 21:48:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 (ip 10.222.0.30) !!! Oct 04 21:48:11.579766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8db8f75f-a816-4c30-bf0f-d294e8ee5d8b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:11.587616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8db8f75f-a816-4c30-bf0f-d294e8ee5d8b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:11.695877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8db8f75f-a816-4c30-bf0f-d294e8ee5d8b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:11.724564 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8db8f75f-a816-4c30-bf0f-d294e8ee5d8b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1093 microversion: 2.1 time: 0.163752 Oct 04 21:48:11.725783 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3232/6440] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:11 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1093 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:12.752193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-99aca7e5-faf6-4aa7-a1c2-b7c32e47e70e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:12.752803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-99aca7e5-faf6-4aa7-a1c2-b7c32e47e70e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:12.889607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-99aca7e5-faf6-4aa7-a1c2-b7c32e47e70e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:12.897046 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-99aca7e5-faf6-4aa7-a1c2-b7c32e47e70e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1093 microversion: 2.1 time: 0.148781 Oct 04 21:48:12.921818 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3209/6441] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:12 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1093 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:13.935072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a06b73f9-a080-4541-be42-206c2e6b15cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:13.935714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a06b73f9-a080-4541-be42-206c2e6b15cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:13.952742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a06b73f9-a080-4541-be42-206c2e6b15cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:13.954071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a06b73f9-a080-4541-be42-206c2e6b15cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:13.954946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a06b73f9-a080-4541-be42-206c2e6b15cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:13.959575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a06b73f9-a080-4541-be42-206c2e6b15cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:13.960386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a06b73f9-a080-4541-be42-206c2e6b15cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:13.961098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a06b73f9-a080-4541-be42-206c2e6b15cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:14.087055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a06b73f9-a080-4541-be42-206c2e6b15cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:14.102947 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a06b73f9-a080-4541-be42-206c2e6b15cd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1143 microversion: 2.1 time: 0.172176 Oct 04 21:48:14.104130 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3233/6442] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:13 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1143 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:15.132861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-678be4a6-dc51-4b69-b7f5-b7d3eba5676e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:15.133727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-678be4a6-dc51-4b69-b7f5-b7d3eba5676e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:15.152120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-678be4a6-dc51-4b69-b7f5-b7d3eba5676e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:15.166490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-678be4a6-dc51-4b69-b7f5-b7d3eba5676e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:15.166490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-678be4a6-dc51-4b69-b7f5-b7d3eba5676e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:15.168076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-678be4a6-dc51-4b69-b7f5-b7d3eba5676e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:15.169937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-678be4a6-dc51-4b69-b7f5-b7d3eba5676e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:15.186328 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-678be4a6-dc51-4b69-b7f5-b7d3eba5676e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:15.445854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-678be4a6-dc51-4b69-b7f5-b7d3eba5676e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:15.464102 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-678be4a6-dc51-4b69-b7f5-b7d3eba5676e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1199 microversion: 2.1 time: 0.336543 Oct 04 21:48:15.467726 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3210/6443] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:15 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1199 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:16.495469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f3f67448-6c27-4400-8189-faabf024ba36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:16.496039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f3f67448-6c27-4400-8189-faabf024ba36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:16.509279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3f67448-6c27-4400-8189-faabf024ba36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:16.510180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3f67448-6c27-4400-8189-faabf024ba36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:16.510892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3f67448-6c27-4400-8189-faabf024ba36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:16.511792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3f67448-6c27-4400-8189-faabf024ba36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:16.514007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3f67448-6c27-4400-8189-faabf024ba36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:16.514675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f3f67448-6c27-4400-8189-faabf024ba36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:16.629338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f3f67448-6c27-4400-8189-faabf024ba36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:16.650125 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f3f67448-6c27-4400-8189-faabf024ba36 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1209 microversion: 2.1 time: 0.158977 Oct 04 21:48:16.652892 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3234/6444] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:16 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1209 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:17.680219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e937a9a3-a822-4c79-bf6a-ae78ce4d96cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:17.681818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e937a9a3-a822-4c79-bf6a-ae78ce4d96cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:17.691826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e937a9a3-a822-4c79-bf6a-ae78ce4d96cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:17.694146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e937a9a3-a822-4c79-bf6a-ae78ce4d96cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:17.701826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e937a9a3-a822-4c79-bf6a-ae78ce4d96cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:17.702969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e937a9a3-a822-4c79-bf6a-ae78ce4d96cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:17.708130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e937a9a3-a822-4c79-bf6a-ae78ce4d96cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:17.708130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e937a9a3-a822-4c79-bf6a-ae78ce4d96cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:17.853064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e937a9a3-a822-4c79-bf6a-ae78ce4d96cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:17.870517 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e937a9a3-a822-4c79-bf6a-ae78ce4d96cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1209 microversion: 2.1 time: 0.194077 Oct 04 21:48:17.871816 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3211/6445] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:17 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1209 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:18.898105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0df160a9-0886-44cc-ba21-fa398beab176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:18.899323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0df160a9-0886-44cc-ba21-fa398beab176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:18.917720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0df160a9-0886-44cc-ba21-fa398beab176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:18.918593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0df160a9-0886-44cc-ba21-fa398beab176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:18.919234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0df160a9-0886-44cc-ba21-fa398beab176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:18.920141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0df160a9-0886-44cc-ba21-fa398beab176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:18.920788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0df160a9-0886-44cc-ba21-fa398beab176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:18.921411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0df160a9-0886-44cc-ba21-fa398beab176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:20.122763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0df160a9-0886-44cc-ba21-fa398beab176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:20.135131 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0df160a9-0886-44cc-ba21-fa398beab176 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1276 microversion: 2.1 time: 1.242275 Oct 04 21:48:20.139305 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3235/6446] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:18 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1276 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:21.076691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-1deb20a8-9030-4538-9995-063a59ed8c04 req-2169ab4b-5daf-41d5-8431-6ea46534ab3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f224bc93-0310-4831-8bd0-5c03ac12c242", "tag": "65aaa995-e131-49ee-b00a-dbdc7799cc33"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:21.087417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:21.111114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1deb20a8-9030-4538-9995-063a59ed8c04 req-2169ab4b-5daf-41d5-8431-6ea46534ab3f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:21.111634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1deb20a8-9030-4538-9995-063a59ed8c04 req-2169ab4b-5daf-41d5-8431-6ea46534ab3f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:21.112083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1deb20a8-9030-4538-9995-063a59ed8c04 req-2169ab4b-5daf-41d5-8431-6ea46534ab3f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:21.165018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2d7f3615-36c9-4d07-ba99-a2114c8ee488 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:21.166947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2d7f3615-36c9-4d07-ba99-a2114c8ee488 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:21.167072 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-1deb20a8-9030-4538-9995-063a59ed8c04 req-2169ab4b-5daf-41d5-8431-6ea46534ab3f service nova] Creating event network-changed:65aaa995-e131-49ee-b00a-dbdc7799cc33 for instance f224bc93-0310-4831-8bd0-5c03ac12c242 on n-h1-860282-1 Oct 04 21:48:21.181521 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-1deb20a8-9030-4538-9995-063a59ed8c04 req-2169ab4b-5daf-41d5-8431-6ea46534ab3f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108896 Oct 04 21:48:21.182428 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3212/6447] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:21.187683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d7f3615-36c9-4d07-ba99-a2114c8ee488 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:21.188431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d7f3615-36c9-4d07-ba99-a2114c8ee488 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:21.194341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d7f3615-36c9-4d07-ba99-a2114c8ee488 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:21.196321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d7f3615-36c9-4d07-ba99-a2114c8ee488 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:21.200303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d7f3615-36c9-4d07-ba99-a2114c8ee488 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:21.200869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d7f3615-36c9-4d07-ba99-a2114c8ee488 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:21.598018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2d7f3615-36c9-4d07-ba99-a2114c8ee488 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:21.610523 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2d7f3615-36c9-4d07-ba99-a2114c8ee488 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1276 microversion: 2.1 time: 0.450641 Oct 04 21:48:21.613497 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3236/6448] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:21 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1276 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:22.637999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-da44a266-e2fd-47d3-a7fd-a723efd4c71c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:22.639834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-da44a266-e2fd-47d3-a7fd-a723efd4c71c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:22.661864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-da44a266-e2fd-47d3-a7fd-a723efd4c71c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:22.662495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-da44a266-e2fd-47d3-a7fd-a723efd4c71c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:22.662946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-da44a266-e2fd-47d3-a7fd-a723efd4c71c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:22.663674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-da44a266-e2fd-47d3-a7fd-a723efd4c71c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:22.664140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-da44a266-e2fd-47d3-a7fd-a723efd4c71c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:22.664576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-da44a266-e2fd-47d3-a7fd-a723efd4c71c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:22.893599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:23.119386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-da44a266-e2fd-47d3-a7fd-a723efd4c71c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:23.130874 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-da44a266-e2fd-47d3-a7fd-a723efd4c71c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1276 microversion: 2.1 time: 0.497051 Oct 04 21:48:23.138754 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3213/6449] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:22 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1276 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:24.167223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9dde2ceb-d76b-47d4-aa96-57c2faa9469e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:24.168049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9dde2ceb-d76b-47d4-aa96-57c2faa9469e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:24.188246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:24.194379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9dde2ceb-d76b-47d4-aa96-57c2faa9469e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.195681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9dde2ceb-d76b-47d4-aa96-57c2faa9469e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.198194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9dde2ceb-d76b-47d4-aa96-57c2faa9469e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.199251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9dde2ceb-d76b-47d4-aa96-57c2faa9469e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:24.201359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9dde2ceb-d76b-47d4-aa96-57c2faa9469e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:24.202804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9dde2ceb-d76b-47d4-aa96-57c2faa9469e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:24.456029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9dde2ceb-d76b-47d4-aa96-57c2faa9469e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:24.621632 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9dde2ceb-d76b-47d4-aa96-57c2faa9469e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1276 microversion: 2.1 time: 0.313093 Oct 04 21:48:24.621632 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3237/6450] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:24 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1276 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:25.541133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3f268da1-9c65-4678-8ebb-2b01c9de4c62 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:25.543156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3f268da1-9c65-4678-8ebb-2b01c9de4c62 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:25.558030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f268da1-9c65-4678-8ebb-2b01c9de4c62 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.558924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f268da1-9c65-4678-8ebb-2b01c9de4c62 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.559588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f268da1-9c65-4678-8ebb-2b01c9de4c62 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.560480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f268da1-9c65-4678-8ebb-2b01c9de4c62 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.561101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f268da1-9c65-4678-8ebb-2b01c9de4c62 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.562073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f268da1-9c65-4678-8ebb-2b01c9de4c62 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.913668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3f268da1-9c65-4678-8ebb-2b01c9de4c62 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:25.927681 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3f268da1-9c65-4678-8ebb-2b01c9de4c62 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1276 microversion: 2.1 time: 0.419732 Oct 04 21:48:25.938618 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3214/6451] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:25 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1276 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:26.957294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b1615549-d050-40e9-948c-983510b59ae4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:26.958019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b1615549-d050-40e9-948c-983510b59ae4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:26.975643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1615549-d050-40e9-948c-983510b59ae4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:26.977185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1615549-d050-40e9-948c-983510b59ae4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:26.979181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1615549-d050-40e9-948c-983510b59ae4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:26.980386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1615549-d050-40e9-948c-983510b59ae4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:26.982910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1615549-d050-40e9-948c-983510b59ae4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:26.984908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1615549-d050-40e9-948c-983510b59ae4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:27.527249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b1615549-d050-40e9-948c-983510b59ae4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:27.541042 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b1615549-d050-40e9-948c-983510b59ae4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1276 microversion: 2.1 time: 0.590409 Oct 04 21:48:27.541599 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3238/6452] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:26 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1276 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:28.568466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-311b3e9e-9e63-4a2a-95fc-8fb1ca3e2ec3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:28.569783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-311b3e9e-9e63-4a2a-95fc-8fb1ca3e2ec3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:28.587495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-311b3e9e-9e63-4a2a-95fc-8fb1ca3e2ec3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:28.588003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-311b3e9e-9e63-4a2a-95fc-8fb1ca3e2ec3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:28.588451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-311b3e9e-9e63-4a2a-95fc-8fb1ca3e2ec3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:28.589164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-311b3e9e-9e63-4a2a-95fc-8fb1ca3e2ec3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:28.589663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-311b3e9e-9e63-4a2a-95fc-8fb1ca3e2ec3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:28.590096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-311b3e9e-9e63-4a2a-95fc-8fb1ca3e2ec3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:28.993860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-311b3e9e-9e63-4a2a-95fc-8fb1ca3e2ec3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:29.001236 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-311b3e9e-9e63-4a2a-95fc-8fb1ca3e2ec3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1276 microversion: 2.1 time: 0.438370 Oct 04 21:48:29.004714 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3215/6453] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:28 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1276 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:30.032536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a409996a-18ae-4124-877a-c1ec6a36c2a0 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:30.033178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a409996a-18ae-4124-877a-c1ec6a36c2a0 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:30.059660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a409996a-18ae-4124-877a-c1ec6a36c2a0 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:30.060232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a409996a-18ae-4124-877a-c1ec6a36c2a0 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:30.077409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a409996a-18ae-4124-877a-c1ec6a36c2a0 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:30.080251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a409996a-18ae-4124-877a-c1ec6a36c2a0 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:30.082356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a409996a-18ae-4124-877a-c1ec6a36c2a0 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:30.082848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a409996a-18ae-4124-877a-c1ec6a36c2a0 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:30.629515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a409996a-18ae-4124-877a-c1ec6a36c2a0 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:30.660542 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a409996a-18ae-4124-877a-c1ec6a36c2a0 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1264 microversion: 2.1 time: 0.630543 Oct 04 21:48:30.661226 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3239/6454] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:30 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1264 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:31.688752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ac50ebc1-2dcc-42d5-b245-ef136de6dfe3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:31.690160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ac50ebc1-2dcc-42d5-b245-ef136de6dfe3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:31.703550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac50ebc1-2dcc-42d5-b245-ef136de6dfe3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:31.704058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac50ebc1-2dcc-42d5-b245-ef136de6dfe3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:31.709646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac50ebc1-2dcc-42d5-b245-ef136de6dfe3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:31.711969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac50ebc1-2dcc-42d5-b245-ef136de6dfe3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:31.711969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac50ebc1-2dcc-42d5-b245-ef136de6dfe3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:31.712400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac50ebc1-2dcc-42d5-b245-ef136de6dfe3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:32.012141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ac50ebc1-2dcc-42d5-b245-ef136de6dfe3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:32.038536 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ac50ebc1-2dcc-42d5-b245-ef136de6dfe3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1264 microversion: 2.1 time: 0.349918 Oct 04 21:48:32.040999 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3216/6455] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:31 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1264 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:33.066323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8bc50f36-bf92-48c9-bbef-b83dd6aa65df tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:33.066976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8bc50f36-bf92-48c9-bbef-b83dd6aa65df tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:33.086777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bc50f36-bf92-48c9-bbef-b83dd6aa65df tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:33.087865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bc50f36-bf92-48c9-bbef-b83dd6aa65df tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:33.088390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bc50f36-bf92-48c9-bbef-b83dd6aa65df tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:33.089403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bc50f36-bf92-48c9-bbef-b83dd6aa65df tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:33.090071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bc50f36-bf92-48c9-bbef-b83dd6aa65df tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:33.095063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8bc50f36-bf92-48c9-bbef-b83dd6aa65df tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:33.620073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8bc50f36-bf92-48c9-bbef-b83dd6aa65df tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:33.638571 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8bc50f36-bf92-48c9-bbef-b83dd6aa65df tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1264 microversion: 2.1 time: 0.576398 Oct 04 21:48:33.642831 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3240/6456] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:33 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1264 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:34.674259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-19c628f4-f5b4-4fe2-9fc3-5bee356bdb8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:34.674259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-19c628f4-f5b4-4fe2-9fc3-5bee356bdb8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:34.683742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19c628f4-f5b4-4fe2-9fc3-5bee356bdb8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:34.684599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19c628f4-f5b4-4fe2-9fc3-5bee356bdb8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:34.686007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19c628f4-f5b4-4fe2-9fc3-5bee356bdb8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:34.687060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19c628f4-f5b4-4fe2-9fc3-5bee356bdb8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:34.691128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19c628f4-f5b4-4fe2-9fc3-5bee356bdb8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:34.691880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-19c628f4-f5b4-4fe2-9fc3-5bee356bdb8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:35.084379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-19c628f4-f5b4-4fe2-9fc3-5bee356bdb8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:35.096521 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-19c628f4-f5b4-4fe2-9fc3-5bee356bdb8c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1264 microversion: 2.1 time: 0.430939 Oct 04 21:48:35.100630 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3217/6457] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:34 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1264 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:36.124212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bda0e9be-fa78-44fe-896a-2ad9b29faff5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:36.125542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bda0e9be-fa78-44fe-896a-2ad9b29faff5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:36.140380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bda0e9be-fa78-44fe-896a-2ad9b29faff5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:36.144825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bda0e9be-fa78-44fe-896a-2ad9b29faff5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:36.146131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bda0e9be-fa78-44fe-896a-2ad9b29faff5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:36.147226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bda0e9be-fa78-44fe-896a-2ad9b29faff5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:36.147727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bda0e9be-fa78-44fe-896a-2ad9b29faff5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:36.148168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bda0e9be-fa78-44fe-896a-2ad9b29faff5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:36.184567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-01d5b47b-8d66-4209-8a87-58c4f289dc4a tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-167196498", "availability_zone": "foo_zone"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:36.236357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.aggregate [None req-01d5b47b-8d66-4209-8a87-58c4f289dc4a tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Generated uuid fcd215ed-7e84-4007-8fde-29a5870f6e6b for aggregate {{(pid=122757) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:48:36.434157 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-01d5b47b-8d66-4209-8a87-58c4f289dc4a tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.510292 Oct 04 21:48:36.435812 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3241/6458] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Oct 4 21:48:35 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:36.448476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0962ddc3-3c47-45e9-a3e7-773b71a368f8 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:36.479559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bda0e9be-fa78-44fe-896a-2ad9b29faff5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:36.481203 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bda0e9be-fa78-44fe-896a-2ad9b29faff5 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1264 microversion: 2.1 time: 0.360896 Oct 04 21:48:36.481839 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3218/6459] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:36 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1264 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:48:36.570703 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0962ddc3-3c47-45e9-a3e7-773b71a368f8 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.126929 Oct 04 21:48:36.577874 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3242/6460] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Oct 4 21:48:36 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:36.586534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e182fcd9-da38-47f9-9f78-76c7d711b6fa tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:36.590544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e182fcd9-da38-47f9-9f78-76c7d711b6fa tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:36.591157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e182fcd9-da38-47f9-9f78-76c7d711b6fa tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:36.591533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e182fcd9-da38-47f9-9f78-76c7d711b6fa tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:36.592272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e182fcd9-da38-47f9-9f78-76c7d711b6fa tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:36.613224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e182fcd9-da38-47f9-9f78-76c7d711b6fa tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:36.636416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e182fcd9-da38-47f9-9f78-76c7d711b6fa tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:36.716719 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e182fcd9-da38-47f9-9f78-76c7d711b6fa tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.137164 Oct 04 21:48:36.727299 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3219/6461] 10.222.0.30 () {58 vars in 1176 bytes} [Tue Oct 4 21:48:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:36.732251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e20a0215-3a4c-4aba-87cb-6a88a958e8b4 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:36.741012 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e20a0215-3a4c-4aba-87cb-6a88a958e8b4 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.014602 Oct 04 21:48:36.742119 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3243/6462] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Oct 4 21:48:36 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:36.758759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-426f0f62-93bc-4283-aa38-4040511504c2 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860282-1"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:36.795872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-426f0f62-93bc-4283-aa38-4040511504c2 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:36.796397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-426f0f62-93bc-4283-aa38-4040511504c2 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:36.796874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-426f0f62-93bc-4283-aa38-4040511504c2 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:37.509658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0af80777-340e-4fa3-a48f-1a8789a40056 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:37.510595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0af80777-340e-4fa3-a48f-1a8789a40056 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:37.521460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0af80777-340e-4fa3-a48f-1a8789a40056 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:37.527047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0af80777-340e-4fa3-a48f-1a8789a40056 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:37.531390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0af80777-340e-4fa3-a48f-1a8789a40056 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:37.532522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0af80777-340e-4fa3-a48f-1a8789a40056 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:37.533268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0af80777-340e-4fa3-a48f-1a8789a40056 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:37.534009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0af80777-340e-4fa3-a48f-1a8789a40056 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:37.555969 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-426f0f62-93bc-4283-aa38-4040511504c2 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.801347 Oct 04 21:48:37.571049 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3220/6463] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Oct 4 21:48:36 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:37.580015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bc5ab889-1183-4765-a016-48bca03d6368 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:37.596212 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bc5ab889-1183-4765-a016-48bca03d6368 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.025434 Oct 04 21:48:37.597274 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3221/6464] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:48:37 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:37.611878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-05822077-a405-4b70-9995-20991c3e1e7e tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-506716316", "availability_zone": "foo_zone"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:37.907203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0af80777-340e-4fa3-a48f-1a8789a40056 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:37.916189 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0af80777-340e-4fa3-a48f-1a8789a40056 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1268 microversion: 2.1 time: 0.411739 Oct 04 21:48:37.918566 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3244/6465] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:37 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1268 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:37.944925 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-05822077-a405-4b70-9995-20991c3e1e7e tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.336780 Oct 04 21:48:37.946026 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3222/6466] 10.222.0.30 () {60 vars in 1173 bytes} [Tue Oct 4 21:48:37 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:37.961802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7ddee63a-cb96-4e12-b528-18c0c9b255c7 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:38.081125 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7ddee63a-cb96-4e12-b528-18c0c9b255c7 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.124553 Oct 04 21:48:38.081988 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3245/6467] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Oct 4 21:48:37 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:48:38.099634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b10a8079-84d6-466c-bccb-36a6f465fbf0 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:38.120239 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b10a8079-84d6-466c-bccb-36a6f465fbf0 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.024359 Oct 04 21:48:38.125675 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3223/6468] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Oct 4 21:48:38 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:38.134603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c504e263-ce8a-46be-8a69-bdd8b087dad4 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860282-1"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:38.154384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c504e263-ce8a-46be-8a69-bdd8b087dad4 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:38.155855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c504e263-ce8a-46be-8a69-bdd8b087dad4 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:38.158357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c504e263-ce8a-46be-8a69-bdd8b087dad4 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:38.582649 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c504e263-ce8a-46be-8a69-bdd8b087dad4 tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.452231 Oct 04 21:48:38.585384 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3246/6469] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Oct 4 21:48:38 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:38.607779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a7e8d346-89e5-4761-a698-71cdb47e968f tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:38.746878 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a7e8d346-89e5-4761-a698-71cdb47e968f tempest-TestAggregatesBasicOps-1531930686 tempest-TestAggregatesBasicOps-1531930686-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.151373 Oct 04 21:48:38.750657 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3224/6470] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Oct 4 21:48:38 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:48:38.944924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-678df215-8b9c-4cc9-a690-0de21d8d59a3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:38.945587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-678df215-8b9c-4cc9-a690-0de21d8d59a3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:38.960389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-678df215-8b9c-4cc9-a690-0de21d8d59a3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:38.961782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-678df215-8b9c-4cc9-a690-0de21d8d59a3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:38.963614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-678df215-8b9c-4cc9-a690-0de21d8d59a3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:38.964693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-678df215-8b9c-4cc9-a690-0de21d8d59a3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:38.967974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-678df215-8b9c-4cc9-a690-0de21d8d59a3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:38.968686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-678df215-8b9c-4cc9-a690-0de21d8d59a3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:39.355854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-678df215-8b9c-4cc9-a690-0de21d8d59a3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:39.372331 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-678df215-8b9c-4cc9-a690-0de21d8d59a3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1264 microversion: 2.1 time: 0.433085 Oct 04 21:48:39.384246 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3247/6471] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:38 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1264 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:39.964087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-99e8a871-1dd9-4b9b-9405-5f11f54a3e3c req-70dbe020-e16a-4ff6-96e1-1448ac234a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f224bc93-0310-4831-8bd0-5c03ac12c242", "name": "network-vif-plugged", "status": "completed", "tag": "65aaa995-e131-49ee-b00a-dbdc7799cc33"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:39.992982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-99e8a871-1dd9-4b9b-9405-5f11f54a3e3c req-70dbe020-e16a-4ff6-96e1-1448ac234a5a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:39.995271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-99e8a871-1dd9-4b9b-9405-5f11f54a3e3c req-70dbe020-e16a-4ff6-96e1-1448ac234a5a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:39.997549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-99e8a871-1dd9-4b9b-9405-5f11f54a3e3c req-70dbe020-e16a-4ff6-96e1-1448ac234a5a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:40.026502 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-99e8a871-1dd9-4b9b-9405-5f11f54a3e3c req-70dbe020-e16a-4ff6-96e1-1448ac234a5a service nova] Creating event network-vif-plugged:65aaa995-e131-49ee-b00a-dbdc7799cc33 for instance f224bc93-0310-4831-8bd0-5c03ac12c242 on n-h1-860282-1 Oct 04 21:48:40.040975 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-99e8a871-1dd9-4b9b-9405-5f11f54a3e3c req-70dbe020-e16a-4ff6-96e1-1448ac234a5a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213701 Oct 04 21:48:40.044065 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3225/6472] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:40.408056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ff52eaa6-c9fd-497f-b476-0effe535f9f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:40.408708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ff52eaa6-c9fd-497f-b476-0effe535f9f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:40.441250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff52eaa6-c9fd-497f-b476-0effe535f9f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:40.446177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff52eaa6-c9fd-497f-b476-0effe535f9f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:40.449251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff52eaa6-c9fd-497f-b476-0effe535f9f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:40.452260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff52eaa6-c9fd-497f-b476-0effe535f9f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:40.455170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff52eaa6-c9fd-497f-b476-0effe535f9f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:40.458901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff52eaa6-c9fd-497f-b476-0effe535f9f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:41.116956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ff52eaa6-c9fd-497f-b476-0effe535f9f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:41.129459 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ff52eaa6-c9fd-497f-b476-0effe535f9f6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1264 microversion: 2.1 time: 0.730363 Oct 04 21:48:41.131099 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3248/6473] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:40 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1264 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:42.156303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8cd34d52-2044-4683-9c1a-6057d84eb1bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:42.157153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8cd34d52-2044-4683-9c1a-6057d84eb1bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:42.181331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:42.191940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cd34d52-2044-4683-9c1a-6057d84eb1bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:42.193282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cd34d52-2044-4683-9c1a-6057d84eb1bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:42.195724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cd34d52-2044-4683-9c1a-6057d84eb1bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:42.196623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cd34d52-2044-4683-9c1a-6057d84eb1bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:42.203580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cd34d52-2044-4683-9c1a-6057d84eb1bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:42.210268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8cd34d52-2044-4683-9c1a-6057d84eb1bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:42.237199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=61 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:42.926391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8cd34d52-2044-4683-9c1a-6057d84eb1bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:42.937878 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8cd34d52-2044-4683-9c1a-6057d84eb1bd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1450 microversion: 2.1 time: 0.787747 Oct 04 21:48:42.953028 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3226/6474] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:42 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1450 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:42.963683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6d47b708-4356-49fc-9b2c-da36f7cc4990 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:42.966392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6d47b708-4356-49fc-9b2c-da36f7cc4990 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:42.977751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d47b708-4356-49fc-9b2c-da36f7cc4990 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:42.978599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d47b708-4356-49fc-9b2c-da36f7cc4990 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:42.979167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d47b708-4356-49fc-9b2c-da36f7cc4990 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:42.980001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d47b708-4356-49fc-9b2c-da36f7cc4990 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:42.980579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d47b708-4356-49fc-9b2c-da36f7cc4990 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:42.981145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d47b708-4356-49fc-9b2c-da36f7cc4990 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:43.289281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6d47b708-4356-49fc-9b2c-da36f7cc4990 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:43.305364 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6d47b708-4356-49fc-9b2c-da36f7cc4990 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1450 microversion: 2.1 time: 0.344875 Oct 04 21:48:43.308585 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3249/6475] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:42 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1450 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:48.205148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:48.547845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fa737190-bb35-4ee2-8979-a2d8762ab739 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Action: 'create', calling method: .version_select at 0x7f578ad684c0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-62631751", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCHjq6Th++M1A9Rr74Ti9DvshijhZSPRoxG9Yx5qwP5wIAKImNB63sn2itlICUjTeYGG41+cwNs7DXZFG/kF1YmKCRIktYgd30yzlPQ4KzFAyBD85HYhZHx++0+FQNwlw=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:48.565481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-fa737190-bb35-4ee2-8979-a2d8762ab739 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Getting quotas for project ef3eda5f0edc45b2b4b2dab10b5f3993. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:48:48.571499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-fa737190-bb35-4ee2-8979-a2d8762ab739 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Getting quotas for user 7c8c93a8fc1f47358fde1357a5c702a2 and project ef3eda5f0edc45b2b4b2dab10b5f3993. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:48:48.689066 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fa737190-bb35-4ee2-8979-a2d8762ab739 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.508684 Oct 04 21:48:48.691346 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3227/6476] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:48:48 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:49.266680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-50e23452-6c81-4069-8b22-aec6622b6620 req-23c5e030-6339-41b9-816c-3dcd09627be4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f224bc93-0310-4831-8bd0-5c03ac12c242", "tag": "65aaa995-e131-49ee-b00a-dbdc7799cc33"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:49.272365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:49.290114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-50e23452-6c81-4069-8b22-aec6622b6620 req-23c5e030-6339-41b9-816c-3dcd09627be4 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:49.290664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-50e23452-6c81-4069-8b22-aec6622b6620 req-23c5e030-6339-41b9-816c-3dcd09627be4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:49.293656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-50e23452-6c81-4069-8b22-aec6622b6620 req-23c5e030-6339-41b9-816c-3dcd09627be4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:49.303313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=77 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:49.330226 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-50e23452-6c81-4069-8b22-aec6622b6620 req-23c5e030-6339-41b9-816c-3dcd09627be4 service nova] Creating event network-changed:65aaa995-e131-49ee-b00a-dbdc7799cc33 for instance f224bc93-0310-4831-8bd0-5c03ac12c242 on n-h1-860282-1 Oct 04 21:48:49.339394 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-50e23452-6c81-4069-8b22-aec6622b6620 req-23c5e030-6339-41b9-816c-3dcd09627be4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076084 Oct 04 21:48:49.349210 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3250/6477] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:04.012014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=5 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:04.013959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:04.015817 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:04.024362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2db85e55-68a6-43a4-a275-a431d40c5e2a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-482728042-access_point-107853454", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "9a73a0d8-7efb-472a-8c4b-df66a3055384"}], "key_name": "tempest-TestSecurityGroupsBasicOps-62631751", "security_groups": [{"name": "tempest-secgroup_access--459287606"}, {"name": "tempest-secgroup_general--577257506"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:04.356304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-2db85e55-68a6-43a4-a275-a431d40c5e2a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] validate_networks() for [('9a73a0d8-7efb-472a-8c4b-df66a3055384', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:49:05.239639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2db85e55-68a6-43a4-a275-a431d40c5e2a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:49:05.240315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2db85e55-68a6-43a4-a275-a431d40c5e2a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:49:05.240818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2db85e55-68a6-43a4-a275-a431d40c5e2a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:49:05.241240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2db85e55-68a6-43a4-a275-a431d40c5e2a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:49:05.241716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-2db85e55-68a6-43a4-a275-a431d40c5e2a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:49:05.277526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2db85e55-68a6-43a4-a275-a431d40c5e2a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:05.279729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2db85e55-68a6-43a4-a275-a431d40c5e2a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:05.282318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2db85e55-68a6-43a4-a275-a431d40c5e2a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:05.283558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2db85e55-68a6-43a4-a275-a431d40c5e2a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:05.284237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2db85e55-68a6-43a4-a275-a431d40c5e2a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:05.286151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2db85e55-68a6-43a4-a275-a431d40c5e2a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:05.338872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-2db85e55-68a6-43a4-a275-a431d40c5e2a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Getting quotas for project ef3eda5f0edc45b2b4b2dab10b5f3993. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:49:05.347934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-2db85e55-68a6-43a4-a275-a431d40c5e2a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Getting quotas for user 7c8c93a8fc1f47358fde1357a5c702a2 and project ef3eda5f0edc45b2b4b2dab10b5f3993. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:49:05.397989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2db85e55-68a6-43a4-a275-a431d40c5e2a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:49:05.401029 n-d-860282-1 devstack@n-api.service[122758]: WARNING nova.utils [None req-2db85e55-68a6-43a4-a275-a431d40c5e2a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-482728042-access_point-107853454 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-482728042-acc Oct 04 21:49:05.403951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2db85e55-68a6-43a4-a275-a431d40c5e2a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:49:05.628018 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2db85e55-68a6-43a4-a275-a431d40c5e2a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 1.617630 Oct 04 21:49:05.628718 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3228/6478] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:49:04 2022] POST /compute/v2.1/servers => generated 456 bytes in 1620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:49:05.662983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9fa17ecc-be57-40a2-a590-fe7796bb8c92 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:05.664898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9fa17ecc-be57-40a2-a590-fe7796bb8c92 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:05.850958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9fa17ecc-be57-40a2-a590-fe7796bb8c92 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:05.865974 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9fa17ecc-be57-40a2-a590-fe7796bb8c92 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1291 microversion: 2.1 time: 0.225418 Oct 04 21:49:05.870928 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3251/6479] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:05 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1291 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:06.896524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4e87e7e4-8f48-4b4c-a868-d667334c6663 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:06.896524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4e87e7e4-8f48-4b4c-a868-d667334c6663 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:07.107686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4e87e7e4-8f48-4b4c-a868-d667334c6663 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:07.130862 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4e87e7e4-8f48-4b4c-a868-d667334c6663 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1291 microversion: 2.1 time: 0.238330 Oct 04 21:49:07.130862 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3229/6480] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:06 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1291 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:08.155328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1763726c-e0f3-48ae-9b77-4b470d7f02b6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:08.156598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1763726c-e0f3-48ae-9b77-4b470d7f02b6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:08.295531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1763726c-e0f3-48ae-9b77-4b470d7f02b6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:08.303729 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1763726c-e0f3-48ae-9b77-4b470d7f02b6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1291 microversion: 2.1 time: 0.154298 Oct 04 21:49:08.305023 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3252/6481] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:08 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1291 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:09.339205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aacf4fff-7fbf-41ae-8604-da85d3e5f6ac tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:09.340956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aacf4fff-7fbf-41ae-8604-da85d3e5f6ac tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:09.349569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aacf4fff-7fbf-41ae-8604-da85d3e5f6ac tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.350757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aacf4fff-7fbf-41ae-8604-da85d3e5f6ac tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.351801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aacf4fff-7fbf-41ae-8604-da85d3e5f6ac tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.353263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aacf4fff-7fbf-41ae-8604-da85d3e5f6ac tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.353937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aacf4fff-7fbf-41ae-8604-da85d3e5f6ac tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.354528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aacf4fff-7fbf-41ae-8604-da85d3e5f6ac tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.525357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aacf4fff-7fbf-41ae-8604-da85d3e5f6ac tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:09.540176 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aacf4fff-7fbf-41ae-8604-da85d3e5f6ac tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1295 microversion: 2.1 time: 0.213238 Oct 04 21:49:09.554765 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3230/6482] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:09 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1295 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:10.570888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-08f46120-8de3-4307-8eb0-b69c2e3970c9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:10.572303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-08f46120-8de3-4307-8eb0-b69c2e3970c9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:10.582796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08f46120-8de3-4307-8eb0-b69c2e3970c9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:10.585773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08f46120-8de3-4307-8eb0-b69c2e3970c9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:10.591917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08f46120-8de3-4307-8eb0-b69c2e3970c9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:10.591917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08f46120-8de3-4307-8eb0-b69c2e3970c9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:10.591917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08f46120-8de3-4307-8eb0-b69c2e3970c9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:10.591917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-08f46120-8de3-4307-8eb0-b69c2e3970c9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:10.997883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-08f46120-8de3-4307-8eb0-b69c2e3970c9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:11.023887 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-08f46120-8de3-4307-8eb0-b69c2e3970c9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1343 microversion: 2.1 time: 0.458380 Oct 04 21:49:11.024495 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3253/6483] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:10 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1343 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:12.051647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9909c9f-80d4-4f8d-bc05-f510b415cc72 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:12.052950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d9909c9f-80d4-4f8d-bc05-f510b415cc72 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:12.061934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9909c9f-80d4-4f8d-bc05-f510b415cc72 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:12.062730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9909c9f-80d4-4f8d-bc05-f510b415cc72 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:12.063350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9909c9f-80d4-4f8d-bc05-f510b415cc72 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:12.064240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9909c9f-80d4-4f8d-bc05-f510b415cc72 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:12.064934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9909c9f-80d4-4f8d-bc05-f510b415cc72 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:12.065370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9909c9f-80d4-4f8d-bc05-f510b415cc72 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:12.174474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d9909c9f-80d4-4f8d-bc05-f510b415cc72 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:12.187821 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d9909c9f-80d4-4f8d-bc05-f510b415cc72 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1351 microversion: 2.1 time: 0.140234 Oct 04 21:49:12.194135 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3231/6484] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:12 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1351 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:13.221372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2bfd7f8c-bdac-4175-9370-127381e49cc5 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:13.222789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2bfd7f8c-bdac-4175-9370-127381e49cc5 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:13.238306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2bfd7f8c-bdac-4175-9370-127381e49cc5 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:13.241866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2bfd7f8c-bdac-4175-9370-127381e49cc5 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:13.243218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2bfd7f8c-bdac-4175-9370-127381e49cc5 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:13.245179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2bfd7f8c-bdac-4175-9370-127381e49cc5 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:13.248643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2bfd7f8c-bdac-4175-9370-127381e49cc5 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:13.249310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2bfd7f8c-bdac-4175-9370-127381e49cc5 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:13.691726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2bfd7f8c-bdac-4175-9370-127381e49cc5 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:13.705206 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2bfd7f8c-bdac-4175-9370-127381e49cc5 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1467 microversion: 2.1 time: 0.487609 Oct 04 21:49:13.708193 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3254/6485] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:13 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1467 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:14.736740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-756ad59b-3ba4-429f-b7d7-575389fa9f15 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:14.738155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-756ad59b-3ba4-429f-b7d7-575389fa9f15 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:14.750844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-756ad59b-3ba4-429f-b7d7-575389fa9f15 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:14.752157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-756ad59b-3ba4-429f-b7d7-575389fa9f15 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:14.769207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-756ad59b-3ba4-429f-b7d7-575389fa9f15 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:14.769207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-756ad59b-3ba4-429f-b7d7-575389fa9f15 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:14.785183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-756ad59b-3ba4-429f-b7d7-575389fa9f15 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:14.788116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-756ad59b-3ba4-429f-b7d7-575389fa9f15 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:15.214873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-756ad59b-3ba4-429f-b7d7-575389fa9f15 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:15.227799 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-756ad59b-3ba4-429f-b7d7-575389fa9f15 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1467 microversion: 2.1 time: 0.494908 Oct 04 21:49:15.228521 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3232/6486] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:14 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1467 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:16.102346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-19e35e39-8040-4712-b8ae-58b0634e7394 req-9fec72fb-1202-4cdc-b44e-39c2622e5efc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af03ead-e47b-46d5-b50a-74532a08cdaa", "tag": "50833009-f1ed-4d39-b9b0-53dbc189e45f"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:16.133652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-19e35e39-8040-4712-b8ae-58b0634e7394 req-9fec72fb-1202-4cdc-b44e-39c2622e5efc service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:16.134472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-19e35e39-8040-4712-b8ae-58b0634e7394 req-9fec72fb-1202-4cdc-b44e-39c2622e5efc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:16.135244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-19e35e39-8040-4712-b8ae-58b0634e7394 req-9fec72fb-1202-4cdc-b44e-39c2622e5efc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:16.148131 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-19e35e39-8040-4712-b8ae-58b0634e7394 req-9fec72fb-1202-4cdc-b44e-39c2622e5efc service nova] Creating event network-changed:50833009-f1ed-4d39-b9b0-53dbc189e45f for instance 1af03ead-e47b-46d5-b50a-74532a08cdaa on n-h2-860282-1 Oct 04 21:49:16.162225 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-19e35e39-8040-4712-b8ae-58b0634e7394 req-9fec72fb-1202-4cdc-b44e-39c2622e5efc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.298558 Oct 04 21:49:16.163243 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3255/6487] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:16.253339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cc91458c-4981-45e3-8f5e-5613d6dbe48f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:16.254999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cc91458c-4981-45e3-8f5e-5613d6dbe48f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:16.256914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:16.266076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc91458c-4981-45e3-8f5e-5613d6dbe48f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:16.269218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc91458c-4981-45e3-8f5e-5613d6dbe48f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:16.269960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc91458c-4981-45e3-8f5e-5613d6dbe48f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:16.271216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc91458c-4981-45e3-8f5e-5613d6dbe48f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:16.271915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc91458c-4981-45e3-8f5e-5613d6dbe48f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:16.272548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc91458c-4981-45e3-8f5e-5613d6dbe48f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:16.599796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cc91458c-4981-45e3-8f5e-5613d6dbe48f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:16.608429 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cc91458c-4981-45e3-8f5e-5613d6dbe48f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1467 microversion: 2.1 time: 0.359317 Oct 04 21:49:16.609024 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3233/6488] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:16 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1467 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:17.635292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cb8837c8-ec79-4369-9bec-20f110c5989e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:17.636029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cb8837c8-ec79-4369-9bec-20f110c5989e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:17.642839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb8837c8-ec79-4369-9bec-20f110c5989e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:17.643350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb8837c8-ec79-4369-9bec-20f110c5989e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:17.643838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb8837c8-ec79-4369-9bec-20f110c5989e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:17.644563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb8837c8-ec79-4369-9bec-20f110c5989e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:17.645111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb8837c8-ec79-4369-9bec-20f110c5989e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:17.646335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb8837c8-ec79-4369-9bec-20f110c5989e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:17.910843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cb8837c8-ec79-4369-9bec-20f110c5989e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:17.923510 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cb8837c8-ec79-4369-9bec-20f110c5989e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1467 microversion: 2.1 time: 0.294056 Oct 04 21:49:17.941780 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3256/6489] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:17 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1467 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:18.956780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-edd988b0-5cd0-4bee-be10-75702bede5d3 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:18.959081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-edd988b0-5cd0-4bee-be10-75702bede5d3 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:18.963806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:18.966874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-edd988b0-5cd0-4bee-be10-75702bede5d3 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:18.967376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-edd988b0-5cd0-4bee-be10-75702bede5d3 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:18.967877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-edd988b0-5cd0-4bee-be10-75702bede5d3 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:18.974535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-edd988b0-5cd0-4bee-be10-75702bede5d3 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:18.975347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-edd988b0-5cd0-4bee-be10-75702bede5d3 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:18.975862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-edd988b0-5cd0-4bee-be10-75702bede5d3 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:19.175778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-edd988b0-5cd0-4bee-be10-75702bede5d3 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:19.184671 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-edd988b0-5cd0-4bee-be10-75702bede5d3 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1467 microversion: 2.1 time: 0.234299 Oct 04 21:49:19.185479 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3234/6490] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:18 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1467 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:20.213077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-41157bd8-c4a8-46e0-80c9-6e1a35242af4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:20.214016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-41157bd8-c4a8-46e0-80c9-6e1a35242af4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:20.216986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:20.230157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41157bd8-c4a8-46e0-80c9-6e1a35242af4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:20.230977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41157bd8-c4a8-46e0-80c9-6e1a35242af4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:20.231776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41157bd8-c4a8-46e0-80c9-6e1a35242af4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:20.232725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41157bd8-c4a8-46e0-80c9-6e1a35242af4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:20.233363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41157bd8-c4a8-46e0-80c9-6e1a35242af4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:20.234320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41157bd8-c4a8-46e0-80c9-6e1a35242af4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:20.480896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-41157bd8-c4a8-46e0-80c9-6e1a35242af4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:20.517057 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-41157bd8-c4a8-46e0-80c9-6e1a35242af4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1467 microversion: 2.1 time: 0.283546 Oct 04 21:49:20.517057 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3257/6491] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:20 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1467 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:21.543214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ea20e1ee-8264-4f97-8ba5-6c9926bf848b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:21.564637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ea20e1ee-8264-4f97-8ba5-6c9926bf848b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:21.590561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea20e1ee-8264-4f97-8ba5-6c9926bf848b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:21.593299 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea20e1ee-8264-4f97-8ba5-6c9926bf848b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:21.600974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea20e1ee-8264-4f97-8ba5-6c9926bf848b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:21.602429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea20e1ee-8264-4f97-8ba5-6c9926bf848b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:21.602762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea20e1ee-8264-4f97-8ba5-6c9926bf848b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:21.603303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea20e1ee-8264-4f97-8ba5-6c9926bf848b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:21.787635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ea20e1ee-8264-4f97-8ba5-6c9926bf848b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:21.796168 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ea20e1ee-8264-4f97-8ba5-6c9926bf848b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1467 microversion: 2.1 time: 0.260020 Oct 04 21:49:21.796824 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3235/6492] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:21 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1467 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:22.423906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-38ae33ee-c809-4aa2-938f-f75b192bbe9d req-3f392635-36f2-477f-9451-bb360d339b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af03ead-e47b-46d5-b50a-74532a08cdaa", "name": "network-vif-plugged", "status": "completed", "tag": "50833009-f1ed-4d39-b9b0-53dbc189e45f"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:22.439430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-38ae33ee-c809-4aa2-938f-f75b192bbe9d req-3f392635-36f2-477f-9451-bb360d339b15 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:22.440204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-38ae33ee-c809-4aa2-938f-f75b192bbe9d req-3f392635-36f2-477f-9451-bb360d339b15 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:22.440830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-38ae33ee-c809-4aa2-938f-f75b192bbe9d req-3f392635-36f2-477f-9451-bb360d339b15 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:22.453820 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-38ae33ee-c809-4aa2-938f-f75b192bbe9d req-3f392635-36f2-477f-9451-bb360d339b15 service nova] Creating event network-vif-plugged:50833009-f1ed-4d39-b9b0-53dbc189e45f for instance 1af03ead-e47b-46d5-b50a-74532a08cdaa on n-h2-860282-1 Oct 04 21:49:22.483639 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-38ae33ee-c809-4aa2-938f-f75b192bbe9d req-3f392635-36f2-477f-9451-bb360d339b15 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040534 Oct 04 21:49:22.483639 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3258/6493] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:22.820210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f7cc4410-9d51-44e5-95c2-7cdce77ad89d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:22.820866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f7cc4410-9d51-44e5-95c2-7cdce77ad89d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:22.830686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7cc4410-9d51-44e5-95c2-7cdce77ad89d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:22.831174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7cc4410-9d51-44e5-95c2-7cdce77ad89d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:22.831678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7cc4410-9d51-44e5-95c2-7cdce77ad89d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:22.832319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7cc4410-9d51-44e5-95c2-7cdce77ad89d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:22.833009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7cc4410-9d51-44e5-95c2-7cdce77ad89d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:22.833486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f7cc4410-9d51-44e5-95c2-7cdce77ad89d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:23.034131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f7cc4410-9d51-44e5-95c2-7cdce77ad89d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:23.043362 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f7cc4410-9d51-44e5-95c2-7cdce77ad89d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1467 microversion: 2.1 time: 0.228142 Oct 04 21:49:23.054113 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3236/6494] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:22 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1467 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:24.072101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f8fc940d-e255-408b-920d-115663ce335a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:24.073813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f8fc940d-e255-408b-920d-115663ce335a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:24.081217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8fc940d-e255-408b-920d-115663ce335a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:24.082285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8fc940d-e255-408b-920d-115663ce335a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:24.083682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8fc940d-e255-408b-920d-115663ce335a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:24.084863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8fc940d-e255-408b-920d-115663ce335a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:24.085677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8fc940d-e255-408b-920d-115663ce335a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:24.086801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8fc940d-e255-408b-920d-115663ce335a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:24.329157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f8fc940d-e255-408b-920d-115663ce335a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:24.338553 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f8fc940d-e255-408b-920d-115663ce335a tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1639 microversion: 2.1 time: 0.273719 Oct 04 21:49:24.341494 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3259/6495] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:24 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1639 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:24.362036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dfe2441e-1fb6-4662-9edb-4b84bd3b3864 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:24.362813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dfe2441e-1fb6-4662-9edb-4b84bd3b3864 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:24.372180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfe2441e-1fb6-4662-9edb-4b84bd3b3864 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:24.373021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfe2441e-1fb6-4662-9edb-4b84bd3b3864 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:24.373738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfe2441e-1fb6-4662-9edb-4b84bd3b3864 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:24.377470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfe2441e-1fb6-4662-9edb-4b84bd3b3864 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:24.378267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfe2441e-1fb6-4662-9edb-4b84bd3b3864 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:24.378919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfe2441e-1fb6-4662-9edb-4b84bd3b3864 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:24.619959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dfe2441e-1fb6-4662-9edb-4b84bd3b3864 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:24.630945 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dfe2441e-1fb6-4662-9edb-4b84bd3b3864 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1639 microversion: 2.1 time: 0.273085 Oct 04 21:49:24.631543 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3237/6496] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:24 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1639 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:24.653027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8b45e6c0-5816-413e-b68b-9ee9dee7e112 tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:24.653716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8b45e6c0-5816-413e-b68b-9ee9dee7e112 tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:24.660059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b45e6c0-5816-413e-b68b-9ee9dee7e112 tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:24.660560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b45e6c0-5816-413e-b68b-9ee9dee7e112 tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:24.661192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b45e6c0-5816-413e-b68b-9ee9dee7e112 tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:24.662130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b45e6c0-5816-413e-b68b-9ee9dee7e112 tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:24.662777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b45e6c0-5816-413e-b68b-9ee9dee7e112 tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:24.663105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b45e6c0-5816-413e-b68b-9ee9dee7e112 tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:24.987375 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8b45e6c0-5816-413e-b68b-9ee9dee7e112 tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1790 microversion: 2.1 time: 0.337939 Oct 04 21:49:24.987972 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3260/6497] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:24 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1790 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:27.560242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-ee4e2a33-26cd-4821-a557-5fc48678d1df req-e82476a6-8ce5-4829-9293-daed381e6863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af03ead-e47b-46d5-b50a-74532a08cdaa", "tag": "50833009-f1ed-4d39-b9b0-53dbc189e45f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:27.589612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ee4e2a33-26cd-4821-a557-5fc48678d1df req-e82476a6-8ce5-4829-9293-daed381e6863 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:27.595687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ee4e2a33-26cd-4821-a557-5fc48678d1df req-e82476a6-8ce5-4829-9293-daed381e6863 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:27.595687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ee4e2a33-26cd-4821-a557-5fc48678d1df req-e82476a6-8ce5-4829-9293-daed381e6863 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:27.605763 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-ee4e2a33-26cd-4821-a557-5fc48678d1df req-e82476a6-8ce5-4829-9293-daed381e6863 service nova] Creating event network-changed:50833009-f1ed-4d39-b9b0-53dbc189e45f for instance 1af03ead-e47b-46d5-b50a-74532a08cdaa on n-h2-860282-1 Oct 04 21:49:27.614192 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-ee4e2a33-26cd-4821-a557-5fc48678d1df req-e82476a6-8ce5-4829-9293-daed381e6863 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056439 Oct 04 21:49:27.616003 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3238/6498] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:15.181697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-82789b79-5a71-4be0-84c5-de6bfca4d087 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1543279110", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "7f9cd79a-0239-4eee-938a-7aea85f66a62"}], "key_name": "tempest-TestSecurityGroupsBasicOps-62631751", "security_groups": []}, "os:scheduler_hints": {"different_host": ["1af03ead-e47b-46d5-b50a-74532a08cdaa"]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:15.202041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=25 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:15.204066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=41 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:15.327982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-82789b79-5a71-4be0-84c5-de6bfca4d087 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] validate_networks() for [('7f9cd79a-0239-4eee-938a-7aea85f66a62', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:50:16.655435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-82789b79-5a71-4be0-84c5-de6bfca4d087 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:50:16.656052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-82789b79-5a71-4be0-84c5-de6bfca4d087 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:50:16.656360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-82789b79-5a71-4be0-84c5-de6bfca4d087 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:50:16.656789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-82789b79-5a71-4be0-84c5-de6bfca4d087 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:50:16.657433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-82789b79-5a71-4be0-84c5-de6bfca4d087 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:50:16.667459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82789b79-5a71-4be0-84c5-de6bfca4d087 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:16.667968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82789b79-5a71-4be0-84c5-de6bfca4d087 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:16.668422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82789b79-5a71-4be0-84c5-de6bfca4d087 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:16.669172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82789b79-5a71-4be0-84c5-de6bfca4d087 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:16.669689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82789b79-5a71-4be0-84c5-de6bfca4d087 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:16.670139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82789b79-5a71-4be0-84c5-de6bfca4d087 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:16.693518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-82789b79-5a71-4be0-84c5-de6bfca4d087 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Getting quotas for project ef3eda5f0edc45b2b4b2dab10b5f3993. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:50:16.693900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-82789b79-5a71-4be0-84c5-de6bfca4d087 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Getting quotas for user 7c8c93a8fc1f47358fde1357a5c702a2 and project ef3eda5f0edc45b2b4b2dab10b5f3993. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:50:16.707367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-82789b79-5a71-4be0-84c5-de6bfca4d087 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:50:16.709996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-82789b79-5a71-4be0-84c5-de6bfca4d087 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:50:16.819014 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-82789b79-5a71-4be0-84c5-de6bfca4d087 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.641671 Oct 04 21:50:16.820452 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3261/6499] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:50:15 2022] POST /compute/v2.1/servers => generated 361 bytes in 1644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:50:16.832762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dfe60db3-f91b-4857-be1c-b9414b7beb93 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:16.833487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dfe60db3-f91b-4857-be1c-b9414b7beb93 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:16.842309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:16.854360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=52 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:16.979179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dfe60db3-f91b-4857-be1c-b9414b7beb93 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:16.990847 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dfe60db3-f91b-4857-be1c-b9414b7beb93 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca" status: 200 len: 1240 microversion: 2.1 time: 0.162016 Oct 04 21:50:17.002434 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3239/6500] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:16 2022] GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca => generated 1240 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:18.033126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bdf9de06-2aa8-41f9-bba9-22782d165fec tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:18.034721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bdf9de06-2aa8-41f9-bba9-22782d165fec tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:18.046152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bdf9de06-2aa8-41f9-bba9-22782d165fec tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:18.047183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bdf9de06-2aa8-41f9-bba9-22782d165fec tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:18.063944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bdf9de06-2aa8-41f9-bba9-22782d165fec tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:18.063944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bdf9de06-2aa8-41f9-bba9-22782d165fec tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:18.063944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bdf9de06-2aa8-41f9-bba9-22782d165fec tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:18.064976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bdf9de06-2aa8-41f9-bba9-22782d165fec tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:18.192672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bdf9de06-2aa8-41f9-bba9-22782d165fec tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:18.201595 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bdf9de06-2aa8-41f9-bba9-22782d165fec tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca" status: 200 len: 1244 microversion: 2.1 time: 0.190202 Oct 04 21:50:18.208515 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3262/6501] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:18 2022] GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca => generated 1244 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:19.231294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a04463f-05fc-4b56-8dd9-47d895a64d7b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:19.231929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7a04463f-05fc-4b56-8dd9-47d895a64d7b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:19.239146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a04463f-05fc-4b56-8dd9-47d895a64d7b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:19.239756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a04463f-05fc-4b56-8dd9-47d895a64d7b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:19.240213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a04463f-05fc-4b56-8dd9-47d895a64d7b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:19.240922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a04463f-05fc-4b56-8dd9-47d895a64d7b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:19.241521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a04463f-05fc-4b56-8dd9-47d895a64d7b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:19.241950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a04463f-05fc-4b56-8dd9-47d895a64d7b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:19.317911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7a04463f-05fc-4b56-8dd9-47d895a64d7b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:19.328390 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7a04463f-05fc-4b56-8dd9-47d895a64d7b tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca" status: 200 len: 1292 microversion: 2.1 time: 0.101667 Oct 04 21:50:19.344288 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3240/6502] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:19 2022] GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca => generated 1292 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:20.356349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4a2898c0-f2ac-43d4-8d1e-19890d0d7f36 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:20.358179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4a2898c0-f2ac-43d4-8d1e-19890d0d7f36 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:20.394695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a2898c0-f2ac-43d4-8d1e-19890d0d7f36 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:20.395261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a2898c0-f2ac-43d4-8d1e-19890d0d7f36 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:20.395857 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a2898c0-f2ac-43d4-8d1e-19890d0d7f36 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:20.396866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a2898c0-f2ac-43d4-8d1e-19890d0d7f36 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:20.397391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a2898c0-f2ac-43d4-8d1e-19890d0d7f36 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:20.397863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a2898c0-f2ac-43d4-8d1e-19890d0d7f36 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:20.504837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4a2898c0-f2ac-43d4-8d1e-19890d0d7f36 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:20.515468 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4a2898c0-f2ac-43d4-8d1e-19890d0d7f36 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca" status: 200 len: 1298 microversion: 2.1 time: 0.164880 Oct 04 21:50:20.524337 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3263/6503] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:20 2022] GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca => generated 1298 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:21.498049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-b756f6c5-70c0-4608-8e75-dcbb3381f76b req-4385ec8e-81c5-4ea5-ab1e-a64b0d31e3ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c7c39d6-174b-432a-9c9e-25d24b2152ca", "tag": "a40cc122-f541-47bc-a3ad-1bcf99eec8f2"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:21.512574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b756f6c5-70c0-4608-8e75-dcbb3381f76b req-4385ec8e-81c5-4ea5-ab1e-a64b0d31e3ca service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:21.513649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b756f6c5-70c0-4608-8e75-dcbb3381f76b req-4385ec8e-81c5-4ea5-ab1e-a64b0d31e3ca service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:21.514102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b756f6c5-70c0-4608-8e75-dcbb3381f76b req-4385ec8e-81c5-4ea5-ab1e-a64b0d31e3ca service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:21.554258 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-b756f6c5-70c0-4608-8e75-dcbb3381f76b req-4385ec8e-81c5-4ea5-ab1e-a64b0d31e3ca service nova] Creating event network-changed:a40cc122-f541-47bc-a3ad-1bcf99eec8f2 for instance 3c7c39d6-174b-432a-9c9e-25d24b2152ca on n-h1-860282-1 Oct 04 21:50:21.554430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f4fe12d7-58a2-47e0-b55e-18aed4a15c20 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:21.555798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f4fe12d7-58a2-47e0-b55e-18aed4a15c20 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:21.572424 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-b756f6c5-70c0-4608-8e75-dcbb3381f76b req-4385ec8e-81c5-4ea5-ab1e-a64b0d31e3ca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074711 Oct 04 21:50:21.573964 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3241/6504] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:21.580949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4fe12d7-58a2-47e0-b55e-18aed4a15c20 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:21.581813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4fe12d7-58a2-47e0-b55e-18aed4a15c20 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:21.582674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4fe12d7-58a2-47e0-b55e-18aed4a15c20 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:21.583593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4fe12d7-58a2-47e0-b55e-18aed4a15c20 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:21.584963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4fe12d7-58a2-47e0-b55e-18aed4a15c20 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:21.585636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4fe12d7-58a2-47e0-b55e-18aed4a15c20 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:21.723955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f4fe12d7-58a2-47e0-b55e-18aed4a15c20 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:21.733858 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f4fe12d7-58a2-47e0-b55e-18aed4a15c20 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca" status: 200 len: 1298 microversion: 2.1 time: 0.193163 Oct 04 21:50:21.735174 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3264/6505] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:21 2022] GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca => generated 1298 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:22.759107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-564f2f8f-2cde-4ad1-b530-205cad9c36e6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:22.759956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-564f2f8f-2cde-4ad1-b530-205cad9c36e6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:22.766960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-564f2f8f-2cde-4ad1-b530-205cad9c36e6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:22.767599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-564f2f8f-2cde-4ad1-b530-205cad9c36e6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:22.768083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-564f2f8f-2cde-4ad1-b530-205cad9c36e6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:22.768834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-564f2f8f-2cde-4ad1-b530-205cad9c36e6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:22.769551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-564f2f8f-2cde-4ad1-b530-205cad9c36e6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:22.769991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-564f2f8f-2cde-4ad1-b530-205cad9c36e6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:22.856903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-564f2f8f-2cde-4ad1-b530-205cad9c36e6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:22.864866 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-564f2f8f-2cde-4ad1-b530-205cad9c36e6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca" status: 200 len: 1298 microversion: 2.1 time: 0.111748 Oct 04 21:50:22.865470 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3242/6506] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:22 2022] GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca => generated 1298 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:23.890027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b2cd69bd-4c91-4072-ad85-e01298f72692 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:23.890783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b2cd69bd-4c91-4072-ad85-e01298f72692 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:23.898315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2cd69bd-4c91-4072-ad85-e01298f72692 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:23.899499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2cd69bd-4c91-4072-ad85-e01298f72692 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:23.900067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2cd69bd-4c91-4072-ad85-e01298f72692 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:23.901129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2cd69bd-4c91-4072-ad85-e01298f72692 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:23.901710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2cd69bd-4c91-4072-ad85-e01298f72692 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:23.902165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2cd69bd-4c91-4072-ad85-e01298f72692 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:23.988970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b2cd69bd-4c91-4072-ad85-e01298f72692 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:23.997553 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b2cd69bd-4c91-4072-ad85-e01298f72692 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca" status: 200 len: 1298 microversion: 2.1 time: 0.111348 Oct 04 21:50:23.998496 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3265/6507] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:23 2022] GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca => generated 1298 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:25.022442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ef84cd67-c90a-4040-8f0e-7db3fd9cef86 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:25.023554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ef84cd67-c90a-4040-8f0e-7db3fd9cef86 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:25.033365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef84cd67-c90a-4040-8f0e-7db3fd9cef86 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:25.034085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef84cd67-c90a-4040-8f0e-7db3fd9cef86 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:25.034085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef84cd67-c90a-4040-8f0e-7db3fd9cef86 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:25.034912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef84cd67-c90a-4040-8f0e-7db3fd9cef86 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:25.035623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef84cd67-c90a-4040-8f0e-7db3fd9cef86 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:25.036047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef84cd67-c90a-4040-8f0e-7db3fd9cef86 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:25.132444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ef84cd67-c90a-4040-8f0e-7db3fd9cef86 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:25.140428 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ef84cd67-c90a-4040-8f0e-7db3fd9cef86 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca" status: 200 len: 1298 microversion: 2.1 time: 0.122874 Oct 04 21:50:25.141021 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3243/6508] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:25 2022] GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca => generated 1298 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:26.169161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-96e56c0a-78d9-4fde-9eae-9d251e659ec8 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:26.169843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-96e56c0a-78d9-4fde-9eae-9d251e659ec8 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:26.181038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96e56c0a-78d9-4fde-9eae-9d251e659ec8 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:26.183256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96e56c0a-78d9-4fde-9eae-9d251e659ec8 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:26.183256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96e56c0a-78d9-4fde-9eae-9d251e659ec8 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:26.196471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96e56c0a-78d9-4fde-9eae-9d251e659ec8 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:26.197000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96e56c0a-78d9-4fde-9eae-9d251e659ec8 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:26.197972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96e56c0a-78d9-4fde-9eae-9d251e659ec8 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:26.298562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-96e56c0a-78d9-4fde-9eae-9d251e659ec8 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:26.310991 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-96e56c0a-78d9-4fde-9eae-9d251e659ec8 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca" status: 200 len: 1298 microversion: 2.1 time: 0.150753 Oct 04 21:50:26.312061 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3266/6509] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:26 2022] GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca => generated 1298 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:27.339160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1a96cf05-121e-45b2-b69e-c469bd420216 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:27.339792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1a96cf05-121e-45b2-b69e-c469bd420216 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:27.342823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:27.354725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1a96cf05-121e-45b2-b69e-c469bd420216 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:27.355232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1a96cf05-121e-45b2-b69e-c469bd420216 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:27.355672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1a96cf05-121e-45b2-b69e-c469bd420216 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:27.356382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1a96cf05-121e-45b2-b69e-c469bd420216 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:27.356840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1a96cf05-121e-45b2-b69e-c469bd420216 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:27.357302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1a96cf05-121e-45b2-b69e-c469bd420216 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:27.466383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1a96cf05-121e-45b2-b69e-c469bd420216 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:27.478846 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1a96cf05-121e-45b2-b69e-c469bd420216 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca" status: 200 len: 1298 microversion: 2.1 time: 0.144417 Oct 04 21:50:27.479745 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3244/6510] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:27 2022] GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca => generated 1298 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:27.928177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-8b5ece23-9ea4-424c-8997-8e52e42c5d64 req-ff45eca6-3c85-4b38-ab8d-b99420ab7810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c7c39d6-174b-432a-9c9e-25d24b2152ca", "name": "network-vif-plugged", "status": "completed", "tag": "a40cc122-f541-47bc-a3ad-1bcf99eec8f2"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:27.946413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:27.948260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:27.957032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8b5ece23-9ea4-424c-8997-8e52e42c5d64 req-ff45eca6-3c85-4b38-ab8d-b99420ab7810 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:27.957815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8b5ece23-9ea4-424c-8997-8e52e42c5d64 req-ff45eca6-3c85-4b38-ab8d-b99420ab7810 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:27.958805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8b5ece23-9ea4-424c-8997-8e52e42c5d64 req-ff45eca6-3c85-4b38-ab8d-b99420ab7810 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:27.980028 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-8b5ece23-9ea4-424c-8997-8e52e42c5d64 req-ff45eca6-3c85-4b38-ab8d-b99420ab7810 service nova] Creating event network-vif-plugged:a40cc122-f541-47bc-a3ad-1bcf99eec8f2 for instance 3c7c39d6-174b-432a-9c9e-25d24b2152ca on n-h1-860282-1 Oct 04 21:50:27.986043 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-8b5ece23-9ea4-424c-8997-8e52e42c5d64 req-ff45eca6-3c85-4b38-ab8d-b99420ab7810 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062011 Oct 04 21:50:27.986660 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3267/6511] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:28.502015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d2e3d960-7b85-43ab-afa3-9115d00cf45d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:28.502835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d2e3d960-7b85-43ab-afa3-9115d00cf45d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:28.513594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2e3d960-7b85-43ab-afa3-9115d00cf45d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:28.514093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2e3d960-7b85-43ab-afa3-9115d00cf45d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:28.514539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2e3d960-7b85-43ab-afa3-9115d00cf45d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:28.515246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2e3d960-7b85-43ab-afa3-9115d00cf45d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:28.515706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2e3d960-7b85-43ab-afa3-9115d00cf45d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:28.516135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d2e3d960-7b85-43ab-afa3-9115d00cf45d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:28.609313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d2e3d960-7b85-43ab-afa3-9115d00cf45d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:28.617181 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d2e3d960-7b85-43ab-afa3-9115d00cf45d tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca" status: 200 len: 1298 microversion: 2.1 time: 0.118984 Oct 04 21:50:28.618484 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3245/6512] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:28 2022] GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:29.642126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d4629348-4441-4a86-ac9d-ac550557b4c7 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:29.642776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d4629348-4441-4a86-ac9d-ac550557b4c7 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:29.655246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4629348-4441-4a86-ac9d-ac550557b4c7 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:29.655835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4629348-4441-4a86-ac9d-ac550557b4c7 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:29.656558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4629348-4441-4a86-ac9d-ac550557b4c7 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:29.657362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4629348-4441-4a86-ac9d-ac550557b4c7 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:29.658434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4629348-4441-4a86-ac9d-ac550557b4c7 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:29.658964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4629348-4441-4a86-ac9d-ac550557b4c7 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:29.761906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d4629348-4441-4a86-ac9d-ac550557b4c7 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:29.776254 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d4629348-4441-4a86-ac9d-ac550557b4c7 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca" status: 200 len: 1471 microversion: 2.1 time: 0.139618 Oct 04 21:50:29.776906 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3268/6513] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:29 2022] GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca => generated 1471 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:29.804285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-32a7cc81-b8a3-4024-9772-b82276bb2af2 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:29.808466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-32a7cc81-b8a3-4024-9772-b82276bb2af2 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:29.817918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-32a7cc81-b8a3-4024-9772-b82276bb2af2 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:29.818415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-32a7cc81-b8a3-4024-9772-b82276bb2af2 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:29.819121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-32a7cc81-b8a3-4024-9772-b82276bb2af2 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:29.819685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-32a7cc81-b8a3-4024-9772-b82276bb2af2 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:29.820204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-32a7cc81-b8a3-4024-9772-b82276bb2af2 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:29.821229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-32a7cc81-b8a3-4024-9772-b82276bb2af2 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:29.912375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-32a7cc81-b8a3-4024-9772-b82276bb2af2 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:29.921796 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-32a7cc81-b8a3-4024-9772-b82276bb2af2 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca" status: 200 len: 1471 microversion: 2.1 time: 0.121372 Oct 04 21:50:29.926872 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3246/6514] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:29 2022] GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca => generated 1471 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:29.953243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-17594acc-e406-4ec6-abcf-75707f69185a tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:29.953243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-17594acc-e406-4ec6-abcf-75707f69185a tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:29.956373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17594acc-e406-4ec6-abcf-75707f69185a tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:29.956890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17594acc-e406-4ec6-abcf-75707f69185a tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:29.957349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17594acc-e406-4ec6-abcf-75707f69185a tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:29.958197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17594acc-e406-4ec6-abcf-75707f69185a tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:29.958712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17594acc-e406-4ec6-abcf-75707f69185a tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:29.960979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17594acc-e406-4ec6-abcf-75707f69185a tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:30.043914 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-17594acc-e406-4ec6-abcf-75707f69185a tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca" status: 200 len: 1622 microversion: 2.1 time: 0.101253 Oct 04 21:50:30.044586 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3269/6515] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:29 2022] GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca => generated 1622 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:50:30.066654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fadc4727-a453-47de-afad-db6ae15dafbe tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:30.067298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fadc4727-a453-47de-afad-db6ae15dafbe tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:30.074747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fadc4727-a453-47de-afad-db6ae15dafbe tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:30.076150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fadc4727-a453-47de-afad-db6ae15dafbe tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:30.076150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fadc4727-a453-47de-afad-db6ae15dafbe tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:30.076765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fadc4727-a453-47de-afad-db6ae15dafbe tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:30.076905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fadc4727-a453-47de-afad-db6ae15dafbe tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:30.077620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fadc4727-a453-47de-afad-db6ae15dafbe tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:30.258695 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fadc4727-a453-47de-afad-db6ae15dafbe tempest-TestSecurityGroupsBasicOps-872908713 tempest-TestSecurityGroupsBasicOps-872908713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1909 microversion: 2.1 time: 0.195676 Oct 04 21:50:30.273443 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3247/6516] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:30 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1909 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:30.755625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7d55bbde-1576-4b70-9ba4-47ee15c34fcd tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:30.756402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7d55bbde-1576-4b70-9ba4-47ee15c34fcd tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:30.764114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d55bbde-1576-4b70-9ba4-47ee15c34fcd tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:30.764828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d55bbde-1576-4b70-9ba4-47ee15c34fcd tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:30.765283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d55bbde-1576-4b70-9ba4-47ee15c34fcd tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:30.766052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d55bbde-1576-4b70-9ba4-47ee15c34fcd tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:30.766726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d55bbde-1576-4b70-9ba4-47ee15c34fcd tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:30.767172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d55bbde-1576-4b70-9ba4-47ee15c34fcd tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:30.795804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7d55bbde-1576-4b70-9ba4-47ee15c34fcd tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:50:31.092013 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7d55bbde-1576-4b70-9ba4-47ee15c34fcd tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca" status: 204 len: 0 microversion: 2.1 time: 0.340796 Oct 04 21:50:31.092656 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3270/6517] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:50:30 2022] DELETE /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:50:31.103204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-71058c9c-9c86-4af4-9532-3396a337240e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:31.103882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-71058c9c-9c86-4af4-9532-3396a337240e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:31.111989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71058c9c-9c86-4af4-9532-3396a337240e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:31.116325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71058c9c-9c86-4af4-9532-3396a337240e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:31.116325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71058c9c-9c86-4af4-9532-3396a337240e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:31.116325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71058c9c-9c86-4af4-9532-3396a337240e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:31.116325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71058c9c-9c86-4af4-9532-3396a337240e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:31.116325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-71058c9c-9c86-4af4-9532-3396a337240e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:31.223605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-71058c9c-9c86-4af4-9532-3396a337240e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:31.232411 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-71058c9c-9c86-4af4-9532-3396a337240e tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca" status: 200 len: 1477 microversion: 2.1 time: 0.134991 Oct 04 21:50:31.233245 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3248/6518] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:31 2022] GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca => generated 1477 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:32.256615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ed5b2254-96fe-4a56-a146-2238c7d35c3f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:32.257412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ed5b2254-96fe-4a56-a146-2238c7d35c3f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:32.264502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed5b2254-96fe-4a56-a146-2238c7d35c3f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:32.265109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed5b2254-96fe-4a56-a146-2238c7d35c3f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:32.265848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed5b2254-96fe-4a56-a146-2238c7d35c3f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:32.268185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed5b2254-96fe-4a56-a146-2238c7d35c3f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:32.268673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed5b2254-96fe-4a56-a146-2238c7d35c3f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:32.269294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed5b2254-96fe-4a56-a146-2238c7d35c3f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:32.376216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ed5b2254-96fe-4a56-a146-2238c7d35c3f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:32.396996 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ed5b2254-96fe-4a56-a146-2238c7d35c3f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca" status: 200 len: 1477 microversion: 2.1 time: 0.139102 Oct 04 21:50:32.397650 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3271/6519] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:32 2022] GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca => generated 1477 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:33.330650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-74a7b974-3e2e-47de-9b7e-efec19597388 req-4ac97167-fdac-4943-905b-9f7c9913dfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c7c39d6-174b-432a-9c9e-25d24b2152ca", "name": "network-vif-deleted", "tag": "a40cc122-f541-47bc-a3ad-1bcf99eec8f2"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:33.350634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-74a7b974-3e2e-47de-9b7e-efec19597388 req-4ac97167-fdac-4943-905b-9f7c9913dfe2 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:33.351147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-74a7b974-3e2e-47de-9b7e-efec19597388 req-4ac97167-fdac-4943-905b-9f7c9913dfe2 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:33.352278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-74a7b974-3e2e-47de-9b7e-efec19597388 req-4ac97167-fdac-4943-905b-9f7c9913dfe2 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:33.364421 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-74a7b974-3e2e-47de-9b7e-efec19597388 req-4ac97167-fdac-4943-905b-9f7c9913dfe2 service nova] Creating event network-vif-deleted:a40cc122-f541-47bc-a3ad-1bcf99eec8f2 for instance 3c7c39d6-174b-432a-9c9e-25d24b2152ca on n-h1-860282-1 Oct 04 21:50:33.371019 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-74a7b974-3e2e-47de-9b7e-efec19597388 req-4ac97167-fdac-4943-905b-9f7c9913dfe2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.257297 Oct 04 21:50:33.372005 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3249/6520] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:33.426486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2744a10d-1d17-4e4f-867d-511f462cdad6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:33.427774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2744a10d-1d17-4e4f-867d-511f462cdad6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:33.436377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2744a10d-1d17-4e4f-867d-511f462cdad6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:33.437250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2744a10d-1d17-4e4f-867d-511f462cdad6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:33.438016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2744a10d-1d17-4e4f-867d-511f462cdad6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:33.439033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2744a10d-1d17-4e4f-867d-511f462cdad6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:33.439832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2744a10d-1d17-4e4f-867d-511f462cdad6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:33.440477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2744a10d-1d17-4e4f-867d-511f462cdad6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:33.514636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2744a10d-1d17-4e4f-867d-511f462cdad6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:33.515280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2744a10d-1d17-4e4f-867d-511f462cdad6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:33.516278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2744a10d-1d17-4e4f-867d-511f462cdad6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:33.516998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-2744a10d-1d17-4e4f-867d-511f462cdad6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lazy-loading 'fault' on Instance uuid 3c7c39d6-174b-432a-9c9e-25d24b2152ca {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:50:33.569375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2744a10d-1d17-4e4f-867d-511f462cdad6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:33.581022 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2744a10d-1d17-4e4f-867d-511f462cdad6 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca" status: 200 len: 1330 microversion: 2.1 time: 0.160472 Oct 04 21:50:33.597564 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3272/6521] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:33 2022] GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca => generated 1330 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:34.607654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ad088df9-7ff6-4b2b-b399-4a5ab66a74b9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:34.609098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ad088df9-7ff6-4b2b-b399-4a5ab66a74b9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 3c7c39d6-174b-432a-9c9e-25d24b2152ca] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:34.632001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad088df9-7ff6-4b2b-b399-4a5ab66a74b9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:34.633661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad088df9-7ff6-4b2b-b399-4a5ab66a74b9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:34.634739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad088df9-7ff6-4b2b-b399-4a5ab66a74b9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:34.635863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad088df9-7ff6-4b2b-b399-4a5ab66a74b9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:34.636548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad088df9-7ff6-4b2b-b399-4a5ab66a74b9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:34.637191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad088df9-7ff6-4b2b-b399-4a5ab66a74b9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:34.658938 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-ad088df9-7ff6-4b2b-b399-4a5ab66a74b9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] HTTP exception thrown: Instance 3c7c39d6-174b-432a-9c9e-25d24b2152ca could not be found. Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ad088df9-7ff6-4b2b-b399-4a5ab66a74b9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Request method failure captured: Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca HTTP/1.1 Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKo98TU1twVchMerNVuM4b0NnursqipzpRxhnzTHIDjyr7Cuf3C-pN_K8iahQhqBeS8BmPTni66LwrKEBbpdlsEr15Ge-UVfDPlAnjsHC_Xn6uwo7N2d_c905kFog7O_0qQWdF2wRAZObMlvAiRnSvpSZ19pTP5Y6SE9yjhojt-Bmcw Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: ef3eda5f0edc45b2b4b2dab10b5f3993 Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-482728042 Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef3eda5f0edc45b2b4b2dab10b5f3993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ef3eda5f0edc45b2b4b2dab10b5f3993"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ef3eda5f0edc45b2b4b2dab10b5f3993"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef3eda5f0edc45b2b4b2dab10b5f3993"}]}] Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestSecurityGroupsBasicOps-482728042 Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: ef3eda5f0edc45b2b4b2dab10b5f3993 Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-482728042 Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestSecurityGroupsBasicOps-482728042-project Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 7c8c93a8fc1f47358fde1357a5c702a2 Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestSecurityGroupsBasicOps-482728042-project Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 3c7c39d6-174b-432a-9c9e-25d24b2152ca could not be found. Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '3c7c39d6-174b-432a-9c9e-25d24b2152ca'} Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c7c39d6-174b-432a-9c9e-25d24b2152ca could not be found. Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c7c39d6-174b-432a-9c9e-25d24b2152ca could not be found. Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:34.662005 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:50:34.669270 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:34.669270 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:34.669270 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:34.669270 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:34.669270 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:34.669270 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c7c39d6-174b-432a-9c9e-25d24b2152ca could not be found. Oct 04 21:50:34.669270 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:50:34.674549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ad088df9-7ff6-4b2b-b399-4a5ab66a74b9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Returning 404 to user: Instance 3c7c39d6-174b-432a-9c9e-25d24b2152ca could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:34.675770 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ad088df9-7ff6-4b2b-b399-4a5ab66a74b9 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca" status: 404 len: 111 microversion: 2.1 time: 0.072384 Oct 04 21:50:34.682248 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3250/6522] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:34 2022] GET /compute/v2.1/servers/3c7c39d6-174b-432a-9c9e-25d24b2152ca => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:50:41.271792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7c1405b9-2bbb-47cf-bd11-9e125053f868 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:41.274551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7c1405b9-2bbb-47cf-bd11-9e125053f868 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:41.286469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c1405b9-2bbb-47cf-bd11-9e125053f868 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:41.295084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c1405b9-2bbb-47cf-bd11-9e125053f868 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:41.295251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-805ba14d-8098-4e28-b363-de2e07648559 req-96230e68-c46d-4801-9032-f0570dfa4ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af03ead-e47b-46d5-b50a-74532a08cdaa", "tag": "50833009-f1ed-4d39-b9b0-53dbc189e45f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:41.295717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c1405b9-2bbb-47cf-bd11-9e125053f868 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:41.295717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c1405b9-2bbb-47cf-bd11-9e125053f868 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:41.295717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c1405b9-2bbb-47cf-bd11-9e125053f868 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:41.295717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c1405b9-2bbb-47cf-bd11-9e125053f868 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:41.313056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-805ba14d-8098-4e28-b363-de2e07648559 req-96230e68-c46d-4801-9032-f0570dfa4ce6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:41.313056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-805ba14d-8098-4e28-b363-de2e07648559 req-96230e68-c46d-4801-9032-f0570dfa4ce6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:41.313056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-805ba14d-8098-4e28-b363-de2e07648559 req-96230e68-c46d-4801-9032-f0570dfa4ce6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:41.339609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7c1405b9-2bbb-47cf-bd11-9e125053f868 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:50:41.350041 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-805ba14d-8098-4e28-b363-de2e07648559 req-96230e68-c46d-4801-9032-f0570dfa4ce6 service nova] Creating event network-changed:50833009-f1ed-4d39-b9b0-53dbc189e45f for instance 1af03ead-e47b-46d5-b50a-74532a08cdaa on n-h2-860282-1 Oct 04 21:50:41.362233 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-805ba14d-8098-4e28-b363-de2e07648559 req-96230e68-c46d-4801-9032-f0570dfa4ce6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075823 Oct 04 21:50:41.366976 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3251/6523] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:41.722767 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7c1405b9-2bbb-47cf-bd11-9e125053f868 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 204 len: 0 microversion: 2.1 time: 0.456614 Oct 04 21:50:41.723387 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3273/6524] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:50:41 2022] DELETE /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:50:41.754288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ea2ed54e-5ab6-4887-bd47-b0eb4a224ff4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:41.755019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ea2ed54e-5ab6-4887-bd47-b0eb4a224ff4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:41.766374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea2ed54e-5ab6-4887-bd47-b0eb4a224ff4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:41.766877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea2ed54e-5ab6-4887-bd47-b0eb4a224ff4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:41.767325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea2ed54e-5ab6-4887-bd47-b0eb4a224ff4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:41.775078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea2ed54e-5ab6-4887-bd47-b0eb4a224ff4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:41.775592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea2ed54e-5ab6-4887-bd47-b0eb4a224ff4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:41.776048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ea2ed54e-5ab6-4887-bd47-b0eb4a224ff4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:42.054184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ea2ed54e-5ab6-4887-bd47-b0eb4a224ff4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:42.066458 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ea2ed54e-5ab6-4887-bd47-b0eb4a224ff4 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1764 microversion: 2.1 time: 0.337578 Oct 04 21:50:42.088697 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3252/6525] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:41 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1764 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:43.097688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-80feca84-a12a-4f17-8cd2-0549719aeb33 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:43.099252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-80feca84-a12a-4f17-8cd2-0549719aeb33 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:43.118433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80feca84-a12a-4f17-8cd2-0549719aeb33 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:43.119374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80feca84-a12a-4f17-8cd2-0549719aeb33 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:43.120064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80feca84-a12a-4f17-8cd2-0549719aeb33 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:43.121080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80feca84-a12a-4f17-8cd2-0549719aeb33 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:43.122854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80feca84-a12a-4f17-8cd2-0549719aeb33 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:43.138033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80feca84-a12a-4f17-8cd2-0549719aeb33 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:43.587178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-80feca84-a12a-4f17-8cd2-0549719aeb33 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:43.597523 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-80feca84-a12a-4f17-8cd2-0549719aeb33 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1764 microversion: 2.1 time: 0.504615 Oct 04 21:50:43.598799 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3274/6526] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:43 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1764 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:43.982448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-5d43c74f-39fe-4c2c-bdbd-a799b41b8ea9 req-89c2096c-3c05-44f2-809b-1752f7e9b595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af03ead-e47b-46d5-b50a-74532a08cdaa", "name": "network-vif-deleted", "tag": "50833009-f1ed-4d39-b9b0-53dbc189e45f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:43.996977 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5d43c74f-39fe-4c2c-bdbd-a799b41b8ea9 req-89c2096c-3c05-44f2-809b-1752f7e9b595 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:43.997496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5d43c74f-39fe-4c2c-bdbd-a799b41b8ea9 req-89c2096c-3c05-44f2-809b-1752f7e9b595 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:43.999723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5d43c74f-39fe-4c2c-bdbd-a799b41b8ea9 req-89c2096c-3c05-44f2-809b-1752f7e9b595 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:44.012584 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-5d43c74f-39fe-4c2c-bdbd-a799b41b8ea9 req-89c2096c-3c05-44f2-809b-1752f7e9b595 service nova] Creating event network-vif-deleted:50833009-f1ed-4d39-b9b0-53dbc189e45f for instance 1af03ead-e47b-46d5-b50a-74532a08cdaa on n-h2-860282-1 Oct 04 21:50:44.019019 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-5d43c74f-39fe-4c2c-bdbd-a799b41b8ea9 req-89c2096c-3c05-44f2-809b-1752f7e9b595 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042476 Oct 04 21:50:44.020271 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3253/6527] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:44.622336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6e385aa9-78f0-41c7-b54b-d544ddb6365c tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:44.623274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6e385aa9-78f0-41c7-b54b-d544ddb6365c tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:44.630412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e385aa9-78f0-41c7-b54b-d544ddb6365c tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:44.631072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e385aa9-78f0-41c7-b54b-d544ddb6365c tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:44.640630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e385aa9-78f0-41c7-b54b-d544ddb6365c tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:44.640630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e385aa9-78f0-41c7-b54b-d544ddb6365c tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:44.640630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e385aa9-78f0-41c7-b54b-d544ddb6365c tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:44.640630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e385aa9-78f0-41c7-b54b-d544ddb6365c tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:44.640630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:44.669835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e385aa9-78f0-41c7-b54b-d544ddb6365c tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:44.670428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e385aa9-78f0-41c7-b54b-d544ddb6365c tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:44.673868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6e385aa9-78f0-41c7-b54b-d544ddb6365c tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:44.673868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-6e385aa9-78f0-41c7-b54b-d544ddb6365c tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lazy-loading 'fault' on Instance uuid 1af03ead-e47b-46d5-b50a-74532a08cdaa {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:50:44.725479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6e385aa9-78f0-41c7-b54b-d544ddb6365c tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8c93a8fc1f47358fde1357a5c702a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3eda5f0edc45b2b4b2dab10b5f3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:44.733441 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6e385aa9-78f0-41c7-b54b-d544ddb6365c tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 200 len: 1381 microversion: 2.1 time: 0.115764 Oct 04 21:50:44.734190 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3275/6528] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:44 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 1381 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:45.756323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8fa4f9fe-39c2-4a59-83e0-5e8d61cb2f9f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:45.757041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8fa4f9fe-39c2-4a59-83e0-5e8d61cb2f9f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] [instance: 1af03ead-e47b-46d5-b50a-74532a08cdaa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:45.765086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8fa4f9fe-39c2-4a59-83e0-5e8d61cb2f9f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:45.765614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8fa4f9fe-39c2-4a59-83e0-5e8d61cb2f9f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:45.766057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8fa4f9fe-39c2-4a59-83e0-5e8d61cb2f9f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:45.766753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8fa4f9fe-39c2-4a59-83e0-5e8d61cb2f9f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:45.767212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8fa4f9fe-39c2-4a59-83e0-5e8d61cb2f9f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:45.767846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8fa4f9fe-39c2-4a59-83e0-5e8d61cb2f9f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:45.781756 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-8fa4f9fe-39c2-4a59-83e0-5e8d61cb2f9f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] HTTP exception thrown: Instance 1af03ead-e47b-46d5-b50a-74532a08cdaa could not be found. Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8fa4f9fe-39c2-4a59-83e0-5e8d61cb2f9f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Request method failure captured: Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa HTTP/1.1 Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKo98TU1twVchMerNVuM4b0NnursqipzpRxhnzTHIDjyr7Cuf3C-pN_K8iahQhqBeS8BmPTni66LwrKEBbpdlsEr15Ge-UVfDPlAnjsHC_Xn6uwo7N2d_c905kFog7O_0qQWdF2wRAZObMlvAiRnSvpSZ19pTP5Y6SE9yjhojt-Bmcw Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: ef3eda5f0edc45b2b4b2dab10b5f3993 Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-482728042 Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef3eda5f0edc45b2b4b2dab10b5f3993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ef3eda5f0edc45b2b4b2dab10b5f3993"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ef3eda5f0edc45b2b4b2dab10b5f3993"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef3eda5f0edc45b2b4b2dab10b5f3993"}]}] Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestSecurityGroupsBasicOps-482728042 Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: ef3eda5f0edc45b2b4b2dab10b5f3993 Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-482728042 Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestSecurityGroupsBasicOps-482728042-project Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 7c8c93a8fc1f47358fde1357a5c702a2 Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestSecurityGroupsBasicOps-482728042-project Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 1af03ead-e47b-46d5-b50a-74532a08cdaa could not be found. Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '1af03ead-e47b-46d5-b50a-74532a08cdaa'} Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af03ead-e47b-46d5-b50a-74532a08cdaa could not be found. Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af03ead-e47b-46d5-b50a-74532a08cdaa could not be found. Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:50:45.783592 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:50:45.788761 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:50:45.788761 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:50:45.788761 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:50:45.788761 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:50:45.788761 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:50:45.788761 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af03ead-e47b-46d5-b50a-74532a08cdaa could not be found. Oct 04 21:50:45.788761 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:50:45.788761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8fa4f9fe-39c2-4a59-83e0-5e8d61cb2f9f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Returning 404 to user: Instance 1af03ead-e47b-46d5-b50a-74532a08cdaa could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:50:45.788761 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8fa4f9fe-39c2-4a59-83e0-5e8d61cb2f9f tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa" status: 404 len: 111 microversion: 2.1 time: 0.032975 Oct 04 21:50:45.789508 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3254/6529] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:45 2022] GET /compute/v2.1/servers/1af03ead-e47b-46d5-b50a-74532a08cdaa => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:50:50.735555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-871bf9eb-f395-434d-8b95-4aa38277ecc5 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] Calling method '.version_select at 0x7f578b885c10>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:50.745741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:50.824632 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-871bf9eb-f395-434d-8b95-4aa38277ecc5 tempest-TestSecurityGroupsBasicOps-482728042 tempest-TestSecurityGroupsBasicOps-482728042-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-62631751" status: 202 len: 0 microversion: 2.1 time: 0.094281 Oct 04 21:50:50.825400 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3276/6530] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 21:50:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-62631751 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:51:17.644582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-857311945", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "312861f3-13cf-429e-ab1a-053d47592c86"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:17.653543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=34 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:17.654292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=66 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:17.880259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] validate_networks() for [('312861f3-13cf-429e-ab1a-053d47592c86', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:51:18.312118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:51:18.312544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:51:18.313023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:51:18.313490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:51:18.313909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:51:18.323229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:18.328710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:18.328710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:18.328710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:18.328710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:18.328710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:18.343457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Getting quotas for project 9ba2aa4b7db54438831a60b953292fcb. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:51:18.348700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Getting quotas for user ea36b24d62f948a0a2f5de7a3ebbef00 and project 9ba2aa4b7db54438831a60b953292fcb. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:51:18.361850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:51:18.364333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:51:18.497383 n-d-860282-1 devstack@n-api.service[122758]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [0ff630d5-b325-4393-83be-78e61dbfd72a] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:51:19.504866 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [0ff630d5-b325-4393-83be-78e61dbfd72a] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 59882. Oct 04 21:51:19.509536 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b15a7758-6cdc-41c4-b408-079e1117034a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.869085 Oct 04 21:51:19.510231 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3255/6531] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:51:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:51:19.521894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-196962b2-3954-4bdf-bddb-26a2545b0d84 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:19.522538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-196962b2-3954-4bdf-bddb-26a2545b0d84 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:19.653809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-196962b2-3954-4bdf-bddb-26a2545b0d84 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:19.656450 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-196962b2-3954-4bdf-bddb-26a2545b0d84 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32" status: 200 len: 1213 microversion: 2.1 time: 0.138914 Oct 04 21:51:19.657028 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3277/6532] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:19 2022] GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 => generated 1213 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:20.682074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0b953705-130f-4882-b602-28ea113f9b1c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:20.682805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0b953705-130f-4882-b602-28ea113f9b1c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:20.737022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0b953705-130f-4882-b602-28ea113f9b1c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:20.745312 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0b953705-130f-4882-b602-28ea113f9b1c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32" status: 200 len: 1213 microversion: 2.1 time: 0.069426 Oct 04 21:51:20.746048 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3256/6533] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:20 2022] GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:21.767770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-581b35e9-064a-46c3-af34-e04048688599 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:21.768523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-581b35e9-064a-46c3-af34-e04048688599 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:21.777160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-581b35e9-064a-46c3-af34-e04048688599 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:21.777700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-581b35e9-064a-46c3-af34-e04048688599 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:21.778159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-581b35e9-064a-46c3-af34-e04048688599 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:21.778881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-581b35e9-064a-46c3-af34-e04048688599 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:21.779389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-581b35e9-064a-46c3-af34-e04048688599 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:21.780100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-581b35e9-064a-46c3-af34-e04048688599 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:21.847318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-581b35e9-064a-46c3-af34-e04048688599 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:21.856940 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-581b35e9-064a-46c3-af34-e04048688599 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32" status: 200 len: 1265 microversion: 2.1 time: 0.093011 Oct 04 21:51:21.857562 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3278/6534] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:21 2022] GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:22.882250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f9a8f834-8662-4c8c-b710-d5fc6c962dcc tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:22.888455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f9a8f834-8662-4c8c-b710-d5fc6c962dcc tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:22.896666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9a8f834-8662-4c8c-b710-d5fc6c962dcc tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:22.897171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9a8f834-8662-4c8c-b710-d5fc6c962dcc tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:22.897649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9a8f834-8662-4c8c-b710-d5fc6c962dcc tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:22.899384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9a8f834-8662-4c8c-b710-d5fc6c962dcc tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:22.899846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9a8f834-8662-4c8c-b710-d5fc6c962dcc tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:22.900724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9a8f834-8662-4c8c-b710-d5fc6c962dcc tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:23.100960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f9a8f834-8662-4c8c-b710-d5fc6c962dcc tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:23.109832 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f9a8f834-8662-4c8c-b710-d5fc6c962dcc tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32" status: 200 len: 1313 microversion: 2.1 time: 0.233200 Oct 04 21:51:23.110415 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3257/6535] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:22 2022] GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:23.857698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-bbedcf97-69c4-456d-b96f-0f9efab36978 req-e091d3c9-e16f-483d-814a-c11a71088a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32", "tag": "d6810bb9-c820-46c3-9f0e-e1b737d72590"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:23.868693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bbedcf97-69c4-456d-b96f-0f9efab36978 req-e091d3c9-e16f-483d-814a-c11a71088a47 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:23.869192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bbedcf97-69c4-456d-b96f-0f9efab36978 req-e091d3c9-e16f-483d-814a-c11a71088a47 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:23.869666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bbedcf97-69c4-456d-b96f-0f9efab36978 req-e091d3c9-e16f-483d-814a-c11a71088a47 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:23.881065 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-bbedcf97-69c4-456d-b96f-0f9efab36978 req-e091d3c9-e16f-483d-814a-c11a71088a47 service nova] Creating event network-changed:d6810bb9-c820-46c3-9f0e-e1b737d72590 for instance f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 on n-h2-860282-1 Oct 04 21:51:23.886584 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-bbedcf97-69c4-456d-b96f-0f9efab36978 req-e091d3c9-e16f-483d-814a-c11a71088a47 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033597 Oct 04 21:51:23.887184 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3279/6536] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:24.133035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fe64edce-54fa-45cb-8b20-f1c51e943d0d tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:24.134486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fe64edce-54fa-45cb-8b20-f1c51e943d0d tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:24.141391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe64edce-54fa-45cb-8b20-f1c51e943d0d tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:24.141902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe64edce-54fa-45cb-8b20-f1c51e943d0d tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:24.142339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe64edce-54fa-45cb-8b20-f1c51e943d0d tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:24.143039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe64edce-54fa-45cb-8b20-f1c51e943d0d tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:24.143488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe64edce-54fa-45cb-8b20-f1c51e943d0d tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:24.143910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe64edce-54fa-45cb-8b20-f1c51e943d0d tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:24.426244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fe64edce-54fa-45cb-8b20-f1c51e943d0d tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:24.435744 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fe64edce-54fa-45cb-8b20-f1c51e943d0d tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32" status: 200 len: 1313 microversion: 2.1 time: 0.307311 Oct 04 21:51:24.436329 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3258/6537] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:24 2022] GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:25.461516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b337feed-d4d3-4460-9eee-8ad448da7797 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:25.462250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b337feed-d4d3-4460-9eee-8ad448da7797 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:25.468549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b337feed-d4d3-4460-9eee-8ad448da7797 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:25.469057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b337feed-d4d3-4460-9eee-8ad448da7797 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:25.469640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b337feed-d4d3-4460-9eee-8ad448da7797 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:25.470368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b337feed-d4d3-4460-9eee-8ad448da7797 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:25.470857 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b337feed-d4d3-4460-9eee-8ad448da7797 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:25.471306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b337feed-d4d3-4460-9eee-8ad448da7797 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:25.606590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b337feed-d4d3-4460-9eee-8ad448da7797 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:25.615600 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b337feed-d4d3-4460-9eee-8ad448da7797 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32" status: 200 len: 1313 microversion: 2.1 time: 0.159375 Oct 04 21:51:25.626104 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3280/6538] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:25 2022] GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:26.641101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e8a688d9-e97a-4f96-84b2-bd7e3a4de863 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:26.641696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e8a688d9-e97a-4f96-84b2-bd7e3a4de863 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:26.650058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8a688d9-e97a-4f96-84b2-bd7e3a4de863 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:26.650664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8a688d9-e97a-4f96-84b2-bd7e3a4de863 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:26.651200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8a688d9-e97a-4f96-84b2-bd7e3a4de863 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:26.652153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8a688d9-e97a-4f96-84b2-bd7e3a4de863 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:26.652788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8a688d9-e97a-4f96-84b2-bd7e3a4de863 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:26.653377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8a688d9-e97a-4f96-84b2-bd7e3a4de863 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:26.793313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e8a688d9-e97a-4f96-84b2-bd7e3a4de863 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:26.801638 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e8a688d9-e97a-4f96-84b2-bd7e3a4de863 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32" status: 200 len: 1313 microversion: 2.1 time: 0.164951 Oct 04 21:51:26.802289 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3259/6539] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:26 2022] GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:27.244935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2a5c0e2f-b833-4202-abc7-b94f1cf021e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:27.245561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2a5c0e2f-b833-4202-abc7-b94f1cf021e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:27.251709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a5c0e2f-b833-4202-abc7-b94f1cf021e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:27.252368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a5c0e2f-b833-4202-abc7-b94f1cf021e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:27.252832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a5c0e2f-b833-4202-abc7-b94f1cf021e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:27.253589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a5c0e2f-b833-4202-abc7-b94f1cf021e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:27.254068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a5c0e2f-b833-4202-abc7-b94f1cf021e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:27.254512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a5c0e2f-b833-4202-abc7-b94f1cf021e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:27.283795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2a5c0e2f-b833-4202-abc7-b94f1cf021e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:51:27.588695 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2a5c0e2f-b833-4202-abc7-b94f1cf021e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 204 len: 0 microversion: 2.1 time: 0.510140 Oct 04 21:51:27.589315 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3281/6540] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:51:27 2022] DELETE /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:51:27.597784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cad5a70e-bd93-4fdc-b7c8-a6f3bdc2502d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:27.598425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cad5a70e-bd93-4fdc-b7c8-a6f3bdc2502d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:27.605619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cad5a70e-bd93-4fdc-b7c8-a6f3bdc2502d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:27.606109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cad5a70e-bd93-4fdc-b7c8-a6f3bdc2502d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:27.606554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cad5a70e-bd93-4fdc-b7c8-a6f3bdc2502d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:27.607247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cad5a70e-bd93-4fdc-b7c8-a6f3bdc2502d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:27.607704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cad5a70e-bd93-4fdc-b7c8-a6f3bdc2502d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:27.608131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cad5a70e-bd93-4fdc-b7c8-a6f3bdc2502d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:27.828997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dcea7007-69d0-412b-8c8b-701e300f5227 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:27.829746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dcea7007-69d0-412b-8c8b-701e300f5227 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:27.836175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcea7007-69d0-412b-8c8b-701e300f5227 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:27.837267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcea7007-69d0-412b-8c8b-701e300f5227 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:27.837811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcea7007-69d0-412b-8c8b-701e300f5227 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:27.838537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcea7007-69d0-412b-8c8b-701e300f5227 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:27.839013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcea7007-69d0-412b-8c8b-701e300f5227 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:27.839522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcea7007-69d0-412b-8c8b-701e300f5227 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:28.058389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dcea7007-69d0-412b-8c8b-701e300f5227 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:28.068130 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dcea7007-69d0-412b-8c8b-701e300f5227 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32" status: 200 len: 1313 microversion: 2.1 time: 0.243758 Oct 04 21:51:28.069105 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3282/6541] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:27 2022] GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:51:28.077352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cad5a70e-bd93-4fdc-b7c8-a6f3bdc2502d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:28.085767 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cad5a70e-bd93-4fdc-b7c8-a6f3bdc2502d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1575 microversion: 2.1 time: 0.491919 Oct 04 21:51:28.086332 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3260/6542] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:27 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1575 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:29.093083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2a47867e-b0d0-4cd8-977e-b8c5b94ee4e5 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:29.094167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2a47867e-b0d0-4cd8-977e-b8c5b94ee4e5 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:29.107992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a47867e-b0d0-4cd8-977e-b8c5b94ee4e5 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:29.107992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a47867e-b0d0-4cd8-977e-b8c5b94ee4e5 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:29.107992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a47867e-b0d0-4cd8-977e-b8c5b94ee4e5 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:29.107992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a47867e-b0d0-4cd8-977e-b8c5b94ee4e5 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:29.107992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a47867e-b0d0-4cd8-977e-b8c5b94ee4e5 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:29.107992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a47867e-b0d0-4cd8-977e-b8c5b94ee4e5 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:29.110255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2ce8afd4-ec9c-4af2-af1a-4e16a6bc6775 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:29.111431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2ce8afd4-ec9c-4af2-af1a-4e16a6bc6775 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:29.122034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:29.130482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ce8afd4-ec9c-4af2-af1a-4e16a6bc6775 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:29.131707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ce8afd4-ec9c-4af2-af1a-4e16a6bc6775 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:29.132361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ce8afd4-ec9c-4af2-af1a-4e16a6bc6775 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:29.133326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ce8afd4-ec9c-4af2-af1a-4e16a6bc6775 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:29.138517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ce8afd4-ec9c-4af2-af1a-4e16a6bc6775 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:29.139220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2ce8afd4-ec9c-4af2-af1a-4e16a6bc6775 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:29.360949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2a47867e-b0d0-4cd8-977e-b8c5b94ee4e5 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:29.366198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2ce8afd4-ec9c-4af2-af1a-4e16a6bc6775 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:29.375602 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2ce8afd4-ec9c-4af2-af1a-4e16a6bc6775 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1575 microversion: 2.1 time: 0.269109 Oct 04 21:51:29.376824 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3261/6543] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:29 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1575 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:29.392350 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2a47867e-b0d0-4cd8-977e-b8c5b94ee4e5 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32" status: 200 len: 1313 microversion: 2.1 time: 0.301822 Oct 04 21:51:29.392350 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3283/6544] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:29 2022] GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:51:30.211147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-44828184-a498-466b-bf87-0155f3e528fc req-3eab8762-d947-4bf3-b2ff-d57134665f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f224bc93-0310-4831-8bd0-5c03ac12c242", "name": "network-vif-deleted", "tag": "65aaa995-e131-49ee-b00a-dbdc7799cc33"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:30.222791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-44828184-a498-466b-bf87-0155f3e528fc req-3eab8762-d947-4bf3-b2ff-d57134665f0f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:30.224536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-44828184-a498-466b-bf87-0155f3e528fc req-3eab8762-d947-4bf3-b2ff-d57134665f0f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:30.224536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-44828184-a498-466b-bf87-0155f3e528fc req-3eab8762-d947-4bf3-b2ff-d57134665f0f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:30.235506 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-44828184-a498-466b-bf87-0155f3e528fc req-3eab8762-d947-4bf3-b2ff-d57134665f0f service nova] Creating event network-vif-deleted:65aaa995-e131-49ee-b00a-dbdc7799cc33 for instance f224bc93-0310-4831-8bd0-5c03ac12c242 on n-h1-860282-1 Oct 04 21:51:30.240829 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-44828184-a498-466b-bf87-0155f3e528fc req-3eab8762-d947-4bf3-b2ff-d57134665f0f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034049 Oct 04 21:51:30.241745 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3262/6545] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:30.416351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-39502253-d2f7-4922-9993-5c883029c982 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:30.417085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-39502253-d2f7-4922-9993-5c883029c982 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:30.418428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b9b1be0d-904f-4272-824d-ed8884cdc472 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:30.419081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b9b1be0d-904f-4272-824d-ed8884cdc472 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:30.436257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:30.439078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39502253-d2f7-4922-9993-5c883029c982 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:30.442945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39502253-d2f7-4922-9993-5c883029c982 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:30.442945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39502253-d2f7-4922-9993-5c883029c982 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:30.442945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39502253-d2f7-4922-9993-5c883029c982 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:30.442945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39502253-d2f7-4922-9993-5c883029c982 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:30.442945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39502253-d2f7-4922-9993-5c883029c982 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:30.445065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9b1be0d-904f-4272-824d-ed8884cdc472 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:30.445811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9b1be0d-904f-4272-824d-ed8884cdc472 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:30.446830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9b1be0d-904f-4272-824d-ed8884cdc472 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:30.447874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9b1be0d-904f-4272-824d-ed8884cdc472 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:30.448540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9b1be0d-904f-4272-824d-ed8884cdc472 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:30.449170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b9b1be0d-904f-4272-824d-ed8884cdc472 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:30.593721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b9b1be0d-904f-4272-824d-ed8884cdc472 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:30.603048 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b9b1be0d-904f-4272-824d-ed8884cdc472 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1224 microversion: 2.1 time: 0.195949 Oct 04 21:51:30.604416 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3284/6546] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:30 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1224 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:30.666318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-39502253-d2f7-4922-9993-5c883029c982 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:30.674374 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-39502253-d2f7-4922-9993-5c883029c982 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32" status: 200 len: 1313 microversion: 2.1 time: 0.262975 Oct 04 21:51:30.675234 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3263/6547] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:30 2022] GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:31.091787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-4b3561c5-e634-4249-94c5-06e260f75827 req-3cfcaac2-f4f1-434b-8705-698f542dfdeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32", "name": "network-vif-plugged", "status": "completed", "tag": "d6810bb9-c820-46c3-9f0e-e1b737d72590"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:31.102681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4b3561c5-e634-4249-94c5-06e260f75827 req-3cfcaac2-f4f1-434b-8705-698f542dfdeb service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:31.103187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4b3561c5-e634-4249-94c5-06e260f75827 req-3cfcaac2-f4f1-434b-8705-698f542dfdeb service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:31.103852 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4b3561c5-e634-4249-94c5-06e260f75827 req-3cfcaac2-f4f1-434b-8705-698f542dfdeb service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:31.116253 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-4b3561c5-e634-4249-94c5-06e260f75827 req-3cfcaac2-f4f1-434b-8705-698f542dfdeb service nova] Creating event network-vif-plugged:d6810bb9-c820-46c3-9f0e-e1b737d72590 for instance f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 on n-h2-860282-1 Oct 04 21:51:31.122733 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-4b3561c5-e634-4249-94c5-06e260f75827 req-3cfcaac2-f4f1-434b-8705-698f542dfdeb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035779 Oct 04 21:51:31.123655 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3285/6548] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:31.626808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-966a58ea-0fac-4ae6-8568-5d6bd819db93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:31.627532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-966a58ea-0fac-4ae6-8568-5d6bd819db93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:31.629533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:31.636056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-966a58ea-0fac-4ae6-8568-5d6bd819db93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:31.636577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-966a58ea-0fac-4ae6-8568-5d6bd819db93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:31.637011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-966a58ea-0fac-4ae6-8568-5d6bd819db93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:31.637727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-966a58ea-0fac-4ae6-8568-5d6bd819db93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:31.638201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-966a58ea-0fac-4ae6-8568-5d6bd819db93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:31.638619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-966a58ea-0fac-4ae6-8568-5d6bd819db93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:31.700043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-629c1d86-9f3c-48c5-be36-cf52949d1a7c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:31.701646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-629c1d86-9f3c-48c5-be36-cf52949d1a7c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:31.704817 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-966a58ea-0fac-4ae6-8568-5d6bd819db93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:31.709085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-629c1d86-9f3c-48c5-be36-cf52949d1a7c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:31.709625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-629c1d86-9f3c-48c5-be36-cf52949d1a7c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:31.710086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-629c1d86-9f3c-48c5-be36-cf52949d1a7c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:31.712338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-629c1d86-9f3c-48c5-be36-cf52949d1a7c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:31.712338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-629c1d86-9f3c-48c5-be36-cf52949d1a7c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:31.712338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-629c1d86-9f3c-48c5-be36-cf52949d1a7c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:31.713582 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-966a58ea-0fac-4ae6-8568-5d6bd819db93 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1224 microversion: 2.1 time: 0.090581 Oct 04 21:51:31.716275 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3264/6549] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:31 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:31.853948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-629c1d86-9f3c-48c5-be36-cf52949d1a7c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:31.862230 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-629c1d86-9f3c-48c5-be36-cf52949d1a7c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32" status: 200 len: 1313 microversion: 2.1 time: 0.167908 Oct 04 21:51:31.865462 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3286/6550] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:31 2022] GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:51:32.737740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b4a6e89e-95fd-4740-bb7d-b01d472f56e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:32.738381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b4a6e89e-95fd-4740-bb7d-b01d472f56e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:32.746200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b4a6e89e-95fd-4740-bb7d-b01d472f56e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:32.746790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b4a6e89e-95fd-4740-bb7d-b01d472f56e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:32.747141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b4a6e89e-95fd-4740-bb7d-b01d472f56e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:32.747911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b4a6e89e-95fd-4740-bb7d-b01d472f56e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:32.748375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b4a6e89e-95fd-4740-bb7d-b01d472f56e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:32.748808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b4a6e89e-95fd-4740-bb7d-b01d472f56e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:32.826005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b4a6e89e-95fd-4740-bb7d-b01d472f56e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:32.835210 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b4a6e89e-95fd-4740-bb7d-b01d472f56e4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1224 microversion: 2.1 time: 0.101574 Oct 04 21:51:32.835886 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3265/6551] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:32 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:32.887087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5f8abc91-132a-4d34-9b5f-aec0223f3f07 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:32.887868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5f8abc91-132a-4d34-9b5f-aec0223f3f07 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:32.894667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f8abc91-132a-4d34-9b5f-aec0223f3f07 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:32.895181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f8abc91-132a-4d34-9b5f-aec0223f3f07 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:32.895707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f8abc91-132a-4d34-9b5f-aec0223f3f07 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:32.896507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f8abc91-132a-4d34-9b5f-aec0223f3f07 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:32.897047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f8abc91-132a-4d34-9b5f-aec0223f3f07 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:32.897599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5f8abc91-132a-4d34-9b5f-aec0223f3f07 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:33.044996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5f8abc91-132a-4d34-9b5f-aec0223f3f07 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:33.053994 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5f8abc91-132a-4d34-9b5f-aec0223f3f07 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32" status: 200 len: 1497 microversion: 2.1 time: 0.171652 Oct 04 21:51:33.054749 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3287/6552] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:32 2022] GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:33.859519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3b3ecbee-b761-4a96-8db8-b901a9ad0cfe tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:33.860126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3b3ecbee-b761-4a96-8db8-b901a9ad0cfe tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:33.868503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3b3ecbee-b761-4a96-8db8-b901a9ad0cfe tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:33.869011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3b3ecbee-b761-4a96-8db8-b901a9ad0cfe tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:33.869470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3b3ecbee-b761-4a96-8db8-b901a9ad0cfe tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:33.870188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3b3ecbee-b761-4a96-8db8-b901a9ad0cfe tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:33.870675 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3b3ecbee-b761-4a96-8db8-b901a9ad0cfe tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:33.871169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3b3ecbee-b761-4a96-8db8-b901a9ad0cfe tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:33.950101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3b3ecbee-b761-4a96-8db8-b901a9ad0cfe tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:33.958508 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3b3ecbee-b761-4a96-8db8-b901a9ad0cfe tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1224 microversion: 2.1 time: 0.103320 Oct 04 21:51:33.959194 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3266/6553] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:33 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:34.981473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-831b347d-b173-4a52-afdf-fff0da9b61ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:34.982313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-831b347d-b173-4a52-afdf-fff0da9b61ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:34.991522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-831b347d-b173-4a52-afdf-fff0da9b61ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:34.992384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-831b347d-b173-4a52-afdf-fff0da9b61ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:34.993651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-831b347d-b173-4a52-afdf-fff0da9b61ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:34.994838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-831b347d-b173-4a52-afdf-fff0da9b61ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:34.995558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-831b347d-b173-4a52-afdf-fff0da9b61ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:34.996595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-831b347d-b173-4a52-afdf-fff0da9b61ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:35.088174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-831b347d-b173-4a52-afdf-fff0da9b61ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:35.107924 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-831b347d-b173-4a52-afdf-fff0da9b61ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1224 microversion: 2.1 time: 0.131026 Oct 04 21:51:35.109886 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3288/6554] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:34 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1224 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:35.547056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4e18cc8f-7420-4bf2-9bd4-5dbc691762ad tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:35.547056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4e18cc8f-7420-4bf2-9bd4-5dbc691762ad tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:35.555181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e18cc8f-7420-4bf2-9bd4-5dbc691762ad tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:35.555711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e18cc8f-7420-4bf2-9bd4-5dbc691762ad tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:35.556151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e18cc8f-7420-4bf2-9bd4-5dbc691762ad tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:35.557546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e18cc8f-7420-4bf2-9bd4-5dbc691762ad tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:35.558048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e18cc8f-7420-4bf2-9bd4-5dbc691762ad tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:35.558483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e18cc8f-7420-4bf2-9bd4-5dbc691762ad tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:35.587496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4e18cc8f-7420-4bf2-9bd4-5dbc691762ad tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:51:35.925588 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4e18cc8f-7420-4bf2-9bd4-5dbc691762ad tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32" status: 204 len: 0 microversion: 2.1 time: 0.383078 Oct 04 21:51:35.926621 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3267/6555] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:51:35 2022] DELETE /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:51:35.935732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-06f74c9c-fe19-40c9-8c38-fa47ea421921 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:35.936708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-06f74c9c-fe19-40c9-8c38-fa47ea421921 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:35.943072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06f74c9c-fe19-40c9-8c38-fa47ea421921 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:35.946847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06f74c9c-fe19-40c9-8c38-fa47ea421921 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:35.946847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06f74c9c-fe19-40c9-8c38-fa47ea421921 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:35.946847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06f74c9c-fe19-40c9-8c38-fa47ea421921 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:35.946847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06f74c9c-fe19-40c9-8c38-fa47ea421921 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:35.946847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06f74c9c-fe19-40c9-8c38-fa47ea421921 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:36.089388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-06f74c9c-fe19-40c9-8c38-fa47ea421921 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:36.109351 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-06f74c9c-fe19-40c9-8c38-fa47ea421921 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32" status: 200 len: 1503 microversion: 2.1 time: 0.177020 Oct 04 21:51:36.111137 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3289/6556] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:35 2022] GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:36.151645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-60df3dc2-4790-40df-9092-e6533e38269f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:36.152810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-60df3dc2-4790-40df-9092-e6533e38269f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:36.162117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60df3dc2-4790-40df-9092-e6533e38269f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:36.162665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60df3dc2-4790-40df-9092-e6533e38269f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:36.163417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60df3dc2-4790-40df-9092-e6533e38269f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:36.164228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60df3dc2-4790-40df-9092-e6533e38269f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:36.165538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60df3dc2-4790-40df-9092-e6533e38269f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:36.166626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60df3dc2-4790-40df-9092-e6533e38269f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:36.205795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60df3dc2-4790-40df-9092-e6533e38269f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:36.206287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60df3dc2-4790-40df-9092-e6533e38269f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:36.206729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60df3dc2-4790-40df-9092-e6533e38269f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:36.207180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-60df3dc2-4790-40df-9092-e6533e38269f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lazy-loading 'fault' on Instance uuid f224bc93-0310-4831-8bd0-5c03ac12c242 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:36.249746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-60df3dc2-4790-40df-9092-e6533e38269f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:36.257777 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-60df3dc2-4790-40df-9092-e6533e38269f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 200 len: 1229 microversion: 2.1 time: 0.119949 Oct 04 21:51:36.260840 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3268/6557] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:36 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 1229 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:37.132273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-efefba52-34ed-49a8-bf4c-eb4eaf29a19a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:37.132945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-efefba52-34ed-49a8-bf4c-eb4eaf29a19a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:37.140686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efefba52-34ed-49a8-bf4c-eb4eaf29a19a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:37.141203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efefba52-34ed-49a8-bf4c-eb4eaf29a19a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:37.141698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efefba52-34ed-49a8-bf4c-eb4eaf29a19a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:37.142420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efefba52-34ed-49a8-bf4c-eb4eaf29a19a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:37.142890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efefba52-34ed-49a8-bf4c-eb4eaf29a19a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:37.143336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efefba52-34ed-49a8-bf4c-eb4eaf29a19a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:37.282028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-142480f2-2b9d-4db6-a55f-21642561d8fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:37.283458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-142480f2-2b9d-4db6-a55f-21642561d8fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:37.290426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-142480f2-2b9d-4db6-a55f-21642561d8fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:37.291409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-142480f2-2b9d-4db6-a55f-21642561d8fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:37.291920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-142480f2-2b9d-4db6-a55f-21642561d8fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:37.293093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-142480f2-2b9d-4db6-a55f-21642561d8fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:37.293667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-142480f2-2b9d-4db6-a55f-21642561d8fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:37.294173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-142480f2-2b9d-4db6-a55f-21642561d8fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:37.309388 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-142480f2-2b9d-4db6-a55f-21642561d8fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] HTTP exception thrown: Instance f224bc93-0310-4831-8bd0-5c03ac12c242 could not be found. Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-142480f2-2b9d-4db6-a55f-21642561d8fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Request method failure captured: Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 HTTP/1.1 Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKgKHoOaT8uqO1KoOPn24xM7P0ylwdbLFlP7NxtckxX5YVgkQXQgvdk_pv_DRrXpTR_A9RTrhRjboZG7XPsaIwCmuey_7FqshLEW4wp7-ccvS6GHij-f3j-K3O_9tzU_63L01blifBD1TcCBZnKNp1OdTYkzGEDdJ0DY_B_XNHTjspY Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68208d23fd2f40479ba279566a819933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68208d23fd2f40479ba279566a819933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}] Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 15748f41da9f49fca3e7eec1fda3b245 Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance f224bc93-0310-4831-8bd0-5c03ac12c242 could not be found. Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'f224bc93-0310-4831-8bd0-5c03ac12c242'} Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f224bc93-0310-4831-8bd0-5c03ac12c242 could not be found. Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f224bc93-0310-4831-8bd0-5c03ac12c242 could not be found. Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:51:37.311413 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:51:37.319494 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:37.319494 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:51:37.319494 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:51:37.319494 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:51:37.319494 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:51:37.319494 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f224bc93-0310-4831-8bd0-5c03ac12c242 could not be found. Oct 04 21:51:37.319494 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:51:37.319494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-142480f2-2b9d-4db6-a55f-21642561d8fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Returning 404 to user: Instance f224bc93-0310-4831-8bd0-5c03ac12c242 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:51:37.322227 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-142480f2-2b9d-4db6-a55f-21642561d8fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 404 len: 111 microversion: 2.1 time: 0.044628 Oct 04 21:51:37.323714 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3269/6558] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:37 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:51:37.343809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-efefba52-34ed-49a8-bf4c-eb4eaf29a19a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:37.356216 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-efefba52-34ed-49a8-bf4c-eb4eaf29a19a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32" status: 200 len: 1503 microversion: 2.1 time: 0.227529 Oct 04 21:51:37.367758 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3290/6559] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:37 2022] GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 => generated 1503 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:37.398356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-097b4e62-e740-496f-95f1-8487e0299550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-599575661", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-793500675", "security_groups": [{"name": "tempest-secgroup-smoke-419452248"}], "block_device_mapping_v2": [{"uuid": "9365616f-40f5-4878-a7fc-5b262728ca01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b7f4cca9-cdc1-49bd-97e7-bd6739547eb6"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:37.584248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-097b4e62-e740-496f-95f1-8487e0299550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] validate_networks() for [('b7f4cca9-cdc1-49bd-97e7-bd6739547eb6', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:51:38.144781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-cf5f83fd-5b2f-40a7-90a7-2a70a72dc6b0 req-ece74fd5-d10d-4461-af2f-9f1d67db0e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32", "name": "network-vif-deleted", "tag": "d6810bb9-c820-46c3-9f0e-e1b737d72590"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:38.156239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cf5f83fd-5b2f-40a7-90a7-2a70a72dc6b0 req-ece74fd5-d10d-4461-af2f-9f1d67db0e6b service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:38.157196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cf5f83fd-5b2f-40a7-90a7-2a70a72dc6b0 req-ece74fd5-d10d-4461-af2f-9f1d67db0e6b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:38.157680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cf5f83fd-5b2f-40a7-90a7-2a70a72dc6b0 req-ece74fd5-d10d-4461-af2f-9f1d67db0e6b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:38.169667 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-cf5f83fd-5b2f-40a7-90a7-2a70a72dc6b0 req-ece74fd5-d10d-4461-af2f-9f1d67db0e6b service nova] Creating event network-vif-deleted:d6810bb9-c820-46c3-9f0e-e1b737d72590 for instance f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 on n-h2-860282-1 Oct 04 21:51:38.173850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-097b4e62-e740-496f-95f1-8487e0299550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:51:38.174322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-097b4e62-e740-496f-95f1-8487e0299550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:51:38.174803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-097b4e62-e740-496f-95f1-8487e0299550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:51:38.175298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-097b4e62-e740-496f-95f1-8487e0299550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:51:38.175426 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-cf5f83fd-5b2f-40a7-90a7-2a70a72dc6b0 req-ece74fd5-d10d-4461-af2f-9f1d67db0e6b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035054 Oct 04 21:51:38.175856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-097b4e62-e740-496f-95f1-8487e0299550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:51:38.176400 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3291/6560] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:38.186117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-097b4e62-e740-496f-95f1-8487e0299550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:38.187329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-097b4e62-e740-496f-95f1-8487e0299550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:38.187931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-097b4e62-e740-496f-95f1-8487e0299550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:38.188788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-097b4e62-e740-496f-95f1-8487e0299550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:38.189260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-097b4e62-e740-496f-95f1-8487e0299550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:38.189705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-097b4e62-e740-496f-95f1-8487e0299550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:38.209513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-097b4e62-e740-496f-95f1-8487e0299550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Getting quotas for project 68208d23fd2f40479ba279566a819933. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:51:38.215394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-097b4e62-e740-496f-95f1-8487e0299550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Getting quotas for user 15748f41da9f49fca3e7eec1fda3b245 and project 68208d23fd2f40479ba279566a819933. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:51:38.286698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-097b4e62-e740-496f-95f1-8487e0299550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:51:38.289233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-097b4e62-e740-496f-95f1-8487e0299550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9365616f-40f5-4878-a7fc-5b262728ca01',volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:51:38.380974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-764c8a4f-c0e3-463e-b9c6-0bf291772be6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:38.381667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-764c8a4f-c0e3-463e-b9c6-0bf291772be6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:38.388688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-764c8a4f-c0e3-463e-b9c6-0bf291772be6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:38.389196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-764c8a4f-c0e3-463e-b9c6-0bf291772be6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:38.389693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-764c8a4f-c0e3-463e-b9c6-0bf291772be6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:38.390420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-764c8a4f-c0e3-463e-b9c6-0bf291772be6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:38.390899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-764c8a4f-c0e3-463e-b9c6-0bf291772be6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:38.391349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-764c8a4f-c0e3-463e-b9c6-0bf291772be6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:38.465862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-764c8a4f-c0e3-463e-b9c6-0bf291772be6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:38.473943 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-764c8a4f-c0e3-463e-b9c6-0bf291772be6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32" status: 200 len: 1298 microversion: 2.1 time: 0.097429 Oct 04 21:51:38.474529 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3292/6561] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:38 2022] GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 => generated 1298 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:51:38.761910 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-097b4e62-e740-496f-95f1-8487e0299550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.367361 Oct 04 21:51:38.762652 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3270/6562] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:51:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 1369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:51:38.774526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d9b9a097-f7c1-4e8d-9c33-f0fd3b08fe82 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:38.775258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d9b9a097-f7c1-4e8d-9c33-f0fd3b08fe82 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:38.834581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d9b9a097-f7c1-4e8d-9c33-f0fd3b08fe82 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:38.843480 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d9b9a097-f7c1-4e8d-9c33-f0fd3b08fe82 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1093 microversion: 2.1 time: 0.073250 Oct 04 21:51:38.844067 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3293/6563] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:38 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:39.498994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5208cd82-c923-4c70-b245-05cc22fadfd6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:39.499615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5208cd82-c923-4c70-b245-05cc22fadfd6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:39.505720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5208cd82-c923-4c70-b245-05cc22fadfd6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:39.506211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5208cd82-c923-4c70-b245-05cc22fadfd6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:39.506650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5208cd82-c923-4c70-b245-05cc22fadfd6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:39.507349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5208cd82-c923-4c70-b245-05cc22fadfd6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:39.507808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5208cd82-c923-4c70-b245-05cc22fadfd6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:39.508264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5208cd82-c923-4c70-b245-05cc22fadfd6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:39.522517 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-5208cd82-c923-4c70-b245-05cc22fadfd6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] HTTP exception thrown: Instance f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 could not be found. Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5208cd82-c923-4c70-b245-05cc22fadfd6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Request method failure captured: Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 HTTP/1.1 Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKrS0lc-mCQqrcMm8LOMqJAuEheU56XhzRwkImZK3vSwB9LUiDB_YTCGkM2lMUXmEUgd6WQ6JvyDuDhzqHdiIGQMG1RLvjQeNwic-zAlloxKEZgRKFvAcbdR1WOgczOgTz7572LEFwHclRZQHQMKHXXviQFYT3t7mrRdPv1ZpLnb-uE Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 9ba2aa4b7db54438831a60b953292fcb Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-VolumesActionsTest-2026808498 Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9ba2aa4b7db54438831a60b953292fcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9ba2aa4b7db54438831a60b953292fcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9ba2aa4b7db54438831a60b953292fcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9ba2aa4b7db54438831a60b953292fcb"}]}] Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-VolumesActionsTest-2026808498 Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 9ba2aa4b7db54438831a60b953292fcb Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-VolumesActionsTest-2026808498 Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-VolumesActionsTest-2026808498-project Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: ea36b24d62f948a0a2f5de7a3ebbef00 Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-VolumesActionsTest-2026808498-project Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 could not be found. Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32'} Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 could not be found. Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 could not be found. Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:51:39.524265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:51:39.539500 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:39.539500 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:51:39.539500 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:51:39.539500 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:51:39.539500 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:51:39.539500 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 could not be found. Oct 04 21:51:39.539500 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:51:39.539500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5208cd82-c923-4c70-b245-05cc22fadfd6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Returning 404 to user: Instance f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:51:39.539500 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5208cd82-c923-4c70-b245-05cc22fadfd6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32" status: 404 len: 111 microversion: 2.1 time: 0.031640 Oct 04 21:51:39.539500 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3271/6564] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:39 2022] GET /compute/v2.1/servers/f97ed7a2-e2ba-4b27-9835-1aa0cbf3bb32 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:51:39.582093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-80470b48-56a0-4706-87a3-ae73c6828f24 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1039663404", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "312861f3-13cf-429e-ab1a-053d47592c86"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:39.638955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-80470b48-56a0-4706-87a3-ae73c6828f24 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] validate_networks() for [('312861f3-13cf-429e-ab1a-053d47592c86', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:51:39.867162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8a248b64-f570-4690-adf8-2659cd27e543 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:39.868317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8a248b64-f570-4690-adf8-2659cd27e543 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:39.875222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a248b64-f570-4690-adf8-2659cd27e543 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:39.875737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a248b64-f570-4690-adf8-2659cd27e543 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:39.876408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a248b64-f570-4690-adf8-2659cd27e543 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:39.877204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a248b64-f570-4690-adf8-2659cd27e543 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:39.877645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a248b64-f570-4690-adf8-2659cd27e543 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:39.878081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a248b64-f570-4690-adf8-2659cd27e543 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:40.032048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8a248b64-f570-4690-adf8-2659cd27e543 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:40.045414 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8a248b64-f570-4690-adf8-2659cd27e543 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1143 microversion: 2.1 time: 0.177837 Oct 04 21:51:40.045414 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3272/6565] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:39 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1143 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:51:40.351110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-80470b48-56a0-4706-87a3-ae73c6828f24 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:51:40.351553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-80470b48-56a0-4706-87a3-ae73c6828f24 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:51:40.352083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-80470b48-56a0-4706-87a3-ae73c6828f24 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:51:40.352514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-80470b48-56a0-4706-87a3-ae73c6828f24 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:51:40.352977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-80470b48-56a0-4706-87a3-ae73c6828f24 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:51:40.362936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80470b48-56a0-4706-87a3-ae73c6828f24 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:40.363674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80470b48-56a0-4706-87a3-ae73c6828f24 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:40.364126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80470b48-56a0-4706-87a3-ae73c6828f24 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:40.364875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80470b48-56a0-4706-87a3-ae73c6828f24 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:40.365346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80470b48-56a0-4706-87a3-ae73c6828f24 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:40.365809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80470b48-56a0-4706-87a3-ae73c6828f24 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:40.384572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-80470b48-56a0-4706-87a3-ae73c6828f24 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Getting quotas for project 9ba2aa4b7db54438831a60b953292fcb. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:51:40.390121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-80470b48-56a0-4706-87a3-ae73c6828f24 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Getting quotas for user ea36b24d62f948a0a2f5de7a3ebbef00 and project 9ba2aa4b7db54438831a60b953292fcb. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:51:40.409649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-80470b48-56a0-4706-87a3-ae73c6828f24 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:51:40.409649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-80470b48-56a0-4706-87a3-ae73c6828f24 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:51:40.572120 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-80470b48-56a0-4706-87a3-ae73c6828f24 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.993891 Oct 04 21:51:40.578466 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3294/6566] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:51:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:51:40.586858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9f0a1af5-6a24-4fb3-ac95-49b768e11b8c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:40.587683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9f0a1af5-6a24-4fb3-ac95-49b768e11b8c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:40.644717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9f0a1af5-6a24-4fb3-ac95-49b768e11b8c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:40.653118 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9f0a1af5-6a24-4fb3-ac95-49b768e11b8c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2" status: 200 len: 1214 microversion: 2.1 time: 0.072675 Oct 04 21:51:40.656089 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3273/6567] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:40 2022] GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:41.066523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a6d547d3-8797-4f82-a14d-9a69b19b07a4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:41.067152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a6d547d3-8797-4f82-a14d-9a69b19b07a4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:41.077182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6d547d3-8797-4f82-a14d-9a69b19b07a4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:41.077727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6d547d3-8797-4f82-a14d-9a69b19b07a4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:41.078193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6d547d3-8797-4f82-a14d-9a69b19b07a4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:41.079542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6d547d3-8797-4f82-a14d-9a69b19b07a4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:41.080035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6d547d3-8797-4f82-a14d-9a69b19b07a4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:41.080493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6d547d3-8797-4f82-a14d-9a69b19b07a4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:41.100481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:41.147926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a6d547d3-8797-4f82-a14d-9a69b19b07a4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:41.157937 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a6d547d3-8797-4f82-a14d-9a69b19b07a4 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1191 microversion: 2.1 time: 0.096210 Oct 04 21:51:41.169445 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3295/6568] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:41 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1191 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:41.867868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-22158fb7-34f8-40c1-b241-b67ddd4ade80 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:41.867868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-22158fb7-34f8-40c1-b241-b67ddd4ade80 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:41.867868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22158fb7-34f8-40c1-b241-b67ddd4ade80 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:41.867868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22158fb7-34f8-40c1-b241-b67ddd4ade80 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:41.867868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22158fb7-34f8-40c1-b241-b67ddd4ade80 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:41.867868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22158fb7-34f8-40c1-b241-b67ddd4ade80 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:41.867868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22158fb7-34f8-40c1-b241-b67ddd4ade80 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:41.867868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22158fb7-34f8-40c1-b241-b67ddd4ade80 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:41.867868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-22158fb7-34f8-40c1-b241-b67ddd4ade80 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:41.867868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:41.867868 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-22158fb7-34f8-40c1-b241-b67ddd4ade80 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2" status: 200 len: 1218 microversion: 2.1 time: 0.147731 Oct 04 21:51:41.867868 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3274/6569] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:41 2022] GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 => generated 1218 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:42.183741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6998b7f3-4070-4b6c-99fd-d1bd599c2fe1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:42.184380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6998b7f3-4070-4b6c-99fd-d1bd599c2fe1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:42.192397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6998b7f3-4070-4b6c-99fd-d1bd599c2fe1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:42.192901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6998b7f3-4070-4b6c-99fd-d1bd599c2fe1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:42.193355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6998b7f3-4070-4b6c-99fd-d1bd599c2fe1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:42.194156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6998b7f3-4070-4b6c-99fd-d1bd599c2fe1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:42.194634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6998b7f3-4070-4b6c-99fd-d1bd599c2fe1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:42.195076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6998b7f3-4070-4b6c-99fd-d1bd599c2fe1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:42.269804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6998b7f3-4070-4b6c-99fd-d1bd599c2fe1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:42.281016 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6998b7f3-4070-4b6c-99fd-d1bd599c2fe1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1209 microversion: 2.1 time: 0.102345 Oct 04 21:51:42.281631 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3296/6570] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:42 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1209 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:42.847106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2e5bfeaa-86f6-413f-baef-d4788eb7d65a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:42.849025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2e5bfeaa-86f6-413f-baef-d4788eb7d65a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:42.859910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e5bfeaa-86f6-413f-baef-d4788eb7d65a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:42.861521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e5bfeaa-86f6-413f-baef-d4788eb7d65a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:42.861521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e5bfeaa-86f6-413f-baef-d4788eb7d65a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:42.862094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e5bfeaa-86f6-413f-baef-d4788eb7d65a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:42.862727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e5bfeaa-86f6-413f-baef-d4788eb7d65a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:42.863523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e5bfeaa-86f6-413f-baef-d4788eb7d65a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:42.963829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2e5bfeaa-86f6-413f-baef-d4788eb7d65a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:42.974097 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2e5bfeaa-86f6-413f-baef-d4788eb7d65a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2" status: 200 len: 1266 microversion: 2.1 time: 0.130771 Oct 04 21:51:42.974841 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3275/6571] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:42 2022] GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 => generated 1266 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:43.312673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8e518ae8-c827-473b-8801-58d71a46b550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:43.314033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8e518ae8-c827-473b-8801-58d71a46b550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:43.323547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e518ae8-c827-473b-8801-58d71a46b550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:43.324486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e518ae8-c827-473b-8801-58d71a46b550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:43.325201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e518ae8-c827-473b-8801-58d71a46b550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:43.326476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e518ae8-c827-473b-8801-58d71a46b550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:43.327376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e518ae8-c827-473b-8801-58d71a46b550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:43.328225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e518ae8-c827-473b-8801-58d71a46b550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:43.596278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8e518ae8-c827-473b-8801-58d71a46b550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:43.605530 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8e518ae8-c827-473b-8801-58d71a46b550 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1276 microversion: 2.1 time: 0.296741 Oct 04 21:51:43.606269 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3297/6572] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:43 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1276 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:43.998803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-83534f27-98be-4925-8bde-61e49554c8e6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:43.999562 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-83534f27-98be-4925-8bde-61e49554c8e6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:44.010492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83534f27-98be-4925-8bde-61e49554c8e6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:44.011886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83534f27-98be-4925-8bde-61e49554c8e6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:44.011886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83534f27-98be-4925-8bde-61e49554c8e6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:44.012134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83534f27-98be-4925-8bde-61e49554c8e6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:44.012600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83534f27-98be-4925-8bde-61e49554c8e6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:44.013463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-83534f27-98be-4925-8bde-61e49554c8e6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:44.132158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-83534f27-98be-4925-8bde-61e49554c8e6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:44.143512 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-83534f27-98be-4925-8bde-61e49554c8e6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2" status: 200 len: 1272 microversion: 2.1 time: 0.148766 Oct 04 21:51:44.144103 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3276/6573] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:43 2022] GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 => generated 1272 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:44.367486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-60cf1d9a-a4c6-4a94-bc38-73ccdbe147ae req-4a7ff37f-56a7-4b81-ad60-ea420051deea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4866bba-4c3e-4ff7-9e38-fb2938323240", "tag": "45cecac7-6d52-46d4-b35f-984dba208b27"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:44.380377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-60cf1d9a-a4c6-4a94-bc38-73ccdbe147ae req-4a7ff37f-56a7-4b81-ad60-ea420051deea service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:44.381528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-60cf1d9a-a4c6-4a94-bc38-73ccdbe147ae req-4a7ff37f-56a7-4b81-ad60-ea420051deea service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:44.381528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-60cf1d9a-a4c6-4a94-bc38-73ccdbe147ae req-4a7ff37f-56a7-4b81-ad60-ea420051deea service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:44.394957 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-60cf1d9a-a4c6-4a94-bc38-73ccdbe147ae req-4a7ff37f-56a7-4b81-ad60-ea420051deea service nova] Creating event network-changed:45cecac7-6d52-46d4-b35f-984dba208b27 for instance f4866bba-4c3e-4ff7-9e38-fb2938323240 on n-h2-860282-1 Oct 04 21:51:44.411091 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-60cf1d9a-a4c6-4a94-bc38-73ccdbe147ae req-4a7ff37f-56a7-4b81-ad60-ea420051deea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038952 Oct 04 21:51:44.411091 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3298/6574] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:44.639893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-35c9f4ed-a2b6-4419-8657-ffed4f45f8fa tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:44.640691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-35c9f4ed-a2b6-4419-8657-ffed4f45f8fa tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:44.646753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35c9f4ed-a2b6-4419-8657-ffed4f45f8fa tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:44.647489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35c9f4ed-a2b6-4419-8657-ffed4f45f8fa tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:44.648104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35c9f4ed-a2b6-4419-8657-ffed4f45f8fa tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:44.649074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35c9f4ed-a2b6-4419-8657-ffed4f45f8fa tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:44.650027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35c9f4ed-a2b6-4419-8657-ffed4f45f8fa tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:44.650672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35c9f4ed-a2b6-4419-8657-ffed4f45f8fa tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:44.966579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-35c9f4ed-a2b6-4419-8657-ffed4f45f8fa tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:44.980973 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-35c9f4ed-a2b6-4419-8657-ffed4f45f8fa tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1276 microversion: 2.1 time: 0.354476 Oct 04 21:51:44.981443 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3277/6575] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:44 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1276 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:45.171376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ce71297e-e80c-48c9-bee8-ea123f76abfa tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:45.172603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ce71297e-e80c-48c9-bee8-ea123f76abfa tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:45.180263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce71297e-e80c-48c9-bee8-ea123f76abfa tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:45.182026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce71297e-e80c-48c9-bee8-ea123f76abfa tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:45.183046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce71297e-e80c-48c9-bee8-ea123f76abfa tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:45.184279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce71297e-e80c-48c9-bee8-ea123f76abfa tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:45.185047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce71297e-e80c-48c9-bee8-ea123f76abfa tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:45.185822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce71297e-e80c-48c9-bee8-ea123f76abfa tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:45.608718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ce71297e-e80c-48c9-bee8-ea123f76abfa tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:45.616873 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ce71297e-e80c-48c9-bee8-ea123f76abfa tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2" status: 200 len: 1314 microversion: 2.1 time: 0.452158 Oct 04 21:51:45.618029 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3299/6576] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:45 2022] GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:46.012102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5a87f0d3-c592-4ab8-8daf-aea2bfe572e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:46.013463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5a87f0d3-c592-4ab8-8daf-aea2bfe572e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:46.021379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a87f0d3-c592-4ab8-8daf-aea2bfe572e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:46.021906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a87f0d3-c592-4ab8-8daf-aea2bfe572e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:46.026512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a87f0d3-c592-4ab8-8daf-aea2bfe572e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:46.026512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a87f0d3-c592-4ab8-8daf-aea2bfe572e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:46.026512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a87f0d3-c592-4ab8-8daf-aea2bfe572e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:46.026512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a87f0d3-c592-4ab8-8daf-aea2bfe572e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:46.296380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5a87f0d3-c592-4ab8-8daf-aea2bfe572e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:46.305471 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5a87f0d3-c592-4ab8-8daf-aea2bfe572e7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1276 microversion: 2.1 time: 0.298070 Oct 04 21:51:46.306883 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3278/6577] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:46 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1276 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:46.434930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-89f834a6-cf66-4895-8987-2f7199da55ae req-ca0a65b9-c2b5-4d81-a31e-8c96e6f84484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a31762-2007-402f-836e-2ed72ecc5eb2", "tag": "733c30cd-ebc7-4e5e-9918-090d3228457b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:46.446862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-89f834a6-cf66-4895-8987-2f7199da55ae req-ca0a65b9-c2b5-4d81-a31e-8c96e6f84484 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:46.447442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-89f834a6-cf66-4895-8987-2f7199da55ae req-ca0a65b9-c2b5-4d81-a31e-8c96e6f84484 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:46.448007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-89f834a6-cf66-4895-8987-2f7199da55ae req-ca0a65b9-c2b5-4d81-a31e-8c96e6f84484 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:46.459773 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-89f834a6-cf66-4895-8987-2f7199da55ae req-ca0a65b9-c2b5-4d81-a31e-8c96e6f84484 service nova] Creating event network-changed:733c30cd-ebc7-4e5e-9918-090d3228457b for instance 96a31762-2007-402f-836e-2ed72ecc5eb2 on n-h2-860282-1 Oct 04 21:51:46.466166 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-89f834a6-cf66-4895-8987-2f7199da55ae req-ca0a65b9-c2b5-4d81-a31e-8c96e6f84484 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036386 Oct 04 21:51:46.466776 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3300/6578] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:46.644711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-be808b64-b9fa-409b-8dac-61b21f5c924a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:46.653543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-be808b64-b9fa-409b-8dac-61b21f5c924a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:46.658623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-be808b64-b9fa-409b-8dac-61b21f5c924a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:46.659140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-be808b64-b9fa-409b-8dac-61b21f5c924a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:46.659617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-be808b64-b9fa-409b-8dac-61b21f5c924a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:46.660450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-be808b64-b9fa-409b-8dac-61b21f5c924a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:46.660883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-be808b64-b9fa-409b-8dac-61b21f5c924a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:46.661285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-be808b64-b9fa-409b-8dac-61b21f5c924a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:47.179548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-be808b64-b9fa-409b-8dac-61b21f5c924a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:47.190645 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-be808b64-b9fa-409b-8dac-61b21f5c924a tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2" status: 200 len: 1314 microversion: 2.1 time: 0.551922 Oct 04 21:51:47.191244 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3279/6579] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:46 2022] GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:47.329695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-77ad5873-6920-4851-b525-9d2704aae532 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:47.330429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-77ad5873-6920-4851-b525-9d2704aae532 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:47.337728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77ad5873-6920-4851-b525-9d2704aae532 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:47.338242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77ad5873-6920-4851-b525-9d2704aae532 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:47.338710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77ad5873-6920-4851-b525-9d2704aae532 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:47.339518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77ad5873-6920-4851-b525-9d2704aae532 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:47.339915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77ad5873-6920-4851-b525-9d2704aae532 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:47.340359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77ad5873-6920-4851-b525-9d2704aae532 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:47.586779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-77ad5873-6920-4851-b525-9d2704aae532 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:47.597487 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-77ad5873-6920-4851-b525-9d2704aae532 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1276 microversion: 2.1 time: 0.271609 Oct 04 21:51:47.598340 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3301/6580] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:47 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1276 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:48.215136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-be9ec5f0-4da0-4d1f-b506-364ed0e79b92 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:48.215878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-be9ec5f0-4da0-4d1f-b506-364ed0e79b92 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:48.219946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:48.220629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:48.227256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-be9ec5f0-4da0-4d1f-b506-364ed0e79b92 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:48.227851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-be9ec5f0-4da0-4d1f-b506-364ed0e79b92 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:48.228296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-be9ec5f0-4da0-4d1f-b506-364ed0e79b92 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:48.229012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-be9ec5f0-4da0-4d1f-b506-364ed0e79b92 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:48.229495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-be9ec5f0-4da0-4d1f-b506-364ed0e79b92 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:48.229928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-be9ec5f0-4da0-4d1f-b506-364ed0e79b92 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:48.370117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-be9ec5f0-4da0-4d1f-b506-364ed0e79b92 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:48.380391 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-be9ec5f0-4da0-4d1f-b506-364ed0e79b92 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2" status: 200 len: 1314 microversion: 2.1 time: 0.169660 Oct 04 21:51:48.381212 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3280/6581] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:48 2022] GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:48.621602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-78116eaf-e432-4786-8fb6-0ab2bb4d80f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:48.622326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-78116eaf-e432-4786-8fb6-0ab2bb4d80f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:48.629518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78116eaf-e432-4786-8fb6-0ab2bb4d80f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:48.630102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78116eaf-e432-4786-8fb6-0ab2bb4d80f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:48.630640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78116eaf-e432-4786-8fb6-0ab2bb4d80f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:48.631425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78116eaf-e432-4786-8fb6-0ab2bb4d80f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:48.632012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78116eaf-e432-4786-8fb6-0ab2bb4d80f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:48.632556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78116eaf-e432-4786-8fb6-0ab2bb4d80f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:48.780402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-78116eaf-e432-4786-8fb6-0ab2bb4d80f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:48.788907 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-78116eaf-e432-4786-8fb6-0ab2bb4d80f1 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1276 microversion: 2.1 time: 0.171170 Oct 04 21:51:48.790304 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3302/6582] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:48 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1276 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:49.405641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e7429391-f14f-4675-9343-3aecc697f884 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:49.406296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e7429391-f14f-4675-9343-3aecc697f884 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:49.413979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7429391-f14f-4675-9343-3aecc697f884 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:49.414618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7429391-f14f-4675-9343-3aecc697f884 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:49.415573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7429391-f14f-4675-9343-3aecc697f884 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:49.416319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7429391-f14f-4675-9343-3aecc697f884 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:49.416855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7429391-f14f-4675-9343-3aecc697f884 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:49.417446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7429391-f14f-4675-9343-3aecc697f884 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:49.578465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e7429391-f14f-4675-9343-3aecc697f884 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:49.586524 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e7429391-f14f-4675-9343-3aecc697f884 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2" status: 200 len: 1314 microversion: 2.1 time: 0.185736 Oct 04 21:51:49.587853 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3281/6583] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:49 2022] GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:49.812819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e54fad97-a610-4c83-a810-76c836fae081 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:49.813407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e54fad97-a610-4c83-a810-76c836fae081 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:49.820358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:49.821075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e54fad97-a610-4c83-a810-76c836fae081 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:49.821645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e54fad97-a610-4c83-a810-76c836fae081 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:49.822128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e54fad97-a610-4c83-a810-76c836fae081 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:49.822849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e54fad97-a610-4c83-a810-76c836fae081 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:49.823320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e54fad97-a610-4c83-a810-76c836fae081 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:49.823767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e54fad97-a610-4c83-a810-76c836fae081 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:49.974954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e54fad97-a610-4c83-a810-76c836fae081 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:49.983294 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e54fad97-a610-4c83-a810-76c836fae081 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1264 microversion: 2.1 time: 0.174661 Oct 04 21:51:49.983859 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3303/6584] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:49 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:50.611091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9d5152b6-b29e-4be2-a005-491cf1f34032 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:50.611971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9d5152b6-b29e-4be2-a005-491cf1f34032 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:50.619398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d5152b6-b29e-4be2-a005-491cf1f34032 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:50.619773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d5152b6-b29e-4be2-a005-491cf1f34032 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:50.620212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d5152b6-b29e-4be2-a005-491cf1f34032 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:50.620913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d5152b6-b29e-4be2-a005-491cf1f34032 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:50.621573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d5152b6-b29e-4be2-a005-491cf1f34032 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:50.621901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d5152b6-b29e-4be2-a005-491cf1f34032 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:50.649874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:50.786929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9d5152b6-b29e-4be2-a005-491cf1f34032 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:50.799907 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9d5152b6-b29e-4be2-a005-491cf1f34032 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2" status: 200 len: 1314 microversion: 2.1 time: 0.192975 Oct 04 21:51:50.800491 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3282/6585] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:50 2022] GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:51.007279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7eeec215-b0f2-437e-bbc2-d9d3297d5385 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:51.007861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7eeec215-b0f2-437e-bbc2-d9d3297d5385 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:51.010485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:51.011186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:51.017023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7eeec215-b0f2-437e-bbc2-d9d3297d5385 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:51.017556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7eeec215-b0f2-437e-bbc2-d9d3297d5385 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:51.018018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7eeec215-b0f2-437e-bbc2-d9d3297d5385 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:51.018728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7eeec215-b0f2-437e-bbc2-d9d3297d5385 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:51.019243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7eeec215-b0f2-437e-bbc2-d9d3297d5385 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:51.019690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7eeec215-b0f2-437e-bbc2-d9d3297d5385 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:51.163519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7eeec215-b0f2-437e-bbc2-d9d3297d5385 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:51.172046 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7eeec215-b0f2-437e-bbc2-d9d3297d5385 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1264 microversion: 2.1 time: 0.169079 Oct 04 21:51:51.172651 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3304/6586] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:51 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:51.823432 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-46407056-a0c5-460b-89cb-90b3ebbbde2b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:51.823976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-46407056-a0c5-460b-89cb-90b3ebbbde2b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:51.831561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46407056-a0c5-460b-89cb-90b3ebbbde2b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:51.832046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46407056-a0c5-460b-89cb-90b3ebbbde2b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:51.832481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46407056-a0c5-460b-89cb-90b3ebbbde2b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:51.833172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46407056-a0c5-460b-89cb-90b3ebbbde2b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:51.833658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46407056-a0c5-460b-89cb-90b3ebbbde2b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:51.834091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46407056-a0c5-460b-89cb-90b3ebbbde2b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:51.970267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-46407056-a0c5-460b-89cb-90b3ebbbde2b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:51.979277 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-46407056-a0c5-460b-89cb-90b3ebbbde2b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2" status: 200 len: 1314 microversion: 2.1 time: 0.159709 Oct 04 21:51:51.979883 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3283/6587] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:51 2022] GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:52.195150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-de8eac83-f915-4935-b8f2-8a9c08de2fda tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:52.196415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-de8eac83-f915-4935-b8f2-8a9c08de2fda tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:52.204021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de8eac83-f915-4935-b8f2-8a9c08de2fda tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:52.204505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de8eac83-f915-4935-b8f2-8a9c08de2fda tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:52.204970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de8eac83-f915-4935-b8f2-8a9c08de2fda tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:52.205703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de8eac83-f915-4935-b8f2-8a9c08de2fda tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:52.206182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de8eac83-f915-4935-b8f2-8a9c08de2fda tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:52.206627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de8eac83-f915-4935-b8f2-8a9c08de2fda tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:52.351508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-de8eac83-f915-4935-b8f2-8a9c08de2fda tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:52.360306 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-de8eac83-f915-4935-b8f2-8a9c08de2fda tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1264 microversion: 2.1 time: 0.169228 Oct 04 21:51:52.360883 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3305/6588] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:52 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:53.002864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0d28955e-0297-49a9-bf4d-553dc4d7063b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:53.003533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0d28955e-0297-49a9-bf4d-553dc4d7063b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:53.011467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d28955e-0297-49a9-bf4d-553dc4d7063b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:53.011970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d28955e-0297-49a9-bf4d-553dc4d7063b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:53.012417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d28955e-0297-49a9-bf4d-553dc4d7063b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:53.013345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d28955e-0297-49a9-bf4d-553dc4d7063b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:53.013944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d28955e-0297-49a9-bf4d-553dc4d7063b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:53.014320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d28955e-0297-49a9-bf4d-553dc4d7063b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:53.047899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-fbb5d775-7867-4808-9d22-bd45d664bf76 req-af7603f8-9b81-45f2-ace7-d229262fea45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a31762-2007-402f-836e-2ed72ecc5eb2", "name": "network-vif-plugged", "status": "completed", "tag": "733c30cd-ebc7-4e5e-9918-090d3228457b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:53.057981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-fbb5d775-7867-4808-9d22-bd45d664bf76 req-af7603f8-9b81-45f2-ace7-d229262fea45 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:53.058585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-fbb5d775-7867-4808-9d22-bd45d664bf76 req-af7603f8-9b81-45f2-ace7-d229262fea45 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:53.059101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-fbb5d775-7867-4808-9d22-bd45d664bf76 req-af7603f8-9b81-45f2-ace7-d229262fea45 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:53.070813 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-fbb5d775-7867-4808-9d22-bd45d664bf76 req-af7603f8-9b81-45f2-ace7-d229262fea45 service nova] Creating event network-vif-plugged:733c30cd-ebc7-4e5e-9918-090d3228457b for instance 96a31762-2007-402f-836e-2ed72ecc5eb2 on n-h2-860282-1 Oct 04 21:51:53.076263 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-fbb5d775-7867-4808-9d22-bd45d664bf76 req-af7603f8-9b81-45f2-ace7-d229262fea45 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032010 Oct 04 21:51:53.076946 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3306/6589] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:51:53.192585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0d28955e-0297-49a9-bf4d-553dc4d7063b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:53.200748 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0d28955e-0297-49a9-bf4d-553dc4d7063b tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2" status: 200 len: 1314 microversion: 2.1 time: 0.201981 Oct 04 21:51:53.201983 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3284/6590] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:52 2022] GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:53.388487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d430880d-b755-4c5a-b0dc-ae202f2fd6fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:53.389111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d430880d-b755-4c5a-b0dc-ae202f2fd6fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:53.396273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d430880d-b755-4c5a-b0dc-ae202f2fd6fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:53.396784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d430880d-b755-4c5a-b0dc-ae202f2fd6fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:53.397247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d430880d-b755-4c5a-b0dc-ae202f2fd6fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:53.397997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d430880d-b755-4c5a-b0dc-ae202f2fd6fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:53.398481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d430880d-b755-4c5a-b0dc-ae202f2fd6fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:53.399521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d430880d-b755-4c5a-b0dc-ae202f2fd6fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:53.535720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d430880d-b755-4c5a-b0dc-ae202f2fd6fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:53.545299 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d430880d-b755-4c5a-b0dc-ae202f2fd6fb tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1264 microversion: 2.1 time: 0.165492 Oct 04 21:51:53.545927 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3307/6591] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:53 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:54.224648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b94949db-e56a-4305-8878-7cacbbe3c4e4 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:54.226028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b94949db-e56a-4305-8878-7cacbbe3c4e4 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:54.234448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b94949db-e56a-4305-8878-7cacbbe3c4e4 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:54.234988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b94949db-e56a-4305-8878-7cacbbe3c4e4 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:54.235451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b94949db-e56a-4305-8878-7cacbbe3c4e4 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:54.236276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b94949db-e56a-4305-8878-7cacbbe3c4e4 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:54.236796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b94949db-e56a-4305-8878-7cacbbe3c4e4 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:54.237289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b94949db-e56a-4305-8878-7cacbbe3c4e4 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:54.379480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b94949db-e56a-4305-8878-7cacbbe3c4e4 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:54.388230 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b94949db-e56a-4305-8878-7cacbbe3c4e4 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2" status: 200 len: 1314 microversion: 2.1 time: 0.167606 Oct 04 21:51:54.388806 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3285/6592] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:54 2022] GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:54.568249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3c5c43f7-5c36-4c28-b5b8-336f05f43a6e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:54.573319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3c5c43f7-5c36-4c28-b5b8-336f05f43a6e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:54.576855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c5c43f7-5c36-4c28-b5b8-336f05f43a6e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:54.577365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c5c43f7-5c36-4c28-b5b8-336f05f43a6e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:54.577855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c5c43f7-5c36-4c28-b5b8-336f05f43a6e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:54.578571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c5c43f7-5c36-4c28-b5b8-336f05f43a6e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:54.579069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c5c43f7-5c36-4c28-b5b8-336f05f43a6e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:54.579552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c5c43f7-5c36-4c28-b5b8-336f05f43a6e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:54.730042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3c5c43f7-5c36-4c28-b5b8-336f05f43a6e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:54.738915 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3c5c43f7-5c36-4c28-b5b8-336f05f43a6e tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1264 microversion: 2.1 time: 0.174524 Oct 04 21:51:54.746917 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3308/6593] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:54 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:55.411353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-56f292ce-9f3d-4761-bca2-52d79a8aad35 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:55.411958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-56f292ce-9f3d-4761-bca2-52d79a8aad35 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:55.419486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56f292ce-9f3d-4761-bca2-52d79a8aad35 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:55.419974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56f292ce-9f3d-4761-bca2-52d79a8aad35 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:55.420410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56f292ce-9f3d-4761-bca2-52d79a8aad35 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:55.421110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56f292ce-9f3d-4761-bca2-52d79a8aad35 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:55.421607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56f292ce-9f3d-4761-bca2-52d79a8aad35 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:55.422038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-56f292ce-9f3d-4761-bca2-52d79a8aad35 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:55.565714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-56f292ce-9f3d-4761-bca2-52d79a8aad35 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:55.574400 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-56f292ce-9f3d-4761-bca2-52d79a8aad35 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2" status: 200 len: 1498 microversion: 2.1 time: 0.167037 Oct 04 21:51:55.574991 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3286/6594] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:55 2022] GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 => generated 1498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:55.762468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5d25209c-298b-491f-a5a7-e708be3efbba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:55.763172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5d25209c-298b-491f-a5a7-e708be3efbba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:55.771226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d25209c-298b-491f-a5a7-e708be3efbba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:55.771812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d25209c-298b-491f-a5a7-e708be3efbba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:55.772343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d25209c-298b-491f-a5a7-e708be3efbba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:55.773073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d25209c-298b-491f-a5a7-e708be3efbba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:55.773579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d25209c-298b-491f-a5a7-e708be3efbba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:55.774067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d25209c-298b-491f-a5a7-e708be3efbba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:55.919890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5d25209c-298b-491f-a5a7-e708be3efbba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:55.927776 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5d25209c-298b-491f-a5a7-e708be3efbba tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1264 microversion: 2.1 time: 0.169457 Oct 04 21:51:55.928448 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3309/6595] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:55 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:56.426003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e3bbd513-ba7f-4d24-8bdc-b2f9316423f6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:56.426545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e3bbd513-ba7f-4d24-8bdc-b2f9316423f6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:56.433684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3bbd513-ba7f-4d24-8bdc-b2f9316423f6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:56.436068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3bbd513-ba7f-4d24-8bdc-b2f9316423f6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:56.436068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3bbd513-ba7f-4d24-8bdc-b2f9316423f6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:56.436068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3bbd513-ba7f-4d24-8bdc-b2f9316423f6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:56.436068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3bbd513-ba7f-4d24-8bdc-b2f9316423f6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:56.436649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3bbd513-ba7f-4d24-8bdc-b2f9316423f6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:56.464682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e3bbd513-ba7f-4d24-8bdc-b2f9316423f6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:51:56.858393 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:51:56.858632 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 21:51:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 (ip 10.222.0.30) !!! Oct 04 21:51:56.868616 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e3bbd513-ba7f-4d24-8bdc-b2f9316423f6 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "DELETE /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2" status: 204 len: 0 microversion: 2.1 time: 0.445623 Oct 04 21:51:56.869851 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3287/6596] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:51:56 2022] DELETE /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:51:56.877404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6c9d3a70-bc8a-4ea6-a6d0-31dab0e63aae tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:56.878065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6c9d3a70-bc8a-4ea6-a6d0-31dab0e63aae tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:56.885733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c9d3a70-bc8a-4ea6-a6d0-31dab0e63aae tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:56.886241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c9d3a70-bc8a-4ea6-a6d0-31dab0e63aae tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:56.886706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c9d3a70-bc8a-4ea6-a6d0-31dab0e63aae tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:56.887415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c9d3a70-bc8a-4ea6-a6d0-31dab0e63aae tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:56.887939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c9d3a70-bc8a-4ea6-a6d0-31dab0e63aae tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:56.890139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6c9d3a70-bc8a-4ea6-a6d0-31dab0e63aae tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:56.955703 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a68b9245-430d-4d3d-8cc4-6a29d1671e9c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:56.955983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a68b9245-430d-4d3d-8cc4-6a29d1671e9c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:56.966037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a68b9245-430d-4d3d-8cc4-6a29d1671e9c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:56.966652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a68b9245-430d-4d3d-8cc4-6a29d1671e9c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:56.967179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a68b9245-430d-4d3d-8cc4-6a29d1671e9c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:56.968046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a68b9245-430d-4d3d-8cc4-6a29d1671e9c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:56.968581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a68b9245-430d-4d3d-8cc4-6a29d1671e9c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:56.969209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a68b9245-430d-4d3d-8cc4-6a29d1671e9c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:57.082094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6c9d3a70-bc8a-4ea6-a6d0-31dab0e63aae tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:57.091248 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6c9d3a70-bc8a-4ea6-a6d0-31dab0e63aae tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2" status: 200 len: 1504 microversion: 2.1 time: 0.217704 Oct 04 21:51:57.102527 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3310/6597] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:56 2022] GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:57.133988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a68b9245-430d-4d3d-8cc4-6a29d1671e9c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:57.142084 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a68b9245-430d-4d3d-8cc4-6a29d1671e9c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1264 microversion: 2.1 time: 0.192563 Oct 04 21:51:57.142670 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3288/6598] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:56 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:51:58.115751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d0cc6d59-be71-4a1f-94ed-994cbec43098 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:58.116396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d0cc6d59-be71-4a1f-94ed-994cbec43098 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:58.124392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0cc6d59-be71-4a1f-94ed-994cbec43098 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:58.124890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0cc6d59-be71-4a1f-94ed-994cbec43098 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:58.125342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0cc6d59-be71-4a1f-94ed-994cbec43098 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:58.126079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0cc6d59-be71-4a1f-94ed-994cbec43098 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:58.126570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0cc6d59-be71-4a1f-94ed-994cbec43098 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:58.127014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0cc6d59-be71-4a1f-94ed-994cbec43098 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:58.165466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3d4b8811-bdea-4d38-b824-c42658812a83 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:58.166205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3d4b8811-bdea-4d38-b824-c42658812a83 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:58.173539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d4b8811-bdea-4d38-b824-c42658812a83 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:58.181670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d4b8811-bdea-4d38-b824-c42658812a83 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:58.181670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d4b8811-bdea-4d38-b824-c42658812a83 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:58.181670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d4b8811-bdea-4d38-b824-c42658812a83 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:58.181670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d4b8811-bdea-4d38-b824-c42658812a83 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:58.181670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3d4b8811-bdea-4d38-b824-c42658812a83 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:58.367444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d0cc6d59-be71-4a1f-94ed-994cbec43098 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:58.375935 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d0cc6d59-be71-4a1f-94ed-994cbec43098 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2" status: 200 len: 1504 microversion: 2.1 time: 0.264297 Oct 04 21:51:58.380255 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3311/6599] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:58 2022] GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:58.433823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3d4b8811-bdea-4d38-b824-c42658812a83 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:58.438149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:58.442594 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3d4b8811-bdea-4d38-b824-c42658812a83 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1264 microversion: 2.1 time: 0.281569 Oct 04 21:51:58.444538 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3289/6600] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:58 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1264 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:51:58.962307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-337bb118-2f92-4652-b03a-c2d8b735dad2 req-53d5dfae-916c-48ab-820d-4291005127ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a31762-2007-402f-836e-2ed72ecc5eb2", "name": "network-vif-deleted", "tag": "733c30cd-ebc7-4e5e-9918-090d3228457b"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:58.972035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-337bb118-2f92-4652-b03a-c2d8b735dad2 req-53d5dfae-916c-48ab-820d-4291005127ce service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:58.972614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-337bb118-2f92-4652-b03a-c2d8b735dad2 req-53d5dfae-916c-48ab-820d-4291005127ce service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:58.973068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-337bb118-2f92-4652-b03a-c2d8b735dad2 req-53d5dfae-916c-48ab-820d-4291005127ce service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:58.985248 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-337bb118-2f92-4652-b03a-c2d8b735dad2 req-53d5dfae-916c-48ab-820d-4291005127ce service nova] Creating event network-vif-deleted:733c30cd-ebc7-4e5e-9918-090d3228457b for instance 96a31762-2007-402f-836e-2ed72ecc5eb2 on n-h2-860282-1 Oct 04 21:51:58.990762 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-337bb118-2f92-4652-b03a-c2d8b735dad2 req-53d5dfae-916c-48ab-820d-4291005127ce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032225 Oct 04 21:51:58.991434 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3312/6601] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:59.403701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dadf9611-703e-40a9-8b31-2cd9480df699 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:59.405264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dadf9611-703e-40a9-8b31-2cd9480df699 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:59.413360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dadf9611-703e-40a9-8b31-2cd9480df699 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:59.414654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dadf9611-703e-40a9-8b31-2cd9480df699 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:59.415461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dadf9611-703e-40a9-8b31-2cd9480df699 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:59.416455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dadf9611-703e-40a9-8b31-2cd9480df699 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:59.416924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dadf9611-703e-40a9-8b31-2cd9480df699 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:59.417358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dadf9611-703e-40a9-8b31-2cd9480df699 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:59.458435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dadf9611-703e-40a9-8b31-2cd9480df699 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:59.459211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dadf9611-703e-40a9-8b31-2cd9480df699 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:59.459845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dadf9611-703e-40a9-8b31-2cd9480df699 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:59.460302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-dadf9611-703e-40a9-8b31-2cd9480df699 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lazy-loading 'fault' on Instance uuid 96a31762-2007-402f-836e-2ed72ecc5eb2 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:51:59.477943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-663f5a66-e94b-4bf8-b59e-603135d7c023 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:59.478692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-663f5a66-e94b-4bf8-b59e-603135d7c023 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:59.497995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-663f5a66-e94b-4bf8-b59e-603135d7c023 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:59.499994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-663f5a66-e94b-4bf8-b59e-603135d7c023 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:59.500474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-663f5a66-e94b-4bf8-b59e-603135d7c023 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:59.502630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-663f5a66-e94b-4bf8-b59e-603135d7c023 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:59.507351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-663f5a66-e94b-4bf8-b59e-603135d7c023 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:59.507938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-663f5a66-e94b-4bf8-b59e-603135d7c023 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:59.550687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dadf9611-703e-40a9-8b31-2cd9480df699 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b24d62f948a0a2f5de7a3ebbef00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba2aa4b7db54438831a60b953292fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:59.570444 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dadf9611-703e-40a9-8b31-2cd9480df699 tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2" status: 200 len: 1304 microversion: 2.1 time: 0.172057 Oct 04 21:51:59.572132 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3290/6602] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:59 2022] GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 => generated 1304 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:59.692419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-663f5a66-e94b-4bf8-b59e-603135d7c023 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:59.701309 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-663f5a66-e94b-4bf8-b59e-603135d7c023 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1264 microversion: 2.1 time: 0.234395 Oct 04 21:51:59.706858 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3313/6603] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:59 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:00.599268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a752751-ccd7-4710-8b16-25b6cb1d1e5c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:00.600034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7a752751-ccd7-4710-8b16-25b6cb1d1e5c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] [instance: 96a31762-2007-402f-836e-2ed72ecc5eb2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:00.607429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a752751-ccd7-4710-8b16-25b6cb1d1e5c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:00.607931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a752751-ccd7-4710-8b16-25b6cb1d1e5c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:00.608377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a752751-ccd7-4710-8b16-25b6cb1d1e5c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:00.609096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a752751-ccd7-4710-8b16-25b6cb1d1e5c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:00.609585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a752751-ccd7-4710-8b16-25b6cb1d1e5c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:00.610053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a752751-ccd7-4710-8b16-25b6cb1d1e5c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:00.629123 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-7a752751-ccd7-4710-8b16-25b6cb1d1e5c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] HTTP exception thrown: Instance 96a31762-2007-402f-836e-2ed72ecc5eb2 could not be found. Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a752751-ccd7-4710-8b16-25b6cb1d1e5c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Request method failure captured: Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 HTTP/1.1 Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKrS0lc-mCQqrcMm8LOMqJAuEheU56XhzRwkImZK3vSwB9LUiDB_YTCGkM2lMUXmEUgd6WQ6JvyDuDhzqHdiIGQMG1RLvjQeNwic-zAlloxKEZgRKFvAcbdR1WOgczOgTz7572LEFwHclRZQHQMKHXXviQFYT3t7mrRdPv1ZpLnb-uE Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 9ba2aa4b7db54438831a60b953292fcb Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-VolumesActionsTest-2026808498 Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9ba2aa4b7db54438831a60b953292fcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9ba2aa4b7db54438831a60b953292fcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9ba2aa4b7db54438831a60b953292fcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9ba2aa4b7db54438831a60b953292fcb"}]}] Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-VolumesActionsTest-2026808498 Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 9ba2aa4b7db54438831a60b953292fcb Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-VolumesActionsTest-2026808498 Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-VolumesActionsTest-2026808498-project Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: ea36b24d62f948a0a2f5de7a3ebbef00 Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-VolumesActionsTest-2026808498-project Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 96a31762-2007-402f-836e-2ed72ecc5eb2 could not be found. Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '96a31762-2007-402f-836e-2ed72ecc5eb2'} Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a31762-2007-402f-836e-2ed72ecc5eb2 could not be found. Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a31762-2007-402f-836e-2ed72ecc5eb2 could not be found. Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:00.630904 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:52:00.637332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:00.637332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:00.637332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:00.637332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:52:00.637332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:52:00.637332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a31762-2007-402f-836e-2ed72ecc5eb2 could not be found. Oct 04 21:52:00.637332 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:52:00.637332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a752751-ccd7-4710-8b16-25b6cb1d1e5c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] Returning 404 to user: Instance 96a31762-2007-402f-836e-2ed72ecc5eb2 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:52:00.637332 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7a752751-ccd7-4710-8b16-25b6cb1d1e5c tempest-VolumesActionsTest-2026808498 tempest-VolumesActionsTest-2026808498-project] 10.222.0.30 "GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2" status: 404 len: 111 microversion: 2.1 time: 0.037099 Oct 04 21:52:00.637332 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3291/6604] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:00 2022] GET /compute/v2.1/servers/96a31762-2007-402f-836e-2ed72ecc5eb2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:52:00.724274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1c8ab21a-e5e9-4d5f-885e-3910b0a4dc11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:00.725052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1c8ab21a-e5e9-4d5f-885e-3910b0a4dc11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:00.732544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c8ab21a-e5e9-4d5f-885e-3910b0a4dc11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:00.733255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c8ab21a-e5e9-4d5f-885e-3910b0a4dc11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:00.733951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c8ab21a-e5e9-4d5f-885e-3910b0a4dc11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:00.734738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c8ab21a-e5e9-4d5f-885e-3910b0a4dc11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:00.735285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c8ab21a-e5e9-4d5f-885e-3910b0a4dc11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:00.735795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c8ab21a-e5e9-4d5f-885e-3910b0a4dc11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:00.901346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1c8ab21a-e5e9-4d5f-885e-3910b0a4dc11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:00.905268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:00.910634 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1c8ab21a-e5e9-4d5f-885e-3910b0a4dc11 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1264 microversion: 2.1 time: 0.189558 Oct 04 21:52:00.910634 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3314/6605] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:00 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:01.135165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-dc617288-c04a-470e-9fd9-592a657de2fa req-b08286c7-c2b2-499d-8e10-3923c7917e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4866bba-4c3e-4ff7-9e38-fb2938323240", "name": "network-vif-plugged", "status": "completed", "tag": "45cecac7-6d52-46d4-b35f-984dba208b27"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:01.144763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-dc617288-c04a-470e-9fd9-592a657de2fa req-b08286c7-c2b2-499d-8e10-3923c7917e70 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:01.150354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-dc617288-c04a-470e-9fd9-592a657de2fa req-b08286c7-c2b2-499d-8e10-3923c7917e70 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:01.150354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-dc617288-c04a-470e-9fd9-592a657de2fa req-b08286c7-c2b2-499d-8e10-3923c7917e70 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:01.161630 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-dc617288-c04a-470e-9fd9-592a657de2fa req-b08286c7-c2b2-499d-8e10-3923c7917e70 service nova] Creating event network-vif-plugged:45cecac7-6d52-46d4-b35f-984dba208b27 for instance f4866bba-4c3e-4ff7-9e38-fb2938323240 on n-h2-860282-1 Oct 04 21:52:01.167054 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-dc617288-c04a-470e-9fd9-592a657de2fa req-b08286c7-c2b2-499d-8e10-3923c7917e70 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036526 Oct 04 21:52:01.167714 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3292/6606] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:01.932217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-903ef03b-4b4b-49df-a6d6-9060dcb15cea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:01.932860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-903ef03b-4b4b-49df-a6d6-9060dcb15cea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:01.940374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-903ef03b-4b4b-49df-a6d6-9060dcb15cea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:01.940879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-903ef03b-4b4b-49df-a6d6-9060dcb15cea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:01.941338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-903ef03b-4b4b-49df-a6d6-9060dcb15cea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:01.942081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-903ef03b-4b4b-49df-a6d6-9060dcb15cea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:01.942561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-903ef03b-4b4b-49df-a6d6-9060dcb15cea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:01.943022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-903ef03b-4b4b-49df-a6d6-9060dcb15cea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:02.085791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-903ef03b-4b4b-49df-a6d6-9060dcb15cea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:02.093822 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-903ef03b-4b4b-49df-a6d6-9060dcb15cea tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1264 microversion: 2.1 time: 0.165544 Oct 04 21:52:02.094415 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3315/6607] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:01 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:03.117511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-de308162-fe83-4abe-a16a-dcba413bc844 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:03.118327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-de308162-fe83-4abe-a16a-dcba413bc844 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:03.126168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de308162-fe83-4abe-a16a-dcba413bc844 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:03.126658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de308162-fe83-4abe-a16a-dcba413bc844 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:03.127098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de308162-fe83-4abe-a16a-dcba413bc844 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:03.127828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de308162-fe83-4abe-a16a-dcba413bc844 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:03.128284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de308162-fe83-4abe-a16a-dcba413bc844 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:03.128749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de308162-fe83-4abe-a16a-dcba413bc844 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:03.313164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-de308162-fe83-4abe-a16a-dcba413bc844 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:03.349465 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-de308162-fe83-4abe-a16a-dcba413bc844 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1451 microversion: 2.1 time: 0.236037 Oct 04 21:52:03.375019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7230bee0-b50e-43b4-8cfa-61317ea2d49a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:03.375667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7230bee0-b50e-43b4-8cfa-61317ea2d49a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:03.383759 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3293/6608] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:03 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1451 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:03.384387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7230bee0-b50e-43b4-8cfa-61317ea2d49a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:03.385166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7230bee0-b50e-43b4-8cfa-61317ea2d49a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:03.385857 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7230bee0-b50e-43b4-8cfa-61317ea2d49a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:03.387002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7230bee0-b50e-43b4-8cfa-61317ea2d49a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:03.387724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7230bee0-b50e-43b4-8cfa-61317ea2d49a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:03.388417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7230bee0-b50e-43b4-8cfa-61317ea2d49a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:03.574520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7230bee0-b50e-43b4-8cfa-61317ea2d49a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:03.584320 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7230bee0-b50e-43b4-8cfa-61317ea2d49a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1451 microversion: 2.1 time: 0.213058 Oct 04 21:52:03.584923 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3316/6609] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:03 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1451 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:06.639241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-3c4549ac-7e3a-477b-947e-1c557f0baae1 req-ceea27cf-ecc0-44c4-ab21-0d577c33d586 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4866bba-4c3e-4ff7-9e38-fb2938323240", "tag": "45cecac7-6d52-46d4-b35f-984dba208b27"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:06.660192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3c4549ac-7e3a-477b-947e-1c557f0baae1 req-ceea27cf-ecc0-44c4-ab21-0d577c33d586 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:06.660601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3c4549ac-7e3a-477b-947e-1c557f0baae1 req-ceea27cf-ecc0-44c4-ab21-0d577c33d586 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:06.661041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3c4549ac-7e3a-477b-947e-1c557f0baae1 req-ceea27cf-ecc0-44c4-ab21-0d577c33d586 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:06.685541 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-3c4549ac-7e3a-477b-947e-1c557f0baae1 req-ceea27cf-ecc0-44c4-ab21-0d577c33d586 service nova] Creating event network-changed:45cecac7-6d52-46d4-b35f-984dba208b27 for instance f4866bba-4c3e-4ff7-9e38-fb2938323240 on n-h2-860282-1 Oct 04 21:52:06.691895 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-3c4549ac-7e3a-477b-947e-1c557f0baae1 req-ceea27cf-ecc0-44c4-ab21-0d577c33d586 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056924 Oct 04 21:52:06.693374 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3294/6610] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:52:09.475175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5b27bb96-c174-4cd1-ae10-8b3651317511 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Action: 'create', calling method: .version_select at 0x7f57905b4ca0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-314440794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISWn3djsudHwz75s2AYg5zJz83DzGEpi6wAlKUuR9SFd+/ELdzgh1Uq8cnXmU9x6PHoluE7NwC5mz+ebLyvPHcFHveUxv14c81qsDAfxiwW86BqWWQAj7ZuaH4rLQgoTQ=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:09.503807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5b27bb96-c174-4cd1-ae10-8b3651317511 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Getting quotas for project ecc41b8b699f4c88a2c94ca7038e8b3a. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:52:09.510670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5b27bb96-c174-4cd1-ae10-8b3651317511 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Getting quotas for user c06b098dc002471fa4a6f073f1d2f3a2 and project ecc41b8b699f4c88a2c94ca7038e8b3a. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:52:09.620220 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5b27bb96-c174-4cd1-ae10-8b3651317511 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.149022 Oct 04 21:52:09.621975 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3317/6611] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:52:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:12.740284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6d8ba987-2b97-40fd-9c3d-2917cd0dfde2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1817183581", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d1e8cbf4-4338-4845-acfd-7bf95b471c69", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-314440794", "security_groups": [{"name": "tempest-secgroup-smoke-1285051638"}], "networks": [{"uuid": "7476f039-9fa2-482c-a13e-1fc5b0d03e75"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:12.884406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-6d8ba987-2b97-40fd-9c3d-2917cd0dfde2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] validate_networks() for [('7476f039-9fa2-482c-a13e-1fc5b0d03e75', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:52:13.338516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6d8ba987-2b97-40fd-9c3d-2917cd0dfde2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:52:13.339045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6d8ba987-2b97-40fd-9c3d-2917cd0dfde2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:52:13.339809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6d8ba987-2b97-40fd-9c3d-2917cd0dfde2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:52:13.340763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6d8ba987-2b97-40fd-9c3d-2917cd0dfde2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:52:13.342118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-6d8ba987-2b97-40fd-9c3d-2917cd0dfde2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:52:13.357276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d8ba987-2b97-40fd-9c3d-2917cd0dfde2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:13.357996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d8ba987-2b97-40fd-9c3d-2917cd0dfde2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:13.358642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d8ba987-2b97-40fd-9c3d-2917cd0dfde2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:13.359550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d8ba987-2b97-40fd-9c3d-2917cd0dfde2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:13.360183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d8ba987-2b97-40fd-9c3d-2917cd0dfde2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:13.360730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d8ba987-2b97-40fd-9c3d-2917cd0dfde2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:13.386485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-6d8ba987-2b97-40fd-9c3d-2917cd0dfde2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Getting quotas for project ecc41b8b699f4c88a2c94ca7038e8b3a. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:52:13.397080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-6d8ba987-2b97-40fd-9c3d-2917cd0dfde2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Getting quotas for user c06b098dc002471fa4a6f073f1d2f3a2 and project ecc41b8b699f4c88a2c94ca7038e8b3a. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:52:13.475047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6d8ba987-2b97-40fd-9c3d-2917cd0dfde2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:52:13.478275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6d8ba987-2b97-40fd-9c3d-2917cd0dfde2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d1e8cbf4-4338-4845-acfd-7bf95b471c69',volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:52:13.936494 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6d8ba987-2b97-40fd-9c3d-2917cd0dfde2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.200280 Oct 04 21:52:13.954975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-53d5b67b-cb73-4424-914c-e5eb6547513a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:13.956310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-53d5b67b-cb73-4424-914c-e5eb6547513a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:13.959587 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3295/6612] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:52:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:52:13.971271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=12 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:14.029825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-53d5b67b-cb73-4424-914c-e5eb6547513a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:14.039899 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-53d5b67b-cb73-4424-914c-e5eb6547513a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1098 microversion: 2.1 time: 0.092179 Oct 04 21:52:14.040852 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3318/6613] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:13 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1098 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:15.064816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8929f85a-ff8b-4fc9-9f7b-610aff0a65f6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:15.066169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8929f85a-ff8b-4fc9-9f7b-610aff0a65f6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:15.125827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8929f85a-ff8b-4fc9-9f7b-610aff0a65f6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:15.144966 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8929f85a-ff8b-4fc9-9f7b-610aff0a65f6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1098 microversion: 2.1 time: 0.084297 Oct 04 21:52:15.147892 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3296/6614] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:15 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1098 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:16.173330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cfecbea8-452f-40f2-a717-0352971b50f7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:16.174638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cfecbea8-452f-40f2-a717-0352971b50f7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:16.189818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cfecbea8-452f-40f2-a717-0352971b50f7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:16.190388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cfecbea8-452f-40f2-a717-0352971b50f7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:16.190868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cfecbea8-452f-40f2-a717-0352971b50f7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:16.191618 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cfecbea8-452f-40f2-a717-0352971b50f7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:16.192287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cfecbea8-452f-40f2-a717-0352971b50f7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:16.194907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cfecbea8-452f-40f2-a717-0352971b50f7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:16.271386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cfecbea8-452f-40f2-a717-0352971b50f7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:16.281361 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cfecbea8-452f-40f2-a717-0352971b50f7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1196 microversion: 2.1 time: 0.112454 Oct 04 21:52:16.282557 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3319/6615] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:16 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1196 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:17.309198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e1be94a7-9587-4872-9d63-f9786b9a2cb6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:17.311512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e1be94a7-9587-4872-9d63-f9786b9a2cb6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:17.331504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1be94a7-9587-4872-9d63-f9786b9a2cb6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:17.332350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1be94a7-9587-4872-9d63-f9786b9a2cb6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:17.335049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1be94a7-9587-4872-9d63-f9786b9a2cb6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:17.339971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1be94a7-9587-4872-9d63-f9786b9a2cb6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:17.339971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1be94a7-9587-4872-9d63-f9786b9a2cb6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:17.339971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1be94a7-9587-4872-9d63-f9786b9a2cb6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:17.450493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e1be94a7-9587-4872-9d63-f9786b9a2cb6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:17.460511 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e1be94a7-9587-4872-9d63-f9786b9a2cb6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1214 microversion: 2.1 time: 0.157473 Oct 04 21:52:17.464577 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3297/6616] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:17 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:18.488773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-51cddfeb-21dc-4402-bc80-693ed4464546 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:18.489317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-51cddfeb-21dc-4402-bc80-693ed4464546 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:18.496599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51cddfeb-21dc-4402-bc80-693ed4464546 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:18.497104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51cddfeb-21dc-4402-bc80-693ed4464546 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:18.497617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51cddfeb-21dc-4402-bc80-693ed4464546 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:18.498338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51cddfeb-21dc-4402-bc80-693ed4464546 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:18.498818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51cddfeb-21dc-4402-bc80-693ed4464546 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:18.499259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51cddfeb-21dc-4402-bc80-693ed4464546 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:18.687368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-51cddfeb-21dc-4402-bc80-693ed4464546 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:18.698195 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-51cddfeb-21dc-4402-bc80-693ed4464546 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1282 microversion: 2.1 time: 0.213397 Oct 04 21:52:18.714103 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3320/6617] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:18 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1282 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:19.002807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-b30a12d3-6fc6-41ef-a0c5-f4dfddc9c66f req-74152a5c-0f46-4ebc-97a5-8ff485b9f656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e278edd-efe1-45d2-834e-99ce935f427e", "tag": "e4a559ca-ebbe-4d6b-a7cf-3784058ca02e"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:19.024635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b30a12d3-6fc6-41ef-a0c5-f4dfddc9c66f req-74152a5c-0f46-4ebc-97a5-8ff485b9f656 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:19.026187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b30a12d3-6fc6-41ef-a0c5-f4dfddc9c66f req-74152a5c-0f46-4ebc-97a5-8ff485b9f656 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:19.027524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b30a12d3-6fc6-41ef-a0c5-f4dfddc9c66f req-74152a5c-0f46-4ebc-97a5-8ff485b9f656 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:19.059188 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-b30a12d3-6fc6-41ef-a0c5-f4dfddc9c66f req-74152a5c-0f46-4ebc-97a5-8ff485b9f656 service nova] Creating event network-changed:e4a559ca-ebbe-4d6b-a7cf-3784058ca02e for instance 4e278edd-efe1-45d2-834e-99ce935f427e on n-h1-860282-1 Oct 04 21:52:19.062672 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-b30a12d3-6fc6-41ef-a0c5-f4dfddc9c66f req-74152a5c-0f46-4ebc-97a5-8ff485b9f656 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064044 Oct 04 21:52:19.063661 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3298/6618] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:19.723153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9f14c76f-f3f6-433f-adc9-09a1a1168717 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:19.725164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9f14c76f-f3f6-433f-adc9-09a1a1168717 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:19.749040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f14c76f-f3f6-433f-adc9-09a1a1168717 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:19.750850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f14c76f-f3f6-433f-adc9-09a1a1168717 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:19.751765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f14c76f-f3f6-433f-adc9-09a1a1168717 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:19.752846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f14c76f-f3f6-433f-adc9-09a1a1168717 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:19.755150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f14c76f-f3f6-433f-adc9-09a1a1168717 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:19.756066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f14c76f-f3f6-433f-adc9-09a1a1168717 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:19.966884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9f14c76f-f3f6-433f-adc9-09a1a1168717 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:19.978256 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9f14c76f-f3f6-433f-adc9-09a1a1168717 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1282 microversion: 2.1 time: 0.259975 Oct 04 21:52:19.979151 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3321/6619] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:19 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1282 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:21.002105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7b031c1d-ca9e-4e7a-a3c3-d79ded7d8bb0 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:21.002958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7b031c1d-ca9e-4e7a-a3c3-d79ded7d8bb0 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:21.006135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:21.016148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b031c1d-ca9e-4e7a-a3c3-d79ded7d8bb0 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:21.016656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b031c1d-ca9e-4e7a-a3c3-d79ded7d8bb0 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:21.019413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b031c1d-ca9e-4e7a-a3c3-d79ded7d8bb0 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:21.019413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b031c1d-ca9e-4e7a-a3c3-d79ded7d8bb0 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:21.019413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b031c1d-ca9e-4e7a-a3c3-d79ded7d8bb0 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:21.019413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b031c1d-ca9e-4e7a-a3c3-d79ded7d8bb0 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:21.293767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7b031c1d-ca9e-4e7a-a3c3-d79ded7d8bb0 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:21.305447 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7b031c1d-ca9e-4e7a-a3c3-d79ded7d8bb0 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1282 microversion: 2.1 time: 0.306912 Oct 04 21:52:21.320806 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3299/6620] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:20 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1282 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:22.328834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-95ed2bde-0750-4c6f-96c5-b42a2062ed6a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:22.450154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-95ed2bde-0750-4c6f-96c5-b42a2062ed6a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:22.450154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:22.450154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95ed2bde-0750-4c6f-96c5-b42a2062ed6a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:22.450154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95ed2bde-0750-4c6f-96c5-b42a2062ed6a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:22.450154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95ed2bde-0750-4c6f-96c5-b42a2062ed6a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:22.450154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95ed2bde-0750-4c6f-96c5-b42a2062ed6a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:22.450154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95ed2bde-0750-4c6f-96c5-b42a2062ed6a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:22.450154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95ed2bde-0750-4c6f-96c5-b42a2062ed6a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:22.489752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-95ed2bde-0750-4c6f-96c5-b42a2062ed6a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:22.498290 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-95ed2bde-0750-4c6f-96c5-b42a2062ed6a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1282 microversion: 2.1 time: 0.173938 Oct 04 21:52:22.498898 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3322/6621] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:22 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:23.548016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e1d90fe4-13fa-4011-a9e2-4da101cb3583 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:23.548913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e1d90fe4-13fa-4011-a9e2-4da101cb3583 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:23.552774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:23.559499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1d90fe4-13fa-4011-a9e2-4da101cb3583 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:23.560164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1d90fe4-13fa-4011-a9e2-4da101cb3583 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:23.560720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1d90fe4-13fa-4011-a9e2-4da101cb3583 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:23.561512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1d90fe4-13fa-4011-a9e2-4da101cb3583 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:23.562004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1d90fe4-13fa-4011-a9e2-4da101cb3583 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:23.562442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e1d90fe4-13fa-4011-a9e2-4da101cb3583 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:23.713122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e1d90fe4-13fa-4011-a9e2-4da101cb3583 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:23.721081 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e1d90fe4-13fa-4011-a9e2-4da101cb3583 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1282 microversion: 2.1 time: 0.178148 Oct 04 21:52:23.721712 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3300/6622] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:23 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1282 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:24.745524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4b3840c4-2f49-4fbb-8436-a1a3ad3064b9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:24.746160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4b3840c4-2f49-4fbb-8436-a1a3ad3064b9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:24.748825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:24.753950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b3840c4-2f49-4fbb-8436-a1a3ad3064b9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:24.754455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b3840c4-2f49-4fbb-8436-a1a3ad3064b9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:24.754914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b3840c4-2f49-4fbb-8436-a1a3ad3064b9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:24.755624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b3840c4-2f49-4fbb-8436-a1a3ad3064b9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:24.756150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b3840c4-2f49-4fbb-8436-a1a3ad3064b9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:24.756587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b3840c4-2f49-4fbb-8436-a1a3ad3064b9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:24.892837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4b3840c4-2f49-4fbb-8436-a1a3ad3064b9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:24.900842 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4b3840c4-2f49-4fbb-8436-a1a3ad3064b9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1270 microversion: 2.1 time: 0.160094 Oct 04 21:52:24.901379 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3323/6623] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:24 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:25.924620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0833c5e2-cfd1-46bd-8ce4-b1fbb1e49a76 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:25.925202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0833c5e2-cfd1-46bd-8ce4-b1fbb1e49a76 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:25.928190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:25.934017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0833c5e2-cfd1-46bd-8ce4-b1fbb1e49a76 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:25.934514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0833c5e2-cfd1-46bd-8ce4-b1fbb1e49a76 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:25.934960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0833c5e2-cfd1-46bd-8ce4-b1fbb1e49a76 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:25.935662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0833c5e2-cfd1-46bd-8ce4-b1fbb1e49a76 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:25.936118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0833c5e2-cfd1-46bd-8ce4-b1fbb1e49a76 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:25.936549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0833c5e2-cfd1-46bd-8ce4-b1fbb1e49a76 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:26.079519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0833c5e2-cfd1-46bd-8ce4-b1fbb1e49a76 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:26.087523 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0833c5e2-cfd1-46bd-8ce4-b1fbb1e49a76 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1270 microversion: 2.1 time: 0.167214 Oct 04 21:52:26.088680 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3301/6624] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:25 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:27.114737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-38473e69-1bb1-434d-8027-33f7d535aaeb tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:27.115481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-38473e69-1bb1-434d-8027-33f7d535aaeb tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:27.123578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38473e69-1bb1-434d-8027-33f7d535aaeb tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:27.126977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38473e69-1bb1-434d-8027-33f7d535aaeb tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:27.126977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38473e69-1bb1-434d-8027-33f7d535aaeb tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:27.126977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38473e69-1bb1-434d-8027-33f7d535aaeb tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:27.126977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38473e69-1bb1-434d-8027-33f7d535aaeb tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:27.126977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38473e69-1bb1-434d-8027-33f7d535aaeb tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:27.267752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-38473e69-1bb1-434d-8027-33f7d535aaeb tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:27.281132 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-38473e69-1bb1-434d-8027-33f7d535aaeb tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1270 microversion: 2.1 time: 0.166121 Oct 04 21:52:27.281132 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3324/6625] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:27 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:28.301724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-54d1bd38-1557-4798-a8c5-ab2160940b56 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:28.302525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-54d1bd38-1557-4798-a8c5-ab2160940b56 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:28.310704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54d1bd38-1557-4798-a8c5-ab2160940b56 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:28.311195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54d1bd38-1557-4798-a8c5-ab2160940b56 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:28.311682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54d1bd38-1557-4798-a8c5-ab2160940b56 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:28.312385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54d1bd38-1557-4798-a8c5-ab2160940b56 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:28.312845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54d1bd38-1557-4798-a8c5-ab2160940b56 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:28.313301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54d1bd38-1557-4798-a8c5-ab2160940b56 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:28.459195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-54d1bd38-1557-4798-a8c5-ab2160940b56 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:28.470084 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-54d1bd38-1557-4798-a8c5-ab2160940b56 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1270 microversion: 2.1 time: 0.172441 Oct 04 21:52:28.470675 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3302/6626] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:28 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:29.494200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e3f843fc-2ba6-4b3e-92de-9e1bcf269f8a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:29.494944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e3f843fc-2ba6-4b3e-92de-9e1bcf269f8a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:29.502766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3f843fc-2ba6-4b3e-92de-9e1bcf269f8a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:29.503273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3f843fc-2ba6-4b3e-92de-9e1bcf269f8a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:29.503735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3f843fc-2ba6-4b3e-92de-9e1bcf269f8a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:29.504453 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3f843fc-2ba6-4b3e-92de-9e1bcf269f8a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:29.504925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3f843fc-2ba6-4b3e-92de-9e1bcf269f8a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:29.505593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3f843fc-2ba6-4b3e-92de-9e1bcf269f8a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:29.992241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e3f843fc-2ba6-4b3e-92de-9e1bcf269f8a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:30.000421 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e3f843fc-2ba6-4b3e-92de-9e1bcf269f8a tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1270 microversion: 2.1 time: 0.510243 Oct 04 21:52:30.013984 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3325/6627] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:29 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1270 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:31.026458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e5ebce91-78e5-4dda-bf93-f0478001e0a2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:31.027266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e5ebce91-78e5-4dda-bf93-f0478001e0a2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:31.035590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5ebce91-78e5-4dda-bf93-f0478001e0a2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:31.036215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5ebce91-78e5-4dda-bf93-f0478001e0a2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:31.036637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5ebce91-78e5-4dda-bf93-f0478001e0a2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:31.038143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5ebce91-78e5-4dda-bf93-f0478001e0a2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:31.038924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5ebce91-78e5-4dda-bf93-f0478001e0a2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:31.039377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5ebce91-78e5-4dda-bf93-f0478001e0a2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:31.047279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=55 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:31.176785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e5ebce91-78e5-4dda-bf93-f0478001e0a2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:31.185314 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e5ebce91-78e5-4dda-bf93-f0478001e0a2 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1270 microversion: 2.1 time: 0.163814 Oct 04 21:52:31.186131 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3303/6628] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:31 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:32.208047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1522105f-c4d8-4e94-8e17-cedbe6402298 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:32.213351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1522105f-c4d8-4e94-8e17-cedbe6402298 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:32.216058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1522105f-c4d8-4e94-8e17-cedbe6402298 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:32.216577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1522105f-c4d8-4e94-8e17-cedbe6402298 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:32.217043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1522105f-c4d8-4e94-8e17-cedbe6402298 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:32.217787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1522105f-c4d8-4e94-8e17-cedbe6402298 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:32.218265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1522105f-c4d8-4e94-8e17-cedbe6402298 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:32.218713 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1522105f-c4d8-4e94-8e17-cedbe6402298 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:32.365011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1522105f-c4d8-4e94-8e17-cedbe6402298 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:32.375077 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1522105f-c4d8-4e94-8e17-cedbe6402298 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1270 microversion: 2.1 time: 0.170168 Oct 04 21:52:32.385232 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3326/6629] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:32 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:32.430554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-3f73623a-2839-4ff4-8249-5ceaba9f3376 req-066b1f0c-c5cd-4974-8799-d012f13c6a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e278edd-efe1-45d2-834e-99ce935f427e", "name": "network-vif-plugged", "status": "completed", "tag": "e4a559ca-ebbe-4d6b-a7cf-3784058ca02e"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:32.444025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3f73623a-2839-4ff4-8249-5ceaba9f3376 req-066b1f0c-c5cd-4974-8799-d012f13c6a2d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:32.444532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3f73623a-2839-4ff4-8249-5ceaba9f3376 req-066b1f0c-c5cd-4974-8799-d012f13c6a2d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:32.445051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3f73623a-2839-4ff4-8249-5ceaba9f3376 req-066b1f0c-c5cd-4974-8799-d012f13c6a2d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:32.457240 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-3f73623a-2839-4ff4-8249-5ceaba9f3376 req-066b1f0c-c5cd-4974-8799-d012f13c6a2d service nova] Creating event network-vif-plugged:e4a559ca-ebbe-4d6b-a7cf-3784058ca02e for instance 4e278edd-efe1-45d2-834e-99ce935f427e on n-h1-860282-1 Oct 04 21:52:32.462589 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-3f73623a-2839-4ff4-8249-5ceaba9f3376 req-066b1f0c-c5cd-4974-8799-d012f13c6a2d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035737 Oct 04 21:52:32.463822 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3304/6630] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:33.291099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f60a1120-c714-41ca-89ef-d90113247726 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'create', calling method: .version_select at 0x7f578b5499d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1531057924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVsEAYJvF/+ld1aSs1iaoGAju1NkwIBKciGKZJ3Gvyci1DRM5mrORdWMep/3bHvHECIfUD/XW1QXGC4fd9JSvooz45kbh6uXLHEI8x6cjUXJgqGarBHIt1XtoiEoKWC0Q=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:33.307118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-f60a1120-c714-41ca-89ef-d90113247726 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Getting quotas for project 187e190360d14111a4107866a8000348. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:52:33.312913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-f60a1120-c714-41ca-89ef-d90113247726 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Getting quotas for user 8c893eb5126c4c9db1012c199660261c and project 187e190360d14111a4107866a8000348. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:52:33.372070 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f60a1120-c714-41ca-89ef-d90113247726 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.245674 Oct 04 21:52:33.372689 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3327/6631] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:52:33 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:33.401688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a0836ab7-3c7e-4347-bcc7-150c50999281 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:33.402401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a0836ab7-3c7e-4347-bcc7-150c50999281 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:33.408849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a0836ab7-3c7e-4347-bcc7-150c50999281 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:33.409378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a0836ab7-3c7e-4347-bcc7-150c50999281 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:33.409805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a0836ab7-3c7e-4347-bcc7-150c50999281 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:33.410512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a0836ab7-3c7e-4347-bcc7-150c50999281 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:33.410969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a0836ab7-3c7e-4347-bcc7-150c50999281 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:33.411401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a0836ab7-3c7e-4347-bcc7-150c50999281 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:33.607492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a0836ab7-3c7e-4347-bcc7-150c50999281 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:33.615725 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a0836ab7-3c7e-4347-bcc7-150c50999281 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1270 microversion: 2.1 time: 0.218300 Oct 04 21:52:33.616318 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3305/6632] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:33 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1270 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:34.640155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-95d24038-c3eb-4d42-9f65-e6a4b104d8e6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:34.640790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-95d24038-c3eb-4d42-9f65-e6a4b104d8e6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:34.646884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95d24038-c3eb-4d42-9f65-e6a4b104d8e6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:34.647389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95d24038-c3eb-4d42-9f65-e6a4b104d8e6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:34.647976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95d24038-c3eb-4d42-9f65-e6a4b104d8e6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:34.648685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95d24038-c3eb-4d42-9f65-e6a4b104d8e6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:34.649172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95d24038-c3eb-4d42-9f65-e6a4b104d8e6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:34.649656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95d24038-c3eb-4d42-9f65-e6a4b104d8e6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:34.817216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-95d24038-c3eb-4d42-9f65-e6a4b104d8e6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:34.826021 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-95d24038-c3eb-4d42-9f65-e6a4b104d8e6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1458 microversion: 2.1 time: 0.191136 Oct 04 21:52:34.826595 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3328/6633] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:34 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1458 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:34.860840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-610ca6cf-2f76-4b82-b46b-28596e8faba7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:34.862241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-610ca6cf-2f76-4b82-b46b-28596e8faba7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:34.870056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-610ca6cf-2f76-4b82-b46b-28596e8faba7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:34.870662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-610ca6cf-2f76-4b82-b46b-28596e8faba7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:34.876317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-610ca6cf-2f76-4b82-b46b-28596e8faba7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:34.876317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-610ca6cf-2f76-4b82-b46b-28596e8faba7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:34.876317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-610ca6cf-2f76-4b82-b46b-28596e8faba7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:34.876317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-610ca6cf-2f76-4b82-b46b-28596e8faba7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:35.042085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-610ca6cf-2f76-4b82-b46b-28596e8faba7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:35.050371 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-610ca6cf-2f76-4b82-b46b-28596e8faba7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1458 microversion: 2.1 time: 0.193928 Oct 04 21:52:35.050956 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3306/6634] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:34 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1458 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:37.911112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-3d01fb00-94f4-4f8c-aff1-0fa1c4ebcbdc req-dafb6823-d4f3-45cf-a83c-b9b9246590c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e278edd-efe1-45d2-834e-99ce935f427e", "tag": "e4a559ca-ebbe-4d6b-a7cf-3784058ca02e"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:37.925869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3d01fb00-94f4-4f8c-aff1-0fa1c4ebcbdc req-dafb6823-d4f3-45cf-a83c-b9b9246590c6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:37.926761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3d01fb00-94f4-4f8c-aff1-0fa1c4ebcbdc req-dafb6823-d4f3-45cf-a83c-b9b9246590c6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:37.927436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3d01fb00-94f4-4f8c-aff1-0fa1c4ebcbdc req-dafb6823-d4f3-45cf-a83c-b9b9246590c6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:37.942371 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-3d01fb00-94f4-4f8c-aff1-0fa1c4ebcbdc req-dafb6823-d4f3-45cf-a83c-b9b9246590c6 service nova] Creating event network-changed:e4a559ca-ebbe-4d6b-a7cf-3784058ca02e for instance 4e278edd-efe1-45d2-834e-99ce935f427e on n-h1-860282-1 Oct 04 21:52:37.951497 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-3d01fb00-94f4-4f8c-aff1-0fa1c4ebcbdc req-dafb6823-d4f3-45cf-a83c-b9b9246590c6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044975 Oct 04 21:52:37.952116 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3329/6635] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:39.214776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-6db59757-1806-4f1e-9b2f-291a0ebb8f39 req-60d998ac-d159-4332-a918-e648a15e85bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e278edd-efe1-45d2-834e-99ce935f427e", "tag": "e4a559ca-ebbe-4d6b-a7cf-3784058ca02e"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:39.226513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6db59757-1806-4f1e-9b2f-291a0ebb8f39 req-60d998ac-d159-4332-a918-e648a15e85bb service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:39.226990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6db59757-1806-4f1e-9b2f-291a0ebb8f39 req-60d998ac-d159-4332-a918-e648a15e85bb service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:39.229676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6db59757-1806-4f1e-9b2f-291a0ebb8f39 req-60d998ac-d159-4332-a918-e648a15e85bb service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:39.246073 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-6db59757-1806-4f1e-9b2f-291a0ebb8f39 req-60d998ac-d159-4332-a918-e648a15e85bb service nova] Creating event network-changed:e4a559ca-ebbe-4d6b-a7cf-3784058ca02e for instance 4e278edd-efe1-45d2-834e-99ce935f427e on n-h1-860282-1 Oct 04 21:52:39.252858 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-6db59757-1806-4f1e-9b2f-291a0ebb8f39 req-60d998ac-d159-4332-a918-e648a15e85bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042062 Oct 04 21:52:39.258307 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3307/6636] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:41.268241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-c7465b1f-c860-4985-bacb-88ff0e58dc1c req-5c86f5e2-1803-46de-867f-fa3bd722c46a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e278edd-efe1-45d2-834e-99ce935f427e", "tag": "e4a559ca-ebbe-4d6b-a7cf-3784058ca02e"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:41.278521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c7465b1f-c860-4985-bacb-88ff0e58dc1c req-5c86f5e2-1803-46de-867f-fa3bd722c46a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:41.279871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c7465b1f-c860-4985-bacb-88ff0e58dc1c req-5c86f5e2-1803-46de-867f-fa3bd722c46a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:41.279871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c7465b1f-c860-4985-bacb-88ff0e58dc1c req-5c86f5e2-1803-46de-867f-fa3bd722c46a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:41.293901 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-c7465b1f-c860-4985-bacb-88ff0e58dc1c req-5c86f5e2-1803-46de-867f-fa3bd722c46a service nova] Creating event network-changed:e4a559ca-ebbe-4d6b-a7cf-3784058ca02e for instance 4e278edd-efe1-45d2-834e-99ce935f427e on n-h1-860282-1 Oct 04 21:52:41.298785 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-c7465b1f-c860-4985-bacb-88ff0e58dc1c req-5c86f5e2-1803-46de-867f-fa3bd722c46a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035582 Oct 04 21:52:41.302849 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3330/6637] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:44.075482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-de270f9b-fa13-4fad-b371-215353ad25f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1484380920", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "12fa2688-b5bc-474f-98e6-5eacc8ee5642"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1531057924", "security_groups": [{"name": "tempest-secgroup-smoke-497992504"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:44.200181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-de270f9b-fa13-4fad-b371-215353ad25f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] validate_networks() for [('12fa2688-b5bc-474f-98e6-5eacc8ee5642', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:52:44.679291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-de270f9b-fa13-4fad-b371-215353ad25f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:52:44.679814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-de270f9b-fa13-4fad-b371-215353ad25f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:52:44.680363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-de270f9b-fa13-4fad-b371-215353ad25f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:52:44.680850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-de270f9b-fa13-4fad-b371-215353ad25f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:52:44.681857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-de270f9b-fa13-4fad-b371-215353ad25f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:52:44.692414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de270f9b-fa13-4fad-b371-215353ad25f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:44.693135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de270f9b-fa13-4fad-b371-215353ad25f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:44.693995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de270f9b-fa13-4fad-b371-215353ad25f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:44.695045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de270f9b-fa13-4fad-b371-215353ad25f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:44.695644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de270f9b-fa13-4fad-b371-215353ad25f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:44.696161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de270f9b-fa13-4fad-b371-215353ad25f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:44.719080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-de270f9b-fa13-4fad-b371-215353ad25f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Getting quotas for project 187e190360d14111a4107866a8000348. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:52:44.726268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-de270f9b-fa13-4fad-b371-215353ad25f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Getting quotas for user 8c893eb5126c4c9db1012c199660261c and project 187e190360d14111a4107866a8000348. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:52:44.750027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-de270f9b-fa13-4fad-b371-215353ad25f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:52:44.756985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-de270f9b-fa13-4fad-b371-215353ad25f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:52:44.937785 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-de270f9b-fa13-4fad-b371-215353ad25f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.865659 Oct 04 21:52:44.937785 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3308/6638] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:52:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:52:44.949651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:44.957223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-306650c8-7e96-43cd-a353-e4c2289f3a31 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:44.958376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-306650c8-7e96-43cd-a353-e4c2289f3a31 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:45.024384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-306650c8-7e96-43cd-a353-e4c2289f3a31 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:45.035749 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-306650c8-7e96-43cd-a353-e4c2289f3a31 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1267 microversion: 2.1 time: 0.090413 Oct 04 21:52:45.036727 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3331/6639] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:44 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:46.060575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7bdea1dc-0944-43e0-9420-e8bdf935fa9c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:46.061204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7bdea1dc-0944-43e0-9420-e8bdf935fa9c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:46.118823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7bdea1dc-0944-43e0-9420-e8bdf935fa9c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:46.126510 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7bdea1dc-0944-43e0-9420-e8bdf935fa9c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1267 microversion: 2.1 time: 0.070099 Oct 04 21:52:46.127161 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3309/6640] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:46 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1267 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:47.150883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-10280aba-84a4-45a7-8e3e-cfb1636bc8c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:47.151536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-10280aba-84a4-45a7-8e3e-cfb1636bc8c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:47.159693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10280aba-84a4-45a7-8e3e-cfb1636bc8c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:47.160312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10280aba-84a4-45a7-8e3e-cfb1636bc8c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:47.166559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10280aba-84a4-45a7-8e3e-cfb1636bc8c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:47.166559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10280aba-84a4-45a7-8e3e-cfb1636bc8c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:47.166559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10280aba-84a4-45a7-8e3e-cfb1636bc8c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:47.166559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10280aba-84a4-45a7-8e3e-cfb1636bc8c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:47.166559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=59 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:47.231292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-10280aba-84a4-45a7-8e3e-cfb1636bc8c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:47.239971 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-10280aba-84a4-45a7-8e3e-cfb1636bc8c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1319 microversion: 2.1 time: 0.094073 Oct 04 21:52:47.240558 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3332/6641] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:47 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1319 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:48.264332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ba03d882-15da-4bf9-bd48-5cd2999dfe99 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:48.264951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ba03d882-15da-4bf9-bd48-5cd2999dfe99 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:48.273183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba03d882-15da-4bf9-bd48-5cd2999dfe99 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:48.273719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba03d882-15da-4bf9-bd48-5cd2999dfe99 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:48.274164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba03d882-15da-4bf9-bd48-5cd2999dfe99 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:48.274872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba03d882-15da-4bf9-bd48-5cd2999dfe99 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:48.275334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba03d882-15da-4bf9-bd48-5cd2999dfe99 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:48.275841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba03d882-15da-4bf9-bd48-5cd2999dfe99 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:48.468693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ba03d882-15da-4bf9-bd48-5cd2999dfe99 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:48.480434 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ba03d882-15da-4bf9-bd48-5cd2999dfe99 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1392 microversion: 2.1 time: 0.216741 Oct 04 21:52:48.480434 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3310/6642] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:48 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1392 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:49.343159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-cf6b4e83-287b-4cd5-b4d6-8b695c04deec req-1dfe65d5-ae8b-4cd3-b577-29fd7f1128a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfacd991-cd91-4d81-a17f-66ecf0b3cdf1", "tag": "17a07455-7c52-4b8d-8a15-7468dbdf44b0"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:49.354249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cf6b4e83-287b-4cd5-b4d6-8b695c04deec req-1dfe65d5-ae8b-4cd3-b577-29fd7f1128a9 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:49.354833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cf6b4e83-287b-4cd5-b4d6-8b695c04deec req-1dfe65d5-ae8b-4cd3-b577-29fd7f1128a9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:49.355505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cf6b4e83-287b-4cd5-b4d6-8b695c04deec req-1dfe65d5-ae8b-4cd3-b577-29fd7f1128a9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:49.367706 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-cf6b4e83-287b-4cd5-b4d6-8b695c04deec req-1dfe65d5-ae8b-4cd3-b577-29fd7f1128a9 service nova] Creating event network-changed:17a07455-7c52-4b8d-8a15-7468dbdf44b0 for instance bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 on n-h2-860282-1 Oct 04 21:52:49.374123 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-cf6b4e83-287b-4cd5-b4d6-8b695c04deec req-1dfe65d5-ae8b-4cd3-b577-29fd7f1128a9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035579 Oct 04 21:52:49.375243 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3333/6643] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:49.500986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-65c2b7f6-1c75-465d-9b1c-3946436b4895 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:49.501787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-65c2b7f6-1c75-465d-9b1c-3946436b4895 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:49.508960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65c2b7f6-1c75-465d-9b1c-3946436b4895 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:49.509471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65c2b7f6-1c75-465d-9b1c-3946436b4895 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:49.510112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65c2b7f6-1c75-465d-9b1c-3946436b4895 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:49.511827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65c2b7f6-1c75-465d-9b1c-3946436b4895 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:49.512436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65c2b7f6-1c75-465d-9b1c-3946436b4895 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:49.512874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65c2b7f6-1c75-465d-9b1c-3946436b4895 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:49.753158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-65c2b7f6-1c75-465d-9b1c-3946436b4895 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:49.762114 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-65c2b7f6-1c75-465d-9b1c-3946436b4895 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1392 microversion: 2.1 time: 0.265152 Oct 04 21:52:49.762878 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3311/6644] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:49 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1392 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:50.789669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-df68af56-d9bf-4cb1-b64a-6b481de43d2a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:50.790314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-df68af56-d9bf-4cb1-b64a-6b481de43d2a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:50.796526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df68af56-d9bf-4cb1-b64a-6b481de43d2a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:50.797026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df68af56-d9bf-4cb1-b64a-6b481de43d2a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:50.797511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df68af56-d9bf-4cb1-b64a-6b481de43d2a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:50.798217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df68af56-d9bf-4cb1-b64a-6b481de43d2a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:50.798693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df68af56-d9bf-4cb1-b64a-6b481de43d2a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:50.799142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df68af56-d9bf-4cb1-b64a-6b481de43d2a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:50.934682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-df68af56-d9bf-4cb1-b64a-6b481de43d2a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:50.942503 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-df68af56-d9bf-4cb1-b64a-6b481de43d2a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1392 microversion: 2.1 time: 0.158153 Oct 04 21:52:50.943086 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3334/6645] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:50 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:51.966862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3f5d1850-c392-426c-90bd-32b3702e839e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:51.967485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3f5d1850-c392-426c-90bd-32b3702e839e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:51.970296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:51.975338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f5d1850-c392-426c-90bd-32b3702e839e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:51.975842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f5d1850-c392-426c-90bd-32b3702e839e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:51.976293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f5d1850-c392-426c-90bd-32b3702e839e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:51.977043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f5d1850-c392-426c-90bd-32b3702e839e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:51.977540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f5d1850-c392-426c-90bd-32b3702e839e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:51.978060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f5d1850-c392-426c-90bd-32b3702e839e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:52.119517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3f5d1850-c392-426c-90bd-32b3702e839e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:52.127464 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3f5d1850-c392-426c-90bd-32b3702e839e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1392 microversion: 2.1 time: 0.165450 Oct 04 21:52:52.128579 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3312/6646] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:51 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:53.151515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2a716d5c-ece7-4723-8a6c-e5612debe273 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:53.152440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2a716d5c-ece7-4723-8a6c-e5612debe273 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:53.159813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a716d5c-ece7-4723-8a6c-e5612debe273 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:53.160327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a716d5c-ece7-4723-8a6c-e5612debe273 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:53.160792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a716d5c-ece7-4723-8a6c-e5612debe273 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:53.161554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a716d5c-ece7-4723-8a6c-e5612debe273 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:53.162040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a716d5c-ece7-4723-8a6c-e5612debe273 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:53.162496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a716d5c-ece7-4723-8a6c-e5612debe273 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:53.305365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2a716d5c-ece7-4723-8a6c-e5612debe273 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:53.314087 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2a716d5c-ece7-4723-8a6c-e5612debe273 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1392 microversion: 2.1 time: 0.166416 Oct 04 21:52:53.314688 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3335/6647] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:53 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:54.337550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-022d0f2b-1931-4800-89fb-ea80bc8babd7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:54.338128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-022d0f2b-1931-4800-89fb-ea80bc8babd7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:54.345965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-022d0f2b-1931-4800-89fb-ea80bc8babd7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:54.346546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-022d0f2b-1931-4800-89fb-ea80bc8babd7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:54.347013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-022d0f2b-1931-4800-89fb-ea80bc8babd7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:54.347705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-022d0f2b-1931-4800-89fb-ea80bc8babd7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:54.348161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-022d0f2b-1931-4800-89fb-ea80bc8babd7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:54.348587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-022d0f2b-1931-4800-89fb-ea80bc8babd7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:54.488692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-022d0f2b-1931-4800-89fb-ea80bc8babd7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:54.496380 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-022d0f2b-1931-4800-89fb-ea80bc8babd7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1392 microversion: 2.1 time: 0.162984 Oct 04 21:52:54.496953 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3313/6648] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:54 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:55.209301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-2a768928-ea48-4cb9-b104-d40f3f6bf0e5 req-be5aacea-4ee5-4845-a9c7-14735ca4fe8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfacd991-cd91-4d81-a17f-66ecf0b3cdf1", "name": "network-vif-plugged", "status": "completed", "tag": "17a07455-7c52-4b8d-8a15-7468dbdf44b0"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:55.215363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:55.216066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:55.221302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2a768928-ea48-4cb9-b104-d40f3f6bf0e5 req-be5aacea-4ee5-4845-a9c7-14735ca4fe8b service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:55.221830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2a768928-ea48-4cb9-b104-d40f3f6bf0e5 req-be5aacea-4ee5-4845-a9c7-14735ca4fe8b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:55.222289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2a768928-ea48-4cb9-b104-d40f3f6bf0e5 req-be5aacea-4ee5-4845-a9c7-14735ca4fe8b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:55.235501 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-2a768928-ea48-4cb9-b104-d40f3f6bf0e5 req-be5aacea-4ee5-4845-a9c7-14735ca4fe8b service nova] Creating event network-vif-plugged:17a07455-7c52-4b8d-8a15-7468dbdf44b0 for instance bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 on n-h2-860282-1 Oct 04 21:52:55.238706 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-2a768928-ea48-4cb9-b104-d40f3f6bf0e5 req-be5aacea-4ee5-4845-a9c7-14735ca4fe8b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033187 Oct 04 21:52:55.239385 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3336/6649] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:55.519391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d6569856-1e9f-4922-bed3-65e995e15f5c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:55.520875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d6569856-1e9f-4922-bed3-65e995e15f5c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:55.522911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:55.528990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6569856-1e9f-4922-bed3-65e995e15f5c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:55.529806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6569856-1e9f-4922-bed3-65e995e15f5c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:55.530241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6569856-1e9f-4922-bed3-65e995e15f5c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:55.530949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6569856-1e9f-4922-bed3-65e995e15f5c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:55.531399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6569856-1e9f-4922-bed3-65e995e15f5c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:55.531999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6569856-1e9f-4922-bed3-65e995e15f5c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:55.670154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d6569856-1e9f-4922-bed3-65e995e15f5c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:55.678859 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d6569856-1e9f-4922-bed3-65e995e15f5c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1392 microversion: 2.1 time: 0.163585 Oct 04 21:52:55.679502 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3314/6650] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:55 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:56.705698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6413723b-9914-40ae-9ea0-781315cc3d78 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:56.706461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6413723b-9914-40ae-9ea0-781315cc3d78 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:56.713702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6413723b-9914-40ae-9ea0-781315cc3d78 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:56.714198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6413723b-9914-40ae-9ea0-781315cc3d78 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:56.714660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6413723b-9914-40ae-9ea0-781315cc3d78 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:56.715525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6413723b-9914-40ae-9ea0-781315cc3d78 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:56.716003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6413723b-9914-40ae-9ea0-781315cc3d78 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:56.716443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6413723b-9914-40ae-9ea0-781315cc3d78 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:56.852224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6413723b-9914-40ae-9ea0-781315cc3d78 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:56.860353 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6413723b-9914-40ae-9ea0-781315cc3d78 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1565 microversion: 2.1 time: 0.161254 Oct 04 21:52:56.860936 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3337/6651] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:56 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:56.885839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-38d754c7-9a83-4da3-a5a1-0071da7aaf24 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:56.886525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-38d754c7-9a83-4da3-a5a1-0071da7aaf24 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:56.889222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:56.895207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38d754c7-9a83-4da3-a5a1-0071da7aaf24 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:56.897489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38d754c7-9a83-4da3-a5a1-0071da7aaf24 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:56.897489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38d754c7-9a83-4da3-a5a1-0071da7aaf24 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:56.897489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38d754c7-9a83-4da3-a5a1-0071da7aaf24 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:56.897489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38d754c7-9a83-4da3-a5a1-0071da7aaf24 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:56.897985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38d754c7-9a83-4da3-a5a1-0071da7aaf24 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:57.036671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-38d754c7-9a83-4da3-a5a1-0071da7aaf24 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:57.045820 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-38d754c7-9a83-4da3-a5a1-0071da7aaf24 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1565 microversion: 2.1 time: 0.164523 Oct 04 21:52:57.046402 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3315/6652] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:56 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:59.580583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b8e6498e-a6f7-4132-91be-7addde36cfa5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:59.580583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b8e6498e-a6f7-4132-91be-7addde36cfa5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:59.582292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-4b17312a-75c1-42fb-8178-ef27458bb0f0 req-1f66d628-cc38-464e-87c1-89d0518a8ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfacd991-cd91-4d81-a17f-66ecf0b3cdf1", "tag": "17a07455-7c52-4b8d-8a15-7468dbdf44b0"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:59.587993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8e6498e-a6f7-4132-91be-7addde36cfa5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:59.588543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8e6498e-a6f7-4132-91be-7addde36cfa5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:59.589004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8e6498e-a6f7-4132-91be-7addde36cfa5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:59.590354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8e6498e-a6f7-4132-91be-7addde36cfa5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:59.590844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8e6498e-a6f7-4132-91be-7addde36cfa5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:59.591332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8e6498e-a6f7-4132-91be-7addde36cfa5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:59.594689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4b17312a-75c1-42fb-8178-ef27458bb0f0 req-1f66d628-cc38-464e-87c1-89d0518a8ef9 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:59.595251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4b17312a-75c1-42fb-8178-ef27458bb0f0 req-1f66d628-cc38-464e-87c1-89d0518a8ef9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:59.595731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4b17312a-75c1-42fb-8178-ef27458bb0f0 req-1f66d628-cc38-464e-87c1-89d0518a8ef9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:59.611607 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-4b17312a-75c1-42fb-8178-ef27458bb0f0 req-1f66d628-cc38-464e-87c1-89d0518a8ef9 service nova] Creating event network-changed:17a07455-7c52-4b8d-8a15-7468dbdf44b0 for instance bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 on n-h2-860282-1 Oct 04 21:52:59.616985 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-4b17312a-75c1-42fb-8178-ef27458bb0f0 req-1f66d628-cc38-464e-87c1-89d0518a8ef9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038433 Oct 04 21:52:59.620858 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3316/6653] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:52:59.818394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b8e6498e-a6f7-4132-91be-7addde36cfa5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:59.826673 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b8e6498e-a6f7-4132-91be-7addde36cfa5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1565 microversion: 2.1 time: 0.251384 Oct 04 21:52:59.827281 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3338/6654] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:59 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1565 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:25.134720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=9 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:25.135534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=61 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:25.139943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ab69acd4-8cc2-4e2f-9617-2b428ccdea19 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:25.142251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ab69acd4-8cc2-4e2f-9617-2b428ccdea19 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:25.148565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab69acd4-8cc2-4e2f-9617-2b428ccdea19 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:25.149450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab69acd4-8cc2-4e2f-9617-2b428ccdea19 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:25.149649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab69acd4-8cc2-4e2f-9617-2b428ccdea19 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:25.150429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab69acd4-8cc2-4e2f-9617-2b428ccdea19 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:25.150886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab69acd4-8cc2-4e2f-9617-2b428ccdea19 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:25.151316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab69acd4-8cc2-4e2f-9617-2b428ccdea19 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:25.205257 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ab69acd4-8cc2-4e2f-9617-2b428ccdea19 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1/action" status: 200 len: 24569 microversion: 2.1 time: 0.073154 Oct 04 21:53:25.205968 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3317/6655] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:53:25 2022] POST /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1/action => generated 24569 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:53:36.233790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-084b5df0-a557-478a-9eb4-55df272b6584 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:36.234412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-084b5df0-a557-478a-9eb4-55df272b6584 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:36.236667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=5 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:36.237343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=33 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:36.244301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-084b5df0-a557-478a-9eb4-55df272b6584 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:36.245015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-084b5df0-a557-478a-9eb4-55df272b6584 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:36.246672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-084b5df0-a557-478a-9eb4-55df272b6584 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:36.253792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-084b5df0-a557-478a-9eb4-55df272b6584 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:36.253792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-084b5df0-a557-478a-9eb4-55df272b6584 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:36.253792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-084b5df0-a557-478a-9eb4-55df272b6584 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:36.534498 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-084b5df0-a557-478a-9eb4-55df272b6584 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1834 microversion: 2.1 time: 0.305035 Oct 04 21:53:36.535426 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3339/6656] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:36 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1834 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:36.562455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-347daa7a-e338-4b96-beb2-482acf7e235b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:36.567679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-347daa7a-e338-4b96-beb2-482acf7e235b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:36.567679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:36.567679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:36.571463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-347daa7a-e338-4b96-beb2-482acf7e235b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:36.571951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-347daa7a-e338-4b96-beb2-482acf7e235b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:36.572435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-347daa7a-e338-4b96-beb2-482acf7e235b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:36.573135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-347daa7a-e338-4b96-beb2-482acf7e235b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:36.573629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-347daa7a-e338-4b96-beb2-482acf7e235b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:36.574142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-347daa7a-e338-4b96-beb2-482acf7e235b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:36.718068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-347daa7a-e338-4b96-beb2-482acf7e235b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:36.726229 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-347daa7a-e338-4b96-beb2-482acf7e235b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1683 microversion: 2.1 time: 0.169172 Oct 04 21:53:36.734053 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3318/6657] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:36 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:36.831362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f868b665-ab71-4afe-b02e-813fd0be11a1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:36.833582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f868b665-ab71-4afe-b02e-813fd0be11a1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:36.840266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f868b665-ab71-4afe-b02e-813fd0be11a1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:36.840770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f868b665-ab71-4afe-b02e-813fd0be11a1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:36.841467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f868b665-ab71-4afe-b02e-813fd0be11a1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:36.842679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f868b665-ab71-4afe-b02e-813fd0be11a1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:36.843141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f868b665-ab71-4afe-b02e-813fd0be11a1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:36.843589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f868b665-ab71-4afe-b02e-813fd0be11a1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:36.895852 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f868b665-ab71-4afe-b02e-813fd0be11a1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1/action" status: 200 len: 32643 microversion: 2.1 time: 0.068230 Oct 04 21:53:36.896559 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3340/6658] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:53:36 2022] POST /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1/action => generated 32643 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:53:37.053759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a62ad05f-60a4-4579-bce8-024ca7176cd6 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:37.054430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a62ad05f-60a4-4579-bce8-024ca7176cd6 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:37.061819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a62ad05f-60a4-4579-bce8-024ca7176cd6 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:37.062297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a62ad05f-60a4-4579-bce8-024ca7176cd6 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:37.062729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a62ad05f-60a4-4579-bce8-024ca7176cd6 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:37.063415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a62ad05f-60a4-4579-bce8-024ca7176cd6 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:37.063933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a62ad05f-60a4-4579-bce8-024ca7176cd6 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:37.064356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a62ad05f-60a4-4579-bce8-024ca7176cd6 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:37.103843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a62ad05f-60a4-4579-bce8-024ca7176cd6 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4a44252f3b2e4911a2dfa61c745bd31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3296ab8b6922491896e649bc2380c942', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:37.104483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a62ad05f-60a4-4579-bce8-024ca7176cd6 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] flavor_id is None. Assuming migration. {{(pid=122758) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 21:53:37.104924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a62ad05f-60a4-4579-bce8-024ca7176cd6 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122758) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:53:37.338538 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a62ad05f-60a4-4579-bce8-024ca7176cd6 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1/action" status: 202 len: 0 microversion: 2.1 time: 0.288559 Oct 04 21:53:37.339238 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3319/6659] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:53:37 2022] POST /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:53:37.349516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-39185471-7a76-4dce-b28e-6a2565fbbb7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:37.350415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-39185471-7a76-4dce-b28e-6a2565fbbb7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:37.358678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39185471-7a76-4dce-b28e-6a2565fbbb7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:37.359182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39185471-7a76-4dce-b28e-6a2565fbbb7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:37.359636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39185471-7a76-4dce-b28e-6a2565fbbb7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:37.360384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39185471-7a76-4dce-b28e-6a2565fbbb7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:37.360859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39185471-7a76-4dce-b28e-6a2565fbbb7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:37.361465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-39185471-7a76-4dce-b28e-6a2565fbbb7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:37.497579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-39185471-7a76-4dce-b28e-6a2565fbbb7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:37.505643 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-39185471-7a76-4dce-b28e-6a2565fbbb7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1692 microversion: 2.1 time: 0.161028 Oct 04 21:53:37.506508 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3341/6660] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:37 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:38.531855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6b977f7d-fc27-4520-bb57-ab314dd1e0ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:38.532519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6b977f7d-fc27-4520-bb57-ab314dd1e0ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:38.540168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b977f7d-fc27-4520-bb57-ab314dd1e0ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:38.540674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b977f7d-fc27-4520-bb57-ab314dd1e0ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:38.543362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b977f7d-fc27-4520-bb57-ab314dd1e0ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:38.543362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b977f7d-fc27-4520-bb57-ab314dd1e0ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:38.543362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b977f7d-fc27-4520-bb57-ab314dd1e0ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:38.543362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b977f7d-fc27-4520-bb57-ab314dd1e0ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:38.684011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6b977f7d-fc27-4520-bb57-ab314dd1e0ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:38.693299 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6b977f7d-fc27-4520-bb57-ab314dd1e0ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1692 microversion: 2.1 time: 0.167212 Oct 04 21:53:38.693855 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3320/6661] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:38 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:39.718684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ae6f9fd8-6963-4aa9-9dc5-560390f7fa57 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:39.719340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ae6f9fd8-6963-4aa9-9dc5-560390f7fa57 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:39.726625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae6f9fd8-6963-4aa9-9dc5-560390f7fa57 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:39.727128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae6f9fd8-6963-4aa9-9dc5-560390f7fa57 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:39.727583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae6f9fd8-6963-4aa9-9dc5-560390f7fa57 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:39.728300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae6f9fd8-6963-4aa9-9dc5-560390f7fa57 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:39.728771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae6f9fd8-6963-4aa9-9dc5-560390f7fa57 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:39.729215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae6f9fd8-6963-4aa9-9dc5-560390f7fa57 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:39.874820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ae6f9fd8-6963-4aa9-9dc5-560390f7fa57 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:39.880533 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ae6f9fd8-6963-4aa9-9dc5-560390f7fa57 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1692 microversion: 2.1 time: 0.166712 Oct 04 21:53:39.881115 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3342/6662] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:39 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:40.904962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c5823a94-2ce0-436c-8be2-1d83bee37042 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:40.905651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c5823a94-2ce0-436c-8be2-1d83bee37042 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:40.912439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5823a94-2ce0-436c-8be2-1d83bee37042 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:40.912917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5823a94-2ce0-436c-8be2-1d83bee37042 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:40.913362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5823a94-2ce0-436c-8be2-1d83bee37042 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:40.914083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5823a94-2ce0-436c-8be2-1d83bee37042 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:40.914547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5823a94-2ce0-436c-8be2-1d83bee37042 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:40.915011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c5823a94-2ce0-436c-8be2-1d83bee37042 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:41.051929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c5823a94-2ce0-436c-8be2-1d83bee37042 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:41.060047 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c5823a94-2ce0-436c-8be2-1d83bee37042 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1692 microversion: 2.1 time: 0.159203 Oct 04 21:53:41.062006 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3321/6663] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:40 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:42.084376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f53fd62c-e85e-48e3-8bac-4907191c8514 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:42.085004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f53fd62c-e85e-48e3-8bac-4907191c8514 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:42.092045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f53fd62c-e85e-48e3-8bac-4907191c8514 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:42.092547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f53fd62c-e85e-48e3-8bac-4907191c8514 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:42.093006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f53fd62c-e85e-48e3-8bac-4907191c8514 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:42.093742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f53fd62c-e85e-48e3-8bac-4907191c8514 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:42.094218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f53fd62c-e85e-48e3-8bac-4907191c8514 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:42.099439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f53fd62c-e85e-48e3-8bac-4907191c8514 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:42.228101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f53fd62c-e85e-48e3-8bac-4907191c8514 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:42.236066 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f53fd62c-e85e-48e3-8bac-4907191c8514 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1697 microversion: 2.1 time: 0.155660 Oct 04 21:53:42.236644 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3343/6664] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:42 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:43.260503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5c7f5e70-2dce-482a-bdc5-ba30738d88c2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:43.261121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5c7f5e70-2dce-482a-bdc5-ba30738d88c2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:43.268458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c7f5e70-2dce-482a-bdc5-ba30738d88c2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:43.268949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c7f5e70-2dce-482a-bdc5-ba30738d88c2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:43.269393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c7f5e70-2dce-482a-bdc5-ba30738d88c2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:43.270109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c7f5e70-2dce-482a-bdc5-ba30738d88c2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:43.270570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c7f5e70-2dce-482a-bdc5-ba30738d88c2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:43.271002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c7f5e70-2dce-482a-bdc5-ba30738d88c2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:43.407781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5c7f5e70-2dce-482a-bdc5-ba30738d88c2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:43.415581 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5c7f5e70-2dce-482a-bdc5-ba30738d88c2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1697 microversion: 2.1 time: 0.159038 Oct 04 21:53:43.416156 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3322/6665] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:43 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:44.439696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3ebde237-0656-4d81-918d-8cb9b11015ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:44.440369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3ebde237-0656-4d81-918d-8cb9b11015ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:44.447236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ebde237-0656-4d81-918d-8cb9b11015ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:44.447743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ebde237-0656-4d81-918d-8cb9b11015ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:44.448212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ebde237-0656-4d81-918d-8cb9b11015ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:44.448947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ebde237-0656-4d81-918d-8cb9b11015ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:44.449448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ebde237-0656-4d81-918d-8cb9b11015ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:44.449894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3ebde237-0656-4d81-918d-8cb9b11015ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:44.582457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3ebde237-0656-4d81-918d-8cb9b11015ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:44.590352 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3ebde237-0656-4d81-918d-8cb9b11015ec tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1697 microversion: 2.1 time: 0.155218 Oct 04 21:53:44.590953 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3344/6666] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:44 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:45.613727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b473c349-ee9c-4828-b73a-59b0558c8872 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:45.614382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b473c349-ee9c-4828-b73a-59b0558c8872 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:45.621579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b473c349-ee9c-4828-b73a-59b0558c8872 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:45.622065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b473c349-ee9c-4828-b73a-59b0558c8872 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:45.629913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b473c349-ee9c-4828-b73a-59b0558c8872 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:45.629913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b473c349-ee9c-4828-b73a-59b0558c8872 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:45.629913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b473c349-ee9c-4828-b73a-59b0558c8872 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:45.629913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b473c349-ee9c-4828-b73a-59b0558c8872 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:45.760495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b473c349-ee9c-4828-b73a-59b0558c8872 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:45.768751 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b473c349-ee9c-4828-b73a-59b0558c8872 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1697 microversion: 2.1 time: 0.159215 Oct 04 21:53:45.769318 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3323/6667] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:45 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:46.793514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-202ce23f-30cc-4eba-a5cb-7a187499fada tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:46.794161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-202ce23f-30cc-4eba-a5cb-7a187499fada tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:46.801088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-202ce23f-30cc-4eba-a5cb-7a187499fada tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:46.801655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-202ce23f-30cc-4eba-a5cb-7a187499fada tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:46.802101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-202ce23f-30cc-4eba-a5cb-7a187499fada tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:46.802827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-202ce23f-30cc-4eba-a5cb-7a187499fada tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:46.803309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-202ce23f-30cc-4eba-a5cb-7a187499fada tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:46.803763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-202ce23f-30cc-4eba-a5cb-7a187499fada tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:46.958708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-202ce23f-30cc-4eba-a5cb-7a187499fada tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:46.970624 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-202ce23f-30cc-4eba-a5cb-7a187499fada tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1697 microversion: 2.1 time: 0.181118 Oct 04 21:53:46.971300 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3345/6668] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:46 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1697 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:48.004322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-14803475-e4f1-4cf7-9d3e-8d57173e5791 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:48.005004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-14803475-e4f1-4cf7-9d3e-8d57173e5791 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:48.012596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14803475-e4f1-4cf7-9d3e-8d57173e5791 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:48.013106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14803475-e4f1-4cf7-9d3e-8d57173e5791 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:48.013614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14803475-e4f1-4cf7-9d3e-8d57173e5791 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:48.014319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14803475-e4f1-4cf7-9d3e-8d57173e5791 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:48.014780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14803475-e4f1-4cf7-9d3e-8d57173e5791 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:48.015210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-14803475-e4f1-4cf7-9d3e-8d57173e5791 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:48.165115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-14803475-e4f1-4cf7-9d3e-8d57173e5791 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:48.173510 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-14803475-e4f1-4cf7-9d3e-8d57173e5791 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1697 microversion: 2.1 time: 0.175211 Oct 04 21:53:48.174099 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3324/6669] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:47 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:49.196524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8f9d6ea6-0b6e-417c-9710-a892e9e46e58 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:49.197092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8f9d6ea6-0b6e-417c-9710-a892e9e46e58 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:49.205442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f9d6ea6-0b6e-417c-9710-a892e9e46e58 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:49.206908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f9d6ea6-0b6e-417c-9710-a892e9e46e58 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:49.206908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f9d6ea6-0b6e-417c-9710-a892e9e46e58 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:49.207259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f9d6ea6-0b6e-417c-9710-a892e9e46e58 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:49.207737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f9d6ea6-0b6e-417c-9710-a892e9e46e58 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:49.208212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f9d6ea6-0b6e-417c-9710-a892e9e46e58 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:49.350214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8f9d6ea6-0b6e-417c-9710-a892e9e46e58 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:49.358476 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8f9d6ea6-0b6e-417c-9710-a892e9e46e58 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1697 microversion: 2.1 time: 0.165920 Oct 04 21:53:49.360241 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3346/6670] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:49 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:50.383465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9c03e042-0a75-43c9-accd-f0f8ddb67995 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:50.384094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9c03e042-0a75-43c9-accd-f0f8ddb67995 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:50.391103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c03e042-0a75-43c9-accd-f0f8ddb67995 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:50.391687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c03e042-0a75-43c9-accd-f0f8ddb67995 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:50.392339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c03e042-0a75-43c9-accd-f0f8ddb67995 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:50.393199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c03e042-0a75-43c9-accd-f0f8ddb67995 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:50.393754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c03e042-0a75-43c9-accd-f0f8ddb67995 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:50.394274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c03e042-0a75-43c9-accd-f0f8ddb67995 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:50.529350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9c03e042-0a75-43c9-accd-f0f8ddb67995 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:50.537739 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9c03e042-0a75-43c9-accd-f0f8ddb67995 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1697 microversion: 2.1 time: 0.158304 Oct 04 21:53:50.538329 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3325/6671] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:50 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:51.562155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9520f81c-ef23-4770-ae0e-444093ed36c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:51.562895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9520f81c-ef23-4770-ae0e-444093ed36c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:51.571619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9520f81c-ef23-4770-ae0e-444093ed36c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:51.572178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9520f81c-ef23-4770-ae0e-444093ed36c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:51.572647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9520f81c-ef23-4770-ae0e-444093ed36c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:51.573376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9520f81c-ef23-4770-ae0e-444093ed36c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:51.573888 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9520f81c-ef23-4770-ae0e-444093ed36c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:51.574339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9520f81c-ef23-4770-ae0e-444093ed36c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:51.713090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9520f81c-ef23-4770-ae0e-444093ed36c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:51.721940 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9520f81c-ef23-4770-ae0e-444093ed36c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1697 microversion: 2.1 time: 0.163869 Oct 04 21:53:51.722521 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3347/6672] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:51 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:52.744994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-707d4ae8-6f31-4848-8c93-fbf9256e5800 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:52.745725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-707d4ae8-6f31-4848-8c93-fbf9256e5800 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:52.753483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-707d4ae8-6f31-4848-8c93-fbf9256e5800 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:52.753974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-707d4ae8-6f31-4848-8c93-fbf9256e5800 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:52.754411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-707d4ae8-6f31-4848-8c93-fbf9256e5800 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:52.755116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-707d4ae8-6f31-4848-8c93-fbf9256e5800 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:52.755570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-707d4ae8-6f31-4848-8c93-fbf9256e5800 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:52.755995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-707d4ae8-6f31-4848-8c93-fbf9256e5800 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:52.895833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-707d4ae8-6f31-4848-8c93-fbf9256e5800 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:52.904190 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-707d4ae8-6f31-4848-8c93-fbf9256e5800 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1697 microversion: 2.1 time: 0.163097 Oct 04 21:53:52.904796 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3326/6673] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:52 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:53.537606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b7fdbc90-9f86-442a-907d-9bd439dfd955 req-1b62c5eb-643a-447f-a294-d4c8a2e8fdc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e278edd-efe1-45d2-834e-99ce935f427e", "tag": "e4a559ca-ebbe-4d6b-a7cf-3784058ca02e"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:53.542530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e23e0593-0c81-4f5b-bce4-0c520c2b12dd tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:53.543318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e23e0593-0c81-4f5b-bce4-0c520c2b12dd tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:53.549508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e23e0593-0c81-4f5b-bce4-0c520c2b12dd tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:53.550007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e23e0593-0c81-4f5b-bce4-0c520c2b12dd tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:53.550443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e23e0593-0c81-4f5b-bce4-0c520c2b12dd tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:53.551144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e23e0593-0c81-4f5b-bce4-0c520c2b12dd tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:53.551293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b7fdbc90-9f86-442a-907d-9bd439dfd955 req-1b62c5eb-643a-447f-a294-d4c8a2e8fdc3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:53.551595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e23e0593-0c81-4f5b-bce4-0c520c2b12dd tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:53.552022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e23e0593-0c81-4f5b-bce4-0c520c2b12dd tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:53.552419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b7fdbc90-9f86-442a-907d-9bd439dfd955 req-1b62c5eb-643a-447f-a294-d4c8a2e8fdc3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:53.553077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b7fdbc90-9f86-442a-907d-9bd439dfd955 req-1b62c5eb-643a-447f-a294-d4c8a2e8fdc3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:53.565726 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b7fdbc90-9f86-442a-907d-9bd439dfd955 req-1b62c5eb-643a-447f-a294-d4c8a2e8fdc3 service nova] Creating event network-changed:e4a559ca-ebbe-4d6b-a7cf-3784058ca02e for instance 4e278edd-efe1-45d2-834e-99ce935f427e on n-h1-860282-1 Oct 04 21:53:53.571648 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b7fdbc90-9f86-442a-907d-9bd439dfd955 req-1b62c5eb-643a-447f-a294-d4c8a2e8fdc3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038619 Oct 04 21:53:53.572526 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3348/6674] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:53.582842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e23e0593-0c81-4f5b-bce4-0c520c2b12dd tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:53:53.928867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-45cbc194-2222-4f12-ab32-8f311de4c23e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:53.929623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-45cbc194-2222-4f12-ab32-8f311de4c23e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:53.936212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45cbc194-2222-4f12-ab32-8f311de4c23e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:53.936997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45cbc194-2222-4f12-ab32-8f311de4c23e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:53.937164 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e23e0593-0c81-4f5b-bce4-0c520c2b12dd tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 204 len: 0 microversion: 2.1 time: 0.396554 Oct 04 21:53:53.938175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45cbc194-2222-4f12-ab32-8f311de4c23e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:53.938984 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3327/6675] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:53:53 2022] DELETE /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:53:53.942561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45cbc194-2222-4f12-ab32-8f311de4c23e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:53.943136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45cbc194-2222-4f12-ab32-8f311de4c23e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:53.943605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45cbc194-2222-4f12-ab32-8f311de4c23e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:53.952751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a97822b-ee14-4f84-98a4-46e6f56faae6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:53.954877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7a97822b-ee14-4f84-98a4-46e6f56faae6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:53.963371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a97822b-ee14-4f84-98a4-46e6f56faae6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:53.964234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a97822b-ee14-4f84-98a4-46e6f56faae6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:53.964939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a97822b-ee14-4f84-98a4-46e6f56faae6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:53.966112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a97822b-ee14-4f84-98a4-46e6f56faae6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:53.966720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a97822b-ee14-4f84-98a4-46e6f56faae6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:53.967302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a97822b-ee14-4f84-98a4-46e6f56faae6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:54.164593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-45cbc194-2222-4f12-ab32-8f311de4c23e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:54.172961 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-45cbc194-2222-4f12-ab32-8f311de4c23e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1697 microversion: 2.1 time: 0.248313 Oct 04 21:53:54.175404 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3349/6676] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:53 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1697 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:54.178624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7a97822b-ee14-4f84-98a4-46e6f56faae6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:54.186464 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7a97822b-ee14-4f84-98a4-46e6f56faae6 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1583 microversion: 2.1 time: 0.240972 Oct 04 21:53:54.187227 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3328/6677] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:53 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1583 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:55.197235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-970af37d-3ea6-4282-882f-acef52740766 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:55.197897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-970af37d-3ea6-4282-882f-acef52740766 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:55.206138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-970af37d-3ea6-4282-882f-acef52740766 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:55.206370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-970af37d-3ea6-4282-882f-acef52740766 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:55.206701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-970af37d-3ea6-4282-882f-acef52740766 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:55.207430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-970af37d-3ea6-4282-882f-acef52740766 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:55.207906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-970af37d-3ea6-4282-882f-acef52740766 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:55.208355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-970af37d-3ea6-4282-882f-acef52740766 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:55.210722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0811b478-092a-4e8a-9215-88547acdd389 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:55.211341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0811b478-092a-4e8a-9215-88547acdd389 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:55.217605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0811b478-092a-4e8a-9215-88547acdd389 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:55.218032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0811b478-092a-4e8a-9215-88547acdd389 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:55.218469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0811b478-092a-4e8a-9215-88547acdd389 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:55.219288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0811b478-092a-4e8a-9215-88547acdd389 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:55.219686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0811b478-092a-4e8a-9215-88547acdd389 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:55.220247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0811b478-092a-4e8a-9215-88547acdd389 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:55.417594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-970af37d-3ea6-4282-882f-acef52740766 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:55.421373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0811b478-092a-4e8a-9215-88547acdd389 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:55.426095 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-970af37d-3ea6-4282-882f-acef52740766 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1697 microversion: 2.1 time: 0.232777 Oct 04 21:53:55.426892 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3350/6678] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:55 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1697 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:55.429789 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0811b478-092a-4e8a-9215-88547acdd389 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1583 microversion: 2.1 time: 0.223788 Oct 04 21:53:55.430702 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3329/6679] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:55 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1583 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:56.020195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-5c3930cf-6697-432c-a160-8eeb20cabb8f req-185884db-3a45-47e1-8e3d-d3780dfea9bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e278edd-efe1-45d2-834e-99ce935f427e", "name": "network-vif-deleted", "tag": "e4a559ca-ebbe-4d6b-a7cf-3784058ca02e"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:56.030284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-5c3930cf-6697-432c-a160-8eeb20cabb8f req-185884db-3a45-47e1-8e3d-d3780dfea9bf service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:56.030792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-5c3930cf-6697-432c-a160-8eeb20cabb8f req-185884db-3a45-47e1-8e3d-d3780dfea9bf service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:56.031255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-5c3930cf-6697-432c-a160-8eeb20cabb8f req-185884db-3a45-47e1-8e3d-d3780dfea9bf service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:56.045892 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-5c3930cf-6697-432c-a160-8eeb20cabb8f req-185884db-3a45-47e1-8e3d-d3780dfea9bf service nova] Creating event network-vif-deleted:e4a559ca-ebbe-4d6b-a7cf-3784058ca02e for instance 4e278edd-efe1-45d2-834e-99ce935f427e on n-h1-860282-1 Oct 04 21:53:56.051585 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-5c3930cf-6697-432c-a160-8eeb20cabb8f req-185884db-3a45-47e1-8e3d-d3780dfea9bf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035775 Oct 04 21:53:56.052222 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3351/6680] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:56.450022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e4adb530-33d0-4690-aee3-e377a6f76b7e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:56.450636 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e4adb530-33d0-4690-aee3-e377a6f76b7e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:56.454082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eaaa8996-97fd-42dd-a081-d6cbbd68e1c9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:56.455468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eaaa8996-97fd-42dd-a081-d6cbbd68e1c9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:56.458987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4adb530-33d0-4690-aee3-e377a6f76b7e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:56.459488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4adb530-33d0-4690-aee3-e377a6f76b7e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:56.459930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4adb530-33d0-4690-aee3-e377a6f76b7e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:56.460631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4adb530-33d0-4690-aee3-e377a6f76b7e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:56.461090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4adb530-33d0-4690-aee3-e377a6f76b7e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:56.461546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4adb530-33d0-4690-aee3-e377a6f76b7e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:56.461988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eaaa8996-97fd-42dd-a081-d6cbbd68e1c9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:56.462497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eaaa8996-97fd-42dd-a081-d6cbbd68e1c9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:56.462953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eaaa8996-97fd-42dd-a081-d6cbbd68e1c9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:56.463731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eaaa8996-97fd-42dd-a081-d6cbbd68e1c9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:56.464210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eaaa8996-97fd-42dd-a081-d6cbbd68e1c9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:56.464659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eaaa8996-97fd-42dd-a081-d6cbbd68e1c9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:56.559162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eaaa8996-97fd-42dd-a081-d6cbbd68e1c9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:56.568065 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eaaa8996-97fd-42dd-a081-d6cbbd68e1c9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1229 microversion: 2.1 time: 0.118988 Oct 04 21:53:56.568659 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3352/6681] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:56 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1229 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:56.628871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e4adb530-33d0-4690-aee3-e377a6f76b7e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:56.636788 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e4adb530-33d0-4690-aee3-e377a6f76b7e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1697 microversion: 2.1 time: 0.190996 Oct 04 21:53:56.637369 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3330/6682] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:56 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1697 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:57.591363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-961ddccd-3d2c-456f-8506-d430455c4202 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:57.591985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-961ddccd-3d2c-456f-8506-d430455c4202 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:57.599041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-961ddccd-3d2c-456f-8506-d430455c4202 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:57.599543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-961ddccd-3d2c-456f-8506-d430455c4202 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:57.599993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-961ddccd-3d2c-456f-8506-d430455c4202 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:57.600699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-961ddccd-3d2c-456f-8506-d430455c4202 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:57.601170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-961ddccd-3d2c-456f-8506-d430455c4202 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:57.601637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-961ddccd-3d2c-456f-8506-d430455c4202 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:57.659684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-68768dae-c3e9-47e8-aaaa-4d260bd24d30 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:57.660302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-68768dae-c3e9-47e8-aaaa-4d260bd24d30 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:57.665063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-961ddccd-3d2c-456f-8506-d430455c4202 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:57.666993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68768dae-c3e9-47e8-aaaa-4d260bd24d30 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:57.667486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68768dae-c3e9-47e8-aaaa-4d260bd24d30 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:57.667932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68768dae-c3e9-47e8-aaaa-4d260bd24d30 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:57.668639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68768dae-c3e9-47e8-aaaa-4d260bd24d30 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:57.669096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68768dae-c3e9-47e8-aaaa-4d260bd24d30 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:57.669548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-68768dae-c3e9-47e8-aaaa-4d260bd24d30 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:57.674150 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-961ddccd-3d2c-456f-8506-d430455c4202 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1229 microversion: 2.1 time: 0.086572 Oct 04 21:53:57.674322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:57.675460 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3353/6683] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:57 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1229 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:57.809183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-68768dae-c3e9-47e8-aaaa-4d260bd24d30 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:57.817373 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-68768dae-c3e9-47e8-aaaa-4d260bd24d30 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1697 microversion: 2.1 time: 0.161671 Oct 04 21:53:57.817985 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3331/6684] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:57 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:58.698160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9c800d22-e378-4e08-b949-6fa3ac511115 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:58.698792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9c800d22-e378-4e08-b949-6fa3ac511115 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:58.706553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c800d22-e378-4e08-b949-6fa3ac511115 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:58.707075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c800d22-e378-4e08-b949-6fa3ac511115 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:58.707993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c800d22-e378-4e08-b949-6fa3ac511115 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:58.709882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c800d22-e378-4e08-b949-6fa3ac511115 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:58.710387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c800d22-e378-4e08-b949-6fa3ac511115 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:58.710847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c800d22-e378-4e08-b949-6fa3ac511115 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:58.780176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9c800d22-e378-4e08-b949-6fa3ac511115 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:58.788717 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9c800d22-e378-4e08-b949-6fa3ac511115 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1229 microversion: 2.1 time: 0.094445 Oct 04 21:53:58.789367 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3354/6685] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:58 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:58.842984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-92a1a391-5967-4d86-b2dd-f3da344046e3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:58.844317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-92a1a391-5967-4d86-b2dd-f3da344046e3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:58.851156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92a1a391-5967-4d86-b2dd-f3da344046e3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:58.851722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92a1a391-5967-4d86-b2dd-f3da344046e3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:58.852315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92a1a391-5967-4d86-b2dd-f3da344046e3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:58.853073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92a1a391-5967-4d86-b2dd-f3da344046e3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:58.853610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92a1a391-5967-4d86-b2dd-f3da344046e3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:58.854863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-92a1a391-5967-4d86-b2dd-f3da344046e3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:59.000506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-92a1a391-5967-4d86-b2dd-f3da344046e3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:59.013493 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-92a1a391-5967-4d86-b2dd-f3da344046e3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1697 microversion: 2.1 time: 0.175682 Oct 04 21:53:59.014170 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3332/6686] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:58 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:59.536676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-41e20931-8b60-4d09-ad8b-656472500af3 req-95a4bf0e-b748-443e-a504-877d1819b15d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfacd991-cd91-4d81-a17f-66ecf0b3cdf1", "name": "network-vif-unplugged", "status": "completed", "tag": "17a07455-7c52-4b8d-8a15-7468dbdf44b0"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:59.550247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-41e20931-8b60-4d09-ad8b-656472500af3 req-95a4bf0e-b748-443e-a504-877d1819b15d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:59.550903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-41e20931-8b60-4d09-ad8b-656472500af3 req-95a4bf0e-b748-443e-a504-877d1819b15d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:59.551430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-41e20931-8b60-4d09-ad8b-656472500af3 req-95a4bf0e-b748-443e-a504-877d1819b15d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:59.565271 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-41e20931-8b60-4d09-ad8b-656472500af3 req-95a4bf0e-b748-443e-a504-877d1819b15d service nova] Creating event network-vif-unplugged:17a07455-7c52-4b8d-8a15-7468dbdf44b0 for instance bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 on n-h1-860282-1 Oct 04 21:53:59.571114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [req-41e20931-8b60-4d09-ad8b-656472500af3 req-95a4bf0e-b748-443e-a504-877d1819b15d service nova] Instance bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122757) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:53:59.583088 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-41e20931-8b60-4d09-ad8b-656472500af3 req-95a4bf0e-b748-443e-a504-877d1819b15d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051546 Oct 04 21:53:59.583973 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3355/6687] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:59.811993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-12dc6a28-a8e4-4d07-9258-243a0b1387d7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:59.812700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-12dc6a28-a8e4-4d07-9258-243a0b1387d7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:59.819230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12dc6a28-a8e4-4d07-9258-243a0b1387d7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:59.819867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12dc6a28-a8e4-4d07-9258-243a0b1387d7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:59.820411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12dc6a28-a8e4-4d07-9258-243a0b1387d7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:59.821220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12dc6a28-a8e4-4d07-9258-243a0b1387d7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:59.821824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12dc6a28-a8e4-4d07-9258-243a0b1387d7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:59.822460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12dc6a28-a8e4-4d07-9258-243a0b1387d7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:59.895568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-12dc6a28-a8e4-4d07-9258-243a0b1387d7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:59.904553 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-12dc6a28-a8e4-4d07-9258-243a0b1387d7 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1229 microversion: 2.1 time: 0.096858 Oct 04 21:53:59.905275 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3333/6688] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:59 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:54:00.039514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c5c6df85-d93a-4de7-ae80-387a3a0b495a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:00.040276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c5c6df85-d93a-4de7-ae80-387a3a0b495a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:00.047881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5c6df85-d93a-4de7-ae80-387a3a0b495a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:00.048557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5c6df85-d93a-4de7-ae80-387a3a0b495a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:00.049107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5c6df85-d93a-4de7-ae80-387a3a0b495a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:00.049875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5c6df85-d93a-4de7-ae80-387a3a0b495a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:00.050565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5c6df85-d93a-4de7-ae80-387a3a0b495a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:00.051021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5c6df85-d93a-4de7-ae80-387a3a0b495a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:00.194659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c5c6df85-d93a-4de7-ae80-387a3a0b495a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:00.202777 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c5c6df85-d93a-4de7-ae80-387a3a0b495a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1696 microversion: 2.1 time: 0.167865 Oct 04 21:54:00.203388 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3356/6689] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:00 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:00.929140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7d942cc4-1649-4f56-a388-3098215c4827 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:00.933376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7d942cc4-1649-4f56-a388-3098215c4827 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:00.937272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d942cc4-1649-4f56-a388-3098215c4827 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:00.937992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d942cc4-1649-4f56-a388-3098215c4827 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:00.938631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d942cc4-1649-4f56-a388-3098215c4827 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:00.940251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d942cc4-1649-4f56-a388-3098215c4827 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:00.940758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d942cc4-1649-4f56-a388-3098215c4827 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:00.941235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d942cc4-1649-4f56-a388-3098215c4827 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:00.973388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d942cc4-1649-4f56-a388-3098215c4827 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:00.973901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d942cc4-1649-4f56-a388-3098215c4827 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:00.974339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d942cc4-1649-4f56-a388-3098215c4827 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:00.974799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-7d942cc4-1649-4f56-a388-3098215c4827 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lazy-loading 'fault' on Instance uuid 4e278edd-efe1-45d2-834e-99ce935f427e {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:54:01.017145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7d942cc4-1649-4f56-a388-3098215c4827 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06b098dc002471fa4a6f073f1d2f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc41b8b699f4c88a2c94ca7038e8b3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:01.028569 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7d942cc4-1649-4f56-a388-3098215c4827 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 200 len: 1234 microversion: 2.1 time: 0.099707 Oct 04 21:54:01.028569 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3334/6690] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:00 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 1234 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:54:01.227413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6cac28dd-9624-474c-8f41-e9a4be4f939d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:01.227987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6cac28dd-9624-474c-8f41-e9a4be4f939d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:01.234879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cac28dd-9624-474c-8f41-e9a4be4f939d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:01.235395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cac28dd-9624-474c-8f41-e9a4be4f939d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:01.236421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cac28dd-9624-474c-8f41-e9a4be4f939d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:01.237302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cac28dd-9624-474c-8f41-e9a4be4f939d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:01.237811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cac28dd-9624-474c-8f41-e9a4be4f939d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:01.238264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6cac28dd-9624-474c-8f41-e9a4be4f939d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:01.257173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=100 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:01.375298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6cac28dd-9624-474c-8f41-e9a4be4f939d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:01.383078 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6cac28dd-9624-474c-8f41-e9a4be4f939d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1696 microversion: 2.1 time: 0.159749 Oct 04 21:54:01.383844 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3357/6691] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:01 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:01.598901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-754c90e2-10d8-46ce-8595-ffdce3dfb21c req-7addf31b-d80b-4e11-a1fd-994cfec7c809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfacd991-cd91-4d81-a17f-66ecf0b3cdf1", "tag": "17a07455-7c52-4b8d-8a15-7468dbdf44b0"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:01.611840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-754c90e2-10d8-46ce-8595-ffdce3dfb21c req-7addf31b-d80b-4e11-a1fd-994cfec7c809 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:01.612763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-754c90e2-10d8-46ce-8595-ffdce3dfb21c req-7addf31b-d80b-4e11-a1fd-994cfec7c809 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:01.613445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-754c90e2-10d8-46ce-8595-ffdce3dfb21c req-7addf31b-d80b-4e11-a1fd-994cfec7c809 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:01.625385 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-754c90e2-10d8-46ce-8595-ffdce3dfb21c req-7addf31b-d80b-4e11-a1fd-994cfec7c809 service nova] Creating event network-changed:17a07455-7c52-4b8d-8a15-7468dbdf44b0 for instance bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 on n-h1-860282-1 Oct 04 21:54:01.630731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-754c90e2-10d8-46ce-8595-ffdce3dfb21c req-7addf31b-d80b-4e11-a1fd-994cfec7c809 service nova] Instance bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:54:01.641560 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-754c90e2-10d8-46ce-8595-ffdce3dfb21c req-7addf31b-d80b-4e11-a1fd-994cfec7c809 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047111 Oct 04 21:54:01.642732 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3335/6692] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:02.048237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f1dd8118-e198-4099-abb0-a3cd16477741 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:02.048966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f1dd8118-e198-4099-abb0-a3cd16477741 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] [instance: 4e278edd-efe1-45d2-834e-99ce935f427e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:02.055250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1dd8118-e198-4099-abb0-a3cd16477741 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.055760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1dd8118-e198-4099-abb0-a3cd16477741 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.056218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1dd8118-e198-4099-abb0-a3cd16477741 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:02.056939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1dd8118-e198-4099-abb0-a3cd16477741 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.057440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1dd8118-e198-4099-abb0-a3cd16477741 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.057896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f1dd8118-e198-4099-abb0-a3cd16477741 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:02.072164 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-f1dd8118-e198-4099-abb0-a3cd16477741 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] HTTP exception thrown: Instance 4e278edd-efe1-45d2-834e-99ce935f427e could not be found. Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f1dd8118-e198-4099-abb0-a3cd16477741 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Request method failure captured: Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e HTTP/1.1 Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKpOZOa9S4Nj3sOanvhXzmjOFQni7JdH_xMwmrZRozwfV2fOhepw97vVP-Yf654VoPwmeCtiawuDJpeF8S7Zed1lvDr4bOShHREztYSjM3LbAIi0IcuEnb5UVszWx8w0MwKOEFzSnGGcnon0x9qIvzGV2o-Rm-BM3lTee0-YSpDgw7w Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: ecc41b8b699f4c88a2c94ca7038e8b3a Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestVolumeBackupRestore-792019823 Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ecc41b8b699f4c88a2c94ca7038e8b3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ecc41b8b699f4c88a2c94ca7038e8b3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ecc41b8b699f4c88a2c94ca7038e8b3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ecc41b8b699f4c88a2c94ca7038e8b3a"}]}] Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestVolumeBackupRestore-792019823 Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: ecc41b8b699f4c88a2c94ca7038e8b3a Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestVolumeBackupRestore-792019823 Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestVolumeBackupRestore-792019823-project Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c06b098dc002471fa4a6f073f1d2f3a2 Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestVolumeBackupRestore-792019823-project Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 4e278edd-efe1-45d2-834e-99ce935f427e could not be found. Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '4e278edd-efe1-45d2-834e-99ce935f427e'} Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e278edd-efe1-45d2-834e-99ce935f427e could not be found. Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e278edd-efe1-45d2-834e-99ce935f427e could not be found. Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:02.073799 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:54:02.079315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:02.079315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:02.079315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:02.079315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:54:02.079315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:54:02.079315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e278edd-efe1-45d2-834e-99ce935f427e could not be found. Oct 04 21:54:02.079315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:54:02.079315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f1dd8118-e198-4099-abb0-a3cd16477741 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Returning 404 to user: Instance 4e278edd-efe1-45d2-834e-99ce935f427e could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:54:02.079315 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f1dd8118-e198-4099-abb0-a3cd16477741 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e" status: 404 len: 111 microversion: 2.1 time: 0.031016 Oct 04 21:54:02.079315 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3358/6693] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:02 2022] GET /compute/v2.1/servers/4e278edd-efe1-45d2-834e-99ce935f427e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:54:02.305993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ae4467f8-1d08-44d1-83c2-b6f4b8eae0f9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] Calling method '.version_select at 0x7f578adfcb80>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:02.387173 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ae4467f8-1d08-44d1-83c2-b6f4b8eae0f9 tempest-TestVolumeBackupRestore-792019823 tempest-TestVolumeBackupRestore-792019823-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-314440794" status: 202 len: 0 microversion: 2.1 time: 0.086311 Oct 04 21:54:02.387771 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3336/6694] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Oct 4 21:54:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-314440794 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:54:02.407143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-72460dfd-db6a-4341-95bc-9131c6fc76fb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:02.407997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-72460dfd-db6a-4341-95bc-9131c6fc76fb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:02.415060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72460dfd-db6a-4341-95bc-9131c6fc76fb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.415596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72460dfd-db6a-4341-95bc-9131c6fc76fb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.416069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72460dfd-db6a-4341-95bc-9131c6fc76fb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:02.416770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72460dfd-db6a-4341-95bc-9131c6fc76fb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:02.417244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72460dfd-db6a-4341-95bc-9131c6fc76fb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:02.417715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72460dfd-db6a-4341-95bc-9131c6fc76fb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:02.562159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-72460dfd-db6a-4341-95bc-9131c6fc76fb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:02.569542 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-72460dfd-db6a-4341-95bc-9131c6fc76fb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1694 microversion: 2.1 time: 0.166494 Oct 04 21:54:02.570142 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3359/6695] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:02 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:03.600712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a21e4f7e-e1b1-4f54-906d-5888ef90d07b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:03.601517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a21e4f7e-e1b1-4f54-906d-5888ef90d07b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:03.609948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a21e4f7e-e1b1-4f54-906d-5888ef90d07b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:03.610584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a21e4f7e-e1b1-4f54-906d-5888ef90d07b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:03.611050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a21e4f7e-e1b1-4f54-906d-5888ef90d07b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:03.611801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a21e4f7e-e1b1-4f54-906d-5888ef90d07b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:03.612272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a21e4f7e-e1b1-4f54-906d-5888ef90d07b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:03.612900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a21e4f7e-e1b1-4f54-906d-5888ef90d07b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:04.111590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a21e4f7e-e1b1-4f54-906d-5888ef90d07b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:04.125470 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a21e4f7e-e1b1-4f54-906d-5888ef90d07b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1691 microversion: 2.1 time: 0.530521 Oct 04 21:54:04.126736 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3337/6696] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:03 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1691 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:04.151187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9c59c869-a5cd-4362-b6bb-e8f4016f16f0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:04.151792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9c59c869-a5cd-4362-b6bb-e8f4016f16f0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:04.159312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c59c869-a5cd-4362-b6bb-e8f4016f16f0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:04.159841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c59c869-a5cd-4362-b6bb-e8f4016f16f0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:04.160308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c59c869-a5cd-4362-b6bb-e8f4016f16f0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:04.161064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c59c869-a5cd-4362-b6bb-e8f4016f16f0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:04.161555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c59c869-a5cd-4362-b6bb-e8f4016f16f0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:04.164217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c59c869-a5cd-4362-b6bb-e8f4016f16f0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:04.403241 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9c59c869-a5cd-4362-b6bb-e8f4016f16f0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1/action" status: 204 len: 0 microversion: 2.1 time: 0.255595 Oct 04 21:54:04.404103 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3360/6697] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:54:04 2022] POST /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1/action => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:54:04.412920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1cb3f1d2-d982-42ac-bf88-92702e156c20 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:04.414499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1cb3f1d2-d982-42ac-bf88-92702e156c20 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:04.422671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cb3f1d2-d982-42ac-bf88-92702e156c20 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:04.423998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cb3f1d2-d982-42ac-bf88-92702e156c20 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:04.425309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cb3f1d2-d982-42ac-bf88-92702e156c20 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:04.426615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cb3f1d2-d982-42ac-bf88-92702e156c20 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:04.427299 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cb3f1d2-d982-42ac-bf88-92702e156c20 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:04.427954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cb3f1d2-d982-42ac-bf88-92702e156c20 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:04.597046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1cb3f1d2-d982-42ac-bf88-92702e156c20 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:04.608189 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1cb3f1d2-d982-42ac-bf88-92702e156c20 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1691 microversion: 2.1 time: 0.199060 Oct 04 21:54:04.627548 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3338/6698] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:04 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1691 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:04.973890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-03d717e0-db4e-453b-a8b0-90ca1040815c req-7ff44891-daba-4067-b798-d05e3c74dcd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfacd991-cd91-4d81-a17f-66ecf0b3cdf1", "name": "network-vif-plugged", "status": "completed", "tag": "17a07455-7c52-4b8d-8a15-7468dbdf44b0"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:04.988311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-03d717e0-db4e-453b-a8b0-90ca1040815c req-7ff44891-daba-4067-b798-d05e3c74dcd3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:04.990284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-03d717e0-db4e-453b-a8b0-90ca1040815c req-7ff44891-daba-4067-b798-d05e3c74dcd3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:04.991020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-03d717e0-db4e-453b-a8b0-90ca1040815c req-7ff44891-daba-4067-b798-d05e3c74dcd3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:05.012464 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-03d717e0-db4e-453b-a8b0-90ca1040815c req-7ff44891-daba-4067-b798-d05e3c74dcd3 service nova] Creating event network-vif-plugged:17a07455-7c52-4b8d-8a15-7468dbdf44b0 for instance bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 on n-h1-860282-1 Oct 04 21:54:05.020224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [req-03d717e0-db4e-453b-a8b0-90ca1040815c req-7ff44891-daba-4067-b798-d05e3c74dcd3 service nova] Instance bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122757) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:54:05.037719 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-03d717e0-db4e-453b-a8b0-90ca1040815c req-7ff44891-daba-4067-b798-d05e3c74dcd3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143031 Oct 04 21:54:05.039127 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3361/6699] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:05.653362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dfacddc8-9c5f-4aaa-a82e-ea177740137c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:05.654295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dfacddc8-9c5f-4aaa-a82e-ea177740137c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:05.662234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfacddc8-9c5f-4aaa-a82e-ea177740137c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:05.662896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfacddc8-9c5f-4aaa-a82e-ea177740137c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:05.663452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfacddc8-9c5f-4aaa-a82e-ea177740137c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:05.664321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfacddc8-9c5f-4aaa-a82e-ea177740137c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:05.665513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfacddc8-9c5f-4aaa-a82e-ea177740137c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:05.666125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfacddc8-9c5f-4aaa-a82e-ea177740137c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:05.844804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dfacddc8-9c5f-4aaa-a82e-ea177740137c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:05.853736 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dfacddc8-9c5f-4aaa-a82e-ea177740137c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1691 microversion: 2.1 time: 0.205030 Oct 04 21:54:05.871385 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3339/6700] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:05 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1691 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:06.879541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-27c7b35c-9bbf-4b71-8469-b3d70754ebbb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:06.880430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-27c7b35c-9bbf-4b71-8469-b3d70754ebbb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:06.882480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=47 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:06.887497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27c7b35c-9bbf-4b71-8469-b3d70754ebbb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:06.888010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27c7b35c-9bbf-4b71-8469-b3d70754ebbb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:06.888473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27c7b35c-9bbf-4b71-8469-b3d70754ebbb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:06.889192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27c7b35c-9bbf-4b71-8469-b3d70754ebbb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:06.889706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27c7b35c-9bbf-4b71-8469-b3d70754ebbb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:06.890194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-27c7b35c-9bbf-4b71-8469-b3d70754ebbb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:07.045556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-27c7b35c-9bbf-4b71-8469-b3d70754ebbb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:07.055230 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-27c7b35c-9bbf-4b71-8469-b3d70754ebbb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1683 microversion: 2.1 time: 0.181051 Oct 04 21:54:07.056585 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3362/6701] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:06 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:27.255257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-58491d9b-fb5d-4209-88f2-175d380cda78 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:27.257555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-58491d9b-fb5d-4209-88f2-175d380cda78 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:27.260256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:27.262948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=46 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:27.267089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58491d9b-fb5d-4209-88f2-175d380cda78 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:27.268154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58491d9b-fb5d-4209-88f2-175d380cda78 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:27.268647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58491d9b-fb5d-4209-88f2-175d380cda78 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:27.269338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58491d9b-fb5d-4209-88f2-175d380cda78 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:27.269828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58491d9b-fb5d-4209-88f2-175d380cda78 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:27.270296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58491d9b-fb5d-4209-88f2-175d380cda78 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:27.326910 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-58491d9b-fb5d-4209-88f2-175d380cda78 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1/action" status: 200 len: 24574 microversion: 2.1 time: 0.075751 Oct 04 21:54:27.327567 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3340/6702] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:54:27 2022] POST /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1/action => generated 24574 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:54:33.504307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ce6619f8-b420-42cd-883b-504fb30ce192 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:33.504945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ce6619f8-b420-42cd-883b-504fb30ce192 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:33.507250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:33.507982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:33.512712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce6619f8-b420-42cd-883b-504fb30ce192 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:33.513222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce6619f8-b420-42cd-883b-504fb30ce192 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:33.513711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce6619f8-b420-42cd-883b-504fb30ce192 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:33.514420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce6619f8-b420-42cd-883b-504fb30ce192 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:33.514894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce6619f8-b420-42cd-883b-504fb30ce192 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:33.515338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce6619f8-b420-42cd-883b-504fb30ce192 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:33.662505 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ce6619f8-b420-42cd-883b-504fb30ce192 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1834 microversion: 2.1 time: 0.162365 Oct 04 21:54:33.663081 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3363/6703] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:33 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1834 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:34.928473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e677b8a7-718c-4f48-b7b9-98e107aa7f8f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:34.934814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-ab0eb1c4-0f84-4b35-85b7-bd324039f4bc req-811f4ef7-0813-4419-b468-7dded2118a23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfacd991-cd91-4d81-a17f-66ecf0b3cdf1", "tag": "17a07455-7c52-4b8d-8a15-7468dbdf44b0"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:34.940134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e677b8a7-718c-4f48-b7b9-98e107aa7f8f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:34.955333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ab0eb1c4-0f84-4b35-85b7-bd324039f4bc req-811f4ef7-0813-4419-b468-7dded2118a23 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:34.955832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ab0eb1c4-0f84-4b35-85b7-bd324039f4bc req-811f4ef7-0813-4419-b468-7dded2118a23 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:34.965707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ab0eb1c4-0f84-4b35-85b7-bd324039f4bc req-811f4ef7-0813-4419-b468-7dded2118a23 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:34.965839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e677b8a7-718c-4f48-b7b9-98e107aa7f8f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:34.965839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e677b8a7-718c-4f48-b7b9-98e107aa7f8f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:34.965839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e677b8a7-718c-4f48-b7b9-98e107aa7f8f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:34.965839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e677b8a7-718c-4f48-b7b9-98e107aa7f8f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:34.965839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e677b8a7-718c-4f48-b7b9-98e107aa7f8f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:34.971154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e677b8a7-718c-4f48-b7b9-98e107aa7f8f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:34.972892 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-ab0eb1c4-0f84-4b35-85b7-bd324039f4bc req-811f4ef7-0813-4419-b468-7dded2118a23 service nova] Creating event network-changed:17a07455-7c52-4b8d-8a15-7468dbdf44b0 for instance bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 on n-h1-860282-1 Oct 04 21:54:34.980646 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-ab0eb1c4-0f84-4b35-85b7-bd324039f4bc req-811f4ef7-0813-4419-b468-7dded2118a23 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049202 Oct 04 21:54:34.981808 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3364/6704] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:35.013812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e677b8a7-718c-4f48-b7b9-98e107aa7f8f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:54:35.448817 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e677b8a7-718c-4f48-b7b9-98e107aa7f8f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 204 len: 0 microversion: 2.1 time: 0.524944 Oct 04 21:54:35.449601 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3341/6705] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:54:34 2022] DELETE /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:54:35.462120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3c1e37bb-0740-4dd7-ac8a-43ce80c453a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:35.462942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3c1e37bb-0740-4dd7-ac8a-43ce80c453a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:35.471828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c1e37bb-0740-4dd7-ac8a-43ce80c453a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:35.472451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c1e37bb-0740-4dd7-ac8a-43ce80c453a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:35.473039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c1e37bb-0740-4dd7-ac8a-43ce80c453a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:35.474436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c1e37bb-0740-4dd7-ac8a-43ce80c453a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:35.475037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c1e37bb-0740-4dd7-ac8a-43ce80c453a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:35.475567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3c1e37bb-0740-4dd7-ac8a-43ce80c453a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:35.655516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3c1e37bb-0740-4dd7-ac8a-43ce80c453a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:35.667515 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3c1e37bb-0740-4dd7-ac8a-43ce80c453a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1689 microversion: 2.1 time: 0.212590 Oct 04 21:54:35.671324 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3365/6706] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:35 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1689 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:36.693841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6ec99dc8-11c2-43c4-b8da-0fdd3b59dad6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:36.695193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6ec99dc8-11c2-43c4-b8da-0fdd3b59dad6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:36.703901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ec99dc8-11c2-43c4-b8da-0fdd3b59dad6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:36.704462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ec99dc8-11c2-43c4-b8da-0fdd3b59dad6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:36.704903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ec99dc8-11c2-43c4-b8da-0fdd3b59dad6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:36.705655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ec99dc8-11c2-43c4-b8da-0fdd3b59dad6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:36.706121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ec99dc8-11c2-43c4-b8da-0fdd3b59dad6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:36.706556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ec99dc8-11c2-43c4-b8da-0fdd3b59dad6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:36.852648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6ec99dc8-11c2-43c4-b8da-0fdd3b59dad6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:36.862527 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6ec99dc8-11c2-43c4-b8da-0fdd3b59dad6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1571 microversion: 2.1 time: 0.173071 Oct 04 21:54:36.863125 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3342/6707] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:36 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1571 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:37.262284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-bcb14a15-56ec-483d-a67d-96775c3d8a6a req-ac6bf1e0-2696-4404-ac1f-c0cf47c24e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfacd991-cd91-4d81-a17f-66ecf0b3cdf1", "name": "network-vif-deleted", "tag": "17a07455-7c52-4b8d-8a15-7468dbdf44b0"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:37.273022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bcb14a15-56ec-483d-a67d-96775c3d8a6a req-ac6bf1e0-2696-4404-ac1f-c0cf47c24e22 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:37.274324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bcb14a15-56ec-483d-a67d-96775c3d8a6a req-ac6bf1e0-2696-4404-ac1f-c0cf47c24e22 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:37.274851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-bcb14a15-56ec-483d-a67d-96775c3d8a6a req-ac6bf1e0-2696-4404-ac1f-c0cf47c24e22 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:37.286739 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-bcb14a15-56ec-483d-a67d-96775c3d8a6a req-ac6bf1e0-2696-4404-ac1f-c0cf47c24e22 service nova] Creating event network-vif-deleted:17a07455-7c52-4b8d-8a15-7468dbdf44b0 for instance bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 on n-h1-860282-1 Oct 04 21:54:37.291860 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-bcb14a15-56ec-483d-a67d-96775c3d8a6a req-ac6bf1e0-2696-4404-ac1f-c0cf47c24e22 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034221 Oct 04 21:54:37.292485 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3366/6708] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:37.885543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5a9fb527-eb1f-4679-9f49-a0386739df9e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:37.886170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5a9fb527-eb1f-4679-9f49-a0386739df9e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:37.893101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a9fb527-eb1f-4679-9f49-a0386739df9e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:37.893639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a9fb527-eb1f-4679-9f49-a0386739df9e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:37.894090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a9fb527-eb1f-4679-9f49-a0386739df9e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:37.894782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a9fb527-eb1f-4679-9f49-a0386739df9e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:37.895244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a9fb527-eb1f-4679-9f49-a0386739df9e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:37.895674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a9fb527-eb1f-4679-9f49-a0386739df9e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:37.927892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a9fb527-eb1f-4679-9f49-a0386739df9e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:37.928381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a9fb527-eb1f-4679-9f49-a0386739df9e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:37.928830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a9fb527-eb1f-4679-9f49-a0386739df9e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:37.929326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-5a9fb527-eb1f-4679-9f49-a0386739df9e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lazy-loading 'fault' on Instance uuid bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:54:37.973600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5a9fb527-eb1f-4679-9f49-a0386739df9e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:37.982710 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5a9fb527-eb1f-4679-9f49-a0386739df9e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 200 len: 1357 microversion: 2.1 time: 0.101068 Oct 04 21:54:37.983322 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3343/6709] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:37 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 1357 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:39.009027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-115fdbe6-6b3f-4c05-8b6c-0c580cfb2dac tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:39.009779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-115fdbe6-6b3f-4c05-8b6c-0c580cfb2dac tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: bfacd991-cd91-4d81-a17f-66ecf0b3cdf1] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:39.016120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-115fdbe6-6b3f-4c05-8b6c-0c580cfb2dac tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:39.016657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-115fdbe6-6b3f-4c05-8b6c-0c580cfb2dac tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:39.017128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-115fdbe6-6b3f-4c05-8b6c-0c580cfb2dac tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:39.017866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-115fdbe6-6b3f-4c05-8b6c-0c580cfb2dac tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:39.018344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-115fdbe6-6b3f-4c05-8b6c-0c580cfb2dac tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:39.018790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-115fdbe6-6b3f-4c05-8b6c-0c580cfb2dac tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:39.032985 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-115fdbe6-6b3f-4c05-8b6c-0c580cfb2dac tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] HTTP exception thrown: Instance bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 could not be found. Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-115fdbe6-6b3f-4c05-8b6c-0c580cfb2dac tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Request method failure captured: Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 HTTP/1.1 Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKsg9wdsQpKRxIYoCO18EnGkiXvFaK3Y37dAKXCvkpYNlW5hI6Th3vwXBScO1z15nuZq6dcbLpHb4UAi01qVzCkAXMzlesG1frtWG0k1ymFc191M4FAp7BOhLPARXjbwQP08vsZYIaM8TzkponyUyXqAm9ryQobG9UgDnWq6vToxOSs Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 187e190360d14111a4107866a8000348 Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-875125608 Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/187e190360d14111a4107866a8000348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_187e190360d14111a4107866a8000348"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/187e190360d14111a4107866a8000348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/187e190360d14111a4107866a8000348"}]}] Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestNetworkAdvancedServerOps-875125608 Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 187e190360d14111a4107866a8000348 Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-875125608 Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestNetworkAdvancedServerOps-875125608-project Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 8c893eb5126c4c9db1012c199660261c Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestNetworkAdvancedServerOps-875125608-project Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 could not be found. Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'bfacd991-cd91-4d81-a17f-66ecf0b3cdf1'} Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 could not be found. Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 could not be found. Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:54:39.034820 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:54:39.043053 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:54:39.043053 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:54:39.043053 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:54:39.043053 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:54:39.043053 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:54:39.043053 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:54:39.043053 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 could not be found. Oct 04 21:54:39.043053 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:54:39.043053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-115fdbe6-6b3f-4c05-8b6c-0c580cfb2dac tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Returning 404 to user: Instance bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:54:39.043053 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-115fdbe6-6b3f-4c05-8b6c-0c580cfb2dac tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1" status: 404 len: 111 microversion: 2.1 time: 0.033416 Oct 04 21:54:39.043053 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3367/6710] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:39 2022] GET /compute/v2.1/servers/bfacd991-cd91-4d81-a17f-66ecf0b3cdf1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:54:42.858128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-27b4e6a5-a69f-4f5a-84d1-7537488d420c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '.version_select at 0x7f578bef4820>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:42.974346 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-27b4e6a5-a69f-4f5a-84d1-7537488d420c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1531057924" status: 202 len: 0 microversion: 2.1 time: 0.121008 Oct 04 21:54:42.974883 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3344/6711] 10.222.0.30 () {58 vars in 1284 bytes} [Tue Oct 4 21:54:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1531057924 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:54:43.007795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c35ce23a-efc8-4f1e-97da-d98bb38ef909 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'create', calling method: .version_select at 0x7f578b63f670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-725748620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHY7I6DL0Bkemtw3Obhgs6LzwymmeIq/KyPNUmxCuHjvBsE/Uk+MimcsaGHGpssmpnwpNbUF9k5IHdXZwCyZPB6oqe6QaHwwDP5D5uYC3GSKZX/HekDTCqI5Boc1CL7Nbw=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:43.028609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-c35ce23a-efc8-4f1e-97da-d98bb38ef909 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Getting quotas for project 187e190360d14111a4107866a8000348. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:54:43.033784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-c35ce23a-efc8-4f1e-97da-d98bb38ef909 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Getting quotas for user 8c893eb5126c4c9db1012c199660261c and project 187e190360d14111a4107866a8000348. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:54:43.192308 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c35ce23a-efc8-4f1e-97da-d98bb38ef909 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.188898 Oct 04 21:54:43.192934 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3368/6712] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:54:43 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:45.191082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0a1bd77f-0f7d-4d35-8c0d-ce275d83d013 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1763321297", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-793500675", "security_groups": [{"name": "tempest-secgroup-smoke-419452248"}], "block_device_mapping_v2": [{"uuid": "661eddcd-c572-4e7f-b31e-6a319435605d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b7f4cca9-cdc1-49bd-97e7-bd6739547eb6"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:45.311191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-0a1bd77f-0f7d-4d35-8c0d-ce275d83d013 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] validate_networks() for [('b7f4cca9-cdc1-49bd-97e7-bd6739547eb6', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:54:45.708170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-0a1bd77f-0f7d-4d35-8c0d-ce275d83d013 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:54:45.708602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-0a1bd77f-0f7d-4d35-8c0d-ce275d83d013 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:54:45.709083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-0a1bd77f-0f7d-4d35-8c0d-ce275d83d013 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:54:45.709527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-0a1bd77f-0f7d-4d35-8c0d-ce275d83d013 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:54:45.709945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-0a1bd77f-0f7d-4d35-8c0d-ce275d83d013 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:54:45.719834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a1bd77f-0f7d-4d35-8c0d-ce275d83d013 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:45.720323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a1bd77f-0f7d-4d35-8c0d-ce275d83d013 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:45.720766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a1bd77f-0f7d-4d35-8c0d-ce275d83d013 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:45.721530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a1bd77f-0f7d-4d35-8c0d-ce275d83d013 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:45.721990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a1bd77f-0f7d-4d35-8c0d-ce275d83d013 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:45.722420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a1bd77f-0f7d-4d35-8c0d-ce275d83d013 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:45.740784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-0a1bd77f-0f7d-4d35-8c0d-ce275d83d013 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Getting quotas for project 68208d23fd2f40479ba279566a819933. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:54:45.746150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-0a1bd77f-0f7d-4d35-8c0d-ce275d83d013 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Getting quotas for user 15748f41da9f49fca3e7eec1fda3b245 and project 68208d23fd2f40479ba279566a819933. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:54:45.808456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0a1bd77f-0f7d-4d35-8c0d-ce275d83d013 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:54:45.810881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0a1bd77f-0f7d-4d35-8c0d-ce275d83d013 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='661eddcd-c572-4e7f-b31e-6a319435605d',volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:54:46.388164 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0a1bd77f-0f7d-4d35-8c0d-ce275d83d013 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.202043 Oct 04 21:54:46.388983 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3345/6713] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:54:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:54:46.401157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7a303b35-93af-4587-bc4d-cb96aabd61dc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:46.401811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7a303b35-93af-4587-bc4d-cb96aabd61dc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:46.465387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7a303b35-93af-4587-bc4d-cb96aabd61dc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:46.474583 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7a303b35-93af-4587-bc4d-cb96aabd61dc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1094 microversion: 2.1 time: 0.078416 Oct 04 21:54:46.475164 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3369/6714] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:46 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:47.501209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a2d7cbfa-12b6-4d1b-8fe5-5602f433c7dc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:47.501875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a2d7cbfa-12b6-4d1b-8fe5-5602f433c7dc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:47.522672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2d7cbfa-12b6-4d1b-8fe5-5602f433c7dc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:47.524221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2d7cbfa-12b6-4d1b-8fe5-5602f433c7dc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:47.524935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2d7cbfa-12b6-4d1b-8fe5-5602f433c7dc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:47.525981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2d7cbfa-12b6-4d1b-8fe5-5602f433c7dc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:47.530194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2d7cbfa-12b6-4d1b-8fe5-5602f433c7dc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:47.530194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a2d7cbfa-12b6-4d1b-8fe5-5602f433c7dc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:47.611214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a2d7cbfa-12b6-4d1b-8fe5-5602f433c7dc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:47.619332 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a2d7cbfa-12b6-4d1b-8fe5-5602f433c7dc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1144 microversion: 2.1 time: 0.123002 Oct 04 21:54:47.619919 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3346/6715] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:47 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1144 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:48.643062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-be262a07-1692-46d4-9e6b-0ea7cb6e6487 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:48.643665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-be262a07-1692-46d4-9e6b-0ea7cb6e6487 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:48.651953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be262a07-1692-46d4-9e6b-0ea7cb6e6487 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:48.654693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be262a07-1692-46d4-9e6b-0ea7cb6e6487 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:48.654693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be262a07-1692-46d4-9e6b-0ea7cb6e6487 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:48.654693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be262a07-1692-46d4-9e6b-0ea7cb6e6487 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:48.654693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be262a07-1692-46d4-9e6b-0ea7cb6e6487 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:48.655019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be262a07-1692-46d4-9e6b-0ea7cb6e6487 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:48.717779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-be262a07-1692-46d4-9e6b-0ea7cb6e6487 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:48.725808 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-be262a07-1692-46d4-9e6b-0ea7cb6e6487 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1192 microversion: 2.1 time: 0.087014 Oct 04 21:54:48.727156 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3370/6716] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:48 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:49.755201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-804e3b50-42a8-4c9e-b668-a94bd9bf5463 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:49.760345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-804e3b50-42a8-4c9e-b668-a94bd9bf5463 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:49.762376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-804e3b50-42a8-4c9e-b668-a94bd9bf5463 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:49.762939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-804e3b50-42a8-4c9e-b668-a94bd9bf5463 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:49.763502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-804e3b50-42a8-4c9e-b668-a94bd9bf5463 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:49.764263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-804e3b50-42a8-4c9e-b668-a94bd9bf5463 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:49.764934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-804e3b50-42a8-4c9e-b668-a94bd9bf5463 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:49.765446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-804e3b50-42a8-4c9e-b668-a94bd9bf5463 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:49.840008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-804e3b50-42a8-4c9e-b668-a94bd9bf5463 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:49.850637 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-804e3b50-42a8-4c9e-b668-a94bd9bf5463 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1210 microversion: 2.1 time: 0.100528 Oct 04 21:54:49.852345 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3347/6717] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:49 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:50.880279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-71d559d2-a895-4a62-b7cd-ff39fc20df21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:50.880910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-71d559d2-a895-4a62-b7cd-ff39fc20df21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:50.899262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71d559d2-a895-4a62-b7cd-ff39fc20df21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:50.900379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71d559d2-a895-4a62-b7cd-ff39fc20df21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:50.902971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71d559d2-a895-4a62-b7cd-ff39fc20df21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:50.906949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71d559d2-a895-4a62-b7cd-ff39fc20df21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:50.907849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71d559d2-a895-4a62-b7cd-ff39fc20df21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:50.910244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71d559d2-a895-4a62-b7cd-ff39fc20df21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:51.384983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-420ab755-7003-4a77-b66f-7750f5aea2df req-f59738d0-7df1-4a3e-8a1e-f91c3af5e5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b9b0b92-1590-4bcc-92a6-a32d334e928a", "tag": "6815e25b-b290-4f38-97ec-1d6ff6f78a46"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:51.402462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-420ab755-7003-4a77-b66f-7750f5aea2df req-f59738d0-7df1-4a3e-8a1e-f91c3af5e5f3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:51.412397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-420ab755-7003-4a77-b66f-7750f5aea2df req-f59738d0-7df1-4a3e-8a1e-f91c3af5e5f3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:51.419289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-420ab755-7003-4a77-b66f-7750f5aea2df req-f59738d0-7df1-4a3e-8a1e-f91c3af5e5f3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:51.459191 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-420ab755-7003-4a77-b66f-7750f5aea2df req-f59738d0-7df1-4a3e-8a1e-f91c3af5e5f3 service nova] Creating event network-changed:6815e25b-b290-4f38-97ec-1d6ff6f78a46 for instance 9b9b0b92-1590-4bcc-92a6-a32d334e928a on n-h1-860282-1 Oct 04 21:54:51.475248 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-420ab755-7003-4a77-b66f-7750f5aea2df req-f59738d0-7df1-4a3e-8a1e-f91c3af5e5f3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097403 Oct 04 21:54:51.476677 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3348/6718] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:54:51.744736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-71d559d2-a895-4a62-b7cd-ff39fc20df21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:51.764400 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-71d559d2-a895-4a62-b7cd-ff39fc20df21 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1277 microversion: 2.1 time: 0.887912 Oct 04 21:54:51.765016 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3371/6719] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:50 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1277 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:52.792355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b555e05d-79ca-40b8-b761-1818b0dfcfe6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:52.792987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b555e05d-79ca-40b8-b761-1818b0dfcfe6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:52.799524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b555e05d-79ca-40b8-b761-1818b0dfcfe6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:52.800099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b555e05d-79ca-40b8-b761-1818b0dfcfe6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:52.800552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b555e05d-79ca-40b8-b761-1818b0dfcfe6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:52.801258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b555e05d-79ca-40b8-b761-1818b0dfcfe6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:52.801735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b555e05d-79ca-40b8-b761-1818b0dfcfe6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:52.802266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b555e05d-79ca-40b8-b761-1818b0dfcfe6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:52.978075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b555e05d-79ca-40b8-b761-1818b0dfcfe6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:52.993830 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b555e05d-79ca-40b8-b761-1818b0dfcfe6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1277 microversion: 2.1 time: 0.206351 Oct 04 21:54:52.995123 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3349/6720] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:52 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1277 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:54.018471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-57154a3d-8cda-481a-a611-61a9b04e30c3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:54.020617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-57154a3d-8cda-481a-a611-61a9b04e30c3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:54.032507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57154a3d-8cda-481a-a611-61a9b04e30c3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:54.040786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57154a3d-8cda-481a-a611-61a9b04e30c3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:54.041562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57154a3d-8cda-481a-a611-61a9b04e30c3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:54.042643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57154a3d-8cda-481a-a611-61a9b04e30c3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:54.042964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57154a3d-8cda-481a-a611-61a9b04e30c3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:54.043420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57154a3d-8cda-481a-a611-61a9b04e30c3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:54.065129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8a09e867-8895-4fcb-aee9-fdcb1f785640 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-776613111", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "3a9db586-b469-444a-ba44-d6eb80678db5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-725748620", "security_groups": [{"name": "tempest-secgroup-smoke-321532547"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:54.275587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-8a09e867-8895-4fcb-aee9-fdcb1f785640 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] validate_networks() for [('3a9db586-b469-444a-ba44-d6eb80678db5', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:54:54.420676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-57154a3d-8cda-481a-a611-61a9b04e30c3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:54.432007 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-57154a3d-8cda-481a-a611-61a9b04e30c3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1277 microversion: 2.1 time: 0.417502 Oct 04 21:54:54.435203 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3372/6721] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:54 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1277 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:54.901722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-8a09e867-8895-4fcb-aee9-fdcb1f785640 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:54:54.902155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-8a09e867-8895-4fcb-aee9-fdcb1f785640 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:54:54.902631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-8a09e867-8895-4fcb-aee9-fdcb1f785640 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:54:54.903076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-8a09e867-8895-4fcb-aee9-fdcb1f785640 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:54:54.903865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-8a09e867-8895-4fcb-aee9-fdcb1f785640 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:54:54.912792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a09e867-8895-4fcb-aee9-fdcb1f785640 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:54.913276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a09e867-8895-4fcb-aee9-fdcb1f785640 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:54.913886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a09e867-8895-4fcb-aee9-fdcb1f785640 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:54.914702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a09e867-8895-4fcb-aee9-fdcb1f785640 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:54.915165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a09e867-8895-4fcb-aee9-fdcb1f785640 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:54.915591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a09e867-8895-4fcb-aee9-fdcb1f785640 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:54.932917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-8a09e867-8895-4fcb-aee9-fdcb1f785640 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Getting quotas for project 187e190360d14111a4107866a8000348. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:54:54.938908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-8a09e867-8895-4fcb-aee9-fdcb1f785640 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Getting quotas for user 8c893eb5126c4c9db1012c199660261c and project 187e190360d14111a4107866a8000348. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:54:54.955967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8a09e867-8895-4fcb-aee9-fdcb1f785640 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:54:54.958799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8a09e867-8895-4fcb-aee9-fdcb1f785640 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:54:55.115410 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8a09e867-8895-4fcb-aee9-fdcb1f785640 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.054445 Oct 04 21:54:55.124390 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3350/6722] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:54:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:54:55.129138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bd93ba37-21d8-48a6-986b-740aaf54ffae tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:55.129824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bd93ba37-21d8-48a6-986b-740aaf54ffae tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:55.209214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bd93ba37-21d8-48a6-986b-740aaf54ffae tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:55.217821 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bd93ba37-21d8-48a6-986b-740aaf54ffae tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1265 microversion: 2.1 time: 0.092878 Oct 04 21:54:55.221943 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3373/6723] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:55 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:54:55.462483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-75c4dc4d-c2c4-44bf-a5ca-91b376147444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:55.463108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-75c4dc4d-c2c4-44bf-a5ca-91b376147444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:55.470864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75c4dc4d-c2c4-44bf-a5ca-91b376147444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:55.471729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75c4dc4d-c2c4-44bf-a5ca-91b376147444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:55.472184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75c4dc4d-c2c4-44bf-a5ca-91b376147444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:55.473357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75c4dc4d-c2c4-44bf-a5ca-91b376147444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:55.473832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75c4dc4d-c2c4-44bf-a5ca-91b376147444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:55.479232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75c4dc4d-c2c4-44bf-a5ca-91b376147444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:55.635951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-75c4dc4d-c2c4-44bf-a5ca-91b376147444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:55.651139 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-75c4dc4d-c2c4-44bf-a5ca-91b376147444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1277 microversion: 2.1 time: 0.193363 Oct 04 21:54:55.652173 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3351/6724] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:55 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:56.250687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e4fb9e60-9440-4db6-8298-023575503325 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:56.251436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e4fb9e60-9440-4db6-8298-023575503325 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:56.310103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e4fb9e60-9440-4db6-8298-023575503325 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:56.317717 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e4fb9e60-9440-4db6-8298-023575503325 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1265 microversion: 2.1 time: 0.079445 Oct 04 21:54:56.318334 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3374/6725] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:56 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:56.676721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e7a696ef-812b-40bf-b947-c96d34c67a3b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:56.676721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e7a696ef-812b-40bf-b947-c96d34c67a3b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:56.683032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7a696ef-812b-40bf-b947-c96d34c67a3b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:56.683525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7a696ef-812b-40bf-b947-c96d34c67a3b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:56.684047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7a696ef-812b-40bf-b947-c96d34c67a3b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:56.684827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7a696ef-812b-40bf-b947-c96d34c67a3b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:56.685284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7a696ef-812b-40bf-b947-c96d34c67a3b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:56.685731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7a696ef-812b-40bf-b947-c96d34c67a3b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:56.836129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e7a696ef-812b-40bf-b947-c96d34c67a3b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:56.844486 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e7a696ef-812b-40bf-b947-c96d34c67a3b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1265 microversion: 2.1 time: 0.173815 Oct 04 21:54:56.845070 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3352/6726] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:56 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:57.340546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2d5d3215-e756-43a3-991c-a743be3d8150 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:57.341098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2d5d3215-e756-43a3-991c-a743be3d8150 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:57.348181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d5d3215-e756-43a3-991c-a743be3d8150 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:57.348680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d5d3215-e756-43a3-991c-a743be3d8150 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:57.354421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d5d3215-e756-43a3-991c-a743be3d8150 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:57.354421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d5d3215-e756-43a3-991c-a743be3d8150 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:57.354421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d5d3215-e756-43a3-991c-a743be3d8150 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:57.354421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d5d3215-e756-43a3-991c-a743be3d8150 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:57.413854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2d5d3215-e756-43a3-991c-a743be3d8150 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:57.422959 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2d5d3215-e756-43a3-991c-a743be3d8150 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1317 microversion: 2.1 time: 0.086427 Oct 04 21:54:57.423731 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3375/6727] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:57 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1317 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:57.869071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-efbf222a-81d7-4c85-849c-13f13b043314 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:57.870581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-efbf222a-81d7-4c85-849c-13f13b043314 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:57.881236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efbf222a-81d7-4c85-849c-13f13b043314 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:57.881915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efbf222a-81d7-4c85-849c-13f13b043314 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:57.882469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efbf222a-81d7-4c85-849c-13f13b043314 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:57.884389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efbf222a-81d7-4c85-849c-13f13b043314 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:57.884592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efbf222a-81d7-4c85-849c-13f13b043314 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:57.885128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-efbf222a-81d7-4c85-849c-13f13b043314 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:58.044002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-efbf222a-81d7-4c85-849c-13f13b043314 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:58.051921 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-efbf222a-81d7-4c85-849c-13f13b043314 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1265 microversion: 2.1 time: 0.187108 Oct 04 21:54:58.057698 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3353/6728] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:57 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:58.447962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-26cf64da-22ee-44d9-9035-e13218c007b0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:58.448598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-26cf64da-22ee-44d9-9035-e13218c007b0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:58.456085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26cf64da-22ee-44d9-9035-e13218c007b0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:58.456591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26cf64da-22ee-44d9-9035-e13218c007b0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:58.457052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26cf64da-22ee-44d9-9035-e13218c007b0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:58.457795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26cf64da-22ee-44d9-9035-e13218c007b0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:58.458276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26cf64da-22ee-44d9-9035-e13218c007b0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:58.458719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-26cf64da-22ee-44d9-9035-e13218c007b0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:58.636549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-26cf64da-22ee-44d9-9035-e13218c007b0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:58.644789 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-26cf64da-22ee-44d9-9035-e13218c007b0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1390 microversion: 2.1 time: 0.201734 Oct 04 21:54:58.645391 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3376/6729] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:58 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1390 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:59.075806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1348b291-7d6e-4805-9f3a-e768b077d5de tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:59.076334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1348b291-7d6e-4805-9f3a-e768b077d5de tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:59.083205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1348b291-7d6e-4805-9f3a-e768b077d5de tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:59.083696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1348b291-7d6e-4805-9f3a-e768b077d5de tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:59.084140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1348b291-7d6e-4805-9f3a-e768b077d5de tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:59.084856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1348b291-7d6e-4805-9f3a-e768b077d5de tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:59.085298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1348b291-7d6e-4805-9f3a-e768b077d5de tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:59.085768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1348b291-7d6e-4805-9f3a-e768b077d5de tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:59.248093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1348b291-7d6e-4805-9f3a-e768b077d5de tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:59.255956 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1348b291-7d6e-4805-9f3a-e768b077d5de tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1265 microversion: 2.1 time: 0.184927 Oct 04 21:54:59.256665 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3354/6730] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:59 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:59.672332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-153aa2d4-1217-4b17-a40a-87a96ee06373 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:59.673067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-153aa2d4-1217-4b17-a40a-87a96ee06373 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:59.701033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-153aa2d4-1217-4b17-a40a-87a96ee06373 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:59.701573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-153aa2d4-1217-4b17-a40a-87a96ee06373 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:59.702996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-153aa2d4-1217-4b17-a40a-87a96ee06373 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:59.707825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-153aa2d4-1217-4b17-a40a-87a96ee06373 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:59.707825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-153aa2d4-1217-4b17-a40a-87a96ee06373 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:59.707825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-153aa2d4-1217-4b17-a40a-87a96ee06373 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:59.857482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-eeffc1e1-e600-4576-a4fc-0af7c95f88e2 req-eb182dff-15ff-4506-8c1f-47cad5a8b25c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2c600bd-ae8d-4de9-be13-21b2fc7da275", "tag": "9d379e96-f275-493b-a7ff-e217784782ce"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:59.869126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-eeffc1e1-e600-4576-a4fc-0af7c95f88e2 req-eb182dff-15ff-4506-8c1f-47cad5a8b25c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:59.869753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-eeffc1e1-e600-4576-a4fc-0af7c95f88e2 req-eb182dff-15ff-4506-8c1f-47cad5a8b25c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:59.870264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-eeffc1e1-e600-4576-a4fc-0af7c95f88e2 req-eb182dff-15ff-4506-8c1f-47cad5a8b25c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:59.883066 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-eeffc1e1-e600-4576-a4fc-0af7c95f88e2 req-eb182dff-15ff-4506-8c1f-47cad5a8b25c service nova] Creating event network-changed:9d379e96-f275-493b-a7ff-e217784782ce for instance e2c600bd-ae8d-4de9-be13-21b2fc7da275 on n-h2-860282-1 Oct 04 21:54:59.889255 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-eeffc1e1-e600-4576-a4fc-0af7c95f88e2 req-eb182dff-15ff-4506-8c1f-47cad5a8b25c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209811 Oct 04 21:54:59.890625 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3355/6731] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:59.899897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-153aa2d4-1217-4b17-a40a-87a96ee06373 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:59.904823 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-153aa2d4-1217-4b17-a40a-87a96ee06373 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1390 microversion: 2.1 time: 0.238279 Oct 04 21:54:59.905530 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3377/6732] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:59 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1390 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:00.281670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-24a1da10-b8de-431b-a296-a046d464c6f3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:00.282566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-24a1da10-b8de-431b-a296-a046d464c6f3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:00.288815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24a1da10-b8de-431b-a296-a046d464c6f3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:00.289294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24a1da10-b8de-431b-a296-a046d464c6f3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:00.289858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24a1da10-b8de-431b-a296-a046d464c6f3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:00.290550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24a1da10-b8de-431b-a296-a046d464c6f3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:00.291082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24a1da10-b8de-431b-a296-a046d464c6f3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:00.291504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-24a1da10-b8de-431b-a296-a046d464c6f3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:00.429516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-24a1da10-b8de-431b-a296-a046d464c6f3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:00.437376 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-24a1da10-b8de-431b-a296-a046d464c6f3 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1265 microversion: 2.1 time: 0.161381 Oct 04 21:55:00.437985 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3356/6733] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:00 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:00.928687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-09eec937-baac-48e3-8b00-f421c4bb7ab8 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:00.929335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-09eec937-baac-48e3-8b00-f421c4bb7ab8 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:00.936843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09eec937-baac-48e3-8b00-f421c4bb7ab8 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:00.937350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09eec937-baac-48e3-8b00-f421c4bb7ab8 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:00.937838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09eec937-baac-48e3-8b00-f421c4bb7ab8 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:00.938585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09eec937-baac-48e3-8b00-f421c4bb7ab8 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:00.939126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09eec937-baac-48e3-8b00-f421c4bb7ab8 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:00.939575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09eec937-baac-48e3-8b00-f421c4bb7ab8 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:01.075613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-09eec937-baac-48e3-8b00-f421c4bb7ab8 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:01.083457 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-09eec937-baac-48e3-8b00-f421c4bb7ab8 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1390 microversion: 2.1 time: 0.158813 Oct 04 21:55:01.084044 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3378/6734] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:00 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:01.460333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8417257a-3d9f-49a8-824c-50f4dc1552cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:01.460946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8417257a-3d9f-49a8-824c-50f4dc1552cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:01.468012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8417257a-3d9f-49a8-824c-50f4dc1552cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:01.468734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8417257a-3d9f-49a8-824c-50f4dc1552cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:01.469175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8417257a-3d9f-49a8-824c-50f4dc1552cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:01.469902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8417257a-3d9f-49a8-824c-50f4dc1552cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:01.470360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8417257a-3d9f-49a8-824c-50f4dc1552cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:01.470788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8417257a-3d9f-49a8-824c-50f4dc1552cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:01.674077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8417257a-3d9f-49a8-824c-50f4dc1552cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:01.682387 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8417257a-3d9f-49a8-824c-50f4dc1552cc tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1265 microversion: 2.1 time: 0.225959 Oct 04 21:55:01.682995 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3357/6735] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:01 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:02.107013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-13f0bca3-a358-41c2-962d-49ade28659c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:02.107655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-13f0bca3-a358-41c2-962d-49ade28659c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:02.114865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13f0bca3-a358-41c2-962d-49ade28659c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:02.115376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13f0bca3-a358-41c2-962d-49ade28659c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:02.115840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13f0bca3-a358-41c2-962d-49ade28659c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:02.116557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13f0bca3-a358-41c2-962d-49ade28659c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:02.117041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13f0bca3-a358-41c2-962d-49ade28659c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:02.118039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-13f0bca3-a358-41c2-962d-49ade28659c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:02.250522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-13f0bca3-a358-41c2-962d-49ade28659c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:02.260381 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-13f0bca3-a358-41c2-962d-49ade28659c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1390 microversion: 2.1 time: 0.155375 Oct 04 21:55:02.265921 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3379/6736] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:02 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:02.706196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e4026b48-f1e3-4b34-bfca-56881c06e9ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:02.706801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e4026b48-f1e3-4b34-bfca-56881c06e9ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:02.714005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4026b48-f1e3-4b34-bfca-56881c06e9ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:02.714509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4026b48-f1e3-4b34-bfca-56881c06e9ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:02.714955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4026b48-f1e3-4b34-bfca-56881c06e9ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:02.715660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4026b48-f1e3-4b34-bfca-56881c06e9ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:02.716123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4026b48-f1e3-4b34-bfca-56881c06e9ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:02.716557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4026b48-f1e3-4b34-bfca-56881c06e9ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:02.735568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:02.853348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e4026b48-f1e3-4b34-bfca-56881c06e9ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:02.861115 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e4026b48-f1e3-4b34-bfca-56881c06e9ad tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1265 microversion: 2.1 time: 0.158978 Oct 04 21:55:02.861718 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3358/6737] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:02 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:03.287940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e15e6a32-a33f-4dd7-93cc-1772c2ccf826 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:03.288611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e15e6a32-a33f-4dd7-93cc-1772c2ccf826 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:03.295706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e15e6a32-a33f-4dd7-93cc-1772c2ccf826 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:03.296160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e15e6a32-a33f-4dd7-93cc-1772c2ccf826 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:03.296621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e15e6a32-a33f-4dd7-93cc-1772c2ccf826 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:03.297340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e15e6a32-a33f-4dd7-93cc-1772c2ccf826 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:03.297858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e15e6a32-a33f-4dd7-93cc-1772c2ccf826 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:03.298310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e15e6a32-a33f-4dd7-93cc-1772c2ccf826 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:03.435293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e15e6a32-a33f-4dd7-93cc-1772c2ccf826 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:03.443263 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e15e6a32-a33f-4dd7-93cc-1772c2ccf826 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1390 microversion: 2.1 time: 0.159212 Oct 04 21:55:03.443873 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3380/6738] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:03 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:03.889497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-54c218f7-ec2e-4b74-8ccb-806e8b2077d7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:03.890126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-54c218f7-ec2e-4b74-8ccb-806e8b2077d7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:03.897288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54c218f7-ec2e-4b74-8ccb-806e8b2077d7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:03.897820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54c218f7-ec2e-4b74-8ccb-806e8b2077d7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:03.898267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54c218f7-ec2e-4b74-8ccb-806e8b2077d7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:03.899136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54c218f7-ec2e-4b74-8ccb-806e8b2077d7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:03.899604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54c218f7-ec2e-4b74-8ccb-806e8b2077d7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:03.900039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54c218f7-ec2e-4b74-8ccb-806e8b2077d7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:04.040097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-54c218f7-ec2e-4b74-8ccb-806e8b2077d7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:04.048778 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-54c218f7-ec2e-4b74-8ccb-806e8b2077d7 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1265 microversion: 2.1 time: 0.164490 Oct 04 21:55:04.049365 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3359/6739] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:03 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:04.467541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d16dca84-110e-4f7b-bfdd-10013335fed1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:04.468216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d16dca84-110e-4f7b-bfdd-10013335fed1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:04.471186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:04.476033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d16dca84-110e-4f7b-bfdd-10013335fed1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:04.476529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d16dca84-110e-4f7b-bfdd-10013335fed1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:04.476995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d16dca84-110e-4f7b-bfdd-10013335fed1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:04.485288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d16dca84-110e-4f7b-bfdd-10013335fed1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:04.485288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d16dca84-110e-4f7b-bfdd-10013335fed1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:04.485288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d16dca84-110e-4f7b-bfdd-10013335fed1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:04.619586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d16dca84-110e-4f7b-bfdd-10013335fed1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:04.627322 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d16dca84-110e-4f7b-bfdd-10013335fed1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1390 microversion: 2.1 time: 0.163768 Oct 04 21:55:04.628012 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3381/6740] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:04 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:05.072024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b41c4f2a-d45a-42e9-88ac-33cec74c9157 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:05.072640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b41c4f2a-d45a-42e9-88ac-33cec74c9157 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:05.075224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:05.075899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=12 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:05.076529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:05.081380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b41c4f2a-d45a-42e9-88ac-33cec74c9157 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:05.081900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b41c4f2a-d45a-42e9-88ac-33cec74c9157 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:05.082340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b41c4f2a-d45a-42e9-88ac-33cec74c9157 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:05.083039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b41c4f2a-d45a-42e9-88ac-33cec74c9157 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:05.083497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b41c4f2a-d45a-42e9-88ac-33cec74c9157 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:05.083952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b41c4f2a-d45a-42e9-88ac-33cec74c9157 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:05.132528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-9ca28b17-bdbd-4837-a1b9-2fa8340319d8 req-7ecb3faa-b54b-4394-b862-bb4e767a46f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9b0b92-1590-4bcc-92a6-a32d334e928a", "name": "network-vif-plugged", "status": "completed", "tag": "6815e25b-b290-4f38-97ec-1d6ff6f78a46"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:05.143878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9ca28b17-bdbd-4837-a1b9-2fa8340319d8 req-7ecb3faa-b54b-4394-b862-bb4e767a46f5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:05.152514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9ca28b17-bdbd-4837-a1b9-2fa8340319d8 req-7ecb3faa-b54b-4394-b862-bb4e767a46f5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:05.152514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9ca28b17-bdbd-4837-a1b9-2fa8340319d8 req-7ecb3faa-b54b-4394-b862-bb4e767a46f5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:05.152514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=79 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:05.157723 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-9ca28b17-bdbd-4837-a1b9-2fa8340319d8 req-7ecb3faa-b54b-4394-b862-bb4e767a46f5 service nova] Creating event network-vif-plugged:6815e25b-b290-4f38-97ec-1d6ff6f78a46 for instance 9b9b0b92-1590-4bcc-92a6-a32d334e928a on n-h1-860282-1 Oct 04 21:55:05.163075 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-9ca28b17-bdbd-4837-a1b9-2fa8340319d8 req-7ecb3faa-b54b-4394-b862-bb4e767a46f5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034580 Oct 04 21:55:05.163716 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3382/6741] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:55:05.231212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b41c4f2a-d45a-42e9-88ac-33cec74c9157 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:05.240046 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b41c4f2a-d45a-42e9-88ac-33cec74c9157 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1265 microversion: 2.1 time: 0.172067 Oct 04 21:55:05.240847 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3360/6742] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:05 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:05.651705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e541152c-59e9-4df9-9302-f8a351c1bebc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:05.652424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e541152c-59e9-4df9-9302-f8a351c1bebc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:05.659271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e541152c-59e9-4df9-9302-f8a351c1bebc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:05.659799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e541152c-59e9-4df9-9302-f8a351c1bebc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:05.660260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e541152c-59e9-4df9-9302-f8a351c1bebc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:05.660977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e541152c-59e9-4df9-9302-f8a351c1bebc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:05.661473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e541152c-59e9-4df9-9302-f8a351c1bebc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:05.661921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e541152c-59e9-4df9-9302-f8a351c1bebc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:05.808499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e541152c-59e9-4df9-9302-f8a351c1bebc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:05.816399 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e541152c-59e9-4df9-9302-f8a351c1bebc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1390 microversion: 2.1 time: 0.170311 Oct 04 21:55:05.816977 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3383/6743] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:05 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:06.263912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a667db3-00d8-45ce-84ea-15c60d95a251 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:06.264435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7a667db3-00d8-45ce-84ea-15c60d95a251 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:06.272117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a667db3-00d8-45ce-84ea-15c60d95a251 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:06.272606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a667db3-00d8-45ce-84ea-15c60d95a251 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:06.273050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a667db3-00d8-45ce-84ea-15c60d95a251 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:06.274512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a667db3-00d8-45ce-84ea-15c60d95a251 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:06.274987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a667db3-00d8-45ce-84ea-15c60d95a251 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:06.275422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a667db3-00d8-45ce-84ea-15c60d95a251 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:06.416648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7a667db3-00d8-45ce-84ea-15c60d95a251 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:06.424673 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7a667db3-00d8-45ce-84ea-15c60d95a251 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1265 microversion: 2.1 time: 0.165129 Oct 04 21:55:06.425264 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3361/6744] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:06 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:06.839272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1121b096-8bcd-4867-8f52-cff5066ad3f2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:06.839844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1121b096-8bcd-4867-8f52-cff5066ad3f2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:06.841809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=10 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:06.847782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1121b096-8bcd-4867-8f52-cff5066ad3f2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:06.848292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1121b096-8bcd-4867-8f52-cff5066ad3f2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:06.848747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1121b096-8bcd-4867-8f52-cff5066ad3f2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:06.849489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1121b096-8bcd-4867-8f52-cff5066ad3f2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:06.849960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1121b096-8bcd-4867-8f52-cff5066ad3f2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:06.850399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1121b096-8bcd-4867-8f52-cff5066ad3f2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:06.984881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1121b096-8bcd-4867-8f52-cff5066ad3f2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:06.993370 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1121b096-8bcd-4867-8f52-cff5066ad3f2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1390 microversion: 2.1 time: 0.157539 Oct 04 21:55:06.993945 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3384/6745] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:06 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:07.181134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-a1394685-9c82-4031-867a-0c467dadd8b7 req-6d69a200-59b5-451a-9c31-60b30097e064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2c600bd-ae8d-4de9-be13-21b2fc7da275", "name": "network-vif-plugged", "status": "completed", "tag": "9d379e96-f275-493b-a7ff-e217784782ce"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:07.190962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a1394685-9c82-4031-867a-0c467dadd8b7 req-6d69a200-59b5-451a-9c31-60b30097e064 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:07.191447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a1394685-9c82-4031-867a-0c467dadd8b7 req-6d69a200-59b5-451a-9c31-60b30097e064 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:07.191947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a1394685-9c82-4031-867a-0c467dadd8b7 req-6d69a200-59b5-451a-9c31-60b30097e064 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:07.203378 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-a1394685-9c82-4031-867a-0c467dadd8b7 req-6d69a200-59b5-451a-9c31-60b30097e064 service nova] Creating event network-vif-plugged:9d379e96-f275-493b-a7ff-e217784782ce for instance e2c600bd-ae8d-4de9-be13-21b2fc7da275 on n-h2-860282-1 Oct 04 21:55:07.208649 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-a1394685-9c82-4031-867a-0c467dadd8b7 req-6d69a200-59b5-451a-9c31-60b30097e064 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032517 Oct 04 21:55:07.209273 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3362/6746] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:07.448378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9f3d5b68-6fb9-4d5a-9b46-a47726b00c5c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:07.448956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9f3d5b68-6fb9-4d5a-9b46-a47726b00c5c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:07.455214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f3d5b68-6fb9-4d5a-9b46-a47726b00c5c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:07.455734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f3d5b68-6fb9-4d5a-9b46-a47726b00c5c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:07.456235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f3d5b68-6fb9-4d5a-9b46-a47726b00c5c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:07.457030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f3d5b68-6fb9-4d5a-9b46-a47726b00c5c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:07.457568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f3d5b68-6fb9-4d5a-9b46-a47726b00c5c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:07.458015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f3d5b68-6fb9-4d5a-9b46-a47726b00c5c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:07.593564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9f3d5b68-6fb9-4d5a-9b46-a47726b00c5c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:07.601347 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9f3d5b68-6fb9-4d5a-9b46-a47726b00c5c tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1451 microversion: 2.1 time: 0.157275 Oct 04 21:55:07.602545 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3385/6747] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:07 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:07.624856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dbfe1cbd-4edd-4b31-91bb-5287254a9b32 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:07.625624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dbfe1cbd-4edd-4b31-91bb-5287254a9b32 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:07.631819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbfe1cbd-4edd-4b31-91bb-5287254a9b32 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:07.632299 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbfe1cbd-4edd-4b31-91bb-5287254a9b32 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:07.632735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbfe1cbd-4edd-4b31-91bb-5287254a9b32 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:07.633968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbfe1cbd-4edd-4b31-91bb-5287254a9b32 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:07.634599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbfe1cbd-4edd-4b31-91bb-5287254a9b32 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:07.635032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dbfe1cbd-4edd-4b31-91bb-5287254a9b32 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:07.770785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dbfe1cbd-4edd-4b31-91bb-5287254a9b32 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:07.779857 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dbfe1cbd-4edd-4b31-91bb-5287254a9b32 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1451 microversion: 2.1 time: 0.159700 Oct 04 21:55:07.780433 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3363/6748] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:07 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:08.017355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-296d6859-5dc6-4edc-864e-6b90331f09cd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:08.021496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-296d6859-5dc6-4edc-864e-6b90331f09cd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:08.024850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-296d6859-5dc6-4edc-864e-6b90331f09cd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:08.025358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-296d6859-5dc6-4edc-864e-6b90331f09cd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:08.025842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-296d6859-5dc6-4edc-864e-6b90331f09cd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:08.026558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-296d6859-5dc6-4edc-864e-6b90331f09cd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:08.027032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-296d6859-5dc6-4edc-864e-6b90331f09cd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:08.027475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-296d6859-5dc6-4edc-864e-6b90331f09cd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:08.232505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-296d6859-5dc6-4edc-864e-6b90331f09cd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:08.241328 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-296d6859-5dc6-4edc-864e-6b90331f09cd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1390 microversion: 2.1 time: 0.228954 Oct 04 21:55:08.244064 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3386/6749] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:08 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1390 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:09.266959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1d11c518-befa-4e71-99cb-af6f7c639859 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:09.267571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1d11c518-befa-4e71-99cb-af6f7c639859 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:09.275770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d11c518-befa-4e71-99cb-af6f7c639859 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:09.276266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d11c518-befa-4e71-99cb-af6f7c639859 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:09.276718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d11c518-befa-4e71-99cb-af6f7c639859 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:09.277456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d11c518-befa-4e71-99cb-af6f7c639859 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:09.277992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d11c518-befa-4e71-99cb-af6f7c639859 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:09.278688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d11c518-befa-4e71-99cb-af6f7c639859 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:09.484368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1d11c518-befa-4e71-99cb-af6f7c639859 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:09.492128 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1d11c518-befa-4e71-99cb-af6f7c639859 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1562 microversion: 2.1 time: 0.229165 Oct 04 21:55:09.493340 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3364/6750] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:09 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1562 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:09.515254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-15366c44-cb02-47c3-96e7-0ab0bc6666dc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:09.515926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-15366c44-cb02-47c3-96e7-0ab0bc6666dc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:09.522811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15366c44-cb02-47c3-96e7-0ab0bc6666dc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:09.523254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15366c44-cb02-47c3-96e7-0ab0bc6666dc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:09.523788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15366c44-cb02-47c3-96e7-0ab0bc6666dc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:09.524641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15366c44-cb02-47c3-96e7-0ab0bc6666dc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:09.525117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15366c44-cb02-47c3-96e7-0ab0bc6666dc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:09.525596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-15366c44-cb02-47c3-96e7-0ab0bc6666dc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:09.745045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-15366c44-cb02-47c3-96e7-0ab0bc6666dc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:09.753115 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-15366c44-cb02-47c3-96e7-0ab0bc6666dc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1562 microversion: 2.1 time: 0.241687 Oct 04 21:55:09.753874 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3387/6751] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:09 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1562 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:10.560269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-ceb6ed5e-fe19-40ad-91f4-49390276e704 req-2ba18b91-dd88-40cc-aff4-160ca41e1ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b9b0b92-1590-4bcc-92a6-a32d334e928a", "tag": "6815e25b-b290-4f38-97ec-1d6ff6f78a46"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:10.572789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ceb6ed5e-fe19-40ad-91f4-49390276e704 req-2ba18b91-dd88-40cc-aff4-160ca41e1ff6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:10.573536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ceb6ed5e-fe19-40ad-91f4-49390276e704 req-2ba18b91-dd88-40cc-aff4-160ca41e1ff6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:10.577602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ceb6ed5e-fe19-40ad-91f4-49390276e704 req-2ba18b91-dd88-40cc-aff4-160ca41e1ff6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:10.586592 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-ceb6ed5e-fe19-40ad-91f4-49390276e704 req-2ba18b91-dd88-40cc-aff4-160ca41e1ff6 service nova] Creating event network-changed:6815e25b-b290-4f38-97ec-1d6ff6f78a46 for instance 9b9b0b92-1590-4bcc-92a6-a32d334e928a on n-h1-860282-1 Oct 04 21:55:10.596480 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-ceb6ed5e-fe19-40ad-91f4-49390276e704 req-2ba18b91-dd88-40cc-aff4-160ca41e1ff6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041078 Oct 04 21:55:10.602293 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3365/6752] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:12.471697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9d9c053c-f631-452a-b2c9-54ee983433a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:12.472334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9d9c053c-f631-452a-b2c9-54ee983433a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:12.480565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d9c053c-f631-452a-b2c9-54ee983433a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:12.488546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-c8dc47fe-3a57-4c08-9070-2427c7997cac req-a784dd43-3513-42f7-b27d-2755e6145f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2c600bd-ae8d-4de9-be13-21b2fc7da275", "tag": "9d379e96-f275-493b-a7ff-e217784782ce"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:12.493989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d9c053c-f631-452a-b2c9-54ee983433a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:12.494605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d9c053c-f631-452a-b2c9-54ee983433a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:12.495549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d9c053c-f631-452a-b2c9-54ee983433a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:12.496104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d9c053c-f631-452a-b2c9-54ee983433a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:12.496599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d9c053c-f631-452a-b2c9-54ee983433a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:12.512954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c8dc47fe-3a57-4c08-9070-2427c7997cac req-a784dd43-3513-42f7-b27d-2755e6145f2b service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:12.513553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c8dc47fe-3a57-4c08-9070-2427c7997cac req-a784dd43-3513-42f7-b27d-2755e6145f2b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:12.514018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c8dc47fe-3a57-4c08-9070-2427c7997cac req-a784dd43-3513-42f7-b27d-2755e6145f2b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:12.526710 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-c8dc47fe-3a57-4c08-9070-2427c7997cac req-a784dd43-3513-42f7-b27d-2755e6145f2b service nova] Creating event network-changed:9d379e96-f275-493b-a7ff-e217784782ce for instance e2c600bd-ae8d-4de9-be13-21b2fc7da275 on n-h2-860282-1 Oct 04 21:55:12.533080 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-c8dc47fe-3a57-4c08-9070-2427c7997cac req-a784dd43-3513-42f7-b27d-2755e6145f2b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049972 Oct 04 21:55:12.534857 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3366/6753] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:12.731911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9d9c053c-f631-452a-b2c9-54ee983433a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:12.740721 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9d9c053c-f631-452a-b2c9-54ee983433a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1562 microversion: 2.1 time: 0.272937 Oct 04 21:55:12.743344 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3388/6754] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:12 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1562 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:36.021581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=13 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:36.022501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=38 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:36.027781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dd6685d4-42ca-4cac-bd93-e536197cd0f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:36.031708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dd6685d4-42ca-4cac-bd93-e536197cd0f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:36.044387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd6685d4-42ca-4cac-bd93-e536197cd0f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:36.045269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd6685d4-42ca-4cac-bd93-e536197cd0f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:36.045806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd6685d4-42ca-4cac-bd93-e536197cd0f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:36.047493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd6685d4-42ca-4cac-bd93-e536197cd0f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:36.047919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd6685d4-42ca-4cac-bd93-e536197cd0f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:36.049150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd6685d4-42ca-4cac-bd93-e536197cd0f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:36.115106 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dd6685d4-42ca-4cac-bd93-e536197cd0f1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275/action" status: 200 len: 24573 microversion: 2.1 time: 0.097875 Oct 04 21:55:36.116029 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3367/6755] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:55:36 2022] POST /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275/action => generated 24573 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:55:47.059170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-78e3d53f-2882-453d-991a-2f684f46da0f tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:47.059798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-78e3d53f-2882-453d-991a-2f684f46da0f tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:47.062626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=15 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:47.063376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=37 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:47.068406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78e3d53f-2882-453d-991a-2f684f46da0f tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:47.068976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78e3d53f-2882-453d-991a-2f684f46da0f tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:47.069512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78e3d53f-2882-453d-991a-2f684f46da0f tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:47.070182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78e3d53f-2882-453d-991a-2f684f46da0f tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:47.070651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78e3d53f-2882-453d-991a-2f684f46da0f tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:47.071094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78e3d53f-2882-453d-991a-2f684f46da0f tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:47.210008 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-78e3d53f-2882-453d-991a-2f684f46da0f tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1832 microversion: 2.1 time: 0.155008 Oct 04 21:55:47.210594 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3389/6756] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:47 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1832 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:47.234805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-00a7329f-a11c-4cb1-84bb-cc50814bde12 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:47.235531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-00a7329f-a11c-4cb1-84bb-cc50814bde12 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:47.238592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:47.239229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:47.244232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00a7329f-a11c-4cb1-84bb-cc50814bde12 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:47.244765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00a7329f-a11c-4cb1-84bb-cc50814bde12 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:47.245206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00a7329f-a11c-4cb1-84bb-cc50814bde12 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:47.245930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00a7329f-a11c-4cb1-84bb-cc50814bde12 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:47.246388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00a7329f-a11c-4cb1-84bb-cc50814bde12 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:47.246819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00a7329f-a11c-4cb1-84bb-cc50814bde12 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:47.381811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-00a7329f-a11c-4cb1-84bb-cc50814bde12 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:47.389763 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-00a7329f-a11c-4cb1-84bb-cc50814bde12 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1681 microversion: 2.1 time: 0.159260 Oct 04 21:55:47.390331 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3368/6757] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:47 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:47.492833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-38033bb9-5ed6-48f7-8e29-8a79ec1b47eb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:47.495121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-38033bb9-5ed6-48f7-8e29-8a79ec1b47eb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:47.501243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38033bb9-5ed6-48f7-8e29-8a79ec1b47eb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:47.501788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38033bb9-5ed6-48f7-8e29-8a79ec1b47eb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:47.502250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38033bb9-5ed6-48f7-8e29-8a79ec1b47eb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:47.503645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38033bb9-5ed6-48f7-8e29-8a79ec1b47eb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:47.504380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38033bb9-5ed6-48f7-8e29-8a79ec1b47eb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:47.504837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38033bb9-5ed6-48f7-8e29-8a79ec1b47eb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:47.563628 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-38033bb9-5ed6-48f7-8e29-8a79ec1b47eb tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275/action" status: 200 len: 32640 microversion: 2.1 time: 0.074665 Oct 04 21:55:47.564372 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3390/6758] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:55:47 2022] POST /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275/action => generated 32640 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:55:47.792656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b43862da-2e66-46ba-9dcf-d0cedbb01b1b tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:47.793557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b43862da-2e66-46ba-9dcf-d0cedbb01b1b tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:47.801617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b43862da-2e66-46ba-9dcf-d0cedbb01b1b tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:47.803205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b43862da-2e66-46ba-9dcf-d0cedbb01b1b tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:47.803205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b43862da-2e66-46ba-9dcf-d0cedbb01b1b tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:47.803654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b43862da-2e66-46ba-9dcf-d0cedbb01b1b tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:47.804111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b43862da-2e66-46ba-9dcf-d0cedbb01b1b tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:47.804537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b43862da-2e66-46ba-9dcf-d0cedbb01b1b tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:47.837669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b43862da-2e66-46ba-9dcf-d0cedbb01b1b tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4a44252f3b2e4911a2dfa61c745bd31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3296ab8b6922491896e649bc2380c942', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:47.838630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b43862da-2e66-46ba-9dcf-d0cedbb01b1b tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] flavor_id is None. Assuming migration. {{(pid=122758) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 21:55:47.839377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b43862da-2e66-46ba-9dcf-d0cedbb01b1b tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122758) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:55:48.142481 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b43862da-2e66-46ba-9dcf-d0cedbb01b1b tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275/action" status: 202 len: 0 microversion: 2.1 time: 0.353824 Oct 04 21:55:48.143364 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3369/6759] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:55:47 2022] POST /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:55:48.154399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4d990316-ea7d-4aba-b5ec-b989eaf4854e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:48.155015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4d990316-ea7d-4aba-b5ec-b989eaf4854e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:48.164262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d990316-ea7d-4aba-b5ec-b989eaf4854e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:48.164781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d990316-ea7d-4aba-b5ec-b989eaf4854e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:48.165221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d990316-ea7d-4aba-b5ec-b989eaf4854e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:48.165976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d990316-ea7d-4aba-b5ec-b989eaf4854e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:48.166450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d990316-ea7d-4aba-b5ec-b989eaf4854e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:48.166968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d990316-ea7d-4aba-b5ec-b989eaf4854e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:48.334761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4d990316-ea7d-4aba-b5ec-b989eaf4854e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:48.346205 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4d990316-ea7d-4aba-b5ec-b989eaf4854e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1690 microversion: 2.1 time: 0.197454 Oct 04 21:55:48.347369 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3391/6760] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:48 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1690 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:49.373093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-672afd2b-d9b9-4c95-baae-7560d1b937be tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:49.373765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-672afd2b-d9b9-4c95-baae-7560d1b937be tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:49.381846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-672afd2b-d9b9-4c95-baae-7560d1b937be tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:49.382345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-672afd2b-d9b9-4c95-baae-7560d1b937be tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:49.382793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-672afd2b-d9b9-4c95-baae-7560d1b937be tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:49.383502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-672afd2b-d9b9-4c95-baae-7560d1b937be tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:49.383994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-672afd2b-d9b9-4c95-baae-7560d1b937be tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:49.384434 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-672afd2b-d9b9-4c95-baae-7560d1b937be tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:49.522068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-672afd2b-d9b9-4c95-baae-7560d1b937be tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:49.530633 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-672afd2b-d9b9-4c95-baae-7560d1b937be tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1690 microversion: 2.1 time: 0.162369 Oct 04 21:55:49.531215 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3370/6761] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:49 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:50.555555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-37429ed1-ae19-417e-8aad-2df25e616d65 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:50.556299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-37429ed1-ae19-417e-8aad-2df25e616d65 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:50.563476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37429ed1-ae19-417e-8aad-2df25e616d65 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:50.563982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37429ed1-ae19-417e-8aad-2df25e616d65 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:50.564440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37429ed1-ae19-417e-8aad-2df25e616d65 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:50.565145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37429ed1-ae19-417e-8aad-2df25e616d65 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:50.565680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37429ed1-ae19-417e-8aad-2df25e616d65 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:50.566243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37429ed1-ae19-417e-8aad-2df25e616d65 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:50.803473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-37429ed1-ae19-417e-8aad-2df25e616d65 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:50.811473 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-37429ed1-ae19-417e-8aad-2df25e616d65 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1690 microversion: 2.1 time: 0.259828 Oct 04 21:55:50.812057 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3392/6762] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:50 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1690 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:51.836172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5f4ae480-dfbd-456c-a4b4-dee07cc27126 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:51.836714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5f4ae480-dfbd-456c-a4b4-dee07cc27126 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:51.843645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f4ae480-dfbd-456c-a4b4-dee07cc27126 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:51.844034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f4ae480-dfbd-456c-a4b4-dee07cc27126 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:51.844477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f4ae480-dfbd-456c-a4b4-dee07cc27126 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:51.845173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f4ae480-dfbd-456c-a4b4-dee07cc27126 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:51.845664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f4ae480-dfbd-456c-a4b4-dee07cc27126 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:51.846098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f4ae480-dfbd-456c-a4b4-dee07cc27126 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:51.977497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5f4ae480-dfbd-456c-a4b4-dee07cc27126 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:51.985246 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5f4ae480-dfbd-456c-a4b4-dee07cc27126 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1695 microversion: 2.1 time: 0.153234 Oct 04 21:55:51.985858 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3371/6763] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:51 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:53.009895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fb2bb0d2-8095-4308-8d62-fc5304bfcbb5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:53.010528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fb2bb0d2-8095-4308-8d62-fc5304bfcbb5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:53.017379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb2bb0d2-8095-4308-8d62-fc5304bfcbb5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:53.017910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb2bb0d2-8095-4308-8d62-fc5304bfcbb5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:53.018366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb2bb0d2-8095-4308-8d62-fc5304bfcbb5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:53.019587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb2bb0d2-8095-4308-8d62-fc5304bfcbb5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:53.020056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb2bb0d2-8095-4308-8d62-fc5304bfcbb5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:53.020498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fb2bb0d2-8095-4308-8d62-fc5304bfcbb5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:53.154823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fb2bb0d2-8095-4308-8d62-fc5304bfcbb5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:53.162679 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fb2bb0d2-8095-4308-8d62-fc5304bfcbb5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1695 microversion: 2.1 time: 0.156722 Oct 04 21:55:53.163257 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3393/6764] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:53 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:54.199134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-62adbc11-d355-4171-a6b6-7162cee2b786 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:54.199751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-62adbc11-d355-4171-a6b6-7162cee2b786 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:54.207459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62adbc11-d355-4171-a6b6-7162cee2b786 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:54.210067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62adbc11-d355-4171-a6b6-7162cee2b786 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:54.210067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62adbc11-d355-4171-a6b6-7162cee2b786 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:54.210067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62adbc11-d355-4171-a6b6-7162cee2b786 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:54.210067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62adbc11-d355-4171-a6b6-7162cee2b786 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:54.210067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62adbc11-d355-4171-a6b6-7162cee2b786 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:54.349093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-62adbc11-d355-4171-a6b6-7162cee2b786 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:54.356817 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-62adbc11-d355-4171-a6b6-7162cee2b786 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1695 microversion: 2.1 time: 0.161887 Oct 04 21:55:54.357398 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3372/6765] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:54 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:55.381172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5337c3be-047f-40c1-8f12-7d5c002ab418 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:55.381836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5337c3be-047f-40c1-8f12-7d5c002ab418 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:55.388730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5337c3be-047f-40c1-8f12-7d5c002ab418 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:55.389238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5337c3be-047f-40c1-8f12-7d5c002ab418 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:55.389753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5337c3be-047f-40c1-8f12-7d5c002ab418 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:55.390508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5337c3be-047f-40c1-8f12-7d5c002ab418 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:55.390982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5337c3be-047f-40c1-8f12-7d5c002ab418 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:55.391433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5337c3be-047f-40c1-8f12-7d5c002ab418 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:55.528955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5337c3be-047f-40c1-8f12-7d5c002ab418 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:55.536929 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5337c3be-047f-40c1-8f12-7d5c002ab418 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1695 microversion: 2.1 time: 0.160136 Oct 04 21:55:55.537547 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3394/6766] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:55 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:56.560112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4ec506c1-79a8-4f4e-8c62-12bae844fcd5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:56.560740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4ec506c1-79a8-4f4e-8c62-12bae844fcd5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:56.568916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ec506c1-79a8-4f4e-8c62-12bae844fcd5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:56.569404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ec506c1-79a8-4f4e-8c62-12bae844fcd5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:56.569864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ec506c1-79a8-4f4e-8c62-12bae844fcd5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:56.570553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ec506c1-79a8-4f4e-8c62-12bae844fcd5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:56.571010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ec506c1-79a8-4f4e-8c62-12bae844fcd5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:56.571434 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ec506c1-79a8-4f4e-8c62-12bae844fcd5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:56.702352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4ec506c1-79a8-4f4e-8c62-12bae844fcd5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:56.710605 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4ec506c1-79a8-4f4e-8c62-12bae844fcd5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1695 microversion: 2.1 time: 0.154351 Oct 04 21:55:56.711176 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3373/6767] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:56 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:57.734135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7899f38d-8fa2-4f4a-be2c-ad9d4c5b7b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:57.734763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7899f38d-8fa2-4f4a-be2c-ad9d4c5b7b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:57.742008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7899f38d-8fa2-4f4a-be2c-ad9d4c5b7b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:57.742510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7899f38d-8fa2-4f4a-be2c-ad9d4c5b7b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:57.742965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7899f38d-8fa2-4f4a-be2c-ad9d4c5b7b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:57.743663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7899f38d-8fa2-4f4a-be2c-ad9d4c5b7b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:57.744133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7899f38d-8fa2-4f4a-be2c-ad9d4c5b7b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:57.744599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7899f38d-8fa2-4f4a-be2c-ad9d4c5b7b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:57.875163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7899f38d-8fa2-4f4a-be2c-ad9d4c5b7b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:57.883703 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7899f38d-8fa2-4f4a-be2c-ad9d4c5b7b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1695 microversion: 2.1 time: 0.153474 Oct 04 21:55:57.884283 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3395/6768] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:57 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:58.907672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-33513668-bc0c-4e25-9232-622156529a6a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:58.908291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-33513668-bc0c-4e25-9232-622156529a6a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:58.916219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33513668-bc0c-4e25-9232-622156529a6a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:58.916714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33513668-bc0c-4e25-9232-622156529a6a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:58.917157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33513668-bc0c-4e25-9232-622156529a6a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:58.917897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33513668-bc0c-4e25-9232-622156529a6a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:58.918361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33513668-bc0c-4e25-9232-622156529a6a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:58.918793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-33513668-bc0c-4e25-9232-622156529a6a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:59.056996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-33513668-bc0c-4e25-9232-622156529a6a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:59.064848 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-33513668-bc0c-4e25-9232-622156529a6a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1695 microversion: 2.1 time: 0.161263 Oct 04 21:55:59.066133 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3374/6769] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:58 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:00.089044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-38687ea0-8436-4561-bc31-03d63721aac7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:00.089611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-38687ea0-8436-4561-bc31-03d63721aac7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:00.096492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38687ea0-8436-4561-bc31-03d63721aac7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:00.097001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38687ea0-8436-4561-bc31-03d63721aac7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:00.097487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38687ea0-8436-4561-bc31-03d63721aac7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:00.098203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38687ea0-8436-4561-bc31-03d63721aac7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:00.098683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38687ea0-8436-4561-bc31-03d63721aac7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:00.099132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38687ea0-8436-4561-bc31-03d63721aac7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:00.235642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-38687ea0-8436-4561-bc31-03d63721aac7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:00.244331 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-38687ea0-8436-4561-bc31-03d63721aac7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1695 microversion: 2.1 time: 0.159379 Oct 04 21:56:00.244924 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3396/6770] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:00 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:01.268270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fe0931d2-f81f-4fdc-92c8-9a31e6af452e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:01.268886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fe0931d2-f81f-4fdc-92c8-9a31e6af452e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:01.276322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe0931d2-f81f-4fdc-92c8-9a31e6af452e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:01.279275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe0931d2-f81f-4fdc-92c8-9a31e6af452e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:01.279275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe0931d2-f81f-4fdc-92c8-9a31e6af452e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:01.279275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe0931d2-f81f-4fdc-92c8-9a31e6af452e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:01.279275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe0931d2-f81f-4fdc-92c8-9a31e6af452e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:01.279275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe0931d2-f81f-4fdc-92c8-9a31e6af452e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:01.417654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fe0931d2-f81f-4fdc-92c8-9a31e6af452e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:01.426149 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fe0931d2-f81f-4fdc-92c8-9a31e6af452e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1695 microversion: 2.1 time: 0.161290 Oct 04 21:56:01.426748 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3375/6771] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:01 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:02.450995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2db44a22-d7fb-45dc-b3cb-41f9fb9ebbb6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:02.451576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2db44a22-d7fb-45dc-b3cb-41f9fb9ebbb6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:02.458857 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2db44a22-d7fb-45dc-b3cb-41f9fb9ebbb6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:02.459368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2db44a22-d7fb-45dc-b3cb-41f9fb9ebbb6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:02.459830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2db44a22-d7fb-45dc-b3cb-41f9fb9ebbb6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:02.460547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2db44a22-d7fb-45dc-b3cb-41f9fb9ebbb6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:02.461110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2db44a22-d7fb-45dc-b3cb-41f9fb9ebbb6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:02.461593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2db44a22-d7fb-45dc-b3cb-41f9fb9ebbb6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:02.596963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2db44a22-d7fb-45dc-b3cb-41f9fb9ebbb6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:02.604999 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2db44a22-d7fb-45dc-b3cb-41f9fb9ebbb6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1695 microversion: 2.1 time: 0.158382 Oct 04 21:56:02.605621 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3397/6772] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:02 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:03.628442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bbca4fc6-5636-4e02-9311-79b8883daf52 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:03.629065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bbca4fc6-5636-4e02-9311-79b8883daf52 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:03.636749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbca4fc6-5636-4e02-9311-79b8883daf52 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:03.637647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbca4fc6-5636-4e02-9311-79b8883daf52 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:03.638445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbca4fc6-5636-4e02-9311-79b8883daf52 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:03.639435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbca4fc6-5636-4e02-9311-79b8883daf52 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:03.639889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbca4fc6-5636-4e02-9311-79b8883daf52 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:03.640320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bbca4fc6-5636-4e02-9311-79b8883daf52 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:03.778286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bbca4fc6-5636-4e02-9311-79b8883daf52 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:03.786201 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bbca4fc6-5636-4e02-9311-79b8883daf52 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1695 microversion: 2.1 time: 0.161812 Oct 04 21:56:03.786788 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3376/6773] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:03 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:04.809310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-843e182c-f27d-4ae5-8d1b-608c34237e1b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:04.810090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-843e182c-f27d-4ae5-8d1b-608c34237e1b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:04.817725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-843e182c-f27d-4ae5-8d1b-608c34237e1b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:04.818226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-843e182c-f27d-4ae5-8d1b-608c34237e1b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:04.818682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-843e182c-f27d-4ae5-8d1b-608c34237e1b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:04.819471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-843e182c-f27d-4ae5-8d1b-608c34237e1b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:04.819944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-843e182c-f27d-4ae5-8d1b-608c34237e1b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:04.820473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-843e182c-f27d-4ae5-8d1b-608c34237e1b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:04.968991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-843e182c-f27d-4ae5-8d1b-608c34237e1b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:04.977567 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-843e182c-f27d-4ae5-8d1b-608c34237e1b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1695 microversion: 2.1 time: 0.171933 Oct 04 21:56:04.978149 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3398/6774] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:04 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:06.001064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a78e0506-a782-460f-bd4b-da2cdd174b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:06.001700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a78e0506-a782-460f-bd4b-da2cdd174b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:06.008955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a78e0506-a782-460f-bd4b-da2cdd174b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:06.009466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a78e0506-a782-460f-bd4b-da2cdd174b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:06.009916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a78e0506-a782-460f-bd4b-da2cdd174b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:06.010606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a78e0506-a782-460f-bd4b-da2cdd174b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:06.011058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a78e0506-a782-460f-bd4b-da2cdd174b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:06.011486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a78e0506-a782-460f-bd4b-da2cdd174b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:06.147536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a78e0506-a782-460f-bd4b-da2cdd174b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:06.155638 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a78e0506-a782-460f-bd4b-da2cdd174b7d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1695 microversion: 2.1 time: 0.158654 Oct 04 21:56:06.156222 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3377/6775] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:05 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:07.179284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-265de6ea-5e03-44ab-9b6a-0dcb03ffa679 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:07.179919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-265de6ea-5e03-44ab-9b6a-0dcb03ffa679 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:07.187206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-265de6ea-5e03-44ab-9b6a-0dcb03ffa679 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:07.192019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-265de6ea-5e03-44ab-9b6a-0dcb03ffa679 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:07.192019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-265de6ea-5e03-44ab-9b6a-0dcb03ffa679 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:07.192019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-265de6ea-5e03-44ab-9b6a-0dcb03ffa679 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:07.192019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-265de6ea-5e03-44ab-9b6a-0dcb03ffa679 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:07.192019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-265de6ea-5e03-44ab-9b6a-0dcb03ffa679 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:07.329034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-265de6ea-5e03-44ab-9b6a-0dcb03ffa679 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:07.337452 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-265de6ea-5e03-44ab-9b6a-0dcb03ffa679 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1695 microversion: 2.1 time: 0.162062 Oct 04 21:56:07.338030 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3399/6776] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:07 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:08.361467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-23e90bfe-24a0-4163-b870-bdf6273dfaba tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:08.362024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-23e90bfe-24a0-4163-b870-bdf6273dfaba tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:08.369380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23e90bfe-24a0-4163-b870-bdf6273dfaba tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:08.369961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23e90bfe-24a0-4163-b870-bdf6273dfaba tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:08.370402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23e90bfe-24a0-4163-b870-bdf6273dfaba tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:08.371098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23e90bfe-24a0-4163-b870-bdf6273dfaba tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:08.371555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23e90bfe-24a0-4163-b870-bdf6273dfaba tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:08.371982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23e90bfe-24a0-4163-b870-bdf6273dfaba tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:08.555809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-23e90bfe-24a0-4163-b870-bdf6273dfaba tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:08.564101 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-23e90bfe-24a0-4163-b870-bdf6273dfaba tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1695 microversion: 2.1 time: 0.206900 Oct 04 21:56:08.564679 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3378/6777] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:08 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1695 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:09.587818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b1bd5332-dfd2-4bec-ac23-4a0ffa10bfc0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:09.588400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b1bd5332-dfd2-4bec-ac23-4a0ffa10bfc0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:09.595820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1bd5332-dfd2-4bec-ac23-4a0ffa10bfc0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:09.596394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1bd5332-dfd2-4bec-ac23-4a0ffa10bfc0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:09.596858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1bd5332-dfd2-4bec-ac23-4a0ffa10bfc0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:09.597619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1bd5332-dfd2-4bec-ac23-4a0ffa10bfc0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:09.598140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1bd5332-dfd2-4bec-ac23-4a0ffa10bfc0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:09.598594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b1bd5332-dfd2-4bec-ac23-4a0ffa10bfc0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:09.749891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b1bd5332-dfd2-4bec-ac23-4a0ffa10bfc0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:09.759043 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b1bd5332-dfd2-4bec-ac23-4a0ffa10bfc0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1694 microversion: 2.1 time: 0.175490 Oct 04 21:56:09.761035 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3400/6778] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:09 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:09.810335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-06078c0e-58f0-494c-9d63-267b611f3459 req-08617be0-d753-46c7-9e3b-a0aa7c60dd17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2c600bd-ae8d-4de9-be13-21b2fc7da275", "name": "network-vif-unplugged", "status": "completed", "tag": "9d379e96-f275-493b-a7ff-e217784782ce"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:09.820095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-06078c0e-58f0-494c-9d63-267b611f3459 req-08617be0-d753-46c7-9e3b-a0aa7c60dd17 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:09.820814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-06078c0e-58f0-494c-9d63-267b611f3459 req-08617be0-d753-46c7-9e3b-a0aa7c60dd17 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:09.821263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-06078c0e-58f0-494c-9d63-267b611f3459 req-08617be0-d753-46c7-9e3b-a0aa7c60dd17 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:09.836192 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-06078c0e-58f0-494c-9d63-267b611f3459 req-08617be0-d753-46c7-9e3b-a0aa7c60dd17 service nova] Creating event network-vif-unplugged:9d379e96-f275-493b-a7ff-e217784782ce for instance e2c600bd-ae8d-4de9-be13-21b2fc7da275 on n-h1-860282-1 Oct 04 21:56:09.842206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-06078c0e-58f0-494c-9d63-267b611f3459 req-08617be0-d753-46c7-9e3b-a0aa7c60dd17 service nova] Instance e2c600bd-ae8d-4de9-be13-21b2fc7da275 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:56:09.854620 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-06078c0e-58f0-494c-9d63-267b611f3459 req-08617be0-d753-46c7-9e3b-a0aa7c60dd17 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118858 Oct 04 21:56:09.855338 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3379/6779] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:10.787630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a41ab721-344c-4b7c-9a88-07d02ecd9c7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:10.788291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a41ab721-344c-4b7c-9a88-07d02ecd9c7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:10.795670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a41ab721-344c-4b7c-9a88-07d02ecd9c7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:10.796167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a41ab721-344c-4b7c-9a88-07d02ecd9c7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:10.796619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a41ab721-344c-4b7c-9a88-07d02ecd9c7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:10.797333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a41ab721-344c-4b7c-9a88-07d02ecd9c7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:10.797829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a41ab721-344c-4b7c-9a88-07d02ecd9c7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:10.798333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a41ab721-344c-4b7c-9a88-07d02ecd9c7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:10.935766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a41ab721-344c-4b7c-9a88-07d02ecd9c7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:10.947166 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a41ab721-344c-4b7c-9a88-07d02ecd9c7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1694 microversion: 2.1 time: 0.163185 Oct 04 21:56:10.947779 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3401/6780] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:10 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:11.870786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-c5224a70-aa8d-4252-b878-8778e88e6ae0 req-ff851efe-9ef8-4163-b2d4-438fd08887eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2c600bd-ae8d-4de9-be13-21b2fc7da275", "tag": "9d379e96-f275-493b-a7ff-e217784782ce"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:11.881043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c5224a70-aa8d-4252-b878-8778e88e6ae0 req-ff851efe-9ef8-4163-b2d4-438fd08887eb service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:11.881450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c5224a70-aa8d-4252-b878-8778e88e6ae0 req-ff851efe-9ef8-4163-b2d4-438fd08887eb service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:11.881898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c5224a70-aa8d-4252-b878-8778e88e6ae0 req-ff851efe-9ef8-4163-b2d4-438fd08887eb service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:11.893460 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-c5224a70-aa8d-4252-b878-8778e88e6ae0 req-ff851efe-9ef8-4163-b2d4-438fd08887eb service nova] Creating event network-changed:9d379e96-f275-493b-a7ff-e217784782ce for instance e2c600bd-ae8d-4de9-be13-21b2fc7da275 on n-h1-860282-1 Oct 04 21:56:11.899361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-c5224a70-aa8d-4252-b878-8778e88e6ae0 req-ff851efe-9ef8-4163-b2d4-438fd08887eb service nova] Instance e2c600bd-ae8d-4de9-be13-21b2fc7da275 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:56:11.910384 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-c5224a70-aa8d-4252-b878-8778e88e6ae0 req-ff851efe-9ef8-4163-b2d4-438fd08887eb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044731 Oct 04 21:56:11.910979 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3380/6781] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:11.972376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7cc8c36e-5086-4317-82db-0fd65785beb0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:11.973091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7cc8c36e-5086-4317-82db-0fd65785beb0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:11.980120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7cc8c36e-5086-4317-82db-0fd65785beb0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:11.980634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7cc8c36e-5086-4317-82db-0fd65785beb0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:11.981125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7cc8c36e-5086-4317-82db-0fd65785beb0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:11.981898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7cc8c36e-5086-4317-82db-0fd65785beb0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:11.982438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7cc8c36e-5086-4317-82db-0fd65785beb0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:11.982884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7cc8c36e-5086-4317-82db-0fd65785beb0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:12.210179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7cc8c36e-5086-4317-82db-0fd65785beb0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:12.218219 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7cc8c36e-5086-4317-82db-0fd65785beb0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1692 microversion: 2.1 time: 0.249905 Oct 04 21:56:12.218926 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3402/6782] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:11 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1692 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:13.243370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5293d9b7-1b89-40d9-af8a-daabf4d37d63 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:13.244123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5293d9b7-1b89-40d9-af8a-daabf4d37d63 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:13.250466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5293d9b7-1b89-40d9-af8a-daabf4d37d63 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:13.251379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5293d9b7-1b89-40d9-af8a-daabf4d37d63 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:13.251379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5293d9b7-1b89-40d9-af8a-daabf4d37d63 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:13.252051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5293d9b7-1b89-40d9-af8a-daabf4d37d63 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:13.252507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5293d9b7-1b89-40d9-af8a-daabf4d37d63 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:13.252934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5293d9b7-1b89-40d9-af8a-daabf4d37d63 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:13.385159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5293d9b7-1b89-40d9-af8a-daabf4d37d63 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:13.393317 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5293d9b7-1b89-40d9-af8a-daabf4d37d63 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1689 microversion: 2.1 time: 0.155149 Oct 04 21:56:13.393956 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3381/6783] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:13 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:13.417140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7f6fe6d9-15dc-4ccf-baf8-f482f601d249 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:13.417726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7f6fe6d9-15dc-4ccf-baf8-f482f601d249 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:13.424721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f6fe6d9-15dc-4ccf-baf8-f482f601d249 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:13.425231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f6fe6d9-15dc-4ccf-baf8-f482f601d249 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:13.425710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f6fe6d9-15dc-4ccf-baf8-f482f601d249 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:13.426422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f6fe6d9-15dc-4ccf-baf8-f482f601d249 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:13.426895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f6fe6d9-15dc-4ccf-baf8-f482f601d249 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:13.427535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f6fe6d9-15dc-4ccf-baf8-f482f601d249 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:13.776702 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7f6fe6d9-15dc-4ccf-baf8-f482f601d249 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275/action" status: 202 len: 0 microversion: 2.1 time: 0.363509 Oct 04 21:56:13.777347 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3403/6784] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:56:13 2022] POST /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:56:13.786464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4e7ce0cd-3042-4308-8dc4-15d356e345b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:13.787865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4e7ce0cd-3042-4308-8dc4-15d356e345b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:13.794062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e7ce0cd-3042-4308-8dc4-15d356e345b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:13.794499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e7ce0cd-3042-4308-8dc4-15d356e345b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:13.794947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e7ce0cd-3042-4308-8dc4-15d356e345b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:13.795658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e7ce0cd-3042-4308-8dc4-15d356e345b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:13.796120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e7ce0cd-3042-4308-8dc4-15d356e345b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:13.796572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e7ce0cd-3042-4308-8dc4-15d356e345b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:13.936751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4e7ce0cd-3042-4308-8dc4-15d356e345b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:13.945106 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4e7ce0cd-3042-4308-8dc4-15d356e345b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1688 microversion: 2.1 time: 0.163048 Oct 04 21:56:13.945726 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3382/6785] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:13 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:14.971438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d306422a-715e-466d-96e0-d76ab5451398 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:14.972161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d306422a-715e-466d-96e0-d76ab5451398 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:14.979385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d306422a-715e-466d-96e0-d76ab5451398 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:14.979892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d306422a-715e-466d-96e0-d76ab5451398 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:14.980351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d306422a-715e-466d-96e0-d76ab5451398 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:14.981065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d306422a-715e-466d-96e0-d76ab5451398 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:14.981562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d306422a-715e-466d-96e0-d76ab5451398 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:14.982013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d306422a-715e-466d-96e0-d76ab5451398 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:14.986075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:15.116039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d306422a-715e-466d-96e0-d76ab5451398 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:15.124078 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d306422a-715e-466d-96e0-d76ab5451398 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1688 microversion: 2.1 time: 0.157709 Oct 04 21:56:15.124718 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3404/6786] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:14 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:16.148116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-73767564-8d2b-4a03-91de-1649d7bed008 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:16.148728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-73767564-8d2b-4a03-91de-1649d7bed008 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:16.156126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73767564-8d2b-4a03-91de-1649d7bed008 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:16.156631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73767564-8d2b-4a03-91de-1649d7bed008 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:16.157075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73767564-8d2b-4a03-91de-1649d7bed008 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:16.157808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73767564-8d2b-4a03-91de-1649d7bed008 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:16.158306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73767564-8d2b-4a03-91de-1649d7bed008 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:16.158740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73767564-8d2b-4a03-91de-1649d7bed008 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:16.178182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:16.299872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-73767564-8d2b-4a03-91de-1649d7bed008 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:16.310137 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-73767564-8d2b-4a03-91de-1649d7bed008 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1688 microversion: 2.1 time: 0.165919 Oct 04 21:56:16.310722 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3383/6787] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:16 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:17.336599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-655dfc56-09b0-4c7e-89d6-4c2518ba65fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:17.337232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-655dfc56-09b0-4c7e-89d6-4c2518ba65fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:17.339566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=37 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:17.344510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-655dfc56-09b0-4c7e-89d6-4c2518ba65fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:17.345011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-655dfc56-09b0-4c7e-89d6-4c2518ba65fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:17.345587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-655dfc56-09b0-4c7e-89d6-4c2518ba65fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:17.346308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-655dfc56-09b0-4c7e-89d6-4c2518ba65fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:17.346805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-655dfc56-09b0-4c7e-89d6-4c2518ba65fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:17.347245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-655dfc56-09b0-4c7e-89d6-4c2518ba65fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:17.515151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-655dfc56-09b0-4c7e-89d6-4c2518ba65fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:17.524104 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-655dfc56-09b0-4c7e-89d6-4c2518ba65fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1688 microversion: 2.1 time: 0.192883 Oct 04 21:56:17.524817 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3405/6788] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:17 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1688 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:18.038596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-882bd0ca-4e9b-4333-8600-736873cdce7f req-19e8de4b-6c3f-4d73-874d-071f589059b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2c600bd-ae8d-4de9-be13-21b2fc7da275", "tag": "9d379e96-f275-493b-a7ff-e217784782ce"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:18.045992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=35 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:18.051595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-882bd0ca-4e9b-4333-8600-736873cdce7f req-19e8de4b-6c3f-4d73-874d-071f589059b0 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:18.052134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-882bd0ca-4e9b-4333-8600-736873cdce7f req-19e8de4b-6c3f-4d73-874d-071f589059b0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:18.056530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-882bd0ca-4e9b-4333-8600-736873cdce7f req-19e8de4b-6c3f-4d73-874d-071f589059b0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:18.065234 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-882bd0ca-4e9b-4333-8600-736873cdce7f req-19e8de4b-6c3f-4d73-874d-071f589059b0 service nova] Creating event network-changed:9d379e96-f275-493b-a7ff-e217784782ce for instance e2c600bd-ae8d-4de9-be13-21b2fc7da275 on n-h2-860282-1 Oct 04 21:56:18.072339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-882bd0ca-4e9b-4333-8600-736873cdce7f req-19e8de4b-6c3f-4d73-874d-071f589059b0 service nova] Instance e2c600bd-ae8d-4de9-be13-21b2fc7da275 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:56:18.084700 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-882bd0ca-4e9b-4333-8600-736873cdce7f req-19e8de4b-6c3f-4d73-874d-071f589059b0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049145 Oct 04 21:56:18.085327 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3384/6789] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:56:18.550534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a499f893-89e8-4be7-bf0f-65c438317d59 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:18.551199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a499f893-89e8-4be7-bf0f-65c438317d59 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:18.560025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a499f893-89e8-4be7-bf0f-65c438317d59 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:18.560837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a499f893-89e8-4be7-bf0f-65c438317d59 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:18.561301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a499f893-89e8-4be7-bf0f-65c438317d59 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:18.564001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a499f893-89e8-4be7-bf0f-65c438317d59 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:18.564001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a499f893-89e8-4be7-bf0f-65c438317d59 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:18.564001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a499f893-89e8-4be7-bf0f-65c438317d59 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:18.710737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a499f893-89e8-4be7-bf0f-65c438317d59 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:18.720005 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a499f893-89e8-4be7-bf0f-65c438317d59 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1688 microversion: 2.1 time: 0.173097 Oct 04 21:56:18.720725 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3406/6790] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:18 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:19.746121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6def593d-e52c-417a-bd18-92a1b8c796ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:19.746806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6def593d-e52c-417a-bd18-92a1b8c796ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:19.753291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6def593d-e52c-417a-bd18-92a1b8c796ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:19.753831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6def593d-e52c-417a-bd18-92a1b8c796ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:19.754272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6def593d-e52c-417a-bd18-92a1b8c796ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:19.755054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6def593d-e52c-417a-bd18-92a1b8c796ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:19.756415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6def593d-e52c-417a-bd18-92a1b8c796ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:19.756842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6def593d-e52c-417a-bd18-92a1b8c796ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:19.955278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6def593d-e52c-417a-bd18-92a1b8c796ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:19.963680 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6def593d-e52c-417a-bd18-92a1b8c796ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1688 microversion: 2.1 time: 0.223124 Oct 04 21:56:19.964269 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3385/6791] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:19 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1688 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:20.996671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-079d207b-0d3b-4044-a977-2b015a064326 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:20.997307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-079d207b-0d3b-4044-a977-2b015a064326 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:21.004331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-079d207b-0d3b-4044-a977-2b015a064326 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:21.004827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-079d207b-0d3b-4044-a977-2b015a064326 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:21.005856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-079d207b-0d3b-4044-a977-2b015a064326 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:21.006558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-079d207b-0d3b-4044-a977-2b015a064326 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:21.007032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-079d207b-0d3b-4044-a977-2b015a064326 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:21.007472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-079d207b-0d3b-4044-a977-2b015a064326 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:21.196571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-079d207b-0d3b-4044-a977-2b015a064326 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:21.204500 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-079d207b-0d3b-4044-a977-2b015a064326 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1681 microversion: 2.1 time: 0.212162 Oct 04 21:56:21.205076 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3407/6792] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:20 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:24.105048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-f75a2b14-7739-4d5d-9507-dd5c22680105 req-07d6b271-1e45-4cce-83a2-a7accad8f13a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2c600bd-ae8d-4de9-be13-21b2fc7da275", "name": "network-vif-plugged", "status": "completed", "tag": "9d379e96-f275-493b-a7ff-e217784782ce"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:24.116210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f75a2b14-7739-4d5d-9507-dd5c22680105 req-07d6b271-1e45-4cce-83a2-a7accad8f13a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:24.116696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f75a2b14-7739-4d5d-9507-dd5c22680105 req-07d6b271-1e45-4cce-83a2-a7accad8f13a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:24.117132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f75a2b14-7739-4d5d-9507-dd5c22680105 req-07d6b271-1e45-4cce-83a2-a7accad8f13a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:24.128386 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-f75a2b14-7739-4d5d-9507-dd5c22680105 req-07d6b271-1e45-4cce-83a2-a7accad8f13a service nova] Creating event network-vif-plugged:9d379e96-f275-493b-a7ff-e217784782ce for instance e2c600bd-ae8d-4de9-be13-21b2fc7da275 on n-h2-860282-1 Oct 04 21:56:24.133368 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-f75a2b14-7739-4d5d-9507-dd5c22680105 req-07d6b271-1e45-4cce-83a2-a7accad8f13a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032247 Oct 04 21:56:24.134074 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3386/6793] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:47.431987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5afdbbc7-833e-4755-ac2d-86cd589697fd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:47.434196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5afdbbc7-833e-4755-ac2d-86cd589697fd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:47.436804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=5 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:47.437554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=23 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:47.442345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5afdbbc7-833e-4755-ac2d-86cd589697fd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:47.442829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5afdbbc7-833e-4755-ac2d-86cd589697fd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:47.443282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5afdbbc7-833e-4755-ac2d-86cd589697fd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:47.444387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5afdbbc7-833e-4755-ac2d-86cd589697fd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:47.444490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5afdbbc7-833e-4755-ac2d-86cd589697fd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:47.444871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5afdbbc7-833e-4755-ac2d-86cd589697fd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:47.507926 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5afdbbc7-833e-4755-ac2d-86cd589697fd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275/action" status: 200 len: 63091 microversion: 2.1 time: 0.080070 Oct 04 21:56:47.508600 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3408/6794] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:56:47 2022] POST /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275/action => generated 63091 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:56:53.724627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=5 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:53.725766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=14 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:53.729340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a4b5d21d-f018-4e23-b62a-db7ce110d274 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:53.730073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a4b5d21d-f018-4e23-b62a-db7ce110d274 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:53.736812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4b5d21d-f018-4e23-b62a-db7ce110d274 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:53.737405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4b5d21d-f018-4e23-b62a-db7ce110d274 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:53.737878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4b5d21d-f018-4e23-b62a-db7ce110d274 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:53.738578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4b5d21d-f018-4e23-b62a-db7ce110d274 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:53.739039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4b5d21d-f018-4e23-b62a-db7ce110d274 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:53.739470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a4b5d21d-f018-4e23-b62a-db7ce110d274 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:53.873082 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a4b5d21d-f018-4e23-b62a-db7ce110d274 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1832 microversion: 2.1 time: 0.150111 Oct 04 21:56:53.873713 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3387/6795] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:53 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1832 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:54.902865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a6369d95-7afc-413e-9bcd-42e72e379352 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:54.903541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a6369d95-7afc-413e-9bcd-42e72e379352 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:54.904234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-3bb2796d-2671-4480-a4ac-9c8fef960877 req-2d074ee7-a7db-400f-8c42-d7fd842434c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2c600bd-ae8d-4de9-be13-21b2fc7da275", "tag": "9d379e96-f275-493b-a7ff-e217784782ce"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:54.911359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6369d95-7afc-413e-9bcd-42e72e379352 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:54.912148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6369d95-7afc-413e-9bcd-42e72e379352 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:54.912608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6369d95-7afc-413e-9bcd-42e72e379352 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:54.913321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6369d95-7afc-413e-9bcd-42e72e379352 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:54.914022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6369d95-7afc-413e-9bcd-42e72e379352 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:54.914462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6369d95-7afc-413e-9bcd-42e72e379352 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:54.915422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3bb2796d-2671-4480-a4ac-9c8fef960877 req-2d074ee7-a7db-400f-8c42-d7fd842434c0 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:54.916144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3bb2796d-2671-4480-a4ac-9c8fef960877 req-2d074ee7-a7db-400f-8c42-d7fd842434c0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:54.916586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3bb2796d-2671-4480-a4ac-9c8fef960877 req-2d074ee7-a7db-400f-8c42-d7fd842434c0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:54.928386 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-3bb2796d-2671-4480-a4ac-9c8fef960877 req-2d074ee7-a7db-400f-8c42-d7fd842434c0 service nova] Creating event network-changed:9d379e96-f275-493b-a7ff-e217784782ce for instance e2c600bd-ae8d-4de9-be13-21b2fc7da275 on n-h2-860282-1 Oct 04 21:56:54.933832 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-3bb2796d-2671-4480-a4ac-9c8fef960877 req-2d074ee7-a7db-400f-8c42-d7fd842434c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033674 Oct 04 21:56:54.935129 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3388/6796] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:56:54.943980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a6369d95-7afc-413e-9bcd-42e72e379352 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:56:55.229271 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a6369d95-7afc-413e-9bcd-42e72e379352 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 204 len: 0 microversion: 2.1 time: 0.330677 Oct 04 21:56:55.240394 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3409/6797] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:56:54 2022] DELETE /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:56:55.244950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9ee1e2d6-fbfa-43a0-b18b-f2c564badb5f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:55.245756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9ee1e2d6-fbfa-43a0-b18b-f2c564badb5f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:55.253272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ee1e2d6-fbfa-43a0-b18b-f2c564badb5f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:55.253826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ee1e2d6-fbfa-43a0-b18b-f2c564badb5f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:55.254397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ee1e2d6-fbfa-43a0-b18b-f2c564badb5f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:55.255039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ee1e2d6-fbfa-43a0-b18b-f2c564badb5f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:55.255508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ee1e2d6-fbfa-43a0-b18b-f2c564badb5f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:55.255946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ee1e2d6-fbfa-43a0-b18b-f2c564badb5f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:55.398832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9ee1e2d6-fbfa-43a0-b18b-f2c564badb5f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:55.408087 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9ee1e2d6-fbfa-43a0-b18b-f2c564badb5f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1687 microversion: 2.1 time: 0.170278 Oct 04 21:56:55.408824 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3389/6798] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:55 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:56.432505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c1e111ee-7683-426a-bcc4-feed2e8b60f3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:56.433229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c1e111ee-7683-426a-bcc4-feed2e8b60f3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:56.441191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1e111ee-7683-426a-bcc4-feed2e8b60f3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:56.441732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1e111ee-7683-426a-bcc4-feed2e8b60f3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:56.442210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1e111ee-7683-426a-bcc4-feed2e8b60f3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:56.442946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1e111ee-7683-426a-bcc4-feed2e8b60f3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:56.443414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1e111ee-7683-426a-bcc4-feed2e8b60f3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:56.443855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1e111ee-7683-426a-bcc4-feed2e8b60f3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:56.680927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c1e111ee-7683-426a-bcc4-feed2e8b60f3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:56.689171 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c1e111ee-7683-426a-bcc4-feed2e8b60f3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 200 len: 1687 microversion: 2.1 time: 0.261036 Oct 04 21:56:56.689772 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3410/6799] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:56 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 1687 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:57.165683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-35039d40-b97e-4940-ace8-0cc0b0973d19 req-1129ce65-3ecd-4661-a15d-79fcc6687664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2c600bd-ae8d-4de9-be13-21b2fc7da275", "name": "network-vif-deleted", "tag": "9d379e96-f275-493b-a7ff-e217784782ce"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:57.176802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-35039d40-b97e-4940-ace8-0cc0b0973d19 req-1129ce65-3ecd-4661-a15d-79fcc6687664 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:57.177336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-35039d40-b97e-4940-ace8-0cc0b0973d19 req-1129ce65-3ecd-4661-a15d-79fcc6687664 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:57.177803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-35039d40-b97e-4940-ace8-0cc0b0973d19 req-1129ce65-3ecd-4661-a15d-79fcc6687664 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:57.189111 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-35039d40-b97e-4940-ace8-0cc0b0973d19 req-1129ce65-3ecd-4661-a15d-79fcc6687664 service nova] Creating event network-vif-deleted:9d379e96-f275-493b-a7ff-e217784782ce for instance e2c600bd-ae8d-4de9-be13-21b2fc7da275 on n-h2-860282-1 Oct 04 21:56:57.194519 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-35039d40-b97e-4940-ace8-0cc0b0973d19 req-1129ce65-3ecd-4661-a15d-79fcc6687664 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032377 Oct 04 21:56:57.194911 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3390/6800] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:57.719655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab3f7078-336b-43be-aa32-846aacd3f0c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:57.719655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ab3f7078-336b-43be-aa32-846aacd3f0c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: e2c600bd-ae8d-4de9-be13-21b2fc7da275] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:57.726313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab3f7078-336b-43be-aa32-846aacd3f0c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:57.726815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab3f7078-336b-43be-aa32-846aacd3f0c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:57.727268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab3f7078-336b-43be-aa32-846aacd3f0c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:57.727974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab3f7078-336b-43be-aa32-846aacd3f0c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:57.728443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab3f7078-336b-43be-aa32-846aacd3f0c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:57.728940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ab3f7078-336b-43be-aa32-846aacd3f0c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:57.743915 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-ab3f7078-336b-43be-aa32-846aacd3f0c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] HTTP exception thrown: Instance e2c600bd-ae8d-4de9-be13-21b2fc7da275 could not be found. Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab3f7078-336b-43be-aa32-846aacd3f0c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Request method failure captured: Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 HTTP/1.1 Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKsg9wdsQpKRxIYoCO18EnGkiXvFaK3Y37dAKXCvkpYNlW5hI6Th3vwXBScO1z15nuZq6dcbLpHb4UAi01qVzCkAXMzlesG1frtWG0k1ymFc191M4FAp7BOhLPARXjbwQP08vsZYIaM8TzkponyUyXqAm9ryQobG9UgDnWq6vToxOSs Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 187e190360d14111a4107866a8000348 Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-875125608 Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/187e190360d14111a4107866a8000348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_187e190360d14111a4107866a8000348"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/187e190360d14111a4107866a8000348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/187e190360d14111a4107866a8000348"}]}] Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestNetworkAdvancedServerOps-875125608 Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 187e190360d14111a4107866a8000348 Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-875125608 Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestNetworkAdvancedServerOps-875125608-project Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 8c893eb5126c4c9db1012c199660261c Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestNetworkAdvancedServerOps-875125608-project Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance e2c600bd-ae8d-4de9-be13-21b2fc7da275 could not be found. Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'e2c600bd-ae8d-4de9-be13-21b2fc7da275'} Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2c600bd-ae8d-4de9-be13-21b2fc7da275 could not be found. Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2c600bd-ae8d-4de9-be13-21b2fc7da275 could not be found. Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:56:57.745600 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:57.752383 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:56:57.752383 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:57.752383 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:57.752383 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:57.752383 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:57.752383 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:57.752383 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2c600bd-ae8d-4de9-be13-21b2fc7da275 could not be found. Oct 04 21:56:57.752383 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:56:57.752383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ab3f7078-336b-43be-aa32-846aacd3f0c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Returning 404 to user: Instance e2c600bd-ae8d-4de9-be13-21b2fc7da275 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:57.752383 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ab3f7078-336b-43be-aa32-846aacd3f0c3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275" status: 404 len: 111 microversion: 2.1 time: 0.033079 Oct 04 21:56:57.752383 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3411/6801] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:57 2022] GET /compute/v2.1/servers/e2c600bd-ae8d-4de9-be13-21b2fc7da275 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:57:01.205925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a3c49ad8-9f71-47eb-8183-046c6c44c64a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '.version_select at 0x7f5790b3d9d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:01.211404 n-d-860282-1 devstack@n-api.service[122758]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a3c49ad8-9f71-47eb-8183-046c6c44c64a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [0d4cfe8b-c4a0-4542-b631-61044cdf0f0d] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:57:02.221600 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [None req-a3c49ad8-9f71-47eb-8183-046c6c44c64a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [0d4cfe8b-c4a0-4542-b631-61044cdf0f0d] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 33976. Oct 04 21:57:02.309922 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a3c49ad8-9f71-47eb-8183-046c6c44c64a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-725748620" status: 202 len: 0 microversion: 2.1 time: 1.109003 Oct 04 21:57:02.310514 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3391/6802] 10.222.0.30 () {58 vars in 1281 bytes} [Tue Oct 4 21:57:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-725748620 => generated 0 bytes in 1111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:57:02.348174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fbb47fd6-a45e-45a4-ae07-21721124e182 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'create', calling method: .version_select at 0x7f578b53d3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1367819598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/qzNKxg8SCWwqeNWA5t/2x6CvQsLeOjT5Eyg5VUQ9dHUzJb6v+Mt06UXMVu3reKHHMQBbcZXU3cjgbnlxAc4T41BjWbGuSe+HzRniulV4yT1WYEKwuAM0A7IByqusz9w=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:02.364881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-fbb47fd6-a45e-45a4-ae07-21721124e182 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Getting quotas for project 187e190360d14111a4107866a8000348. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:57:02.371406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-fbb47fd6-a45e-45a4-ae07-21721124e182 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Getting quotas for user 8c893eb5126c4c9db1012c199660261c and project 187e190360d14111a4107866a8000348. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:57:02.480961 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fbb47fd6-a45e-45a4-ae07-21721124e182 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.136705 Oct 04 21:57:02.481536 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3412/6803] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:57:02 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:10.458305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=16 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:10.464086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9eed9591-2bab-4d3a-bdd0-f357679ab54e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-590101021", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "1227d6de-4962-4fd3-940e-788a65f2592c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1367819598", "security_groups": [{"name": "tempest-secgroup-smoke-2024848382"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:10.657596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-9eed9591-2bab-4d3a-bdd0-f357679ab54e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] validate_networks() for [('1227d6de-4962-4fd3-940e-788a65f2592c', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:57:11.193129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-9eed9591-2bab-4d3a-bdd0-f357679ab54e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:57:11.194169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-9eed9591-2bab-4d3a-bdd0-f357679ab54e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:57:11.194813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-9eed9591-2bab-4d3a-bdd0-f357679ab54e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:57:11.195463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-9eed9591-2bab-4d3a-bdd0-f357679ab54e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:57:11.196105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-9eed9591-2bab-4d3a-bdd0-f357679ab54e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:57:11.213768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9eed9591-2bab-4d3a-bdd0-f357679ab54e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:11.214508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9eed9591-2bab-4d3a-bdd0-f357679ab54e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:11.215592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9eed9591-2bab-4d3a-bdd0-f357679ab54e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:11.216860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9eed9591-2bab-4d3a-bdd0-f357679ab54e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:11.218033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9eed9591-2bab-4d3a-bdd0-f357679ab54e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:11.218705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9eed9591-2bab-4d3a-bdd0-f357679ab54e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:11.233965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cb2badf5-7622-45d3-8a0b-087e6a55c61b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:11.244813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cb2badf5-7622-45d3-8a0b-087e6a55c61b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:11.244813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:11.248696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb2badf5-7622-45d3-8a0b-087e6a55c61b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:11.250279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb2badf5-7622-45d3-8a0b-087e6a55c61b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:11.253410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb2badf5-7622-45d3-8a0b-087e6a55c61b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:11.255478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb2badf5-7622-45d3-8a0b-087e6a55c61b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:11.257739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb2badf5-7622-45d3-8a0b-087e6a55c61b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:11.258387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cb2badf5-7622-45d3-8a0b-087e6a55c61b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:11.274395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-9eed9591-2bab-4d3a-bdd0-f357679ab54e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Getting quotas for project 187e190360d14111a4107866a8000348. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:57:11.298273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-9eed9591-2bab-4d3a-bdd0-f357679ab54e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Getting quotas for user 8c893eb5126c4c9db1012c199660261c and project 187e190360d14111a4107866a8000348. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:57:11.332615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9eed9591-2bab-4d3a-bdd0-f357679ab54e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:57:11.335464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cb2badf5-7622-45d3-8a0b-087e6a55c61b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:57:11.347295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9eed9591-2bab-4d3a-bdd0-f357679ab54e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:57:11.551205 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9eed9591-2bab-4d3a-bdd0-f357679ab54e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.094401 Oct 04 21:57:11.560774 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3392/6804] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:57:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:57:11.567227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-1f6fb75e-619b-4087-8fd5-1f9231e3e05e req-f24d45eb-1719-4ceb-9640-bf2a2adce9cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b9b0b92-1590-4bcc-92a6-a32d334e928a", "tag": "6815e25b-b290-4f38-97ec-1d6ff6f78a46"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:11.577867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1f6fb75e-619b-4087-8fd5-1f9231e3e05e req-f24d45eb-1719-4ceb-9640-bf2a2adce9cb service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:11.578673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1f6fb75e-619b-4087-8fd5-1f9231e3e05e req-f24d45eb-1719-4ceb-9640-bf2a2adce9cb service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:11.579427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1f6fb75e-619b-4087-8fd5-1f9231e3e05e req-f24d45eb-1719-4ceb-9640-bf2a2adce9cb service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:11.623322 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-1f6fb75e-619b-4087-8fd5-1f9231e3e05e req-f24d45eb-1719-4ceb-9640-bf2a2adce9cb service nova] Creating event network-changed:6815e25b-b290-4f38-97ec-1d6ff6f78a46 for instance 9b9b0b92-1590-4bcc-92a6-a32d334e928a on n-h1-860282-1 Oct 04 21:57:11.635021 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-1f6fb75e-619b-4087-8fd5-1f9231e3e05e req-f24d45eb-1719-4ceb-9640-bf2a2adce9cb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072292 Oct 04 21:57:11.638467 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3393/6805] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:11.662644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0df8c5ed-64aa-4407-9ced-21bdb8bed71b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:11.666713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0df8c5ed-64aa-4407-9ced-21bdb8bed71b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:11.767888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0df8c5ed-64aa-4407-9ced-21bdb8bed71b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:11.777781 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0df8c5ed-64aa-4407-9ced-21bdb8bed71b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1266 microversion: 2.1 time: 0.136423 Oct 04 21:57:11.781552 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3394/6806] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:11 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:11.822806 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cb2badf5-7622-45d3-8a0b-087e6a55c61b tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 204 len: 0 microversion: 2.1 time: 0.594850 Oct 04 21:57:11.823414 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3413/6807] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:57:11 2022] DELETE /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:57:11.833485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-65047f3f-9236-4820-b501-cf656715214d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:11.834226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-65047f3f-9236-4820-b501-cf656715214d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:11.845738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65047f3f-9236-4820-b501-cf656715214d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:11.846258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65047f3f-9236-4820-b501-cf656715214d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:11.846716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65047f3f-9236-4820-b501-cf656715214d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:11.847485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65047f3f-9236-4820-b501-cf656715214d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:11.847902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65047f3f-9236-4820-b501-cf656715214d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:11.852372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65047f3f-9236-4820-b501-cf656715214d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:12.029949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-65047f3f-9236-4820-b501-cf656715214d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:12.039490 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-65047f3f-9236-4820-b501-cf656715214d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1576 microversion: 2.1 time: 0.211639 Oct 04 21:57:12.040521 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3395/6808] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:11 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1576 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:12.801297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9369208d-2a9f-4357-9965-227c516a103b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:12.802049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9369208d-2a9f-4357-9965-227c516a103b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:12.804870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:12.810316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9369208d-2a9f-4357-9965-227c516a103b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:12.810828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9369208d-2a9f-4357-9965-227c516a103b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:12.811279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9369208d-2a9f-4357-9965-227c516a103b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:12.811991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9369208d-2a9f-4357-9965-227c516a103b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:12.812635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9369208d-2a9f-4357-9965-227c516a103b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:12.813079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9369208d-2a9f-4357-9965-227c516a103b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:12.888340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9369208d-2a9f-4357-9965-227c516a103b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:12.896764 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9369208d-2a9f-4357-9965-227c516a103b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1270 microversion: 2.1 time: 0.100067 Oct 04 21:57:12.897359 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3414/6809] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:12 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:13.067475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-717e932c-971f-4be6-8ef4-492b4c62911f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:13.068107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-717e932c-971f-4be6-8ef4-492b4c62911f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:13.075293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-717e932c-971f-4be6-8ef4-492b4c62911f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:13.075808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-717e932c-971f-4be6-8ef4-492b4c62911f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:13.076253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-717e932c-971f-4be6-8ef4-492b4c62911f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:13.076966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-717e932c-971f-4be6-8ef4-492b4c62911f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:13.077450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-717e932c-971f-4be6-8ef4-492b4c62911f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:13.077935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-717e932c-971f-4be6-8ef4-492b4c62911f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:13.235914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-717e932c-971f-4be6-8ef4-492b4c62911f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:13.245636 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-717e932c-971f-4be6-8ef4-492b4c62911f tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1576 microversion: 2.1 time: 0.183934 Oct 04 21:57:13.246242 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3396/6810] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:13 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:13.921846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c94b6049-a46b-492f-8e48-7f78b09d1379 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:13.922601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c94b6049-a46b-492f-8e48-7f78b09d1379 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:13.932941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c94b6049-a46b-492f-8e48-7f78b09d1379 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:13.933710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c94b6049-a46b-492f-8e48-7f78b09d1379 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:13.934366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c94b6049-a46b-492f-8e48-7f78b09d1379 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:13.935925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c94b6049-a46b-492f-8e48-7f78b09d1379 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:13.936570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c94b6049-a46b-492f-8e48-7f78b09d1379 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:13.937687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c94b6049-a46b-492f-8e48-7f78b09d1379 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:14.107069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c94b6049-a46b-492f-8e48-7f78b09d1379 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:14.123013 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c94b6049-a46b-492f-8e48-7f78b09d1379 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1326 microversion: 2.1 time: 0.198771 Oct 04 21:57:14.123013 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3415/6811] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:13 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1326 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:14.271058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-22f5bf65-9f41-4fb6-9111-7cbc930e6a24 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:14.271691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-22f5bf65-9f41-4fb6-9111-7cbc930e6a24 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:14.282087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22f5bf65-9f41-4fb6-9111-7cbc930e6a24 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:14.283991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22f5bf65-9f41-4fb6-9111-7cbc930e6a24 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:14.294900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22f5bf65-9f41-4fb6-9111-7cbc930e6a24 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:14.294900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22f5bf65-9f41-4fb6-9111-7cbc930e6a24 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:14.294900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22f5bf65-9f41-4fb6-9111-7cbc930e6a24 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:14.294900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-22f5bf65-9f41-4fb6-9111-7cbc930e6a24 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:14.333154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-9efd2831-db5c-4e87-a7ef-b0cbb957abff req-a89c2bdf-5c3b-450b-9917-ea23e66cc9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9b0b92-1590-4bcc-92a6-a32d334e928a", "name": "network-vif-deleted", "tag": "6815e25b-b290-4f38-97ec-1d6ff6f78a46"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:14.346116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9efd2831-db5c-4e87-a7ef-b0cbb957abff req-a89c2bdf-5c3b-450b-9917-ea23e66cc9d4 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:14.346907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9efd2831-db5c-4e87-a7ef-b0cbb957abff req-a89c2bdf-5c3b-450b-9917-ea23e66cc9d4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:14.347520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9efd2831-db5c-4e87-a7ef-b0cbb957abff req-a89c2bdf-5c3b-450b-9917-ea23e66cc9d4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:14.364283 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-9efd2831-db5c-4e87-a7ef-b0cbb957abff req-a89c2bdf-5c3b-450b-9917-ea23e66cc9d4 service nova] Creating event network-vif-deleted:6815e25b-b290-4f38-97ec-1d6ff6f78a46 for instance 9b9b0b92-1590-4bcc-92a6-a32d334e928a on n-h1-860282-1 Oct 04 21:57:14.366176 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-9efd2831-db5c-4e87-a7ef-b0cbb957abff req-a89c2bdf-5c3b-450b-9917-ea23e66cc9d4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043786 Oct 04 21:57:14.367136 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3416/6812] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:57:14.369342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-22f5bf65-9f41-4fb6-9111-7cbc930e6a24 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:14.378091 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-22f5bf65-9f41-4fb6-9111-7cbc930e6a24 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1390 microversion: 2.1 time: 0.111263 Oct 04 21:57:14.378619 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3397/6813] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:14 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1390 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:15.145027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-efcfb369-f046-4fac-9843-06cba3288698 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:15.145794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-efcfb369-f046-4fac-9843-06cba3288698 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:15.155446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efcfb369-f046-4fac-9843-06cba3288698 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:15.156241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efcfb369-f046-4fac-9843-06cba3288698 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:15.156864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efcfb369-f046-4fac-9843-06cba3288698 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:15.157811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efcfb369-f046-4fac-9843-06cba3288698 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:15.160074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efcfb369-f046-4fac-9843-06cba3288698 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:15.160719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efcfb369-f046-4fac-9843-06cba3288698 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:15.404214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0fbf848a-1eab-459a-81d4-7c5abbf1c13a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:15.404846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0fbf848a-1eab-459a-81d4-7c5abbf1c13a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:15.422154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fbf848a-1eab-459a-81d4-7c5abbf1c13a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:15.427124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fbf848a-1eab-459a-81d4-7c5abbf1c13a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:15.427594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fbf848a-1eab-459a-81d4-7c5abbf1c13a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:15.427743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-efcfb369-f046-4fac-9843-06cba3288698 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:15.428369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fbf848a-1eab-459a-81d4-7c5abbf1c13a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:15.428851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fbf848a-1eab-459a-81d4-7c5abbf1c13a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:15.429292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0fbf848a-1eab-459a-81d4-7c5abbf1c13a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:15.441720 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-efcfb369-f046-4fac-9843-06cba3288698 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1392 microversion: 2.1 time: 0.300837 Oct 04 21:57:15.460704 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3417/6814] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:15 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1392 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:15.591608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0fbf848a-1eab-459a-81d4-7c5abbf1c13a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:15.600261 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0fbf848a-1eab-459a-81d4-7c5abbf1c13a tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1225 microversion: 2.1 time: 0.201821 Oct 04 21:57:15.600848 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3398/6815] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:15 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1225 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:16.023726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-6f9623c2-e947-4c6e-8ca9-21ef84b03e69 req-66a28151-bca9-4ed6-a834-0bbe324620f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3131d2-f12f-4d56-8794-bcb09057583c", "tag": "96a3ded2-e29b-4af6-b7d1-a769588c08fb"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:16.040637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6f9623c2-e947-4c6e-8ca9-21ef84b03e69 req-66a28151-bca9-4ed6-a834-0bbe324620f9 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:16.041397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6f9623c2-e947-4c6e-8ca9-21ef84b03e69 req-66a28151-bca9-4ed6-a834-0bbe324620f9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:16.042037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6f9623c2-e947-4c6e-8ca9-21ef84b03e69 req-66a28151-bca9-4ed6-a834-0bbe324620f9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:16.053819 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-6f9623c2-e947-4c6e-8ca9-21ef84b03e69 req-66a28151-bca9-4ed6-a834-0bbe324620f9 service nova] Creating event network-changed:96a3ded2-e29b-4af6-b7d1-a769588c08fb for instance 3f3131d2-f12f-4d56-8794-bcb09057583c on n-h1-860282-1 Oct 04 21:57:16.058863 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-6f9623c2-e947-4c6e-8ca9-21ef84b03e69 req-66a28151-bca9-4ed6-a834-0bbe324620f9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038804 Oct 04 21:57:16.059653 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3418/6816] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:16.466670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3531de80-1b48-4a80-a718-b33d7cd11f83 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:16.467403 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3531de80-1b48-4a80-a718-b33d7cd11f83 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:16.475976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3531de80-1b48-4a80-a718-b33d7cd11f83 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:16.476730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3531de80-1b48-4a80-a718-b33d7cd11f83 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:16.477180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3531de80-1b48-4a80-a718-b33d7cd11f83 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:16.477933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3531de80-1b48-4a80-a718-b33d7cd11f83 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:16.478402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3531de80-1b48-4a80-a718-b33d7cd11f83 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:16.478839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3531de80-1b48-4a80-a718-b33d7cd11f83 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:16.626278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-65cfb86c-1aab-4a16-846e-4471e339c237 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:16.627937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-65cfb86c-1aab-4a16-846e-4471e339c237 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:16.633376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3531de80-1b48-4a80-a718-b33d7cd11f83 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:16.641065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65cfb86c-1aab-4a16-846e-4471e339c237 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:16.643620 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3531de80-1b48-4a80-a718-b33d7cd11f83 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1392 microversion: 2.1 time: 0.180588 Oct 04 21:57:16.644307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65cfb86c-1aab-4a16-846e-4471e339c237 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:16.644882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65cfb86c-1aab-4a16-846e-4471e339c237 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:16.645758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65cfb86c-1aab-4a16-846e-4471e339c237 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:16.646640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65cfb86c-1aab-4a16-846e-4471e339c237 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:16.648883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65cfb86c-1aab-4a16-846e-4471e339c237 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:16.659125 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3399/6817] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:16 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1392 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:16.725703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-65cfb86c-1aab-4a16-846e-4471e339c237 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:16.733978 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-65cfb86c-1aab-4a16-846e-4471e339c237 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1225 microversion: 2.1 time: 0.113002 Oct 04 21:57:16.734554 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3419/6818] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:16 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:17.668492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9432716c-5efb-4632-a051-7bc8d040f0a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:17.669043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9432716c-5efb-4632-a051-7bc8d040f0a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:17.676552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9432716c-5efb-4632-a051-7bc8d040f0a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:17.677050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9432716c-5efb-4632-a051-7bc8d040f0a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:17.677516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9432716c-5efb-4632-a051-7bc8d040f0a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:17.678220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9432716c-5efb-4632-a051-7bc8d040f0a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:17.678680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9432716c-5efb-4632-a051-7bc8d040f0a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:17.679142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9432716c-5efb-4632-a051-7bc8d040f0a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:17.758226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ad1c9a96-9e6a-46b6-900c-09489680fc4d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:17.758879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ad1c9a96-9e6a-46b6-900c-09489680fc4d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:17.761583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:17.766476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad1c9a96-9e6a-46b6-900c-09489680fc4d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:17.766991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad1c9a96-9e6a-46b6-900c-09489680fc4d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:17.767648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad1c9a96-9e6a-46b6-900c-09489680fc4d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:17.768378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad1c9a96-9e6a-46b6-900c-09489680fc4d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:17.768854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad1c9a96-9e6a-46b6-900c-09489680fc4d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:17.769300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ad1c9a96-9e6a-46b6-900c-09489680fc4d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:17.841578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ad1c9a96-9e6a-46b6-900c-09489680fc4d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:17.850336 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ad1c9a96-9e6a-46b6-900c-09489680fc4d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1225 microversion: 2.1 time: 0.096030 Oct 04 21:57:17.850935 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3420/6819] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:17 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:57:17.851063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9432716c-5efb-4632-a051-7bc8d040f0a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:17.859018 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9432716c-5efb-4632-a051-7bc8d040f0a3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1392 microversion: 2.1 time: 0.194573 Oct 04 21:57:17.859578 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3400/6820] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:17 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1392 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:18.873803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a6c3c099-e459-4bd3-8fd2-c1d19fa562bf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:18.874440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a6c3c099-e459-4bd3-8fd2-c1d19fa562bf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:18.882438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6c3c099-e459-4bd3-8fd2-c1d19fa562bf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:18.882801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9e4338e4-676b-4a51-8765-b3704a9bd20e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:18.883243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6c3c099-e459-4bd3-8fd2-c1d19fa562bf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:18.883391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6c3c099-e459-4bd3-8fd2-c1d19fa562bf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:18.883485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9e4338e4-676b-4a51-8765-b3704a9bd20e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:18.884213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6c3c099-e459-4bd3-8fd2-c1d19fa562bf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:18.884697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6c3c099-e459-4bd3-8fd2-c1d19fa562bf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:18.885151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a6c3c099-e459-4bd3-8fd2-c1d19fa562bf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:18.890954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e4338e4-676b-4a51-8765-b3704a9bd20e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:18.891786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e4338e4-676b-4a51-8765-b3704a9bd20e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:18.891913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e4338e4-676b-4a51-8765-b3704a9bd20e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:18.893635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e4338e4-676b-4a51-8765-b3704a9bd20e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:18.894138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e4338e4-676b-4a51-8765-b3704a9bd20e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:18.894571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9e4338e4-676b-4a51-8765-b3704a9bd20e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:18.955516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a6c3c099-e459-4bd3-8fd2-c1d19fa562bf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:18.963475 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a6c3c099-e459-4bd3-8fd2-c1d19fa562bf tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 200 len: 1225 microversion: 2.1 time: 0.094079 Oct 04 21:57:18.964075 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3421/6821] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:18 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:19.063481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9e4338e4-676b-4a51-8765-b3704a9bd20e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:19.072475 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9e4338e4-676b-4a51-8765-b3704a9bd20e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1392 microversion: 2.1 time: 0.193590 Oct 04 21:57:19.073066 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3401/6822] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:18 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1392 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:57:19.987893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dcfb6b54-887a-4785-a1a9-04082268fc35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:19.988422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dcfb6b54-887a-4785-a1a9-04082268fc35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: 9b9b0b92-1590-4bcc-92a6-a32d334e928a] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:19.995313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcfb6b54-887a-4785-a1a9-04082268fc35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:19.995820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcfb6b54-887a-4785-a1a9-04082268fc35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:19.996283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcfb6b54-887a-4785-a1a9-04082268fc35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:19.996996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcfb6b54-887a-4785-a1a9-04082268fc35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:19.997596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcfb6b54-887a-4785-a1a9-04082268fc35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:19.998069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcfb6b54-887a-4785-a1a9-04082268fc35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:20.021656 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-dcfb6b54-887a-4785-a1a9-04082268fc35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] HTTP exception thrown: Instance 9b9b0b92-1590-4bcc-92a6-a32d334e928a could not be found. Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dcfb6b54-887a-4785-a1a9-04082268fc35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Request method failure captured: Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a HTTP/1.1 Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKgKHoOaT8uqO1KoOPn24xM7P0ylwdbLFlP7NxtckxX5YVgkQXQgvdk_pv_DRrXpTR_A9RTrhRjboZG7XPsaIwCmuey_7FqshLEW4wp7-ccvS6GHij-f3j-K3O_9tzU_63L01blifBD1TcCBZnKNp1OdTYkzGEDdJ0DY_B_XNHTjspY Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68208d23fd2f40479ba279566a819933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68208d23fd2f40479ba279566a819933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}] Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 15748f41da9f49fca3e7eec1fda3b245 Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 9b9b0b92-1590-4bcc-92a6-a32d334e928a could not be found. Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '9b9b0b92-1590-4bcc-92a6-a32d334e928a'} Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b9b0b92-1590-4bcc-92a6-a32d334e928a could not be found. Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b9b0b92-1590-4bcc-92a6-a32d334e928a could not be found. Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:20.023348 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:57:20.027706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:20.027706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:20.027706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:20.027706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:57:20.027706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:57:20.027706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b9b0b92-1590-4bcc-92a6-a32d334e928a could not be found. Oct 04 21:57:20.027706 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:57:20.027706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dcfb6b54-887a-4785-a1a9-04082268fc35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Returning 404 to user: Instance 9b9b0b92-1590-4bcc-92a6-a32d334e928a could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:57:20.027706 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dcfb6b54-887a-4785-a1a9-04082268fc35 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a" status: 404 len: 111 microversion: 2.1 time: 0.041595 Oct 04 21:57:20.027706 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3422/6823] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:19 2022] GET /compute/v2.1/servers/9b9b0b92-1590-4bcc-92a6-a32d334e928a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:57:20.096417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4acc4530-009b-4771-98a8-8ad43d7c6651 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:20.097210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4acc4530-009b-4771-98a8-8ad43d7c6651 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:20.105295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4acc4530-009b-4771-98a8-8ad43d7c6651 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:20.105823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4acc4530-009b-4771-98a8-8ad43d7c6651 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:20.106269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4acc4530-009b-4771-98a8-8ad43d7c6651 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:20.106975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4acc4530-009b-4771-98a8-8ad43d7c6651 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:20.107435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4acc4530-009b-4771-98a8-8ad43d7c6651 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:20.107865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4acc4530-009b-4771-98a8-8ad43d7c6651 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:20.247723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4acc4530-009b-4771-98a8-8ad43d7c6651 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:20.257850 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4acc4530-009b-4771-98a8-8ad43d7c6651 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1392 microversion: 2.1 time: 0.165540 Oct 04 21:57:20.258638 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3402/6824] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:20 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:21.280534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d9694735-cbdc-4c3f-8195-68fb4d916fcd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:21.281098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d9694735-cbdc-4c3f-8195-68fb4d916fcd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:21.288525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9694735-cbdc-4c3f-8195-68fb4d916fcd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:21.289039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9694735-cbdc-4c3f-8195-68fb4d916fcd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:21.289528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9694735-cbdc-4c3f-8195-68fb4d916fcd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:21.290248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9694735-cbdc-4c3f-8195-68fb4d916fcd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:21.290730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9694735-cbdc-4c3f-8195-68fb4d916fcd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:21.291179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d9694735-cbdc-4c3f-8195-68fb4d916fcd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:21.441816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d9694735-cbdc-4c3f-8195-68fb4d916fcd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:21.449780 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d9694735-cbdc-4c3f-8195-68fb4d916fcd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1392 microversion: 2.1 time: 0.173510 Oct 04 21:57:21.450356 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3423/6825] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:21 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:21.712948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-12f1d947-2ac0-4228-9253-2091038bebd8 req-0b682df9-b1e9-499d-87ab-b3c590d15325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3131d2-f12f-4d56-8794-bcb09057583c", "name": "network-vif-plugged", "status": "completed", "tag": "96a3ded2-e29b-4af6-b7d1-a769588c08fb"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:21.721546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:21.725662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-12f1d947-2ac0-4228-9253-2091038bebd8 req-0b682df9-b1e9-499d-87ab-b3c590d15325 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:21.726647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-12f1d947-2ac0-4228-9253-2091038bebd8 req-0b682df9-b1e9-499d-87ab-b3c590d15325 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:21.726647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-12f1d947-2ac0-4228-9253-2091038bebd8 req-0b682df9-b1e9-499d-87ab-b3c590d15325 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:21.738962 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-12f1d947-2ac0-4228-9253-2091038bebd8 req-0b682df9-b1e9-499d-87ab-b3c590d15325 service nova] Creating event network-vif-plugged:96a3ded2-e29b-4af6-b7d1-a769588c08fb for instance 3f3131d2-f12f-4d56-8794-bcb09057583c on n-h1-860282-1 Oct 04 21:57:21.744196 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-12f1d947-2ac0-4228-9253-2091038bebd8 req-0b682df9-b1e9-499d-87ab-b3c590d15325 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035161 Oct 04 21:57:21.744805 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3403/6826] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:22.472698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-150357a4-e114-4202-a51b-babec0c1e9f9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:22.473262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-150357a4-e114-4202-a51b-babec0c1e9f9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:22.480213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-150357a4-e114-4202-a51b-babec0c1e9f9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:22.480722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-150357a4-e114-4202-a51b-babec0c1e9f9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:22.481184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-150357a4-e114-4202-a51b-babec0c1e9f9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:22.481942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-150357a4-e114-4202-a51b-babec0c1e9f9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:22.482424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-150357a4-e114-4202-a51b-babec0c1e9f9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:22.482875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-150357a4-e114-4202-a51b-babec0c1e9f9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:22.623947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-150357a4-e114-4202-a51b-babec0c1e9f9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:22.633197 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-150357a4-e114-4202-a51b-babec0c1e9f9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1392 microversion: 2.1 time: 0.164809 Oct 04 21:57:22.633927 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3424/6827] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:22 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:23.658865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3bed1853-b299-432d-8039-2eb37fbde6ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:23.660311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3bed1853-b299-432d-8039-2eb37fbde6ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:23.662330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:23.669801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bed1853-b299-432d-8039-2eb37fbde6ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:23.679903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bed1853-b299-432d-8039-2eb37fbde6ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:23.679903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bed1853-b299-432d-8039-2eb37fbde6ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:23.679903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bed1853-b299-432d-8039-2eb37fbde6ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:23.679903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bed1853-b299-432d-8039-2eb37fbde6ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:23.679903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3bed1853-b299-432d-8039-2eb37fbde6ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:23.817370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3bed1853-b299-432d-8039-2eb37fbde6ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:23.826549 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3bed1853-b299-432d-8039-2eb37fbde6ff tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1563 microversion: 2.1 time: 0.173806 Oct 04 21:57:23.841901 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3404/6828] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:23 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1563 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:23.850892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-17454588-ae84-499f-bc8e-919809c063ce tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:23.851640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-17454588-ae84-499f-bc8e-919809c063ce tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:23.858729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17454588-ae84-499f-bc8e-919809c063ce tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:23.859235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17454588-ae84-499f-bc8e-919809c063ce tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:23.859694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17454588-ae84-499f-bc8e-919809c063ce tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:23.860409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17454588-ae84-499f-bc8e-919809c063ce tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:23.860909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17454588-ae84-499f-bc8e-919809c063ce tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:23.861358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17454588-ae84-499f-bc8e-919809c063ce tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:24.006026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-17454588-ae84-499f-bc8e-919809c063ce tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:24.014114 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-17454588-ae84-499f-bc8e-919809c063ce tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1563 microversion: 2.1 time: 0.167179 Oct 04 21:57:24.015322 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3425/6829] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:23 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:26.226018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-26db2549-17f3-450c-a0de-4c98970bbfdc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:26.226662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-26db2549-17f3-450c-a0de-4c98970bbfdc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:26.229349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:26.235451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-d0ab7344-03e0-43e4-a6f4-5b30ad0ebc8d req-00ddcc91-bc98-422d-9956-1c533ef777a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3131d2-f12f-4d56-8794-bcb09057583c", "tag": "96a3ded2-e29b-4af6-b7d1-a769588c08fb"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:26.242184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26db2549-17f3-450c-a0de-4c98970bbfdc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:26.242184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26db2549-17f3-450c-a0de-4c98970bbfdc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:26.242184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26db2549-17f3-450c-a0de-4c98970bbfdc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:26.242184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26db2549-17f3-450c-a0de-4c98970bbfdc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:26.242184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26db2549-17f3-450c-a0de-4c98970bbfdc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:26.242184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-26db2549-17f3-450c-a0de-4c98970bbfdc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:26.258375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d0ab7344-03e0-43e4-a6f4-5b30ad0ebc8d req-00ddcc91-bc98-422d-9956-1c533ef777a6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:26.259109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d0ab7344-03e0-43e4-a6f4-5b30ad0ebc8d req-00ddcc91-bc98-422d-9956-1c533ef777a6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:26.259812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-d0ab7344-03e0-43e4-a6f4-5b30ad0ebc8d req-00ddcc91-bc98-422d-9956-1c533ef777a6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:26.273954 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-d0ab7344-03e0-43e4-a6f4-5b30ad0ebc8d req-00ddcc91-bc98-422d-9956-1c533ef777a6 service nova] Creating event network-changed:96a3ded2-e29b-4af6-b7d1-a769588c08fb for instance 3f3131d2-f12f-4d56-8794-bcb09057583c on n-h1-860282-1 Oct 04 21:57:26.280323 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-d0ab7344-03e0-43e4-a6f4-5b30ad0ebc8d req-00ddcc91-bc98-422d-9956-1c533ef777a6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051804 Oct 04 21:57:26.286183 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3426/6830] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:57:26.490283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-26db2549-17f3-450c-a0de-4c98970bbfdc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:26.507157 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-26db2549-17f3-450c-a0de-4c98970bbfdc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1563 microversion: 2.1 time: 0.285230 Oct 04 21:57:26.509036 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3405/6831] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:26 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1563 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:26.727705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8683e299-8908-4d4a-88d4-3ddcc82c8fd6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:26.728802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8683e299-8908-4d4a-88d4-3ddcc82c8fd6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:26.739850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8683e299-8908-4d4a-88d4-3ddcc82c8fd6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:26.742020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8683e299-8908-4d4a-88d4-3ddcc82c8fd6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:26.742656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8683e299-8908-4d4a-88d4-3ddcc82c8fd6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:26.744638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8683e299-8908-4d4a-88d4-3ddcc82c8fd6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:26.747446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8683e299-8908-4d4a-88d4-3ddcc82c8fd6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:26.748332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8683e299-8908-4d4a-88d4-3ddcc82c8fd6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:26.754511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-a4bd602b-408c-4e42-9b5b-3c27a2428ba4 req-f4725b10-c729-44ba-82f8-4835b406aad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4866bba-4c3e-4ff7-9e38-fb2938323240", "tag": "45cecac7-6d52-46d4-b35f-984dba208b27"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:26.765392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a4bd602b-408c-4e42-9b5b-3c27a2428ba4 req-f4725b10-c729-44ba-82f8-4835b406aad0 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:26.766193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a4bd602b-408c-4e42-9b5b-3c27a2428ba4 req-f4725b10-c729-44ba-82f8-4835b406aad0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:26.766804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a4bd602b-408c-4e42-9b5b-3c27a2428ba4 req-f4725b10-c729-44ba-82f8-4835b406aad0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:26.780698 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-a4bd602b-408c-4e42-9b5b-3c27a2428ba4 req-f4725b10-c729-44ba-82f8-4835b406aad0 service nova] Creating event network-changed:45cecac7-6d52-46d4-b35f-984dba208b27 for instance f4866bba-4c3e-4ff7-9e38-fb2938323240 on n-h2-860282-1 Oct 04 21:57:26.780827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8683e299-8908-4d4a-88d4-3ddcc82c8fd6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:57:26.784491 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-a4bd602b-408c-4e42-9b5b-3c27a2428ba4 req-f4725b10-c729-44ba-82f8-4835b406aad0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034123 Oct 04 21:57:26.787044 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3406/6832] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:27.066428 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:57:27.066881 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 21:57:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 (ip 10.222.0.30) !!! Oct 04 21:57:27.131260 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8683e299-8908-4d4a-88d4-3ddcc82c8fd6 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 204 len: 0 microversion: 2.1 time: 0.407394 Oct 04 21:57:27.131876 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3427/6833] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:57:26 2022] DELETE /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:57:27.142804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dd9ae926-a6ae-468b-8414-4d67b72588ff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:27.143717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dd9ae926-a6ae-468b-8414-4d67b72588ff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:27.160537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd9ae926-a6ae-468b-8414-4d67b72588ff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:27.161350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd9ae926-a6ae-468b-8414-4d67b72588ff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:27.164169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd9ae926-a6ae-468b-8414-4d67b72588ff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:27.164169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd9ae926-a6ae-468b-8414-4d67b72588ff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:27.164860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd9ae926-a6ae-468b-8414-4d67b72588ff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:27.166326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dd9ae926-a6ae-468b-8414-4d67b72588ff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:27.384723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dd9ae926-a6ae-468b-8414-4d67b72588ff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:27.395579 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dd9ae926-a6ae-468b-8414-4d67b72588ff tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1576 microversion: 2.1 time: 0.258328 Oct 04 21:57:27.397709 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3407/6834] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:27 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1576 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:28.419226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-88b34974-4f1a-4b71-ad87-21a8c7771c2d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:28.419940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-88b34974-4f1a-4b71-ad87-21a8c7771c2d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:28.430924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88b34974-4f1a-4b71-ad87-21a8c7771c2d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:28.432501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88b34974-4f1a-4b71-ad87-21a8c7771c2d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:28.432983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88b34974-4f1a-4b71-ad87-21a8c7771c2d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:28.433768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88b34974-4f1a-4b71-ad87-21a8c7771c2d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:28.434251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88b34974-4f1a-4b71-ad87-21a8c7771c2d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:28.434699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-88b34974-4f1a-4b71-ad87-21a8c7771c2d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:28.499442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-88b34974-4f1a-4b71-ad87-21a8c7771c2d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:28.503493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:28.512193 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-88b34974-4f1a-4b71-ad87-21a8c7771c2d tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1390 microversion: 2.1 time: 0.093662 Oct 04 21:57:28.512193 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3428/6835] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:28 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:28.800343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-75df34e2-2d79-44a3-bd7e-e775419663b4 req-9c7f491c-fb8a-44e7-9134-9a39aac276e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4866bba-4c3e-4ff7-9e38-fb2938323240", "name": "network-vif-deleted", "tag": "45cecac7-6d52-46d4-b35f-984dba208b27"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:28.810877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-75df34e2-2d79-44a3-bd7e-e775419663b4 req-9c7f491c-fb8a-44e7-9134-9a39aac276e6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:28.811365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-75df34e2-2d79-44a3-bd7e-e775419663b4 req-9c7f491c-fb8a-44e7-9134-9a39aac276e6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:28.811807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-75df34e2-2d79-44a3-bd7e-e775419663b4 req-9c7f491c-fb8a-44e7-9134-9a39aac276e6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:28.823503 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-75df34e2-2d79-44a3-bd7e-e775419663b4 req-9c7f491c-fb8a-44e7-9134-9a39aac276e6 service nova] Creating event network-vif-deleted:45cecac7-6d52-46d4-b35f-984dba208b27 for instance f4866bba-4c3e-4ff7-9e38-fb2938323240 on n-h2-860282-1 Oct 04 21:57:28.828236 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-75df34e2-2d79-44a3-bd7e-e775419663b4 req-9c7f491c-fb8a-44e7-9134-9a39aac276e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032300 Oct 04 21:57:28.828827 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3408/6836] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:29.538009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2c7c3a95-0bc6-450a-ada0-91de5b90f643 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:29.538788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2c7c3a95-0bc6-450a-ada0-91de5b90f643 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:29.546695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c7c3a95-0bc6-450a-ada0-91de5b90f643 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:29.547201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c7c3a95-0bc6-450a-ada0-91de5b90f643 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:29.547656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c7c3a95-0bc6-450a-ada0-91de5b90f643 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:29.548998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c7c3a95-0bc6-450a-ada0-91de5b90f643 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:29.549508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c7c3a95-0bc6-450a-ada0-91de5b90f643 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:29.549956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2c7c3a95-0bc6-450a-ada0-91de5b90f643 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:29.616410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2c7c3a95-0bc6-450a-ada0-91de5b90f643 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:29.625194 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2c7c3a95-0bc6-450a-ada0-91de5b90f643 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1224 microversion: 2.1 time: 0.091994 Oct 04 21:57:29.626376 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3429/6837] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:29 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:30.654070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c060b7e8-d376-4ee3-905e-dc224ff6aa84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:30.654844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c060b7e8-d376-4ee3-905e-dc224ff6aa84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:30.661621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c060b7e8-d376-4ee3-905e-dc224ff6aa84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:30.662116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c060b7e8-d376-4ee3-905e-dc224ff6aa84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:30.662555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c060b7e8-d376-4ee3-905e-dc224ff6aa84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:30.663251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c060b7e8-d376-4ee3-905e-dc224ff6aa84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:30.663711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c060b7e8-d376-4ee3-905e-dc224ff6aa84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:30.664137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c060b7e8-d376-4ee3-905e-dc224ff6aa84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:30.729816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c060b7e8-d376-4ee3-905e-dc224ff6aa84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:30.738456 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c060b7e8-d376-4ee3-905e-dc224ff6aa84 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1224 microversion: 2.1 time: 0.089933 Oct 04 21:57:30.739025 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3409/6838] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:30 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:31.772929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9103d75f-c025-42da-abd2-57fee118e072 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:31.773597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9103d75f-c025-42da-abd2-57fee118e072 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:31.781724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9103d75f-c025-42da-abd2-57fee118e072 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:31.782233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9103d75f-c025-42da-abd2-57fee118e072 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:31.783664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9103d75f-c025-42da-abd2-57fee118e072 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:31.784523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9103d75f-c025-42da-abd2-57fee118e072 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:31.785000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9103d75f-c025-42da-abd2-57fee118e072 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:31.785504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9103d75f-c025-42da-abd2-57fee118e072 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:31.851752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9103d75f-c025-42da-abd2-57fee118e072 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:31.859742 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9103d75f-c025-42da-abd2-57fee118e072 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1224 microversion: 2.1 time: 0.090886 Oct 04 21:57:31.860324 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3430/6839] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:31 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:32.883541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6c783392-18ac-49ff-861e-4ac2a66185ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:32.884204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6c783392-18ac-49ff-861e-4ac2a66185ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:32.891251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6c783392-18ac-49ff-861e-4ac2a66185ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:32.891743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6c783392-18ac-49ff-861e-4ac2a66185ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:32.892473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6c783392-18ac-49ff-861e-4ac2a66185ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:32.893188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6c783392-18ac-49ff-861e-4ac2a66185ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:32.893680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6c783392-18ac-49ff-861e-4ac2a66185ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:32.894114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6c783392-18ac-49ff-861e-4ac2a66185ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:32.926641 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6c783392-18ac-49ff-861e-4ac2a66185ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:32.927130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6c783392-18ac-49ff-861e-4ac2a66185ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:32.927577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6c783392-18ac-49ff-861e-4ac2a66185ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:32.928036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-6c783392-18ac-49ff-861e-4ac2a66185ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lazy-loading 'fault' on Instance uuid f4866bba-4c3e-4ff7-9e38-fb2938323240 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:57:32.968177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6c783392-18ac-49ff-861e-4ac2a66185ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15748f41da9f49fca3e7eec1fda3b245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68208d23fd2f40479ba279566a819933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:32.977060 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6c783392-18ac-49ff-861e-4ac2a66185ca tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 200 len: 1229 microversion: 2.1 time: 0.097644 Oct 04 21:57:32.977681 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3410/6840] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:32 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:34.000083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-454d2835-dfad-486e-ab38-580fe2287005 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:34.000717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-454d2835-dfad-486e-ab38-580fe2287005 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f4866bba-4c3e-4ff7-9e38-fb2938323240] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:34.008419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454d2835-dfad-486e-ab38-580fe2287005 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:34.008911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454d2835-dfad-486e-ab38-580fe2287005 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:34.009368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454d2835-dfad-486e-ab38-580fe2287005 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:34.010107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454d2835-dfad-486e-ab38-580fe2287005 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:34.010583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454d2835-dfad-486e-ab38-580fe2287005 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:34.011031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-454d2835-dfad-486e-ab38-580fe2287005 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:34.025551 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-454d2835-dfad-486e-ab38-580fe2287005 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] HTTP exception thrown: Instance f4866bba-4c3e-4ff7-9e38-fb2938323240 could not be found. Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-454d2835-dfad-486e-ab38-580fe2287005 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Request method failure captured: Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 HTTP/1.1 Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKgKHoOaT8uqO1KoOPn24xM7P0ylwdbLFlP7NxtckxX5YVgkQXQgvdk_pv_DRrXpTR_A9RTrhRjboZG7XPsaIwCmuey_7FqshLEW4wp7-ccvS6GHij-f3j-K3O_9tzU_63L01blifBD1TcCBZnKNp1OdTYkzGEDdJ0DY_B_XNHTjspY Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68208d23fd2f40479ba279566a819933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68208d23fd2f40479ba279566a819933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}] Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 15748f41da9f49fca3e7eec1fda3b245 Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance f4866bba-4c3e-4ff7-9e38-fb2938323240 could not be found. Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'f4866bba-4c3e-4ff7-9e38-fb2938323240'} Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4866bba-4c3e-4ff7-9e38-fb2938323240 could not be found. Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4866bba-4c3e-4ff7-9e38-fb2938323240 could not be found. Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:34.027489 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:57:34.031473 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:34.031473 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:34.031473 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:34.031473 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:57:34.031473 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:57:34.031473 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4866bba-4c3e-4ff7-9e38-fb2938323240 could not be found. Oct 04 21:57:34.031473 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:57:34.031473 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-454d2835-dfad-486e-ab38-580fe2287005 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Returning 404 to user: Instance f4866bba-4c3e-4ff7-9e38-fb2938323240 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:57:34.031473 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-454d2835-dfad-486e-ab38-580fe2287005 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240" status: 404 len: 111 microversion: 2.1 time: 0.033416 Oct 04 21:57:34.031473 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3431/6841] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:33 2022] GET /compute/v2.1/servers/f4866bba-4c3e-4ff7-9e38-fb2938323240 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:57:34.560987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-622e300d-89ef-43c4-b847-c7d03a019444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:34.561522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-622e300d-89ef-43c4-b847-c7d03a019444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:34.568833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-622e300d-89ef-43c4-b847-c7d03a019444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:34.569327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-622e300d-89ef-43c4-b847-c7d03a019444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:34.569805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-622e300d-89ef-43c4-b847-c7d03a019444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:34.570526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-622e300d-89ef-43c4-b847-c7d03a019444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:34.570990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-622e300d-89ef-43c4-b847-c7d03a019444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:34.571423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-622e300d-89ef-43c4-b847-c7d03a019444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:34.584863 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-622e300d-89ef-43c4-b847-c7d03a019444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] HTTP exception thrown: Instance f224bc93-0310-4831-8bd0-5c03ac12c242 could not be found. Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-622e300d-89ef-43c4-b847-c7d03a019444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Request method failure captured: Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 HTTP/1.1 Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKgKHoOaT8uqO1KoOPn24xM7P0ylwdbLFlP7NxtckxX5YVgkQXQgvdk_pv_DRrXpTR_A9RTrhRjboZG7XPsaIwCmuey_7FqshLEW4wp7-ccvS6GHij-f3j-K3O_9tzU_63L01blifBD1TcCBZnKNp1OdTYkzGEDdJ0DY_B_XNHTjspY Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68208d23fd2f40479ba279566a819933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68208d23fd2f40479ba279566a819933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}] Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 15748f41da9f49fca3e7eec1fda3b245 Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance f224bc93-0310-4831-8bd0-5c03ac12c242 could not be found. Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'f224bc93-0310-4831-8bd0-5c03ac12c242'} Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f224bc93-0310-4831-8bd0-5c03ac12c242 could not be found. Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:57:34.586576 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:57:34.590713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f224bc93-0310-4831-8bd0-5c03ac12c242 could not be found. Oct 04 21:57:34.590713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:57:34.590713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:34.590713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:57:34.590713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:34.590713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:34.590713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:34.590713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:57:34.590713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:57:34.590713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f224bc93-0310-4831-8bd0-5c03ac12c242 could not be found. Oct 04 21:57:34.590713 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 21:57:34.590713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-622e300d-89ef-43c4-b847-c7d03a019444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Returning 404 to user: Instance f224bc93-0310-4831-8bd0-5c03ac12c242 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:57:34.590713 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-622e300d-89ef-43c4-b847-c7d03a019444 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 404 len: 111 microversion: 2.1 time: 0.031082 Oct 04 21:57:34.590713 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3411/6842] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:57:34 2022] DELETE /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:57:34.597091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-da1a6b44-18da-4a86-94be-7a48e8811255 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:34.597747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-da1a6b44-18da-4a86-94be-7a48e8811255 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] [instance: f224bc93-0310-4831-8bd0-5c03ac12c242] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:34.603729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da1a6b44-18da-4a86-94be-7a48e8811255 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:34.604231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da1a6b44-18da-4a86-94be-7a48e8811255 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:34.604693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da1a6b44-18da-4a86-94be-7a48e8811255 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:34.605400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da1a6b44-18da-4a86-94be-7a48e8811255 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:34.605910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da1a6b44-18da-4a86-94be-7a48e8811255 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:34.606357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da1a6b44-18da-4a86-94be-7a48e8811255 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:34.620280 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-da1a6b44-18da-4a86-94be-7a48e8811255 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] HTTP exception thrown: Instance f224bc93-0310-4831-8bd0-5c03ac12c242 could not be found. Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-da1a6b44-18da-4a86-94be-7a48e8811255 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Request method failure captured: Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 HTTP/1.1 Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKgKHoOaT8uqO1KoOPn24xM7P0ylwdbLFlP7NxtckxX5YVgkQXQgvdk_pv_DRrXpTR_A9RTrhRjboZG7XPsaIwCmuey_7FqshLEW4wp7-ccvS6GHij-f3j-K3O_9tzU_63L01blifBD1TcCBZnKNp1OdTYkzGEDdJ0DY_B_XNHTjspY Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68208d23fd2f40479ba279566a819933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68208d23fd2f40479ba279566a819933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68208d23fd2f40479ba279566a819933"}]}] Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 68208d23fd2f40479ba279566a819933 Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestVolumeBootPattern-1307856765 Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 15748f41da9f49fca3e7eec1fda3b245 Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestVolumeBootPattern-1307856765-project Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance f224bc93-0310-4831-8bd0-5c03ac12c242 could not be found. Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'f224bc93-0310-4831-8bd0-5c03ac12c242'} Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f224bc93-0310-4831-8bd0-5c03ac12c242 could not be found. Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f224bc93-0310-4831-8bd0-5c03ac12c242 could not be found. Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:34.621831 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:57:34.626030 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:34.626030 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:34.626030 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:34.626030 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:57:34.626030 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:57:34.626030 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f224bc93-0310-4831-8bd0-5c03ac12c242 could not be found. Oct 04 21:57:34.626030 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:57:34.626030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-da1a6b44-18da-4a86-94be-7a48e8811255 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Returning 404 to user: Instance f224bc93-0310-4831-8bd0-5c03ac12c242 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:57:34.626030 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-da1a6b44-18da-4a86-94be-7a48e8811255 tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242" status: 404 len: 111 microversion: 2.1 time: 0.030568 Oct 04 21:57:34.626030 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3432/6843] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:34 2022] GET /compute/v2.1/servers/f224bc93-0310-4831-8bd0-5c03ac12c242 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:57:38.228119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-15d643d1-c582-4f75-a81a-685e253f81fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] Calling method '.version_select at 0x7f5790d30f70>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:38.326347 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-15d643d1-c582-4f75-a81a-685e253f81fd tempest-TestVolumeBootPattern-1307856765 tempest-TestVolumeBootPattern-1307856765-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-793500675" status: 202 len: 0 microversion: 2.1 time: 0.102282 Oct 04 21:57:38.327069 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3412/6844] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Oct 4 21:57:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-793500675 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:57:47.803125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:47.803815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=16 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:48.043715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f2579aba-3ac1-48d9-942b-5152143c110b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:48.046071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f2579aba-3ac1-48d9-942b-5152143c110b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:48.052659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2579aba-3ac1-48d9-942b-5152143c110b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:48.053228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2579aba-3ac1-48d9-942b-5152143c110b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:48.053673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2579aba-3ac1-48d9-942b-5152143c110b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:48.054394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2579aba-3ac1-48d9-942b-5152143c110b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:48.054881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2579aba-3ac1-48d9-942b-5152143c110b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:48.055333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f2579aba-3ac1-48d9-942b-5152143c110b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:48.107717 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f2579aba-3ac1-48d9-942b-5152143c110b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c/action" status: 200 len: 24573 microversion: 2.1 time: 0.309732 Oct 04 21:57:48.108362 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3433/6845] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:57:47 2022] POST /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c/action => generated 24573 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:57:54.553583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=92 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:54.554337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:54.558240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d57094d4-6206-4d13-9cab-e8d1cc2a1109 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:54.558855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d57094d4-6206-4d13-9cab-e8d1cc2a1109 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:54.566263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d57094d4-6206-4d13-9cab-e8d1cc2a1109 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:54.568140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d57094d4-6206-4d13-9cab-e8d1cc2a1109 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:54.568140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d57094d4-6206-4d13-9cab-e8d1cc2a1109 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:54.568140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d57094d4-6206-4d13-9cab-e8d1cc2a1109 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:54.568458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d57094d4-6206-4d13-9cab-e8d1cc2a1109 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:54.568777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d57094d4-6206-4d13-9cab-e8d1cc2a1109 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:54.710036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d57094d4-6206-4d13-9cab-e8d1cc2a1109 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:54.717986 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d57094d4-6206-4d13-9cab-e8d1cc2a1109 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1681 microversion: 2.1 time: 0.166251 Oct 04 21:57:54.718557 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3413/6846] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:54 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:57:54.828181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-29ada3ee-6ebf-40eb-b985-645c846108b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:54.830594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-29ada3ee-6ebf-40eb-b985-645c846108b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:54.838858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29ada3ee-6ebf-40eb-b985-645c846108b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:54.844510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29ada3ee-6ebf-40eb-b985-645c846108b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:54.844510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29ada3ee-6ebf-40eb-b985-645c846108b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:54.844510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29ada3ee-6ebf-40eb-b985-645c846108b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:54.844510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29ada3ee-6ebf-40eb-b985-645c846108b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:54.844510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29ada3ee-6ebf-40eb-b985-645c846108b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:54.893342 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-29ada3ee-6ebf-40eb-b985-645c846108b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c/action" status: 200 len: 32638 microversion: 2.1 time: 0.069275 Oct 04 21:57:54.894727 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3434/6847] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:57:54 2022] POST /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c/action => generated 32638 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:57:55.162723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-55ace3c9-6241-4f8f-a644-c52a74ef8026 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:55.163346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-55ace3c9-6241-4f8f-a644-c52a74ef8026 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:55.169519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55ace3c9-6241-4f8f-a644-c52a74ef8026 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:55.170013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55ace3c9-6241-4f8f-a644-c52a74ef8026 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:55.170458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55ace3c9-6241-4f8f-a644-c52a74ef8026 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:55.171182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55ace3c9-6241-4f8f-a644-c52a74ef8026 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:55.171645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55ace3c9-6241-4f8f-a644-c52a74ef8026 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:55.172077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55ace3c9-6241-4f8f-a644-c52a74ef8026 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:55.304888 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-55ace3c9-6241-4f8f-a644-c52a74ef8026 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1832 microversion: 2.1 time: 0.258436 Oct 04 21:57:55.305659 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3414/6848] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:55 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1832 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:55.335887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d1938bfc-1a94-467d-8404-fa623e5213d8 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:55.338520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d1938bfc-1a94-467d-8404-fa623e5213d8 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:55.345730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1938bfc-1a94-467d-8404-fa623e5213d8 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:55.346307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1938bfc-1a94-467d-8404-fa623e5213d8 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:55.346855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1938bfc-1a94-467d-8404-fa623e5213d8 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:55.347565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1938bfc-1a94-467d-8404-fa623e5213d8 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:55.348036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1938bfc-1a94-467d-8404-fa623e5213d8 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:55.348477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1938bfc-1a94-467d-8404-fa623e5213d8 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:55.495604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-d1938bfc-1a94-467d-8404-fa623e5213d8 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lazy-loading 'flavor' on Instance uuid 3f3131d2-f12f-4d56-8794-bcb09057583c {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:57:55.502314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d1938bfc-1a94-467d-8404-fa623e5213d8 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Going to try to live migrate instance to another host {{(pid=122757) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:57:57.910951 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d1938bfc-1a94-467d-8404-fa623e5213d8 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c/action" status: 202 len: 0 microversion: 2.1 time: 2.579904 Oct 04 21:57:57.911605 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3435/6849] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:57:55 2022] POST /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c/action => generated 0 bytes in 2581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:57:57.920552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1c6f89a7-a337-4444-9af5-8474b4cb992b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:57.921175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1c6f89a7-a337-4444-9af5-8474b4cb992b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:57.928588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6f89a7-a337-4444-9af5-8474b4cb992b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:57.929092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6f89a7-a337-4444-9af5-8474b4cb992b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:57.929597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6f89a7-a337-4444-9af5-8474b4cb992b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:57.930302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6f89a7-a337-4444-9af5-8474b4cb992b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:57.930768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6f89a7-a337-4444-9af5-8474b4cb992b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:57.931218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6f89a7-a337-4444-9af5-8474b4cb992b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:58.068876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1c6f89a7-a337-4444-9af5-8474b4cb992b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:58.076698 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1c6f89a7-a337-4444-9af5-8474b4cb992b tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1691 microversion: 2.1 time: 0.160128 Oct 04 21:57:58.077278 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3415/6850] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:57 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:59.101816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c96bcc73-2093-418a-a64b-fff45fdb8cae tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:59.102436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c96bcc73-2093-418a-a64b-fff45fdb8cae tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:59.109656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c96bcc73-2093-418a-a64b-fff45fdb8cae tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:59.110162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c96bcc73-2093-418a-a64b-fff45fdb8cae tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:59.110617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c96bcc73-2093-418a-a64b-fff45fdb8cae tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:59.111329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c96bcc73-2093-418a-a64b-fff45fdb8cae tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:59.111799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c96bcc73-2093-418a-a64b-fff45fdb8cae tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:59.112246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c96bcc73-2093-418a-a64b-fff45fdb8cae tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:59.330082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c96bcc73-2093-418a-a64b-fff45fdb8cae tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:59.338700 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c96bcc73-2093-418a-a64b-fff45fdb8cae tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1691 microversion: 2.1 time: 0.240801 Oct 04 21:57:59.339285 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3436/6851] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:59 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1691 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:59.401168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-f86260db-7172-4c42-b4bf-6b77a00aa277 req-16a6ac4f-699b-4584-a986-0d34587fc404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3131d2-f12f-4d56-8794-bcb09057583c", "name": "network-vif-unplugged", "status": "completed", "tag": "96a3ded2-e29b-4af6-b7d1-a769588c08fb"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:59.411940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f86260db-7172-4c42-b4bf-6b77a00aa277 req-16a6ac4f-699b-4584-a986-0d34587fc404 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:59.412433 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f86260db-7172-4c42-b4bf-6b77a00aa277 req-16a6ac4f-699b-4584-a986-0d34587fc404 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:59.412848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f86260db-7172-4c42-b4bf-6b77a00aa277 req-16a6ac4f-699b-4584-a986-0d34587fc404 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:59.423688 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-f86260db-7172-4c42-b4bf-6b77a00aa277 req-16a6ac4f-699b-4584-a986-0d34587fc404 service nova] Creating event network-vif-unplugged:96a3ded2-e29b-4af6-b7d1-a769588c08fb for instance 3f3131d2-f12f-4d56-8794-bcb09057583c on n-h1-860282-1 Oct 04 21:57:59.429399 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-f86260db-7172-4c42-b4bf-6b77a00aa277 req-16a6ac4f-699b-4584-a986-0d34587fc404 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032072 Oct 04 21:57:59.433883 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3416/6852] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:00.363680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-402a8d9a-4e33-490d-ae8f-157e27e7cba9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:00.368022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-402a8d9a-4e33-490d-ae8f-157e27e7cba9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:00.371464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-402a8d9a-4e33-490d-ae8f-157e27e7cba9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:00.371969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-402a8d9a-4e33-490d-ae8f-157e27e7cba9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:00.372421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-402a8d9a-4e33-490d-ae8f-157e27e7cba9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:00.373129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-402a8d9a-4e33-490d-ae8f-157e27e7cba9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:00.373736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-402a8d9a-4e33-490d-ae8f-157e27e7cba9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:00.374182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-402a8d9a-4e33-490d-ae8f-157e27e7cba9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:00.516837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-402a8d9a-4e33-490d-ae8f-157e27e7cba9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:00.525221 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-402a8d9a-4e33-490d-ae8f-157e27e7cba9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1691 microversion: 2.1 time: 0.166102 Oct 04 21:58:00.529143 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3437/6853] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:00 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:01.445488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-3ba337f2-1cc4-4dac-8574-6a12ab7b74e3 req-fe341cb3-1fc9-4053-8826-7329d0e8178f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3131d2-f12f-4d56-8794-bcb09057583c", "tag": "96a3ded2-e29b-4af6-b7d1-a769588c08fb"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:01.455011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3ba337f2-1cc4-4dac-8574-6a12ab7b74e3 req-fe341cb3-1fc9-4053-8826-7329d0e8178f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:01.455486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3ba337f2-1cc4-4dac-8574-6a12ab7b74e3 req-fe341cb3-1fc9-4053-8826-7329d0e8178f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:01.455916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3ba337f2-1cc4-4dac-8574-6a12ab7b74e3 req-fe341cb3-1fc9-4053-8826-7329d0e8178f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:01.467070 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-3ba337f2-1cc4-4dac-8574-6a12ab7b74e3 req-fe341cb3-1fc9-4053-8826-7329d0e8178f service nova] Creating event network-changed:96a3ded2-e29b-4af6-b7d1-a769588c08fb for instance 3f3131d2-f12f-4d56-8794-bcb09057583c on n-h1-860282-1 Oct 04 21:58:01.471838 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-3ba337f2-1cc4-4dac-8574-6a12ab7b74e3 req-fe341cb3-1fc9-4053-8826-7329d0e8178f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031966 Oct 04 21:58:01.472399 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3417/6854] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:01.549170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ac42f415-5717-4132-9465-7ec697806e0e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:01.550692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ac42f415-5717-4132-9465-7ec697806e0e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:01.557412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac42f415-5717-4132-9465-7ec697806e0e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:01.557943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac42f415-5717-4132-9465-7ec697806e0e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:01.558398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac42f415-5717-4132-9465-7ec697806e0e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:01.559105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac42f415-5717-4132-9465-7ec697806e0e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:01.559579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac42f415-5717-4132-9465-7ec697806e0e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:01.560018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ac42f415-5717-4132-9465-7ec697806e0e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:01.700033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ac42f415-5717-4132-9465-7ec697806e0e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:01.708044 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ac42f415-5717-4132-9465-7ec697806e0e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1691 microversion: 2.1 time: 0.162681 Oct 04 21:58:01.708641 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3438/6855] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:01 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:02.733636 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1324ef8f-3c82-498c-9936-898ebf77b6d5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:02.734369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1324ef8f-3c82-498c-9936-898ebf77b6d5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:02.740676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1324ef8f-3c82-498c-9936-898ebf77b6d5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:02.741163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1324ef8f-3c82-498c-9936-898ebf77b6d5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:02.741640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1324ef8f-3c82-498c-9936-898ebf77b6d5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:02.742362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1324ef8f-3c82-498c-9936-898ebf77b6d5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:02.742822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1324ef8f-3c82-498c-9936-898ebf77b6d5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:02.743253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1324ef8f-3c82-498c-9936-898ebf77b6d5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:02.888969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1324ef8f-3c82-498c-9936-898ebf77b6d5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:02.889995 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1324ef8f-3c82-498c-9936-898ebf77b6d5 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1691 microversion: 2.1 time: 0.161518 Oct 04 21:58:02.890590 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3418/6856] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:02 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:03.913478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-599c75e1-cc25-4a09-92dc-c5e343d306b3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:03.914042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-599c75e1-cc25-4a09-92dc-c5e343d306b3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:03.920923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-599c75e1-cc25-4a09-92dc-c5e343d306b3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:03.921447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-599c75e1-cc25-4a09-92dc-c5e343d306b3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:03.921929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-599c75e1-cc25-4a09-92dc-c5e343d306b3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:03.922639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-599c75e1-cc25-4a09-92dc-c5e343d306b3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:03.923118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-599c75e1-cc25-4a09-92dc-c5e343d306b3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:03.923566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-599c75e1-cc25-4a09-92dc-c5e343d306b3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:04.054864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-599c75e1-cc25-4a09-92dc-c5e343d306b3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:04.062808 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-599c75e1-cc25-4a09-92dc-c5e343d306b3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1691 microversion: 2.1 time: 0.153935 Oct 04 21:58:04.063867 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3439/6857] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:03 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:05.086950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cca36032-df5f-471c-821b-ac24806997d0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:05.087612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cca36032-df5f-471c-821b-ac24806997d0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:05.094354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cca36032-df5f-471c-821b-ac24806997d0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:05.094858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cca36032-df5f-471c-821b-ac24806997d0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:05.095308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cca36032-df5f-471c-821b-ac24806997d0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:05.096010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cca36032-df5f-471c-821b-ac24806997d0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:05.096478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cca36032-df5f-471c-821b-ac24806997d0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:05.096916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cca36032-df5f-471c-821b-ac24806997d0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:05.235273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cca36032-df5f-471c-821b-ac24806997d0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:05.243594 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cca36032-df5f-471c-821b-ac24806997d0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1691 microversion: 2.1 time: 0.160745 Oct 04 21:58:05.244168 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3419/6858] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:05 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:06.267415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8b3be011-5028-4268-b70b-d5a387d4cff9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:06.268076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8b3be011-5028-4268-b70b-d5a387d4cff9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:06.275276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b3be011-5028-4268-b70b-d5a387d4cff9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:06.275806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b3be011-5028-4268-b70b-d5a387d4cff9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:06.276519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b3be011-5028-4268-b70b-d5a387d4cff9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:06.277248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b3be011-5028-4268-b70b-d5a387d4cff9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:06.277749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b3be011-5028-4268-b70b-d5a387d4cff9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:06.278196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8b3be011-5028-4268-b70b-d5a387d4cff9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:06.417858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8b3be011-5028-4268-b70b-d5a387d4cff9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:06.425631 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8b3be011-5028-4268-b70b-d5a387d4cff9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1691 microversion: 2.1 time: 0.162109 Oct 04 21:58:06.426275 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3440/6859] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:06 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:07.448662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-018bf65a-6e24-412f-9aca-d275523e72b6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:07.449291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-018bf65a-6e24-412f-9aca-d275523e72b6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:07.456004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-018bf65a-6e24-412f-9aca-d275523e72b6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:07.456499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-018bf65a-6e24-412f-9aca-d275523e72b6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:07.456952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-018bf65a-6e24-412f-9aca-d275523e72b6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:07.458262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-018bf65a-6e24-412f-9aca-d275523e72b6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:07.458727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-018bf65a-6e24-412f-9aca-d275523e72b6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:07.459166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-018bf65a-6e24-412f-9aca-d275523e72b6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:07.668538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-018bf65a-6e24-412f-9aca-d275523e72b6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:07.679424 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-018bf65a-6e24-412f-9aca-d275523e72b6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1691 microversion: 2.1 time: 0.234420 Oct 04 21:58:07.686205 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3420/6860] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:07 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1691 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:08.704520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8e30a33f-9553-47ec-8fa9-cfb9627f0591 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:08.705177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8e30a33f-9553-47ec-8fa9-cfb9627f0591 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:08.712879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e30a33f-9553-47ec-8fa9-cfb9627f0591 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:08.713382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e30a33f-9553-47ec-8fa9-cfb9627f0591 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:08.713871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e30a33f-9553-47ec-8fa9-cfb9627f0591 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:08.714574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e30a33f-9553-47ec-8fa9-cfb9627f0591 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:08.715215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e30a33f-9553-47ec-8fa9-cfb9627f0591 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:08.715660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e30a33f-9553-47ec-8fa9-cfb9627f0591 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:08.853388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8e30a33f-9553-47ec-8fa9-cfb9627f0591 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:08.861678 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8e30a33f-9553-47ec-8fa9-cfb9627f0591 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1681 microversion: 2.1 time: 0.161196 Oct 04 21:58:08.862260 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3441/6861] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:08 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:08.884842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7f63ac27-bfa4-4899-b18f-5ae4cb8440e7 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:08.885481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7f63ac27-bfa4-4899-b18f-5ae4cb8440e7 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:08.892365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f63ac27-bfa4-4899-b18f-5ae4cb8440e7 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:08.892854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f63ac27-bfa4-4899-b18f-5ae4cb8440e7 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:08.893297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f63ac27-bfa4-4899-b18f-5ae4cb8440e7 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:08.894017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f63ac27-bfa4-4899-b18f-5ae4cb8440e7 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:08.894478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f63ac27-bfa4-4899-b18f-5ae4cb8440e7 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:08.894911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f63ac27-bfa4-4899-b18f-5ae4cb8440e7 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:09.024255 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7f63ac27-bfa4-4899-b18f-5ae4cb8440e7 tempest-TestNetworkAdvancedServerOps-242842544 tempest-TestNetworkAdvancedServerOps-242842544-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1832 microversion: 2.1 time: 0.143018 Oct 04 21:58:09.031355 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3421/6862] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:08 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1832 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:09.048875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-71db76a2-f104-480d-a15b-14ed05172e5e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:09.049481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-71db76a2-f104-480d-a15b-14ed05172e5e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:09.055622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71db76a2-f104-480d-a15b-14ed05172e5e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:09.056126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71db76a2-f104-480d-a15b-14ed05172e5e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:09.056590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71db76a2-f104-480d-a15b-14ed05172e5e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:09.057301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71db76a2-f104-480d-a15b-14ed05172e5e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:09.057862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71db76a2-f104-480d-a15b-14ed05172e5e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:09.058310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71db76a2-f104-480d-a15b-14ed05172e5e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:09.193980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-71db76a2-f104-480d-a15b-14ed05172e5e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:09.202122 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-71db76a2-f104-480d-a15b-14ed05172e5e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1681 microversion: 2.1 time: 0.157210 Oct 04 21:58:09.202703 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3442/6863] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:09 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:09.297781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-37ceb26b-d1a9-406b-8ac0-e2b69e37bb6d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:09.300348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-37ceb26b-d1a9-406b-8ac0-e2b69e37bb6d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:09.306642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37ceb26b-d1a9-406b-8ac0-e2b69e37bb6d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:09.307141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37ceb26b-d1a9-406b-8ac0-e2b69e37bb6d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:09.307587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37ceb26b-d1a9-406b-8ac0-e2b69e37bb6d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:09.308292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37ceb26b-d1a9-406b-8ac0-e2b69e37bb6d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:09.308755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37ceb26b-d1a9-406b-8ac0-e2b69e37bb6d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:09.309192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37ceb26b-d1a9-406b-8ac0-e2b69e37bb6d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:09.376130 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-37ceb26b-d1a9-406b-8ac0-e2b69e37bb6d tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c/action" status: 200 len: 38528 microversion: 2.1 time: 0.082227 Oct 04 21:58:09.376794 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3422/6864] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:58:09 2022] POST /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c/action => generated 38528 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:58:14.211278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-96a4199b-7ffb-4c70-af23-f7923e2fb1c7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:14.211802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-96a4199b-7ffb-4c70-af23-f7923e2fb1c7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:14.215413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-3a7a4475-36c2-4675-b962-c5ca74ec58cd req-d0a294cf-2e48-49a1-81f9-6e489d6fbe2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3131d2-f12f-4d56-8794-bcb09057583c", "tag": "96a3ded2-e29b-4af6-b7d1-a769588c08fb"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:14.218817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96a4199b-7ffb-4c70-af23-f7923e2fb1c7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:14.219357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96a4199b-7ffb-4c70-af23-f7923e2fb1c7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:14.219796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96a4199b-7ffb-4c70-af23-f7923e2fb1c7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:14.220566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96a4199b-7ffb-4c70-af23-f7923e2fb1c7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:14.220996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96a4199b-7ffb-4c70-af23-f7923e2fb1c7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:14.221471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-96a4199b-7ffb-4c70-af23-f7923e2fb1c7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:14.228187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3a7a4475-36c2-4675-b962-c5ca74ec58cd req-d0a294cf-2e48-49a1-81f9-6e489d6fbe2d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:14.228674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3a7a4475-36c2-4675-b962-c5ca74ec58cd req-d0a294cf-2e48-49a1-81f9-6e489d6fbe2d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:14.229227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3a7a4475-36c2-4675-b962-c5ca74ec58cd req-d0a294cf-2e48-49a1-81f9-6e489d6fbe2d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:14.241697 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-3a7a4475-36c2-4675-b962-c5ca74ec58cd req-d0a294cf-2e48-49a1-81f9-6e489d6fbe2d service nova] Creating event network-changed:96a3ded2-e29b-4af6-b7d1-a769588c08fb for instance 3f3131d2-f12f-4d56-8794-bcb09057583c on n-h2-860282-1 Oct 04 21:58:14.246701 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-3a7a4475-36c2-4675-b962-c5ca74ec58cd req-d0a294cf-2e48-49a1-81f9-6e489d6fbe2d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035634 Oct 04 21:58:14.247688 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3423/6865] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:58:14.251139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-96a4199b-7ffb-4c70-af23-f7923e2fb1c7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:58:14.524665 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-96a4199b-7ffb-4c70-af23-f7923e2fb1c7 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 204 len: 0 microversion: 2.1 time: 0.317837 Oct 04 21:58:14.533785 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3443/6866] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 21:58:14 2022] DELETE /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:58:14.535841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d25f4ccf-9db2-44c0-9e76-941fef770f66 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:14.536856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d25f4ccf-9db2-44c0-9e76-941fef770f66 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:14.546188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d25f4ccf-9db2-44c0-9e76-941fef770f66 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:14.546916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d25f4ccf-9db2-44c0-9e76-941fef770f66 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:14.547534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d25f4ccf-9db2-44c0-9e76-941fef770f66 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:14.548469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d25f4ccf-9db2-44c0-9e76-941fef770f66 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:14.548941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d25f4ccf-9db2-44c0-9e76-941fef770f66 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:14.549379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d25f4ccf-9db2-44c0-9e76-941fef770f66 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:14.685758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d25f4ccf-9db2-44c0-9e76-941fef770f66 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:14.697342 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d25f4ccf-9db2-44c0-9e76-941fef770f66 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1687 microversion: 2.1 time: 0.166766 Oct 04 21:58:14.697966 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3424/6867] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:14 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:15.584304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-8b67bd75-42ed-43d2-a4cc-f97570170dab req-49929031-ccda-4e31-8b55-27ec3250efa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3131d2-f12f-4d56-8794-bcb09057583c", "name": "network-vif-deleted", "tag": "96a3ded2-e29b-4af6-b7d1-a769588c08fb"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:15.595205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8b67bd75-42ed-43d2-a4cc-f97570170dab req-49929031-ccda-4e31-8b55-27ec3250efa3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:15.595694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8b67bd75-42ed-43d2-a4cc-f97570170dab req-49929031-ccda-4e31-8b55-27ec3250efa3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:15.596276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8b67bd75-42ed-43d2-a4cc-f97570170dab req-49929031-ccda-4e31-8b55-27ec3250efa3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:15.607468 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-8b67bd75-42ed-43d2-a4cc-f97570170dab req-49929031-ccda-4e31-8b55-27ec3250efa3 service nova] Creating event network-vif-deleted:96a3ded2-e29b-4af6-b7d1-a769588c08fb for instance 3f3131d2-f12f-4d56-8794-bcb09057583c on n-h2-860282-1 Oct 04 21:58:15.612262 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-8b67bd75-42ed-43d2-a4cc-f97570170dab req-49929031-ccda-4e31-8b55-27ec3250efa3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032572 Oct 04 21:58:15.612847 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3444/6868] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:15.721720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1c6cd0ee-4bcf-4ea2-87e9-cf9c8b957445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:15.722533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1c6cd0ee-4bcf-4ea2-87e9-cf9c8b957445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:15.730642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6cd0ee-4bcf-4ea2-87e9-cf9c8b957445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:15.731128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6cd0ee-4bcf-4ea2-87e9-cf9c8b957445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:15.731565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6cd0ee-4bcf-4ea2-87e9-cf9c8b957445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:15.733650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6cd0ee-4bcf-4ea2-87e9-cf9c8b957445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:15.733650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6cd0ee-4bcf-4ea2-87e9-cf9c8b957445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:15.733650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c6cd0ee-4bcf-4ea2-87e9-cf9c8b957445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:15.800298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1c6cd0ee-4bcf-4ea2-87e9-cf9c8b957445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:15.808338 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1c6cd0ee-4bcf-4ea2-87e9-cf9c8b957445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 200 len: 1351 microversion: 2.1 time: 0.090573 Oct 04 21:58:15.810441 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3425/6869] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:15 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 1351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:16.833256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a7996d2a-a6c5-44e7-b04f-3f66ddf7a26e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:16.834009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a7996d2a-a6c5-44e7-b04f-3f66ddf7a26e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: 3f3131d2-f12f-4d56-8794-bcb09057583c] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:16.840194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7996d2a-a6c5-44e7-b04f-3f66ddf7a26e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:16.840695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7996d2a-a6c5-44e7-b04f-3f66ddf7a26e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:16.841161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7996d2a-a6c5-44e7-b04f-3f66ddf7a26e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:16.841896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7996d2a-a6c5-44e7-b04f-3f66ddf7a26e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:16.842369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7996d2a-a6c5-44e7-b04f-3f66ddf7a26e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:16.842812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a7996d2a-a6c5-44e7-b04f-3f66ddf7a26e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:16.856363 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-a7996d2a-a6c5-44e7-b04f-3f66ddf7a26e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] HTTP exception thrown: Instance 3f3131d2-f12f-4d56-8794-bcb09057583c could not be found. Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a7996d2a-a6c5-44e7-b04f-3f66ddf7a26e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Request method failure captured: Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c HTTP/1.1 Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKsg9wdsQpKRxIYoCO18EnGkiXvFaK3Y37dAKXCvkpYNlW5hI6Th3vwXBScO1z15nuZq6dcbLpHb4UAi01qVzCkAXMzlesG1frtWG0k1ymFc191M4FAp7BOhLPARXjbwQP08vsZYIaM8TzkponyUyXqAm9ryQobG9UgDnWq6vToxOSs Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 187e190360d14111a4107866a8000348 Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-875125608 Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/187e190360d14111a4107866a8000348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_187e190360d14111a4107866a8000348"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/187e190360d14111a4107866a8000348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/187e190360d14111a4107866a8000348"}]}] Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestNetworkAdvancedServerOps-875125608 Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 187e190360d14111a4107866a8000348 Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-875125608 Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestNetworkAdvancedServerOps-875125608-project Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 8c893eb5126c4c9db1012c199660261c Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestNetworkAdvancedServerOps-875125608-project Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 3f3131d2-f12f-4d56-8794-bcb09057583c could not be found. Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '3f3131d2-f12f-4d56-8794-bcb09057583c'} Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f3131d2-f12f-4d56-8794-bcb09057583c could not be found. Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f3131d2-f12f-4d56-8794-bcb09057583c could not be found. Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:58:16.858026 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:16.862599 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:58:16.862599 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:16.862599 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:16.862599 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:16.862599 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:16.862599 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:16.862599 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f3131d2-f12f-4d56-8794-bcb09057583c could not be found. Oct 04 21:58:16.862599 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 21:58:16.862599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a7996d2a-a6c5-44e7-b04f-3f66ddf7a26e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Returning 404 to user: Instance 3f3131d2-f12f-4d56-8794-bcb09057583c could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:16.862599 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a7996d2a-a6c5-44e7-b04f-3f66ddf7a26e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c" status: 404 len: 111 microversion: 2.1 time: 0.032084 Oct 04 21:58:16.862599 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3445/6870] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:16 2022] GET /compute/v2.1/servers/3f3131d2-f12f-4d56-8794-bcb09057583c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:58:20.328917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e37776dd-2b3d-46b4-afdf-05a1fd88069e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '.version_select at 0x7f5790de31f0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:20.417576 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e37776dd-2b3d-46b4-afdf-05a1fd88069e tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1367819598" status: 202 len: 0 microversion: 2.1 time: 0.092335 Oct 04 21:58:20.418068 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3426/6871] 10.222.0.30 () {58 vars in 1284 bytes} [Tue Oct 4 21:58:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1367819598 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:58:20.447793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-392d0437-45a1-4bdf-a43a-14c1906b5e64 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'create', calling method: .version_select at 0x7f578af7d4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-165750379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPR/spsCxFHImg8xzpTTIE0EPxFV1SrO/oCaBpWRqzpjKsRTs0mLWyuNcL/Q+5yYGosSbdO3vDgiSHkFjD4R+Aylo9DBcId9DVJfZWC5+lIq8QUixjeptzfAYLn07BMBtA=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:20.454064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:20.467085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-392d0437-45a1-4bdf-a43a-14c1906b5e64 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Getting quotas for project 187e190360d14111a4107866a8000348. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:58:20.471400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-392d0437-45a1-4bdf-a43a-14c1906b5e64 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Getting quotas for user 8c893eb5126c4c9db1012c199660261c and project 187e190360d14111a4107866a8000348. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:58:20.594790 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-392d0437-45a1-4bdf-a43a-14c1906b5e64 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.150923 Oct 04 21:58:20.595402 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3446/6872] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 21:58:20 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:28.652396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=64 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:28.657253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9ba5dff8-3905-417d-a59e-27d0126893e4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1794952793", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "b130df35-cd5a-4161-88ee-36c75225c691"}], "key_name": "tempest-TestNetworkAdvancedServerOps-165750379", "security_groups": [{"name": "tempest-secgroup-smoke-1598764836"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:28.668110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:28.788910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-9ba5dff8-3905-417d-a59e-27d0126893e4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] validate_networks() for [('b130df35-cd5a-4161-88ee-36c75225c691', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:58:29.223194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-9ba5dff8-3905-417d-a59e-27d0126893e4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:58:29.223632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-9ba5dff8-3905-417d-a59e-27d0126893e4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:58:29.224143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-9ba5dff8-3905-417d-a59e-27d0126893e4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:58:29.224560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-9ba5dff8-3905-417d-a59e-27d0126893e4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:58:29.224979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-9ba5dff8-3905-417d-a59e-27d0126893e4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:58:29.234248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ba5dff8-3905-417d-a59e-27d0126893e4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:29.234737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ba5dff8-3905-417d-a59e-27d0126893e4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:29.235182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ba5dff8-3905-417d-a59e-27d0126893e4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:29.235912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ba5dff8-3905-417d-a59e-27d0126893e4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:29.236369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ba5dff8-3905-417d-a59e-27d0126893e4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:29.236801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ba5dff8-3905-417d-a59e-27d0126893e4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:29.255931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-9ba5dff8-3905-417d-a59e-27d0126893e4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Getting quotas for project 187e190360d14111a4107866a8000348. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:58:29.262579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-9ba5dff8-3905-417d-a59e-27d0126893e4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Getting quotas for user 8c893eb5126c4c9db1012c199660261c and project 187e190360d14111a4107866a8000348. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:58:29.277473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9ba5dff8-3905-417d-a59e-27d0126893e4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:58:29.279871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9ba5dff8-3905-417d-a59e-27d0126893e4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:58:29.378883 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9ba5dff8-3905-417d-a59e-27d0126893e4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.728463 Oct 04 21:58:29.379548 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3427/6873] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 21:58:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:58:29.388846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:29.393893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-269aeb07-e3d1-46ae-beff-ec2feec5f6c4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:29.394900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-269aeb07-e3d1-46ae-beff-ec2feec5f6c4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:29.460009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-269aeb07-e3d1-46ae-beff-ec2feec5f6c4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:29.468891 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-269aeb07-e3d1-46ae-beff-ec2feec5f6c4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1266 microversion: 2.1 time: 0.081728 Oct 04 21:58:29.469606 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3447/6874] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:29 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:30.492913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dc04a78a-81ea-4579-92ca-a6b16ba69428 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:30.493601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dc04a78a-81ea-4579-92ca-a6b16ba69428 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:30.501576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc04a78a-81ea-4579-92ca-a6b16ba69428 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:30.502141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc04a78a-81ea-4579-92ca-a6b16ba69428 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:30.502593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc04a78a-81ea-4579-92ca-a6b16ba69428 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:30.503307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc04a78a-81ea-4579-92ca-a6b16ba69428 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:30.503772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc04a78a-81ea-4579-92ca-a6b16ba69428 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:30.504338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc04a78a-81ea-4579-92ca-a6b16ba69428 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:30.579877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dc04a78a-81ea-4579-92ca-a6b16ba69428 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:30.588715 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dc04a78a-81ea-4579-92ca-a6b16ba69428 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1270 microversion: 2.1 time: 0.100240 Oct 04 21:58:30.589315 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3428/6875] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:30 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:31.612191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-442ae7f2-5a2e-42f3-a4f2-811440bf1e7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:31.612823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-442ae7f2-5a2e-42f3-a4f2-811440bf1e7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:31.624337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-442ae7f2-5a2e-42f3-a4f2-811440bf1e7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:31.624787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-442ae7f2-5a2e-42f3-a4f2-811440bf1e7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:31.625485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-442ae7f2-5a2e-42f3-a4f2-811440bf1e7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:31.626220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-442ae7f2-5a2e-42f3-a4f2-811440bf1e7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:31.626712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-442ae7f2-5a2e-42f3-a4f2-811440bf1e7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:31.627150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-442ae7f2-5a2e-42f3-a4f2-811440bf1e7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:31.698672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-442ae7f2-5a2e-42f3-a4f2-811440bf1e7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:31.706986 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-442ae7f2-5a2e-42f3-a4f2-811440bf1e7a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1336 microversion: 2.1 time: 0.098650 Oct 04 21:58:31.707635 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3448/6876] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:31 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1336 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:32.730662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-839e25b3-ba22-4f7b-940f-bf36f4b4f5a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:32.731206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-839e25b3-ba22-4f7b-940f-bf36f4b4f5a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:32.738070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-839e25b3-ba22-4f7b-940f-bf36f4b4f5a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:32.738570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-839e25b3-ba22-4f7b-940f-bf36f4b4f5a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:32.739950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-839e25b3-ba22-4f7b-940f-bf36f4b4f5a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:32.739950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-839e25b3-ba22-4f7b-940f-bf36f4b4f5a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:32.740266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-839e25b3-ba22-4f7b-940f-bf36f4b4f5a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:32.740558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-839e25b3-ba22-4f7b-940f-bf36f4b4f5a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:32.876690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-839e25b3-ba22-4f7b-940f-bf36f4b4f5a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:32.886823 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-839e25b3-ba22-4f7b-940f-bf36f4b4f5a0 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1392 microversion: 2.1 time: 0.160280 Oct 04 21:58:32.887506 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3429/6877] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:32 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:33.147264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-f77045a2-3ecc-4e2c-93e0-53093d4589b5 req-10e8f9d3-a76a-415d-b5c4-1e5208f555ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dab6c187-01fc-4aeb-a5d3-c69f565a05a2", "tag": "088246be-fee0-4827-ae1c-e780d2fdc9c3"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:33.158694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f77045a2-3ecc-4e2c-93e0-53093d4589b5 req-10e8f9d3-a76a-415d-b5c4-1e5208f555ad service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:33.159407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f77045a2-3ecc-4e2c-93e0-53093d4589b5 req-10e8f9d3-a76a-415d-b5c4-1e5208f555ad service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:33.159856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f77045a2-3ecc-4e2c-93e0-53093d4589b5 req-10e8f9d3-a76a-415d-b5c4-1e5208f555ad service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:33.171648 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-f77045a2-3ecc-4e2c-93e0-53093d4589b5 req-10e8f9d3-a76a-415d-b5c4-1e5208f555ad service nova] Creating event network-changed:088246be-fee0-4827-ae1c-e780d2fdc9c3 for instance dab6c187-01fc-4aeb-a5d3-c69f565a05a2 on n-h1-860282-1 Oct 04 21:58:33.176628 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-f77045a2-3ecc-4e2c-93e0-53093d4589b5 req-10e8f9d3-a76a-415d-b5c4-1e5208f555ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033595 Oct 04 21:58:33.177228 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3449/6878] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:33.909753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8eb9d420-9bbf-4e9e-88e0-b82ab02be411 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:33.910399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8eb9d420-9bbf-4e9e-88e0-b82ab02be411 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:33.918083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8eb9d420-9bbf-4e9e-88e0-b82ab02be411 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:33.918571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8eb9d420-9bbf-4e9e-88e0-b82ab02be411 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:33.919015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8eb9d420-9bbf-4e9e-88e0-b82ab02be411 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:33.919710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8eb9d420-9bbf-4e9e-88e0-b82ab02be411 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:33.920170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8eb9d420-9bbf-4e9e-88e0-b82ab02be411 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:33.920599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8eb9d420-9bbf-4e9e-88e0-b82ab02be411 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:34.054468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8eb9d420-9bbf-4e9e-88e0-b82ab02be411 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:34.062961 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8eb9d420-9bbf-4e9e-88e0-b82ab02be411 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1392 microversion: 2.1 time: 0.157183 Oct 04 21:58:34.063539 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3430/6879] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:33 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:35.086903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-48b91559-e8a1-41d8-91a6-0bcd1ef0dd60 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:35.087632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-48b91559-e8a1-41d8-91a6-0bcd1ef0dd60 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:35.094714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48b91559-e8a1-41d8-91a6-0bcd1ef0dd60 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:35.095223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48b91559-e8a1-41d8-91a6-0bcd1ef0dd60 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:35.095704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48b91559-e8a1-41d8-91a6-0bcd1ef0dd60 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:35.096417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48b91559-e8a1-41d8-91a6-0bcd1ef0dd60 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:35.096892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48b91559-e8a1-41d8-91a6-0bcd1ef0dd60 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:35.097338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-48b91559-e8a1-41d8-91a6-0bcd1ef0dd60 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:35.230529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-48b91559-e8a1-41d8-91a6-0bcd1ef0dd60 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:35.238576 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-48b91559-e8a1-41d8-91a6-0bcd1ef0dd60 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1392 microversion: 2.1 time: 0.156407 Oct 04 21:58:35.239418 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3450/6880] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:35 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:36.261796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fd7b103c-9c74-4258-9c19-0548f77b7f27 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:36.262414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fd7b103c-9c74-4258-9c19-0548f77b7f27 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:36.268952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd7b103c-9c74-4258-9c19-0548f77b7f27 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:36.269473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd7b103c-9c74-4258-9c19-0548f77b7f27 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:36.269917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd7b103c-9c74-4258-9c19-0548f77b7f27 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:36.270639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd7b103c-9c74-4258-9c19-0548f77b7f27 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:36.271070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd7b103c-9c74-4258-9c19-0548f77b7f27 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:36.271502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd7b103c-9c74-4258-9c19-0548f77b7f27 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:36.408806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fd7b103c-9c74-4258-9c19-0548f77b7f27 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:36.417380 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fd7b103c-9c74-4258-9c19-0548f77b7f27 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1392 microversion: 2.1 time: 0.159756 Oct 04 21:58:36.417985 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3431/6881] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:36 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:37.440512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c205a585-90fb-44f7-8442-b6770253d1dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:37.441139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c205a585-90fb-44f7-8442-b6770253d1dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:37.448593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c205a585-90fb-44f7-8442-b6770253d1dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:37.449090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c205a585-90fb-44f7-8442-b6770253d1dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:37.449569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c205a585-90fb-44f7-8442-b6770253d1dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:37.450266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c205a585-90fb-44f7-8442-b6770253d1dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:37.450734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c205a585-90fb-44f7-8442-b6770253d1dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:37.451172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c205a585-90fb-44f7-8442-b6770253d1dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:37.582297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c205a585-90fb-44f7-8442-b6770253d1dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:37.590173 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c205a585-90fb-44f7-8442-b6770253d1dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1392 microversion: 2.1 time: 0.153564 Oct 04 21:58:37.590751 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3451/6882] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:37 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:38.612204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-96a6da85-30fa-4da1-808b-9d047e882c09 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:38.612815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-96a6da85-30fa-4da1-808b-9d047e882c09 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:38.619821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96a6da85-30fa-4da1-808b-9d047e882c09 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:38.620309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96a6da85-30fa-4da1-808b-9d047e882c09 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:38.620933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96a6da85-30fa-4da1-808b-9d047e882c09 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:38.621673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96a6da85-30fa-4da1-808b-9d047e882c09 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:38.622132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96a6da85-30fa-4da1-808b-9d047e882c09 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:38.622559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-96a6da85-30fa-4da1-808b-9d047e882c09 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:38.767830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-96a6da85-30fa-4da1-808b-9d047e882c09 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:38.776910 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-96a6da85-30fa-4da1-808b-9d047e882c09 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1392 microversion: 2.1 time: 0.168592 Oct 04 21:58:38.777517 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3432/6883] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:38 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:39.800608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-85c80f7a-df66-4257-8eac-ffd1a7d9df22 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:39.801469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-85c80f7a-df66-4257-8eac-ffd1a7d9df22 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:39.804264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:39.810571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-85c80f7a-df66-4257-8eac-ffd1a7d9df22 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:39.814352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-85c80f7a-df66-4257-8eac-ffd1a7d9df22 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:39.814352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-85c80f7a-df66-4257-8eac-ffd1a7d9df22 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:39.814352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-85c80f7a-df66-4257-8eac-ffd1a7d9df22 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:39.814352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-85c80f7a-df66-4257-8eac-ffd1a7d9df22 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:39.814352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-85c80f7a-df66-4257-8eac-ffd1a7d9df22 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:39.949092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-85c80f7a-df66-4257-8eac-ffd1a7d9df22 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:39.957007 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-85c80f7a-df66-4257-8eac-ffd1a7d9df22 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1392 microversion: 2.1 time: 0.160417 Oct 04 21:58:39.957644 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3452/6884] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:39 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:40.097963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-f88c33ac-8563-40b5-a8cf-b3cb55d5658d req-16dae6f3-8d74-4937-9eed-34b9a9fd9788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab6c187-01fc-4aeb-a5d3-c69f565a05a2", "name": "network-vif-plugged", "status": "completed", "tag": "088246be-fee0-4827-ae1c-e780d2fdc9c3"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:40.103579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:40.104267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:40.110487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f88c33ac-8563-40b5-a8cf-b3cb55d5658d req-16dae6f3-8d74-4937-9eed-34b9a9fd9788 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:40.112028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f88c33ac-8563-40b5-a8cf-b3cb55d5658d req-16dae6f3-8d74-4937-9eed-34b9a9fd9788 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:40.112028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f88c33ac-8563-40b5-a8cf-b3cb55d5658d req-16dae6f3-8d74-4937-9eed-34b9a9fd9788 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:40.123294 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-f88c33ac-8563-40b5-a8cf-b3cb55d5658d req-16dae6f3-8d74-4937-9eed-34b9a9fd9788 service nova] Creating event network-vif-plugged:088246be-fee0-4827-ae1c-e780d2fdc9c3 for instance dab6c187-01fc-4aeb-a5d3-c69f565a05a2 on n-h1-860282-1 Oct 04 21:58:40.128165 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-f88c33ac-8563-40b5-a8cf-b3cb55d5658d req-16dae6f3-8d74-4937-9eed-34b9a9fd9788 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034119 Oct 04 21:58:40.128728 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3433/6885] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:40.980213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-78403745-1c0a-4e7b-8aca-98587103a445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:40.981174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-78403745-1c0a-4e7b-8aca-98587103a445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:40.987725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78403745-1c0a-4e7b-8aca-98587103a445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:40.990361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78403745-1c0a-4e7b-8aca-98587103a445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:40.990361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78403745-1c0a-4e7b-8aca-98587103a445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:40.990361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78403745-1c0a-4e7b-8aca-98587103a445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:40.990361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78403745-1c0a-4e7b-8aca-98587103a445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:40.990361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78403745-1c0a-4e7b-8aca-98587103a445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:41.122233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-78403745-1c0a-4e7b-8aca-98587103a445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:41.129931 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-78403745-1c0a-4e7b-8aca-98587103a445 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1392 microversion: 2.1 time: 0.153682 Oct 04 21:58:41.130505 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3453/6886] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:40 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:42.153478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a6a67bbd-090f-4c5c-83bc-b374ccfe659f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:42.154188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a6a67bbd-090f-4c5c-83bc-b374ccfe659f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:42.162426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a6a67bbd-090f-4c5c-83bc-b374ccfe659f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:42.162909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a6a67bbd-090f-4c5c-83bc-b374ccfe659f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:42.163349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a6a67bbd-090f-4c5c-83bc-b374ccfe659f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:42.164040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a6a67bbd-090f-4c5c-83bc-b374ccfe659f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:42.164501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a6a67bbd-090f-4c5c-83bc-b374ccfe659f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:42.164929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a6a67bbd-090f-4c5c-83bc-b374ccfe659f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:42.303591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a6a67bbd-090f-4c5c-83bc-b374ccfe659f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:42.311336 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a6a67bbd-090f-4c5c-83bc-b374ccfe659f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1564 microversion: 2.1 time: 0.162928 Oct 04 21:58:42.311911 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3434/6887] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:42 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:42.334168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-03574b49-13dd-4fb3-b586-ebfe701b753f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:42.334961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-03574b49-13dd-4fb3-b586-ebfe701b753f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:42.342875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03574b49-13dd-4fb3-b586-ebfe701b753f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:42.343444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03574b49-13dd-4fb3-b586-ebfe701b753f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:42.351841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03574b49-13dd-4fb3-b586-ebfe701b753f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:42.351841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03574b49-13dd-4fb3-b586-ebfe701b753f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:42.351841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03574b49-13dd-4fb3-b586-ebfe701b753f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:42.351841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03574b49-13dd-4fb3-b586-ebfe701b753f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:42.478701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-03574b49-13dd-4fb3-b586-ebfe701b753f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:42.486473 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-03574b49-13dd-4fb3-b586-ebfe701b753f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1564 microversion: 2.1 time: 0.156364 Oct 04 21:58:42.487244 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3454/6888] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:42 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:44.668166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-93007920-2a9b-404f-bb4f-6ddf1481f864 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:44.669011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-ba08ea5d-b57c-4036-8133-1885f21541f9 req-fb0be235-5168-4ccf-96ab-5c7aebffc1ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dab6c187-01fc-4aeb-a5d3-c69f565a05a2", "tag": "088246be-fee0-4827-ae1c-e780d2fdc9c3"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:44.669627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-93007920-2a9b-404f-bb4f-6ddf1481f864 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:44.681756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93007920-2a9b-404f-bb4f-6ddf1481f864 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:44.682258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93007920-2a9b-404f-bb4f-6ddf1481f864 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:44.682705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93007920-2a9b-404f-bb4f-6ddf1481f864 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:44.683423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93007920-2a9b-404f-bb4f-6ddf1481f864 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:44.683888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93007920-2a9b-404f-bb4f-6ddf1481f864 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:44.684597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93007920-2a9b-404f-bb4f-6ddf1481f864 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:44.693886 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ba08ea5d-b57c-4036-8133-1885f21541f9 req-fb0be235-5168-4ccf-96ab-5c7aebffc1ea service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:44.694720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ba08ea5d-b57c-4036-8133-1885f21541f9 req-fb0be235-5168-4ccf-96ab-5c7aebffc1ea service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:44.695390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ba08ea5d-b57c-4036-8133-1885f21541f9 req-fb0be235-5168-4ccf-96ab-5c7aebffc1ea service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:44.710696 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-ba08ea5d-b57c-4036-8133-1885f21541f9 req-fb0be235-5168-4ccf-96ab-5c7aebffc1ea service nova] Creating event network-changed:088246be-fee0-4827-ae1c-e780d2fdc9c3 for instance dab6c187-01fc-4aeb-a5d3-c69f565a05a2 on n-h1-860282-1 Oct 04 21:58:44.716956 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-ba08ea5d-b57c-4036-8133-1885f21541f9 req-fb0be235-5168-4ccf-96ab-5c7aebffc1ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055097 Oct 04 21:58:44.717765 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3455/6889] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:58:44.833860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-93007920-2a9b-404f-bb4f-6ddf1481f864 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:44.843034 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-93007920-2a9b-404f-bb4f-6ddf1481f864 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1564 microversion: 2.1 time: 0.185059 Oct 04 21:58:44.843625 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3435/6890] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:44 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1564 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:06.098563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:06.099267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=40 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:06.103490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c8a182c2-1618-4e64-b81a-1009c3a3bdd4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:06.105807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c8a182c2-1618-4e64-b81a-1009c3a3bdd4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:06.112009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8a182c2-1618-4e64-b81a-1009c3a3bdd4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:06.112512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8a182c2-1618-4e64-b81a-1009c3a3bdd4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:06.112981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8a182c2-1618-4e64-b81a-1009c3a3bdd4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:06.113722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8a182c2-1618-4e64-b81a-1009c3a3bdd4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:06.114201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8a182c2-1618-4e64-b81a-1009c3a3bdd4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:06.114647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c8a182c2-1618-4e64-b81a-1009c3a3bdd4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:06.171363 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c8a182c2-1618-4e64-b81a-1009c3a3bdd4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2/action" status: 200 len: 24568 microversion: 2.1 time: 0.074901 Oct 04 21:59:06.172005 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3456/6891] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:59:06 2022] POST /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2/action => generated 24568 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:59:17.138959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:17.142341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:17.144468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:17.145189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=46 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:17.150875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:17.151367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:17.151812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:17.152518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:17.152982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:17.153446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:17.240659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:59:17.241143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:59:17.241657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:59:17.242071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:59:17.242483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:59:17.429106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:17.435087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:17.435588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:17.436067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:17.436774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:17.437232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:17.437686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:17.463870 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1cc0e300-dad2-4fcb-830a-acef5cc31e32 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2/action" status: 202 len: 1138 microversion: 2.1 time: 0.329285 Oct 04 21:59:17.464519 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3436/6892] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 21:59:17 2022] POST /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2/action => generated 1138 bytes in 331 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 21:59:17.484994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b313b668-a5bc-42e4-ae31-fb082a12f111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:17.486785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b313b668-a5bc-42e4-ae31-fb082a12f111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:17.489142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:17.495173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b313b668-a5bc-42e4-ae31-fb082a12f111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:17.495682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b313b668-a5bc-42e4-ae31-fb082a12f111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:17.496144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b313b668-a5bc-42e4-ae31-fb082a12f111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:17.496863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b313b668-a5bc-42e4-ae31-fb082a12f111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:17.497339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b313b668-a5bc-42e4-ae31-fb082a12f111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:17.497820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b313b668-a5bc-42e4-ae31-fb082a12f111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:17.634944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b313b668-a5bc-42e4-ae31-fb082a12f111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:17.643381 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b313b668-a5bc-42e4-ae31-fb082a12f111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1692 microversion: 2.1 time: 0.162935 Oct 04 21:59:17.643941 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3457/6893] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:17 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:18.667024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6abb75df-b259-4b2d-a9cb-4ad13d5ca51f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:18.667642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6abb75df-b259-4b2d-a9cb-4ad13d5ca51f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:18.675253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6abb75df-b259-4b2d-a9cb-4ad13d5ca51f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:18.675738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6abb75df-b259-4b2d-a9cb-4ad13d5ca51f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:18.676179 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6abb75df-b259-4b2d-a9cb-4ad13d5ca51f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:18.676869 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6abb75df-b259-4b2d-a9cb-4ad13d5ca51f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:18.677334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6abb75df-b259-4b2d-a9cb-4ad13d5ca51f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:18.677790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6abb75df-b259-4b2d-a9cb-4ad13d5ca51f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:18.820558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6abb75df-b259-4b2d-a9cb-4ad13d5ca51f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:18.828625 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6abb75df-b259-4b2d-a9cb-4ad13d5ca51f tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1692 microversion: 2.1 time: 0.165766 Oct 04 21:59:18.829190 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3437/6894] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:18 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:19.854959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-54947533-2179-4626-8588-a493934d29d2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:19.855493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-54947533-2179-4626-8588-a493934d29d2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:19.862594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54947533-2179-4626-8588-a493934d29d2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:19.863103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54947533-2179-4626-8588-a493934d29d2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:19.863561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54947533-2179-4626-8588-a493934d29d2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:19.864272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54947533-2179-4626-8588-a493934d29d2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:19.864743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54947533-2179-4626-8588-a493934d29d2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:19.865190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54947533-2179-4626-8588-a493934d29d2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:20.004148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-54947533-2179-4626-8588-a493934d29d2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:20.011813 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-54947533-2179-4626-8588-a493934d29d2 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1692 microversion: 2.1 time: 0.162319 Oct 04 21:59:20.012421 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3458/6895] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:19 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:21.035979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-74541e8b-cc21-4ad9-868e-4076e500b75c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:21.036596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-74541e8b-cc21-4ad9-868e-4076e500b75c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:21.043427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74541e8b-cc21-4ad9-868e-4076e500b75c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:21.043933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74541e8b-cc21-4ad9-868e-4076e500b75c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:21.044361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74541e8b-cc21-4ad9-868e-4076e500b75c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:21.045063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74541e8b-cc21-4ad9-868e-4076e500b75c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:21.046067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74541e8b-cc21-4ad9-868e-4076e500b75c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:21.046504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-74541e8b-cc21-4ad9-868e-4076e500b75c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:21.182712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-74541e8b-cc21-4ad9-868e-4076e500b75c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:21.191456 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-74541e8b-cc21-4ad9-868e-4076e500b75c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1692 microversion: 2.1 time: 0.159473 Oct 04 21:59:21.192019 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3438/6896] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:21 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:22.215021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-300c5426-5698-429d-992b-02c7d29d9ad3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:22.215660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-300c5426-5698-429d-992b-02c7d29d9ad3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:22.222582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-300c5426-5698-429d-992b-02c7d29d9ad3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:22.223085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-300c5426-5698-429d-992b-02c7d29d9ad3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:22.223543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-300c5426-5698-429d-992b-02c7d29d9ad3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:22.224252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-300c5426-5698-429d-992b-02c7d29d9ad3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:22.224725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-300c5426-5698-429d-992b-02c7d29d9ad3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:22.225172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-300c5426-5698-429d-992b-02c7d29d9ad3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:22.361045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-300c5426-5698-429d-992b-02c7d29d9ad3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:22.368799 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-300c5426-5698-429d-992b-02c7d29d9ad3 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1692 microversion: 2.1 time: 0.157694 Oct 04 21:59:22.369369 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3459/6897] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:22 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:23.392764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-242490e7-89f9-4378-8146-f6e71a7866b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:23.393377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-242490e7-89f9-4378-8146-f6e71a7866b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:23.400214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-242490e7-89f9-4378-8146-f6e71a7866b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:23.400957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-242490e7-89f9-4378-8146-f6e71a7866b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:23.401399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-242490e7-89f9-4378-8146-f6e71a7866b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:23.402111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-242490e7-89f9-4378-8146-f6e71a7866b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:23.402570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-242490e7-89f9-4378-8146-f6e71a7866b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:23.403002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-242490e7-89f9-4378-8146-f6e71a7866b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:23.534704 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-242490e7-89f9-4378-8146-f6e71a7866b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:23.542763 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-242490e7-89f9-4378-8146-f6e71a7866b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1692 microversion: 2.1 time: 0.154402 Oct 04 21:59:23.543352 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3439/6898] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:23 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:24.566700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2956559a-3c0e-4cfa-9e0e-09948dc58111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:24.567331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2956559a-3c0e-4cfa-9e0e-09948dc58111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:24.574215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2956559a-3c0e-4cfa-9e0e-09948dc58111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:24.574716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2956559a-3c0e-4cfa-9e0e-09948dc58111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:24.575173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2956559a-3c0e-4cfa-9e0e-09948dc58111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:24.575879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2956559a-3c0e-4cfa-9e0e-09948dc58111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:24.576352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2956559a-3c0e-4cfa-9e0e-09948dc58111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:24.577383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2956559a-3c0e-4cfa-9e0e-09948dc58111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:24.715718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2956559a-3c0e-4cfa-9e0e-09948dc58111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:24.723441 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2956559a-3c0e-4cfa-9e0e-09948dc58111 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1692 microversion: 2.1 time: 0.160662 Oct 04 21:59:24.724017 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3460/6899] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:24 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:25.747545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-51defb79-7398-4882-b475-db12a5b862fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:25.748161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-51defb79-7398-4882-b475-db12a5b862fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:25.755662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51defb79-7398-4882-b475-db12a5b862fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:25.756152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51defb79-7398-4882-b475-db12a5b862fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:25.756586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51defb79-7398-4882-b475-db12a5b862fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:25.757274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51defb79-7398-4882-b475-db12a5b862fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:25.757755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51defb79-7398-4882-b475-db12a5b862fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:25.758180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51defb79-7398-4882-b475-db12a5b862fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:25.888731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-51defb79-7398-4882-b475-db12a5b862fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:25.896608 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-51defb79-7398-4882-b475-db12a5b862fe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1692 microversion: 2.1 time: 0.153014 Oct 04 21:59:25.897179 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3440/6900] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:25 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:26.922431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-044f272b-c1aa-4e90-be08-3f446aede5da tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:26.923067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-044f272b-c1aa-4e90-be08-3f446aede5da tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:26.931021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-044f272b-c1aa-4e90-be08-3f446aede5da tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:26.931526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-044f272b-c1aa-4e90-be08-3f446aede5da tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:26.931979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-044f272b-c1aa-4e90-be08-3f446aede5da tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:26.932684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-044f272b-c1aa-4e90-be08-3f446aede5da tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:26.933155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-044f272b-c1aa-4e90-be08-3f446aede5da tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:26.933646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-044f272b-c1aa-4e90-be08-3f446aede5da tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:27.067955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-044f272b-c1aa-4e90-be08-3f446aede5da tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:27.075937 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-044f272b-c1aa-4e90-be08-3f446aede5da tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1692 microversion: 2.1 time: 0.159439 Oct 04 21:59:27.076598 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3461/6901] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:26 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:28.099101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0bfbee98-75c1-4bc0-8fc7-63f700526338 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:28.099717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0bfbee98-75c1-4bc0-8fc7-63f700526338 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:28.106687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0bfbee98-75c1-4bc0-8fc7-63f700526338 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:28.107169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0bfbee98-75c1-4bc0-8fc7-63f700526338 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:28.107623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0bfbee98-75c1-4bc0-8fc7-63f700526338 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:28.108319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0bfbee98-75c1-4bc0-8fc7-63f700526338 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:28.108797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0bfbee98-75c1-4bc0-8fc7-63f700526338 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:28.109220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0bfbee98-75c1-4bc0-8fc7-63f700526338 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:28.244430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0bfbee98-75c1-4bc0-8fc7-63f700526338 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:28.253712 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0bfbee98-75c1-4bc0-8fc7-63f700526338 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1692 microversion: 2.1 time: 0.158504 Oct 04 21:59:28.254327 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3441/6902] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:28 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:29.279181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d2fa9ce4-aab7-4f32-a874-9aa3e5374c7c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:29.280813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d2fa9ce4-aab7-4f32-a874-9aa3e5374c7c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:29.287826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2fa9ce4-aab7-4f32-a874-9aa3e5374c7c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:29.288326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2fa9ce4-aab7-4f32-a874-9aa3e5374c7c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:29.288812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2fa9ce4-aab7-4f32-a874-9aa3e5374c7c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:29.289540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2fa9ce4-aab7-4f32-a874-9aa3e5374c7c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:29.296202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2fa9ce4-aab7-4f32-a874-9aa3e5374c7c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:29.296202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2fa9ce4-aab7-4f32-a874-9aa3e5374c7c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:29.421919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d2fa9ce4-aab7-4f32-a874-9aa3e5374c7c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:29.429616 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d2fa9ce4-aab7-4f32-a874-9aa3e5374c7c tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1692 microversion: 2.1 time: 0.154649 Oct 04 21:59:29.430196 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3462/6903] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:29 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:30.452525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e3fcd1bc-6e8b-43c2-88bd-ea1d18d0b2f6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:30.453144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e3fcd1bc-6e8b-43c2-88bd-ea1d18d0b2f6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:30.460064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3fcd1bc-6e8b-43c2-88bd-ea1d18d0b2f6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:30.460585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3fcd1bc-6e8b-43c2-88bd-ea1d18d0b2f6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:30.461030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3fcd1bc-6e8b-43c2-88bd-ea1d18d0b2f6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:30.461751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3fcd1bc-6e8b-43c2-88bd-ea1d18d0b2f6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:30.462214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3fcd1bc-6e8b-43c2-88bd-ea1d18d0b2f6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:30.462643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3fcd1bc-6e8b-43c2-88bd-ea1d18d0b2f6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:30.598552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e3fcd1bc-6e8b-43c2-88bd-ea1d18d0b2f6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:30.606265 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e3fcd1bc-6e8b-43c2-88bd-ea1d18d0b2f6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1692 microversion: 2.1 time: 0.157885 Oct 04 21:59:30.606834 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3442/6904] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:30 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:31.630669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ee73d462-cd93-4cbe-871e-c5618b5e948a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:31.631318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ee73d462-cd93-4cbe-871e-c5618b5e948a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:31.638238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee73d462-cd93-4cbe-871e-c5618b5e948a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:31.638752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee73d462-cd93-4cbe-871e-c5618b5e948a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:31.639493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee73d462-cd93-4cbe-871e-c5618b5e948a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:31.640220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee73d462-cd93-4cbe-871e-c5618b5e948a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:31.640700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee73d462-cd93-4cbe-871e-c5618b5e948a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:31.641152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee73d462-cd93-4cbe-871e-c5618b5e948a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:31.772838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ee73d462-cd93-4cbe-871e-c5618b5e948a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:31.781593 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ee73d462-cd93-4cbe-871e-c5618b5e948a tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1692 microversion: 2.1 time: 0.154928 Oct 04 21:59:31.782201 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3463/6905] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:31 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:32.810260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2bd37edb-14f6-4bae-8217-01995b26d2b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:32.810260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2bd37edb-14f6-4bae-8217-01995b26d2b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:32.813912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bd37edb-14f6-4bae-8217-01995b26d2b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:32.814392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bd37edb-14f6-4bae-8217-01995b26d2b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:32.814830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bd37edb-14f6-4bae-8217-01995b26d2b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:32.815516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bd37edb-14f6-4bae-8217-01995b26d2b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:32.815970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bd37edb-14f6-4bae-8217-01995b26d2b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:32.816399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2bd37edb-14f6-4bae-8217-01995b26d2b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:32.953256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2bd37edb-14f6-4bae-8217-01995b26d2b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:32.961021 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2bd37edb-14f6-4bae-8217-01995b26d2b1 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1692 microversion: 2.1 time: 0.159329 Oct 04 21:59:32.961629 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3443/6906] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:32 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:33.984583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9d921e94-af6d-4b96-a716-15e7d63870d6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:33.985143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9d921e94-af6d-4b96-a716-15e7d63870d6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:33.992023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d921e94-af6d-4b96-a716-15e7d63870d6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:33.992526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d921e94-af6d-4b96-a716-15e7d63870d6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:33.992981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d921e94-af6d-4b96-a716-15e7d63870d6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:33.993737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d921e94-af6d-4b96-a716-15e7d63870d6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:33.994214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d921e94-af6d-4b96-a716-15e7d63870d6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:33.994661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d921e94-af6d-4b96-a716-15e7d63870d6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:34.133764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9d921e94-af6d-4b96-a716-15e7d63870d6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:34.142438 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9d921e94-af6d-4b96-a716-15e7d63870d6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1692 microversion: 2.1 time: 0.161975 Oct 04 21:59:34.149295 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3464/6907] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:33 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:35.172507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c40fc6bb-8292-4cdb-bbfd-c2cf43452345 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:35.173038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c40fc6bb-8292-4cdb-bbfd-c2cf43452345 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:35.179636 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c40fc6bb-8292-4cdb-bbfd-c2cf43452345 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:35.181058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c40fc6bb-8292-4cdb-bbfd-c2cf43452345 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:35.181058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c40fc6bb-8292-4cdb-bbfd-c2cf43452345 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:35.181407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c40fc6bb-8292-4cdb-bbfd-c2cf43452345 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:35.181902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c40fc6bb-8292-4cdb-bbfd-c2cf43452345 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:35.182332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c40fc6bb-8292-4cdb-bbfd-c2cf43452345 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:35.322280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c40fc6bb-8292-4cdb-bbfd-c2cf43452345 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:35.332440 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c40fc6bb-8292-4cdb-bbfd-c2cf43452345 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1692 microversion: 2.1 time: 0.164081 Oct 04 21:59:35.333276 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3444/6908] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:35 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:36.356686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b57a974f-b009-4025-94df-bbfed2039115 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:36.357214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b57a974f-b009-4025-94df-bbfed2039115 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:36.364627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b57a974f-b009-4025-94df-bbfed2039115 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:36.365125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b57a974f-b009-4025-94df-bbfed2039115 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:36.365604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b57a974f-b009-4025-94df-bbfed2039115 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:36.366304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b57a974f-b009-4025-94df-bbfed2039115 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:36.366773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b57a974f-b009-4025-94df-bbfed2039115 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:36.367211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b57a974f-b009-4025-94df-bbfed2039115 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:36.510292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b57a974f-b009-4025-94df-bbfed2039115 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:36.518377 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b57a974f-b009-4025-94df-bbfed2039115 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1698 microversion: 2.1 time: 0.165644 Oct 04 21:59:36.518954 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3465/6909] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:36 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1698 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:37.543201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c1e1e08d-db6a-4160-9e13-2f0c5a2ab005 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:37.543818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c1e1e08d-db6a-4160-9e13-2f0c5a2ab005 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:37.551182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1e1e08d-db6a-4160-9e13-2f0c5a2ab005 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:37.551669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1e1e08d-db6a-4160-9e13-2f0c5a2ab005 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:37.552109 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1e1e08d-db6a-4160-9e13-2f0c5a2ab005 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:37.552801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1e1e08d-db6a-4160-9e13-2f0c5a2ab005 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:37.553257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1e1e08d-db6a-4160-9e13-2f0c5a2ab005 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:37.553708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1e1e08d-db6a-4160-9e13-2f0c5a2ab005 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:37.694927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c1e1e08d-db6a-4160-9e13-2f0c5a2ab005 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:37.703318 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c1e1e08d-db6a-4160-9e13-2f0c5a2ab005 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1698 microversion: 2.1 time: 0.163967 Oct 04 21:59:37.703907 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3445/6910] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:37 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1698 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:38.461579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-10fe4414-3b8e-4a4c-8862-edf1092b8c83 req-55896b45-e0d1-4067-8c19-225b3e3f68a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab6c187-01fc-4aeb-a5d3-c69f565a05a2", "name": "network-vif-unplugged", "status": "completed", "tag": "088246be-fee0-4827-ae1c-e780d2fdc9c3"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:38.471060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-10fe4414-3b8e-4a4c-8862-edf1092b8c83 req-55896b45-e0d1-4067-8c19-225b3e3f68a7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:38.471548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-10fe4414-3b8e-4a4c-8862-edf1092b8c83 req-55896b45-e0d1-4067-8c19-225b3e3f68a7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:38.471994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-10fe4414-3b8e-4a4c-8862-edf1092b8c83 req-55896b45-e0d1-4067-8c19-225b3e3f68a7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:38.483322 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-10fe4414-3b8e-4a4c-8862-edf1092b8c83 req-55896b45-e0d1-4067-8c19-225b3e3f68a7 service nova] Creating event network-vif-unplugged:088246be-fee0-4827-ae1c-e780d2fdc9c3 for instance dab6c187-01fc-4aeb-a5d3-c69f565a05a2 on n-h1-860282-1 Oct 04 21:59:38.488627 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-10fe4414-3b8e-4a4c-8862-edf1092b8c83 req-55896b45-e0d1-4067-8c19-225b3e3f68a7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098702 Oct 04 21:59:38.490106 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3466/6911] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:59:38.726408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-536f3d27-d73e-4c66-8bf8-1bb34eaf2afe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:38.726934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-536f3d27-d73e-4c66-8bf8-1bb34eaf2afe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:38.735130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-536f3d27-d73e-4c66-8bf8-1bb34eaf2afe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:38.735634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-536f3d27-d73e-4c66-8bf8-1bb34eaf2afe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:38.736086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-536f3d27-d73e-4c66-8bf8-1bb34eaf2afe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:38.736800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-536f3d27-d73e-4c66-8bf8-1bb34eaf2afe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:38.737266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-536f3d27-d73e-4c66-8bf8-1bb34eaf2afe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:38.737763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-536f3d27-d73e-4c66-8bf8-1bb34eaf2afe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:38.873408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-536f3d27-d73e-4c66-8bf8-1bb34eaf2afe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:38.881383 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-536f3d27-d73e-4c66-8bf8-1bb34eaf2afe tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1683 microversion: 2.1 time: 0.158999 Oct 04 21:59:38.881987 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3446/6912] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:38 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:40.504924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-c0f88548-bda6-45a6-8c75-ea0569c6e044 req-fb747942-a23f-4fcf-8866-69967149abdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab6c187-01fc-4aeb-a5d3-c69f565a05a2", "name": "network-vif-plugged", "status": "completed", "tag": "088246be-fee0-4827-ae1c-e780d2fdc9c3"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:40.514623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c0f88548-bda6-45a6-8c75-ea0569c6e044 req-fb747942-a23f-4fcf-8866-69967149abdd service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:40.515726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c0f88548-bda6-45a6-8c75-ea0569c6e044 req-fb747942-a23f-4fcf-8866-69967149abdd service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:40.516182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c0f88548-bda6-45a6-8c75-ea0569c6e044 req-fb747942-a23f-4fcf-8866-69967149abdd service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:40.527149 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-c0f88548-bda6-45a6-8c75-ea0569c6e044 req-fb747942-a23f-4fcf-8866-69967149abdd service nova] Creating event network-vif-plugged:088246be-fee0-4827-ae1c-e780d2fdc9c3 for instance dab6c187-01fc-4aeb-a5d3-c69f565a05a2 on n-h1-860282-1 Oct 04 21:59:40.532912 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-c0f88548-bda6-45a6-8c75-ea0569c6e044 req-fb747942-a23f-4fcf-8866-69967149abdd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033448 Oct 04 21:59:40.533757 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3467/6913] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 21:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:03.072743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b8001ca0-da63-461a-9998-85b4d83628b9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:03.075103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b8001ca0-da63-461a-9998-85b4d83628b9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:03.077968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=26 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:03.078648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:03.083457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8001ca0-da63-461a-9998-85b4d83628b9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:03.083949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8001ca0-da63-461a-9998-85b4d83628b9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:03.084398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8001ca0-da63-461a-9998-85b4d83628b9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:03.085093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8001ca0-da63-461a-9998-85b4d83628b9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:03.085584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8001ca0-da63-461a-9998-85b4d83628b9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:03.086016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8001ca0-da63-461a-9998-85b4d83628b9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:03.136010 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b8001ca0-da63-461a-9998-85b4d83628b9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "POST /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2/action" status: 200 len: 24572 microversion: 2.1 time: 0.067159 Oct 04 22:00:03.136650 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3447/6914] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:00:03 2022] POST /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2/action => generated 24572 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:00:10.443421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=24 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:10.444248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=58 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:10.448625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4b77acf8-8bc6-48ef-b4d1-314986f7e7b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:10.456557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4b77acf8-8bc6-48ef-b4d1-314986f7e7b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:10.456557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b77acf8-8bc6-48ef-b4d1-314986f7e7b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:10.457262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b77acf8-8bc6-48ef-b4d1-314986f7e7b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:10.457413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b77acf8-8bc6-48ef-b4d1-314986f7e7b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:10.458359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b77acf8-8bc6-48ef-b4d1-314986f7e7b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:10.459089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b77acf8-8bc6-48ef-b4d1-314986f7e7b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:10.459650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4b77acf8-8bc6-48ef-b4d1-314986f7e7b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:10.491667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4b77acf8-8bc6-48ef-b4d1-314986f7e7b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:00:10.517709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-4afc4755-89d9-4adc-87e2-a1c4faedd7a3 req-13a0558a-41b0-4f0b-94bd-2d0f7b562514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dab6c187-01fc-4aeb-a5d3-c69f565a05a2", "tag": "088246be-fee0-4827-ae1c-e780d2fdc9c3"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:10.538087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4afc4755-89d9-4adc-87e2-a1c4faedd7a3 req-13a0558a-41b0-4f0b-94bd-2d0f7b562514 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:10.538581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4afc4755-89d9-4adc-87e2-a1c4faedd7a3 req-13a0558a-41b0-4f0b-94bd-2d0f7b562514 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:10.539022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4afc4755-89d9-4adc-87e2-a1c4faedd7a3 req-13a0558a-41b0-4f0b-94bd-2d0f7b562514 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:10.551553 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-4afc4755-89d9-4adc-87e2-a1c4faedd7a3 req-13a0558a-41b0-4f0b-94bd-2d0f7b562514 service nova] Creating event network-changed:088246be-fee0-4827-ae1c-e780d2fdc9c3 for instance dab6c187-01fc-4aeb-a5d3-c69f565a05a2 on n-h1-860282-1 Oct 04 22:00:10.556815 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-4afc4755-89d9-4adc-87e2-a1c4faedd7a3 req-13a0558a-41b0-4f0b-94bd-2d0f7b562514 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112550 Oct 04 22:00:10.557578 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3448/6915] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:10.734175 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4b77acf8-8bc6-48ef-b4d1-314986f7e7b4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 204 len: 0 microversion: 2.1 time: 0.292581 Oct 04 22:00:10.735196 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3468/6916] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:00:10 2022] DELETE /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:00:10.746421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9dee0bb1-31bd-4fe3-8928-dfa66c0270d9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:10.747577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9dee0bb1-31bd-4fe3-8928-dfa66c0270d9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:10.756939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dee0bb1-31bd-4fe3-8928-dfa66c0270d9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:10.757462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dee0bb1-31bd-4fe3-8928-dfa66c0270d9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:10.757917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dee0bb1-31bd-4fe3-8928-dfa66c0270d9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:10.758653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dee0bb1-31bd-4fe3-8928-dfa66c0270d9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:10.759099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dee0bb1-31bd-4fe3-8928-dfa66c0270d9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:10.761514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9dee0bb1-31bd-4fe3-8928-dfa66c0270d9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:10.902537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9dee0bb1-31bd-4fe3-8928-dfa66c0270d9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:10.911346 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9dee0bb1-31bd-4fe3-8928-dfa66c0270d9 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1689 microversion: 2.1 time: 0.170586 Oct 04 22:00:10.912013 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3449/6917] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:10 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:11.937092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0add53ce-0685-4c51-8a91-999d7e4265f4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:11.937842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0add53ce-0685-4c51-8a91-999d7e4265f4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:11.945112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0add53ce-0685-4c51-8a91-999d7e4265f4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:11.945656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0add53ce-0685-4c51-8a91-999d7e4265f4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:11.946113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0add53ce-0685-4c51-8a91-999d7e4265f4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:11.946827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0add53ce-0685-4c51-8a91-999d7e4265f4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:11.947305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0add53ce-0685-4c51-8a91-999d7e4265f4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:11.947752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0add53ce-0685-4c51-8a91-999d7e4265f4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:12.087085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0add53ce-0685-4c51-8a91-999d7e4265f4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:12.095472 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0add53ce-0685-4c51-8a91-999d7e4265f4 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1689 microversion: 2.1 time: 0.162650 Oct 04 22:00:12.099519 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3469/6918] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:11 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:12.602588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-2b1554ab-14be-4368-a515-984ed88d23f0 req-d82c6c63-08f6-400c-b226-a466c77b9e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab6c187-01fc-4aeb-a5d3-c69f565a05a2", "name": "network-vif-deleted", "tag": "088246be-fee0-4827-ae1c-e780d2fdc9c3"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:12.613967 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2b1554ab-14be-4368-a515-984ed88d23f0 req-d82c6c63-08f6-400c-b226-a466c77b9e7a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:12.614454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2b1554ab-14be-4368-a515-984ed88d23f0 req-d82c6c63-08f6-400c-b226-a466c77b9e7a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:12.614894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2b1554ab-14be-4368-a515-984ed88d23f0 req-d82c6c63-08f6-400c-b226-a466c77b9e7a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:12.628842 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-2b1554ab-14be-4368-a515-984ed88d23f0 req-d82c6c63-08f6-400c-b226-a466c77b9e7a service nova] Creating event network-vif-deleted:088246be-fee0-4827-ae1c-e780d2fdc9c3 for instance dab6c187-01fc-4aeb-a5d3-c69f565a05a2 on n-h1-860282-1 Oct 04 22:00:12.633760 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-2b1554ab-14be-4368-a515-984ed88d23f0 req-d82c6c63-08f6-400c-b226-a466c77b9e7a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034913 Oct 04 22:00:12.635051 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3450/6919] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:13.123113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dc24053d-11a4-4eba-8968-c42853be72dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:13.123786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dc24053d-11a4-4eba-8968-c42853be72dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:13.131132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc24053d-11a4-4eba-8968-c42853be72dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:13.133119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc24053d-11a4-4eba-8968-c42853be72dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:13.133119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc24053d-11a4-4eba-8968-c42853be72dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:13.133119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc24053d-11a4-4eba-8968-c42853be72dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:13.133388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc24053d-11a4-4eba-8968-c42853be72dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:13.133724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc24053d-11a4-4eba-8968-c42853be72dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:13.166357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc24053d-11a4-4eba-8968-c42853be72dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:13.166858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc24053d-11a4-4eba-8968-c42853be72dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:13.167913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc24053d-11a4-4eba-8968-c42853be72dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:13.168385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-dc24053d-11a4-4eba-8968-c42853be72dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lazy-loading 'fault' on Instance uuid dab6c187-01fc-4aeb-a5d3-c69f565a05a2 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:00:13.211138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dc24053d-11a4-4eba-8968-c42853be72dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c893eb5126c4c9db1012c199660261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187e190360d14111a4107866a8000348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:13.219217 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dc24053d-11a4-4eba-8968-c42853be72dd tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 200 len: 1356 microversion: 2.1 time: 0.100097 Oct 04 22:00:13.219767 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3470/6920] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:13 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:14.245655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-28489d84-8851-486e-95c5-3ebefdbe68a6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:14.246301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-28489d84-8851-486e-95c5-3ebefdbe68a6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] [instance: dab6c187-01fc-4aeb-a5d3-c69f565a05a2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:14.252602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28489d84-8851-486e-95c5-3ebefdbe68a6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:14.253086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28489d84-8851-486e-95c5-3ebefdbe68a6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:14.253568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28489d84-8851-486e-95c5-3ebefdbe68a6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:14.254302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28489d84-8851-486e-95c5-3ebefdbe68a6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:14.254738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28489d84-8851-486e-95c5-3ebefdbe68a6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:14.255167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28489d84-8851-486e-95c5-3ebefdbe68a6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:14.269076 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-28489d84-8851-486e-95c5-3ebefdbe68a6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] HTTP exception thrown: Instance dab6c187-01fc-4aeb-a5d3-c69f565a05a2 could not be found. Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-28489d84-8851-486e-95c5-3ebefdbe68a6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Request method failure captured: Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 HTTP/1.1 Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKsg9wdsQpKRxIYoCO18EnGkiXvFaK3Y37dAKXCvkpYNlW5hI6Th3vwXBScO1z15nuZq6dcbLpHb4UAi01qVzCkAXMzlesG1frtWG0k1ymFc191M4FAp7BOhLPARXjbwQP08vsZYIaM8TzkponyUyXqAm9ryQobG9UgDnWq6vToxOSs Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 187e190360d14111a4107866a8000348 Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-875125608 Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/187e190360d14111a4107866a8000348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_187e190360d14111a4107866a8000348"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/187e190360d14111a4107866a8000348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/187e190360d14111a4107866a8000348"}]}] Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestNetworkAdvancedServerOps-875125608 Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 187e190360d14111a4107866a8000348 Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-875125608 Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestNetworkAdvancedServerOps-875125608-project Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 8c893eb5126c4c9db1012c199660261c Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestNetworkAdvancedServerOps-875125608-project Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance dab6c187-01fc-4aeb-a5d3-c69f565a05a2 could not be found. Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'dab6c187-01fc-4aeb-a5d3-c69f565a05a2'} Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab6c187-01fc-4aeb-a5d3-c69f565a05a2 could not be found. Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab6c187-01fc-4aeb-a5d3-c69f565a05a2 could not be found. Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:00:14.270782 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:14.275018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:00:14.275018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:14.275018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:14.275018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:14.275018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:14.275018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:14.275018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab6c187-01fc-4aeb-a5d3-c69f565a05a2 could not be found. Oct 04 22:00:14.275018 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:00:14.275018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-28489d84-8851-486e-95c5-3ebefdbe68a6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Returning 404 to user: Instance dab6c187-01fc-4aeb-a5d3-c69f565a05a2 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:14.275018 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-28489d84-8851-486e-95c5-3ebefdbe68a6 tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2" status: 404 len: 111 microversion: 2.1 time: 0.032418 Oct 04 22:00:14.275018 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3451/6921] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:14 2022] GET /compute/v2.1/servers/dab6c187-01fc-4aeb-a5d3-c69f565a05a2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:00:17.648909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-46362d0e-fe18-45ac-b721-61dbba1eb2bc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] Calling method '.version_select at 0x7f578b7b8040>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:17.747233 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-46362d0e-fe18-45ac-b721-61dbba1eb2bc tempest-TestNetworkAdvancedServerOps-875125608 tempest-TestNetworkAdvancedServerOps-875125608-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-165750379" status: 202 len: 0 microversion: 2.1 time: 0.102714 Oct 04 22:00:17.747763 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3471/6922] 10.222.0.30 () {58 vars in 1281 bytes} [Tue Oct 4 22:00:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-165750379 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:00:38.392884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=10 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:38.394868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=16 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:38.586325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-891d477c-0ad8-4e7c-91b7-a53082a98849 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Action: 'create', calling method: .version_select at 0x7f578b4559d0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1553157075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGraFXBQF70wa2fba2/cfPCfHoDI2rp6aayOnKZ/jG+w+zZGPBv3N2arHLguZDLfeTgrDYO5vEUgC+sLoeOcvNl+EKX5UxpOI8p3PUDackKtdWPiLnAP7xxKA3mnwW+K+w=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:38.602119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-891d477c-0ad8-4e7c-91b7-a53082a98849 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Getting quotas for project 7e4149d5e998467eae12fb0480a0c57e. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:00:38.607255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-891d477c-0ad8-4e7c-91b7-a53082a98849 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Getting quotas for user 3e441f450e7a421c8f0f551791f34a29 and project 7e4149d5e998467eae12fb0480a0c57e. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:00:38.706640 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-891d477c-0ad8-4e7c-91b7-a53082a98849 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.314898 Oct 04 22:00:38.707181 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3452/6923] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 22:00:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:41.325539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1002207411", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1553157075", "security_groups": [{"name": "tempest-secgroup-smoke-2033732040"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "5fc3d563-cee9-4976-a263-74cb252f49e4"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:41.337008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:41.337750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:41.442244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] validate_networks() for [('5fc3d563-cee9-4976-a263-74cb252f49e4', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:00:41.867798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Getting quotas for project 7e4149d5e998467eae12fb0480a0c57e. Resources: dict_keys(['metadata_items']) {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:00:41.873355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Getting quotas for user 3e441f450e7a421c8f0f551791f34a29 and project 7e4149d5e998467eae12fb0480a0c57e. Resources: dict_keys(['metadata_items']) {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:00:41.888533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:00:41.888977 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:00:41.889483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:00:41.889969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:00:41.890400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:00:41.900895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:41.901519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:41.901905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:41.902656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:41.903132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:41.903572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:41.921680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Getting quotas for project 7e4149d5e998467eae12fb0480a0c57e. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:00:41.926937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Getting quotas for user 3e441f450e7a421c8f0f551791f34a29 and project 7e4149d5e998467eae12fb0480a0c57e. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:00:41.940382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:00:41.942761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:00:42.071367 n-d-860282-1 devstack@n-api.service[122757]: ERROR oslo.messaging._drivers.impl_rabbit [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [4ddc784a-55a5-4baa-9847-97a3eafa1d07] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:00:43.078526 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [4ddc784a-55a5-4baa-9847-97a3eafa1d07] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 34810. Oct 04 22:00:43.082371 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-80646251-9e53-4020-93ff-b41ba32def3b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.760876 Oct 04 22:00:43.083035 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3472/6924] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:00:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:00:43.094830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f947c2c1-c15c-448f-ab1c-4d8ace9d6934 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:43.095448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f947c2c1-c15c-448f-ab1c-4d8ace9d6934 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:43.155215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f947c2c1-c15c-448f-ab1c-4d8ace9d6934 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e441f450e7a421c8f0f551791f34a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4149d5e998467eae12fb0480a0c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:43.163915 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f947c2c1-c15c-448f-ab1c-4d8ace9d6934 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 200 len: 1303 microversion: 2.1 time: 0.071705 Oct 04 22:00:43.167894 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3453/6925] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:43 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 1303 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:44.189528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-22d8a41e-90dd-4225-8ab2-35575ea9d5cf tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:44.190157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-22d8a41e-90dd-4225-8ab2-35575ea9d5cf tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:44.247064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-22d8a41e-90dd-4225-8ab2-35575ea9d5cf tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e441f450e7a421c8f0f551791f34a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4149d5e998467eae12fb0480a0c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:44.254128 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-22d8a41e-90dd-4225-8ab2-35575ea9d5cf tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 200 len: 1303 microversion: 2.1 time: 0.069680 Oct 04 22:00:44.254695 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3473/6926] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:44 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 1303 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:45.276941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-53549f23-78e4-46b9-aea7-1fbd47753e4f tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:45.277970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-53549f23-78e4-46b9-aea7-1fbd47753e4f tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:45.332238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-53549f23-78e4-46b9-aea7-1fbd47753e4f tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e441f450e7a421c8f0f551791f34a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4149d5e998467eae12fb0480a0c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:45.339327 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-53549f23-78e4-46b9-aea7-1fbd47753e4f tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 200 len: 1303 microversion: 2.1 time: 0.066991 Oct 04 22:00:45.339911 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3454/6927] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:45 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 1303 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:46.362418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f4405729-1334-4f9e-8918-2215f76cb73d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:46.363045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f4405729-1334-4f9e-8918-2215f76cb73d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:46.371711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4405729-1334-4f9e-8918-2215f76cb73d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:46.372232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4405729-1334-4f9e-8918-2215f76cb73d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:46.373096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4405729-1334-4f9e-8918-2215f76cb73d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:46.373844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4405729-1334-4f9e-8918-2215f76cb73d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:46.374314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4405729-1334-4f9e-8918-2215f76cb73d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:46.374757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4405729-1334-4f9e-8918-2215f76cb73d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:46.440761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f4405729-1334-4f9e-8918-2215f76cb73d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e441f450e7a421c8f0f551791f34a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4149d5e998467eae12fb0480a0c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:46.448659 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f4405729-1334-4f9e-8918-2215f76cb73d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 200 len: 1307 microversion: 2.1 time: 0.090199 Oct 04 22:00:46.449251 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3474/6928] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:46 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 1307 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:47.471431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4092cfb5-9a2d-4a6e-8a62-aa966204b04b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:47.472046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4092cfb5-9a2d-4a6e-8a62-aa966204b04b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:47.479589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4092cfb5-9a2d-4a6e-8a62-aa966204b04b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:47.480241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4092cfb5-9a2d-4a6e-8a62-aa966204b04b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:47.480513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4092cfb5-9a2d-4a6e-8a62-aa966204b04b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:47.481211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4092cfb5-9a2d-4a6e-8a62-aa966204b04b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:47.481734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4092cfb5-9a2d-4a6e-8a62-aa966204b04b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:47.482165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4092cfb5-9a2d-4a6e-8a62-aa966204b04b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:47.566780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4092cfb5-9a2d-4a6e-8a62-aa966204b04b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e441f450e7a421c8f0f551791f34a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4149d5e998467eae12fb0480a0c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:47.576341 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4092cfb5-9a2d-4a6e-8a62-aa966204b04b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 200 len: 1373 microversion: 2.1 time: 0.108805 Oct 04 22:00:47.577214 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3455/6929] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:47 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 1373 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:48.600350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5241dae7-e69a-4412-8143-0d9b5cbec772 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:48.600903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5241dae7-e69a-4412-8143-0d9b5cbec772 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:48.607988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5241dae7-e69a-4412-8143-0d9b5cbec772 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:48.608498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5241dae7-e69a-4412-8143-0d9b5cbec772 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:48.608949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5241dae7-e69a-4412-8143-0d9b5cbec772 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:48.609686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5241dae7-e69a-4412-8143-0d9b5cbec772 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:48.610164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5241dae7-e69a-4412-8143-0d9b5cbec772 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:48.610610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5241dae7-e69a-4412-8143-0d9b5cbec772 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:48.796224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5241dae7-e69a-4412-8143-0d9b5cbec772 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e441f450e7a421c8f0f551791f34a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4149d5e998467eae12fb0480a0c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:48.803877 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5241dae7-e69a-4412-8143-0d9b5cbec772 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 200 len: 1429 microversion: 2.1 time: 0.207682 Oct 04 22:00:48.804522 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3475/6930] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:48 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 1429 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:49.203177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-e6a0a171-58a8-4b6d-9cf7-5bd362075ce7 req-5e6dd816-83fb-4d3a-ab16-5c92e849079c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b40ed723-ba15-4edc-abbb-92e05e651833", "tag": "8a2aec20-c7a7-438d-96ca-07306aa2a78d"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:49.215225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e6a0a171-58a8-4b6d-9cf7-5bd362075ce7 req-5e6dd816-83fb-4d3a-ab16-5c92e849079c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:49.215966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e6a0a171-58a8-4b6d-9cf7-5bd362075ce7 req-5e6dd816-83fb-4d3a-ab16-5c92e849079c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:49.216591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e6a0a171-58a8-4b6d-9cf7-5bd362075ce7 req-5e6dd816-83fb-4d3a-ab16-5c92e849079c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:49.229748 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-e6a0a171-58a8-4b6d-9cf7-5bd362075ce7 req-5e6dd816-83fb-4d3a-ab16-5c92e849079c service nova] Creating event network-changed:8a2aec20-c7a7-438d-96ca-07306aa2a78d for instance b40ed723-ba15-4edc-abbb-92e05e651833 on n-h2-860282-1 Oct 04 22:00:49.234686 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-e6a0a171-58a8-4b6d-9cf7-5bd362075ce7 req-5e6dd816-83fb-4d3a-ab16-5c92e849079c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035494 Oct 04 22:00:49.235279 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3456/6931] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:00:49.828231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d4fc80cb-30d9-459c-9cee-040754f52f34 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:49.828887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d4fc80cb-30d9-459c-9cee-040754f52f34 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:49.835691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4fc80cb-30d9-459c-9cee-040754f52f34 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:49.836200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4fc80cb-30d9-459c-9cee-040754f52f34 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:49.836772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4fc80cb-30d9-459c-9cee-040754f52f34 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:49.837512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4fc80cb-30d9-459c-9cee-040754f52f34 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:49.838647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4fc80cb-30d9-459c-9cee-040754f52f34 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:49.839096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4fc80cb-30d9-459c-9cee-040754f52f34 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:50.401596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d4fc80cb-30d9-459c-9cee-040754f52f34 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e441f450e7a421c8f0f551791f34a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4149d5e998467eae12fb0480a0c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:50.409642 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d4fc80cb-30d9-459c-9cee-040754f52f34 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 200 len: 1429 microversion: 2.1 time: 0.585238 Oct 04 22:00:50.410303 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3476/6932] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:49 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 1429 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:51.434110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-11776092-10b2-4b4f-975d-95c4fbfd437d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:51.434811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-11776092-10b2-4b4f-975d-95c4fbfd437d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:51.441038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11776092-10b2-4b4f-975d-95c4fbfd437d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:51.441555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11776092-10b2-4b4f-975d-95c4fbfd437d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:51.442068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11776092-10b2-4b4f-975d-95c4fbfd437d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:51.442823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11776092-10b2-4b4f-975d-95c4fbfd437d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:51.443276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11776092-10b2-4b4f-975d-95c4fbfd437d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:51.443785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-11776092-10b2-4b4f-975d-95c4fbfd437d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:51.582378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-11776092-10b2-4b4f-975d-95c4fbfd437d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e441f450e7a421c8f0f551791f34a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4149d5e998467eae12fb0480a0c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:51.590284 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-11776092-10b2-4b4f-975d-95c4fbfd437d tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 200 len: 1429 microversion: 2.1 time: 0.161913 Oct 04 22:00:51.590867 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3457/6933] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:51 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 1429 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:52.613456 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4964cf15-89fa-4d2f-9756-35ea5ea4fbd2 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:52.614046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4964cf15-89fa-4d2f-9756-35ea5ea4fbd2 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:52.617868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:52.623836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4964cf15-89fa-4d2f-9756-35ea5ea4fbd2 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:52.624337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4964cf15-89fa-4d2f-9756-35ea5ea4fbd2 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:52.625147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4964cf15-89fa-4d2f-9756-35ea5ea4fbd2 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:52.626010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4964cf15-89fa-4d2f-9756-35ea5ea4fbd2 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:52.626482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4964cf15-89fa-4d2f-9756-35ea5ea4fbd2 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:52.626923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4964cf15-89fa-4d2f-9756-35ea5ea4fbd2 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:52.765001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4964cf15-89fa-4d2f-9756-35ea5ea4fbd2 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e441f450e7a421c8f0f551791f34a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4149d5e998467eae12fb0480a0c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:52.772802 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4964cf15-89fa-4d2f-9756-35ea5ea4fbd2 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 200 len: 1429 microversion: 2.1 time: 0.163471 Oct 04 22:00:52.773538 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3477/6934] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:52 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 1429 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:53.795743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-66339bab-366a-4612-bbc8-d8f4e2e6164a tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:53.796502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-66339bab-366a-4612-bbc8-d8f4e2e6164a tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:53.805990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66339bab-366a-4612-bbc8-d8f4e2e6164a tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:53.810701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66339bab-366a-4612-bbc8-d8f4e2e6164a tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:53.810701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66339bab-366a-4612-bbc8-d8f4e2e6164a tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:53.810701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66339bab-366a-4612-bbc8-d8f4e2e6164a tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:53.810701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66339bab-366a-4612-bbc8-d8f4e2e6164a tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:53.810701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66339bab-366a-4612-bbc8-d8f4e2e6164a tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:53.958264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-66339bab-366a-4612-bbc8-d8f4e2e6164a tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e441f450e7a421c8f0f551791f34a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4149d5e998467eae12fb0480a0c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:53.967373 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-66339bab-366a-4612-bbc8-d8f4e2e6164a tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 200 len: 1429 microversion: 2.1 time: 0.175818 Oct 04 22:00:53.967966 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3458/6935] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:53 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 1429 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:54.991690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5085f632-404f-41d1-8abe-220e5f9bdbc6 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:54.992331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5085f632-404f-41d1-8abe-220e5f9bdbc6 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:54.995080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=12 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:55.001048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5085f632-404f-41d1-8abe-220e5f9bdbc6 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:55.001588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5085f632-404f-41d1-8abe-220e5f9bdbc6 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:55.002047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5085f632-404f-41d1-8abe-220e5f9bdbc6 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:55.002763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5085f632-404f-41d1-8abe-220e5f9bdbc6 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:55.003241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5085f632-404f-41d1-8abe-220e5f9bdbc6 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:55.003691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5085f632-404f-41d1-8abe-220e5f9bdbc6 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:55.140538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5085f632-404f-41d1-8abe-220e5f9bdbc6 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e441f450e7a421c8f0f551791f34a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4149d5e998467eae12fb0480a0c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:55.148534 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5085f632-404f-41d1-8abe-220e5f9bdbc6 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 200 len: 1429 microversion: 2.1 time: 0.161361 Oct 04 22:00:55.149147 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3478/6936] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:54 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 1429 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:55.431464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-0c764b95-9eec-4f22-bd14-750908b64757 req-0997e0af-4332-493d-9029-45bef1b420bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b40ed723-ba15-4edc-abbb-92e05e651833", "name": "network-vif-plugged", "status": "completed", "tag": "8a2aec20-c7a7-438d-96ca-07306aa2a78d"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:55.437992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:55.443244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0c764b95-9eec-4f22-bd14-750908b64757 req-0997e0af-4332-493d-9029-45bef1b420bc service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:55.443732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0c764b95-9eec-4f22-bd14-750908b64757 req-0997e0af-4332-493d-9029-45bef1b420bc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:55.444170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0c764b95-9eec-4f22-bd14-750908b64757 req-0997e0af-4332-493d-9029-45bef1b420bc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:55.455892 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-0c764b95-9eec-4f22-bd14-750908b64757 req-0997e0af-4332-493d-9029-45bef1b420bc service nova] Creating event network-vif-plugged:8a2aec20-c7a7-438d-96ca-07306aa2a78d for instance b40ed723-ba15-4edc-abbb-92e05e651833 on n-h2-860282-1 Oct 04 22:00:55.460881 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-0c764b95-9eec-4f22-bd14-750908b64757 req-0997e0af-4332-493d-9029-45bef1b420bc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033290 Oct 04 22:00:55.461555 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3459/6937] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:56.173158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-57fd5e92-e786-4066-888f-f5b8a0f08026 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:56.173848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-57fd5e92-e786-4066-888f-f5b8a0f08026 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:56.180751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57fd5e92-e786-4066-888f-f5b8a0f08026 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:56.181253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57fd5e92-e786-4066-888f-f5b8a0f08026 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:56.181807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57fd5e92-e786-4066-888f-f5b8a0f08026 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:56.187733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57fd5e92-e786-4066-888f-f5b8a0f08026 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:56.187733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57fd5e92-e786-4066-888f-f5b8a0f08026 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:56.187733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57fd5e92-e786-4066-888f-f5b8a0f08026 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:56.322155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-57fd5e92-e786-4066-888f-f5b8a0f08026 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e441f450e7a421c8f0f551791f34a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4149d5e998467eae12fb0480a0c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:56.330868 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-57fd5e92-e786-4066-888f-f5b8a0f08026 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 200 len: 1429 microversion: 2.1 time: 0.161802 Oct 04 22:00:56.331447 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3479/6938] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:56 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 1429 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:57.357730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8aabc88a-ff15-44af-a30b-a3ac9efcbf8b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:57.358446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8aabc88a-ff15-44af-a30b-a3ac9efcbf8b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:57.365105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8aabc88a-ff15-44af-a30b-a3ac9efcbf8b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:57.365642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8aabc88a-ff15-44af-a30b-a3ac9efcbf8b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:57.366092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8aabc88a-ff15-44af-a30b-a3ac9efcbf8b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:57.366783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8aabc88a-ff15-44af-a30b-a3ac9efcbf8b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:57.367245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8aabc88a-ff15-44af-a30b-a3ac9efcbf8b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:57.367680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8aabc88a-ff15-44af-a30b-a3ac9efcbf8b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:57.502375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8aabc88a-ff15-44af-a30b-a3ac9efcbf8b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e441f450e7a421c8f0f551791f34a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4149d5e998467eae12fb0480a0c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:57.510081 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8aabc88a-ff15-44af-a30b-a3ac9efcbf8b tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 200 len: 1609 microversion: 2.1 time: 0.159190 Oct 04 22:00:57.510662 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3460/6939] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:57 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 1609 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:57.533275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4157f0eb-3cb4-4ac7-aa1b-35db76f69eb5 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:57.533959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4157f0eb-3cb4-4ac7-aa1b-35db76f69eb5 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:57.543465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4157f0eb-3cb4-4ac7-aa1b-35db76f69eb5 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:57.543976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4157f0eb-3cb4-4ac7-aa1b-35db76f69eb5 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:57.544436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4157f0eb-3cb4-4ac7-aa1b-35db76f69eb5 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:57.545166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4157f0eb-3cb4-4ac7-aa1b-35db76f69eb5 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:57.545666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4157f0eb-3cb4-4ac7-aa1b-35db76f69eb5 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:57.546112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4157f0eb-3cb4-4ac7-aa1b-35db76f69eb5 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:57.686887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4157f0eb-3cb4-4ac7-aa1b-35db76f69eb5 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e441f450e7a421c8f0f551791f34a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4149d5e998467eae12fb0480a0c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:57.695678 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4157f0eb-3cb4-4ac7-aa1b-35db76f69eb5 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 200 len: 1609 microversion: 2.1 time: 0.166330 Oct 04 22:00:57.696258 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3480/6940] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:57 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 1609 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:57.718233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8b6a87a2-221c-48c9-b1e4-fd8b6d363404 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:57.718881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8b6a87a2-221c-48c9-b1e4-fd8b6d363404 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:57.724945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b6a87a2-221c-48c9-b1e4-fd8b6d363404 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:57.725503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b6a87a2-221c-48c9-b1e4-fd8b6d363404 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:57.725905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b6a87a2-221c-48c9-b1e4-fd8b6d363404 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:57.726953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b6a87a2-221c-48c9-b1e4-fd8b6d363404 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:57.727050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b6a87a2-221c-48c9-b1e4-fd8b6d363404 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:57.727453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8b6a87a2-221c-48c9-b1e4-fd8b6d363404 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:57.858315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8b6a87a2-221c-48c9-b1e4-fd8b6d363404 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e441f450e7a421c8f0f551791f34a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4149d5e998467eae12fb0480a0c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:57.866101 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8b6a87a2-221c-48c9-b1e4-fd8b6d363404 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 200 len: 1609 microversion: 2.1 time: 0.151832 Oct 04 22:00:57.866681 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3461/6941] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:57 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 1609 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:59.753700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-c73f2c80-85c3-4667-a7e5-7c9ee19e704f req-4aa37810-9fee-4c3f-a56a-65d8cce8fe72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b40ed723-ba15-4edc-abbb-92e05e651833", "tag": "8a2aec20-c7a7-438d-96ca-07306aa2a78d"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:59.765013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c73f2c80-85c3-4667-a7e5-7c9ee19e704f req-4aa37810-9fee-4c3f-a56a-65d8cce8fe72 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:59.765549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c73f2c80-85c3-4667-a7e5-7c9ee19e704f req-4aa37810-9fee-4c3f-a56a-65d8cce8fe72 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:59.766009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c73f2c80-85c3-4667-a7e5-7c9ee19e704f req-4aa37810-9fee-4c3f-a56a-65d8cce8fe72 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:59.779347 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-c73f2c80-85c3-4667-a7e5-7c9ee19e704f req-4aa37810-9fee-4c3f-a56a-65d8cce8fe72 service nova] Creating event network-changed:8a2aec20-c7a7-438d-96ca-07306aa2a78d for instance b40ed723-ba15-4edc-abbb-92e05e651833 on n-h2-860282-1 Oct 04 22:00:59.784487 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-c73f2c80-85c3-4667-a7e5-7c9ee19e704f req-4aa37810-9fee-4c3f-a56a-65d8cce8fe72 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034508 Oct 04 22:00:59.785050 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3481/6942] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:01:38.282897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-eda25feb-5ce1-4123-b5ce-b0645a74ccbc tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:38.283627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-eda25feb-5ce1-4123-b5ce-b0645a74ccbc tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:38.285725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:38.286396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=34 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:38.291236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eda25feb-5ce1-4123-b5ce-b0645a74ccbc tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:38.291725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eda25feb-5ce1-4123-b5ce-b0645a74ccbc tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:38.292160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eda25feb-5ce1-4123-b5ce-b0645a74ccbc tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:38.292858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eda25feb-5ce1-4123-b5ce-b0645a74ccbc tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:38.293308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eda25feb-5ce1-4123-b5ce-b0645a74ccbc tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:38.293774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eda25feb-5ce1-4123-b5ce-b0645a74ccbc tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:38.318985 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-eda25feb-5ce1-4123-b5ce-b0645a74ccbc tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.040631 Oct 04 22:01:38.319570 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3462/6943] 10.222.0.30 () {58 vars in 1293 bytes} [Tue Oct 4 22:01:38 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833/os-server-password => generated 116 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:05:41.974308 n-d-860282-1 devstack@n-api.service[122757]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09430b1c-e049-493f-9e8b-ffc95d4d7683] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:05:41.975188 n-d-860282-1 devstack@n-api.service[122757]: ERROR oslo.messaging._drivers.impl_rabbit [-] [02d9f940-80f2-491b-9a18-0a7fa72932fa] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:05:41.975750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:41.976519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=46 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:05:41.977321 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:05:41.977486 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 22:05:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 (ip 10.222.0.30) !!! Oct 04 22:05:41.978877 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:05:41.978997 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 22:05:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 (ip 10.222.0.30) !!! Oct 04 22:05:41.979894 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:05:41.980034 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 22:05:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 (ip 10.222.0.30) !!! Oct 04 22:05:42.132950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1e636090-eaa7-48c8-a747-5eb558db8b69 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:42.133625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1e636090-eaa7-48c8-a747-5eb558db8b69 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:42.140476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e636090-eaa7-48c8-a747-5eb558db8b69 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:42.140991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e636090-eaa7-48c8-a747-5eb558db8b69 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:42.141477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e636090-eaa7-48c8-a747-5eb558db8b69 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:42.142190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e636090-eaa7-48c8-a747-5eb558db8b69 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:42.142662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e636090-eaa7-48c8-a747-5eb558db8b69 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:42.143103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1e636090-eaa7-48c8-a747-5eb558db8b69 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:42.170535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1e636090-eaa7-48c8-a747-5eb558db8b69 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:05:42.401556 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1e636090-eaa7-48c8-a747-5eb558db8b69 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 204 len: 0 microversion: 2.1 time: 0.428767 Oct 04 22:05:42.402111 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3482/6944] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:05:41 2022] DELETE /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:05:42.408730 n-d-860282-1 devstack@n-api.service[122758]: ERROR oslo.messaging._drivers.impl_rabbit [-] [85957c5a-63ea-4587-9a7c-19b9c9ad6fe2] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:05:42.409965 n-d-860282-1 devstack@n-api.service[122758]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb95aab1-3781-4811-b11d-1606a5055a6d] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:05:42.410689 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:05:42.410831 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 22:05:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 (ip 10.222.0.30) !!! Oct 04 22:05:42.412263 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:05:42.412404 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 22:05:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 (ip 10.222.0.30) !!! Oct 04 22:05:42.414001 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:05:42.414117 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 22:05:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 (ip 10.222.0.30) !!! Oct 04 22:05:42.431518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7f8e0741-e1ca-4d51-af52-dd7d10c45558 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:42.432133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7f8e0741-e1ca-4d51-af52-dd7d10c45558 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:42.443240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f8e0741-e1ca-4d51-af52-dd7d10c45558 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:42.443733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f8e0741-e1ca-4d51-af52-dd7d10c45558 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:42.444176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f8e0741-e1ca-4d51-af52-dd7d10c45558 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:42.444906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f8e0741-e1ca-4d51-af52-dd7d10c45558 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:42.445363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f8e0741-e1ca-4d51-af52-dd7d10c45558 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:42.445817 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7f8e0741-e1ca-4d51-af52-dd7d10c45558 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:42.704383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7f8e0741-e1ca-4d51-af52-dd7d10c45558 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e441f450e7a421c8f0f551791f34a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4149d5e998467eae12fb0480a0c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:42.712328 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7f8e0741-e1ca-4d51-af52-dd7d10c45558 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 200 len: 1734 microversion: 2.1 time: 0.306046 Oct 04 22:05:42.712932 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3463/6945] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:42 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 1734 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:43.737367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-91819628-50bd-45be-9ee6-517b4c40cdba tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:43.738156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-91819628-50bd-45be-9ee6-517b4c40cdba tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:43.748710 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] [02d9f940-80f2-491b-9a18-0a7fa72932fa] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 35000. Oct 04 22:05:43.753654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91819628-50bd-45be-9ee6-517b4c40cdba tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:43.754161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91819628-50bd-45be-9ee6-517b4c40cdba tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:43.754631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91819628-50bd-45be-9ee6-517b4c40cdba tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:43.755360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91819628-50bd-45be-9ee6-517b4c40cdba tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:43.755834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91819628-50bd-45be-9ee6-517b4c40cdba tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:43.756280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91819628-50bd-45be-9ee6-517b4c40cdba tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:43.756918 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] [09430b1c-e049-493f-9e8b-ffc95d4d7683] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 34998. Oct 04 22:05:44.059304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-91819628-50bd-45be-9ee6-517b4c40cdba tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e441f450e7a421c8f0f551791f34a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4149d5e998467eae12fb0480a0c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:44.067122 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-91819628-50bd-45be-9ee6-517b4c40cdba tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 200 len: 1734 microversion: 2.1 time: 0.334813 Oct 04 22:05:44.067715 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3483/6946] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:43 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 1734 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:44.924982 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] [85957c5a-63ea-4587-9a7c-19b9c9ad6fe2] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 35012. Oct 04 22:05:44.926879 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb95aab1-3781-4811-b11d-1606a5055a6d] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 35014. Oct 04 22:05:44.966889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-6fd3e3d4-4c06-49d5-a879-fef8804f3a09 req-ee719ae0-2ff3-4580-9d91-cae94cbd31c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b40ed723-ba15-4edc-abbb-92e05e651833", "name": "network-vif-deleted", "tag": "8a2aec20-c7a7-438d-96ca-07306aa2a78d"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:05:44.984473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6fd3e3d4-4c06-49d5-a879-fef8804f3a09 req-ee719ae0-2ff3-4580-9d91-cae94cbd31c5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:44.984960 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6fd3e3d4-4c06-49d5-a879-fef8804f3a09 req-ee719ae0-2ff3-4580-9d91-cae94cbd31c5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:44.985453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6fd3e3d4-4c06-49d5-a879-fef8804f3a09 req-ee719ae0-2ff3-4580-9d91-cae94cbd31c5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:44.998181 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-6fd3e3d4-4c06-49d5-a879-fef8804f3a09 req-ee719ae0-2ff3-4580-9d91-cae94cbd31c5 service nova] Creating event network-vif-deleted:8a2aec20-c7a7-438d-96ca-07306aa2a78d for instance b40ed723-ba15-4edc-abbb-92e05e651833 on n-h2-860282-1 Oct 04 22:05:45.005451 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-6fd3e3d4-4c06-49d5-a879-fef8804f3a09 req-ee719ae0-2ff3-4580-9d91-cae94cbd31c5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103983 Oct 04 22:05:45.006250 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3464/6947] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:05:45.105802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-20de2881-08be-4d63-84d2-a8b4cf0903cb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:45.106501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-20de2881-08be-4d63-84d2-a8b4cf0903cb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:45.113455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20de2881-08be-4d63-84d2-a8b4cf0903cb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:45.122990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20de2881-08be-4d63-84d2-a8b4cf0903cb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:45.123471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20de2881-08be-4d63-84d2-a8b4cf0903cb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:45.124787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20de2881-08be-4d63-84d2-a8b4cf0903cb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:45.125526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20de2881-08be-4d63-84d2-a8b4cf0903cb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:45.125981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20de2881-08be-4d63-84d2-a8b4cf0903cb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:45.204020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-20de2881-08be-4d63-84d2-a8b4cf0903cb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e441f450e7a421c8f0f551791f34a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4149d5e998467eae12fb0480a0c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:05:45.215347 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-20de2881-08be-4d63-84d2-a8b4cf0903cb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 200 len: 1384 microversion: 2.1 time: 0.129800 Oct 04 22:05:45.216224 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3484/6948] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:45 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 1384 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:05:46.241397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9765a702-e119-4f51-a80f-9dd3a178dc07 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:46.242273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9765a702-e119-4f51-a80f-9dd3a178dc07 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:46.251489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9765a702-e119-4f51-a80f-9dd3a178dc07 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:46.251987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9765a702-e119-4f51-a80f-9dd3a178dc07 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:46.252435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9765a702-e119-4f51-a80f-9dd3a178dc07 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:46.253149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9765a702-e119-4f51-a80f-9dd3a178dc07 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:46.253650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9765a702-e119-4f51-a80f-9dd3a178dc07 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:46.254086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9765a702-e119-4f51-a80f-9dd3a178dc07 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:46.268328 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-9765a702-e119-4f51-a80f-9dd3a178dc07 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] HTTP exception thrown: Instance b40ed723-ba15-4edc-abbb-92e05e651833 could not be found. Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9765a702-e119-4f51-a80f-9dd3a178dc07 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Request method failure captured: Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 HTTP/1.1 Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKz_1BouSR7fWXpPlUVZzhMXE2UEyE8NobFTgZmPMgITzO5aBgPANQWZNaQjshGMXQ3fiujjKIcuwWjMRJ3KiN0v9YP82AqkD4LtJvV47qicBpl65lwIy3Si5OqhJa3HkWM1_JMlFouVT-L4YyhFm0ROWxXkhIVTU1uNA6M0KqUNepY Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7e4149d5e998467eae12fb0480a0c57e Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestServerBasicOps-1350433597 Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7e4149d5e998467eae12fb0480a0c57e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7e4149d5e998467eae12fb0480a0c57e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7e4149d5e998467eae12fb0480a0c57e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7e4149d5e998467eae12fb0480a0c57e"}]}] Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestServerBasicOps-1350433597 Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7e4149d5e998467eae12fb0480a0c57e Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestServerBasicOps-1350433597 Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestServerBasicOps-1350433597-project Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3e441f450e7a421c8f0f551791f34a29 Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestServerBasicOps-1350433597-project Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance b40ed723-ba15-4edc-abbb-92e05e651833 could not be found. Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'b40ed723-ba15-4edc-abbb-92e05e651833'} Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b40ed723-ba15-4edc-abbb-92e05e651833 could not be found. Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b40ed723-ba15-4edc-abbb-92e05e651833 could not be found. Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:46.270020 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:05:46.274921 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:46.274921 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:46.274921 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:46.274921 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:05:46.274921 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:05:46.274921 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b40ed723-ba15-4edc-abbb-92e05e651833 could not be found. Oct 04 22:05:46.274921 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:05:46.274921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9765a702-e119-4f51-a80f-9dd3a178dc07 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Returning 404 to user: Instance b40ed723-ba15-4edc-abbb-92e05e651833 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:05:46.274921 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9765a702-e119-4f51-a80f-9dd3a178dc07 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 404 len: 111 microversion: 2.1 time: 0.035522 Oct 04 22:05:46.274921 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3465/6949] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:46 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:05:47.103170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b864dead-23aa-4da3-9149-b3aa23950f95 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:47.103703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b864dead-23aa-4da3-9149-b3aa23950f95 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:47.113399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b864dead-23aa-4da3-9149-b3aa23950f95 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:47.113928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b864dead-23aa-4da3-9149-b3aa23950f95 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:47.114379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b864dead-23aa-4da3-9149-b3aa23950f95 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:47.115087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b864dead-23aa-4da3-9149-b3aa23950f95 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:47.115558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b864dead-23aa-4da3-9149-b3aa23950f95 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:47.116006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b864dead-23aa-4da3-9149-b3aa23950f95 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:47.129327 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-b864dead-23aa-4da3-9149-b3aa23950f95 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] HTTP exception thrown: Instance b40ed723-ba15-4edc-abbb-92e05e651833 could not be found. Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b864dead-23aa-4da3-9149-b3aa23950f95 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Request method failure captured: Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 HTTP/1.1 Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPKz_1BouSR7fWXpPlUVZzhMXE2UEyE8NobFTgZmPMgITzO5aBgPANQWZNaQjshGMXQ3fiujjKIcuwWjMRJ3KiN0v9YP82AqkD4LtJvV47qicBpl65lwIy3Si5OqhJa3HkWM1_JMlFouVT-L4YyhFm0ROWxXkhIVTU1uNA6M0KqUNepY Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 7e4149d5e998467eae12fb0480a0c57e Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestServerBasicOps-1350433597 Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7e4149d5e998467eae12fb0480a0c57e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7e4149d5e998467eae12fb0480a0c57e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7e4149d5e998467eae12fb0480a0c57e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7e4149d5e998467eae12fb0480a0c57e"}]}] Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestServerBasicOps-1350433597 Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 7e4149d5e998467eae12fb0480a0c57e Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestServerBasicOps-1350433597 Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestServerBasicOps-1350433597-project Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3e441f450e7a421c8f0f551791f34a29 Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestServerBasicOps-1350433597-project Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance b40ed723-ba15-4edc-abbb-92e05e651833 could not be found. Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'b40ed723-ba15-4edc-abbb-92e05e651833'} Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b40ed723-ba15-4edc-abbb-92e05e651833 could not be found. Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:05:47.131043 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:05:47.135588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b40ed723-ba15-4edc-abbb-92e05e651833 could not be found. Oct 04 22:05:47.135588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:05:47.135588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:47.135588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:05:47.135588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:47.135588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:47.135588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:47.135588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:05:47.135588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:05:47.135588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b40ed723-ba15-4edc-abbb-92e05e651833 could not be found. Oct 04 22:05:47.135588 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:05:47.135588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b864dead-23aa-4da3-9149-b3aa23950f95 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Returning 404 to user: Instance b40ed723-ba15-4edc-abbb-92e05e651833 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:05:47.135588 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b864dead-23aa-4da3-9149-b3aa23950f95 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 404 len: 111 microversion: 2.1 time: 0.033813 Oct 04 22:05:47.135588 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3485/6950] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:05:47 2022] DELETE /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:05:47.141696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-90e48520-a829-4133-8c15-7abae60c39eb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:47.142336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-90e48520-a829-4133-8c15-7abae60c39eb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] [instance: b40ed723-ba15-4edc-abbb-92e05e651833] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:05:47.150868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90e48520-a829-4133-8c15-7abae60c39eb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:47.151357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90e48520-a829-4133-8c15-7abae60c39eb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:47.151802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90e48520-a829-4133-8c15-7abae60c39eb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:47.152493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90e48520-a829-4133-8c15-7abae60c39eb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:05:47.152950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90e48520-a829-4133-8c15-7abae60c39eb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:05:47.153380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90e48520-a829-4133-8c15-7abae60c39eb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:05:47.170874 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-90e48520-a829-4133-8c15-7abae60c39eb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] HTTP exception thrown: Instance b40ed723-ba15-4edc-abbb-92e05e651833 could not be found. Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-90e48520-a829-4133-8c15-7abae60c39eb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Request method failure captured: Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 HTTP/1.1 Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPKz_1BouSR7fWXpPlUVZzhMXE2UEyE8NobFTgZmPMgITzO5aBgPANQWZNaQjshGMXQ3fiujjKIcuwWjMRJ3KiN0v9YP82AqkD4LtJvV47qicBpl65lwIy3Si5OqhJa3HkWM1_JMlFouVT-L4YyhFm0ROWxXkhIVTU1uNA6M0KqUNepY Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 7e4149d5e998467eae12fb0480a0c57e Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestServerBasicOps-1350433597 Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7e4149d5e998467eae12fb0480a0c57e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7e4149d5e998467eae12fb0480a0c57e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7e4149d5e998467eae12fb0480a0c57e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7e4149d5e998467eae12fb0480a0c57e"}]}] Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestServerBasicOps-1350433597 Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 7e4149d5e998467eae12fb0480a0c57e Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestServerBasicOps-1350433597 Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestServerBasicOps-1350433597-project Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3e441f450e7a421c8f0f551791f34a29 Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestServerBasicOps-1350433597-project Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance b40ed723-ba15-4edc-abbb-92e05e651833 could not be found. Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'b40ed723-ba15-4edc-abbb-92e05e651833'} Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b40ed723-ba15-4edc-abbb-92e05e651833 could not be found. Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b40ed723-ba15-4edc-abbb-92e05e651833 could not be found. Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:05:47.173174 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:05:47.177562 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:05:47.177562 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:05:47.177562 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:05:47.177562 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:05:47.177562 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:05:47.177562 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b40ed723-ba15-4edc-abbb-92e05e651833 could not be found. Oct 04 22:05:47.177562 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:05:47.177562 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-90e48520-a829-4133-8c15-7abae60c39eb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Returning 404 to user: Instance b40ed723-ba15-4edc-abbb-92e05e651833 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:05:47.177562 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-90e48520-a829-4133-8c15-7abae60c39eb tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833" status: 404 len: 111 microversion: 2.1 time: 0.037096 Oct 04 22:05:47.177562 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3466/6951] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:05:47 2022] GET /compute/v2.1/servers/b40ed723-ba15-4edc-abbb-92e05e651833 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:05:47.395028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0a8a8336-adae-41e2-a461-f05e4baadb26 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] Calling method '.version_select at 0x7f57909cc940>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:05:47.471547 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0a8a8336-adae-41e2-a461-f05e4baadb26 tempest-TestServerBasicOps-1350433597 tempest-TestServerBasicOps-1350433597-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1553157075" status: 202 len: 0 microversion: 2.1 time: 0.080478 Oct 04 22:05:47.472169 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3486/6952] 10.222.0.30 () {58 vars in 1254 bytes} [Tue Oct 4 22:05:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1553157075 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:06:19.669625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=10 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:19.670359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=16 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:19.803502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-31c995b4-dc74-442d-92f6-9a07d280d1fb tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1973550433", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:19.861962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-31c995b4-dc74-442d-92f6-9a07d280d1fb tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] validate_networks() for None {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:06:20.147059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-31c995b4-dc74-442d-92f6-9a07d280d1fb tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:06:20.147490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-31c995b4-dc74-442d-92f6-9a07d280d1fb tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:06:20.147969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-31c995b4-dc74-442d-92f6-9a07d280d1fb tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:06:20.148422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-31c995b4-dc74-442d-92f6-9a07d280d1fb tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:06:20.148841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-31c995b4-dc74-442d-92f6-9a07d280d1fb tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:06:20.161301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31c995b4-dc74-442d-92f6-9a07d280d1fb tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:20.161825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31c995b4-dc74-442d-92f6-9a07d280d1fb tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:20.162271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31c995b4-dc74-442d-92f6-9a07d280d1fb tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:20.163004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31c995b4-dc74-442d-92f6-9a07d280d1fb tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:20.163465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31c995b4-dc74-442d-92f6-9a07d280d1fb tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:20.164064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31c995b4-dc74-442d-92f6-9a07d280d1fb tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:20.184116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-31c995b4-dc74-442d-92f6-9a07d280d1fb tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Getting quotas for project d078aeb8b27746c99871df3d294dc514. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:06:20.189596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-31c995b4-dc74-442d-92f6-9a07d280d1fb tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Getting quotas for user ae9e2ecd3e1e4253ab07f121cddc2639 and project d078aeb8b27746c99871df3d294dc514. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:06:20.202926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-31c995b4-dc74-442d-92f6-9a07d280d1fb tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:06:20.205379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-31c995b4-dc74-442d-92f6-9a07d280d1fb tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:06:20.300511 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-31c995b4-dc74-442d-92f6-9a07d280d1fb tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635857 Oct 04 22:06:20.301169 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3467/6953] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:06:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:06:20.311575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:20.312365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:20.321786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f6c99183-8b8b-455e-841d-6e47afb9b085 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:20.321786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f6c99183-8b8b-455e-841d-6e47afb9b085 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:20.375378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f6c99183-8b8b-455e-841d-6e47afb9b085 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9e2ecd3e1e4253ab07f121cddc2639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd078aeb8b27746c99871df3d294dc514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:20.385714 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f6c99183-8b8b-455e-841d-6e47afb9b085 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] 10.222.0.30 "GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229" status: 200 len: 1222 microversion: 2.1 time: 0.075894 Oct 04 22:06:20.386519 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3487/6954] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:20 2022] GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229 => generated 1222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:21.411078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ba0f6d43-206d-443d-aca1-ee22a77024cc tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:21.411825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ba0f6d43-206d-443d-aca1-ee22a77024cc tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:21.464901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ba0f6d43-206d-443d-aca1-ee22a77024cc tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9e2ecd3e1e4253ab07f121cddc2639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd078aeb8b27746c99871df3d294dc514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:21.471946 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ba0f6d43-206d-443d-aca1-ee22a77024cc tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] 10.222.0.30 "GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229" status: 200 len: 1222 microversion: 2.1 time: 0.066362 Oct 04 22:06:21.472663 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3468/6955] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:21 2022] GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229 => generated 1222 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:22.496197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bf5cff0d-ba91-4d38-ad51-d143bf85d7c9 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:22.496864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bf5cff0d-ba91-4d38-ad51-d143bf85d7c9 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:22.504951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf5cff0d-ba91-4d38-ad51-d143bf85d7c9 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:22.505488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf5cff0d-ba91-4d38-ad51-d143bf85d7c9 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:22.505955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf5cff0d-ba91-4d38-ad51-d143bf85d7c9 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:22.506786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf5cff0d-ba91-4d38-ad51-d143bf85d7c9 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:22.507268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf5cff0d-ba91-4d38-ad51-d143bf85d7c9 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:22.507720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf5cff0d-ba91-4d38-ad51-d143bf85d7c9 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:22.573062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bf5cff0d-ba91-4d38-ad51-d143bf85d7c9 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9e2ecd3e1e4253ab07f121cddc2639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd078aeb8b27746c99871df3d294dc514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:22.581929 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bf5cff0d-ba91-4d38-ad51-d143bf85d7c9 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] 10.222.0.30 "GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229" status: 200 len: 1282 microversion: 2.1 time: 0.089620 Oct 04 22:06:22.582681 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3488/6956] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:22 2022] GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229 => generated 1282 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:23.606398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4f184c0a-caa8-479c-ba29-a5b8962103cc tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:23.607030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4f184c0a-caa8-479c-ba29-a5b8962103cc tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:23.613950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f184c0a-caa8-479c-ba29-a5b8962103cc tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:23.614451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f184c0a-caa8-479c-ba29-a5b8962103cc tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:23.614894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f184c0a-caa8-479c-ba29-a5b8962103cc tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:23.615594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f184c0a-caa8-479c-ba29-a5b8962103cc tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:23.616055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f184c0a-caa8-479c-ba29-a5b8962103cc tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:23.616487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4f184c0a-caa8-479c-ba29-a5b8962103cc tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:23.687248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4f184c0a-caa8-479c-ba29-a5b8962103cc tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9e2ecd3e1e4253ab07f121cddc2639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd078aeb8b27746c99871df3d294dc514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:23.695833 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4f184c0a-caa8-479c-ba29-a5b8962103cc tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] 10.222.0.30 "GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229" status: 200 len: 1280 microversion: 2.1 time: 0.093469 Oct 04 22:06:23.696409 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3469/6957] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:23 2022] GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229 => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:24.719693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f39e55cc-fd0b-40d3-99de-0021b9367357 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:24.720340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f39e55cc-fd0b-40d3-99de-0021b9367357 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:24.728217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f39e55cc-fd0b-40d3-99de-0021b9367357 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:24.728742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f39e55cc-fd0b-40d3-99de-0021b9367357 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:24.729200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f39e55cc-fd0b-40d3-99de-0021b9367357 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:24.729965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f39e55cc-fd0b-40d3-99de-0021b9367357 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:24.730454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f39e55cc-fd0b-40d3-99de-0021b9367357 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:24.730909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f39e55cc-fd0b-40d3-99de-0021b9367357 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:24.869395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f39e55cc-fd0b-40d3-99de-0021b9367357 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9e2ecd3e1e4253ab07f121cddc2639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd078aeb8b27746c99871df3d294dc514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:24.879114 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f39e55cc-fd0b-40d3-99de-0021b9367357 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] 10.222.0.30 "GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229" status: 200 len: 1322 microversion: 2.1 time: 0.162864 Oct 04 22:06:24.879726 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3489/6958] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:24 2022] GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:24.955089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-61c43770-523a-4a66-b005-7b6c009aedbd req-e9ed6544-fe16-4ebc-905e-2ef3f4dd48e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "819ca3c0-6671-4a46-9032-97790d1d2229", "tag": "33703cd0-b820-48d1-b405-dfeb4cf66235"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:24.964836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-61c43770-523a-4a66-b005-7b6c009aedbd req-e9ed6544-fe16-4ebc-905e-2ef3f4dd48e5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:24.965315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-61c43770-523a-4a66-b005-7b6c009aedbd req-e9ed6544-fe16-4ebc-905e-2ef3f4dd48e5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:24.965777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-61c43770-523a-4a66-b005-7b6c009aedbd req-e9ed6544-fe16-4ebc-905e-2ef3f4dd48e5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:24.977049 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-61c43770-523a-4a66-b005-7b6c009aedbd req-e9ed6544-fe16-4ebc-905e-2ef3f4dd48e5 service nova] Creating event network-changed:33703cd0-b820-48d1-b405-dfeb4cf66235 for instance 819ca3c0-6671-4a46-9032-97790d1d2229 on n-h1-860282-1 Oct 04 22:06:24.982499 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-61c43770-523a-4a66-b005-7b6c009aedbd req-e9ed6544-fe16-4ebc-905e-2ef3f4dd48e5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082691 Oct 04 22:06:24.983062 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3470/6959] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:25.902791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b15109fa-8874-49af-8a37-1cdc3ff18167 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:25.903426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b15109fa-8874-49af-8a37-1cdc3ff18167 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:25.911085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b15109fa-8874-49af-8a37-1cdc3ff18167 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:25.911590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b15109fa-8874-49af-8a37-1cdc3ff18167 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:25.912048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b15109fa-8874-49af-8a37-1cdc3ff18167 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:25.912764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b15109fa-8874-49af-8a37-1cdc3ff18167 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:25.913236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b15109fa-8874-49af-8a37-1cdc3ff18167 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:25.913707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b15109fa-8874-49af-8a37-1cdc3ff18167 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:26.043583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b15109fa-8874-49af-8a37-1cdc3ff18167 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9e2ecd3e1e4253ab07f121cddc2639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd078aeb8b27746c99871df3d294dc514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:26.051344 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b15109fa-8874-49af-8a37-1cdc3ff18167 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] 10.222.0.30 "GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229" status: 200 len: 1322 microversion: 2.1 time: 0.152552 Oct 04 22:06:26.054067 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3490/6960] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:25 2022] GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:27.075368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ffe9788e-e2b2-4694-9994-f22a56b1955c tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:27.076066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ffe9788e-e2b2-4694-9994-f22a56b1955c tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:27.083767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffe9788e-e2b2-4694-9994-f22a56b1955c tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:27.084249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffe9788e-e2b2-4694-9994-f22a56b1955c tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:27.084689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffe9788e-e2b2-4694-9994-f22a56b1955c tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:27.085373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffe9788e-e2b2-4694-9994-f22a56b1955c tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:27.085856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffe9788e-e2b2-4694-9994-f22a56b1955c tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:27.086281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ffe9788e-e2b2-4694-9994-f22a56b1955c tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:27.218660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ffe9788e-e2b2-4694-9994-f22a56b1955c tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9e2ecd3e1e4253ab07f121cddc2639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd078aeb8b27746c99871df3d294dc514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:27.226751 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ffe9788e-e2b2-4694-9994-f22a56b1955c tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] 10.222.0.30 "GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229" status: 200 len: 1322 microversion: 2.1 time: 0.155640 Oct 04 22:06:27.227324 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3471/6961] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:27 2022] GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:28.250279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-38cfda5d-0f87-4605-9d6f-6713f775f7d3 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:28.250918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-38cfda5d-0f87-4605-9d6f-6713f775f7d3 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:28.258474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38cfda5d-0f87-4605-9d6f-6713f775f7d3 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:28.258995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38cfda5d-0f87-4605-9d6f-6713f775f7d3 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:28.259463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38cfda5d-0f87-4605-9d6f-6713f775f7d3 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:28.260195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38cfda5d-0f87-4605-9d6f-6713f775f7d3 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:28.260709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38cfda5d-0f87-4605-9d6f-6713f775f7d3 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:28.261164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38cfda5d-0f87-4605-9d6f-6713f775f7d3 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:28.399606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-38cfda5d-0f87-4605-9d6f-6713f775f7d3 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9e2ecd3e1e4253ab07f121cddc2639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd078aeb8b27746c99871df3d294dc514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:28.407678 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-38cfda5d-0f87-4605-9d6f-6713f775f7d3 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] 10.222.0.30 "GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229" status: 200 len: 1322 microversion: 2.1 time: 0.161548 Oct 04 22:06:28.408263 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3491/6962] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:28 2022] GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:29.430919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2f52532d-57e0-4705-b30a-988301e2a27b tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:29.431465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2f52532d-57e0-4705-b30a-988301e2a27b tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:29.438425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2f52532d-57e0-4705-b30a-988301e2a27b tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:29.438919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2f52532d-57e0-4705-b30a-988301e2a27b tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:29.439365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2f52532d-57e0-4705-b30a-988301e2a27b tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:29.440066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2f52532d-57e0-4705-b30a-988301e2a27b tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:29.441142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2f52532d-57e0-4705-b30a-988301e2a27b tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:29.441611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2f52532d-57e0-4705-b30a-988301e2a27b tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:29.572393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2f52532d-57e0-4705-b30a-988301e2a27b tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9e2ecd3e1e4253ab07f121cddc2639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd078aeb8b27746c99871df3d294dc514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:29.580153 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2f52532d-57e0-4705-b30a-988301e2a27b tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] 10.222.0.30 "GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229" status: 200 len: 1322 microversion: 2.1 time: 0.153250 Oct 04 22:06:29.580726 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3472/6963] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:29 2022] GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:30.474257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:30.533172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-e284fbda-6f4a-4867-92e7-b8d7b3701b89 req-6a9b2656-94e3-4ad9-b6bc-4d1863e419ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819ca3c0-6671-4a46-9032-97790d1d2229", "name": "network-vif-plugged", "status": "completed", "tag": "33703cd0-b820-48d1-b405-dfeb4cf66235"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:30.543461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e284fbda-6f4a-4867-92e7-b8d7b3701b89 req-6a9b2656-94e3-4ad9-b6bc-4d1863e419ea service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:30.544031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e284fbda-6f4a-4867-92e7-b8d7b3701b89 req-6a9b2656-94e3-4ad9-b6bc-4d1863e419ea service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:30.544572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e284fbda-6f4a-4867-92e7-b8d7b3701b89 req-6a9b2656-94e3-4ad9-b6bc-4d1863e419ea service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:30.556425 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-e284fbda-6f4a-4867-92e7-b8d7b3701b89 req-6a9b2656-94e3-4ad9-b6bc-4d1863e419ea service nova] Creating event network-vif-plugged:33703cd0-b820-48d1-b405-dfeb4cf66235 for instance 819ca3c0-6671-4a46-9032-97790d1d2229 on n-h1-860282-1 Oct 04 22:06:30.562487 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-e284fbda-6f4a-4867-92e7-b8d7b3701b89 req-6a9b2656-94e3-4ad9-b6bc-4d1863e419ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093640 Oct 04 22:06:30.563107 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3492/6964] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:30.602556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ba2fe386-92b9-4e8e-92e8-b0f7431f8250 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:30.603270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ba2fe386-92b9-4e8e-92e8-b0f7431f8250 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:30.605407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:30.611904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba2fe386-92b9-4e8e-92e8-b0f7431f8250 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:30.612588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba2fe386-92b9-4e8e-92e8-b0f7431f8250 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:30.612994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba2fe386-92b9-4e8e-92e8-b0f7431f8250 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:30.613696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba2fe386-92b9-4e8e-92e8-b0f7431f8250 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:30.614154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba2fe386-92b9-4e8e-92e8-b0f7431f8250 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:30.614582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba2fe386-92b9-4e8e-92e8-b0f7431f8250 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:30.747807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ba2fe386-92b9-4e8e-92e8-b0f7431f8250 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9e2ecd3e1e4253ab07f121cddc2639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd078aeb8b27746c99871df3d294dc514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:30.755598 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ba2fe386-92b9-4e8e-92e8-b0f7431f8250 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] 10.222.0.30 "GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229" status: 200 len: 1322 microversion: 2.1 time: 0.157154 Oct 04 22:06:30.756169 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3473/6965] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:30 2022] GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:31.779413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8eb6bb0a-5c0f-4eb7-93e4-896bbd1c296f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:31.780159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8eb6bb0a-5c0f-4eb7-93e4-896bbd1c296f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:31.786743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8eb6bb0a-5c0f-4eb7-93e4-896bbd1c296f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:31.787254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8eb6bb0a-5c0f-4eb7-93e4-896bbd1c296f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:31.787723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8eb6bb0a-5c0f-4eb7-93e4-896bbd1c296f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:31.788449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8eb6bb0a-5c0f-4eb7-93e4-896bbd1c296f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:31.788928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8eb6bb0a-5c0f-4eb7-93e4-896bbd1c296f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:31.789382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8eb6bb0a-5c0f-4eb7-93e4-896bbd1c296f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:31.932678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8eb6bb0a-5c0f-4eb7-93e4-896bbd1c296f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9e2ecd3e1e4253ab07f121cddc2639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd078aeb8b27746c99871df3d294dc514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:31.940742 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8eb6bb0a-5c0f-4eb7-93e4-896bbd1c296f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] 10.222.0.30 "GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229" status: 200 len: 1322 microversion: 2.1 time: 0.166527 Oct 04 22:06:31.941340 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3493/6966] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:31 2022] GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:32.964086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-376cf602-8c3c-451d-9efc-c1dd40828a5a tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:32.964702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-376cf602-8c3c-451d-9efc-c1dd40828a5a tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:32.966565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:32.972807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-376cf602-8c3c-451d-9efc-c1dd40828a5a tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:32.973290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-376cf602-8c3c-451d-9efc-c1dd40828a5a tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:32.973759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-376cf602-8c3c-451d-9efc-c1dd40828a5a tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:32.974452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-376cf602-8c3c-451d-9efc-c1dd40828a5a tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:32.974907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-376cf602-8c3c-451d-9efc-c1dd40828a5a tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:32.981528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-376cf602-8c3c-451d-9efc-c1dd40828a5a tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:33.108287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-376cf602-8c3c-451d-9efc-c1dd40828a5a tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9e2ecd3e1e4253ab07f121cddc2639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd078aeb8b27746c99871df3d294dc514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:33.116598 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-376cf602-8c3c-451d-9efc-c1dd40828a5a tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] 10.222.0.30 "GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229" status: 200 len: 1472 microversion: 2.1 time: 0.156425 Oct 04 22:06:33.117171 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3474/6967] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:32 2022] GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229 => generated 1472 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:33.187095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-710e1695-28ff-44dc-83ae-7c8de0ff00e9 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Calling method '.version_select at 0x7f578b4e51f0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:33.249895 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-710e1695-28ff-44dc-83ae-7c8de0ff00e9 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/c9fc3cf951a54005b1764fe34c9d0bc1" status: 200 len: 371 microversion: 2.1 time: 0.112159 Oct 04 22:06:33.250469 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3494/6968] 10.222.0.30 () {58 vars in 1242 bytes} [Tue Oct 4 22:06:33 2022] GET /compute/v2.1/os-quota-sets/c9fc3cf951a54005b1764fe34c9d0bc1 => generated 371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:33.262920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5752692c-2aeb-4895-9231-081e291ff27c tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1741239971", "id": 597396782, "os-flavor-access:is_public": "True"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:33.330812 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5752692c-2aeb-4895-9231-081e291ff27c tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.071640 Oct 04 22:06:33.331512 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3475/6969] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:06:33 2022] POST /compute/v2.1/flavors => generated 435 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:06:33.343856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "597396782"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:33.346188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:33.355114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:33.355634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:33.356100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:33.356835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:33.357312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:33.357790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:33.527361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a47125623789478b93616067b35c82ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fc3cf951a54005b1764fe34c9d0bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:33.533763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1741239971 {{(pid=122757) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:06:33.541698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:33.542155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:33.542617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:33.543373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:33.543851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:33.544315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:33.569663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Getting quotas for project d078aeb8b27746c99871df3d294dc514. Resources: {'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:06:33.574686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Getting quotas for user ae9e2ecd3e1e4253ab07f121cddc2639 and project d078aeb8b27746c99871df3d294dc514. Resources: {'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:06:33.588941 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.compute.api [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] ram quota exceeded for c9fc3cf951a54005b1764fe34c9d0bc1, tried to resize instance. Oct 04 22:06:33.589544 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Request method failure captured: Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229/action HTTP/1.1 Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 38 Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPK5bXTcrDfKOc1Y52KbEyK2n5rm73Ieey8hah5xWfAhta3D6orSH3L5drxn5WT4r9EtQwVBQhGT1FQI3Cl4aptm8SZ9CfGUVtyrB_2VBi9c-0OqcBs1FBua4DdCPkYusgTqzzzFRHBEiwSNgRlzdUnmvJBSViURgT8i05ffFrpT_LhE Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: c9fc3cf951a54005b1764fe34c9d0bc1 Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-977413191 Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member,admin Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member,admin Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c9fc3cf951a54005b1764fe34c9d0bc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c9fc3cf951a54005b1764fe34c9d0bc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c9fc3cf951a54005b1764fe34c9d0bc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c9fc3cf951a54005b1764fe34c9d0bc1"}]}] Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersAdminNegativeTestJSON-977413191 Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: c9fc3cf951a54005b1764fe34c9d0bc1 Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-977413191 Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersAdminNegativeTestJSON-977413191-project-admin Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: a47125623789478b93616067b35c82ba Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersAdminNegativeTestJSON-977413191-project-admin Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: {"resize": {"flavorRef": "597396782"}} Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '819ca3c0-6671-4a46-9032-97790d1d2229', 'body': {'resize': {'flavorRef': '597396782'}}} Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:06:33.600525 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-76fff43a-0e21-4103-a208-7b05a66b967a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229/action" status: 403 len: 118 microversion: 2.1 time: 0.262107 Oct 04 22:06:33.605006 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3495/6970] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:06:33 2022] POST /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229/action => generated 118 bytes in 263 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:33.611112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-405cbf8e-5c75-4c46-996f-569b9f4c2a1c tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:33.697657 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-405cbf8e-5c75-4c46-996f-569b9f4c2a1c tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/597396782" status: 202 len: 0 microversion: 2.1 time: 0.090239 Oct 04 22:06:33.698244 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3476/6971] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Oct 4 22:06:33 2022] DELETE /compute/v2.1/flavors/597396782 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:06:33.718214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-54c7b9dd-9844-4ee4-999c-bd4ffc9ef0a2 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:33.739958 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-54c7b9dd-9844-4ee4-999c-bd4ffc9ef0a2 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025388 Oct 04 22:06:33.740451 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3496/6972] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 22:06:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:33.760196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bb6d8482-58e7-4488-9004-5171873c6f8a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Calling method '.version_select at 0x7f57907be550>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:33.827277 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bb6d8482-58e7-4488-9004-5171873c6f8a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/c9fc3cf951a54005b1764fe34c9d0bc1" status: 200 len: 371 microversion: 2.1 time: 0.070779 Oct 04 22:06:33.827854 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3477/6973] 10.222.0.30 () {58 vars in 1242 bytes} [Tue Oct 4 22:06:33 2022] GET /compute/v2.1/os-quota-sets/c9fc3cf951a54005b1764fe34c9d0bc1 => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:33.840210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2d9e8568-bd5c-4c81-b424-f05300c489ad tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-953912410", "id": 1478034150, "os-flavor-access:is_public": "True"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:33.943396 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2d9e8568-bd5c-4c81-b424-f05300c489ad tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.106788 Oct 04 22:06:33.944028 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3497/6974] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:06:33 2022] POST /compute/v2.1/flavors => generated 436 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:33.958429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1478034150"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:33.960768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:33.966723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:33.967266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:33.967668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:33.968345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:33.968837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:33.969264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:34.131785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a47125623789478b93616067b35c82ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fc3cf951a54005b1764fe34c9d0bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:34.138103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-953912410 {{(pid=122758) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:06:34.145822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:34.146312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:34.146763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:34.147498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:34.147962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:34.148401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:34.169648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Getting quotas for project d078aeb8b27746c99871df3d294dc514. Resources: {'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:06:34.174655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Getting quotas for user ae9e2ecd3e1e4253ab07f121cddc2639 and project d078aeb8b27746c99871df3d294dc514. Resources: {'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:06:34.187102 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.compute.api [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] cores quota exceeded for c9fc3cf951a54005b1764fe34c9d0bc1, tried to resize instance. Oct 04 22:06:34.187652 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Request method failure captured: Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229/action HTTP/1.1 Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 39 Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPK5bXTcrDfKOc1Y52KbEyK2n5rm73Ieey8hah5xWfAhta3D6orSH3L5drxn5WT4r9EtQwVBQhGT1FQI3Cl4aptm8SZ9CfGUVtyrB_2VBi9c-0OqcBs1FBua4DdCPkYusgTqzzzFRHBEiwSNgRlzdUnmvJBSViURgT8i05ffFrpT_LhE Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: c9fc3cf951a54005b1764fe34c9d0bc1 Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-977413191 Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member,admin Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member,admin Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c9fc3cf951a54005b1764fe34c9d0bc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c9fc3cf951a54005b1764fe34c9d0bc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c9fc3cf951a54005b1764fe34c9d0bc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c9fc3cf951a54005b1764fe34c9d0bc1"}]}] Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersAdminNegativeTestJSON-977413191 Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: c9fc3cf951a54005b1764fe34c9d0bc1 Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-977413191 Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersAdminNegativeTestJSON-977413191-project-admin Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: a47125623789478b93616067b35c82ba Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersAdminNegativeTestJSON-977413191-project-admin Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: {"resize": {"flavorRef": "1478034150"}} Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '819ca3c0-6671-4a46-9032-97790d1d2229', 'body': {'resize': {'flavorRef': '1478034150'}}} Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:06:34.189752 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aad58dcd-dd59-4a3c-96ba-9b72eff7b766 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229/action" status: 403 len: 113 microversion: 2.1 time: 0.238297 Oct 04 22:06:34.194385 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3478/6975] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:06:33 2022] POST /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229/action => generated 113 bytes in 239 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:34.200771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4fab8507-878c-4954-a23d-29a4cee4b750 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:34.256891 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4fab8507-878c-4954-a23d-29a4cee4b750 tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1478034150" status: 202 len: 0 microversion: 2.1 time: 0.059765 Oct 04 22:06:34.257510 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3498/6976] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Oct 4 22:06:34 2022] DELETE /compute/v2.1/flavors/1478034150 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:06:34.265272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a14ff44e-d1f7-4652-8133-b8d5fb5ab40a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:34.287078 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a14ff44e-d1f7-4652-8133-b8d5fb5ab40a tempest-ServersAdminNegativeTestJSON-977413191 tempest-ServersAdminNegativeTestJSON-977413191-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025444 Oct 04 22:06:34.287644 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3479/6977] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Oct 4 22:06:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:34.307985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3f8b4b01-d2af-4aea-8620-4c6b5d62ba1f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:34.308428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3f8b4b01-d2af-4aea-8620-4c6b5d62ba1f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:34.314684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f8b4b01-d2af-4aea-8620-4c6b5d62ba1f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:34.315187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f8b4b01-d2af-4aea-8620-4c6b5d62ba1f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:34.316147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f8b4b01-d2af-4aea-8620-4c6b5d62ba1f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:34.316855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f8b4b01-d2af-4aea-8620-4c6b5d62ba1f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:34.317330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f8b4b01-d2af-4aea-8620-4c6b5d62ba1f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:34.317826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f8b4b01-d2af-4aea-8620-4c6b5d62ba1f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:34.343326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3f8b4b01-d2af-4aea-8620-4c6b5d62ba1f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:06:34.566764 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3f8b4b01-d2af-4aea-8620-4c6b5d62ba1f tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] 10.222.0.30 "DELETE /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229" status: 204 len: 0 microversion: 2.1 time: 0.262351 Oct 04 22:06:34.567296 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3499/6978] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:06:34 2022] DELETE /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:06:34.575445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-014bc21b-bb6c-411d-b469-a0035a568652 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:34.576069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-014bc21b-bb6c-411d-b469-a0035a568652 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:34.582565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-014bc21b-bb6c-411d-b469-a0035a568652 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:34.583053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-014bc21b-bb6c-411d-b469-a0035a568652 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:34.583494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-014bc21b-bb6c-411d-b469-a0035a568652 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:34.584189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-014bc21b-bb6c-411d-b469-a0035a568652 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:34.584650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-014bc21b-bb6c-411d-b469-a0035a568652 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:34.585082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-014bc21b-bb6c-411d-b469-a0035a568652 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:34.716982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-014bc21b-bb6c-411d-b469-a0035a568652 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9e2ecd3e1e4253ab07f121cddc2639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd078aeb8b27746c99871df3d294dc514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:34.723846 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-014bc21b-bb6c-411d-b469-a0035a568652 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] 10.222.0.30 "GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229" status: 200 len: 1478 microversion: 2.1 time: 0.152392 Oct 04 22:06:34.724423 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3480/6979] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:34 2022] GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229 => generated 1478 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:35.747833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0da65af7-cd60-450a-91de-239db0304282 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:35.748562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0da65af7-cd60-450a-91de-239db0304282 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:35.756166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0da65af7-cd60-450a-91de-239db0304282 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:35.756725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0da65af7-cd60-450a-91de-239db0304282 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:35.757163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0da65af7-cd60-450a-91de-239db0304282 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:35.758052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0da65af7-cd60-450a-91de-239db0304282 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:35.758490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0da65af7-cd60-450a-91de-239db0304282 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:35.758896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0da65af7-cd60-450a-91de-239db0304282 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:35.901746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0da65af7-cd60-450a-91de-239db0304282 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9e2ecd3e1e4253ab07f121cddc2639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd078aeb8b27746c99871df3d294dc514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:35.911062 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0da65af7-cd60-450a-91de-239db0304282 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] 10.222.0.30 "GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229" status: 200 len: 1478 microversion: 2.1 time: 0.167746 Oct 04 22:06:35.917511 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3500/6980] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:35 2022] GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229 => generated 1478 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:36.414282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-1945eca2-2c7d-44bd-a95b-27bd2fa51ff6 req-fce5fa36-6fec-4792-9456-b654e220fbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819ca3c0-6671-4a46-9032-97790d1d2229", "name": "network-vif-deleted", "tag": "33703cd0-b820-48d1-b405-dfeb4cf66235"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:36.426083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1945eca2-2c7d-44bd-a95b-27bd2fa51ff6 req-fce5fa36-6fec-4792-9456-b654e220fbb4 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:36.426608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1945eca2-2c7d-44bd-a95b-27bd2fa51ff6 req-fce5fa36-6fec-4792-9456-b654e220fbb4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:36.427047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1945eca2-2c7d-44bd-a95b-27bd2fa51ff6 req-fce5fa36-6fec-4792-9456-b654e220fbb4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:36.438926 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-1945eca2-2c7d-44bd-a95b-27bd2fa51ff6 req-fce5fa36-6fec-4792-9456-b654e220fbb4 service nova] Creating event network-vif-deleted:33703cd0-b820-48d1-b405-dfeb4cf66235 for instance 819ca3c0-6671-4a46-9032-97790d1d2229 on n-h1-860282-1 Oct 04 22:06:36.444270 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-1945eca2-2c7d-44bd-a95b-27bd2fa51ff6 req-fce5fa36-6fec-4792-9456-b654e220fbb4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033681 Oct 04 22:06:36.445054 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3481/6981] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:36.934926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-29b1a6af-8cf1-4f01-a129-e7f44fc682a2 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:36.935565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-29b1a6af-8cf1-4f01-a129-e7f44fc682a2 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:36.942422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29b1a6af-8cf1-4f01-a129-e7f44fc682a2 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:36.942927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29b1a6af-8cf1-4f01-a129-e7f44fc682a2 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:36.943387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29b1a6af-8cf1-4f01-a129-e7f44fc682a2 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:36.944100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29b1a6af-8cf1-4f01-a129-e7f44fc682a2 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:36.944575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29b1a6af-8cf1-4f01-a129-e7f44fc682a2 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:36.945025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29b1a6af-8cf1-4f01-a129-e7f44fc682a2 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:36.976319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29b1a6af-8cf1-4f01-a129-e7f44fc682a2 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:36.976819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29b1a6af-8cf1-4f01-a129-e7f44fc682a2 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:36.977287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-29b1a6af-8cf1-4f01-a129-e7f44fc682a2 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:36.977782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-29b1a6af-8cf1-4f01-a129-e7f44fc682a2 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lazy-loading 'fault' on Instance uuid 819ca3c0-6671-4a46-9032-97790d1d2229 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:06:37.020029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-29b1a6af-8cf1-4f01-a129-e7f44fc682a2 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9e2ecd3e1e4253ab07f121cddc2639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd078aeb8b27746c99871df3d294dc514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:37.028324 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-29b1a6af-8cf1-4f01-a129-e7f44fc682a2 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] 10.222.0.30 "GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229" status: 200 len: 1312 microversion: 2.1 time: 0.097411 Oct 04 22:06:37.029086 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3501/6982] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:36 2022] GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:38.055292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e81d7136-1be4-49f3-9650-7bf5de9c0955 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:38.056001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e81d7136-1be4-49f3-9650-7bf5de9c0955 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] [instance: 819ca3c0-6671-4a46-9032-97790d1d2229] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:38.062295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e81d7136-1be4-49f3-9650-7bf5de9c0955 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:38.062790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e81d7136-1be4-49f3-9650-7bf5de9c0955 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:38.063264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e81d7136-1be4-49f3-9650-7bf5de9c0955 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:38.063972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e81d7136-1be4-49f3-9650-7bf5de9c0955 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:38.064440 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e81d7136-1be4-49f3-9650-7bf5de9c0955 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:38.064878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e81d7136-1be4-49f3-9650-7bf5de9c0955 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:38.078499 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-e81d7136-1be4-49f3-9650-7bf5de9c0955 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] HTTP exception thrown: Instance 819ca3c0-6671-4a46-9032-97790d1d2229 could not be found. Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e81d7136-1be4-49f3-9650-7bf5de9c0955 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Request method failure captured: Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229 HTTP/1.1 Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPK5alfGJfbyezbyCpyTTLSeXSJ3ujo8pmtCSLczMpuHXCsyyXLjR9EsZAo7DPYQWT9jYJt-uvuXOh9Mlz33NQkaWtbasfFPZ55F4GQYB1rBvVYWPKHiLGbptY7NCNhvHUvnbghj4MFjY3THX6cR2SbmplAm14D6d1az6AVMS5XynRmA Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: d078aeb8b27746c99871df3d294dc514 Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-637981321 Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d078aeb8b27746c99871df3d294dc514"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d078aeb8b27746c99871df3d294dc514"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d078aeb8b27746c99871df3d294dc514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d078aeb8b27746c99871df3d294dc514"}]}] Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersAdminNegativeTestJSON-637981321 Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: d078aeb8b27746c99871df3d294dc514 Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-637981321 Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersAdminNegativeTestJSON-637981321-project Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: ae9e2ecd3e1e4253ab07f121cddc2639 Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersAdminNegativeTestJSON-637981321-project Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 819ca3c0-6671-4a46-9032-97790d1d2229 could not be found. Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '819ca3c0-6671-4a46-9032-97790d1d2229'} Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 819ca3c0-6671-4a46-9032-97790d1d2229 could not be found. Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 819ca3c0-6671-4a46-9032-97790d1d2229 could not be found. Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:06:38.080133 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:38.084829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:06:38.084829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:38.084829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:38.084829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:38.084829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:38.084829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:38.084829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 819ca3c0-6671-4a46-9032-97790d1d2229 could not be found. Oct 04 22:06:38.084829 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:06:38.084829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e81d7136-1be4-49f3-9650-7bf5de9c0955 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] Returning 404 to user: Instance 819ca3c0-6671-4a46-9032-97790d1d2229 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:38.084829 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e81d7136-1be4-49f3-9650-7bf5de9c0955 tempest-ServersAdminNegativeTestJSON-637981321 tempest-ServersAdminNegativeTestJSON-637981321-project] 10.222.0.30 "GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229" status: 404 len: 111 microversion: 2.1 time: 0.032568 Oct 04 22:06:38.084829 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3482/6983] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:38 2022] GET /compute/v2.1/servers/819ca3c0-6671-4a46-9032-97790d1d2229 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:46.626178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:46.626995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:46.758351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3eb682a7-002c-4463-a520-3d188f13e194 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1466933856", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "fb98c7d0-3bcd-4345-aa24-62f16d9b8b31"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:46.813967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-3eb682a7-002c-4463-a520-3d188f13e194 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] validate_networks() for [('fb98c7d0-3bcd-4345-aa24-62f16d9b8b31', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:06:47.025381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:47.288261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-3eb682a7-002c-4463-a520-3d188f13e194 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:06:47.288718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-3eb682a7-002c-4463-a520-3d188f13e194 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:06:47.289522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-3eb682a7-002c-4463-a520-3d188f13e194 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:06:47.289953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-3eb682a7-002c-4463-a520-3d188f13e194 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:06:47.290887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-3eb682a7-002c-4463-a520-3d188f13e194 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:06:47.305153 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3eb682a7-002c-4463-a520-3d188f13e194 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:47.305703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3eb682a7-002c-4463-a520-3d188f13e194 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:47.306174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3eb682a7-002c-4463-a520-3d188f13e194 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:47.306930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3eb682a7-002c-4463-a520-3d188f13e194 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:47.307419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3eb682a7-002c-4463-a520-3d188f13e194 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:47.307869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3eb682a7-002c-4463-a520-3d188f13e194 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:47.325591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-3eb682a7-002c-4463-a520-3d188f13e194 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Getting quotas for project 057fcc596eef488fa1d5b6fefee67d0a. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:06:47.330965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-3eb682a7-002c-4463-a520-3d188f13e194 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Getting quotas for user 030237c8954a4bf3a8a7aa9e93749b00 and project 057fcc596eef488fa1d5b6fefee67d0a. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:06:47.344574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3eb682a7-002c-4463-a520-3d188f13e194 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:06:47.347243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3eb682a7-002c-4463-a520-3d188f13e194 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:06:47.489282 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3eb682a7-002c-4463-a520-3d188f13e194 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.868023 Oct 04 22:06:47.489873 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3502/6984] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:06:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:06:47.501833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f9b7bf37-05fd-4edf-a75a-f69f11dc01d6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:47.502447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f9b7bf37-05fd-4edf-a75a-f69f11dc01d6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:47.504621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:47.505298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:47.580886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f9b7bf37-05fd-4edf-a75a-f69f11dc01d6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:47.589261 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f9b7bf37-05fd-4edf-a75a-f69f11dc01d6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1215 microversion: 2.1 time: 0.091697 Oct 04 22:06:47.590888 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3483/6985] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:47 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:06:48.613617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-61d95b17-e72b-4b71-bd03-27907aeebaf2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:48.614261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-61d95b17-e72b-4b71-bd03-27907aeebaf2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:48.669089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-61d95b17-e72b-4b71-bd03-27907aeebaf2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:48.676504 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-61d95b17-e72b-4b71-bd03-27907aeebaf2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1215 microversion: 2.1 time: 0.068294 Oct 04 22:06:48.677097 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3503/6986] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:48 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:49.701128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6836311e-4d96-47b3-a300-54faa5283af6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:49.701785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6836311e-4d96-47b3-a300-54faa5283af6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:49.703637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=57 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:49.710957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6836311e-4d96-47b3-a300-54faa5283af6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:49.711452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6836311e-4d96-47b3-a300-54faa5283af6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:49.711895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6836311e-4d96-47b3-a300-54faa5283af6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:49.712596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6836311e-4d96-47b3-a300-54faa5283af6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:49.713061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6836311e-4d96-47b3-a300-54faa5283af6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:49.713511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6836311e-4d96-47b3-a300-54faa5283af6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:49.783385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6836311e-4d96-47b3-a300-54faa5283af6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:49.791683 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6836311e-4d96-47b3-a300-54faa5283af6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1267 microversion: 2.1 time: 0.094402 Oct 04 22:06:49.792278 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3484/6987] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:49 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1267 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:50.815844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1eed140b-b853-4a38-a5ae-4057d362cdb2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:50.817068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1eed140b-b853-4a38-a5ae-4057d362cdb2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:50.824253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1eed140b-b853-4a38-a5ae-4057d362cdb2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:50.824765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1eed140b-b853-4a38-a5ae-4057d362cdb2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:50.825220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1eed140b-b853-4a38-a5ae-4057d362cdb2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:50.825970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1eed140b-b853-4a38-a5ae-4057d362cdb2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:50.826448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1eed140b-b853-4a38-a5ae-4057d362cdb2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:50.827073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1eed140b-b853-4a38-a5ae-4057d362cdb2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:50.968068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1eed140b-b853-4a38-a5ae-4057d362cdb2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:50.976516 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1eed140b-b853-4a38-a5ae-4057d362cdb2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1315 microversion: 2.1 time: 0.164622 Oct 04 22:06:50.977111 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3504/6988] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:50 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:51.629027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-cb3ea436-5be6-4622-8a00-47a9373c6941 req-6c334625-a53c-45c4-a16b-5f41b916f874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa01c537-1b74-4a63-abea-366354d3b9b0", "tag": "a398734f-c887-45f0-95d8-1da8a85e1f14"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:51.635537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:51.640837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-cb3ea436-5be6-4622-8a00-47a9373c6941 req-6c334625-a53c-45c4-a16b-5f41b916f874 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:51.641315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-cb3ea436-5be6-4622-8a00-47a9373c6941 req-6c334625-a53c-45c4-a16b-5f41b916f874 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:51.641778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-cb3ea436-5be6-4622-8a00-47a9373c6941 req-6c334625-a53c-45c4-a16b-5f41b916f874 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:51.653123 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-cb3ea436-5be6-4622-8a00-47a9373c6941 req-6c334625-a53c-45c4-a16b-5f41b916f874 service nova] Creating event network-changed:a398734f-c887-45f0-95d8-1da8a85e1f14 for instance aa01c537-1b74-4a63-abea-366354d3b9b0 on n-h1-860282-1 Oct 04 22:06:51.658316 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-cb3ea436-5be6-4622-8a00-47a9373c6941 req-6c334625-a53c-45c4-a16b-5f41b916f874 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033130 Oct 04 22:06:51.659737 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3485/6989] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:52.003491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1317e8a2-deed-429a-a189-72b96ef71318 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:52.003491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1317e8a2-deed-429a-a189-72b96ef71318 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:52.009316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1317e8a2-deed-429a-a189-72b96ef71318 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:52.009831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1317e8a2-deed-429a-a189-72b96ef71318 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:52.010392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1317e8a2-deed-429a-a189-72b96ef71318 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:52.011219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1317e8a2-deed-429a-a189-72b96ef71318 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:52.011820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1317e8a2-deed-429a-a189-72b96ef71318 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:52.012372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1317e8a2-deed-429a-a189-72b96ef71318 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:52.149885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1317e8a2-deed-429a-a189-72b96ef71318 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:52.158219 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1317e8a2-deed-429a-a189-72b96ef71318 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1315 microversion: 2.1 time: 0.161655 Oct 04 22:06:52.159349 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3505/6990] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:51 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:53.183004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-90285660-38f9-4408-94e3-0857c81b89c2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:53.183716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-90285660-38f9-4408-94e3-0857c81b89c2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:53.190256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90285660-38f9-4408-94e3-0857c81b89c2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:53.190740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90285660-38f9-4408-94e3-0857c81b89c2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:53.191898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90285660-38f9-4408-94e3-0857c81b89c2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:53.192621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90285660-38f9-4408-94e3-0857c81b89c2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:53.193073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90285660-38f9-4408-94e3-0857c81b89c2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:53.194913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90285660-38f9-4408-94e3-0857c81b89c2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:53.329812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-90285660-38f9-4408-94e3-0857c81b89c2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:53.337925 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-90285660-38f9-4408-94e3-0857c81b89c2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1315 microversion: 2.1 time: 0.159955 Oct 04 22:06:53.338499 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3486/6991] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:53 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:54.361116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eb521b1d-55d9-45d7-8d62-def03218d9f2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:54.361806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eb521b1d-55d9-45d7-8d62-def03218d9f2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:54.369401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb521b1d-55d9-45d7-8d62-def03218d9f2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:54.369927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb521b1d-55d9-45d7-8d62-def03218d9f2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:54.370389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb521b1d-55d9-45d7-8d62-def03218d9f2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:54.371089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb521b1d-55d9-45d7-8d62-def03218d9f2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:54.371563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb521b1d-55d9-45d7-8d62-def03218d9f2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:54.372005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb521b1d-55d9-45d7-8d62-def03218d9f2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:54.502198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eb521b1d-55d9-45d7-8d62-def03218d9f2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:54.510721 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eb521b1d-55d9-45d7-8d62-def03218d9f2 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1315 microversion: 2.1 time: 0.153586 Oct 04 22:06:54.511308 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3506/6992] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:54 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:55.534721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bd2b8f87-4c1b-4526-8e83-1200cfd0d80a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:55.535337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bd2b8f87-4c1b-4526-8e83-1200cfd0d80a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:55.542521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd2b8f87-4c1b-4526-8e83-1200cfd0d80a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:55.543005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd2b8f87-4c1b-4526-8e83-1200cfd0d80a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:55.543467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd2b8f87-4c1b-4526-8e83-1200cfd0d80a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:55.544159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd2b8f87-4c1b-4526-8e83-1200cfd0d80a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:55.544614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd2b8f87-4c1b-4526-8e83-1200cfd0d80a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:55.545036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd2b8f87-4c1b-4526-8e83-1200cfd0d80a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:55.678741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bd2b8f87-4c1b-4526-8e83-1200cfd0d80a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:55.687139 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bd2b8f87-4c1b-4526-8e83-1200cfd0d80a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1315 microversion: 2.1 time: 0.156474 Oct 04 22:06:55.687707 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3487/6993] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:55 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:56.629861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-cf8aa56f-b813-4765-a3e5-10651b2f03f2 req-a6097be0-160e-4b10-ac5c-c6bd88797171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa01c537-1b74-4a63-abea-366354d3b9b0", "name": "network-vif-plugged", "status": "completed", "tag": "a398734f-c887-45f0-95d8-1da8a85e1f14"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:56.636417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:56.641516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cf8aa56f-b813-4765-a3e5-10651b2f03f2 req-a6097be0-160e-4b10-ac5c-c6bd88797171 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:56.645576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cf8aa56f-b813-4765-a3e5-10651b2f03f2 req-a6097be0-160e-4b10-ac5c-c6bd88797171 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:56.645576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cf8aa56f-b813-4765-a3e5-10651b2f03f2 req-a6097be0-160e-4b10-ac5c-c6bd88797171 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:56.654295 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-cf8aa56f-b813-4765-a3e5-10651b2f03f2 req-a6097be0-160e-4b10-ac5c-c6bd88797171 service nova] Creating event network-vif-plugged:a398734f-c887-45f0-95d8-1da8a85e1f14 for instance aa01c537-1b74-4a63-abea-366354d3b9b0 on n-h1-860282-1 Oct 04 22:06:56.659365 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-cf8aa56f-b813-4765-a3e5-10651b2f03f2 req-a6097be0-160e-4b10-ac5c-c6bd88797171 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033199 Oct 04 22:06:56.660032 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3507/6994] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:56.711231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a913551f-6e15-4f8b-b6da-b17dfc37d5ac tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:56.711963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a913551f-6e15-4f8b-b6da-b17dfc37d5ac tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:56.719540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a913551f-6e15-4f8b-b6da-b17dfc37d5ac tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:56.720034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a913551f-6e15-4f8b-b6da-b17dfc37d5ac tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:56.720626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a913551f-6e15-4f8b-b6da-b17dfc37d5ac tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:56.721336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a913551f-6e15-4f8b-b6da-b17dfc37d5ac tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:56.721816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a913551f-6e15-4f8b-b6da-b17dfc37d5ac tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:56.722244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a913551f-6e15-4f8b-b6da-b17dfc37d5ac tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:56.859599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a913551f-6e15-4f8b-b6da-b17dfc37d5ac tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:56.867384 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a913551f-6e15-4f8b-b6da-b17dfc37d5ac tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1315 microversion: 2.1 time: 0.161687 Oct 04 22:06:56.867960 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3488/6995] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:56 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:57.891948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2166c845-6e8f-4a20-9251-54d6040db971 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:57.892687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2166c845-6e8f-4a20-9251-54d6040db971 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:57.894988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:57.901883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2166c845-6e8f-4a20-9251-54d6040db971 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:57.902401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2166c845-6e8f-4a20-9251-54d6040db971 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:57.905031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2166c845-6e8f-4a20-9251-54d6040db971 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:57.905031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2166c845-6e8f-4a20-9251-54d6040db971 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:57.905031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2166c845-6e8f-4a20-9251-54d6040db971 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:57.905031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2166c845-6e8f-4a20-9251-54d6040db971 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:58.039874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2166c845-6e8f-4a20-9251-54d6040db971 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:58.047728 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2166c845-6e8f-4a20-9251-54d6040db971 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1315 microversion: 2.1 time: 0.160562 Oct 04 22:06:58.053583 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3508/6996] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:57 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:59.071316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-67d25461-1149-4112-a0f0-af63f686ea66 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:59.072574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-67d25461-1149-4112-a0f0-af63f686ea66 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:59.074848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:59.081639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d25461-1149-4112-a0f0-af63f686ea66 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:59.082135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d25461-1149-4112-a0f0-af63f686ea66 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:59.090012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d25461-1149-4112-a0f0-af63f686ea66 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:59.090012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d25461-1149-4112-a0f0-af63f686ea66 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:59.090012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d25461-1149-4112-a0f0-af63f686ea66 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:59.090012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-67d25461-1149-4112-a0f0-af63f686ea66 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:59.231458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67d25461-1149-4112-a0f0-af63f686ea66 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:59.239511 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-67d25461-1149-4112-a0f0-af63f686ea66 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1502 microversion: 2.1 time: 0.172107 Oct 04 22:06:59.240746 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3489/6997] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:59 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:06:59.266838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-57ed53af-6329-4754-8d82-8d23fe888e55 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:59.269686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-57ed53af-6329-4754-8d82-8d23fe888e55 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:59.272010 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:59.278389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57ed53af-6329-4754-8d82-8d23fe888e55 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:59.278902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57ed53af-6329-4754-8d82-8d23fe888e55 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:59.279356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57ed53af-6329-4754-8d82-8d23fe888e55 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:59.280157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57ed53af-6329-4754-8d82-8d23fe888e55 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:59.280953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57ed53af-6329-4754-8d82-8d23fe888e55 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:59.281464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57ed53af-6329-4754-8d82-8d23fe888e55 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:59.314956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-57ed53af-6329-4754-8d82-8d23fe888e55 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:59.321780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-57ed53af-6329-4754-8d82-8d23fe888e55 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Old instance type m1.heat2, new instance type m1.heat {{(pid=122757) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:06:59.328454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-57ed53af-6329-4754-8d82-8d23fe888e55 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:06:59.328896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-57ed53af-6329-4754-8d82-8d23fe888e55 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:06:59.329390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-57ed53af-6329-4754-8d82-8d23fe888e55 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:06:59.329846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-57ed53af-6329-4754-8d82-8d23fe888e55 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:06:59.330275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-57ed53af-6329-4754-8d82-8d23fe888e55 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:06:59.553389 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-57ed53af-6329-4754-8d82-8d23fe888e55 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "POST /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0/action" status: 202 len: 0 microversion: 2.1 time: 0.290536 Oct 04 22:06:59.554088 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3509/6998] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:06:59 2022] POST /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:06:59.562672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e5fddfbd-45bb-4e47-a611-94fa0fafcdf5 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:59.563579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e5fddfbd-45bb-4e47-a611-94fa0fafcdf5 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:59.571256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5fddfbd-45bb-4e47-a611-94fa0fafcdf5 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:59.571756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5fddfbd-45bb-4e47-a611-94fa0fafcdf5 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:59.572351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5fddfbd-45bb-4e47-a611-94fa0fafcdf5 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:59.572899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5fddfbd-45bb-4e47-a611-94fa0fafcdf5 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:59.573546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5fddfbd-45bb-4e47-a611-94fa0fafcdf5 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:59.574046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5fddfbd-45bb-4e47-a611-94fa0fafcdf5 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:59.706990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e5fddfbd-45bb-4e47-a611-94fa0fafcdf5 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:59.715229 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e5fddfbd-45bb-4e47-a611-94fa0fafcdf5 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1511 microversion: 2.1 time: 0.156809 Oct 04 22:06:59.715958 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3490/6999] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:59 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:00.740792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c3fb9243-a2ee-4188-adfc-10d6c7c83a04 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:00.741428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c3fb9243-a2ee-4188-adfc-10d6c7c83a04 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:00.748054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3fb9243-a2ee-4188-adfc-10d6c7c83a04 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:00.748560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3fb9243-a2ee-4188-adfc-10d6c7c83a04 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:00.749014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3fb9243-a2ee-4188-adfc-10d6c7c83a04 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:00.749763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3fb9243-a2ee-4188-adfc-10d6c7c83a04 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:00.750238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3fb9243-a2ee-4188-adfc-10d6c7c83a04 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:00.750676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3fb9243-a2ee-4188-adfc-10d6c7c83a04 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:00.886971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c3fb9243-a2ee-4188-adfc-10d6c7c83a04 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:00.895324 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c3fb9243-a2ee-4188-adfc-10d6c7c83a04 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1511 microversion: 2.1 time: 0.159556 Oct 04 22:07:00.896423 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3510/7000] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:00 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:01.918693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cd69bee6-6a4a-464c-8c49-fdba8ecc964c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:01.919887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cd69bee6-6a4a-464c-8c49-fdba8ecc964c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:01.928332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd69bee6-6a4a-464c-8c49-fdba8ecc964c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:01.928900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd69bee6-6a4a-464c-8c49-fdba8ecc964c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:01.929350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd69bee6-6a4a-464c-8c49-fdba8ecc964c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:01.930082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd69bee6-6a4a-464c-8c49-fdba8ecc964c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:01.930548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd69bee6-6a4a-464c-8c49-fdba8ecc964c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:01.930987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd69bee6-6a4a-464c-8c49-fdba8ecc964c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:02.066331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cd69bee6-6a4a-464c-8c49-fdba8ecc964c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:02.074840 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cd69bee6-6a4a-464c-8c49-fdba8ecc964c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1511 microversion: 2.1 time: 0.160067 Oct 04 22:07:02.075418 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3491/7001] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:01 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:03.099786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7a4600d9-83b4-4be8-9abc-a3a7e52e806f tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:03.100487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7a4600d9-83b4-4be8-9abc-a3a7e52e806f tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:03.107444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7a4600d9-83b4-4be8-9abc-a3a7e52e806f tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:03.107942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7a4600d9-83b4-4be8-9abc-a3a7e52e806f tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:03.108396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7a4600d9-83b4-4be8-9abc-a3a7e52e806f tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:03.109104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7a4600d9-83b4-4be8-9abc-a3a7e52e806f tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:03.109610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7a4600d9-83b4-4be8-9abc-a3a7e52e806f tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:03.110052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7a4600d9-83b4-4be8-9abc-a3a7e52e806f tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:03.244252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7a4600d9-83b4-4be8-9abc-a3a7e52e806f tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:03.252132 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7a4600d9-83b4-4be8-9abc-a3a7e52e806f tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1516 microversion: 2.1 time: 0.156835 Oct 04 22:07:03.252651 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3511/7002] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:03 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:04.277362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e3f6b8cf-a569-4ec0-bc1b-76af8dc53eae tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:04.277934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e3f6b8cf-a569-4ec0-bc1b-76af8dc53eae tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:04.284855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3f6b8cf-a569-4ec0-bc1b-76af8dc53eae tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:04.285341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3f6b8cf-a569-4ec0-bc1b-76af8dc53eae tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:04.285801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3f6b8cf-a569-4ec0-bc1b-76af8dc53eae tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:04.286491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3f6b8cf-a569-4ec0-bc1b-76af8dc53eae tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:04.286942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3f6b8cf-a569-4ec0-bc1b-76af8dc53eae tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:04.287366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3f6b8cf-a569-4ec0-bc1b-76af8dc53eae tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:04.420758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e3f6b8cf-a569-4ec0-bc1b-76af8dc53eae tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:04.429030 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e3f6b8cf-a569-4ec0-bc1b-76af8dc53eae tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1516 microversion: 2.1 time: 0.155018 Oct 04 22:07:04.429760 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3492/7003] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:04 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:05.452326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d45da86d-90ba-4174-a189-bd00d40451df tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:05.453013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d45da86d-90ba-4174-a189-bd00d40451df tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:05.460549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d45da86d-90ba-4174-a189-bd00d40451df tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:05.461047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d45da86d-90ba-4174-a189-bd00d40451df tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:05.461539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d45da86d-90ba-4174-a189-bd00d40451df tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:05.462257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d45da86d-90ba-4174-a189-bd00d40451df tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:05.462737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d45da86d-90ba-4174-a189-bd00d40451df tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:05.463183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d45da86d-90ba-4174-a189-bd00d40451df tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:05.597454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d45da86d-90ba-4174-a189-bd00d40451df tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:05.605897 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d45da86d-90ba-4174-a189-bd00d40451df tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1516 microversion: 2.1 time: 0.157557 Oct 04 22:07:05.606479 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3512/7004] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:05 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:06.629550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-398a8649-c9e8-4d81-956d-8be5b31ede51 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:06.630161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-398a8649-c9e8-4d81-956d-8be5b31ede51 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:06.637690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-398a8649-c9e8-4d81-956d-8be5b31ede51 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:06.638177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-398a8649-c9e8-4d81-956d-8be5b31ede51 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:06.638612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-398a8649-c9e8-4d81-956d-8be5b31ede51 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:06.639299 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-398a8649-c9e8-4d81-956d-8be5b31ede51 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:06.639748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-398a8649-c9e8-4d81-956d-8be5b31ede51 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:06.640173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-398a8649-c9e8-4d81-956d-8be5b31ede51 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:06.769883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-398a8649-c9e8-4d81-956d-8be5b31ede51 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:06.778305 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-398a8649-c9e8-4d81-956d-8be5b31ede51 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1516 microversion: 2.1 time: 0.152864 Oct 04 22:07:06.778873 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3493/7005] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:06 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:07.802240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d2628210-e148-4ad3-b418-45a0ec471457 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:07.802834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d2628210-e148-4ad3-b418-45a0ec471457 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:07.810350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2628210-e148-4ad3-b418-45a0ec471457 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:07.810862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2628210-e148-4ad3-b418-45a0ec471457 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:07.811323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2628210-e148-4ad3-b418-45a0ec471457 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:07.812038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2628210-e148-4ad3-b418-45a0ec471457 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:07.812520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2628210-e148-4ad3-b418-45a0ec471457 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:07.812971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d2628210-e148-4ad3-b418-45a0ec471457 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:07.942844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d2628210-e148-4ad3-b418-45a0ec471457 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:07.953610 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d2628210-e148-4ad3-b418-45a0ec471457 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1516 microversion: 2.1 time: 0.155380 Oct 04 22:07:07.954197 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3513/7006] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:07 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:08.976225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-84e11b90-2b2e-48b8-a52e-edcdcfdfc2a3 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:08.976856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-84e11b90-2b2e-48b8-a52e-edcdcfdfc2a3 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:08.983643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84e11b90-2b2e-48b8-a52e-edcdcfdfc2a3 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:08.984140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84e11b90-2b2e-48b8-a52e-edcdcfdfc2a3 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:08.984577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84e11b90-2b2e-48b8-a52e-edcdcfdfc2a3 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:08.985300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84e11b90-2b2e-48b8-a52e-edcdcfdfc2a3 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:08.985779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84e11b90-2b2e-48b8-a52e-edcdcfdfc2a3 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:08.986211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84e11b90-2b2e-48b8-a52e-edcdcfdfc2a3 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:09.128094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-84e11b90-2b2e-48b8-a52e-edcdcfdfc2a3 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:09.136561 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-84e11b90-2b2e-48b8-a52e-edcdcfdfc2a3 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1516 microversion: 2.1 time: 0.164357 Oct 04 22:07:09.137164 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3494/7007] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:08 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:10.160237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c92ebf54-5400-4dc5-8b75-d6a0e494db39 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:10.160786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c92ebf54-5400-4dc5-8b75-d6a0e494db39 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:10.168740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c92ebf54-5400-4dc5-8b75-d6a0e494db39 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:10.169240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c92ebf54-5400-4dc5-8b75-d6a0e494db39 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:10.169737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c92ebf54-5400-4dc5-8b75-d6a0e494db39 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:10.176068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c92ebf54-5400-4dc5-8b75-d6a0e494db39 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:10.176068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c92ebf54-5400-4dc5-8b75-d6a0e494db39 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:10.176068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c92ebf54-5400-4dc5-8b75-d6a0e494db39 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:10.301569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c92ebf54-5400-4dc5-8b75-d6a0e494db39 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:10.309888 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c92ebf54-5400-4dc5-8b75-d6a0e494db39 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1516 microversion: 2.1 time: 0.153726 Oct 04 22:07:10.310469 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3514/7008] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:10 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:11.332234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6076f8c5-1dd2-4b83-ab18-0e5e6e1f268a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:11.332882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6076f8c5-1dd2-4b83-ab18-0e5e6e1f268a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:11.340848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6076f8c5-1dd2-4b83-ab18-0e5e6e1f268a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:11.341331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6076f8c5-1dd2-4b83-ab18-0e5e6e1f268a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:11.342199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6076f8c5-1dd2-4b83-ab18-0e5e6e1f268a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:11.342895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6076f8c5-1dd2-4b83-ab18-0e5e6e1f268a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:11.343350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6076f8c5-1dd2-4b83-ab18-0e5e6e1f268a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:11.344177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6076f8c5-1dd2-4b83-ab18-0e5e6e1f268a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:11.478029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6076f8c5-1dd2-4b83-ab18-0e5e6e1f268a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:11.485960 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6076f8c5-1dd2-4b83-ab18-0e5e6e1f268a tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1516 microversion: 2.1 time: 0.157617 Oct 04 22:07:11.486541 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3495/7009] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:11 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:12.510723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5c8d9003-0302-43c9-9d97-70e3a1f12402 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:12.511362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5c8d9003-0302-43c9-9d97-70e3a1f12402 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:12.518282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c8d9003-0302-43c9-9d97-70e3a1f12402 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:12.518789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c8d9003-0302-43c9-9d97-70e3a1f12402 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:12.519532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c8d9003-0302-43c9-9d97-70e3a1f12402 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:12.520304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c8d9003-0302-43c9-9d97-70e3a1f12402 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:12.520784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c8d9003-0302-43c9-9d97-70e3a1f12402 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:12.521235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5c8d9003-0302-43c9-9d97-70e3a1f12402 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:12.655612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5c8d9003-0302-43c9-9d97-70e3a1f12402 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:12.663392 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5c8d9003-0302-43c9-9d97-70e3a1f12402 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1516 microversion: 2.1 time: 0.157277 Oct 04 22:07:12.663984 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3515/7010] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:12 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:13.685327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b9f9f934-edb9-4a87-b291-c4b5a1389330 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:13.685895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b9f9f934-edb9-4a87-b291-c4b5a1389330 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:13.692580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9f9f934-edb9-4a87-b291-c4b5a1389330 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:13.693065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9f9f934-edb9-4a87-b291-c4b5a1389330 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:13.693529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9f9f934-edb9-4a87-b291-c4b5a1389330 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:13.694215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9f9f934-edb9-4a87-b291-c4b5a1389330 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:13.694667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9f9f934-edb9-4a87-b291-c4b5a1389330 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:13.695094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9f9f934-edb9-4a87-b291-c4b5a1389330 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:13.826674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b9f9f934-edb9-4a87-b291-c4b5a1389330 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:13.834266 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b9f9f934-edb9-4a87-b291-c4b5a1389330 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1516 microversion: 2.1 time: 0.152955 Oct 04 22:07:13.834835 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3496/7011] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:13 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:14.858875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8d148d51-7b65-41be-8463-631e4e5c02af tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:14.859437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8d148d51-7b65-41be-8463-631e4e5c02af tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:14.865590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d148d51-7b65-41be-8463-631e4e5c02af tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:14.866104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d148d51-7b65-41be-8463-631e4e5c02af tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:14.866563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d148d51-7b65-41be-8463-631e4e5c02af tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:14.867274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d148d51-7b65-41be-8463-631e4e5c02af tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:14.868355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d148d51-7b65-41be-8463-631e4e5c02af tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:14.868808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8d148d51-7b65-41be-8463-631e4e5c02af tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:14.996951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8d148d51-7b65-41be-8463-631e4e5c02af tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:15.004957 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8d148d51-7b65-41be-8463-631e4e5c02af tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1516 microversion: 2.1 time: 0.150278 Oct 04 22:07:15.005551 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3516/7012] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:14 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:16.030793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-98374f59-7bd3-4f70-a3e7-ae36ca1a7773 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:16.031411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-98374f59-7bd3-4f70-a3e7-ae36ca1a7773 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:16.037563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98374f59-7bd3-4f70-a3e7-ae36ca1a7773 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:16.038051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98374f59-7bd3-4f70-a3e7-ae36ca1a7773 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:16.038514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98374f59-7bd3-4f70-a3e7-ae36ca1a7773 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:16.039713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98374f59-7bd3-4f70-a3e7-ae36ca1a7773 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:16.040171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98374f59-7bd3-4f70-a3e7-ae36ca1a7773 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:16.040596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98374f59-7bd3-4f70-a3e7-ae36ca1a7773 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:16.167755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-98374f59-7bd3-4f70-a3e7-ae36ca1a7773 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:16.175412 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-98374f59-7bd3-4f70-a3e7-ae36ca1a7773 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1516 microversion: 2.1 time: 0.148877 Oct 04 22:07:16.175984 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3497/7013] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:16 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:17.199570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-be4010be-02cc-4244-927e-5dde5a8e14f4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:17.200234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-be4010be-02cc-4244-927e-5dde5a8e14f4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:17.207104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be4010be-02cc-4244-927e-5dde5a8e14f4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:17.207608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be4010be-02cc-4244-927e-5dde5a8e14f4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:17.208069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be4010be-02cc-4244-927e-5dde5a8e14f4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:17.208781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be4010be-02cc-4244-927e-5dde5a8e14f4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:17.209259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be4010be-02cc-4244-927e-5dde5a8e14f4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:17.209731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be4010be-02cc-4244-927e-5dde5a8e14f4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:17.212639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:17.347493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-be4010be-02cc-4244-927e-5dde5a8e14f4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:17.355609 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-be4010be-02cc-4244-927e-5dde5a8e14f4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1516 microversion: 2.1 time: 0.160719 Oct 04 22:07:17.356627 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3517/7014] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:17 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:18.379138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-503a9e9f-9412-465f-a958-776975ba53ca tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:18.379757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-503a9e9f-9412-465f-a958-776975ba53ca tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:18.387121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-503a9e9f-9412-465f-a958-776975ba53ca tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:18.387608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-503a9e9f-9412-465f-a958-776975ba53ca tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:18.388045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-503a9e9f-9412-465f-a958-776975ba53ca tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:18.388734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-503a9e9f-9412-465f-a958-776975ba53ca tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:18.389191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-503a9e9f-9412-465f-a958-776975ba53ca tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:18.389652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-503a9e9f-9412-465f-a958-776975ba53ca tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:18.519914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-503a9e9f-9412-465f-a958-776975ba53ca tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:18.528749 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-503a9e9f-9412-465f-a958-776975ba53ca tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1516 microversion: 2.1 time: 0.153471 Oct 04 22:07:18.529718 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3498/7015] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:18 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:07:19.552625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1afbb53d-5a3c-4454-8dd0-69a2fef9b937 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:19.553172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1afbb53d-5a3c-4454-8dd0-69a2fef9b937 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:19.560065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1afbb53d-5a3c-4454-8dd0-69a2fef9b937 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:19.560566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1afbb53d-5a3c-4454-8dd0-69a2fef9b937 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:19.561018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1afbb53d-5a3c-4454-8dd0-69a2fef9b937 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:19.561757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1afbb53d-5a3c-4454-8dd0-69a2fef9b937 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:19.562232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1afbb53d-5a3c-4454-8dd0-69a2fef9b937 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:19.562678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1afbb53d-5a3c-4454-8dd0-69a2fef9b937 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:19.698938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1afbb53d-5a3c-4454-8dd0-69a2fef9b937 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:19.706917 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1afbb53d-5a3c-4454-8dd0-69a2fef9b937 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1516 microversion: 2.1 time: 0.158276 Oct 04 22:07:19.707502 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3518/7016] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:19 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:20.731915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9ff03b35-0d65-4925-adf9-17d29e1f846e tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:20.732571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9ff03b35-0d65-4925-adf9-17d29e1f846e tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:20.740011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ff03b35-0d65-4925-adf9-17d29e1f846e tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:20.740992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ff03b35-0d65-4925-adf9-17d29e1f846e tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:20.741108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ff03b35-0d65-4925-adf9-17d29e1f846e tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:20.741857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ff03b35-0d65-4925-adf9-17d29e1f846e tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:20.742332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ff03b35-0d65-4925-adf9-17d29e1f846e tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:20.742766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9ff03b35-0d65-4925-adf9-17d29e1f846e tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:20.993163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9ff03b35-0d65-4925-adf9-17d29e1f846e tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:21.001102 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9ff03b35-0d65-4925-adf9-17d29e1f846e tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1515 microversion: 2.1 time: 0.273895 Oct 04 22:07:21.004524 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3499/7017] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:20 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1515 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:21.100221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-3a57c6f7-1287-466c-aa03-fd53cc63a13a req-5762943e-e828-4e98-b57f-2bbde3bd2da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa01c537-1b74-4a63-abea-366354d3b9b0", "name": "network-vif-unplugged", "status": "completed", "tag": "a398734f-c887-45f0-95d8-1da8a85e1f14"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:21.111312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3a57c6f7-1287-466c-aa03-fd53cc63a13a req-5762943e-e828-4e98-b57f-2bbde3bd2da4 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:21.111816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3a57c6f7-1287-466c-aa03-fd53cc63a13a req-5762943e-e828-4e98-b57f-2bbde3bd2da4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:21.112297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3a57c6f7-1287-466c-aa03-fd53cc63a13a req-5762943e-e828-4e98-b57f-2bbde3bd2da4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:21.123957 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-3a57c6f7-1287-466c-aa03-fd53cc63a13a req-5762943e-e828-4e98-b57f-2bbde3bd2da4 service nova] Creating event network-vif-unplugged:a398734f-c887-45f0-95d8-1da8a85e1f14 for instance aa01c537-1b74-4a63-abea-366354d3b9b0 on n-h2-860282-1 Oct 04 22:07:21.129256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [req-3a57c6f7-1287-466c-aa03-fd53cc63a13a req-5762943e-e828-4e98-b57f-2bbde3bd2da4 service nova] Instance aa01c537-1b74-4a63-abea-366354d3b9b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122757) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:07:21.140080 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-3a57c6f7-1287-466c-aa03-fd53cc63a13a req-5762943e-e828-4e98-b57f-2bbde3bd2da4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043607 Oct 04 22:07:21.140694 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3519/7018] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:07:22.024897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-95f12f9f-8bc3-45ea-a528-b691d76141de tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:22.025542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-95f12f9f-8bc3-45ea-a528-b691d76141de tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:22.032359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95f12f9f-8bc3-45ea-a528-b691d76141de tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:22.032849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95f12f9f-8bc3-45ea-a528-b691d76141de tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:22.033294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95f12f9f-8bc3-45ea-a528-b691d76141de tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:22.034022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95f12f9f-8bc3-45ea-a528-b691d76141de tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:22.034484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95f12f9f-8bc3-45ea-a528-b691d76141de tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:22.034912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95f12f9f-8bc3-45ea-a528-b691d76141de tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:22.037505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=93 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:22.188259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-95f12f9f-8bc3-45ea-a528-b691d76141de tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:22.196487 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-95f12f9f-8bc3-45ea-a528-b691d76141de tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1515 microversion: 2.1 time: 0.175483 Oct 04 22:07:22.197223 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3500/7019] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:22 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:23.157305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-6b51fd58-4b5c-4a1d-8a79-6b0c75fc6818 req-4d587787-3c3f-4425-9ad8-1319f0bde8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa01c537-1b74-4a63-abea-366354d3b9b0", "tag": "a398734f-c887-45f0-95d8-1da8a85e1f14"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:23.168365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6b51fd58-4b5c-4a1d-8a79-6b0c75fc6818 req-4d587787-3c3f-4425-9ad8-1319f0bde8b6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:23.168856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6b51fd58-4b5c-4a1d-8a79-6b0c75fc6818 req-4d587787-3c3f-4425-9ad8-1319f0bde8b6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:23.169300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6b51fd58-4b5c-4a1d-8a79-6b0c75fc6818 req-4d587787-3c3f-4425-9ad8-1319f0bde8b6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:23.180053 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-6b51fd58-4b5c-4a1d-8a79-6b0c75fc6818 req-4d587787-3c3f-4425-9ad8-1319f0bde8b6 service nova] Creating event network-changed:a398734f-c887-45f0-95d8-1da8a85e1f14 for instance aa01c537-1b74-4a63-abea-366354d3b9b0 on n-h2-860282-1 Oct 04 22:07:23.185907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [req-6b51fd58-4b5c-4a1d-8a79-6b0c75fc6818 req-4d587787-3c3f-4425-9ad8-1319f0bde8b6 service nova] Instance aa01c537-1b74-4a63-abea-366354d3b9b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122757) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:07:23.197617 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-6b51fd58-4b5c-4a1d-8a79-6b0c75fc6818 req-4d587787-3c3f-4425-9ad8-1319f0bde8b6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045475 Oct 04 22:07:23.198244 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3520/7020] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:07:23.219455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8f342454-e713-4baf-b099-22b93e91a3d4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:23.220079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8f342454-e713-4baf-b099-22b93e91a3d4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:23.227526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f342454-e713-4baf-b099-22b93e91a3d4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:23.228021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f342454-e713-4baf-b099-22b93e91a3d4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:23.228479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f342454-e713-4baf-b099-22b93e91a3d4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:23.229170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f342454-e713-4baf-b099-22b93e91a3d4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:23.229658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f342454-e713-4baf-b099-22b93e91a3d4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:23.230090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8f342454-e713-4baf-b099-22b93e91a3d4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:23.366595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8f342454-e713-4baf-b099-22b93e91a3d4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:23.375090 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8f342454-e713-4baf-b099-22b93e91a3d4 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1513 microversion: 2.1 time: 0.159524 Oct 04 22:07:23.375761 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3501/7021] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:23 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:24.402499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1bc7cc84-f775-4c54-b7b7-51c551c40537 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:24.403229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1bc7cc84-f775-4c54-b7b7-51c551c40537 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:24.409332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bc7cc84-f775-4c54-b7b7-51c551c40537 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:24.409868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bc7cc84-f775-4c54-b7b7-51c551c40537 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:24.410319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bc7cc84-f775-4c54-b7b7-51c551c40537 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:24.411020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bc7cc84-f775-4c54-b7b7-51c551c40537 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:24.411660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bc7cc84-f775-4c54-b7b7-51c551c40537 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:24.412063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bc7cc84-f775-4c54-b7b7-51c551c40537 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:24.547195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1bc7cc84-f775-4c54-b7b7-51c551c40537 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:24.555123 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1bc7cc84-f775-4c54-b7b7-51c551c40537 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1510 microversion: 2.1 time: 0.159399 Oct 04 22:07:24.555698 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3521/7022] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:24 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:24.578303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1e9ba715-9deb-4fb5-8493-7fad326ecd0c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:24.578845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1e9ba715-9deb-4fb5-8493-7fad326ecd0c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:24.581565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=34 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:24.586332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e9ba715-9deb-4fb5-8493-7fad326ecd0c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:24.586824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e9ba715-9deb-4fb5-8493-7fad326ecd0c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:24.588100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e9ba715-9deb-4fb5-8493-7fad326ecd0c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:24.588810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e9ba715-9deb-4fb5-8493-7fad326ecd0c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:24.589267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e9ba715-9deb-4fb5-8493-7fad326ecd0c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:24.589724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1e9ba715-9deb-4fb5-8493-7fad326ecd0c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:24.615392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1e9ba715-9deb-4fb5-8493-7fad326ecd0c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:07:24.728481 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.compute.api [None req-1e9ba715-9deb-4fb5-8493-7fad326ecd0c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Found an unconfirmed migration during delete, id: 16, status: finished Oct 04 22:07:26.770965 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1e9ba715-9deb-4fb5-8493-7fad326ecd0c tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 204 len: 0 microversion: 2.1 time: 2.196359 Oct 04 22:07:26.771677 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3502/7023] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:07:24 2022] DELETE /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 0 bytes in 2198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:07:26.779944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e3906df1-a628-47dd-b8f6-715d7bab1450 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:26.780584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e3906df1-a628-47dd-b8f6-715d7bab1450 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:26.787540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3906df1-a628-47dd-b8f6-715d7bab1450 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:26.788049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3906df1-a628-47dd-b8f6-715d7bab1450 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:26.788510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3906df1-a628-47dd-b8f6-715d7bab1450 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:26.789224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3906df1-a628-47dd-b8f6-715d7bab1450 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:26.789735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3906df1-a628-47dd-b8f6-715d7bab1450 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:26.790779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3906df1-a628-47dd-b8f6-715d7bab1450 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:26.923340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e3906df1-a628-47dd-b8f6-715d7bab1450 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:26.931434 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e3906df1-a628-47dd-b8f6-715d7bab1450 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1502 microversion: 2.1 time: 0.155288 Oct 04 22:07:26.932048 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3522/7024] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:26 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:07:27.137736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-9f3d0ab2-4662-4c7a-a8d2-b6e6c2f9720b req-015126ad-9f10-4258-b0b6-d69decdc9fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa01c537-1b74-4a63-abea-366354d3b9b0", "name": "network-vif-plugged", "status": "completed", "tag": "a398734f-c887-45f0-95d8-1da8a85e1f14"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:27.148105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9f3d0ab2-4662-4c7a-a8d2-b6e6c2f9720b req-015126ad-9f10-4258-b0b6-d69decdc9fed service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:27.148588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9f3d0ab2-4662-4c7a-a8d2-b6e6c2f9720b req-015126ad-9f10-4258-b0b6-d69decdc9fed service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:27.149023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9f3d0ab2-4662-4c7a-a8d2-b6e6c2f9720b req-015126ad-9f10-4258-b0b6-d69decdc9fed service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:27.159976 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-9f3d0ab2-4662-4c7a-a8d2-b6e6c2f9720b req-015126ad-9f10-4258-b0b6-d69decdc9fed service nova] Creating event network-vif-plugged:a398734f-c887-45f0-95d8-1da8a85e1f14 for instance aa01c537-1b74-4a63-abea-366354d3b9b0 on n-h2-860282-1 Oct 04 22:07:27.164991 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-9f3d0ab2-4662-4c7a-a8d2-b6e6c2f9720b req-015126ad-9f10-4258-b0b6-d69decdc9fed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031722 Oct 04 22:07:27.169686 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3503/7025] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:07:27.954738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b2e22d64-9b00-4e89-8489-4512e1887982 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:27.955376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b2e22d64-9b00-4e89-8489-4512e1887982 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:27.962388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2e22d64-9b00-4e89-8489-4512e1887982 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:27.962895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2e22d64-9b00-4e89-8489-4512e1887982 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:27.963354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2e22d64-9b00-4e89-8489-4512e1887982 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:27.964068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2e22d64-9b00-4e89-8489-4512e1887982 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:27.964546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2e22d64-9b00-4e89-8489-4512e1887982 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:27.965019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2e22d64-9b00-4e89-8489-4512e1887982 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:28.098484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b2e22d64-9b00-4e89-8489-4512e1887982 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:28.108176 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b2e22d64-9b00-4e89-8489-4512e1887982 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1502 microversion: 2.1 time: 0.157296 Oct 04 22:07:28.108971 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3523/7026] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:27 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:28.740472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-4485c875-a1d6-40d6-aad5-44e275435587 req-7941d632-099a-414d-a56d-9cdd54856a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa01c537-1b74-4a63-abea-366354d3b9b0", "name": "network-vif-deleted", "tag": "a398734f-c887-45f0-95d8-1da8a85e1f14"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:28.750665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4485c875-a1d6-40d6-aad5-44e275435587 req-7941d632-099a-414d-a56d-9cdd54856a57 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:28.751215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4485c875-a1d6-40d6-aad5-44e275435587 req-7941d632-099a-414d-a56d-9cdd54856a57 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:28.751645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4485c875-a1d6-40d6-aad5-44e275435587 req-7941d632-099a-414d-a56d-9cdd54856a57 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:28.767005 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-4485c875-a1d6-40d6-aad5-44e275435587 req-7941d632-099a-414d-a56d-9cdd54856a57 service nova] Creating event network-vif-deleted:a398734f-c887-45f0-95d8-1da8a85e1f14 for instance aa01c537-1b74-4a63-abea-366354d3b9b0 on n-h2-860282-1 Oct 04 22:07:28.773256 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-4485c875-a1d6-40d6-aad5-44e275435587 req-7941d632-099a-414d-a56d-9cdd54856a57 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037520 Oct 04 22:07:28.774107 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3504/7027] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:07:29.131694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ff1aa45e-cfb1-4288-b874-e585fd6fb423 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:29.132373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ff1aa45e-cfb1-4288-b874-e585fd6fb423 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:29.139403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff1aa45e-cfb1-4288-b874-e585fd6fb423 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:29.139892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff1aa45e-cfb1-4288-b874-e585fd6fb423 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:29.140346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff1aa45e-cfb1-4288-b874-e585fd6fb423 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:29.141056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff1aa45e-cfb1-4288-b874-e585fd6fb423 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:29.141554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff1aa45e-cfb1-4288-b874-e585fd6fb423 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:29.145586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff1aa45e-cfb1-4288-b874-e585fd6fb423 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:29.174835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff1aa45e-cfb1-4288-b874-e585fd6fb423 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:29.175383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff1aa45e-cfb1-4288-b874-e585fd6fb423 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:29.175839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff1aa45e-cfb1-4288-b874-e585fd6fb423 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:29.176306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-ff1aa45e-cfb1-4288-b874-e585fd6fb423 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lazy-loading 'fault' on Instance uuid aa01c537-1b74-4a63-abea-366354d3b9b0 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:07:29.218033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ff1aa45e-cfb1-4288-b874-e585fd6fb423 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030237c8954a4bf3a8a7aa9e93749b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057fcc596eef488fa1d5b6fefee67d0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:29.226625 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ff1aa45e-cfb1-4288-b874-e585fd6fb423 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 200 len: 1305 microversion: 2.1 time: 0.098874 Oct 04 22:07:29.227200 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3524/7028] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:29 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:30.257520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9b36cbf-ab7b-4b81-8751-969f6a7911eb tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:30.258216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d9b36cbf-ab7b-4b81-8751-969f6a7911eb tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:30.264300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9b36cbf-ab7b-4b81-8751-969f6a7911eb tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:30.264779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9b36cbf-ab7b-4b81-8751-969f6a7911eb tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:30.265210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9b36cbf-ab7b-4b81-8751-969f6a7911eb tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:30.265928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9b36cbf-ab7b-4b81-8751-969f6a7911eb tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:30.266378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9b36cbf-ab7b-4b81-8751-969f6a7911eb tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:30.266803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d9b36cbf-ab7b-4b81-8751-969f6a7911eb tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:30.280026 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-d9b36cbf-ab7b-4b81-8751-969f6a7911eb tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] HTTP exception thrown: Instance aa01c537-1b74-4a63-abea-366354d3b9b0 could not be found. Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9b36cbf-ab7b-4b81-8751-969f6a7911eb tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Request method failure captured: Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 HTTP/1.1 Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPK52IKxAX2sGggsVbGsMlTJUxQbrFVsmjRICRdN7jGiYExT6fD4a5OFGiUai4L5F9H1DrOREoRN0mt7Zg6WGWSAlHliMUw0zBHOqlOgkdH7t-rE1x4aKm7CS11ozcQAjQEi6uJrn7-1jyGQdLY1kiPXlnczOms7PREjFhieeX-wgplA Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 057fcc596eef488fa1d5b6fefee67d0a Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-DeleteServersTestJSON-1146656694 Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/057fcc596eef488fa1d5b6fefee67d0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_057fcc596eef488fa1d5b6fefee67d0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/057fcc596eef488fa1d5b6fefee67d0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/057fcc596eef488fa1d5b6fefee67d0a"}]}] Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-DeleteServersTestJSON-1146656694 Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 057fcc596eef488fa1d5b6fefee67d0a Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-DeleteServersTestJSON-1146656694 Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-DeleteServersTestJSON-1146656694-project Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 030237c8954a4bf3a8a7aa9e93749b00 Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-DeleteServersTestJSON-1146656694-project Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance aa01c537-1b74-4a63-abea-366354d3b9b0 could not be found. Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'aa01c537-1b74-4a63-abea-366354d3b9b0'} Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa01c537-1b74-4a63-abea-366354d3b9b0 could not be found. Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa01c537-1b74-4a63-abea-366354d3b9b0 could not be found. Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:30.281661 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.286368 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:30.286368 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:30.286368 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:30.286368 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:07:30.286368 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:07:30.286368 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa01c537-1b74-4a63-abea-366354d3b9b0 could not be found. Oct 04 22:07:30.286368 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.286368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d9b36cbf-ab7b-4b81-8751-969f6a7911eb tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Returning 404 to user: Instance aa01c537-1b74-4a63-abea-366354d3b9b0 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:07:30.286368 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d9b36cbf-ab7b-4b81-8751-969f6a7911eb tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 404 len: 111 microversion: 2.1 time: 0.030660 Oct 04 22:07:30.286368 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3505/7029] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:30 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:07:30.295772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-99a34ffb-e6f9-4124-8fa5-f0266a32228b tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:30.296291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-99a34ffb-e6f9-4124-8fa5-f0266a32228b tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:30.299142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=42 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:30.303905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99a34ffb-e6f9-4124-8fa5-f0266a32228b tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:30.304401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99a34ffb-e6f9-4124-8fa5-f0266a32228b tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:30.304853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99a34ffb-e6f9-4124-8fa5-f0266a32228b tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:30.305587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99a34ffb-e6f9-4124-8fa5-f0266a32228b tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:30.306734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99a34ffb-e6f9-4124-8fa5-f0266a32228b tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:30.307181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-99a34ffb-e6f9-4124-8fa5-f0266a32228b tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:30.320360 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-99a34ffb-e6f9-4124-8fa5-f0266a32228b tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] HTTP exception thrown: Instance aa01c537-1b74-4a63-abea-366354d3b9b0 could not be found. Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-99a34ffb-e6f9-4124-8fa5-f0266a32228b tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Request method failure captured: Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 HTTP/1.1 Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPK52IKxAX2sGggsVbGsMlTJUxQbrFVsmjRICRdN7jGiYExT6fD4a5OFGiUai4L5F9H1DrOREoRN0mt7Zg6WGWSAlHliMUw0zBHOqlOgkdH7t-rE1x4aKm7CS11ozcQAjQEi6uJrn7-1jyGQdLY1kiPXlnczOms7PREjFhieeX-wgplA Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 057fcc596eef488fa1d5b6fefee67d0a Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-DeleteServersTestJSON-1146656694 Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/057fcc596eef488fa1d5b6fefee67d0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_057fcc596eef488fa1d5b6fefee67d0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/057fcc596eef488fa1d5b6fefee67d0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/057fcc596eef488fa1d5b6fefee67d0a"}]}] Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-DeleteServersTestJSON-1146656694 Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 057fcc596eef488fa1d5b6fefee67d0a Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-DeleteServersTestJSON-1146656694 Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-DeleteServersTestJSON-1146656694-project Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 030237c8954a4bf3a8a7aa9e93749b00 Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-DeleteServersTestJSON-1146656694-project Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance aa01c537-1b74-4a63-abea-366354d3b9b0 could not be found. Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'aa01c537-1b74-4a63-abea-366354d3b9b0'} Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa01c537-1b74-4a63-abea-366354d3b9b0 could not be found. Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:07:30.322085 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:07:30.326129 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa01c537-1b74-4a63-abea-366354d3b9b0 could not be found. Oct 04 22:07:30.326129 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.326129 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:30.326129 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.326129 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:30.326129 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:30.326129 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:30.326129 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:07:30.326129 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:07:30.326129 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa01c537-1b74-4a63-abea-366354d3b9b0 could not be found. Oct 04 22:07:30.326129 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.326129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-99a34ffb-e6f9-4124-8fa5-f0266a32228b tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Returning 404 to user: Instance aa01c537-1b74-4a63-abea-366354d3b9b0 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:07:30.326129 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-99a34ffb-e6f9-4124-8fa5-f0266a32228b tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 404 len: 111 microversion: 2.1 time: 0.031681 Oct 04 22:07:30.326129 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3525/7030] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:07:30 2022] DELETE /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:07:30.332314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-af3c5f94-0040-4897-aa1c-4721986a93d6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:30.332921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-af3c5f94-0040-4897-aa1c-4721986a93d6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] [instance: aa01c537-1b74-4a63-abea-366354d3b9b0] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:30.338984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af3c5f94-0040-4897-aa1c-4721986a93d6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:30.339463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af3c5f94-0040-4897-aa1c-4721986a93d6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:30.339901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af3c5f94-0040-4897-aa1c-4721986a93d6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:30.340579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af3c5f94-0040-4897-aa1c-4721986a93d6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:30.341034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af3c5f94-0040-4897-aa1c-4721986a93d6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:30.341494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af3c5f94-0040-4897-aa1c-4721986a93d6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:30.355142 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-af3c5f94-0040-4897-aa1c-4721986a93d6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] HTTP exception thrown: Instance aa01c537-1b74-4a63-abea-366354d3b9b0 could not be found. Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-af3c5f94-0040-4897-aa1c-4721986a93d6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Request method failure captured: Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 HTTP/1.1 Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPK52IKxAX2sGggsVbGsMlTJUxQbrFVsmjRICRdN7jGiYExT6fD4a5OFGiUai4L5F9H1DrOREoRN0mt7Zg6WGWSAlHliMUw0zBHOqlOgkdH7t-rE1x4aKm7CS11ozcQAjQEi6uJrn7-1jyGQdLY1kiPXlnczOms7PREjFhieeX-wgplA Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 057fcc596eef488fa1d5b6fefee67d0a Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-DeleteServersTestJSON-1146656694 Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/057fcc596eef488fa1d5b6fefee67d0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_057fcc596eef488fa1d5b6fefee67d0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/057fcc596eef488fa1d5b6fefee67d0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/057fcc596eef488fa1d5b6fefee67d0a"}]}] Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-DeleteServersTestJSON-1146656694 Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 057fcc596eef488fa1d5b6fefee67d0a Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-DeleteServersTestJSON-1146656694 Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-DeleteServersTestJSON-1146656694-project Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 030237c8954a4bf3a8a7aa9e93749b00 Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-DeleteServersTestJSON-1146656694-project Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance aa01c537-1b74-4a63-abea-366354d3b9b0 could not be found. Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'aa01c537-1b74-4a63-abea-366354d3b9b0'} Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa01c537-1b74-4a63-abea-366354d3b9b0 could not be found. Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa01c537-1b74-4a63-abea-366354d3b9b0 could not be found. Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:07:30.356677 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.360649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:07:30.360649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:07:30.360649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:07:30.360649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:07:30.360649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:07:30.360649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa01c537-1b74-4a63-abea-366354d3b9b0 could not be found. Oct 04 22:07:30.360649 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:07:30.360649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-af3c5f94-0040-4897-aa1c-4721986a93d6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] Returning 404 to user: Instance aa01c537-1b74-4a63-abea-366354d3b9b0 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:07:30.360649 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-af3c5f94-0040-4897-aa1c-4721986a93d6 tempest-DeleteServersTestJSON-1146656694 tempest-DeleteServersTestJSON-1146656694-project] 10.222.0.30 "GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0" status: 404 len: 111 microversion: 2.1 time: 0.029642 Oct 04 22:07:30.360649 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3506/7031] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:30 2022] GET /compute/v2.1/servers/aa01c537-1b74-4a63-abea-366354d3b9b0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:07:41.343688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=47 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:41.452932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-84252649-09c7-417d-bce4-690eba9a2793 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-283241614", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "b3ebe20c-fac1-4797-96a4-eea925dcb937"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:41.506399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-84252649-09c7-417d-bce4-690eba9a2793 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] validate_networks() for [('b3ebe20c-fac1-4797-96a4-eea925dcb937', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:07:41.888881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-84252649-09c7-417d-bce4-690eba9a2793 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:07:41.889328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-84252649-09c7-417d-bce4-690eba9a2793 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:07:41.890435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-84252649-09c7-417d-bce4-690eba9a2793 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:07:41.890879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-84252649-09c7-417d-bce4-690eba9a2793 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:07:41.891321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-84252649-09c7-417d-bce4-690eba9a2793 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:07:41.900950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84252649-09c7-417d-bce4-690eba9a2793 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:41.901479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84252649-09c7-417d-bce4-690eba9a2793 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:41.901939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84252649-09c7-417d-bce4-690eba9a2793 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:41.902690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84252649-09c7-417d-bce4-690eba9a2793 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:41.903173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84252649-09c7-417d-bce4-690eba9a2793 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:41.903680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-84252649-09c7-417d-bce4-690eba9a2793 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:41.920876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-84252649-09c7-417d-bce4-690eba9a2793 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Getting quotas for project 6072248a19c841778fe06ccea68ecf57. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:07:41.927003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-84252649-09c7-417d-bce4-690eba9a2793 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Getting quotas for user 6f3b0a36cdc245f69ed52226192b12fc and project 6072248a19c841778fe06ccea68ecf57. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:07:41.942979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-84252649-09c7-417d-bce4-690eba9a2793 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:07:41.943188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-84252649-09c7-417d-bce4-690eba9a2793 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:07:42.059255 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-84252649-09c7-417d-bce4-690eba9a2793 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722004 Oct 04 22:07:42.060214 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3526/7032] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:07:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:07:42.072303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-abc45cab-515b-437d-a4f4-ff6488391bdd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:42.073259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-abc45cab-515b-437d-a4f4-ff6488391bdd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:42.076507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:42.077317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:42.153064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-abc45cab-515b-437d-a4f4-ff6488391bdd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:42.163322 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-abc45cab-515b-437d-a4f4-ff6488391bdd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1217 microversion: 2.1 time: 0.094943 Oct 04 22:07:42.166138 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3507/7033] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:42 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:07:43.194722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a935a262-eecf-4b07-b390-b847921bc29d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:43.196725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a935a262-eecf-4b07-b390-b847921bc29d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:43.203164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a935a262-eecf-4b07-b390-b847921bc29d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:43.203673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a935a262-eecf-4b07-b390-b847921bc29d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:43.204129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a935a262-eecf-4b07-b390-b847921bc29d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:43.204850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a935a262-eecf-4b07-b390-b847921bc29d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:43.205326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a935a262-eecf-4b07-b390-b847921bc29d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:43.205798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a935a262-eecf-4b07-b390-b847921bc29d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:43.292558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a935a262-eecf-4b07-b390-b847921bc29d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:43.301460 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a935a262-eecf-4b07-b390-b847921bc29d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1221 microversion: 2.1 time: 0.112601 Oct 04 22:07:43.302365 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3527/7034] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:43 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1221 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:44.324312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9533cfe9-6e78-4787-9c4a-236ad49ba742 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:44.331126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9533cfe9-6e78-4787-9c4a-236ad49ba742 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:44.334444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9533cfe9-6e78-4787-9c4a-236ad49ba742 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:44.335183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9533cfe9-6e78-4787-9c4a-236ad49ba742 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:44.335822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9533cfe9-6e78-4787-9c4a-236ad49ba742 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:44.337474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9533cfe9-6e78-4787-9c4a-236ad49ba742 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:44.338990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9533cfe9-6e78-4787-9c4a-236ad49ba742 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:44.339631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9533cfe9-6e78-4787-9c4a-236ad49ba742 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:44.442578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9533cfe9-6e78-4787-9c4a-236ad49ba742 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:44.458999 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9533cfe9-6e78-4787-9c4a-236ad49ba742 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1277 microversion: 2.1 time: 0.138265 Oct 04 22:07:44.460664 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3508/7035] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:44 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:45.483533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6eaecbcb-38e6-4d60-934b-9cb3b4b40f35 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:45.484320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6eaecbcb-38e6-4d60-934b-9cb3b4b40f35 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:45.490995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6eaecbcb-38e6-4d60-934b-9cb3b4b40f35 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:45.491617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6eaecbcb-38e6-4d60-934b-9cb3b4b40f35 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:45.492091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6eaecbcb-38e6-4d60-934b-9cb3b4b40f35 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:45.492808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6eaecbcb-38e6-4d60-934b-9cb3b4b40f35 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:45.493448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6eaecbcb-38e6-4d60-934b-9cb3b4b40f35 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:45.493966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6eaecbcb-38e6-4d60-934b-9cb3b4b40f35 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:45.736611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6eaecbcb-38e6-4d60-934b-9cb3b4b40f35 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:45.744934 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6eaecbcb-38e6-4d60-934b-9cb3b4b40f35 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1317 microversion: 2.1 time: 0.265387 Oct 04 22:07:45.745612 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3528/7036] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:45 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:45.971665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-22c6b49e-11da-4e34-aad6-910d4167cc9e req-0c68fc51-f6b0-4106-860e-d21bda30f1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d5e9b5-39f2-4ec4-8f98-ac29d44bad89", "tag": "f87a0eab-885b-4d4a-80a3-3b1873296c10"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:45.984075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-22c6b49e-11da-4e34-aad6-910d4167cc9e req-0c68fc51-f6b0-4106-860e-d21bda30f1c0 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:45.984841 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-22c6b49e-11da-4e34-aad6-910d4167cc9e req-0c68fc51-f6b0-4106-860e-d21bda30f1c0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:45.985330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-22c6b49e-11da-4e34-aad6-910d4167cc9e req-0c68fc51-f6b0-4106-860e-d21bda30f1c0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:45.998048 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-22c6b49e-11da-4e34-aad6-910d4167cc9e req-0c68fc51-f6b0-4106-860e-d21bda30f1c0 service nova] Creating event network-changed:f87a0eab-885b-4d4a-80a3-3b1873296c10 for instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 on n-h2-860282-1 Oct 04 22:07:46.003451 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-22c6b49e-11da-4e34-aad6-910d4167cc9e req-0c68fc51-f6b0-4106-860e-d21bda30f1c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035772 Oct 04 22:07:46.007355 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3509/7037] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:07:46.768630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9d0f3935-9216-4efb-93c0-933752506078 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:46.769330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9d0f3935-9216-4efb-93c0-933752506078 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:46.778088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d0f3935-9216-4efb-93c0-933752506078 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:46.778592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d0f3935-9216-4efb-93c0-933752506078 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:46.780766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d0f3935-9216-4efb-93c0-933752506078 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:46.780766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d0f3935-9216-4efb-93c0-933752506078 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:46.780766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d0f3935-9216-4efb-93c0-933752506078 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:46.780766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9d0f3935-9216-4efb-93c0-933752506078 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:46.908328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9d0f3935-9216-4efb-93c0-933752506078 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:46.916438 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9d0f3935-9216-4efb-93c0-933752506078 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1317 microversion: 2.1 time: 0.151922 Oct 04 22:07:46.916956 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3529/7038] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:46 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:47.940378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ebaccd10-b180-4c48-8c41-c013ba075a33 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:47.941086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ebaccd10-b180-4c48-8c41-c013ba075a33 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:47.947235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebaccd10-b180-4c48-8c41-c013ba075a33 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:47.947714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebaccd10-b180-4c48-8c41-c013ba075a33 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:47.948148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebaccd10-b180-4c48-8c41-c013ba075a33 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:47.948827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebaccd10-b180-4c48-8c41-c013ba075a33 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:47.949275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebaccd10-b180-4c48-8c41-c013ba075a33 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:47.949725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ebaccd10-b180-4c48-8c41-c013ba075a33 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:48.084801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ebaccd10-b180-4c48-8c41-c013ba075a33 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:48.093306 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ebaccd10-b180-4c48-8c41-c013ba075a33 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1317 microversion: 2.1 time: 0.157997 Oct 04 22:07:48.093900 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3510/7039] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:47 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:49.116883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d088d4d0-d481-40b3-aaae-cd8a774322a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:49.121315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d088d4d0-d481-40b3-aaae-cd8a774322a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:49.128869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d088d4d0-d481-40b3-aaae-cd8a774322a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:49.129392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d088d4d0-d481-40b3-aaae-cd8a774322a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:49.129885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d088d4d0-d481-40b3-aaae-cd8a774322a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:49.130671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d088d4d0-d481-40b3-aaae-cd8a774322a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:49.131152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d088d4d0-d481-40b3-aaae-cd8a774322a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:49.132134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d088d4d0-d481-40b3-aaae-cd8a774322a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:49.282171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d088d4d0-d481-40b3-aaae-cd8a774322a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:49.291218 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d088d4d0-d481-40b3-aaae-cd8a774322a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1317 microversion: 2.1 time: 0.178679 Oct 04 22:07:49.291889 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3530/7040] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:49 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:50.314659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7ce556c1-0990-4b95-827e-ae35d23b237d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:50.315272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7ce556c1-0990-4b95-827e-ae35d23b237d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:50.322451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ce556c1-0990-4b95-827e-ae35d23b237d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:50.322953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ce556c1-0990-4b95-827e-ae35d23b237d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:50.323428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ce556c1-0990-4b95-827e-ae35d23b237d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:50.324138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ce556c1-0990-4b95-827e-ae35d23b237d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:50.324603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ce556c1-0990-4b95-827e-ae35d23b237d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:50.325037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ce556c1-0990-4b95-827e-ae35d23b237d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:50.456402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7ce556c1-0990-4b95-827e-ae35d23b237d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:50.464727 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7ce556c1-0990-4b95-827e-ae35d23b237d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1317 microversion: 2.1 time: 0.154043 Oct 04 22:07:50.465291 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3511/7041] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:50 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:51.237032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-086115c0-f726-4b55-a891-9159082c5f4a req-91b307dd-7143-4f03-8c38-ea5a6c5a5a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d5e9b5-39f2-4ec4-8f98-ac29d44bad89", "name": "network-vif-plugged", "status": "completed", "tag": "f87a0eab-885b-4d4a-80a3-3b1873296c10"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:51.248296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-086115c0-f726-4b55-a891-9159082c5f4a req-91b307dd-7143-4f03-8c38-ea5a6c5a5a9d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:51.248802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-086115c0-f726-4b55-a891-9159082c5f4a req-91b307dd-7143-4f03-8c38-ea5a6c5a5a9d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:51.249264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-086115c0-f726-4b55-a891-9159082c5f4a req-91b307dd-7143-4f03-8c38-ea5a6c5a5a9d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:51.260411 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-086115c0-f726-4b55-a891-9159082c5f4a req-91b307dd-7143-4f03-8c38-ea5a6c5a5a9d service nova] Creating event network-vif-plugged:f87a0eab-885b-4d4a-80a3-3b1873296c10 for instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 on n-h2-860282-1 Oct 04 22:07:51.265501 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-086115c0-f726-4b55-a891-9159082c5f4a req-91b307dd-7143-4f03-8c38-ea5a6c5a5a9d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032144 Oct 04 22:07:51.266110 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3531/7042] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:07:51.487453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-60f7353a-c1bd-4122-a1dc-631476585f29 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:51.488394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-60f7353a-c1bd-4122-a1dc-631476585f29 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:51.495605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60f7353a-c1bd-4122-a1dc-631476585f29 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:51.496088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60f7353a-c1bd-4122-a1dc-631476585f29 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:51.496521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60f7353a-c1bd-4122-a1dc-631476585f29 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:51.497210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60f7353a-c1bd-4122-a1dc-631476585f29 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:51.497690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60f7353a-c1bd-4122-a1dc-631476585f29 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:51.498140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-60f7353a-c1bd-4122-a1dc-631476585f29 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:51.636830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-60f7353a-c1bd-4122-a1dc-631476585f29 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:51.645022 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-60f7353a-c1bd-4122-a1dc-631476585f29 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1317 microversion: 2.1 time: 0.161429 Oct 04 22:07:51.645753 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3512/7043] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:51 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:07:52.665787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:52.666589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:52.671710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c4ca910c-6759-4433-80ba-efbfa08e5336 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:52.673139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c4ca910c-6759-4433-80ba-efbfa08e5336 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:52.679417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4ca910c-6759-4433-80ba-efbfa08e5336 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:52.679946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4ca910c-6759-4433-80ba-efbfa08e5336 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:52.680917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4ca910c-6759-4433-80ba-efbfa08e5336 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:52.681699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4ca910c-6759-4433-80ba-efbfa08e5336 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:52.682208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4ca910c-6759-4433-80ba-efbfa08e5336 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:52.682699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4ca910c-6759-4433-80ba-efbfa08e5336 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:52.816106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c4ca910c-6759-4433-80ba-efbfa08e5336 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:52.824112 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c4ca910c-6759-4433-80ba-efbfa08e5336 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1506 microversion: 2.1 time: 0.159654 Oct 04 22:07:52.824683 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3532/7044] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:52 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:52.845774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-05e93372-a796-4a1d-9177-238f338d5baf tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:52.846388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-05e93372-a796-4a1d-9177-238f338d5baf tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:52.848358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:07:52.854505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05e93372-a796-4a1d-9177-238f338d5baf tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:52.855030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05e93372-a796-4a1d-9177-238f338d5baf tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:52.860135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05e93372-a796-4a1d-9177-238f338d5baf tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:52.860135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05e93372-a796-4a1d-9177-238f338d5baf tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:52.860135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05e93372-a796-4a1d-9177-238f338d5baf tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:52.860135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05e93372-a796-4a1d-9177-238f338d5baf tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:52.997285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-05e93372-a796-4a1d-9177-238f338d5baf tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:53.005038 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-05e93372-a796-4a1d-9177-238f338d5baf tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1506 microversion: 2.1 time: 0.163046 Oct 04 22:07:53.005668 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3513/7045] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:52 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:53.027269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d8799dbc-ac0b-4d9b-a084-e56a0ee84c66 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:53.029823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d8799dbc-ac0b-4d9b-a084-e56a0ee84c66 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:53.035838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8799dbc-ac0b-4d9b-a084-e56a0ee84c66 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:53.036347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8799dbc-ac0b-4d9b-a084-e56a0ee84c66 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:53.036810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8799dbc-ac0b-4d9b-a084-e56a0ee84c66 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:53.037563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8799dbc-ac0b-4d9b-a084-e56a0ee84c66 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:53.038048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8799dbc-ac0b-4d9b-a084-e56a0ee84c66 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:53.038494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d8799dbc-ac0b-4d9b-a084-e56a0ee84c66 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:53.151897 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d8799dbc-ac0b-4d9b-a084-e56a0ee84c66 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "PUT /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1078 microversion: 2.1 time: 0.128600 Oct 04 22:07:53.152726 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3533/7046] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Oct 4 22:07:53 2022] PUT /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1078 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:53.171298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a7c09a4f-5be0-4c5d-9c68-ea063c1ddc18 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:53.171924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a7c09a4f-5be0-4c5d-9c68-ea063c1ddc18 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:53.177844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7c09a4f-5be0-4c5d-9c68-ea063c1ddc18 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:53.178330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7c09a4f-5be0-4c5d-9c68-ea063c1ddc18 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:53.178855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7c09a4f-5be0-4c5d-9c68-ea063c1ddc18 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:53.179548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7c09a4f-5be0-4c5d-9c68-ea063c1ddc18 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:53.180007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7c09a4f-5be0-4c5d-9c68-ea063c1ddc18 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:53.180464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a7c09a4f-5be0-4c5d-9c68-ea063c1ddc18 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:53.312996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a7c09a4f-5be0-4c5d-9c68-ea063c1ddc18 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:53.320728 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a7c09a4f-5be0-4c5d-9c68-ea063c1ddc18 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1504 microversion: 2.1 time: 0.153286 Oct 04 22:07:53.321329 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3514/7047] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:53 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:53.342784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dd5c6858-3207-4083-abba-d3227105032e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:53.343421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dd5c6858-3207-4083-abba-d3227105032e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:53.349508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd5c6858-3207-4083-abba-d3227105032e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:53.350007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd5c6858-3207-4083-abba-d3227105032e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:53.350459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd5c6858-3207-4083-abba-d3227105032e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:53.351161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd5c6858-3207-4083-abba-d3227105032e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:53.351632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd5c6858-3207-4083-abba-d3227105032e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:53.352821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd5c6858-3207-4083-abba-d3227105032e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:53.480549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dd5c6858-3207-4083-abba-d3227105032e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:53.488272 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dd5c6858-3207-4083-abba-d3227105032e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1504 microversion: 2.1 time: 0.149533 Oct 04 22:07:53.488867 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3534/7048] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:53 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:53.510811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5246f237-e8e2-4dc0-8df3-2806e82e5981 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:07:53.513173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5246f237-e8e2-4dc0-8df3-2806e82e5981 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:53.519385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5246f237-e8e2-4dc0-8df3-2806e82e5981 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:53.519872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5246f237-e8e2-4dc0-8df3-2806e82e5981 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:53.520315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5246f237-e8e2-4dc0-8df3-2806e82e5981 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:53.521013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5246f237-e8e2-4dc0-8df3-2806e82e5981 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:53.521502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5246f237-e8e2-4dc0-8df3-2806e82e5981 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:53.521940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5246f237-e8e2-4dc0-8df3-2806e82e5981 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:53.551463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5246f237-e8e2-4dc0-8df3-2806e82e5981 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:53.557182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5246f237-e8e2-4dc0-8df3-2806e82e5981 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Old instance type m1.heat2, new instance type m1.heat {{(pid=122758) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:07:53.563739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-5246f237-e8e2-4dc0-8df3-2806e82e5981 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:07:53.564172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-5246f237-e8e2-4dc0-8df3-2806e82e5981 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:07:53.564657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-5246f237-e8e2-4dc0-8df3-2806e82e5981 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:07:53.565077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-5246f237-e8e2-4dc0-8df3-2806e82e5981 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:07:53.565528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-5246f237-e8e2-4dc0-8df3-2806e82e5981 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:07:53.717635 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5246f237-e8e2-4dc0-8df3-2806e82e5981 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "POST /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89/action" status: 202 len: 0 microversion: 2.1 time: 0.211528 Oct 04 22:07:53.718338 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3515/7049] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:07:53 2022] POST /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:07:53.726556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-52dd0fcd-87b2-4501-a0b9-6280439e2ee6 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:53.727277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-52dd0fcd-87b2-4501-a0b9-6280439e2ee6 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:53.735170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52dd0fcd-87b2-4501-a0b9-6280439e2ee6 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:53.736109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52dd0fcd-87b2-4501-a0b9-6280439e2ee6 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:53.736487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52dd0fcd-87b2-4501-a0b9-6280439e2ee6 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:53.737226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52dd0fcd-87b2-4501-a0b9-6280439e2ee6 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:53.737732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52dd0fcd-87b2-4501-a0b9-6280439e2ee6 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:53.738196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52dd0fcd-87b2-4501-a0b9-6280439e2ee6 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:53.886737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-52dd0fcd-87b2-4501-a0b9-6280439e2ee6 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:53.902853 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-52dd0fcd-87b2-4501-a0b9-6280439e2ee6 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1515 microversion: 2.1 time: 0.180108 Oct 04 22:07:53.903582 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3535/7050] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:53 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:54.926543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5aae1cae-b9c9-456b-afab-d313e3c55750 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:54.927218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5aae1cae-b9c9-456b-afab-d313e3c55750 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:54.935617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5aae1cae-b9c9-456b-afab-d313e3c55750 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:54.936111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5aae1cae-b9c9-456b-afab-d313e3c55750 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:54.936553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5aae1cae-b9c9-456b-afab-d313e3c55750 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:54.937251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5aae1cae-b9c9-456b-afab-d313e3c55750 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:54.937738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5aae1cae-b9c9-456b-afab-d313e3c55750 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:54.938172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5aae1cae-b9c9-456b-afab-d313e3c55750 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:55.071834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5aae1cae-b9c9-456b-afab-d313e3c55750 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:55.079967 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5aae1cae-b9c9-456b-afab-d313e3c55750 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1515 microversion: 2.1 time: 0.157398 Oct 04 22:07:55.080533 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3516/7051] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:54 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:56.105651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1662739c-ecab-4357-95ae-da2ae8772b04 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:56.106342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1662739c-ecab-4357-95ae-da2ae8772b04 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:56.113190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1662739c-ecab-4357-95ae-da2ae8772b04 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:56.113737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1662739c-ecab-4357-95ae-da2ae8772b04 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:56.114203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1662739c-ecab-4357-95ae-da2ae8772b04 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:56.114929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1662739c-ecab-4357-95ae-da2ae8772b04 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:56.115410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1662739c-ecab-4357-95ae-da2ae8772b04 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:56.115864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1662739c-ecab-4357-95ae-da2ae8772b04 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:56.321014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1662739c-ecab-4357-95ae-da2ae8772b04 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:56.329023 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1662739c-ecab-4357-95ae-da2ae8772b04 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1515 microversion: 2.1 time: 0.228584 Oct 04 22:07:56.329731 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3536/7052] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:56 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:57.352606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4ac08e58-14d3-4c5a-8266-7735da08646c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:57.353832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4ac08e58-14d3-4c5a-8266-7735da08646c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:57.360671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ac08e58-14d3-4c5a-8266-7735da08646c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:57.361175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ac08e58-14d3-4c5a-8266-7735da08646c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:57.361672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ac08e58-14d3-4c5a-8266-7735da08646c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:57.362363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ac08e58-14d3-4c5a-8266-7735da08646c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:57.362826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ac08e58-14d3-4c5a-8266-7735da08646c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:57.363257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ac08e58-14d3-4c5a-8266-7735da08646c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:57.493107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4ac08e58-14d3-4c5a-8266-7735da08646c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:57.501589 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4ac08e58-14d3-4c5a-8266-7735da08646c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.152927 Oct 04 22:07:57.502169 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3517/7053] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:57 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:58.524350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-62726179-a799-4f37-933b-4aea046fb7eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:58.524984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-62726179-a799-4f37-933b-4aea046fb7eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:58.531930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-62726179-a799-4f37-933b-4aea046fb7eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:58.532429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-62726179-a799-4f37-933b-4aea046fb7eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:58.532878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-62726179-a799-4f37-933b-4aea046fb7eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:58.533631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-62726179-a799-4f37-933b-4aea046fb7eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:58.534113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-62726179-a799-4f37-933b-4aea046fb7eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:58.534554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-62726179-a799-4f37-933b-4aea046fb7eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:58.668023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-62726179-a799-4f37-933b-4aea046fb7eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:58.675893 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-62726179-a799-4f37-933b-4aea046fb7eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.155419 Oct 04 22:07:58.676475 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3537/7054] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:58 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:07:59.699223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f2f59b8c-262e-460e-ab22-c61c48643aae tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:07:59.699834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f2f59b8c-262e-460e-ab22-c61c48643aae tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:07:59.706620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2f59b8c-262e-460e-ab22-c61c48643aae tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:59.707104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2f59b8c-262e-460e-ab22-c61c48643aae tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:59.707540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2f59b8c-262e-460e-ab22-c61c48643aae tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:59.708226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2f59b8c-262e-460e-ab22-c61c48643aae tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:07:59.708678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2f59b8c-262e-460e-ab22-c61c48643aae tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:07:59.709103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2f59b8c-262e-460e-ab22-c61c48643aae tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:07:59.844784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f2f59b8c-262e-460e-ab22-c61c48643aae tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:07:59.852503 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f2f59b8c-262e-460e-ab22-c61c48643aae tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.157301 Oct 04 22:07:59.853801 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3518/7055] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:07:59 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:00.876188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-49035c3f-e0a4-48aa-8748-a4c0ce0ff5ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:00.876813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-49035c3f-e0a4-48aa-8748-a4c0ce0ff5ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:00.883773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49035c3f-e0a4-48aa-8748-a4c0ce0ff5ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:00.884940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49035c3f-e0a4-48aa-8748-a4c0ce0ff5ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:00.885630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49035c3f-e0a4-48aa-8748-a4c0ce0ff5ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:00.886383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49035c3f-e0a4-48aa-8748-a4c0ce0ff5ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:00.886861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49035c3f-e0a4-48aa-8748-a4c0ce0ff5ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:00.887307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49035c3f-e0a4-48aa-8748-a4c0ce0ff5ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:01.019790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-49035c3f-e0a4-48aa-8748-a4c0ce0ff5ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:01.027785 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-49035c3f-e0a4-48aa-8748-a4c0ce0ff5ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.155559 Oct 04 22:08:01.028361 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3538/7056] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:00 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:08:02.051257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e540908c-b99d-4417-81ad-cb9f17f63598 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:02.051874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e540908c-b99d-4417-81ad-cb9f17f63598 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:02.059016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e540908c-b99d-4417-81ad-cb9f17f63598 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:02.059501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e540908c-b99d-4417-81ad-cb9f17f63598 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:02.059940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e540908c-b99d-4417-81ad-cb9f17f63598 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:02.060626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e540908c-b99d-4417-81ad-cb9f17f63598 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:02.061079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e540908c-b99d-4417-81ad-cb9f17f63598 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:02.061535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e540908c-b99d-4417-81ad-cb9f17f63598 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:02.192528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e540908c-b99d-4417-81ad-cb9f17f63598 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:02.201315 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e540908c-b99d-4417-81ad-cb9f17f63598 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.153844 Oct 04 22:08:02.201918 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3519/7057] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:02 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:03.224160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-10acd7f9-b962-4467-8a26-41c1efc719d5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:03.224815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-10acd7f9-b962-4467-8a26-41c1efc719d5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:03.232552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10acd7f9-b962-4467-8a26-41c1efc719d5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:03.233054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10acd7f9-b962-4467-8a26-41c1efc719d5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:03.233544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10acd7f9-b962-4467-8a26-41c1efc719d5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:03.234248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10acd7f9-b962-4467-8a26-41c1efc719d5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:03.234750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10acd7f9-b962-4467-8a26-41c1efc719d5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:03.235192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10acd7f9-b962-4467-8a26-41c1efc719d5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:03.364197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-10acd7f9-b962-4467-8a26-41c1efc719d5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:03.372090 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-10acd7f9-b962-4467-8a26-41c1efc719d5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.151910 Oct 04 22:08:03.372664 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3539/7058] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:03 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:04.395521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-31657b06-9c46-458d-9658-156d08fe01b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:04.396141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-31657b06-9c46-458d-9658-156d08fe01b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:04.403965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31657b06-9c46-458d-9658-156d08fe01b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:04.404443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31657b06-9c46-458d-9658-156d08fe01b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:04.404880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31657b06-9c46-458d-9658-156d08fe01b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:04.405600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31657b06-9c46-458d-9658-156d08fe01b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:04.406053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31657b06-9c46-458d-9658-156d08fe01b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:04.406477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31657b06-9c46-458d-9658-156d08fe01b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:04.535005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-31657b06-9c46-458d-9658-156d08fe01b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:04.543801 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-31657b06-9c46-458d-9658-156d08fe01b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.152396 Oct 04 22:08:04.544425 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3520/7059] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:04 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:05.566875 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f73f6a16-a24c-479c-bf51-ea31f814f7f9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:05.567509 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f73f6a16-a24c-479c-bf51-ea31f814f7f9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:05.574481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f73f6a16-a24c-479c-bf51-ea31f814f7f9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:05.574985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f73f6a16-a24c-479c-bf51-ea31f814f7f9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:05.575508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f73f6a16-a24c-479c-bf51-ea31f814f7f9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:05.576371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f73f6a16-a24c-479c-bf51-ea31f814f7f9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:05.576847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f73f6a16-a24c-479c-bf51-ea31f814f7f9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:05.577287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f73f6a16-a24c-479c-bf51-ea31f814f7f9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:05.713107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f73f6a16-a24c-479c-bf51-ea31f814f7f9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:05.721228 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f73f6a16-a24c-479c-bf51-ea31f814f7f9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.158555 Oct 04 22:08:05.721879 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3540/7060] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:05 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:06.744788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-194cbf28-195f-434c-9b5d-892016733e61 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:06.745560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-194cbf28-195f-434c-9b5d-892016733e61 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:06.752372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-194cbf28-195f-434c-9b5d-892016733e61 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:06.752859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-194cbf28-195f-434c-9b5d-892016733e61 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:06.753304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-194cbf28-195f-434c-9b5d-892016733e61 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:06.754019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-194cbf28-195f-434c-9b5d-892016733e61 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:06.754477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-194cbf28-195f-434c-9b5d-892016733e61 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:06.754909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-194cbf28-195f-434c-9b5d-892016733e61 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:06.882081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-194cbf28-195f-434c-9b5d-892016733e61 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:06.889796 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-194cbf28-195f-434c-9b5d-892016733e61 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.148873 Oct 04 22:08:06.890374 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3521/7061] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:06 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:07.912900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2b569972-144f-4670-afc2-428d72db8975 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:07.913559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2b569972-144f-4670-afc2-428d72db8975 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:07.921046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b569972-144f-4670-afc2-428d72db8975 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:07.921587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b569972-144f-4670-afc2-428d72db8975 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:07.922042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b569972-144f-4670-afc2-428d72db8975 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:07.922745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b569972-144f-4670-afc2-428d72db8975 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:07.923216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b569972-144f-4670-afc2-428d72db8975 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:07.923658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b569972-144f-4670-afc2-428d72db8975 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:08.059391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2b569972-144f-4670-afc2-428d72db8975 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:08.067214 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2b569972-144f-4670-afc2-428d72db8975 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.158279 Oct 04 22:08:08.067788 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3541/7062] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:07 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:09.090810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1f599953-81a8-4664-813d-57828db4f51c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:09.091345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1f599953-81a8-4664-813d-57828db4f51c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:09.098146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f599953-81a8-4664-813d-57828db4f51c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:09.098634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f599953-81a8-4664-813d-57828db4f51c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:09.099078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f599953-81a8-4664-813d-57828db4f51c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:09.099765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f599953-81a8-4664-813d-57828db4f51c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:09.100223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f599953-81a8-4664-813d-57828db4f51c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:09.100651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1f599953-81a8-4664-813d-57828db4f51c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:09.232086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1f599953-81a8-4664-813d-57828db4f51c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:09.239989 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1f599953-81a8-4664-813d-57828db4f51c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.153693 Oct 04 22:08:09.240567 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3522/7063] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:09 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:10.263155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-764c8bab-4fe7-47de-b209-d7e7cf309575 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:10.263796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-764c8bab-4fe7-47de-b209-d7e7cf309575 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:10.271047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-764c8bab-4fe7-47de-b209-d7e7cf309575 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:10.271554 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-764c8bab-4fe7-47de-b209-d7e7cf309575 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:10.272018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-764c8bab-4fe7-47de-b209-d7e7cf309575 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:10.272732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-764c8bab-4fe7-47de-b209-d7e7cf309575 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:10.273212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-764c8bab-4fe7-47de-b209-d7e7cf309575 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:10.273693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-764c8bab-4fe7-47de-b209-d7e7cf309575 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:10.408714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-764c8bab-4fe7-47de-b209-d7e7cf309575 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:10.416557 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-764c8bab-4fe7-47de-b209-d7e7cf309575 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.157445 Oct 04 22:08:10.418049 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3542/7064] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:10 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:11.443453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-824e6af6-cd5f-474c-8f7d-148889f6a563 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:11.444074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-824e6af6-cd5f-474c-8f7d-148889f6a563 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:11.451989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-824e6af6-cd5f-474c-8f7d-148889f6a563 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:11.452479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-824e6af6-cd5f-474c-8f7d-148889f6a563 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:11.452924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-824e6af6-cd5f-474c-8f7d-148889f6a563 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:11.453656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-824e6af6-cd5f-474c-8f7d-148889f6a563 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:11.454119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-824e6af6-cd5f-474c-8f7d-148889f6a563 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:11.454549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-824e6af6-cd5f-474c-8f7d-148889f6a563 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:11.583272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-824e6af6-cd5f-474c-8f7d-148889f6a563 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:11.586788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:11.591350 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-824e6af6-cd5f-474c-8f7d-148889f6a563 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.151824 Oct 04 22:08:11.591943 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3523/7065] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:11 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:12.614734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b7988f68-87d3-4ea1-babb-ecbffcc9ab8e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:12.615429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b7988f68-87d3-4ea1-babb-ecbffcc9ab8e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:12.618115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:12.623045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7988f68-87d3-4ea1-babb-ecbffcc9ab8e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:12.623549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7988f68-87d3-4ea1-babb-ecbffcc9ab8e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:12.624011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7988f68-87d3-4ea1-babb-ecbffcc9ab8e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:12.624721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7988f68-87d3-4ea1-babb-ecbffcc9ab8e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:12.625200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7988f68-87d3-4ea1-babb-ecbffcc9ab8e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:12.625675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7988f68-87d3-4ea1-babb-ecbffcc9ab8e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:12.629607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:12.759894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b7988f68-87d3-4ea1-babb-ecbffcc9ab8e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:12.767561 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b7988f68-87d3-4ea1-babb-ecbffcc9ab8e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.156780 Oct 04 22:08:12.768403 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3543/7066] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:12 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:13.791275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-41149cfe-3662-4ee3-b9d7-0f446f80cb1c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:13.792495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-41149cfe-3662-4ee3-b9d7-0f446f80cb1c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:13.799926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41149cfe-3662-4ee3-b9d7-0f446f80cb1c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:13.800412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41149cfe-3662-4ee3-b9d7-0f446f80cb1c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:13.800853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41149cfe-3662-4ee3-b9d7-0f446f80cb1c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:13.801575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41149cfe-3662-4ee3-b9d7-0f446f80cb1c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:13.802058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41149cfe-3662-4ee3-b9d7-0f446f80cb1c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:13.802490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-41149cfe-3662-4ee3-b9d7-0f446f80cb1c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:13.937444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-41149cfe-3662-4ee3-b9d7-0f446f80cb1c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:13.945369 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-41149cfe-3662-4ee3-b9d7-0f446f80cb1c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.158055 Oct 04 22:08:13.945993 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3524/7067] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:13 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:14.969068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0662d675-188f-4672-97af-938ad2e53282 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:14.969767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0662d675-188f-4672-97af-938ad2e53282 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:14.976024 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0662d675-188f-4672-97af-938ad2e53282 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:14.976529 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0662d675-188f-4672-97af-938ad2e53282 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:14.976992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0662d675-188f-4672-97af-938ad2e53282 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:14.977831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0662d675-188f-4672-97af-938ad2e53282 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:14.978312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0662d675-188f-4672-97af-938ad2e53282 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:14.978775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0662d675-188f-4672-97af-938ad2e53282 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:15.107971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0662d675-188f-4672-97af-938ad2e53282 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:15.116340 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0662d675-188f-4672-97af-938ad2e53282 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.151890 Oct 04 22:08:15.116927 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3544/7068] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:14 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:16.139760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f47e512d-59b1-4aff-8d70-7c8a07c760fa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:16.140370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f47e512d-59b1-4aff-8d70-7c8a07c760fa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:16.142636 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=43 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:16.148152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f47e512d-59b1-4aff-8d70-7c8a07c760fa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:16.148639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f47e512d-59b1-4aff-8d70-7c8a07c760fa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:16.149074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f47e512d-59b1-4aff-8d70-7c8a07c760fa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:16.149794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f47e512d-59b1-4aff-8d70-7c8a07c760fa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:16.150241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f47e512d-59b1-4aff-8d70-7c8a07c760fa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:16.150696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f47e512d-59b1-4aff-8d70-7c8a07c760fa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:16.285143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f47e512d-59b1-4aff-8d70-7c8a07c760fa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:16.294775 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f47e512d-59b1-4aff-8d70-7c8a07c760fa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.159286 Oct 04 22:08:16.295365 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3525/7069] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:16 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:17.318600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-32889aa5-f84d-4848-851b-e634618c227c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:17.319132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-32889aa5-f84d-4848-851b-e634618c227c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:17.326131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32889aa5-f84d-4848-851b-e634618c227c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:17.326630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32889aa5-f84d-4848-851b-e634618c227c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:17.327116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32889aa5-f84d-4848-851b-e634618c227c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:17.327826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32889aa5-f84d-4848-851b-e634618c227c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:17.328304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32889aa5-f84d-4848-851b-e634618c227c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:17.328748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-32889aa5-f84d-4848-851b-e634618c227c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:17.458668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-32889aa5-f84d-4848-851b-e634618c227c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:17.467392 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-32889aa5-f84d-4848-851b-e634618c227c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.152861 Oct 04 22:08:17.467976 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3545/7070] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:17 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:18.490616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-73ba6352-0e52-46b0-b330-e4a9c1c8496c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:18.491238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-73ba6352-0e52-46b0-b330-e4a9c1c8496c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:18.498845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73ba6352-0e52-46b0-b330-e4a9c1c8496c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:18.499330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73ba6352-0e52-46b0-b330-e4a9c1c8496c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:18.499771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73ba6352-0e52-46b0-b330-e4a9c1c8496c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:18.500460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73ba6352-0e52-46b0-b330-e4a9c1c8496c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:18.500916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73ba6352-0e52-46b0-b330-e4a9c1c8496c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:18.501341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73ba6352-0e52-46b0-b330-e4a9c1c8496c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:18.629623 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-73ba6352-0e52-46b0-b330-e4a9c1c8496c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:18.638169 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-73ba6352-0e52-46b0-b330-e4a9c1c8496c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.150649 Oct 04 22:08:18.638754 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3526/7071] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:18 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:19.662441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-59a08f3d-f25a-47a8-9f1e-6e99f0791803 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:19.663104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-59a08f3d-f25a-47a8-9f1e-6e99f0791803 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:19.670948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59a08f3d-f25a-47a8-9f1e-6e99f0791803 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:19.671484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59a08f3d-f25a-47a8-9f1e-6e99f0791803 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:19.671938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59a08f3d-f25a-47a8-9f1e-6e99f0791803 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:19.672647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59a08f3d-f25a-47a8-9f1e-6e99f0791803 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:19.673120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59a08f3d-f25a-47a8-9f1e-6e99f0791803 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:19.673597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59a08f3d-f25a-47a8-9f1e-6e99f0791803 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:19.807600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-59a08f3d-f25a-47a8-9f1e-6e99f0791803 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:19.816464 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-59a08f3d-f25a-47a8-9f1e-6e99f0791803 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.157951 Oct 04 22:08:19.821038 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3546/7072] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:19 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:20.843217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4a744b80-1446-4d6f-a290-6e358b358b40 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:20.843816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4a744b80-1446-4d6f-a290-6e358b358b40 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:20.850734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a744b80-1446-4d6f-a290-6e358b358b40 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:20.851216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a744b80-1446-4d6f-a290-6e358b358b40 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:20.851649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a744b80-1446-4d6f-a290-6e358b358b40 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:20.852421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a744b80-1446-4d6f-a290-6e358b358b40 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:20.852924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a744b80-1446-4d6f-a290-6e358b358b40 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:20.853374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a744b80-1446-4d6f-a290-6e358b358b40 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:20.983336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4a744b80-1446-4d6f-a290-6e358b358b40 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:20.991066 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4a744b80-1446-4d6f-a290-6e358b358b40 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.152483 Oct 04 22:08:20.991632 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3527/7073] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:20 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:22.014495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-51983bca-7a16-4712-b0d5-43c8ac52205d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:22.015136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-51983bca-7a16-4712-b0d5-43c8ac52205d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:22.022413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51983bca-7a16-4712-b0d5-43c8ac52205d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:22.022917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51983bca-7a16-4712-b0d5-43c8ac52205d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:22.023378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51983bca-7a16-4712-b0d5-43c8ac52205d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:22.024121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51983bca-7a16-4712-b0d5-43c8ac52205d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:22.024602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51983bca-7a16-4712-b0d5-43c8ac52205d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:22.025050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-51983bca-7a16-4712-b0d5-43c8ac52205d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:22.156629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-51983bca-7a16-4712-b0d5-43c8ac52205d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:22.164439 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-51983bca-7a16-4712-b0d5-43c8ac52205d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.154450 Oct 04 22:08:22.165015 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3547/7074] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:22 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:23.188204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b7856423-84ff-4baa-9599-a21b98e1e8cb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:23.188857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b7856423-84ff-4baa-9599-a21b98e1e8cb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:23.195683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7856423-84ff-4baa-9599-a21b98e1e8cb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:23.196171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7856423-84ff-4baa-9599-a21b98e1e8cb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:23.196612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7856423-84ff-4baa-9599-a21b98e1e8cb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:23.197310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7856423-84ff-4baa-9599-a21b98e1e8cb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:23.197797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7856423-84ff-4baa-9599-a21b98e1e8cb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:23.198232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b7856423-84ff-4baa-9599-a21b98e1e8cb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:23.327384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b7856423-84ff-4baa-9599-a21b98e1e8cb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:23.335090 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b7856423-84ff-4baa-9599-a21b98e1e8cb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1520 microversion: 2.1 time: 0.150809 Oct 04 22:08:23.335677 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3528/7075] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:23 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:24.359169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1eb0bb05-4dfb-4dec-bf22-7fcb1b96a48b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:24.359817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1eb0bb05-4dfb-4dec-bf22-7fcb1b96a48b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:24.368437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-b7b14cfd-bd1e-4ae8-b16f-55fbfc23c059 req-1dc791d5-91c3-410a-bd33-c8326f174000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d5e9b5-39f2-4ec4-8f98-ac29d44bad89", "name": "network-vif-unplugged", "status": "completed", "tag": "f87a0eab-885b-4d4a-80a3-3b1873296c10"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:24.368922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1eb0bb05-4dfb-4dec-bf22-7fcb1b96a48b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:24.368922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1eb0bb05-4dfb-4dec-bf22-7fcb1b96a48b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:24.368922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1eb0bb05-4dfb-4dec-bf22-7fcb1b96a48b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:24.368922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1eb0bb05-4dfb-4dec-bf22-7fcb1b96a48b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:24.368922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1eb0bb05-4dfb-4dec-bf22-7fcb1b96a48b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:24.369349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1eb0bb05-4dfb-4dec-bf22-7fcb1b96a48b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:24.378240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b7b14cfd-bd1e-4ae8-b16f-55fbfc23c059 req-1dc791d5-91c3-410a-bd33-c8326f174000 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:24.378813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b7b14cfd-bd1e-4ae8-b16f-55fbfc23c059 req-1dc791d5-91c3-410a-bd33-c8326f174000 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:24.379325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b7b14cfd-bd1e-4ae8-b16f-55fbfc23c059 req-1dc791d5-91c3-410a-bd33-c8326f174000 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:24.391628 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-b7b14cfd-bd1e-4ae8-b16f-55fbfc23c059 req-1dc791d5-91c3-410a-bd33-c8326f174000 service nova] Creating event network-vif-unplugged:f87a0eab-885b-4d4a-80a3-3b1873296c10 for instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 on n-h1-860282-1 Oct 04 22:08:24.397561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-b7b14cfd-bd1e-4ae8-b16f-55fbfc23c059 req-1dc791d5-91c3-410a-bd33-c8326f174000 service nova] Instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:08:24.408844 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-b7b14cfd-bd1e-4ae8-b16f-55fbfc23c059 req-1dc791d5-91c3-410a-bd33-c8326f174000 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046277 Oct 04 22:08:24.409492 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3529/7076] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:08:24.510180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1eb0bb05-4dfb-4dec-bf22-7fcb1b96a48b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:24.523093 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1eb0bb05-4dfb-4dec-bf22-7fcb1b96a48b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1519 microversion: 2.1 time: 0.164889 Oct 04 22:08:24.523093 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3548/7077] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:24 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:08:25.546423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5a2e3f1e-de99-43a3-ae3d-fcaee38479df tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:25.547244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5a2e3f1e-de99-43a3-ae3d-fcaee38479df tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:25.553525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a2e3f1e-de99-43a3-ae3d-fcaee38479df tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:25.557366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a2e3f1e-de99-43a3-ae3d-fcaee38479df tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:25.557366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a2e3f1e-de99-43a3-ae3d-fcaee38479df tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:25.557366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a2e3f1e-de99-43a3-ae3d-fcaee38479df tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:25.557366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a2e3f1e-de99-43a3-ae3d-fcaee38479df tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:25.557366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5a2e3f1e-de99-43a3-ae3d-fcaee38479df tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:25.691227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5a2e3f1e-de99-43a3-ae3d-fcaee38479df tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:25.699133 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5a2e3f1e-de99-43a3-ae3d-fcaee38479df tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1517 microversion: 2.1 time: 0.158168 Oct 04 22:08:25.699723 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3530/7078] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:25 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:26.424524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-4ac1fa24-9b70-4dde-a55e-73b3b4151233 req-98fedabc-3ddc-46b8-bd34-4a33e03ecfc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d5e9b5-39f2-4ec4-8f98-ac29d44bad89", "tag": "f87a0eab-885b-4d4a-80a3-3b1873296c10"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:26.435564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4ac1fa24-9b70-4dde-a55e-73b3b4151233 req-98fedabc-3ddc-46b8-bd34-4a33e03ecfc8 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:26.436052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4ac1fa24-9b70-4dde-a55e-73b3b4151233 req-98fedabc-3ddc-46b8-bd34-4a33e03ecfc8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:26.436502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4ac1fa24-9b70-4dde-a55e-73b3b4151233 req-98fedabc-3ddc-46b8-bd34-4a33e03ecfc8 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:26.448003 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-4ac1fa24-9b70-4dde-a55e-73b3b4151233 req-98fedabc-3ddc-46b8-bd34-4a33e03ecfc8 service nova] Creating event network-changed:f87a0eab-885b-4d4a-80a3-3b1873296c10 for instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 on n-h1-860282-1 Oct 04 22:08:26.453217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [req-4ac1fa24-9b70-4dde-a55e-73b3b4151233 req-98fedabc-3ddc-46b8-bd34-4a33e03ecfc8 service nova] Instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122757) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:08:26.464119 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-4ac1fa24-9b70-4dde-a55e-73b3b4151233 req-98fedabc-3ddc-46b8-bd34-4a33e03ecfc8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043309 Oct 04 22:08:26.464722 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3549/7079] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:08:26.722847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-15df5b5d-5ae8-489d-bf1f-39481e2fd685 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:26.723478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-15df5b5d-5ae8-489d-bf1f-39481e2fd685 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:26.732423 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15df5b5d-5ae8-489d-bf1f-39481e2fd685 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:26.733043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15df5b5d-5ae8-489d-bf1f-39481e2fd685 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:26.733526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15df5b5d-5ae8-489d-bf1f-39481e2fd685 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:26.734249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15df5b5d-5ae8-489d-bf1f-39481e2fd685 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:26.734710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15df5b5d-5ae8-489d-bf1f-39481e2fd685 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:26.735141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-15df5b5d-5ae8-489d-bf1f-39481e2fd685 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:27.130392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-15df5b5d-5ae8-489d-bf1f-39481e2fd685 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:27.156114 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-15df5b5d-5ae8-489d-bf1f-39481e2fd685 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1517 microversion: 2.1 time: 0.437181 Oct 04 22:08:27.156965 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3531/7080] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:26 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1517 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:28.180483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b844f6a8-418c-4c9f-b3cc-8cdaa73da405 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:28.181201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b844f6a8-418c-4c9f-b3cc-8cdaa73da405 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:28.189199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b844f6a8-418c-4c9f-b3cc-8cdaa73da405 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:28.189808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b844f6a8-418c-4c9f-b3cc-8cdaa73da405 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:28.190260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b844f6a8-418c-4c9f-b3cc-8cdaa73da405 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:28.190961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b844f6a8-418c-4c9f-b3cc-8cdaa73da405 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:28.191431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b844f6a8-418c-4c9f-b3cc-8cdaa73da405 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:28.191872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b844f6a8-418c-4c9f-b3cc-8cdaa73da405 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:28.330281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b844f6a8-418c-4c9f-b3cc-8cdaa73da405 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:28.338074 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b844f6a8-418c-4c9f-b3cc-8cdaa73da405 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1514 microversion: 2.1 time: 0.161991 Oct 04 22:08:28.338652 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3550/7081] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:28 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:28.361178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fff3ef9e-1143-4c06-9560-069400888653 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:28.361744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fff3ef9e-1143-4c06-9560-069400888653 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:28.368437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fff3ef9e-1143-4c06-9560-069400888653 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:28.368930 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fff3ef9e-1143-4c06-9560-069400888653 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:28.369410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fff3ef9e-1143-4c06-9560-069400888653 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:28.370134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fff3ef9e-1143-4c06-9560-069400888653 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:28.370592 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fff3ef9e-1143-4c06-9560-069400888653 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:28.371049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fff3ef9e-1143-4c06-9560-069400888653 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:28.580711 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fff3ef9e-1143-4c06-9560-069400888653 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "POST /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89/action" status: 204 len: 0 microversion: 2.1 time: 0.223218 Oct 04 22:08:28.581390 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3532/7082] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:08:28 2022] POST /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89/action => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:08:28.590608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-090393ed-4dd1-4825-986d-a12018dd2c53 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:28.591233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-090393ed-4dd1-4825-986d-a12018dd2c53 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:28.597709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-090393ed-4dd1-4825-986d-a12018dd2c53 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:28.598217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-090393ed-4dd1-4825-986d-a12018dd2c53 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:28.598669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-090393ed-4dd1-4825-986d-a12018dd2c53 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:28.599399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-090393ed-4dd1-4825-986d-a12018dd2c53 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:28.599854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-090393ed-4dd1-4825-986d-a12018dd2c53 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:28.600299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-090393ed-4dd1-4825-986d-a12018dd2c53 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:28.781677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-090393ed-4dd1-4825-986d-a12018dd2c53 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:28.789876 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-090393ed-4dd1-4825-986d-a12018dd2c53 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1514 microversion: 2.1 time: 0.203826 Oct 04 22:08:28.790802 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3551/7083] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:28 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:29.814345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8092bfe7-b679-407e-b1ea-70a73834989a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:29.815048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8092bfe7-b679-407e-b1ea-70a73834989a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:29.821235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8092bfe7-b679-407e-b1ea-70a73834989a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:29.821767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8092bfe7-b679-407e-b1ea-70a73834989a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:29.822211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8092bfe7-b679-407e-b1ea-70a73834989a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:29.822911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8092bfe7-b679-407e-b1ea-70a73834989a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:29.823366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8092bfe7-b679-407e-b1ea-70a73834989a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:29.823792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8092bfe7-b679-407e-b1ea-70a73834989a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:29.959298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8092bfe7-b679-407e-b1ea-70a73834989a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:29.967178 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8092bfe7-b679-407e-b1ea-70a73834989a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1514 microversion: 2.1 time: 0.158664 Oct 04 22:08:29.967812 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3533/7084] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:29 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:30.989956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-02e351cb-35dd-44bc-bddd-35d300680a75 req-25e60043-b878-41e7-a45d-10d0594990cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d5e9b5-39f2-4ec4-8f98-ac29d44bad89", "name": "network-vif-plugged", "status": "completed", "tag": "f87a0eab-885b-4d4a-80a3-3b1873296c10"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:30.995569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-81187515-74b7-4d6e-92ce-0c5ea81735ba tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:30.996217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-81187515-74b7-4d6e-92ce-0c5ea81735ba tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:31.003232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81187515-74b7-4d6e-92ce-0c5ea81735ba tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:31.003718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81187515-74b7-4d6e-92ce-0c5ea81735ba tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:31.004154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81187515-74b7-4d6e-92ce-0c5ea81735ba tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:31.004848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81187515-74b7-4d6e-92ce-0c5ea81735ba tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:31.005305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81187515-74b7-4d6e-92ce-0c5ea81735ba tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:31.005492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-02e351cb-35dd-44bc-bddd-35d300680a75 req-25e60043-b878-41e7-a45d-10d0594990cb service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:31.005759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81187515-74b7-4d6e-92ce-0c5ea81735ba tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:31.005893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-02e351cb-35dd-44bc-bddd-35d300680a75 req-25e60043-b878-41e7-a45d-10d0594990cb service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:31.006353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-02e351cb-35dd-44bc-bddd-35d300680a75 req-25e60043-b878-41e7-a45d-10d0594990cb service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:31.018391 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-02e351cb-35dd-44bc-bddd-35d300680a75 req-25e60043-b878-41e7-a45d-10d0594990cb service nova] Creating event network-vif-plugged:f87a0eab-885b-4d4a-80a3-3b1873296c10 for instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 on n-h1-860282-1 Oct 04 22:08:31.023531 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-02e351cb-35dd-44bc-bddd-35d300680a75 req-25e60043-b878-41e7-a45d-10d0594990cb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037630 Oct 04 22:08:31.032390 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3552/7085] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:08:31.142673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-81187515-74b7-4d6e-92ce-0c5ea81735ba tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:31.150913 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-81187515-74b7-4d6e-92ce-0c5ea81735ba tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1506 microversion: 2.1 time: 0.159357 Oct 04 22:08:31.151485 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3534/7086] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:30 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:31.173868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ed15e177-f9d9-4a07-9931-bda06e223e9e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:31.174605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ed15e177-f9d9-4a07-9931-bda06e223e9e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:31.180809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed15e177-f9d9-4a07-9931-bda06e223e9e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:31.181320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed15e177-f9d9-4a07-9931-bda06e223e9e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:31.181808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed15e177-f9d9-4a07-9931-bda06e223e9e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:31.182520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed15e177-f9d9-4a07-9931-bda06e223e9e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:31.182999 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed15e177-f9d9-4a07-9931-bda06e223e9e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:31.183453 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ed15e177-f9d9-4a07-9931-bda06e223e9e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:31.315418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ed15e177-f9d9-4a07-9931-bda06e223e9e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:31.323434 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ed15e177-f9d9-4a07-9931-bda06e223e9e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1506 microversion: 2.1 time: 0.153908 Oct 04 22:08:31.324011 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3553/7087] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:31 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:31.349236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a1d534dc-4db3-4071-b574-0cd8e2f26ddf tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Action: 'create', calling method: .version_select at 0x7f57906c4a60>, body: {"keypair": {"name": "tempest-keypair-36208735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHi6Wyh4sOIKMDxJurFiRss32JFGstMG7Ol7QRKvWKRTPlzmSm1TtbDdagusQ7D3zFbD9UlHP6z/50Y1SPWpEYqBBFgGcKpVVUQmxhZCUhKgORw1Klz1ybD/V/F6A/ZuEw=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:31.365615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-a1d534dc-4db3-4071-b574-0cd8e2f26ddf tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Getting quotas for project 6072248a19c841778fe06ccea68ecf57. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:08:31.370627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-a1d534dc-4db3-4071-b574-0cd8e2f26ddf tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Getting quotas for user 6f3b0a36cdc245f69ed52226192b12fc and project 6072248a19c841778fe06ccea68ecf57. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:08:31.456582 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a1d534dc-4db3-4071-b574-0cd8e2f26ddf tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.111094 Oct 04 22:08:31.457246 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3535/7088] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 22:08:31 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:08:33.357697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ee64ce73-711e-4734-bc3b-da3b5b4f049a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:33.358454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ee64ce73-711e-4734-bc3b-da3b5b4f049a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:33.365392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee64ce73-711e-4734-bc3b-da3b5b4f049a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:33.365920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee64ce73-711e-4734-bc3b-da3b5b4f049a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:33.366376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee64ce73-711e-4734-bc3b-da3b5b4f049a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:33.367150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee64ce73-711e-4734-bc3b-da3b5b4f049a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:33.367613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee64ce73-711e-4734-bc3b-da3b5b4f049a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:33.368054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee64ce73-711e-4734-bc3b-da3b5b4f049a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:33.502205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ee64ce73-711e-4734-bc3b-da3b5b4f049a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:33.510021 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ee64ce73-711e-4734-bc3b-da3b5b4f049a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 200 len: 1506 microversion: 2.1 time: 0.156349 Oct 04 22:08:33.510603 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3554/7089] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:33 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:33.534128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b5220f29-2eba-4da2-aeeb-cbe2f70e4c11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:33.535246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b5220f29-2eba-4da2-aeeb-cbe2f70e4c11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:33.542156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5220f29-2eba-4da2-aeeb-cbe2f70e4c11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:33.542655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5220f29-2eba-4da2-aeeb-cbe2f70e4c11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:33.543785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5220f29-2eba-4da2-aeeb-cbe2f70e4c11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:33.544499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5220f29-2eba-4da2-aeeb-cbe2f70e4c11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:33.544964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5220f29-2eba-4da2-aeeb-cbe2f70e4c11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:33.545401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5220f29-2eba-4da2-aeeb-cbe2f70e4c11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:33.569686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b5220f29-2eba-4da2-aeeb-cbe2f70e4c11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:08:33.769513 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b5220f29-2eba-4da2-aeeb-cbe2f70e4c11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "DELETE /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 204 len: 0 microversion: 2.1 time: 0.239935 Oct 04 22:08:33.770067 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3536/7090] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:08:33 2022] DELETE /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:08:33.828125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-12be28f8-92f3-427b-a2e8-f28f3ed881fe tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-767323549", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "b3ebe20c-fac1-4797-96a4-eea925dcb937"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:33.882468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-12be28f8-92f3-427b-a2e8-f28f3ed881fe tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] validate_networks() for [('b3ebe20c-fac1-4797-96a4-eea925dcb937', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:08:34.251638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-12be28f8-92f3-427b-a2e8-f28f3ed881fe tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:08:34.252261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-12be28f8-92f3-427b-a2e8-f28f3ed881fe tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:08:34.252809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-12be28f8-92f3-427b-a2e8-f28f3ed881fe tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:08:34.253248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-12be28f8-92f3-427b-a2e8-f28f3ed881fe tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:08:34.253714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-12be28f8-92f3-427b-a2e8-f28f3ed881fe tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:08:34.263335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12be28f8-92f3-427b-a2e8-f28f3ed881fe tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:34.263843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12be28f8-92f3-427b-a2e8-f28f3ed881fe tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:34.264303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12be28f8-92f3-427b-a2e8-f28f3ed881fe tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:34.265061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12be28f8-92f3-427b-a2e8-f28f3ed881fe tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:34.265577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12be28f8-92f3-427b-a2e8-f28f3ed881fe tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:34.266030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12be28f8-92f3-427b-a2e8-f28f3ed881fe tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:34.283388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-12be28f8-92f3-427b-a2e8-f28f3ed881fe tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Getting quotas for project 6072248a19c841778fe06ccea68ecf57. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:08:34.288609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-12be28f8-92f3-427b-a2e8-f28f3ed881fe tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Getting quotas for user 6f3b0a36cdc245f69ed52226192b12fc and project 6072248a19c841778fe06ccea68ecf57. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:08:34.300828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-12be28f8-92f3-427b-a2e8-f28f3ed881fe tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:08:34.303157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-12be28f8-92f3-427b-a2e8-f28f3ed881fe tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:08:34.406853 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-12be28f8-92f3-427b-a2e8-f28f3ed881fe tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.582941 Oct 04 22:08:34.407798 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3555/7091] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:08:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:08:34.420305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3df2eda3-fc0b-4203-b986-728d6154b77a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:34.421209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3df2eda3-fc0b-4203-b986-728d6154b77a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:34.475990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3df2eda3-fc0b-4203-b986-728d6154b77a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:34.483949 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3df2eda3-fc0b-4203-b986-728d6154b77a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1217 microversion: 2.1 time: 0.068714 Oct 04 22:08:34.484544 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3537/7092] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:34 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:35.515947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-45d83261-8f13-4dd2-9939-efaa1ce5d126 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:35.518115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-45d83261-8f13-4dd2-9939-efaa1ce5d126 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:35.545752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45d83261-8f13-4dd2-9939-efaa1ce5d126 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:35.546285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45d83261-8f13-4dd2-9939-efaa1ce5d126 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:35.554299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45d83261-8f13-4dd2-9939-efaa1ce5d126 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:35.555704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45d83261-8f13-4dd2-9939-efaa1ce5d126 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:35.556295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45d83261-8f13-4dd2-9939-efaa1ce5d126 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:35.556860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45d83261-8f13-4dd2-9939-efaa1ce5d126 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:35.639056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-3414ccf2-df97-43aa-9db9-caa6a9ad7b6e req-cd185e5d-6080-454b-b203-dd15b346452a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d5e9b5-39f2-4ec4-8f98-ac29d44bad89", "name": "network-vif-deleted", "tag": "f87a0eab-885b-4d4a-80a3-3b1873296c10"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:35.656060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3414ccf2-df97-43aa-9db9-caa6a9ad7b6e req-cd185e5d-6080-454b-b203-dd15b346452a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:35.659742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3414ccf2-df97-43aa-9db9-caa6a9ad7b6e req-cd185e5d-6080-454b-b203-dd15b346452a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:35.660470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3414ccf2-df97-43aa-9db9-caa6a9ad7b6e req-cd185e5d-6080-454b-b203-dd15b346452a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:35.662541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-45d83261-8f13-4dd2-9939-efaa1ce5d126 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:35.675768 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-45d83261-8f13-4dd2-9939-efaa1ce5d126 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1213 microversion: 2.1 time: 0.172869 Oct 04 22:08:35.682499 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3556/7093] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:35 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1213 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:35.687467 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-3414ccf2-df97-43aa-9db9-caa6a9ad7b6e req-cd185e5d-6080-454b-b203-dd15b346452a service nova] Creating event network-vif-deleted:f87a0eab-885b-4d4a-80a3-3b1873296c10 for instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 on n-h1-860282-1 Oct 04 22:08:35.697545 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-3414ccf2-df97-43aa-9db9-caa6a9ad7b6e req-cd185e5d-6080-454b-b203-dd15b346452a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062395 Oct 04 22:08:35.698156 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3538/7094] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:08:36.700065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e3fa3d6b-e056-4cfa-b6cb-3c929b536ba9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:36.700930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e3fa3d6b-e056-4cfa-b6cb-3c929b536ba9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:36.708543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3fa3d6b-e056-4cfa-b6cb-3c929b536ba9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:36.709129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3fa3d6b-e056-4cfa-b6cb-3c929b536ba9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:36.709644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3fa3d6b-e056-4cfa-b6cb-3c929b536ba9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:36.710365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3fa3d6b-e056-4cfa-b6cb-3c929b536ba9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:36.710854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3fa3d6b-e056-4cfa-b6cb-3c929b536ba9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:36.711310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e3fa3d6b-e056-4cfa-b6cb-3c929b536ba9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:36.776826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e3fa3d6b-e056-4cfa-b6cb-3c929b536ba9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:36.785806 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e3fa3d6b-e056-4cfa-b6cb-3c929b536ba9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1275 microversion: 2.1 time: 0.090402 Oct 04 22:08:36.786404 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3557/7095] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:36 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1275 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:37.812552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5fcd4410-ca26-47ab-9b61-399e6f182134 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:37.813404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5fcd4410-ca26-47ab-9b61-399e6f182134 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:37.821102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5fcd4410-ca26-47ab-9b61-399e6f182134 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:37.821556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5fcd4410-ca26-47ab-9b61-399e6f182134 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:37.822002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5fcd4410-ca26-47ab-9b61-399e6f182134 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:37.822702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5fcd4410-ca26-47ab-9b61-399e6f182134 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:37.823167 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5fcd4410-ca26-47ab-9b61-399e6f182134 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:37.823649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5fcd4410-ca26-47ab-9b61-399e6f182134 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:37.964632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5fcd4410-ca26-47ab-9b61-399e6f182134 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:37.972746 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5fcd4410-ca26-47ab-9b61-399e6f182134 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1317 microversion: 2.1 time: 0.167167 Oct 04 22:08:37.973510 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3539/7096] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:37 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:37.994688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-0fdc79e0-ae99-46c4-b228-20e532cabe70 req-658c0fe7-bd9a-405c-b965-c2f562303c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83be1eed-1422-4903-875c-291f60851e10", "tag": "cdf1e163-ccb2-462c-bb5f-614f7e5a6b88"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:38.005791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0fdc79e0-ae99-46c4-b228-20e532cabe70 req-658c0fe7-bd9a-405c-b965-c2f562303c1a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:38.006294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0fdc79e0-ae99-46c4-b228-20e532cabe70 req-658c0fe7-bd9a-405c-b965-c2f562303c1a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:38.006932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0fdc79e0-ae99-46c4-b228-20e532cabe70 req-658c0fe7-bd9a-405c-b965-c2f562303c1a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:38.018781 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-0fdc79e0-ae99-46c4-b228-20e532cabe70 req-658c0fe7-bd9a-405c-b965-c2f562303c1a service nova] Creating event network-changed:cdf1e163-ccb2-462c-bb5f-614f7e5a6b88 for instance 83be1eed-1422-4903-875c-291f60851e10 on n-h1-860282-1 Oct 04 22:08:38.023995 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-0fdc79e0-ae99-46c4-b228-20e532cabe70 req-658c0fe7-bd9a-405c-b965-c2f562303c1a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033236 Oct 04 22:08:38.031192 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3558/7097] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:08:38.997213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4004d126-2453-435f-b9b6-11f2594a6d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:39.002763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4004d126-2453-435f-b9b6-11f2594a6d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:39.005414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4004d126-2453-435f-b9b6-11f2594a6d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:39.005933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4004d126-2453-435f-b9b6-11f2594a6d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:39.006448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4004d126-2453-435f-b9b6-11f2594a6d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:39.007217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4004d126-2453-435f-b9b6-11f2594a6d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:39.007681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4004d126-2453-435f-b9b6-11f2594a6d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:39.008111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4004d126-2453-435f-b9b6-11f2594a6d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:39.141383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4004d126-2453-435f-b9b6-11f2594a6d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:39.143971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:39.150114 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4004d126-2453-435f-b9b6-11f2594a6d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1317 microversion: 2.1 time: 0.157590 Oct 04 22:08:39.150698 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3540/7098] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:38 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:40.174671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-efdd7a7d-63e2-42b0-9015-9ff2ee3a187d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:40.175406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-efdd7a7d-63e2-42b0-9015-9ff2ee3a187d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:40.182112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efdd7a7d-63e2-42b0-9015-9ff2ee3a187d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:40.182621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efdd7a7d-63e2-42b0-9015-9ff2ee3a187d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:40.183087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efdd7a7d-63e2-42b0-9015-9ff2ee3a187d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:40.184621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efdd7a7d-63e2-42b0-9015-9ff2ee3a187d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:40.185103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efdd7a7d-63e2-42b0-9015-9ff2ee3a187d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:40.185587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efdd7a7d-63e2-42b0-9015-9ff2ee3a187d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:40.322746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-efdd7a7d-63e2-42b0-9015-9ff2ee3a187d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:40.331069 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-efdd7a7d-63e2-42b0-9015-9ff2ee3a187d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1317 microversion: 2.1 time: 0.162133 Oct 04 22:08:40.331651 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3559/7099] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:40 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:41.353962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f92fad09-731b-4a4b-9d88-0ded1b6fdb88 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:41.354571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f92fad09-731b-4a4b-9d88-0ded1b6fdb88 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:41.362864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f92fad09-731b-4a4b-9d88-0ded1b6fdb88 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:41.363283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f92fad09-731b-4a4b-9d88-0ded1b6fdb88 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:41.363716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f92fad09-731b-4a4b-9d88-0ded1b6fdb88 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:41.364413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f92fad09-731b-4a4b-9d88-0ded1b6fdb88 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:41.364865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f92fad09-731b-4a4b-9d88-0ded1b6fdb88 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:41.365294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f92fad09-731b-4a4b-9d88-0ded1b6fdb88 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:41.498517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f92fad09-731b-4a4b-9d88-0ded1b6fdb88 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:41.506887 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f92fad09-731b-4a4b-9d88-0ded1b6fdb88 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1317 microversion: 2.1 time: 0.156828 Oct 04 22:08:41.507475 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3541/7100] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:41 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:42.538942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b0df3642-1193-4d61-b2eb-4240f57ad03e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:42.539597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b0df3642-1193-4d61-b2eb-4240f57ad03e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:42.547306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b0df3642-1193-4d61-b2eb-4240f57ad03e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:42.547811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b0df3642-1193-4d61-b2eb-4240f57ad03e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:42.548262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b0df3642-1193-4d61-b2eb-4240f57ad03e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:42.548963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b0df3642-1193-4d61-b2eb-4240f57ad03e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:42.549440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b0df3642-1193-4d61-b2eb-4240f57ad03e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:42.549895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b0df3642-1193-4d61-b2eb-4240f57ad03e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:42.681595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b0df3642-1193-4d61-b2eb-4240f57ad03e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:42.689358 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b0df3642-1193-4d61-b2eb-4240f57ad03e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1317 microversion: 2.1 time: 0.154524 Oct 04 22:08:42.689967 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3560/7101] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:42 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:43.076428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-989f016f-1f66-4951-889d-908e32354c60 req-cbc0a2cd-9ce4-45e2-905f-a003e6cbfeff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83be1eed-1422-4903-875c-291f60851e10", "name": "network-vif-plugged", "status": "completed", "tag": "cdf1e163-ccb2-462c-bb5f-614f7e5a6b88"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:43.086779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-989f016f-1f66-4951-889d-908e32354c60 req-cbc0a2cd-9ce4-45e2-905f-a003e6cbfeff service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:43.087281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-989f016f-1f66-4951-889d-908e32354c60 req-cbc0a2cd-9ce4-45e2-905f-a003e6cbfeff service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:43.092006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-989f016f-1f66-4951-889d-908e32354c60 req-cbc0a2cd-9ce4-45e2-905f-a003e6cbfeff service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:43.099246 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-989f016f-1f66-4951-889d-908e32354c60 req-cbc0a2cd-9ce4-45e2-905f-a003e6cbfeff service nova] Creating event network-vif-plugged:cdf1e163-ccb2-462c-bb5f-614f7e5a6b88 for instance 83be1eed-1422-4903-875c-291f60851e10 on n-h1-860282-1 Oct 04 22:08:43.104292 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-989f016f-1f66-4951-889d-908e32354c60 req-cbc0a2cd-9ce4-45e2-905f-a003e6cbfeff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032118 Oct 04 22:08:43.105000 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3542/7102] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:08:43.711656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-808cc69b-4b12-4c13-a6df-7983af3d34a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:43.712290 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-808cc69b-4b12-4c13-a6df-7983af3d34a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:43.715897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:43.720607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-808cc69b-4b12-4c13-a6df-7983af3d34a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:43.721106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-808cc69b-4b12-4c13-a6df-7983af3d34a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:43.721600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-808cc69b-4b12-4c13-a6df-7983af3d34a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:43.722307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-808cc69b-4b12-4c13-a6df-7983af3d34a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:43.722779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-808cc69b-4b12-4c13-a6df-7983af3d34a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:43.723222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-808cc69b-4b12-4c13-a6df-7983af3d34a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:43.725822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=94 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:43.862118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-808cc69b-4b12-4c13-a6df-7983af3d34a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:43.869857 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-808cc69b-4b12-4c13-a6df-7983af3d34a8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1317 microversion: 2.1 time: 0.162155 Oct 04 22:08:43.870441 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3561/7103] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:43 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:44.890413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:44.894906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0d384cae-d4c0-4559-a4d0-e51836c923ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:44.895621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0d384cae-d4c0-4559-a4d0-e51836c923ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:44.901769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d384cae-d4c0-4559-a4d0-e51836c923ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:44.905698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d384cae-d4c0-4559-a4d0-e51836c923ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:44.905698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d384cae-d4c0-4559-a4d0-e51836c923ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:44.905698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d384cae-d4c0-4559-a4d0-e51836c923ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:44.905698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d384cae-d4c0-4559-a4d0-e51836c923ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:44.905698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0d384cae-d4c0-4559-a4d0-e51836c923ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:45.035677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0d384cae-d4c0-4559-a4d0-e51836c923ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:45.044385 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0d384cae-d4c0-4559-a4d0-e51836c923ac tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1507 microversion: 2.1 time: 0.155887 Oct 04 22:08:45.044959 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3543/7104] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:44 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:45.067486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e26d3197-28b0-443d-9ed1-979ff3573ef4 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:45.068117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e26d3197-28b0-443d-9ed1-979ff3573ef4 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:45.070109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:45.070796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:45.076832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e26d3197-28b0-443d-9ed1-979ff3573ef4 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:45.077336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e26d3197-28b0-443d-9ed1-979ff3573ef4 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:45.078431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e26d3197-28b0-443d-9ed1-979ff3573ef4 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:45.078617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e26d3197-28b0-443d-9ed1-979ff3573ef4 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:45.079078 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e26d3197-28b0-443d-9ed1-979ff3573ef4 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:45.079530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e26d3197-28b0-443d-9ed1-979ff3573ef4 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:45.218887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e26d3197-28b0-443d-9ed1-979ff3573ef4 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:45.226662 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e26d3197-28b0-443d-9ed1-979ff3573ef4 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1507 microversion: 2.1 time: 0.163159 Oct 04 22:08:45.227260 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3562/7105] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:45 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:45.250200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-afd3ebe1-ff04-419f-9be8-9f29a55959bd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:45.252457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-afd3ebe1-ff04-419f-9be8-9f29a55959bd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:45.258689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afd3ebe1-ff04-419f-9be8-9f29a55959bd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:45.259172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afd3ebe1-ff04-419f-9be8-9f29a55959bd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:45.259608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afd3ebe1-ff04-419f-9be8-9f29a55959bd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:45.260297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afd3ebe1-ff04-419f-9be8-9f29a55959bd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:45.260747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afd3ebe1-ff04-419f-9be8-9f29a55959bd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:45.261170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-afd3ebe1-ff04-419f-9be8-9f29a55959bd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:45.289868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-afd3ebe1-ff04-419f-9be8-9f29a55959bd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:45.295917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-afd3ebe1-ff04-419f-9be8-9f29a55959bd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Old instance type m1.heat2, new instance type m1.heat {{(pid=122758) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:08:45.302335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-afd3ebe1-ff04-419f-9be8-9f29a55959bd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:08:45.302755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-afd3ebe1-ff04-419f-9be8-9f29a55959bd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:08:45.303234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-afd3ebe1-ff04-419f-9be8-9f29a55959bd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:08:45.303640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-afd3ebe1-ff04-419f-9be8-9f29a55959bd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:08:45.304048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-afd3ebe1-ff04-419f-9be8-9f29a55959bd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:08:45.504607 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-afd3ebe1-ff04-419f-9be8-9f29a55959bd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "POST /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10/action" status: 202 len: 0 microversion: 2.1 time: 0.258865 Oct 04 22:08:45.508092 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3544/7106] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:08:45 2022] POST /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:08:45.514105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6d7126b8-33f5-486f-bdba-b05048ffc88d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:45.514756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6d7126b8-33f5-486f-bdba-b05048ffc88d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:45.521070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d7126b8-33f5-486f-bdba-b05048ffc88d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:45.521677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d7126b8-33f5-486f-bdba-b05048ffc88d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:45.522083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d7126b8-33f5-486f-bdba-b05048ffc88d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:45.522808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d7126b8-33f5-486f-bdba-b05048ffc88d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:45.523285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d7126b8-33f5-486f-bdba-b05048ffc88d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:45.523739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6d7126b8-33f5-486f-bdba-b05048ffc88d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:45.656403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6d7126b8-33f5-486f-bdba-b05048ffc88d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:45.664428 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6d7126b8-33f5-486f-bdba-b05048ffc88d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1514 microversion: 2.1 time: 0.154997 Oct 04 22:08:45.665008 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3563/7107] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:45 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:46.688304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6001a44b-ec04-4cef-b7f1-f90db5b8d079 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:46.688894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6001a44b-ec04-4cef-b7f1-f90db5b8d079 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:46.690715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:46.699816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6001a44b-ec04-4cef-b7f1-f90db5b8d079 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:46.700309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6001a44b-ec04-4cef-b7f1-f90db5b8d079 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:46.700744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6001a44b-ec04-4cef-b7f1-f90db5b8d079 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:46.701509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6001a44b-ec04-4cef-b7f1-f90db5b8d079 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:46.701963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6001a44b-ec04-4cef-b7f1-f90db5b8d079 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:46.702389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6001a44b-ec04-4cef-b7f1-f90db5b8d079 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:46.840215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6001a44b-ec04-4cef-b7f1-f90db5b8d079 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:46.848166 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6001a44b-ec04-4cef-b7f1-f90db5b8d079 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1514 microversion: 2.1 time: 0.165012 Oct 04 22:08:46.848793 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3545/7108] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:46 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:47.871565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-38f80209-e726-491c-9b8b-3bc9b820f402 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:47.872214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-38f80209-e726-491c-9b8b-3bc9b820f402 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:47.879955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38f80209-e726-491c-9b8b-3bc9b820f402 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:47.880469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38f80209-e726-491c-9b8b-3bc9b820f402 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:47.880930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38f80209-e726-491c-9b8b-3bc9b820f402 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:47.881679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38f80209-e726-491c-9b8b-3bc9b820f402 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:47.882160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38f80209-e726-491c-9b8b-3bc9b820f402 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:47.882610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38f80209-e726-491c-9b8b-3bc9b820f402 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:48.018651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-38f80209-e726-491c-9b8b-3bc9b820f402 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:48.026908 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-38f80209-e726-491c-9b8b-3bc9b820f402 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1514 microversion: 2.1 time: 0.159281 Oct 04 22:08:48.027484 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3564/7109] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:47 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:49.051140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-907df496-b674-44ec-a232-649efd9a204f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:49.051763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-907df496-b674-44ec-a232-649efd9a204f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:49.058892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-907df496-b674-44ec-a232-649efd9a204f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:49.059409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-907df496-b674-44ec-a232-649efd9a204f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:49.059853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-907df496-b674-44ec-a232-649efd9a204f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:49.060547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-907df496-b674-44ec-a232-649efd9a204f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:49.061659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-907df496-b674-44ec-a232-649efd9a204f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:49.062089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-907df496-b674-44ec-a232-649efd9a204f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:49.193251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-907df496-b674-44ec-a232-649efd9a204f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:49.201000 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-907df496-b674-44ec-a232-649efd9a204f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.153791 Oct 04 22:08:49.201929 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3546/7110] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:49 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:08:50.228480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-65336870-8c15-45fa-a32d-c39c6c4eebab tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:50.229036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-65336870-8c15-45fa-a32d-c39c6c4eebab tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:50.236579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65336870-8c15-45fa-a32d-c39c6c4eebab tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:50.237080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65336870-8c15-45fa-a32d-c39c6c4eebab tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:50.237629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65336870-8c15-45fa-a32d-c39c6c4eebab tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:50.238337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65336870-8c15-45fa-a32d-c39c6c4eebab tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:50.238808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65336870-8c15-45fa-a32d-c39c6c4eebab tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:50.239249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65336870-8c15-45fa-a32d-c39c6c4eebab tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:50.368475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-65336870-8c15-45fa-a32d-c39c6c4eebab tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:50.376629 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-65336870-8c15-45fa-a32d-c39c6c4eebab tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.152269 Oct 04 22:08:50.377217 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3565/7111] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:50 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:51.400541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4e9269b9-3366-468f-bd09-48706fe8f45d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:51.401201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4e9269b9-3366-468f-bd09-48706fe8f45d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:51.408459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e9269b9-3366-468f-bd09-48706fe8f45d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:51.408949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e9269b9-3366-468f-bd09-48706fe8f45d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:51.409392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e9269b9-3366-468f-bd09-48706fe8f45d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:51.410135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e9269b9-3366-468f-bd09-48706fe8f45d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:51.410593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e9269b9-3366-468f-bd09-48706fe8f45d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:51.411020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e9269b9-3366-468f-bd09-48706fe8f45d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:51.543567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4e9269b9-3366-468f-bd09-48706fe8f45d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:51.551316 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4e9269b9-3366-468f-bd09-48706fe8f45d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.154691 Oct 04 22:08:51.551891 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3547/7112] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:51 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:52.574481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b3adafb0-696d-435b-b456-59a530c31f09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:52.575056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b3adafb0-696d-435b-b456-59a530c31f09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:52.582101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3adafb0-696d-435b-b456-59a530c31f09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:52.582611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3adafb0-696d-435b-b456-59a530c31f09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:52.583096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3adafb0-696d-435b-b456-59a530c31f09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:52.583860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3adafb0-696d-435b-b456-59a530c31f09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:52.584337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3adafb0-696d-435b-b456-59a530c31f09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:52.584820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3adafb0-696d-435b-b456-59a530c31f09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:52.713250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b3adafb0-696d-435b-b456-59a530c31f09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:52.721936 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b3adafb0-696d-435b-b456-59a530c31f09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.151512 Oct 04 22:08:52.722521 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3566/7113] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:52 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:53.745796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-809893c1-00ce-4992-afdb-e9fd60b88f97 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:53.746415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-809893c1-00ce-4992-afdb-e9fd60b88f97 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:53.753952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-809893c1-00ce-4992-afdb-e9fd60b88f97 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:53.754442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-809893c1-00ce-4992-afdb-e9fd60b88f97 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:53.754875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-809893c1-00ce-4992-afdb-e9fd60b88f97 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:53.755565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-809893c1-00ce-4992-afdb-e9fd60b88f97 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:53.756014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-809893c1-00ce-4992-afdb-e9fd60b88f97 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:53.756442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-809893c1-00ce-4992-afdb-e9fd60b88f97 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:53.890341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-809893c1-00ce-4992-afdb-e9fd60b88f97 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:53.898462 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-809893c1-00ce-4992-afdb-e9fd60b88f97 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.156606 Oct 04 22:08:53.899041 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3548/7114] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:53 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:54.921590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3280c1b1-706b-441c-9469-eef9c8e8103f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:54.922313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3280c1b1-706b-441c-9469-eef9c8e8103f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:54.929351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3280c1b1-706b-441c-9469-eef9c8e8103f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:54.929884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3280c1b1-706b-441c-9469-eef9c8e8103f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:54.930342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3280c1b1-706b-441c-9469-eef9c8e8103f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:54.931049 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3280c1b1-706b-441c-9469-eef9c8e8103f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:54.931519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3280c1b1-706b-441c-9469-eef9c8e8103f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:54.931967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3280c1b1-706b-441c-9469-eef9c8e8103f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:55.067500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3280c1b1-706b-441c-9469-eef9c8e8103f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:55.075418 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3280c1b1-706b-441c-9469-eef9c8e8103f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.157866 Oct 04 22:08:55.075995 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3567/7115] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:54 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:56.100057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0df4c4db-922b-42a1-b00a-faa192d24c09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:56.100665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0df4c4db-922b-42a1-b00a-faa192d24c09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:56.107671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0df4c4db-922b-42a1-b00a-faa192d24c09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:56.108147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0df4c4db-922b-42a1-b00a-faa192d24c09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:56.108579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0df4c4db-922b-42a1-b00a-faa192d24c09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:56.109261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0df4c4db-922b-42a1-b00a-faa192d24c09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:56.109747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0df4c4db-922b-42a1-b00a-faa192d24c09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:56.110312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0df4c4db-922b-42a1-b00a-faa192d24c09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:56.241536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0df4c4db-922b-42a1-b00a-faa192d24c09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:56.249582 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0df4c4db-922b-42a1-b00a-faa192d24c09 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.153341 Oct 04 22:08:56.250161 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3549/7116] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:56 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:57.272538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-57d7370f-aeda-4643-b515-657276d5b6e1 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:57.273208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-57d7370f-aeda-4643-b515-657276d5b6e1 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:57.280281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57d7370f-aeda-4643-b515-657276d5b6e1 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:57.280795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57d7370f-aeda-4643-b515-657276d5b6e1 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:57.281256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57d7370f-aeda-4643-b515-657276d5b6e1 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:57.282011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57d7370f-aeda-4643-b515-657276d5b6e1 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:57.282487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57d7370f-aeda-4643-b515-657276d5b6e1 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:57.282933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57d7370f-aeda-4643-b515-657276d5b6e1 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:57.421604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-57d7370f-aeda-4643-b515-657276d5b6e1 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:57.429618 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-57d7370f-aeda-4643-b515-657276d5b6e1 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.161087 Oct 04 22:08:57.430201 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3568/7117] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:57 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:58.452239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9d6a4ae4-4d43-44b6-993f-c1d075158c3e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:58.452858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9d6a4ae4-4d43-44b6-993f-c1d075158c3e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:58.460233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d6a4ae4-4d43-44b6-993f-c1d075158c3e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:58.460722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d6a4ae4-4d43-44b6-993f-c1d075158c3e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:58.461162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d6a4ae4-4d43-44b6-993f-c1d075158c3e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:58.461881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d6a4ae4-4d43-44b6-993f-c1d075158c3e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:58.462371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d6a4ae4-4d43-44b6-993f-c1d075158c3e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:58.462799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9d6a4ae4-4d43-44b6-993f-c1d075158c3e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:58.593922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9d6a4ae4-4d43-44b6-993f-c1d075158c3e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:58.602308 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9d6a4ae4-4d43-44b6-993f-c1d075158c3e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.153987 Oct 04 22:08:58.602880 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3550/7118] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:58 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:08:59.625699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aa966eac-3c89-4c09-b5a2-9ba6fa760e7e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:08:59.626332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-aa966eac-3c89-4c09-b5a2-9ba6fa760e7e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:59.633738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa966eac-3c89-4c09-b5a2-9ba6fa760e7e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:59.634445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa966eac-3c89-4c09-b5a2-9ba6fa760e7e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:59.634913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa966eac-3c89-4c09-b5a2-9ba6fa760e7e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:59.635643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa966eac-3c89-4c09-b5a2-9ba6fa760e7e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:59.636115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa966eac-3c89-4c09-b5a2-9ba6fa760e7e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:59.636640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa966eac-3c89-4c09-b5a2-9ba6fa760e7e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:59.775858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-aa966eac-3c89-4c09-b5a2-9ba6fa760e7e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:08:59.784645 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-aa966eac-3c89-4c09-b5a2-9ba6fa760e7e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.162028 Oct 04 22:08:59.785524 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3569/7119] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:08:59 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:00.808201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-81fff09a-36f4-466d-a0ed-caf15b6efdaa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:00.808885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-81fff09a-36f4-466d-a0ed-caf15b6efdaa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:00.815836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81fff09a-36f4-466d-a0ed-caf15b6efdaa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:00.816451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81fff09a-36f4-466d-a0ed-caf15b6efdaa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:00.816892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81fff09a-36f4-466d-a0ed-caf15b6efdaa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:00.817684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81fff09a-36f4-466d-a0ed-caf15b6efdaa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:00.818140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81fff09a-36f4-466d-a0ed-caf15b6efdaa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:00.818569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81fff09a-36f4-466d-a0ed-caf15b6efdaa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:00.954399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-81fff09a-36f4-466d-a0ed-caf15b6efdaa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:00.962436 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-81fff09a-36f4-466d-a0ed-caf15b6efdaa tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.158192 Oct 04 22:09:00.969027 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3551/7120] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:00 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:01.985964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fa076f7c-6c48-46d7-9c99-dc5ad4183908 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:01.986607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fa076f7c-6c48-46d7-9c99-dc5ad4183908 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:01.994052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa076f7c-6c48-46d7-9c99-dc5ad4183908 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:01.994560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa076f7c-6c48-46d7-9c99-dc5ad4183908 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:01.995034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa076f7c-6c48-46d7-9c99-dc5ad4183908 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:01.995749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa076f7c-6c48-46d7-9c99-dc5ad4183908 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:01.996231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa076f7c-6c48-46d7-9c99-dc5ad4183908 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:01.996682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa076f7c-6c48-46d7-9c99-dc5ad4183908 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:02.124805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fa076f7c-6c48-46d7-9c99-dc5ad4183908 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:02.133185 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fa076f7c-6c48-46d7-9c99-dc5ad4183908 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.151175 Oct 04 22:09:02.133801 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3570/7121] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:01 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:03.156622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fb20abb6-9892-4f98-a9b5-8bdf0d02c96a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:03.157241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fb20abb6-9892-4f98-a9b5-8bdf0d02c96a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:03.168342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb20abb6-9892-4f98-a9b5-8bdf0d02c96a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:03.168830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb20abb6-9892-4f98-a9b5-8bdf0d02c96a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:03.169264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb20abb6-9892-4f98-a9b5-8bdf0d02c96a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:03.169998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb20abb6-9892-4f98-a9b5-8bdf0d02c96a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:03.170451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb20abb6-9892-4f98-a9b5-8bdf0d02c96a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:03.170874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fb20abb6-9892-4f98-a9b5-8bdf0d02c96a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:03.304931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fb20abb6-9892-4f98-a9b5-8bdf0d02c96a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:03.312674 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fb20abb6-9892-4f98-a9b5-8bdf0d02c96a tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.160433 Oct 04 22:09:03.313251 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3552/7122] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:03 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:04.336037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-926d3c19-8713-43aa-8ab1-83716373d9a0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:04.336587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-926d3c19-8713-43aa-8ab1-83716373d9a0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:04.339661 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:09:04.339795 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 22:09:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 (ip 10.222.0.30) !!! Oct 04 22:09:04.346116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-926d3c19-8713-43aa-8ab1-83716373d9a0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:04.346614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-926d3c19-8713-43aa-8ab1-83716373d9a0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:04.347214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-926d3c19-8713-43aa-8ab1-83716373d9a0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:04.348122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-926d3c19-8713-43aa-8ab1-83716373d9a0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:04.348598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-926d3c19-8713-43aa-8ab1-83716373d9a0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:04.349041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-926d3c19-8713-43aa-8ab1-83716373d9a0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:04.478698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-926d3c19-8713-43aa-8ab1-83716373d9a0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:04.486562 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-926d3c19-8713-43aa-8ab1-83716373d9a0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.154513 Oct 04 22:09:04.487151 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3571/7123] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:04 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:05.510750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4a587337-8535-48bf-bff0-0f6dbc19b3b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:05.511376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4a587337-8535-48bf-bff0-0f6dbc19b3b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:05.518499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a587337-8535-48bf-bff0-0f6dbc19b3b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:05.518998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a587337-8535-48bf-bff0-0f6dbc19b3b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:05.520115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a587337-8535-48bf-bff0-0f6dbc19b3b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:05.520987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a587337-8535-48bf-bff0-0f6dbc19b3b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:05.521473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a587337-8535-48bf-bff0-0f6dbc19b3b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:05.521912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4a587337-8535-48bf-bff0-0f6dbc19b3b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:05.655083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4a587337-8535-48bf-bff0-0f6dbc19b3b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:05.663287 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4a587337-8535-48bf-bff0-0f6dbc19b3b8 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.156492 Oct 04 22:09:05.663867 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3553/7124] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:05 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:06.687678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c9b1ecb9-d27a-40ce-a138-7f213294ad79 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:06.688311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c9b1ecb9-d27a-40ce-a138-7f213294ad79 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:06.695787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9b1ecb9-d27a-40ce-a138-7f213294ad79 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:06.696292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9b1ecb9-d27a-40ce-a138-7f213294ad79 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:06.696751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9b1ecb9-d27a-40ce-a138-7f213294ad79 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:06.697515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9b1ecb9-d27a-40ce-a138-7f213294ad79 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:06.697995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9b1ecb9-d27a-40ce-a138-7f213294ad79 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:06.698441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9b1ecb9-d27a-40ce-a138-7f213294ad79 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:06.835970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c9b1ecb9-d27a-40ce-a138-7f213294ad79 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:06.843650 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c9b1ecb9-d27a-40ce-a138-7f213294ad79 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.159938 Oct 04 22:09:06.844227 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3572/7125] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:06 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:07.866310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7c78635b-f39a-4ebf-a560-96f43433a21b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:07.866936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7c78635b-f39a-4ebf-a560-96f43433a21b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:07.873823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c78635b-f39a-4ebf-a560-96f43433a21b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:07.874303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c78635b-f39a-4ebf-a560-96f43433a21b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:07.874736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c78635b-f39a-4ebf-a560-96f43433a21b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:07.875419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c78635b-f39a-4ebf-a560-96f43433a21b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:07.875868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c78635b-f39a-4ebf-a560-96f43433a21b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:07.876291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c78635b-f39a-4ebf-a560-96f43433a21b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:08.016224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7c78635b-f39a-4ebf-a560-96f43433a21b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:08.016224 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7c78635b-f39a-4ebf-a560-96f43433a21b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.153611 Oct 04 22:09:08.016957 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3554/7126] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:07 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:09.040526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c31204f5-e4a4-41a8-be32-c6c8164f11a5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:09.041222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c31204f5-e4a4-41a8-be32-c6c8164f11a5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:09.048040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c31204f5-e4a4-41a8-be32-c6c8164f11a5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:09.048539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c31204f5-e4a4-41a8-be32-c6c8164f11a5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:09.048992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c31204f5-e4a4-41a8-be32-c6c8164f11a5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:09.049737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c31204f5-e4a4-41a8-be32-c6c8164f11a5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:09.050207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c31204f5-e4a4-41a8-be32-c6c8164f11a5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:09.050649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c31204f5-e4a4-41a8-be32-c6c8164f11a5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:09.182065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c31204f5-e4a4-41a8-be32-c6c8164f11a5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:09.189880 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c31204f5-e4a4-41a8-be32-c6c8164f11a5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.153282 Oct 04 22:09:09.190875 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3573/7127] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:09 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:10.214039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-865095f0-eb02-4bda-9dd9-d2c9fd2c2e96 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:10.214652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-865095f0-eb02-4bda-9dd9-d2c9fd2c2e96 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:10.221583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-865095f0-eb02-4bda-9dd9-d2c9fd2c2e96 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:10.222004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-865095f0-eb02-4bda-9dd9-d2c9fd2c2e96 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:10.222436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-865095f0-eb02-4bda-9dd9-d2c9fd2c2e96 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:10.223118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-865095f0-eb02-4bda-9dd9-d2c9fd2c2e96 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:10.223566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-865095f0-eb02-4bda-9dd9-d2c9fd2c2e96 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:10.223986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-865095f0-eb02-4bda-9dd9-d2c9fd2c2e96 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:10.352801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-865095f0-eb02-4bda-9dd9-d2c9fd2c2e96 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:10.360506 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-865095f0-eb02-4bda-9dd9-d2c9fd2c2e96 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.150887 Oct 04 22:09:10.361082 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3555/7128] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:10 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:11.383165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9b63f730-4034-4cea-8015-e8a538f90f43 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:11.383806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9b63f730-4034-4cea-8015-e8a538f90f43 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:11.390703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b63f730-4034-4cea-8015-e8a538f90f43 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:11.391210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b63f730-4034-4cea-8015-e8a538f90f43 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:11.391669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b63f730-4034-4cea-8015-e8a538f90f43 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:11.392646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b63f730-4034-4cea-8015-e8a538f90f43 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:11.393130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b63f730-4034-4cea-8015-e8a538f90f43 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:11.393615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9b63f730-4034-4cea-8015-e8a538f90f43 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:11.525235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9b63f730-4034-4cea-8015-e8a538f90f43 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:11.533114 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9b63f730-4034-4cea-8015-e8a538f90f43 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.153881 Oct 04 22:09:11.533846 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3574/7129] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:11 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:12.556660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa18697f-b1ea-4f3b-a0c2-4f93fe47a4e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:12.557279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aa18697f-b1ea-4f3b-a0c2-4f93fe47a4e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:12.564200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa18697f-b1ea-4f3b-a0c2-4f93fe47a4e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:12.564682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa18697f-b1ea-4f3b-a0c2-4f93fe47a4e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:12.565118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa18697f-b1ea-4f3b-a0c2-4f93fe47a4e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:12.565844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa18697f-b1ea-4f3b-a0c2-4f93fe47a4e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:12.566302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa18697f-b1ea-4f3b-a0c2-4f93fe47a4e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:12.566730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa18697f-b1ea-4f3b-a0c2-4f93fe47a4e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:12.570023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:12.696567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aa18697f-b1ea-4f3b-a0c2-4f93fe47a4e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:12.704073 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aa18697f-b1ea-4f3b-a0c2-4f93fe47a4e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.151830 Oct 04 22:09:12.704642 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3556/7130] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:12 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:13.727863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-93420253-2a23-48c6-b559-fcd4a4b819e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:13.728493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-93420253-2a23-48c6-b559-fcd4a4b819e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:13.735300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93420253-2a23-48c6-b559-fcd4a4b819e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:13.735797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93420253-2a23-48c6-b559-fcd4a4b819e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:13.736245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93420253-2a23-48c6-b559-fcd4a4b819e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:13.736949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93420253-2a23-48c6-b559-fcd4a4b819e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:13.737415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93420253-2a23-48c6-b559-fcd4a4b819e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:13.737879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-93420253-2a23-48c6-b559-fcd4a4b819e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:13.870868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-93420253-2a23-48c6-b559-fcd4a4b819e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:13.873142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=88 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:13.879293 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-93420253-2a23-48c6-b559-fcd4a4b819e5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.156314 Oct 04 22:09:13.880611 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3575/7131] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:13 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:14.903100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b467f6af-dd3c-42a3-9d34-4b54bf52183c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:14.903723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b467f6af-dd3c-42a3-9d34-4b54bf52183c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:14.910553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b467f6af-dd3c-42a3-9d34-4b54bf52183c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:14.911049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b467f6af-dd3c-42a3-9d34-4b54bf52183c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:14.911489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b467f6af-dd3c-42a3-9d34-4b54bf52183c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:14.912178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b467f6af-dd3c-42a3-9d34-4b54bf52183c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:14.913145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b467f6af-dd3c-42a3-9d34-4b54bf52183c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:14.913686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b467f6af-dd3c-42a3-9d34-4b54bf52183c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:15.055124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b467f6af-dd3c-42a3-9d34-4b54bf52183c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:15.063080 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b467f6af-dd3c-42a3-9d34-4b54bf52183c tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.163949 Oct 04 22:09:15.063658 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3557/7132] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:14 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:16.085987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-41d120c0-0268-4068-8756-163b5a91afbd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:16.086660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-41d120c0-0268-4068-8756-163b5a91afbd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:16.090131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=30 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:16.094924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41d120c0-0268-4068-8756-163b5a91afbd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:16.095431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41d120c0-0268-4068-8756-163b5a91afbd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:16.095897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41d120c0-0268-4068-8756-163b5a91afbd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:16.096610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41d120c0-0268-4068-8756-163b5a91afbd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:16.097090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41d120c0-0268-4068-8756-163b5a91afbd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:16.097573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41d120c0-0268-4068-8756-163b5a91afbd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:16.228454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-41d120c0-0268-4068-8756-163b5a91afbd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:16.236223 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-41d120c0-0268-4068-8756-163b5a91afbd tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.154285 Oct 04 22:09:16.236799 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3576/7133] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:16 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:17.259318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-609fac9c-ead9-49ed-90b9-bda8e9938217 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:17.259938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-609fac9c-ead9-49ed-90b9-bda8e9938217 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:17.266732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-609fac9c-ead9-49ed-90b9-bda8e9938217 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:17.267474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-609fac9c-ead9-49ed-90b9-bda8e9938217 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:17.267909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-609fac9c-ead9-49ed-90b9-bda8e9938217 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:17.268598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-609fac9c-ead9-49ed-90b9-bda8e9938217 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:17.269052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-609fac9c-ead9-49ed-90b9-bda8e9938217 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:17.269509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-609fac9c-ead9-49ed-90b9-bda8e9938217 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:17.404103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-609fac9c-ead9-49ed-90b9-bda8e9938217 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:17.411775 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-609fac9c-ead9-49ed-90b9-bda8e9938217 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.156466 Oct 04 22:09:17.412355 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3558/7134] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:17 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:18.436359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7d289fce-1113-48f0-9632-ffb4bcb72809 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:18.436990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7d289fce-1113-48f0-9632-ffb4bcb72809 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:18.443816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d289fce-1113-48f0-9632-ffb4bcb72809 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:18.444316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d289fce-1113-48f0-9632-ffb4bcb72809 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:18.444772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d289fce-1113-48f0-9632-ffb4bcb72809 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:18.445494 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d289fce-1113-48f0-9632-ffb4bcb72809 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:18.446755 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d289fce-1113-48f0-9632-ffb4bcb72809 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:18.447200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d289fce-1113-48f0-9632-ffb4bcb72809 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:18.590444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7d289fce-1113-48f0-9632-ffb4bcb72809 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:18.590444 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7d289fce-1113-48f0-9632-ffb4bcb72809 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.158073 Oct 04 22:09:18.591045 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3577/7135] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:18 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:19.614251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-61d7149e-5985-41ef-bbc4-d1e03a43088b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:19.614892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-61d7149e-5985-41ef-bbc4-d1e03a43088b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:19.617756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=28 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:19.625076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61d7149e-5985-41ef-bbc4-d1e03a43088b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:19.625640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61d7149e-5985-41ef-bbc4-d1e03a43088b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:19.635311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61d7149e-5985-41ef-bbc4-d1e03a43088b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:19.635311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61d7149e-5985-41ef-bbc4-d1e03a43088b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:19.635311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61d7149e-5985-41ef-bbc4-d1e03a43088b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:19.635311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-61d7149e-5985-41ef-bbc4-d1e03a43088b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:19.759791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-61d7149e-5985-41ef-bbc4-d1e03a43088b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:19.767707 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-61d7149e-5985-41ef-bbc4-d1e03a43088b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1519 microversion: 2.1 time: 0.157391 Oct 04 22:09:19.768276 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3559/7136] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:19 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:20.791995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2e064a10-8889-4a7e-aa27-2c7c34e8c5e2 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:20.792540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2e064a10-8889-4a7e-aa27-2c7c34e8c5e2 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:20.800003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e064a10-8889-4a7e-aa27-2c7c34e8c5e2 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:20.800496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e064a10-8889-4a7e-aa27-2c7c34e8c5e2 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:20.800944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e064a10-8889-4a7e-aa27-2c7c34e8c5e2 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:20.801684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e064a10-8889-4a7e-aa27-2c7c34e8c5e2 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:20.802156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e064a10-8889-4a7e-aa27-2c7c34e8c5e2 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:20.802598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e064a10-8889-4a7e-aa27-2c7c34e8c5e2 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:20.942655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2e064a10-8889-4a7e-aa27-2c7c34e8c5e2 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:20.951305 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2e064a10-8889-4a7e-aa27-2c7c34e8c5e2 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1518 microversion: 2.1 time: 0.164227 Oct 04 22:09:20.951904 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3578/7137] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:20 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:21.539465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-115c9eda-de34-4e8d-ad35-d981f24a7391 req-e25f640e-9833-49fa-9abd-229fb39053d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83be1eed-1422-4903-875c-291f60851e10", "name": "network-vif-unplugged", "status": "completed", "tag": "cdf1e163-ccb2-462c-bb5f-614f7e5a6b88"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:21.550671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-115c9eda-de34-4e8d-ad35-d981f24a7391 req-e25f640e-9833-49fa-9abd-229fb39053d0 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:21.551152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-115c9eda-de34-4e8d-ad35-d981f24a7391 req-e25f640e-9833-49fa-9abd-229fb39053d0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:21.551582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-115c9eda-de34-4e8d-ad35-d981f24a7391 req-e25f640e-9833-49fa-9abd-229fb39053d0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:21.563353 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-115c9eda-de34-4e8d-ad35-d981f24a7391 req-e25f640e-9833-49fa-9abd-229fb39053d0 service nova] Creating event network-vif-unplugged:cdf1e163-ccb2-462c-bb5f-614f7e5a6b88 for instance 83be1eed-1422-4903-875c-291f60851e10 on n-h2-860282-1 Oct 04 22:09:21.568462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-115c9eda-de34-4e8d-ad35-d981f24a7391 req-e25f640e-9833-49fa-9abd-229fb39053d0 service nova] Instance 83be1eed-1422-4903-875c-291f60851e10 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:09:21.580498 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-115c9eda-de34-4e8d-ad35-d981f24a7391 req-e25f640e-9833-49fa-9abd-229fb39053d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045126 Oct 04 22:09:21.587550 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3560/7138] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:21.974107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d1205021-be98-4b54-a89b-15a5845f7912 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:21.975139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d1205021-be98-4b54-a89b-15a5845f7912 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:21.982702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1205021-be98-4b54-a89b-15a5845f7912 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:21.983207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1205021-be98-4b54-a89b-15a5845f7912 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:21.983663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1205021-be98-4b54-a89b-15a5845f7912 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:21.984378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1205021-be98-4b54-a89b-15a5845f7912 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:21.984856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1205021-be98-4b54-a89b-15a5845f7912 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:21.985292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1205021-be98-4b54-a89b-15a5845f7912 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:22.252615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d1205021-be98-4b54-a89b-15a5845f7912 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:22.261945 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d1205021-be98-4b54-a89b-15a5845f7912 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1518 microversion: 2.1 time: 0.291384 Oct 04 22:09:22.263163 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3579/7139] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:21 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1518 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:23.291057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-36f0d6ab-3d4a-4862-b13d-fd37c4e67513 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:23.291691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-36f0d6ab-3d4a-4862-b13d-fd37c4e67513 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:23.298655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36f0d6ab-3d4a-4862-b13d-fd37c4e67513 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:23.299141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36f0d6ab-3d4a-4862-b13d-fd37c4e67513 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:23.299580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36f0d6ab-3d4a-4862-b13d-fd37c4e67513 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:23.300274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36f0d6ab-3d4a-4862-b13d-fd37c4e67513 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:23.300730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36f0d6ab-3d4a-4862-b13d-fd37c4e67513 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:23.301158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36f0d6ab-3d4a-4862-b13d-fd37c4e67513 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:23.434765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-36f0d6ab-3d4a-4862-b13d-fd37c4e67513 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:23.442482 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-36f0d6ab-3d4a-4862-b13d-fd37c4e67513 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1516 microversion: 2.1 time: 0.156944 Oct 04 22:09:23.443060 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3561/7140] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:23 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:23.596161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-94115ade-bb0b-4854-8cfd-4978d1ed0b30 req-dc715178-83a7-46a9-8498-75dc6be1f640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83be1eed-1422-4903-875c-291f60851e10", "tag": "cdf1e163-ccb2-462c-bb5f-614f7e5a6b88"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:23.606466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-94115ade-bb0b-4854-8cfd-4978d1ed0b30 req-dc715178-83a7-46a9-8498-75dc6be1f640 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:23.606957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-94115ade-bb0b-4854-8cfd-4978d1ed0b30 req-dc715178-83a7-46a9-8498-75dc6be1f640 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:23.607404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-94115ade-bb0b-4854-8cfd-4978d1ed0b30 req-dc715178-83a7-46a9-8498-75dc6be1f640 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:23.619600 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-94115ade-bb0b-4854-8cfd-4978d1ed0b30 req-dc715178-83a7-46a9-8498-75dc6be1f640 service nova] Creating event network-changed:cdf1e163-ccb2-462c-bb5f-614f7e5a6b88 for instance 83be1eed-1422-4903-875c-291f60851e10 on n-h2-860282-1 Oct 04 22:09:23.624964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [req-94115ade-bb0b-4854-8cfd-4978d1ed0b30 req-dc715178-83a7-46a9-8498-75dc6be1f640 service nova] Instance 83be1eed-1422-4903-875c-291f60851e10 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122757) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:09:23.635666 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-94115ade-bb0b-4854-8cfd-4978d1ed0b30 req-dc715178-83a7-46a9-8498-75dc6be1f640 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043285 Oct 04 22:09:23.636251 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3580/7141] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:09:24.465847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-de160b39-8f95-4ddd-9ee4-446e518c8f11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:24.466500 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-de160b39-8f95-4ddd-9ee4-446e518c8f11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:24.473304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de160b39-8f95-4ddd-9ee4-446e518c8f11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:24.473830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de160b39-8f95-4ddd-9ee4-446e518c8f11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:24.474277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de160b39-8f95-4ddd-9ee4-446e518c8f11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:24.475011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de160b39-8f95-4ddd-9ee4-446e518c8f11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:24.475474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de160b39-8f95-4ddd-9ee4-446e518c8f11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:24.475910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de160b39-8f95-4ddd-9ee4-446e518c8f11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:24.682303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-de160b39-8f95-4ddd-9ee4-446e518c8f11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:24.691432 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-de160b39-8f95-4ddd-9ee4-446e518c8f11 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1516 microversion: 2.1 time: 0.229434 Oct 04 22:09:24.692567 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3562/7142] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:24 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:25.715790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2d53d001-db20-4e82-a3f5-e031b014cf1b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:25.716571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2d53d001-db20-4e82-a3f5-e031b014cf1b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:25.723628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d53d001-db20-4e82-a3f5-e031b014cf1b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:25.724129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d53d001-db20-4e82-a3f5-e031b014cf1b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:25.724586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d53d001-db20-4e82-a3f5-e031b014cf1b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:25.725294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d53d001-db20-4e82-a3f5-e031b014cf1b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:25.725865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d53d001-db20-4e82-a3f5-e031b014cf1b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:25.726348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2d53d001-db20-4e82-a3f5-e031b014cf1b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:25.863169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2d53d001-db20-4e82-a3f5-e031b014cf1b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:25.870997 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2d53d001-db20-4e82-a3f5-e031b014cf1b tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1513 microversion: 2.1 time: 0.160040 Oct 04 22:09:25.871613 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3581/7143] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:25 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:25.896382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7b5061e2-7e14-4501-8ce9-7073d66c0844 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:25.896908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7b5061e2-7e14-4501-8ce9-7073d66c0844 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:25.904372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b5061e2-7e14-4501-8ce9-7073d66c0844 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:25.904858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b5061e2-7e14-4501-8ce9-7073d66c0844 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:25.905325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b5061e2-7e14-4501-8ce9-7073d66c0844 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:25.906042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b5061e2-7e14-4501-8ce9-7073d66c0844 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:25.906497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b5061e2-7e14-4501-8ce9-7073d66c0844 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:25.906924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7b5061e2-7e14-4501-8ce9-7073d66c0844 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:26.167457 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7b5061e2-7e14-4501-8ce9-7073d66c0844 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "POST /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10/action" status: 204 len: 0 microversion: 2.1 time: 0.276031 Oct 04 22:09:26.168160 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3563/7144] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:09:25 2022] POST /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10/action => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:09:26.177843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-795099c6-6a50-4378-8643-89ee1b1d66b5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:26.178912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-795099c6-6a50-4378-8643-89ee1b1d66b5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:26.184432 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-795099c6-6a50-4378-8643-89ee1b1d66b5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:26.184936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-795099c6-6a50-4378-8643-89ee1b1d66b5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:26.185449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-795099c6-6a50-4378-8643-89ee1b1d66b5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:26.186165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-795099c6-6a50-4378-8643-89ee1b1d66b5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:26.186668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-795099c6-6a50-4378-8643-89ee1b1d66b5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:26.187111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-795099c6-6a50-4378-8643-89ee1b1d66b5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:26.324385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-795099c6-6a50-4378-8643-89ee1b1d66b5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:26.332798 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-795099c6-6a50-4378-8643-89ee1b1d66b5 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1513 microversion: 2.1 time: 0.160214 Oct 04 22:09:26.333602 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3582/7145] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:26 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:27.357399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0cef61f5-3429-418a-8218-ce588d7e8af9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:27.358968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0cef61f5-3429-418a-8218-ce588d7e8af9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:27.365087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0cef61f5-3429-418a-8218-ce588d7e8af9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:27.365690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0cef61f5-3429-418a-8218-ce588d7e8af9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:27.366137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0cef61f5-3429-418a-8218-ce588d7e8af9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:27.366836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0cef61f5-3429-418a-8218-ce588d7e8af9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:27.367293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0cef61f5-3429-418a-8218-ce588d7e8af9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:27.367720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0cef61f5-3429-418a-8218-ce588d7e8af9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:27.509241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0cef61f5-3429-418a-8218-ce588d7e8af9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:27.518355 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0cef61f5-3429-418a-8218-ce588d7e8af9 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1513 microversion: 2.1 time: 0.166079 Oct 04 22:09:27.518953 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3564/7146] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:27 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:28.542612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5ffe7a4f-f8fe-4c7a-b77e-bffd31afa40e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:28.543278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5ffe7a4f-f8fe-4c7a-b77e-bffd31afa40e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:28.550801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ffe7a4f-f8fe-4c7a-b77e-bffd31afa40e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:28.551302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ffe7a4f-f8fe-4c7a-b77e-bffd31afa40e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:28.551759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ffe7a4f-f8fe-4c7a-b77e-bffd31afa40e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:28.552469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ffe7a4f-f8fe-4c7a-b77e-bffd31afa40e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:28.552941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ffe7a4f-f8fe-4c7a-b77e-bffd31afa40e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:28.553381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ffe7a4f-f8fe-4c7a-b77e-bffd31afa40e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:28.708108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5ffe7a4f-f8fe-4c7a-b77e-bffd31afa40e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:28.715979 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5ffe7a4f-f8fe-4c7a-b77e-bffd31afa40e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1505 microversion: 2.1 time: 0.177369 Oct 04 22:09:28.716564 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3583/7147] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:28 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1505 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:28.739203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b9edac4a-4d9e-4840-8d51-293bd157da4e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:28.739813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b9edac4a-4d9e-4840-8d51-293bd157da4e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:28.746854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9edac4a-4d9e-4840-8d51-293bd157da4e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:28.747335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9edac4a-4d9e-4840-8d51-293bd157da4e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:28.747768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9edac4a-4d9e-4840-8d51-293bd157da4e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:28.748504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9edac4a-4d9e-4840-8d51-293bd157da4e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:28.749238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9edac4a-4d9e-4840-8d51-293bd157da4e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:28.749576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b9edac4a-4d9e-4840-8d51-293bd157da4e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:28.879438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b9edac4a-4d9e-4840-8d51-293bd157da4e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:28.887208 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b9edac4a-4d9e-4840-8d51-293bd157da4e tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1505 microversion: 2.1 time: 0.151919 Oct 04 22:09:28.887779 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3565/7148] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:28 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:28.910257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bc9af8e5-9ed7-46ac-bf73-b7b0bac761de tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:28.910608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bc9af8e5-9ed7-46ac-bf73-b7b0bac761de tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:28.916331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc9af8e5-9ed7-46ac-bf73-b7b0bac761de tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:28.916840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc9af8e5-9ed7-46ac-bf73-b7b0bac761de tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:28.917293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc9af8e5-9ed7-46ac-bf73-b7b0bac761de tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:28.918037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc9af8e5-9ed7-46ac-bf73-b7b0bac761de tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:28.918517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc9af8e5-9ed7-46ac-bf73-b7b0bac761de tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:28.918968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc9af8e5-9ed7-46ac-bf73-b7b0bac761de tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:29.054367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bc9af8e5-9ed7-46ac-bf73-b7b0bac761de tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:29.062402 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bc9af8e5-9ed7-46ac-bf73-b7b0bac761de tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1505 microversion: 2.1 time: 0.156634 Oct 04 22:09:29.062987 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3584/7149] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:28 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:29.084637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cd3c8e38-12fc-4a0c-8507-79519bd74d1f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:29.085142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cd3c8e38-12fc-4a0c-8507-79519bd74d1f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:29.091124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd3c8e38-12fc-4a0c-8507-79519bd74d1f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:29.091607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd3c8e38-12fc-4a0c-8507-79519bd74d1f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:29.092042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd3c8e38-12fc-4a0c-8507-79519bd74d1f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:29.093582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd3c8e38-12fc-4a0c-8507-79519bd74d1f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:29.094047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd3c8e38-12fc-4a0c-8507-79519bd74d1f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:29.094477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd3c8e38-12fc-4a0c-8507-79519bd74d1f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:29.118847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cd3c8e38-12fc-4a0c-8507-79519bd74d1f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:09:29.356573 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cd3c8e38-12fc-4a0c-8507-79519bd74d1f tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "DELETE /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 204 len: 0 microversion: 2.1 time: 0.275434 Oct 04 22:09:29.357177 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3566/7150] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:09:29 2022] DELETE /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:09:29.373259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-06d61c7e-a9be-4144-adc9-f9a0f1c775eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:29.374383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-06d61c7e-a9be-4144-adc9-f9a0f1c775eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:29.380958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06d61c7e-a9be-4144-adc9-f9a0f1c775eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:29.381716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06d61c7e-a9be-4144-adc9-f9a0f1c775eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:29.382177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06d61c7e-a9be-4144-adc9-f9a0f1c775eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:29.382905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06d61c7e-a9be-4144-adc9-f9a0f1c775eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:29.383383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06d61c7e-a9be-4144-adc9-f9a0f1c775eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:29.383832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06d61c7e-a9be-4144-adc9-f9a0f1c775eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:29.410571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-06d61c7e-a9be-4144-adc9-f9a0f1c775eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:09:29.455807 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.compute.api [None req-06d61c7e-a9be-4144-adc9-f9a0f1c775eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Instance is already in deleting state, ignoring this request Oct 04 22:09:29.456694 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-06d61c7e-a9be-4144-adc9-f9a0f1c775eb tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "DELETE /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 204 len: 0 microversion: 2.1 time: 0.087586 Oct 04 22:09:29.457307 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3585/7151] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:09:29 2022] DELETE /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:09:29.465870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3390bc99-b38e-45bb-8629-09cb0e28e6d0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:29.466585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3390bc99-b38e-45bb-8629-09cb0e28e6d0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:29.472598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3390bc99-b38e-45bb-8629-09cb0e28e6d0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:29.473077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3390bc99-b38e-45bb-8629-09cb0e28e6d0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:29.473539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3390bc99-b38e-45bb-8629-09cb0e28e6d0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:29.474308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3390bc99-b38e-45bb-8629-09cb0e28e6d0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:29.474769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3390bc99-b38e-45bb-8629-09cb0e28e6d0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:29.475203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3390bc99-b38e-45bb-8629-09cb0e28e6d0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:29.586357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-eeaf16ca-b727-4e15-b6a7-855511fa22d8 req-7575c032-d082-4f79-aa1f-a612c84a7aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83be1eed-1422-4903-875c-291f60851e10", "name": "network-vif-plugged", "status": "completed", "tag": "cdf1e163-ccb2-462c-bb5f-614f7e5a6b88"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:29.597580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-eeaf16ca-b727-4e15-b6a7-855511fa22d8 req-7575c032-d082-4f79-aa1f-a612c84a7aa9 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:29.598210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-eeaf16ca-b727-4e15-b6a7-855511fa22d8 req-7575c032-d082-4f79-aa1f-a612c84a7aa9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:29.598749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-eeaf16ca-b727-4e15-b6a7-855511fa22d8 req-7575c032-d082-4f79-aa1f-a612c84a7aa9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:29.608180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3390bc99-b38e-45bb-8629-09cb0e28e6d0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:29.610701 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-eeaf16ca-b727-4e15-b6a7-855511fa22d8 req-7575c032-d082-4f79-aa1f-a612c84a7aa9 service nova] Creating event network-vif-plugged:cdf1e163-ccb2-462c-bb5f-614f7e5a6b88 for instance 83be1eed-1422-4903-875c-291f60851e10 on n-h2-860282-1 Oct 04 22:09:29.616032 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-eeaf16ca-b727-4e15-b6a7-855511fa22d8 req-7575c032-d082-4f79-aa1f-a612c84a7aa9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033511 Oct 04 22:09:29.616731 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3586/7152] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:09:29.617009 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3390bc99-b38e-45bb-8629-09cb0e28e6d0 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1511 microversion: 2.1 time: 0.155240 Oct 04 22:09:29.617623 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3567/7153] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:29 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:30.642776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a65ccd9b-19d7-4194-ba46-7de92580b035 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:30.643503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a65ccd9b-19d7-4194-ba46-7de92580b035 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:30.649665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a65ccd9b-19d7-4194-ba46-7de92580b035 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:30.650168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a65ccd9b-19d7-4194-ba46-7de92580b035 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:30.650623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a65ccd9b-19d7-4194-ba46-7de92580b035 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:30.651325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a65ccd9b-19d7-4194-ba46-7de92580b035 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:30.651795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a65ccd9b-19d7-4194-ba46-7de92580b035 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:30.652249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a65ccd9b-19d7-4194-ba46-7de92580b035 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:30.786414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a65ccd9b-19d7-4194-ba46-7de92580b035 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:30.796066 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a65ccd9b-19d7-4194-ba46-7de92580b035 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1511 microversion: 2.1 time: 0.158367 Oct 04 22:09:30.796066 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3587/7154] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:30 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:31.324509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-9588e523-45a5-4699-8324-912d9c9a61b5 req-64f3bc1b-aef6-44dd-9407-3e173e1fccb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83be1eed-1422-4903-875c-291f60851e10", "name": "network-vif-deleted", "tag": "cdf1e163-ccb2-462c-bb5f-614f7e5a6b88"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:31.341607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9588e523-45a5-4699-8324-912d9c9a61b5 req-64f3bc1b-aef6-44dd-9407-3e173e1fccb6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:31.342303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9588e523-45a5-4699-8324-912d9c9a61b5 req-64f3bc1b-aef6-44dd-9407-3e173e1fccb6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:31.343021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9588e523-45a5-4699-8324-912d9c9a61b5 req-64f3bc1b-aef6-44dd-9407-3e173e1fccb6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:31.355017 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-9588e523-45a5-4699-8324-912d9c9a61b5 req-64f3bc1b-aef6-44dd-9407-3e173e1fccb6 service nova] Creating event network-vif-deleted:cdf1e163-ccb2-462c-bb5f-614f7e5a6b88 for instance 83be1eed-1422-4903-875c-291f60851e10 on n-h2-860282-1 Oct 04 22:09:31.361571 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-9588e523-45a5-4699-8324-912d9c9a61b5 req-64f3bc1b-aef6-44dd-9407-3e173e1fccb6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040496 Oct 04 22:09:31.362216 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3568/7155] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:31.817863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d1f291d2-246c-40fc-abd3-56ca6c4b4e5d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:31.818499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d1f291d2-246c-40fc-abd3-56ca6c4b4e5d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:31.825483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1f291d2-246c-40fc-abd3-56ca6c4b4e5d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:31.825995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1f291d2-246c-40fc-abd3-56ca6c4b4e5d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:31.826457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1f291d2-246c-40fc-abd3-56ca6c4b4e5d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:31.827174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1f291d2-246c-40fc-abd3-56ca6c4b4e5d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:31.827651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1f291d2-246c-40fc-abd3-56ca6c4b4e5d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:31.828098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1f291d2-246c-40fc-abd3-56ca6c4b4e5d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:31.861753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1f291d2-246c-40fc-abd3-56ca6c4b4e5d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:31.862251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1f291d2-246c-40fc-abd3-56ca6c4b4e5d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:31.862708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d1f291d2-246c-40fc-abd3-56ca6c4b4e5d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:31.863176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-d1f291d2-246c-40fc-abd3-56ca6c4b4e5d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lazy-loading 'fault' on Instance uuid 83be1eed-1422-4903-875c-291f60851e10 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:09:31.909486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d1f291d2-246c-40fc-abd3-56ca6c4b4e5d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3b0a36cdc245f69ed52226192b12fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6072248a19c841778fe06ccea68ecf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:31.917503 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d1f291d2-246c-40fc-abd3-56ca6c4b4e5d tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 200 len: 1305 microversion: 2.1 time: 0.103578 Oct 04 22:09:31.918085 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3588/7156] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:31 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:32.942935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-25949dd0-7970-4d2d-9673-a35cc4934d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:32.943642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-25949dd0-7970-4d2d-9673-a35cc4934d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 83be1eed-1422-4903-875c-291f60851e10] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:32.949771 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25949dd0-7970-4d2d-9673-a35cc4934d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:32.950251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25949dd0-7970-4d2d-9673-a35cc4934d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:32.950687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25949dd0-7970-4d2d-9673-a35cc4934d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:32.951372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25949dd0-7970-4d2d-9673-a35cc4934d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:32.951826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25949dd0-7970-4d2d-9673-a35cc4934d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:32.952247 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25949dd0-7970-4d2d-9673-a35cc4934d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:32.965114 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-25949dd0-7970-4d2d-9673-a35cc4934d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] HTTP exception thrown: Instance 83be1eed-1422-4903-875c-291f60851e10 could not be found. Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-25949dd0-7970-4d2d-9673-a35cc4934d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Request method failure captured: Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 HTTP/1.1 Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPK6tfnxWIZuLxOZUBmub4gGFmQys7yYzA4dGBTclhAHt2NQZ2lhU4CBzBgrrbMl70BUKgcjex60iOtNvLc0cjzdHaAUg4lvYegN_X7DeSGIB7Rs_j1ccjftUMyNcGvkNptCYVXXnnl6gEPaEsNBAWMZvgg114WNYZ0in5SrLiBoWCT8 Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 6072248a19c841778fe06ccea68ecf57 Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1548599908 Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6072248a19c841778fe06ccea68ecf57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6072248a19c841778fe06ccea68ecf57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6072248a19c841778fe06ccea68ecf57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6072248a19c841778fe06ccea68ecf57"}]}] Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerDiskConfigTestJSON-1548599908 Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 6072248a19c841778fe06ccea68ecf57 Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1548599908 Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerDiskConfigTestJSON-1548599908-project Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 6f3b0a36cdc245f69ed52226192b12fc Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerDiskConfigTestJSON-1548599908-project Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 83be1eed-1422-4903-875c-291f60851e10 could not be found. Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '83be1eed-1422-4903-875c-291f60851e10'} Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83be1eed-1422-4903-875c-291f60851e10 could not be found. Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83be1eed-1422-4903-875c-291f60851e10 could not be found. Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:09:32.966762 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:09:32.972061 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:32.972061 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:09:32.972061 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:09:32.972061 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:09:32.972061 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:09:32.972061 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83be1eed-1422-4903-875c-291f60851e10 could not be found. Oct 04 22:09:32.972061 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:09:32.972061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-25949dd0-7970-4d2d-9673-a35cc4934d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Returning 404 to user: Instance 83be1eed-1422-4903-875c-291f60851e10 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:09:32.972061 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-25949dd0-7970-4d2d-9673-a35cc4934d89 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10" status: 404 len: 111 microversion: 2.1 time: 0.031130 Oct 04 22:09:32.972061 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3569/7157] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:32 2022] GET /compute/v2.1/servers/83be1eed-1422-4903-875c-291f60851e10 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:09:32.976980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bea1bf23-e1c0-4b87-84bf-d6c6106577f6 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '.version_select at 0x7f578b53d280>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:33.060288 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bea1bf23-e1c0-4b87-84bf-d6c6106577f6 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-36208735" status: 202 len: 0 microversion: 2.1 time: 0.087063 Oct 04 22:09:33.060923 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3589/7158] 10.222.0.30 () {58 vars in 1215 bytes} [Tue Oct 4 22:09:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-36208735 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:09:33.794277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f2245b76-2517-46e1-b177-5c89b9d68ea3 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:33.794711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f2245b76-2517-46e1-b177-5c89b9d68ea3 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:33.800722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2245b76-2517-46e1-b177-5c89b9d68ea3 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:33.808690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2245b76-2517-46e1-b177-5c89b9d68ea3 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:33.808690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2245b76-2517-46e1-b177-5c89b9d68ea3 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:33.808690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2245b76-2517-46e1-b177-5c89b9d68ea3 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:33.808690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2245b76-2517-46e1-b177-5c89b9d68ea3 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:33.808690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f2245b76-2517-46e1-b177-5c89b9d68ea3 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:33.817192 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-f2245b76-2517-46e1-b177-5c89b9d68ea3 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] HTTP exception thrown: Instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 could not be found. Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f2245b76-2517-46e1-b177-5c89b9d68ea3 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Request method failure captured: Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 HTTP/1.1 Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPK6tfnxWIZuLxOZUBmub4gGFmQys7yYzA4dGBTclhAHt2NQZ2lhU4CBzBgrrbMl70BUKgcjex60iOtNvLc0cjzdHaAUg4lvYegN_X7DeSGIB7Rs_j1ccjftUMyNcGvkNptCYVXXnnl6gEPaEsNBAWMZvgg114WNYZ0in5SrLiBoWCT8 Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 6072248a19c841778fe06ccea68ecf57 Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1548599908 Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6072248a19c841778fe06ccea68ecf57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6072248a19c841778fe06ccea68ecf57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6072248a19c841778fe06ccea68ecf57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6072248a19c841778fe06ccea68ecf57"}]}] Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerDiskConfigTestJSON-1548599908 Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 6072248a19c841778fe06ccea68ecf57 Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1548599908 Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerDiskConfigTestJSON-1548599908-project Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 6f3b0a36cdc245f69ed52226192b12fc Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerDiskConfigTestJSON-1548599908-project Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 could not be found. Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '03d5e9b5-39f2-4ec4-8f98-ac29d44bad89'} Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 could not be found. Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:09:33.818741 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:09:33.823651 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 could not be found. Oct 04 22:09:33.823651 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:09:33.823651 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:09:33.823651 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:09:33.823651 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:33.823651 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:09:33.823651 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:09:33.823651 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:09:33.823651 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:09:33.823651 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 could not be found. Oct 04 22:09:33.823651 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:09:33.823651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f2245b76-2517-46e1-b177-5c89b9d68ea3 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Returning 404 to user: Instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:09:33.823651 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f2245b76-2517-46e1-b177-5c89b9d68ea3 tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "DELETE /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 404 len: 111 microversion: 2.1 time: 0.029779 Oct 04 22:09:33.823651 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3570/7159] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:09:33 2022] DELETE /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:09:33.829480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0df5f507-e4f9-4747-8d01-10afa6667cdc tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:33.830117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0df5f507-e4f9-4747-8d01-10afa6667cdc tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] [instance: 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:33.836667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0df5f507-e4f9-4747-8d01-10afa6667cdc tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:33.837165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0df5f507-e4f9-4747-8d01-10afa6667cdc tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:33.837652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0df5f507-e4f9-4747-8d01-10afa6667cdc tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:33.838351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0df5f507-e4f9-4747-8d01-10afa6667cdc tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:33.838821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0df5f507-e4f9-4747-8d01-10afa6667cdc tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:33.839261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0df5f507-e4f9-4747-8d01-10afa6667cdc tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:33.852185 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-0df5f507-e4f9-4747-8d01-10afa6667cdc tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] HTTP exception thrown: Instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 could not be found. Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0df5f507-e4f9-4747-8d01-10afa6667cdc tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Request method failure captured: Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 HTTP/1.1 Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPK6tfnxWIZuLxOZUBmub4gGFmQys7yYzA4dGBTclhAHt2NQZ2lhU4CBzBgrrbMl70BUKgcjex60iOtNvLc0cjzdHaAUg4lvYegN_X7DeSGIB7Rs_j1ccjftUMyNcGvkNptCYVXXnnl6gEPaEsNBAWMZvgg114WNYZ0in5SrLiBoWCT8 Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 6072248a19c841778fe06ccea68ecf57 Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1548599908 Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6072248a19c841778fe06ccea68ecf57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6072248a19c841778fe06ccea68ecf57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6072248a19c841778fe06ccea68ecf57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6072248a19c841778fe06ccea68ecf57"}]}] Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerDiskConfigTestJSON-1548599908 Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 6072248a19c841778fe06ccea68ecf57 Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1548599908 Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerDiskConfigTestJSON-1548599908-project Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 6f3b0a36cdc245f69ed52226192b12fc Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerDiskConfigTestJSON-1548599908-project Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 could not be found. Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '03d5e9b5-39f2-4ec4-8f98-ac29d44bad89'} Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 could not be found. Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 could not be found. Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:09:33.853861 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:09:33.859067 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:09:33.859067 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:09:33.859067 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:09:33.859067 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:09:33.859067 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:09:33.859067 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 could not be found. Oct 04 22:09:33.859067 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:09:33.859067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0df5f507-e4f9-4747-8d01-10afa6667cdc tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] Returning 404 to user: Instance 03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:09:33.859067 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0df5f507-e4f9-4747-8d01-10afa6667cdc tempest-ServerDiskConfigTestJSON-1548599908 tempest-ServerDiskConfigTestJSON-1548599908-project] 10.222.0.30 "GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89" status: 404 len: 111 microversion: 2.1 time: 0.030507 Oct 04 22:09:33.859067 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3590/7160] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:33 2022] GET /compute/v2.1/servers/03d5e9b5-39f2-4ec4-8f98-ac29d44bad89 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:09:44.832093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:44.832859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:44.951348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d319c3cb-5bb7-4f1e-a0e8-8ca827d95a70 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Action: 'create', calling method: .version_select at 0x7f578b4e3670>, body: {"keypair": {"name": "tempest-keypair-955841605", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJtWfNUelyNgexh+l90sxSLdWSBqUrFIjrJ0LWCLPVyNrCGirIfZ1tqhVpotKHVcyNUrzkuRj7QSiZKDKPJLjdfGgZE5szvHJGtSaL6/i0lxs7WyLbDfldrtbkuhQw0CA=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:44.968674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-d319c3cb-5bb7-4f1e-a0e8-8ca827d95a70 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Getting quotas for project 5aa764882b244357892ebdad69cff689. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:09:44.978654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-d319c3cb-5bb7-4f1e-a0e8-8ca827d95a70 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Getting quotas for user c01d66c6cbba4c30831508fdaf953268 and project 5aa764882b244357892ebdad69cff689. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:09:45.055170 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d319c3cb-5bb7-4f1e-a0e8-8ca827d95a70 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.228864 Oct 04 22:09:45.055751 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3571/7161] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 22:09:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:47.373539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ccd54fa7-1447-4fe1-8e64-8942cdb6c00a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1811827453", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f62b5be-7019-44f6-811c-aa44b61d2d81"}], "security_groups": [{"name": "tempest-securitygroup--1599777208"}], "key_name": "tempest-keypair-955841605", "user_data": "}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:47.383006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:47.383752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:47.514354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-ccd54fa7-1447-4fe1-8e64-8942cdb6c00a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] validate_networks() for [('5f62b5be-7019-44f6-811c-aa44b61d2d81', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:09:47.910953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ccd54fa7-1447-4fe1-8e64-8942cdb6c00a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:09:47.911395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ccd54fa7-1447-4fe1-8e64-8942cdb6c00a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:09:47.911993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ccd54fa7-1447-4fe1-8e64-8942cdb6c00a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:09:47.912427 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ccd54fa7-1447-4fe1-8e64-8942cdb6c00a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:09:47.912882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ccd54fa7-1447-4fe1-8e64-8942cdb6c00a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:09:47.922997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccd54fa7-1447-4fe1-8e64-8942cdb6c00a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:47.923543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccd54fa7-1447-4fe1-8e64-8942cdb6c00a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:47.924028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccd54fa7-1447-4fe1-8e64-8942cdb6c00a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:47.924789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccd54fa7-1447-4fe1-8e64-8942cdb6c00a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:47.925278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccd54fa7-1447-4fe1-8e64-8942cdb6c00a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:47.925753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ccd54fa7-1447-4fe1-8e64-8942cdb6c00a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:47.943571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-ccd54fa7-1447-4fe1-8e64-8942cdb6c00a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Getting quotas for project 5aa764882b244357892ebdad69cff689. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:09:47.948947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-ccd54fa7-1447-4fe1-8e64-8942cdb6c00a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Getting quotas for user c01d66c6cbba4c30831508fdaf953268 and project 5aa764882b244357892ebdad69cff689. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:09:47.962712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ccd54fa7-1447-4fe1-8e64-8942cdb6c00a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:09:47.965053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ccd54fa7-1447-4fe1-8e64-8942cdb6c00a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:09:48.084837 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ccd54fa7-1447-4fe1-8e64-8942cdb6c00a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.715965 Oct 04 22:09:48.085533 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3591/7162] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:09:47 2022] POST /compute/v2.1/servers => generated 409 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:09:48.098905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-67ad7c04-9538-4691-a510-637c25d21d17 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:48.099520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-67ad7c04-9538-4691-a510-637c25d21d17 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:48.174747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-67ad7c04-9538-4691-a510-637c25d21d17 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:48.183027 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-67ad7c04-9538-4691-a510-637c25d21d17 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1238 microversion: 2.1 time: 0.088735 Oct 04 22:09:48.183619 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3572/7163] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:48 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:49.207244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3e9d5ae4-df29-485a-9b60-62915acd26e6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:49.208092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3e9d5ae4-df29-485a-9b60-62915acd26e6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:49.215208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e9d5ae4-df29-485a-9b60-62915acd26e6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:49.215710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e9d5ae4-df29-485a-9b60-62915acd26e6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:49.216164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e9d5ae4-df29-485a-9b60-62915acd26e6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:49.217757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e9d5ae4-df29-485a-9b60-62915acd26e6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:49.218245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e9d5ae4-df29-485a-9b60-62915acd26e6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:49.218683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3e9d5ae4-df29-485a-9b60-62915acd26e6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:49.284120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3e9d5ae4-df29-485a-9b60-62915acd26e6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:49.292053 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3e9d5ae4-df29-485a-9b60-62915acd26e6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1242 microversion: 2.1 time: 0.089868 Oct 04 22:09:49.292630 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3592/7164] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:49 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:50.315937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ddf794c8-46c2-46f7-a2d1-d905184b54b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:50.317600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ddf794c8-46c2-46f7-a2d1-d905184b54b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:50.328005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddf794c8-46c2-46f7-a2d1-d905184b54b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:50.331191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddf794c8-46c2-46f7-a2d1-d905184b54b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:50.331191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddf794c8-46c2-46f7-a2d1-d905184b54b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:50.331191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddf794c8-46c2-46f7-a2d1-d905184b54b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:50.331191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddf794c8-46c2-46f7-a2d1-d905184b54b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:50.331191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ddf794c8-46c2-46f7-a2d1-d905184b54b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:50.398393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ddf794c8-46c2-46f7-a2d1-d905184b54b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:50.407492 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ddf794c8-46c2-46f7-a2d1-d905184b54b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1298 microversion: 2.1 time: 0.095594 Oct 04 22:09:50.408083 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3573/7165] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:50 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:51.432128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0f8ca468-c9f6-427a-b65f-a69220c493aa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:51.432761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0f8ca468-c9f6-427a-b65f-a69220c493aa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:51.440319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f8ca468-c9f6-427a-b65f-a69220c493aa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:51.440819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f8ca468-c9f6-427a-b65f-a69220c493aa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:51.441273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f8ca468-c9f6-427a-b65f-a69220c493aa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:51.442003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f8ca468-c9f6-427a-b65f-a69220c493aa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:51.442474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f8ca468-c9f6-427a-b65f-a69220c493aa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:51.442913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0f8ca468-c9f6-427a-b65f-a69220c493aa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:51.585716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0f8ca468-c9f6-427a-b65f-a69220c493aa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:51.594476 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0f8ca468-c9f6-427a-b65f-a69220c493aa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1364 microversion: 2.1 time: 0.166164 Oct 04 22:09:51.595388 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3593/7166] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:51 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:51.956558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-e9dab969-c1c5-4010-ae23-8c9f2b9ec24d req-7e3ea805-387e-47fb-8651-602a07bae9cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edbaa85f-c78d-43bc-860a-5a57a93438fc", "tag": "f5c72d8a-b660-404a-8146-f684ce790630"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:51.966517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e9dab969-c1c5-4010-ae23-8c9f2b9ec24d req-7e3ea805-387e-47fb-8651-602a07bae9cc service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:51.968216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e9dab969-c1c5-4010-ae23-8c9f2b9ec24d req-7e3ea805-387e-47fb-8651-602a07bae9cc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:51.969447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e9dab969-c1c5-4010-ae23-8c9f2b9ec24d req-7e3ea805-387e-47fb-8651-602a07bae9cc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:51.979756 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-e9dab969-c1c5-4010-ae23-8c9f2b9ec24d req-7e3ea805-387e-47fb-8651-602a07bae9cc service nova] Creating event network-changed:f5c72d8a-b660-404a-8146-f684ce790630 for instance edbaa85f-c78d-43bc-860a-5a57a93438fc on n-h1-860282-1 Oct 04 22:09:51.985500 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-e9dab969-c1c5-4010-ae23-8c9f2b9ec24d req-7e3ea805-387e-47fb-8651-602a07bae9cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032512 Oct 04 22:09:51.986269 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3574/7167] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:52.618762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-586aebdf-9b4f-4e32-b209-eac7c5ed9cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:52.619503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-586aebdf-9b4f-4e32-b209-eac7c5ed9cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:52.627267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-586aebdf-9b4f-4e32-b209-eac7c5ed9cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:52.627887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-586aebdf-9b4f-4e32-b209-eac7c5ed9cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:52.628353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-586aebdf-9b4f-4e32-b209-eac7c5ed9cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:52.629074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-586aebdf-9b4f-4e32-b209-eac7c5ed9cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:52.629583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-586aebdf-9b4f-4e32-b209-eac7c5ed9cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:52.630036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-586aebdf-9b4f-4e32-b209-eac7c5ed9cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:52.765042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-586aebdf-9b4f-4e32-b209-eac7c5ed9cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:52.773089 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-586aebdf-9b4f-4e32-b209-eac7c5ed9cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1364 microversion: 2.1 time: 0.158331 Oct 04 22:09:52.773689 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3594/7168] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:52 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:53.797202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cc6ebee5-5bed-43d9-9117-2252515a0de2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:53.797838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cc6ebee5-5bed-43d9-9117-2252515a0de2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:53.804830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc6ebee5-5bed-43d9-9117-2252515a0de2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:53.807284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc6ebee5-5bed-43d9-9117-2252515a0de2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:53.807284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc6ebee5-5bed-43d9-9117-2252515a0de2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:53.807284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc6ebee5-5bed-43d9-9117-2252515a0de2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:53.807284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc6ebee5-5bed-43d9-9117-2252515a0de2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:53.807708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cc6ebee5-5bed-43d9-9117-2252515a0de2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:53.938596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cc6ebee5-5bed-43d9-9117-2252515a0de2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:53.946231 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cc6ebee5-5bed-43d9-9117-2252515a0de2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1364 microversion: 2.1 time: 0.154060 Oct 04 22:09:53.947008 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3575/7169] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:53 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:54.969254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6ab5892a-a032-45fe-9fe3-0b8fdff332cd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:54.969937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6ab5892a-a032-45fe-9fe3-0b8fdff332cd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:54.976810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ab5892a-a032-45fe-9fe3-0b8fdff332cd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:54.977298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ab5892a-a032-45fe-9fe3-0b8fdff332cd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:54.977786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ab5892a-a032-45fe-9fe3-0b8fdff332cd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:54.978490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ab5892a-a032-45fe-9fe3-0b8fdff332cd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:54.978959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ab5892a-a032-45fe-9fe3-0b8fdff332cd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:54.979403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ab5892a-a032-45fe-9fe3-0b8fdff332cd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:55.113318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6ab5892a-a032-45fe-9fe3-0b8fdff332cd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:55.121203 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6ab5892a-a032-45fe-9fe3-0b8fdff332cd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1364 microversion: 2.1 time: 0.156655 Oct 04 22:09:55.121808 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3595/7170] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:54 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:56.143759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6cc0f8c3-2f9a-4d33-b67f-fc7d56deb4c4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:56.144374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6cc0f8c3-2f9a-4d33-b67f-fc7d56deb4c4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:56.151353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cc0f8c3-2f9a-4d33-b67f-fc7d56deb4c4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:56.151837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cc0f8c3-2f9a-4d33-b67f-fc7d56deb4c4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:56.152275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cc0f8c3-2f9a-4d33-b67f-fc7d56deb4c4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:56.152956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cc0f8c3-2f9a-4d33-b67f-fc7d56deb4c4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:56.153434 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cc0f8c3-2f9a-4d33-b67f-fc7d56deb4c4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:56.153852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cc0f8c3-2f9a-4d33-b67f-fc7d56deb4c4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:56.285043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6cc0f8c3-2f9a-4d33-b67f-fc7d56deb4c4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:56.292846 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6cc0f8c3-2f9a-4d33-b67f-fc7d56deb4c4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1364 microversion: 2.1 time: 0.153238 Oct 04 22:09:56.293438 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3576/7171] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:56 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:57.309318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-cad3d623-37c6-4bf6-89af-2050666077cd req-8883e205-992c-4557-979f-94e49c7a35d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edbaa85f-c78d-43bc-860a-5a57a93438fc", "name": "network-vif-plugged", "status": "completed", "tag": "f5c72d8a-b660-404a-8146-f684ce790630"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:57.317911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-86fd30cd-b6be-4c85-8aff-9e4c6ad7da8c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:57.318698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-86fd30cd-b6be-4c85-8aff-9e4c6ad7da8c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:57.320962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cad3d623-37c6-4bf6-89af-2050666077cd req-8883e205-992c-4557-979f-94e49c7a35d3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:57.321526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cad3d623-37c6-4bf6-89af-2050666077cd req-8883e205-992c-4557-979f-94e49c7a35d3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:57.321979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cad3d623-37c6-4bf6-89af-2050666077cd req-8883e205-992c-4557-979f-94e49c7a35d3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:57.325518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86fd30cd-b6be-4c85-8aff-9e4c6ad7da8c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:57.326023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86fd30cd-b6be-4c85-8aff-9e4c6ad7da8c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:57.326469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86fd30cd-b6be-4c85-8aff-9e4c6ad7da8c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:57.327198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86fd30cd-b6be-4c85-8aff-9e4c6ad7da8c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:57.327657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86fd30cd-b6be-4c85-8aff-9e4c6ad7da8c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:57.328784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-86fd30cd-b6be-4c85-8aff-9e4c6ad7da8c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:57.336997 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-cad3d623-37c6-4bf6-89af-2050666077cd req-8883e205-992c-4557-979f-94e49c7a35d3 service nova] Creating event network-vif-plugged:f5c72d8a-b660-404a-8146-f684ce790630 for instance edbaa85f-c78d-43bc-860a-5a57a93438fc on n-h1-860282-1 Oct 04 22:09:57.342320 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-cad3d623-37c6-4bf6-89af-2050666077cd req-8883e205-992c-4557-979f-94e49c7a35d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036788 Oct 04 22:09:57.349027 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3596/7172] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:57.465705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-86fd30cd-b6be-4c85-8aff-9e4c6ad7da8c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:57.474055 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-86fd30cd-b6be-4c85-8aff-9e4c6ad7da8c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1364 microversion: 2.1 time: 0.161550 Oct 04 22:09:57.474860 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3577/7173] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:57 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:58.496719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-72676f7b-a5b3-4356-a7f0-0eb1f66b9666 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:58.497517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-72676f7b-a5b3-4356-a7f0-0eb1f66b9666 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:58.499486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:58.500745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:58.506757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72676f7b-a5b3-4356-a7f0-0eb1f66b9666 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:58.514464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72676f7b-a5b3-4356-a7f0-0eb1f66b9666 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:58.514464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72676f7b-a5b3-4356-a7f0-0eb1f66b9666 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:58.514464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72676f7b-a5b3-4356-a7f0-0eb1f66b9666 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:58.514464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72676f7b-a5b3-4356-a7f0-0eb1f66b9666 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:58.514464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-72676f7b-a5b3-4356-a7f0-0eb1f66b9666 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:58.646732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-72676f7b-a5b3-4356-a7f0-0eb1f66b9666 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:58.654607 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-72676f7b-a5b3-4356-a7f0-0eb1f66b9666 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1364 microversion: 2.1 time: 0.162111 Oct 04 22:09:58.655191 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3597/7174] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:58 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:59.678655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1d874c05-32c4-4025-985c-d6938cfea25b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:59.679269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1d874c05-32c4-4025-985c-d6938cfea25b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:59.681234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:59.687266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d874c05-32c4-4025-985c-d6938cfea25b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:59.687747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d874c05-32c4-4025-985c-d6938cfea25b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:59.694233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d874c05-32c4-4025-985c-d6938cfea25b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:59.694233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d874c05-32c4-4025-985c-d6938cfea25b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:59.694233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d874c05-32c4-4025-985c-d6938cfea25b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:59.694233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d874c05-32c4-4025-985c-d6938cfea25b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:59.833911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1d874c05-32c4-4025-985c-d6938cfea25b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:59.842409 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1d874c05-32c4-4025-985c-d6938cfea25b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1551 microversion: 2.1 time: 0.168009 Oct 04 22:09:59.842998 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3578/7175] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:59 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1551 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:59.866844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c284405f-3cb1-48fc-b57b-7719de945839 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:59.867485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c284405f-3cb1-48fc-b57b-7719de945839 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:59.880776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c284405f-3cb1-48fc-b57b-7719de945839 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:59.880776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c284405f-3cb1-48fc-b57b-7719de945839 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:59.880776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c284405f-3cb1-48fc-b57b-7719de945839 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:59.880776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c284405f-3cb1-48fc-b57b-7719de945839 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:59.880776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c284405f-3cb1-48fc-b57b-7719de945839 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:59.880776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c284405f-3cb1-48fc-b57b-7719de945839 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:59.966266 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c284405f-3cb1-48fc-b57b-7719de945839 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103707 Oct 04 22:09:59.966881 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3598/7176] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 22:09:59 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:01.326120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-a5319361-81b5-4ba1-92a1-20027a0058cf req-65d30628-b3d5-4a7b-b883-5e58e3221c64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edbaa85f-c78d-43bc-860a-5a57a93438fc", "tag": "f5c72d8a-b660-404a-8146-f684ce790630"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:01.337075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a5319361-81b5-4ba1-92a1-20027a0058cf req-65d30628-b3d5-4a7b-b883-5e58e3221c64 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:01.337692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a5319361-81b5-4ba1-92a1-20027a0058cf req-65d30628-b3d5-4a7b-b883-5e58e3221c64 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:01.338207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a5319361-81b5-4ba1-92a1-20027a0058cf req-65d30628-b3d5-4a7b-b883-5e58e3221c64 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:01.352659 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-a5319361-81b5-4ba1-92a1-20027a0058cf req-65d30628-b3d5-4a7b-b883-5e58e3221c64 service nova] Creating event network-changed:f5c72d8a-b660-404a-8146-f684ce790630 for instance edbaa85f-c78d-43bc-860a-5a57a93438fc on n-h1-860282-1 Oct 04 22:10:01.357771 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-a5319361-81b5-4ba1-92a1-20027a0058cf req-65d30628-b3d5-4a7b-b883-5e58e3221c64 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035399 Oct 04 22:10:01.358416 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3579/7177] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:35.353104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:35.353696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=38 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:35.357345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dec25db6-8758-4f03-ada5-64543cf9f785 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:35.358089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dec25db6-8758-4f03-ada5-64543cf9f785 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:35.364591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dec25db6-8758-4f03-ada5-64543cf9f785 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:35.365100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dec25db6-8758-4f03-ada5-64543cf9f785 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:35.365575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dec25db6-8758-4f03-ada5-64543cf9f785 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:35.366453 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dec25db6-8758-4f03-ada5-64543cf9f785 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:35.366926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dec25db6-8758-4f03-ada5-64543cf9f785 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:35.367370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dec25db6-8758-4f03-ada5-64543cf9f785 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:35.510266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dec25db6-8758-4f03-ada5-64543cf9f785 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:35.518876 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dec25db6-8758-4f03-ada5-64543cf9f785 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1670 microversion: 2.1 time: 0.168298 Oct 04 22:10:35.519784 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3599/7178] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:35 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1670 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:35.541121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:35.542189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=34 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:35.546002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6dc1263b-f3ae-488b-bf47-5be22d83cf43 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:35.546708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6dc1263b-f3ae-488b-bf47-5be22d83cf43 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:35.552948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6dc1263b-f3ae-488b-bf47-5be22d83cf43 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:35.553515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6dc1263b-f3ae-488b-bf47-5be22d83cf43 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:35.553906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6dc1263b-f3ae-488b-bf47-5be22d83cf43 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:35.554607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6dc1263b-f3ae-488b-bf47-5be22d83cf43 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:35.555068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6dc1263b-f3ae-488b-bf47-5be22d83cf43 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:35.555497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6dc1263b-f3ae-488b-bf47-5be22d83cf43 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:35.688896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6dc1263b-f3ae-488b-bf47-5be22d83cf43 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:35.697796 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6dc1263b-f3ae-488b-bf47-5be22d83cf43 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1670 microversion: 2.1 time: 0.158726 Oct 04 22:10:35.699249 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3580/7179] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:35 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:35.729984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0fce9451-aeb1-472b-9f8a-fafe2795dda0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:35.730623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0fce9451-aeb1-472b-9f8a-fafe2795dda0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:35.736807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fce9451-aeb1-472b-9f8a-fafe2795dda0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:35.737317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fce9451-aeb1-472b-9f8a-fafe2795dda0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:35.737840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fce9451-aeb1-472b-9f8a-fafe2795dda0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:35.738583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fce9451-aeb1-472b-9f8a-fafe2795dda0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:35.739614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fce9451-aeb1-472b-9f8a-fafe2795dda0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:35.740160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fce9451-aeb1-472b-9f8a-fafe2795dda0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:35.880657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0fce9451-aeb1-472b-9f8a-fafe2795dda0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:35.889172 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0fce9451-aeb1-472b-9f8a-fafe2795dda0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1670 microversion: 2.1 time: 0.163017 Oct 04 22:10:35.889932 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3600/7180] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:35 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:10:35.912809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-725b1d31-fa49-44f3-b0ee-cba2638b24a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:35.915104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-725b1d31-fa49-44f3-b0ee-cba2638b24a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:35.921279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-725b1d31-fa49-44f3-b0ee-cba2638b24a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:35.921815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-725b1d31-fa49-44f3-b0ee-cba2638b24a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:35.922257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-725b1d31-fa49-44f3-b0ee-cba2638b24a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:35.922959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-725b1d31-fa49-44f3-b0ee-cba2638b24a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:35.923418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-725b1d31-fa49-44f3-b0ee-cba2638b24a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:35.923850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-725b1d31-fa49-44f3-b0ee-cba2638b24a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:35.952951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-725b1d31-fa49-44f3-b0ee-cba2638b24a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:35.958518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-725b1d31-fa49-44f3-b0ee-cba2638b24a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Old instance type m1.heat2, new instance type m1.heat {{(pid=122758) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:10:35.965131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-725b1d31-fa49-44f3-b0ee-cba2638b24a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:10:35.965590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-725b1d31-fa49-44f3-b0ee-cba2638b24a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:10:35.966074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-725b1d31-fa49-44f3-b0ee-cba2638b24a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:10:35.966487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-725b1d31-fa49-44f3-b0ee-cba2638b24a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:10:35.966906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-725b1d31-fa49-44f3-b0ee-cba2638b24a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:10:36.165641 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-725b1d31-fa49-44f3-b0ee-cba2638b24a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "POST /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc/action" status: 202 len: 0 microversion: 2.1 time: 0.257421 Oct 04 22:10:36.166356 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3581/7181] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:10:35 2022] POST /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:10:36.174544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-984bc9c1-973b-401b-a312-9e7b99c0af0a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:36.177441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-984bc9c1-973b-401b-a312-9e7b99c0af0a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:36.183606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-984bc9c1-973b-401b-a312-9e7b99c0af0a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:36.184121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-984bc9c1-973b-401b-a312-9e7b99c0af0a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:36.184578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-984bc9c1-973b-401b-a312-9e7b99c0af0a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:36.185293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-984bc9c1-973b-401b-a312-9e7b99c0af0a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:36.185792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-984bc9c1-973b-401b-a312-9e7b99c0af0a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:36.186241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-984bc9c1-973b-401b-a312-9e7b99c0af0a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:36.320392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-984bc9c1-973b-401b-a312-9e7b99c0af0a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:36.328266 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-984bc9c1-973b-401b-a312-9e7b99c0af0a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1679 microversion: 2.1 time: 0.157834 Oct 04 22:10:36.328852 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3601/7182] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:36 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:37.353809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9339bf91-9e06-484a-ac5d-32343189295d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:37.354431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9339bf91-9e06-484a-ac5d-32343189295d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:37.361492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9339bf91-9e06-484a-ac5d-32343189295d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:37.361992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9339bf91-9e06-484a-ac5d-32343189295d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:37.362456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9339bf91-9e06-484a-ac5d-32343189295d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:37.363141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9339bf91-9e06-484a-ac5d-32343189295d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:37.363603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9339bf91-9e06-484a-ac5d-32343189295d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:37.364575 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9339bf91-9e06-484a-ac5d-32343189295d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:37.500437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9339bf91-9e06-484a-ac5d-32343189295d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:37.509960 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9339bf91-9e06-484a-ac5d-32343189295d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1679 microversion: 2.1 time: 0.160455 Oct 04 22:10:37.511028 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3582/7183] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:37 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:38.534990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e2b5c1f7-03eb-4f43-8376-bae248158a9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:38.535619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e2b5c1f7-03eb-4f43-8376-bae248158a9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:38.543510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2b5c1f7-03eb-4f43-8376-bae248158a9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:38.544025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2b5c1f7-03eb-4f43-8376-bae248158a9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:38.544484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2b5c1f7-03eb-4f43-8376-bae248158a9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:38.545207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2b5c1f7-03eb-4f43-8376-bae248158a9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:38.545711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2b5c1f7-03eb-4f43-8376-bae248158a9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:38.546165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2b5c1f7-03eb-4f43-8376-bae248158a9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:38.678770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e2b5c1f7-03eb-4f43-8376-bae248158a9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:38.686967 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e2b5c1f7-03eb-4f43-8376-bae248158a9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1679 microversion: 2.1 time: 0.156087 Oct 04 22:10:38.687565 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3602/7184] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:38 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:39.710961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-73840ed3-0861-4ed4-bc4a-9d6f28418361 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:39.711556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-73840ed3-0861-4ed4-bc4a-9d6f28418361 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:39.718519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73840ed3-0861-4ed4-bc4a-9d6f28418361 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:39.719011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73840ed3-0861-4ed4-bc4a-9d6f28418361 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:39.719460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73840ed3-0861-4ed4-bc4a-9d6f28418361 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:39.720155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73840ed3-0861-4ed4-bc4a-9d6f28418361 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:39.720619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73840ed3-0861-4ed4-bc4a-9d6f28418361 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:39.721045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-73840ed3-0861-4ed4-bc4a-9d6f28418361 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:39.856199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-73840ed3-0861-4ed4-bc4a-9d6f28418361 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:39.863951 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-73840ed3-0861-4ed4-bc4a-9d6f28418361 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1684 microversion: 2.1 time: 0.157681 Oct 04 22:10:39.864530 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3583/7185] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:39 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:40.892582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c3d856a0-8652-449e-a527-6606b9c1822e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:40.893245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c3d856a0-8652-449e-a527-6606b9c1822e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:40.900697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3d856a0-8652-449e-a527-6606b9c1822e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:40.901206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3d856a0-8652-449e-a527-6606b9c1822e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:40.901702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3d856a0-8652-449e-a527-6606b9c1822e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:40.906461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3d856a0-8652-449e-a527-6606b9c1822e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:40.906461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3d856a0-8652-449e-a527-6606b9c1822e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:40.906461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c3d856a0-8652-449e-a527-6606b9c1822e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:41.038286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c3d856a0-8652-449e-a527-6606b9c1822e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:41.046095 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c3d856a0-8652-449e-a527-6606b9c1822e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1684 microversion: 2.1 time: 0.157871 Oct 04 22:10:41.046680 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3603/7186] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:40 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:42.070320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6ba978e9-ab0a-4afc-9533-2e659019d35c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:42.070976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6ba978e9-ab0a-4afc-9533-2e659019d35c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:42.077772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ba978e9-ab0a-4afc-9533-2e659019d35c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:42.078263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ba978e9-ab0a-4afc-9533-2e659019d35c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:42.078710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ba978e9-ab0a-4afc-9533-2e659019d35c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:42.079407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ba978e9-ab0a-4afc-9533-2e659019d35c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:42.079874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ba978e9-ab0a-4afc-9533-2e659019d35c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:42.080304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ba978e9-ab0a-4afc-9533-2e659019d35c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:42.208290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6ba978e9-ab0a-4afc-9533-2e659019d35c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:42.216100 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6ba978e9-ab0a-4afc-9533-2e659019d35c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1684 microversion: 2.1 time: 0.149895 Oct 04 22:10:42.216683 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3584/7187] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:42 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:43.240810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6453f2d5-5093-44b3-924e-b7af092a85d8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:43.241512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6453f2d5-5093-44b3-924e-b7af092a85d8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:43.248443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6453f2d5-5093-44b3-924e-b7af092a85d8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:43.248954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6453f2d5-5093-44b3-924e-b7af092a85d8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:43.249412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6453f2d5-5093-44b3-924e-b7af092a85d8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:43.250189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6453f2d5-5093-44b3-924e-b7af092a85d8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:43.250696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6453f2d5-5093-44b3-924e-b7af092a85d8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:43.251146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6453f2d5-5093-44b3-924e-b7af092a85d8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:43.385949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6453f2d5-5093-44b3-924e-b7af092a85d8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:43.394133 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6453f2d5-5093-44b3-924e-b7af092a85d8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1684 microversion: 2.1 time: 0.157818 Oct 04 22:10:43.394712 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3604/7188] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:43 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:44.417308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cfe817eb-82ca-4e6e-a92e-bc9ea57e58f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:44.417955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cfe817eb-82ca-4e6e-a92e-bc9ea57e58f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:44.425294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfe817eb-82ca-4e6e-a92e-bc9ea57e58f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:44.425810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfe817eb-82ca-4e6e-a92e-bc9ea57e58f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:44.426249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfe817eb-82ca-4e6e-a92e-bc9ea57e58f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:44.426938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfe817eb-82ca-4e6e-a92e-bc9ea57e58f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:44.427395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfe817eb-82ca-4e6e-a92e-bc9ea57e58f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:44.428497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfe817eb-82ca-4e6e-a92e-bc9ea57e58f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:44.610130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cfe817eb-82ca-4e6e-a92e-bc9ea57e58f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:44.619039 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cfe817eb-82ca-4e6e-a92e-bc9ea57e58f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1684 microversion: 2.1 time: 0.205586 Oct 04 22:10:44.620249 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3585/7189] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:44 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1684 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:45.645936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-49c4d455-2cbf-4ead-955f-2d1f4fb7203c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:45.647240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-49c4d455-2cbf-4ead-955f-2d1f4fb7203c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:45.654111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49c4d455-2cbf-4ead-955f-2d1f4fb7203c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:45.654617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49c4d455-2cbf-4ead-955f-2d1f4fb7203c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:45.655072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49c4d455-2cbf-4ead-955f-2d1f4fb7203c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:45.655770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49c4d455-2cbf-4ead-955f-2d1f4fb7203c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:45.656239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49c4d455-2cbf-4ead-955f-2d1f4fb7203c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:45.656680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49c4d455-2cbf-4ead-955f-2d1f4fb7203c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:46.187438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-49c4d455-2cbf-4ead-955f-2d1f4fb7203c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:46.195991 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-49c4d455-2cbf-4ead-955f-2d1f4fb7203c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1684 microversion: 2.1 time: 0.554285 Oct 04 22:10:46.196558 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3605/7190] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:45 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1684 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:47.219726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-857b0b3c-590f-4b60-811c-4d815f5331bf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:47.220437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-857b0b3c-590f-4b60-811c-4d815f5331bf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:47.228529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-857b0b3c-590f-4b60-811c-4d815f5331bf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:47.229025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-857b0b3c-590f-4b60-811c-4d815f5331bf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:47.229507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-857b0b3c-590f-4b60-811c-4d815f5331bf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:47.230252 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-857b0b3c-590f-4b60-811c-4d815f5331bf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:47.230714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-857b0b3c-590f-4b60-811c-4d815f5331bf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:47.231144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-857b0b3c-590f-4b60-811c-4d815f5331bf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:47.368606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-857b0b3c-590f-4b60-811c-4d815f5331bf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:47.376707 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-857b0b3c-590f-4b60-811c-4d815f5331bf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1684 microversion: 2.1 time: 0.161496 Oct 04 22:10:47.379751 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3586/7191] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:47 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:48.401115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-86dd3dad-98d2-4c99-a27d-d2c9772c6bcd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:48.401779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-86dd3dad-98d2-4c99-a27d-d2c9772c6bcd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:48.408612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86dd3dad-98d2-4c99-a27d-d2c9772c6bcd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:48.409152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86dd3dad-98d2-4c99-a27d-d2c9772c6bcd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:48.409642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86dd3dad-98d2-4c99-a27d-d2c9772c6bcd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:48.410354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86dd3dad-98d2-4c99-a27d-d2c9772c6bcd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:48.410829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86dd3dad-98d2-4c99-a27d-d2c9772c6bcd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:48.411274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-86dd3dad-98d2-4c99-a27d-d2c9772c6bcd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:48.542780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-86dd3dad-98d2-4c99-a27d-d2c9772c6bcd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:48.550625 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-86dd3dad-98d2-4c99-a27d-d2c9772c6bcd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1684 microversion: 2.1 time: 0.153952 Oct 04 22:10:48.551205 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3606/7192] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:48 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:49.573872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-07709ef9-bf48-4758-878d-3f95e2ffe3f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:49.574424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-07709ef9-bf48-4758-878d-3f95e2ffe3f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:49.581189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07709ef9-bf48-4758-878d-3f95e2ffe3f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:49.581700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07709ef9-bf48-4758-878d-3f95e2ffe3f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:49.582138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07709ef9-bf48-4758-878d-3f95e2ffe3f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:49.582820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07709ef9-bf48-4758-878d-3f95e2ffe3f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:49.583274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07709ef9-bf48-4758-878d-3f95e2ffe3f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:49.583699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07709ef9-bf48-4758-878d-3f95e2ffe3f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:49.712937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-07709ef9-bf48-4758-878d-3f95e2ffe3f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:49.720759 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-07709ef9-bf48-4758-878d-3f95e2ffe3f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1684 microversion: 2.1 time: 0.150796 Oct 04 22:10:49.721337 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3587/7193] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:49 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:50.745245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-be8d2ae0-60b7-437b-979b-b70d4aae0689 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:50.745913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-be8d2ae0-60b7-437b-979b-b70d4aae0689 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:50.752676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be8d2ae0-60b7-437b-979b-b70d4aae0689 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:50.753176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be8d2ae0-60b7-437b-979b-b70d4aae0689 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:50.753661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be8d2ae0-60b7-437b-979b-b70d4aae0689 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:50.754364 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be8d2ae0-60b7-437b-979b-b70d4aae0689 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:50.754840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be8d2ae0-60b7-437b-979b-b70d4aae0689 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:50.755277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-be8d2ae0-60b7-437b-979b-b70d4aae0689 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:50.887130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-be8d2ae0-60b7-437b-979b-b70d4aae0689 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:50.895242 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-be8d2ae0-60b7-437b-979b-b70d4aae0689 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1684 microversion: 2.1 time: 0.153966 Oct 04 22:10:50.895847 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3607/7194] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:50 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:51.807123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-0f7f45f0-5ecd-453e-b2e1-56c953ec7c69 req-e58c1b1c-10cd-496d-9e10-4d478c1962ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edbaa85f-c78d-43bc-860a-5a57a93438fc", "name": "network-vif-unplugged", "status": "completed", "tag": "f5c72d8a-b660-404a-8146-f684ce790630"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:51.816495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0f7f45f0-5ecd-453e-b2e1-56c953ec7c69 req-e58c1b1c-10cd-496d-9e10-4d478c1962ce service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:51.816975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0f7f45f0-5ecd-453e-b2e1-56c953ec7c69 req-e58c1b1c-10cd-496d-9e10-4d478c1962ce service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:51.817407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0f7f45f0-5ecd-453e-b2e1-56c953ec7c69 req-e58c1b1c-10cd-496d-9e10-4d478c1962ce service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:51.828871 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-0f7f45f0-5ecd-453e-b2e1-56c953ec7c69 req-e58c1b1c-10cd-496d-9e10-4d478c1962ce service nova] Creating event network-vif-unplugged:f5c72d8a-b660-404a-8146-f684ce790630 for instance edbaa85f-c78d-43bc-860a-5a57a93438fc on n-h2-860282-1 Oct 04 22:10:51.834397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-0f7f45f0-5ecd-453e-b2e1-56c953ec7c69 req-e58c1b1c-10cd-496d-9e10-4d478c1962ce service nova] Instance edbaa85f-c78d-43bc-860a-5a57a93438fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:10:51.852136 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-0f7f45f0-5ecd-453e-b2e1-56c953ec7c69 req-e58c1b1c-10cd-496d-9e10-4d478c1962ce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102981 Oct 04 22:10:51.853011 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3588/7195] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:51.919143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f8a03520-3aa5-4029-8d14-af0434a65baa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:51.919786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f8a03520-3aa5-4029-8d14-af0434a65baa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:51.931956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8a03520-3aa5-4029-8d14-af0434a65baa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:51.931956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8a03520-3aa5-4029-8d14-af0434a65baa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:51.931956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8a03520-3aa5-4029-8d14-af0434a65baa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:51.931956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8a03520-3aa5-4029-8d14-af0434a65baa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:51.931956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8a03520-3aa5-4029-8d14-af0434a65baa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:51.931956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8a03520-3aa5-4029-8d14-af0434a65baa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:52.158042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f8a03520-3aa5-4029-8d14-af0434a65baa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:52.166795 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f8a03520-3aa5-4029-8d14-af0434a65baa tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1683 microversion: 2.1 time: 0.251715 Oct 04 22:10:52.167394 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3608/7196] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:51 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1683 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:53.192277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa3bc54a-6c79-4c97-b1d9-ea81c0b29ac9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:53.192991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aa3bc54a-6c79-4c97-b1d9-ea81c0b29ac9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:53.199756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa3bc54a-6c79-4c97-b1d9-ea81c0b29ac9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:53.200242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa3bc54a-6c79-4c97-b1d9-ea81c0b29ac9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:53.200681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa3bc54a-6c79-4c97-b1d9-ea81c0b29ac9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:53.201379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa3bc54a-6c79-4c97-b1d9-ea81c0b29ac9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:53.201863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa3bc54a-6c79-4c97-b1d9-ea81c0b29ac9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:53.202296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa3bc54a-6c79-4c97-b1d9-ea81c0b29ac9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:53.338778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-aa3bc54a-6c79-4c97-b1d9-ea81c0b29ac9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:53.346799 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aa3bc54a-6c79-4c97-b1d9-ea81c0b29ac9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1683 microversion: 2.1 time: 0.159494 Oct 04 22:10:53.347369 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3589/7197] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:53 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:53.867886 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-cad557ad-e1fa-4e80-8e1d-e1d2959bd94c req-b93caaa3-a693-4347-9962-3b8af4402145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edbaa85f-c78d-43bc-860a-5a57a93438fc", "tag": "f5c72d8a-b660-404a-8146-f684ce790630"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:53.878085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cad557ad-e1fa-4e80-8e1d-e1d2959bd94c req-b93caaa3-a693-4347-9962-3b8af4402145 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:53.878581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cad557ad-e1fa-4e80-8e1d-e1d2959bd94c req-b93caaa3-a693-4347-9962-3b8af4402145 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:53.879035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-cad557ad-e1fa-4e80-8e1d-e1d2959bd94c req-b93caaa3-a693-4347-9962-3b8af4402145 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:53.890736 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-cad557ad-e1fa-4e80-8e1d-e1d2959bd94c req-b93caaa3-a693-4347-9962-3b8af4402145 service nova] Creating event network-changed:f5c72d8a-b660-404a-8146-f684ce790630 for instance edbaa85f-c78d-43bc-860a-5a57a93438fc on n-h2-860282-1 Oct 04 22:10:53.896035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [req-cad557ad-e1fa-4e80-8e1d-e1d2959bd94c req-b93caaa3-a693-4347-9962-3b8af4402145 service nova] Instance edbaa85f-c78d-43bc-860a-5a57a93438fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122757) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:10:53.906907 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-cad557ad-e1fa-4e80-8e1d-e1d2959bd94c req-b93caaa3-a693-4347-9962-3b8af4402145 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043377 Oct 04 22:10:53.907513 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3609/7198] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:54.375038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5d3732e7-d044-4f57-b1a7-14589f1ec2ed tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:54.387063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5d3732e7-d044-4f57-b1a7-14589f1ec2ed tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:54.387063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d3732e7-d044-4f57-b1a7-14589f1ec2ed tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:54.387063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d3732e7-d044-4f57-b1a7-14589f1ec2ed tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:54.387063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d3732e7-d044-4f57-b1a7-14589f1ec2ed tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:54.387063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d3732e7-d044-4f57-b1a7-14589f1ec2ed tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:54.387063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d3732e7-d044-4f57-b1a7-14589f1ec2ed tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:54.387063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5d3732e7-d044-4f57-b1a7-14589f1ec2ed tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:54.520230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5d3732e7-d044-4f57-b1a7-14589f1ec2ed tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:54.528771 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5d3732e7-d044-4f57-b1a7-14589f1ec2ed tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1681 microversion: 2.1 time: 0.157643 Oct 04 22:10:54.529341 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3590/7199] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:54 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:55.555164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0d633cfd-75ee-40db-bf83-a409b88ac620 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:55.555887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0d633cfd-75ee-40db-bf83-a409b88ac620 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:55.562138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d633cfd-75ee-40db-bf83-a409b88ac620 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:55.562649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d633cfd-75ee-40db-bf83-a409b88ac620 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:55.563108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d633cfd-75ee-40db-bf83-a409b88ac620 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:55.563832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d633cfd-75ee-40db-bf83-a409b88ac620 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:55.564310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d633cfd-75ee-40db-bf83-a409b88ac620 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:55.564757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d633cfd-75ee-40db-bf83-a409b88ac620 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:55.702931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0d633cfd-75ee-40db-bf83-a409b88ac620 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:55.711792 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0d633cfd-75ee-40db-bf83-a409b88ac620 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1678 microversion: 2.1 time: 0.162064 Oct 04 22:10:55.712387 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3610/7200] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:55 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:55.736015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a93b0a54-461e-4b8c-b4c3-43aa684582be tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:55.736551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a93b0a54-461e-4b8c-b4c3-43aa684582be tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:55.743428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a93b0a54-461e-4b8c-b4c3-43aa684582be tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:55.753934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a93b0a54-461e-4b8c-b4c3-43aa684582be tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:55.753934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a93b0a54-461e-4b8c-b4c3-43aa684582be tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:55.753934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a93b0a54-461e-4b8c-b4c3-43aa684582be tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:55.753934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a93b0a54-461e-4b8c-b4c3-43aa684582be tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:55.753934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a93b0a54-461e-4b8c-b4c3-43aa684582be tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:55.874235 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a93b0a54-461e-4b8c-b4c3-43aa684582be tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "POST /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc/action" status: 204 len: 0 microversion: 2.1 time: 0.142223 Oct 04 22:10:55.876323 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3591/7201] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:10:55 2022] POST /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc/action => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:10:55.883785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c74e7ba1-3ccf-439d-a77c-3621f4dbfb4c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:55.884435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c74e7ba1-3ccf-439d-a77c-3621f4dbfb4c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:55.891852 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c74e7ba1-3ccf-439d-a77c-3621f4dbfb4c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:55.892345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c74e7ba1-3ccf-439d-a77c-3621f4dbfb4c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:55.892806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c74e7ba1-3ccf-439d-a77c-3621f4dbfb4c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:55.893593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c74e7ba1-3ccf-439d-a77c-3621f4dbfb4c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:55.894068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c74e7ba1-3ccf-439d-a77c-3621f4dbfb4c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:55.894522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c74e7ba1-3ccf-439d-a77c-3621f4dbfb4c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:56.036864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c74e7ba1-3ccf-439d-a77c-3621f4dbfb4c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:56.046319 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c74e7ba1-3ccf-439d-a77c-3621f4dbfb4c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1678 microversion: 2.1 time: 0.166546 Oct 04 22:10:56.047080 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3611/7202] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:55 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:57.070926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3295f658-b20c-49d4-b801-83a6a89cb5ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:57.071640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3295f658-b20c-49d4-b801-83a6a89cb5ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:57.078639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3295f658-b20c-49d4-b801-83a6a89cb5ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:57.079126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3295f658-b20c-49d4-b801-83a6a89cb5ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:57.079568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3295f658-b20c-49d4-b801-83a6a89cb5ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:57.080262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3295f658-b20c-49d4-b801-83a6a89cb5ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:57.080721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3295f658-b20c-49d4-b801-83a6a89cb5ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:57.081152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3295f658-b20c-49d4-b801-83a6a89cb5ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:57.217613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3295f658-b20c-49d4-b801-83a6a89cb5ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:57.225705 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3295f658-b20c-49d4-b801-83a6a89cb5ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1678 microversion: 2.1 time: 0.159151 Oct 04 22:10:57.226987 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3592/7203] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:57 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:58.112373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-10796aed-214b-4667-a2ff-1542f911166d req-d8decc46-a6e2-4eaa-bdfa-633ea8a46d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edbaa85f-c78d-43bc-860a-5a57a93438fc", "name": "network-vif-plugged", "status": "completed", "tag": "f5c72d8a-b660-404a-8146-f684ce790630"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:58.123242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-10796aed-214b-4667-a2ff-1542f911166d req-d8decc46-a6e2-4eaa-bdfa-633ea8a46d48 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:58.123761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-10796aed-214b-4667-a2ff-1542f911166d req-d8decc46-a6e2-4eaa-bdfa-633ea8a46d48 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:58.124229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-10796aed-214b-4667-a2ff-1542f911166d req-d8decc46-a6e2-4eaa-bdfa-633ea8a46d48 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:58.135766 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-10796aed-214b-4667-a2ff-1542f911166d req-d8decc46-a6e2-4eaa-bdfa-633ea8a46d48 service nova] Creating event network-vif-plugged:f5c72d8a-b660-404a-8146-f684ce790630 for instance edbaa85f-c78d-43bc-860a-5a57a93438fc on n-h2-860282-1 Oct 04 22:10:58.141114 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-10796aed-214b-4667-a2ff-1542f911166d req-d8decc46-a6e2-4eaa-bdfa-633ea8a46d48 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032293 Oct 04 22:10:58.141751 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3612/7204] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:58.250446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8ff7f0a1-51a3-4421-833b-e6cc600e32f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:58.251069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8ff7f0a1-51a3-4421-833b-e6cc600e32f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:58.258542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ff7f0a1-51a3-4421-833b-e6cc600e32f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:58.259034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ff7f0a1-51a3-4421-833b-e6cc600e32f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:58.259477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ff7f0a1-51a3-4421-833b-e6cc600e32f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:58.260174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ff7f0a1-51a3-4421-833b-e6cc600e32f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:58.260633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ff7f0a1-51a3-4421-833b-e6cc600e32f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:58.261067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ff7f0a1-51a3-4421-833b-e6cc600e32f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:58.394852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8ff7f0a1-51a3-4421-833b-e6cc600e32f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:58.403311 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8ff7f0a1-51a3-4421-833b-e6cc600e32f0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1670 microversion: 2.1 time: 0.156859 Oct 04 22:10:58.403901 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3593/7205] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:58 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:58.432389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d32203c5-ecae-4d36-9e8e-d58a1eb5ad9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:58.433122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d32203c5-ecae-4d36-9e8e-d58a1eb5ad9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:58.439563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d32203c5-ecae-4d36-9e8e-d58a1eb5ad9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:58.440076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d32203c5-ecae-4d36-9e8e-d58a1eb5ad9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:58.440541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d32203c5-ecae-4d36-9e8e-d58a1eb5ad9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:58.441256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d32203c5-ecae-4d36-9e8e-d58a1eb5ad9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:58.441780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d32203c5-ecae-4d36-9e8e-d58a1eb5ad9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:58.442234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d32203c5-ecae-4d36-9e8e-d58a1eb5ad9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:58.574124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d32203c5-ecae-4d36-9e8e-d58a1eb5ad9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:58.581935 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d32203c5-ecae-4d36-9e8e-d58a1eb5ad9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1670 microversion: 2.1 time: 0.154234 Oct 04 22:10:58.582525 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3613/7206] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:58 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:58.604650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0ec2788e-25e1-4679-83f1-39f365f2f0ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:58.605195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0ec2788e-25e1-4679-83f1-39f365f2f0ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:58.611238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0ec2788e-25e1-4679-83f1-39f365f2f0ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:58.611729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0ec2788e-25e1-4679-83f1-39f365f2f0ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:58.612172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0ec2788e-25e1-4679-83f1-39f365f2f0ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:58.612864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0ec2788e-25e1-4679-83f1-39f365f2f0ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:58.613323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0ec2788e-25e1-4679-83f1-39f365f2f0ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:58.613783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0ec2788e-25e1-4679-83f1-39f365f2f0ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:58.628715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:58.746813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0ec2788e-25e1-4679-83f1-39f365f2f0ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:58.754441 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0ec2788e-25e1-4679-83f1-39f365f2f0ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1670 microversion: 2.1 time: 0.153806 Oct 04 22:10:58.755008 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3594/7207] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:58 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:10:58.777271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-674e8107-c4d2-44aa-b02f-2f3ef7b8313f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:58.777837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-674e8107-c4d2-44aa-b02f-2f3ef7b8313f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:58.783816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-674e8107-c4d2-44aa-b02f-2f3ef7b8313f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:58.784320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-674e8107-c4d2-44aa-b02f-2f3ef7b8313f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:58.784781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-674e8107-c4d2-44aa-b02f-2f3ef7b8313f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:58.785532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-674e8107-c4d2-44aa-b02f-2f3ef7b8313f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:58.786017 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-674e8107-c4d2-44aa-b02f-2f3ef7b8313f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:58.786470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-674e8107-c4d2-44aa-b02f-2f3ef7b8313f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:58.812064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-674e8107-c4d2-44aa-b02f-2f3ef7b8313f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:10:58.947741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:59.148514 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-674e8107-c4d2-44aa-b02f-2f3ef7b8313f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "DELETE /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 204 len: 0 microversion: 2.1 time: 0.375396 Oct 04 22:10:59.149184 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3614/7208] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:10:58 2022] DELETE /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:10:59.157495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9a31f01e-f78d-45a0-b009-1d7f7d3dfdf7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:10:59.158186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9a31f01e-f78d-45a0-b009-1d7f7d3dfdf7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:59.164794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a31f01e-f78d-45a0-b009-1d7f7d3dfdf7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:59.165280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a31f01e-f78d-45a0-b009-1d7f7d3dfdf7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:59.165749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a31f01e-f78d-45a0-b009-1d7f7d3dfdf7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:59.166440 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a31f01e-f78d-45a0-b009-1d7f7d3dfdf7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:59.166896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a31f01e-f78d-45a0-b009-1d7f7d3dfdf7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:59.167321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9a31f01e-f78d-45a0-b009-1d7f7d3dfdf7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:59.296455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9a31f01e-f78d-45a0-b009-1d7f7d3dfdf7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:10:59.304766 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9a31f01e-f78d-45a0-b009-1d7f7d3dfdf7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1676 microversion: 2.1 time: 0.150690 Oct 04 22:10:59.305604 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3595/7209] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:10:59 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:00.330119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7672fc2f-9d34-4f2a-828a-6c0485b2bb0c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:00.330846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7672fc2f-9d34-4f2a-828a-6c0485b2bb0c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:00.339058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7672fc2f-9d34-4f2a-828a-6c0485b2bb0c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:00.339566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7672fc2f-9d34-4f2a-828a-6c0485b2bb0c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:00.340026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7672fc2f-9d34-4f2a-828a-6c0485b2bb0c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:00.340732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7672fc2f-9d34-4f2a-828a-6c0485b2bb0c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:00.341208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7672fc2f-9d34-4f2a-828a-6c0485b2bb0c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:00.341683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7672fc2f-9d34-4f2a-828a-6c0485b2bb0c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:00.475729 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7672fc2f-9d34-4f2a-828a-6c0485b2bb0c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:00.483866 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7672fc2f-9d34-4f2a-828a-6c0485b2bb0c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1676 microversion: 2.1 time: 0.158731 Oct 04 22:11:00.484443 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3615/7210] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:00 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:01.508814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8c6a78b6-d610-4e67-be2d-ebb3926f870e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:01.510082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8c6a78b6-d610-4e67-be2d-ebb3926f870e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:01.518120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c6a78b6-d610-4e67-be2d-ebb3926f870e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:01.518914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c6a78b6-d610-4e67-be2d-ebb3926f870e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:01.519429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c6a78b6-d610-4e67-be2d-ebb3926f870e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:01.520206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c6a78b6-d610-4e67-be2d-ebb3926f870e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:01.521157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c6a78b6-d610-4e67-be2d-ebb3926f870e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:01.521953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8c6a78b6-d610-4e67-be2d-ebb3926f870e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:01.538770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-4951dab0-9557-4241-a09a-1f28ce43a89c req-5511662b-c5b8-468d-a589-b9bb21a8d473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edbaa85f-c78d-43bc-860a-5a57a93438fc", "name": "network-vif-deleted", "tag": "f5c72d8a-b660-404a-8146-f684ce790630"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:01.554522 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4951dab0-9557-4241-a09a-1f28ce43a89c req-5511662b-c5b8-468d-a589-b9bb21a8d473 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:01.555099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4951dab0-9557-4241-a09a-1f28ce43a89c req-5511662b-c5b8-468d-a589-b9bb21a8d473 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:01.555596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-4951dab0-9557-4241-a09a-1f28ce43a89c req-5511662b-c5b8-468d-a589-b9bb21a8d473 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:01.567565 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-4951dab0-9557-4241-a09a-1f28ce43a89c req-5511662b-c5b8-468d-a589-b9bb21a8d473 service nova] Creating event network-vif-deleted:f5c72d8a-b660-404a-8146-f684ce790630 for instance edbaa85f-c78d-43bc-860a-5a57a93438fc on n-h2-860282-1 Oct 04 22:11:01.573882 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-4951dab0-9557-4241-a09a-1f28ce43a89c req-5511662b-c5b8-468d-a589-b9bb21a8d473 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048279 Oct 04 22:11:01.574518 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3616/7211] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:11:01.600692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8c6a78b6-d610-4e67-be2d-ebb3926f870e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:01.615155 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8c6a78b6-d610-4e67-be2d-ebb3926f870e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 200 len: 1608 microversion: 2.1 time: 0.110464 Oct 04 22:11:01.623226 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3596/7212] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:01 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 1608 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:02.642762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8909658c-890c-43c7-b949-aa62fe42e61d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:02.643612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8909658c-890c-43c7-b949-aa62fe42e61d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:02.650105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8909658c-890c-43c7-b949-aa62fe42e61d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:02.650621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8909658c-890c-43c7-b949-aa62fe42e61d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:02.651088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8909658c-890c-43c7-b949-aa62fe42e61d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:02.652103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8909658c-890c-43c7-b949-aa62fe42e61d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:02.652589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8909658c-890c-43c7-b949-aa62fe42e61d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:02.653048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8909658c-890c-43c7-b949-aa62fe42e61d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:02.669716 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-8909658c-890c-43c7-b949-aa62fe42e61d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] HTTP exception thrown: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8909658c-890c-43c7-b949-aa62fe42e61d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Request method failure captured: Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc HTTP/1.1 Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPK8oecCePEZ1fjQeOvLUymrlk79ZSDMC_m3SQmxdMtXhHHvhD1zn86_Mnhmwnf3CTzZYgu9HlWWt5S89bCsK70TBvqC_PsuS5A9ZH5z3zSd6qECgW80Bqf-YGFd31IgZ7PhK_th5fwhMT0w_DbjLHA4xe_oVPvuobxSs8EncCZ5xwHg Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5aa764882b244357892ebdad69cff689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5aa764882b244357892ebdad69cff689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}] Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerActionsTestJSON-560335426 Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c01d66c6cbba4c30831508fdaf953268 Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'edbaa85f-c78d-43bc-860a-5a57a93438fc'} Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:11:02.671377 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:11:02.676336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:11:02.676336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:11:02.676336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:11:02.676336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:11:02.676336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:11:02.676336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:11:02.676336 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:11:02.676336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8909658c-890c-43c7-b949-aa62fe42e61d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Returning 404 to user: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:11:02.676336 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8909658c-890c-43c7-b949-aa62fe42e61d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 404 len: 111 microversion: 2.1 time: 0.035649 Oct 04 22:11:02.676336 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3617/7213] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:02 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:11:02.685884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b55bfbe1-8dee-43c7-ada0-2e3b4732a766 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:02.686502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b55bfbe1-8dee-43c7-ada0-2e3b4732a766 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:02.693385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b55bfbe1-8dee-43c7-ada0-2e3b4732a766 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:02.693902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b55bfbe1-8dee-43c7-ada0-2e3b4732a766 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:02.694342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b55bfbe1-8dee-43c7-ada0-2e3b4732a766 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:02.696222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b55bfbe1-8dee-43c7-ada0-2e3b4732a766 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:02.696680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b55bfbe1-8dee-43c7-ada0-2e3b4732a766 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:02.697107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b55bfbe1-8dee-43c7-ada0-2e3b4732a766 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:02.710855 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-b55bfbe1-8dee-43c7-ada0-2e3b4732a766 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] HTTP exception thrown: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b55bfbe1-8dee-43c7-ada0-2e3b4732a766 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Request method failure captured: Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc HTTP/1.1 Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPK8oecCePEZ1fjQeOvLUymrlk79ZSDMC_m3SQmxdMtXhHHvhD1zn86_Mnhmwnf3CTzZYgu9HlWWt5S89bCsK70TBvqC_PsuS5A9ZH5z3zSd6qECgW80Bqf-YGFd31IgZ7PhK_th5fwhMT0w_DbjLHA4xe_oVPvuobxSs8EncCZ5xwHg Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5aa764882b244357892ebdad69cff689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5aa764882b244357892ebdad69cff689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}] Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerActionsTestJSON-560335426 Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c01d66c6cbba4c30831508fdaf953268 Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'edbaa85f-c78d-43bc-860a-5a57a93438fc'} Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:11:02.712496 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:11:02.717154 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:11:02.717154 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:11:02.717154 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:11:02.717154 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:11:02.717154 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:11:02.717154 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:11:02.717154 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:11:02.717154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b55bfbe1-8dee-43c7-ada0-2e3b4732a766 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Returning 404 to user: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:11:02.717154 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b55bfbe1-8dee-43c7-ada0-2e3b4732a766 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 404 len: 111 microversion: 2.1 time: 0.031945 Oct 04 22:11:02.717154 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3597/7214] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:02 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:11:02.762943 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-37ee6bbc-9bef-411b-9d3d-2d74cf477032 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-834729416", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "5f62b5be-7019-44f6-811c-aa44b61d2d81"}], "security_groups": [{"name": "tempest-securitygroup--1599777208"}], "key_name": "tempest-keypair-955841605", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:02.870118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-37ee6bbc-9bef-411b-9d3d-2d74cf477032 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] validate_networks() for [('5f62b5be-7019-44f6-811c-aa44b61d2d81', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:11:03.253983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-37ee6bbc-9bef-411b-9d3d-2d74cf477032 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:11:03.254451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-37ee6bbc-9bef-411b-9d3d-2d74cf477032 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:11:03.254970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-37ee6bbc-9bef-411b-9d3d-2d74cf477032 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:11:03.255399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-37ee6bbc-9bef-411b-9d3d-2d74cf477032 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:11:03.255827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-37ee6bbc-9bef-411b-9d3d-2d74cf477032 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:11:03.264724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37ee6bbc-9bef-411b-9d3d-2d74cf477032 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:03.265222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37ee6bbc-9bef-411b-9d3d-2d74cf477032 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:03.265969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37ee6bbc-9bef-411b-9d3d-2d74cf477032 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:03.266720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37ee6bbc-9bef-411b-9d3d-2d74cf477032 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:03.267190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37ee6bbc-9bef-411b-9d3d-2d74cf477032 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:03.267631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-37ee6bbc-9bef-411b-9d3d-2d74cf477032 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:03.284397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-37ee6bbc-9bef-411b-9d3d-2d74cf477032 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Getting quotas for project 5aa764882b244357892ebdad69cff689. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:11:03.290317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-37ee6bbc-9bef-411b-9d3d-2d74cf477032 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Getting quotas for user c01d66c6cbba4c30831508fdaf953268 and project 5aa764882b244357892ebdad69cff689. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:11:03.302313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-37ee6bbc-9bef-411b-9d3d-2d74cf477032 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:11:03.304873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-37ee6bbc-9bef-411b-9d3d-2d74cf477032 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:11:03.431827 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-37ee6bbc-9bef-411b-9d3d-2d74cf477032 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.673040 Oct 04 22:11:03.432476 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3618/7215] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:11:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:11:03.443531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-83602a7b-ca47-443b-904f-5b0a0420cc60 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:03.444150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-83602a7b-ca47-443b-904f-5b0a0420cc60 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:03.503433 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-83602a7b-ca47-443b-904f-5b0a0420cc60 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:03.511562 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-83602a7b-ca47-443b-904f-5b0a0420cc60 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1237 microversion: 2.1 time: 0.071859 Oct 04 22:11:03.512183 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3598/7216] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:03 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:04.539133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-713a41bc-819c-4b66-880a-b89d129f121d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:04.540510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-713a41bc-819c-4b66-880a-b89d129f121d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:04.547991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-713a41bc-819c-4b66-880a-b89d129f121d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:04.548504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-713a41bc-819c-4b66-880a-b89d129f121d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:04.548974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-713a41bc-819c-4b66-880a-b89d129f121d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:04.549737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-713a41bc-819c-4b66-880a-b89d129f121d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:04.550225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-713a41bc-819c-4b66-880a-b89d129f121d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:04.550666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-713a41bc-819c-4b66-880a-b89d129f121d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:04.614105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-713a41bc-819c-4b66-880a-b89d129f121d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:04.622824 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-713a41bc-819c-4b66-880a-b89d129f121d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1233 microversion: 2.1 time: 0.087650 Oct 04 22:11:04.622824 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3619/7217] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:04 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1233 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:05.646004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-994fe7a7-2301-4393-9cf1-e96bd0872650 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:05.646681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-994fe7a7-2301-4393-9cf1-e96bd0872650 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:05.649604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=45 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:05.655347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-994fe7a7-2301-4393-9cf1-e96bd0872650 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:05.655846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-994fe7a7-2301-4393-9cf1-e96bd0872650 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:05.656289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-994fe7a7-2301-4393-9cf1-e96bd0872650 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:05.656987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-994fe7a7-2301-4393-9cf1-e96bd0872650 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:05.657456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-994fe7a7-2301-4393-9cf1-e96bd0872650 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:05.664882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-994fe7a7-2301-4393-9cf1-e96bd0872650 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:05.724284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-994fe7a7-2301-4393-9cf1-e96bd0872650 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:05.732213 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-994fe7a7-2301-4393-9cf1-e96bd0872650 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1295 microversion: 2.1 time: 0.090142 Oct 04 22:11:05.732794 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3599/7218] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:05 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1295 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:06.758834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1deed95b-032f-4a3b-b577-816329ec3018 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:06.759501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1deed95b-032f-4a3b-b577-816329ec3018 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:06.762369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:06.767376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1deed95b-032f-4a3b-b577-816329ec3018 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:06.770226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1deed95b-032f-4a3b-b577-816329ec3018 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:06.770226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1deed95b-032f-4a3b-b577-816329ec3018 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:06.770226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1deed95b-032f-4a3b-b577-816329ec3018 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:06.770226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1deed95b-032f-4a3b-b577-816329ec3018 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:06.770226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1deed95b-032f-4a3b-b577-816329ec3018 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:06.905899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1deed95b-032f-4a3b-b577-816329ec3018 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:06.915208 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1deed95b-032f-4a3b-b577-816329ec3018 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1363 microversion: 2.1 time: 0.159725 Oct 04 22:11:06.917579 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3620/7219] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:06 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:06.929583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-d234df6b-a08e-4708-8f87-ee08c72ed125 req-6b5e5474-e2f3-4c23-b6dc-54c9e989932a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32ffb34b-569d-4809-8ba0-07758088a706", "tag": "f15a50d1-a893-4a79-93ed-11b415f8c974"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:06.940479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d234df6b-a08e-4708-8f87-ee08c72ed125 req-6b5e5474-e2f3-4c23-b6dc-54c9e989932a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:06.941049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d234df6b-a08e-4708-8f87-ee08c72ed125 req-6b5e5474-e2f3-4c23-b6dc-54c9e989932a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:06.941535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d234df6b-a08e-4708-8f87-ee08c72ed125 req-6b5e5474-e2f3-4c23-b6dc-54c9e989932a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:06.952864 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-d234df6b-a08e-4708-8f87-ee08c72ed125 req-6b5e5474-e2f3-4c23-b6dc-54c9e989932a service nova] Creating event network-changed:f15a50d1-a893-4a79-93ed-11b415f8c974 for instance 32ffb34b-569d-4809-8ba0-07758088a706 on n-h1-860282-1 Oct 04 22:11:06.957875 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-d234df6b-a08e-4708-8f87-ee08c72ed125 req-6b5e5474-e2f3-4c23-b6dc-54c9e989932a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032162 Oct 04 22:11:06.958478 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3600/7220] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:11:07.939171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-54e706ea-8e5c-4456-8835-de2824b78973 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:07.939752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-54e706ea-8e5c-4456-8835-de2824b78973 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:07.947077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54e706ea-8e5c-4456-8835-de2824b78973 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:07.947582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54e706ea-8e5c-4456-8835-de2824b78973 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:07.948048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54e706ea-8e5c-4456-8835-de2824b78973 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:07.948757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54e706ea-8e5c-4456-8835-de2824b78973 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:07.949233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54e706ea-8e5c-4456-8835-de2824b78973 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:07.949707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54e706ea-8e5c-4456-8835-de2824b78973 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:08.080927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-54e706ea-8e5c-4456-8835-de2824b78973 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:08.088806 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-54e706ea-8e5c-4456-8835-de2824b78973 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1363 microversion: 2.1 time: 0.153756 Oct 04 22:11:08.089385 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3621/7221] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:07 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:09.116275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a3d3b70-eb62-472a-80d9-7024ef05135c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:09.116988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7a3d3b70-eb62-472a-80d9-7024ef05135c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:09.124125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a3d3b70-eb62-472a-80d9-7024ef05135c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:09.124611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a3d3b70-eb62-472a-80d9-7024ef05135c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:09.125049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a3d3b70-eb62-472a-80d9-7024ef05135c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:09.125762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a3d3b70-eb62-472a-80d9-7024ef05135c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:09.126246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a3d3b70-eb62-472a-80d9-7024ef05135c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:09.126649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a3d3b70-eb62-472a-80d9-7024ef05135c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:09.255548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7a3d3b70-eb62-472a-80d9-7024ef05135c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:09.263704 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7a3d3b70-eb62-472a-80d9-7024ef05135c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1363 microversion: 2.1 time: 0.152926 Oct 04 22:11:09.264288 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3601/7222] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:09 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:10.287758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-65be690a-59e5-4e45-b75b-88a477c3f49f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:10.288344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-65be690a-59e5-4e45-b75b-88a477c3f49f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:10.295847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65be690a-59e5-4e45-b75b-88a477c3f49f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:10.296353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65be690a-59e5-4e45-b75b-88a477c3f49f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:10.296810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65be690a-59e5-4e45-b75b-88a477c3f49f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:10.297557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65be690a-59e5-4e45-b75b-88a477c3f49f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:10.298033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65be690a-59e5-4e45-b75b-88a477c3f49f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:10.298480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65be690a-59e5-4e45-b75b-88a477c3f49f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:10.432546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-65be690a-59e5-4e45-b75b-88a477c3f49f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:10.440268 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-65be690a-59e5-4e45-b75b-88a477c3f49f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1363 microversion: 2.1 time: 0.156485 Oct 04 22:11:10.440855 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3622/7223] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:10 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:11.463998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-66c0b0bd-e2f1-4e98-83dd-8c4549bc5cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:11.464658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-66c0b0bd-e2f1-4e98-83dd-8c4549bc5cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:11.471518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66c0b0bd-e2f1-4e98-83dd-8c4549bc5cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:11.472015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66c0b0bd-e2f1-4e98-83dd-8c4549bc5cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:11.472456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66c0b0bd-e2f1-4e98-83dd-8c4549bc5cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:11.473156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66c0b0bd-e2f1-4e98-83dd-8c4549bc5cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:11.473646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66c0b0bd-e2f1-4e98-83dd-8c4549bc5cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:11.474081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66c0b0bd-e2f1-4e98-83dd-8c4549bc5cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:11.615824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-66c0b0bd-e2f1-4e98-83dd-8c4549bc5cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:11.624461 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-66c0b0bd-e2f1-4e98-83dd-8c4549bc5cc8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1363 microversion: 2.1 time: 0.165014 Oct 04 22:11:11.625198 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3602/7224] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:11 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:11.706862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-f49cb306-7e74-43ad-b6d6-eca1695e5884 req-1bd9a325-c871-4b48-8336-c54cb526bde4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ffb34b-569d-4809-8ba0-07758088a706", "name": "network-vif-plugged", "status": "completed", "tag": "f15a50d1-a893-4a79-93ed-11b415f8c974"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:11.717743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f49cb306-7e74-43ad-b6d6-eca1695e5884 req-1bd9a325-c871-4b48-8336-c54cb526bde4 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:11.718184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f49cb306-7e74-43ad-b6d6-eca1695e5884 req-1bd9a325-c871-4b48-8336-c54cb526bde4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:11.718632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f49cb306-7e74-43ad-b6d6-eca1695e5884 req-1bd9a325-c871-4b48-8336-c54cb526bde4 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:11.729592 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-f49cb306-7e74-43ad-b6d6-eca1695e5884 req-1bd9a325-c871-4b48-8336-c54cb526bde4 service nova] Creating event network-vif-plugged:f15a50d1-a893-4a79-93ed-11b415f8c974 for instance 32ffb34b-569d-4809-8ba0-07758088a706 on n-h1-860282-1 Oct 04 22:11:11.734523 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-f49cb306-7e74-43ad-b6d6-eca1695e5884 req-1bd9a325-c871-4b48-8336-c54cb526bde4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031483 Oct 04 22:11:11.735113 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3623/7225] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:11:12.648148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-69afb4f1-f6db-45a9-84a9-515e3089b353 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:12.649412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-69afb4f1-f6db-45a9-84a9-515e3089b353 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:12.656200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-69afb4f1-f6db-45a9-84a9-515e3089b353 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:12.656697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-69afb4f1-f6db-45a9-84a9-515e3089b353 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:12.657125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-69afb4f1-f6db-45a9-84a9-515e3089b353 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:12.657850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-69afb4f1-f6db-45a9-84a9-515e3089b353 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:12.658310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-69afb4f1-f6db-45a9-84a9-515e3089b353 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:12.658741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-69afb4f1-f6db-45a9-84a9-515e3089b353 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:12.791239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-69afb4f1-f6db-45a9-84a9-515e3089b353 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:12.798838 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-69afb4f1-f6db-45a9-84a9-515e3089b353 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1363 microversion: 2.1 time: 0.154631 Oct 04 22:11:12.799410 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3603/7226] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:12 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:13.821247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:13.822063 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:13.826196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4ef35a97-0d06-4446-8b04-e518a836dff0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:13.826920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4ef35a97-0d06-4446-8b04-e518a836dff0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:13.832970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ef35a97-0d06-4446-8b04-e518a836dff0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:13.837731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ef35a97-0d06-4446-8b04-e518a836dff0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:13.837731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ef35a97-0d06-4446-8b04-e518a836dff0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:13.837731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ef35a97-0d06-4446-8b04-e518a836dff0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:13.837731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ef35a97-0d06-4446-8b04-e518a836dff0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:13.837731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ef35a97-0d06-4446-8b04-e518a836dff0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:13.969634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4ef35a97-0d06-4446-8b04-e518a836dff0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:13.978405 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4ef35a97-0d06-4446-8b04-e518a836dff0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1550 microversion: 2.1 time: 0.159195 Oct 04 22:11:13.979039 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3624/7227] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:13 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:14.001848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e94839bf-4deb-4a2c-b7df-96144aa46bd6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:14.002354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e94839bf-4deb-4a2c-b7df-96144aa46bd6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:14.004249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:14.010607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e94839bf-4deb-4a2c-b7df-96144aa46bd6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:14.011092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e94839bf-4deb-4a2c-b7df-96144aa46bd6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:14.011528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e94839bf-4deb-4a2c-b7df-96144aa46bd6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:14.012207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e94839bf-4deb-4a2c-b7df-96144aa46bd6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:14.012660 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e94839bf-4deb-4a2c-b7df-96144aa46bd6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:14.013085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e94839bf-4deb-4a2c-b7df-96144aa46bd6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:14.091820 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e94839bf-4deb-4a2c-b7df-96144aa46bd6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093882 Oct 04 22:11:14.092418 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3604/7228] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 22:11:13 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:11:15.439576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-69aa1de6-4d24-40ba-b283-2759a43343a6 req-1c5d78e8-115b-45a5-b7cc-c9c5d7ac005e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32ffb34b-569d-4809-8ba0-07758088a706", "tag": "f15a50d1-a893-4a79-93ed-11b415f8c974"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:15.450826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-69aa1de6-4d24-40ba-b283-2759a43343a6 req-1c5d78e8-115b-45a5-b7cc-c9c5d7ac005e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:15.451355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-69aa1de6-4d24-40ba-b283-2759a43343a6 req-1c5d78e8-115b-45a5-b7cc-c9c5d7ac005e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:15.451809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-69aa1de6-4d24-40ba-b283-2759a43343a6 req-1c5d78e8-115b-45a5-b7cc-c9c5d7ac005e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:15.463257 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-69aa1de6-4d24-40ba-b283-2759a43343a6 req-1c5d78e8-115b-45a5-b7cc-c9c5d7ac005e service nova] Creating event network-changed:f15a50d1-a893-4a79-93ed-11b415f8c974 for instance 32ffb34b-569d-4809-8ba0-07758088a706 on n-h1-860282-1 Oct 04 22:11:15.468190 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-69aa1de6-4d24-40ba-b283-2759a43343a6 req-1c5d78e8-115b-45a5-b7cc-c9c5d7ac005e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032598 Oct 04 22:11:15.468792 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3625/7229] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:11:48.359507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=11 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:48.360267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=47 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:48.364420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-925825ae-7830-43bc-a7d3-fb9f402418d3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:48.370824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-925825ae-7830-43bc-a7d3-fb9f402418d3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:48.371311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-925825ae-7830-43bc-a7d3-fb9f402418d3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:48.371750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-925825ae-7830-43bc-a7d3-fb9f402418d3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:48.394938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-925825ae-7830-43bc-a7d3-fb9f402418d3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Going to try to stop instance {{(pid=122758) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 22:11:48.545625 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-925825ae-7830-43bc-a7d3-fb9f402418d3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "POST /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706/action" status: 202 len: 0 microversion: 2.1 time: 0.187812 Oct 04 22:11:48.546247 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3605/7230] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:11:48 2022] POST /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:11:48.553410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=11 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:48.554506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=46 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:48.558901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6709b720-a4d9-4e8a-97e3-1b5de04bda9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:48.559625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6709b720-a4d9-4e8a-97e3-1b5de04bda9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:48.565809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6709b720-a4d9-4e8a-97e3-1b5de04bda9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:48.566303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6709b720-a4d9-4e8a-97e3-1b5de04bda9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:48.566758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6709b720-a4d9-4e8a-97e3-1b5de04bda9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:48.567460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6709b720-a4d9-4e8a-97e3-1b5de04bda9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:48.567934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6709b720-a4d9-4e8a-97e3-1b5de04bda9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:48.568377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6709b720-a4d9-4e8a-97e3-1b5de04bda9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:48.705651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6709b720-a4d9-4e8a-97e3-1b5de04bda9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:48.714174 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6709b720-a4d9-4e8a-97e3-1b5de04bda9d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1679 microversion: 2.1 time: 0.163159 Oct 04 22:11:48.714782 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3626/7231] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:48 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:49.738791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-43da8e75-b0b8-4fa9-a6f7-df19cc4d72db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:49.739496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-43da8e75-b0b8-4fa9-a6f7-df19cc4d72db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:49.745890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43da8e75-b0b8-4fa9-a6f7-df19cc4d72db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:49.746378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43da8e75-b0b8-4fa9-a6f7-df19cc4d72db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:49.746820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43da8e75-b0b8-4fa9-a6f7-df19cc4d72db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:49.747509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43da8e75-b0b8-4fa9-a6f7-df19cc4d72db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:49.747966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43da8e75-b0b8-4fa9-a6f7-df19cc4d72db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:49.748395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-43da8e75-b0b8-4fa9-a6f7-df19cc4d72db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:49.884123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-43da8e75-b0b8-4fa9-a6f7-df19cc4d72db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:49.892352 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-43da8e75-b0b8-4fa9-a6f7-df19cc4d72db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1679 microversion: 2.1 time: 0.158677 Oct 04 22:11:49.892942 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3606/7232] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:49 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:50.916694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9869766d-7a69-4aac-bc8b-fb9b6f0e981d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:50.917339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9869766d-7a69-4aac-bc8b-fb9b6f0e981d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:50.924602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9869766d-7a69-4aac-bc8b-fb9b6f0e981d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:50.925106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9869766d-7a69-4aac-bc8b-fb9b6f0e981d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:50.925595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9869766d-7a69-4aac-bc8b-fb9b6f0e981d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:50.926307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9869766d-7a69-4aac-bc8b-fb9b6f0e981d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:50.926775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9869766d-7a69-4aac-bc8b-fb9b6f0e981d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:50.927216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9869766d-7a69-4aac-bc8b-fb9b6f0e981d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:51.060131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9869766d-7a69-4aac-bc8b-fb9b6f0e981d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:51.067865 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9869766d-7a69-4aac-bc8b-fb9b6f0e981d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1679 microversion: 2.1 time: 0.155749 Oct 04 22:11:51.068435 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3627/7233] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:50 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:52.092909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5f5b72e4-a4b4-42a2-a823-76ae8306bc54 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:52.093557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5f5b72e4-a4b4-42a2-a823-76ae8306bc54 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:52.100318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f5b72e4-a4b4-42a2-a823-76ae8306bc54 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:52.100798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f5b72e4-a4b4-42a2-a823-76ae8306bc54 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:52.101233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f5b72e4-a4b4-42a2-a823-76ae8306bc54 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:52.101941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f5b72e4-a4b4-42a2-a823-76ae8306bc54 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:52.102509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f5b72e4-a4b4-42a2-a823-76ae8306bc54 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:52.102820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f5b72e4-a4b4-42a2-a823-76ae8306bc54 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:52.231911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5f5b72e4-a4b4-42a2-a823-76ae8306bc54 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:52.239641 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5f5b72e4-a4b4-42a2-a823-76ae8306bc54 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1679 microversion: 2.1 time: 0.150604 Oct 04 22:11:52.240220 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3607/7234] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:52 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:11:53.264180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9c95023b-8d3d-46c9-810f-158b1738f64a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:53.265069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9c95023b-8d3d-46c9-810f-158b1738f64a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:53.271879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c95023b-8d3d-46c9-810f-158b1738f64a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:53.272383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c95023b-8d3d-46c9-810f-158b1738f64a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:53.272842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c95023b-8d3d-46c9-810f-158b1738f64a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:53.273583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c95023b-8d3d-46c9-810f-158b1738f64a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:53.274090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c95023b-8d3d-46c9-810f-158b1738f64a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:53.274541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c95023b-8d3d-46c9-810f-158b1738f64a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:53.404145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9c95023b-8d3d-46c9-810f-158b1738f64a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:53.410592 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9c95023b-8d3d-46c9-810f-158b1738f64a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1679 microversion: 2.1 time: 0.150916 Oct 04 22:11:53.411172 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3628/7235] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:53 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:54.434537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-113af619-ac8a-451c-bf48-ddc098dbc7a3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:54.435085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-113af619-ac8a-451c-bf48-ddc098dbc7a3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:54.441924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-113af619-ac8a-451c-bf48-ddc098dbc7a3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:54.442451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-113af619-ac8a-451c-bf48-ddc098dbc7a3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:54.442896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-113af619-ac8a-451c-bf48-ddc098dbc7a3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:54.443591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-113af619-ac8a-451c-bf48-ddc098dbc7a3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:54.444060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-113af619-ac8a-451c-bf48-ddc098dbc7a3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:54.444495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-113af619-ac8a-451c-bf48-ddc098dbc7a3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:54.577613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-113af619-ac8a-451c-bf48-ddc098dbc7a3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:54.585392 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-113af619-ac8a-451c-bf48-ddc098dbc7a3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1679 microversion: 2.1 time: 0.155460 Oct 04 22:11:54.585993 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3608/7236] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:54 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:55.609784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a179d5a0-a643-463c-9e7d-ab9ebc67aec6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:55.610425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a179d5a0-a643-463c-9e7d-ab9ebc67aec6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:55.617291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a179d5a0-a643-463c-9e7d-ab9ebc67aec6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:55.617832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a179d5a0-a643-463c-9e7d-ab9ebc67aec6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:55.618290 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a179d5a0-a643-463c-9e7d-ab9ebc67aec6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:55.619006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a179d5a0-a643-463c-9e7d-ab9ebc67aec6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:55.619477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a179d5a0-a643-463c-9e7d-ab9ebc67aec6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:55.619924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a179d5a0-a643-463c-9e7d-ab9ebc67aec6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:55.746475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a179d5a0-a643-463c-9e7d-ab9ebc67aec6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:55.754333 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a179d5a0-a643-463c-9e7d-ab9ebc67aec6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1679 microversion: 2.1 time: 0.148531 Oct 04 22:11:55.754924 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3629/7237] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:55 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:56.777966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-25c8c137-4101-44ea-b93c-425f9d59a51c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:56.788652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-25c8c137-4101-44ea-b93c-425f9d59a51c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:56.788652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25c8c137-4101-44ea-b93c-425f9d59a51c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:56.788652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25c8c137-4101-44ea-b93c-425f9d59a51c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:56.788652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25c8c137-4101-44ea-b93c-425f9d59a51c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:56.788652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25c8c137-4101-44ea-b93c-425f9d59a51c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:56.788652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25c8c137-4101-44ea-b93c-425f9d59a51c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:56.788652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25c8c137-4101-44ea-b93c-425f9d59a51c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:56.925873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-25c8c137-4101-44ea-b93c-425f9d59a51c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:56.934548 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-25c8c137-4101-44ea-b93c-425f9d59a51c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1679 microversion: 2.1 time: 0.160603 Oct 04 22:11:56.935132 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3609/7238] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:56 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:57.958126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dcbfdf58-98c5-47f6-96a7-c836fd1bcb72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:57.958764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dcbfdf58-98c5-47f6-96a7-c836fd1bcb72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:57.966078 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcbfdf58-98c5-47f6-96a7-c836fd1bcb72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:57.966585 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcbfdf58-98c5-47f6-96a7-c836fd1bcb72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:57.967043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcbfdf58-98c5-47f6-96a7-c836fd1bcb72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:57.967753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcbfdf58-98c5-47f6-96a7-c836fd1bcb72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:57.968231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcbfdf58-98c5-47f6-96a7-c836fd1bcb72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:57.968679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dcbfdf58-98c5-47f6-96a7-c836fd1bcb72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:58.098179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dcbfdf58-98c5-47f6-96a7-c836fd1bcb72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:58.106383 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dcbfdf58-98c5-47f6-96a7-c836fd1bcb72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1679 microversion: 2.1 time: 0.152212 Oct 04 22:11:58.106957 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3630/7239] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:57 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:59.129009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0e31a764-c1f2-4281-8786-f8aeffd32d7a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:59.129657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0e31a764-c1f2-4281-8786-f8aeffd32d7a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:59.137271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e31a764-c1f2-4281-8786-f8aeffd32d7a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:59.137793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e31a764-c1f2-4281-8786-f8aeffd32d7a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:59.138244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e31a764-c1f2-4281-8786-f8aeffd32d7a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:59.138942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e31a764-c1f2-4281-8786-f8aeffd32d7a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:59.139650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e31a764-c1f2-4281-8786-f8aeffd32d7a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:59.140091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e31a764-c1f2-4281-8786-f8aeffd32d7a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:59.270276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0e31a764-c1f2-4281-8786-f8aeffd32d7a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:59.278985 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0e31a764-c1f2-4281-8786-f8aeffd32d7a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1679 microversion: 2.1 time: 0.153859 Oct 04 22:11:59.279572 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3610/7240] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:59 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:00.302686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f231592e-2d36-46c3-8e61-e11af4471022 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:00.303254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f231592e-2d36-46c3-8e61-e11af4471022 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:00.310855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f231592e-2d36-46c3-8e61-e11af4471022 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:00.311366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f231592e-2d36-46c3-8e61-e11af4471022 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:00.311831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f231592e-2d36-46c3-8e61-e11af4471022 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:00.312546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f231592e-2d36-46c3-8e61-e11af4471022 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:00.313028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f231592e-2d36-46c3-8e61-e11af4471022 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:00.313518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f231592e-2d36-46c3-8e61-e11af4471022 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:00.452485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f231592e-2d36-46c3-8e61-e11af4471022 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:00.460239 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f231592e-2d36-46c3-8e61-e11af4471022 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1679 microversion: 2.1 time: 0.161630 Oct 04 22:12:00.460830 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3631/7241] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:00 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:01.483753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bd7e6a3f-cf26-4812-ad0d-96adc2704114 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:01.484352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bd7e6a3f-cf26-4812-ad0d-96adc2704114 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:01.491144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd7e6a3f-cf26-4812-ad0d-96adc2704114 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:01.491631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd7e6a3f-cf26-4812-ad0d-96adc2704114 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:01.492066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd7e6a3f-cf26-4812-ad0d-96adc2704114 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:01.492755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd7e6a3f-cf26-4812-ad0d-96adc2704114 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:01.493209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd7e6a3f-cf26-4812-ad0d-96adc2704114 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:01.493670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd7e6a3f-cf26-4812-ad0d-96adc2704114 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:01.627267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bd7e6a3f-cf26-4812-ad0d-96adc2704114 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:01.634972 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bd7e6a3f-cf26-4812-ad0d-96adc2704114 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1679 microversion: 2.1 time: 0.155195 Oct 04 22:12:01.635533 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3611/7242] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:01 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:02.659769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8e044f00-474f-4724-84ea-7dc30cd86c2a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:02.660396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8e044f00-474f-4724-84ea-7dc30cd86c2a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:02.667477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e044f00-474f-4724-84ea-7dc30cd86c2a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:02.667969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e044f00-474f-4724-84ea-7dc30cd86c2a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:02.668443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e044f00-474f-4724-84ea-7dc30cd86c2a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:02.669306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e044f00-474f-4724-84ea-7dc30cd86c2a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:02.669802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e044f00-474f-4724-84ea-7dc30cd86c2a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:02.670243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e044f00-474f-4724-84ea-7dc30cd86c2a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:02.810149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8e044f00-474f-4724-84ea-7dc30cd86c2a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:02.823062 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8e044f00-474f-4724-84ea-7dc30cd86c2a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1679 microversion: 2.1 time: 0.166224 Oct 04 22:12:02.823669 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3632/7243] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:02 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:03.850389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cfbb973f-3874-4bc6-856f-081a1f1c0308 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:03.851007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cfbb973f-3874-4bc6-856f-081a1f1c0308 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:03.858256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfbb973f-3874-4bc6-856f-081a1f1c0308 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:03.859952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfbb973f-3874-4bc6-856f-081a1f1c0308 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:03.859952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfbb973f-3874-4bc6-856f-081a1f1c0308 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:03.860206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfbb973f-3874-4bc6-856f-081a1f1c0308 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:03.860688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfbb973f-3874-4bc6-856f-081a1f1c0308 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:03.861121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfbb973f-3874-4bc6-856f-081a1f1c0308 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:03.996316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cfbb973f-3874-4bc6-856f-081a1f1c0308 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:04.005658 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cfbb973f-3874-4bc6-856f-081a1f1c0308 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1679 microversion: 2.1 time: 0.159072 Oct 04 22:12:04.006271 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3612/7244] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:03 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:05.029280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c17f88df-c701-4262-ba29-6f79972f2202 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:05.029964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c17f88df-c701-4262-ba29-6f79972f2202 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:05.037564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c17f88df-c701-4262-ba29-6f79972f2202 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:05.038071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c17f88df-c701-4262-ba29-6f79972f2202 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:05.038526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c17f88df-c701-4262-ba29-6f79972f2202 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:05.039235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c17f88df-c701-4262-ba29-6f79972f2202 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:05.039708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c17f88df-c701-4262-ba29-6f79972f2202 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:05.040155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c17f88df-c701-4262-ba29-6f79972f2202 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:05.170912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c17f88df-c701-4262-ba29-6f79972f2202 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:05.178832 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c17f88df-c701-4262-ba29-6f79972f2202 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1656 microversion: 2.1 time: 0.153474 Oct 04 22:12:05.179410 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3633/7245] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:05 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1656 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:05.201394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-03be59cb-af63-43ec-beea-6d40687718a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:05.203645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-03be59cb-af63-43ec-beea-6d40687718a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:05.210394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03be59cb-af63-43ec-beea-6d40687718a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:05.210882 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03be59cb-af63-43ec-beea-6d40687718a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:05.211325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03be59cb-af63-43ec-beea-6d40687718a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:05.212016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03be59cb-af63-43ec-beea-6d40687718a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:05.212474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03be59cb-af63-43ec-beea-6d40687718a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:05.212906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03be59cb-af63-43ec-beea-6d40687718a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:05.240537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-03be59cb-af63-43ec-beea-6d40687718a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:05.245764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-03be59cb-af63-43ec-beea-6d40687718a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Old instance type m1.heat2, new instance type m1.heat {{(pid=122758) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:12:05.252789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-03be59cb-af63-43ec-beea-6d40687718a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:12:05.253217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-03be59cb-af63-43ec-beea-6d40687718a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:12:05.253717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-03be59cb-af63-43ec-beea-6d40687718a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:12:05.254135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-03be59cb-af63-43ec-beea-6d40687718a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:12:05.254554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-03be59cb-af63-43ec-beea-6d40687718a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:12:05.442626 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-03be59cb-af63-43ec-beea-6d40687718a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "POST /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706/action" status: 202 len: 0 microversion: 2.1 time: 0.245535 Oct 04 22:12:05.443462 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3613/7246] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:12:05 2022] POST /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:12:05.454904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4805b138-435d-4da3-a2c5-4d0cc998b083 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:05.456309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4805b138-435d-4da3-a2c5-4d0cc998b083 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:05.462265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4805b138-435d-4da3-a2c5-4d0cc998b083 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:05.462772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4805b138-435d-4da3-a2c5-4d0cc998b083 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:05.463234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4805b138-435d-4da3-a2c5-4d0cc998b083 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:05.463982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4805b138-435d-4da3-a2c5-4d0cc998b083 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:05.464460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4805b138-435d-4da3-a2c5-4d0cc998b083 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:05.464907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4805b138-435d-4da3-a2c5-4d0cc998b083 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:05.598661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4805b138-435d-4da3-a2c5-4d0cc998b083 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:05.606476 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4805b138-435d-4da3-a2c5-4d0cc998b083 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1679 microversion: 2.1 time: 0.158951 Oct 04 22:12:05.607556 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3634/7247] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:05 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:06.631230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ad7944d0-4bde-4e30-824d-b1696dbb245c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:06.631848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ad7944d0-4bde-4e30-824d-b1696dbb245c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:06.640637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad7944d0-4bde-4e30-824d-b1696dbb245c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:06.641112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad7944d0-4bde-4e30-824d-b1696dbb245c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:06.641587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad7944d0-4bde-4e30-824d-b1696dbb245c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:06.642471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad7944d0-4bde-4e30-824d-b1696dbb245c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:06.642936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad7944d0-4bde-4e30-824d-b1696dbb245c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:06.643354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad7944d0-4bde-4e30-824d-b1696dbb245c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:06.778448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ad7944d0-4bde-4e30-824d-b1696dbb245c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:06.786928 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ad7944d0-4bde-4e30-824d-b1696dbb245c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1679 microversion: 2.1 time: 0.160582 Oct 04 22:12:06.787507 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3614/7248] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:06 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:07.811808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5d85aa49-03b0-4d4f-a3cd-47cd3a64be06 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:07.812381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5d85aa49-03b0-4d4f-a3cd-47cd3a64be06 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:07.819347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d85aa49-03b0-4d4f-a3cd-47cd3a64be06 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.819880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d85aa49-03b0-4d4f-a3cd-47cd3a64be06 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.820341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d85aa49-03b0-4d4f-a3cd-47cd3a64be06 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.821198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d85aa49-03b0-4d4f-a3cd-47cd3a64be06 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:07.821696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d85aa49-03b0-4d4f-a3cd-47cd3a64be06 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:07.822143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d85aa49-03b0-4d4f-a3cd-47cd3a64be06 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:07.955499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5d85aa49-03b0-4d4f-a3cd-47cd3a64be06 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:07.963482 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5d85aa49-03b0-4d4f-a3cd-47cd3a64be06 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1679 microversion: 2.1 time: 0.155933 Oct 04 22:12:07.964063 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3635/7249] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:07 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:08.987654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7cde0433-eaee-447d-8844-34b6ab05ba28 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:08.988281 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7cde0433-eaee-447d-8844-34b6ab05ba28 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:08.995232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cde0433-eaee-447d-8844-34b6ab05ba28 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:08.995724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cde0433-eaee-447d-8844-34b6ab05ba28 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:08.996170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cde0433-eaee-447d-8844-34b6ab05ba28 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:08.996871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cde0433-eaee-447d-8844-34b6ab05ba28 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:08.997332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cde0433-eaee-447d-8844-34b6ab05ba28 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:08.997813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7cde0433-eaee-447d-8844-34b6ab05ba28 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:09.126796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7cde0433-eaee-447d-8844-34b6ab05ba28 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:09.134625 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7cde0433-eaee-447d-8844-34b6ab05ba28 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1684 microversion: 2.1 time: 0.150911 Oct 04 22:12:09.135210 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3615/7250] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:08 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:10.158788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-854ab2d5-c3ac-4f0f-81c3-71b2476303cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:10.159419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-854ab2d5-c3ac-4f0f-81c3-71b2476303cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:10.166262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-854ab2d5-c3ac-4f0f-81c3-71b2476303cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:10.166763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-854ab2d5-c3ac-4f0f-81c3-71b2476303cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:10.167220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-854ab2d5-c3ac-4f0f-81c3-71b2476303cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:10.167924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-854ab2d5-c3ac-4f0f-81c3-71b2476303cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:10.168396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-854ab2d5-c3ac-4f0f-81c3-71b2476303cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:10.168838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-854ab2d5-c3ac-4f0f-81c3-71b2476303cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:10.311566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-854ab2d5-c3ac-4f0f-81c3-71b2476303cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:10.311566 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-854ab2d5-c3ac-4f0f-81c3-71b2476303cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1684 microversion: 2.1 time: 0.154236 Oct 04 22:12:10.311566 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3636/7251] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:10 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:11.332957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ad83193c-28f6-4e77-bdb4-54e2c82e1fa4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:11.333593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ad83193c-28f6-4e77-bdb4-54e2c82e1fa4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:11.340367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad83193c-28f6-4e77-bdb4-54e2c82e1fa4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:11.349543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad83193c-28f6-4e77-bdb4-54e2c82e1fa4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:11.349543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad83193c-28f6-4e77-bdb4-54e2c82e1fa4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:11.349543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad83193c-28f6-4e77-bdb4-54e2c82e1fa4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:11.349543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad83193c-28f6-4e77-bdb4-54e2c82e1fa4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:11.349543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ad83193c-28f6-4e77-bdb4-54e2c82e1fa4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:11.412413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-57f3bd29-8d5d-4664-9ae3-8552e4d47954 req-fb8d184c-bf79-4099-a84a-60fd8e47bf94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ffb34b-569d-4809-8ba0-07758088a706", "name": "network-vif-unplugged", "status": "completed", "tag": "f15a50d1-a893-4a79-93ed-11b415f8c974"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:11.422997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-57f3bd29-8d5d-4664-9ae3-8552e4d47954 req-fb8d184c-bf79-4099-a84a-60fd8e47bf94 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:11.424820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-57f3bd29-8d5d-4664-9ae3-8552e4d47954 req-fb8d184c-bf79-4099-a84a-60fd8e47bf94 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:11.424820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-57f3bd29-8d5d-4664-9ae3-8552e4d47954 req-fb8d184c-bf79-4099-a84a-60fd8e47bf94 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:11.439611 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-57f3bd29-8d5d-4664-9ae3-8552e4d47954 req-fb8d184c-bf79-4099-a84a-60fd8e47bf94 service nova] Creating event network-vif-unplugged:f15a50d1-a893-4a79-93ed-11b415f8c974 for instance 32ffb34b-569d-4809-8ba0-07758088a706 on n-h2-860282-1 Oct 04 22:12:11.445181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [req-57f3bd29-8d5d-4664-9ae3-8552e4d47954 req-fb8d184c-bf79-4099-a84a-60fd8e47bf94 service nova] Instance 32ffb34b-569d-4809-8ba0-07758088a706 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122757) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:12:11.456721 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-57f3bd29-8d5d-4664-9ae3-8552e4d47954 req-fb8d184c-bf79-4099-a84a-60fd8e47bf94 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048059 Oct 04 22:12:11.457361 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3637/7252] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:12:11.511258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ad83193c-28f6-4e77-bdb4-54e2c82e1fa4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:11.520050 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ad83193c-28f6-4e77-bdb4-54e2c82e1fa4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1683 microversion: 2.1 time: 0.190979 Oct 04 22:12:11.520642 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3616/7253] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:11 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1683 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:12.547562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-21fa21e2-ad3d-4e46-8505-c59ccde21dee tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:12.547562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-21fa21e2-ad3d-4e46-8505-c59ccde21dee tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:12.552734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21fa21e2-ad3d-4e46-8505-c59ccde21dee tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:12.553238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21fa21e2-ad3d-4e46-8505-c59ccde21dee tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:12.553720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21fa21e2-ad3d-4e46-8505-c59ccde21dee tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:12.554430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21fa21e2-ad3d-4e46-8505-c59ccde21dee tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:12.554899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21fa21e2-ad3d-4e46-8505-c59ccde21dee tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:12.555358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-21fa21e2-ad3d-4e46-8505-c59ccde21dee tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:12.756166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-21fa21e2-ad3d-4e46-8505-c59ccde21dee tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:12.764616 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-21fa21e2-ad3d-4e46-8505-c59ccde21dee tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1683 microversion: 2.1 time: 0.224200 Oct 04 22:12:12.765206 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3638/7254] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:12 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1683 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:13.471057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-7e9538ed-796b-4685-a79c-53d8749f90e3 req-fac6859c-6595-4076-95ed-c4fa7a028729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32ffb34b-569d-4809-8ba0-07758088a706", "tag": "f15a50d1-a893-4a79-93ed-11b415f8c974"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:13.481116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-7e9538ed-796b-4685-a79c-53d8749f90e3 req-fac6859c-6595-4076-95ed-c4fa7a028729 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:13.481646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-7e9538ed-796b-4685-a79c-53d8749f90e3 req-fac6859c-6595-4076-95ed-c4fa7a028729 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:13.482189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-7e9538ed-796b-4685-a79c-53d8749f90e3 req-fac6859c-6595-4076-95ed-c4fa7a028729 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:13.493664 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-7e9538ed-796b-4685-a79c-53d8749f90e3 req-fac6859c-6595-4076-95ed-c4fa7a028729 service nova] Creating event network-changed:f15a50d1-a893-4a79-93ed-11b415f8c974 for instance 32ffb34b-569d-4809-8ba0-07758088a706 on n-h2-860282-1 Oct 04 22:12:13.499537 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-7e9538ed-796b-4685-a79c-53d8749f90e3 req-fac6859c-6595-4076-95ed-c4fa7a028729 service nova] Instance 32ffb34b-569d-4809-8ba0-07758088a706 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:12:13.510542 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-7e9538ed-796b-4685-a79c-53d8749f90e3 req-fac6859c-6595-4076-95ed-c4fa7a028729 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043896 Oct 04 22:12:13.511136 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3617/7255] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:13.788608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-483ab6b2-ebd6-42a2-8dea-cdfa08a98b90 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:13.789289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-483ab6b2-ebd6-42a2-8dea-cdfa08a98b90 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:13.796816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-483ab6b2-ebd6-42a2-8dea-cdfa08a98b90 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:13.797337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-483ab6b2-ebd6-42a2-8dea-cdfa08a98b90 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:13.797833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-483ab6b2-ebd6-42a2-8dea-cdfa08a98b90 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:13.798559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-483ab6b2-ebd6-42a2-8dea-cdfa08a98b90 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:13.799038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-483ab6b2-ebd6-42a2-8dea-cdfa08a98b90 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:13.799485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-483ab6b2-ebd6-42a2-8dea-cdfa08a98b90 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:13.936356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-483ab6b2-ebd6-42a2-8dea-cdfa08a98b90 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:13.944218 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-483ab6b2-ebd6-42a2-8dea-cdfa08a98b90 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1681 microversion: 2.1 time: 0.159879 Oct 04 22:12:13.944812 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3639/7256] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:13 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:14.970620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ce285dd1-2c46-45eb-9259-87c1f13b2659 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:14.971327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ce285dd1-2c46-45eb-9259-87c1f13b2659 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:14.978034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce285dd1-2c46-45eb-9259-87c1f13b2659 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:14.978518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce285dd1-2c46-45eb-9259-87c1f13b2659 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:14.978953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce285dd1-2c46-45eb-9259-87c1f13b2659 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:14.979649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce285dd1-2c46-45eb-9259-87c1f13b2659 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:14.980100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce285dd1-2c46-45eb-9259-87c1f13b2659 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:14.980523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ce285dd1-2c46-45eb-9259-87c1f13b2659 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:15.116465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ce285dd1-2c46-45eb-9259-87c1f13b2659 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:15.125756 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ce285dd1-2c46-45eb-9259-87c1f13b2659 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1677 microversion: 2.1 time: 0.161057 Oct 04 22:12:15.126653 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3618/7257] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:14 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:15.149350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6da82069-4b52-4447-913e-757322623df8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:15.149925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6da82069-4b52-4447-913e-757322623df8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:15.157478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6da82069-4b52-4447-913e-757322623df8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:15.157997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6da82069-4b52-4447-913e-757322623df8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:15.158450 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6da82069-4b52-4447-913e-757322623df8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:15.159363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6da82069-4b52-4447-913e-757322623df8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:15.159997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6da82069-4b52-4447-913e-757322623df8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:15.160587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6da82069-4b52-4447-913e-757322623df8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:15.369931 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6da82069-4b52-4447-913e-757322623df8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "POST /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706/action" status: 204 len: 0 microversion: 2.1 time: 0.224376 Oct 04 22:12:15.370617 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3640/7258] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:12:15 2022] POST /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706/action => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:12:15.379555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-57172227-89f0-4410-bd32-4bc24010086a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:15.382064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-57172227-89f0-4410-bd32-4bc24010086a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:15.386534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57172227-89f0-4410-bd32-4bc24010086a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:15.387024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57172227-89f0-4410-bd32-4bc24010086a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:15.387467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57172227-89f0-4410-bd32-4bc24010086a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:15.388294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57172227-89f0-4410-bd32-4bc24010086a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:15.388802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57172227-89f0-4410-bd32-4bc24010086a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:15.389547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57172227-89f0-4410-bd32-4bc24010086a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:15.407644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:15.529729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-57172227-89f0-4410-bd32-4bc24010086a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:15.539006 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-57172227-89f0-4410-bd32-4bc24010086a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1677 microversion: 2.1 time: 0.162938 Oct 04 22:12:15.539192 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3619/7259] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:15 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:16.563839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c44429df-097f-4004-9137-da6b8db445b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:16.564652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c44429df-097f-4004-9137-da6b8db445b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:16.571074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c44429df-097f-4004-9137-da6b8db445b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:16.571575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c44429df-097f-4004-9137-da6b8db445b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:16.572028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c44429df-097f-4004-9137-da6b8db445b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:16.572732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c44429df-097f-4004-9137-da6b8db445b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:16.573204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c44429df-097f-4004-9137-da6b8db445b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:16.573684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c44429df-097f-4004-9137-da6b8db445b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:16.712046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c44429df-097f-4004-9137-da6b8db445b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:16.716043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:16.723633 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c44429df-097f-4004-9137-da6b8db445b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1677 microversion: 2.1 time: 0.164865 Oct 04 22:12:16.727470 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3641/7260] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:16 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:17.749257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4d139e01-b355-4101-ae4a-faf44c236b82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:17.749915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4d139e01-b355-4101-ae4a-faf44c236b82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:17.757048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d139e01-b355-4101-ae4a-faf44c236b82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:17.757638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d139e01-b355-4101-ae4a-faf44c236b82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:17.758083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d139e01-b355-4101-ae4a-faf44c236b82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:17.758780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d139e01-b355-4101-ae4a-faf44c236b82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:17.759243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d139e01-b355-4101-ae4a-faf44c236b82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:17.759671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4d139e01-b355-4101-ae4a-faf44c236b82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:17.896258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4d139e01-b355-4101-ae4a-faf44c236b82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:17.904181 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4d139e01-b355-4101-ae4a-faf44c236b82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1656 microversion: 2.1 time: 0.159639 Oct 04 22:12:17.904793 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3620/7261] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:17 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1656 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:17.927800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bd3b535a-8de3-4340-bdef-a65d54a39f1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:17.928444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bd3b535a-8de3-4340-bdef-a65d54a39f1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:17.936348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd3b535a-8de3-4340-bdef-a65d54a39f1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:17.936861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd3b535a-8de3-4340-bdef-a65d54a39f1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:17.937322 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd3b535a-8de3-4340-bdef-a65d54a39f1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:17.938075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd3b535a-8de3-4340-bdef-a65d54a39f1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:17.938555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd3b535a-8de3-4340-bdef-a65d54a39f1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:17.939005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bd3b535a-8de3-4340-bdef-a65d54a39f1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:18.070093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bd3b535a-8de3-4340-bdef-a65d54a39f1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:18.078530 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bd3b535a-8de3-4340-bdef-a65d54a39f1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1656 microversion: 2.1 time: 0.155041 Oct 04 22:12:18.079111 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3642/7262] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:17 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1656 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:18.100569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9545de08-b1d3-44f9-85bd-89b0be8593c3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:18.106576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9545de08-b1d3-44f9-85bd-89b0be8593c3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:18.107078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9545de08-b1d3-44f9-85bd-89b0be8593c3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:18.107511 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9545de08-b1d3-44f9-85bd-89b0be8593c3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:18.129925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9545de08-b1d3-44f9-85bd-89b0be8593c3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Going to try to start instance {{(pid=122758) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 22:12:18.299564 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9545de08-b1d3-44f9-85bd-89b0be8593c3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "POST /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706/action" status: 202 len: 0 microversion: 2.1 time: 0.202878 Oct 04 22:12:18.300232 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3621/7263] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:12:18 2022] POST /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:12:18.310985 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-182c7795-a700-47eb-a7f9-fd9e3cde5480 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:18.311956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-182c7795-a700-47eb-a7f9-fd9e3cde5480 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:18.318930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-182c7795-a700-47eb-a7f9-fd9e3cde5480 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:18.319539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-182c7795-a700-47eb-a7f9-fd9e3cde5480 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:18.320313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-182c7795-a700-47eb-a7f9-fd9e3cde5480 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:18.321391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-182c7795-a700-47eb-a7f9-fd9e3cde5480 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:18.321894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-182c7795-a700-47eb-a7f9-fd9e3cde5480 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:18.322341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-182c7795-a700-47eb-a7f9-fd9e3cde5480 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:18.412483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-f89ae915-e9e2-401a-8d8c-28341cf28263 req-c11045cd-e2f8-4962-9176-7911c4c6ace3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ffb34b-569d-4809-8ba0-07758088a706", "name": "network-vif-plugged", "status": "completed", "tag": "f15a50d1-a893-4a79-93ed-11b415f8c974"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:18.418547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=39 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:18.424431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f89ae915-e9e2-401a-8d8c-28341cf28263 req-c11045cd-e2f8-4962-9176-7911c4c6ace3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:18.424922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f89ae915-e9e2-401a-8d8c-28341cf28263 req-c11045cd-e2f8-4962-9176-7911c4c6ace3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:18.429672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f89ae915-e9e2-401a-8d8c-28341cf28263 req-c11045cd-e2f8-4962-9176-7911c4c6ace3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:18.437407 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-f89ae915-e9e2-401a-8d8c-28341cf28263 req-c11045cd-e2f8-4962-9176-7911c4c6ace3 service nova] Creating event network-vif-plugged:f15a50d1-a893-4a79-93ed-11b415f8c974 for instance 32ffb34b-569d-4809-8ba0-07758088a706 on n-h2-860282-1 Oct 04 22:12:18.442571 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-f89ae915-e9e2-401a-8d8c-28341cf28263 req-c11045cd-e2f8-4962-9176-7911c4c6ace3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091794 Oct 04 22:12:18.443497 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3622/7264] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:12:18.464438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-182c7795-a700-47eb-a7f9-fd9e3cde5480 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:18.473167 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-182c7795-a700-47eb-a7f9-fd9e3cde5480 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1665 microversion: 2.1 time: 0.168447 Oct 04 22:12:18.474398 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3643/7265] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:18 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1665 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:19.497843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-82875b9f-a7ad-4f1d-b9d0-1482c0259138 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:19.498567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-82875b9f-a7ad-4f1d-b9d0-1482c0259138 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:19.505246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82875b9f-a7ad-4f1d-b9d0-1482c0259138 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:19.505760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82875b9f-a7ad-4f1d-b9d0-1482c0259138 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:19.506199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82875b9f-a7ad-4f1d-b9d0-1482c0259138 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:19.506890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82875b9f-a7ad-4f1d-b9d0-1482c0259138 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:19.507345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82875b9f-a7ad-4f1d-b9d0-1482c0259138 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:19.507770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82875b9f-a7ad-4f1d-b9d0-1482c0259138 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:19.640688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-82875b9f-a7ad-4f1d-b9d0-1482c0259138 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:19.648570 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-82875b9f-a7ad-4f1d-b9d0-1482c0259138 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1665 microversion: 2.1 time: 0.156197 Oct 04 22:12:19.649149 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3623/7266] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:19 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:20.672652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4daba6a7-ca08-466c-b011-4621a9d2b3eb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:20.673291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4daba6a7-ca08-466c-b011-4621a9d2b3eb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:20.676120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=37 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:20.680853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4daba6a7-ca08-466c-b011-4621a9d2b3eb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:20.681365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4daba6a7-ca08-466c-b011-4621a9d2b3eb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:20.681857 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4daba6a7-ca08-466c-b011-4621a9d2b3eb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:20.682571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4daba6a7-ca08-466c-b011-4621a9d2b3eb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:20.683052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4daba6a7-ca08-466c-b011-4621a9d2b3eb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:20.683505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4daba6a7-ca08-466c-b011-4621a9d2b3eb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:20.817371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4daba6a7-ca08-466c-b011-4621a9d2b3eb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:20.826064 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4daba6a7-ca08-466c-b011-4621a9d2b3eb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1669 microversion: 2.1 time: 0.157443 Oct 04 22:12:20.826736 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3644/7267] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:20 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:20.849532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a702bca7-06be-4cb4-9966-1e5fc7a9d574 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:20.850074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a702bca7-06be-4cb4-9966-1e5fc7a9d574 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:20.856921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a702bca7-06be-4cb4-9966-1e5fc7a9d574 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:20.857515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a702bca7-06be-4cb4-9966-1e5fc7a9d574 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:20.857935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a702bca7-06be-4cb4-9966-1e5fc7a9d574 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:20.858645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a702bca7-06be-4cb4-9966-1e5fc7a9d574 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:20.859101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a702bca7-06be-4cb4-9966-1e5fc7a9d574 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:20.859531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a702bca7-06be-4cb4-9966-1e5fc7a9d574 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:20.887473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a702bca7-06be-4cb4-9966-1e5fc7a9d574 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:12:21.084030 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a702bca7-06be-4cb4-9966-1e5fc7a9d574 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "DELETE /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 204 len: 0 microversion: 2.1 time: 0.238127 Oct 04 22:12:21.084612 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3624/7268] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:20 2022] DELETE /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:12:21.093007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-73b35689-84db-4b15-b67b-7011b6c2d693 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:21.094908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-73b35689-84db-4b15-b67b-7011b6c2d693 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:21.099853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73b35689-84db-4b15-b67b-7011b6c2d693 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:21.100374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73b35689-84db-4b15-b67b-7011b6c2d693 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:21.100952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73b35689-84db-4b15-b67b-7011b6c2d693 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:21.101704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73b35689-84db-4b15-b67b-7011b6c2d693 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:21.102188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73b35689-84db-4b15-b67b-7011b6c2d693 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:21.102635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73b35689-84db-4b15-b67b-7011b6c2d693 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:21.237447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-73b35689-84db-4b15-b67b-7011b6c2d693 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:21.245150 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-73b35689-84db-4b15-b67b-7011b6c2d693 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1675 microversion: 2.1 time: 0.156163 Oct 04 22:12:21.245763 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3645/7269] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:21 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:22.269846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-00463bda-0503-411b-b5b5-b61d5ab772bc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:22.270542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-00463bda-0503-411b-b5b5-b61d5ab772bc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:22.277231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00463bda-0503-411b-b5b5-b61d5ab772bc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:22.277758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00463bda-0503-411b-b5b5-b61d5ab772bc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:22.278193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00463bda-0503-411b-b5b5-b61d5ab772bc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:22.278880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00463bda-0503-411b-b5b5-b61d5ab772bc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:22.279434 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00463bda-0503-411b-b5b5-b61d5ab772bc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:22.279861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00463bda-0503-411b-b5b5-b61d5ab772bc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:22.409541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-00463bda-0503-411b-b5b5-b61d5ab772bc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:22.417203 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-00463bda-0503-411b-b5b5-b61d5ab772bc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1675 microversion: 2.1 time: 0.151561 Oct 04 22:12:22.417770 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3625/7270] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:22 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:23.441118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-60921754-4bf3-4471-859f-a21257282418 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:23.442288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-60921754-4bf3-4471-859f-a21257282418 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:23.449266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60921754-4bf3-4471-859f-a21257282418 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:23.449812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60921754-4bf3-4471-859f-a21257282418 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:23.450277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60921754-4bf3-4471-859f-a21257282418 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:23.451714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60921754-4bf3-4471-859f-a21257282418 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:23.452383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60921754-4bf3-4471-859f-a21257282418 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:23.452869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60921754-4bf3-4471-859f-a21257282418 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:23.531718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-60921754-4bf3-4471-859f-a21257282418 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:23.537932 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-60921754-4bf3-4471-859f-a21257282418 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1607 microversion: 2.1 time: 0.100777 Oct 04 22:12:23.549608 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3646/7271] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:23 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1607 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:23.644262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-feaabe78-c1bc-494c-a07a-5fd8b600a2a1 req-41156836-9c00-4bfa-bde6-e007dbd9a5ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ffb34b-569d-4809-8ba0-07758088a706", "name": "network-vif-deleted", "tag": "f15a50d1-a893-4a79-93ed-11b415f8c974"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:23.655477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-feaabe78-c1bc-494c-a07a-5fd8b600a2a1 req-41156836-9c00-4bfa-bde6-e007dbd9a5ba service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:23.656046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-feaabe78-c1bc-494c-a07a-5fd8b600a2a1 req-41156836-9c00-4bfa-bde6-e007dbd9a5ba service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:23.656554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-feaabe78-c1bc-494c-a07a-5fd8b600a2a1 req-41156836-9c00-4bfa-bde6-e007dbd9a5ba service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:23.667740 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-feaabe78-c1bc-494c-a07a-5fd8b600a2a1 req-41156836-9c00-4bfa-bde6-e007dbd9a5ba service nova] Creating event network-vif-deleted:f15a50d1-a893-4a79-93ed-11b415f8c974 for instance 32ffb34b-569d-4809-8ba0-07758088a706 on n-h2-860282-1 Oct 04 22:12:23.672772 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-feaabe78-c1bc-494c-a07a-5fd8b600a2a1 req-41156836-9c00-4bfa-bde6-e007dbd9a5ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032427 Oct 04 22:12:23.675464 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3626/7272] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:24.563032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-69ca5972-e457-47fc-9456-39b6607ba34c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:24.563693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-69ca5972-e457-47fc-9456-39b6607ba34c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:24.571019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69ca5972-e457-47fc-9456-39b6607ba34c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:24.571534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69ca5972-e457-47fc-9456-39b6607ba34c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:24.572011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69ca5972-e457-47fc-9456-39b6607ba34c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:24.572755 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69ca5972-e457-47fc-9456-39b6607ba34c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:24.573323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69ca5972-e457-47fc-9456-39b6607ba34c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:24.573794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69ca5972-e457-47fc-9456-39b6607ba34c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:24.608286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69ca5972-e457-47fc-9456-39b6607ba34c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:24.608791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69ca5972-e457-47fc-9456-39b6607ba34c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:24.609246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-69ca5972-e457-47fc-9456-39b6607ba34c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:24.609739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-69ca5972-e457-47fc-9456-39b6607ba34c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lazy-loading 'fault' on Instance uuid 32ffb34b-569d-4809-8ba0-07758088a706 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:12:24.651741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-69ca5972-e457-47fc-9456-39b6607ba34c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:24.663656 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-69ca5972-e457-47fc-9456-39b6607ba34c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 200 len: 1327 microversion: 2.1 time: 0.101914 Oct 04 22:12:24.663656 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3647/7273] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:24 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:25.687075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4492893d-37c3-4a7a-85b7-85abe74af369 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:25.688044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4492893d-37c3-4a7a-85b7-85abe74af369 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:25.694552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4492893d-37c3-4a7a-85b7-85abe74af369 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:25.695038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4492893d-37c3-4a7a-85b7-85abe74af369 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:25.695479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4492893d-37c3-4a7a-85b7-85abe74af369 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:25.696185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4492893d-37c3-4a7a-85b7-85abe74af369 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:25.696628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4492893d-37c3-4a7a-85b7-85abe74af369 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:25.697052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4492893d-37c3-4a7a-85b7-85abe74af369 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:25.710954 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-4492893d-37c3-4a7a-85b7-85abe74af369 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] HTTP exception thrown: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4492893d-37c3-4a7a-85b7-85abe74af369 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Request method failure captured: Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 HTTP/1.1 Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPK8oecCePEZ1fjQeOvLUymrlk79ZSDMC_m3SQmxdMtXhHHvhD1zn86_Mnhmwnf3CTzZYgu9HlWWt5S89bCsK70TBvqC_PsuS5A9ZH5z3zSd6qECgW80Bqf-YGFd31IgZ7PhK_th5fwhMT0w_DbjLHA4xe_oVPvuobxSs8EncCZ5xwHg Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5aa764882b244357892ebdad69cff689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5aa764882b244357892ebdad69cff689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}] Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerActionsTestJSON-560335426 Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c01d66c6cbba4c30831508fdaf953268 Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '32ffb34b-569d-4809-8ba0-07758088a706'} Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:25.712570 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:12:25.717574 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:25.717574 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:25.717574 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:25.717574 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:25.717574 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:25.717574 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:12:25.717574 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:12:25.717574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4492893d-37c3-4a7a-85b7-85abe74af369 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Returning 404 to user: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:25.717574 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4492893d-37c3-4a7a-85b7-85abe74af369 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 404 len: 111 microversion: 2.1 time: 0.033255 Oct 04 22:12:25.717574 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3627/7274] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:25 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:25.732196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d6d1bd24-93ce-4e19-95f3-d68e4e98315c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:25.732834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d6d1bd24-93ce-4e19-95f3-d68e4e98315c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:25.736058 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:12:25.736206 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 22:12:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 (ip 10.222.0.30) !!! Oct 04 22:12:25.742601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6d1bd24-93ce-4e19-95f3-d68e4e98315c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:25.743108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6d1bd24-93ce-4e19-95f3-d68e4e98315c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:25.743572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6d1bd24-93ce-4e19-95f3-d68e4e98315c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:25.744293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6d1bd24-93ce-4e19-95f3-d68e4e98315c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:25.744774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6d1bd24-93ce-4e19-95f3-d68e4e98315c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:25.745227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6d1bd24-93ce-4e19-95f3-d68e4e98315c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:25.759628 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-d6d1bd24-93ce-4e19-95f3-d68e4e98315c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] HTTP exception thrown: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d6d1bd24-93ce-4e19-95f3-d68e4e98315c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Request method failure captured: Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 HTTP/1.1 Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPK8oecCePEZ1fjQeOvLUymrlk79ZSDMC_m3SQmxdMtXhHHvhD1zn86_Mnhmwnf3CTzZYgu9HlWWt5S89bCsK70TBvqC_PsuS5A9ZH5z3zSd6qECgW80Bqf-YGFd31IgZ7PhK_th5fwhMT0w_DbjLHA4xe_oVPvuobxSs8EncCZ5xwHg Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5aa764882b244357892ebdad69cff689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5aa764882b244357892ebdad69cff689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}] Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerActionsTestJSON-560335426 Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c01d66c6cbba4c30831508fdaf953268 Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '32ffb34b-569d-4809-8ba0-07758088a706'} Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:25.761315 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:12:25.767228 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:25.767228 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:25.767228 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:25.767228 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:25.767228 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:25.767228 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:12:25.767228 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:12:25.767228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d6d1bd24-93ce-4e19-95f3-d68e4e98315c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Returning 404 to user: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:25.767228 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d6d1bd24-93ce-4e19-95f3-d68e4e98315c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 404 len: 111 microversion: 2.1 time: 0.034622 Oct 04 22:12:25.767228 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3648/7275] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:25 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:25.812885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-df94f4d5-6a89-4d50-adb6-4a8cfe0b9031 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-916843626", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "5f62b5be-7019-44f6-811c-aa44b61d2d81"}], "security_groups": [{"name": "tempest-securitygroup--1599777208"}], "key_name": "tempest-keypair-955841605", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:25.921761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-df94f4d5-6a89-4d50-adb6-4a8cfe0b9031 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] validate_networks() for [('5f62b5be-7019-44f6-811c-aa44b61d2d81', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:12:26.346526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-df94f4d5-6a89-4d50-adb6-4a8cfe0b9031 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:12:26.355613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-df94f4d5-6a89-4d50-adb6-4a8cfe0b9031 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:12:26.355613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-df94f4d5-6a89-4d50-adb6-4a8cfe0b9031 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:12:26.355613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-df94f4d5-6a89-4d50-adb6-4a8cfe0b9031 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:12:26.355613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-df94f4d5-6a89-4d50-adb6-4a8cfe0b9031 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:12:26.357915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df94f4d5-6a89-4d50-adb6-4a8cfe0b9031 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:26.358396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df94f4d5-6a89-4d50-adb6-4a8cfe0b9031 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:26.358829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df94f4d5-6a89-4d50-adb6-4a8cfe0b9031 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:26.359552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df94f4d5-6a89-4d50-adb6-4a8cfe0b9031 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:26.360006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df94f4d5-6a89-4d50-adb6-4a8cfe0b9031 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:26.360432 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df94f4d5-6a89-4d50-adb6-4a8cfe0b9031 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:26.377736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-df94f4d5-6a89-4d50-adb6-4a8cfe0b9031 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Getting quotas for project 5aa764882b244357892ebdad69cff689. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:12:26.382912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-df94f4d5-6a89-4d50-adb6-4a8cfe0b9031 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Getting quotas for user c01d66c6cbba4c30831508fdaf953268 and project 5aa764882b244357892ebdad69cff689. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:12:26.395898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-df94f4d5-6a89-4d50-adb6-4a8cfe0b9031 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:12:26.398266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-df94f4d5-6a89-4d50-adb6-4a8cfe0b9031 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:12:26.515941 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-df94f4d5-6a89-4d50-adb6-4a8cfe0b9031 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.707382 Oct 04 22:12:26.516595 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3628/7276] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:12:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:12:26.528065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c5792b7a-4670-4098-a28c-172642a01b9e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:26.529069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c5792b7a-4670-4098-a28c-172642a01b9e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:26.588389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c5792b7a-4670-4098-a28c-172642a01b9e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:26.595562 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c5792b7a-4670-4098-a28c-172642a01b9e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1237 microversion: 2.1 time: 0.071489 Oct 04 22:12:26.596389 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3649/7277] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:26 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:27.621482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-de48a420-cc36-4770-98c7-e12b504a038a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:27.622101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-de48a420-cc36-4770-98c7-e12b504a038a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:27.630244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de48a420-cc36-4770-98c7-e12b504a038a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:27.635943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de48a420-cc36-4770-98c7-e12b504a038a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:27.635943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de48a420-cc36-4770-98c7-e12b504a038a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:27.635943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de48a420-cc36-4770-98c7-e12b504a038a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:27.635943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de48a420-cc36-4770-98c7-e12b504a038a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:27.635943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-de48a420-cc36-4770-98c7-e12b504a038a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:27.695182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-de48a420-cc36-4770-98c7-e12b504a038a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:27.703176 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-de48a420-cc36-4770-98c7-e12b504a038a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1241 microversion: 2.1 time: 0.087735 Oct 04 22:12:27.703761 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3629/7278] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:27 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:28.727718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f9c76522-ac24-4bd4-8eaa-d11fa0cc4d4d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:28.728362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f9c76522-ac24-4bd4-8eaa-d11fa0cc4d4d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:28.738093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9c76522-ac24-4bd4-8eaa-d11fa0cc4d4d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:28.739045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9c76522-ac24-4bd4-8eaa-d11fa0cc4d4d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:28.742025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9c76522-ac24-4bd4-8eaa-d11fa0cc4d4d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:28.742025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9c76522-ac24-4bd4-8eaa-d11fa0cc4d4d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:28.742025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9c76522-ac24-4bd4-8eaa-d11fa0cc4d4d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:28.742025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9c76522-ac24-4bd4-8eaa-d11fa0cc4d4d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:28.815765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f9c76522-ac24-4bd4-8eaa-d11fa0cc4d4d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:28.823719 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f9c76522-ac24-4bd4-8eaa-d11fa0cc4d4d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1307 microversion: 2.1 time: 0.100627 Oct 04 22:12:28.825606 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3650/7279] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:28 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:29.848985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-05cb33c0-4a95-429a-b179-1477f654fa8b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:29.849632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-05cb33c0-4a95-429a-b179-1477f654fa8b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:29.856501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05cb33c0-4a95-429a-b179-1477f654fa8b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:29.856989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05cb33c0-4a95-429a-b179-1477f654fa8b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:29.857456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05cb33c0-4a95-429a-b179-1477f654fa8b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:29.858183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05cb33c0-4a95-429a-b179-1477f654fa8b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:29.859156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05cb33c0-4a95-429a-b179-1477f654fa8b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:29.859576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05cb33c0-4a95-429a-b179-1477f654fa8b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:29.995993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-05cb33c0-4a95-429a-b179-1477f654fa8b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:30.004606 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-05cb33c0-4a95-429a-b179-1477f654fa8b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1363 microversion: 2.1 time: 0.159719 Oct 04 22:12:30.005186 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3630/7280] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:29 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:12:30.102456 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b024dc6a-6031-4291-b539-67306be580c9 req-86b99a0e-b88f-42a2-b12c-3532783ee114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b9fe99-0b9c-405f-badb-ce3d33c047f2", "tag": "7e2b56d2-f4ae-4041-ba1e-eb3a59c135c9"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:30.112652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b024dc6a-6031-4291-b539-67306be580c9 req-86b99a0e-b88f-42a2-b12c-3532783ee114 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:30.113161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b024dc6a-6031-4291-b539-67306be580c9 req-86b99a0e-b88f-42a2-b12c-3532783ee114 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:30.113789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b024dc6a-6031-4291-b539-67306be580c9 req-86b99a0e-b88f-42a2-b12c-3532783ee114 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:30.126015 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b024dc6a-6031-4291-b539-67306be580c9 req-86b99a0e-b88f-42a2-b12c-3532783ee114 service nova] Creating event network-changed:7e2b56d2-f4ae-4041-ba1e-eb3a59c135c9 for instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 on n-h1-860282-1 Oct 04 22:12:30.130980 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b024dc6a-6031-4291-b539-67306be580c9 req-86b99a0e-b88f-42a2-b12c-3532783ee114 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095948 Oct 04 22:12:30.131802 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3651/7281] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:31.028489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-01fa53b9-e6fe-4358-966d-fc2f2391a0db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:31.029099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-01fa53b9-e6fe-4358-966d-fc2f2391a0db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:31.036743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01fa53b9-e6fe-4358-966d-fc2f2391a0db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:31.037231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01fa53b9-e6fe-4358-966d-fc2f2391a0db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:31.037711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01fa53b9-e6fe-4358-966d-fc2f2391a0db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:31.038406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01fa53b9-e6fe-4358-966d-fc2f2391a0db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:31.038867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01fa53b9-e6fe-4358-966d-fc2f2391a0db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:31.039296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01fa53b9-e6fe-4358-966d-fc2f2391a0db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:31.171521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-01fa53b9-e6fe-4358-966d-fc2f2391a0db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:31.179109 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-01fa53b9-e6fe-4358-966d-fc2f2391a0db tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1363 microversion: 2.1 time: 0.154579 Oct 04 22:12:31.179689 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3631/7282] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:31 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:32.203471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-78a8b1fe-e231-4141-9c5e-b1a85e6cacfc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:32.204815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-78a8b1fe-e231-4141-9c5e-b1a85e6cacfc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:32.211207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78a8b1fe-e231-4141-9c5e-b1a85e6cacfc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:32.211839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78a8b1fe-e231-4141-9c5e-b1a85e6cacfc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:32.212301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78a8b1fe-e231-4141-9c5e-b1a85e6cacfc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:32.213011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78a8b1fe-e231-4141-9c5e-b1a85e6cacfc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:32.213506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78a8b1fe-e231-4141-9c5e-b1a85e6cacfc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:32.213951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78a8b1fe-e231-4141-9c5e-b1a85e6cacfc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:32.355446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-78a8b1fe-e231-4141-9c5e-b1a85e6cacfc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:32.363836 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-78a8b1fe-e231-4141-9c5e-b1a85e6cacfc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1363 microversion: 2.1 time: 0.165815 Oct 04 22:12:32.364421 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3652/7283] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:32 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:33.387127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d4ed1345-742d-4ca3-bd93-3230a517018d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:33.387738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d4ed1345-742d-4ca3-bd93-3230a517018d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:33.394845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4ed1345-742d-4ca3-bd93-3230a517018d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:33.395326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4ed1345-742d-4ca3-bd93-3230a517018d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:33.395846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4ed1345-742d-4ca3-bd93-3230a517018d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:33.396529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4ed1345-742d-4ca3-bd93-3230a517018d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:33.396982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4ed1345-742d-4ca3-bd93-3230a517018d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:33.397408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d4ed1345-742d-4ca3-bd93-3230a517018d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:33.528767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d4ed1345-742d-4ca3-bd93-3230a517018d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:33.537388 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d4ed1345-742d-4ca3-bd93-3230a517018d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1363 microversion: 2.1 time: 0.154153 Oct 04 22:12:33.537996 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3632/7284] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:33 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:34.184368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-eb59e53c-af60-4bef-9659-28245db8b6f4 req-ab8865ad-e9e0-4e6c-be48-46899af3fea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b9fe99-0b9c-405f-badb-ce3d33c047f2", "name": "network-vif-plugged", "status": "completed", "tag": "7e2b56d2-f4ae-4041-ba1e-eb3a59c135c9"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:34.194940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-eb59e53c-af60-4bef-9659-28245db8b6f4 req-ab8865ad-e9e0-4e6c-be48-46899af3fea6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:34.195435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-eb59e53c-af60-4bef-9659-28245db8b6f4 req-ab8865ad-e9e0-4e6c-be48-46899af3fea6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:34.196009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-eb59e53c-af60-4bef-9659-28245db8b6f4 req-ab8865ad-e9e0-4e6c-be48-46899af3fea6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:34.207662 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-eb59e53c-af60-4bef-9659-28245db8b6f4 req-ab8865ad-e9e0-4e6c-be48-46899af3fea6 service nova] Creating event network-vif-plugged:7e2b56d2-f4ae-4041-ba1e-eb3a59c135c9 for instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 on n-h1-860282-1 Oct 04 22:12:34.212734 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-eb59e53c-af60-4bef-9659-28245db8b6f4 req-ab8865ad-e9e0-4e6c-be48-46899af3fea6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032224 Oct 04 22:12:34.219101 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3653/7285] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:34.561374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-215f00d6-c61a-4c21-8fc8-83a41e62fc16 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:34.562630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-215f00d6-c61a-4c21-8fc8-83a41e62fc16 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:34.569515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215f00d6-c61a-4c21-8fc8-83a41e62fc16 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:34.570000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215f00d6-c61a-4c21-8fc8-83a41e62fc16 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:34.570439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215f00d6-c61a-4c21-8fc8-83a41e62fc16 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:34.571130 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215f00d6-c61a-4c21-8fc8-83a41e62fc16 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:34.571586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215f00d6-c61a-4c21-8fc8-83a41e62fc16 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:34.572017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-215f00d6-c61a-4c21-8fc8-83a41e62fc16 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:34.701384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-215f00d6-c61a-4c21-8fc8-83a41e62fc16 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:34.710111 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-215f00d6-c61a-4c21-8fc8-83a41e62fc16 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1363 microversion: 2.1 time: 0.152699 Oct 04 22:12:34.710693 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3633/7286] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:34 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:35.734958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0eb96071-2779-489d-ba85-182419108986 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:35.735737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0eb96071-2779-489d-ba85-182419108986 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:35.742959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0eb96071-2779-489d-ba85-182419108986 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:35.743475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0eb96071-2779-489d-ba85-182419108986 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:35.743934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0eb96071-2779-489d-ba85-182419108986 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:35.744773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0eb96071-2779-489d-ba85-182419108986 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:35.745252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0eb96071-2779-489d-ba85-182419108986 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:35.745724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0eb96071-2779-489d-ba85-182419108986 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:35.885034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0eb96071-2779-489d-ba85-182419108986 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:35.894191 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0eb96071-2779-489d-ba85-182419108986 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1550 microversion: 2.1 time: 0.164140 Oct 04 22:12:35.894787 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3654/7287] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:35 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1550 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:35.918361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f8b622a0-eb2f-485a-9066-e9619bf5c838 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:35.918860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f8b622a0-eb2f-485a-9066-e9619bf5c838 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:35.925943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8b622a0-eb2f-485a-9066-e9619bf5c838 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:35.926436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8b622a0-eb2f-485a-9066-e9619bf5c838 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:35.926883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8b622a0-eb2f-485a-9066-e9619bf5c838 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:35.927590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8b622a0-eb2f-485a-9066-e9619bf5c838 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:35.928048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8b622a0-eb2f-485a-9066-e9619bf5c838 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:35.928558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f8b622a0-eb2f-485a-9066-e9619bf5c838 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:36.007365 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f8b622a0-eb2f-485a-9066-e9619bf5c838 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092977 Oct 04 22:12:36.008057 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3634/7288] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 22:12:35 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:12:37.360584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-6a1ac7f6-dea4-44aa-94e6-15bc6eceb36a req-2c280c8b-3ccb-4bf4-a656-fe778dea71d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b9fe99-0b9c-405f-badb-ce3d33c047f2", "tag": "7e2b56d2-f4ae-4041-ba1e-eb3a59c135c9"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:37.365377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:37.371454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6a1ac7f6-dea4-44aa-94e6-15bc6eceb36a req-2c280c8b-3ccb-4bf4-a656-fe778dea71d0 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:37.372041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6a1ac7f6-dea4-44aa-94e6-15bc6eceb36a req-2c280c8b-3ccb-4bf4-a656-fe778dea71d0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:37.372411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6a1ac7f6-dea4-44aa-94e6-15bc6eceb36a req-2c280c8b-3ccb-4bf4-a656-fe778dea71d0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:37.383757 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-6a1ac7f6-dea4-44aa-94e6-15bc6eceb36a req-2c280c8b-3ccb-4bf4-a656-fe778dea71d0 service nova] Creating event network-changed:7e2b56d2-f4ae-4041-ba1e-eb3a59c135c9 for instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 on n-h1-860282-1 Oct 04 22:12:37.388600 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-6a1ac7f6-dea4-44aa-94e6-15bc6eceb36a req-2c280c8b-3ccb-4bf4-a656-fe778dea71d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031910 Oct 04 22:12:37.390288 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3655/7289] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:05.955441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:05.956263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:05.958141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:05.958859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:05.962830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c7ba3668-1a07-4485-b9fe-1c7d11e50ce4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:05.965171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c7ba3668-1a07-4485-b9fe-1c7d11e50ce4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:05.971630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c7ba3668-1a07-4485-b9fe-1c7d11e50ce4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:05.972141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c7ba3668-1a07-4485-b9fe-1c7d11e50ce4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:05.972551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c7ba3668-1a07-4485-b9fe-1c7d11e50ce4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:05.973237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c7ba3668-1a07-4485-b9fe-1c7d11e50ce4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:05.973731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c7ba3668-1a07-4485-b9fe-1c7d11e50ce4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:05.974161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c7ba3668-1a07-4485-b9fe-1c7d11e50ce4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:06.002962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c7ba3668-1a07-4485-b9fe-1c7d11e50ce4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:06.008703 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c7ba3668-1a07-4485-b9fe-1c7d11e50ce4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Old instance type m1.heat2, new instance type m1.heat {{(pid=122758) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:13:06.015474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c7ba3668-1a07-4485-b9fe-1c7d11e50ce4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:13:06.015904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c7ba3668-1a07-4485-b9fe-1c7d11e50ce4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:13:06.016388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c7ba3668-1a07-4485-b9fe-1c7d11e50ce4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:13:06.016934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c7ba3668-1a07-4485-b9fe-1c7d11e50ce4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:13:06.017325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-c7ba3668-1a07-4485-b9fe-1c7d11e50ce4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:13:06.236375 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c7ba3668-1a07-4485-b9fe-1c7d11e50ce4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "POST /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2/action" status: 202 len: 0 microversion: 2.1 time: 0.281033 Oct 04 22:13:06.237198 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3635/7290] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:13:05 2022] POST /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:13:06.244227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=27 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:06.245208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=65 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:06.249947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-279612ce-2bab-446c-a0fc-6ca618c366a0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:06.250216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-279612ce-2bab-446c-a0fc-6ca618c366a0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:06.256724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-279612ce-2bab-446c-a0fc-6ca618c366a0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:06.257295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-279612ce-2bab-446c-a0fc-6ca618c366a0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:06.257835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-279612ce-2bab-446c-a0fc-6ca618c366a0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:06.258589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-279612ce-2bab-446c-a0fc-6ca618c366a0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:06.259126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-279612ce-2bab-446c-a0fc-6ca618c366a0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:06.259519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-279612ce-2bab-446c-a0fc-6ca618c366a0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:06.395768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-279612ce-2bab-446c-a0fc-6ca618c366a0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:06.403460 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-279612ce-2bab-446c-a0fc-6ca618c366a0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1678 microversion: 2.1 time: 0.161928 Oct 04 22:13:06.404070 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3656/7291] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:06 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:07.430104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2a6af085-b840-4d41-8cca-5a075653b932 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:07.430702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2a6af085-b840-4d41-8cca-5a075653b932 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:07.437389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a6af085-b840-4d41-8cca-5a075653b932 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:07.437901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a6af085-b840-4d41-8cca-5a075653b932 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:07.438766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a6af085-b840-4d41-8cca-5a075653b932 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:07.439609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a6af085-b840-4d41-8cca-5a075653b932 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:07.440073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a6af085-b840-4d41-8cca-5a075653b932 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:07.440587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2a6af085-b840-4d41-8cca-5a075653b932 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:07.583225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2a6af085-b840-4d41-8cca-5a075653b932 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:07.591190 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2a6af085-b840-4d41-8cca-5a075653b932 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1678 microversion: 2.1 time: 0.166606 Oct 04 22:13:07.595245 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3636/7292] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:07 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:13:08.615012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c35db8bb-9c57-42c5-bb41-42b08c1e39a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:08.615656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c35db8bb-9c57-42c5-bb41-42b08c1e39a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:08.622944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c35db8bb-9c57-42c5-bb41-42b08c1e39a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:08.623455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c35db8bb-9c57-42c5-bb41-42b08c1e39a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:08.623964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c35db8bb-9c57-42c5-bb41-42b08c1e39a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:08.624638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c35db8bb-9c57-42c5-bb41-42b08c1e39a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:08.625114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c35db8bb-9c57-42c5-bb41-42b08c1e39a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:08.625609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c35db8bb-9c57-42c5-bb41-42b08c1e39a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:08.757550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c35db8bb-9c57-42c5-bb41-42b08c1e39a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:08.765876 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c35db8bb-9c57-42c5-bb41-42b08c1e39a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1678 microversion: 2.1 time: 0.154768 Oct 04 22:13:08.772857 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3657/7293] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:08 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:09.794957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-110af0a8-28e4-482c-b43a-891422c80cba tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:09.795513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-110af0a8-28e4-482c-b43a-891422c80cba tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:09.803040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-110af0a8-28e4-482c-b43a-891422c80cba tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:09.803525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-110af0a8-28e4-482c-b43a-891422c80cba tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:09.803958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-110af0a8-28e4-482c-b43a-891422c80cba tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:09.804644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-110af0a8-28e4-482c-b43a-891422c80cba tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:09.805099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-110af0a8-28e4-482c-b43a-891422c80cba tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:09.805549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-110af0a8-28e4-482c-b43a-891422c80cba tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:09.940358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-110af0a8-28e4-482c-b43a-891422c80cba tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:09.948182 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-110af0a8-28e4-482c-b43a-891422c80cba tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1683 microversion: 2.1 time: 0.157230 Oct 04 22:13:09.948759 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3637/7294] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:09 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:10.972526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ff15b8d1-dce5-4597-b36d-0bd2455aea17 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:10.973164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ff15b8d1-dce5-4597-b36d-0bd2455aea17 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:10.982315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff15b8d1-dce5-4597-b36d-0bd2455aea17 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:10.982537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff15b8d1-dce5-4597-b36d-0bd2455aea17 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:10.982975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff15b8d1-dce5-4597-b36d-0bd2455aea17 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:10.983708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff15b8d1-dce5-4597-b36d-0bd2455aea17 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:10.984180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff15b8d1-dce5-4597-b36d-0bd2455aea17 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:10.984632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff15b8d1-dce5-4597-b36d-0bd2455aea17 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:11.118274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ff15b8d1-dce5-4597-b36d-0bd2455aea17 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:11.126214 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ff15b8d1-dce5-4597-b36d-0bd2455aea17 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1683 microversion: 2.1 time: 0.157639 Oct 04 22:13:11.126801 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3658/7295] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:10 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:12.149269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-490e54d8-bb6d-4c09-ba62-318ebcc9e0b7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:12.149987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-490e54d8-bb6d-4c09-ba62-318ebcc9e0b7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:12.157029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-490e54d8-bb6d-4c09-ba62-318ebcc9e0b7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:12.157563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-490e54d8-bb6d-4c09-ba62-318ebcc9e0b7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:12.158051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-490e54d8-bb6d-4c09-ba62-318ebcc9e0b7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:12.158745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-490e54d8-bb6d-4c09-ba62-318ebcc9e0b7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:12.159262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-490e54d8-bb6d-4c09-ba62-318ebcc9e0b7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:12.159691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-490e54d8-bb6d-4c09-ba62-318ebcc9e0b7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:12.292349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-490e54d8-bb6d-4c09-ba62-318ebcc9e0b7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:12.300763 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-490e54d8-bb6d-4c09-ba62-318ebcc9e0b7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1683 microversion: 2.1 time: 0.155406 Oct 04 22:13:12.301344 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3638/7296] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:12 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:13.324808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7dce8830-c382-4ba6-854a-5a0a163bd80d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:13.325458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7dce8830-c382-4ba6-854a-5a0a163bd80d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:13.333152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7dce8830-c382-4ba6-854a-5a0a163bd80d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:13.333681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7dce8830-c382-4ba6-854a-5a0a163bd80d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:13.334139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7dce8830-c382-4ba6-854a-5a0a163bd80d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:13.334874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7dce8830-c382-4ba6-854a-5a0a163bd80d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:13.335344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7dce8830-c382-4ba6-854a-5a0a163bd80d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:13.335786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7dce8830-c382-4ba6-854a-5a0a163bd80d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:13.467383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7dce8830-c382-4ba6-854a-5a0a163bd80d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:13.475173 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7dce8830-c382-4ba6-854a-5a0a163bd80d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1683 microversion: 2.1 time: 0.154346 Oct 04 22:13:13.475759 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3659/7297] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:13 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:14.497632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-35184e21-2f4d-4ef6-ad50-27b8d152f731 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:14.498211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-35184e21-2f4d-4ef6-ad50-27b8d152f731 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:14.504989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35184e21-2f4d-4ef6-ad50-27b8d152f731 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:14.505506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35184e21-2f4d-4ef6-ad50-27b8d152f731 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:14.505951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35184e21-2f4d-4ef6-ad50-27b8d152f731 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:14.506651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35184e21-2f4d-4ef6-ad50-27b8d152f731 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:14.507110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35184e21-2f4d-4ef6-ad50-27b8d152f731 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:14.507542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35184e21-2f4d-4ef6-ad50-27b8d152f731 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:14.635400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-35184e21-2f4d-4ef6-ad50-27b8d152f731 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:14.643903 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-35184e21-2f4d-4ef6-ad50-27b8d152f731 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1683 microversion: 2.1 time: 0.150364 Oct 04 22:13:14.644480 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3639/7298] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:14 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:15.668178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a682efc4-168a-4021-8b06-9f0017e1034e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:15.668804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a682efc4-168a-4021-8b06-9f0017e1034e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:15.675378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a682efc4-168a-4021-8b06-9f0017e1034e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:15.675874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a682efc4-168a-4021-8b06-9f0017e1034e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:15.676377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a682efc4-168a-4021-8b06-9f0017e1034e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:15.677080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a682efc4-168a-4021-8b06-9f0017e1034e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:15.677746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a682efc4-168a-4021-8b06-9f0017e1034e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:15.678197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a682efc4-168a-4021-8b06-9f0017e1034e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:15.809910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a682efc4-168a-4021-8b06-9f0017e1034e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:15.817640 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a682efc4-168a-4021-8b06-9f0017e1034e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1683 microversion: 2.1 time: 0.153620 Oct 04 22:13:15.818214 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3660/7299] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:15 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:16.840349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-962aa8e4-599c-4ee1-85e3-4c783150d884 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:16.840890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-962aa8e4-599c-4ee1-85e3-4c783150d884 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:16.848585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-962aa8e4-599c-4ee1-85e3-4c783150d884 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:16.849071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-962aa8e4-599c-4ee1-85e3-4c783150d884 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:16.849538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-962aa8e4-599c-4ee1-85e3-4c783150d884 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:16.850232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-962aa8e4-599c-4ee1-85e3-4c783150d884 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:16.850716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-962aa8e4-599c-4ee1-85e3-4c783150d884 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:16.851149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-962aa8e4-599c-4ee1-85e3-4c783150d884 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:16.979311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-962aa8e4-599c-4ee1-85e3-4c783150d884 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:16.986864 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-962aa8e4-599c-4ee1-85e3-4c783150d884 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1683 microversion: 2.1 time: 0.150565 Oct 04 22:13:16.987699 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3640/7300] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:16 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:18.010465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ba558eea-1f86-4ddc-8fd3-f9803afed350 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:18.011096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ba558eea-1f86-4ddc-8fd3-f9803afed350 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:18.019189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba558eea-1f86-4ddc-8fd3-f9803afed350 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:18.019705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba558eea-1f86-4ddc-8fd3-f9803afed350 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:18.020176 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba558eea-1f86-4ddc-8fd3-f9803afed350 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:18.020905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba558eea-1f86-4ddc-8fd3-f9803afed350 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:18.021382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba558eea-1f86-4ddc-8fd3-f9803afed350 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:18.021997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba558eea-1f86-4ddc-8fd3-f9803afed350 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:18.157328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ba558eea-1f86-4ddc-8fd3-f9803afed350 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:18.165889 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ba558eea-1f86-4ddc-8fd3-f9803afed350 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1683 microversion: 2.1 time: 0.159326 Oct 04 22:13:18.166548 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3661/7301] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:18 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:19.190780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a30602b0-ef99-4753-92e8-a82f164b9301 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:19.191395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a30602b0-ef99-4753-92e8-a82f164b9301 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:19.198290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a30602b0-ef99-4753-92e8-a82f164b9301 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:19.198781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a30602b0-ef99-4753-92e8-a82f164b9301 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:19.199250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a30602b0-ef99-4753-92e8-a82f164b9301 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:19.199942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a30602b0-ef99-4753-92e8-a82f164b9301 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:19.200426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a30602b0-ef99-4753-92e8-a82f164b9301 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:19.200829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a30602b0-ef99-4753-92e8-a82f164b9301 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:19.333339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a30602b0-ef99-4753-92e8-a82f164b9301 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:19.341639 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a30602b0-ef99-4753-92e8-a82f164b9301 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1683 microversion: 2.1 time: 0.155491 Oct 04 22:13:19.342211 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3641/7302] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:19 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:20.365937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-636fa11c-7dd6-49c5-b9e6-b6d40186fd37 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:20.366598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-636fa11c-7dd6-49c5-b9e6-b6d40186fd37 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:20.373620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-636fa11c-7dd6-49c5-b9e6-b6d40186fd37 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:20.374128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-636fa11c-7dd6-49c5-b9e6-b6d40186fd37 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:20.374589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-636fa11c-7dd6-49c5-b9e6-b6d40186fd37 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:20.375300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-636fa11c-7dd6-49c5-b9e6-b6d40186fd37 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:20.375776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-636fa11c-7dd6-49c5-b9e6-b6d40186fd37 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:20.376233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-636fa11c-7dd6-49c5-b9e6-b6d40186fd37 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:20.505762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-636fa11c-7dd6-49c5-b9e6-b6d40186fd37 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:20.513717 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-636fa11c-7dd6-49c5-b9e6-b6d40186fd37 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1683 microversion: 2.1 time: 0.151562 Oct 04 22:13:20.514288 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3662/7303] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:20 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:21.536254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b41c8b49-9e83-4685-8df6-bf527f4f077c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:21.536893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b41c8b49-9e83-4685-8df6-bf527f4f077c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:21.544241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b41c8b49-9e83-4685-8df6-bf527f4f077c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:21.544801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b41c8b49-9e83-4685-8df6-bf527f4f077c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:21.545337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b41c8b49-9e83-4685-8df6-bf527f4f077c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:21.546128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b41c8b49-9e83-4685-8df6-bf527f4f077c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:21.546650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b41c8b49-9e83-4685-8df6-bf527f4f077c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:21.547146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b41c8b49-9e83-4685-8df6-bf527f4f077c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:21.751768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b41c8b49-9e83-4685-8df6-bf527f4f077c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:21.762177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-c2b6b91c-5a9b-4bc9-b664-b5ace6e2cc99 req-eb59e0d4-bf09-483e-95b7-f34855099983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b9fe99-0b9c-405f-badb-ce3d33c047f2", "name": "network-vif-unplugged", "status": "completed", "tag": "7e2b56d2-f4ae-4041-ba1e-eb3a59c135c9"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:21.771943 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b41c8b49-9e83-4685-8df6-bf527f4f077c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1682 microversion: 2.1 time: 0.239531 Oct 04 22:13:21.777930 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3642/7304] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:21 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1682 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:21.778241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c2b6b91c-5a9b-4bc9-b664-b5ace6e2cc99 req-eb59e0d4-bf09-483e-95b7-f34855099983 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:21.778241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c2b6b91c-5a9b-4bc9-b664-b5ace6e2cc99 req-eb59e0d4-bf09-483e-95b7-f34855099983 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:21.778241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c2b6b91c-5a9b-4bc9-b664-b5ace6e2cc99 req-eb59e0d4-bf09-483e-95b7-f34855099983 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:21.788797 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-c2b6b91c-5a9b-4bc9-b664-b5ace6e2cc99 req-eb59e0d4-bf09-483e-95b7-f34855099983 service nova] Creating event network-vif-unplugged:7e2b56d2-f4ae-4041-ba1e-eb3a59c135c9 for instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 on n-h2-860282-1 Oct 04 22:13:21.794347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [req-c2b6b91c-5a9b-4bc9-b664-b5ace6e2cc99 req-eb59e0d4-bf09-483e-95b7-f34855099983 service nova] Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122757) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:13:21.806597 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-c2b6b91c-5a9b-4bc9-b664-b5ace6e2cc99 req-eb59e0d4-bf09-483e-95b7-f34855099983 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048032 Oct 04 22:13:21.808683 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3663/7305] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:13:22.796056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-46cecbcc-a7a8-4e25-a548-8d9f4709b6d9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:22.796669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-46cecbcc-a7a8-4e25-a548-8d9f4709b6d9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:22.803563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46cecbcc-a7a8-4e25-a548-8d9f4709b6d9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:22.804044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46cecbcc-a7a8-4e25-a548-8d9f4709b6d9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:22.804476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46cecbcc-a7a8-4e25-a548-8d9f4709b6d9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:22.805157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46cecbcc-a7a8-4e25-a548-8d9f4709b6d9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:22.805666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46cecbcc-a7a8-4e25-a548-8d9f4709b6d9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:22.806091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-46cecbcc-a7a8-4e25-a548-8d9f4709b6d9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:22.938276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-46cecbcc-a7a8-4e25-a548-8d9f4709b6d9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:22.946038 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-46cecbcc-a7a8-4e25-a548-8d9f4709b6d9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1682 microversion: 2.1 time: 0.153817 Oct 04 22:13:22.946611 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3643/7306] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:22 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:23.824512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-7a86f2e6-01f8-48f3-bb79-8569e65dbd99 req-5027bad2-95df-49ec-ad15-a4e10671766f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b9fe99-0b9c-405f-badb-ce3d33c047f2", "tag": "7e2b56d2-f4ae-4041-ba1e-eb3a59c135c9"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:23.836175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7a86f2e6-01f8-48f3-bb79-8569e65dbd99 req-5027bad2-95df-49ec-ad15-a4e10671766f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:23.840036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7a86f2e6-01f8-48f3-bb79-8569e65dbd99 req-5027bad2-95df-49ec-ad15-a4e10671766f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:23.840036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-7a86f2e6-01f8-48f3-bb79-8569e65dbd99 req-5027bad2-95df-49ec-ad15-a4e10671766f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:23.849466 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-7a86f2e6-01f8-48f3-bb79-8569e65dbd99 req-5027bad2-95df-49ec-ad15-a4e10671766f service nova] Creating event network-changed:7e2b56d2-f4ae-4041-ba1e-eb3a59c135c9 for instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 on n-h2-860282-1 Oct 04 22:13:23.855001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [req-7a86f2e6-01f8-48f3-bb79-8569e65dbd99 req-5027bad2-95df-49ec-ad15-a4e10671766f service nova] Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122757) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:13:23.866722 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-7a86f2e6-01f8-48f3-bb79-8569e65dbd99 req-5027bad2-95df-49ec-ad15-a4e10671766f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047590 Oct 04 22:13:23.867329 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3664/7307] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:13:23.969106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3f22c161-6fb1-4f25-b27f-d5a029abd652 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:23.969753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3f22c161-6fb1-4f25-b27f-d5a029abd652 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:23.978269 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f22c161-6fb1-4f25-b27f-d5a029abd652 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:23.978999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f22c161-6fb1-4f25-b27f-d5a029abd652 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:23.979203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f22c161-6fb1-4f25-b27f-d5a029abd652 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:23.979912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f22c161-6fb1-4f25-b27f-d5a029abd652 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:23.980373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f22c161-6fb1-4f25-b27f-d5a029abd652 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:23.980806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3f22c161-6fb1-4f25-b27f-d5a029abd652 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:24.120709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3f22c161-6fb1-4f25-b27f-d5a029abd652 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:24.129487 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3f22c161-6fb1-4f25-b27f-d5a029abd652 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1680 microversion: 2.1 time: 0.164384 Oct 04 22:13:24.130173 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3644/7308] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:23 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:25.155203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-36655ce2-4a89-4333-96b4-5681160cc528 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:25.156940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-36655ce2-4a89-4333-96b4-5681160cc528 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:25.162980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36655ce2-4a89-4333-96b4-5681160cc528 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:25.163481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36655ce2-4a89-4333-96b4-5681160cc528 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:25.163957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36655ce2-4a89-4333-96b4-5681160cc528 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:25.164669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36655ce2-4a89-4333-96b4-5681160cc528 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:25.165147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36655ce2-4a89-4333-96b4-5681160cc528 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:25.165634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36655ce2-4a89-4333-96b4-5681160cc528 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:25.360559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-36655ce2-4a89-4333-96b4-5681160cc528 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:25.368905 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-36655ce2-4a89-4333-96b4-5681160cc528 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1680 microversion: 2.1 time: 0.218988 Oct 04 22:13:25.376595 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3665/7309] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:25 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1680 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:26.392376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7ca7be72-25d5-4552-ba0d-6a79cadd563e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:26.393030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7ca7be72-25d5-4552-ba0d-6a79cadd563e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:26.400683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ca7be72-25d5-4552-ba0d-6a79cadd563e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:26.401181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ca7be72-25d5-4552-ba0d-6a79cadd563e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:26.401667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ca7be72-25d5-4552-ba0d-6a79cadd563e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:26.402366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ca7be72-25d5-4552-ba0d-6a79cadd563e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:26.402832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ca7be72-25d5-4552-ba0d-6a79cadd563e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:26.403262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ca7be72-25d5-4552-ba0d-6a79cadd563e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:26.544075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7ca7be72-25d5-4552-ba0d-6a79cadd563e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:26.552839 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7ca7be72-25d5-4552-ba0d-6a79cadd563e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1677 microversion: 2.1 time: 0.164618 Oct 04 22:13:26.553431 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3645/7310] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:26 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:26.575658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-063f0e32-c9b3-44d8-81a6-176875b0f4b3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:26.576211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-063f0e32-c9b3-44d8-81a6-176875b0f4b3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:26.582973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-063f0e32-c9b3-44d8-81a6-176875b0f4b3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:26.583481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-063f0e32-c9b3-44d8-81a6-176875b0f4b3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:26.583930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-063f0e32-c9b3-44d8-81a6-176875b0f4b3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:26.584641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-063f0e32-c9b3-44d8-81a6-176875b0f4b3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:26.585115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-063f0e32-c9b3-44d8-81a6-176875b0f4b3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:26.585592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-063f0e32-c9b3-44d8-81a6-176875b0f4b3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:26.622968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-063f0e32-c9b3-44d8-81a6-176875b0f4b3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:26.623488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-063f0e32-c9b3-44d8-81a6-176875b0f4b3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:26.623944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-063f0e32-c9b3-44d8-81a6-176875b0f4b3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:26.624687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-063f0e32-c9b3-44d8-81a6-176875b0f4b3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:26.625160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-063f0e32-c9b3-44d8-81a6-176875b0f4b3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:26.625640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-063f0e32-c9b3-44d8-81a6-176875b0f4b3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:26.648268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-063f0e32-c9b3-44d8-81a6-176875b0f4b3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Getting quotas for project 5aa764882b244357892ebdad69cff689. Resources: {'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:13:26.653562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-063f0e32-c9b3-44d8-81a6-176875b0f4b3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Getting quotas for user c01d66c6cbba4c30831508fdaf953268 and project 5aa764882b244357892ebdad69cff689. Resources: {'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:13:27.075710 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-063f0e32-c9b3-44d8-81a6-176875b0f4b3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "POST /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2/action" status: 202 len: 0 microversion: 2.1 time: 0.503672 Oct 04 22:13:27.076388 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3666/7311] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:13:26 2022] POST /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:13:27.084554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ba43fd9b-6cb8-40b0-811e-11f02a0a92ef tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:27.085180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ba43fd9b-6cb8-40b0-811e-11f02a0a92ef tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:27.091404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba43fd9b-6cb8-40b0-811e-11f02a0a92ef tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:27.091945 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba43fd9b-6cb8-40b0-811e-11f02a0a92ef tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:27.092359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba43fd9b-6cb8-40b0-811e-11f02a0a92ef tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:27.093067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba43fd9b-6cb8-40b0-811e-11f02a0a92ef tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:27.093578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba43fd9b-6cb8-40b0-811e-11f02a0a92ef tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:27.094019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba43fd9b-6cb8-40b0-811e-11f02a0a92ef tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:27.272761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ba43fd9b-6cb8-40b0-811e-11f02a0a92ef tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:27.280551 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ba43fd9b-6cb8-40b0-811e-11f02a0a92ef tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1676 microversion: 2.1 time: 0.199915 Oct 04 22:13:27.281135 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3646/7312] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:27 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1676 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:28.305468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bf15ac36-f155-4b14-b200-6456d6daf03b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:28.306130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bf15ac36-f155-4b14-b200-6456d6daf03b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:28.312311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf15ac36-f155-4b14-b200-6456d6daf03b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:28.312815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf15ac36-f155-4b14-b200-6456d6daf03b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:28.313264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf15ac36-f155-4b14-b200-6456d6daf03b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:28.314002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf15ac36-f155-4b14-b200-6456d6daf03b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:28.314478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf15ac36-f155-4b14-b200-6456d6daf03b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:28.314927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf15ac36-f155-4b14-b200-6456d6daf03b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:28.447658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bf15ac36-f155-4b14-b200-6456d6daf03b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:28.455522 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bf15ac36-f155-4b14-b200-6456d6daf03b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1676 microversion: 2.1 time: 0.155579 Oct 04 22:13:28.456098 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3667/7313] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:28 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:28.673676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-ffd356c9-8ff6-48b1-9c51-e36307d643cf req-d4850d2a-f46e-494a-99a1-79d8b6a04dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b9fe99-0b9c-405f-badb-ce3d33c047f2", "name": "network-vif-plugged", "status": "completed", "tag": "7e2b56d2-f4ae-4041-ba1e-eb3a59c135c9"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:28.685393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ffd356c9-8ff6-48b1-9c51-e36307d643cf req-d4850d2a-f46e-494a-99a1-79d8b6a04dac service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:28.686030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ffd356c9-8ff6-48b1-9c51-e36307d643cf req-d4850d2a-f46e-494a-99a1-79d8b6a04dac service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:28.686471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-ffd356c9-8ff6-48b1-9c51-e36307d643cf req-d4850d2a-f46e-494a-99a1-79d8b6a04dac service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:28.699011 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-ffd356c9-8ff6-48b1-9c51-e36307d643cf req-d4850d2a-f46e-494a-99a1-79d8b6a04dac service nova] Creating event network-vif-plugged:7e2b56d2-f4ae-4041-ba1e-eb3a59c135c9 for instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 on n-h2-860282-1 Oct 04 22:13:28.704417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-ffd356c9-8ff6-48b1-9c51-e36307d643cf req-d4850d2a-f46e-494a-99a1-79d8b6a04dac service nova] Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:13:28.716696 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-ffd356c9-8ff6-48b1-9c51-e36307d643cf req-d4850d2a-f46e-494a-99a1-79d8b6a04dac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046833 Oct 04 22:13:28.717298 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3647/7314] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:29.480321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-342d6cdc-d777-44bb-8d0c-43d2e9655fec tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:29.480877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-342d6cdc-d777-44bb-8d0c-43d2e9655fec tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:29.488455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-342d6cdc-d777-44bb-8d0c-43d2e9655fec tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:29.492034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-342d6cdc-d777-44bb-8d0c-43d2e9655fec tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:29.492034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-342d6cdc-d777-44bb-8d0c-43d2e9655fec tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:29.492034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-342d6cdc-d777-44bb-8d0c-43d2e9655fec tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:29.492034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-342d6cdc-d777-44bb-8d0c-43d2e9655fec tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:29.492034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-342d6cdc-d777-44bb-8d0c-43d2e9655fec tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:29.627679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-342d6cdc-d777-44bb-8d0c-43d2e9655fec tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:29.636286 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-342d6cdc-d777-44bb-8d0c-43d2e9655fec tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1676 microversion: 2.1 time: 0.160046 Oct 04 22:13:29.636882 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3668/7315] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:29 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:30.660576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b036bb76-3c1a-428c-88e0-5b700f668be2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:30.661543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b036bb76-3c1a-428c-88e0-5b700f668be2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:30.670491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b036bb76-3c1a-428c-88e0-5b700f668be2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:30.670987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b036bb76-3c1a-428c-88e0-5b700f668be2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:30.671474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b036bb76-3c1a-428c-88e0-5b700f668be2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:30.672147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b036bb76-3c1a-428c-88e0-5b700f668be2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:30.672610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b036bb76-3c1a-428c-88e0-5b700f668be2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:30.673044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b036bb76-3c1a-428c-88e0-5b700f668be2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:30.807855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b036bb76-3c1a-428c-88e0-5b700f668be2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:30.814298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-e5060612-a185-4c7c-9d34-9215ad00af76 req-85d443aa-7588-4f17-ac26-1695b33df959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b9fe99-0b9c-405f-badb-ce3d33c047f2", "name": "network-vif-unplugged", "status": "completed", "tag": "7e2b56d2-f4ae-4041-ba1e-eb3a59c135c9"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:30.816771 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b036bb76-3c1a-428c-88e0-5b700f668be2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1676 microversion: 2.1 time: 0.160860 Oct 04 22:13:30.829938 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3648/7316] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:30 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:30.832109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e5060612-a185-4c7c-9d34-9215ad00af76 req-85d443aa-7588-4f17-ac26-1695b33df959 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:30.832616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e5060612-a185-4c7c-9d34-9215ad00af76 req-85d443aa-7588-4f17-ac26-1695b33df959 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:30.833056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e5060612-a185-4c7c-9d34-9215ad00af76 req-85d443aa-7588-4f17-ac26-1695b33df959 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:30.845111 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-e5060612-a185-4c7c-9d34-9215ad00af76 req-85d443aa-7588-4f17-ac26-1695b33df959 service nova] Creating event network-vif-unplugged:7e2b56d2-f4ae-4041-ba1e-eb3a59c135c9 for instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 on n-h1-860282-1 Oct 04 22:13:30.851189 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [req-e5060612-a185-4c7c-9d34-9215ad00af76 req-85d443aa-7588-4f17-ac26-1695b33df959 service nova] Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122757) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:13:30.862188 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-e5060612-a185-4c7c-9d34-9215ad00af76 req-85d443aa-7588-4f17-ac26-1695b33df959 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053908 Oct 04 22:13:30.863892 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3669/7317] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:13:31.842091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4ab29c16-8084-4c05-9e9d-16f983b25d47 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:31.842697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4ab29c16-8084-4c05-9e9d-16f983b25d47 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:31.850334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ab29c16-8084-4c05-9e9d-16f983b25d47 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:31.850830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ab29c16-8084-4c05-9e9d-16f983b25d47 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:31.851276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ab29c16-8084-4c05-9e9d-16f983b25d47 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:31.851987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ab29c16-8084-4c05-9e9d-16f983b25d47 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:31.852446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ab29c16-8084-4c05-9e9d-16f983b25d47 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:31.852877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ab29c16-8084-4c05-9e9d-16f983b25d47 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:31.994495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4ab29c16-8084-4c05-9e9d-16f983b25d47 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:32.002340 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4ab29c16-8084-4c05-9e9d-16f983b25d47 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1676 microversion: 2.1 time: 0.164275 Oct 04 22:13:32.002961 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3649/7318] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:31 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:32.879185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-0d07c578-3297-471d-a83c-3cca7745c82a req-653d12d3-8c48-4e45-9b1f-b366c5eb6bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b9fe99-0b9c-405f-badb-ce3d33c047f2", "tag": "7e2b56d2-f4ae-4041-ba1e-eb3a59c135c9"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:32.889582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0d07c578-3297-471d-a83c-3cca7745c82a req-653d12d3-8c48-4e45-9b1f-b366c5eb6bf9 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:32.890074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0d07c578-3297-471d-a83c-3cca7745c82a req-653d12d3-8c48-4e45-9b1f-b366c5eb6bf9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:32.890517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0d07c578-3297-471d-a83c-3cca7745c82a req-653d12d3-8c48-4e45-9b1f-b366c5eb6bf9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:32.902852 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-0d07c578-3297-471d-a83c-3cca7745c82a req-653d12d3-8c48-4e45-9b1f-b366c5eb6bf9 service nova] Creating event network-changed:7e2b56d2-f4ae-4041-ba1e-eb3a59c135c9 for instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 on n-h1-860282-1 Oct 04 22:13:32.905438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:32.909154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [req-0d07c578-3297-471d-a83c-3cca7745c82a req-653d12d3-8c48-4e45-9b1f-b366c5eb6bf9 service nova] Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122757) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:13:32.920064 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-0d07c578-3297-471d-a83c-3cca7745c82a req-653d12d3-8c48-4e45-9b1f-b366c5eb6bf9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045745 Oct 04 22:13:32.920708 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3670/7319] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:33.027564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f92a1f0f-ca78-41c2-870f-7d8185f26bea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:33.028279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f92a1f0f-ca78-41c2-870f-7d8185f26bea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:33.035678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f92a1f0f-ca78-41c2-870f-7d8185f26bea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:33.036184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f92a1f0f-ca78-41c2-870f-7d8185f26bea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:33.036627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f92a1f0f-ca78-41c2-870f-7d8185f26bea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:33.037346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f92a1f0f-ca78-41c2-870f-7d8185f26bea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:33.037834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f92a1f0f-ca78-41c2-870f-7d8185f26bea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:33.038296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f92a1f0f-ca78-41c2-870f-7d8185f26bea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:33.060258 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:33.249175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f92a1f0f-ca78-41c2-870f-7d8185f26bea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:33.258113 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f92a1f0f-ca78-41c2-870f-7d8185f26bea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1676 microversion: 2.1 time: 0.234536 Oct 04 22:13:33.258752 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3650/7320] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:33 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1676 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:34.283353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8e37eba2-7e2d-47db-afac-25ba681efb2f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:34.284102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8e37eba2-7e2d-47db-afac-25ba681efb2f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:34.291456 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e37eba2-7e2d-47db-afac-25ba681efb2f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:34.291967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e37eba2-7e2d-47db-afac-25ba681efb2f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:34.292429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e37eba2-7e2d-47db-afac-25ba681efb2f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:34.293138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e37eba2-7e2d-47db-afac-25ba681efb2f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:34.293647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e37eba2-7e2d-47db-afac-25ba681efb2f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:34.294097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8e37eba2-7e2d-47db-afac-25ba681efb2f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:34.427988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8e37eba2-7e2d-47db-afac-25ba681efb2f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:34.435862 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8e37eba2-7e2d-47db-afac-25ba681efb2f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1669 microversion: 2.1 time: 0.157649 Oct 04 22:13:34.436440 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3671/7321] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:34 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:34.458099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a55d02f2-bd01-4091-a1d9-d5f9fac4b1ea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:34.458717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a55d02f2-bd01-4091-a1d9-d5f9fac4b1ea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:34.466049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a55d02f2-bd01-4091-a1d9-d5f9fac4b1ea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:34.466480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a55d02f2-bd01-4091-a1d9-d5f9fac4b1ea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:34.466923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a55d02f2-bd01-4091-a1d9-d5f9fac4b1ea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:34.467640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a55d02f2-bd01-4091-a1d9-d5f9fac4b1ea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:34.468098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a55d02f2-bd01-4091-a1d9-d5f9fac4b1ea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:34.468527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a55d02f2-bd01-4091-a1d9-d5f9fac4b1ea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:34.603010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a55d02f2-bd01-4091-a1d9-d5f9fac4b1ea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:34.610638 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a55d02f2-bd01-4091-a1d9-d5f9fac4b1ea tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1669 microversion: 2.1 time: 0.156522 Oct 04 22:13:34.611209 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3651/7322] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:34 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:13:34.632982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-78d2297e-a91c-4e6a-9f89-eb9172a1946b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:34.633648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-78d2297e-a91c-4e6a-9f89-eb9172a1946b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:34.639758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78d2297e-a91c-4e6a-9f89-eb9172a1946b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:34.640247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78d2297e-a91c-4e6a-9f89-eb9172a1946b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:34.640699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78d2297e-a91c-4e6a-9f89-eb9172a1946b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:34.641415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78d2297e-a91c-4e6a-9f89-eb9172a1946b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:34.641891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78d2297e-a91c-4e6a-9f89-eb9172a1946b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:34.642331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-78d2297e-a91c-4e6a-9f89-eb9172a1946b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:34.783188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-78d2297e-a91c-4e6a-9f89-eb9172a1946b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:34.792096 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-78d2297e-a91c-4e6a-9f89-eb9172a1946b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1669 microversion: 2.1 time: 0.162877 Oct 04 22:13:34.797894 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3672/7323] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:34 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:34.814441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cf856bf9-6a7e-4e5a-86d0-29c7504d55a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:34.815174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cf856bf9-6a7e-4e5a-86d0-29c7504d55a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:34.821210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf856bf9-6a7e-4e5a-86d0-29c7504d55a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:34.821730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf856bf9-6a7e-4e5a-86d0-29c7504d55a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:34.822175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf856bf9-6a7e-4e5a-86d0-29c7504d55a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:34.823814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf856bf9-6a7e-4e5a-86d0-29c7504d55a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:34.824285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf856bf9-6a7e-4e5a-86d0-29c7504d55a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:34.824752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf856bf9-6a7e-4e5a-86d0-29c7504d55a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:34.850832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cf856bf9-6a7e-4e5a-86d0-29c7504d55a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:13:35.072129 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cf856bf9-6a7e-4e5a-86d0-29c7504d55a9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 204 len: 0 microversion: 2.1 time: 0.261202 Oct 04 22:13:35.072632 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3652/7324] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:13:34 2022] DELETE /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:13:35.081142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7f7fdec9-d94c-4271-b37a-99d1f589cf41 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:35.082025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7f7fdec9-d94c-4271-b37a-99d1f589cf41 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:35.089001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f7fdec9-d94c-4271-b37a-99d1f589cf41 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:35.089538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f7fdec9-d94c-4271-b37a-99d1f589cf41 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:35.090073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f7fdec9-d94c-4271-b37a-99d1f589cf41 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:35.090834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f7fdec9-d94c-4271-b37a-99d1f589cf41 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:35.091339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f7fdec9-d94c-4271-b37a-99d1f589cf41 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:35.091974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7f7fdec9-d94c-4271-b37a-99d1f589cf41 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:35.226439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7f7fdec9-d94c-4271-b37a-99d1f589cf41 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:35.234429 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7f7fdec9-d94c-4271-b37a-99d1f589cf41 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1675 microversion: 2.1 time: 0.157218 Oct 04 22:13:35.235010 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3673/7325] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:35 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:36.259726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9f94fc8d-fd83-4b60-aef9-55c1c075b79b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:36.260442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9f94fc8d-fd83-4b60-aef9-55c1c075b79b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:36.267741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f94fc8d-fd83-4b60-aef9-55c1c075b79b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:36.268294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f94fc8d-fd83-4b60-aef9-55c1c075b79b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:36.268681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f94fc8d-fd83-4b60-aef9-55c1c075b79b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:36.269384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f94fc8d-fd83-4b60-aef9-55c1c075b79b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:36.269932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f94fc8d-fd83-4b60-aef9-55c1c075b79b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:36.270366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9f94fc8d-fd83-4b60-aef9-55c1c075b79b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:36.406333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9f94fc8d-fd83-4b60-aef9-55c1c075b79b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:36.414400 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9f94fc8d-fd83-4b60-aef9-55c1c075b79b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1675 microversion: 2.1 time: 0.159023 Oct 04 22:13:36.417476 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3653/7326] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:36 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:37.162717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-e7e04683-7e9e-4878-a6fa-9e5968f30c14 req-3e978921-d74f-42e2-94a6-7e1b721cfd7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b9fe99-0b9c-405f-badb-ce3d33c047f2", "name": "network-vif-deleted", "tag": "7e2b56d2-f4ae-4041-ba1e-eb3a59c135c9"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:37.168517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:37.169259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:37.174972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e7e04683-7e9e-4878-a6fa-9e5968f30c14 req-3e978921-d74f-42e2-94a6-7e1b721cfd7f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:37.175546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e7e04683-7e9e-4878-a6fa-9e5968f30c14 req-3e978921-d74f-42e2-94a6-7e1b721cfd7f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:37.176619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-e7e04683-7e9e-4878-a6fa-9e5968f30c14 req-3e978921-d74f-42e2-94a6-7e1b721cfd7f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:37.188967 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-e7e04683-7e9e-4878-a6fa-9e5968f30c14 req-3e978921-d74f-42e2-94a6-7e1b721cfd7f service nova] Creating event network-vif-deleted:7e2b56d2-f4ae-4041-ba1e-eb3a59c135c9 for instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 on n-h1-860282-1 Oct 04 22:13:37.194863 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-e7e04683-7e9e-4878-a6fa-9e5968f30c14 req-3e978921-d74f-42e2-94a6-7e1b721cfd7f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035870 Oct 04 22:13:37.195486 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3674/7327] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:37.439777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-44b2c56b-510e-4549-b1d6-1b615c874670 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:37.440730 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-44b2c56b-510e-4549-b1d6-1b615c874670 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:37.444108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:37.449129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44b2c56b-510e-4549-b1d6-1b615c874670 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:37.454471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44b2c56b-510e-4549-b1d6-1b615c874670 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:37.454471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44b2c56b-510e-4549-b1d6-1b615c874670 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:37.454471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44b2c56b-510e-4549-b1d6-1b615c874670 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:37.454471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44b2c56b-510e-4549-b1d6-1b615c874670 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:37.454471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44b2c56b-510e-4549-b1d6-1b615c874670 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:37.485025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44b2c56b-510e-4549-b1d6-1b615c874670 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:37.485582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44b2c56b-510e-4549-b1d6-1b615c874670 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:37.486093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-44b2c56b-510e-4549-b1d6-1b615c874670 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:37.486533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-44b2c56b-510e-4549-b1d6-1b615c874670 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lazy-loading 'fault' on Instance uuid b5b9fe99-0b9c-405f-badb-ce3d33c047f2 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:13:37.539825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-44b2c56b-510e-4549-b1d6-1b615c874670 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:37.548294 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-44b2c56b-510e-4549-b1d6-1b615c874670 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 200 len: 1327 microversion: 2.1 time: 0.112787 Oct 04 22:13:37.549075 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3654/7328] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:37 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 1327 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:38.574186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-458f9268-f2e2-4619-8000-8411614fb0a2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:38.574934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-458f9268-f2e2-4619-8000-8411614fb0a2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:38.581890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-458f9268-f2e2-4619-8000-8411614fb0a2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:38.582959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-458f9268-f2e2-4619-8000-8411614fb0a2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:38.583460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-458f9268-f2e2-4619-8000-8411614fb0a2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:38.584175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-458f9268-f2e2-4619-8000-8411614fb0a2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:38.584645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-458f9268-f2e2-4619-8000-8411614fb0a2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:38.585087 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-458f9268-f2e2-4619-8000-8411614fb0a2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:38.599203 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-458f9268-f2e2-4619-8000-8411614fb0a2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] HTTP exception thrown: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-458f9268-f2e2-4619-8000-8411614fb0a2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Request method failure captured: Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 HTTP/1.1 Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPK8oecCePEZ1fjQeOvLUymrlk79ZSDMC_m3SQmxdMtXhHHvhD1zn86_Mnhmwnf3CTzZYgu9HlWWt5S89bCsK70TBvqC_PsuS5A9ZH5z3zSd6qECgW80Bqf-YGFd31IgZ7PhK_th5fwhMT0w_DbjLHA4xe_oVPvuobxSs8EncCZ5xwHg Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5aa764882b244357892ebdad69cff689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5aa764882b244357892ebdad69cff689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}] Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerActionsTestJSON-560335426 Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c01d66c6cbba4c30831508fdaf953268 Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'b5b9fe99-0b9c-405f-badb-ce3d33c047f2'} Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:38.600846 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:13:38.605300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:38.605300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:38.605300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:38.605300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:13:38.605300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:13:38.605300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:13:38.605300 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:13:38.605300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-458f9268-f2e2-4619-8000-8411614fb0a2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Returning 404 to user: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:13:38.605300 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-458f9268-f2e2-4619-8000-8411614fb0a2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 404 len: 111 microversion: 2.1 time: 0.033737 Oct 04 22:13:38.605300 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3675/7329] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:38 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:13:38.616303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2406eb34-8d3c-41d8-8c17-7037640829e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:38.616951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2406eb34-8d3c-41d8-8c17-7037640829e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:38.623758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2406eb34-8d3c-41d8-8c17-7037640829e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:38.624249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2406eb34-8d3c-41d8-8c17-7037640829e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:38.624689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2406eb34-8d3c-41d8-8c17-7037640829e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:38.625387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2406eb34-8d3c-41d8-8c17-7037640829e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:38.625874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2406eb34-8d3c-41d8-8c17-7037640829e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:38.626306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2406eb34-8d3c-41d8-8c17-7037640829e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:38.639948 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-2406eb34-8d3c-41d8-8c17-7037640829e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] HTTP exception thrown: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2406eb34-8d3c-41d8-8c17-7037640829e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Request method failure captured: Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 HTTP/1.1 Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPK8oecCePEZ1fjQeOvLUymrlk79ZSDMC_m3SQmxdMtXhHHvhD1zn86_Mnhmwnf3CTzZYgu9HlWWt5S89bCsK70TBvqC_PsuS5A9ZH5z3zSd6qECgW80Bqf-YGFd31IgZ7PhK_th5fwhMT0w_DbjLHA4xe_oVPvuobxSs8EncCZ5xwHg Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5aa764882b244357892ebdad69cff689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5aa764882b244357892ebdad69cff689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}] Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerActionsTestJSON-560335426 Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c01d66c6cbba4c30831508fdaf953268 Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'b5b9fe99-0b9c-405f-badb-ce3d33c047f2'} Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:38.641653 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:13:38.647263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:38.647263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:38.647263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:38.647263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:13:38.647263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:13:38.647263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:13:38.647263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:13:38.647263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2406eb34-8d3c-41d8-8c17-7037640829e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Returning 404 to user: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:13:38.647263 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2406eb34-8d3c-41d8-8c17-7037640829e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 404 len: 111 microversion: 2.1 time: 0.031243 Oct 04 22:13:38.647263 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3655/7330] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:38 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:13:38.693679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dc757fc7-4ae4-4d00-b878-9d4bfe9cbd89 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-406163397", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "5f62b5be-7019-44f6-811c-aa44b61d2d81"}], "security_groups": [{"name": "tempest-securitygroup--1599777208"}], "key_name": "tempest-keypair-955841605", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:38.797856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-dc757fc7-4ae4-4d00-b878-9d4bfe9cbd89 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] validate_networks() for [('5f62b5be-7019-44f6-811c-aa44b61d2d81', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:13:39.208489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-dc757fc7-4ae4-4d00-b878-9d4bfe9cbd89 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:13:39.208937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-dc757fc7-4ae4-4d00-b878-9d4bfe9cbd89 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:13:39.209503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-dc757fc7-4ae4-4d00-b878-9d4bfe9cbd89 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:13:39.209936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-dc757fc7-4ae4-4d00-b878-9d4bfe9cbd89 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:13:39.210368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-dc757fc7-4ae4-4d00-b878-9d4bfe9cbd89 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:13:39.219375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc757fc7-4ae4-4d00-b878-9d4bfe9cbd89 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:39.219876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc757fc7-4ae4-4d00-b878-9d4bfe9cbd89 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:39.220333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc757fc7-4ae4-4d00-b878-9d4bfe9cbd89 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:39.221083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc757fc7-4ae4-4d00-b878-9d4bfe9cbd89 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:39.221594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc757fc7-4ae4-4d00-b878-9d4bfe9cbd89 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:39.222044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc757fc7-4ae4-4d00-b878-9d4bfe9cbd89 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:39.239172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-dc757fc7-4ae4-4d00-b878-9d4bfe9cbd89 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Getting quotas for project 5aa764882b244357892ebdad69cff689. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:13:39.244653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-dc757fc7-4ae4-4d00-b878-9d4bfe9cbd89 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Getting quotas for user c01d66c6cbba4c30831508fdaf953268 and project 5aa764882b244357892ebdad69cff689. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:13:39.257902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dc757fc7-4ae4-4d00-b878-9d4bfe9cbd89 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:13:39.260232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dc757fc7-4ae4-4d00-b878-9d4bfe9cbd89 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:13:39.365148 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dc757fc7-4ae4-4d00-b878-9d4bfe9cbd89 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.675794 Oct 04 22:13:39.365855 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3676/7331] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:13:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:13:39.378842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fee97543-998d-48ff-bd7d-b4beea4ccec1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:39.381621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fee97543-998d-48ff-bd7d-b4beea4ccec1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:39.436349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fee97543-998d-48ff-bd7d-b4beea4ccec1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:39.443929 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fee97543-998d-48ff-bd7d-b4beea4ccec1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1237 microversion: 2.1 time: 0.070636 Oct 04 22:13:39.444497 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3656/7332] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:39 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:13:40.468692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dc9c0170-5a9d-44b1-8407-4dc0ad9a7ffd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:40.469291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dc9c0170-5a9d-44b1-8407-4dc0ad9a7ffd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:40.477491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc9c0170-5a9d-44b1-8407-4dc0ad9a7ffd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:40.478011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc9c0170-5a9d-44b1-8407-4dc0ad9a7ffd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:40.478505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc9c0170-5a9d-44b1-8407-4dc0ad9a7ffd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:40.479266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc9c0170-5a9d-44b1-8407-4dc0ad9a7ffd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:40.479752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc9c0170-5a9d-44b1-8407-4dc0ad9a7ffd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:40.480206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc9c0170-5a9d-44b1-8407-4dc0ad9a7ffd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:40.543576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dc9c0170-5a9d-44b1-8407-4dc0ad9a7ffd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:40.551639 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dc9c0170-5a9d-44b1-8407-4dc0ad9a7ffd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1233 microversion: 2.1 time: 0.087842 Oct 04 22:13:40.552424 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3677/7333] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:40 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1233 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:41.576553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-37e4154c-4106-4f19-8a37-44263f6ad1cf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:41.577412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-37e4154c-4106-4f19-8a37-44263f6ad1cf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:41.590756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37e4154c-4106-4f19-8a37-44263f6ad1cf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:41.591260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37e4154c-4106-4f19-8a37-44263f6ad1cf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:41.591707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37e4154c-4106-4f19-8a37-44263f6ad1cf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:41.592427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37e4154c-4106-4f19-8a37-44263f6ad1cf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:41.592889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37e4154c-4106-4f19-8a37-44263f6ad1cf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:41.593334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-37e4154c-4106-4f19-8a37-44263f6ad1cf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:41.673554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-37e4154c-4106-4f19-8a37-44263f6ad1cf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:41.681818 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-37e4154c-4106-4f19-8a37-44263f6ad1cf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1295 microversion: 2.1 time: 0.109220 Oct 04 22:13:41.682397 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3657/7334] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:41 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1295 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:42.706561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f585bb46-5301-44fe-bbc7-0c5b3ec7865e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:42.707125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f585bb46-5301-44fe-bbc7-0c5b3ec7865e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:42.714912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f585bb46-5301-44fe-bbc7-0c5b3ec7865e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:42.715426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f585bb46-5301-44fe-bbc7-0c5b3ec7865e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:42.715894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f585bb46-5301-44fe-bbc7-0c5b3ec7865e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:42.716619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f585bb46-5301-44fe-bbc7-0c5b3ec7865e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:42.717105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f585bb46-5301-44fe-bbc7-0c5b3ec7865e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:42.717592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f585bb46-5301-44fe-bbc7-0c5b3ec7865e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:42.882155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f585bb46-5301-44fe-bbc7-0c5b3ec7865e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:42.890173 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f585bb46-5301-44fe-bbc7-0c5b3ec7865e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1363 microversion: 2.1 time: 0.187794 Oct 04 22:13:42.891640 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3678/7335] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:42 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:43.288953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-59dc9ca5-62b9-4626-9277-d525d208d3cc req-d098258a-06bb-4381-8fdf-7102eb33d07c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69067cea-983e-4add-a8f5-f92f398ede71", "tag": "d070c196-cf8d-440b-b034-289aab5e9c7f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:43.299722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-59dc9ca5-62b9-4626-9277-d525d208d3cc req-d098258a-06bb-4381-8fdf-7102eb33d07c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:43.300324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-59dc9ca5-62b9-4626-9277-d525d208d3cc req-d098258a-06bb-4381-8fdf-7102eb33d07c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:43.300752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-59dc9ca5-62b9-4626-9277-d525d208d3cc req-d098258a-06bb-4381-8fdf-7102eb33d07c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:43.313068 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-59dc9ca5-62b9-4626-9277-d525d208d3cc req-d098258a-06bb-4381-8fdf-7102eb33d07c service nova] Creating event network-changed:d070c196-cf8d-440b-b034-289aab5e9c7f for instance 69067cea-983e-4add-a8f5-f92f398ede71 on n-h2-860282-1 Oct 04 22:13:43.318281 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-59dc9ca5-62b9-4626-9277-d525d208d3cc req-d098258a-06bb-4381-8fdf-7102eb33d07c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033754 Oct 04 22:13:43.318885 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3658/7336] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:43.914994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d4749947-2c86-4d01-81c3-3a3cd690e8ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:43.915632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d4749947-2c86-4d01-81c3-3a3cd690e8ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:43.921953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4749947-2c86-4d01-81c3-3a3cd690e8ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:43.922461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4749947-2c86-4d01-81c3-3a3cd690e8ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:43.922919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4749947-2c86-4d01-81c3-3a3cd690e8ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:43.923640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4749947-2c86-4d01-81c3-3a3cd690e8ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:43.924108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4749947-2c86-4d01-81c3-3a3cd690e8ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:43.924560 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d4749947-2c86-4d01-81c3-3a3cd690e8ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:44.101501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d4749947-2c86-4d01-81c3-3a3cd690e8ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:44.111279 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d4749947-2c86-4d01-81c3-3a3cd690e8ae tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1363 microversion: 2.1 time: 0.198868 Oct 04 22:13:44.111279 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3679/7337] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:43 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:45.135657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1c094685-d566-474d-a6b2-8e5deabeaf96 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:45.136362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1c094685-d566-474d-a6b2-8e5deabeaf96 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:45.142921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c094685-d566-474d-a6b2-8e5deabeaf96 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:45.143300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c094685-d566-474d-a6b2-8e5deabeaf96 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:45.143740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c094685-d566-474d-a6b2-8e5deabeaf96 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:45.144429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c094685-d566-474d-a6b2-8e5deabeaf96 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:45.145550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c094685-d566-474d-a6b2-8e5deabeaf96 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:45.146057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1c094685-d566-474d-a6b2-8e5deabeaf96 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:45.278775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1c094685-d566-474d-a6b2-8e5deabeaf96 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:45.287235 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1c094685-d566-474d-a6b2-8e5deabeaf96 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1363 microversion: 2.1 time: 0.156836 Oct 04 22:13:45.287823 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3659/7338] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:45 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:46.310443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-492f20cb-d9ed-4d82-b5df-475591b87d05 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:46.311076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-492f20cb-d9ed-4d82-b5df-475591b87d05 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:46.318750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-492f20cb-d9ed-4d82-b5df-475591b87d05 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:46.319256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-492f20cb-d9ed-4d82-b5df-475591b87d05 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:46.319715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-492f20cb-d9ed-4d82-b5df-475591b87d05 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:46.320429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-492f20cb-d9ed-4d82-b5df-475591b87d05 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:46.320902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-492f20cb-d9ed-4d82-b5df-475591b87d05 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:46.321348 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-492f20cb-d9ed-4d82-b5df-475591b87d05 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:46.449128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-492f20cb-d9ed-4d82-b5df-475591b87d05 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:46.457259 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-492f20cb-d9ed-4d82-b5df-475591b87d05 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1363 microversion: 2.1 time: 0.150622 Oct 04 22:13:46.457812 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3680/7339] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:46 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:47.480459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-972c400c-266b-40d0-a83c-f7e978273bc0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:47.481032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-972c400c-266b-40d0-a83c-f7e978273bc0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:47.487898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-972c400c-266b-40d0-a83c-f7e978273bc0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:47.488970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-972c400c-266b-40d0-a83c-f7e978273bc0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:47.489412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-972c400c-266b-40d0-a83c-f7e978273bc0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:47.490135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-972c400c-266b-40d0-a83c-f7e978273bc0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:47.490614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-972c400c-266b-40d0-a83c-f7e978273bc0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:47.491027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-972c400c-266b-40d0-a83c-f7e978273bc0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:47.620927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-972c400c-266b-40d0-a83c-f7e978273bc0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:47.628546 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-972c400c-266b-40d0-a83c-f7e978273bc0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1363 microversion: 2.1 time: 0.152097 Oct 04 22:13:47.629993 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3660/7340] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:47 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:48.652105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-83b3f8a8-b25c-4537-a5f0-5b2bd92be78a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:48.652733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-83b3f8a8-b25c-4537-a5f0-5b2bd92be78a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:48.659663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83b3f8a8-b25c-4537-a5f0-5b2bd92be78a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:48.664612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83b3f8a8-b25c-4537-a5f0-5b2bd92be78a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:48.664612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83b3f8a8-b25c-4537-a5f0-5b2bd92be78a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:48.664612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83b3f8a8-b25c-4537-a5f0-5b2bd92be78a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:48.664612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83b3f8a8-b25c-4537-a5f0-5b2bd92be78a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:48.664612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83b3f8a8-b25c-4537-a5f0-5b2bd92be78a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:48.787852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-1b9fd416-67fb-4ba2-b778-31593c16751e req-d1832a89-11de-4151-83e1-b314f666e99e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69067cea-983e-4add-a8f5-f92f398ede71", "name": "network-vif-plugged", "status": "completed", "tag": "d070c196-cf8d-440b-b034-289aab5e9c7f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:48.798490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1b9fd416-67fb-4ba2-b778-31593c16751e req-d1832a89-11de-4151-83e1-b314f666e99e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:48.799380 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1b9fd416-67fb-4ba2-b778-31593c16751e req-d1832a89-11de-4151-83e1-b314f666e99e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:48.799820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1b9fd416-67fb-4ba2-b778-31593c16751e req-d1832a89-11de-4151-83e1-b314f666e99e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:48.805853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-83b3f8a8-b25c-4537-a5f0-5b2bd92be78a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:48.811982 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-1b9fd416-67fb-4ba2-b778-31593c16751e req-d1832a89-11de-4151-83e1-b314f666e99e service nova] Creating event network-vif-plugged:d070c196-cf8d-440b-b034-289aab5e9c7f for instance 69067cea-983e-4add-a8f5-f92f398ede71 on n-h2-860282-1 Oct 04 22:13:48.813492 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-83b3f8a8-b25c-4537-a5f0-5b2bd92be78a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1363 microversion: 2.1 time: 0.165236 Oct 04 22:13:48.815889 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3681/7341] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:48 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:48.817488 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-1b9fd416-67fb-4ba2-b778-31593c16751e req-d1832a89-11de-4151-83e1-b314f666e99e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033479 Oct 04 22:13:48.818078 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3661/7342] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:13:49.838720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0c05537b-6c3b-45d7-9eb1-a10560e16159 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:49.842653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0c05537b-6c3b-45d7-9eb1-a10560e16159 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:49.842653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:49.842653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:49.847670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c05537b-6c3b-45d7-9eb1-a10560e16159 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:49.848758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c05537b-6c3b-45d7-9eb1-a10560e16159 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:49.849217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c05537b-6c3b-45d7-9eb1-a10560e16159 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:49.849961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c05537b-6c3b-45d7-9eb1-a10560e16159 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:49.850438 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c05537b-6c3b-45d7-9eb1-a10560e16159 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:49.850884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c05537b-6c3b-45d7-9eb1-a10560e16159 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:49.986582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0c05537b-6c3b-45d7-9eb1-a10560e16159 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:49.997168 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0c05537b-6c3b-45d7-9eb1-a10560e16159 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1363 microversion: 2.1 time: 0.162370 Oct 04 22:13:49.997849 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3682/7343] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:49 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:51.018648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:51.024429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7beefcce-3fe3-49de-b2da-1fb4aa667eb8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:51.025180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7beefcce-3fe3-49de-b2da-1fb4aa667eb8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:51.031304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7beefcce-3fe3-49de-b2da-1fb4aa667eb8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:51.032906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7beefcce-3fe3-49de-b2da-1fb4aa667eb8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:51.032906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7beefcce-3fe3-49de-b2da-1fb4aa667eb8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:51.032906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7beefcce-3fe3-49de-b2da-1fb4aa667eb8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:51.033332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7beefcce-3fe3-49de-b2da-1fb4aa667eb8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:51.033796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7beefcce-3fe3-49de-b2da-1fb4aa667eb8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:51.163857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7beefcce-3fe3-49de-b2da-1fb4aa667eb8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:51.171595 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7beefcce-3fe3-49de-b2da-1fb4aa667eb8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1550 microversion: 2.1 time: 0.153947 Oct 04 22:13:51.172192 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3662/7344] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:51 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:51.195552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1214c9ca-4571-4b21-9fa9-d9f24fa4e662 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:51.196104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1214c9ca-4571-4b21-9fa9-d9f24fa4e662 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:51.202789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1214c9ca-4571-4b21-9fa9-d9f24fa4e662 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:51.203283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1214c9ca-4571-4b21-9fa9-d9f24fa4e662 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:51.203743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1214c9ca-4571-4b21-9fa9-d9f24fa4e662 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:51.204496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1214c9ca-4571-4b21-9fa9-d9f24fa4e662 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:51.204967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1214c9ca-4571-4b21-9fa9-d9f24fa4e662 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:51.205410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1214c9ca-4571-4b21-9fa9-d9f24fa4e662 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:51.281450 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1214c9ca-4571-4b21-9fa9-d9f24fa4e662 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090394 Oct 04 22:13:51.282049 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3683/7345] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 22:13:51 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:52.291093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-81f66c2d-a420-43b4-83cb-b4529120fa64 req-4dcaac44-76ad-48a8-bf0a-dd4ff7ed8fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69067cea-983e-4add-a8f5-f92f398ede71", "tag": "d070c196-cf8d-440b-b034-289aab5e9c7f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:52.301716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-81f66c2d-a420-43b4-83cb-b4529120fa64 req-4dcaac44-76ad-48a8-bf0a-dd4ff7ed8fc7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:52.302197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-81f66c2d-a420-43b4-83cb-b4529120fa64 req-4dcaac44-76ad-48a8-bf0a-dd4ff7ed8fc7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:52.302790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-81f66c2d-a420-43b4-83cb-b4529120fa64 req-4dcaac44-76ad-48a8-bf0a-dd4ff7ed8fc7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:52.313870 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-81f66c2d-a420-43b4-83cb-b4529120fa64 req-4dcaac44-76ad-48a8-bf0a-dd4ff7ed8fc7 service nova] Creating event network-changed:d070c196-cf8d-440b-b034-289aab5e9c7f for instance 69067cea-983e-4add-a8f5-f92f398ede71 on n-h2-860282-1 Oct 04 22:13:52.319225 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-81f66c2d-a420-43b4-83cb-b4529120fa64 req-4dcaac44-76ad-48a8-bf0a-dd4ff7ed8fc7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032492 Oct 04 22:13:52.319892 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3663/7346] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:14:35.649737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:35.650516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=64 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:35.655061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2042c571-3b8e-44d7-975f-7132f19c36cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:35.663950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2042c571-3b8e-44d7-975f-7132f19c36cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:35.663950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2042c571-3b8e-44d7-975f-7132f19c36cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:35.663950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2042c571-3b8e-44d7-975f-7132f19c36cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:35.663950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2042c571-3b8e-44d7-975f-7132f19c36cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:35.664561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2042c571-3b8e-44d7-975f-7132f19c36cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:35.665092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2042c571-3b8e-44d7-975f-7132f19c36cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:35.665565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2042c571-3b8e-44d7-975f-7132f19c36cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:35.808860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2042c571-3b8e-44d7-975f-7132f19c36cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:35.817082 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2042c571-3b8e-44d7-975f-7132f19c36cb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1669 microversion: 2.1 time: 0.169479 Oct 04 22:14:35.817684 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3684/7347] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:35 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1669 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:35.838246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=23 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:35.839082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:35.844312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e00eb748-ce31-4a39-9a9e-9efb587c2c15 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26112273-35de-4ad8-b039-160ce46c2c35"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:14:35.850484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e00eb748-ce31-4a39-9a9e-9efb587c2c15 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:35.854544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e00eb748-ce31-4a39-9a9e-9efb587c2c15 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:35.855026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e00eb748-ce31-4a39-9a9e-9efb587c2c15 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:35.855456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e00eb748-ce31-4a39-9a9e-9efb587c2c15 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:35.856149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e00eb748-ce31-4a39-9a9e-9efb587c2c15 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:35.856602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e00eb748-ce31-4a39-9a9e-9efb587c2c15 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:35.857023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e00eb748-ce31-4a39-9a9e-9efb587c2c15 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:36.536945 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e00eb748-ce31-4a39-9a9e-9efb587c2c15 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "POST /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.700730 Oct 04 22:14:36.537592 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3664/7348] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 22:14:35 2022] POST /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71/os-volume_attachments => generated 194 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:14:48.480691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e202ae89-367b-49b7-820a-cd80e51a8c81 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:14:48.483132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e202ae89-367b-49b7-820a-cd80e51a8c81 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:48.485594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:48.486267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:48.491136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e202ae89-367b-49b7-820a-cd80e51a8c81 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:48.496122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e202ae89-367b-49b7-820a-cd80e51a8c81 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:48.496122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e202ae89-367b-49b7-820a-cd80e51a8c81 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:48.496937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e202ae89-367b-49b7-820a-cd80e51a8c81 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:48.497459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e202ae89-367b-49b7-820a-cd80e51a8c81 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:48.497922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e202ae89-367b-49b7-820a-cd80e51a8c81 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:48.531164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e202ae89-367b-49b7-820a-cd80e51a8c81 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:48.536968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e202ae89-367b-49b7-820a-cd80e51a8c81 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Old instance type m1.heat2, new instance type m1.heat {{(pid=122757) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:14:48.544906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e202ae89-367b-49b7-820a-cd80e51a8c81 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:14:48.545344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e202ae89-367b-49b7-820a-cd80e51a8c81 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:14:48.545861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e202ae89-367b-49b7-820a-cd80e51a8c81 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:14:48.546287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e202ae89-367b-49b7-820a-cd80e51a8c81 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:14:48.546716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-e202ae89-367b-49b7-820a-cd80e51a8c81 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:14:48.736541 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e202ae89-367b-49b7-820a-cd80e51a8c81 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "POST /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71/action" status: 202 len: 0 microversion: 2.1 time: 0.259888 Oct 04 22:14:48.737160 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3685/7349] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:14:48 2022] POST /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:14:48.744152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:48.745186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:48.749387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-38ad3d76-d8dc-4be9-b0be-8ba626a4ad72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:48.752418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-38ad3d76-d8dc-4be9-b0be-8ba626a4ad72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:48.756087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38ad3d76-d8dc-4be9-b0be-8ba626a4ad72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:48.756571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38ad3d76-d8dc-4be9-b0be-8ba626a4ad72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:48.757057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38ad3d76-d8dc-4be9-b0be-8ba626a4ad72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:48.757890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38ad3d76-d8dc-4be9-b0be-8ba626a4ad72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:48.758345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38ad3d76-d8dc-4be9-b0be-8ba626a4ad72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:48.758862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38ad3d76-d8dc-4be9-b0be-8ba626a4ad72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:48.894616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-38ad3d76-d8dc-4be9-b0be-8ba626a4ad72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:48.903617 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-38ad3d76-d8dc-4be9-b0be-8ba626a4ad72 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1724 microversion: 2.1 time: 0.162000 Oct 04 22:14:48.904874 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3665/7350] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:48 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:49.929191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-67fd3c31-8dae-4a5f-90ce-8c4e29fdc579 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:49.929905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-67fd3c31-8dae-4a5f-90ce-8c4e29fdc579 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:49.936897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67fd3c31-8dae-4a5f-90ce-8c4e29fdc579 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:49.937401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67fd3c31-8dae-4a5f-90ce-8c4e29fdc579 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:49.937880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67fd3c31-8dae-4a5f-90ce-8c4e29fdc579 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:49.938602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67fd3c31-8dae-4a5f-90ce-8c4e29fdc579 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:49.939084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67fd3c31-8dae-4a5f-90ce-8c4e29fdc579 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:49.939533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67fd3c31-8dae-4a5f-90ce-8c4e29fdc579 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:50.075756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-67fd3c31-8dae-4a5f-90ce-8c4e29fdc579 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:50.084184 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-67fd3c31-8dae-4a5f-90ce-8c4e29fdc579 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1724 microversion: 2.1 time: 0.159877 Oct 04 22:14:50.084761 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3686/7351] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:49 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:51.108222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d740d376-68c6-41fc-a027-d222ba2d7ada tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:51.108870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d740d376-68c6-41fc-a027-d222ba2d7ada tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:51.116568 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d740d376-68c6-41fc-a027-d222ba2d7ada tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:51.117058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d740d376-68c6-41fc-a027-d222ba2d7ada tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:51.117521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d740d376-68c6-41fc-a027-d222ba2d7ada tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:51.118214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d740d376-68c6-41fc-a027-d222ba2d7ada tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:51.118669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d740d376-68c6-41fc-a027-d222ba2d7ada tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:51.119094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d740d376-68c6-41fc-a027-d222ba2d7ada tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:51.327884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d740d376-68c6-41fc-a027-d222ba2d7ada tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:51.336679 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d740d376-68c6-41fc-a027-d222ba2d7ada tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1724 microversion: 2.1 time: 0.232257 Oct 04 22:14:51.337195 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3666/7352] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:51 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:52.361327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d3b06d56-06b2-469e-bee1-64b89c2f8c1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:52.362000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d3b06d56-06b2-469e-bee1-64b89c2f8c1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:52.369629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3b06d56-06b2-469e-bee1-64b89c2f8c1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:52.370143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3b06d56-06b2-469e-bee1-64b89c2f8c1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:52.370605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3b06d56-06b2-469e-bee1-64b89c2f8c1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:52.371325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3b06d56-06b2-469e-bee1-64b89c2f8c1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:52.371806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3b06d56-06b2-469e-bee1-64b89c2f8c1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:52.372260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d3b06d56-06b2-469e-bee1-64b89c2f8c1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:52.504223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d3b06d56-06b2-469e-bee1-64b89c2f8c1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:52.512913 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d3b06d56-06b2-469e-bee1-64b89c2f8c1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.155516 Oct 04 22:14:52.513452 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3687/7353] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:52 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:53.536274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7dd3c6a3-d90e-4dc7-9bf0-e3843dc66a5c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:53.536894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7dd3c6a3-d90e-4dc7-9bf0-e3843dc66a5c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:53.543821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7dd3c6a3-d90e-4dc7-9bf0-e3843dc66a5c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:53.544314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7dd3c6a3-d90e-4dc7-9bf0-e3843dc66a5c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:53.544754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7dd3c6a3-d90e-4dc7-9bf0-e3843dc66a5c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:53.545470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7dd3c6a3-d90e-4dc7-9bf0-e3843dc66a5c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:53.545958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7dd3c6a3-d90e-4dc7-9bf0-e3843dc66a5c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:53.546388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7dd3c6a3-d90e-4dc7-9bf0-e3843dc66a5c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:53.677925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7dd3c6a3-d90e-4dc7-9bf0-e3843dc66a5c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:53.686756 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7dd3c6a3-d90e-4dc7-9bf0-e3843dc66a5c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.154401 Oct 04 22:14:53.687336 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3667/7354] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:53 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:54.709724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e22cdb7d-3ec0-4450-b7f8-3b9d7a17e2c3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:54.710354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e22cdb7d-3ec0-4450-b7f8-3b9d7a17e2c3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:54.717892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e22cdb7d-3ec0-4450-b7f8-3b9d7a17e2c3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:54.718390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e22cdb7d-3ec0-4450-b7f8-3b9d7a17e2c3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:54.718844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e22cdb7d-3ec0-4450-b7f8-3b9d7a17e2c3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:54.719545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e22cdb7d-3ec0-4450-b7f8-3b9d7a17e2c3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:54.720015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e22cdb7d-3ec0-4450-b7f8-3b9d7a17e2c3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:54.720456 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e22cdb7d-3ec0-4450-b7f8-3b9d7a17e2c3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:54.853380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e22cdb7d-3ec0-4450-b7f8-3b9d7a17e2c3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:54.861735 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e22cdb7d-3ec0-4450-b7f8-3b9d7a17e2c3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.155874 Oct 04 22:14:54.864554 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3688/7355] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:54 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:55.885800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dfaa508a-078e-4e0b-9cf9-f0ae8aeda0a7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:55.886417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dfaa508a-078e-4e0b-9cf9-f0ae8aeda0a7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:55.893402 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfaa508a-078e-4e0b-9cf9-f0ae8aeda0a7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:55.893920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfaa508a-078e-4e0b-9cf9-f0ae8aeda0a7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:55.894352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfaa508a-078e-4e0b-9cf9-f0ae8aeda0a7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:55.895032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfaa508a-078e-4e0b-9cf9-f0ae8aeda0a7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:55.895483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfaa508a-078e-4e0b-9cf9-f0ae8aeda0a7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:55.895904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfaa508a-078e-4e0b-9cf9-f0ae8aeda0a7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:56.029747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dfaa508a-078e-4e0b-9cf9-f0ae8aeda0a7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:56.037898 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dfaa508a-078e-4e0b-9cf9-f0ae8aeda0a7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.156512 Oct 04 22:14:56.038469 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3668/7356] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:55 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:57.060665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4494d9e4-fffb-48b7-9b07-c9ce2ef114e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:57.061326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4494d9e4-fffb-48b7-9b07-c9ce2ef114e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:57.068135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4494d9e4-fffb-48b7-9b07-c9ce2ef114e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:57.072983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4494d9e4-fffb-48b7-9b07-c9ce2ef114e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:57.072983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4494d9e4-fffb-48b7-9b07-c9ce2ef114e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:57.072983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4494d9e4-fffb-48b7-9b07-c9ce2ef114e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:57.072983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4494d9e4-fffb-48b7-9b07-c9ce2ef114e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:57.072983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4494d9e4-fffb-48b7-9b07-c9ce2ef114e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:57.200191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4494d9e4-fffb-48b7-9b07-c9ce2ef114e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:57.208568 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4494d9e4-fffb-48b7-9b07-c9ce2ef114e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.151811 Oct 04 22:14:57.210993 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3689/7357] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:57 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:58.232470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6a600920-faf0-4e92-8f4e-476c1088078c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:58.233081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6a600920-faf0-4e92-8f4e-476c1088078c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:58.239926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a600920-faf0-4e92-8f4e-476c1088078c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:58.240405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a600920-faf0-4e92-8f4e-476c1088078c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:58.240845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a600920-faf0-4e92-8f4e-476c1088078c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:58.241555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a600920-faf0-4e92-8f4e-476c1088078c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:58.242012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a600920-faf0-4e92-8f4e-476c1088078c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:58.242436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a600920-faf0-4e92-8f4e-476c1088078c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:58.371539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6a600920-faf0-4e92-8f4e-476c1088078c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:58.379753 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6a600920-faf0-4e92-8f4e-476c1088078c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.151208 Oct 04 22:14:58.380323 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3669/7358] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:58 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:59.403772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a3fba77a-1a33-4803-a384-c7177fe15b8d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:59.404437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a3fba77a-1a33-4803-a384-c7177fe15b8d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:59.411452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3fba77a-1a33-4803-a384-c7177fe15b8d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:59.411996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3fba77a-1a33-4803-a384-c7177fe15b8d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:59.412443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3fba77a-1a33-4803-a384-c7177fe15b8d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:59.413185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3fba77a-1a33-4803-a384-c7177fe15b8d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:59.413689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3fba77a-1a33-4803-a384-c7177fe15b8d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:59.414138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a3fba77a-1a33-4803-a384-c7177fe15b8d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:59.548342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a3fba77a-1a33-4803-a384-c7177fe15b8d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:59.556631 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a3fba77a-1a33-4803-a384-c7177fe15b8d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.156854 Oct 04 22:14:59.558025 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3690/7359] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:59 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:00.579926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-faea9ffc-6033-452f-ac1d-8f61502921f4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:00.580548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-faea9ffc-6033-452f-ac1d-8f61502921f4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:00.587565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-faea9ffc-6033-452f-ac1d-8f61502921f4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:00.589530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-faea9ffc-6033-452f-ac1d-8f61502921f4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:00.589530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-faea9ffc-6033-452f-ac1d-8f61502921f4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:00.590098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-faea9ffc-6033-452f-ac1d-8f61502921f4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:00.590559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-faea9ffc-6033-452f-ac1d-8f61502921f4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:00.590995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-faea9ffc-6033-452f-ac1d-8f61502921f4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:00.722076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-faea9ffc-6033-452f-ac1d-8f61502921f4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:00.730171 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-faea9ffc-6033-452f-ac1d-8f61502921f4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.154157 Oct 04 22:15:00.730751 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3670/7360] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:00 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:01.753513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0db93108-a928-4f5c-a68d-073969d0a607 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:01.754173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0db93108-a928-4f5c-a68d-073969d0a607 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:01.761198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0db93108-a928-4f5c-a68d-073969d0a607 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:01.761743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0db93108-a928-4f5c-a68d-073969d0a607 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:01.762468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0db93108-a928-4f5c-a68d-073969d0a607 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:01.763178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0db93108-a928-4f5c-a68d-073969d0a607 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:01.763654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0db93108-a928-4f5c-a68d-073969d0a607 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:01.764107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0db93108-a928-4f5c-a68d-073969d0a607 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:01.896429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0db93108-a928-4f5c-a68d-073969d0a607 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:01.905734 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0db93108-a928-4f5c-a68d-073969d0a607 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.156172 Oct 04 22:15:01.906319 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3691/7361] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:01 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:02.928230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-eda5fb4b-3382-4a7a-9a4f-ae0246388eac tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:02.928878 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-eda5fb4b-3382-4a7a-9a4f-ae0246388eac tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:02.936213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eda5fb4b-3382-4a7a-9a4f-ae0246388eac tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:02.936698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eda5fb4b-3382-4a7a-9a4f-ae0246388eac tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:02.937136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eda5fb4b-3382-4a7a-9a4f-ae0246388eac tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:02.937847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eda5fb4b-3382-4a7a-9a4f-ae0246388eac tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:02.938305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eda5fb4b-3382-4a7a-9a4f-ae0246388eac tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:02.938732 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eda5fb4b-3382-4a7a-9a4f-ae0246388eac tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:03.071470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-eda5fb4b-3382-4a7a-9a4f-ae0246388eac tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:03.076849 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-eda5fb4b-3382-4a7a-9a4f-ae0246388eac tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.152574 Oct 04 22:15:03.077566 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3671/7362] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:02 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:04.100501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d52d4057-23e6-4c4a-8c7a-ca879a474604 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:04.101138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d52d4057-23e6-4c4a-8c7a-ca879a474604 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:04.108735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d52d4057-23e6-4c4a-8c7a-ca879a474604 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:04.109234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d52d4057-23e6-4c4a-8c7a-ca879a474604 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:04.109725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d52d4057-23e6-4c4a-8c7a-ca879a474604 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:04.110430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d52d4057-23e6-4c4a-8c7a-ca879a474604 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:04.110902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d52d4057-23e6-4c4a-8c7a-ca879a474604 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:04.111346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d52d4057-23e6-4c4a-8c7a-ca879a474604 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:04.242118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d52d4057-23e6-4c4a-8c7a-ca879a474604 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:04.250986 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d52d4057-23e6-4c4a-8c7a-ca879a474604 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.154780 Oct 04 22:15:04.251558 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3692/7363] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:04 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:05.273947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4fba9ddb-cb90-47eb-9776-9a13e5139cf2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:05.274533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4fba9ddb-cb90-47eb-9776-9a13e5139cf2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:05.281555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fba9ddb-cb90-47eb-9776-9a13e5139cf2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:05.282045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fba9ddb-cb90-47eb-9776-9a13e5139cf2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:05.282484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fba9ddb-cb90-47eb-9776-9a13e5139cf2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:05.283206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fba9ddb-cb90-47eb-9776-9a13e5139cf2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:05.283666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fba9ddb-cb90-47eb-9776-9a13e5139cf2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:05.284094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4fba9ddb-cb90-47eb-9776-9a13e5139cf2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:05.413205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4fba9ddb-cb90-47eb-9776-9a13e5139cf2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:05.421897 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4fba9ddb-cb90-47eb-9776-9a13e5139cf2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.152209 Oct 04 22:15:05.422477 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3672/7364] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:05 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:06.445462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3891012a-64b4-40d3-97e2-e33de40db8ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:06.446104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3891012a-64b4-40d3-97e2-e33de40db8ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:06.453578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3891012a-64b4-40d3-97e2-e33de40db8ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:06.454095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3891012a-64b4-40d3-97e2-e33de40db8ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:06.454558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3891012a-64b4-40d3-97e2-e33de40db8ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:06.455284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3891012a-64b4-40d3-97e2-e33de40db8ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:06.455765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3891012a-64b4-40d3-97e2-e33de40db8ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:06.456220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3891012a-64b4-40d3-97e2-e33de40db8ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:06.606234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3891012a-64b4-40d3-97e2-e33de40db8ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:06.614664 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3891012a-64b4-40d3-97e2-e33de40db8ab tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.173135 Oct 04 22:15:06.615249 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3693/7365] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:06 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:07.638521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6dcfb29d-5532-4077-9b69-827c514824a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:07.639158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6dcfb29d-5532-4077-9b69-827c514824a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:07.645918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6dcfb29d-5532-4077-9b69-827c514824a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:07.646431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6dcfb29d-5532-4077-9b69-827c514824a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:07.646901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6dcfb29d-5532-4077-9b69-827c514824a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:07.647582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6dcfb29d-5532-4077-9b69-827c514824a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:07.648037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6dcfb29d-5532-4077-9b69-827c514824a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:07.648461 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6dcfb29d-5532-4077-9b69-827c514824a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:07.785115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6dcfb29d-5532-4077-9b69-827c514824a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:07.795988 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6dcfb29d-5532-4077-9b69-827c514824a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.159229 Oct 04 22:15:07.795988 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3673/7366] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:07 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:08.817011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3a12c467-6477-44c7-b818-5f73b70ca9bd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:08.817580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3a12c467-6477-44c7-b818-5f73b70ca9bd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:08.824397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a12c467-6477-44c7-b818-5f73b70ca9bd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:08.824902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a12c467-6477-44c7-b818-5f73b70ca9bd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:08.825358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a12c467-6477-44c7-b818-5f73b70ca9bd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:08.826286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a12c467-6477-44c7-b818-5f73b70ca9bd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:08.826761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a12c467-6477-44c7-b818-5f73b70ca9bd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:08.827208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a12c467-6477-44c7-b818-5f73b70ca9bd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:08.958590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3a12c467-6477-44c7-b818-5f73b70ca9bd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:08.967672 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3a12c467-6477-44c7-b818-5f73b70ca9bd tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.154783 Oct 04 22:15:08.968251 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3694/7367] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:08 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:09.991829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-32cfb2f9-6737-4866-b7d8-891855cf484a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:09.992483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-32cfb2f9-6737-4866-b7d8-891855cf484a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:09.999282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-32cfb2f9-6737-4866-b7d8-891855cf484a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:09.999980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-32cfb2f9-6737-4866-b7d8-891855cf484a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:10.000454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-32cfb2f9-6737-4866-b7d8-891855cf484a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:10.001143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-32cfb2f9-6737-4866-b7d8-891855cf484a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:10.001627 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-32cfb2f9-6737-4866-b7d8-891855cf484a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:10.002055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-32cfb2f9-6737-4866-b7d8-891855cf484a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:10.135434 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-32cfb2f9-6737-4866-b7d8-891855cf484a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:10.144777 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-32cfb2f9-6737-4866-b7d8-891855cf484a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.157051 Oct 04 22:15:10.145354 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3674/7368] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:09 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:11.168723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3230cf74-6480-4963-b2e0-1425ce44bbe0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:11.169356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3230cf74-6480-4963-b2e0-1425ce44bbe0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:11.176497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3230cf74-6480-4963-b2e0-1425ce44bbe0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:11.177009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3230cf74-6480-4963-b2e0-1425ce44bbe0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:11.177488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3230cf74-6480-4963-b2e0-1425ce44bbe0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:11.178200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3230cf74-6480-4963-b2e0-1425ce44bbe0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:11.178675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3230cf74-6480-4963-b2e0-1425ce44bbe0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:11.179120 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3230cf74-6480-4963-b2e0-1425ce44bbe0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:11.308890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3230cf74-6480-4963-b2e0-1425ce44bbe0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:11.317671 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3230cf74-6480-4963-b2e0-1425ce44bbe0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.152945 Oct 04 22:15:11.318283 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3695/7369] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:11 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:12.341013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1518ebc4-8b25-481b-9833-463323becb0d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:12.341652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1518ebc4-8b25-481b-9833-463323becb0d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:12.349790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1518ebc4-8b25-481b-9833-463323becb0d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:12.350279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1518ebc4-8b25-481b-9833-463323becb0d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:12.350717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1518ebc4-8b25-481b-9833-463323becb0d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:12.351408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1518ebc4-8b25-481b-9833-463323becb0d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:12.351861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1518ebc4-8b25-481b-9833-463323becb0d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:12.352288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1518ebc4-8b25-481b-9833-463323becb0d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:12.479919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1518ebc4-8b25-481b-9833-463323becb0d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:12.490335 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1518ebc4-8b25-481b-9833-463323becb0d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.152981 Oct 04 22:15:12.490934 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3675/7370] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:12 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:13.515003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4d4be85f-56b1-4243-a715-7d8fc6573fdc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:13.515631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4d4be85f-56b1-4243-a715-7d8fc6573fdc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:13.523167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d4be85f-56b1-4243-a715-7d8fc6573fdc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:13.523668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d4be85f-56b1-4243-a715-7d8fc6573fdc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:13.524125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d4be85f-56b1-4243-a715-7d8fc6573fdc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:13.524843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d4be85f-56b1-4243-a715-7d8fc6573fdc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:13.525303 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d4be85f-56b1-4243-a715-7d8fc6573fdc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:13.525803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d4be85f-56b1-4243-a715-7d8fc6573fdc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:13.660196 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4d4be85f-56b1-4243-a715-7d8fc6573fdc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:13.668634 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4d4be85f-56b1-4243-a715-7d8fc6573fdc tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.157791 Oct 04 22:15:13.669199 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3696/7371] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:13 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:14.692254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b665a824-03a0-4336-a512-bffc30e77812 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:14.692862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b665a824-03a0-4336-a512-bffc30e77812 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:14.699679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b665a824-03a0-4336-a512-bffc30e77812 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:14.700159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b665a824-03a0-4336-a512-bffc30e77812 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:14.700594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b665a824-03a0-4336-a512-bffc30e77812 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:14.701273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b665a824-03a0-4336-a512-bffc30e77812 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:14.701757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b665a824-03a0-4336-a512-bffc30e77812 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:14.702180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b665a824-03a0-4336-a512-bffc30e77812 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:14.836433 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b665a824-03a0-4336-a512-bffc30e77812 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:14.845401 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b665a824-03a0-4336-a512-bffc30e77812 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.157691 Oct 04 22:15:14.846091 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3676/7372] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:14 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:15.870042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6bf71b8a-95a0-41c1-ae4b-5475e6225286 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:15.870705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6bf71b8a-95a0-41c1-ae4b-5475e6225286 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:15.877004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6bf71b8a-95a0-41c1-ae4b-5475e6225286 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:15.877537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6bf71b8a-95a0-41c1-ae4b-5475e6225286 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:15.877998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6bf71b8a-95a0-41c1-ae4b-5475e6225286 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:15.878787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6bf71b8a-95a0-41c1-ae4b-5475e6225286 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:15.879184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6bf71b8a-95a0-41c1-ae4b-5475e6225286 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:15.879637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6bf71b8a-95a0-41c1-ae4b-5475e6225286 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:16.348464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6bf71b8a-95a0-41c1-ae4b-5475e6225286 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:16.356903 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6bf71b8a-95a0-41c1-ae4b-5475e6225286 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.491059 Oct 04 22:15:16.357501 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3697/7373] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:15 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:17.380736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-890d9a1d-a65c-444d-af17-b65247039d7b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:17.381474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-890d9a1d-a65c-444d-af17-b65247039d7b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:17.387834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-890d9a1d-a65c-444d-af17-b65247039d7b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:17.388315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-890d9a1d-a65c-444d-af17-b65247039d7b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:17.388749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-890d9a1d-a65c-444d-af17-b65247039d7b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:17.389443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-890d9a1d-a65c-444d-af17-b65247039d7b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:17.389913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-890d9a1d-a65c-444d-af17-b65247039d7b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:17.390339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-890d9a1d-a65c-444d-af17-b65247039d7b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:17.519171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-890d9a1d-a65c-444d-af17-b65247039d7b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:17.527377 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-890d9a1d-a65c-444d-af17-b65247039d7b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.150616 Oct 04 22:15:17.527953 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3677/7374] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:17 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:18.550599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e28422dc-9e31-4588-9bfa-ffce78b38ac5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:18.551229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e28422dc-9e31-4588-9bfa-ffce78b38ac5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:18.553982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=31 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:18.558663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e28422dc-9e31-4588-9bfa-ffce78b38ac5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:18.559169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e28422dc-9e31-4588-9bfa-ffce78b38ac5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:18.559620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e28422dc-9e31-4588-9bfa-ffce78b38ac5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:18.560323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e28422dc-9e31-4588-9bfa-ffce78b38ac5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:18.560794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e28422dc-9e31-4588-9bfa-ffce78b38ac5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:18.561232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e28422dc-9e31-4588-9bfa-ffce78b38ac5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:18.564419 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:18.694517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e28422dc-9e31-4588-9bfa-ffce78b38ac5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:18.702766 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e28422dc-9e31-4588-9bfa-ffce78b38ac5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.156035 Oct 04 22:15:18.703933 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3698/7375] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:18 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:19.726599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5bae32b5-7846-4c74-8d43-21d6d72638e4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:19.727126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5bae32b5-7846-4c74-8d43-21d6d72638e4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:19.729859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=27 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:19.734665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bae32b5-7846-4c74-8d43-21d6d72638e4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:19.735120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bae32b5-7846-4c74-8d43-21d6d72638e4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:19.735749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bae32b5-7846-4c74-8d43-21d6d72638e4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:19.736450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bae32b5-7846-4c74-8d43-21d6d72638e4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:19.736909 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bae32b5-7846-4c74-8d43-21d6d72638e4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:19.737341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bae32b5-7846-4c74-8d43-21d6d72638e4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:19.873616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5bae32b5-7846-4c74-8d43-21d6d72638e4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:19.882016 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5bae32b5-7846-4c74-8d43-21d6d72638e4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.159453 Oct 04 22:15:19.882770 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3678/7376] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:19 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:20.907106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3b7bcce4-f6a3-4996-a0d5-32f6f3bd45a6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:20.907742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3b7bcce4-f6a3-4996-a0d5-32f6f3bd45a6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:20.914981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b7bcce4-f6a3-4996-a0d5-32f6f3bd45a6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:20.915487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b7bcce4-f6a3-4996-a0d5-32f6f3bd45a6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:20.915946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b7bcce4-f6a3-4996-a0d5-32f6f3bd45a6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:20.916677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b7bcce4-f6a3-4996-a0d5-32f6f3bd45a6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:20.917133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b7bcce4-f6a3-4996-a0d5-32f6f3bd45a6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:20.917623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b7bcce4-f6a3-4996-a0d5-32f6f3bd45a6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:21.058909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3b7bcce4-f6a3-4996-a0d5-32f6f3bd45a6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:21.067483 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3b7bcce4-f6a3-4996-a0d5-32f6f3bd45a6 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1729 microversion: 2.1 time: 0.164835 Oct 04 22:15:21.068071 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3699/7377] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:20 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:22.005656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-62418b68-df66-435e-aada-293ef9e8aa3e req-44d5839e-b5e2-4a69-ba32-7caf7e51d426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69067cea-983e-4add-a8f5-f92f398ede71", "name": "network-vif-unplugged", "status": "completed", "tag": "d070c196-cf8d-440b-b034-289aab5e9c7f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:22.016487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-62418b68-df66-435e-aada-293ef9e8aa3e req-44d5839e-b5e2-4a69-ba32-7caf7e51d426 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:22.016970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-62418b68-df66-435e-aada-293ef9e8aa3e req-44d5839e-b5e2-4a69-ba32-7caf7e51d426 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:22.017407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-62418b68-df66-435e-aada-293ef9e8aa3e req-44d5839e-b5e2-4a69-ba32-7caf7e51d426 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:22.021184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=85 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:22.031273 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-62418b68-df66-435e-aada-293ef9e8aa3e req-44d5839e-b5e2-4a69-ba32-7caf7e51d426 service nova] Creating event network-vif-unplugged:d070c196-cf8d-440b-b034-289aab5e9c7f for instance 69067cea-983e-4add-a8f5-f92f398ede71 on n-h1-860282-1 Oct 04 22:15:22.037664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-62418b68-df66-435e-aada-293ef9e8aa3e req-44d5839e-b5e2-4a69-ba32-7caf7e51d426 service nova] Instance 69067cea-983e-4add-a8f5-f92f398ede71 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:15:22.049990 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-62418b68-df66-435e-aada-293ef9e8aa3e req-44d5839e-b5e2-4a69-ba32-7caf7e51d426 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047863 Oct 04 22:15:22.050528 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3679/7378] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:15:22.090793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9c115e99-bf5c-40b8-8274-4d5415de363a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:22.091539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9c115e99-bf5c-40b8-8274-4d5415de363a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:22.098842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c115e99-bf5c-40b8-8274-4d5415de363a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:22.099431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c115e99-bf5c-40b8-8274-4d5415de363a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:22.099956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c115e99-bf5c-40b8-8274-4d5415de363a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:22.100772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c115e99-bf5c-40b8-8274-4d5415de363a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:22.101311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c115e99-bf5c-40b8-8274-4d5415de363a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:22.101779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c115e99-bf5c-40b8-8274-4d5415de363a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:22.236604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9c115e99-bf5c-40b8-8274-4d5415de363a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:22.244922 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9c115e99-bf5c-40b8-8274-4d5415de363a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1728 microversion: 2.1 time: 0.158149 Oct 04 22:15:22.245568 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3700/7379] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:22 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:23.272939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-57777b9d-287e-455b-a541-adab1bd0bd6c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:23.273583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-57777b9d-287e-455b-a541-adab1bd0bd6c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:23.280061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57777b9d-287e-455b-a541-adab1bd0bd6c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:23.280552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57777b9d-287e-455b-a541-adab1bd0bd6c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:23.280991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57777b9d-287e-455b-a541-adab1bd0bd6c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:23.281759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57777b9d-287e-455b-a541-adab1bd0bd6c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:23.282217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57777b9d-287e-455b-a541-adab1bd0bd6c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:23.283035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57777b9d-287e-455b-a541-adab1bd0bd6c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:23.415457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-57777b9d-287e-455b-a541-adab1bd0bd6c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:23.424186 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-57777b9d-287e-455b-a541-adab1bd0bd6c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1728 microversion: 2.1 time: 0.156500 Oct 04 22:15:23.424836 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3680/7380] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:23 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:24.064491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-85e552fc-80ec-45f6-adcf-f91e7fa918e8 req-10be21f2-7893-4ba8-ae28-05c663d0a64c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69067cea-983e-4add-a8f5-f92f398ede71", "tag": "d070c196-cf8d-440b-b034-289aab5e9c7f"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:24.075361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-85e552fc-80ec-45f6-adcf-f91e7fa918e8 req-10be21f2-7893-4ba8-ae28-05c663d0a64c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:24.075864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-85e552fc-80ec-45f6-adcf-f91e7fa918e8 req-10be21f2-7893-4ba8-ae28-05c663d0a64c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:24.076320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-85e552fc-80ec-45f6-adcf-f91e7fa918e8 req-10be21f2-7893-4ba8-ae28-05c663d0a64c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:24.088707 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-85e552fc-80ec-45f6-adcf-f91e7fa918e8 req-10be21f2-7893-4ba8-ae28-05c663d0a64c service nova] Creating event network-changed:d070c196-cf8d-440b-b034-289aab5e9c7f for instance 69067cea-983e-4add-a8f5-f92f398ede71 on n-h1-860282-1 Oct 04 22:15:24.094867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [req-85e552fc-80ec-45f6-adcf-f91e7fa918e8 req-10be21f2-7893-4ba8-ae28-05c663d0a64c service nova] Instance 69067cea-983e-4add-a8f5-f92f398ede71 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122757) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:15:24.107181 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-85e552fc-80ec-45f6-adcf-f91e7fa918e8 req-10be21f2-7893-4ba8-ae28-05c663d0a64c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046078 Oct 04 22:15:24.107848 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3701/7381] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:15:24.450338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6bf38062-ce4a-43c3-a630-65cb28b18f82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:24.452275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6bf38062-ce4a-43c3-a630-65cb28b18f82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:24.460683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6bf38062-ce4a-43c3-a630-65cb28b18f82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:24.461174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6bf38062-ce4a-43c3-a630-65cb28b18f82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:24.461638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6bf38062-ce4a-43c3-a630-65cb28b18f82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:24.462335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6bf38062-ce4a-43c3-a630-65cb28b18f82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:24.462787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6bf38062-ce4a-43c3-a630-65cb28b18f82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:24.463209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6bf38062-ce4a-43c3-a630-65cb28b18f82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:24.698795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6bf38062-ce4a-43c3-a630-65cb28b18f82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:24.709129 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6bf38062-ce4a-43c3-a630-65cb28b18f82 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1726 microversion: 2.1 time: 0.264139 Oct 04 22:15:24.710094 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3681/7382] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:24 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1726 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:25.732836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-80d16fda-580a-4d11-ad69-3c6b2dacfefb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:25.733662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-80d16fda-580a-4d11-ad69-3c6b2dacfefb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:25.740775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80d16fda-580a-4d11-ad69-3c6b2dacfefb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:25.741275 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80d16fda-580a-4d11-ad69-3c6b2dacfefb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:25.741753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80d16fda-580a-4d11-ad69-3c6b2dacfefb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:25.742463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80d16fda-580a-4d11-ad69-3c6b2dacfefb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:25.742934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80d16fda-580a-4d11-ad69-3c6b2dacfefb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:25.743377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80d16fda-580a-4d11-ad69-3c6b2dacfefb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:25.881289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-80d16fda-580a-4d11-ad69-3c6b2dacfefb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:25.890467 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-80d16fda-580a-4d11-ad69-3c6b2dacfefb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1726 microversion: 2.1 time: 0.161936 Oct 04 22:15:25.891670 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3702/7383] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:25 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:26.914947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bcd2b728-33ee-458b-8b14-0c2855c1e238 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:26.915569 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bcd2b728-33ee-458b-8b14-0c2855c1e238 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:26.922622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bcd2b728-33ee-458b-8b14-0c2855c1e238 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:26.923127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bcd2b728-33ee-458b-8b14-0c2855c1e238 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:26.923570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bcd2b728-33ee-458b-8b14-0c2855c1e238 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:26.924277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bcd2b728-33ee-458b-8b14-0c2855c1e238 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:26.924742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bcd2b728-33ee-458b-8b14-0c2855c1e238 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:26.925176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bcd2b728-33ee-458b-8b14-0c2855c1e238 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:27.057816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bcd2b728-33ee-458b-8b14-0c2855c1e238 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:27.067266 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bcd2b728-33ee-458b-8b14-0c2855c1e238 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1726 microversion: 2.1 time: 0.156297 Oct 04 22:15:27.072660 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3682/7384] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:26 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:28.091583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c13b0d90-1eab-4e76-80fe-cfc64d4cea64 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:28.092222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c13b0d90-1eab-4e76-80fe-cfc64d4cea64 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:28.099924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c13b0d90-1eab-4e76-80fe-cfc64d4cea64 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:28.100566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c13b0d90-1eab-4e76-80fe-cfc64d4cea64 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:28.101037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c13b0d90-1eab-4e76-80fe-cfc64d4cea64 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:28.101794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c13b0d90-1eab-4e76-80fe-cfc64d4cea64 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:28.102261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c13b0d90-1eab-4e76-80fe-cfc64d4cea64 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:28.102738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c13b0d90-1eab-4e76-80fe-cfc64d4cea64 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:28.241226 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c13b0d90-1eab-4e76-80fe-cfc64d4cea64 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:28.249761 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c13b0d90-1eab-4e76-80fe-cfc64d4cea64 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1726 microversion: 2.1 time: 0.162158 Oct 04 22:15:28.250371 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3703/7385] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:28 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:29.273319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e4a364df-f4c0-4542-9d98-6633cce3763f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:29.274213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e4a364df-f4c0-4542-9d98-6633cce3763f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:29.281018 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4a364df-f4c0-4542-9d98-6633cce3763f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:29.282374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4a364df-f4c0-4542-9d98-6633cce3763f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:29.282638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4a364df-f4c0-4542-9d98-6633cce3763f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:29.283344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4a364df-f4c0-4542-9d98-6633cce3763f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:29.283801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4a364df-f4c0-4542-9d98-6633cce3763f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:29.284232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e4a364df-f4c0-4542-9d98-6633cce3763f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:29.418723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e4a364df-f4c0-4542-9d98-6633cce3763f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:29.427987 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e4a364df-f4c0-4542-9d98-6633cce3763f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1726 microversion: 2.1 time: 0.158585 Oct 04 22:15:29.428615 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3683/7386] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:29 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:30.451994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-71d9e26d-26ca-43e1-8cc2-49e5bd28aa60 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:30.452629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-71d9e26d-26ca-43e1-8cc2-49e5bd28aa60 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:30.460164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71d9e26d-26ca-43e1-8cc2-49e5bd28aa60 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:30.460672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71d9e26d-26ca-43e1-8cc2-49e5bd28aa60 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:30.461127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71d9e26d-26ca-43e1-8cc2-49e5bd28aa60 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:30.461874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71d9e26d-26ca-43e1-8cc2-49e5bd28aa60 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:30.462350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71d9e26d-26ca-43e1-8cc2-49e5bd28aa60 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:30.462795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71d9e26d-26ca-43e1-8cc2-49e5bd28aa60 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:30.595230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-71d9e26d-26ca-43e1-8cc2-49e5bd28aa60 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:30.603487 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-71d9e26d-26ca-43e1-8cc2-49e5bd28aa60 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1726 microversion: 2.1 time: 0.155419 Oct 04 22:15:30.604078 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3704/7387] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:30 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:31.626807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-75dde3c0-5b15-4178-a2ae-dee4524ef01e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:31.627421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-75dde3c0-5b15-4178-a2ae-dee4524ef01e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:31.634266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75dde3c0-5b15-4178-a2ae-dee4524ef01e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:31.634753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75dde3c0-5b15-4178-a2ae-dee4524ef01e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:31.635192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75dde3c0-5b15-4178-a2ae-dee4524ef01e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:31.635913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75dde3c0-5b15-4178-a2ae-dee4524ef01e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:31.636419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75dde3c0-5b15-4178-a2ae-dee4524ef01e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:31.637110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75dde3c0-5b15-4178-a2ae-dee4524ef01e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:31.770728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-75dde3c0-5b15-4178-a2ae-dee4524ef01e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:31.779074 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-75dde3c0-5b15-4178-a2ae-dee4524ef01e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1726 microversion: 2.1 time: 0.156201 Oct 04 22:15:31.779647 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3684/7388] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:31 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:32.857753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a38dfd03-3957-46d2-910e-d6fb2a602683 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:32.858495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a38dfd03-3957-46d2-910e-d6fb2a602683 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:32.866185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a38dfd03-3957-46d2-910e-d6fb2a602683 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:32.866702 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a38dfd03-3957-46d2-910e-d6fb2a602683 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:32.867157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a38dfd03-3957-46d2-910e-d6fb2a602683 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:32.867870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a38dfd03-3957-46d2-910e-d6fb2a602683 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:32.868340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a38dfd03-3957-46d2-910e-d6fb2a602683 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:32.868781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a38dfd03-3957-46d2-910e-d6fb2a602683 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:32.998783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a38dfd03-3957-46d2-910e-d6fb2a602683 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:33.007718 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a38dfd03-3957-46d2-910e-d6fb2a602683 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1726 microversion: 2.1 time: 0.153930 Oct 04 22:15:33.008307 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3705/7389] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:32 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:34.031308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d299bdc8-c47a-450e-8602-2d380411289c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:34.032165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d299bdc8-c47a-450e-8602-2d380411289c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:34.039040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d299bdc8-c47a-450e-8602-2d380411289c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:34.039535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d299bdc8-c47a-450e-8602-2d380411289c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:34.039983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d299bdc8-c47a-450e-8602-2d380411289c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:34.040679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d299bdc8-c47a-450e-8602-2d380411289c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:34.041153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d299bdc8-c47a-450e-8602-2d380411289c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:34.041620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d299bdc8-c47a-450e-8602-2d380411289c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:34.174492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d299bdc8-c47a-450e-8602-2d380411289c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:34.182706 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d299bdc8-c47a-450e-8602-2d380411289c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1726 microversion: 2.1 time: 0.155336 Oct 04 22:15:34.183282 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3685/7390] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:34 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:35.207077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eebbe994-61b1-4446-bcb8-b9c0c85cf9a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:35.207595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eebbe994-61b1-4446-bcb8-b9c0c85cf9a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:35.215345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eebbe994-61b1-4446-bcb8-b9c0c85cf9a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:35.215849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eebbe994-61b1-4446-bcb8-b9c0c85cf9a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:35.216301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eebbe994-61b1-4446-bcb8-b9c0c85cf9a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:35.217007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eebbe994-61b1-4446-bcb8-b9c0c85cf9a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:35.217501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eebbe994-61b1-4446-bcb8-b9c0c85cf9a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:35.217945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eebbe994-61b1-4446-bcb8-b9c0c85cf9a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:35.352357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eebbe994-61b1-4446-bcb8-b9c0c85cf9a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:35.361476 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eebbe994-61b1-4446-bcb8-b9c0c85cf9a5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1726 microversion: 2.1 time: 0.158634 Oct 04 22:15:35.362157 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3706/7391] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:35 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:36.384102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7c77e47d-478a-47de-91c7-2cc9932276b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:36.387855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7c77e47d-478a-47de-91c7-2cc9932276b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:36.392165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c77e47d-478a-47de-91c7-2cc9932276b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:36.392666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c77e47d-478a-47de-91c7-2cc9932276b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:36.393105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c77e47d-478a-47de-91c7-2cc9932276b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:36.393823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c77e47d-478a-47de-91c7-2cc9932276b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:36.394278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c77e47d-478a-47de-91c7-2cc9932276b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:36.394702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c77e47d-478a-47de-91c7-2cc9932276b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:36.532032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7c77e47d-478a-47de-91c7-2cc9932276b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:36.541065 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7c77e47d-478a-47de-91c7-2cc9932276b1 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1726 microversion: 2.1 time: 0.160433 Oct 04 22:15:36.541332 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3686/7392] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:36 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:37.565964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7d1616d3-2180-41f6-bda8-f18172d9eecb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:37.566600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7d1616d3-2180-41f6-bda8-f18172d9eecb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:37.573392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d1616d3-2180-41f6-bda8-f18172d9eecb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:37.573922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d1616d3-2180-41f6-bda8-f18172d9eecb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:37.574376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d1616d3-2180-41f6-bda8-f18172d9eecb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:37.575113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d1616d3-2180-41f6-bda8-f18172d9eecb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:37.575589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d1616d3-2180-41f6-bda8-f18172d9eecb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:37.576034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7d1616d3-2180-41f6-bda8-f18172d9eecb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:37.707047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7d1616d3-2180-41f6-bda8-f18172d9eecb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:37.715478 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7d1616d3-2180-41f6-bda8-f18172d9eecb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1723 microversion: 2.1 time: 0.154244 Oct 04 22:15:37.716063 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3707/7393] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:37 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:37.740485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0a7c72bb-1a6d-41ec-8529-8ec7d3f8ef1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:37.741053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0a7c72bb-1a6d-41ec-8529-8ec7d3f8ef1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:37.748417 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a7c72bb-1a6d-41ec-8529-8ec7d3f8ef1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:37.748905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a7c72bb-1a6d-41ec-8529-8ec7d3f8ef1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:37.749407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a7c72bb-1a6d-41ec-8529-8ec7d3f8ef1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:37.750657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a7c72bb-1a6d-41ec-8529-8ec7d3f8ef1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:37.751120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a7c72bb-1a6d-41ec-8529-8ec7d3f8ef1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:37.751545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a7c72bb-1a6d-41ec-8529-8ec7d3f8ef1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:37.789491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a7c72bb-1a6d-41ec-8529-8ec7d3f8ef1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:37.790047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a7c72bb-1a6d-41ec-8529-8ec7d3f8ef1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:37.790422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a7c72bb-1a6d-41ec-8529-8ec7d3f8ef1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:37.791150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a7c72bb-1a6d-41ec-8529-8ec7d3f8ef1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:37.791607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a7c72bb-1a6d-41ec-8529-8ec7d3f8ef1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:37.792049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a7c72bb-1a6d-41ec-8529-8ec7d3f8ef1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:37.812383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-0a7c72bb-1a6d-41ec-8529-8ec7d3f8ef1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Getting quotas for project 5aa764882b244357892ebdad69cff689. Resources: {'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:15:37.818378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-0a7c72bb-1a6d-41ec-8529-8ec7d3f8ef1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Getting quotas for user c01d66c6cbba4c30831508fdaf953268 and project 5aa764882b244357892ebdad69cff689. Resources: {'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:15:38.135631 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0a7c72bb-1a6d-41ec-8529-8ec7d3f8ef1d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "POST /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71/action" status: 202 len: 0 microversion: 2.1 time: 0.399068 Oct 04 22:15:38.136247 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3687/7394] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:15:37 2022] POST /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:15:38.145576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cea7139e-83ec-4508-b591-d9ec1fa78b7c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:38.146221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cea7139e-83ec-4508-b591-d9ec1fa78b7c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:38.152412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cea7139e-83ec-4508-b591-d9ec1fa78b7c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:38.152956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cea7139e-83ec-4508-b591-d9ec1fa78b7c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:38.153431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cea7139e-83ec-4508-b591-d9ec1fa78b7c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:38.154313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cea7139e-83ec-4508-b591-d9ec1fa78b7c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:38.154811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cea7139e-83ec-4508-b591-d9ec1fa78b7c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:38.155246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cea7139e-83ec-4508-b591-d9ec1fa78b7c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:38.290516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cea7139e-83ec-4508-b591-d9ec1fa78b7c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:38.299972 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cea7139e-83ec-4508-b591-d9ec1fa78b7c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1722 microversion: 2.1 time: 0.159226 Oct 04 22:15:38.300574 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3708/7395] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:38 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:39.324839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dc80572c-3e42-409e-92c7-05b5f3075e6e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:39.325473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dc80572c-3e42-409e-92c7-05b5f3075e6e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:39.332625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc80572c-3e42-409e-92c7-05b5f3075e6e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:39.338584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc80572c-3e42-409e-92c7-05b5f3075e6e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:39.338584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc80572c-3e42-409e-92c7-05b5f3075e6e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:39.338584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc80572c-3e42-409e-92c7-05b5f3075e6e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:39.338584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc80572c-3e42-409e-92c7-05b5f3075e6e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:39.338584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dc80572c-3e42-409e-92c7-05b5f3075e6e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:39.466089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dc80572c-3e42-409e-92c7-05b5f3075e6e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:39.474383 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dc80572c-3e42-409e-92c7-05b5f3075e6e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1722 microversion: 2.1 time: 0.154799 Oct 04 22:15:39.474960 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3688/7396] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:39 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:40.497759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f9dd6276-1994-4236-91a9-15cc70deaa1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:40.498390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f9dd6276-1994-4236-91a9-15cc70deaa1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:40.505876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9dd6276-1994-4236-91a9-15cc70deaa1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:40.506372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9dd6276-1994-4236-91a9-15cc70deaa1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:40.506862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9dd6276-1994-4236-91a9-15cc70deaa1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:40.507564 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9dd6276-1994-4236-91a9-15cc70deaa1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:40.508034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9dd6276-1994-4236-91a9-15cc70deaa1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:40.508517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9dd6276-1994-4236-91a9-15cc70deaa1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:40.641838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f9dd6276-1994-4236-91a9-15cc70deaa1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:40.650956 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f9dd6276-1994-4236-91a9-15cc70deaa1a tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1722 microversion: 2.1 time: 0.157181 Oct 04 22:15:40.652967 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3709/7397] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:40 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:41.093177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-f14db364-a225-43f5-a23d-6c22e481cfb0 req-d8385688-be38-41f7-9058-2670e23b85aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69067cea-983e-4add-a8f5-f92f398ede71", "name": "network-vif-plugged", "status": "completed", "tag": "d070c196-cf8d-440b-b034-289aab5e9c7f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:41.105546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f14db364-a225-43f5-a23d-6c22e481cfb0 req-d8385688-be38-41f7-9058-2670e23b85aa service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:41.106097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f14db364-a225-43f5-a23d-6c22e481cfb0 req-d8385688-be38-41f7-9058-2670e23b85aa service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:41.106526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f14db364-a225-43f5-a23d-6c22e481cfb0 req-d8385688-be38-41f7-9058-2670e23b85aa service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:41.121867 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-f14db364-a225-43f5-a23d-6c22e481cfb0 req-d8385688-be38-41f7-9058-2670e23b85aa service nova] Creating event network-vif-plugged:d070c196-cf8d-440b-b034-289aab5e9c7f for instance 69067cea-983e-4add-a8f5-f92f398ede71 on n-h1-860282-1 Oct 04 22:15:41.127497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-f14db364-a225-43f5-a23d-6c22e481cfb0 req-d8385688-be38-41f7-9058-2670e23b85aa service nova] Instance 69067cea-983e-4add-a8f5-f92f398ede71 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:15:41.138671 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-f14db364-a225-43f5-a23d-6c22e481cfb0 req-d8385688-be38-41f7-9058-2670e23b85aa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049428 Oct 04 22:15:41.139280 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3689/7398] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:15:41.673971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bf57d53c-b729-4341-bae5-3e4670982b5e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:41.674619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bf57d53c-b729-4341-bae5-3e4670982b5e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:41.681878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf57d53c-b729-4341-bae5-3e4670982b5e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:41.682391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf57d53c-b729-4341-bae5-3e4670982b5e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:41.682853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf57d53c-b729-4341-bae5-3e4670982b5e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:41.683695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf57d53c-b729-4341-bae5-3e4670982b5e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:41.684181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf57d53c-b729-4341-bae5-3e4670982b5e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:41.684629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bf57d53c-b729-4341-bae5-3e4670982b5e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:41.821840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bf57d53c-b729-4341-bae5-3e4670982b5e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:41.830978 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bf57d53c-b729-4341-bae5-3e4670982b5e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1722 microversion: 2.1 time: 0.161092 Oct 04 22:15:41.831649 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3710/7399] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:41 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:42.856208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7e6bb12d-0c51-4435-a391-0094d102e952 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:42.856804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7e6bb12d-0c51-4435-a391-0094d102e952 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:42.864005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e6bb12d-0c51-4435-a391-0094d102e952 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:42.864489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e6bb12d-0c51-4435-a391-0094d102e952 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:42.864924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e6bb12d-0c51-4435-a391-0094d102e952 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:42.865681 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e6bb12d-0c51-4435-a391-0094d102e952 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:42.866137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e6bb12d-0c51-4435-a391-0094d102e952 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:42.866680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7e6bb12d-0c51-4435-a391-0094d102e952 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:43.003113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7e6bb12d-0c51-4435-a391-0094d102e952 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:43.011700 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7e6bb12d-0c51-4435-a391-0094d102e952 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1722 microversion: 2.1 time: 0.160660 Oct 04 22:15:43.012565 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3690/7400] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:42 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:43.975097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-f1a35c07-0c02-4b35-8eaa-44e0fcc6c4b9 req-18bc1861-6545-4ddc-a143-00a381c514e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69067cea-983e-4add-a8f5-f92f398ede71", "name": "network-vif-unplugged", "status": "completed", "tag": "d070c196-cf8d-440b-b034-289aab5e9c7f"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:43.984838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f1a35c07-0c02-4b35-8eaa-44e0fcc6c4b9 req-18bc1861-6545-4ddc-a143-00a381c514e0 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:43.985333 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f1a35c07-0c02-4b35-8eaa-44e0fcc6c4b9 req-18bc1861-6545-4ddc-a143-00a381c514e0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:43.986345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f1a35c07-0c02-4b35-8eaa-44e0fcc6c4b9 req-18bc1861-6545-4ddc-a143-00a381c514e0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:43.998188 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-f1a35c07-0c02-4b35-8eaa-44e0fcc6c4b9 req-18bc1861-6545-4ddc-a143-00a381c514e0 service nova] Creating event network-vif-unplugged:d070c196-cf8d-440b-b034-289aab5e9c7f for instance 69067cea-983e-4add-a8f5-f92f398ede71 on n-h2-860282-1 Oct 04 22:15:44.004107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [req-f1a35c07-0c02-4b35-8eaa-44e0fcc6c4b9 req-18bc1861-6545-4ddc-a143-00a381c514e0 service nova] Instance 69067cea-983e-4add-a8f5-f92f398ede71 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122757) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:15:44.014924 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-f1a35c07-0c02-4b35-8eaa-44e0fcc6c4b9 req-18bc1861-6545-4ddc-a143-00a381c514e0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043811 Oct 04 22:15:44.015647 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3711/7401] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:15:44.036695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9c0c6837-411e-4730-958b-409bae93c658 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:44.037310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9c0c6837-411e-4730-958b-409bae93c658 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:44.044223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c0c6837-411e-4730-958b-409bae93c658 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:44.044708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c0c6837-411e-4730-958b-409bae93c658 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:44.045301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c0c6837-411e-4730-958b-409bae93c658 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:44.045877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c0c6837-411e-4730-958b-409bae93c658 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:44.046329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c0c6837-411e-4730-958b-409bae93c658 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:44.046759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9c0c6837-411e-4730-958b-409bae93c658 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:44.353196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9c0c6837-411e-4730-958b-409bae93c658 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:44.362159 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9c0c6837-411e-4730-958b-409bae93c658 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1722 microversion: 2.1 time: 0.330010 Oct 04 22:15:44.362745 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3691/7402] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:44 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1722 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:45.387871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d043f35e-0110-481e-abdc-a987f7af2bce tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:45.388594 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d043f35e-0110-481e-abdc-a987f7af2bce tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:45.395280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d043f35e-0110-481e-abdc-a987f7af2bce tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:45.395787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d043f35e-0110-481e-abdc-a987f7af2bce tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:45.396247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d043f35e-0110-481e-abdc-a987f7af2bce tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:45.396960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d043f35e-0110-481e-abdc-a987f7af2bce tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:45.397449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d043f35e-0110-481e-abdc-a987f7af2bce tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:45.397905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d043f35e-0110-481e-abdc-a987f7af2bce tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:45.581925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d043f35e-0110-481e-abdc-a987f7af2bce tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:45.590274 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d043f35e-0110-481e-abdc-a987f7af2bce tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1722 microversion: 2.1 time: 0.207828 Oct 04 22:15:45.590859 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3712/7403] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:45 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:46.029527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-54ed1083-31e0-4b23-86fe-3a22a3c7b28e req-45ad1418-658c-48aa-8368-fbf8c169e8ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69067cea-983e-4add-a8f5-f92f398ede71", "tag": "d070c196-cf8d-440b-b034-289aab5e9c7f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:46.039680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-54ed1083-31e0-4b23-86fe-3a22a3c7b28e req-45ad1418-658c-48aa-8368-fbf8c169e8ed service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:46.040156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-54ed1083-31e0-4b23-86fe-3a22a3c7b28e req-45ad1418-658c-48aa-8368-fbf8c169e8ed service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:46.040583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-54ed1083-31e0-4b23-86fe-3a22a3c7b28e req-45ad1418-658c-48aa-8368-fbf8c169e8ed service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:46.052705 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-54ed1083-31e0-4b23-86fe-3a22a3c7b28e req-45ad1418-658c-48aa-8368-fbf8c169e8ed service nova] Creating event network-changed:d070c196-cf8d-440b-b034-289aab5e9c7f for instance 69067cea-983e-4add-a8f5-f92f398ede71 on n-h2-860282-1 Oct 04 22:15:46.058099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-54ed1083-31e0-4b23-86fe-3a22a3c7b28e req-45ad1418-658c-48aa-8368-fbf8c169e8ed service nova] Instance 69067cea-983e-4add-a8f5-f92f398ede71 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:15:46.069623 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-54ed1083-31e0-4b23-86fe-3a22a3c7b28e req-45ad1418-658c-48aa-8368-fbf8c169e8ed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043926 Oct 04 22:15:46.070284 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3692/7404] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:15:46.615159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9be2a961-66bf-4f2e-a43f-91efd085994d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:46.615936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9be2a961-66bf-4f2e-a43f-91efd085994d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:46.623550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9be2a961-66bf-4f2e-a43f-91efd085994d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:46.624427 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9be2a961-66bf-4f2e-a43f-91efd085994d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:46.625400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9be2a961-66bf-4f2e-a43f-91efd085994d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:46.626551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9be2a961-66bf-4f2e-a43f-91efd085994d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:46.627256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9be2a961-66bf-4f2e-a43f-91efd085994d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:46.627935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9be2a961-66bf-4f2e-a43f-91efd085994d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:46.768879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9be2a961-66bf-4f2e-a43f-91efd085994d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:46.777450 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9be2a961-66bf-4f2e-a43f-91efd085994d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1722 microversion: 2.1 time: 0.166957 Oct 04 22:15:46.778245 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3713/7405] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:46 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:47.802782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f24a52bb-9425-4eb7-8825-0f4d863ca1a8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:47.803394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f24a52bb-9425-4eb7-8825-0f4d863ca1a8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:47.805288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:47.810384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f24a52bb-9425-4eb7-8825-0f4d863ca1a8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:47.810871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f24a52bb-9425-4eb7-8825-0f4d863ca1a8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:47.811311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f24a52bb-9425-4eb7-8825-0f4d863ca1a8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:47.812002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f24a52bb-9425-4eb7-8825-0f4d863ca1a8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:47.812462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f24a52bb-9425-4eb7-8825-0f4d863ca1a8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:47.812895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f24a52bb-9425-4eb7-8825-0f4d863ca1a8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:47.943365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f24a52bb-9425-4eb7-8825-0f4d863ca1a8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:47.945581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:47.952317 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f24a52bb-9425-4eb7-8825-0f4d863ca1a8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1722 microversion: 2.1 time: 0.155477 Oct 04 22:15:47.952893 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3693/7406] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:47 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:48.975901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6f83e5ef-f85d-4f43-bceb-84d9239b5955 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:48.976532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6f83e5ef-f85d-4f43-bceb-84d9239b5955 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:48.979575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=32 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:48.984297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6f83e5ef-f85d-4f43-bceb-84d9239b5955 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:48.984800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6f83e5ef-f85d-4f43-bceb-84d9239b5955 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:48.985250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6f83e5ef-f85d-4f43-bceb-84d9239b5955 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:48.985995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6f83e5ef-f85d-4f43-bceb-84d9239b5955 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:48.986463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6f83e5ef-f85d-4f43-bceb-84d9239b5955 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:48.986942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6f83e5ef-f85d-4f43-bceb-84d9239b5955 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:49.128681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6f83e5ef-f85d-4f43-bceb-84d9239b5955 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:49.137401 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6f83e5ef-f85d-4f43-bceb-84d9239b5955 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1722 microversion: 2.1 time: 0.165195 Oct 04 22:15:49.138222 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3714/7407] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:48 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:50.162838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-089d727e-bc05-421c-8fd2-0265c0fe81ff tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:50.163450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-089d727e-bc05-421c-8fd2-0265c0fe81ff tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:50.166860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:50.172099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-089d727e-bc05-421c-8fd2-0265c0fe81ff tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:50.172505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-089d727e-bc05-421c-8fd2-0265c0fe81ff tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:50.173590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-089d727e-bc05-421c-8fd2-0265c0fe81ff tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:50.174433 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-089d727e-bc05-421c-8fd2-0265c0fe81ff tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:50.174981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-089d727e-bc05-421c-8fd2-0265c0fe81ff tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:50.175415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-089d727e-bc05-421c-8fd2-0265c0fe81ff tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:50.309198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-089d727e-bc05-421c-8fd2-0265c0fe81ff tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:50.317392 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-089d727e-bc05-421c-8fd2-0265c0fe81ff tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1722 microversion: 2.1 time: 0.158630 Oct 04 22:15:50.318147 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3694/7408] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:50 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:51.341563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-16e40420-15ab-4419-87a5-0efd54ee7b84 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:51.342200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-16e40420-15ab-4419-87a5-0efd54ee7b84 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:51.349949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16e40420-15ab-4419-87a5-0efd54ee7b84 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:51.350458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16e40420-15ab-4419-87a5-0efd54ee7b84 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:51.350919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16e40420-15ab-4419-87a5-0efd54ee7b84 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:51.351631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16e40420-15ab-4419-87a5-0efd54ee7b84 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:51.352105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16e40420-15ab-4419-87a5-0efd54ee7b84 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:51.352550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-16e40420-15ab-4419-87a5-0efd54ee7b84 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:51.356558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:51.485767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-16e40420-15ab-4419-87a5-0efd54ee7b84 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:51.494517 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-16e40420-15ab-4419-87a5-0efd54ee7b84 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1722 microversion: 2.1 time: 0.156850 Oct 04 22:15:51.495121 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3715/7409] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:51 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:52.517971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-560ff2ce-6238-407b-a94d-922eb24baa99 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:52.518582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-560ff2ce-6238-407b-a94d-922eb24baa99 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:52.526712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-560ff2ce-6238-407b-a94d-922eb24baa99 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:52.527228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-560ff2ce-6238-407b-a94d-922eb24baa99 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:52.527669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-560ff2ce-6238-407b-a94d-922eb24baa99 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:52.528362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-560ff2ce-6238-407b-a94d-922eb24baa99 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:52.528815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-560ff2ce-6238-407b-a94d-922eb24baa99 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:52.529240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-560ff2ce-6238-407b-a94d-922eb24baa99 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:52.658323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-560ff2ce-6238-407b-a94d-922eb24baa99 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:52.666408 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-560ff2ce-6238-407b-a94d-922eb24baa99 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1722 microversion: 2.1 time: 0.152728 Oct 04 22:15:52.666988 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3695/7410] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:52 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:53.691318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c1fb52e8-e42e-41b2-bccf-a67dc4fd49f3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:53.691878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c1fb52e8-e42e-41b2-bccf-a67dc4fd49f3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:53.698770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1fb52e8-e42e-41b2-bccf-a67dc4fd49f3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:53.699269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1fb52e8-e42e-41b2-bccf-a67dc4fd49f3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:53.699726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1fb52e8-e42e-41b2-bccf-a67dc4fd49f3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:53.700430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1fb52e8-e42e-41b2-bccf-a67dc4fd49f3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:53.700895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1fb52e8-e42e-41b2-bccf-a67dc4fd49f3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:53.701334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1fb52e8-e42e-41b2-bccf-a67dc4fd49f3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:53.829311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c1fb52e8-e42e-41b2-bccf-a67dc4fd49f3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:53.837736 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c1fb52e8-e42e-41b2-bccf-a67dc4fd49f3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1722 microversion: 2.1 time: 0.151084 Oct 04 22:15:53.840069 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3716/7411] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:53 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:15:54.861690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-880090e6-24d9-45fb-9ac2-ac91fec492b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:54.862229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-880090e6-24d9-45fb-9ac2-ac91fec492b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:54.869174 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-880090e6-24d9-45fb-9ac2-ac91fec492b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:54.869700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-880090e6-24d9-45fb-9ac2-ac91fec492b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:54.870148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-880090e6-24d9-45fb-9ac2-ac91fec492b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:54.870840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-880090e6-24d9-45fb-9ac2-ac91fec492b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:54.871302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-880090e6-24d9-45fb-9ac2-ac91fec492b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:54.871741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-880090e6-24d9-45fb-9ac2-ac91fec492b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:55.006206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-880090e6-24d9-45fb-9ac2-ac91fec492b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:55.014717 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-880090e6-24d9-45fb-9ac2-ac91fec492b5 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1722 microversion: 2.1 time: 0.157809 Oct 04 22:15:55.015304 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3696/7412] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:54 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:56.039474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e2cf2cd7-6643-411a-929f-771cb7ea4cf0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:56.040105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e2cf2cd7-6643-411a-929f-771cb7ea4cf0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:56.047086 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2cf2cd7-6643-411a-929f-771cb7ea4cf0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:56.047588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2cf2cd7-6643-411a-929f-771cb7ea4cf0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:56.048106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2cf2cd7-6643-411a-929f-771cb7ea4cf0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:56.048819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2cf2cd7-6643-411a-929f-771cb7ea4cf0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:56.049295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2cf2cd7-6643-411a-929f-771cb7ea4cf0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:56.049770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e2cf2cd7-6643-411a-929f-771cb7ea4cf0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:56.182222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e2cf2cd7-6643-411a-929f-771cb7ea4cf0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:56.191324 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e2cf2cd7-6643-411a-929f-771cb7ea4cf0 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1722 microversion: 2.1 time: 0.155778 Oct 04 22:15:56.191916 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3717/7413] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:56 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:15:57.215898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-858b92d6-e0c2-4214-b1d3-440e4f0b2059 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:57.220427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-858b92d6-e0c2-4214-b1d3-440e4f0b2059 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:57.224452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-858b92d6-e0c2-4214-b1d3-440e4f0b2059 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:57.224946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-858b92d6-e0c2-4214-b1d3-440e4f0b2059 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:57.225388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-858b92d6-e0c2-4214-b1d3-440e4f0b2059 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:57.226111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-858b92d6-e0c2-4214-b1d3-440e4f0b2059 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:57.226572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-858b92d6-e0c2-4214-b1d3-440e4f0b2059 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:57.227001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-858b92d6-e0c2-4214-b1d3-440e4f0b2059 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:57.363386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-858b92d6-e0c2-4214-b1d3-440e4f0b2059 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:57.372896 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-858b92d6-e0c2-4214-b1d3-440e4f0b2059 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1722 microversion: 2.1 time: 0.160810 Oct 04 22:15:57.373511 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3697/7414] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:57 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:58.396437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ba0b501e-154b-4d69-ae08-5c765d8ba9e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:58.397077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ba0b501e-154b-4d69-ae08-5c765d8ba9e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:58.404133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba0b501e-154b-4d69-ae08-5c765d8ba9e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:58.404650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba0b501e-154b-4d69-ae08-5c765d8ba9e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:58.405111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba0b501e-154b-4d69-ae08-5c765d8ba9e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:58.405853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba0b501e-154b-4d69-ae08-5c765d8ba9e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:58.406335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba0b501e-154b-4d69-ae08-5c765d8ba9e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:58.406787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba0b501e-154b-4d69-ae08-5c765d8ba9e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:58.545604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ba0b501e-154b-4d69-ae08-5c765d8ba9e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:58.555068 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ba0b501e-154b-4d69-ae08-5c765d8ba9e3 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1715 microversion: 2.1 time: 0.162603 Oct 04 22:15:58.555653 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3718/7415] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:58 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1715 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:58.577603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-66423e1d-df14-4def-a0ce-bcbea3246faf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:58.578219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-66423e1d-df14-4def-a0ce-bcbea3246faf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:58.584996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66423e1d-df14-4def-a0ce-bcbea3246faf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:58.585518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66423e1d-df14-4def-a0ce-bcbea3246faf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:58.585959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66423e1d-df14-4def-a0ce-bcbea3246faf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:58.586643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66423e1d-df14-4def-a0ce-bcbea3246faf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:58.587097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66423e1d-df14-4def-a0ce-bcbea3246faf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:58.587529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66423e1d-df14-4def-a0ce-bcbea3246faf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:58.717955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-66423e1d-df14-4def-a0ce-bcbea3246faf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:58.727402 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-66423e1d-df14-4def-a0ce-bcbea3246faf tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1715 microversion: 2.1 time: 0.153589 Oct 04 22:15:58.728008 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3698/7416] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:58 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1715 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:58.753117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f14e3387-0e85-44a2-90ed-7e47630f9443 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:58.753766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f14e3387-0e85-44a2-90ed-7e47630f9443 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:58.761386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f14e3387-0e85-44a2-90ed-7e47630f9443 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:58.762203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f14e3387-0e85-44a2-90ed-7e47630f9443 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:58.762666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f14e3387-0e85-44a2-90ed-7e47630f9443 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:58.763404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f14e3387-0e85-44a2-90ed-7e47630f9443 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:58.763882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f14e3387-0e85-44a2-90ed-7e47630f9443 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:58.764330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f14e3387-0e85-44a2-90ed-7e47630f9443 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:58.902260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f14e3387-0e85-44a2-90ed-7e47630f9443 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:58.911153 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f14e3387-0e85-44a2-90ed-7e47630f9443 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1715 microversion: 2.1 time: 0.163262 Oct 04 22:15:58.911736 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3719/7417] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:58 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:58.932985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d8df26c4-e9d4-4550-9b25-a949ed74676d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:58.933520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d8df26c4-e9d4-4550-9b25-a949ed74676d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:58.939683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8df26c4-e9d4-4550-9b25-a949ed74676d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:58.940164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8df26c4-e9d4-4550-9b25-a949ed74676d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:58.940598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8df26c4-e9d4-4550-9b25-a949ed74676d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:58.941277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8df26c4-e9d4-4550-9b25-a949ed74676d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:58.941764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8df26c4-e9d4-4550-9b25-a949ed74676d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:58.942193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d8df26c4-e9d4-4550-9b25-a949ed74676d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:58.967096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d8df26c4-e9d4-4550-9b25-a949ed74676d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:15:59.261973 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d8df26c4-e9d4-4550-9b25-a949ed74676d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "DELETE /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 204 len: 0 microversion: 2.1 time: 0.332202 Oct 04 22:15:59.270201 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3699/7418] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:15:58 2022] DELETE /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:15:59.271963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4ca4a538-53b0-439b-9852-6e98da0217f8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:59.272683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4ca4a538-53b0-439b-9852-6e98da0217f8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:59.278792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ca4a538-53b0-439b-9852-6e98da0217f8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:59.279291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ca4a538-53b0-439b-9852-6e98da0217f8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:59.279742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ca4a538-53b0-439b-9852-6e98da0217f8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:59.280572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ca4a538-53b0-439b-9852-6e98da0217f8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:59.280907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ca4a538-53b0-439b-9852-6e98da0217f8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:59.281346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ca4a538-53b0-439b-9852-6e98da0217f8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:59.292157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-f6772f13-7bf7-493d-9239-da52de0b775e req-1f87e7a1-9e76-4642-b953-33d971a2ad59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69067cea-983e-4add-a8f5-f92f398ede71", "name": "network-vif-plugged", "status": "completed", "tag": "d070c196-cf8d-440b-b034-289aab5e9c7f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:59.303629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f6772f13-7bf7-493d-9239-da52de0b775e req-1f87e7a1-9e76-4642-b953-33d971a2ad59 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:59.304209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f6772f13-7bf7-493d-9239-da52de0b775e req-1f87e7a1-9e76-4642-b953-33d971a2ad59 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:59.304647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-f6772f13-7bf7-493d-9239-da52de0b775e req-1f87e7a1-9e76-4642-b953-33d971a2ad59 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:59.316835 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-f6772f13-7bf7-493d-9239-da52de0b775e req-1f87e7a1-9e76-4642-b953-33d971a2ad59 service nova] Creating event network-vif-plugged:d070c196-cf8d-440b-b034-289aab5e9c7f for instance 69067cea-983e-4add-a8f5-f92f398ede71 on n-h2-860282-1 Oct 04 22:15:59.321858 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-f6772f13-7bf7-493d-9239-da52de0b775e req-1f87e7a1-9e76-4642-b953-33d971a2ad59 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035680 Oct 04 22:15:59.322468 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3700/7419] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:15:59.418683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4ca4a538-53b0-439b-9852-6e98da0217f8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:59.427961 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4ca4a538-53b0-439b-9852-6e98da0217f8 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1721 microversion: 2.1 time: 0.159909 Oct 04 22:15:59.428755 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3720/7420] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:59 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:16:00.453654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-341925e2-37ef-4fb7-af35-575d24dc08e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:00.454354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-341925e2-37ef-4fb7-af35-575d24dc08e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:00.460936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-341925e2-37ef-4fb7-af35-575d24dc08e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:00.461436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-341925e2-37ef-4fb7-af35-575d24dc08e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:00.461887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-341925e2-37ef-4fb7-af35-575d24dc08e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:00.462572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-341925e2-37ef-4fb7-af35-575d24dc08e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:00.463022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-341925e2-37ef-4fb7-af35-575d24dc08e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:00.463446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-341925e2-37ef-4fb7-af35-575d24dc08e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:00.595881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-341925e2-37ef-4fb7-af35-575d24dc08e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:00.604388 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-341925e2-37ef-4fb7-af35-575d24dc08e2 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1721 microversion: 2.1 time: 0.155766 Oct 04 22:16:00.604966 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3701/7421] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:00 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:01.627765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a06d3f42-a1c3-4e21-893c-3974dc3401e9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:01.628589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a06d3f42-a1c3-4e21-893c-3974dc3401e9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:01.635859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a06d3f42-a1c3-4e21-893c-3974dc3401e9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:01.637082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a06d3f42-a1c3-4e21-893c-3974dc3401e9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:01.637648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a06d3f42-a1c3-4e21-893c-3974dc3401e9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:01.638381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a06d3f42-a1c3-4e21-893c-3974dc3401e9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:01.638865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a06d3f42-a1c3-4e21-893c-3974dc3401e9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:01.639453 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a06d3f42-a1c3-4e21-893c-3974dc3401e9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:01.717548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a06d3f42-a1c3-4e21-893c-3974dc3401e9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:01.727397 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a06d3f42-a1c3-4e21-893c-3974dc3401e9 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1653 microversion: 2.1 time: 0.103495 Oct 04 22:16:01.728200 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3721/7422] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:01 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1653 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:01.948618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-4cf1224d-aacb-41c3-a759-5a941e850011 req-06116acb-20bf-4806-bc39-ccab0c074673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69067cea-983e-4add-a8f5-f92f398ede71", "name": "network-vif-deleted", "tag": "d070c196-cf8d-440b-b034-289aab5e9c7f"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:01.960429 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4cf1224d-aacb-41c3-a759-5a941e850011 req-06116acb-20bf-4806-bc39-ccab0c074673 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:01.960920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4cf1224d-aacb-41c3-a759-5a941e850011 req-06116acb-20bf-4806-bc39-ccab0c074673 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:01.961365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4cf1224d-aacb-41c3-a759-5a941e850011 req-06116acb-20bf-4806-bc39-ccab0c074673 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:01.974135 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-4cf1224d-aacb-41c3-a759-5a941e850011 req-06116acb-20bf-4806-bc39-ccab0c074673 service nova] Creating event network-vif-deleted:d070c196-cf8d-440b-b034-289aab5e9c7f for instance 69067cea-983e-4add-a8f5-f92f398ede71 on n-h2-860282-1 Oct 04 22:16:01.979040 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-4cf1224d-aacb-41c3-a759-5a941e850011 req-06116acb-20bf-4806-bc39-ccab0c074673 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086976 Oct 04 22:16:01.979655 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3702/7423] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:16:02.751536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-91894515-b2b9-4224-b62d-1e4e4acb58de tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:02.752165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-91894515-b2b9-4224-b62d-1e4e4acb58de tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:02.759421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91894515-b2b9-4224-b62d-1e4e4acb58de tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:02.759926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91894515-b2b9-4224-b62d-1e4e4acb58de tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:02.760388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91894515-b2b9-4224-b62d-1e4e4acb58de tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:02.761225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91894515-b2b9-4224-b62d-1e4e4acb58de tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:02.761990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91894515-b2b9-4224-b62d-1e4e4acb58de tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:02.762431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91894515-b2b9-4224-b62d-1e4e4acb58de tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:02.830533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-91894515-b2b9-4224-b62d-1e4e4acb58de tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:02.839609 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-91894515-b2b9-4224-b62d-1e4e4acb58de tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1368 microversion: 2.1 time: 0.091928 Oct 04 22:16:02.840209 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3722/7424] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:02 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:03.864893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8237ed5e-50dd-4be9-b85f-2154059aa848 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:03.865617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8237ed5e-50dd-4be9-b85f-2154059aa848 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:03.871840 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8237ed5e-50dd-4be9-b85f-2154059aa848 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:03.872326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8237ed5e-50dd-4be9-b85f-2154059aa848 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:03.872762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8237ed5e-50dd-4be9-b85f-2154059aa848 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:03.873476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8237ed5e-50dd-4be9-b85f-2154059aa848 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:03.873934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8237ed5e-50dd-4be9-b85f-2154059aa848 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:03.874356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8237ed5e-50dd-4be9-b85f-2154059aa848 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:03.940669 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8237ed5e-50dd-4be9-b85f-2154059aa848 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:03.950499 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8237ed5e-50dd-4be9-b85f-2154059aa848 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1368 microversion: 2.1 time: 0.091220 Oct 04 22:16:03.951084 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3703/7425] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:03 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:04.973944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-81f4385a-b36f-4205-b583-0f7ca298682f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:04.974573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-81f4385a-b36f-4205-b583-0f7ca298682f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:04.981533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81f4385a-b36f-4205-b583-0f7ca298682f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:04.982052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81f4385a-b36f-4205-b583-0f7ca298682f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:04.982513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81f4385a-b36f-4205-b583-0f7ca298682f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:04.983328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81f4385a-b36f-4205-b583-0f7ca298682f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:04.983695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81f4385a-b36f-4205-b583-0f7ca298682f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:04.984177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-81f4385a-b36f-4205-b583-0f7ca298682f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:05.051052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-81f4385a-b36f-4205-b583-0f7ca298682f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:05.060006 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-81f4385a-b36f-4205-b583-0f7ca298682f tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1368 microversion: 2.1 time: 0.090535 Oct 04 22:16:05.060843 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3723/7426] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:04 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:06.085658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7ef27a8a-e446-409b-b758-02bb3886089e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:06.086230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7ef27a8a-e446-409b-b758-02bb3886089e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:06.094194 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ef27a8a-e446-409b-b758-02bb3886089e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:06.094688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ef27a8a-e446-409b-b758-02bb3886089e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:06.095191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ef27a8a-e446-409b-b758-02bb3886089e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:06.096008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ef27a8a-e446-409b-b758-02bb3886089e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:06.096571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ef27a8a-e446-409b-b758-02bb3886089e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:06.097000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ef27a8a-e446-409b-b758-02bb3886089e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:06.165657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7ef27a8a-e446-409b-b758-02bb3886089e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01d66c6cbba4c30831508fdaf953268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa764882b244357892ebdad69cff689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:06.174327 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7ef27a8a-e446-409b-b758-02bb3886089e tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 200 len: 1368 microversion: 2.1 time: 0.094081 Oct 04 22:16:06.174921 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3704/7427] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:06 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:07.198247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4cdcfe01-2891-48c9-922b-34cd149fddbb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:07.198868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4cdcfe01-2891-48c9-922b-34cd149fddbb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:07.205897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cdcfe01-2891-48c9-922b-34cd149fddbb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:07.206402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cdcfe01-2891-48c9-922b-34cd149fddbb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:07.207370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cdcfe01-2891-48c9-922b-34cd149fddbb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:07.208077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cdcfe01-2891-48c9-922b-34cd149fddbb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:07.208547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cdcfe01-2891-48c9-922b-34cd149fddbb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:07.208990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cdcfe01-2891-48c9-922b-34cd149fddbb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:07.222416 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-4cdcfe01-2891-48c9-922b-34cd149fddbb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] HTTP exception thrown: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4cdcfe01-2891-48c9-922b-34cd149fddbb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Request method failure captured: Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 HTTP/1.1 Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPK8oecCePEZ1fjQeOvLUymrlk79ZSDMC_m3SQmxdMtXhHHvhD1zn86_Mnhmwnf3CTzZYgu9HlWWt5S89bCsK70TBvqC_PsuS5A9ZH5z3zSd6qECgW80Bqf-YGFd31IgZ7PhK_th5fwhMT0w_DbjLHA4xe_oVPvuobxSs8EncCZ5xwHg Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5aa764882b244357892ebdad69cff689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5aa764882b244357892ebdad69cff689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}] Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c01d66c6cbba4c30831508fdaf953268 Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '69067cea-983e-4add-a8f5-f92f398ede71'} Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:07.224071 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:07.229152 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:07.229152 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:07.229152 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:07.229152 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:07.229152 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:07.229152 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:07.229152 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:07.229152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4cdcfe01-2891-48c9-922b-34cd149fddbb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Returning 404 to user: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:07.229152 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4cdcfe01-2891-48c9-922b-34cd149fddbb tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 404 len: 111 microversion: 2.1 time: 0.031150 Oct 04 22:16:07.229152 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3724/7428] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:07 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:16:07.287484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e5692613-b71b-4c9a-aad0-78a1661dc41d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:07.289709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e5692613-b71b-4c9a-aad0-78a1661dc41d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:07.296785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5692613-b71b-4c9a-aad0-78a1661dc41d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:07.297275 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5692613-b71b-4c9a-aad0-78a1661dc41d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:07.297748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5692613-b71b-4c9a-aad0-78a1661dc41d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:07.298454 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5692613-b71b-4c9a-aad0-78a1661dc41d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:07.298917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5692613-b71b-4c9a-aad0-78a1661dc41d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:07.299377 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e5692613-b71b-4c9a-aad0-78a1661dc41d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:07.311902 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-e5692613-b71b-4c9a-aad0-78a1661dc41d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] HTTP exception thrown: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e5692613-b71b-4c9a-aad0-78a1661dc41d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Request method failure captured: Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71/os-volume_attachments HTTP/1.1 Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPK8oecCePEZ1fjQeOvLUymrlk79ZSDMC_m3SQmxdMtXhHHvhD1zn86_Mnhmwnf3CTzZYgu9HlWWt5S89bCsK70TBvqC_PsuS5A9ZH5z3zSd6qECgW80Bqf-YGFd31IgZ7PhK_th5fwhMT0w_DbjLHA4xe_oVPvuobxSs8EncCZ5xwHg Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5aa764882b244357892ebdad69cff689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5aa764882b244357892ebdad69cff689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}] Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c01d66c6cbba4c30831508fdaf953268 Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'server_id': '69067cea-983e-4add-a8f5-f92f398ede71'} Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:07.313652 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:07.318988 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:07.318988 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:07.318988 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:07.318988 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:07.318988 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:07.318988 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:07.318988 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:07.318988 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:07.318988 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:07.318988 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:07.318988 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:07.318988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e5692613-b71b-4c9a-aad0-78a1661dc41d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Returning 404 to user: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:07.318988 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e5692613-b71b-4c9a-aad0-78a1661dc41d tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031628 Oct 04 22:16:07.318988 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3705/7429] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:16:07 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:16:10.758273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d854a118-8832-4695-bcf4-727e597ae280 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:10.758877 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d854a118-8832-4695-bcf4-727e597ae280 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:10.766137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d854a118-8832-4695-bcf4-727e597ae280 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:10.766716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d854a118-8832-4695-bcf4-727e597ae280 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:10.767247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d854a118-8832-4695-bcf4-727e597ae280 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:10.768032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d854a118-8832-4695-bcf4-727e597ae280 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:10.768577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d854a118-8832-4695-bcf4-727e597ae280 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:10.769093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d854a118-8832-4695-bcf4-727e597ae280 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:10.783439 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-d854a118-8832-4695-bcf4-727e597ae280 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] HTTP exception thrown: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d854a118-8832-4695-bcf4-727e597ae280 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Request method failure captured: Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 HTTP/1.1 Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPK8oecCePEZ1fjQeOvLUymrlk79ZSDMC_m3SQmxdMtXhHHvhD1zn86_Mnhmwnf3CTzZYgu9HlWWt5S89bCsK70TBvqC_PsuS5A9ZH5z3zSd6qECgW80Bqf-YGFd31IgZ7PhK_th5fwhMT0w_DbjLHA4xe_oVPvuobxSs8EncCZ5xwHg Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5aa764882b244357892ebdad69cff689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5aa764882b244357892ebdad69cff689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}] Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c01d66c6cbba4c30831508fdaf953268 Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '69067cea-983e-4add-a8f5-f92f398ede71'} Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:10.784953 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:10.789900 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:10.789900 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.789900 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:10.789900 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.789900 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:10.789900 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:10.789900 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:10.789900 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:10.789900 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:10.789900 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:10.789900 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.789900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d854a118-8832-4695-bcf4-727e597ae280 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Returning 404 to user: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:10.789900 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d854a118-8832-4695-bcf4-727e597ae280 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "DELETE /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 404 len: 111 microversion: 2.1 time: 0.033053 Oct 04 22:16:10.789900 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3725/7430] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:16:10 2022] DELETE /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:16:10.795631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e059680a-ee77-43f3-ab5e-25c0703ae0b4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:10.797005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e059680a-ee77-43f3-ab5e-25c0703ae0b4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 69067cea-983e-4add-a8f5-f92f398ede71] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:10.804813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e059680a-ee77-43f3-ab5e-25c0703ae0b4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:10.805319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e059680a-ee77-43f3-ab5e-25c0703ae0b4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:10.805855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e059680a-ee77-43f3-ab5e-25c0703ae0b4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:10.806671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e059680a-ee77-43f3-ab5e-25c0703ae0b4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:10.807204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e059680a-ee77-43f3-ab5e-25c0703ae0b4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:10.807706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e059680a-ee77-43f3-ab5e-25c0703ae0b4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:10.822135 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-e059680a-ee77-43f3-ab5e-25c0703ae0b4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] HTTP exception thrown: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e059680a-ee77-43f3-ab5e-25c0703ae0b4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Request method failure captured: Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 HTTP/1.1 Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPK8oecCePEZ1fjQeOvLUymrlk79ZSDMC_m3SQmxdMtXhHHvhD1zn86_Mnhmwnf3CTzZYgu9HlWWt5S89bCsK70TBvqC_PsuS5A9ZH5z3zSd6qECgW80Bqf-YGFd31IgZ7PhK_th5fwhMT0w_DbjLHA4xe_oVPvuobxSs8EncCZ5xwHg Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5aa764882b244357892ebdad69cff689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5aa764882b244357892ebdad69cff689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}] Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c01d66c6cbba4c30831508fdaf953268 Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '69067cea-983e-4add-a8f5-f92f398ede71'} Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:10.823798 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.828668 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:10.828668 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:10.828668 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:10.828668 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:10.828668 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:10.828668 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. Oct 04 22:16:10.828668 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.828668 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e059680a-ee77-43f3-ab5e-25c0703ae0b4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Returning 404 to user: Instance 69067cea-983e-4add-a8f5-f92f398ede71 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:10.828668 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e059680a-ee77-43f3-ab5e-25c0703ae0b4 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71" status: 404 len: 111 microversion: 2.1 time: 0.034765 Oct 04 22:16:10.829234 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3706/7431] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:10 2022] GET /compute/v2.1/servers/69067cea-983e-4add-a8f5-f92f398ede71 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:16:10.836975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e1ad9c45-adf8-4b63-ab35-939b4f9f4b74 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:10.837514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e1ad9c45-adf8-4b63-ab35-939b4f9f4b74 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:10.843530 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1ad9c45-adf8-4b63-ab35-939b4f9f4b74 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:10.844096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1ad9c45-adf8-4b63-ab35-939b4f9f4b74 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:10.844558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1ad9c45-adf8-4b63-ab35-939b4f9f4b74 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:10.852060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1ad9c45-adf8-4b63-ab35-939b4f9f4b74 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:10.852060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1ad9c45-adf8-4b63-ab35-939b4f9f4b74 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:10.852060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1ad9c45-adf8-4b63-ab35-939b4f9f4b74 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:10.859971 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-e1ad9c45-adf8-4b63-ab35-939b4f9f4b74 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] HTTP exception thrown: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e1ad9c45-adf8-4b63-ab35-939b4f9f4b74 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Request method failure captured: Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 HTTP/1.1 Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPK8oecCePEZ1fjQeOvLUymrlk79ZSDMC_m3SQmxdMtXhHHvhD1zn86_Mnhmwnf3CTzZYgu9HlWWt5S89bCsK70TBvqC_PsuS5A9ZH5z3zSd6qECgW80Bqf-YGFd31IgZ7PhK_th5fwhMT0w_DbjLHA4xe_oVPvuobxSs8EncCZ5xwHg Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5aa764882b244357892ebdad69cff689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5aa764882b244357892ebdad69cff689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}] Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c01d66c6cbba4c30831508fdaf953268 Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'b5b9fe99-0b9c-405f-badb-ce3d33c047f2'} Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:10.861569 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:10.867337 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:16:10.867337 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.867337 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:10.867337 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.867337 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:10.867337 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:10.867337 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:10.867337 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:10.867337 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:10.867337 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:16:10.867337 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.867337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e1ad9c45-adf8-4b63-ab35-939b4f9f4b74 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Returning 404 to user: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:10.867337 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e1ad9c45-adf8-4b63-ab35-939b4f9f4b74 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 404 len: 111 microversion: 2.1 time: 0.030396 Oct 04 22:16:10.867337 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3726/7432] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:16:10 2022] DELETE /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:16:10.873085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fa02128e-4983-4995-9b18-db34f937a0ca tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:10.873951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fa02128e-4983-4995-9b18-db34f937a0ca tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: b5b9fe99-0b9c-405f-badb-ce3d33c047f2] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:10.881083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa02128e-4983-4995-9b18-db34f937a0ca tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:10.892059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa02128e-4983-4995-9b18-db34f937a0ca tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:10.892059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa02128e-4983-4995-9b18-db34f937a0ca tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:10.892059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa02128e-4983-4995-9b18-db34f937a0ca tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:10.892059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa02128e-4983-4995-9b18-db34f937a0ca tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:10.892059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fa02128e-4983-4995-9b18-db34f937a0ca tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:10.897759 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-fa02128e-4983-4995-9b18-db34f937a0ca tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] HTTP exception thrown: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fa02128e-4983-4995-9b18-db34f937a0ca tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Request method failure captured: Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 HTTP/1.1 Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPK8oecCePEZ1fjQeOvLUymrlk79ZSDMC_m3SQmxdMtXhHHvhD1zn86_Mnhmwnf3CTzZYgu9HlWWt5S89bCsK70TBvqC_PsuS5A9ZH5z3zSd6qECgW80Bqf-YGFd31IgZ7PhK_th5fwhMT0w_DbjLHA4xe_oVPvuobxSs8EncCZ5xwHg Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5aa764882b244357892ebdad69cff689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5aa764882b244357892ebdad69cff689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}] Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c01d66c6cbba4c30831508fdaf953268 Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'b5b9fe99-0b9c-405f-badb-ce3d33c047f2'} Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:10.899295 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.905535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:10.905535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:10.905535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:10.905535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:10.905535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:10.905535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. Oct 04 22:16:10.905535 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.905535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fa02128e-4983-4995-9b18-db34f937a0ca tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Returning 404 to user: Instance b5b9fe99-0b9c-405f-badb-ce3d33c047f2 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:10.905535 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fa02128e-4983-4995-9b18-db34f937a0ca tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2" status: 404 len: 111 microversion: 2.1 time: 0.031650 Oct 04 22:16:10.905535 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3707/7433] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:10 2022] GET /compute/v2.1/servers/b5b9fe99-0b9c-405f-badb-ce3d33c047f2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:16:10.909646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-52439f06-de46-40c0-ab98-212f616a552b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:10.910167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-52439f06-de46-40c0-ab98-212f616a552b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:10.916339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52439f06-de46-40c0-ab98-212f616a552b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:10.920799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52439f06-de46-40c0-ab98-212f616a552b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:10.920799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52439f06-de46-40c0-ab98-212f616a552b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:10.920799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52439f06-de46-40c0-ab98-212f616a552b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:10.920799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52439f06-de46-40c0-ab98-212f616a552b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:10.920799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52439f06-de46-40c0-ab98-212f616a552b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:10.933145 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-52439f06-de46-40c0-ab98-212f616a552b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] HTTP exception thrown: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-52439f06-de46-40c0-ab98-212f616a552b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Request method failure captured: Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 HTTP/1.1 Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPK8oecCePEZ1fjQeOvLUymrlk79ZSDMC_m3SQmxdMtXhHHvhD1zn86_Mnhmwnf3CTzZYgu9HlWWt5S89bCsK70TBvqC_PsuS5A9ZH5z3zSd6qECgW80Bqf-YGFd31IgZ7PhK_th5fwhMT0w_DbjLHA4xe_oVPvuobxSs8EncCZ5xwHg Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5aa764882b244357892ebdad69cff689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5aa764882b244357892ebdad69cff689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}] Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c01d66c6cbba4c30831508fdaf953268 Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '32ffb34b-569d-4809-8ba0-07758088a706'} Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:10.934745 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:10.938827 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:16:10.938827 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.938827 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:10.938827 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.938827 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:10.938827 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:10.938827 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:10.938827 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:10.938827 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:10.938827 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:16:10.938827 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.938827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-52439f06-de46-40c0-ab98-212f616a552b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Returning 404 to user: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:10.938827 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-52439f06-de46-40c0-ab98-212f616a552b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "DELETE /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 404 len: 111 microversion: 2.1 time: 0.030471 Oct 04 22:16:10.938827 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3727/7434] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:16:10 2022] DELETE /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:16:10.945182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-08e59bd9-4faf-4319-be91-85f323124a1c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:10.945832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-08e59bd9-4faf-4319-be91-85f323124a1c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: 32ffb34b-569d-4809-8ba0-07758088a706] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:10.951845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08e59bd9-4faf-4319-be91-85f323124a1c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:10.952323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08e59bd9-4faf-4319-be91-85f323124a1c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:10.952758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08e59bd9-4faf-4319-be91-85f323124a1c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:10.953475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08e59bd9-4faf-4319-be91-85f323124a1c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:10.953918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08e59bd9-4faf-4319-be91-85f323124a1c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:10.954343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08e59bd9-4faf-4319-be91-85f323124a1c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:10.967708 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-08e59bd9-4faf-4319-be91-85f323124a1c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] HTTP exception thrown: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-08e59bd9-4faf-4319-be91-85f323124a1c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Request method failure captured: Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 HTTP/1.1 Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPK8oecCePEZ1fjQeOvLUymrlk79ZSDMC_m3SQmxdMtXhHHvhD1zn86_Mnhmwnf3CTzZYgu9HlWWt5S89bCsK70TBvqC_PsuS5A9ZH5z3zSd6qECgW80Bqf-YGFd31IgZ7PhK_th5fwhMT0w_DbjLHA4xe_oVPvuobxSs8EncCZ5xwHg Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5aa764882b244357892ebdad69cff689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5aa764882b244357892ebdad69cff689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}] Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c01d66c6cbba4c30831508fdaf953268 Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '32ffb34b-569d-4809-8ba0-07758088a706'} Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:10.969220 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.975105 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:10.975105 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:10.975105 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:10.975105 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:10.975105 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:10.975105 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. Oct 04 22:16:10.975105 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:10.975105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-08e59bd9-4faf-4319-be91-85f323124a1c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Returning 404 to user: Instance 32ffb34b-569d-4809-8ba0-07758088a706 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:10.975105 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-08e59bd9-4faf-4319-be91-85f323124a1c tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706" status: 404 len: 111 microversion: 2.1 time: 0.029896 Oct 04 22:16:10.975105 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3708/7435] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:10 2022] GET /compute/v2.1/servers/32ffb34b-569d-4809-8ba0-07758088a706 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:16:10.979405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e4e42215-c637-4321-858c-ebadef5be570 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:10.979927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e4e42215-c637-4321-858c-ebadef5be570 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:10.985867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4e42215-c637-4321-858c-ebadef5be570 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:10.986367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4e42215-c637-4321-858c-ebadef5be570 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:10.986816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4e42215-c637-4321-858c-ebadef5be570 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:10.987521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4e42215-c637-4321-858c-ebadef5be570 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:10.987988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4e42215-c637-4321-858c-ebadef5be570 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:10.988429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4e42215-c637-4321-858c-ebadef5be570 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:11.005248 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-e4e42215-c637-4321-858c-ebadef5be570 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] HTTP exception thrown: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e4e42215-c637-4321-858c-ebadef5be570 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Request method failure captured: Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc HTTP/1.1 Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPK8oecCePEZ1fjQeOvLUymrlk79ZSDMC_m3SQmxdMtXhHHvhD1zn86_Mnhmwnf3CTzZYgu9HlWWt5S89bCsK70TBvqC_PsuS5A9ZH5z3zSd6qECgW80Bqf-YGFd31IgZ7PhK_th5fwhMT0w_DbjLHA4xe_oVPvuobxSs8EncCZ5xwHg Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5aa764882b244357892ebdad69cff689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5aa764882b244357892ebdad69cff689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}] Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: c01d66c6cbba4c30831508fdaf953268 Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'edbaa85f-c78d-43bc-860a-5a57a93438fc'} Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:11.007031 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:11.012212 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:16:11.012212 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:11.012212 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:11.012212 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:11.012212 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:11.012212 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:11.012212 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:11.012212 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:11.012212 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:11.012212 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:16:11.012212 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:11.012212 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e4e42215-c637-4321-858c-ebadef5be570 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Returning 404 to user: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:11.012212 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e4e42215-c637-4321-858c-ebadef5be570 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "DELETE /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 404 len: 111 microversion: 2.1 time: 0.032853 Oct 04 22:16:11.012212 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3728/7436] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:16:10 2022] DELETE /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:16:11.017180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-75f8fd4f-880a-44c2-ad52-eab0f5f134e7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:11.017823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-75f8fd4f-880a-44c2-ad52-eab0f5f134e7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [instance: edbaa85f-c78d-43bc-860a-5a57a93438fc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:11.024439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75f8fd4f-880a-44c2-ad52-eab0f5f134e7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:11.024923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75f8fd4f-880a-44c2-ad52-eab0f5f134e7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:11.025360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75f8fd4f-880a-44c2-ad52-eab0f5f134e7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:11.026078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75f8fd4f-880a-44c2-ad52-eab0f5f134e7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:11.026535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75f8fd4f-880a-44c2-ad52-eab0f5f134e7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:11.026961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-75f8fd4f-880a-44c2-ad52-eab0f5f134e7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:11.041897 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-75f8fd4f-880a-44c2-ad52-eab0f5f134e7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] HTTP exception thrown: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-75f8fd4f-880a-44c2-ad52-eab0f5f134e7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Request method failure captured: Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc HTTP/1.1 Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPK8oecCePEZ1fjQeOvLUymrlk79ZSDMC_m3SQmxdMtXhHHvhD1zn86_Mnhmwnf3CTzZYgu9HlWWt5S89bCsK70TBvqC_PsuS5A9ZH5z3zSd6qECgW80Bqf-YGFd31IgZ7PhK_th5fwhMT0w_DbjLHA4xe_oVPvuobxSs8EncCZ5xwHg Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5aa764882b244357892ebdad69cff689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5aa764882b244357892ebdad69cff689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5aa764882b244357892ebdad69cff689"}]}] Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 5aa764882b244357892ebdad69cff689 Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServerActionsTestJSON-560335426 Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: c01d66c6cbba4c30831508fdaf953268 Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServerActionsTestJSON-560335426-project Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'edbaa85f-c78d-43bc-860a-5a57a93438fc'} Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:11.043386 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:11.048241 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:11.048241 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:11.048241 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:11.048241 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:11.048241 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:11.048241 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. Oct 04 22:16:11.048241 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:11.048241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-75f8fd4f-880a-44c2-ad52-eab0f5f134e7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Returning 404 to user: Instance edbaa85f-c78d-43bc-860a-5a57a93438fc could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:11.048241 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-75f8fd4f-880a-44c2-ad52-eab0f5f134e7 tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc" status: 404 len: 111 microversion: 2.1 time: 0.031437 Oct 04 22:16:11.048241 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3709/7437] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:11 2022] GET /compute/v2.1/servers/edbaa85f-c78d-43bc-860a-5a57a93438fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:16:11.054260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3fc9f73b-5a5c-484f-8898-c1206185218b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] Calling method '.version_select at 0x7f57906044c0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:11.058824 n-d-860282-1 devstack@n-api.service[122757]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3fc9f73b-5a5c-484f-8898-c1206185218b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [39c7b8a6-38f5-4ef5-8a76-e5946e80cb02] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:16:12.066368 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [None req-3fc9f73b-5a5c-484f-8898-c1206185218b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] [39c7b8a6-38f5-4ef5-8a76-e5946e80cb02] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 36936. Oct 04 22:16:12.179179 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3fc9f73b-5a5c-484f-8898-c1206185218b tempest-ServerActionsTestJSON-560335426 tempest-ServerActionsTestJSON-560335426-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-955841605" status: 202 len: 0 microversion: 2.1 time: 1.129394 Oct 04 22:16:12.179787 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3729/7438] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Oct 4 22:16:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-955841605 => generated 0 bytes in 1131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:16:23.771954 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:16:23.772534 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 22:16:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Oct 04 22:16:23.773538 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:16:23.773674 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 22:16:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Oct 04 22:16:23.774651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:23.775849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:23.920969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ec4c0add-a55b-4d37-8779-90ab6a50cf2c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1414832289", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "d4fa6988-9149-4f8c-afe1-190cd8bdc92f"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:23.977519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-ec4c0add-a55b-4d37-8779-90ab6a50cf2c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] validate_networks() for [('d4fa6988-9149-4f8c-afe1-190cd8bdc92f', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:16:24.356230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ec4c0add-a55b-4d37-8779-90ab6a50cf2c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:16:24.356672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ec4c0add-a55b-4d37-8779-90ab6a50cf2c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:16:24.357159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ec4c0add-a55b-4d37-8779-90ab6a50cf2c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:16:24.357611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ec4c0add-a55b-4d37-8779-90ab6a50cf2c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:16:24.358038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-ec4c0add-a55b-4d37-8779-90ab6a50cf2c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:16:24.367560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec4c0add-a55b-4d37-8779-90ab6a50cf2c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:24.368043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec4c0add-a55b-4d37-8779-90ab6a50cf2c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:24.368482 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec4c0add-a55b-4d37-8779-90ab6a50cf2c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:24.369207 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec4c0add-a55b-4d37-8779-90ab6a50cf2c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:24.369700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec4c0add-a55b-4d37-8779-90ab6a50cf2c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:24.370884 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec4c0add-a55b-4d37-8779-90ab6a50cf2c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:24.388138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ec4c0add-a55b-4d37-8779-90ab6a50cf2c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Getting quotas for project 20f2f18eda374a5ba1da2b2f37a3fa7d. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:16:24.393349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-ec4c0add-a55b-4d37-8779-90ab6a50cf2c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Getting quotas for user a0cfb842f42a468a9f727c43b59138bd and project 20f2f18eda374a5ba1da2b2f37a3fa7d. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:16:24.405842 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ec4c0add-a55b-4d37-8779-90ab6a50cf2c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:16:24.408187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ec4c0add-a55b-4d37-8779-90ab6a50cf2c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:16:24.530034 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ec4c0add-a55b-4d37-8779-90ab6a50cf2c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.763633 Oct 04 22:16:24.530917 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3710/7439] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:16:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:16:24.541740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=63 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:24.542361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:24.548871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b4e896a5-502c-485c-be9b-4244d6d5fffc tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:24.550413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b4e896a5-502c-485c-be9b-4244d6d5fffc tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:24.611887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b4e896a5-502c-485c-be9b-4244d6d5fffc tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:24.620412 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b4e896a5-502c-485c-be9b-4244d6d5fffc tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1217 microversion: 2.1 time: 0.081338 Oct 04 22:16:24.626545 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3730/7440] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:24 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:25.644570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-af2dc080-6f90-4b71-8f38-cabdc2a27524 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:25.645356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-af2dc080-6f90-4b71-8f38-cabdc2a27524 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:25.652355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af2dc080-6f90-4b71-8f38-cabdc2a27524 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:25.652857 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af2dc080-6f90-4b71-8f38-cabdc2a27524 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:25.653274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af2dc080-6f90-4b71-8f38-cabdc2a27524 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:25.653991 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af2dc080-6f90-4b71-8f38-cabdc2a27524 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:25.654448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af2dc080-6f90-4b71-8f38-cabdc2a27524 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:25.654883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-af2dc080-6f90-4b71-8f38-cabdc2a27524 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:25.727517 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-af2dc080-6f90-4b71-8f38-cabdc2a27524 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:25.735298 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-af2dc080-6f90-4b71-8f38-cabdc2a27524 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1221 microversion: 2.1 time: 0.095576 Oct 04 22:16:25.735901 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3711/7441] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:25 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1221 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:26.759025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dd9664e5-1f0c-4106-a680-bdbae71a568e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:26.759760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dd9664e5-1f0c-4106-a680-bdbae71a568e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:26.768129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd9664e5-1f0c-4106-a680-bdbae71a568e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:26.768646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd9664e5-1f0c-4106-a680-bdbae71a568e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:26.769116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd9664e5-1f0c-4106-a680-bdbae71a568e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:26.769901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd9664e5-1f0c-4106-a680-bdbae71a568e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:26.776477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd9664e5-1f0c-4106-a680-bdbae71a568e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:26.777129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd9664e5-1f0c-4106-a680-bdbae71a568e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:26.857967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dd9664e5-1f0c-4106-a680-bdbae71a568e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:26.875028 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dd9664e5-1f0c-4106-a680-bdbae71a568e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1277 microversion: 2.1 time: 0.119399 Oct 04 22:16:26.875410 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3731/7442] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:26 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1277 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:27.904199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5258670b-7e7f-403e-9aea-6c976ae7a9ae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:27.904950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5258670b-7e7f-403e-9aea-6c976ae7a9ae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:27.912373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5258670b-7e7f-403e-9aea-6c976ae7a9ae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:27.912871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5258670b-7e7f-403e-9aea-6c976ae7a9ae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:27.913299 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5258670b-7e7f-403e-9aea-6c976ae7a9ae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:27.914026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5258670b-7e7f-403e-9aea-6c976ae7a9ae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:27.914478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5258670b-7e7f-403e-9aea-6c976ae7a9ae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:27.914933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5258670b-7e7f-403e-9aea-6c976ae7a9ae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:28.052586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5258670b-7e7f-403e-9aea-6c976ae7a9ae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:28.060322 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5258670b-7e7f-403e-9aea-6c976ae7a9ae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1317 microversion: 2.1 time: 0.160133 Oct 04 22:16:28.060906 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3712/7443] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:27 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:28.462329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-c211f52b-c901-4b50-bbdc-c170db7904f6 req-a62cbba3-17d5-42a5-a5f4-61c950decfb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f83c7d0b-ea71-4db9-8450-f8cd3670607b", "tag": "feb2134c-e6a4-4685-9aa2-7ad86b7eb186"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:28.473258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c211f52b-c901-4b50-bbdc-c170db7904f6 req-a62cbba3-17d5-42a5-a5f4-61c950decfb7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:28.474685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c211f52b-c901-4b50-bbdc-c170db7904f6 req-a62cbba3-17d5-42a5-a5f4-61c950decfb7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:28.475553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c211f52b-c901-4b50-bbdc-c170db7904f6 req-a62cbba3-17d5-42a5-a5f4-61c950decfb7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:28.487893 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-c211f52b-c901-4b50-bbdc-c170db7904f6 req-a62cbba3-17d5-42a5-a5f4-61c950decfb7 service nova] Creating event network-changed:feb2134c-e6a4-4685-9aa2-7ad86b7eb186 for instance f83c7d0b-ea71-4db9-8450-f8cd3670607b on n-h1-860282-1 Oct 04 22:16:28.494179 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-c211f52b-c901-4b50-bbdc-c170db7904f6 req-a62cbba3-17d5-42a5-a5f4-61c950decfb7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035712 Oct 04 22:16:28.495380 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3732/7444] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:16:29.084412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-533664a2-2ed7-448a-b434-ed62a04bf69e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:29.085031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-533664a2-2ed7-448a-b434-ed62a04bf69e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:29.091947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-533664a2-2ed7-448a-b434-ed62a04bf69e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:29.092435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-533664a2-2ed7-448a-b434-ed62a04bf69e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:29.092874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-533664a2-2ed7-448a-b434-ed62a04bf69e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:29.093593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-533664a2-2ed7-448a-b434-ed62a04bf69e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:29.094049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-533664a2-2ed7-448a-b434-ed62a04bf69e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:29.094472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-533664a2-2ed7-448a-b434-ed62a04bf69e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:29.234080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-533664a2-2ed7-448a-b434-ed62a04bf69e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:29.242606 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-533664a2-2ed7-448a-b434-ed62a04bf69e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1317 microversion: 2.1 time: 0.162702 Oct 04 22:16:29.243224 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3713/7445] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:29 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:30.268539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6db4ace6-65ab-4527-88b3-be9250d8e2e6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:30.269297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6db4ace6-65ab-4527-88b3-be9250d8e2e6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:30.276066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6db4ace6-65ab-4527-88b3-be9250d8e2e6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:30.276570 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6db4ace6-65ab-4527-88b3-be9250d8e2e6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:30.277031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6db4ace6-65ab-4527-88b3-be9250d8e2e6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:30.277774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6db4ace6-65ab-4527-88b3-be9250d8e2e6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:30.278250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6db4ace6-65ab-4527-88b3-be9250d8e2e6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:30.278698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6db4ace6-65ab-4527-88b3-be9250d8e2e6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:30.409909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6db4ace6-65ab-4527-88b3-be9250d8e2e6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:30.419619 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6db4ace6-65ab-4527-88b3-be9250d8e2e6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1317 microversion: 2.1 time: 0.156147 Oct 04 22:16:30.420209 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3733/7446] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:30 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:31.443075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0dc8cb96-b62a-4884-a7ef-6216124857f2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:31.443698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0dc8cb96-b62a-4884-a7ef-6216124857f2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:31.450926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dc8cb96-b62a-4884-a7ef-6216124857f2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:31.451410 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dc8cb96-b62a-4884-a7ef-6216124857f2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:31.451847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dc8cb96-b62a-4884-a7ef-6216124857f2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:31.452677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dc8cb96-b62a-4884-a7ef-6216124857f2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:31.453138 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dc8cb96-b62a-4884-a7ef-6216124857f2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:31.453648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dc8cb96-b62a-4884-a7ef-6216124857f2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:31.595712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0dc8cb96-b62a-4884-a7ef-6216124857f2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:31.603625 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0dc8cb96-b62a-4884-a7ef-6216124857f2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1317 microversion: 2.1 time: 0.164952 Oct 04 22:16:31.604571 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3714/7447] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:31 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:32.627595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b8657f83-b564-4a3a-9bee-be08946a8ad6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:32.628249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b8657f83-b564-4a3a-9bee-be08946a8ad6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:32.635207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8657f83-b564-4a3a-9bee-be08946a8ad6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:32.635707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8657f83-b564-4a3a-9bee-be08946a8ad6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:32.636161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8657f83-b564-4a3a-9bee-be08946a8ad6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:32.637131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8657f83-b564-4a3a-9bee-be08946a8ad6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:32.637628 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8657f83-b564-4a3a-9bee-be08946a8ad6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:32.638072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b8657f83-b564-4a3a-9bee-be08946a8ad6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:32.768717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b8657f83-b564-4a3a-9bee-be08946a8ad6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:32.777174 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b8657f83-b564-4a3a-9bee-be08946a8ad6 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1317 microversion: 2.1 time: 0.153561 Oct 04 22:16:32.777789 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3734/7448] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:32 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:33.800240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6a226fc6-7f2c-4ea8-8fc5-b04f8dae878a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:33.800783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6a226fc6-7f2c-4ea8-8fc5-b04f8dae878a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:33.808083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a226fc6-7f2c-4ea8-8fc5-b04f8dae878a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:33.808577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a226fc6-7f2c-4ea8-8fc5-b04f8dae878a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:33.809055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a226fc6-7f2c-4ea8-8fc5-b04f8dae878a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:33.809779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a226fc6-7f2c-4ea8-8fc5-b04f8dae878a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:33.810235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a226fc6-7f2c-4ea8-8fc5-b04f8dae878a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:33.810688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a226fc6-7f2c-4ea8-8fc5-b04f8dae878a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:33.940654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6a226fc6-7f2c-4ea8-8fc5-b04f8dae878a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:33.948396 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6a226fc6-7f2c-4ea8-8fc5-b04f8dae878a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1317 microversion: 2.1 time: 0.152155 Oct 04 22:16:33.948977 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3715/7449] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:33 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:34.972345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-05cee83f-7404-4005-b288-de51593befd8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:34.973670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-05cee83f-7404-4005-b288-de51593befd8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:34.977828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:34.981805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05cee83f-7404-4005-b288-de51593befd8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:34.982163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05cee83f-7404-4005-b288-de51593befd8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:34.982869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05cee83f-7404-4005-b288-de51593befd8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:34.988596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05cee83f-7404-4005-b288-de51593befd8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:34.988596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05cee83f-7404-4005-b288-de51593befd8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:34.988596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-05cee83f-7404-4005-b288-de51593befd8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:35.128396 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-05cee83f-7404-4005-b288-de51593befd8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:35.138516 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-05cee83f-7404-4005-b288-de51593befd8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1317 microversion: 2.1 time: 0.169755 Oct 04 22:16:35.149567 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3735/7450] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:34 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:35.176056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-902f5f13-411f-480a-9934-c0c904f2df9b req-9fbbdfeb-a988-4437-904b-91d47f5ff088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83c7d0b-ea71-4db9-8450-f8cd3670607b", "name": "network-vif-plugged", "status": "completed", "tag": "feb2134c-e6a4-4685-9aa2-7ad86b7eb186"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:35.182119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:35.182804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:35.188968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-902f5f13-411f-480a-9934-c0c904f2df9b req-9fbbdfeb-a988-4437-904b-91d47f5ff088 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:35.189488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-902f5f13-411f-480a-9934-c0c904f2df9b req-9fbbdfeb-a988-4437-904b-91d47f5ff088 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:35.189926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-902f5f13-411f-480a-9934-c0c904f2df9b req-9fbbdfeb-a988-4437-904b-91d47f5ff088 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:35.201893 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-902f5f13-411f-480a-9934-c0c904f2df9b req-9fbbdfeb-a988-4437-904b-91d47f5ff088 service nova] Creating event network-vif-plugged:feb2134c-e6a4-4685-9aa2-7ad86b7eb186 for instance f83c7d0b-ea71-4db9-8450-f8cd3670607b on n-h1-860282-1 Oct 04 22:16:35.207485 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-902f5f13-411f-480a-9934-c0c904f2df9b req-9fbbdfeb-a988-4437-904b-91d47f5ff088 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035257 Oct 04 22:16:35.208448 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3716/7451] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:16:36.163556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f0ec6d1a-adcb-4918-93d8-0bb71897c33f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:36.164267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f0ec6d1a-adcb-4918-93d8-0bb71897c33f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:36.171131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0ec6d1a-adcb-4918-93d8-0bb71897c33f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:36.171625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0ec6d1a-adcb-4918-93d8-0bb71897c33f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:36.172077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0ec6d1a-adcb-4918-93d8-0bb71897c33f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:36.172780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0ec6d1a-adcb-4918-93d8-0bb71897c33f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:36.173246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0ec6d1a-adcb-4918-93d8-0bb71897c33f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:36.173741 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f0ec6d1a-adcb-4918-93d8-0bb71897c33f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:36.313076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f0ec6d1a-adcb-4918-93d8-0bb71897c33f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:36.321360 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f0ec6d1a-adcb-4918-93d8-0bb71897c33f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1317 microversion: 2.1 time: 0.162178 Oct 04 22:16:36.321977 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3736/7452] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:36 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:37.345585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-03fb6c99-efe9-4877-ae89-7c8aa467b009 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:37.346193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-03fb6c99-efe9-4877-ae89-7c8aa467b009 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:37.354969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03fb6c99-efe9-4877-ae89-7c8aa467b009 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:37.355602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03fb6c99-efe9-4877-ae89-7c8aa467b009 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:37.356043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03fb6c99-efe9-4877-ae89-7c8aa467b009 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:37.356737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03fb6c99-efe9-4877-ae89-7c8aa467b009 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:37.357190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03fb6c99-efe9-4877-ae89-7c8aa467b009 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:37.357738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-03fb6c99-efe9-4877-ae89-7c8aa467b009 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:37.492144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-03fb6c99-efe9-4877-ae89-7c8aa467b009 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:37.499905 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-03fb6c99-efe9-4877-ae89-7c8aa467b009 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1506 microversion: 2.1 time: 0.159426 Oct 04 22:16:37.500474 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3717/7453] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:37 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:37.562573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-17daea57-9bb5-4bdd-9b2f-f29ed3bf408c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-975567896", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "d4fa6988-9149-4f8c-afe1-190cd8bdc92f"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:37.616608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-17daea57-9bb5-4bdd-9b2f-f29ed3bf408c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] validate_networks() for [('d4fa6988-9149-4f8c-afe1-190cd8bdc92f', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:16:37.986081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-17daea57-9bb5-4bdd-9b2f-f29ed3bf408c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:16:37.986544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-17daea57-9bb5-4bdd-9b2f-f29ed3bf408c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:16:37.987039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-17daea57-9bb5-4bdd-9b2f-f29ed3bf408c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:16:37.987470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-17daea57-9bb5-4bdd-9b2f-f29ed3bf408c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:16:37.987955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-17daea57-9bb5-4bdd-9b2f-f29ed3bf408c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:16:37.996934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17daea57-9bb5-4bdd-9b2f-f29ed3bf408c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:37.997455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17daea57-9bb5-4bdd-9b2f-f29ed3bf408c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:37.997906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17daea57-9bb5-4bdd-9b2f-f29ed3bf408c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:37.998651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17daea57-9bb5-4bdd-9b2f-f29ed3bf408c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:37.999116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17daea57-9bb5-4bdd-9b2f-f29ed3bf408c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:37.999555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17daea57-9bb5-4bdd-9b2f-f29ed3bf408c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:38.016830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-17daea57-9bb5-4bdd-9b2f-f29ed3bf408c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Getting quotas for project 20f2f18eda374a5ba1da2b2f37a3fa7d. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:16:38.021996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-17daea57-9bb5-4bdd-9b2f-f29ed3bf408c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Getting quotas for user a0cfb842f42a468a9f727c43b59138bd and project 20f2f18eda374a5ba1da2b2f37a3fa7d. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:16:38.034645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-17daea57-9bb5-4bdd-9b2f-f29ed3bf408c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:16:38.036941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-17daea57-9bb5-4bdd-9b2f-f29ed3bf408c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:16:38.172831 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-17daea57-9bb5-4bdd-9b2f-f29ed3bf408c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614011 Oct 04 22:16:38.173408 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3737/7454] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:16:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:16:38.184317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ad5ebdf0-6042-4420-a49f-cff1a4a33d8d tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:38.184931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ad5ebdf0-6042-4420-a49f-cff1a4a33d8d tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:38.239702 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ad5ebdf0-6042-4420-a49f-cff1a4a33d8d tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:38.247320 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ad5ebdf0-6042-4420-a49f-cff1a4a33d8d tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb" status: 200 len: 1216 microversion: 2.1 time: 0.066810 Oct 04 22:16:38.247893 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3718/7455] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:38 2022] GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb => generated 1216 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:39.275424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0fcc96fd-2d90-4fab-b8e6-e353f804c247 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:39.275982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0fcc96fd-2d90-4fab-b8e6-e353f804c247 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:39.282794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fcc96fd-2d90-4fab-b8e6-e353f804c247 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:39.283288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fcc96fd-2d90-4fab-b8e6-e353f804c247 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:39.284236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fcc96fd-2d90-4fab-b8e6-e353f804c247 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:39.284428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fcc96fd-2d90-4fab-b8e6-e353f804c247 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:39.284933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fcc96fd-2d90-4fab-b8e6-e353f804c247 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:39.285375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0fcc96fd-2d90-4fab-b8e6-e353f804c247 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:39.359359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0fcc96fd-2d90-4fab-b8e6-e353f804c247 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:39.367384 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0fcc96fd-2d90-4fab-b8e6-e353f804c247 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb" status: 200 len: 1220 microversion: 2.1 time: 0.100469 Oct 04 22:16:39.368023 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3738/7456] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:39 2022] GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:40.393234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fab7bd71-20cc-4df8-8a12-d52211e7ad82 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:40.394089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fab7bd71-20cc-4df8-8a12-d52211e7ad82 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:40.402622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fab7bd71-20cc-4df8-8a12-d52211e7ad82 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:40.403110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fab7bd71-20cc-4df8-8a12-d52211e7ad82 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:40.403772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fab7bd71-20cc-4df8-8a12-d52211e7ad82 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:40.404504 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fab7bd71-20cc-4df8-8a12-d52211e7ad82 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:40.404963 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fab7bd71-20cc-4df8-8a12-d52211e7ad82 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:40.405388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fab7bd71-20cc-4df8-8a12-d52211e7ad82 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:40.481024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fab7bd71-20cc-4df8-8a12-d52211e7ad82 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:40.489241 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fab7bd71-20cc-4df8-8a12-d52211e7ad82 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb" status: 200 len: 1274 microversion: 2.1 time: 0.102678 Oct 04 22:16:40.489856 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3719/7457] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:40 2022] GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:41.513580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a78e5e80-3e24-4280-9c55-b24ae80ce77c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:41.514210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a78e5e80-3e24-4280-9c55-b24ae80ce77c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:41.521003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a78e5e80-3e24-4280-9c55-b24ae80ce77c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:41.521536 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a78e5e80-3e24-4280-9c55-b24ae80ce77c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:41.521991 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a78e5e80-3e24-4280-9c55-b24ae80ce77c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:41.522698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a78e5e80-3e24-4280-9c55-b24ae80ce77c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:41.523165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a78e5e80-3e24-4280-9c55-b24ae80ce77c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:41.523601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a78e5e80-3e24-4280-9c55-b24ae80ce77c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:41.746052 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a78e5e80-3e24-4280-9c55-b24ae80ce77c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:41.754117 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a78e5e80-3e24-4280-9c55-b24ae80ce77c tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb" status: 200 len: 1316 microversion: 2.1 time: 0.244728 Oct 04 22:16:41.754708 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3739/7458] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:41 2022] GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb => generated 1316 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:42.202806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-84e33b45-6224-41e6-8ce5-0995499983fc req-da415371-dcf1-4d9a-bc57-e3023b328543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "503b315e-3c87-4212-ab5a-9034ddb41fdb", "tag": "e8ec207c-db0a-4d38-99e5-06046bc4bdea"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:42.214000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-84e33b45-6224-41e6-8ce5-0995499983fc req-da415371-dcf1-4d9a-bc57-e3023b328543 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:42.214603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-84e33b45-6224-41e6-8ce5-0995499983fc req-da415371-dcf1-4d9a-bc57-e3023b328543 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:42.215069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-84e33b45-6224-41e6-8ce5-0995499983fc req-da415371-dcf1-4d9a-bc57-e3023b328543 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:42.226530 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-84e33b45-6224-41e6-8ce5-0995499983fc req-da415371-dcf1-4d9a-bc57-e3023b328543 service nova] Creating event network-changed:e8ec207c-db0a-4d38-99e5-06046bc4bdea for instance 503b315e-3c87-4212-ab5a-9034ddb41fdb on n-h2-860282-1 Oct 04 22:16:42.231834 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-84e33b45-6224-41e6-8ce5-0995499983fc req-da415371-dcf1-4d9a-bc57-e3023b328543 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033909 Oct 04 22:16:42.232634 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3720/7459] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:16:42.778761 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5e047fa5-0bce-4f02-b391-3a6a362c4f45 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:42.779429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5e047fa5-0bce-4f02-b391-3a6a362c4f45 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:42.786328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e047fa5-0bce-4f02-b391-3a6a362c4f45 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:42.786834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e047fa5-0bce-4f02-b391-3a6a362c4f45 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:42.787305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e047fa5-0bce-4f02-b391-3a6a362c4f45 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:42.788016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e047fa5-0bce-4f02-b391-3a6a362c4f45 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:42.788493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e047fa5-0bce-4f02-b391-3a6a362c4f45 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:42.788938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e047fa5-0bce-4f02-b391-3a6a362c4f45 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:43.006617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5e047fa5-0bce-4f02-b391-3a6a362c4f45 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:43.014972 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5e047fa5-0bce-4f02-b391-3a6a362c4f45 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb" status: 200 len: 1316 microversion: 2.1 time: 0.240843 Oct 04 22:16:43.015569 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3740/7460] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:42 2022] GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:16:44.037985 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-42ed8b25-72ff-4f30-b481-e7533eea66a4 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:44.038717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-42ed8b25-72ff-4f30-b481-e7533eea66a4 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:44.046399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42ed8b25-72ff-4f30-b481-e7533eea66a4 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:44.046879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42ed8b25-72ff-4f30-b481-e7533eea66a4 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:44.047316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42ed8b25-72ff-4f30-b481-e7533eea66a4 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:44.048004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42ed8b25-72ff-4f30-b481-e7533eea66a4 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:44.048457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42ed8b25-72ff-4f30-b481-e7533eea66a4 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:44.048879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-42ed8b25-72ff-4f30-b481-e7533eea66a4 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:44.184490 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-42ed8b25-72ff-4f30-b481-e7533eea66a4 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:44.192141 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-42ed8b25-72ff-4f30-b481-e7533eea66a4 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb" status: 200 len: 1316 microversion: 2.1 time: 0.158462 Oct 04 22:16:44.192713 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3721/7461] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:44 2022] GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:45.215097 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-efbd6fd4-f19f-4ac5-983a-4b899c4ae9f8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:45.215733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-efbd6fd4-f19f-4ac5-983a-4b899c4ae9f8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:45.221841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efbd6fd4-f19f-4ac5-983a-4b899c4ae9f8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:45.222346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efbd6fd4-f19f-4ac5-983a-4b899c4ae9f8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:45.222809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efbd6fd4-f19f-4ac5-983a-4b899c4ae9f8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:45.223527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efbd6fd4-f19f-4ac5-983a-4b899c4ae9f8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:45.224008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efbd6fd4-f19f-4ac5-983a-4b899c4ae9f8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:45.224459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-efbd6fd4-f19f-4ac5-983a-4b899c4ae9f8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:45.356299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-efbd6fd4-f19f-4ac5-983a-4b899c4ae9f8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:45.364285 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-efbd6fd4-f19f-4ac5-983a-4b899c4ae9f8 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb" status: 200 len: 1316 microversion: 2.1 time: 0.153405 Oct 04 22:16:45.366277 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3741/7462] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:45 2022] GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:46.388224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-df8a9e4e-3e9c-4302-aacc-c965af9cecb0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:46.388839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-df8a9e4e-3e9c-4302-aacc-c965af9cecb0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:46.394975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df8a9e4e-3e9c-4302-aacc-c965af9cecb0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:46.395455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df8a9e4e-3e9c-4302-aacc-c965af9cecb0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:46.395889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df8a9e4e-3e9c-4302-aacc-c965af9cecb0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:46.396581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df8a9e4e-3e9c-4302-aacc-c965af9cecb0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:46.397036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df8a9e4e-3e9c-4302-aacc-c965af9cecb0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:46.397476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df8a9e4e-3e9c-4302-aacc-c965af9cecb0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:46.525216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-df8a9e4e-3e9c-4302-aacc-c965af9cecb0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:46.533511 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-df8a9e4e-3e9c-4302-aacc-c965af9cecb0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb" status: 200 len: 1316 microversion: 2.1 time: 0.149680 Oct 04 22:16:46.534288 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3722/7463] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:46 2022] GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:47.490352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-9f994ab4-ef36-4d44-a79a-de1da23a6625 req-d235d4e2-cd5c-4b8c-8d88-14670214f00b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503b315e-3c87-4212-ab5a-9034ddb41fdb", "name": "network-vif-plugged", "status": "completed", "tag": "e8ec207c-db0a-4d38-99e5-06046bc4bdea"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:47.501363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9f994ab4-ef36-4d44-a79a-de1da23a6625 req-d235d4e2-cd5c-4b8c-8d88-14670214f00b service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:47.501895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9f994ab4-ef36-4d44-a79a-de1da23a6625 req-d235d4e2-cd5c-4b8c-8d88-14670214f00b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:47.502346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9f994ab4-ef36-4d44-a79a-de1da23a6625 req-d235d4e2-cd5c-4b8c-8d88-14670214f00b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:47.514700 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-9f994ab4-ef36-4d44-a79a-de1da23a6625 req-d235d4e2-cd5c-4b8c-8d88-14670214f00b service nova] Creating event network-vif-plugged:e8ec207c-db0a-4d38-99e5-06046bc4bdea for instance 503b315e-3c87-4212-ab5a-9034ddb41fdb on n-h2-860282-1 Oct 04 22:16:47.519969 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-9f994ab4-ef36-4d44-a79a-de1da23a6625 req-d235d4e2-cd5c-4b8c-8d88-14670214f00b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033550 Oct 04 22:16:47.520553 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3742/7464] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:16:47.556507 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6efbe46e-0d25-4ac6-8776-83b4fb3117c0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:47.559264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6efbe46e-0d25-4ac6-8776-83b4fb3117c0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:47.565926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6efbe46e-0d25-4ac6-8776-83b4fb3117c0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:47.566497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6efbe46e-0d25-4ac6-8776-83b4fb3117c0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:47.567001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6efbe46e-0d25-4ac6-8776-83b4fb3117c0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:47.567793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6efbe46e-0d25-4ac6-8776-83b4fb3117c0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:47.568630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6efbe46e-0d25-4ac6-8776-83b4fb3117c0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:47.569260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6efbe46e-0d25-4ac6-8776-83b4fb3117c0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:47.760379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6efbe46e-0d25-4ac6-8776-83b4fb3117c0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:47.768255 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6efbe46e-0d25-4ac6-8776-83b4fb3117c0 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb" status: 200 len: 1316 microversion: 2.1 time: 0.215974 Oct 04 22:16:47.768828 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3723/7465] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:47 2022] GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:48.788828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:48.789663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:48.794675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-163428e1-f4db-4b26-a62a-12147fdb2c04 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:48.795424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-163428e1-f4db-4b26-a62a-12147fdb2c04 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:48.802947 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-163428e1-f4db-4b26-a62a-12147fdb2c04 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:48.803483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-163428e1-f4db-4b26-a62a-12147fdb2c04 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:48.803937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-163428e1-f4db-4b26-a62a-12147fdb2c04 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:48.804640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-163428e1-f4db-4b26-a62a-12147fdb2c04 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:48.805108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-163428e1-f4db-4b26-a62a-12147fdb2c04 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:48.805573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-163428e1-f4db-4b26-a62a-12147fdb2c04 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:48.943696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-163428e1-f4db-4b26-a62a-12147fdb2c04 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:48.951531 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-163428e1-f4db-4b26-a62a-12147fdb2c04 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb" status: 200 len: 1316 microversion: 2.1 time: 0.163611 Oct 04 22:16:48.952146 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3743/7466] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:48 2022] GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:49.975266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dfa761fa-0d64-44c2-9556-918b340f6db1 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:49.975872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dfa761fa-0d64-44c2-9556-918b340f6db1 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:49.977816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:49.984137 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfa761fa-0d64-44c2-9556-918b340f6db1 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:49.984626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfa761fa-0d64-44c2-9556-918b340f6db1 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:49.985067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfa761fa-0d64-44c2-9556-918b340f6db1 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:49.985802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfa761fa-0d64-44c2-9556-918b340f6db1 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:49.986310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfa761fa-0d64-44c2-9556-918b340f6db1 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:49.986738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfa761fa-0d64-44c2-9556-918b340f6db1 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:50.118156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dfa761fa-0d64-44c2-9556-918b340f6db1 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:50.126291 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dfa761fa-0d64-44c2-9556-918b340f6db1 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb" status: 200 len: 1504 microversion: 2.1 time: 0.155234 Oct 04 22:16:50.126864 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3724/7467] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:49 2022] GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:50.149084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-61853e4b-87dc-40d3-87f8-fea30fbc08f7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:50.149619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-61853e4b-87dc-40d3-87f8-fea30fbc08f7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:50.156351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61853e4b-87dc-40d3-87f8-fea30fbc08f7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:50.156866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61853e4b-87dc-40d3-87f8-fea30fbc08f7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:50.157298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61853e4b-87dc-40d3-87f8-fea30fbc08f7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:50.158030 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61853e4b-87dc-40d3-87f8-fea30fbc08f7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:50.158500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61853e4b-87dc-40d3-87f8-fea30fbc08f7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:50.158944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-61853e4b-87dc-40d3-87f8-fea30fbc08f7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:50.187016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-61853e4b-87dc-40d3-87f8-fea30fbc08f7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:16:50.485827 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-61853e4b-87dc-40d3-87f8-fea30fbc08f7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "DELETE /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb" status: 204 len: 0 microversion: 2.1 time: 0.340285 Oct 04 22:16:50.486441 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3744/7468] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:16:50 2022] DELETE /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:16:50.494424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f54ea816-616f-4f4b-9639-0ee08027a154 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:50.495045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f54ea816-616f-4f4b-9639-0ee08027a154 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:50.501758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f54ea816-616f-4f4b-9639-0ee08027a154 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:50.506113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f54ea816-616f-4f4b-9639-0ee08027a154 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:50.506113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f54ea816-616f-4f4b-9639-0ee08027a154 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:50.506113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f54ea816-616f-4f4b-9639-0ee08027a154 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:50.506113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f54ea816-616f-4f4b-9639-0ee08027a154 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:50.506113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f54ea816-616f-4f4b-9639-0ee08027a154 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:50.633808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f54ea816-616f-4f4b-9639-0ee08027a154 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:50.641962 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f54ea816-616f-4f4b-9639-0ee08027a154 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb" status: 200 len: 1510 microversion: 2.1 time: 0.151435 Oct 04 22:16:50.642541 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3725/7469] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:50 2022] GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:51.668251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-95484674-6f3b-4873-88bc-ddc75f0029bf tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:51.668980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-95484674-6f3b-4873-88bc-ddc75f0029bf tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:51.676802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95484674-6f3b-4873-88bc-ddc75f0029bf tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:51.677313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95484674-6f3b-4873-88bc-ddc75f0029bf tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:51.677891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95484674-6f3b-4873-88bc-ddc75f0029bf tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:51.678619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95484674-6f3b-4873-88bc-ddc75f0029bf tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:51.679088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95484674-6f3b-4873-88bc-ddc75f0029bf tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:51.679535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95484674-6f3b-4873-88bc-ddc75f0029bf tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:51.820862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-95484674-6f3b-4873-88bc-ddc75f0029bf tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:51.828825 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-95484674-6f3b-4873-88bc-ddc75f0029bf tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb" status: 200 len: 1510 microversion: 2.1 time: 0.167562 Oct 04 22:16:51.829404 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3745/7470] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:51 2022] GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:52.396907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-65f2f57d-85ba-4dbe-bcae-6524165b2d21 req-8b615ac3-7cbe-4a5d-ba93-cdf8250978f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503b315e-3c87-4212-ab5a-9034ddb41fdb", "name": "network-vif-deleted", "tag": "e8ec207c-db0a-4d38-99e5-06046bc4bdea"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:52.408901 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-65f2f57d-85ba-4dbe-bcae-6524165b2d21 req-8b615ac3-7cbe-4a5d-ba93-cdf8250978f0 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:52.409457 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-65f2f57d-85ba-4dbe-bcae-6524165b2d21 req-8b615ac3-7cbe-4a5d-ba93-cdf8250978f0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:52.410158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-65f2f57d-85ba-4dbe-bcae-6524165b2d21 req-8b615ac3-7cbe-4a5d-ba93-cdf8250978f0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:52.424156 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-65f2f57d-85ba-4dbe-bcae-6524165b2d21 req-8b615ac3-7cbe-4a5d-ba93-cdf8250978f0 service nova] Creating event network-vif-deleted:e8ec207c-db0a-4d38-99e5-06046bc4bdea for instance 503b315e-3c87-4212-ab5a-9034ddb41fdb on n-h2-860282-1 Oct 04 22:16:52.430318 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-65f2f57d-85ba-4dbe-bcae-6524165b2d21 req-8b615ac3-7cbe-4a5d-ba93-cdf8250978f0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036716 Oct 04 22:16:52.431091 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3726/7471] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:16:52.852005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ee6f9c7f-ba4e-42e0-a233-fb53ef82e80f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:52.852694 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ee6f9c7f-ba4e-42e0-a233-fb53ef82e80f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:52.859736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee6f9c7f-ba4e-42e0-a233-fb53ef82e80f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:52.860241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee6f9c7f-ba4e-42e0-a233-fb53ef82e80f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:52.860700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee6f9c7f-ba4e-42e0-a233-fb53ef82e80f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:52.861408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee6f9c7f-ba4e-42e0-a233-fb53ef82e80f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:52.861914 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee6f9c7f-ba4e-42e0-a233-fb53ef82e80f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:52.862359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee6f9c7f-ba4e-42e0-a233-fb53ef82e80f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:52.893258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee6f9c7f-ba4e-42e0-a233-fb53ef82e80f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:52.893794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee6f9c7f-ba4e-42e0-a233-fb53ef82e80f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:52.894256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ee6f9c7f-ba4e-42e0-a233-fb53ef82e80f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:52.894719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-ee6f9c7f-ba4e-42e0-a233-fb53ef82e80f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lazy-loading 'fault' on Instance uuid 503b315e-3c87-4212-ab5a-9034ddb41fdb {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:16:52.938576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ee6f9c7f-ba4e-42e0-a233-fb53ef82e80f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:52.946322 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ee6f9c7f-ba4e-42e0-a233-fb53ef82e80f tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb" status: 200 len: 1306 microversion: 2.1 time: 0.098282 Oct 04 22:16:52.946892 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3746/7472] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:52 2022] GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb => generated 1306 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:53.971072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e42ebfc6-1a18-4198-8bc9-7cbdf3d1988e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:53.971782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e42ebfc6-1a18-4198-8bc9-7cbdf3d1988e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:53.974999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:53.979917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e42ebfc6-1a18-4198-8bc9-7cbdf3d1988e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:53.980406 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e42ebfc6-1a18-4198-8bc9-7cbdf3d1988e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:53.980848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e42ebfc6-1a18-4198-8bc9-7cbdf3d1988e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:53.981578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e42ebfc6-1a18-4198-8bc9-7cbdf3d1988e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:53.982751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e42ebfc6-1a18-4198-8bc9-7cbdf3d1988e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:53.983184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e42ebfc6-1a18-4198-8bc9-7cbdf3d1988e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:53.996602 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-e42ebfc6-1a18-4198-8bc9-7cbdf3d1988e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] HTTP exception thrown: Instance 503b315e-3c87-4212-ab5a-9034ddb41fdb could not be found. Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e42ebfc6-1a18-4198-8bc9-7cbdf3d1988e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Request method failure captured: Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb HTTP/1.1 Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPLC312S-Db6Hbszs-aHKFInRy4wRWrLoGf1zGOHlpV0IW-Bs-VN3H-n7b4a73857Kl7ukUqR2-NK4ea_7Kx1bNNXQW0wWm8-W37_gzsLsB5aRRFZYK1QpA2Vpx-uTvY03KAeTP1pWP6w3NvsFIULoaPI8oJ_9Xgb7Qv-01j9pgb6ovg Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 20f2f18eda374a5ba1da2b2f37a3fa7d Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}] Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 20f2f18eda374a5ba1da2b2f37a3fa7d Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-32650119-project Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: a0cfb842f42a468a9f727c43b59138bd Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-32650119-project Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 503b315e-3c87-4212-ab5a-9034ddb41fdb could not be found. Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '503b315e-3c87-4212-ab5a-9034ddb41fdb'} Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 503b315e-3c87-4212-ab5a-9034ddb41fdb could not be found. Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 503b315e-3c87-4212-ab5a-9034ddb41fdb could not be found. Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:53.998340 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:54.007928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:54.007928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:54.007928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:54.007928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:54.007928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:54.007928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 503b315e-3c87-4212-ab5a-9034ddb41fdb could not be found. Oct 04 22:16:54.007928 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:54.007928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e42ebfc6-1a18-4198-8bc9-7cbdf3d1988e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Returning 404 to user: Instance 503b315e-3c87-4212-ab5a-9034ddb41fdb could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:54.007928 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e42ebfc6-1a18-4198-8bc9-7cbdf3d1988e tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb" status: 404 len: 111 microversion: 2.1 time: 0.033930 Oct 04 22:16:54.007928 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3727/7473] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:53 2022] GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:16:54.009016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e0a3679a-ce4a-4d82-b945-90d9a036a302 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:54.009676 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e0a3679a-ce4a-4d82-b945-90d9a036a302 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:54.017207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0a3679a-ce4a-4d82-b945-90d9a036a302 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:54.017737 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0a3679a-ce4a-4d82-b945-90d9a036a302 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:54.018219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0a3679a-ce4a-4d82-b945-90d9a036a302 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:54.018923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0a3679a-ce4a-4d82-b945-90d9a036a302 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:54.019395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0a3679a-ce4a-4d82-b945-90d9a036a302 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:54.019838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e0a3679a-ce4a-4d82-b945-90d9a036a302 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:54.040195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:54.154776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e0a3679a-ce4a-4d82-b945-90d9a036a302 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:54.161449 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e0a3679a-ce4a-4d82-b945-90d9a036a302 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1506 microversion: 2.1 time: 0.156261 Oct 04 22:16:54.162052 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3747/7474] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:54 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:54.184682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-27fe71dc-0c4d-41bb-8e72-cc01ee045c3a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:54.187438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-27fe71dc-0c4d-41bb-8e72-cc01ee045c3a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: e5de751e-5f33-4ccd-9d8a-8768c355f22b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:54.193251 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-27fe71dc-0c4d-41bb-8e72-cc01ee045c3a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] HTTP exception thrown: Instance e5de751e-5f33-4ccd-9d8a-8768c355f22b could not be found. Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-27fe71dc-0c4d-41bb-8e72-cc01ee045c3a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Request method failure captured: Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/e5de751e-5f33-4ccd-9d8a-8768c355f22b/action HTTP/1.1 Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 32 Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPLC312S-Db6Hbszs-aHKFInRy4wRWrLoGf1zGOHlpV0IW-Bs-VN3H-n7b4a73857Kl7ukUqR2-NK4ea_7Kx1bNNXQW0wWm8-W37_gzsLsB5aRRFZYK1QpA2Vpx-uTvY03KAeTP1pWP6w3NvsFIULoaPI8oJ_9Xgb7Qv-01j9pgb6ovg Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 20f2f18eda374a5ba1da2b2f37a3fa7d Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}] Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 20f2f18eda374a5ba1da2b2f37a3fa7d Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-32650119-project Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: a0cfb842f42a468a9f727c43b59138bd Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-32650119-project Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: {"resize": {"flavorRef": "452"}} Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance e5de751e-5f33-4ccd-9d8a-8768c355f22b could not be found. Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'e5de751e-5f33-4ccd-9d8a-8768c355f22b', 'body': {'resize': {'flavorRef': '452'}}} Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5de751e-5f33-4ccd-9d8a-8768c355f22b could not be found. Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:54.197989 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:54.203089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5de751e-5f33-4ccd-9d8a-8768c355f22b could not be found. Oct 04 22:16:54.203089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:54.203089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:54.203089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:54.203089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:54.203089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:54.203089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:54.203089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:54.203089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:54.203089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5de751e-5f33-4ccd-9d8a-8768c355f22b could not be found. Oct 04 22:16:54.203089 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:54.203089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-27fe71dc-0c4d-41bb-8e72-cc01ee045c3a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Returning 404 to user: Instance e5de751e-5f33-4ccd-9d8a-8768c355f22b could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:54.203089 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-27fe71dc-0c4d-41bb-8e72-cc01ee045c3a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "POST /compute/v2.1/servers/e5de751e-5f33-4ccd-9d8a-8768c355f22b/action" status: 404 len: 111 microversion: 2.1 time: 0.016160 Oct 04 22:16:54.203089 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3728/7475] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:16:54 2022] POST /compute/v2.1/servers/e5de751e-5f33-4ccd-9d8a-8768c355f22b/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:16:54.205266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5b5a6fee-d2ba-434b-8121-3afb6e89bbae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:54.205968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5b5a6fee-d2ba-434b-8121-3afb6e89bbae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:54.212261 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b5a6fee-d2ba-434b-8121-3afb6e89bbae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:54.213406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b5a6fee-d2ba-434b-8121-3afb6e89bbae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:54.213894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b5a6fee-d2ba-434b-8121-3afb6e89bbae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:54.214604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b5a6fee-d2ba-434b-8121-3afb6e89bbae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:54.215082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b5a6fee-d2ba-434b-8121-3afb6e89bbae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:54.215531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b5a6fee-d2ba-434b-8121-3afb6e89bbae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:54.347488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5b5a6fee-d2ba-434b-8121-3afb6e89bbae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:54.355446 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5b5a6fee-d2ba-434b-8121-3afb6e89bbae tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1506 microversion: 2.1 time: 0.154530 Oct 04 22:16:54.356037 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3748/7476] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:54 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:54.381213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-797879ad-235e-4cc5-978a-8e81cc079a2a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:54.382073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-797879ad-235e-4cc5-978a-8e81cc079a2a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:54.389366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-797879ad-235e-4cc5-978a-8e81cc079a2a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:54.389880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-797879ad-235e-4cc5-978a-8e81cc079a2a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:54.390323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-797879ad-235e-4cc5-978a-8e81cc079a2a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:54.391008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-797879ad-235e-4cc5-978a-8e81cc079a2a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:54.391460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-797879ad-235e-4cc5-978a-8e81cc079a2a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:54.391886 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-797879ad-235e-4cc5-978a-8e81cc079a2a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:54.394700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=83 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:54.524214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-797879ad-235e-4cc5-978a-8e81cc079a2a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:54.532637 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-797879ad-235e-4cc5-978a-8e81cc079a2a tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1506 microversion: 2.1 time: 0.158442 Oct 04 22:16:54.533210 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3729/7477] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:54 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:54.556173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b7be0f7a-d081-4f0a-a7e9-d6f54abd0741 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "7c1c3a58-d1fa-49df-a1b3-22517c1e3dd8"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:54.558462 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b7be0f7a-d081-4f0a-a7e9-d6f54abd0741 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:54.564601 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7be0f7a-d081-4f0a-a7e9-d6f54abd0741 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:54.565104 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7be0f7a-d081-4f0a-a7e9-d6f54abd0741 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:54.565602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7be0f7a-d081-4f0a-a7e9-d6f54abd0741 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:54.566312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7be0f7a-d081-4f0a-a7e9-d6f54abd0741 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:54.566785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7be0f7a-d081-4f0a-a7e9-d6f54abd0741 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:54.567228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7be0f7a-d081-4f0a-a7e9-d6f54abd0741 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:54.612028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b7be0f7a-d081-4f0a-a7e9-d6f54abd0741 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:54.617321 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-b7be0f7a-d081-4f0a-a7e9-d6f54abd0741 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] HTTP exception thrown: Flavor 7c1c3a58-d1fa-49df-a1b3-22517c1e3dd8 could not be found. Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b7be0f7a-d081-4f0a-a7e9-d6f54abd0741 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Request method failure captured: Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: request: POST /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b/action HTTP/1.1 Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 65 Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPLC312S-Db6Hbszs-aHKFInRy4wRWrLoGf1zGOHlpV0IW-Bs-VN3H-n7b4a73857Kl7ukUqR2-NK4ea_7Kx1bNNXQW0wWm8-W37_gzsLsB5aRRFZYK1QpA2Vpx-uTvY03KAeTP1pWP6w3NvsFIULoaPI8oJ_9Xgb7Qv-01j9pgb6ovg Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 20f2f18eda374a5ba1da2b2f37a3fa7d Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}] Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 20f2f18eda374a5ba1da2b2f37a3fa7d Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-32650119-project Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: a0cfb842f42a468a9f727c43b59138bd Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-32650119-project Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: {"resize": {"flavorRef": "7c1c3a58-d1fa-49df-a1b3-22517c1e3dd8"}} Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: exception: Flavor 7c1c3a58-d1fa-49df-a1b3-22517c1e3dd8 could not be found. Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'f83c7d0b-ea71-4db9-8450-f8cd3670607b', 'body': {'resize': {'flavorRef': '7c1c3a58-d1fa-49df-a1b3-22517c1e3dd8'}}} Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:54.628892 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 7c1c3a58-d1fa-49df-a1b3-22517c1e3dd8 could not be found. Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 7c1c3a58-d1fa-49df-a1b3-22517c1e3dd8 could not be found. Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 7c1c3a58-d1fa-49df-a1b3-22517c1e3dd8 could not be found. Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b7be0f7a-d081-4f0a-a7e9-d6f54abd0741 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Returning 400 to user: Flavor 7c1c3a58-d1fa-49df-a1b3-22517c1e3dd8 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b7be0f7a-d081-4f0a-a7e9-d6f54abd0741 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "POST /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b/action" status: 400 len: 107 microversion: 2.1 time: 0.078327 Oct 04 22:16:54.634083 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3749/7478] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:16:54 2022] POST /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b/action => generated 107 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 22:16:54.640489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5da355a6-5a24-44d9-980c-febf5a0acc74 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:54.641140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5da355a6-5a24-44d9-980c-febf5a0acc74 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:54.647393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5da355a6-5a24-44d9-980c-febf5a0acc74 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:54.647885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5da355a6-5a24-44d9-980c-febf5a0acc74 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:54.648330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5da355a6-5a24-44d9-980c-febf5a0acc74 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:54.653164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5da355a6-5a24-44d9-980c-febf5a0acc74 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:54.654297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5da355a6-5a24-44d9-980c-febf5a0acc74 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:54.654912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5da355a6-5a24-44d9-980c-febf5a0acc74 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:54.794339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5da355a6-5a24-44d9-980c-febf5a0acc74 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:54.802681 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5da355a6-5a24-44d9-980c-febf5a0acc74 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1506 microversion: 2.1 time: 0.167095 Oct 04 22:16:54.803262 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3730/7479] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:54 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:54.825773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5bfab463-ee8f-4423-9919-61310b9eda09 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:54.826449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5bfab463-ee8f-4423-9919-61310b9eda09 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:54.833744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5bfab463-ee8f-4423-9919-61310b9eda09 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:54.834253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5bfab463-ee8f-4423-9919-61310b9eda09 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:54.834718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5bfab463-ee8f-4423-9919-61310b9eda09 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:54.835436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5bfab463-ee8f-4423-9919-61310b9eda09 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:54.835920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5bfab463-ee8f-4423-9919-61310b9eda09 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:54.836372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5bfab463-ee8f-4423-9919-61310b9eda09 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:54.973534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5bfab463-ee8f-4423-9919-61310b9eda09 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:54.985199 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5bfab463-ee8f-4423-9919-61310b9eda09 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1506 microversion: 2.1 time: 0.163421 Oct 04 22:16:54.985816 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3750/7480] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:54 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:55.007549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0ddf4c73-6ccf-44d9-b201-2a6e32f54b65 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0ddf4c73-6ccf-44d9-b201-2a6e32f54b65 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Request method failure captured: Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: request: POST /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b/action HTTP/1.1 Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 29 Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPLC312S-Db6Hbszs-aHKFInRy4wRWrLoGf1zGOHlpV0IW-Bs-VN3H-n7b4a73857Kl7ukUqR2-NK4ea_7Kx1bNNXQW0wWm8-W37_gzsLsB5aRRFZYK1QpA2Vpx-uTvY03KAeTP1pWP6w3NvsFIULoaPI8oJ_9Xgb7Qv-01j9pgb6ovg Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 20f2f18eda374a5ba1da2b2f37a3fa7d Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}] Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 20f2f18eda374a5ba1da2b2f37a3fa7d Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-32650119-project Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: a0cfb842f42a468a9f727c43b59138bd Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-32650119-project Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: {"resize": {"flavorRef": ""}} Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'f83c7d0b-ea71-4db9-8450-f8cd3670607b', 'body': {'resize': {'flavorRef': ''}}} Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise error Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi '' Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:55.011126 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:55.017013 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:55.017013 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:55.017013 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:55.017013 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:55.017013 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 22:16:55.017013 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 22:16:55.017013 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 22:16:55.017013 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:55.017013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0ddf4c73-6ccf-44d9-b201-2a6e32f54b65 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:55.017013 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0ddf4c73-6ccf-44d9-b201-2a6e32f54b65 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "POST /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b/action" status: 400 len: 113 microversion: 2.1 time: 0.009236 Oct 04 22:16:55.017013 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3731/7481] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:16:55 2022] POST /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 22:16:55.021720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a31ccfa1-2cc8-427c-ae0e-406dfe9a0b34 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:55.022366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a31ccfa1-2cc8-427c-ae0e-406dfe9a0b34 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:55.030183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a31ccfa1-2cc8-427c-ae0e-406dfe9a0b34 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:55.030693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a31ccfa1-2cc8-427c-ae0e-406dfe9a0b34 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:55.031163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a31ccfa1-2cc8-427c-ae0e-406dfe9a0b34 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:55.031876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a31ccfa1-2cc8-427c-ae0e-406dfe9a0b34 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:55.032360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a31ccfa1-2cc8-427c-ae0e-406dfe9a0b34 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:55.032815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a31ccfa1-2cc8-427c-ae0e-406dfe9a0b34 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:55.162768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a31ccfa1-2cc8-427c-ae0e-406dfe9a0b34 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:55.170525 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a31ccfa1-2cc8-427c-ae0e-406dfe9a0b34 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1506 microversion: 2.1 time: 0.152560 Oct 04 22:16:55.171103 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3751/7482] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:55 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:55.196792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-00d0f23e-87a2-43f1-9186-1392800f25e9 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:55.197603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-00d0f23e-87a2-43f1-9186-1392800f25e9 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:55.205034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00d0f23e-87a2-43f1-9186-1392800f25e9 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:55.205549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00d0f23e-87a2-43f1-9186-1392800f25e9 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:55.205990 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00d0f23e-87a2-43f1-9186-1392800f25e9 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:55.206679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00d0f23e-87a2-43f1-9186-1392800f25e9 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:55.207136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00d0f23e-87a2-43f1-9186-1392800f25e9 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:55.207564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-00d0f23e-87a2-43f1-9186-1392800f25e9 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:55.221101 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-00d0f23e-87a2-43f1-9186-1392800f25e9 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] HTTP exception thrown: Instance 503b315e-3c87-4212-ab5a-9034ddb41fdb could not be found. Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-00d0f23e-87a2-43f1-9186-1392800f25e9 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Request method failure captured: Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb HTTP/1.1 Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPLC312S-Db6Hbszs-aHKFInRy4wRWrLoGf1zGOHlpV0IW-Bs-VN3H-n7b4a73857Kl7ukUqR2-NK4ea_7Kx1bNNXQW0wWm8-W37_gzsLsB5aRRFZYK1QpA2Vpx-uTvY03KAeTP1pWP6w3NvsFIULoaPI8oJ_9Xgb7Qv-01j9pgb6ovg Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 20f2f18eda374a5ba1da2b2f37a3fa7d Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}] Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 20f2f18eda374a5ba1da2b2f37a3fa7d Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-ServersNegativeTestJSON-32650119-project Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: a0cfb842f42a468a9f727c43b59138bd Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-ServersNegativeTestJSON-32650119-project Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 503b315e-3c87-4212-ab5a-9034ddb41fdb could not be found. Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '503b315e-3c87-4212-ab5a-9034ddb41fdb'} Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 503b315e-3c87-4212-ab5a-9034ddb41fdb could not be found. Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:55.222667 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:55.227261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 503b315e-3c87-4212-ab5a-9034ddb41fdb could not be found. Oct 04 22:16:55.227261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:55.227261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:55.227261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:55.227261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:55.227261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:55.227261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:55.227261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:55.227261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:55.227261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 503b315e-3c87-4212-ab5a-9034ddb41fdb could not be found. Oct 04 22:16:55.227261 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:16:55.227261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-00d0f23e-87a2-43f1-9186-1392800f25e9 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Returning 404 to user: Instance 503b315e-3c87-4212-ab5a-9034ddb41fdb could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:55.227261 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-00d0f23e-87a2-43f1-9186-1392800f25e9 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "DELETE /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb" status: 404 len: 111 microversion: 2.1 time: 0.032383 Oct 04 22:16:55.227261 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3732/7483] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:16:55 2022] DELETE /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:16:55.233012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-75142f99-adc1-4e4c-b75e-5a2144afaabb tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:55.233679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-75142f99-adc1-4e4c-b75e-5a2144afaabb tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: 503b315e-3c87-4212-ab5a-9034ddb41fdb] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:55.239650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75142f99-adc1-4e4c-b75e-5a2144afaabb tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:55.240143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75142f99-adc1-4e4c-b75e-5a2144afaabb tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:55.240592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75142f99-adc1-4e4c-b75e-5a2144afaabb tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:55.241296 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75142f99-adc1-4e4c-b75e-5a2144afaabb tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:55.241797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75142f99-adc1-4e4c-b75e-5a2144afaabb tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:55.242236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75142f99-adc1-4e4c-b75e-5a2144afaabb tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:55.255942 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-75142f99-adc1-4e4c-b75e-5a2144afaabb tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] HTTP exception thrown: Instance 503b315e-3c87-4212-ab5a-9034ddb41fdb could not be found. Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-75142f99-adc1-4e4c-b75e-5a2144afaabb tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Request method failure captured: Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb HTTP/1.1 Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPLC312S-Db6Hbszs-aHKFInRy4wRWrLoGf1zGOHlpV0IW-Bs-VN3H-n7b4a73857Kl7ukUqR2-NK4ea_7Kx1bNNXQW0wWm8-W37_gzsLsB5aRRFZYK1QpA2Vpx-uTvY03KAeTP1pWP6w3NvsFIULoaPI8oJ_9Xgb7Qv-01j9pgb6ovg Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 20f2f18eda374a5ba1da2b2f37a3fa7d Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}] Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 20f2f18eda374a5ba1da2b2f37a3fa7d Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-32650119-project Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: a0cfb842f42a468a9f727c43b59138bd Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-32650119-project Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 503b315e-3c87-4212-ab5a-9034ddb41fdb could not be found. Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '503b315e-3c87-4212-ab5a-9034ddb41fdb'} Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 503b315e-3c87-4212-ab5a-9034ddb41fdb could not be found. Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 503b315e-3c87-4212-ab5a-9034ddb41fdb could not be found. Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:55.257493 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:55.262778 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:55.262778 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:55.262778 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:55.262778 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:55.262778 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:55.262778 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 503b315e-3c87-4212-ab5a-9034ddb41fdb could not be found. Oct 04 22:16:55.262778 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:55.262778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-75142f99-adc1-4e4c-b75e-5a2144afaabb tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Returning 404 to user: Instance 503b315e-3c87-4212-ab5a-9034ddb41fdb could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:55.262778 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-75142f99-adc1-4e4c-b75e-5a2144afaabb tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb" status: 404 len: 111 microversion: 2.1 time: 0.029746 Oct 04 22:16:55.262778 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3752/7484] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:55 2022] GET /compute/v2.1/servers/503b315e-3c87-4212-ab5a-9034ddb41fdb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:16:55.268718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3724270d-2174-46cd-a7ae-812bd7690293 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:55.269321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3724270d-2174-46cd-a7ae-812bd7690293 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:55.275366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3724270d-2174-46cd-a7ae-812bd7690293 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:55.275853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3724270d-2174-46cd-a7ae-812bd7690293 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:55.276296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3724270d-2174-46cd-a7ae-812bd7690293 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:55.276987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3724270d-2174-46cd-a7ae-812bd7690293 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:55.277479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3724270d-2174-46cd-a7ae-812bd7690293 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:55.277900 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3724270d-2174-46cd-a7ae-812bd7690293 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:55.303122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3724270d-2174-46cd-a7ae-812bd7690293 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:16:55.554080 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3724270d-2174-46cd-a7ae-812bd7690293 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 204 len: 0 microversion: 2.1 time: 0.288891 Oct 04 22:16:55.554691 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3733/7485] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:16:55 2022] DELETE /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:16:55.563467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a1a73574-368c-4dd8-b577-7319c992d7c7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:55.565139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a1a73574-368c-4dd8-b577-7319c992d7c7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:55.570278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1a73574-368c-4dd8-b577-7319c992d7c7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:55.570782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1a73574-368c-4dd8-b577-7319c992d7c7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:55.571233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1a73574-368c-4dd8-b577-7319c992d7c7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:55.571931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1a73574-368c-4dd8-b577-7319c992d7c7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:55.572401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1a73574-368c-4dd8-b577-7319c992d7c7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:55.572844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1a73574-368c-4dd8-b577-7319c992d7c7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:55.708047 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a1a73574-368c-4dd8-b577-7319c992d7c7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:55.715874 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a1a73574-368c-4dd8-b577-7319c992d7c7 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1512 microversion: 2.1 time: 0.156965 Oct 04 22:16:55.716473 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3753/7486] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:55 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:56.739767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-da17d8a8-d7f3-45be-93c3-079578f8c396 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:56.740478 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-da17d8a8-d7f3-45be-93c3-079578f8c396 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:56.747270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-da17d8a8-d7f3-45be-93c3-079578f8c396 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:56.748348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-da17d8a8-d7f3-45be-93c3-079578f8c396 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:56.748790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-da17d8a8-d7f3-45be-93c3-079578f8c396 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:56.750249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-da17d8a8-d7f3-45be-93c3-079578f8c396 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:56.750710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-da17d8a8-d7f3-45be-93c3-079578f8c396 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:56.751505 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-da17d8a8-d7f3-45be-93c3-079578f8c396 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:56.881340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-da17d8a8-d7f3-45be-93c3-079578f8c396 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:56.890113 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-da17d8a8-d7f3-45be-93c3-079578f8c396 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1512 microversion: 2.1 time: 0.154910 Oct 04 22:16:56.890692 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3734/7487] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:56 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:57.396596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-f5c9efc6-91e7-49d7-8372-92578129abfd req-274057a1-6f85-4b22-bc19-eb20ba9dce54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83c7d0b-ea71-4db9-8450-f8cd3670607b", "name": "network-vif-deleted", "tag": "feb2134c-e6a4-4685-9aa2-7ad86b7eb186"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:57.403671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:57.407643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f5c9efc6-91e7-49d7-8372-92578129abfd req-274057a1-6f85-4b22-bc19-eb20ba9dce54 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:57.408436 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f5c9efc6-91e7-49d7-8372-92578129abfd req-274057a1-6f85-4b22-bc19-eb20ba9dce54 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:57.408590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f5c9efc6-91e7-49d7-8372-92578129abfd req-274057a1-6f85-4b22-bc19-eb20ba9dce54 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:57.421236 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-f5c9efc6-91e7-49d7-8372-92578129abfd req-274057a1-6f85-4b22-bc19-eb20ba9dce54 service nova] Creating event network-vif-deleted:feb2134c-e6a4-4685-9aa2-7ad86b7eb186 for instance f83c7d0b-ea71-4db9-8450-f8cd3670607b on n-h1-860282-1 Oct 04 22:16:57.426568 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-f5c9efc6-91e7-49d7-8372-92578129abfd req-274057a1-6f85-4b22-bc19-eb20ba9dce54 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033663 Oct 04 22:16:57.427182 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3754/7488] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:16:57.913494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dfd43539-9fbe-4347-bc26-575e409cb9a2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:57.914113 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dfd43539-9fbe-4347-bc26-575e409cb9a2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:57.921652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd43539-9fbe-4347-bc26-575e409cb9a2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:57.922151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd43539-9fbe-4347-bc26-575e409cb9a2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:57.922590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd43539-9fbe-4347-bc26-575e409cb9a2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:57.923284 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd43539-9fbe-4347-bc26-575e409cb9a2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:57.923741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd43539-9fbe-4347-bc26-575e409cb9a2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:57.924170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd43539-9fbe-4347-bc26-575e409cb9a2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:57.954135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd43539-9fbe-4347-bc26-575e409cb9a2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:57.954614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd43539-9fbe-4347-bc26-575e409cb9a2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:57.955050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd43539-9fbe-4347-bc26-575e409cb9a2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:57.955495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-dfd43539-9fbe-4347-bc26-575e409cb9a2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lazy-loading 'fault' on Instance uuid f83c7d0b-ea71-4db9-8450-f8cd3670607b {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:16:57.996206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dfd43539-9fbe-4347-bc26-575e409cb9a2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0cfb842f42a468a9f727c43b59138bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2f18eda374a5ba1da2b2f37a3fa7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:58.004154 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dfd43539-9fbe-4347-bc26-575e409cb9a2 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 200 len: 1307 microversion: 2.1 time: 0.094602 Oct 04 22:16:58.004733 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3735/7489] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:57 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:59.029575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8509ae60-ec7e-472d-bf68-bdcd556cdcc5 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:59.030306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8509ae60-ec7e-472d-bf68-bdcd556cdcc5 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] [instance: f83c7d0b-ea71-4db9-8450-f8cd3670607b] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:59.037051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8509ae60-ec7e-472d-bf68-bdcd556cdcc5 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:59.037613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8509ae60-ec7e-472d-bf68-bdcd556cdcc5 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:59.038073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8509ae60-ec7e-472d-bf68-bdcd556cdcc5 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:59.038779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8509ae60-ec7e-472d-bf68-bdcd556cdcc5 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:59.039251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8509ae60-ec7e-472d-bf68-bdcd556cdcc5 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:59.039696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8509ae60-ec7e-472d-bf68-bdcd556cdcc5 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:59.053662 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-8509ae60-ec7e-472d-bf68-bdcd556cdcc5 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] HTTP exception thrown: Instance f83c7d0b-ea71-4db9-8450-f8cd3670607b could not be found. Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8509ae60-ec7e-472d-bf68-bdcd556cdcc5 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Request method failure captured: Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b HTTP/1.1 Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPLC312S-Db6Hbszs-aHKFInRy4wRWrLoGf1zGOHlpV0IW-Bs-VN3H-n7b4a73857Kl7ukUqR2-NK4ea_7Kx1bNNXQW0wWm8-W37_gzsLsB5aRRFZYK1QpA2Vpx-uTvY03KAeTP1pWP6w3NvsFIULoaPI8oJ_9Xgb7Qv-01j9pgb6ovg Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 20f2f18eda374a5ba1da2b2f37a3fa7d Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/20f2f18eda374a5ba1da2b2f37a3fa7d"}]}] Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 20f2f18eda374a5ba1da2b2f37a3fa7d Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-ServersNegativeTestJSON-32650119 Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-ServersNegativeTestJSON-32650119-project Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: a0cfb842f42a468a9f727c43b59138bd Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-ServersNegativeTestJSON-32650119-project Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance f83c7d0b-ea71-4db9-8450-f8cd3670607b could not be found. Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': 'f83c7d0b-ea71-4db9-8450-f8cd3670607b'} Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f83c7d0b-ea71-4db9-8450-f8cd3670607b could not be found. Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f83c7d0b-ea71-4db9-8450-f8cd3670607b could not be found. Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:59.055326 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:59.059573 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:59.059573 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:59.059573 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:59.059573 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:59.059573 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:59.059573 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f83c7d0b-ea71-4db9-8450-f8cd3670607b could not be found. Oct 04 22:16:59.059573 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:16:59.059573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8509ae60-ec7e-472d-bf68-bdcd556cdcc5 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] Returning 404 to user: Instance f83c7d0b-ea71-4db9-8450-f8cd3670607b could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:59.059573 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8509ae60-ec7e-472d-bf68-bdcd556cdcc5 tempest-ServersNegativeTestJSON-32650119 tempest-ServersNegativeTestJSON-32650119-project] 10.222.0.30 "GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b" status: 404 len: 111 microversion: 2.1 time: 0.032523 Oct 04 22:16:59.059573 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3755/7490] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:59 2022] GET /compute/v2.1/servers/f83c7d0b-ea71-4db9-8450-f8cd3670607b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:17:42.130832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:17:42.131647 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:17:42.301061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cc8dcb59-1310-487e-a98b-bfc898537295 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Action: 'create', calling method: .version_select at 0x7f578abf1f70>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-812991867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYaBM3GjSBu9Lwd1vgMHZF/fBGFJw4ftjpAurEX6CGupN3KHre+TDLGZaD/d1G62pYB6URFMXf2oM3moozftKDBeGk3dp+cELbmol93WM8bmHypF9LLVUVy8cC5mmR+YQ=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:42.319010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-cc8dcb59-1310-487e-a98b-bfc898537295 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Getting quotas for project 76c9a0ad4e82496ab61a251cbcb0a04c. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:17:42.324483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-cc8dcb59-1310-487e-a98b-bfc898537295 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Getting quotas for user e2342ae39a8542fa84bc9662e5764dd9 and project 76c9a0ad4e82496ab61a251cbcb0a04c. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:17:42.415891 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cc8dcb59-1310-487e-a98b-bfc898537295 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.288507 Oct 04 22:17:42.415891 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3736/7491] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 22:17:42 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:17:42.472244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-10562821-aa3c-4e36-b14f-5e12ea5d386f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-342593211", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-812991867", "networks": [{"uuid": "b6bd29e5-059f-4d08-ab27-3eff5e9e71d2"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:42.482659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=36 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:17:42.543604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-10562821-aa3c-4e36-b14f-5e12ea5d386f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] validate_networks() for [('b6bd29e5-059f-4d08-ab27-3eff5e9e71d2', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:17:42.972127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-10562821-aa3c-4e36-b14f-5e12ea5d386f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:17:42.972579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-10562821-aa3c-4e36-b14f-5e12ea5d386f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:17:42.973073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-10562821-aa3c-4e36-b14f-5e12ea5d386f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:17:42.973539 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-10562821-aa3c-4e36-b14f-5e12ea5d386f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:17:42.973969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-10562821-aa3c-4e36-b14f-5e12ea5d386f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:17:42.982950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10562821-aa3c-4e36-b14f-5e12ea5d386f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:42.983447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10562821-aa3c-4e36-b14f-5e12ea5d386f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:42.983896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10562821-aa3c-4e36-b14f-5e12ea5d386f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:42.984630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10562821-aa3c-4e36-b14f-5e12ea5d386f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:42.985689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10562821-aa3c-4e36-b14f-5e12ea5d386f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:42.986132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10562821-aa3c-4e36-b14f-5e12ea5d386f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:43.014615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-10562821-aa3c-4e36-b14f-5e12ea5d386f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Getting quotas for project 76c9a0ad4e82496ab61a251cbcb0a04c. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:17:43.026768 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-10562821-aa3c-4e36-b14f-5e12ea5d386f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Getting quotas for user e2342ae39a8542fa84bc9662e5764dd9 and project 76c9a0ad4e82496ab61a251cbcb0a04c. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:17:43.041936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-10562821-aa3c-4e36-b14f-5e12ea5d386f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:17:43.044369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-10562821-aa3c-4e36-b14f-5e12ea5d386f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:17:43.148132 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-10562821-aa3c-4e36-b14f-5e12ea5d386f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681421 Oct 04 22:17:43.148809 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3756/7492] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:17:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:17:43.161673 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ab324c8a-8303-428f-83e3-7440c3829a99 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:43.162917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ab324c8a-8303-428f-83e3-7440c3829a99 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:43.221412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ab324c8a-8303-428f-83e3-7440c3829a99 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:43.233150 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ab324c8a-8303-428f-83e3-7440c3829a99 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e" status: 200 len: 1261 microversion: 2.1 time: 0.076907 Oct 04 22:17:43.238713 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3737/7493] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:43 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e => generated 1261 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:44.257109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e07b153b-f650-4d02-953e-a97f7a279e57 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:44.257664 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e07b153b-f650-4d02-953e-a97f7a279e57 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:44.265020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e07b153b-f650-4d02-953e-a97f7a279e57 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:44.265596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e07b153b-f650-4d02-953e-a97f7a279e57 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:44.266071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e07b153b-f650-4d02-953e-a97f7a279e57 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:44.267583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e07b153b-f650-4d02-953e-a97f7a279e57 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:44.268059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e07b153b-f650-4d02-953e-a97f7a279e57 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:44.268503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e07b153b-f650-4d02-953e-a97f7a279e57 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:44.334489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e07b153b-f650-4d02-953e-a97f7a279e57 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:44.342394 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e07b153b-f650-4d02-953e-a97f7a279e57 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e" status: 200 len: 1265 microversion: 2.1 time: 0.089793 Oct 04 22:17:44.342976 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3757/7494] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:44 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:45.366343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9de62e49-32e7-4f72-9d42-5721ea4d5471 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:45.366972 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9de62e49-32e7-4f72-9d42-5721ea4d5471 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:45.373261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9de62e49-32e7-4f72-9d42-5721ea4d5471 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:45.373825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9de62e49-32e7-4f72-9d42-5721ea4d5471 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:45.374300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9de62e49-32e7-4f72-9d42-5721ea4d5471 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:45.375105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9de62e49-32e7-4f72-9d42-5721ea4d5471 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:45.375809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9de62e49-32e7-4f72-9d42-5721ea4d5471 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:45.376535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9de62e49-32e7-4f72-9d42-5721ea4d5471 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:45.444119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9de62e49-32e7-4f72-9d42-5721ea4d5471 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:45.452480 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9de62e49-32e7-4f72-9d42-5721ea4d5471 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e" status: 200 len: 1321 microversion: 2.1 time: 0.090567 Oct 04 22:17:45.453127 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3738/7495] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:45 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e => generated 1321 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:17:46.477731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4a643613-4ea0-4bf0-a41c-7d357323f006 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:46.479145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4a643613-4ea0-4bf0-a41c-7d357323f006 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:46.490791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a643613-4ea0-4bf0-a41c-7d357323f006 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:46.491701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a643613-4ea0-4bf0-a41c-7d357323f006 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:46.492394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a643613-4ea0-4bf0-a41c-7d357323f006 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:46.493519 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a643613-4ea0-4bf0-a41c-7d357323f006 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:46.494233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a643613-4ea0-4bf0-a41c-7d357323f006 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:46.494949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4a643613-4ea0-4bf0-a41c-7d357323f006 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:46.667309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4a643613-4ea0-4bf0-a41c-7d357323f006 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:46.675938 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4a643613-4ea0-4bf0-a41c-7d357323f006 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e" status: 200 len: 1361 microversion: 2.1 time: 0.202626 Oct 04 22:17:46.689592 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3758/7496] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:46 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:47.409066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-2d4d5c0a-642f-4e71-90ef-f937cb706d89 req-258c0a4c-7724-4ad8-a113-fb983fdf387a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e", "tag": "719bf065-3483-4b18-a0f9-b33969ee8ea1"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:47.419114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2d4d5c0a-642f-4e71-90ef-f937cb706d89 req-258c0a4c-7724-4ad8-a113-fb983fdf387a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:47.419870 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2d4d5c0a-642f-4e71-90ef-f937cb706d89 req-258c0a4c-7724-4ad8-a113-fb983fdf387a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:47.420300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2d4d5c0a-642f-4e71-90ef-f937cb706d89 req-258c0a4c-7724-4ad8-a113-fb983fdf387a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:47.432676 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-2d4d5c0a-642f-4e71-90ef-f937cb706d89 req-258c0a4c-7724-4ad8-a113-fb983fdf387a service nova] Creating event network-changed:719bf065-3483-4b18-a0f9-b33969ee8ea1 for instance ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e on n-h1-860282-1 Oct 04 22:17:47.438280 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-2d4d5c0a-642f-4e71-90ef-f937cb706d89 req-258c0a4c-7724-4ad8-a113-fb983fdf387a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115864 Oct 04 22:17:47.439522 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3739/7497] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:17:47.700147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c5b58d78-0928-45f0-9ade-29f7136e65ae tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:47.702898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c5b58d78-0928-45f0-9ade-29f7136e65ae tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:47.710384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5b58d78-0928-45f0-9ade-29f7136e65ae tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:47.711035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5b58d78-0928-45f0-9ade-29f7136e65ae tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:47.711370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5b58d78-0928-45f0-9ade-29f7136e65ae tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:47.712108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5b58d78-0928-45f0-9ade-29f7136e65ae tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:47.712588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5b58d78-0928-45f0-9ade-29f7136e65ae tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:47.713042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c5b58d78-0928-45f0-9ade-29f7136e65ae tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:47.858015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c5b58d78-0928-45f0-9ade-29f7136e65ae tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:47.866963 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c5b58d78-0928-45f0-9ade-29f7136e65ae tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e" status: 200 len: 1361 microversion: 2.1 time: 0.170648 Oct 04 22:17:47.867565 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3759/7498] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:47 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:48.891143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-45e1de49-6042-4e3b-afe0-c06a03d047f9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:48.892418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-45e1de49-6042-4e3b-afe0-c06a03d047f9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:48.899560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45e1de49-6042-4e3b-afe0-c06a03d047f9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:48.900051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45e1de49-6042-4e3b-afe0-c06a03d047f9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:48.900489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45e1de49-6042-4e3b-afe0-c06a03d047f9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:48.901190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45e1de49-6042-4e3b-afe0-c06a03d047f9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:48.901676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45e1de49-6042-4e3b-afe0-c06a03d047f9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:48.902106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-45e1de49-6042-4e3b-afe0-c06a03d047f9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:49.040597 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-45e1de49-6042-4e3b-afe0-c06a03d047f9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:49.049253 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-45e1de49-6042-4e3b-afe0-c06a03d047f9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e" status: 200 len: 1361 microversion: 2.1 time: 0.162349 Oct 04 22:17:49.049869 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3740/7499] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:48 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:17:50.072385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cf8f9b52-7def-4332-a434-984ba74af1e1 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:50.073022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cf8f9b52-7def-4332-a434-984ba74af1e1 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:50.080922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf8f9b52-7def-4332-a434-984ba74af1e1 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:50.081441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf8f9b52-7def-4332-a434-984ba74af1e1 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:50.081913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf8f9b52-7def-4332-a434-984ba74af1e1 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:50.082631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf8f9b52-7def-4332-a434-984ba74af1e1 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:50.083114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf8f9b52-7def-4332-a434-984ba74af1e1 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:50.083562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf8f9b52-7def-4332-a434-984ba74af1e1 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:50.211054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cf8f9b52-7def-4332-a434-984ba74af1e1 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:50.218819 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cf8f9b52-7def-4332-a434-984ba74af1e1 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e" status: 200 len: 1361 microversion: 2.1 time: 0.150332 Oct 04 22:17:50.219408 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3760/7500] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:50 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:51.241809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ab123f2a-529a-44de-b14e-d14acd18e7e8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:51.242427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ab123f2a-529a-44de-b14e-d14acd18e7e8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:51.249387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab123f2a-529a-44de-b14e-d14acd18e7e8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:51.249903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab123f2a-529a-44de-b14e-d14acd18e7e8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:51.250344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab123f2a-529a-44de-b14e-d14acd18e7e8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:51.251153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab123f2a-529a-44de-b14e-d14acd18e7e8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:51.251611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab123f2a-529a-44de-b14e-d14acd18e7e8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:51.252038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ab123f2a-529a-44de-b14e-d14acd18e7e8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:51.392473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ab123f2a-529a-44de-b14e-d14acd18e7e8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:51.400132 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ab123f2a-529a-44de-b14e-d14acd18e7e8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e" status: 200 len: 1361 microversion: 2.1 time: 0.162277 Oct 04 22:17:51.400699 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3741/7501] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:51 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:52.424240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-30ecb0b1-0401-490d-bb7f-ab13b65004d6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:52.424867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-30ecb0b1-0401-490d-bb7f-ab13b65004d6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:52.431698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30ecb0b1-0401-490d-bb7f-ab13b65004d6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:52.432257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30ecb0b1-0401-490d-bb7f-ab13b65004d6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:52.432708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30ecb0b1-0401-490d-bb7f-ab13b65004d6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:52.433406 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30ecb0b1-0401-490d-bb7f-ab13b65004d6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:52.433896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30ecb0b1-0401-490d-bb7f-ab13b65004d6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:52.434383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30ecb0b1-0401-490d-bb7f-ab13b65004d6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:52.566502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-30ecb0b1-0401-490d-bb7f-ab13b65004d6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:52.574202 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-30ecb0b1-0401-490d-bb7f-ab13b65004d6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e" status: 200 len: 1361 microversion: 2.1 time: 0.153970 Oct 04 22:17:52.574772 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3761/7502] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:52 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:53.597984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f77b9374-ad93-43c5-aca0-0f52d2bdbd51 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:53.598635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f77b9374-ad93-43c5-aca0-0f52d2bdbd51 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:53.601510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:17:53.606290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f77b9374-ad93-43c5-aca0-0f52d2bdbd51 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:53.611324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f77b9374-ad93-43c5-aca0-0f52d2bdbd51 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:53.611324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f77b9374-ad93-43c5-aca0-0f52d2bdbd51 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:53.611324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f77b9374-ad93-43c5-aca0-0f52d2bdbd51 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:53.611324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f77b9374-ad93-43c5-aca0-0f52d2bdbd51 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:53.611324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f77b9374-ad93-43c5-aca0-0f52d2bdbd51 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:53.646006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:17:53.646882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:17:53.713118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-2e6768c7-b20e-434c-91e6-45359cd646e0 req-75850ab8-ade0-4c86-9dc4-51d4e05e2b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e", "name": "network-vif-plugged", "status": "completed", "tag": "719bf065-3483-4b18-a0f9-b33969ee8ea1"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:53.723696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2e6768c7-b20e-434c-91e6-45359cd646e0 req-75850ab8-ade0-4c86-9dc4-51d4e05e2b0e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:53.724283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2e6768c7-b20e-434c-91e6-45359cd646e0 req-75850ab8-ade0-4c86-9dc4-51d4e05e2b0e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:53.724739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2e6768c7-b20e-434c-91e6-45359cd646e0 req-75850ab8-ade0-4c86-9dc4-51d4e05e2b0e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:53.736377 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-2e6768c7-b20e-434c-91e6-45359cd646e0 req-75850ab8-ade0-4c86-9dc4-51d4e05e2b0e service nova] Creating event network-vif-plugged:719bf065-3483-4b18-a0f9-b33969ee8ea1 for instance ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e on n-h1-860282-1 Oct 04 22:17:53.741553 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-2e6768c7-b20e-434c-91e6-45359cd646e0 req-75850ab8-ade0-4c86-9dc4-51d4e05e2b0e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100278 Oct 04 22:17:53.742337 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3762/7503] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:17:53.751892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f77b9374-ad93-43c5-aca0-0f52d2bdbd51 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:53.760718 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f77b9374-ad93-43c5-aca0-0f52d2bdbd51 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e" status: 200 len: 1361 microversion: 2.1 time: 0.166609 Oct 04 22:17:53.761925 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3742/7504] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:53 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:54.785235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-893632d6-863b-4cf5-91bf-d21bbcd7bcfb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:54.786145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-893632d6-863b-4cf5-91bf-d21bbcd7bcfb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:54.793760 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-893632d6-863b-4cf5-91bf-d21bbcd7bcfb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:54.794240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-893632d6-863b-4cf5-91bf-d21bbcd7bcfb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:54.794704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-893632d6-863b-4cf5-91bf-d21bbcd7bcfb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:54.795426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-893632d6-863b-4cf5-91bf-d21bbcd7bcfb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:54.795928 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-893632d6-863b-4cf5-91bf-d21bbcd7bcfb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:54.796386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-893632d6-863b-4cf5-91bf-d21bbcd7bcfb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:54.932534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-893632d6-863b-4cf5-91bf-d21bbcd7bcfb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:54.940609 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-893632d6-863b-4cf5-91bf-d21bbcd7bcfb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e" status: 200 len: 1361 microversion: 2.1 time: 0.160057 Oct 04 22:17:54.941225 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3763/7505] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:54 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:55.965340 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6ff4113b-5453-4a99-8281-87a70ac0d356 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:55.966016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6ff4113b-5453-4a99-8281-87a70ac0d356 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:55.972970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ff4113b-5453-4a99-8281-87a70ac0d356 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:55.973487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ff4113b-5453-4a99-8281-87a70ac0d356 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:55.973933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ff4113b-5453-4a99-8281-87a70ac0d356 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:55.974629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ff4113b-5453-4a99-8281-87a70ac0d356 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:55.975097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ff4113b-5453-4a99-8281-87a70ac0d356 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:55.975530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ff4113b-5453-4a99-8281-87a70ac0d356 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:56.103941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6ff4113b-5453-4a99-8281-87a70ac0d356 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:56.112345 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6ff4113b-5453-4a99-8281-87a70ac0d356 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e" status: 200 len: 1553 microversion: 2.1 time: 0.150882 Oct 04 22:17:56.112934 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3743/7506] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:55 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:56.134463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3b722393-069d-4a0d-8544-55abfc6f2707 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:56.135116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3b722393-069d-4a0d-8544-55abfc6f2707 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:56.143206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b722393-069d-4a0d-8544-55abfc6f2707 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:56.143978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b722393-069d-4a0d-8544-55abfc6f2707 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:56.144439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b722393-069d-4a0d-8544-55abfc6f2707 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:56.145138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b722393-069d-4a0d-8544-55abfc6f2707 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:56.145637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b722393-069d-4a0d-8544-55abfc6f2707 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:56.146077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3b722393-069d-4a0d-8544-55abfc6f2707 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:56.280824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3b722393-069d-4a0d-8544-55abfc6f2707 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:56.289302 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3b722393-069d-4a0d-8544-55abfc6f2707 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e" status: 200 len: 1553 microversion: 2.1 time: 0.158743 Oct 04 22:17:56.289916 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3764/7507] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:56 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:59.409097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0e2aff19-5a66-4306-bf0a-49cc7df7b736 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e72d0924-8f04-4bde-b0bb-37b1925fdc80"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:59.411530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0e2aff19-5a66-4306-bf0a-49cc7df7b736 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:59.418400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e2aff19-5a66-4306-bf0a-49cc7df7b736 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:59.418877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e2aff19-5a66-4306-bf0a-49cc7df7b736 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:59.419313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e2aff19-5a66-4306-bf0a-49cc7df7b736 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:59.419996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e2aff19-5a66-4306-bf0a-49cc7df7b736 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:59.420448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e2aff19-5a66-4306-bf0a-49cc7df7b736 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:59.420871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0e2aff19-5a66-4306-bf0a-49cc7df7b736 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:00.122603 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0e2aff19-5a66-4306-bf0a-49cc7df7b736 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "POST /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.717976 Oct 04 22:18:00.123255 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3744/7508] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 22:17:59 2022] POST /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e/os-volume_attachments => generated 194 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:11.884817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-409f4500-8ddd-447e-a879-1bdddabda2f4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:11.885337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-409f4500-8ddd-447e-a879-1bdddabda2f4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:11.889743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:11.890465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=46 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:11.895832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-409f4500-8ddd-447e-a879-1bdddabda2f4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:11.896301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-409f4500-8ddd-447e-a879-1bdddabda2f4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:11.898665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-409f4500-8ddd-447e-a879-1bdddabda2f4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:11.898665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-409f4500-8ddd-447e-a879-1bdddabda2f4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:11.898665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-409f4500-8ddd-447e-a879-1bdddabda2f4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:11.898665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-409f4500-8ddd-447e-a879-1bdddabda2f4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:11.979114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-409f4500-8ddd-447e-a879-1bdddabda2f4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lazy-loading 'services' on Instance uuid ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:18:12.174458 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-409f4500-8ddd-447e-a879-1bdddabda2f4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e/os-volume_attachments/e72d0924-8f04-4bde-b0bb-37b1925fdc80" status: 202 len: 0 microversion: 2.1 time: 0.293576 Oct 04 22:18:12.175417 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3765/7509] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 22:18:11 2022] DELETE /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e/os-volume_attachments/e72d0924-8f04-4bde-b0bb-37b1925fdc80 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:18:12.183065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:12.183851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:12.188098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5c53e8fb-3154-431d-858b-5dfbd7dcdcfb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:12.190473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5c53e8fb-3154-431d-858b-5dfbd7dcdcfb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:12.197655 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c53e8fb-3154-431d-858b-5dfbd7dcdcfb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:12.198147 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c53e8fb-3154-431d-858b-5dfbd7dcdcfb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:12.198595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c53e8fb-3154-431d-858b-5dfbd7dcdcfb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:12.199329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c53e8fb-3154-431d-858b-5dfbd7dcdcfb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:12.199793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c53e8fb-3154-431d-858b-5dfbd7dcdcfb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:12.200228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5c53e8fb-3154-431d-858b-5dfbd7dcdcfb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:12.230772 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5c53e8fb-3154-431d-858b-5dfbd7dcdcfb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050164 Oct 04 22:18:12.231374 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3745/7510] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:18:12 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:13.244381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5fd25e55-d694-4004-a4ba-772a3c1fe5d4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:13.246883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5fd25e55-d694-4004-a4ba-772a3c1fe5d4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:13.253933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fd25e55-d694-4004-a4ba-772a3c1fe5d4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:13.254969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fd25e55-d694-4004-a4ba-772a3c1fe5d4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:13.255423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fd25e55-d694-4004-a4ba-772a3c1fe5d4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:13.256134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fd25e55-d694-4004-a4ba-772a3c1fe5d4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:13.256598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fd25e55-d694-4004-a4ba-772a3c1fe5d4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:13.257035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5fd25e55-d694-4004-a4ba-772a3c1fe5d4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:13.287995 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5fd25e55-d694-4004-a4ba-772a3c1fe5d4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047996 Oct 04 22:18:13.288567 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3766/7511] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:18:13 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:14.300337 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6f2245ab-de48-47ff-bdf2-c756f8b60eac tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:14.302519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6f2245ab-de48-47ff-bdf2-c756f8b60eac tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:14.310666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f2245ab-de48-47ff-bdf2-c756f8b60eac tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:14.311213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f2245ab-de48-47ff-bdf2-c756f8b60eac tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:14.311649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f2245ab-de48-47ff-bdf2-c756f8b60eac tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:14.312355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f2245ab-de48-47ff-bdf2-c756f8b60eac tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:14.312796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f2245ab-de48-47ff-bdf2-c756f8b60eac tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:14.313223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6f2245ab-de48-47ff-bdf2-c756f8b60eac tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:14.344272 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6f2245ab-de48-47ff-bdf2-c756f8b60eac tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047750 Oct 04 22:18:14.344897 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3746/7512] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:18:14 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:15.358091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b04ddbff-db16-4a61-af0c-96b107e42dee tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:15.360295 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b04ddbff-db16-4a61-af0c-96b107e42dee tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:15.367080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b04ddbff-db16-4a61-af0c-96b107e42dee tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:15.367565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b04ddbff-db16-4a61-af0c-96b107e42dee tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:15.368023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b04ddbff-db16-4a61-af0c-96b107e42dee tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:15.368742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b04ddbff-db16-4a61-af0c-96b107e42dee tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:15.369220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b04ddbff-db16-4a61-af0c-96b107e42dee tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:15.369704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b04ddbff-db16-4a61-af0c-96b107e42dee tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:15.403704 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b04ddbff-db16-4a61-af0c-96b107e42dee tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049885 Oct 04 22:18:15.404291 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3767/7513] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:18:15 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:16.416756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2e5a68b7-3fd0-466f-815b-6d052a6d0f08 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:16.419009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2e5a68b7-3fd0-466f-815b-6d052a6d0f08 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:16.426287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e5a68b7-3fd0-466f-815b-6d052a6d0f08 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:16.426869 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e5a68b7-3fd0-466f-815b-6d052a6d0f08 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:16.427309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e5a68b7-3fd0-466f-815b-6d052a6d0f08 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:16.428005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e5a68b7-3fd0-466f-815b-6d052a6d0f08 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:16.428462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e5a68b7-3fd0-466f-815b-6d052a6d0f08 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:16.428889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e5a68b7-3fd0-466f-815b-6d052a6d0f08 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:16.459742 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2e5a68b7-3fd0-466f-815b-6d052a6d0f08 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046932 Oct 04 22:18:16.460322 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3747/7514] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:18:16 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:17.471907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-79e943f9-2ec8-490f-9d77-d125551d6e1c tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:17.474155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-79e943f9-2ec8-490f-9d77-d125551d6e1c tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:17.481145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79e943f9-2ec8-490f-9d77-d125551d6e1c tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:17.481689 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79e943f9-2ec8-490f-9d77-d125551d6e1c tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:17.482150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79e943f9-2ec8-490f-9d77-d125551d6e1c tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:17.482867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79e943f9-2ec8-490f-9d77-d125551d6e1c tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:17.483346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79e943f9-2ec8-490f-9d77-d125551d6e1c tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:17.483845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79e943f9-2ec8-490f-9d77-d125551d6e1c tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:17.514830 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-79e943f9-2ec8-490f-9d77-d125551d6e1c tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047000 Oct 04 22:18:17.515401 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3768/7515] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:18:17 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:18:17.526570 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6a2419da-132b-4499-a8e6-dde741146b27 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:17.527088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6a2419da-132b-4499-a8e6-dde741146b27 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:17.534409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a2419da-132b-4499-a8e6-dde741146b27 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:17.534905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a2419da-132b-4499-a8e6-dde741146b27 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:17.535351 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a2419da-132b-4499-a8e6-dde741146b27 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:17.536089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a2419da-132b-4499-a8e6-dde741146b27 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:17.536544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a2419da-132b-4499-a8e6-dde741146b27 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:17.536970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6a2419da-132b-4499-a8e6-dde741146b27 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:17.611173 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-6a2419da-132b-4499-a8e6-dde741146b27 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] HTTP exception thrown: Instance ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e is not attached to volume e72d0924-8f04-4bde-b0bb-37b1925fdc80 Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6a2419da-132b-4499-a8e6-dde741146b27 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Request method failure captured: Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e/os-volume_attachments/e72d0924-8f04-4bde-b0bb-37b1925fdc80 HTTP/1.1 Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPLEAvyBEdHzKQjPFxv2VzOeLNMb4jnXYES8tcLINHK7ri-sHBSnj97gWSWg0EyCavx447Mmh13WVZ1paS5xdLy9znsL853tESqAKjIwo_A0H3gSafcxRhkA0TNopp_XmDu0wubw4xDYVaRmqX8r3KMAKus17S2cwPqtmsm68KeISBpA Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 76c9a0ad4e82496ab61a251cbcb0a04c Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestEncryptedCinderVolumes-900665055 Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76c9a0ad4e82496ab61a251cbcb0a04c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_76c9a0ad4e82496ab61a251cbcb0a04c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/76c9a0ad4e82496ab61a251cbcb0a04c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76c9a0ad4e82496ab61a251cbcb0a04c"}]}] Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestEncryptedCinderVolumes-900665055 Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 76c9a0ad4e82496ab61a251cbcb0a04c Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-900665055 Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestEncryptedCinderVolumes-900665055-project Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: e2342ae39a8542fa84bc9662e5764dd9 Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestEncryptedCinderVolumes-900665055-project Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e is not attached to volume e72d0924-8f04-4bde-b0bb-37b1925fdc80 Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'server_id': 'ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e', 'id': 'e72d0924-8f04-4bde-b0bb-37b1925fdc80'} Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e72d0924-8f04-4bde-b0bb-37b1925fdc80. Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e is not attached to volume e72d0924-8f04-4bde-b0bb-37b1925fdc80 Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:18:17.621357 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:18:17.626335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:18:17.626335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:18:17.626335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e is not attached to volume e72d0924-8f04-4bde-b0bb-37b1925fdc80 Oct 04 22:18:17.626335 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:18:17.626335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6a2419da-132b-4499-a8e6-dde741146b27 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Returning 404 to user: Instance ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e is not attached to volume e72d0924-8f04-4bde-b0bb-37b1925fdc80 {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:18:17.626335 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6a2419da-132b-4499-a8e6-dde741146b27 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e/os-volume_attachments/e72d0924-8f04-4bde-b0bb-37b1925fdc80" status: 404 len: 154 microversion: 2.1 time: 0.100235 Oct 04 22:18:17.626335 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3748/7516] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 22:18:17 2022] DELETE /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e/os-volume_attachments/e72d0924-8f04-4bde-b0bb-37b1925fdc80 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:18:21.143777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c4536324-3a6d-440f-a80b-820795c5f06f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:21.144297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c4536324-3a6d-440f-a80b-820795c5f06f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:21.152233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4536324-3a6d-440f-a80b-820795c5f06f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:21.152733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4536324-3a6d-440f-a80b-820795c5f06f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:21.153187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4536324-3a6d-440f-a80b-820795c5f06f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:21.153937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4536324-3a6d-440f-a80b-820795c5f06f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:21.154405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4536324-3a6d-440f-a80b-820795c5f06f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:21.154843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4536324-3a6d-440f-a80b-820795c5f06f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:21.179996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c4536324-3a6d-440f-a80b-820795c5f06f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:18:21.479295 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c4536324-3a6d-440f-a80b-820795c5f06f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e" status: 204 len: 0 microversion: 2.1 time: 0.339156 Oct 04 22:18:21.490326 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3769/7517] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:18:21 2022] DELETE /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:18:21.491119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fedfc6d9-9d13-404f-acb7-b9cea0bf0cb4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:21.492699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fedfc6d9-9d13-404f-acb7-b9cea0bf0cb4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:21.500962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fedfc6d9-9d13-404f-acb7-b9cea0bf0cb4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:21.501743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fedfc6d9-9d13-404f-acb7-b9cea0bf0cb4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:21.502547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fedfc6d9-9d13-404f-acb7-b9cea0bf0cb4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:21.505326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fedfc6d9-9d13-404f-acb7-b9cea0bf0cb4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:21.507443 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fedfc6d9-9d13-404f-acb7-b9cea0bf0cb4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:21.508131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fedfc6d9-9d13-404f-acb7-b9cea0bf0cb4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:21.655434 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fedfc6d9-9d13-404f-acb7-b9cea0bf0cb4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:21.664105 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fedfc6d9-9d13-404f-acb7-b9cea0bf0cb4 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e" status: 200 len: 1559 microversion: 2.1 time: 0.179039 Oct 04 22:18:21.664899 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3749/7518] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:21 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:22.689179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5a15adad-f9e7-48cc-ae36-a3b0207d79f2 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:22.689889 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5a15adad-f9e7-48cc-ae36-a3b0207d79f2 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:22.697262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a15adad-f9e7-48cc-ae36-a3b0207d79f2 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:22.697800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a15adad-f9e7-48cc-ae36-a3b0207d79f2 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:22.698260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a15adad-f9e7-48cc-ae36-a3b0207d79f2 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:22.698971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a15adad-f9e7-48cc-ae36-a3b0207d79f2 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:22.699448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a15adad-f9e7-48cc-ae36-a3b0207d79f2 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:22.699898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5a15adad-f9e7-48cc-ae36-a3b0207d79f2 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:22.839137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5a15adad-f9e7-48cc-ae36-a3b0207d79f2 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:22.846978 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5a15adad-f9e7-48cc-ae36-a3b0207d79f2 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e" status: 200 len: 1559 microversion: 2.1 time: 0.162419 Oct 04 22:18:22.847558 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3770/7519] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:22 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:23.424196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-0f2bba32-517e-47ce-b472-28d287e782df req-a5277273-a3c8-4055-9e2f-132f955b0afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e", "name": "network-vif-deleted", "tag": "719bf065-3483-4b18-a0f9-b33969ee8ea1"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:23.436295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0f2bba32-517e-47ce-b472-28d287e782df req-a5277273-a3c8-4055-9e2f-132f955b0afc service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:23.436898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0f2bba32-517e-47ce-b472-28d287e782df req-a5277273-a3c8-4055-9e2f-132f955b0afc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:23.437335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-0f2bba32-517e-47ce-b472-28d287e782df req-a5277273-a3c8-4055-9e2f-132f955b0afc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:23.448516 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-0f2bba32-517e-47ce-b472-28d287e782df req-a5277273-a3c8-4055-9e2f-132f955b0afc service nova] Creating event network-vif-deleted:719bf065-3483-4b18-a0f9-b33969ee8ea1 for instance ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e on n-h1-860282-1 Oct 04 22:18:23.453485 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-0f2bba32-517e-47ce-b472-28d287e782df req-a5277273-a3c8-4055-9e2f-132f955b0afc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033109 Oct 04 22:18:23.454085 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3750/7520] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:23.870091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ecaa926e-c2b7-4fc6-ac97-f737cb51cdb6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:23.870731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ecaa926e-c2b7-4fc6-ac97-f737cb51cdb6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:23.877829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ecaa926e-c2b7-4fc6-ac97-f737cb51cdb6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:23.878343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ecaa926e-c2b7-4fc6-ac97-f737cb51cdb6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:23.878803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ecaa926e-c2b7-4fc6-ac97-f737cb51cdb6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:23.879802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ecaa926e-c2b7-4fc6-ac97-f737cb51cdb6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:23.880418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ecaa926e-c2b7-4fc6-ac97-f737cb51cdb6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:23.880874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ecaa926e-c2b7-4fc6-ac97-f737cb51cdb6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:23.913740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ecaa926e-c2b7-4fc6-ac97-f737cb51cdb6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:23.914254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ecaa926e-c2b7-4fc6-ac97-f737cb51cdb6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:23.914714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ecaa926e-c2b7-4fc6-ac97-f737cb51cdb6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:23.915185 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-ecaa926e-c2b7-4fc6-ac97-f737cb51cdb6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lazy-loading 'fault' on Instance uuid ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:18:23.955155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ecaa926e-c2b7-4fc6-ac97-f737cb51cdb6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:23.963609 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ecaa926e-c2b7-4fc6-ac97-f737cb51cdb6 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e" status: 200 len: 1351 microversion: 2.1 time: 0.097473 Oct 04 22:18:23.964216 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3771/7521] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:23 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:24.989210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-79da1821-84e2-4c49-8414-1bb2d9a5eebf tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:24.990005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-79da1821-84e2-4c49-8414-1bb2d9a5eebf tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:24.996155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79da1821-84e2-4c49-8414-1bb2d9a5eebf tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:24.996644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79da1821-84e2-4c49-8414-1bb2d9a5eebf tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:24.997090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79da1821-84e2-4c49-8414-1bb2d9a5eebf tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:24.997815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79da1821-84e2-4c49-8414-1bb2d9a5eebf tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:24.998273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79da1821-84e2-4c49-8414-1bb2d9a5eebf tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:24.998701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-79da1821-84e2-4c49-8414-1bb2d9a5eebf tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:25.014645 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-79da1821-84e2-4c49-8414-1bb2d9a5eebf tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] HTTP exception thrown: Instance ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e could not be found. Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-79da1821-84e2-4c49-8414-1bb2d9a5eebf tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Request method failure captured: Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e HTTP/1.1 Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPLEAvyBEdHzKQjPFxv2VzOeLNMb4jnXYES8tcLINHK7ri-sHBSnj97gWSWg0EyCavx447Mmh13WVZ1paS5xdLy9znsL853tESqAKjIwo_A0H3gSafcxRhkA0TNopp_XmDu0wubw4xDYVaRmqX8r3KMAKus17S2cwPqtmsm68KeISBpA Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 76c9a0ad4e82496ab61a251cbcb0a04c Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestEncryptedCinderVolumes-900665055 Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76c9a0ad4e82496ab61a251cbcb0a04c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_76c9a0ad4e82496ab61a251cbcb0a04c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/76c9a0ad4e82496ab61a251cbcb0a04c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76c9a0ad4e82496ab61a251cbcb0a04c"}]}] Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestEncryptedCinderVolumes-900665055 Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 76c9a0ad4e82496ab61a251cbcb0a04c Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-900665055 Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestEncryptedCinderVolumes-900665055-project Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: e2342ae39a8542fa84bc9662e5764dd9 Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestEncryptedCinderVolumes-900665055-project Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e could not be found. Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e'} Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e could not be found. Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e could not be found. Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:18:25.016265 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:18:25.022088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:25.022088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:18:25.022088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:18:25.022088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:18:25.022088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:18:25.022088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e could not be found. Oct 04 22:18:25.022088 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:18:25.022088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-79da1821-84e2-4c49-8414-1bb2d9a5eebf tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Returning 404 to user: Instance ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:18:25.022088 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-79da1821-84e2-4c49-8414-1bb2d9a5eebf tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e" status: 404 len: 111 microversion: 2.1 time: 0.033648 Oct 04 22:18:25.022088 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3751/7522] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:24 2022] GET /compute/v2.1/servers/ca5b5701-d3e1-4bfb-a503-eb66e07c5f7e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:18:25.027240 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d18d5d4d-4234-4870-b86d-ad1a46530ea8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '.version_select at 0x7f578b8dd310>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:25.101698 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d18d5d4d-4234-4870-b86d-ad1a46530ea8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-812991867" status: 202 len: 0 microversion: 2.1 time: 0.078176 Oct 04 22:18:25.102210 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3772/7523] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 22:18:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-812991867 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:18:25.119941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-99933b63-64d0-4616-bb44-c1cecc8b11ee tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Action: 'create', calling method: .version_select at 0x7f578abda040>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-395381455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRd5Rn60bUjo8AkDJAkO7o8WrplpOLQVRzhAFQ865WjEvJl0qHHgOrWvM+P45uqjqCH5MetTfLACV51sz9dUMynh0HFzzXz1GoqIs3QIyPBSMq0BhvE8d9W0XzpmlIzug=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:25.136336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-99933b63-64d0-4616-bb44-c1cecc8b11ee tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Getting quotas for project 76c9a0ad4e82496ab61a251cbcb0a04c. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:18:25.141439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-99933b63-64d0-4616-bb44-c1cecc8b11ee tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Getting quotas for user e2342ae39a8542fa84bc9662e5764dd9 and project 76c9a0ad4e82496ab61a251cbcb0a04c. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:18:25.233595 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-99933b63-64d0-4616-bb44-c1cecc8b11ee tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.117558 Oct 04 22:18:25.234259 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3752/7524] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 22:18:25 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:25.285907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-418d4019-3d9f-4820-a3f4-5cefbb407a3f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1478862725", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-395381455", "networks": [{"uuid": "b6bd29e5-059f-4d08-ab27-3eff5e9e71d2"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:25.338717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-418d4019-3d9f-4820-a3f4-5cefbb407a3f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] validate_networks() for [('b6bd29e5-059f-4d08-ab27-3eff5e9e71d2', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:18:25.717990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-418d4019-3d9f-4820-a3f4-5cefbb407a3f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:18:25.718443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-418d4019-3d9f-4820-a3f4-5cefbb407a3f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:18:25.718972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-418d4019-3d9f-4820-a3f4-5cefbb407a3f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:18:25.719443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-418d4019-3d9f-4820-a3f4-5cefbb407a3f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:18:25.719885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-418d4019-3d9f-4820-a3f4-5cefbb407a3f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:18:25.729726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-418d4019-3d9f-4820-a3f4-5cefbb407a3f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:25.730239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-418d4019-3d9f-4820-a3f4-5cefbb407a3f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:25.730699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-418d4019-3d9f-4820-a3f4-5cefbb407a3f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:25.731454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-418d4019-3d9f-4820-a3f4-5cefbb407a3f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:25.731933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-418d4019-3d9f-4820-a3f4-5cefbb407a3f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:25.732389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-418d4019-3d9f-4820-a3f4-5cefbb407a3f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:25.750302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-418d4019-3d9f-4820-a3f4-5cefbb407a3f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Getting quotas for project 76c9a0ad4e82496ab61a251cbcb0a04c. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:18:25.755987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-418d4019-3d9f-4820-a3f4-5cefbb407a3f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Getting quotas for user e2342ae39a8542fa84bc9662e5764dd9 and project 76c9a0ad4e82496ab61a251cbcb0a04c. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:18:25.768603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-418d4019-3d9f-4820-a3f4-5cefbb407a3f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:18:25.771336 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-418d4019-3d9f-4820-a3f4-5cefbb407a3f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:18:25.876598 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-418d4019-3d9f-4820-a3f4-5cefbb407a3f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594704 Oct 04 22:18:25.877261 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3773/7525] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:18:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:18:25.888993 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-be3a8208-5218-4f0e-b66b-75734681b30a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:25.889805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-be3a8208-5218-4f0e-b66b-75734681b30a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:25.945726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-be3a8208-5218-4f0e-b66b-75734681b30a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:25.953745 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-be3a8208-5218-4f0e-b66b-75734681b30a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096" status: 200 len: 1262 microversion: 2.1 time: 0.069115 Oct 04 22:18:25.954509 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3753/7526] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:25 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096 => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:26.977752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-06eb5cab-03e7-4251-a8f5-1822efd28f0a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:26.978387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-06eb5cab-03e7-4251-a8f5-1822efd28f0a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:26.984774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06eb5cab-03e7-4251-a8f5-1822efd28f0a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:26.985277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06eb5cab-03e7-4251-a8f5-1822efd28f0a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:26.985767 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06eb5cab-03e7-4251-a8f5-1822efd28f0a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:26.986479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06eb5cab-03e7-4251-a8f5-1822efd28f0a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:26.986959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06eb5cab-03e7-4251-a8f5-1822efd28f0a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:26.987411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-06eb5cab-03e7-4251-a8f5-1822efd28f0a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:27.050687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-06eb5cab-03e7-4251-a8f5-1822efd28f0a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:27.061573 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-06eb5cab-03e7-4251-a8f5-1822efd28f0a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096" status: 200 len: 1266 microversion: 2.1 time: 0.086650 Oct 04 22:18:27.061573 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3774/7527] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:26 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:28.082796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c19260c1-72fe-43c0-9800-9ee364f80759 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:28.083498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c19260c1-72fe-43c0-9800-9ee364f80759 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:28.090667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c19260c1-72fe-43c0-9800-9ee364f80759 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:28.091210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c19260c1-72fe-43c0-9800-9ee364f80759 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:28.091649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c19260c1-72fe-43c0-9800-9ee364f80759 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:28.092356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c19260c1-72fe-43c0-9800-9ee364f80759 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:28.092818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c19260c1-72fe-43c0-9800-9ee364f80759 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:28.093248 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c19260c1-72fe-43c0-9800-9ee364f80759 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:28.162371 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c19260c1-72fe-43c0-9800-9ee364f80759 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:28.170248 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c19260c1-72fe-43c0-9800-9ee364f80759 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096" status: 200 len: 1320 microversion: 2.1 time: 0.091500 Oct 04 22:18:28.175197 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3754/7528] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:28 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096 => generated 1320 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:29.193408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-01acaac3-a6be-46dd-8997-fe333f69f19f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:29.194100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-01acaac3-a6be-46dd-8997-fe333f69f19f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:29.201368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01acaac3-a6be-46dd-8997-fe333f69f19f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:29.201849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01acaac3-a6be-46dd-8997-fe333f69f19f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:29.202306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01acaac3-a6be-46dd-8997-fe333f69f19f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:29.203025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01acaac3-a6be-46dd-8997-fe333f69f19f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:29.203499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01acaac3-a6be-46dd-8997-fe333f69f19f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:29.203944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-01acaac3-a6be-46dd-8997-fe333f69f19f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:29.337412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-01acaac3-a6be-46dd-8997-fe333f69f19f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:29.345252 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-01acaac3-a6be-46dd-8997-fe333f69f19f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096" status: 200 len: 1362 microversion: 2.1 time: 0.155835 Oct 04 22:18:29.345876 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3775/7529] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:29 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:29.382388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-2fca9c69-1a0d-4549-bb17-f0e34c78dde3 req-eec9c3bf-d8c9-454a-b996-b6c590fa0bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6feef41e-0f78-4af1-bef0-c1a12d41b096", "tag": "1468b054-dadd-49b4-83df-1ea1381cd8b6"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:29.393710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2fca9c69-1a0d-4549-bb17-f0e34c78dde3 req-eec9c3bf-d8c9-454a-b996-b6c590fa0bf3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:29.394271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2fca9c69-1a0d-4549-bb17-f0e34c78dde3 req-eec9c3bf-d8c9-454a-b996-b6c590fa0bf3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:29.395510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2fca9c69-1a0d-4549-bb17-f0e34c78dde3 req-eec9c3bf-d8c9-454a-b996-b6c590fa0bf3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:29.406208 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-2fca9c69-1a0d-4549-bb17-f0e34c78dde3 req-eec9c3bf-d8c9-454a-b996-b6c590fa0bf3 service nova] Creating event network-changed:1468b054-dadd-49b4-83df-1ea1381cd8b6 for instance 6feef41e-0f78-4af1-bef0-c1a12d41b096 on n-h1-860282-1 Oct 04 22:18:29.412404 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-2fca9c69-1a0d-4549-bb17-f0e34c78dde3 req-eec9c3bf-d8c9-454a-b996-b6c590fa0bf3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033567 Oct 04 22:18:29.413005 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3755/7530] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:30.369262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-793fab46-6c43-4104-8e0f-da5be1a2e7fb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:30.369950 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-793fab46-6c43-4104-8e0f-da5be1a2e7fb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:30.377061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-793fab46-6c43-4104-8e0f-da5be1a2e7fb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:30.377605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-793fab46-6c43-4104-8e0f-da5be1a2e7fb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:30.378062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-793fab46-6c43-4104-8e0f-da5be1a2e7fb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:30.378774 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-793fab46-6c43-4104-8e0f-da5be1a2e7fb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:30.379269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-793fab46-6c43-4104-8e0f-da5be1a2e7fb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:30.379715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-793fab46-6c43-4104-8e0f-da5be1a2e7fb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:30.507305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-793fab46-6c43-4104-8e0f-da5be1a2e7fb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:30.515245 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-793fab46-6c43-4104-8e0f-da5be1a2e7fb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096" status: 200 len: 1362 microversion: 2.1 time: 0.149865 Oct 04 22:18:30.515820 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3776/7531] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:30 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:31.538885 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ff33864f-dbe3-4028-a2a7-76d31e1c2a1b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:31.539619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ff33864f-dbe3-4028-a2a7-76d31e1c2a1b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:31.546737 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff33864f-dbe3-4028-a2a7-76d31e1c2a1b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:31.547235 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff33864f-dbe3-4028-a2a7-76d31e1c2a1b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:31.547682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff33864f-dbe3-4028-a2a7-76d31e1c2a1b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:31.548390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff33864f-dbe3-4028-a2a7-76d31e1c2a1b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:31.548851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff33864f-dbe3-4028-a2a7-76d31e1c2a1b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:31.549282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ff33864f-dbe3-4028-a2a7-76d31e1c2a1b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:31.682718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ff33864f-dbe3-4028-a2a7-76d31e1c2a1b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:31.690517 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ff33864f-dbe3-4028-a2a7-76d31e1c2a1b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096" status: 200 len: 1362 microversion: 2.1 time: 0.156423 Oct 04 22:18:31.691084 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3756/7532] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:31 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:32.713791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c4063b43-ac75-48dc-89b7-18f7cea95a99 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:32.714353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c4063b43-ac75-48dc-89b7-18f7cea95a99 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:32.721284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4063b43-ac75-48dc-89b7-18f7cea95a99 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:32.721850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4063b43-ac75-48dc-89b7-18f7cea95a99 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:32.722320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4063b43-ac75-48dc-89b7-18f7cea95a99 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:32.723033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4063b43-ac75-48dc-89b7-18f7cea95a99 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:32.723513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4063b43-ac75-48dc-89b7-18f7cea95a99 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:32.723960 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c4063b43-ac75-48dc-89b7-18f7cea95a99 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:32.862111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c4063b43-ac75-48dc-89b7-18f7cea95a99 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:32.870500 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c4063b43-ac75-48dc-89b7-18f7cea95a99 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096" status: 200 len: 1362 microversion: 2.1 time: 0.160848 Oct 04 22:18:32.871087 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3777/7533] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:32 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:33.894229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d15d5025-03c1-4d22-8ae0-eb4e583adb73 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:33.894855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d15d5025-03c1-4d22-8ae0-eb4e583adb73 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:33.901933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d15d5025-03c1-4d22-8ae0-eb4e583adb73 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:33.908254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d15d5025-03c1-4d22-8ae0-eb4e583adb73 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:33.908254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d15d5025-03c1-4d22-8ae0-eb4e583adb73 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:33.908254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d15d5025-03c1-4d22-8ae0-eb4e583adb73 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:33.908254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d15d5025-03c1-4d22-8ae0-eb4e583adb73 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:33.908254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d15d5025-03c1-4d22-8ae0-eb4e583adb73 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:34.037583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d15d5025-03c1-4d22-8ae0-eb4e583adb73 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:34.045345 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d15d5025-03c1-4d22-8ae0-eb4e583adb73 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096" status: 200 len: 1362 microversion: 2.1 time: 0.155094 Oct 04 22:18:34.046064 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3757/7534] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:33 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:35.068978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-458c8e7b-7b2e-4cf8-ba24-daeda2d8ef9d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:35.069612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-458c8e7b-7b2e-4cf8-ba24-daeda2d8ef9d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:35.076274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-458c8e7b-7b2e-4cf8-ba24-daeda2d8ef9d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:35.076808 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-458c8e7b-7b2e-4cf8-ba24-daeda2d8ef9d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:35.077270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-458c8e7b-7b2e-4cf8-ba24-daeda2d8ef9d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:35.078009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-458c8e7b-7b2e-4cf8-ba24-daeda2d8ef9d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:35.078485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-458c8e7b-7b2e-4cf8-ba24-daeda2d8ef9d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:35.078934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-458c8e7b-7b2e-4cf8-ba24-daeda2d8ef9d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:35.210734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-458c8e7b-7b2e-4cf8-ba24-daeda2d8ef9d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:35.218489 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-458c8e7b-7b2e-4cf8-ba24-daeda2d8ef9d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096" status: 200 len: 1362 microversion: 2.1 time: 0.154224 Oct 04 22:18:35.219065 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3778/7535] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:35 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:35.919563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-a47ca153-e2b8-4882-bd08-6744ad8b946c req-b7eaca6a-4e1c-41c0-a811-5c88906cf482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6feef41e-0f78-4af1-bef0-c1a12d41b096", "name": "network-vif-plugged", "status": "completed", "tag": "1468b054-dadd-49b4-83df-1ea1381cd8b6"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:35.931442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a47ca153-e2b8-4882-bd08-6744ad8b946c req-b7eaca6a-4e1c-41c0-a811-5c88906cf482 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:35.931923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a47ca153-e2b8-4882-bd08-6744ad8b946c req-b7eaca6a-4e1c-41c0-a811-5c88906cf482 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:35.932354 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a47ca153-e2b8-4882-bd08-6744ad8b946c req-b7eaca6a-4e1c-41c0-a811-5c88906cf482 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:35.944026 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-a47ca153-e2b8-4882-bd08-6744ad8b946c req-b7eaca6a-4e1c-41c0-a811-5c88906cf482 service nova] Creating event network-vif-plugged:1468b054-dadd-49b4-83df-1ea1381cd8b6 for instance 6feef41e-0f78-4af1-bef0-c1a12d41b096 on n-h1-860282-1 Oct 04 22:18:35.950060 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-a47ca153-e2b8-4882-bd08-6744ad8b946c req-b7eaca6a-4e1c-41c0-a811-5c88906cf482 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034408 Oct 04 22:18:35.950996 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3758/7536] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:36.242141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a0991e59-977f-42ce-8cad-1dd6814b8048 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:36.242786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a0991e59-977f-42ce-8cad-1dd6814b8048 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:36.244844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:36.245558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:36.251235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0991e59-977f-42ce-8cad-1dd6814b8048 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:36.252041 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0991e59-977f-42ce-8cad-1dd6814b8048 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:36.252506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0991e59-977f-42ce-8cad-1dd6814b8048 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:36.253264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0991e59-977f-42ce-8cad-1dd6814b8048 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:36.253778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0991e59-977f-42ce-8cad-1dd6814b8048 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:36.254230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a0991e59-977f-42ce-8cad-1dd6814b8048 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:36.382951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a0991e59-977f-42ce-8cad-1dd6814b8048 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:36.391067 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a0991e59-977f-42ce-8cad-1dd6814b8048 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096" status: 200 len: 1362 microversion: 2.1 time: 0.153669 Oct 04 22:18:36.391650 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3779/7537] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:36 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:37.415346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-059f3b19-4326-46c3-a299-5d1d10c45900 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:37.416080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-059f3b19-4326-46c3-a299-5d1d10c45900 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:37.418030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:37.423807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-059f3b19-4326-46c3-a299-5d1d10c45900 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:37.424288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-059f3b19-4326-46c3-a299-5d1d10c45900 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:37.424858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-059f3b19-4326-46c3-a299-5d1d10c45900 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:37.425589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-059f3b19-4326-46c3-a299-5d1d10c45900 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:37.426047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-059f3b19-4326-46c3-a299-5d1d10c45900 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:37.426475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-059f3b19-4326-46c3-a299-5d1d10c45900 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:37.561488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-059f3b19-4326-46c3-a299-5d1d10c45900 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:37.569206 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-059f3b19-4326-46c3-a299-5d1d10c45900 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096" status: 200 len: 1555 microversion: 2.1 time: 0.158729 Oct 04 22:18:37.569809 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3759/7538] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:37 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:37.591249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-36594a2d-c583-4f3d-90a3-2e2015ed2505 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:37.591887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-36594a2d-c583-4f3d-90a3-2e2015ed2505 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:37.598736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36594a2d-c583-4f3d-90a3-2e2015ed2505 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:37.599241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36594a2d-c583-4f3d-90a3-2e2015ed2505 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:37.600284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36594a2d-c583-4f3d-90a3-2e2015ed2505 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:37.601157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36594a2d-c583-4f3d-90a3-2e2015ed2505 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:37.601661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36594a2d-c583-4f3d-90a3-2e2015ed2505 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:37.602114 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-36594a2d-c583-4f3d-90a3-2e2015ed2505 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:37.620983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:37.732591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-36594a2d-c583-4f3d-90a3-2e2015ed2505 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:37.741632 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-36594a2d-c583-4f3d-90a3-2e2015ed2505 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096" status: 200 len: 1555 microversion: 2.1 time: 0.154300 Oct 04 22:18:37.742212 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3780/7539] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:37 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:40.612941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b1e69764-5d9c-413c-a69b-66df0ca0d5c8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5bb5055f-0b7c-4f49-837e-3d35e6f27256"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:40.615331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b1e69764-5d9c-413c-a69b-66df0ca0d5c8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:40.622080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1e69764-5d9c-413c-a69b-66df0ca0d5c8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:40.622582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1e69764-5d9c-413c-a69b-66df0ca0d5c8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:40.623013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1e69764-5d9c-413c-a69b-66df0ca0d5c8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:40.623692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1e69764-5d9c-413c-a69b-66df0ca0d5c8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:40.624143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1e69764-5d9c-413c-a69b-66df0ca0d5c8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:40.624564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b1e69764-5d9c-413c-a69b-66df0ca0d5c8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:41.505367 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b1e69764-5d9c-413c-a69b-66df0ca0d5c8 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "POST /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.896266 Oct 04 22:18:41.506435 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3760/7540] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 22:18:40 2022] POST /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096/os-volume_attachments => generated 194 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:53.295316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5ca05378-9ab6-4e79-9543-3b63fa0f1734 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:53.295910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5ca05378-9ab6-4e79-9543-3b63fa0f1734 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:53.297878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:53.298588 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:53.303255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ca05378-9ab6-4e79-9543-3b63fa0f1734 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:53.304309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ca05378-9ab6-4e79-9543-3b63fa0f1734 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:53.304309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ca05378-9ab6-4e79-9543-3b63fa0f1734 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:53.304905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ca05378-9ab6-4e79-9543-3b63fa0f1734 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:53.305378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ca05378-9ab6-4e79-9543-3b63fa0f1734 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:53.306569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5ca05378-9ab6-4e79-9543-3b63fa0f1734 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:53.386293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-5ca05378-9ab6-4e79-9543-3b63fa0f1734 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lazy-loading 'services' on Instance uuid 6feef41e-0f78-4af1-bef0-c1a12d41b096 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:18:53.539281 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5ca05378-9ab6-4e79-9543-3b63fa0f1734 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096/os-volume_attachments/5bb5055f-0b7c-4f49-837e-3d35e6f27256" status: 202 len: 0 microversion: 2.1 time: 0.247973 Oct 04 22:18:53.540584 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3781/7541] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 22:18:53 2022] DELETE /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096/os-volume_attachments/5bb5055f-0b7c-4f49-837e-3d35e6f27256 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:18:53.555573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1afcaf0b-7771-49f5-8fde-12668c87122d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:53.558404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1afcaf0b-7771-49f5-8fde-12668c87122d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:53.561009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:53.561715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:53.567283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1afcaf0b-7771-49f5-8fde-12668c87122d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:53.567768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1afcaf0b-7771-49f5-8fde-12668c87122d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:53.568209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1afcaf0b-7771-49f5-8fde-12668c87122d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:53.568910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1afcaf0b-7771-49f5-8fde-12668c87122d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:53.569370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1afcaf0b-7771-49f5-8fde-12668c87122d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:53.569823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1afcaf0b-7771-49f5-8fde-12668c87122d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:53.599478 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1afcaf0b-7771-49f5-8fde-12668c87122d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048677 Oct 04 22:18:53.600038 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3761/7542] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:18:53 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:54.614747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8237553d-a709-403b-a6f4-005d9fcd3f0f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:54.617257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8237553d-a709-403b-a6f4-005d9fcd3f0f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:54.623798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8237553d-a709-403b-a6f4-005d9fcd3f0f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:54.624380 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8237553d-a709-403b-a6f4-005d9fcd3f0f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:54.624923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8237553d-a709-403b-a6f4-005d9fcd3f0f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:54.625734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8237553d-a709-403b-a6f4-005d9fcd3f0f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:54.626288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8237553d-a709-403b-a6f4-005d9fcd3f0f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:54.626799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8237553d-a709-403b-a6f4-005d9fcd3f0f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:54.657623 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8237553d-a709-403b-a6f4-005d9fcd3f0f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048047 Oct 04 22:18:54.658337 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3782/7543] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:18:54 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:55.670458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-35172d2b-0416-4eed-880e-477cd3545a4d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:55.672679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-35172d2b-0416-4eed-880e-477cd3545a4d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:55.681934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35172d2b-0416-4eed-880e-477cd3545a4d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:55.682513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35172d2b-0416-4eed-880e-477cd3545a4d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:55.682964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35172d2b-0416-4eed-880e-477cd3545a4d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:55.683686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35172d2b-0416-4eed-880e-477cd3545a4d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:55.684155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35172d2b-0416-4eed-880e-477cd3545a4d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:55.684587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35172d2b-0416-4eed-880e-477cd3545a4d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:55.718746 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-35172d2b-0416-4eed-880e-477cd3545a4d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052331 Oct 04 22:18:55.719332 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3762/7544] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:18:55 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:56.732181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a55354db-136f-4a82-9510-f55fde90e1c5 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:56.734447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a55354db-136f-4a82-9510-f55fde90e1c5 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:56.741452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a55354db-136f-4a82-9510-f55fde90e1c5 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:56.741916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a55354db-136f-4a82-9510-f55fde90e1c5 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:56.742368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a55354db-136f-4a82-9510-f55fde90e1c5 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:56.743118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a55354db-136f-4a82-9510-f55fde90e1c5 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:56.743775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a55354db-136f-4a82-9510-f55fde90e1c5 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:56.744224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a55354db-136f-4a82-9510-f55fde90e1c5 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:56.778015 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a55354db-136f-4a82-9510-f55fde90e1c5 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050587 Oct 04 22:18:56.778808 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3783/7545] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:18:56 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:57.791264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9bcb4e20-537d-4e63-90e9-93a021b483fd tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:57.793515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9bcb4e20-537d-4e63-90e9-93a021b483fd tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:57.801398 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bcb4e20-537d-4e63-90e9-93a021b483fd tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:57.801899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bcb4e20-537d-4e63-90e9-93a021b483fd tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:57.802335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bcb4e20-537d-4e63-90e9-93a021b483fd tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:57.803031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bcb4e20-537d-4e63-90e9-93a021b483fd tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:57.803491 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bcb4e20-537d-4e63-90e9-93a021b483fd tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:57.803916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9bcb4e20-537d-4e63-90e9-93a021b483fd tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:57.837666 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9bcb4e20-537d-4e63-90e9-93a021b483fd tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049953 Oct 04 22:18:57.838394 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3763/7546] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:18:57 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:18:58.851843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ce3a3084-7124-4f03-bb23-18ba3585f510 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:58.854583 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ce3a3084-7124-4f03-bb23-18ba3585f510 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:58.861444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce3a3084-7124-4f03-bb23-18ba3585f510 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:58.861963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce3a3084-7124-4f03-bb23-18ba3585f510 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:58.862420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce3a3084-7124-4f03-bb23-18ba3585f510 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:58.863127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce3a3084-7124-4f03-bb23-18ba3585f510 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:58.863599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce3a3084-7124-4f03-bb23-18ba3585f510 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:58.864044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce3a3084-7124-4f03-bb23-18ba3585f510 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:58.893518 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ce3a3084-7124-4f03-bb23-18ba3585f510 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045780 Oct 04 22:18:58.894092 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3784/7547] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:18:58 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:18:58.905287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4c713482-6dbe-4f20-b8ff-c0c618253266 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:58.905814 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4c713482-6dbe-4f20-b8ff-c0c618253266 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:58.912581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c713482-6dbe-4f20-b8ff-c0c618253266 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:58.913067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c713482-6dbe-4f20-b8ff-c0c618253266 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:58.913536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c713482-6dbe-4f20-b8ff-c0c618253266 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:58.914225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c713482-6dbe-4f20-b8ff-c0c618253266 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:58.914778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c713482-6dbe-4f20-b8ff-c0c618253266 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:58.915804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4c713482-6dbe-4f20-b8ff-c0c618253266 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:58.990596 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-4c713482-6dbe-4f20-b8ff-c0c618253266 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] HTTP exception thrown: Instance 6feef41e-0f78-4af1-bef0-c1a12d41b096 is not attached to volume 5bb5055f-0b7c-4f49-837e-3d35e6f27256 Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4c713482-6dbe-4f20-b8ff-c0c618253266 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Request method failure captured: Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096/os-volume_attachments/5bb5055f-0b7c-4f49-837e-3d35e6f27256 HTTP/1.1 Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPLEAvyBEdHzKQjPFxv2VzOeLNMb4jnXYES8tcLINHK7ri-sHBSnj97gWSWg0EyCavx447Mmh13WVZ1paS5xdLy9znsL853tESqAKjIwo_A0H3gSafcxRhkA0TNopp_XmDu0wubw4xDYVaRmqX8r3KMAKus17S2cwPqtmsm68KeISBpA Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 76c9a0ad4e82496ab61a251cbcb0a04c Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestEncryptedCinderVolumes-900665055 Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76c9a0ad4e82496ab61a251cbcb0a04c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_76c9a0ad4e82496ab61a251cbcb0a04c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/76c9a0ad4e82496ab61a251cbcb0a04c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76c9a0ad4e82496ab61a251cbcb0a04c"}]}] Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestEncryptedCinderVolumes-900665055 Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 76c9a0ad4e82496ab61a251cbcb0a04c Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-900665055 Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestEncryptedCinderVolumes-900665055-project Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: e2342ae39a8542fa84bc9662e5764dd9 Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestEncryptedCinderVolumes-900665055-project Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 6feef41e-0f78-4af1-bef0-c1a12d41b096 is not attached to volume 5bb5055f-0b7c-4f49-837e-3d35e6f27256 Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'server_id': '6feef41e-0f78-4af1-bef0-c1a12d41b096', 'id': '5bb5055f-0b7c-4f49-837e-3d35e6f27256'} Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5bb5055f-0b7c-4f49-837e-3d35e6f27256. Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6feef41e-0f78-4af1-bef0-c1a12d41b096 is not attached to volume 5bb5055f-0b7c-4f49-837e-3d35e6f27256 Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:18:58.992239 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:18:58.997204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:18:58.997204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:18:58.997204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6feef41e-0f78-4af1-bef0-c1a12d41b096 is not attached to volume 5bb5055f-0b7c-4f49-837e-3d35e6f27256 Oct 04 22:18:58.997204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:18:58.997204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4c713482-6dbe-4f20-b8ff-c0c618253266 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Returning 404 to user: Instance 6feef41e-0f78-4af1-bef0-c1a12d41b096 is not attached to volume 5bb5055f-0b7c-4f49-837e-3d35e6f27256 {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:18:58.997204 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4c713482-6dbe-4f20-b8ff-c0c618253266 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096/os-volume_attachments/5bb5055f-0b7c-4f49-837e-3d35e6f27256" status: 404 len: 154 microversion: 2.1 time: 0.092535 Oct 04 22:18:58.997204 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3764/7548] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 22:18:58 2022] DELETE /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096/os-volume_attachments/5bb5055f-0b7c-4f49-837e-3d35e6f27256 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:19:02.509076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-00d621f1-480a-44ff-b184-a736ed1e0c52 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:02.509718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-00d621f1-480a-44ff-b184-a736ed1e0c52 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:02.517005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00d621f1-480a-44ff-b184-a736ed1e0c52 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:02.517649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00d621f1-480a-44ff-b184-a736ed1e0c52 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:02.518205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00d621f1-480a-44ff-b184-a736ed1e0c52 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:02.518917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00d621f1-480a-44ff-b184-a736ed1e0c52 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:02.519443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00d621f1-480a-44ff-b184-a736ed1e0c52 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:02.520070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-00d621f1-480a-44ff-b184-a736ed1e0c52 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:02.547035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-00d621f1-480a-44ff-b184-a736ed1e0c52 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:19:02.861475 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-00d621f1-480a-44ff-b184-a736ed1e0c52 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096" status: 204 len: 0 microversion: 2.1 time: 0.356033 Oct 04 22:19:02.862171 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3785/7549] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:19:02 2022] DELETE /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:19:02.871097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-88c0653e-51d4-4f78-94ae-abb6bf14544b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:02.872378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-88c0653e-51d4-4f78-94ae-abb6bf14544b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:02.880315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88c0653e-51d4-4f78-94ae-abb6bf14544b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:02.880890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88c0653e-51d4-4f78-94ae-abb6bf14544b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:02.881479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88c0653e-51d4-4f78-94ae-abb6bf14544b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:02.882271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88c0653e-51d4-4f78-94ae-abb6bf14544b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:02.882890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88c0653e-51d4-4f78-94ae-abb6bf14544b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:02.883450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-88c0653e-51d4-4f78-94ae-abb6bf14544b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:03.371986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-88c0653e-51d4-4f78-94ae-abb6bf14544b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:03.380273 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-88c0653e-51d4-4f78-94ae-abb6bf14544b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096" status: 200 len: 1561 microversion: 2.1 time: 0.513631 Oct 04 22:19:03.380890 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3765/7550] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:02 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096 => generated 1561 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:04.404417 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-363d9bf7-b145-44a6-b52a-8a5198ec20ab tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:04.405146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-363d9bf7-b145-44a6-b52a-8a5198ec20ab tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:04.412220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-363d9bf7-b145-44a6-b52a-8a5198ec20ab tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:04.412742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-363d9bf7-b145-44a6-b52a-8a5198ec20ab tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:04.413208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-363d9bf7-b145-44a6-b52a-8a5198ec20ab tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:04.413982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-363d9bf7-b145-44a6-b52a-8a5198ec20ab tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:04.414471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-363d9bf7-b145-44a6-b52a-8a5198ec20ab tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:04.415435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-363d9bf7-b145-44a6-b52a-8a5198ec20ab tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:04.549187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-363d9bf7-b145-44a6-b52a-8a5198ec20ab tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:04.557849 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-363d9bf7-b145-44a6-b52a-8a5198ec20ab tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096" status: 200 len: 1561 microversion: 2.1 time: 0.157623 Oct 04 22:19:04.558445 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3786/7551] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:04 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:04.898531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-9944e169-ae7e-4684-ac5c-d7f7582b1a20 req-c7039f6e-4251-4c90-9baf-dc46ca5c9880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6feef41e-0f78-4af1-bef0-c1a12d41b096", "name": "network-vif-deleted", "tag": "1468b054-dadd-49b4-83df-1ea1381cd8b6"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:04.909469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9944e169-ae7e-4684-ac5c-d7f7582b1a20 req-c7039f6e-4251-4c90-9baf-dc46ca5c9880 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:04.910685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9944e169-ae7e-4684-ac5c-d7f7582b1a20 req-c7039f6e-4251-4c90-9baf-dc46ca5c9880 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:04.910685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9944e169-ae7e-4684-ac5c-d7f7582b1a20 req-c7039f6e-4251-4c90-9baf-dc46ca5c9880 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:04.921800 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-9944e169-ae7e-4684-ac5c-d7f7582b1a20 req-c7039f6e-4251-4c90-9baf-dc46ca5c9880 service nova] Creating event network-vif-deleted:1468b054-dadd-49b4-83df-1ea1381cd8b6 for instance 6feef41e-0f78-4af1-bef0-c1a12d41b096 on n-h1-860282-1 Oct 04 22:19:04.926871 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-9944e169-ae7e-4684-ac5c-d7f7582b1a20 req-c7039f6e-4251-4c90-9baf-dc46ca5c9880 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032246 Oct 04 22:19:04.927549 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3766/7552] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:05.581267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-532de709-57e3-410f-8e5b-f59a35c59e23 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:05.582328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-532de709-57e3-410f-8e5b-f59a35c59e23 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:05.589233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-532de709-57e3-410f-8e5b-f59a35c59e23 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:05.589772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-532de709-57e3-410f-8e5b-f59a35c59e23 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:05.590221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-532de709-57e3-410f-8e5b-f59a35c59e23 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:05.590923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-532de709-57e3-410f-8e5b-f59a35c59e23 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:05.591395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-532de709-57e3-410f-8e5b-f59a35c59e23 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:05.591832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-532de709-57e3-410f-8e5b-f59a35c59e23 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:05.622879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-532de709-57e3-410f-8e5b-f59a35c59e23 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:05.623369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-532de709-57e3-410f-8e5b-f59a35c59e23 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:05.623821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-532de709-57e3-410f-8e5b-f59a35c59e23 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:05.624284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-532de709-57e3-410f-8e5b-f59a35c59e23 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lazy-loading 'fault' on Instance uuid 6feef41e-0f78-4af1-bef0-c1a12d41b096 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:19:05.670305 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-532de709-57e3-410f-8e5b-f59a35c59e23 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:05.679183 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-532de709-57e3-410f-8e5b-f59a35c59e23 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096" status: 200 len: 1352 microversion: 2.1 time: 0.101701 Oct 04 22:19:05.679781 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3787/7553] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:05 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096 => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:06.704571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1b99e879-69d5-493c-b99d-e2a173faeebe tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:06.705208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1b99e879-69d5-493c-b99d-e2a173faeebe tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: 6feef41e-0f78-4af1-bef0-c1a12d41b096] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:06.711638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b99e879-69d5-493c-b99d-e2a173faeebe tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:06.712172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b99e879-69d5-493c-b99d-e2a173faeebe tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:06.712659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b99e879-69d5-493c-b99d-e2a173faeebe tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:06.713360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b99e879-69d5-493c-b99d-e2a173faeebe tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:06.713845 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b99e879-69d5-493c-b99d-e2a173faeebe tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:06.714279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b99e879-69d5-493c-b99d-e2a173faeebe tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:06.728589 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-1b99e879-69d5-493c-b99d-e2a173faeebe tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] HTTP exception thrown: Instance 6feef41e-0f78-4af1-bef0-c1a12d41b096 could not be found. Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1b99e879-69d5-493c-b99d-e2a173faeebe tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Request method failure captured: Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096 HTTP/1.1 Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPLEAvyBEdHzKQjPFxv2VzOeLNMb4jnXYES8tcLINHK7ri-sHBSnj97gWSWg0EyCavx447Mmh13WVZ1paS5xdLy9znsL853tESqAKjIwo_A0H3gSafcxRhkA0TNopp_XmDu0wubw4xDYVaRmqX8r3KMAKus17S2cwPqtmsm68KeISBpA Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 76c9a0ad4e82496ab61a251cbcb0a04c Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestEncryptedCinderVolumes-900665055 Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76c9a0ad4e82496ab61a251cbcb0a04c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_76c9a0ad4e82496ab61a251cbcb0a04c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/76c9a0ad4e82496ab61a251cbcb0a04c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76c9a0ad4e82496ab61a251cbcb0a04c"}]}] Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestEncryptedCinderVolumes-900665055 Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 76c9a0ad4e82496ab61a251cbcb0a04c Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-900665055 Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestEncryptedCinderVolumes-900665055-project Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: e2342ae39a8542fa84bc9662e5764dd9 Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestEncryptedCinderVolumes-900665055-project Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 6feef41e-0f78-4af1-bef0-c1a12d41b096 could not be found. Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '6feef41e-0f78-4af1-bef0-c1a12d41b096'} Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6feef41e-0f78-4af1-bef0-c1a12d41b096 could not be found. Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6feef41e-0f78-4af1-bef0-c1a12d41b096 could not be found. Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:19:06.730263 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:19:06.735859 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:19:06.735859 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:19:06.735859 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:19:06.735859 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:19:06.735859 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:19:06.735859 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6feef41e-0f78-4af1-bef0-c1a12d41b096 could not be found. Oct 04 22:19:06.735859 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:19:06.735859 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1b99e879-69d5-493c-b99d-e2a173faeebe tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Returning 404 to user: Instance 6feef41e-0f78-4af1-bef0-c1a12d41b096 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:19:06.735859 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1b99e879-69d5-493c-b99d-e2a173faeebe tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096" status: 404 len: 111 microversion: 2.1 time: 0.032551 Oct 04 22:19:06.735859 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3767/7554] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:06 2022] GET /compute/v2.1/servers/6feef41e-0f78-4af1-bef0-c1a12d41b096 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:19:06.740631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-def320d8-906a-44f4-a212-d66dd4cbd292 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '.version_select at 0x7f579441dca0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:06.822648 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-def320d8-906a-44f4-a212-d66dd4cbd292 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-395381455" status: 202 len: 0 microversion: 2.1 time: 0.085878 Oct 04 22:19:06.823241 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3788/7555] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 22:19:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-395381455 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:19:06.841308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0abb2e34-e53d-455d-afdc-3bcafadf3183 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Action: 'create', calling method: .version_select at 0x7f578bf074c0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-957449107", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXTlUJFo0gpnnSm49kLrbA8cKwOOHvN6XKJeFrG5klFEHjkLQ+8J3Iy5gdTVE7iTGpeO0Y8QPMxE8pPJ9k1Yx6sHlBCP5xM4PQJaexqFyCD9lvCmNSrKG10Y/fqJ9LTGg=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:06.856679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-0abb2e34-e53d-455d-afdc-3bcafadf3183 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Getting quotas for project 76c9a0ad4e82496ab61a251cbcb0a04c. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:19:06.861747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-0abb2e34-e53d-455d-afdc-3bcafadf3183 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Getting quotas for user e2342ae39a8542fa84bc9662e5764dd9 and project 76c9a0ad4e82496ab61a251cbcb0a04c. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:19:06.936463 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0abb2e34-e53d-455d-afdc-3bcafadf3183 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.099599 Oct 04 22:19:06.937064 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3768/7556] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 22:19:06 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:06.988393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-19c75b2d-3678-4aff-b7b7-c526e9848e3b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1671126265", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-957449107", "networks": [{"uuid": "b6bd29e5-059f-4d08-ab27-3eff5e9e71d2"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:07.043191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-19c75b2d-3678-4aff-b7b7-c526e9848e3b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] validate_networks() for [('b6bd29e5-059f-4d08-ab27-3eff5e9e71d2', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:19:07.501562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-19c75b2d-3678-4aff-b7b7-c526e9848e3b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:19:07.502013 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-19c75b2d-3678-4aff-b7b7-c526e9848e3b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:19:07.502629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-19c75b2d-3678-4aff-b7b7-c526e9848e3b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:19:07.503067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-19c75b2d-3678-4aff-b7b7-c526e9848e3b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:19:07.503504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-19c75b2d-3678-4aff-b7b7-c526e9848e3b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:19:07.512709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19c75b2d-3678-4aff-b7b7-c526e9848e3b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:07.513210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19c75b2d-3678-4aff-b7b7-c526e9848e3b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:07.513710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19c75b2d-3678-4aff-b7b7-c526e9848e3b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:07.514459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19c75b2d-3678-4aff-b7b7-c526e9848e3b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:07.514933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19c75b2d-3678-4aff-b7b7-c526e9848e3b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:07.515440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19c75b2d-3678-4aff-b7b7-c526e9848e3b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:07.532699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-19c75b2d-3678-4aff-b7b7-c526e9848e3b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Getting quotas for project 76c9a0ad4e82496ab61a251cbcb0a04c. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:19:07.538513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-19c75b2d-3678-4aff-b7b7-c526e9848e3b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Getting quotas for user e2342ae39a8542fa84bc9662e5764dd9 and project 76c9a0ad4e82496ab61a251cbcb0a04c. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:19:07.551446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-19c75b2d-3678-4aff-b7b7-c526e9848e3b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:19:07.553812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-19c75b2d-3678-4aff-b7b7-c526e9848e3b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:19:07.662575 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-19c75b2d-3678-4aff-b7b7-c526e9848e3b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678101 Oct 04 22:19:07.663240 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3789/7557] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:19:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:19:07.677002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1bdc50dd-dafe-453f-80b5-20f34db6250b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:07.677956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1bdc50dd-dafe-453f-80b5-20f34db6250b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:07.737013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1bdc50dd-dafe-453f-80b5-20f34db6250b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:07.747011 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1bdc50dd-dafe-453f-80b5-20f34db6250b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7" status: 200 len: 1262 microversion: 2.1 time: 0.075189 Oct 04 22:19:07.747605 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3769/7558] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:07 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7 => generated 1262 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:08.771445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cd665494-8821-4d8a-906a-869b8b66559a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:08.772081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cd665494-8821-4d8a-906a-869b8b66559a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:08.785278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd665494-8821-4d8a-906a-869b8b66559a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:08.785828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd665494-8821-4d8a-906a-869b8b66559a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:08.786290 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd665494-8821-4d8a-906a-869b8b66559a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:08.787043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd665494-8821-4d8a-906a-869b8b66559a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:08.787695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd665494-8821-4d8a-906a-869b8b66559a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:08.788195 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd665494-8821-4d8a-906a-869b8b66559a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:08.869470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cd665494-8821-4d8a-906a-869b8b66559a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:08.877751 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cd665494-8821-4d8a-906a-869b8b66559a tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7" status: 200 len: 1266 microversion: 2.1 time: 0.111250 Oct 04 22:19:08.878363 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3790/7559] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:08 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7 => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:09.905587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-665285d7-fde9-45a7-be7d-41ab6217c970 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:09.907022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-665285d7-fde9-45a7-be7d-41ab6217c970 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:09.913828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-665285d7-fde9-45a7-be7d-41ab6217c970 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:09.914322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-665285d7-fde9-45a7-be7d-41ab6217c970 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:09.914918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-665285d7-fde9-45a7-be7d-41ab6217c970 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:09.915753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-665285d7-fde9-45a7-be7d-41ab6217c970 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:09.916437 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-665285d7-fde9-45a7-be7d-41ab6217c970 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:09.917166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-665285d7-fde9-45a7-be7d-41ab6217c970 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:09.983205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-665285d7-fde9-45a7-be7d-41ab6217c970 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:09.991056 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-665285d7-fde9-45a7-be7d-41ab6217c970 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7" status: 200 len: 1332 microversion: 2.1 time: 0.089576 Oct 04 22:19:09.991817 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3770/7560] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:09 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7 => generated 1332 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:11.015699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-614892d1-64de-47cd-af31-7cf567fce498 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:11.016334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-614892d1-64de-47cd-af31-7cf567fce498 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:11.023595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-614892d1-64de-47cd-af31-7cf567fce498 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:11.024809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-614892d1-64de-47cd-af31-7cf567fce498 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:11.025317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-614892d1-64de-47cd-af31-7cf567fce498 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:11.026082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-614892d1-64de-47cd-af31-7cf567fce498 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:11.026555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-614892d1-64de-47cd-af31-7cf567fce498 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:11.026997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-614892d1-64de-47cd-af31-7cf567fce498 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:11.164447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-614892d1-64de-47cd-af31-7cf567fce498 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:11.172962 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-614892d1-64de-47cd-af31-7cf567fce498 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7" status: 200 len: 1362 microversion: 2.1 time: 0.161232 Oct 04 22:19:11.173571 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3791/7561] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:11 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:11.317549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-acc9a40d-1c2e-49a5-96aa-c7526c2b2fe6 req-8fc7931d-79ed-4b13-8c4d-82e625659d0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd50177d-7701-43c8-81a9-82875d6acae7", "tag": "a046c385-0621-427c-984d-791e02c52316"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:11.328779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-acc9a40d-1c2e-49a5-96aa-c7526c2b2fe6 req-8fc7931d-79ed-4b13-8c4d-82e625659d0d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:11.329264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-acc9a40d-1c2e-49a5-96aa-c7526c2b2fe6 req-8fc7931d-79ed-4b13-8c4d-82e625659d0d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:11.329733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-acc9a40d-1c2e-49a5-96aa-c7526c2b2fe6 req-8fc7931d-79ed-4b13-8c4d-82e625659d0d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:11.341541 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-acc9a40d-1c2e-49a5-96aa-c7526c2b2fe6 req-8fc7931d-79ed-4b13-8c4d-82e625659d0d service nova] Creating event network-changed:a046c385-0621-427c-984d-791e02c52316 for instance dd50177d-7701-43c8-81a9-82875d6acae7 on n-h1-860282-1 Oct 04 22:19:11.346294 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-acc9a40d-1c2e-49a5-96aa-c7526c2b2fe6 req-8fc7931d-79ed-4b13-8c4d-82e625659d0d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033518 Oct 04 22:19:11.346929 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3771/7562] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:12.196579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cf401951-10ed-4559-af01-17d8838ce60f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:12.197107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cf401951-10ed-4559-af01-17d8838ce60f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:12.204407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf401951-10ed-4559-af01-17d8838ce60f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:12.204911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf401951-10ed-4559-af01-17d8838ce60f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:12.205365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf401951-10ed-4559-af01-17d8838ce60f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:12.206098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf401951-10ed-4559-af01-17d8838ce60f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:12.206712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf401951-10ed-4559-af01-17d8838ce60f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:12.207158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf401951-10ed-4559-af01-17d8838ce60f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:12.333745 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cf401951-10ed-4559-af01-17d8838ce60f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:12.342051 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cf401951-10ed-4559-af01-17d8838ce60f tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7" status: 200 len: 1362 microversion: 2.1 time: 0.149482 Oct 04 22:19:12.342629 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3792/7563] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:12 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:13.366951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6d94938f-ac0f-4b43-a5a5-5de6a423e802 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:13.368279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6d94938f-ac0f-4b43-a5a5-5de6a423e802 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:13.374850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d94938f-ac0f-4b43-a5a5-5de6a423e802 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:13.375345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d94938f-ac0f-4b43-a5a5-5de6a423e802 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:13.375790 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d94938f-ac0f-4b43-a5a5-5de6a423e802 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:13.376493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d94938f-ac0f-4b43-a5a5-5de6a423e802 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:13.376964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d94938f-ac0f-4b43-a5a5-5de6a423e802 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:13.377401 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d94938f-ac0f-4b43-a5a5-5de6a423e802 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:13.512086 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6d94938f-ac0f-4b43-a5a5-5de6a423e802 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:13.519809 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6d94938f-ac0f-4b43-a5a5-5de6a423e802 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7" status: 200 len: 1362 microversion: 2.1 time: 0.158037 Oct 04 22:19:13.520371 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3772/7564] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:13 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:14.550569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7ea8474c-1893-48af-a1a1-3fad291a8242 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:14.550569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7ea8474c-1893-48af-a1a1-3fad291a8242 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:14.550569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ea8474c-1893-48af-a1a1-3fad291a8242 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:14.550569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ea8474c-1893-48af-a1a1-3fad291a8242 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:14.551264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ea8474c-1893-48af-a1a1-3fad291a8242 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:14.551725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ea8474c-1893-48af-a1a1-3fad291a8242 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:14.552200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ea8474c-1893-48af-a1a1-3fad291a8242 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:14.552642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7ea8474c-1893-48af-a1a1-3fad291a8242 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:14.682263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7ea8474c-1893-48af-a1a1-3fad291a8242 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:14.689005 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7ea8474c-1893-48af-a1a1-3fad291a8242 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7" status: 200 len: 1362 microversion: 2.1 time: 0.150322 Oct 04 22:19:14.689603 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3793/7565] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:14 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:15.713370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-53e3cc33-9b74-4248-a265-3a88e3c75a16 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:15.714060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-53e3cc33-9b74-4248-a265-3a88e3c75a16 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:15.720451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53e3cc33-9b74-4248-a265-3a88e3c75a16 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:15.720943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53e3cc33-9b74-4248-a265-3a88e3c75a16 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:15.721391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53e3cc33-9b74-4248-a265-3a88e3c75a16 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:15.722108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53e3cc33-9b74-4248-a265-3a88e3c75a16 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:15.722573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53e3cc33-9b74-4248-a265-3a88e3c75a16 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:15.723006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53e3cc33-9b74-4248-a265-3a88e3c75a16 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:15.852926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-53e3cc33-9b74-4248-a265-3a88e3c75a16 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:15.860629 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-53e3cc33-9b74-4248-a265-3a88e3c75a16 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7" status: 200 len: 1362 microversion: 2.1 time: 0.151958 Oct 04 22:19:15.861204 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3773/7566] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:15 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:16.883798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cd6b8f49-e668-4e6c-b389-160bf5948ffc tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:16.884586 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cd6b8f49-e668-4e6c-b389-160bf5948ffc tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:16.891817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd6b8f49-e668-4e6c-b389-160bf5948ffc tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:16.892330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd6b8f49-e668-4e6c-b389-160bf5948ffc tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:16.892795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd6b8f49-e668-4e6c-b389-160bf5948ffc tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:16.893551 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd6b8f49-e668-4e6c-b389-160bf5948ffc tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:16.894036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd6b8f49-e668-4e6c-b389-160bf5948ffc tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:16.894485 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd6b8f49-e668-4e6c-b389-160bf5948ffc tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:17.032441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cd6b8f49-e668-4e6c-b389-160bf5948ffc tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:17.040685 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cd6b8f49-e668-4e6c-b389-160bf5948ffc tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7" status: 200 len: 1362 microversion: 2.1 time: 0.160185 Oct 04 22:19:17.041440 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3794/7567] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:16 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:18.066803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ec6922b4-736e-4a23-aa22-59d5de1afd10 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:18.067187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ec6922b4-736e-4a23-aa22-59d5de1afd10 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:18.070393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:18.076584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-5a42123a-4bf0-47d3-8199-ae32239bebd1 req-25d947e3-20da-44f1-8a49-460583627f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd50177d-7701-43c8-81a9-82875d6acae7", "name": "network-vif-plugged", "status": "completed", "tag": "a046c385-0621-427c-984d-791e02c52316"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:18.077370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec6922b4-736e-4a23-aa22-59d5de1afd10 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:18.077908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec6922b4-736e-4a23-aa22-59d5de1afd10 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:18.081400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec6922b4-736e-4a23-aa22-59d5de1afd10 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:18.081400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec6922b4-736e-4a23-aa22-59d5de1afd10 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:18.081400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec6922b4-736e-4a23-aa22-59d5de1afd10 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:18.081400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec6922b4-736e-4a23-aa22-59d5de1afd10 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:18.081806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:18.082365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:18.088751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-5a42123a-4bf0-47d3-8199-ae32239bebd1 req-25d947e3-20da-44f1-8a49-460583627f19 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:18.089242 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-5a42123a-4bf0-47d3-8199-ae32239bebd1 req-25d947e3-20da-44f1-8a49-460583627f19 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:18.089714 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-5a42123a-4bf0-47d3-8199-ae32239bebd1 req-25d947e3-20da-44f1-8a49-460583627f19 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:18.100800 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-5a42123a-4bf0-47d3-8199-ae32239bebd1 req-25d947e3-20da-44f1-8a49-460583627f19 service nova] Creating event network-vif-plugged:a046c385-0621-427c-984d-791e02c52316 for instance dd50177d-7701-43c8-81a9-82875d6acae7 on n-h1-860282-1 Oct 04 22:19:18.106662 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-5a42123a-4bf0-47d3-8199-ae32239bebd1 req-25d947e3-20da-44f1-8a49-460583627f19 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034439 Oct 04 22:19:18.107260 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3795/7568] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:18.228493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ec6922b4-736e-4a23-aa22-59d5de1afd10 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:18.236860 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ec6922b4-736e-4a23-aa22-59d5de1afd10 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7" status: 200 len: 1362 microversion: 2.1 time: 0.174277 Oct 04 22:19:18.237480 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3774/7569] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:18 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:19.264197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7bbf05fe-0fc8-45d9-8bbb-6b541f2f8067 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:19.265000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7bbf05fe-0fc8-45d9-8bbb-6b541f2f8067 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:19.272599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bbf05fe-0fc8-45d9-8bbb-6b541f2f8067 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:19.273130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bbf05fe-0fc8-45d9-8bbb-6b541f2f8067 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:19.273618 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bbf05fe-0fc8-45d9-8bbb-6b541f2f8067 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:19.275116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bbf05fe-0fc8-45d9-8bbb-6b541f2f8067 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:19.275524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bbf05fe-0fc8-45d9-8bbb-6b541f2f8067 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:19.275974 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bbf05fe-0fc8-45d9-8bbb-6b541f2f8067 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:19.412730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7bbf05fe-0fc8-45d9-8bbb-6b541f2f8067 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:19.421310 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7bbf05fe-0fc8-45d9-8bbb-6b541f2f8067 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7" status: 200 len: 1362 microversion: 2.1 time: 0.163209 Oct 04 22:19:19.421925 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3796/7570] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:19 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:20.443765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f16584fa-424c-472d-a82a-870a028e4c2b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:20.444383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f16584fa-424c-472d-a82a-870a028e4c2b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:20.451738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f16584fa-424c-472d-a82a-870a028e4c2b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:20.452223 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f16584fa-424c-472d-a82a-870a028e4c2b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:20.452664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f16584fa-424c-472d-a82a-870a028e4c2b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:20.453357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f16584fa-424c-472d-a82a-870a028e4c2b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:20.453847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f16584fa-424c-472d-a82a-870a028e4c2b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:20.454278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f16584fa-424c-472d-a82a-870a028e4c2b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:20.588253 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f16584fa-424c-472d-a82a-870a028e4c2b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:20.597499 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f16584fa-424c-472d-a82a-870a028e4c2b tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7" status: 200 len: 1555 microversion: 2.1 time: 0.157588 Oct 04 22:19:20.598083 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3775/7571] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:20 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:20.624311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ea7bc248-029e-4b95-b39b-991f032cbe41 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:20.624963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ea7bc248-029e-4b95-b39b-991f032cbe41 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:20.631941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea7bc248-029e-4b95-b39b-991f032cbe41 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:20.632445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea7bc248-029e-4b95-b39b-991f032cbe41 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:20.632901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea7bc248-029e-4b95-b39b-991f032cbe41 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:20.633681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea7bc248-029e-4b95-b39b-991f032cbe41 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:20.634159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea7bc248-029e-4b95-b39b-991f032cbe41 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:20.634607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ea7bc248-029e-4b95-b39b-991f032cbe41 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:20.639005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:20.768709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ea7bc248-029e-4b95-b39b-991f032cbe41 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:20.777089 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ea7bc248-029e-4b95-b39b-991f032cbe41 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7" status: 200 len: 1555 microversion: 2.1 time: 0.156657 Oct 04 22:19:20.777699 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3797/7572] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:20 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:23.787519 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f59e91d8-59b5-4801-b569-e1c58df5d046 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "378fc0ca-b90d-44e7-a6be-01bba5c8cb3f"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:23.790246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f59e91d8-59b5-4801-b569-e1c58df5d046 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:23.797006 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f59e91d8-59b5-4801-b569-e1c58df5d046 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:23.797554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f59e91d8-59b5-4801-b569-e1c58df5d046 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:23.798092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f59e91d8-59b5-4801-b569-e1c58df5d046 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:23.798784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f59e91d8-59b5-4801-b569-e1c58df5d046 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:23.799244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f59e91d8-59b5-4801-b569-e1c58df5d046 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:23.799676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f59e91d8-59b5-4801-b569-e1c58df5d046 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:24.545313 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f59e91d8-59b5-4801-b569-e1c58df5d046 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "POST /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761589 Oct 04 22:19:24.545956 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3776/7573] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 22:19:23 2022] POST /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:36.325201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3f3df48b-6be1-459a-88e0-4113cd6aebe9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:36.325740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3f3df48b-6be1-459a-88e0-4113cd6aebe9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:36.329246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:36.334386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f3df48b-6be1-459a-88e0-4113cd6aebe9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:36.334892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f3df48b-6be1-459a-88e0-4113cd6aebe9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:36.335352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f3df48b-6be1-459a-88e0-4113cd6aebe9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:36.336064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f3df48b-6be1-459a-88e0-4113cd6aebe9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:36.337320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f3df48b-6be1-459a-88e0-4113cd6aebe9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:36.337739 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f3df48b-6be1-459a-88e0-4113cd6aebe9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:36.419771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-3f3df48b-6be1-459a-88e0-4113cd6aebe9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lazy-loading 'services' on Instance uuid dd50177d-7701-43c8-81a9-82875d6acae7 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:19:36.579805 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3f3df48b-6be1-459a-88e0-4113cd6aebe9 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7/os-volume_attachments/378fc0ca-b90d-44e7-a6be-01bba5c8cb3f" status: 202 len: 0 microversion: 2.1 time: 0.258432 Oct 04 22:19:36.580443 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3798/7574] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 22:19:36 2022] DELETE /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7/os-volume_attachments/378fc0ca-b90d-44e7-a6be-01bba5c8cb3f => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:19:36.587101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:36.588134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:36.592480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a5621421-e84d-487e-97e7-2331ab9b5c8d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:36.594955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a5621421-e84d-487e-97e7-2331ab9b5c8d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:36.601022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a5621421-e84d-487e-97e7-2331ab9b5c8d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:36.601540 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a5621421-e84d-487e-97e7-2331ab9b5c8d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:36.603580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a5621421-e84d-487e-97e7-2331ab9b5c8d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:36.603580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a5621421-e84d-487e-97e7-2331ab9b5c8d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:36.603580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a5621421-e84d-487e-97e7-2331ab9b5c8d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:36.603580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a5621421-e84d-487e-97e7-2331ab9b5c8d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:36.634303 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a5621421-e84d-487e-97e7-2331ab9b5c8d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049163 Oct 04 22:19:36.635150 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3777/7575] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:19:36 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:37.650183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9e177815-3f0d-4b16-ab3e-287c355e2178 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:37.652556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9e177815-3f0d-4b16-ab3e-287c355e2178 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:37.658993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e177815-3f0d-4b16-ab3e-287c355e2178 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:37.659681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e177815-3f0d-4b16-ab3e-287c355e2178 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:37.660136 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e177815-3f0d-4b16-ab3e-287c355e2178 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:37.660895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e177815-3f0d-4b16-ab3e-287c355e2178 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:37.661524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e177815-3f0d-4b16-ab3e-287c355e2178 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:37.676911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e177815-3f0d-4b16-ab3e-287c355e2178 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:37.695244 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9e177815-3f0d-4b16-ab3e-287c355e2178 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051267 Oct 04 22:19:37.699682 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3799/7576] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:19:37 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:38.708757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a81ec9c0-456c-4782-9c9d-2eb0aa8f0bfa tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:38.713197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a81ec9c0-456c-4782-9c9d-2eb0aa8f0bfa tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:38.720298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a81ec9c0-456c-4782-9c9d-2eb0aa8f0bfa tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:38.720839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a81ec9c0-456c-4782-9c9d-2eb0aa8f0bfa tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:38.721286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a81ec9c0-456c-4782-9c9d-2eb0aa8f0bfa tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:38.722087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a81ec9c0-456c-4782-9c9d-2eb0aa8f0bfa tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:38.722548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a81ec9c0-456c-4782-9c9d-2eb0aa8f0bfa tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:38.722980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a81ec9c0-456c-4782-9c9d-2eb0aa8f0bfa tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:38.754326 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a81ec9c0-456c-4782-9c9d-2eb0aa8f0bfa tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049729 Oct 04 22:19:38.754905 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3778/7577] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:19:38 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:39.767492 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-573631aa-bd64-483a-b62f-c5462b3a04fd tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:39.769828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-573631aa-bd64-483a-b62f-c5462b3a04fd tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:39.777113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-573631aa-bd64-483a-b62f-c5462b3a04fd tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:39.777648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-573631aa-bd64-483a-b62f-c5462b3a04fd tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:39.778108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-573631aa-bd64-483a-b62f-c5462b3a04fd tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:39.778825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-573631aa-bd64-483a-b62f-c5462b3a04fd tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:39.779298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-573631aa-bd64-483a-b62f-c5462b3a04fd tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:39.779743 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-573631aa-bd64-483a-b62f-c5462b3a04fd tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:39.812619 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-573631aa-bd64-483a-b62f-c5462b3a04fd tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049387 Oct 04 22:19:39.813092 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3800/7578] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:19:39 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:40.825591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-53c34923-062d-4081-afd4-ba0f810ab4ad tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:40.827904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-53c34923-062d-4081-afd4-ba0f810ab4ad tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:40.835373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53c34923-062d-4081-afd4-ba0f810ab4ad tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:40.835860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53c34923-062d-4081-afd4-ba0f810ab4ad tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:40.836352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53c34923-062d-4081-afd4-ba0f810ab4ad tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:40.837139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53c34923-062d-4081-afd4-ba0f810ab4ad tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:40.837624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53c34923-062d-4081-afd4-ba0f810ab4ad tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:40.838088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-53c34923-062d-4081-afd4-ba0f810ab4ad tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:40.868351 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-53c34923-062d-4081-afd4-ba0f810ab4ad tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047515 Oct 04 22:19:40.868921 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3779/7579] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:19:40 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:41.880088 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2b7e1f5a-dcd6-473b-b97f-89f0826f3993 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:41.882285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2b7e1f5a-dcd6-473b-b97f-89f0826f3993 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:41.889467 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b7e1f5a-dcd6-473b-b97f-89f0826f3993 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:41.889972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b7e1f5a-dcd6-473b-b97f-89f0826f3993 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:41.890425 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b7e1f5a-dcd6-473b-b97f-89f0826f3993 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:41.891129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b7e1f5a-dcd6-473b-b97f-89f0826f3993 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:41.891602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b7e1f5a-dcd6-473b-b97f-89f0826f3993 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:41.892044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b7e1f5a-dcd6-473b-b97f-89f0826f3993 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:41.922125 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2b7e1f5a-dcd6-473b-b97f-89f0826f3993 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046028 Oct 04 22:19:41.922690 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3801/7580] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:19:41 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:19:41.933552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d6b93f77-86dc-44fb-8f71-9f91cbaa4188 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:41.934079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d6b93f77-86dc-44fb-8f71-9f91cbaa4188 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:41.941319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6b93f77-86dc-44fb-8f71-9f91cbaa4188 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:41.941852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6b93f77-86dc-44fb-8f71-9f91cbaa4188 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:41.942295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6b93f77-86dc-44fb-8f71-9f91cbaa4188 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:41.943024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6b93f77-86dc-44fb-8f71-9f91cbaa4188 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:41.943488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6b93f77-86dc-44fb-8f71-9f91cbaa4188 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:41.943924 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6b93f77-86dc-44fb-8f71-9f91cbaa4188 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:42.030619 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-d6b93f77-86dc-44fb-8f71-9f91cbaa4188 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] HTTP exception thrown: Instance dd50177d-7701-43c8-81a9-82875d6acae7 is not attached to volume 378fc0ca-b90d-44e7-a6be-01bba5c8cb3f Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d6b93f77-86dc-44fb-8f71-9f91cbaa4188 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Request method failure captured: Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: request: DELETE /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7/os-volume_attachments/378fc0ca-b90d-44e7-a6be-01bba5c8cb3f HTTP/1.1 Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPLEAvyBEdHzKQjPFxv2VzOeLNMb4jnXYES8tcLINHK7ri-sHBSnj97gWSWg0EyCavx447Mmh13WVZ1paS5xdLy9znsL853tESqAKjIwo_A0H3gSafcxRhkA0TNopp_XmDu0wubw4xDYVaRmqX8r3KMAKus17S2cwPqtmsm68KeISBpA Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 76c9a0ad4e82496ab61a251cbcb0a04c Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestEncryptedCinderVolumes-900665055 Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76c9a0ad4e82496ab61a251cbcb0a04c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_76c9a0ad4e82496ab61a251cbcb0a04c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/76c9a0ad4e82496ab61a251cbcb0a04c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76c9a0ad4e82496ab61a251cbcb0a04c"}]}] Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestEncryptedCinderVolumes-900665055 Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 76c9a0ad4e82496ab61a251cbcb0a04c Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-900665055 Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestEncryptedCinderVolumes-900665055-project Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: e2342ae39a8542fa84bc9662e5764dd9 Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestEncryptedCinderVolumes-900665055-project Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance dd50177d-7701-43c8-81a9-82875d6acae7 is not attached to volume 378fc0ca-b90d-44e7-a6be-01bba5c8cb3f Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'server_id': 'dd50177d-7701-43c8-81a9-82875d6acae7', 'id': '378fc0ca-b90d-44e7-a6be-01bba5c8cb3f'} Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 378fc0ca-b90d-44e7-a6be-01bba5c8cb3f. Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd50177d-7701-43c8-81a9-82875d6acae7 is not attached to volume 378fc0ca-b90d-44e7-a6be-01bba5c8cb3f Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:19:42.032313 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:19:42.037204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:19:42.037204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:19:42.037204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd50177d-7701-43c8-81a9-82875d6acae7 is not attached to volume 378fc0ca-b90d-44e7-a6be-01bba5c8cb3f Oct 04 22:19:42.037204 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:19:42.037204 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d6b93f77-86dc-44fb-8f71-9f91cbaa4188 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Returning 404 to user: Instance dd50177d-7701-43c8-81a9-82875d6acae7 is not attached to volume 378fc0ca-b90d-44e7-a6be-01bba5c8cb3f {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:19:42.037204 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d6b93f77-86dc-44fb-8f71-9f91cbaa4188 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7/os-volume_attachments/378fc0ca-b90d-44e7-a6be-01bba5c8cb3f" status: 404 len: 154 microversion: 2.1 time: 0.104588 Oct 04 22:19:42.037204 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3780/7581] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 22:19:41 2022] DELETE /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7/os-volume_attachments/378fc0ca-b90d-44e7-a6be-01bba5c8cb3f => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:19:45.548796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-53d0c1f0-0793-4013-abd7-7a19b7293fac tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:45.549332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-53d0c1f0-0793-4013-abd7-7a19b7293fac tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:45.556276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53d0c1f0-0793-4013-abd7-7a19b7293fac tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:45.556792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53d0c1f0-0793-4013-abd7-7a19b7293fac tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:45.557249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53d0c1f0-0793-4013-abd7-7a19b7293fac tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:45.558002 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53d0c1f0-0793-4013-abd7-7a19b7293fac tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:45.558478 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53d0c1f0-0793-4013-abd7-7a19b7293fac tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:45.558922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-53d0c1f0-0793-4013-abd7-7a19b7293fac tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:45.585307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-53d0c1f0-0793-4013-abd7-7a19b7293fac tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:19:45.826791 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-53d0c1f0-0793-4013-abd7-7a19b7293fac tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7" status: 204 len: 0 microversion: 2.1 time: 0.281484 Oct 04 22:19:45.827411 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3802/7582] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:19:45 2022] DELETE /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:19:45.836029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5ff01a7c-308f-4e74-8d67-50083ea145a5 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:45.836656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5ff01a7c-308f-4e74-8d67-50083ea145a5 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:45.844368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ff01a7c-308f-4e74-8d67-50083ea145a5 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:45.844897 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ff01a7c-308f-4e74-8d67-50083ea145a5 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:45.845339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ff01a7c-308f-4e74-8d67-50083ea145a5 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:45.846072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ff01a7c-308f-4e74-8d67-50083ea145a5 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:45.846606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ff01a7c-308f-4e74-8d67-50083ea145a5 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:45.846966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ff01a7c-308f-4e74-8d67-50083ea145a5 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:45.986217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5ff01a7c-308f-4e74-8d67-50083ea145a5 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:45.994443 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5ff01a7c-308f-4e74-8d67-50083ea145a5 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7" status: 200 len: 1561 microversion: 2.1 time: 0.162360 Oct 04 22:19:45.995122 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3781/7583] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:45 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:47.019540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3d44ebb6-a6f7-4046-bf6f-54348868d288 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:47.020252 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3d44ebb6-a6f7-4046-bf6f-54348868d288 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:47.027260 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d44ebb6-a6f7-4046-bf6f-54348868d288 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:47.027750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d44ebb6-a6f7-4046-bf6f-54348868d288 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:47.028209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d44ebb6-a6f7-4046-bf6f-54348868d288 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:47.028902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d44ebb6-a6f7-4046-bf6f-54348868d288 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:47.029367 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d44ebb6-a6f7-4046-bf6f-54348868d288 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:47.029836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3d44ebb6-a6f7-4046-bf6f-54348868d288 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:47.159728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3d44ebb6-a6f7-4046-bf6f-54348868d288 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:47.167732 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3d44ebb6-a6f7-4046-bf6f-54348868d288 tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7" status: 200 len: 1561 microversion: 2.1 time: 0.152463 Oct 04 22:19:47.168312 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3803/7584] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:47 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:47.860528 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-acdcd0d6-a95f-48a0-8426-31b820cff59b req-96ceae1c-e20b-418c-b4dc-37d7bb3740c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd50177d-7701-43c8-81a9-82875d6acae7", "name": "network-vif-deleted", "tag": "a046c385-0621-427c-984d-791e02c52316"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:47.873183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-acdcd0d6-a95f-48a0-8426-31b820cff59b req-96ceae1c-e20b-418c-b4dc-37d7bb3740c1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:47.873699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-acdcd0d6-a95f-48a0-8426-31b820cff59b req-96ceae1c-e20b-418c-b4dc-37d7bb3740c1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:47.874139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-acdcd0d6-a95f-48a0-8426-31b820cff59b req-96ceae1c-e20b-418c-b4dc-37d7bb3740c1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:47.886787 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-acdcd0d6-a95f-48a0-8426-31b820cff59b req-96ceae1c-e20b-418c-b4dc-37d7bb3740c1 service nova] Creating event network-vif-deleted:a046c385-0621-427c-984d-791e02c52316 for instance dd50177d-7701-43c8-81a9-82875d6acae7 on n-h1-860282-1 Oct 04 22:19:47.892876 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-acdcd0d6-a95f-48a0-8426-31b820cff59b req-96ceae1c-e20b-418c-b4dc-37d7bb3740c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036413 Oct 04 22:19:47.893512 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3782/7585] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:48.192423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9e474054-3c60-45a0-bb89-f3ba65ec243d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:48.193148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9e474054-3c60-45a0-bb89-f3ba65ec243d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:48.201280 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e474054-3c60-45a0-bb89-f3ba65ec243d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:48.201949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e474054-3c60-45a0-bb89-f3ba65ec243d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:48.202514 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e474054-3c60-45a0-bb89-f3ba65ec243d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:48.203302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e474054-3c60-45a0-bb89-f3ba65ec243d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:48.203851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e474054-3c60-45a0-bb89-f3ba65ec243d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:48.204369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e474054-3c60-45a0-bb89-f3ba65ec243d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:48.238917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e474054-3c60-45a0-bb89-f3ba65ec243d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:48.239428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e474054-3c60-45a0-bb89-f3ba65ec243d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:48.240083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9e474054-3c60-45a0-bb89-f3ba65ec243d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:48.240568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-9e474054-3c60-45a0-bb89-f3ba65ec243d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lazy-loading 'fault' on Instance uuid dd50177d-7701-43c8-81a9-82875d6acae7 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:19:48.294465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9e474054-3c60-45a0-bb89-f3ba65ec243d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2342ae39a8542fa84bc9662e5764dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c9a0ad4e82496ab61a251cbcb0a04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:48.302284 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9e474054-3c60-45a0-bb89-f3ba65ec243d tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7" status: 200 len: 1352 microversion: 2.1 time: 0.114102 Oct 04 22:19:48.302863 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3804/7586] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:48 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7 => generated 1352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:49.327004 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-81820407-90c8-4db7-b2ca-c2f0b7c295cb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:49.327721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-81820407-90c8-4db7-b2ca-c2f0b7c295cb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] [instance: dd50177d-7701-43c8-81a9-82875d6acae7] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:49.334712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81820407-90c8-4db7-b2ca-c2f0b7c295cb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:49.335191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81820407-90c8-4db7-b2ca-c2f0b7c295cb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:49.335630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81820407-90c8-4db7-b2ca-c2f0b7c295cb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:49.336316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81820407-90c8-4db7-b2ca-c2f0b7c295cb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:49.336770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81820407-90c8-4db7-b2ca-c2f0b7c295cb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:49.337197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-81820407-90c8-4db7-b2ca-c2f0b7c295cb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:49.350644 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-81820407-90c8-4db7-b2ca-c2f0b7c295cb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] HTTP exception thrown: Instance dd50177d-7701-43c8-81a9-82875d6acae7 could not be found. Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-81820407-90c8-4db7-b2ca-c2f0b7c295cb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Request method failure captured: Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7 HTTP/1.1 Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPLEAvyBEdHzKQjPFxv2VzOeLNMb4jnXYES8tcLINHK7ri-sHBSnj97gWSWg0EyCavx447Mmh13WVZ1paS5xdLy9znsL853tESqAKjIwo_A0H3gSafcxRhkA0TNopp_XmDu0wubw4xDYVaRmqX8r3KMAKus17S2cwPqtmsm68KeISBpA Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 76c9a0ad4e82496ab61a251cbcb0a04c Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestEncryptedCinderVolumes-900665055 Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76c9a0ad4e82496ab61a251cbcb0a04c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_76c9a0ad4e82496ab61a251cbcb0a04c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/76c9a0ad4e82496ab61a251cbcb0a04c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76c9a0ad4e82496ab61a251cbcb0a04c"}]}] Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestEncryptedCinderVolumes-900665055 Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 76c9a0ad4e82496ab61a251cbcb0a04c Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-900665055 Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestEncryptedCinderVolumes-900665055-project Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: e2342ae39a8542fa84bc9662e5764dd9 Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestEncryptedCinderVolumes-900665055-project Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance dd50177d-7701-43c8-81a9-82875d6acae7 could not be found. Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'dd50177d-7701-43c8-81a9-82875d6acae7'} Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd50177d-7701-43c8-81a9-82875d6acae7 could not be found. Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd50177d-7701-43c8-81a9-82875d6acae7 could not be found. Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:19:49.352285 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:19:49.359053 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:19:49.359053 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:19:49.359053 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:19:49.359053 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:19:49.359053 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:19:49.359053 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd50177d-7701-43c8-81a9-82875d6acae7 could not be found. Oct 04 22:19:49.359053 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:19:49.359053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-81820407-90c8-4db7-b2ca-c2f0b7c295cb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Returning 404 to user: Instance dd50177d-7701-43c8-81a9-82875d6acae7 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:19:49.359053 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-81820407-90c8-4db7-b2ca-c2f0b7c295cb tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7" status: 404 len: 111 microversion: 2.1 time: 0.031432 Oct 04 22:19:49.359053 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3783/7587] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:49 2022] GET /compute/v2.1/servers/dd50177d-7701-43c8-81a9-82875d6acae7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:19:49.363291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b2e1e535-c2f5-4b57-aeb7-1a004e9f22cc tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] Calling method '.version_select at 0x7f578b5d9820>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:49.449849 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b2e1e535-c2f5-4b57-aeb7-1a004e9f22cc tempest-TestEncryptedCinderVolumes-900665055 tempest-TestEncryptedCinderVolumes-900665055-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-957449107" status: 202 len: 0 microversion: 2.1 time: 0.090266 Oct 04 22:19:49.450450 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3805/7588] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Oct 4 22:19:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-957449107 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:20:21.497290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6e3ebba3-1186-4a65-89ff-1aa645ab11a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Action: 'create', calling method: .version_select at 0x7f578ae3ef70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1643445338", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsf5U6N3i31+dqDMaz7JeKl23+Ll01KI0pB/+MpH0wq7KsG6CE8OAeyy+UaPGaVeuhyEwYcPWzRlyyRPQjRf7wKWUYzfs6KKYonGL/XvtfPCETXA/su7pY61qkE8icR3g=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:21.503961 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:20:21.504133 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 22:20:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.30) !!! Oct 04 22:20:21.505608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=14 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:21.506277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=34 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:21.521067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-6e3ebba3-1186-4a65-89ff-1aa645ab11a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Getting quotas for project 3aa1500ce5ca4d26b4e2a3eaf3c3ccae. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:20:21.526203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-6e3ebba3-1186-4a65-89ff-1aa645ab11a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Getting quotas for user 7a37c7b63d0b4f0ba08738215f7c2455 and project 3aa1500ce5ca4d26b4e2a3eaf3c3ccae. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:20:21.649434 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6e3ebba3-1186-4a65-89ff-1aa645ab11a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.156129 Oct 04 22:20:21.650061 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3784/7589] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 22:20:21 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:20:21.698221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:21.698996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:21.703068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5267576b-212b-4e5d-b770-d05be0eedc61 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1906456666", "imageRef": "5d016da7-6aaf-4861-bb60-15d1ebf14bab", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1643445338", "networks": [{"uuid": "1c5337a7-1f7b-464b-a44d-7f8875f0c9c0"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:21.755707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-5267576b-212b-4e5d-b770-d05be0eedc61 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] validate_networks() for [('1c5337a7-1f7b-464b-a44d-7f8875f0c9c0', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:20:22.130775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5267576b-212b-4e5d-b770-d05be0eedc61 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:20:22.131534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5267576b-212b-4e5d-b770-d05be0eedc61 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:20:22.132440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5267576b-212b-4e5d-b770-d05be0eedc61 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:20:22.132906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5267576b-212b-4e5d-b770-d05be0eedc61 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:20:22.133358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-5267576b-212b-4e5d-b770-d05be0eedc61 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:20:22.142718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5267576b-212b-4e5d-b770-d05be0eedc61 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:22.143220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5267576b-212b-4e5d-b770-d05be0eedc61 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:22.143678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5267576b-212b-4e5d-b770-d05be0eedc61 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:22.144427 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5267576b-212b-4e5d-b770-d05be0eedc61 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:22.144903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5267576b-212b-4e5d-b770-d05be0eedc61 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:22.145349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5267576b-212b-4e5d-b770-d05be0eedc61 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:22.162922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5267576b-212b-4e5d-b770-d05be0eedc61 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Getting quotas for project 3aa1500ce5ca4d26b4e2a3eaf3c3ccae. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:20:22.168175 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-5267576b-212b-4e5d-b770-d05be0eedc61 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Getting quotas for user 7a37c7b63d0b4f0ba08738215f7c2455 and project 3aa1500ce5ca4d26b4e2a3eaf3c3ccae. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:20:22.180870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5267576b-212b-4e5d-b770-d05be0eedc61 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:20:22.183156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5267576b-212b-4e5d-b770-d05be0eedc61 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d016da7-6aaf-4861-bb60-15d1ebf14bab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:20:22.296149 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5267576b-212b-4e5d-b770-d05be0eedc61 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600565 Oct 04 22:20:22.296730 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3806/7590] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:20:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:20:22.308526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d1a7847b-5feb-4051-be99-1e645e93e668 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:22.309236 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d1a7847b-5feb-4051-be99-1e645e93e668 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:22.364731 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d1a7847b-5feb-4051-be99-1e645e93e668 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:22.371729 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d1a7847b-5feb-4051-be99-1e645e93e668 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1259 microversion: 2.1 time: 0.067142 Oct 04 22:20:22.372309 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3785/7591] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:22 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1259 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:23.400032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-98aa6d80-2c97-4fdf-8ef4-b09fc1ad2e1b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:23.400667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-98aa6d80-2c97-4fdf-8ef4-b09fc1ad2e1b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:23.407293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98aa6d80-2c97-4fdf-8ef4-b09fc1ad2e1b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:23.408447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98aa6d80-2c97-4fdf-8ef4-b09fc1ad2e1b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:23.409038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98aa6d80-2c97-4fdf-8ef4-b09fc1ad2e1b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:23.409784 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98aa6d80-2c97-4fdf-8ef4-b09fc1ad2e1b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:23.410265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98aa6d80-2c97-4fdf-8ef4-b09fc1ad2e1b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:23.410709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98aa6d80-2c97-4fdf-8ef4-b09fc1ad2e1b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:23.474841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-98aa6d80-2c97-4fdf-8ef4-b09fc1ad2e1b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:23.483256 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-98aa6d80-2c97-4fdf-8ef4-b09fc1ad2e1b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1263 microversion: 2.1 time: 0.087646 Oct 04 22:20:23.483892 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3807/7592] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:23 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1263 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:24.506883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-df7bf5dc-dee4-4682-882b-412bf21ac8a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:24.507514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-df7bf5dc-dee4-4682-882b-412bf21ac8a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:24.516783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df7bf5dc-dee4-4682-882b-412bf21ac8a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:24.518027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df7bf5dc-dee4-4682-882b-412bf21ac8a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:24.518477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df7bf5dc-dee4-4682-882b-412bf21ac8a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:24.519189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df7bf5dc-dee4-4682-882b-412bf21ac8a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:24.519718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df7bf5dc-dee4-4682-882b-412bf21ac8a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:24.520132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df7bf5dc-dee4-4682-882b-412bf21ac8a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:24.603691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-df7bf5dc-dee4-4682-882b-412bf21ac8a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:24.612037 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-df7bf5dc-dee4-4682-882b-412bf21ac8a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1319 microversion: 2.1 time: 0.109007 Oct 04 22:20:24.612618 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3786/7593] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:24 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1319 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:25.648447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5d47d205-d6ba-4808-9fc2-cd413abd443d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:25.650878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5d47d205-d6ba-4808-9fc2-cd413abd443d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:25.663009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d47d205-d6ba-4808-9fc2-cd413abd443d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:25.664050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d47d205-d6ba-4808-9fc2-cd413abd443d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:25.664693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d47d205-d6ba-4808-9fc2-cd413abd443d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:25.665837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d47d205-d6ba-4808-9fc2-cd413abd443d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:25.670474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d47d205-d6ba-4808-9fc2-cd413abd443d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:25.671499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5d47d205-d6ba-4808-9fc2-cd413abd443d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:25.871339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5d47d205-d6ba-4808-9fc2-cd413abd443d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:25.880336 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5d47d205-d6ba-4808-9fc2-cd413abd443d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1359 microversion: 2.1 time: 0.242703 Oct 04 22:20:25.880920 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3808/7594] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:25 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:26.904251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6197d425-5082-4d6c-b965-5ddf35ce7dea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:26.904874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6197d425-5082-4d6c-b965-5ddf35ce7dea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:26.912695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6197d425-5082-4d6c-b965-5ddf35ce7dea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:26.913274 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6197d425-5082-4d6c-b965-5ddf35ce7dea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:26.913825 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6197d425-5082-4d6c-b965-5ddf35ce7dea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:26.914608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6197d425-5082-4d6c-b965-5ddf35ce7dea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:26.915303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6197d425-5082-4d6c-b965-5ddf35ce7dea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:26.916076 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6197d425-5082-4d6c-b965-5ddf35ce7dea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:27.075057 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6197d425-5082-4d6c-b965-5ddf35ce7dea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:27.093140 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6197d425-5082-4d6c-b965-5ddf35ce7dea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1359 microversion: 2.1 time: 0.192411 Oct 04 22:20:27.094781 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3787/7595] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:26 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:28.116723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-12177e39-9d1b-4d5a-b08c-5e4b702217ea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:28.117361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-12177e39-9d1b-4d5a-b08c-5e4b702217ea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:28.124381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12177e39-9d1b-4d5a-b08c-5e4b702217ea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:28.124893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12177e39-9d1b-4d5a-b08c-5e4b702217ea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:28.125351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12177e39-9d1b-4d5a-b08c-5e4b702217ea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:28.126190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12177e39-9d1b-4d5a-b08c-5e4b702217ea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:28.127326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12177e39-9d1b-4d5a-b08c-5e4b702217ea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:28.128133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-12177e39-9d1b-4d5a-b08c-5e4b702217ea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:28.279711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-12177e39-9d1b-4d5a-b08c-5e4b702217ea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:28.289140 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-12177e39-9d1b-4d5a-b08c-5e4b702217ea tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1359 microversion: 2.1 time: 0.176186 Oct 04 22:20:28.290550 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3809/7596] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:28 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:29.317218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b934b8e4-6a11-4e8b-8ee6-5c6bbdc81704 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:29.317953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b934b8e4-6a11-4e8b-8ee6-5c6bbdc81704 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:29.325368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b934b8e4-6a11-4e8b-8ee6-5c6bbdc81704 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:29.325895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b934b8e4-6a11-4e8b-8ee6-5c6bbdc81704 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:29.326335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b934b8e4-6a11-4e8b-8ee6-5c6bbdc81704 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:29.327038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b934b8e4-6a11-4e8b-8ee6-5c6bbdc81704 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:29.327495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b934b8e4-6a11-4e8b-8ee6-5c6bbdc81704 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:29.327920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b934b8e4-6a11-4e8b-8ee6-5c6bbdc81704 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:29.496332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b934b8e4-6a11-4e8b-8ee6-5c6bbdc81704 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:29.506712 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b934b8e4-6a11-4e8b-8ee6-5c6bbdc81704 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1359 microversion: 2.1 time: 0.194074 Oct 04 22:20:29.507976 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3788/7597] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:29 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:30.534254 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-73baafe6-e52d-45fa-8ce4-5e7219ca4602 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:30.535663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-73baafe6-e52d-45fa-8ce4-5e7219ca4602 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:30.547199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73baafe6-e52d-45fa-8ce4-5e7219ca4602 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:30.547866 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73baafe6-e52d-45fa-8ce4-5e7219ca4602 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:30.549080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73baafe6-e52d-45fa-8ce4-5e7219ca4602 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:30.553387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73baafe6-e52d-45fa-8ce4-5e7219ca4602 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:30.553387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73baafe6-e52d-45fa-8ce4-5e7219ca4602 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:30.553387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-73baafe6-e52d-45fa-8ce4-5e7219ca4602 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:30.704379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-73baafe6-e52d-45fa-8ce4-5e7219ca4602 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:30.712710 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-73baafe6-e52d-45fa-8ce4-5e7219ca4602 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1359 microversion: 2.1 time: 0.184111 Oct 04 22:20:30.713450 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3810/7598] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:30 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:31.736062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f09cf048-bcd3-45f5-a214-20639e442c04 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:31.736888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f09cf048-bcd3-45f5-a214-20639e442c04 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:31.744098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f09cf048-bcd3-45f5-a214-20639e442c04 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:31.744594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f09cf048-bcd3-45f5-a214-20639e442c04 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:31.745045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f09cf048-bcd3-45f5-a214-20639e442c04 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:31.745791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f09cf048-bcd3-45f5-a214-20639e442c04 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:31.746257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f09cf048-bcd3-45f5-a214-20639e442c04 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:31.746700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f09cf048-bcd3-45f5-a214-20639e442c04 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:31.887407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f09cf048-bcd3-45f5-a214-20639e442c04 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:31.896856 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f09cf048-bcd3-45f5-a214-20639e442c04 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1359 microversion: 2.1 time: 0.164702 Oct 04 22:20:31.897667 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3789/7599] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:31 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:32.921101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-290a80ce-77d4-446e-beea-5d1eaade018c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:32.921766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-290a80ce-77d4-446e-beea-5d1eaade018c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:32.924579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:32.925268 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:32.930116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-290a80ce-77d4-446e-beea-5d1eaade018c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:32.930624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-290a80ce-77d4-446e-beea-5d1eaade018c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:32.931084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-290a80ce-77d4-446e-beea-5d1eaade018c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:32.931858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-290a80ce-77d4-446e-beea-5d1eaade018c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:32.932335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-290a80ce-77d4-446e-beea-5d1eaade018c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:32.932835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-290a80ce-77d4-446e-beea-5d1eaade018c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:33.072067 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-290a80ce-77d4-446e-beea-5d1eaade018c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:33.080126 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-290a80ce-77d4-446e-beea-5d1eaade018c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1359 microversion: 2.1 time: 0.162933 Oct 04 22:20:33.081083 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3811/7600] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:32 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:34.103039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3488deaa-84ed-43ab-879e-36ac3971aa2f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:34.103662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3488deaa-84ed-43ab-879e-36ac3971aa2f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:34.105533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:34.111416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3488deaa-84ed-43ab-879e-36ac3971aa2f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:34.112470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3488deaa-84ed-43ab-879e-36ac3971aa2f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:34.118493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3488deaa-84ed-43ab-879e-36ac3971aa2f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:34.118493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3488deaa-84ed-43ab-879e-36ac3971aa2f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:34.118493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3488deaa-84ed-43ab-879e-36ac3971aa2f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:34.118493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3488deaa-84ed-43ab-879e-36ac3971aa2f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:34.264563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3488deaa-84ed-43ab-879e-36ac3971aa2f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:34.274370 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3488deaa-84ed-43ab-879e-36ac3971aa2f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1359 microversion: 2.1 time: 0.173347 Oct 04 22:20:34.274370 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3790/7601] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:34 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:34.300025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b47d2b5b-132c-46ea-b6c7-323f2eb10728 req-f7c5d971-5fef-4b68-8a91-2efc7f814ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d04722c9-8f07-405c-b461-8f3bc5c8875e", "tag": "bd3fe8d5-2e71-49e4-b78e-fb4858cc6a71"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:34.311653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b47d2b5b-132c-46ea-b6c7-323f2eb10728 req-f7c5d971-5fef-4b68-8a91-2efc7f814ed5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:34.312156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b47d2b5b-132c-46ea-b6c7-323f2eb10728 req-f7c5d971-5fef-4b68-8a91-2efc7f814ed5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:34.312605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b47d2b5b-132c-46ea-b6c7-323f2eb10728 req-f7c5d971-5fef-4b68-8a91-2efc7f814ed5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:34.325582 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b47d2b5b-132c-46ea-b6c7-323f2eb10728 req-f7c5d971-5fef-4b68-8a91-2efc7f814ed5 service nova] Creating event network-changed:bd3fe8d5-2e71-49e4-b78e-fb4858cc6a71 for instance d04722c9-8f07-405c-b461-8f3bc5c8875e on n-h2-860282-1 Oct 04 22:20:34.331145 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b47d2b5b-132c-46ea-b6c7-323f2eb10728 req-f7c5d971-5fef-4b68-8a91-2efc7f814ed5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035259 Oct 04 22:20:34.331957 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3812/7602] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:20:35.296858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-df3b34e3-c553-4ef9-abad-09abc8744c3a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:35.297711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-df3b34e3-c553-4ef9-abad-09abc8744c3a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:35.306474 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df3b34e3-c553-4ef9-abad-09abc8744c3a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:35.307025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df3b34e3-c553-4ef9-abad-09abc8744c3a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:35.307476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df3b34e3-c553-4ef9-abad-09abc8744c3a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:35.308199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df3b34e3-c553-4ef9-abad-09abc8744c3a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:35.308666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df3b34e3-c553-4ef9-abad-09abc8744c3a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:35.309101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df3b34e3-c553-4ef9-abad-09abc8744c3a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:35.454077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-df3b34e3-c553-4ef9-abad-09abc8744c3a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:35.463504 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-df3b34e3-c553-4ef9-abad-09abc8744c3a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1359 microversion: 2.1 time: 0.171311 Oct 04 22:20:35.464177 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3791/7603] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:35 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:36.488338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e4bc5983-acbc-4f45-937a-7756b3fe709f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:36.489072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e4bc5983-acbc-4f45-937a-7756b3fe709f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:36.496168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4bc5983-acbc-4f45-937a-7756b3fe709f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:36.496611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4bc5983-acbc-4f45-937a-7756b3fe709f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:36.497054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4bc5983-acbc-4f45-937a-7756b3fe709f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:36.497794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4bc5983-acbc-4f45-937a-7756b3fe709f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:36.498271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4bc5983-acbc-4f45-937a-7756b3fe709f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:36.498720 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e4bc5983-acbc-4f45-937a-7756b3fe709f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:36.637980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e4bc5983-acbc-4f45-937a-7756b3fe709f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:36.645834 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e4bc5983-acbc-4f45-937a-7756b3fe709f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1359 microversion: 2.1 time: 0.162446 Oct 04 22:20:36.646410 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3813/7604] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:36 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:37.669442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-087717bb-8adf-4d61-9041-3775293bbd9e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:37.670071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-087717bb-8adf-4d61-9041-3775293bbd9e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:37.676954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-087717bb-8adf-4d61-9041-3775293bbd9e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:37.677472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-087717bb-8adf-4d61-9041-3775293bbd9e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:37.677925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-087717bb-8adf-4d61-9041-3775293bbd9e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:37.678629 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-087717bb-8adf-4d61-9041-3775293bbd9e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:37.679092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-087717bb-8adf-4d61-9041-3775293bbd9e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:37.679526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-087717bb-8adf-4d61-9041-3775293bbd9e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:37.810201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-087717bb-8adf-4d61-9041-3775293bbd9e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:37.820088 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-087717bb-8adf-4d61-9041-3775293bbd9e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1359 microversion: 2.1 time: 0.154540 Oct 04 22:20:37.821122 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3792/7605] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:37 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:38.844155 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-382782f5-8edc-46fe-b15e-585914e8de6c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:38.844828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-382782f5-8edc-46fe-b15e-585914e8de6c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:38.852537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-382782f5-8edc-46fe-b15e-585914e8de6c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:38.853044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-382782f5-8edc-46fe-b15e-585914e8de6c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:38.853538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-382782f5-8edc-46fe-b15e-585914e8de6c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:38.854250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-382782f5-8edc-46fe-b15e-585914e8de6c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:38.854724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-382782f5-8edc-46fe-b15e-585914e8de6c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:38.855170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-382782f5-8edc-46fe-b15e-585914e8de6c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:38.988423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-382782f5-8edc-46fe-b15e-585914e8de6c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:38.996126 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-382782f5-8edc-46fe-b15e-585914e8de6c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1359 microversion: 2.1 time: 0.155883 Oct 04 22:20:38.996702 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3814/7606] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:38 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:40.019755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4ebf97cb-6ad8-4921-a13c-441eacc9ad38 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:40.020381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4ebf97cb-6ad8-4921-a13c-441eacc9ad38 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:40.027364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ebf97cb-6ad8-4921-a13c-441eacc9ad38 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:40.027854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ebf97cb-6ad8-4921-a13c-441eacc9ad38 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:40.028323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ebf97cb-6ad8-4921-a13c-441eacc9ad38 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:40.029044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ebf97cb-6ad8-4921-a13c-441eacc9ad38 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:40.029516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ebf97cb-6ad8-4921-a13c-441eacc9ad38 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:40.029956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4ebf97cb-6ad8-4921-a13c-441eacc9ad38 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:40.170588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4ebf97cb-6ad8-4921-a13c-441eacc9ad38 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:40.181492 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4ebf97cb-6ad8-4921-a13c-441eacc9ad38 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1359 microversion: 2.1 time: 0.164955 Oct 04 22:20:40.182091 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3793/7607] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:40 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:40.323357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-c132acdd-b11a-44a0-b7f1-36dabda702cb req-89854b9b-0215-4ce1-bde8-f1757d197c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d04722c9-8f07-405c-b461-8f3bc5c8875e", "name": "network-vif-plugged", "status": "completed", "tag": "bd3fe8d5-2e71-49e4-b78e-fb4858cc6a71"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:40.333935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c132acdd-b11a-44a0-b7f1-36dabda702cb req-89854b9b-0215-4ce1-bde8-f1757d197c55 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:40.334475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c132acdd-b11a-44a0-b7f1-36dabda702cb req-89854b9b-0215-4ce1-bde8-f1757d197c55 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:40.334930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-c132acdd-b11a-44a0-b7f1-36dabda702cb req-89854b9b-0215-4ce1-bde8-f1757d197c55 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:40.346274 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-c132acdd-b11a-44a0-b7f1-36dabda702cb req-89854b9b-0215-4ce1-bde8-f1757d197c55 service nova] Creating event network-vif-plugged:bd3fe8d5-2e71-49e4-b78e-fb4858cc6a71 for instance d04722c9-8f07-405c-b461-8f3bc5c8875e on n-h2-860282-1 Oct 04 22:20:40.351249 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-c132acdd-b11a-44a0-b7f1-36dabda702cb req-89854b9b-0215-4ce1-bde8-f1757d197c55 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031620 Oct 04 22:20:40.358811 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3815/7608] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:20:41.204180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ac2fa860-dcbb-4a31-ac08-5b9fbf620fc0 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:41.204798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ac2fa860-dcbb-4a31-ac08-5b9fbf620fc0 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:41.212277 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac2fa860-dcbb-4a31-ac08-5b9fbf620fc0 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:41.212820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac2fa860-dcbb-4a31-ac08-5b9fbf620fc0 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:41.213268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac2fa860-dcbb-4a31-ac08-5b9fbf620fc0 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:41.213983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac2fa860-dcbb-4a31-ac08-5b9fbf620fc0 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:41.214438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac2fa860-dcbb-4a31-ac08-5b9fbf620fc0 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:41.214864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ac2fa860-dcbb-4a31-ac08-5b9fbf620fc0 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:41.348290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ac2fa860-dcbb-4a31-ac08-5b9fbf620fc0 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:41.356008 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ac2fa860-dcbb-4a31-ac08-5b9fbf620fc0 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1359 microversion: 2.1 time: 0.155827 Oct 04 22:20:41.356604 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3794/7609] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:41 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:42.380479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f237a04c-2633-44f3-a725-161de7814c54 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:42.381202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f237a04c-2633-44f3-a725-161de7814c54 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:42.387805 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f237a04c-2633-44f3-a725-161de7814c54 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:42.388312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f237a04c-2633-44f3-a725-161de7814c54 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:42.388772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f237a04c-2633-44f3-a725-161de7814c54 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:42.389502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f237a04c-2633-44f3-a725-161de7814c54 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:42.389978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f237a04c-2633-44f3-a725-161de7814c54 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:42.390426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f237a04c-2633-44f3-a725-161de7814c54 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:42.523996 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f237a04c-2633-44f3-a725-161de7814c54 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:42.532155 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f237a04c-2633-44f3-a725-161de7814c54 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1549 microversion: 2.1 time: 0.156876 Oct 04 22:20:42.532764 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3816/7610] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:42 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:42.554165 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fcc84ab9-ca5a-4471-89f4-e4774128c9dd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:42.554782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fcc84ab9-ca5a-4471-89f4-e4774128c9dd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:42.561612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcc84ab9-ca5a-4471-89f4-e4774128c9dd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:42.562102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcc84ab9-ca5a-4471-89f4-e4774128c9dd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:42.562536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcc84ab9-ca5a-4471-89f4-e4774128c9dd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:42.563218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcc84ab9-ca5a-4471-89f4-e4774128c9dd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:42.563671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcc84ab9-ca5a-4471-89f4-e4774128c9dd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:42.564091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fcc84ab9-ca5a-4471-89f4-e4774128c9dd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:42.696703 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fcc84ab9-ca5a-4471-89f4-e4774128c9dd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:42.703616 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fcc84ab9-ca5a-4471-89f4-e4774128c9dd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1549 microversion: 2.1 time: 0.153334 Oct 04 22:20:42.704185 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3795/7611] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:42 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:42.726145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c59f1651-1139-439b-87bc-1f8b5a09a425 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:42.731090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c59f1651-1139-439b-87bc-1f8b5a09a425 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:42.731679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c59f1651-1139-439b-87bc-1f8b5a09a425 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Searching by: {'deleted': False, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:20:42.736954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c59f1651-1139-439b-87bc-1f8b5a09a425 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:42.737471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c59f1651-1139-439b-87bc-1f8b5a09a425 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:42.737924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c59f1651-1139-439b-87bc-1f8b5a09a425 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:42.738649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c59f1651-1139-439b-87bc-1f8b5a09a425 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:42.739116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c59f1651-1139-439b-87bc-1f8b5a09a425 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:42.739553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c59f1651-1139-439b-87bc-1f8b5a09a425 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:42.763845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-c59f1651-1139-439b-87bc-1f8b5a09a425 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:20:42.791457 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c59f1651-1139-439b-87bc-1f8b5a09a425 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069196 Oct 04 22:20:42.792043 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3817/7612] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Oct 4 22:20:42 2022] GET /compute/v2.1/servers => generated 343 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:20:42.804306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1d1e6351-06e7-4dce-ac49-1651dd3ccb30 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:42.804925 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1d1e6351-06e7-4dce-ac49-1651dd3ccb30 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:42.810808 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d1e6351-06e7-4dce-ac49-1651dd3ccb30 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:42.811293 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d1e6351-06e7-4dce-ac49-1651dd3ccb30 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:42.811733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d1e6351-06e7-4dce-ac49-1651dd3ccb30 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:42.812420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d1e6351-06e7-4dce-ac49-1651dd3ccb30 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:42.812874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d1e6351-06e7-4dce-ac49-1651dd3ccb30 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:42.813300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1d1e6351-06e7-4dce-ac49-1651dd3ccb30 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:42.943289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1d1e6351-06e7-4dce-ac49-1651dd3ccb30 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:42.951092 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1d1e6351-06e7-4dce-ac49-1651dd3ccb30 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1549 microversion: 2.1 time: 0.150630 Oct 04 22:20:42.951670 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3796/7613] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:42 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:45.871400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-43c4731a-de83-4123-a6ec-50ba65fce0c5 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "607a0b22-a3bf-41cf-b047-eca368640f10"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:45.873834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-43c4731a-de83-4123-a6ec-50ba65fce0c5 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:45.880219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43c4731a-de83-4123-a6ec-50ba65fce0c5 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:45.880723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43c4731a-de83-4123-a6ec-50ba65fce0c5 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:45.881181 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43c4731a-de83-4123-a6ec-50ba65fce0c5 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:45.881925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43c4731a-de83-4123-a6ec-50ba65fce0c5 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:45.882403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43c4731a-de83-4123-a6ec-50ba65fce0c5 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:45.882859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43c4731a-de83-4123-a6ec-50ba65fce0c5 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:46.692784 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-43c4731a-de83-4123-a6ec-50ba65fce0c5 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "POST /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.825237 Oct 04 22:20:46.693523 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3818/7614] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 22:20:45 2022] POST /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/os-volume_attachments => generated 194 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:21:01.031054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a665e755-e4a9-463e-81b0-b1af45998347 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:01.031690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a665e755-e4a9-463e-81b0-b1af45998347 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:01.033921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:01.034604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=66 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:01.040173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a665e755-e4a9-463e-81b0-b1af45998347 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:01.040701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a665e755-e4a9-463e-81b0-b1af45998347 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:01.041153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a665e755-e4a9-463e-81b0-b1af45998347 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:01.041933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a665e755-e4a9-463e-81b0-b1af45998347 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:01.042420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a665e755-e4a9-463e-81b0-b1af45998347 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:01.042863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a665e755-e4a9-463e-81b0-b1af45998347 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:01.227411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a665e755-e4a9-463e-81b0-b1af45998347 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:01.235420 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a665e755-e4a9-463e-81b0-b1af45998347 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1595 microversion: 2.1 time: 0.208600 Oct 04 22:21:01.236004 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3797/7615] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:01 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1595 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:03.163040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:03.163906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:03.164831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:03.228688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-574543e8-be9c-41ae-b88b-ad5f3e51251a req-f2c7eec2-e921-4bac-994b-9f709607510f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d04722c9-8f07-405c-b461-8f3bc5c8875e", "tag": "bd3fe8d5-2e71-49e4-b78e-fb4858cc6a71"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:03.239677 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-574543e8-be9c-41ae-b88b-ad5f3e51251a req-f2c7eec2-e921-4bac-994b-9f709607510f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:03.240227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-574543e8-be9c-41ae-b88b-ad5f3e51251a req-f2c7eec2-e921-4bac-994b-9f709607510f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:03.240685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-574543e8-be9c-41ae-b88b-ad5f3e51251a req-f2c7eec2-e921-4bac-994b-9f709607510f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:03.252641 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-574543e8-be9c-41ae-b88b-ad5f3e51251a req-f2c7eec2-e921-4bac-994b-9f709607510f service nova] Creating event network-changed:bd3fe8d5-2e71-49e4-b78e-fb4858cc6a71 for instance d04722c9-8f07-405c-b461-8f3bc5c8875e on n-h2-860282-1 Oct 04 22:21:03.259637 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-574543e8-be9c-41ae-b88b-ad5f3e51251a req-f2c7eec2-e921-4bac-994b-9f709607510f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112572 Oct 04 22:21:03.261275 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3819/7616] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:21:05.336976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b4c31d5b-066d-4b31-8175-ace6a8d5ad21 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-538720682"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:05.338689 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b4c31d5b-066d-4b31-8175-ace6a8d5ad21 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:05.345388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b4c31d5b-066d-4b31-8175-ace6a8d5ad21 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:05.345926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b4c31d5b-066d-4b31-8175-ace6a8d5ad21 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:05.346370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b4c31d5b-066d-4b31-8175-ace6a8d5ad21 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:05.347082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b4c31d5b-066d-4b31-8175-ace6a8d5ad21 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:05.347530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b4c31d5b-066d-4b31-8175-ace6a8d5ad21 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:05.347962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b4c31d5b-066d-4b31-8175-ace6a8d5ad21 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:05.479383 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.network.security_group_api [None req-b4c31d5b-066d-4b31-8175-ace6a8d5ad21 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Adding security group 828ab857-0828-4ce8-8860-645d3e17c89f to port bd3fe8d5-2e71-49e4-b78e-fb4858cc6a71 Oct 04 22:21:05.844002 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b4c31d5b-066d-4b31-8175-ace6a8d5ad21 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "POST /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/action" status: 202 len: 0 microversion: 2.1 time: 0.511020 Oct 04 22:21:05.844712 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3798/7617] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:21:05 2022] POST /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:21:05.855408 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6dd98c89-112e-4082-97ad-ce9a3db45b92 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:05.856063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6dd98c89-112e-4082-97ad-ce9a3db45b92 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:05.857975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-30861e34-c9c4-4cda-b6ca-b09b9afe50ab req-499ad227-d854-4e9f-b57e-59499a3891e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d04722c9-8f07-405c-b461-8f3bc5c8875e", "tag": "bd3fe8d5-2e71-49e4-b78e-fb4858cc6a71"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:05.863087 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6dd98c89-112e-4082-97ad-ce9a3db45b92 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:05.863583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6dd98c89-112e-4082-97ad-ce9a3db45b92 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:05.864123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6dd98c89-112e-4082-97ad-ce9a3db45b92 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:05.864942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6dd98c89-112e-4082-97ad-ce9a3db45b92 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:05.865407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6dd98c89-112e-4082-97ad-ce9a3db45b92 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:05.866041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6dd98c89-112e-4082-97ad-ce9a3db45b92 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:05.882967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-30861e34-c9c4-4cda-b6ca-b09b9afe50ab req-499ad227-d854-4e9f-b57e-59499a3891e3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:05.883463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-30861e34-c9c4-4cda-b6ca-b09b9afe50ab req-499ad227-d854-4e9f-b57e-59499a3891e3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:05.883917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-30861e34-c9c4-4cda-b6ca-b09b9afe50ab req-499ad227-d854-4e9f-b57e-59499a3891e3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:05.909717 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-30861e34-c9c4-4cda-b6ca-b09b9afe50ab req-499ad227-d854-4e9f-b57e-59499a3891e3 service nova] Creating event network-changed:bd3fe8d5-2e71-49e4-b78e-fb4858cc6a71 for instance d04722c9-8f07-405c-b461-8f3bc5c8875e on n-h2-860282-1 Oct 04 22:21:05.915801 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-30861e34-c9c4-4cda-b6ca-b09b9afe50ab req-499ad227-d854-4e9f-b57e-59499a3891e3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064131 Oct 04 22:21:05.916743 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3820/7618] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:21:06.113070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6dd98c89-112e-4082-97ad-ce9a3db45b92 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:06.121825 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6dd98c89-112e-4082-97ad-ce9a3db45b92 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1759 microversion: 2.1 time: 0.270625 Oct 04 22:21:06.122571 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3799/7619] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:05 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1759 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:44.492150 n-d-860282-1 devstack@n-api.service[122757]: ERROR oslo.messaging._drivers.impl_rabbit [-] [02d9f940-80f2-491b-9a18-0a7fa72932fa] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:22:44.492693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:22:44.493763 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:22:44.493975 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 22:22:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/action (ip 10.222.0.30) !!! Oct 04 22:22:44.495141 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:22:44.495275 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 22:22:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/action (ip 10.222.0.30) !!! Oct 04 22:22:44.501103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a652ad5d-8370-44a6-8c70-ead5a183b0fd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:22:44.503576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a652ad5d-8370-44a6-8c70-ead5a183b0fd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:44.513643 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a652ad5d-8370-44a6-8c70-ead5a183b0fd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:44.514251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a652ad5d-8370-44a6-8c70-ead5a183b0fd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:44.514706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a652ad5d-8370-44a6-8c70-ead5a183b0fd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:44.515424 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a652ad5d-8370-44a6-8c70-ead5a183b0fd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:44.515896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a652ad5d-8370-44a6-8c70-ead5a183b0fd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:44.516342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a652ad5d-8370-44a6-8c70-ead5a183b0fd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:44.741566 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a652ad5d-8370-44a6-8c70-ead5a183b0fd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "POST /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/action" status: 202 len: 0 microversion: 2.1 time: 0.251246 Oct 04 22:22:44.742135 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3821/7620] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:22:44 2022] POST /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:22:44.748175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:22:44.759119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=16 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:22:44.759119 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:22:44.759119 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 22:22:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e (ip 10.222.0.30) !!! Oct 04 22:22:44.759119 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:22:44.759119 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 22:22:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e (ip 10.222.0.30) !!! Oct 04 22:22:44.759119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-39309ca4-31a0-4d4b-ae55-d0a56778ec35 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:44.759119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-39309ca4-31a0-4d4b-ae55-d0a56778ec35 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:44.772095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39309ca4-31a0-4d4b-ae55-d0a56778ec35 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:44.772620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39309ca4-31a0-4d4b-ae55-d0a56778ec35 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:44.773066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39309ca4-31a0-4d4b-ae55-d0a56778ec35 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:44.773792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39309ca4-31a0-4d4b-ae55-d0a56778ec35 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:44.774268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39309ca4-31a0-4d4b-ae55-d0a56778ec35 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:44.774759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-39309ca4-31a0-4d4b-ae55-d0a56778ec35 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:44.933579 n-d-860282-1 devstack@n-api.service[122758]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb95aab1-3781-4811-b11d-1606a5055a6d] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:22:44.934473 n-d-860282-1 devstack@n-api.service[122758]: ERROR oslo.messaging._drivers.impl_rabbit [-] [85957c5a-63ea-4587-9a7c-19b9c9ad6fe2] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:22:44.963005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-39309ca4-31a0-4d4b-ae55-d0a56778ec35 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:44.972714 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-39309ca4-31a0-4d4b-ae55-d0a56778ec35 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1761 microversion: 2.1 time: 0.225720 Oct 04 22:22:44.973369 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3800/7621] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:44 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1761 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:45.999089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d7fa193e-0ff5-4cf6-8f9a-07621904f80d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:45.999892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d7fa193e-0ff5-4cf6-8f9a-07621904f80d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:46.014799 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] [02d9f940-80f2-491b-9a18-0a7fa72932fa] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 38286. Oct 04 22:22:46.017137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7fa193e-0ff5-4cf6-8f9a-07621904f80d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:46.017619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7fa193e-0ff5-4cf6-8f9a-07621904f80d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:46.018078 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7fa193e-0ff5-4cf6-8f9a-07621904f80d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:46.018801 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7fa193e-0ff5-4cf6-8f9a-07621904f80d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:46.019941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7fa193e-0ff5-4cf6-8f9a-07621904f80d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:46.020434 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d7fa193e-0ff5-4cf6-8f9a-07621904f80d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:46.170377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d7fa193e-0ff5-4cf6-8f9a-07621904f80d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:46.179423 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d7fa193e-0ff5-4cf6-8f9a-07621904f80d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1766 microversion: 2.1 time: 0.184931 Oct 04 22:22:46.179998 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3822/7622] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:45 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1766 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:47.203510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5ddfa2ce-b51e-48ba-804c-f92db9380e27 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:47.204047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5ddfa2ce-b51e-48ba-804c-f92db9380e27 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:47.213583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ddfa2ce-b51e-48ba-804c-f92db9380e27 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:47.214071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ddfa2ce-b51e-48ba-804c-f92db9380e27 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:47.214512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ddfa2ce-b51e-48ba-804c-f92db9380e27 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:47.215203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ddfa2ce-b51e-48ba-804c-f92db9380e27 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:47.215657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ddfa2ce-b51e-48ba-804c-f92db9380e27 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:47.216080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5ddfa2ce-b51e-48ba-804c-f92db9380e27 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:47.219891 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb95aab1-3781-4811-b11d-1606a5055a6d] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 38290. Oct 04 22:22:47.222904 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] [85957c5a-63ea-4587-9a7c-19b9c9ad6fe2] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 38292. Oct 04 22:22:47.363023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5ddfa2ce-b51e-48ba-804c-f92db9380e27 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:47.372767 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5ddfa2ce-b51e-48ba-804c-f92db9380e27 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1759 microversion: 2.1 time: 0.173290 Oct 04 22:22:47.374437 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3801/7623] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:47 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:01.383721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:01.384577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:01.389298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-98c3a6a7-4126-4cdc-856a-f2874d41669a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-538720682"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:01.389878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-98c3a6a7-4126-4cdc-856a-f2874d41669a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:01.395650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98c3a6a7-4126-4cdc-856a-f2874d41669a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:01.404123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98c3a6a7-4126-4cdc-856a-f2874d41669a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:01.404123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98c3a6a7-4126-4cdc-856a-f2874d41669a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:01.404123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98c3a6a7-4126-4cdc-856a-f2874d41669a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:01.404123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98c3a6a7-4126-4cdc-856a-f2874d41669a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:01.404123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98c3a6a7-4126-4cdc-856a-f2874d41669a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:01.533036 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.network.security_group_api [None req-98c3a6a7-4126-4cdc-856a-f2874d41669a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Removing security group 828ab857-0828-4ce8-8860-645d3e17c89f from port bd3fe8d5-2e71-49e4-b78e-fb4858cc6a71 Oct 04 22:24:01.883312 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-98c3a6a7-4126-4cdc-856a-f2874d41669a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "POST /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/action" status: 202 len: 0 microversion: 2.1 time: 0.500902 Oct 04 22:24:01.887009 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3823/7624] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:24:01 2022] POST /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:24:01.892863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-c89548b8-9501-4c6d-8a11-cee81740d23c req-6d05c7a4-5de3-495a-93d7-3463760f70b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d04722c9-8f07-405c-b461-8f3bc5c8875e", "tag": "bd3fe8d5-2e71-49e4-b78e-fb4858cc6a71"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:01.899785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:01.910040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=12 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:01.916042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c89548b8-9501-4c6d-8a11-cee81740d23c req-6d05c7a4-5de3-495a-93d7-3463760f70b1 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:01.916829 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c89548b8-9501-4c6d-8a11-cee81740d23c req-6d05c7a4-5de3-495a-93d7-3463760f70b1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:01.917516 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-c89548b8-9501-4c6d-8a11-cee81740d23c req-6d05c7a4-5de3-495a-93d7-3463760f70b1 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:01.931179 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-c89548b8-9501-4c6d-8a11-cee81740d23c req-6d05c7a4-5de3-495a-93d7-3463760f70b1 service nova] Creating event network-changed:bd3fe8d5-2e71-49e4-b78e-fb4858cc6a71 for instance d04722c9-8f07-405c-b461-8f3bc5c8875e on n-h2-860282-1 Oct 04 22:24:01.939056 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-c89548b8-9501-4c6d-8a11-cee81740d23c req-6d05c7a4-5de3-495a-93d7-3463760f70b1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051755 Oct 04 22:24:01.940287 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3802/7625] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:24:03.348377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-817eaef0-2c5f-4451-beda-c518629bd75a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:03.348892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-817eaef0-2c5f-4451-beda-c518629bd75a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:03.355237 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-817eaef0-2c5f-4451-beda-c518629bd75a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:03.355435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-817eaef0-2c5f-4451-beda-c518629bd75a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:03.355880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-817eaef0-2c5f-4451-beda-c518629bd75a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:03.357330 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-817eaef0-2c5f-4451-beda-c518629bd75a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:03.357832 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-817eaef0-2c5f-4451-beda-c518629bd75a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:03.358270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-817eaef0-2c5f-4451-beda-c518629bd75a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:03.440818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-817eaef0-2c5f-4451-beda-c518629bd75a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lazy-loading 'services' on Instance uuid d04722c9-8f07-405c-b461-8f3bc5c8875e {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:24:03.626592 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-817eaef0-2c5f-4451-beda-c518629bd75a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/os-volume_attachments/607a0b22-a3bf-41cf-b047-eca368640f10" status: 202 len: 0 microversion: 2.1 time: 0.282975 Oct 04 22:24:03.627194 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3824/7626] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 22:24:03 2022] DELETE /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/os-volume_attachments/607a0b22-a3bf-41cf-b047-eca368640f10 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:24:03.638654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b68f9d81-2036-43e4-b316-a8fd0ae27cd5 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:03.641161 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b68f9d81-2036-43e4-b316-a8fd0ae27cd5 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:03.649271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b68f9d81-2036-43e4-b316-a8fd0ae27cd5 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:03.649762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b68f9d81-2036-43e4-b316-a8fd0ae27cd5 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:03.650209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b68f9d81-2036-43e4-b316-a8fd0ae27cd5 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:03.650923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b68f9d81-2036-43e4-b316-a8fd0ae27cd5 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:03.651391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b68f9d81-2036-43e4-b316-a8fd0ae27cd5 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:03.651820 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b68f9d81-2036-43e4-b316-a8fd0ae27cd5 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:03.684855 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b68f9d81-2036-43e4-b316-a8fd0ae27cd5 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052749 Oct 04 22:24:03.685445 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3803/7627] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:24:03 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:24:03.955740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b114fb52-be0d-417d-96e8-c3851eb1f896 req-b8f7ec54-0c53-468f-b5e6-4a3823333921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d04722c9-8f07-405c-b461-8f3bc5c8875e", "tag": "bd3fe8d5-2e71-49e4-b78e-fb4858cc6a71"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:03.965855 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b114fb52-be0d-417d-96e8-c3851eb1f896 req-b8f7ec54-0c53-468f-b5e6-4a3823333921 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:03.966355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b114fb52-be0d-417d-96e8-c3851eb1f896 req-b8f7ec54-0c53-468f-b5e6-4a3823333921 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:03.966810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b114fb52-be0d-417d-96e8-c3851eb1f896 req-b8f7ec54-0c53-468f-b5e6-4a3823333921 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:03.978049 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b114fb52-be0d-417d-96e8-c3851eb1f896 req-b8f7ec54-0c53-468f-b5e6-4a3823333921 service nova] Creating event network-changed:bd3fe8d5-2e71-49e4-b78e-fb4858cc6a71 for instance d04722c9-8f07-405c-b461-8f3bc5c8875e on n-h2-860282-1 Oct 04 22:24:03.982980 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b114fb52-be0d-417d-96e8-c3851eb1f896 req-b8f7ec54-0c53-468f-b5e6-4a3823333921 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031351 Oct 04 22:24:03.984322 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3825/7628] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:24:04.698357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8d4839f2-a36f-4de3-9be7-31060db615b2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:04.701263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8d4839f2-a36f-4de3-9be7-31060db615b2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:04.708455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d4839f2-a36f-4de3-9be7-31060db615b2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:04.709064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d4839f2-a36f-4de3-9be7-31060db615b2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:04.709661 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d4839f2-a36f-4de3-9be7-31060db615b2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:04.710463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d4839f2-a36f-4de3-9be7-31060db615b2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:04.711100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d4839f2-a36f-4de3-9be7-31060db615b2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:04.711621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8d4839f2-a36f-4de3-9be7-31060db615b2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:04.745523 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8d4839f2-a36f-4de3-9be7-31060db615b2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049544 Oct 04 22:24:04.745523 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3804/7629] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:24:04 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:24:05.758093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2b082d1f-0964-496f-832e-dbe53e1b3b2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:05.760722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2b082d1f-0964-496f-832e-dbe53e1b3b2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:05.768199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b082d1f-0964-496f-832e-dbe53e1b3b2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:05.768709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b082d1f-0964-496f-832e-dbe53e1b3b2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:05.769516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b082d1f-0964-496f-832e-dbe53e1b3b2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:05.776384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b082d1f-0964-496f-832e-dbe53e1b3b2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:05.776384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b082d1f-0964-496f-832e-dbe53e1b3b2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:05.776384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b082d1f-0964-496f-832e-dbe53e1b3b2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:05.804994 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2b082d1f-0964-496f-832e-dbe53e1b3b2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049191 Oct 04 22:24:05.804994 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3826/7630] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:24:05 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:24:06.814455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b8f1960d-4911-4347-b446-91fea7102da8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:06.816596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b8f1960d-4911-4347-b446-91fea7102da8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:06.823531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8f1960d-4911-4347-b446-91fea7102da8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:06.824023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8f1960d-4911-4347-b446-91fea7102da8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:06.824468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8f1960d-4911-4347-b446-91fea7102da8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:06.825791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8f1960d-4911-4347-b446-91fea7102da8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:06.826259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8f1960d-4911-4347-b446-91fea7102da8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:06.826693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b8f1960d-4911-4347-b446-91fea7102da8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:06.857216 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b8f1960d-4911-4347-b446-91fea7102da8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046797 Oct 04 22:24:06.857836 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3805/7631] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:24:06 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:24:07.869812 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1a49cf54-e78b-4344-8e5c-c8f90f401e4c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:07.872657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1a49cf54-e78b-4344-8e5c-c8f90f401e4c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:07.879504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a49cf54-e78b-4344-8e5c-c8f90f401e4c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:07.880008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a49cf54-e78b-4344-8e5c-c8f90f401e4c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:07.880463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a49cf54-e78b-4344-8e5c-c8f90f401e4c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:07.881177 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a49cf54-e78b-4344-8e5c-c8f90f401e4c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:07.881684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a49cf54-e78b-4344-8e5c-c8f90f401e4c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:07.882392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a49cf54-e78b-4344-8e5c-c8f90f401e4c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:07.912506 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1a49cf54-e78b-4344-8e5c-c8f90f401e4c tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046678 Oct 04 22:24:07.913076 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3827/7632] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:24:07 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:24:08.925077 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6274d2fa-eab4-4bd1-82a4-e145ac19a831 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:08.927341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6274d2fa-eab4-4bd1-82a4-e145ac19a831 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:08.934108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6274d2fa-eab4-4bd1-82a4-e145ac19a831 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:08.934632 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6274d2fa-eab4-4bd1-82a4-e145ac19a831 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:08.935611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6274d2fa-eab4-4bd1-82a4-e145ac19a831 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:08.936303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6274d2fa-eab4-4bd1-82a4-e145ac19a831 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:08.936756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6274d2fa-eab4-4bd1-82a4-e145ac19a831 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:08.937180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6274d2fa-eab4-4bd1-82a4-e145ac19a831 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:08.966285 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6274d2fa-eab4-4bd1-82a4-e145ac19a831 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045301 Oct 04 22:24:08.966862 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3806/7633] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:24:08 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:24:08.977816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d783fdee-5998-4b71-b871-0efc24020595 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:08.978343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d783fdee-5998-4b71-b871-0efc24020595 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:08.985837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d783fdee-5998-4b71-b871-0efc24020595 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:08.986341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d783fdee-5998-4b71-b871-0efc24020595 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:08.986797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d783fdee-5998-4b71-b871-0efc24020595 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:08.987512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d783fdee-5998-4b71-b871-0efc24020595 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:08.987983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d783fdee-5998-4b71-b871-0efc24020595 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:08.988874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d783fdee-5998-4b71-b871-0efc24020595 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:09.064262 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-d783fdee-5998-4b71-b871-0efc24020595 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] HTTP exception thrown: Instance d04722c9-8f07-405c-b461-8f3bc5c8875e is not attached to volume 607a0b22-a3bf-41cf-b047-eca368640f10 Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d783fdee-5998-4b71-b871-0efc24020595 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Request method failure captured: Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/os-volume_attachments/607a0b22-a3bf-41cf-b047-eca368640f10 HTTP/1.1 Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPLGUAfThvRWzUDYTVj8O3ExgUt6x8kEMj9qmJMXkruIiQgz7smKwTkE82PCqZyUzuhFqljVJjNZHDDs8p224Q1ADEAkn1p7qbToXpphdOGmfQeVLMHLqRxkvl8Ovpgrgbrpz7tNpul-7bkh6EIkYkY4JZpoI353je4LklFhRNu2wQ3M Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 3aa1500ce5ca4d26b4e2a3eaf3c3ccae Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestMinimumBasicScenario-1597296029 Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aa1500ce5ca4d26b4e2a3eaf3c3ccae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3aa1500ce5ca4d26b4e2a3eaf3c3ccae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3aa1500ce5ca4d26b4e2a3eaf3c3ccae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aa1500ce5ca4d26b4e2a3eaf3c3ccae"}]}] Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestMinimumBasicScenario-1597296029 Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 3aa1500ce5ca4d26b4e2a3eaf3c3ccae Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1597296029 Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestMinimumBasicScenario-1597296029-project Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 7a37c7b63d0b4f0ba08738215f7c2455 Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestMinimumBasicScenario-1597296029-project Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance d04722c9-8f07-405c-b461-8f3bc5c8875e is not attached to volume 607a0b22-a3bf-41cf-b047-eca368640f10 Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'server_id': 'd04722c9-8f07-405c-b461-8f3bc5c8875e', 'id': '607a0b22-a3bf-41cf-b047-eca368640f10'} Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 607a0b22-a3bf-41cf-b047-eca368640f10. Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d04722c9-8f07-405c-b461-8f3bc5c8875e is not attached to volume 607a0b22-a3bf-41cf-b047-eca368640f10 Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:09.066635 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:09.071731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:09.071731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:09.071731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d04722c9-8f07-405c-b461-8f3bc5c8875e is not attached to volume 607a0b22-a3bf-41cf-b047-eca368640f10 Oct 04 22:24:09.071731 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:24:09.071731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d783fdee-5998-4b71-b871-0efc24020595 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Returning 404 to user: Instance d04722c9-8f07-405c-b461-8f3bc5c8875e is not attached to volume 607a0b22-a3bf-41cf-b047-eca368640f10 {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:09.071731 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d783fdee-5998-4b71-b871-0efc24020595 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/os-volume_attachments/607a0b22-a3bf-41cf-b047-eca368640f10" status: 404 len: 154 microversion: 2.1 time: 0.094554 Oct 04 22:24:09.071731 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3828/7634] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 22:24:08 2022] DELETE /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e/os-volume_attachments/607a0b22-a3bf-41cf-b047-eca368640f10 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:24:12.456594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4e3a505d-0ee6-49d6-9db8-e14ef17ccdb2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:12.457104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4e3a505d-0ee6-49d6-9db8-e14ef17ccdb2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:12.464110 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e3a505d-0ee6-49d6-9db8-e14ef17ccdb2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:12.464602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e3a505d-0ee6-49d6-9db8-e14ef17ccdb2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:12.465049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e3a505d-0ee6-49d6-9db8-e14ef17ccdb2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:12.465781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e3a505d-0ee6-49d6-9db8-e14ef17ccdb2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:12.466246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e3a505d-0ee6-49d6-9db8-e14ef17ccdb2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:12.467196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e3a505d-0ee6-49d6-9db8-e14ef17ccdb2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:12.493214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4e3a505d-0ee6-49d6-9db8-e14ef17ccdb2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:24:12.736163 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4e3a505d-0ee6-49d6-9db8-e14ef17ccdb2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 204 len: 0 microversion: 2.1 time: 0.283239 Oct 04 22:24:12.736775 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3807/7635] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:24:12 2022] DELETE /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:24:12.746382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0353478a-8ea5-4758-af66-97e979054098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:12.747969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0353478a-8ea5-4758-af66-97e979054098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:12.755223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0353478a-8ea5-4758-af66-97e979054098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:12.755754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0353478a-8ea5-4758-af66-97e979054098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:12.756217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0353478a-8ea5-4758-af66-97e979054098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:12.757216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0353478a-8ea5-4758-af66-97e979054098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:12.757712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0353478a-8ea5-4758-af66-97e979054098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:12.758151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0353478a-8ea5-4758-af66-97e979054098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:12.892214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0353478a-8ea5-4758-af66-97e979054098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:12.900146 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0353478a-8ea5-4758-af66-97e979054098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1555 microversion: 2.1 time: 0.158876 Oct 04 22:24:12.900734 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3829/7636] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:12 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:13.926010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3ffb59fb-873a-4a67-b0c4-e25ab65fd793 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:13.927184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3ffb59fb-873a-4a67-b0c4-e25ab65fd793 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:13.937611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ffb59fb-873a-4a67-b0c4-e25ab65fd793 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:13.938108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ffb59fb-873a-4a67-b0c4-e25ab65fd793 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:13.938580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ffb59fb-873a-4a67-b0c4-e25ab65fd793 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:13.939548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ffb59fb-873a-4a67-b0c4-e25ab65fd793 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:13.940157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ffb59fb-873a-4a67-b0c4-e25ab65fd793 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:13.940595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ffb59fb-873a-4a67-b0c4-e25ab65fd793 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:14.090333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3ffb59fb-873a-4a67-b0c4-e25ab65fd793 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:14.099528 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3ffb59fb-873a-4a67-b0c4-e25ab65fd793 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1555 microversion: 2.1 time: 0.179520 Oct 04 22:24:14.100264 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3808/7637] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:13 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1555 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:15.124921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-23a84bc9-caae-4dd3-9604-609fcb4c5927 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:15.125489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-23a84bc9-caae-4dd3-9604-609fcb4c5927 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:15.132408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23a84bc9-caae-4dd3-9604-609fcb4c5927 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:15.132912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23a84bc9-caae-4dd3-9604-609fcb4c5927 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:15.133412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23a84bc9-caae-4dd3-9604-609fcb4c5927 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:15.134145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23a84bc9-caae-4dd3-9604-609fcb4c5927 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:15.134616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23a84bc9-caae-4dd3-9604-609fcb4c5927 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:15.135059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-23a84bc9-caae-4dd3-9604-609fcb4c5927 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:15.211763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-23a84bc9-caae-4dd3-9604-609fcb4c5927 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:15.221614 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-23a84bc9-caae-4dd3-9604-609fcb4c5927 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1513 microversion: 2.1 time: 0.101267 Oct 04 22:24:15.222502 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3830/7638] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:15 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1513 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:15.291439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-eed349d1-d4af-4d7d-a362-6ce60e0bb2b7 req-8cdf7bdf-4ace-47c9-9b2a-66716c65e233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d04722c9-8f07-405c-b461-8f3bc5c8875e", "name": "network-vif-deleted", "tag": "bd3fe8d5-2e71-49e4-b78e-fb4858cc6a71"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:15.302172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-eed349d1-d4af-4d7d-a362-6ce60e0bb2b7 req-8cdf7bdf-4ace-47c9-9b2a-66716c65e233 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:15.303304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-eed349d1-d4af-4d7d-a362-6ce60e0bb2b7 req-8cdf7bdf-4ace-47c9-9b2a-66716c65e233 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:15.303304 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-eed349d1-d4af-4d7d-a362-6ce60e0bb2b7 req-8cdf7bdf-4ace-47c9-9b2a-66716c65e233 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:15.314828 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-eed349d1-d4af-4d7d-a362-6ce60e0bb2b7 req-8cdf7bdf-4ace-47c9-9b2a-66716c65e233 service nova] Creating event network-vif-deleted:bd3fe8d5-2e71-49e4-b78e-fb4858cc6a71 for instance d04722c9-8f07-405c-b461-8f3bc5c8875e on n-h2-860282-1 Oct 04 22:24:15.319892 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-eed349d1-d4af-4d7d-a362-6ce60e0bb2b7 req-8cdf7bdf-4ace-47c9-9b2a-66716c65e233 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032153 Oct 04 22:24:15.320533 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3809/7639] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:24:16.244285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fa4415ca-79c3-461b-b936-d35fea737045 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:16.244913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fa4415ca-79c3-461b-b936-d35fea737045 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:16.251959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa4415ca-79c3-461b-b936-d35fea737045 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:16.252479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa4415ca-79c3-461b-b936-d35fea737045 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:16.252925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa4415ca-79c3-461b-b936-d35fea737045 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:16.253709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa4415ca-79c3-461b-b936-d35fea737045 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:16.254172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa4415ca-79c3-461b-b936-d35fea737045 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:16.254611 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa4415ca-79c3-461b-b936-d35fea737045 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:16.286573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa4415ca-79c3-461b-b936-d35fea737045 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:16.286989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa4415ca-79c3-461b-b936-d35fea737045 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:16.287480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fa4415ca-79c3-461b-b936-d35fea737045 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:16.287941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-fa4415ca-79c3-461b-b936-d35fea737045 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lazy-loading 'fault' on Instance uuid d04722c9-8f07-405c-b461-8f3bc5c8875e {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:24:16.330360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fa4415ca-79c3-461b-b936-d35fea737045 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:16.337969 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fa4415ca-79c3-461b-b936-d35fea737045 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 200 len: 1349 microversion: 2.1 time: 0.097630 Oct 04 22:24:16.338550 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3831/7640] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:16 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:17.367469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-89adb8e3-1701-443e-a863-975ea315270a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:17.368185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-89adb8e3-1701-443e-a863-975ea315270a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: d04722c9-8f07-405c-b461-8f3bc5c8875e] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:17.374615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89adb8e3-1701-443e-a863-975ea315270a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:17.375105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89adb8e3-1701-443e-a863-975ea315270a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:17.376311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89adb8e3-1701-443e-a863-975ea315270a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:17.376311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89adb8e3-1701-443e-a863-975ea315270a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:17.376715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89adb8e3-1701-443e-a863-975ea315270a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:17.377149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-89adb8e3-1701-443e-a863-975ea315270a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:17.391219 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-89adb8e3-1701-443e-a863-975ea315270a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] HTTP exception thrown: Instance d04722c9-8f07-405c-b461-8f3bc5c8875e could not be found. Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-89adb8e3-1701-443e-a863-975ea315270a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Request method failure captured: Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e HTTP/1.1 Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPLGUAfThvRWzUDYTVj8O3ExgUt6x8kEMj9qmJMXkruIiQgz7smKwTkE82PCqZyUzuhFqljVJjNZHDDs8p224Q1ADEAkn1p7qbToXpphdOGmfQeVLMHLqRxkvl8Ovpgrgbrpz7tNpul-7bkh6EIkYkY4JZpoI353je4LklFhRNu2wQ3M Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 3aa1500ce5ca4d26b4e2a3eaf3c3ccae Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestMinimumBasicScenario-1597296029 Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aa1500ce5ca4d26b4e2a3eaf3c3ccae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3aa1500ce5ca4d26b4e2a3eaf3c3ccae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3aa1500ce5ca4d26b4e2a3eaf3c3ccae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aa1500ce5ca4d26b4e2a3eaf3c3ccae"}]}] Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestMinimumBasicScenario-1597296029 Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 3aa1500ce5ca4d26b4e2a3eaf3c3ccae Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1597296029 Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestMinimumBasicScenario-1597296029-project Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 7a37c7b63d0b4f0ba08738215f7c2455 Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestMinimumBasicScenario-1597296029-project Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance d04722c9-8f07-405c-b461-8f3bc5c8875e could not be found. Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'd04722c9-8f07-405c-b461-8f3bc5c8875e'} Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d04722c9-8f07-405c-b461-8f3bc5c8875e could not be found. Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d04722c9-8f07-405c-b461-8f3bc5c8875e could not be found. Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:17.392805 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:24:17.397316 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:17.397316 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:17.397316 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:17.397316 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:17.397316 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:17.397316 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d04722c9-8f07-405c-b461-8f3bc5c8875e could not be found. Oct 04 22:24:17.397316 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:24:17.397316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-89adb8e3-1701-443e-a863-975ea315270a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Returning 404 to user: Instance d04722c9-8f07-405c-b461-8f3bc5c8875e could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:17.397316 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-89adb8e3-1701-443e-a863-975ea315270a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e" status: 404 len: 111 microversion: 2.1 time: 0.032113 Oct 04 22:24:17.397316 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3810/7641] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:17 2022] GET /compute/v2.1/servers/d04722c9-8f07-405c-b461-8f3bc5c8875e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:24:17.403273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8b39a951-2b37-43be-8862-89e374b86150 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '.version_select at 0x7f578b952b80>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:17.474473 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8b39a951-2b37-43be-8862-89e374b86150 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1643445338" status: 202 len: 0 microversion: 2.1 time: 0.075219 Oct 04 22:24:17.475072 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3832/7642] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 22:24:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1643445338 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:24:28.573191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1d420e7b-8b68-43cd-a2e0-5b454bf75074 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Action: 'create', calling method: .version_select at 0x7f5790e6fca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1431916073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+7scVMmhavW0Cfxk2RvYmvYVrs80Kmuw73klwgT+Q50vQZXXuTggSkwUNQQfyXMFnnDJWk1ZVlHL+vce0Tk1DpWxKG54GJPM7H+gQhUy488GrXE77tODxhx8UFYvjm4w=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:28.575724 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:24:28.576412 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 22:24:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.30) !!! Oct 04 22:24:28.581549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:28.582173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:28.595265 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-1d420e7b-8b68-43cd-a2e0-5b454bf75074 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Getting quotas for project 3aa1500ce5ca4d26b4e2a3eaf3c3ccae. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:24:28.600463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-1d420e7b-8b68-43cd-a2e0-5b454bf75074 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Getting quotas for user 7a37c7b63d0b4f0ba08738215f7c2455 and project 3aa1500ce5ca4d26b4e2a3eaf3c3ccae. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:24:28.731396 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1d420e7b-8b68-43cd-a2e0-5b454bf75074 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.166372 Oct 04 22:24:28.732346 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3811/7643] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 22:24:28 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:24:28.781253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:28.781911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:28.786018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-41a0e146-045b-49c6-8a55-ec62f6646965 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-48584126", "imageRef": "fb2b3b9c-805d-4101-814b-257876a1bf47", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1431916073", "networks": [{"uuid": "1c5337a7-1f7b-464b-a44d-7f8875f0c9c0"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:28.839466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-41a0e146-045b-49c6-8a55-ec62f6646965 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] validate_networks() for [('1c5337a7-1f7b-464b-a44d-7f8875f0c9c0', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:24:29.279621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-41a0e146-045b-49c6-8a55-ec62f6646965 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:24:29.280138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-41a0e146-045b-49c6-8a55-ec62f6646965 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:24:29.280642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-41a0e146-045b-49c6-8a55-ec62f6646965 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:24:29.281077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-41a0e146-045b-49c6-8a55-ec62f6646965 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:24:29.281576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-41a0e146-045b-49c6-8a55-ec62f6646965 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:24:29.290695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41a0e146-045b-49c6-8a55-ec62f6646965 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:29.291198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41a0e146-045b-49c6-8a55-ec62f6646965 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:29.291656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41a0e146-045b-49c6-8a55-ec62f6646965 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:29.292403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41a0e146-045b-49c6-8a55-ec62f6646965 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:29.292988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41a0e146-045b-49c6-8a55-ec62f6646965 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:29.293327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41a0e146-045b-49c6-8a55-ec62f6646965 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:29.313344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-41a0e146-045b-49c6-8a55-ec62f6646965 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Getting quotas for project 3aa1500ce5ca4d26b4e2a3eaf3c3ccae. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:24:29.318704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-41a0e146-045b-49c6-8a55-ec62f6646965 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Getting quotas for user 7a37c7b63d0b4f0ba08738215f7c2455 and project 3aa1500ce5ca4d26b4e2a3eaf3c3ccae. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:24:29.331165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-41a0e146-045b-49c6-8a55-ec62f6646965 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:24:29.333441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-41a0e146-045b-49c6-8a55-ec62f6646965 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fb2b3b9c-805d-4101-814b-257876a1bf47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:24:29.451869 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-41a0e146-045b-49c6-8a55-ec62f6646965 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673136 Oct 04 22:24:29.452539 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3833/7644] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:24:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:24:29.463694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-86f39e96-fc19-4af5-97b5-dc83719c6d23 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:29.464321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-86f39e96-fc19-4af5-97b5-dc83719c6d23 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:29.519860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-86f39e96-fc19-4af5-97b5-dc83719c6d23 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:29.526834 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-86f39e96-fc19-4af5-97b5-dc83719c6d23 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1257 microversion: 2.1 time: 0.067141 Oct 04 22:24:29.527440 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3812/7645] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:29 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:30.551122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c38c1cf0-cedd-49bf-a720-aba51b833444 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:30.551872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c38c1cf0-cedd-49bf-a720-aba51b833444 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:30.604154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c38c1cf0-cedd-49bf-a720-aba51b833444 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:30.612679 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c38c1cf0-cedd-49bf-a720-aba51b833444 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1257 microversion: 2.1 time: 0.066204 Oct 04 22:24:30.613325 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3834/7646] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:30 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:31.636614 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8d3023d6-f3c8-4f45-85bb-021e627805c4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:31.637231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8d3023d6-f3c8-4f45-85bb-021e627805c4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:31.691037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8d3023d6-f3c8-4f45-85bb-021e627805c4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:31.698666 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8d3023d6-f3c8-4f45-85bb-021e627805c4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1257 microversion: 2.1 time: 0.065996 Oct 04 22:24:31.699234 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3813/7647] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:31 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1257 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:32.722885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0c1cf8c7-dfa0-48d8-a7c7-d0a4e8be3bf4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:32.723521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0c1cf8c7-dfa0-48d8-a7c7-d0a4e8be3bf4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:32.730384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c1cf8c7-dfa0-48d8-a7c7-d0a4e8be3bf4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:32.730897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c1cf8c7-dfa0-48d8-a7c7-d0a4e8be3bf4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:32.731360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c1cf8c7-dfa0-48d8-a7c7-d0a4e8be3bf4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:32.732078 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c1cf8c7-dfa0-48d8-a7c7-d0a4e8be3bf4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:32.732691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c1cf8c7-dfa0-48d8-a7c7-d0a4e8be3bf4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:32.732998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0c1cf8c7-dfa0-48d8-a7c7-d0a4e8be3bf4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:32.796509 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0c1cf8c7-dfa0-48d8-a7c7-d0a4e8be3bf4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:32.804419 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0c1cf8c7-dfa0-48d8-a7c7-d0a4e8be3bf4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1261 microversion: 2.1 time: 0.085548 Oct 04 22:24:32.804993 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3835/7648] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:32 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:33.827927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0158e2bb-7a59-414d-881f-585175f81466 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:33.828720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0158e2bb-7a59-414d-881f-585175f81466 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:33.835866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0158e2bb-7a59-414d-881f-585175f81466 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:33.836656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0158e2bb-7a59-414d-881f-585175f81466 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:33.837320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0158e2bb-7a59-414d-881f-585175f81466 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:33.838090 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0158e2bb-7a59-414d-881f-585175f81466 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:33.838561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0158e2bb-7a59-414d-881f-585175f81466 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:33.838997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0158e2bb-7a59-414d-881f-585175f81466 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:33.902677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0158e2bb-7a59-414d-881f-585175f81466 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:33.911247 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0158e2bb-7a59-414d-881f-585175f81466 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1315 microversion: 2.1 time: 0.087980 Oct 04 22:24:33.925631 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3814/7649] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:33 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1315 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:34.935446 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e53dc66c-8d37-4984-9657-ce7ea251a3a7 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:34.936130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e53dc66c-8d37-4984-9657-ce7ea251a3a7 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:34.944079 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e53dc66c-8d37-4984-9657-ce7ea251a3a7 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:34.944679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e53dc66c-8d37-4984-9657-ce7ea251a3a7 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:34.945199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e53dc66c-8d37-4984-9657-ce7ea251a3a7 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:34.946034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e53dc66c-8d37-4984-9657-ce7ea251a3a7 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:34.946576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e53dc66c-8d37-4984-9657-ce7ea251a3a7 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:34.947108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e53dc66c-8d37-4984-9657-ce7ea251a3a7 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:35.138626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e53dc66c-8d37-4984-9657-ce7ea251a3a7 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:35.147458 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e53dc66c-8d37-4984-9657-ce7ea251a3a7 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1357 microversion: 2.1 time: 0.216146 Oct 04 22:24:35.148098 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3836/7650] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:34 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1357 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:36.175350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-91df7ed5-07b8-483c-858b-ab62d056f14a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:36.176713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-91df7ed5-07b8-483c-858b-ab62d056f14a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:36.185238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91df7ed5-07b8-483c-858b-ab62d056f14a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:36.186187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91df7ed5-07b8-483c-858b-ab62d056f14a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:36.186875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91df7ed5-07b8-483c-858b-ab62d056f14a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:36.187802 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91df7ed5-07b8-483c-858b-ab62d056f14a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:36.188463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91df7ed5-07b8-483c-858b-ab62d056f14a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:36.189118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-91df7ed5-07b8-483c-858b-ab62d056f14a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:36.350441 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-91df7ed5-07b8-483c-858b-ab62d056f14a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:36.358723 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-91df7ed5-07b8-483c-858b-ab62d056f14a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1357 microversion: 2.1 time: 0.187525 Oct 04 22:24:36.359292 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3815/7651] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:36 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:37.381092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b61af152-df61-43f2-9829-d8fb8f46fccd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:37.382058 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b61af152-df61-43f2-9829-d8fb8f46fccd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:37.389754 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b61af152-df61-43f2-9829-d8fb8f46fccd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:37.390651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b61af152-df61-43f2-9829-d8fb8f46fccd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:37.391118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b61af152-df61-43f2-9829-d8fb8f46fccd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:37.391848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b61af152-df61-43f2-9829-d8fb8f46fccd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:37.392331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b61af152-df61-43f2-9829-d8fb8f46fccd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:37.392791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b61af152-df61-43f2-9829-d8fb8f46fccd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:37.532231 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b61af152-df61-43f2-9829-d8fb8f46fccd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:37.540527 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b61af152-df61-43f2-9829-d8fb8f46fccd tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1357 microversion: 2.1 time: 0.163431 Oct 04 22:24:37.541973 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3837/7652] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:37 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:38.567214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-95776310-9443-4d82-960d-e599486804a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:38.568143 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-95776310-9443-4d82-960d-e599486804a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:38.576462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95776310-9443-4d82-960d-e599486804a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:38.576986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95776310-9443-4d82-960d-e599486804a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:38.577514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95776310-9443-4d82-960d-e599486804a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:38.578220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95776310-9443-4d82-960d-e599486804a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:38.578679 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95776310-9443-4d82-960d-e599486804a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:38.579107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-95776310-9443-4d82-960d-e599486804a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:38.719987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-95776310-9443-4d82-960d-e599486804a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:38.728502 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-95776310-9443-4d82-960d-e599486804a6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1357 microversion: 2.1 time: 0.167154 Oct 04 22:24:38.729289 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3816/7653] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:38 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:39.753000 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b6e21e74-c787-4cdb-9c03-2ed1f67b7293 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:39.754106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b6e21e74-c787-4cdb-9c03-2ed1f67b7293 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:39.761746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:39.763566 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6e21e74-c787-4cdb-9c03-2ed1f67b7293 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:39.764429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6e21e74-c787-4cdb-9c03-2ed1f67b7293 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:39.766134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6e21e74-c787-4cdb-9c03-2ed1f67b7293 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:39.767162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6e21e74-c787-4cdb-9c03-2ed1f67b7293 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:39.767798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6e21e74-c787-4cdb-9c03-2ed1f67b7293 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:39.768326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b6e21e74-c787-4cdb-9c03-2ed1f67b7293 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:39.922317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b6e21e74-c787-4cdb-9c03-2ed1f67b7293 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:39.929645 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b6e21e74-c787-4cdb-9c03-2ed1f67b7293 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1357 microversion: 2.1 time: 0.181653 Oct 04 22:24:39.930252 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3838/7654] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:39 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:40.956782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-753cb684-c4d0-4e9f-9995-8b64abaa333d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:40.956782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-753cb684-c4d0-4e9f-9995-8b64abaa333d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:40.963508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-753cb684-c4d0-4e9f-9995-8b64abaa333d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:40.964030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-753cb684-c4d0-4e9f-9995-8b64abaa333d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:40.964471 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-753cb684-c4d0-4e9f-9995-8b64abaa333d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:40.965188 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-753cb684-c4d0-4e9f-9995-8b64abaa333d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:40.965685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-753cb684-c4d0-4e9f-9995-8b64abaa333d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:40.974514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-753cb684-c4d0-4e9f-9995-8b64abaa333d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:41.119856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-753cb684-c4d0-4e9f-9995-8b64abaa333d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:41.129326 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-753cb684-c4d0-4e9f-9995-8b64abaa333d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1357 microversion: 2.1 time: 0.179051 Oct 04 22:24:41.129867 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3817/7655] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:40 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:42.154818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8011f62a-54a6-4877-8e3a-f4e57ce4ed81 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:42.155552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8011f62a-54a6-4877-8e3a-f4e57ce4ed81 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:42.157802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:42.163449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8011f62a-54a6-4877-8e3a-f4e57ce4ed81 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:42.163962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8011f62a-54a6-4877-8e3a-f4e57ce4ed81 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:42.164421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8011f62a-54a6-4877-8e3a-f4e57ce4ed81 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:42.165143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8011f62a-54a6-4877-8e3a-f4e57ce4ed81 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:42.165655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8011f62a-54a6-4877-8e3a-f4e57ce4ed81 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:42.166102 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8011f62a-54a6-4877-8e3a-f4e57ce4ed81 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:42.303361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8011f62a-54a6-4877-8e3a-f4e57ce4ed81 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:42.311273 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8011f62a-54a6-4877-8e3a-f4e57ce4ed81 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1357 microversion: 2.1 time: 0.160451 Oct 04 22:24:42.312490 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3839/7656] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:42 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:43.335273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4cc703d8-c936-4149-a977-9f0c6f4b3a64 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:43.335850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4cc703d8-c936-4149-a977-9f0c6f4b3a64 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:43.337953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:43.345014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cc703d8-c936-4149-a977-9f0c6f4b3a64 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:43.350609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cc703d8-c936-4149-a977-9f0c6f4b3a64 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:43.350609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cc703d8-c936-4149-a977-9f0c6f4b3a64 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:43.350609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cc703d8-c936-4149-a977-9f0c6f4b3a64 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:43.350609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cc703d8-c936-4149-a977-9f0c6f4b3a64 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:43.350609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4cc703d8-c936-4149-a977-9f0c6f4b3a64 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:43.484129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4cc703d8-c936-4149-a977-9f0c6f4b3a64 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:43.492186 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4cc703d8-c936-4149-a977-9f0c6f4b3a64 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1357 microversion: 2.1 time: 0.161011 Oct 04 22:24:43.494626 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3818/7657] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:43 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:43.899381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-23906fad-0c93-4fe7-b043-c04bb2668d0e req-c0170736-155a-4020-bef8-fe1af5496ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24bd7567-db32-4226-960f-6ae465c5c585", "tag": "ec80f04b-de67-43a0-b707-190a6c4767eb"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:43.909471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-23906fad-0c93-4fe7-b043-c04bb2668d0e req-c0170736-155a-4020-bef8-fe1af5496ed7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:43.910022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-23906fad-0c93-4fe7-b043-c04bb2668d0e req-c0170736-155a-4020-bef8-fe1af5496ed7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:43.910479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-23906fad-0c93-4fe7-b043-c04bb2668d0e req-c0170736-155a-4020-bef8-fe1af5496ed7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:43.921832 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-23906fad-0c93-4fe7-b043-c04bb2668d0e req-c0170736-155a-4020-bef8-fe1af5496ed7 service nova] Creating event network-changed:ec80f04b-de67-43a0-b707-190a6c4767eb for instance 24bd7567-db32-4226-960f-6ae465c5c585 on n-h1-860282-1 Oct 04 22:24:43.926860 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-23906fad-0c93-4fe7-b043-c04bb2668d0e req-c0170736-155a-4020-bef8-fe1af5496ed7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087946 Oct 04 22:24:43.927561 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3840/7658] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:24:44.520890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-90f5c1e8-9337-41d2-8e38-5d1569cd35a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:44.521465 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-90f5c1e8-9337-41d2-8e38-5d1569cd35a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:44.528352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90f5c1e8-9337-41d2-8e38-5d1569cd35a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:44.528847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90f5c1e8-9337-41d2-8e38-5d1569cd35a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:44.529294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90f5c1e8-9337-41d2-8e38-5d1569cd35a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:44.530030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90f5c1e8-9337-41d2-8e38-5d1569cd35a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:44.531145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90f5c1e8-9337-41d2-8e38-5d1569cd35a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:44.531579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-90f5c1e8-9337-41d2-8e38-5d1569cd35a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:44.663659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-90f5c1e8-9337-41d2-8e38-5d1569cd35a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:44.674567 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-90f5c1e8-9337-41d2-8e38-5d1569cd35a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1357 microversion: 2.1 time: 0.157611 Oct 04 22:24:44.675320 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3819/7659] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:44 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:45.705558 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3a2947df-9c3f-4721-a089-ac3e83ccb6a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:45.706312 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3a2947df-9c3f-4721-a089-ac3e83ccb6a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:45.712481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a2947df-9c3f-4721-a089-ac3e83ccb6a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:45.712989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a2947df-9c3f-4721-a089-ac3e83ccb6a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:45.713464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a2947df-9c3f-4721-a089-ac3e83ccb6a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:45.714174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a2947df-9c3f-4721-a089-ac3e83ccb6a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:45.714654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a2947df-9c3f-4721-a089-ac3e83ccb6a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:45.715100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3a2947df-9c3f-4721-a089-ac3e83ccb6a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:45.841535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3a2947df-9c3f-4721-a089-ac3e83ccb6a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:45.849547 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3a2947df-9c3f-4721-a089-ac3e83ccb6a4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1357 microversion: 2.1 time: 0.149755 Oct 04 22:24:45.850122 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3841/7660] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:45 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:46.872170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6188e51b-ead6-4e88-9688-632294283680 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:46.872789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6188e51b-ead6-4e88-9688-632294283680 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:46.879696 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6188e51b-ead6-4e88-9688-632294283680 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:46.880180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6188e51b-ead6-4e88-9688-632294283680 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:46.880619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6188e51b-ead6-4e88-9688-632294283680 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:46.881306 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6188e51b-ead6-4e88-9688-632294283680 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:46.882046 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6188e51b-ead6-4e88-9688-632294283680 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:46.882468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6188e51b-ead6-4e88-9688-632294283680 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:47.009350 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6188e51b-ead6-4e88-9688-632294283680 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:47.017565 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6188e51b-ead6-4e88-9688-632294283680 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1357 microversion: 2.1 time: 0.149318 Oct 04 22:24:47.018145 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3820/7661] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:46 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:48.041613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0618145c-4a03-405e-8d1e-84028fcd9098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:48.042161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0618145c-4a03-405e-8d1e-84028fcd9098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:48.049447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0618145c-4a03-405e-8d1e-84028fcd9098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:48.049946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0618145c-4a03-405e-8d1e-84028fcd9098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:48.050397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0618145c-4a03-405e-8d1e-84028fcd9098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:48.051099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0618145c-4a03-405e-8d1e-84028fcd9098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:48.051600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0618145c-4a03-405e-8d1e-84028fcd9098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:48.052033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0618145c-4a03-405e-8d1e-84028fcd9098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:48.521187 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0618145c-4a03-405e-8d1e-84028fcd9098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:48.528993 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0618145c-4a03-405e-8d1e-84028fcd9098 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1357 microversion: 2.1 time: 0.492685 Oct 04 22:24:48.529862 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3842/7662] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:48 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1357 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:49.552965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-36e09ac4-ef2b-4fb3-a0fd-9a2d4f7cd2e6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:49.553619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-36e09ac4-ef2b-4fb3-a0fd-9a2d4f7cd2e6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:49.560034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36e09ac4-ef2b-4fb3-a0fd-9a2d4f7cd2e6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:49.560582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36e09ac4-ef2b-4fb3-a0fd-9a2d4f7cd2e6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:49.561024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36e09ac4-ef2b-4fb3-a0fd-9a2d4f7cd2e6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:49.561774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36e09ac4-ef2b-4fb3-a0fd-9a2d4f7cd2e6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:49.562323 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36e09ac4-ef2b-4fb3-a0fd-9a2d4f7cd2e6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:49.562756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36e09ac4-ef2b-4fb3-a0fd-9a2d4f7cd2e6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:49.697055 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-36e09ac4-ef2b-4fb3-a0fd-9a2d4f7cd2e6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:49.704977 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-36e09ac4-ef2b-4fb3-a0fd-9a2d4f7cd2e6 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1357 microversion: 2.1 time: 0.156065 Oct 04 22:24:49.705781 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3821/7663] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:49 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:49.743650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-98372b9e-f000-4dbf-a63b-acecace47c2f req-69f771e1-2f41-44f9-ba3f-b124737a1a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24bd7567-db32-4226-960f-6ae465c5c585", "name": "network-vif-plugged", "status": "completed", "tag": "ec80f04b-de67-43a0-b707-190a6c4767eb"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:49.753589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-98372b9e-f000-4dbf-a63b-acecace47c2f req-69f771e1-2f41-44f9-ba3f-b124737a1a4a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:49.754091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-98372b9e-f000-4dbf-a63b-acecace47c2f req-69f771e1-2f41-44f9-ba3f-b124737a1a4a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:49.754687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-98372b9e-f000-4dbf-a63b-acecace47c2f req-69f771e1-2f41-44f9-ba3f-b124737a1a4a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:49.767272 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-98372b9e-f000-4dbf-a63b-acecace47c2f req-69f771e1-2f41-44f9-ba3f-b124737a1a4a service nova] Creating event network-vif-plugged:ec80f04b-de67-43a0-b707-190a6c4767eb for instance 24bd7567-db32-4226-960f-6ae465c5c585 on n-h1-860282-1 Oct 04 22:24:49.772342 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-98372b9e-f000-4dbf-a63b-acecace47c2f req-69f771e1-2f41-44f9-ba3f-b124737a1a4a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091568 Oct 04 22:24:49.773003 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3843/7664] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:24:50.729230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bb3c0fbb-f236-4a5e-9148-8a30464e58e4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:50.729879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bb3c0fbb-f236-4a5e-9148-8a30464e58e4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:50.737392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb3c0fbb-f236-4a5e-9148-8a30464e58e4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:50.737921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb3c0fbb-f236-4a5e-9148-8a30464e58e4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:50.738369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb3c0fbb-f236-4a5e-9148-8a30464e58e4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:50.739064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb3c0fbb-f236-4a5e-9148-8a30464e58e4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:50.739525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb3c0fbb-f236-4a5e-9148-8a30464e58e4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:50.739957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb3c0fbb-f236-4a5e-9148-8a30464e58e4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:50.873470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bb3c0fbb-f236-4a5e-9148-8a30464e58e4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:50.882351 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bb3c0fbb-f236-4a5e-9148-8a30464e58e4 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1357 microversion: 2.1 time: 0.156963 Oct 04 22:24:50.882941 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3822/7665] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:50 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:51.906705 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0abfa87e-e527-4fc1-b7d5-4c944370e23a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:51.907440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0abfa87e-e527-4fc1-b7d5-4c944370e23a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:51.914563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0abfa87e-e527-4fc1-b7d5-4c944370e23a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:51.915072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0abfa87e-e527-4fc1-b7d5-4c944370e23a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:51.915527 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0abfa87e-e527-4fc1-b7d5-4c944370e23a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:51.916238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0abfa87e-e527-4fc1-b7d5-4c944370e23a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:51.916718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0abfa87e-e527-4fc1-b7d5-4c944370e23a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:51.917165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0abfa87e-e527-4fc1-b7d5-4c944370e23a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:52.045151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0abfa87e-e527-4fc1-b7d5-4c944370e23a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:52.053112 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0abfa87e-e527-4fc1-b7d5-4c944370e23a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1546 microversion: 2.1 time: 0.151527 Oct 04 22:24:52.053717 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3844/7666] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:51 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:52.085146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c7900dfb-c6c3-4d9b-ae91-f4df54390d19 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:52.085827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c7900dfb-c6c3-4d9b-ae91-f4df54390d19 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:52.093345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c7900dfb-c6c3-4d9b-ae91-f4df54390d19 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:52.093866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c7900dfb-c6c3-4d9b-ae91-f4df54390d19 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:52.094315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c7900dfb-c6c3-4d9b-ae91-f4df54390d19 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:52.095097 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c7900dfb-c6c3-4d9b-ae91-f4df54390d19 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:52.095563 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c7900dfb-c6c3-4d9b-ae91-f4df54390d19 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:52.095999 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c7900dfb-c6c3-4d9b-ae91-f4df54390d19 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:52.227082 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c7900dfb-c6c3-4d9b-ae91-f4df54390d19 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:52.235021 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c7900dfb-c6c3-4d9b-ae91-f4df54390d19 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1546 microversion: 2.1 time: 0.153884 Oct 04 22:24:52.235600 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3823/7667] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:52 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:24:52.256759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e90edf07-d184-46f3-acd0-bd25f83c90a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:52.261693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e90edf07-d184-46f3-acd0-bd25f83c90a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:52.262483 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e90edf07-d184-46f3-acd0-bd25f83c90a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Searching by: {'deleted': False, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae'} {{(pid=122757) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:24:52.268395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e90edf07-d184-46f3-acd0-bd25f83c90a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:52.268897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e90edf07-d184-46f3-acd0-bd25f83c90a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:52.269350 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e90edf07-d184-46f3-acd0-bd25f83c90a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:52.270134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e90edf07-d184-46f3-acd0-bd25f83c90a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:52.270609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e90edf07-d184-46f3-acd0-bd25f83c90a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:52.271055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e90edf07-d184-46f3-acd0-bd25f83c90a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:52.294615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.multi_cell_list [None req-e90edf07-d184-46f3-acd0-bd25f83c90a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122757) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:24:52.323680 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e90edf07-d184-46f3-acd0-bd25f83c90a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.070996 Oct 04 22:24:52.324269 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3845/7668] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Oct 4 22:24:52 2022] GET /compute/v2.1/servers => generated 341 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:24:52.336456 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4babe393-75ee-4f1a-929f-2a7ec0cec62d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:52.337106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4babe393-75ee-4f1a-929f-2a7ec0cec62d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:52.343739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4babe393-75ee-4f1a-929f-2a7ec0cec62d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:52.344296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4babe393-75ee-4f1a-929f-2a7ec0cec62d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:52.344733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4babe393-75ee-4f1a-929f-2a7ec0cec62d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:52.345475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4babe393-75ee-4f1a-929f-2a7ec0cec62d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:52.345932 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4babe393-75ee-4f1a-929f-2a7ec0cec62d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:52.346359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4babe393-75ee-4f1a-929f-2a7ec0cec62d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:52.476794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4babe393-75ee-4f1a-929f-2a7ec0cec62d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:52.485513 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4babe393-75ee-4f1a-929f-2a7ec0cec62d tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1546 microversion: 2.1 time: 0.152857 Oct 04 22:24:52.486090 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3824/7669] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:52 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:55.303354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-62324992-e668-4c12-85f9-48f61dea0e29 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d063362-adf2-4d3e-9609-753a307568da"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:55.305742 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-62324992-e668-4c12-85f9-48f61dea0e29 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:55.312555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-62324992-e668-4c12-85f9-48f61dea0e29 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:55.313053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-62324992-e668-4c12-85f9-48f61dea0e29 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:55.314145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-62324992-e668-4c12-85f9-48f61dea0e29 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:55.314884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-62324992-e668-4c12-85f9-48f61dea0e29 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:55.315353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-62324992-e668-4c12-85f9-48f61dea0e29 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:55.315793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-62324992-e668-4c12-85f9-48f61dea0e29 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:56.019315 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-62324992-e668-4c12-85f9-48f61dea0e29 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "POST /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.719692 Oct 04 22:24:56.019951 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3846/7670] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Oct 4 22:24:55 2022] POST /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/os-volume_attachments => generated 194 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:25:07.846548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d1adb3ea-af93-437c-be1d-c0b557044056 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:07.847289 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d1adb3ea-af93-437c-be1d-c0b557044056 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:07.858716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:07.862362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=66 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:07.862362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1adb3ea-af93-437c-be1d-c0b557044056 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:07.862362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1adb3ea-af93-437c-be1d-c0b557044056 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:07.862362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1adb3ea-af93-437c-be1d-c0b557044056 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:07.863028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1adb3ea-af93-437c-be1d-c0b557044056 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:07.863488 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1adb3ea-af93-437c-be1d-c0b557044056 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:07.863926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d1adb3ea-af93-437c-be1d-c0b557044056 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:07.999319 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d1adb3ea-af93-437c-be1d-c0b557044056 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:08.008496 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d1adb3ea-af93-437c-be1d-c0b557044056 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1592 microversion: 2.1 time: 0.165933 Oct 04 22:25:08.009072 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3825/7671] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:07 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1592 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:09.957503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-2aef7da5-7913-4b93-9e7d-88daaddf9d52 req-4801d665-620f-4b5f-afe2-3a44a2980711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24bd7567-db32-4226-960f-6ae465c5c585", "tag": "ec80f04b-de67-43a0-b707-190a6c4767eb"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:25:09.964523 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:09.968165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:09.968165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:09.972429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2aef7da5-7913-4b93-9e7d-88daaddf9d52 req-4801d665-620f-4b5f-afe2-3a44a2980711 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:09.972931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2aef7da5-7913-4b93-9e7d-88daaddf9d52 req-4801d665-620f-4b5f-afe2-3a44a2980711 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:09.973382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2aef7da5-7913-4b93-9e7d-88daaddf9d52 req-4801d665-620f-4b5f-afe2-3a44a2980711 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:09.984870 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-2aef7da5-7913-4b93-9e7d-88daaddf9d52 req-4801d665-620f-4b5f-afe2-3a44a2980711 service nova] Creating event network-changed:ec80f04b-de67-43a0-b707-190a6c4767eb for instance 24bd7567-db32-4226-960f-6ae465c5c585 on n-h1-860282-1 Oct 04 22:25:09.991869 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-2aef7da5-7913-4b93-9e7d-88daaddf9d52 req-4801d665-620f-4b5f-afe2-3a44a2980711 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040112 Oct 04 22:25:09.992682 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3847/7672] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:25:12.729098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e9691115-782b-463d-a40a-3b0313285e79 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-90021593"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:25:12.731958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e9691115-782b-463d-a40a-3b0313285e79 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:12.736624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9691115-782b-463d-a40a-3b0313285e79 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:12.737804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9691115-782b-463d-a40a-3b0313285e79 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:12.738237 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9691115-782b-463d-a40a-3b0313285e79 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:12.738939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9691115-782b-463d-a40a-3b0313285e79 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:12.739397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9691115-782b-463d-a40a-3b0313285e79 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:12.739832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e9691115-782b-463d-a40a-3b0313285e79 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:12.869650 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.network.security_group_api [None req-e9691115-782b-463d-a40a-3b0313285e79 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Adding security group 06751c69-ceb0-4f8b-97f6-910d556ef452 to port ec80f04b-de67-43a0-b707-190a6c4767eb Oct 04 22:25:13.245748 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e9691115-782b-463d-a40a-3b0313285e79 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "POST /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/action" status: 202 len: 0 microversion: 2.1 time: 0.520669 Oct 04 22:25:13.249545 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3826/7673] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:25:12 2022] POST /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:25:13.254008 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-b50450f7-e854-4471-8e92-eab8420e81e8 req-d96b4883-9390-48c1-8690-5c04edbbd432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24bd7567-db32-4226-960f-6ae465c5c585", "tag": "ec80f04b-de67-43a0-b707-190a6c4767eb"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:25:13.255741 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0c8e923b-eb9a-4bc0-88c3-17d2b409e833 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:13.256867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0c8e923b-eb9a-4bc0-88c3-17d2b409e833 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:13.263439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c8e923b-eb9a-4bc0-88c3-17d2b409e833 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:13.264279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c8e923b-eb9a-4bc0-88c3-17d2b409e833 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:13.265031 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c8e923b-eb9a-4bc0-88c3-17d2b409e833 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:13.265882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b50450f7-e854-4471-8e92-eab8420e81e8 req-d96b4883-9390-48c1-8690-5c04edbbd432 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:13.266383 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b50450f7-e854-4471-8e92-eab8420e81e8 req-d96b4883-9390-48c1-8690-5c04edbbd432 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:13.266513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c8e923b-eb9a-4bc0-88c3-17d2b409e833 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:13.266827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-b50450f7-e854-4471-8e92-eab8420e81e8 req-d96b4883-9390-48c1-8690-5c04edbbd432 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:13.267430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c8e923b-eb9a-4bc0-88c3-17d2b409e833 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:13.267935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0c8e923b-eb9a-4bc0-88c3-17d2b409e833 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:13.282882 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-b50450f7-e854-4471-8e92-eab8420e81e8 req-d96b4883-9390-48c1-8690-5c04edbbd432 service nova] Creating event network-changed:ec80f04b-de67-43a0-b707-190a6c4767eb for instance 24bd7567-db32-4226-960f-6ae465c5c585 on n-h1-860282-1 Oct 04 22:25:13.290850 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-b50450f7-e854-4471-8e92-eab8420e81e8 req-d96b4883-9390-48c1-8690-5c04edbbd432 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040273 Oct 04 22:25:13.291780 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3848/7674] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:25:13.458526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0c8e923b-eb9a-4bc0-88c3-17d2b409e833 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:13.467821 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0c8e923b-eb9a-4bc0-88c3-17d2b409e833 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1755 microversion: 2.1 time: 0.216504 Oct 04 22:25:13.468678 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3827/7675] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:13 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1755 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:22.896096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-af0c2551-d158-4599-8534-b8787d28dd21 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:25:22.898376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-af0c2551-d158-4599-8534-b8787d28dd21 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:22.905447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af0c2551-d158-4599-8534-b8787d28dd21 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:22.905978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af0c2551-d158-4599-8534-b8787d28dd21 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:22.906429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af0c2551-d158-4599-8534-b8787d28dd21 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:22.907128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af0c2551-d158-4599-8534-b8787d28dd21 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:22.907590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af0c2551-d158-4599-8534-b8787d28dd21 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:22.908057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-af0c2551-d158-4599-8534-b8787d28dd21 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:23.133238 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-af0c2551-d158-4599-8534-b8787d28dd21 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "POST /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/action" status: 202 len: 0 microversion: 2.1 time: 0.242920 Oct 04 22:25:23.133934 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3849/7676] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:25:22 2022] POST /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:25:23.142439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-418431f3-95fe-4d98-9437-a2c2b4125006 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:23.143064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-418431f3-95fe-4d98-9437-a2c2b4125006 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:23.149709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-418431f3-95fe-4d98-9437-a2c2b4125006 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:23.150139 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-418431f3-95fe-4d98-9437-a2c2b4125006 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:23.150578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-418431f3-95fe-4d98-9437-a2c2b4125006 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:23.151309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-418431f3-95fe-4d98-9437-a2c2b4125006 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:23.151784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-418431f3-95fe-4d98-9437-a2c2b4125006 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:23.152264 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-418431f3-95fe-4d98-9437-a2c2b4125006 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:23.306736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-418431f3-95fe-4d98-9437-a2c2b4125006 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:23.315303 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-418431f3-95fe-4d98-9437-a2c2b4125006 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1747 microversion: 2.1 time: 0.177117 Oct 04 22:25:23.316598 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3828/7677] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:23 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1747 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:24.341374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cee08334-f363-4c9b-9191-205d7453b443 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:24.342125 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cee08334-f363-4c9b-9191-205d7453b443 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:24.348777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cee08334-f363-4c9b-9191-205d7453b443 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:24.349366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cee08334-f363-4c9b-9191-205d7453b443 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:24.349916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cee08334-f363-4c9b-9191-205d7453b443 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:24.350620 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cee08334-f363-4c9b-9191-205d7453b443 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:24.351093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cee08334-f363-4c9b-9191-205d7453b443 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:24.351534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cee08334-f363-4c9b-9191-205d7453b443 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:24.496863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cee08334-f363-4c9b-9191-205d7453b443 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:24.505985 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cee08334-f363-4c9b-9191-205d7453b443 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1752 microversion: 2.1 time: 0.169928 Oct 04 22:25:24.506799 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3850/7678] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:24 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:25.529618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ece879a5-3aee-49f8-be81-2a912eb96897 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:25.530239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ece879a5-3aee-49f8-be81-2a912eb96897 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:25.537733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ece879a5-3aee-49f8-be81-2a912eb96897 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:25.538279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ece879a5-3aee-49f8-be81-2a912eb96897 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:25.538724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ece879a5-3aee-49f8-be81-2a912eb96897 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:25.539481 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ece879a5-3aee-49f8-be81-2a912eb96897 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:25.539940 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ece879a5-3aee-49f8-be81-2a912eb96897 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:25.540714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ece879a5-3aee-49f8-be81-2a912eb96897 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:25.686000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ece879a5-3aee-49f8-be81-2a912eb96897 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:25.695287 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ece879a5-3aee-49f8-be81-2a912eb96897 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1752 microversion: 2.1 time: 0.169816 Oct 04 22:25:25.695873 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3829/7679] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:25 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:26.722323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-eb9e50fd-1426-46ff-91a7-0c0288e3b9a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:26.722957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-eb9e50fd-1426-46ff-91a7-0c0288e3b9a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:26.730235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb9e50fd-1426-46ff-91a7-0c0288e3b9a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:26.730731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb9e50fd-1426-46ff-91a7-0c0288e3b9a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:26.731183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb9e50fd-1426-46ff-91a7-0c0288e3b9a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:26.731885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb9e50fd-1426-46ff-91a7-0c0288e3b9a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:26.732352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb9e50fd-1426-46ff-91a7-0c0288e3b9a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:26.732791 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-eb9e50fd-1426-46ff-91a7-0c0288e3b9a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:26.880835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-eb9e50fd-1426-46ff-91a7-0c0288e3b9a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:26.889398 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-eb9e50fd-1426-46ff-91a7-0c0288e3b9a8 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1752 microversion: 2.1 time: 0.170970 Oct 04 22:25:26.889993 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3851/7680] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:26 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:27.914263 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c1564f40-24b3-4bcc-97c1-943a34df476b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:27.915061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c1564f40-24b3-4bcc-97c1-943a34df476b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:27.921879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1564f40-24b3-4bcc-97c1-943a34df476b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:27.922373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1564f40-24b3-4bcc-97c1-943a34df476b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:27.922823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1564f40-24b3-4bcc-97c1-943a34df476b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:27.923579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1564f40-24b3-4bcc-97c1-943a34df476b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:27.924042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1564f40-24b3-4bcc-97c1-943a34df476b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:27.924479 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c1564f40-24b3-4bcc-97c1-943a34df476b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:28.070217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c1564f40-24b3-4bcc-97c1-943a34df476b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:28.078562 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c1564f40-24b3-4bcc-97c1-943a34df476b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1752 microversion: 2.1 time: 0.169322 Oct 04 22:25:28.079148 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3830/7681] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:27 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:25:29.101873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d6e208e7-9de6-4275-82d9-4a4e0a26d071 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:29.102546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d6e208e7-9de6-4275-82d9-4a4e0a26d071 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:29.109214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6e208e7-9de6-4275-82d9-4a4e0a26d071 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:29.109789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6e208e7-9de6-4275-82d9-4a4e0a26d071 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:29.110236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6e208e7-9de6-4275-82d9-4a4e0a26d071 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:29.110929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6e208e7-9de6-4275-82d9-4a4e0a26d071 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:29.111397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6e208e7-9de6-4275-82d9-4a4e0a26d071 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:29.111834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d6e208e7-9de6-4275-82d9-4a4e0a26d071 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:29.255277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d6e208e7-9de6-4275-82d9-4a4e0a26d071 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:29.263669 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d6e208e7-9de6-4275-82d9-4a4e0a26d071 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1752 microversion: 2.1 time: 0.165790 Oct 04 22:25:29.264244 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3852/7682] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:29 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:30.287282 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0766971c-c754-4dd2-bb72-6c5641def79f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:30.287838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0766971c-c754-4dd2-bb72-6c5641def79f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:30.294762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0766971c-c754-4dd2-bb72-6c5641def79f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:30.295251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0766971c-c754-4dd2-bb72-6c5641def79f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:30.295694 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0766971c-c754-4dd2-bb72-6c5641def79f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:30.296421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0766971c-c754-4dd2-bb72-6c5641def79f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:30.296883 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0766971c-c754-4dd2-bb72-6c5641def79f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:30.297343 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0766971c-c754-4dd2-bb72-6c5641def79f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:30.439544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0766971c-c754-4dd2-bb72-6c5641def79f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:30.448039 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0766971c-c754-4dd2-bb72-6c5641def79f tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1752 microversion: 2.1 time: 0.165458 Oct 04 22:25:30.448611 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3831/7683] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:30 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:31.471811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a412a82d-4fd7-4d80-9e69-d520ed87c96a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:31.472449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a412a82d-4fd7-4d80-9e69-d520ed87c96a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:31.479948 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a412a82d-4fd7-4d80-9e69-d520ed87c96a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:31.480455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a412a82d-4fd7-4d80-9e69-d520ed87c96a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:31.480913 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a412a82d-4fd7-4d80-9e69-d520ed87c96a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:31.481666 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a412a82d-4fd7-4d80-9e69-d520ed87c96a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:31.482145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a412a82d-4fd7-4d80-9e69-d520ed87c96a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:31.482592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a412a82d-4fd7-4d80-9e69-d520ed87c96a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:31.627035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a412a82d-4fd7-4d80-9e69-d520ed87c96a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:31.635958 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a412a82d-4fd7-4d80-9e69-d520ed87c96a tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1752 microversion: 2.1 time: 0.168137 Oct 04 22:25:31.636534 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3853/7684] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:31 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:32.659922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6bb04dc2-f2cc-4e27-aa66-13dbe3f0a2db tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:32.660571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6bb04dc2-f2cc-4e27-aa66-13dbe3f0a2db tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:32.667538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6bb04dc2-f2cc-4e27-aa66-13dbe3f0a2db tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:32.668035 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6bb04dc2-f2cc-4e27-aa66-13dbe3f0a2db tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:32.668486 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6bb04dc2-f2cc-4e27-aa66-13dbe3f0a2db tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:32.669189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6bb04dc2-f2cc-4e27-aa66-13dbe3f0a2db tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:32.669684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6bb04dc2-f2cc-4e27-aa66-13dbe3f0a2db tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:32.670124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6bb04dc2-f2cc-4e27-aa66-13dbe3f0a2db tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:32.813039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6bb04dc2-f2cc-4e27-aa66-13dbe3f0a2db tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:32.821595 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6bb04dc2-f2cc-4e27-aa66-13dbe3f0a2db tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1752 microversion: 2.1 time: 0.165589 Oct 04 22:25:32.822171 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3832/7685] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:32 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:33.844115 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9ba17a5e-e610-480d-91ae-0c360eb32ace tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:33.844747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9ba17a5e-e610-480d-91ae-0c360eb32ace tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:33.851780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9ba17a5e-e610-480d-91ae-0c360eb32ace tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:33.852274 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9ba17a5e-e610-480d-91ae-0c360eb32ace tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:33.852721 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9ba17a5e-e610-480d-91ae-0c360eb32ace tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:33.853437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9ba17a5e-e610-480d-91ae-0c360eb32ace tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:33.853906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9ba17a5e-e610-480d-91ae-0c360eb32ace tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:33.854343 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9ba17a5e-e610-480d-91ae-0c360eb32ace tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:33.995811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9ba17a5e-e610-480d-91ae-0c360eb32ace tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:34.004040 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9ba17a5e-e610-480d-91ae-0c360eb32ace tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1752 microversion: 2.1 time: 0.163833 Oct 04 22:25:34.004816 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3854/7686] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:33 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:35.028279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ba8936be-5969-455b-b584-364dff221e1e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:35.028914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ba8936be-5969-455b-b584-364dff221e1e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:35.037150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba8936be-5969-455b-b584-364dff221e1e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:35.037781 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba8936be-5969-455b-b584-364dff221e1e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:35.038240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba8936be-5969-455b-b584-364dff221e1e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:35.038952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba8936be-5969-455b-b584-364dff221e1e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:35.039422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba8936be-5969-455b-b584-364dff221e1e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:35.039915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba8936be-5969-455b-b584-364dff221e1e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:35.195861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ba8936be-5969-455b-b584-364dff221e1e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:35.204294 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ba8936be-5969-455b-b584-364dff221e1e tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1755 microversion: 2.1 time: 0.180038 Oct 04 22:25:35.204893 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3833/7687] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:35 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:07.626863 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-75a625c4-7813-4e40-97e8-6a79aff780f1 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-90021593"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:07.627461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-75a625c4-7813-4e40-97e8-6a79aff780f1 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:07.629724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=16 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:07.630752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:07.636083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75a625c4-7813-4e40-97e8-6a79aff780f1 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:07.641639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75a625c4-7813-4e40-97e8-6a79aff780f1 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:07.641639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75a625c4-7813-4e40-97e8-6a79aff780f1 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:07.641639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75a625c4-7813-4e40-97e8-6a79aff780f1 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:07.641639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75a625c4-7813-4e40-97e8-6a79aff780f1 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:07.641639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-75a625c4-7813-4e40-97e8-6a79aff780f1 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:07.846492 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.network.security_group_api [None req-75a625c4-7813-4e40-97e8-6a79aff780f1 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Removing security group 06751c69-ceb0-4f8b-97f6-910d556ef452 from port ec80f04b-de67-43a0-b707-190a6c4767eb Oct 04 22:26:08.227886 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-75a625c4-7813-4e40-97e8-6a79aff780f1 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "POST /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/action" status: 202 len: 0 microversion: 2.1 time: 0.605120 Oct 04 22:26:08.229518 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3855/7688] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:26:07 2022] POST /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:26:08.239690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=18 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:08.241502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=52 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:08.331713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-57d45309-64e6-4726-bf12-549aa73c2a07 req-c67ab6b4-cd6f-4d4d-ad44-c83517b75c96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24bd7567-db32-4226-960f-6ae465c5c585", "tag": "ec80f04b-de67-43a0-b707-190a6c4767eb"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:08.347499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-57d45309-64e6-4726-bf12-549aa73c2a07 req-c67ab6b4-cd6f-4d4d-ad44-c83517b75c96 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:08.348357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-57d45309-64e6-4726-bf12-549aa73c2a07 req-c67ab6b4-cd6f-4d4d-ad44-c83517b75c96 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:08.349042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-57d45309-64e6-4726-bf12-549aa73c2a07 req-c67ab6b4-cd6f-4d4d-ad44-c83517b75c96 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:08.365098 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-57d45309-64e6-4726-bf12-549aa73c2a07 req-c67ab6b4-cd6f-4d4d-ad44-c83517b75c96 service nova] Creating event network-changed:ec80f04b-de67-43a0-b707-190a6c4767eb for instance 24bd7567-db32-4226-960f-6ae465c5c585 on n-h1-860282-1 Oct 04 22:26:08.372765 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-57d45309-64e6-4726-bf12-549aa73c2a07 req-c67ab6b4-cd6f-4d4d-ad44-c83517b75c96 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139903 Oct 04 22:26:08.375198 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3834/7689] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:26:09.435016 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-17730d83-2ed8-4be4-ac33-4b0d34facdba tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:09.435597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-17730d83-2ed8-4be4-ac33-4b0d34facdba tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:09.441994 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17730d83-2ed8-4be4-ac33-4b0d34facdba tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:09.442496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17730d83-2ed8-4be4-ac33-4b0d34facdba tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:09.442952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17730d83-2ed8-4be4-ac33-4b0d34facdba tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:09.443662 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17730d83-2ed8-4be4-ac33-4b0d34facdba tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:09.444129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17730d83-2ed8-4be4-ac33-4b0d34facdba tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:09.444593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-17730d83-2ed8-4be4-ac33-4b0d34facdba tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:09.525641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-17730d83-2ed8-4be4-ac33-4b0d34facdba tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lazy-loading 'services' on Instance uuid 24bd7567-db32-4226-960f-6ae465c5c585 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:26:09.766773 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-17730d83-2ed8-4be4-ac33-4b0d34facdba tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "DELETE /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/os-volume_attachments/2d063362-adf2-4d3e-9609-753a307568da" status: 202 len: 0 microversion: 2.1 time: 0.337843 Oct 04 22:26:09.767922 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3856/7690] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 22:26:09 2022] DELETE /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/os-volume_attachments/2d063362-adf2-4d3e-9609-753a307568da => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:26:09.780745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-eabf63f1-d6c0-4470-adc6-22133ef71366 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:09.783804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-eabf63f1-d6c0-4470-adc6-22133ef71366 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:09.794268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eabf63f1-d6c0-4470-adc6-22133ef71366 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:09.794743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eabf63f1-d6c0-4470-adc6-22133ef71366 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:09.795184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eabf63f1-d6c0-4470-adc6-22133ef71366 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:09.795902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eabf63f1-d6c0-4470-adc6-22133ef71366 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:09.796362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eabf63f1-d6c0-4470-adc6-22133ef71366 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:09.796822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eabf63f1-d6c0-4470-adc6-22133ef71366 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:09.826452 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-eabf63f1-d6c0-4470-adc6-22133ef71366 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050913 Oct 04 22:26:09.827304 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3835/7691] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:26:09 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:10.392161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-845ee46c-18ac-4b30-9504-842f2dc65b6f req-e85053d3-7e5e-480f-9ee6-be469e91cfb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24bd7567-db32-4226-960f-6ae465c5c585", "tag": "ec80f04b-de67-43a0-b707-190a6c4767eb"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:10.403646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-845ee46c-18ac-4b30-9504-842f2dc65b6f req-e85053d3-7e5e-480f-9ee6-be469e91cfb7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:10.404309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-845ee46c-18ac-4b30-9504-842f2dc65b6f req-e85053d3-7e5e-480f-9ee6-be469e91cfb7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:10.404852 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-845ee46c-18ac-4b30-9504-842f2dc65b6f req-e85053d3-7e5e-480f-9ee6-be469e91cfb7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:10.418240 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-845ee46c-18ac-4b30-9504-842f2dc65b6f req-e85053d3-7e5e-480f-9ee6-be469e91cfb7 service nova] Creating event network-changed:ec80f04b-de67-43a0-b707-190a6c4767eb for instance 24bd7567-db32-4226-960f-6ae465c5c585 on n-h1-860282-1 Oct 04 22:26:10.424391 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-845ee46c-18ac-4b30-9504-842f2dc65b6f req-e85053d3-7e5e-480f-9ee6-be469e91cfb7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037169 Oct 04 22:26:10.426247 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3857/7692] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:10.840344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-57a1520d-f22e-4d2a-9cc8-767931970247 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:10.843527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-57a1520d-f22e-4d2a-9cc8-767931970247 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:10.850800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57a1520d-f22e-4d2a-9cc8-767931970247 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:10.851374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57a1520d-f22e-4d2a-9cc8-767931970247 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:10.851890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57a1520d-f22e-4d2a-9cc8-767931970247 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:10.852758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57a1520d-f22e-4d2a-9cc8-767931970247 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:10.853295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57a1520d-f22e-4d2a-9cc8-767931970247 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:10.853835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-57a1520d-f22e-4d2a-9cc8-767931970247 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:10.885086 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-57a1520d-f22e-4d2a-9cc8-767931970247 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049728 Oct 04 22:26:10.891294 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3836/7693] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:26:10 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:11.899110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-55a6a44f-0b0b-44d0-9b65-33a150a70d84 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:11.902093 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-55a6a44f-0b0b-44d0-9b65-33a150a70d84 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:11.909404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55a6a44f-0b0b-44d0-9b65-33a150a70d84 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:11.909942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55a6a44f-0b0b-44d0-9b65-33a150a70d84 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:11.910421 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55a6a44f-0b0b-44d0-9b65-33a150a70d84 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:11.911147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55a6a44f-0b0b-44d0-9b65-33a150a70d84 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:11.911621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55a6a44f-0b0b-44d0-9b65-33a150a70d84 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:11.912066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-55a6a44f-0b0b-44d0-9b65-33a150a70d84 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:11.944632 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-55a6a44f-0b0b-44d0-9b65-33a150a70d84 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049909 Oct 04 22:26:11.945206 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3858/7694] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:26:11 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:12.957617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a3e19fbd-0fd3-486e-ac32-9fe9d98db1a2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:12.959744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a3e19fbd-0fd3-486e-ac32-9fe9d98db1a2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:12.967464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3e19fbd-0fd3-486e-ac32-9fe9d98db1a2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:12.967954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3e19fbd-0fd3-486e-ac32-9fe9d98db1a2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:12.968397 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3e19fbd-0fd3-486e-ac32-9fe9d98db1a2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:12.969101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3e19fbd-0fd3-486e-ac32-9fe9d98db1a2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:12.969599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3e19fbd-0fd3-486e-ac32-9fe9d98db1a2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:12.970029 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a3e19fbd-0fd3-486e-ac32-9fe9d98db1a2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:12.999698 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a3e19fbd-0fd3-486e-ac32-9fe9d98db1a2 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046246 Oct 04 22:26:13.000274 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3837/7695] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:26:12 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:14.013146 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-65f70641-5fcc-442b-a745-f0b54c30face tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:14.015597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-65f70641-5fcc-442b-a745-f0b54c30face tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:14.022876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65f70641-5fcc-442b-a745-f0b54c30face tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:14.023459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65f70641-5fcc-442b-a745-f0b54c30face tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:14.023995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65f70641-5fcc-442b-a745-f0b54c30face tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:14.024719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65f70641-5fcc-442b-a745-f0b54c30face tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:14.025194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65f70641-5fcc-442b-a745-f0b54c30face tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:14.025668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-65f70641-5fcc-442b-a745-f0b54c30face tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:14.055874 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-65f70641-5fcc-442b-a745-f0b54c30face tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046972 Oct 04 22:26:14.056441 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3859/7696] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:26:14 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:15.070941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5f9b851a-2a61-4968-b161-77af8e35a4cc tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:15.073565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5f9b851a-2a61-4968-b161-77af8e35a4cc tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:15.081863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f9b851a-2a61-4968-b161-77af8e35a4cc tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:15.082358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f9b851a-2a61-4968-b161-77af8e35a4cc tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:15.082803 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f9b851a-2a61-4968-b161-77af8e35a4cc tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:15.083514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f9b851a-2a61-4968-b161-77af8e35a4cc tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:15.084864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f9b851a-2a61-4968-b161-77af8e35a4cc tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:15.085307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5f9b851a-2a61-4968-b161-77af8e35a4cc tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:15.118363 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5f9b851a-2a61-4968-b161-77af8e35a4cc tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053437 Oct 04 22:26:15.118949 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3838/7697] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Oct 4 22:26:15 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:26:15.132024 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2a69adbc-da5e-48d2-8787-2718cd76cc2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:15.132581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2a69adbc-da5e-48d2-8787-2718cd76cc2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:15.139659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a69adbc-da5e-48d2-8787-2718cd76cc2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:15.140164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a69adbc-da5e-48d2-8787-2718cd76cc2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:15.140612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a69adbc-da5e-48d2-8787-2718cd76cc2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:15.141327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a69adbc-da5e-48d2-8787-2718cd76cc2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:15.141817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a69adbc-da5e-48d2-8787-2718cd76cc2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:15.142253 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a69adbc-da5e-48d2-8787-2718cd76cc2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:15.221327 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-2a69adbc-da5e-48d2-8787-2718cd76cc2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] HTTP exception thrown: Instance 24bd7567-db32-4226-960f-6ae465c5c585 is not attached to volume 2d063362-adf2-4d3e-9609-753a307568da Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2a69adbc-da5e-48d2-8787-2718cd76cc2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Request method failure captured: Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: request: DELETE /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/os-volume_attachments/2d063362-adf2-4d3e-9609-753a307568da HTTP/1.1 Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPLGUAfThvRWzUDYTVj8O3ExgUt6x8kEMj9qmJMXkruIiQgz7smKwTkE82PCqZyUzuhFqljVJjNZHDDs8p224Q1ADEAkn1p7qbToXpphdOGmfQeVLMHLqRxkvl8Ovpgrgbrpz7tNpul-7bkh6EIkYkY4JZpoI353je4LklFhRNu2wQ3M Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 3aa1500ce5ca4d26b4e2a3eaf3c3ccae Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestMinimumBasicScenario-1597296029 Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aa1500ce5ca4d26b4e2a3eaf3c3ccae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3aa1500ce5ca4d26b4e2a3eaf3c3ccae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3aa1500ce5ca4d26b4e2a3eaf3c3ccae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aa1500ce5ca4d26b4e2a3eaf3c3ccae"}]}] Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestMinimumBasicScenario-1597296029 Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 3aa1500ce5ca4d26b4e2a3eaf3c3ccae Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1597296029 Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestMinimumBasicScenario-1597296029-project Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 7a37c7b63d0b4f0ba08738215f7c2455 Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestMinimumBasicScenario-1597296029-project Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 24bd7567-db32-4226-960f-6ae465c5c585 is not attached to volume 2d063362-adf2-4d3e-9609-753a307568da Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'server_id': '24bd7567-db32-4226-960f-6ae465c5c585', 'id': '2d063362-adf2-4d3e-9609-753a307568da'} Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2d063362-adf2-4d3e-9609-753a307568da. Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24bd7567-db32-4226-960f-6ae465c5c585 is not attached to volume 2d063362-adf2-4d3e-9609-753a307568da Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:26:15.223215 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:26:15.231435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:26:15.231435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:26:15.231435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24bd7567-db32-4226-960f-6ae465c5c585 is not attached to volume 2d063362-adf2-4d3e-9609-753a307568da Oct 04 22:26:15.231435 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:26:15.231435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2a69adbc-da5e-48d2-8787-2718cd76cc2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Returning 404 to user: Instance 24bd7567-db32-4226-960f-6ae465c5c585 is not attached to volume 2d063362-adf2-4d3e-9609-753a307568da {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:26:15.231435 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2a69adbc-da5e-48d2-8787-2718cd76cc2b tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "DELETE /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/os-volume_attachments/2d063362-adf2-4d3e-9609-753a307568da" status: 404 len: 154 microversion: 2.1 time: 0.097333 Oct 04 22:26:15.231435 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3860/7698] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Oct 4 22:26:15 2022] DELETE /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585/os-volume_attachments/2d063362-adf2-4d3e-9609-753a307568da => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:26:18.623467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a23376ca-631f-48d0-a57e-07626a3d7b85 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:18.624001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a23376ca-631f-48d0-a57e-07626a3d7b85 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:18.636767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a23376ca-631f-48d0-a57e-07626a3d7b85 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:18.637905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a23376ca-631f-48d0-a57e-07626a3d7b85 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:18.638603 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a23376ca-631f-48d0-a57e-07626a3d7b85 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:18.639701 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a23376ca-631f-48d0-a57e-07626a3d7b85 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:18.640391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a23376ca-631f-48d0-a57e-07626a3d7b85 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:18.641246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a23376ca-631f-48d0-a57e-07626a3d7b85 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:18.676367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a23376ca-631f-48d0-a57e-07626a3d7b85 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:26:18.967279 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a23376ca-631f-48d0-a57e-07626a3d7b85 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "DELETE /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 204 len: 0 microversion: 2.1 time: 0.348502 Oct 04 22:26:18.967898 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3839/7699] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:26:18 2022] DELETE /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:26:18.976298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-67c20255-8e3e-4459-8baa-8d12b23089a3 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:18.976934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-67c20255-8e3e-4459-8baa-8d12b23089a3 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:18.983735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67c20255-8e3e-4459-8baa-8d12b23089a3 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:18.984233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67c20255-8e3e-4459-8baa-8d12b23089a3 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:18.984687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67c20255-8e3e-4459-8baa-8d12b23089a3 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:18.985394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67c20255-8e3e-4459-8baa-8d12b23089a3 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:18.985892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67c20255-8e3e-4459-8baa-8d12b23089a3 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:18.986341 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67c20255-8e3e-4459-8baa-8d12b23089a3 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:19.125258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-67c20255-8e3e-4459-8baa-8d12b23089a3 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:19.133574 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-67c20255-8e3e-4459-8baa-8d12b23089a3 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1552 microversion: 2.1 time: 0.161204 Oct 04 22:26:19.134155 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3861/7700] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:18 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:20.157735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-13b21116-50c4-45da-b10f-f74340a5d989 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:20.158445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-13b21116-50c4-45da-b10f-f74340a5d989 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:20.165218 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13b21116-50c4-45da-b10f-f74340a5d989 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:20.165744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13b21116-50c4-45da-b10f-f74340a5d989 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:20.166183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13b21116-50c4-45da-b10f-f74340a5d989 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:20.167145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13b21116-50c4-45da-b10f-f74340a5d989 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:20.167605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13b21116-50c4-45da-b10f-f74340a5d989 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:20.168034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13b21116-50c4-45da-b10f-f74340a5d989 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:20.347383 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-13b21116-50c4-45da-b10f-f74340a5d989 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:20.356332 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-13b21116-50c4-45da-b10f-f74340a5d989 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1552 microversion: 2.1 time: 0.202981 Oct 04 22:26:20.356902 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3840/7701] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:20 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1552 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:21.177472 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-eb5bce32-9aec-44a8-b8b1-e5acfb3b2b68 req-d79d1fa3-65b0-4a03-b7f6-9abe8b7dcfb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24bd7567-db32-4226-960f-6ae465c5c585", "name": "network-vif-deleted", "tag": "ec80f04b-de67-43a0-b707-190a6c4767eb"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:21.188164 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-eb5bce32-9aec-44a8-b8b1-e5acfb3b2b68 req-d79d1fa3-65b0-4a03-b7f6-9abe8b7dcfb5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:21.188655 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-eb5bce32-9aec-44a8-b8b1-e5acfb3b2b68 req-d79d1fa3-65b0-4a03-b7f6-9abe8b7dcfb5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:21.189099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-eb5bce32-9aec-44a8-b8b1-e5acfb3b2b68 req-d79d1fa3-65b0-4a03-b7f6-9abe8b7dcfb5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:21.200387 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-eb5bce32-9aec-44a8-b8b1-e5acfb3b2b68 req-d79d1fa3-65b0-4a03-b7f6-9abe8b7dcfb5 service nova] Creating event network-vif-deleted:ec80f04b-de67-43a0-b707-190a6c4767eb for instance 24bd7567-db32-4226-960f-6ae465c5c585 on n-h1-860282-1 Oct 04 22:26:21.205710 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-eb5bce32-9aec-44a8-b8b1-e5acfb3b2b68 req-d79d1fa3-65b0-4a03-b7f6-9abe8b7dcfb5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031859 Oct 04 22:26:21.206312 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3862/7702] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:21.379959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dcd6f824-98ba-42e8-bc09-be0157f990fe tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:21.380949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dcd6f824-98ba-42e8-bc09-be0157f990fe tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:21.388040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dcd6f824-98ba-42e8-bc09-be0157f990fe tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:21.388579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dcd6f824-98ba-42e8-bc09-be0157f990fe tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:21.389016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dcd6f824-98ba-42e8-bc09-be0157f990fe tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:21.390080 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dcd6f824-98ba-42e8-bc09-be0157f990fe tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:21.390545 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dcd6f824-98ba-42e8-bc09-be0157f990fe tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:21.390969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dcd6f824-98ba-42e8-bc09-be0157f990fe tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:21.457320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dcd6f824-98ba-42e8-bc09-be0157f990fe tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a37c7b63d0b4f0ba08738215f7c2455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa1500ce5ca4d26b4e2a3eaf3c3ccae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:21.466534 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dcd6f824-98ba-42e8-bc09-be0157f990fe tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 200 len: 1342 microversion: 2.1 time: 0.090234 Oct 04 22:26:21.467354 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3841/7703] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:21 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 1342 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:22.490032 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-03680c55-e72e-416d-a926-28229520c3ae tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:22.490771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-03680c55-e72e-416d-a926-28229520c3ae tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] [instance: 24bd7567-db32-4226-960f-6ae465c5c585] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:22.497941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03680c55-e72e-416d-a926-28229520c3ae tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:22.498437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03680c55-e72e-416d-a926-28229520c3ae tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:22.498885 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03680c55-e72e-416d-a926-28229520c3ae tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:22.499598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03680c55-e72e-416d-a926-28229520c3ae tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:22.500073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03680c55-e72e-416d-a926-28229520c3ae tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:22.500512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03680c55-e72e-416d-a926-28229520c3ae tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:22.514183 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-03680c55-e72e-416d-a926-28229520c3ae tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] HTTP exception thrown: Instance 24bd7567-db32-4226-960f-6ae465c5c585 could not be found. Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-03680c55-e72e-416d-a926-28229520c3ae tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Request method failure captured: Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 HTTP/1.1 Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPLGUAfThvRWzUDYTVj8O3ExgUt6x8kEMj9qmJMXkruIiQgz7smKwTkE82PCqZyUzuhFqljVJjNZHDDs8p224Q1ADEAkn1p7qbToXpphdOGmfQeVLMHLqRxkvl8Ovpgrgbrpz7tNpul-7bkh6EIkYkY4JZpoI353je4LklFhRNu2wQ3M Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: 3aa1500ce5ca4d26b4e2a3eaf3c3ccae Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestMinimumBasicScenario-1597296029 Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aa1500ce5ca4d26b4e2a3eaf3c3ccae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3aa1500ce5ca4d26b4e2a3eaf3c3ccae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3aa1500ce5ca4d26b4e2a3eaf3c3ccae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aa1500ce5ca4d26b4e2a3eaf3c3ccae"}]}] Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestMinimumBasicScenario-1597296029 Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: 3aa1500ce5ca4d26b4e2a3eaf3c3ccae Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1597296029 Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestMinimumBasicScenario-1597296029-project Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 7a37c7b63d0b4f0ba08738215f7c2455 Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestMinimumBasicScenario-1597296029-project Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 24bd7567-db32-4226-960f-6ae465c5c585 could not be found. Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '24bd7567-db32-4226-960f-6ae465c5c585'} Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24bd7567-db32-4226-960f-6ae465c5c585 could not be found. Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24bd7567-db32-4226-960f-6ae465c5c585 could not be found. Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:26:22.515815 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:26:22.520510 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:26:22.520510 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:26:22.520510 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:26:22.520510 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:26:22.520510 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:26:22.520510 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24bd7567-db32-4226-960f-6ae465c5c585 could not be found. Oct 04 22:26:22.520510 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:26:22.520510 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-03680c55-e72e-416d-a926-28229520c3ae tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Returning 404 to user: Instance 24bd7567-db32-4226-960f-6ae465c5c585 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:26:22.520510 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-03680c55-e72e-416d-a926-28229520c3ae tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585" status: 404 len: 111 microversion: 2.1 time: 0.031625 Oct 04 22:26:22.520510 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3863/7704] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:22 2022] GET /compute/v2.1/servers/24bd7567-db32-4226-960f-6ae465c5c585 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:26:22.526706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5ecee888-b661-45fd-b3fd-2d7e44349294 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] Calling method '.version_select at 0x7f5791b51ee0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:22.603104 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5ecee888-b661-45fd-b3fd-2d7e44349294 tempest-TestMinimumBasicScenario-1597296029 tempest-TestMinimumBasicScenario-1597296029-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1431916073" status: 202 len: 0 microversion: 2.1 time: 0.080821 Oct 04 22:26:22.603694 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3842/7705] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Oct 4 22:26:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1431916073 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:26:34.331470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=18 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:34.332232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:34.514220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9cd1c125-510c-4a40-b380-43e40bdbbeea tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'create', calling method: .version_select at 0x7f578af7df70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-210952738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFdVb+WkmSWvWTUGBtPOsYHeIovMkw1cCTG/6WkPoYbp+BceW+pRwh4CDqVE4DCVhODzbz4XPvohk25byoOxHhcAVEi4H5eX9+8MoLoPdwisvCCnxMqrhOwNbQpoh0hjQ=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:34.530759 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-9cd1c125-510c-4a40-b380-43e40bdbbeea tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for project ef5ef0af634f40c598c43019f28afb5b. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:26:34.535972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-9cd1c125-510c-4a40-b380-43e40bdbbeea tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for user 3ead2dace0aa45419aa7f8a2cd8d2104 and project ef5ef0af634f40c598c43019f28afb5b. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:26:34.647843 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9cd1c125-510c-4a40-b380-43e40bdbbeea tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.321905 Oct 04 22:26:34.648454 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3864/7706] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 22:26:34 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:43.305098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:43.305098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:43.309642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e8115f9c-027f-4675-94b2-8d88c4b2e8f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1639462745", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "f687b98b-7be6-48b8-a324-91e9fdfc5394"}], "key_name": "tempest-TestNetworkAdvancedServerOps-210952738", "security_groups": [{"name": "tempest-secgroup-smoke-599469645"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:43.460644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-e8115f9c-027f-4675-94b2-8d88c4b2e8f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] validate_networks() for [('f687b98b-7be6-48b8-a324-91e9fdfc5394', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:26:43.957385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e8115f9c-027f-4675-94b2-8d88c4b2e8f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:26:43.957846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e8115f9c-027f-4675-94b2-8d88c4b2e8f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:26:43.958327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e8115f9c-027f-4675-94b2-8d88c4b2e8f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:26:43.958749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e8115f9c-027f-4675-94b2-8d88c4b2e8f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:26:43.959169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-e8115f9c-027f-4675-94b2-8d88c4b2e8f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:26:43.969745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8115f9c-027f-4675-94b2-8d88c4b2e8f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:43.970249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8115f9c-027f-4675-94b2-8d88c4b2e8f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:43.970686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8115f9c-027f-4675-94b2-8d88c4b2e8f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:43.971419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8115f9c-027f-4675-94b2-8d88c4b2e8f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:43.971876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8115f9c-027f-4675-94b2-8d88c4b2e8f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:43.972302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8115f9c-027f-4675-94b2-8d88c4b2e8f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:43.992217 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-e8115f9c-027f-4675-94b2-8d88c4b2e8f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for project ef5ef0af634f40c598c43019f28afb5b. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:26:43.998821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-e8115f9c-027f-4675-94b2-8d88c4b2e8f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for user 3ead2dace0aa45419aa7f8a2cd8d2104 and project ef5ef0af634f40c598c43019f28afb5b. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:26:44.012722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e8115f9c-027f-4675-94b2-8d88c4b2e8f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:26:44.015085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e8115f9c-027f-4675-94b2-8d88c4b2e8f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:26:44.130572 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e8115f9c-027f-4675-94b2-8d88c4b2e8f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.827970 Oct 04 22:26:44.131507 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3843/7707] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:26:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:26:44.144515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5b53b5fc-eb24-41e5-8d90-7a7e424f90b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:44.145080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5b53b5fc-eb24-41e5-8d90-7a7e424f90b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:44.215542 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5b53b5fc-eb24-41e5-8d90-7a7e424f90b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:44.225103 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5b53b5fc-eb24-41e5-8d90-7a7e424f90b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1266 microversion: 2.1 time: 0.085508 Oct 04 22:26:44.236108 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3865/7708] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:44 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:45.252512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b209594d-4c9c-4c11-80ed-593dcbbba118 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:45.253123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b209594d-4c9c-4c11-80ed-593dcbbba118 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:45.315440 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b209594d-4c9c-4c11-80ed-593dcbbba118 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:45.324347 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b209594d-4c9c-4c11-80ed-593dcbbba118 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1266 microversion: 2.1 time: 0.077087 Oct 04 22:26:45.324943 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3844/7709] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:45 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:46.347772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9ad0394e-095c-4ed3-9e81-57c8ce113eb5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:46.348337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9ad0394e-095c-4ed3-9e81-57c8ce113eb5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:46.356025 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9ad0394e-095c-4ed3-9e81-57c8ce113eb5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:46.356553 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9ad0394e-095c-4ed3-9e81-57c8ce113eb5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:46.357011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9ad0394e-095c-4ed3-9e81-57c8ce113eb5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:46.357725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9ad0394e-095c-4ed3-9e81-57c8ce113eb5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:46.358192 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9ad0394e-095c-4ed3-9e81-57c8ce113eb5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:46.358629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9ad0394e-095c-4ed3-9e81-57c8ce113eb5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:46.420248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9ad0394e-095c-4ed3-9e81-57c8ce113eb5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:46.428016 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9ad0394e-095c-4ed3-9e81-57c8ce113eb5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1318 microversion: 2.1 time: 0.084396 Oct 04 22:26:46.428592 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3866/7710] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:46 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1318 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:47.452358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f508682c-8782-4f3f-97d8-d698b74c5a11 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:47.453176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f508682c-8782-4f3f-97d8-d698b74c5a11 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:47.459677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f508682c-8782-4f3f-97d8-d698b74c5a11 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:47.460178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f508682c-8782-4f3f-97d8-d698b74c5a11 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:47.460617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f508682c-8782-4f3f-97d8-d698b74c5a11 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:47.461326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f508682c-8782-4f3f-97d8-d698b74c5a11 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:47.461804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f508682c-8782-4f3f-97d8-d698b74c5a11 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:47.462232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f508682c-8782-4f3f-97d8-d698b74c5a11 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:47.529791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f508682c-8782-4f3f-97d8-d698b74c5a11 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:47.541299 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f508682c-8782-4f3f-97d8-d698b74c5a11 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1324 microversion: 2.1 time: 0.094039 Oct 04 22:26:47.541958 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3845/7711] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:47 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1324 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:48.567955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-60ff52dd-adc8-4f54-9e4d-51e9a9657518 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:48.568502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-60ff52dd-adc8-4f54-9e4d-51e9a9657518 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:48.576009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60ff52dd-adc8-4f54-9e4d-51e9a9657518 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:48.576596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60ff52dd-adc8-4f54-9e4d-51e9a9657518 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:48.577048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60ff52dd-adc8-4f54-9e4d-51e9a9657518 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:48.577794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60ff52dd-adc8-4f54-9e4d-51e9a9657518 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:48.578272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60ff52dd-adc8-4f54-9e4d-51e9a9657518 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:48.578740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60ff52dd-adc8-4f54-9e4d-51e9a9657518 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:48.721856 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-60ff52dd-adc8-4f54-9e4d-51e9a9657518 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:48.730566 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-60ff52dd-adc8-4f54-9e4d-51e9a9657518 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1391 microversion: 2.1 time: 0.166478 Oct 04 22:26:48.731409 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3867/7712] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:48 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:48.824506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-94f5f742-94c0-4ea4-a099-e7508697b59e req-87735285-2a52-44e6-a715-58993ff2a8cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c1140f-21aa-4306-9e07-06ac39edc8fa", "tag": "43684891-8b3f-4793-ad98-8cc634e19afa"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:48.837610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-94f5f742-94c0-4ea4-a099-e7508697b59e req-87735285-2a52-44e6-a715-58993ff2a8cb service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:48.837610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-94f5f742-94c0-4ea4-a099-e7508697b59e req-87735285-2a52-44e6-a715-58993ff2a8cb service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:48.837610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-94f5f742-94c0-4ea4-a099-e7508697b59e req-87735285-2a52-44e6-a715-58993ff2a8cb service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:48.849863 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-94f5f742-94c0-4ea4-a099-e7508697b59e req-87735285-2a52-44e6-a715-58993ff2a8cb service nova] Creating event network-changed:43684891-8b3f-4793-ad98-8cc634e19afa for instance 38c1140f-21aa-4306-9e07-06ac39edc8fa on n-h1-860282-1 Oct 04 22:26:48.855865 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-94f5f742-94c0-4ea4-a099-e7508697b59e req-87735285-2a52-44e6-a715-58993ff2a8cb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034583 Oct 04 22:26:48.856906 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3846/7713] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:49.753584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-844b0e07-e133-42a7-a165-1514f41a8295 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:49.754122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-844b0e07-e133-42a7-a165-1514f41a8295 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:49.762504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-844b0e07-e133-42a7-a165-1514f41a8295 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:49.763156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-844b0e07-e133-42a7-a165-1514f41a8295 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:49.763636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-844b0e07-e133-42a7-a165-1514f41a8295 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:49.764342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-844b0e07-e133-42a7-a165-1514f41a8295 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:49.764811 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-844b0e07-e133-42a7-a165-1514f41a8295 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:49.765251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-844b0e07-e133-42a7-a165-1514f41a8295 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:49.908688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-844b0e07-e133-42a7-a165-1514f41a8295 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:49.916544 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-844b0e07-e133-42a7-a165-1514f41a8295 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1391 microversion: 2.1 time: 0.166965 Oct 04 22:26:49.917632 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3868/7714] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:49 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:50.940821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d3001d93-6112-41a9-af02-5287ac638022 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:50.941559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d3001d93-6112-41a9-af02-5287ac638022 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:50.947892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3001d93-6112-41a9-af02-5287ac638022 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:50.956628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3001d93-6112-41a9-af02-5287ac638022 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:50.956628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3001d93-6112-41a9-af02-5287ac638022 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:50.956628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3001d93-6112-41a9-af02-5287ac638022 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:50.956628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3001d93-6112-41a9-af02-5287ac638022 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:50.956628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d3001d93-6112-41a9-af02-5287ac638022 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:51.083735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d3001d93-6112-41a9-af02-5287ac638022 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:51.092140 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d3001d93-6112-41a9-af02-5287ac638022 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1391 microversion: 2.1 time: 0.156517 Oct 04 22:26:51.092709 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3847/7715] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:50 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:26:52.115506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fe069cd6-8504-4550-a9c9-eb28904344d3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:52.116152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fe069cd6-8504-4550-a9c9-eb28904344d3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:52.123191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe069cd6-8504-4550-a9c9-eb28904344d3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:52.123707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe069cd6-8504-4550-a9c9-eb28904344d3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:52.124170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe069cd6-8504-4550-a9c9-eb28904344d3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:52.124895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe069cd6-8504-4550-a9c9-eb28904344d3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:52.125370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe069cd6-8504-4550-a9c9-eb28904344d3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:52.125918 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fe069cd6-8504-4550-a9c9-eb28904344d3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:52.262681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fe069cd6-8504-4550-a9c9-eb28904344d3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:52.270728 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fe069cd6-8504-4550-a9c9-eb28904344d3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1391 microversion: 2.1 time: 0.159232 Oct 04 22:26:52.271318 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3869/7716] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:52 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:53.295068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8eb5e570-8101-4a6a-801b-fe345279b7d0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:53.295682 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8eb5e570-8101-4a6a-801b-fe345279b7d0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:53.302863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8eb5e570-8101-4a6a-801b-fe345279b7d0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:53.303349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8eb5e570-8101-4a6a-801b-fe345279b7d0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:53.303800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8eb5e570-8101-4a6a-801b-fe345279b7d0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:53.304476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8eb5e570-8101-4a6a-801b-fe345279b7d0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:53.304938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8eb5e570-8101-4a6a-801b-fe345279b7d0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:53.305367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8eb5e570-8101-4a6a-801b-fe345279b7d0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:53.441276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8eb5e570-8101-4a6a-801b-fe345279b7d0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:53.449285 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8eb5e570-8101-4a6a-801b-fe345279b7d0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1391 microversion: 2.1 time: 0.158735 Oct 04 22:26:53.449901 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3848/7717] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:53 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:54.190444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-418a8dd1-7b0c-4e02-af47-1435e9d9ebe8 req-9b3e3fdb-32ac-4439-8dc0-eb9e144ae292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c1140f-21aa-4306-9e07-06ac39edc8fa", "name": "network-vif-plugged", "status": "completed", "tag": "43684891-8b3f-4793-ad98-8cc634e19afa"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:54.200453 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-418a8dd1-7b0c-4e02-af47-1435e9d9ebe8 req-9b3e3fdb-32ac-4439-8dc0-eb9e144ae292 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:54.200942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-418a8dd1-7b0c-4e02-af47-1435e9d9ebe8 req-9b3e3fdb-32ac-4439-8dc0-eb9e144ae292 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:54.201387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-418a8dd1-7b0c-4e02-af47-1435e9d9ebe8 req-9b3e3fdb-32ac-4439-8dc0-eb9e144ae292 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:54.212135 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-418a8dd1-7b0c-4e02-af47-1435e9d9ebe8 req-9b3e3fdb-32ac-4439-8dc0-eb9e144ae292 service nova] Creating event network-vif-plugged:43684891-8b3f-4793-ad98-8cc634e19afa for instance 38c1140f-21aa-4306-9e07-06ac39edc8fa on n-h1-860282-1 Oct 04 22:26:54.217735 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-418a8dd1-7b0c-4e02-af47-1435e9d9ebe8 req-9b3e3fdb-32ac-4439-8dc0-eb9e144ae292 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030982 Oct 04 22:26:54.218323 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3870/7718] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:54.473008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2992d4ac-5c3e-45d3-9e93-81648458786a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:54.473843 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2992d4ac-5c3e-45d3-9e93-81648458786a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:54.475838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:54.482283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2992d4ac-5c3e-45d3-9e93-81648458786a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:54.482778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2992d4ac-5c3e-45d3-9e93-81648458786a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:54.484770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2992d4ac-5c3e-45d3-9e93-81648458786a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:54.484770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2992d4ac-5c3e-45d3-9e93-81648458786a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:54.484770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2992d4ac-5c3e-45d3-9e93-81648458786a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:54.484770 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2992d4ac-5c3e-45d3-9e93-81648458786a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:54.627793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2992d4ac-5c3e-45d3-9e93-81648458786a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:54.636423 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2992d4ac-5c3e-45d3-9e93-81648458786a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1391 microversion: 2.1 time: 0.166806 Oct 04 22:26:54.637178 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3849/7719] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:54 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:55.657157 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:55.662113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0caf531f-58bb-497f-ab95-e87523f98d85 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:55.668671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0caf531f-58bb-497f-ab95-e87523f98d85 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:55.669665 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0caf531f-58bb-497f-ab95-e87523f98d85 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:55.670169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0caf531f-58bb-497f-ab95-e87523f98d85 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:55.670627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0caf531f-58bb-497f-ab95-e87523f98d85 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:55.671335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0caf531f-58bb-497f-ab95-e87523f98d85 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:55.671818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0caf531f-58bb-497f-ab95-e87523f98d85 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:55.672266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0caf531f-58bb-497f-ab95-e87523f98d85 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:55.805244 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0caf531f-58bb-497f-ab95-e87523f98d85 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:55.813170 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0caf531f-58bb-497f-ab95-e87523f98d85 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1562 microversion: 2.1 time: 0.157026 Oct 04 22:26:55.813777 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3871/7720] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:55 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:55.835947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-21873a77-2323-4246-a70b-c071d51a5b90 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:55.836598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-21873a77-2323-4246-a70b-c071d51a5b90 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:55.838558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=8 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:55.844780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21873a77-2323-4246-a70b-c071d51a5b90 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:55.845259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21873a77-2323-4246-a70b-c071d51a5b90 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:55.852333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21873a77-2323-4246-a70b-c071d51a5b90 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:55.852333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21873a77-2323-4246-a70b-c071d51a5b90 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:55.852333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21873a77-2323-4246-a70b-c071d51a5b90 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:55.852333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-21873a77-2323-4246-a70b-c071d51a5b90 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:55.978298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-21873a77-2323-4246-a70b-c071d51a5b90 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:55.986004 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-21873a77-2323-4246-a70b-c071d51a5b90 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1562 microversion: 2.1 time: 0.154039 Oct 04 22:26:55.986571 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3850/7721] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:55 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:57.876723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ba484b17-a3e0-4010-9651-7693924e52e6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:57.877368 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ba484b17-a3e0-4010-9651-7693924e52e6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:57.883460 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-cd61258f-1637-4477-83d7-3e04ad5d7858 req-208392f9-47ab-42b4-80b6-d2ef91d0cd21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c1140f-21aa-4306-9e07-06ac39edc8fa", "tag": "43684891-8b3f-4793-ad98-8cc634e19afa"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:57.894233 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba484b17-a3e0-4010-9651-7693924e52e6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:57.894975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba484b17-a3e0-4010-9651-7693924e52e6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:57.895435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba484b17-a3e0-4010-9651-7693924e52e6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:57.895555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-cd61258f-1637-4477-83d7-3e04ad5d7858 req-208392f9-47ab-42b4-80b6-d2ef91d0cd21 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:57.895980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-cd61258f-1637-4477-83d7-3e04ad5d7858 req-208392f9-47ab-42b4-80b6-d2ef91d0cd21 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:57.896149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba484b17-a3e0-4010-9651-7693924e52e6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:57.896416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-cd61258f-1637-4477-83d7-3e04ad5d7858 req-208392f9-47ab-42b4-80b6-d2ef91d0cd21 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:57.896937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba484b17-a3e0-4010-9651-7693924e52e6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:57.897389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ba484b17-a3e0-4010-9651-7693924e52e6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:57.908670 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-cd61258f-1637-4477-83d7-3e04ad5d7858 req-208392f9-47ab-42b4-80b6-d2ef91d0cd21 service nova] Creating event network-changed:43684891-8b3f-4793-ad98-8cc634e19afa for instance 38c1140f-21aa-4306-9e07-06ac39edc8fa on n-h1-860282-1 Oct 04 22:26:57.913947 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-cd61258f-1637-4477-83d7-3e04ad5d7858 req-208392f9-47ab-42b4-80b6-d2ef91d0cd21 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042444 Oct 04 22:26:57.914699 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3851/7722] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:58.049457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ba484b17-a3e0-4010-9651-7693924e52e6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:58.057349 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ba484b17-a3e0-4010-9651-7693924e52e6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1562 microversion: 2.1 time: 0.190313 Oct 04 22:26:58.073754 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3872/7723] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:57 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1562 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:21.313183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:21.313894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=36 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:21.318183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c38427fb-1743-48b4-8183-36eceeb8a78e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:21.320662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c38427fb-1743-48b4-8183-36eceeb8a78e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:21.326916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c38427fb-1743-48b4-8183-36eceeb8a78e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:21.334070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c38427fb-1743-48b4-8183-36eceeb8a78e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:21.334070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c38427fb-1743-48b4-8183-36eceeb8a78e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:21.334070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c38427fb-1743-48b4-8183-36eceeb8a78e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:21.334070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c38427fb-1743-48b4-8183-36eceeb8a78e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:21.334070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c38427fb-1743-48b4-8183-36eceeb8a78e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:21.383639 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c38427fb-1743-48b4-8183-36eceeb8a78e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa/action" status: 200 len: 24573 microversion: 2.1 time: 0.072564 Oct 04 22:27:21.384316 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3852/7724] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:27:21 2022] POST /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa/action => generated 24573 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:27:27.770704 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-71e794ad-3fcd-43ec-ab6f-34bcd2bc60f3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:27.771291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-71e794ad-3fcd-43ec-ab6f-34bcd2bc60f3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:27.773371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:27.774201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=38 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:27.779647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71e794ad-3fcd-43ec-ab6f-34bcd2bc60f3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:27.780148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71e794ad-3fcd-43ec-ab6f-34bcd2bc60f3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:27.780600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71e794ad-3fcd-43ec-ab6f-34bcd2bc60f3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:27.781331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71e794ad-3fcd-43ec-ab6f-34bcd2bc60f3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:27.781851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71e794ad-3fcd-43ec-ab6f-34bcd2bc60f3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:27.792659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-71e794ad-3fcd-43ec-ab6f-34bcd2bc60f3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:28.015846 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-71e794ad-3fcd-43ec-ab6f-34bcd2bc60f3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa/action" status: 202 len: 0 microversion: 2.1 time: 0.249109 Oct 04 22:27:28.016562 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3873/7725] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:27:27 2022] POST /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:27:28.025544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0dbabe0c-7f35-47a4-a3af-cb78301cf6fd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:28.026257 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0dbabe0c-7f35-47a4-a3af-cb78301cf6fd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:28.035233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dbabe0c-7f35-47a4-a3af-cb78301cf6fd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:28.036890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dbabe0c-7f35-47a4-a3af-cb78301cf6fd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:28.036890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dbabe0c-7f35-47a4-a3af-cb78301cf6fd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:28.036890 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dbabe0c-7f35-47a4-a3af-cb78301cf6fd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:28.037314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dbabe0c-7f35-47a4-a3af-cb78301cf6fd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:28.037761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0dbabe0c-7f35-47a4-a3af-cb78301cf6fd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:28.179321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0dbabe0c-7f35-47a4-a3af-cb78301cf6fd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:28.187815 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0dbabe0c-7f35-47a4-a3af-cb78301cf6fd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1684 microversion: 2.1 time: 0.166909 Oct 04 22:27:28.188392 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3853/7726] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:28 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:29.213727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dc8cf079-cff0-445f-9848-b7e94c67b1a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:29.214447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dc8cf079-cff0-445f-9848-b7e94c67b1a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:29.221356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc8cf079-cff0-445f-9848-b7e94c67b1a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:29.221895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc8cf079-cff0-445f-9848-b7e94c67b1a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:29.222354 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc8cf079-cff0-445f-9848-b7e94c67b1a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:29.223056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc8cf079-cff0-445f-9848-b7e94c67b1a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:29.223612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc8cf079-cff0-445f-9848-b7e94c67b1a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:29.224084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dc8cf079-cff0-445f-9848-b7e94c67b1a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:29.359469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dc8cf079-cff0-445f-9848-b7e94c67b1a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:29.367253 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dc8cf079-cff0-445f-9848-b7e94c67b1a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1664 microversion: 2.1 time: 0.158890 Oct 04 22:27:29.367827 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3874/7727] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:29 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:30.462493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4e997e78-28a3-4584-8b14-5dda4aec37e7 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:30.464616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4e997e78-28a3-4584-8b14-5dda4aec37e7 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:30.472652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e997e78-28a3-4584-8b14-5dda4aec37e7 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:30.473145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e997e78-28a3-4584-8b14-5dda4aec37e7 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:30.473626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e997e78-28a3-4584-8b14-5dda4aec37e7 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:30.474331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e997e78-28a3-4584-8b14-5dda4aec37e7 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:30.474792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e997e78-28a3-4584-8b14-5dda4aec37e7 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:30.475221 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e997e78-28a3-4584-8b14-5dda4aec37e7 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:30.525198 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4e997e78-28a3-4584-8b14-5dda4aec37e7 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa/action" status: 200 len: 32647 microversion: 2.1 time: 0.066667 Oct 04 22:27:30.525873 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3854/7728] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:27:30 2022] POST /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa/action => generated 32647 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:27:30.537627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a1db2da3-3448-4c54-b44f-b67af39552cc tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:30.538168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a1db2da3-3448-4c54-b44f-b67af39552cc tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:30.545788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1db2da3-3448-4c54-b44f-b67af39552cc tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:30.546294 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1db2da3-3448-4c54-b44f-b67af39552cc tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:30.546747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1db2da3-3448-4c54-b44f-b67af39552cc tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:30.547459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1db2da3-3448-4c54-b44f-b67af39552cc tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:30.547926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1db2da3-3448-4c54-b44f-b67af39552cc tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:30.548366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a1db2da3-3448-4c54-b44f-b67af39552cc tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:30.724333 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a1db2da3-3448-4c54-b44f-b67af39552cc tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa/action" status: 202 len: 0 microversion: 2.1 time: 0.190354 Oct 04 22:27:30.724987 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3875/7729] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:27:30 2022] POST /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:27:30.734754 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-55932840-8cad-408e-b9ce-3c097f58ec2b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:30.735480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-55932840-8cad-408e-b9ce-3c097f58ec2b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:30.742659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55932840-8cad-408e-b9ce-3c097f58ec2b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:30.744240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55932840-8cad-408e-b9ce-3c097f58ec2b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:30.744240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55932840-8cad-408e-b9ce-3c097f58ec2b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:30.744546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55932840-8cad-408e-b9ce-3c097f58ec2b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:30.744759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55932840-8cad-408e-b9ce-3c097f58ec2b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:30.745195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-55932840-8cad-408e-b9ce-3c097f58ec2b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:30.885678 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-55932840-8cad-408e-b9ce-3c097f58ec2b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:30.893719 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-55932840-8cad-408e-b9ce-3c097f58ec2b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1671 microversion: 2.1 time: 0.164367 Oct 04 22:27:30.894303 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3855/7730] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:30 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:31.919562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-09d239e0-ea0d-4633-9b42-84f4c5ad1dad tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:31.920288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-09d239e0-ea0d-4633-9b42-84f4c5ad1dad tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:31.926578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09d239e0-ea0d-4633-9b42-84f4c5ad1dad tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:31.931700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09d239e0-ea0d-4633-9b42-84f4c5ad1dad tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:31.931700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09d239e0-ea0d-4633-9b42-84f4c5ad1dad tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:31.931700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09d239e0-ea0d-4633-9b42-84f4c5ad1dad tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:31.931700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09d239e0-ea0d-4633-9b42-84f4c5ad1dad tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:31.931700 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-09d239e0-ea0d-4633-9b42-84f4c5ad1dad tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:32.061698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-09d239e0-ea0d-4633-9b42-84f4c5ad1dad tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:32.069515 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-09d239e0-ea0d-4633-9b42-84f4c5ad1dad tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1679 microversion: 2.1 time: 0.155632 Oct 04 22:27:32.070092 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3876/7731] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:31 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:32.167724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a03f97dd-f4ee-4fa3-b6ea-97ef176f016c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:32.171001 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a03f97dd-f4ee-4fa3-b6ea-97ef176f016c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:32.178711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a03f97dd-f4ee-4fa3-b6ea-97ef176f016c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:32.179210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a03f97dd-f4ee-4fa3-b6ea-97ef176f016c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:32.179658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a03f97dd-f4ee-4fa3-b6ea-97ef176f016c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:32.180362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a03f97dd-f4ee-4fa3-b6ea-97ef176f016c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:32.180838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a03f97dd-f4ee-4fa3-b6ea-97ef176f016c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:32.181276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a03f97dd-f4ee-4fa3-b6ea-97ef176f016c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:32.232384 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a03f97dd-f4ee-4fa3-b6ea-97ef176f016c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa/action" status: 200 len: 36870 microversion: 2.1 time: 0.068507 Oct 04 22:27:32.233054 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3856/7732] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:27:32 2022] POST /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa/action => generated 36870 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:27:33.356687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-83b0085a-f649-4366-ae97-1f611605c86e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:33.357234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-83b0085a-f649-4366-ae97-1f611605c86e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:33.365083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83b0085a-f649-4366-ae97-1f611605c86e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:33.365270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83b0085a-f649-4366-ae97-1f611605c86e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:33.365726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83b0085a-f649-4366-ae97-1f611605c86e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:33.366270 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-b7c44616-06a1-4bdd-82eb-131e405654c0 req-54feef24-76f7-47f7-9704-375058974277 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c1140f-21aa-4306-9e07-06ac39edc8fa", "tag": "43684891-8b3f-4793-ad98-8cc634e19afa"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:33.366772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83b0085a-f649-4366-ae97-1f611605c86e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:33.367375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83b0085a-f649-4366-ae97-1f611605c86e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:33.367920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-83b0085a-f649-4366-ae97-1f611605c86e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:33.378042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b7c44616-06a1-4bdd-82eb-131e405654c0 req-54feef24-76f7-47f7-9704-375058974277 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:33.378532 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b7c44616-06a1-4bdd-82eb-131e405654c0 req-54feef24-76f7-47f7-9704-375058974277 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:33.378976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b7c44616-06a1-4bdd-82eb-131e405654c0 req-54feef24-76f7-47f7-9704-375058974277 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:33.391074 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-b7c44616-06a1-4bdd-82eb-131e405654c0 req-54feef24-76f7-47f7-9704-375058974277 service nova] Creating event network-changed:43684891-8b3f-4793-ad98-8cc634e19afa for instance 38c1140f-21aa-4306-9e07-06ac39edc8fa on n-h1-860282-1 Oct 04 22:27:33.396115 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-b7c44616-06a1-4bdd-82eb-131e405654c0 req-54feef24-76f7-47f7-9704-375058974277 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033801 Oct 04 22:27:33.397056 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3857/7733] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:27:33.400951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-83b0085a-f649-4366-ae97-1f611605c86e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:27:33.675241 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-83b0085a-f649-4366-ae97-1f611605c86e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "DELETE /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 204 len: 0 microversion: 2.1 time: 0.322756 Oct 04 22:27:33.676181 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3877/7734] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:27:33 2022] DELETE /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:27:33.685984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8dae0934-618a-4b4e-8a76-525315f5e46c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:33.686697 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8dae0934-618a-4b4e-8a76-525315f5e46c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:33.694691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dae0934-618a-4b4e-8a76-525315f5e46c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:33.695189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dae0934-618a-4b4e-8a76-525315f5e46c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:33.695928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dae0934-618a-4b4e-8a76-525315f5e46c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:33.696830 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dae0934-618a-4b4e-8a76-525315f5e46c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:33.697477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dae0934-618a-4b4e-8a76-525315f5e46c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:33.698133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8dae0934-618a-4b4e-8a76-525315f5e46c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:33.836208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8dae0934-618a-4b4e-8a76-525315f5e46c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:33.844111 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8dae0934-618a-4b4e-8a76-525315f5e46c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1685 microversion: 2.1 time: 0.163626 Oct 04 22:27:33.844703 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3858/7735] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:33 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:34.868308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9f0e6021-5b5c-498f-bc74-53d198f54fa5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:34.869050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9f0e6021-5b5c-498f-bc74-53d198f54fa5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:34.875790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f0e6021-5b5c-498f-bc74-53d198f54fa5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:34.876302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f0e6021-5b5c-498f-bc74-53d198f54fa5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:34.876757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f0e6021-5b5c-498f-bc74-53d198f54fa5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:34.877629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f0e6021-5b5c-498f-bc74-53d198f54fa5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:34.878107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f0e6021-5b5c-498f-bc74-53d198f54fa5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:34.878581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9f0e6021-5b5c-498f-bc74-53d198f54fa5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:35.029684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9f0e6021-5b5c-498f-bc74-53d198f54fa5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:35.037945 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9f0e6021-5b5c-498f-bc74-53d198f54fa5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1685 microversion: 2.1 time: 0.173883 Oct 04 22:27:35.038561 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3878/7736] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:34 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:35.751470 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-844bcae5-4c8a-4907-b745-274f0850159a req-6904267e-9521-45fe-823a-86d39e4e49d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c1140f-21aa-4306-9e07-06ac39edc8fa", "name": "network-vif-deleted", "tag": "43684891-8b3f-4793-ad98-8cc634e19afa"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:35.762654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-844bcae5-4c8a-4907-b745-274f0850159a req-6904267e-9521-45fe-823a-86d39e4e49d7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:35.763202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-844bcae5-4c8a-4907-b745-274f0850159a req-6904267e-9521-45fe-823a-86d39e4e49d7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:35.763639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-844bcae5-4c8a-4907-b745-274f0850159a req-6904267e-9521-45fe-823a-86d39e4e49d7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:35.774820 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-844bcae5-4c8a-4907-b745-274f0850159a req-6904267e-9521-45fe-823a-86d39e4e49d7 service nova] Creating event network-vif-deleted:43684891-8b3f-4793-ad98-8cc634e19afa for instance 38c1140f-21aa-4306-9e07-06ac39edc8fa on n-h1-860282-1 Oct 04 22:27:35.780446 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-844bcae5-4c8a-4907-b745-274f0850159a req-6904267e-9521-45fe-823a-86d39e4e49d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032706 Oct 04 22:27:35.781040 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3859/7737] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:27:36.064680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-adab33ef-88f8-45ed-92e0-851fd950fb84 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:36.065320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-adab33ef-88f8-45ed-92e0-851fd950fb84 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:36.073563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-adab33ef-88f8-45ed-92e0-851fd950fb84 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:36.073766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-adab33ef-88f8-45ed-92e0-851fd950fb84 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:36.074257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-adab33ef-88f8-45ed-92e0-851fd950fb84 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:36.075500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-adab33ef-88f8-45ed-92e0-851fd950fb84 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:36.075967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-adab33ef-88f8-45ed-92e0-851fd950fb84 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:36.076410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-adab33ef-88f8-45ed-92e0-851fd950fb84 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:36.151687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-adab33ef-88f8-45ed-92e0-851fd950fb84 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:36.160607 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-adab33ef-88f8-45ed-92e0-851fd950fb84 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 200 len: 1351 microversion: 2.1 time: 0.099838 Oct 04 22:27:36.174106 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3879/7738] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:36 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 1351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:37.186558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1adfd759-0a67-453a-879e-97f4dddba01a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:37.187262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1adfd759-0a67-453a-879e-97f4dddba01a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 38c1140f-21aa-4306-9e07-06ac39edc8fa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:37.193484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1adfd759-0a67-453a-879e-97f4dddba01a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:37.193969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1adfd759-0a67-453a-879e-97f4dddba01a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:37.194412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1adfd759-0a67-453a-879e-97f4dddba01a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:37.195096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1adfd759-0a67-453a-879e-97f4dddba01a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:37.195551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1adfd759-0a67-453a-879e-97f4dddba01a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:37.195980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1adfd759-0a67-453a-879e-97f4dddba01a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:37.209702 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-1adfd759-0a67-453a-879e-97f4dddba01a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] HTTP exception thrown: Instance 38c1140f-21aa-4306-9e07-06ac39edc8fa could not be found. Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1adfd759-0a67-453a-879e-97f4dddba01a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Request method failure captured: Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa HTTP/1.1 Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPLMZuTLnApqSMxiBV15PI5S_RjEXV0e6DgU6tkVSj3Qbs_Cnvc6Wu6b-YKVM5qs41najaSVYiQoC8_V32Y3kjBm4UYmmPnCk923S11FSQGy-h7LMSKU4E0ZEbT2AhOP4CO6e2ZA15WGFizXGUgRcI6so0AfyEB2d3Mi5xsLsph4NZQo Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: ef5ef0af634f40c598c43019f28afb5b Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-377632635 Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef5ef0af634f40c598c43019f28afb5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ef5ef0af634f40c598c43019f28afb5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ef5ef0af634f40c598c43019f28afb5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef5ef0af634f40c598c43019f28afb5b"}]}] Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestNetworkAdvancedServerOps-377632635 Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: ef5ef0af634f40c598c43019f28afb5b Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-377632635 Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestNetworkAdvancedServerOps-377632635-project Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3ead2dace0aa45419aa7f8a2cd8d2104 Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestNetworkAdvancedServerOps-377632635-project Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 38c1140f-21aa-4306-9e07-06ac39edc8fa could not be found. Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '38c1140f-21aa-4306-9e07-06ac39edc8fa'} Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c1140f-21aa-4306-9e07-06ac39edc8fa could not be found. Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c1140f-21aa-4306-9e07-06ac39edc8fa could not be found. Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:27:37.211331 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:27:37.217118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:27:37.217118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:27:37.217118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:27:37.217118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:27:37.217118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:27:37.217118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:27:37.217118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c1140f-21aa-4306-9e07-06ac39edc8fa could not be found. Oct 04 22:27:37.217118 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:27:37.217118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1adfd759-0a67-453a-879e-97f4dddba01a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Returning 404 to user: Instance 38c1140f-21aa-4306-9e07-06ac39edc8fa could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:27:37.217118 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1adfd759-0a67-453a-879e-97f4dddba01a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa" status: 404 len: 111 microversion: 2.1 time: 0.031347 Oct 04 22:27:37.217118 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3860/7739] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:37 2022] GET /compute/v2.1/servers/38c1140f-21aa-4306-9e07-06ac39edc8fa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:27:41.115653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d3d7e700-7bf4-4029-9aa8-980928756f38 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '.version_select at 0x7f5788630280>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:41.206826 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d3d7e700-7bf4-4029-9aa8-980928756f38 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-210952738" status: 202 len: 0 microversion: 2.1 time: 0.097624 Oct 04 22:27:41.207331 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3880/7740] 10.222.0.30 () {58 vars in 1281 bytes} [Tue Oct 4 22:27:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-210952738 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:27:41.234420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-43b43715-1ab1-46f6-8fcf-20ca31a0f119 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'create', calling method: .version_select at 0x7f578ac6f5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-388307784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWNtKA2l4YFriVOq+hsl/mNkzUSCXaYoQj8CUZlHEE6AUEhVoVZRhl3Ja5TH79fJBGAaWXCgvvIPa9ZgW+UFCoelqClBh+kHQ/KazaqDem4syqKdRya5XFIg/Ctvk2/og=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:41.252495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-43b43715-1ab1-46f6-8fcf-20ca31a0f119 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for project ef5ef0af634f40c598c43019f28afb5b. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:27:41.257834 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-43b43715-1ab1-46f6-8fcf-20ca31a0f119 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for user 3ead2dace0aa45419aa7f8a2cd8d2104 and project ef5ef0af634f40c598c43019f28afb5b. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:27:41.367334 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-43b43715-1ab1-46f6-8fcf-20ca31a0f119 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.136881 Oct 04 22:27:41.367977 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3861/7741] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 22:27:41 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:27:49.490727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:49.491979 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:27:49.492114 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 22:27:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Oct 04 22:27:49.498269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ae4a5e0b-fd0a-4f00-8a14-6fabef824b73 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-846286357", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "e01d119e-37e1-41c3-8b31-2b51ddc48ba8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-388307784", "security_groups": [{"name": "tempest-secgroup-smoke-1009538966"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:49.657749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-ae4a5e0b-fd0a-4f00-8a14-6fabef824b73 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] validate_networks() for [('e01d119e-37e1-41c3-8b31-2b51ddc48ba8', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:27:50.055744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ae4a5e0b-fd0a-4f00-8a14-6fabef824b73 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:27:50.056190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ae4a5e0b-fd0a-4f00-8a14-6fabef824b73 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:27:50.056683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ae4a5e0b-fd0a-4f00-8a14-6fabef824b73 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:27:50.057112 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ae4a5e0b-fd0a-4f00-8a14-6fabef824b73 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:27:50.057599 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-ae4a5e0b-fd0a-4f00-8a14-6fabef824b73 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:27:50.067430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae4a5e0b-fd0a-4f00-8a14-6fabef824b73 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:50.067932 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae4a5e0b-fd0a-4f00-8a14-6fabef824b73 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:50.068381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae4a5e0b-fd0a-4f00-8a14-6fabef824b73 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:50.069129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae4a5e0b-fd0a-4f00-8a14-6fabef824b73 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:50.069631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae4a5e0b-fd0a-4f00-8a14-6fabef824b73 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:50.070071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae4a5e0b-fd0a-4f00-8a14-6fabef824b73 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:50.089019 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-ae4a5e0b-fd0a-4f00-8a14-6fabef824b73 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for project ef5ef0af634f40c598c43019f28afb5b. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:27:50.094282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-ae4a5e0b-fd0a-4f00-8a14-6fabef824b73 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for user 3ead2dace0aa45419aa7f8a2cd8d2104 and project ef5ef0af634f40c598c43019f28afb5b. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:27:50.107633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ae4a5e0b-fd0a-4f00-8a14-6fabef824b73 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:27:50.110003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ae4a5e0b-fd0a-4f00-8a14-6fabef824b73 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:27:50.232157 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ae4a5e0b-fd0a-4f00-8a14-6fabef824b73 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.743242 Oct 04 22:27:50.233039 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3881/7742] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:27:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:27:50.242291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=36 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:50.248412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-facbc362-791c-4249-b460-bdac1cc066df tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:50.249094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-facbc362-791c-4249-b460-bdac1cc066df tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:50.319710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-facbc362-791c-4249-b460-bdac1cc066df tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:50.329099 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-facbc362-791c-4249-b460-bdac1cc066df tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1265 microversion: 2.1 time: 0.088453 Oct 04 22:27:50.341690 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3862/7743] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:50 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:51.353193 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f26157a6-7090-4f1c-8f54-423fb6419193 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:51.353865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f26157a6-7090-4f1c-8f54-423fb6419193 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:51.432569 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f26157a6-7090-4f1c-8f54-423fb6419193 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:51.441060 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f26157a6-7090-4f1c-8f54-423fb6419193 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1265 microversion: 2.1 time: 0.092653 Oct 04 22:27:51.445516 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3882/7744] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:51 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:52.473947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a516c100-37e1-4a02-a143-97a232de7021 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:52.474609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a516c100-37e1-4a02-a143-97a232de7021 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:52.482187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a516c100-37e1-4a02-a143-97a232de7021 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:52.482686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a516c100-37e1-4a02-a143-97a232de7021 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:52.483128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a516c100-37e1-4a02-a143-97a232de7021 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:52.483874 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a516c100-37e1-4a02-a143-97a232de7021 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:52.484331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a516c100-37e1-4a02-a143-97a232de7021 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:52.484758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a516c100-37e1-4a02-a143-97a232de7021 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:52.547484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a516c100-37e1-4a02-a143-97a232de7021 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:52.555831 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a516c100-37e1-4a02-a143-97a232de7021 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1269 microversion: 2.1 time: 0.086100 Oct 04 22:27:52.556408 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3863/7745] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:52 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1269 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:53.580044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-45a7ac89-6d23-4506-83cf-745ef3261d72 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:53.580675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-45a7ac89-6d23-4506-83cf-745ef3261d72 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:53.588124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45a7ac89-6d23-4506-83cf-745ef3261d72 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:53.588639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45a7ac89-6d23-4506-83cf-745ef3261d72 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:53.589092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45a7ac89-6d23-4506-83cf-745ef3261d72 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:53.590731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45a7ac89-6d23-4506-83cf-745ef3261d72 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:53.591236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45a7ac89-6d23-4506-83cf-745ef3261d72 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:53.591685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-45a7ac89-6d23-4506-83cf-745ef3261d72 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:53.655938 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-45a7ac89-6d23-4506-83cf-745ef3261d72 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:53.663913 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-45a7ac89-6d23-4506-83cf-745ef3261d72 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1323 microversion: 2.1 time: 0.087857 Oct 04 22:27:53.664796 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3883/7746] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:53 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1323 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:27:54.688651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6918a960-6036-4dce-be21-fa13ea56000c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:54.689307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6918a960-6036-4dce-be21-fa13ea56000c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:54.696387 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6918a960-6036-4dce-be21-fa13ea56000c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:54.696880 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6918a960-6036-4dce-be21-fa13ea56000c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:54.697325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6918a960-6036-4dce-be21-fa13ea56000c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:54.698065 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6918a960-6036-4dce-be21-fa13ea56000c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:54.698548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6918a960-6036-4dce-be21-fa13ea56000c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:54.698997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6918a960-6036-4dce-be21-fa13ea56000c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:54.851442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6918a960-6036-4dce-be21-fa13ea56000c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:54.860710 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6918a960-6036-4dce-be21-fa13ea56000c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1391 microversion: 2.1 time: 0.176319 Oct 04 22:27:54.862166 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3864/7747] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:54 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:27:55.012678 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-a432d8ca-375e-43b5-b6d5-163be5899593 req-2ace322a-3ef0-4adb-ad3b-20e9cd5ab450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3698a99d-4d79-44b7-91d0-6c998b6b8236", "tag": "437c09f9-c047-4673-b546-d900b80c67b9"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:55.023965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a432d8ca-375e-43b5-b6d5-163be5899593 req-2ace322a-3ef0-4adb-ad3b-20e9cd5ab450 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:55.024509 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a432d8ca-375e-43b5-b6d5-163be5899593 req-2ace322a-3ef0-4adb-ad3b-20e9cd5ab450 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:55.024968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a432d8ca-375e-43b5-b6d5-163be5899593 req-2ace322a-3ef0-4adb-ad3b-20e9cd5ab450 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:55.038051 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-a432d8ca-375e-43b5-b6d5-163be5899593 req-2ace322a-3ef0-4adb-ad3b-20e9cd5ab450 service nova] Creating event network-changed:437c09f9-c047-4673-b546-d900b80c67b9 for instance 3698a99d-4d79-44b7-91d0-6c998b6b8236 on n-h1-860282-1 Oct 04 22:27:55.043797 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-a432d8ca-375e-43b5-b6d5-163be5899593 req-2ace322a-3ef0-4adb-ad3b-20e9cd5ab450 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034333 Oct 04 22:27:55.044434 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3884/7748] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:27:55.886955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-82eb3784-5e71-459b-b353-78579565d229 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:55.887729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-82eb3784-5e71-459b-b353-78579565d229 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:55.894645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82eb3784-5e71-459b-b353-78579565d229 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:55.896510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82eb3784-5e71-459b-b353-78579565d229 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:55.896510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82eb3784-5e71-459b-b353-78579565d229 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:55.896510 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82eb3784-5e71-459b-b353-78579565d229 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:55.896962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82eb3784-5e71-459b-b353-78579565d229 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:55.897169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-82eb3784-5e71-459b-b353-78579565d229 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:56.030724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-82eb3784-5e71-459b-b353-78579565d229 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:56.038442 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-82eb3784-5e71-459b-b353-78579565d229 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1391 microversion: 2.1 time: 0.155601 Oct 04 22:27:56.039015 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3865/7749] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:55 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:57.063129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4ad01cc8-ccc9-4145-aafc-8b980b63c07a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:57.063861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4ad01cc8-ccc9-4145-aafc-8b980b63c07a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:57.070987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ad01cc8-ccc9-4145-aafc-8b980b63c07a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:57.071501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ad01cc8-ccc9-4145-aafc-8b980b63c07a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:57.071968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ad01cc8-ccc9-4145-aafc-8b980b63c07a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:57.072684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ad01cc8-ccc9-4145-aafc-8b980b63c07a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:57.073165 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ad01cc8-ccc9-4145-aafc-8b980b63c07a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:57.073660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4ad01cc8-ccc9-4145-aafc-8b980b63c07a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:57.207708 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4ad01cc8-ccc9-4145-aafc-8b980b63c07a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:57.215725 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4ad01cc8-ccc9-4145-aafc-8b980b63c07a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1391 microversion: 2.1 time: 0.157520 Oct 04 22:27:57.216301 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3885/7750] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:57 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:58.238050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d52b42d8-3dea-4f02-8b75-b4abaf8c8cfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:58.238608 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d52b42d8-3dea-4f02-8b75-b4abaf8c8cfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:58.241254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:58.246153 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d52b42d8-3dea-4f02-8b75-b4abaf8c8cfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:58.246651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d52b42d8-3dea-4f02-8b75-b4abaf8c8cfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:58.247101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d52b42d8-3dea-4f02-8b75-b4abaf8c8cfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:58.247804 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d52b42d8-3dea-4f02-8b75-b4abaf8c8cfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:58.248272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d52b42d8-3dea-4f02-8b75-b4abaf8c8cfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:58.248709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d52b42d8-3dea-4f02-8b75-b4abaf8c8cfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:58.385273 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d52b42d8-3dea-4f02-8b75-b4abaf8c8cfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:58.393770 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d52b42d8-3dea-4f02-8b75-b4abaf8c8cfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1391 microversion: 2.1 time: 0.159884 Oct 04 22:27:58.394351 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3866/7751] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:58 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:59.419095 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-fc5f2131-889c-4b6f-8ed0-968b10a13425 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:59.419772 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-fc5f2131-889c-4b6f-8ed0-968b10a13425 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:59.422679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:59.427526 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc5f2131-889c-4b6f-8ed0-968b10a13425 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:59.428031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc5f2131-889c-4b6f-8ed0-968b10a13425 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:59.428544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc5f2131-889c-4b6f-8ed0-968b10a13425 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:59.429264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc5f2131-889c-4b6f-8ed0-968b10a13425 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:59.429862 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc5f2131-889c-4b6f-8ed0-968b10a13425 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:59.437879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-fc5f2131-889c-4b6f-8ed0-968b10a13425 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:59.564573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-fc5f2131-889c-4b6f-8ed0-968b10a13425 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:59.572804 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-fc5f2131-889c-4b6f-8ed0-968b10a13425 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1391 microversion: 2.1 time: 0.158453 Oct 04 22:27:59.573375 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3886/7752] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:59 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:00.596746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-25b25abe-0967-4683-8408-786fab59539e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:00.597525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-25b25abe-0967-4683-8408-786fab59539e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:00.600314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:28:00.605229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25b25abe-0967-4683-8408-786fab59539e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:00.605767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25b25abe-0967-4683-8408-786fab59539e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:00.606206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25b25abe-0967-4683-8408-786fab59539e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:00.606911 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25b25abe-0967-4683-8408-786fab59539e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:00.607369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25b25abe-0967-4683-8408-786fab59539e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:00.607853 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-25b25abe-0967-4683-8408-786fab59539e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:00.615061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-a5f7d0b1-a0c8-4c7d-92af-3396c8654426 req-cf268713-3d1d-47cb-a232-80fff7669ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3698a99d-4d79-44b7-91d0-6c998b6b8236", "name": "network-vif-plugged", "status": "completed", "tag": "437c09f9-c047-4673-b546-d900b80c67b9"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:28:00.620861 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:28:00.627267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a5f7d0b1-a0c8-4c7d-92af-3396c8654426 req-cf268713-3d1d-47cb-a232-80fff7669ef7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:00.627766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a5f7d0b1-a0c8-4c7d-92af-3396c8654426 req-cf268713-3d1d-47cb-a232-80fff7669ef7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:00.628213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a5f7d0b1-a0c8-4c7d-92af-3396c8654426 req-cf268713-3d1d-47cb-a232-80fff7669ef7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:00.640443 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-a5f7d0b1-a0c8-4c7d-92af-3396c8654426 req-cf268713-3d1d-47cb-a232-80fff7669ef7 service nova] Creating event network-vif-plugged:437c09f9-c047-4673-b546-d900b80c67b9 for instance 3698a99d-4d79-44b7-91d0-6c998b6b8236 on n-h1-860282-1 Oct 04 22:28:00.645602 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-a5f7d0b1-a0c8-4c7d-92af-3396c8654426 req-cf268713-3d1d-47cb-a232-80fff7669ef7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034240 Oct 04 22:28:00.646300 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3887/7753] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:28:00.756773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-25b25abe-0967-4683-8408-786fab59539e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:00.766385 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-25b25abe-0967-4683-8408-786fab59539e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1391 microversion: 2.1 time: 0.173466 Oct 04 22:28:00.766987 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3867/7754] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:00 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:01.786415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:28:01.791482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c7d92bde-7d5e-4e0a-a675-0ab9eb2f0653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:01.795327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c7d92bde-7d5e-4e0a-a675-0ab9eb2f0653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:01.799464 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7d92bde-7d5e-4e0a-a675-0ab9eb2f0653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:01.799981 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7d92bde-7d5e-4e0a-a675-0ab9eb2f0653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:01.800423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7d92bde-7d5e-4e0a-a675-0ab9eb2f0653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:01.801135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7d92bde-7d5e-4e0a-a675-0ab9eb2f0653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:01.801634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7d92bde-7d5e-4e0a-a675-0ab9eb2f0653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:01.802081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c7d92bde-7d5e-4e0a-a675-0ab9eb2f0653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:01.938020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c7d92bde-7d5e-4e0a-a675-0ab9eb2f0653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:01.946124 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c7d92bde-7d5e-4e0a-a675-0ab9eb2f0653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1391 microversion: 2.1 time: 0.160772 Oct 04 22:28:01.946740 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3888/7755] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:01 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:02.969833 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c4d4861a-8742-4f01-b952-adf4f4f300e3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:02.970459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c4d4861a-8742-4f01-b952-adf4f4f300e3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:02.977295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4d4861a-8742-4f01-b952-adf4f4f300e3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:02.977818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4d4861a-8742-4f01-b952-adf4f4f300e3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:02.978396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4d4861a-8742-4f01-b952-adf4f4f300e3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:02.979094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4d4861a-8742-4f01-b952-adf4f4f300e3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:02.979557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4d4861a-8742-4f01-b952-adf4f4f300e3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:02.980017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c4d4861a-8742-4f01-b952-adf4f4f300e3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:03.111012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c4d4861a-8742-4f01-b952-adf4f4f300e3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:03.118742 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c4d4861a-8742-4f01-b952-adf4f4f300e3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1564 microversion: 2.1 time: 0.152932 Oct 04 22:28:03.119266 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3868/7756] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:02 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:03.141815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c550944a-ef60-43c7-81ef-1e35f2c48938 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:03.142455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c550944a-ef60-43c7-81ef-1e35f2c48938 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:03.149197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c550944a-ef60-43c7-81ef-1e35f2c48938 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:03.149762 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c550944a-ef60-43c7-81ef-1e35f2c48938 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:03.150225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c550944a-ef60-43c7-81ef-1e35f2c48938 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:03.150944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c550944a-ef60-43c7-81ef-1e35f2c48938 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:03.151423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c550944a-ef60-43c7-81ef-1e35f2c48938 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:03.152410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c550944a-ef60-43c7-81ef-1e35f2c48938 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:03.284756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c550944a-ef60-43c7-81ef-1e35f2c48938 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:03.293400 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c550944a-ef60-43c7-81ef-1e35f2c48938 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1564 microversion: 2.1 time: 0.154685 Oct 04 22:28:03.294059 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3889/7757] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:03 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:05.452062 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e3bc0686-6485-4d85-8023-589c08666886 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:05.452760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e3bc0686-6485-4d85-8023-589c08666886 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:05.455056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-9e70b191-4747-45bf-b45f-f21191f4b389 req-f60d1257-11ee-4f18-ad10-0ed6fb719bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3698a99d-4d79-44b7-91d0-6c998b6b8236", "tag": "437c09f9-c047-4673-b546-d900b80c67b9"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:28:05.459953 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3bc0686-6485-4d85-8023-589c08666886 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:05.460452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3bc0686-6485-4d85-8023-589c08666886 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:05.461088 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3bc0686-6485-4d85-8023-589c08666886 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:05.461822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3bc0686-6485-4d85-8023-589c08666886 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:05.462450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3bc0686-6485-4d85-8023-589c08666886 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:05.462948 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e3bc0686-6485-4d85-8023-589c08666886 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:05.466639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9e70b191-4747-45bf-b45f-f21191f4b389 req-f60d1257-11ee-4f18-ad10-0ed6fb719bf7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:05.467129 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9e70b191-4747-45bf-b45f-f21191f4b389 req-f60d1257-11ee-4f18-ad10-0ed6fb719bf7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:05.467580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9e70b191-4747-45bf-b45f-f21191f4b389 req-f60d1257-11ee-4f18-ad10-0ed6fb719bf7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:05.479114 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-9e70b191-4747-45bf-b45f-f21191f4b389 req-f60d1257-11ee-4f18-ad10-0ed6fb719bf7 service nova] Creating event network-changed:437c09f9-c047-4673-b546-d900b80c67b9 for instance 3698a99d-4d79-44b7-91d0-6c998b6b8236 on n-h1-860282-1 Oct 04 22:28:05.485104 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-9e70b191-4747-45bf-b45f-f21191f4b389 req-f60d1257-11ee-4f18-ad10-0ed6fb719bf7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034083 Oct 04 22:28:05.486099 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3890/7758] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:28:05.603119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e3bc0686-6485-4d85-8023-589c08666886 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:05.612000 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e3bc0686-6485-4d85-8023-589c08666886 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1564 microversion: 2.1 time: 0.164544 Oct 04 22:28:05.612731 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3869/7759] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:05 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:26.856393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=9 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:28:26.857184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=38 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:28:26.862091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-52b45209-5d2d-44f1-a28c-1aee03f8067d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:28:26.864363 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-52b45209-5d2d-44f1-a28c-1aee03f8067d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:26.870468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52b45209-5d2d-44f1-a28c-1aee03f8067d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:26.870973 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52b45209-5d2d-44f1-a28c-1aee03f8067d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:26.871428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52b45209-5d2d-44f1-a28c-1aee03f8067d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:26.872162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52b45209-5d2d-44f1-a28c-1aee03f8067d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:26.872637 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52b45209-5d2d-44f1-a28c-1aee03f8067d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:26.873113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-52b45209-5d2d-44f1-a28c-1aee03f8067d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:26.926601 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-52b45209-5d2d-44f1-a28c-1aee03f8067d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236/action" status: 200 len: 24564 microversion: 2.1 time: 0.072038 Oct 04 22:28:26.927261 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3891/7760] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:28:26 2022] POST /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236/action => generated 24564 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:28:33.317616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7d773a55-a6e8-48e3-9ab4-7ab8e6d384ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:28:33.320625 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7d773a55-a6e8-48e3-9ab4-7ab8e6d384ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:33.322797 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=7 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:28:33.323620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=42 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:28:33.328160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d773a55-a6e8-48e3-9ab4-7ab8e6d384ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:33.328649 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d773a55-a6e8-48e3-9ab4-7ab8e6d384ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:33.329119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d773a55-a6e8-48e3-9ab4-7ab8e6d384ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:33.329839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d773a55-a6e8-48e3-9ab4-7ab8e6d384ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:33.330298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d773a55-a6e8-48e3-9ab4-7ab8e6d384ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:33.330728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d773a55-a6e8-48e3-9ab4-7ab8e6d384ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:33.535432 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7d773a55-a6e8-48e3-9ab4-7ab8e6d384ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236/action" status: 202 len: 0 microversion: 2.1 time: 0.221746 Oct 04 22:28:33.539850 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3870/7761] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:28:33 2022] POST /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:28:33.545782 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e1245a4d-f562-43c6-8e1b-a8c75e5088f3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:33.546499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e1245a4d-f562-43c6-8e1b-a8c75e5088f3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:33.554935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1245a4d-f562-43c6-8e1b-a8c75e5088f3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:33.555454 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1245a4d-f562-43c6-8e1b-a8c75e5088f3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:33.555898 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1245a4d-f562-43c6-8e1b-a8c75e5088f3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:33.556610 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1245a4d-f562-43c6-8e1b-a8c75e5088f3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:33.557082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1245a4d-f562-43c6-8e1b-a8c75e5088f3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:33.557603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e1245a4d-f562-43c6-8e1b-a8c75e5088f3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:33.699706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e1245a4d-f562-43c6-8e1b-a8c75e5088f3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:33.708529 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e1245a4d-f562-43c6-8e1b-a8c75e5088f3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1675 microversion: 2.1 time: 0.166357 Oct 04 22:28:33.708529 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3892/7762] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:33 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:34.735123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7bf0ea15-12b1-427c-9de4-759566d2402d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:34.735864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7bf0ea15-12b1-427c-9de4-759566d2402d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:34.742126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bf0ea15-12b1-427c-9de4-759566d2402d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:34.742618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bf0ea15-12b1-427c-9de4-759566d2402d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:34.743156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bf0ea15-12b1-427c-9de4-759566d2402d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:34.743867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bf0ea15-12b1-427c-9de4-759566d2402d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:34.744327 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bf0ea15-12b1-427c-9de4-759566d2402d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:34.744761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7bf0ea15-12b1-427c-9de4-759566d2402d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:34.877865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7bf0ea15-12b1-427c-9de4-759566d2402d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:34.886070 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7bf0ea15-12b1-427c-9de4-759566d2402d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1680 microversion: 2.1 time: 0.156310 Oct 04 22:28:34.886651 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3871/7763] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:34 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:35.914340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2b6364e1-28b0-465c-a064-2c39735c4930 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:35.914980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2b6364e1-28b0-465c-a064-2c39735c4930 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:35.922617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b6364e1-28b0-465c-a064-2c39735c4930 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:35.923126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b6364e1-28b0-465c-a064-2c39735c4930 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:35.923587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b6364e1-28b0-465c-a064-2c39735c4930 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:35.924301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b6364e1-28b0-465c-a064-2c39735c4930 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:35.924777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b6364e1-28b0-465c-a064-2c39735c4930 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:35.925224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2b6364e1-28b0-465c-a064-2c39735c4930 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:36.057283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2b6364e1-28b0-465c-a064-2c39735c4930 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:36.065093 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2b6364e1-28b0-465c-a064-2c39735c4930 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1680 microversion: 2.1 time: 0.155335 Oct 04 22:28:36.065707 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3893/7764] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:35 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:37.087590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6d712b2f-25d3-40c4-aad3-76f8ee5e5223 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:37.088201 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6d712b2f-25d3-40c4-aad3-76f8ee5e5223 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:37.095054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d712b2f-25d3-40c4-aad3-76f8ee5e5223 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:37.095538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d712b2f-25d3-40c4-aad3-76f8ee5e5223 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:37.095980 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d712b2f-25d3-40c4-aad3-76f8ee5e5223 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:37.096671 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d712b2f-25d3-40c4-aad3-76f8ee5e5223 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:37.097126 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d712b2f-25d3-40c4-aad3-76f8ee5e5223 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:37.097581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d712b2f-25d3-40c4-aad3-76f8ee5e5223 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:37.232200 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6d712b2f-25d3-40c4-aad3-76f8ee5e5223 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:37.241109 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6d712b2f-25d3-40c4-aad3-76f8ee5e5223 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1680 microversion: 2.1 time: 0.157625 Oct 04 22:28:37.241813 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3872/7765] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:37 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:38.265279 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f813aa5c-8d65-4210-a67f-1653c74bc73d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:38.265945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f813aa5c-8d65-4210-a67f-1653c74bc73d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:38.273508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f813aa5c-8d65-4210-a67f-1653c74bc73d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:38.274012 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f813aa5c-8d65-4210-a67f-1653c74bc73d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:38.274471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f813aa5c-8d65-4210-a67f-1653c74bc73d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:38.275180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f813aa5c-8d65-4210-a67f-1653c74bc73d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:38.275656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f813aa5c-8d65-4210-a67f-1653c74bc73d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:38.276101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f813aa5c-8d65-4210-a67f-1653c74bc73d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:38.410831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f813aa5c-8d65-4210-a67f-1653c74bc73d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:38.419182 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f813aa5c-8d65-4210-a67f-1653c74bc73d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1680 microversion: 2.1 time: 0.157824 Oct 04 22:28:38.419770 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3894/7766] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:38 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:39.444177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-47f520c1-6a1a-451b-8ae6-0db4c211b73a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:39.444815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-47f520c1-6a1a-451b-8ae6-0db4c211b73a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:39.451710 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47f520c1-6a1a-451b-8ae6-0db4c211b73a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:39.452197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47f520c1-6a1a-451b-8ae6-0db4c211b73a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:39.452638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47f520c1-6a1a-451b-8ae6-0db4c211b73a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:39.453326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47f520c1-6a1a-451b-8ae6-0db4c211b73a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:39.453806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47f520c1-6a1a-451b-8ae6-0db4c211b73a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:39.454232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-47f520c1-6a1a-451b-8ae6-0db4c211b73a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:39.590740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-47f520c1-6a1a-451b-8ae6-0db4c211b73a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:39.598543 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-47f520c1-6a1a-451b-8ae6-0db4c211b73a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1680 microversion: 2.1 time: 0.158316 Oct 04 22:28:39.599190 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3873/7767] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:39 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:40.623439 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e074a81a-d63d-43e4-b979-35a4c8f3ec28 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:40.624072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e074a81a-d63d-43e4-b979-35a4c8f3ec28 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:40.631786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e074a81a-d63d-43e4-b979-35a4c8f3ec28 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:40.632287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e074a81a-d63d-43e4-b979-35a4c8f3ec28 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:40.632747 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e074a81a-d63d-43e4-b979-35a4c8f3ec28 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:40.633476 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e074a81a-d63d-43e4-b979-35a4c8f3ec28 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:40.633957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e074a81a-d63d-43e4-b979-35a4c8f3ec28 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:40.634403 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e074a81a-d63d-43e4-b979-35a4c8f3ec28 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:40.766777 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e074a81a-d63d-43e4-b979-35a4c8f3ec28 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:40.775417 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e074a81a-d63d-43e4-b979-35a4c8f3ec28 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1680 microversion: 2.1 time: 0.155813 Oct 04 22:28:40.776008 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3895/7768] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:40 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:41.799154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1fa4ef32-5e91-45a3-94d9-ddc686e8581c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:41.799708 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1fa4ef32-5e91-45a3-94d9-ddc686e8581c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:41.806751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1fa4ef32-5e91-45a3-94d9-ddc686e8581c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:41.807250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1fa4ef32-5e91-45a3-94d9-ddc686e8581c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:41.807690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1fa4ef32-5e91-45a3-94d9-ddc686e8581c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:41.808439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1fa4ef32-5e91-45a3-94d9-ddc686e8581c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:41.808887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1fa4ef32-5e91-45a3-94d9-ddc686e8581c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:41.809313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1fa4ef32-5e91-45a3-94d9-ddc686e8581c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:41.946142 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1fa4ef32-5e91-45a3-94d9-ddc686e8581c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:41.954055 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1fa4ef32-5e91-45a3-94d9-ddc686e8581c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1680 microversion: 2.1 time: 0.158961 Oct 04 22:28:41.954639 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3874/7769] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:41 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:42.979504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cc2b2e35-b893-4edd-a89f-aef4072ac134 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:42.980126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cc2b2e35-b893-4edd-a89f-aef4072ac134 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:42.987455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc2b2e35-b893-4edd-a89f-aef4072ac134 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:42.987966 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc2b2e35-b893-4edd-a89f-aef4072ac134 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:42.988420 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc2b2e35-b893-4edd-a89f-aef4072ac134 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:42.989123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc2b2e35-b893-4edd-a89f-aef4072ac134 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:42.989629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc2b2e35-b893-4edd-a89f-aef4072ac134 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:42.990075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc2b2e35-b893-4edd-a89f-aef4072ac134 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:43.120271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cc2b2e35-b893-4edd-a89f-aef4072ac134 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:43.128048 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cc2b2e35-b893-4edd-a89f-aef4072ac134 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1680 microversion: 2.1 time: 0.152824 Oct 04 22:28:43.128896 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3896/7770] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:42 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:44.151425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ef66b823-7d56-4e47-a170-405907d1b42e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:44.152053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ef66b823-7d56-4e47-a170-405907d1b42e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:44.158941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef66b823-7d56-4e47-a170-405907d1b42e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:44.159438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef66b823-7d56-4e47-a170-405907d1b42e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:44.159893 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef66b823-7d56-4e47-a170-405907d1b42e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:44.160600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef66b823-7d56-4e47-a170-405907d1b42e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:44.161063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef66b823-7d56-4e47-a170-405907d1b42e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:44.162173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ef66b823-7d56-4e47-a170-405907d1b42e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:44.292956 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ef66b823-7d56-4e47-a170-405907d1b42e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:44.301466 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ef66b823-7d56-4e47-a170-405907d1b42e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1680 microversion: 2.1 time: 0.153955 Oct 04 22:28:44.302010 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3875/7771] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:44 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:45.325409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-95a5a418-eaab-462f-aac4-97363778a601 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:45.326064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-95a5a418-eaab-462f-aac4-97363778a601 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:45.332908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95a5a418-eaab-462f-aac4-97363778a601 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:45.333414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95a5a418-eaab-462f-aac4-97363778a601 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:45.333899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95a5a418-eaab-462f-aac4-97363778a601 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:45.334878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95a5a418-eaab-462f-aac4-97363778a601 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:45.335357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95a5a418-eaab-462f-aac4-97363778a601 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:45.335806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-95a5a418-eaab-462f-aac4-97363778a601 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:45.468921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-95a5a418-eaab-462f-aac4-97363778a601 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:45.477518 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-95a5a418-eaab-462f-aac4-97363778a601 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1683 microversion: 2.1 time: 0.155966 Oct 04 22:28:45.478099 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3897/7772] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:45 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:09.666020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e08173c6-627e-4b9a-b6a3-5c1e758e15ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:09.668230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e08173c6-627e-4b9a-b6a3-5c1e758e15ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:09.670400 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=12 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:09.671102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:09.675793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e08173c6-627e-4b9a-b6a3-5c1e758e15ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:09.676312 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e08173c6-627e-4b9a-b6a3-5c1e758e15ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:09.676755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e08173c6-627e-4b9a-b6a3-5c1e758e15ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:09.677464 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e08173c6-627e-4b9a-b6a3-5c1e758e15ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:09.677929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e08173c6-627e-4b9a-b6a3-5c1e758e15ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:09.678520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e08173c6-627e-4b9a-b6a3-5c1e758e15ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:09.737314 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e08173c6-627e-4b9a-b6a3-5c1e758e15ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236/action" status: 200 len: 69105 microversion: 2.1 time: 0.075952 Oct 04 22:29:09.737941 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3876/7773] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:29:09 2022] POST /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236/action => generated 69105 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:29:17.143100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c6e29f39-115e-4752-8178-9c762993b0d5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:17.143652 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c6e29f39-115e-4752-8178-9c762993b0d5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:17.152852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-572d0d30-1b32-4a84-8e58-7f395ee542bd req-f45f24b1-6365-4dea-b933-f0cfcc03dedc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3698a99d-4d79-44b7-91d0-6c998b6b8236", "tag": "437c09f9-c047-4673-b546-d900b80c67b9"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:17.162182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=14 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:17.162952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=40 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:17.168466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6e29f39-115e-4752-8178-9c762993b0d5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:17.171698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6e29f39-115e-4752-8178-9c762993b0d5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:17.171698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6e29f39-115e-4752-8178-9c762993b0d5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:17.171698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6e29f39-115e-4752-8178-9c762993b0d5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:17.171698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6e29f39-115e-4752-8178-9c762993b0d5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:17.171698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c6e29f39-115e-4752-8178-9c762993b0d5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:17.175944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-572d0d30-1b32-4a84-8e58-7f395ee542bd req-f45f24b1-6365-4dea-b933-f0cfcc03dedc service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:17.176425 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-572d0d30-1b32-4a84-8e58-7f395ee542bd req-f45f24b1-6365-4dea-b933-f0cfcc03dedc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:17.176996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-572d0d30-1b32-4a84-8e58-7f395ee542bd req-f45f24b1-6365-4dea-b933-f0cfcc03dedc service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:17.189857 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-572d0d30-1b32-4a84-8e58-7f395ee542bd req-f45f24b1-6365-4dea-b933-f0cfcc03dedc service nova] Creating event network-changed:437c09f9-c047-4673-b546-d900b80c67b9 for instance 3698a99d-4d79-44b7-91d0-6c998b6b8236 on n-h1-860282-1 Oct 04 22:29:17.196115 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-572d0d30-1b32-4a84-8e58-7f395ee542bd req-f45f24b1-6365-4dea-b933-f0cfcc03dedc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048662 Oct 04 22:29:17.200541 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3877/7774] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:29:17.207525 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c6e29f39-115e-4752-8178-9c762993b0d5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:29:17.456603 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c6e29f39-115e-4752-8178-9c762993b0d5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 204 len: 0 microversion: 2.1 time: 0.317411 Oct 04 22:29:17.457204 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3898/7775] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:29:17 2022] DELETE /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:29:17.467816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-31f98334-20d6-4174-ab4b-ba3c031b548f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:17.468905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-31f98334-20d6-4174-ab4b-ba3c031b548f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:17.475672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31f98334-20d6-4174-ab4b-ba3c031b548f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:17.476261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31f98334-20d6-4174-ab4b-ba3c031b548f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:17.476807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31f98334-20d6-4174-ab4b-ba3c031b548f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:17.477555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31f98334-20d6-4174-ab4b-ba3c031b548f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:17.478162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31f98334-20d6-4174-ab4b-ba3c031b548f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:17.478609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31f98334-20d6-4174-ab4b-ba3c031b548f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:17.629495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-31f98334-20d6-4174-ab4b-ba3c031b548f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:17.637600 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-31f98334-20d6-4174-ab4b-ba3c031b548f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1689 microversion: 2.1 time: 0.174602 Oct 04 22:29:17.638184 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3878/7776] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:17 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:18.661327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6948d638-4898-448b-87df-e7803d65fb45 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:18.662208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6948d638-4898-448b-87df-e7803d65fb45 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:18.670433 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6948d638-4898-448b-87df-e7803d65fb45 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:18.670939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6948d638-4898-448b-87df-e7803d65fb45 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:18.671394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6948d638-4898-448b-87df-e7803d65fb45 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:18.672108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6948d638-4898-448b-87df-e7803d65fb45 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:18.672580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6948d638-4898-448b-87df-e7803d65fb45 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:18.673020 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6948d638-4898-448b-87df-e7803d65fb45 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:18.811100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6948d638-4898-448b-87df-e7803d65fb45 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:18.819168 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6948d638-4898-448b-87df-e7803d65fb45 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1689 microversion: 2.1 time: 0.161942 Oct 04 22:29:18.819765 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3899/7777] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:18 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:19.431950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-6ea5c0a3-8535-47bf-93bd-68a9bba0573d req-741fdb79-f3f7-4cd2-b4e1-47f9a06a7960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3698a99d-4d79-44b7-91d0-6c998b6b8236", "name": "network-vif-deleted", "tag": "437c09f9-c047-4673-b546-d900b80c67b9"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:19.442778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6ea5c0a3-8535-47bf-93bd-68a9bba0573d req-741fdb79-f3f7-4cd2-b4e1-47f9a06a7960 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:19.443353 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6ea5c0a3-8535-47bf-93bd-68a9bba0573d req-741fdb79-f3f7-4cd2-b4e1-47f9a06a7960 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:19.443855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6ea5c0a3-8535-47bf-93bd-68a9bba0573d req-741fdb79-f3f7-4cd2-b4e1-47f9a06a7960 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:19.456609 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-6ea5c0a3-8535-47bf-93bd-68a9bba0573d req-741fdb79-f3f7-4cd2-b4e1-47f9a06a7960 service nova] Creating event network-vif-deleted:437c09f9-c047-4673-b546-d900b80c67b9 for instance 3698a99d-4d79-44b7-91d0-6c998b6b8236 on n-h1-860282-1 Oct 04 22:29:19.462312 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-6ea5c0a3-8535-47bf-93bd-68a9bba0573d req-741fdb79-f3f7-4cd2-b4e1-47f9a06a7960 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035216 Oct 04 22:29:19.462920 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3879/7778] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:29:19.844696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-990a3d20-b665-430a-8a09-81a727b610aa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:19.845325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-990a3d20-b665-430a-8a09-81a727b610aa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:19.852591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-990a3d20-b665-430a-8a09-81a727b610aa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:19.853139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-990a3d20-b665-430a-8a09-81a727b610aa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:19.853630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-990a3d20-b665-430a-8a09-81a727b610aa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:19.855535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-990a3d20-b665-430a-8a09-81a727b610aa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:19.856040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-990a3d20-b665-430a-8a09-81a727b610aa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:19.856487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-990a3d20-b665-430a-8a09-81a727b610aa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:19.894617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-990a3d20-b665-430a-8a09-81a727b610aa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:19.895122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-990a3d20-b665-430a-8a09-81a727b610aa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:19.895574 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-990a3d20-b665-430a-8a09-81a727b610aa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:19.896036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-990a3d20-b665-430a-8a09-81a727b610aa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lazy-loading 'fault' on Instance uuid 3698a99d-4d79-44b7-91d0-6c998b6b8236 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:29:19.940108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-990a3d20-b665-430a-8a09-81a727b610aa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:19.948744 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-990a3d20-b665-430a-8a09-81a727b610aa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 200 len: 1355 microversion: 2.1 time: 0.108283 Oct 04 22:29:19.949323 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3900/7779] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:19 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 1355 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:20.980163 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-65f15ba6-b6ef-45bc-ad80-1d9ea8c1f414 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:20.980862 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-65f15ba6-b6ef-45bc-ad80-1d9ea8c1f414 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 3698a99d-4d79-44b7-91d0-6c998b6b8236] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:20.987005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65f15ba6-b6ef-45bc-ad80-1d9ea8c1f414 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:20.987492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65f15ba6-b6ef-45bc-ad80-1d9ea8c1f414 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:20.987935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65f15ba6-b6ef-45bc-ad80-1d9ea8c1f414 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:20.988628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65f15ba6-b6ef-45bc-ad80-1d9ea8c1f414 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:20.989084 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65f15ba6-b6ef-45bc-ad80-1d9ea8c1f414 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:20.989538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-65f15ba6-b6ef-45bc-ad80-1d9ea8c1f414 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:21.002546 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-65f15ba6-b6ef-45bc-ad80-1d9ea8c1f414 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] HTTP exception thrown: Instance 3698a99d-4d79-44b7-91d0-6c998b6b8236 could not be found. Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-65f15ba6-b6ef-45bc-ad80-1d9ea8c1f414 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Request method failure captured: Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 HTTP/1.1 Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPLMZuTLnApqSMxiBV15PI5S_RjEXV0e6DgU6tkVSj3Qbs_Cnvc6Wu6b-YKVM5qs41najaSVYiQoC8_V32Y3kjBm4UYmmPnCk923S11FSQGy-h7LMSKU4E0ZEbT2AhOP4CO6e2ZA15WGFizXGUgRcI6so0AfyEB2d3Mi5xsLsph4NZQo Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: ef5ef0af634f40c598c43019f28afb5b Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-377632635 Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef5ef0af634f40c598c43019f28afb5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ef5ef0af634f40c598c43019f28afb5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ef5ef0af634f40c598c43019f28afb5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef5ef0af634f40c598c43019f28afb5b"}]}] Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestNetworkAdvancedServerOps-377632635 Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: ef5ef0af634f40c598c43019f28afb5b Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-377632635 Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestNetworkAdvancedServerOps-377632635-project Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3ead2dace0aa45419aa7f8a2cd8d2104 Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestNetworkAdvancedServerOps-377632635-project Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 3698a99d-4d79-44b7-91d0-6c998b6b8236 could not be found. Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '3698a99d-4d79-44b7-91d0-6c998b6b8236'} Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3698a99d-4d79-44b7-91d0-6c998b6b8236 could not be found. Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3698a99d-4d79-44b7-91d0-6c998b6b8236 could not be found. Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:29:21.007796 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:29:21.012716 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:29:21.012716 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:29:21.012716 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:29:21.012716 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:29:21.012716 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:29:21.012716 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:29:21.012716 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3698a99d-4d79-44b7-91d0-6c998b6b8236 could not be found. Oct 04 22:29:21.012716 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:29:21.012716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-65f15ba6-b6ef-45bc-ad80-1d9ea8c1f414 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Returning 404 to user: Instance 3698a99d-4d79-44b7-91d0-6c998b6b8236 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:29:21.012716 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-65f15ba6-b6ef-45bc-ad80-1d9ea8c1f414 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236" status: 404 len: 111 microversion: 2.1 time: 0.031521 Oct 04 22:29:21.012716 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3880/7780] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:20 2022] GET /compute/v2.1/servers/3698a99d-4d79-44b7-91d0-6c998b6b8236 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:29:24.373481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aa8bab74-13ac-4951-bc8c-9ac3e0530490 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '.version_select at 0x7f578862d5e0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:24.463541 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-aa8bab74-13ac-4951-bc8c-9ac3e0530490 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-388307784" status: 202 len: 0 microversion: 2.1 time: 0.093877 Oct 04 22:29:24.464149 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3901/7781] 10.222.0.30 () {58 vars in 1281 bytes} [Tue Oct 4 22:29:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-388307784 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:29:24.491466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fcc9448a-30dd-4dc8-b19e-6f4b01ff0332 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'create', calling method: .version_select at 0x7f578bbca310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-379590421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSxkXEbXFOVOaYUb27ozaGrvRKgFxTgLLoHgPX4MZPpydUNWwMMYa+zV69Wns7M2P5TO1lUwrf91wRG8nI6T4hbp3mDOmoduW9i/9mi21/ggGpLQF96bFMamA+CbV3iSg=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:24.509914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-fcc9448a-30dd-4dc8-b19e-6f4b01ff0332 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for project ef5ef0af634f40c598c43019f28afb5b. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:29:24.515193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-fcc9448a-30dd-4dc8-b19e-6f4b01ff0332 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for user 3ead2dace0aa45419aa7f8a2cd8d2104 and project ef5ef0af634f40c598c43019f28afb5b. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:29:24.577463 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fcc9448a-30dd-4dc8-b19e-6f4b01ff0332 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.089871 Oct 04 22:29:24.578077 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3881/7782] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 22:29:24 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:29:32.909117 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:32.914430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-41578665-1b6c-43e7-993f-2a2f88aa72c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1447748292", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "81628b89-8969-4e67-9e0d-4d2dd58436bf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-379590421", "security_groups": [{"name": "tempest-secgroup-smoke-251274946"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:33.058924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-41578665-1b6c-43e7-993f-2a2f88aa72c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] validate_networks() for [('81628b89-8969-4e67-9e0d-4d2dd58436bf', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:29:33.626502 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-41578665-1b6c-43e7-993f-2a2f88aa72c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:29:33.627332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-41578665-1b6c-43e7-993f-2a2f88aa72c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:29:33.628543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-41578665-1b6c-43e7-993f-2a2f88aa72c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:29:33.628978 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-41578665-1b6c-43e7-993f-2a2f88aa72c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:29:33.629409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-41578665-1b6c-43e7-993f-2a2f88aa72c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:29:33.639273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41578665-1b6c-43e7-993f-2a2f88aa72c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:33.640401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41578665-1b6c-43e7-993f-2a2f88aa72c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:33.640864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41578665-1b6c-43e7-993f-2a2f88aa72c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:33.641649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41578665-1b6c-43e7-993f-2a2f88aa72c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:33.642122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41578665-1b6c-43e7-993f-2a2f88aa72c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:33.642563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-41578665-1b6c-43e7-993f-2a2f88aa72c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:33.665976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-41578665-1b6c-43e7-993f-2a2f88aa72c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for project ef5ef0af634f40c598c43019f28afb5b. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:29:33.671764 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-41578665-1b6c-43e7-993f-2a2f88aa72c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for user 3ead2dace0aa45419aa7f8a2cd8d2104 and project ef5ef0af634f40c598c43019f28afb5b. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:29:33.686045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-41578665-1b6c-43e7-993f-2a2f88aa72c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:29:33.688504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-41578665-1b6c-43e7-993f-2a2f88aa72c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:29:33.784263 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-41578665-1b6c-43e7-993f-2a2f88aa72c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.877609 Oct 04 22:29:33.785502 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3902/7783] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:29:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:29:33.795072 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:29:33.795610 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 22:29:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc (ip 10.222.0.30) !!! Oct 04 22:29:33.796280 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=16 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:33.800336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-37412d45-7324-4254-aa4f-c6eba3f5b701 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:33.800976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-37412d45-7324-4254-aa4f-c6eba3f5b701 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:33.871636 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-37412d45-7324-4254-aa4f-c6eba3f5b701 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:33.880010 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-37412d45-7324-4254-aa4f-c6eba3f5b701 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1266 microversion: 2.1 time: 0.087063 Oct 04 22:29:33.880580 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3882/7784] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:33 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:34.927412 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b7b24e7a-3a18-48ee-a899-110037f73d05 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:34.928227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b7b24e7a-3a18-48ee-a899-110037f73d05 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:34.939504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7b24e7a-3a18-48ee-a899-110037f73d05 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:34.940346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7b24e7a-3a18-48ee-a899-110037f73d05 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:34.941379 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7b24e7a-3a18-48ee-a899-110037f73d05 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:34.942384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7b24e7a-3a18-48ee-a899-110037f73d05 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:34.943223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7b24e7a-3a18-48ee-a899-110037f73d05 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:34.944044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b7b24e7a-3a18-48ee-a899-110037f73d05 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:35.047895 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b7b24e7a-3a18-48ee-a899-110037f73d05 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:35.056462 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b7b24e7a-3a18-48ee-a899-110037f73d05 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1270 microversion: 2.1 time: 0.143128 Oct 04 22:29:35.057060 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3903/7785] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:34 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:36.081186 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-97adc4e4-4884-4c8f-b5ad-85cc9d6b755f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:36.082041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-97adc4e4-4884-4c8f-b5ad-85cc9d6b755f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:36.090229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-97adc4e4-4884-4c8f-b5ad-85cc9d6b755f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:36.090721 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-97adc4e4-4884-4c8f-b5ad-85cc9d6b755f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:36.091169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-97adc4e4-4884-4c8f-b5ad-85cc9d6b755f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:36.098751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-97adc4e4-4884-4c8f-b5ad-85cc9d6b755f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:36.099376 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-97adc4e4-4884-4c8f-b5ad-85cc9d6b755f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:36.100135 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-97adc4e4-4884-4c8f-b5ad-85cc9d6b755f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:36.207908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-97adc4e4-4884-4c8f-b5ad-85cc9d6b755f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:36.216860 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-97adc4e4-4884-4c8f-b5ad-85cc9d6b755f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1336 microversion: 2.1 time: 0.140313 Oct 04 22:29:36.217744 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3883/7786] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:36 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1336 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:37.243881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-10949579-2a2f-489d-9915-1a2d3fefc10c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:37.244459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-10949579-2a2f-489d-9915-1a2d3fefc10c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:37.251853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10949579-2a2f-489d-9915-1a2d3fefc10c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:37.252374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10949579-2a2f-489d-9915-1a2d3fefc10c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:37.253107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10949579-2a2f-489d-9915-1a2d3fefc10c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:37.253869 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10949579-2a2f-489d-9915-1a2d3fefc10c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:37.254346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10949579-2a2f-489d-9915-1a2d3fefc10c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:37.254794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10949579-2a2f-489d-9915-1a2d3fefc10c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:37.701607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-10949579-2a2f-489d-9915-1a2d3fefc10c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:37.709361 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-10949579-2a2f-489d-9915-1a2d3fefc10c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1391 microversion: 2.1 time: 0.469770 Oct 04 22:29:37.709976 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3904/7787] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:37 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1391 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:38.209129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-945a4bf2-7472-43be-a84e-d346f21b3d7d req-29a9635f-db98-4078-bde7-1d851267cd81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e4c258-1d44-44f1-8616-76dfc43772cc", "tag": "6560b681-f269-4372-a88f-87a32e6e31ec"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:38.220531 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-945a4bf2-7472-43be-a84e-d346f21b3d7d req-29a9635f-db98-4078-bde7-1d851267cd81 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:38.223336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-945a4bf2-7472-43be-a84e-d346f21b3d7d req-29a9635f-db98-4078-bde7-1d851267cd81 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:38.223336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-945a4bf2-7472-43be-a84e-d346f21b3d7d req-29a9635f-db98-4078-bde7-1d851267cd81 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:38.233366 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-945a4bf2-7472-43be-a84e-d346f21b3d7d req-29a9635f-db98-4078-bde7-1d851267cd81 service nova] Creating event network-changed:6560b681-f269-4372-a88f-87a32e6e31ec for instance d6e4c258-1d44-44f1-8616-76dfc43772cc on n-h2-860282-1 Oct 04 22:29:38.238662 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-945a4bf2-7472-43be-a84e-d346f21b3d7d req-29a9635f-db98-4078-bde7-1d851267cd81 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033624 Oct 04 22:29:38.239457 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3884/7788] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:29:38.732673 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0995b27e-6a03-4d9b-b3af-c4107246bb18 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:38.733385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0995b27e-6a03-4d9b-b3af-c4107246bb18 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:38.740213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0995b27e-6a03-4d9b-b3af-c4107246bb18 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:38.740718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0995b27e-6a03-4d9b-b3af-c4107246bb18 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:38.741171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0995b27e-6a03-4d9b-b3af-c4107246bb18 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:38.742059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0995b27e-6a03-4d9b-b3af-c4107246bb18 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:38.742534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0995b27e-6a03-4d9b-b3af-c4107246bb18 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:38.742976 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0995b27e-6a03-4d9b-b3af-c4107246bb18 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:38.977128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-0995b27e-6a03-4d9b-b3af-c4107246bb18 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:38.985402 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0995b27e-6a03-4d9b-b3af-c4107246bb18 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1391 microversion: 2.1 time: 0.256644 Oct 04 22:29:38.986209 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3905/7789] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:38 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1391 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:40.010359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-23fc8b0b-5805-48f1-bfd8-15329ebb9cc3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:40.011124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-23fc8b0b-5805-48f1-bfd8-15329ebb9cc3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:40.013996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:40.019117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23fc8b0b-5805-48f1-bfd8-15329ebb9cc3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:40.019612 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23fc8b0b-5805-48f1-bfd8-15329ebb9cc3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:40.020059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23fc8b0b-5805-48f1-bfd8-15329ebb9cc3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:40.020766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23fc8b0b-5805-48f1-bfd8-15329ebb9cc3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:40.021228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23fc8b0b-5805-48f1-bfd8-15329ebb9cc3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:40.021695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-23fc8b0b-5805-48f1-bfd8-15329ebb9cc3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:40.159191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-23fc8b0b-5805-48f1-bfd8-15329ebb9cc3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:40.167087 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-23fc8b0b-5805-48f1-bfd8-15329ebb9cc3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1391 microversion: 2.1 time: 0.161242 Oct 04 22:29:40.167672 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3885/7790] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:40 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:41.189962 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1252a79b-01f4-4808-9c6b-28a367b76b32 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:41.190590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1252a79b-01f4-4808-9c6b-28a367b76b32 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:41.197684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1252a79b-01f4-4808-9c6b-28a367b76b32 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:41.198221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1252a79b-01f4-4808-9c6b-28a367b76b32 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:41.198688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1252a79b-01f4-4808-9c6b-28a367b76b32 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:41.199414 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1252a79b-01f4-4808-9c6b-28a367b76b32 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:41.199930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1252a79b-01f4-4808-9c6b-28a367b76b32 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:41.200366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1252a79b-01f4-4808-9c6b-28a367b76b32 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:41.337909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1252a79b-01f4-4808-9c6b-28a367b76b32 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:41.346012 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1252a79b-01f4-4808-9c6b-28a367b76b32 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1391 microversion: 2.1 time: 0.159857 Oct 04 22:29:41.346575 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3906/7791] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:41 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:42.370489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b153686d-091d-4d2b-b567-4d0461cf7402 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:42.371111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b153686d-091d-4d2b-b567-4d0461cf7402 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:42.378631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b153686d-091d-4d2b-b567-4d0461cf7402 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:42.379122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b153686d-091d-4d2b-b567-4d0461cf7402 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:42.379559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b153686d-091d-4d2b-b567-4d0461cf7402 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:42.380255 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b153686d-091d-4d2b-b567-4d0461cf7402 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:42.380723 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b153686d-091d-4d2b-b567-4d0461cf7402 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:42.381148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b153686d-091d-4d2b-b567-4d0461cf7402 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:42.518358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b153686d-091d-4d2b-b567-4d0461cf7402 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:42.526534 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b153686d-091d-4d2b-b567-4d0461cf7402 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1391 microversion: 2.1 time: 0.160497 Oct 04 22:29:42.527058 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3886/7792] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:42 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:43.549039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9c83af55-87a9-493e-b21d-cd557daf6806 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:43.549699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9c83af55-87a9-493e-b21d-cd557daf6806 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:43.556549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c83af55-87a9-493e-b21d-cd557daf6806 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:43.557050 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c83af55-87a9-493e-b21d-cd557daf6806 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:43.557541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c83af55-87a9-493e-b21d-cd557daf6806 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:43.558241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c83af55-87a9-493e-b21d-cd557daf6806 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:43.558709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c83af55-87a9-493e-b21d-cd557daf6806 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:43.559147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9c83af55-87a9-493e-b21d-cd557daf6806 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:43.648608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:43.680001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:43.695073 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9c83af55-87a9-493e-b21d-cd557daf6806 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:43.702946 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9c83af55-87a9-493e-b21d-cd557daf6806 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1391 microversion: 2.1 time: 0.157796 Oct 04 22:29:43.703820 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3907/7793] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:43 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:44.424615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-a8a66ef1-d263-49b2-bf23-1c2c0b7b99a0 req-a5ec4b30-e5ff-4e85-a186-e6e5bd2ce50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e4c258-1d44-44f1-8616-76dfc43772cc", "name": "network-vif-plugged", "status": "completed", "tag": "6560b681-f269-4372-a88f-87a32e6e31ec"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:44.430690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:44.436099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a8a66ef1-d263-49b2-bf23-1c2c0b7b99a0 req-a5ec4b30-e5ff-4e85-a186-e6e5bd2ce50d service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:44.436583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a8a66ef1-d263-49b2-bf23-1c2c0b7b99a0 req-a5ec4b30-e5ff-4e85-a186-e6e5bd2ce50d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:44.437021 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a8a66ef1-d263-49b2-bf23-1c2c0b7b99a0 req-a5ec4b30-e5ff-4e85-a186-e6e5bd2ce50d service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:44.448607 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-a8a66ef1-d263-49b2-bf23-1c2c0b7b99a0 req-a5ec4b30-e5ff-4e85-a186-e6e5bd2ce50d service nova] Creating event network-vif-plugged:6560b681-f269-4372-a88f-87a32e6e31ec for instance d6e4c258-1d44-44f1-8616-76dfc43772cc on n-h2-860282-1 Oct 04 22:29:44.453713 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-a8a66ef1-d263-49b2-bf23-1c2c0b7b99a0 req-a5ec4b30-e5ff-4e85-a186-e6e5bd2ce50d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032829 Oct 04 22:29:44.454305 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3887/7794] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:29:44.726111 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-30ef1373-9ac5-4245-8365-5c3a3a7b7b93 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:44.726775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-30ef1373-9ac5-4245-8365-5c3a3a7b7b93 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:44.734484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30ef1373-9ac5-4245-8365-5c3a3a7b7b93 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:44.734923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30ef1373-9ac5-4245-8365-5c3a3a7b7b93 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:44.735377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30ef1373-9ac5-4245-8365-5c3a3a7b7b93 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:44.736082 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30ef1373-9ac5-4245-8365-5c3a3a7b7b93 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:44.736581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30ef1373-9ac5-4245-8365-5c3a3a7b7b93 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:44.737022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-30ef1373-9ac5-4245-8365-5c3a3a7b7b93 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:44.870468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-30ef1373-9ac5-4245-8365-5c3a3a7b7b93 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:44.878546 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-30ef1373-9ac5-4245-8365-5c3a3a7b7b93 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1391 microversion: 2.1 time: 0.156265 Oct 04 22:29:44.879135 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3908/7795] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:44 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:45.903459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-59ae0e63-3892-4dbf-a591-730a39fff6f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:45.904172 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-59ae0e63-3892-4dbf-a591-730a39fff6f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:45.911634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59ae0e63-3892-4dbf-a591-730a39fff6f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:45.912124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59ae0e63-3892-4dbf-a591-730a39fff6f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:45.913413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59ae0e63-3892-4dbf-a591-730a39fff6f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:45.913413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59ae0e63-3892-4dbf-a591-730a39fff6f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:45.913722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59ae0e63-3892-4dbf-a591-730a39fff6f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:45.914419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59ae0e63-3892-4dbf-a591-730a39fff6f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:46.058772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-59ae0e63-3892-4dbf-a591-730a39fff6f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:46.066447 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-59ae0e63-3892-4dbf-a591-730a39fff6f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1391 microversion: 2.1 time: 0.167908 Oct 04 22:29:46.067024 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3888/7796] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:45 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:47.090581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1bbd1f92-c6e3-4654-8854-6ddfa8fad922 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:47.091215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1bbd1f92-c6e3-4654-8854-6ddfa8fad922 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:47.097763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bbd1f92-c6e3-4654-8854-6ddfa8fad922 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:47.098267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bbd1f92-c6e3-4654-8854-6ddfa8fad922 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:47.098726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bbd1f92-c6e3-4654-8854-6ddfa8fad922 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:47.099441 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bbd1f92-c6e3-4654-8854-6ddfa8fad922 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:47.099922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bbd1f92-c6e3-4654-8854-6ddfa8fad922 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:47.100371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bbd1f92-c6e3-4654-8854-6ddfa8fad922 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:47.230051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1bbd1f92-c6e3-4654-8854-6ddfa8fad922 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:47.237830 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1bbd1f92-c6e3-4654-8854-6ddfa8fad922 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1563 microversion: 2.1 time: 0.152045 Oct 04 22:29:47.238415 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3909/7797] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:47 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:47.260787 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b514bc1c-2fa9-4009-a701-dcaeca61a5a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:47.261413 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b514bc1c-2fa9-4009-a701-dcaeca61a5a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:47.268686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b514bc1c-2fa9-4009-a701-dcaeca61a5a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:47.269299 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b514bc1c-2fa9-4009-a701-dcaeca61a5a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:47.270050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b514bc1c-2fa9-4009-a701-dcaeca61a5a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:47.270792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b514bc1c-2fa9-4009-a701-dcaeca61a5a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:47.271259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b514bc1c-2fa9-4009-a701-dcaeca61a5a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:47.271698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b514bc1c-2fa9-4009-a701-dcaeca61a5a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:47.402037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b514bc1c-2fa9-4009-a701-dcaeca61a5a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:47.411851 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b514bc1c-2fa9-4009-a701-dcaeca61a5a5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1563 microversion: 2.1 time: 0.152841 Oct 04 22:29:47.411851 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3889/7798] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:47 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:29:49.513779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2582f4d7-e9b2-4b23-8af2-7a0676123221 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:49.514543 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2582f4d7-e9b2-4b23-8af2-7a0676123221 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:49.515529 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-93e75a39-e09a-43cd-9aa4-23ea9242753e req-e113ed83-51e4-4d77-8c78-573596da697e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e4c258-1d44-44f1-8616-76dfc43772cc", "tag": "6560b681-f269-4372-a88f-87a32e6e31ec"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:49.517597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:49.523075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2582f4d7-e9b2-4b23-8af2-7a0676123221 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:49.523849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2582f4d7-e9b2-4b23-8af2-7a0676123221 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:49.524382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2582f4d7-e9b2-4b23-8af2-7a0676123221 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:49.525335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2582f4d7-e9b2-4b23-8af2-7a0676123221 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:49.526172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2582f4d7-e9b2-4b23-8af2-7a0676123221 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:49.526947 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-93e75a39-e09a-43cd-9aa4-23ea9242753e req-e113ed83-51e4-4d77-8c78-573596da697e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:49.527667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2582f4d7-e9b2-4b23-8af2-7a0676123221 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:49.527902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-93e75a39-e09a-43cd-9aa4-23ea9242753e req-e113ed83-51e4-4d77-8c78-573596da697e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:49.528626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-93e75a39-e09a-43cd-9aa4-23ea9242753e req-e113ed83-51e4-4d77-8c78-573596da697e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:49.541780 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-93e75a39-e09a-43cd-9aa4-23ea9242753e req-e113ed83-51e4-4d77-8c78-573596da697e service nova] Creating event network-changed:6560b681-f269-4372-a88f-87a32e6e31ec for instance d6e4c258-1d44-44f1-8616-76dfc43772cc on n-h2-860282-1 Oct 04 22:29:49.547473 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-93e75a39-e09a-43cd-9aa4-23ea9242753e req-e113ed83-51e4-4d77-8c78-573596da697e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035356 Oct 04 22:29:49.549901 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3890/7799] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:29:49.761603 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2582f4d7-e9b2-4b23-8af2-7a0676123221 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:49.769438 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2582f4d7-e9b2-4b23-8af2-7a0676123221 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1563 microversion: 2.1 time: 0.260118 Oct 04 22:29:49.770570 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3910/7800] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:49 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1563 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:13.070002 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f187645d-3c3b-4fcc-8b8b-b9f640fd1f9d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:30:13.072365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f187645d-3c3b-4fcc-8b8b-b9f640fd1f9d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:13.075736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=11 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:30:13.076523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=36 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:30:13.081823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f187645d-3c3b-4fcc-8b8b-b9f640fd1f9d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:13.082316 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f187645d-3c3b-4fcc-8b8b-b9f640fd1f9d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:13.082757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f187645d-3c3b-4fcc-8b8b-b9f640fd1f9d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:13.083458 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f187645d-3c3b-4fcc-8b8b-b9f640fd1f9d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:13.083912 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f187645d-3c3b-4fcc-8b8b-b9f640fd1f9d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:13.084338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f187645d-3c3b-4fcc-8b8b-b9f640fd1f9d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:13.145489 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f187645d-3c3b-4fcc-8b8b-b9f640fd1f9d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc/action" status: 200 len: 24568 microversion: 2.1 time: 0.079829 Oct 04 22:30:13.146145 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3891/7801] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:30:13 2022] POST /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc/action => generated 24568 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:30:24.005325 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7485bed2-e0df-4b7c-9698-beee9de9418d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:30:24.007752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7485bed2-e0df-4b7c-9698-beee9de9418d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:24.009942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:30:24.010607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=50 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:30:24.015559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7485bed2-e0df-4b7c-9698-beee9de9418d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:24.016060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7485bed2-e0df-4b7c-9698-beee9de9418d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:24.016513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7485bed2-e0df-4b7c-9698-beee9de9418d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:24.017216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7485bed2-e0df-4b7c-9698-beee9de9418d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:24.017794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7485bed2-e0df-4b7c-9698-beee9de9418d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:24.022606 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7485bed2-e0df-4b7c-9698-beee9de9418d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:24.058276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7485bed2-e0df-4b7c-9698-beee9de9418d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:24.066143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7485bed2-e0df-4b7c-9698-beee9de9418d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Old instance type m1.heat2, new instance type m1.heat {{(pid=122757) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:30:24.072550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7485bed2-e0df-4b7c-9698-beee9de9418d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:30:24.072984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7485bed2-e0df-4b7c-9698-beee9de9418d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:30:24.073507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7485bed2-e0df-4b7c-9698-beee9de9418d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:30:24.073933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7485bed2-e0df-4b7c-9698-beee9de9418d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:30:24.074356 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-7485bed2-e0df-4b7c-9698-beee9de9418d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:30:24.269517 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7485bed2-e0df-4b7c-9698-beee9de9418d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc/action" status: 202 len: 0 microversion: 2.1 time: 0.268122 Oct 04 22:30:24.270076 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3911/7802] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:30:23 2022] POST /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:30:24.279582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-36d15381-8453-4a5a-86dd-7d382538b711 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:24.280295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-36d15381-8453-4a5a-86dd-7d382538b711 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:24.283412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:30:24.283670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=4 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:30:24.288648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36d15381-8453-4a5a-86dd-7d382538b711 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:24.289119 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36d15381-8453-4a5a-86dd-7d382538b711 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:24.289587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36d15381-8453-4a5a-86dd-7d382538b711 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:24.290295 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36d15381-8453-4a5a-86dd-7d382538b711 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:24.290782 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36d15381-8453-4a5a-86dd-7d382538b711 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:24.291211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-36d15381-8453-4a5a-86dd-7d382538b711 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:24.425690 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-36d15381-8453-4a5a-86dd-7d382538b711 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:24.434008 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-36d15381-8453-4a5a-86dd-7d382538b711 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1690 microversion: 2.1 time: 0.159400 Oct 04 22:30:24.434585 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3892/7803] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:24 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:30:25.461507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7873424c-8040-42a3-add3-84394e07935f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:25.461507 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7873424c-8040-42a3-add3-84394e07935f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:25.466659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7873424c-8040-42a3-add3-84394e07935f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:25.467158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7873424c-8040-42a3-add3-84394e07935f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:25.467615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7873424c-8040-42a3-add3-84394e07935f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:25.468410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7873424c-8040-42a3-add3-84394e07935f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:25.468882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7873424c-8040-42a3-add3-84394e07935f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:25.469324 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7873424c-8040-42a3-add3-84394e07935f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:25.610174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7873424c-8040-42a3-add3-84394e07935f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:25.618121 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7873424c-8040-42a3-add3-84394e07935f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1690 microversion: 2.1 time: 0.163205 Oct 04 22:30:25.618745 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3912/7804] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:25 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:26.642530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fd0dabcb-d822-462d-866a-dd0dbd45e068 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:26.643196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fd0dabcb-d822-462d-866a-dd0dbd45e068 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:26.650100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd0dabcb-d822-462d-866a-dd0dbd45e068 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:26.650595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd0dabcb-d822-462d-866a-dd0dbd45e068 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:26.651052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd0dabcb-d822-462d-866a-dd0dbd45e068 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:26.651750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd0dabcb-d822-462d-866a-dd0dbd45e068 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:26.652210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd0dabcb-d822-462d-866a-dd0dbd45e068 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:26.652642 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd0dabcb-d822-462d-866a-dd0dbd45e068 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:26.786672 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fd0dabcb-d822-462d-866a-dd0dbd45e068 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:26.795195 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fd0dabcb-d822-462d-866a-dd0dbd45e068 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1690 microversion: 2.1 time: 0.156324 Oct 04 22:30:26.796032 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3893/7805] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:26 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:27.819607 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7afa2f19-7706-4990-b5bd-60a4b4c330c7 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:27.820230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7afa2f19-7706-4990-b5bd-60a4b4c330c7 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:27.827169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7afa2f19-7706-4990-b5bd-60a4b4c330c7 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:27.827670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7afa2f19-7706-4990-b5bd-60a4b4c330c7 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:27.828122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7afa2f19-7706-4990-b5bd-60a4b4c330c7 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:27.828827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7afa2f19-7706-4990-b5bd-60a4b4c330c7 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:27.829293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7afa2f19-7706-4990-b5bd-60a4b4c330c7 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:27.829780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7afa2f19-7706-4990-b5bd-60a4b4c330c7 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:27.968813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7afa2f19-7706-4990-b5bd-60a4b4c330c7 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:27.976661 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7afa2f19-7706-4990-b5bd-60a4b4c330c7 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1695 microversion: 2.1 time: 0.161198 Oct 04 22:30:27.977254 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3913/7806] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:27 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:29.002628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bb29b114-a381-464c-9afc-28931b6dcfb6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:29.003252 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bb29b114-a381-464c-9afc-28931b6dcfb6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:29.010091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb29b114-a381-464c-9afc-28931b6dcfb6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:29.010583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb29b114-a381-464c-9afc-28931b6dcfb6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:29.011030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb29b114-a381-464c-9afc-28931b6dcfb6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:29.011733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb29b114-a381-464c-9afc-28931b6dcfb6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:29.012195 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb29b114-a381-464c-9afc-28931b6dcfb6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:29.012630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb29b114-a381-464c-9afc-28931b6dcfb6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:29.144407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bb29b114-a381-464c-9afc-28931b6dcfb6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:29.152157 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bb29b114-a381-464c-9afc-28931b6dcfb6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1695 microversion: 2.1 time: 0.154523 Oct 04 22:30:29.152727 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3894/7807] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:28 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:30.176672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-df57850d-88da-4b47-b06f-9d94b688a343 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:30.177298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-df57850d-88da-4b47-b06f-9d94b688a343 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:30.184109 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df57850d-88da-4b47-b06f-9d94b688a343 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:30.184613 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df57850d-88da-4b47-b06f-9d94b688a343 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:30.185066 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df57850d-88da-4b47-b06f-9d94b688a343 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:30.185795 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df57850d-88da-4b47-b06f-9d94b688a343 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:30.186267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df57850d-88da-4b47-b06f-9d94b688a343 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:30.186716 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-df57850d-88da-4b47-b06f-9d94b688a343 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:30.581401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-df57850d-88da-4b47-b06f-9d94b688a343 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:30.589151 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-df57850d-88da-4b47-b06f-9d94b688a343 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1695 microversion: 2.1 time: 0.416351 Oct 04 22:30:30.589747 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3914/7808] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:30 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1695 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:31.612989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-35acaf83-c1ea-48c2-bdc0-88d3b9f7a68e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:31.613640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-35acaf83-c1ea-48c2-bdc0-88d3b9f7a68e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:31.620448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35acaf83-c1ea-48c2-bdc0-88d3b9f7a68e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:31.620921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35acaf83-c1ea-48c2-bdc0-88d3b9f7a68e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:31.621367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35acaf83-c1ea-48c2-bdc0-88d3b9f7a68e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:31.622092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35acaf83-c1ea-48c2-bdc0-88d3b9f7a68e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:31.622556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35acaf83-c1ea-48c2-bdc0-88d3b9f7a68e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:31.622989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-35acaf83-c1ea-48c2-bdc0-88d3b9f7a68e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:31.753645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-35acaf83-c1ea-48c2-bdc0-88d3b9f7a68e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:31.761438 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-35acaf83-c1ea-48c2-bdc0-88d3b9f7a68e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1695 microversion: 2.1 time: 0.152505 Oct 04 22:30:31.762026 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3895/7809] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:31 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:32.786288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7bd9d450-9ba4-4ab1-8a0c-93fdf4220382 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:32.786917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7bd9d450-9ba4-4ab1-8a0c-93fdf4220382 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:32.793769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bd9d450-9ba4-4ab1-8a0c-93fdf4220382 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:32.794207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bd9d450-9ba4-4ab1-8a0c-93fdf4220382 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:32.794658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bd9d450-9ba4-4ab1-8a0c-93fdf4220382 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:32.795358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bd9d450-9ba4-4ab1-8a0c-93fdf4220382 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:32.795824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bd9d450-9ba4-4ab1-8a0c-93fdf4220382 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:32.796259 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7bd9d450-9ba4-4ab1-8a0c-93fdf4220382 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:32.925915 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7bd9d450-9ba4-4ab1-8a0c-93fdf4220382 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:32.933740 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7bd9d450-9ba4-4ab1-8a0c-93fdf4220382 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1695 microversion: 2.1 time: 0.152184 Oct 04 22:30:32.934317 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3915/7810] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:32 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:33.957605 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-385e8e67-f672-477d-b838-0ef76c9e72c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:33.958359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-385e8e67-f672-477d-b838-0ef76c9e72c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:33.965151 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-385e8e67-f672-477d-b838-0ef76c9e72c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:33.970177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-385e8e67-f672-477d-b838-0ef76c9e72c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:33.970177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-385e8e67-f672-477d-b838-0ef76c9e72c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:33.970177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-385e8e67-f672-477d-b838-0ef76c9e72c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:33.970177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-385e8e67-f672-477d-b838-0ef76c9e72c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:33.970177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-385e8e67-f672-477d-b838-0ef76c9e72c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:34.104659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-385e8e67-f672-477d-b838-0ef76c9e72c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:34.112483 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-385e8e67-f672-477d-b838-0ef76c9e72c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1695 microversion: 2.1 time: 0.158992 Oct 04 22:30:34.113058 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3896/7811] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:33 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:35.136698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5e5bab27-484f-4058-afe7-298e6e128b2f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:35.137372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5e5bab27-484f-4058-afe7-298e6e128b2f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:35.146907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e5bab27-484f-4058-afe7-298e6e128b2f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:35.147430 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e5bab27-484f-4058-afe7-298e6e128b2f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:35.147897 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e5bab27-484f-4058-afe7-298e6e128b2f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:35.148638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e5bab27-484f-4058-afe7-298e6e128b2f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:35.149118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e5bab27-484f-4058-afe7-298e6e128b2f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:35.149598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5e5bab27-484f-4058-afe7-298e6e128b2f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:35.290142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5e5bab27-484f-4058-afe7-298e6e128b2f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:35.298109 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5e5bab27-484f-4058-afe7-298e6e128b2f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1695 microversion: 2.1 time: 0.165474 Oct 04 22:30:35.298680 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3916/7812] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:35 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:36.323777 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f9550eaf-d622-41dc-bfa8-e5ab7439c24a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:36.324386 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f9550eaf-d622-41dc-bfa8-e5ab7439c24a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:36.331345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9550eaf-d622-41dc-bfa8-e5ab7439c24a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:36.331828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9550eaf-d622-41dc-bfa8-e5ab7439c24a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:36.332879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9550eaf-d622-41dc-bfa8-e5ab7439c24a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:36.333749 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9550eaf-d622-41dc-bfa8-e5ab7439c24a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:36.334212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9550eaf-d622-41dc-bfa8-e5ab7439c24a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:36.334646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9550eaf-d622-41dc-bfa8-e5ab7439c24a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:36.467081 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f9550eaf-d622-41dc-bfa8-e5ab7439c24a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:36.475514 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f9550eaf-d622-41dc-bfa8-e5ab7439c24a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1695 microversion: 2.1 time: 0.155822 Oct 04 22:30:36.476092 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3897/7813] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:36 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:37.499695 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a690fcee-077e-4dff-a860-0baca498adf4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:37.500327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a690fcee-077e-4dff-a860-0baca498adf4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:37.508206 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a690fcee-077e-4dff-a860-0baca498adf4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:37.508706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a690fcee-077e-4dff-a860-0baca498adf4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:37.509160 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a690fcee-077e-4dff-a860-0baca498adf4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:37.509896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a690fcee-077e-4dff-a860-0baca498adf4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:37.510370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a690fcee-077e-4dff-a860-0baca498adf4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:37.510813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a690fcee-077e-4dff-a860-0baca498adf4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:37.641969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a690fcee-077e-4dff-a860-0baca498adf4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:37.650449 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a690fcee-077e-4dff-a860-0baca498adf4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1695 microversion: 2.1 time: 0.154689 Oct 04 22:30:37.651016 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3917/7814] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:37 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:38.673567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-baa1f6a8-af80-4705-be17-12a1f331c1a4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:38.674184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-baa1f6a8-af80-4705-be17-12a1f331c1a4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:38.681495 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-baa1f6a8-af80-4705-be17-12a1f331c1a4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:38.681987 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-baa1f6a8-af80-4705-be17-12a1f331c1a4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:38.682430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-baa1f6a8-af80-4705-be17-12a1f331c1a4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:38.683121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-baa1f6a8-af80-4705-be17-12a1f331c1a4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:38.683579 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-baa1f6a8-af80-4705-be17-12a1f331c1a4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:38.684007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-baa1f6a8-af80-4705-be17-12a1f331c1a4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:38.814322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-baa1f6a8-af80-4705-be17-12a1f331c1a4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:38.822579 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-baa1f6a8-af80-4705-be17-12a1f331c1a4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1695 microversion: 2.1 time: 0.152957 Oct 04 22:30:38.823153 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3898/7815] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:38 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:39.845504 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-77869324-3fa7-4dd6-9ffd-a7433efcf653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:39.846090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-77869324-3fa7-4dd6-9ffd-a7433efcf653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:39.853668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77869324-3fa7-4dd6-9ffd-a7433efcf653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:39.854179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77869324-3fa7-4dd6-9ffd-a7433efcf653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:39.854644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77869324-3fa7-4dd6-9ffd-a7433efcf653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:39.855361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77869324-3fa7-4dd6-9ffd-a7433efcf653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:39.855838 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77869324-3fa7-4dd6-9ffd-a7433efcf653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:39.856287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77869324-3fa7-4dd6-9ffd-a7433efcf653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:39.995936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-77869324-3fa7-4dd6-9ffd-a7433efcf653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:40.004056 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-77869324-3fa7-4dd6-9ffd-a7433efcf653 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1695 microversion: 2.1 time: 0.162624 Oct 04 22:30:40.007498 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3918/7816] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:39 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:41.027485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cd8f48ef-8314-4acb-a2ab-72aec7180af0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:41.028098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cd8f48ef-8314-4acb-a2ab-72aec7180af0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:41.035404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd8f48ef-8314-4acb-a2ab-72aec7180af0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:41.036499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd8f48ef-8314-4acb-a2ab-72aec7180af0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:41.037118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd8f48ef-8314-4acb-a2ab-72aec7180af0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:41.037837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd8f48ef-8314-4acb-a2ab-72aec7180af0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:41.038300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd8f48ef-8314-4acb-a2ab-72aec7180af0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:41.038727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd8f48ef-8314-4acb-a2ab-72aec7180af0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:41.180177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cd8f48ef-8314-4acb-a2ab-72aec7180af0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:41.187977 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cd8f48ef-8314-4acb-a2ab-72aec7180af0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1695 microversion: 2.1 time: 0.164651 Oct 04 22:30:41.188561 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3899/7817] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:41 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:42.211595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b2ef25bb-93b1-4683-824f-26c4f65d5270 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:42.212214 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b2ef25bb-93b1-4683-824f-26c4f65d5270 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:42.219090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2ef25bb-93b1-4683-824f-26c4f65d5270 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:42.219596 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2ef25bb-93b1-4683-824f-26c4f65d5270 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:42.220054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2ef25bb-93b1-4683-824f-26c4f65d5270 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:42.220769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2ef25bb-93b1-4683-824f-26c4f65d5270 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:42.221247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2ef25bb-93b1-4683-824f-26c4f65d5270 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:42.221728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b2ef25bb-93b1-4683-824f-26c4f65d5270 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:42.707370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b2ef25bb-93b1-4683-824f-26c4f65d5270 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:42.715940 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b2ef25bb-93b1-4683-824f-26c4f65d5270 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1695 microversion: 2.1 time: 0.508215 Oct 04 22:30:42.716527 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3919/7818] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:42 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1695 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:43.740332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-06a661a6-475f-4ec8-9ea4-e142870ac9c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:43.740979 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-06a661a6-475f-4ec8-9ea4-e142870ac9c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:43.747894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06a661a6-475f-4ec8-9ea4-e142870ac9c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:43.748394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06a661a6-475f-4ec8-9ea4-e142870ac9c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:43.748844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06a661a6-475f-4ec8-9ea4-e142870ac9c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:43.749589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06a661a6-475f-4ec8-9ea4-e142870ac9c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:43.750058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06a661a6-475f-4ec8-9ea4-e142870ac9c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:43.750494 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-06a661a6-475f-4ec8-9ea4-e142870ac9c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:43.888664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-06a661a6-475f-4ec8-9ea4-e142870ac9c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:43.896831 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-06a661a6-475f-4ec8-9ea4-e142870ac9c5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1695 microversion: 2.1 time: 0.160625 Oct 04 22:30:43.897604 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3900/7819] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:43 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:44.920387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-922fd64b-5bf8-4956-9db4-2ac06627483f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:44.921070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-922fd64b-5bf8-4956-9db4-2ac06627483f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:44.927616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-922fd64b-5bf8-4956-9db4-2ac06627483f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:44.933557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-922fd64b-5bf8-4956-9db4-2ac06627483f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:44.933557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-922fd64b-5bf8-4956-9db4-2ac06627483f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:44.933557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-922fd64b-5bf8-4956-9db4-2ac06627483f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:44.933557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-922fd64b-5bf8-4956-9db4-2ac06627483f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:44.933557 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-922fd64b-5bf8-4956-9db4-2ac06627483f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:45.065773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-922fd64b-5bf8-4956-9db4-2ac06627483f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:45.074163 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-922fd64b-5bf8-4956-9db4-2ac06627483f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1695 microversion: 2.1 time: 0.157703 Oct 04 22:30:45.074750 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3920/7820] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:44 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:46.098580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d73e1af1-6368-4242-8cee-e488270ede9b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:46.104371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d73e1af1-6368-4242-8cee-e488270ede9b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:46.106688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d73e1af1-6368-4242-8cee-e488270ede9b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:46.107204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d73e1af1-6368-4242-8cee-e488270ede9b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:46.107675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d73e1af1-6368-4242-8cee-e488270ede9b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:46.108369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d73e1af1-6368-4242-8cee-e488270ede9b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:46.108849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d73e1af1-6368-4242-8cee-e488270ede9b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:46.109338 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d73e1af1-6368-4242-8cee-e488270ede9b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:46.146123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-11d21972-e1d2-4036-bc83-be7dd6ffd098 req-65f2cf62-e1cb-4d56-befe-87cd26584bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e4c258-1d44-44f1-8616-76dfc43772cc", "name": "network-vif-unplugged", "status": "completed", "tag": "6560b681-f269-4372-a88f-87a32e6e31ec"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:30:46.158572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-11d21972-e1d2-4036-bc83-be7dd6ffd098 req-65f2cf62-e1cb-4d56-befe-87cd26584bb5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:46.159356 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-11d21972-e1d2-4036-bc83-be7dd6ffd098 req-65f2cf62-e1cb-4d56-befe-87cd26584bb5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:46.160024 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-11d21972-e1d2-4036-bc83-be7dd6ffd098 req-65f2cf62-e1cb-4d56-befe-87cd26584bb5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:46.176799 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-11d21972-e1d2-4036-bc83-be7dd6ffd098 req-65f2cf62-e1cb-4d56-befe-87cd26584bb5 service nova] Creating event network-vif-unplugged:6560b681-f269-4372-a88f-87a32e6e31ec for instance d6e4c258-1d44-44f1-8616-76dfc43772cc on n-h1-860282-1 Oct 04 22:30:46.185231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [req-11d21972-e1d2-4036-bc83-be7dd6ffd098 req-65f2cf62-e1cb-4d56-befe-87cd26584bb5 service nova] Instance d6e4c258-1d44-44f1-8616-76dfc43772cc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122758) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:30:46.200150 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-11d21972-e1d2-4036-bc83-be7dd6ffd098 req-65f2cf62-e1cb-4d56-befe-87cd26584bb5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124819 Oct 04 22:30:46.201376 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3901/7821] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:30:46.249925 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d73e1af1-6368-4242-8cee-e488270ede9b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:46.258102 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d73e1af1-6368-4242-8cee-e488270ede9b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1694 microversion: 2.1 time: 0.163441 Oct 04 22:30:46.258790 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3921/7822] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:46 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:30:47.283553 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b5fc3bd5-02a0-4cbe-a4a3-1b3baa6887b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:47.284208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b5fc3bd5-02a0-4cbe-a4a3-1b3baa6887b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:47.290952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5fc3bd5-02a0-4cbe-a4a3-1b3baa6887b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:47.291468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5fc3bd5-02a0-4cbe-a4a3-1b3baa6887b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:47.291913 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5fc3bd5-02a0-4cbe-a4a3-1b3baa6887b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:47.292604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5fc3bd5-02a0-4cbe-a4a3-1b3baa6887b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:47.293060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5fc3bd5-02a0-4cbe-a4a3-1b3baa6887b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:47.293513 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b5fc3bd5-02a0-4cbe-a4a3-1b3baa6887b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:47.431538 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b5fc3bd5-02a0-4cbe-a4a3-1b3baa6887b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:47.439296 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b5fc3bd5-02a0-4cbe-a4a3-1b3baa6887b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1694 microversion: 2.1 time: 0.160361 Oct 04 22:30:47.439958 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3902/7823] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:47 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:48.223342 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-1a709426-1211-49ff-9a96-17266f3644a8 req-41717153-393f-4637-bf9f-d9788ff2cd38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e4c258-1d44-44f1-8616-76dfc43772cc", "tag": "6560b681-f269-4372-a88f-87a32e6e31ec"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:30:48.234802 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1a709426-1211-49ff-9a96-17266f3644a8 req-41717153-393f-4637-bf9f-d9788ff2cd38 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:48.235301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1a709426-1211-49ff-9a96-17266f3644a8 req-41717153-393f-4637-bf9f-d9788ff2cd38 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:48.235751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1a709426-1211-49ff-9a96-17266f3644a8 req-41717153-393f-4637-bf9f-d9788ff2cd38 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:48.248312 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-1a709426-1211-49ff-9a96-17266f3644a8 req-41717153-393f-4637-bf9f-d9788ff2cd38 service nova] Creating event network-changed:6560b681-f269-4372-a88f-87a32e6e31ec for instance d6e4c258-1d44-44f1-8616-76dfc43772cc on n-h1-860282-1 Oct 04 22:30:48.254130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [req-1a709426-1211-49ff-9a96-17266f3644a8 req-41717153-393f-4637-bf9f-d9788ff2cd38 service nova] Instance d6e4c258-1d44-44f1-8616-76dfc43772cc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122757) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:30:48.265389 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-1a709426-1211-49ff-9a96-17266f3644a8 req-41717153-393f-4637-bf9f-d9788ff2cd38 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045907 Oct 04 22:30:48.266004 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3922/7824] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:30:48.464180 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cb071f60-a017-464c-9f8a-0256e32529f8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:48.464707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cb071f60-a017-464c-9f8a-0256e32529f8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:48.473779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb071f60-a017-464c-9f8a-0256e32529f8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:48.473779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb071f60-a017-464c-9f8a-0256e32529f8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:48.474245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb071f60-a017-464c-9f8a-0256e32529f8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:48.474950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb071f60-a017-464c-9f8a-0256e32529f8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:48.475414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb071f60-a017-464c-9f8a-0256e32529f8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:48.475839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cb071f60-a017-464c-9f8a-0256e32529f8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:48.702941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cb071f60-a017-464c-9f8a-0256e32529f8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:48.711432 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cb071f60-a017-464c-9f8a-0256e32529f8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1692 microversion: 2.1 time: 0.251163 Oct 04 22:30:48.712027 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3903/7825] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:48 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1692 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:49.736946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c1a0d683-b602-4cc7-8491-0d4814ca4c86 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:49.737703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c1a0d683-b602-4cc7-8491-0d4814ca4c86 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:49.744909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1a0d683-b602-4cc7-8491-0d4814ca4c86 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:49.745432 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1a0d683-b602-4cc7-8491-0d4814ca4c86 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:49.745920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1a0d683-b602-4cc7-8491-0d4814ca4c86 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:49.746639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1a0d683-b602-4cc7-8491-0d4814ca4c86 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:49.747116 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1a0d683-b602-4cc7-8491-0d4814ca4c86 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:49.747561 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1a0d683-b602-4cc7-8491-0d4814ca4c86 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:49.892858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c1a0d683-b602-4cc7-8491-0d4814ca4c86 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:49.901448 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c1a0d683-b602-4cc7-8491-0d4814ca4c86 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1689 microversion: 2.1 time: 0.169711 Oct 04 22:30:49.902026 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3923/7826] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:49 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:49.924462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-df37710e-840c-4e36-86f1-877a03bcbdd6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:30:49.925003 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-df37710e-840c-4e36-86f1-877a03bcbdd6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:49.931934 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df37710e-840c-4e36-86f1-877a03bcbdd6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:49.932418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df37710e-840c-4e36-86f1-877a03bcbdd6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:49.932858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df37710e-840c-4e36-86f1-877a03bcbdd6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:49.933574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df37710e-840c-4e36-86f1-877a03bcbdd6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:49.934026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df37710e-840c-4e36-86f1-877a03bcbdd6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:49.934447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-df37710e-840c-4e36-86f1-877a03bcbdd6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:50.191864 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-df37710e-840c-4e36-86f1-877a03bcbdd6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc/action" status: 204 len: 0 microversion: 2.1 time: 0.271057 Oct 04 22:30:50.192627 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3904/7827] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:30:49 2022] POST /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc/action => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:30:50.201647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9a97d986-7278-47ac-909b-f590d5ca7559 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:50.202293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9a97d986-7278-47ac-909b-f590d5ca7559 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:50.208489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a97d986-7278-47ac-909b-f590d5ca7559 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:50.209001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a97d986-7278-47ac-909b-f590d5ca7559 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:50.209488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a97d986-7278-47ac-909b-f590d5ca7559 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:50.210209 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a97d986-7278-47ac-909b-f590d5ca7559 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:50.210692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a97d986-7278-47ac-909b-f590d5ca7559 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:50.211833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9a97d986-7278-47ac-909b-f590d5ca7559 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:50.374313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9a97d986-7278-47ac-909b-f590d5ca7559 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:50.382367 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9a97d986-7278-47ac-909b-f590d5ca7559 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1689 microversion: 2.1 time: 0.184748 Oct 04 22:30:50.383491 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3924/7828] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:50 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:30:50.406091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-dfd204da-0b8a-481c-b07f-fe16a6a5d338 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:50.406835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-dfd204da-0b8a-481c-b07f-fe16a6a5d338 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:50.413241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd204da-0b8a-481c-b07f-fe16a6a5d338 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:50.413773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd204da-0b8a-481c-b07f-fe16a6a5d338 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:50.414747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd204da-0b8a-481c-b07f-fe16a6a5d338 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:50.415455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd204da-0b8a-481c-b07f-fe16a6a5d338 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:50.415914 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd204da-0b8a-481c-b07f-fe16a6a5d338 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:50.416348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-dfd204da-0b8a-481c-b07f-fe16a6a5d338 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:50.608187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-dfd204da-0b8a-481c-b07f-fe16a6a5d338 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:50.615939 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-dfd204da-0b8a-481c-b07f-fe16a6a5d338 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1689 microversion: 2.1 time: 0.214162 Oct 04 22:30:50.616515 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3905/7829] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:50 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1689 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:51.405965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-ef503c06-3c78-4731-9ff1-194589fd584f req-6890208f-5502-481f-bf0a-110b4ec96709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e4c258-1d44-44f1-8616-76dfc43772cc", "name": "network-vif-plugged", "status": "completed", "tag": "6560b681-f269-4372-a88f-87a32e6e31ec"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:30:51.416029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ef503c06-3c78-4731-9ff1-194589fd584f req-6890208f-5502-481f-bf0a-110b4ec96709 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:51.416528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ef503c06-3c78-4731-9ff1-194589fd584f req-6890208f-5502-481f-bf0a-110b4ec96709 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:51.416983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ef503c06-3c78-4731-9ff1-194589fd584f req-6890208f-5502-481f-bf0a-110b4ec96709 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:51.428438 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-ef503c06-3c78-4731-9ff1-194589fd584f req-6890208f-5502-481f-bf0a-110b4ec96709 service nova] Creating event network-vif-plugged:6560b681-f269-4372-a88f-87a32e6e31ec for instance d6e4c258-1d44-44f1-8616-76dfc43772cc on n-h1-860282-1 Oct 04 22:30:51.435449 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [req-ef503c06-3c78-4731-9ff1-194589fd584f req-6890208f-5502-481f-bf0a-110b4ec96709 service nova] Instance d6e4c258-1d44-44f1-8616-76dfc43772cc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860282-1', 'n-h1-860282-1'} {{(pid=122757) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:30:51.446467 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-ef503c06-3c78-4731-9ff1-194589fd584f req-6890208f-5502-481f-bf0a-110b4ec96709 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099926 Oct 04 22:30:51.449725 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3925/7830] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:30:51.640974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6e3d17f3-ce91-4022-a2f7-ea4255a92bcf tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:51.644330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6e3d17f3-ce91-4022-a2f7-ea4255a92bcf tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:51.649230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e3d17f3-ce91-4022-a2f7-ea4255a92bcf tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:51.649740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e3d17f3-ce91-4022-a2f7-ea4255a92bcf tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:51.650182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e3d17f3-ce91-4022-a2f7-ea4255a92bcf tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:51.650873 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e3d17f3-ce91-4022-a2f7-ea4255a92bcf tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:51.651330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e3d17f3-ce91-4022-a2f7-ea4255a92bcf tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:51.651758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6e3d17f3-ce91-4022-a2f7-ea4255a92bcf tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:51.792637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6e3d17f3-ce91-4022-a2f7-ea4255a92bcf tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:51.800789 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6e3d17f3-ce91-4022-a2f7-ea4255a92bcf tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1689 microversion: 2.1 time: 0.164661 Oct 04 22:30:51.802512 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3906/7831] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:51 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:30:52.825993 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d515527c-175e-46bc-81b9-4673999514c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:30:52.826727 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d515527c-175e-46bc-81b9-4673999514c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:30:52.833099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d515527c-175e-46bc-81b9-4673999514c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:52.833645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d515527c-175e-46bc-81b9-4673999514c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:52.834106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d515527c-175e-46bc-81b9-4673999514c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:52.834828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d515527c-175e-46bc-81b9-4673999514c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:30:52.835304 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d515527c-175e-46bc-81b9-4673999514c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:30:52.836386 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d515527c-175e-46bc-81b9-4673999514c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:30:52.973447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d515527c-175e-46bc-81b9-4673999514c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:30:52.977748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:30:52.982390 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d515527c-175e-46bc-81b9-4673999514c8 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1681 microversion: 2.1 time: 0.161580 Oct 04 22:30:52.982998 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3926/7832] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:30:52 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:13.157921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7455daf9-6984-4960-8766-5190c63a0ff0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:13.160333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7455daf9-6984-4960-8766-5190c63a0ff0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:13.163850 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=30 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:13.164576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:13.176828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7455daf9-6984-4960-8766-5190c63a0ff0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:13.176828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7455daf9-6984-4960-8766-5190c63a0ff0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:13.176828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7455daf9-6984-4960-8766-5190c63a0ff0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:13.176828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7455daf9-6984-4960-8766-5190c63a0ff0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:13.176828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7455daf9-6984-4960-8766-5190c63a0ff0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:13.176828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7455daf9-6984-4960-8766-5190c63a0ff0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:13.224354 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7455daf9-6984-4960-8766-5190c63a0ff0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc/action" status: 200 len: 24581 microversion: 2.1 time: 0.070298 Oct 04 22:31:13.225271 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3907/7833] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:31:13 2022] POST /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc/action => generated 24581 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:31:20.444040 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c1f3846d-86dc-4bc2-b167-5698ab5efe30 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:20.444547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c1f3846d-86dc-4bc2-b167-5698ab5efe30 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:20.447251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=36 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:20.461736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1f3846d-86dc-4bc2-b167-5698ab5efe30 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:20.461736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1f3846d-86dc-4bc2-b167-5698ab5efe30 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:20.461736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1f3846d-86dc-4bc2-b167-5698ab5efe30 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:20.461736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1f3846d-86dc-4bc2-b167-5698ab5efe30 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:20.461736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1f3846d-86dc-4bc2-b167-5698ab5efe30 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:20.461736 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c1f3846d-86dc-4bc2-b167-5698ab5efe30 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:20.490408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c1f3846d-86dc-4bc2-b167-5698ab5efe30 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:31:20.525606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-74fcef56-1698-455c-8b88-880662cce1f5 req-d0a5ae82-c347-4302-a288-1751a18e64dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e4c258-1d44-44f1-8616-76dfc43772cc", "tag": "6560b681-f269-4372-a88f-87a32e6e31ec"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:20.543451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-74fcef56-1698-455c-8b88-880662cce1f5 req-d0a5ae82-c347-4302-a288-1751a18e64dd service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:20.546330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-74fcef56-1698-455c-8b88-880662cce1f5 req-d0a5ae82-c347-4302-a288-1751a18e64dd service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:20.546330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-74fcef56-1698-455c-8b88-880662cce1f5 req-d0a5ae82-c347-4302-a288-1751a18e64dd service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:20.555538 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-74fcef56-1698-455c-8b88-880662cce1f5 req-d0a5ae82-c347-4302-a288-1751a18e64dd service nova] Creating event network-changed:6560b681-f269-4372-a88f-87a32e6e31ec for instance d6e4c258-1d44-44f1-8616-76dfc43772cc on n-h1-860282-1 Oct 04 22:31:20.561556 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-74fcef56-1698-455c-8b88-880662cce1f5 req-d0a5ae82-c347-4302-a288-1751a18e64dd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125830 Oct 04 22:31:20.562161 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3908/7834] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:31:20.796138 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c1f3846d-86dc-4bc2-b167-5698ab5efe30 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 204 len: 0 microversion: 2.1 time: 0.363672 Oct 04 22:31:20.806839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b64b8ff2-ef34-4850-80e3-f68f1588a1d1 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:20.808317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b64b8ff2-ef34-4850-80e3-f68f1588a1d1 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:20.814429 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3927/7835] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:31:20 2022] DELETE /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:31:20.826047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b64b8ff2-ef34-4850-80e3-f68f1588a1d1 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:20.826047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b64b8ff2-ef34-4850-80e3-f68f1588a1d1 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:20.826047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b64b8ff2-ef34-4850-80e3-f68f1588a1d1 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:20.826047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b64b8ff2-ef34-4850-80e3-f68f1588a1d1 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:20.826047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b64b8ff2-ef34-4850-80e3-f68f1588a1d1 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:20.826047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b64b8ff2-ef34-4850-80e3-f68f1588a1d1 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:21.015923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b64b8ff2-ef34-4850-80e3-f68f1588a1d1 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:21.026526 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b64b8ff2-ef34-4850-80e3-f68f1588a1d1 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1687 microversion: 2.1 time: 0.224773 Oct 04 22:31:21.027126 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3909/7836] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:20 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1687 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:22.052788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-82aebccd-8152-48e2-a59d-5fc965916c7f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:22.053709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-82aebccd-8152-48e2-a59d-5fc965916c7f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:22.061001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82aebccd-8152-48e2-a59d-5fc965916c7f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:22.061626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82aebccd-8152-48e2-a59d-5fc965916c7f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:22.062152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82aebccd-8152-48e2-a59d-5fc965916c7f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:22.062949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82aebccd-8152-48e2-a59d-5fc965916c7f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:22.063491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82aebccd-8152-48e2-a59d-5fc965916c7f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:22.064169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-82aebccd-8152-48e2-a59d-5fc965916c7f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:22.263239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-82aebccd-8152-48e2-a59d-5fc965916c7f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:22.271324 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-82aebccd-8152-48e2-a59d-5fc965916c7f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1687 microversion: 2.1 time: 0.223164 Oct 04 22:31:22.271910 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3928/7837] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:22 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1687 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:22.882175 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-63364c65-25d1-4254-ae95-ccfde6366c05 req-7d49467f-dd8e-4b93-b114-cd202bf52952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e4c258-1d44-44f1-8616-76dfc43772cc", "name": "network-vif-deleted", "tag": "6560b681-f269-4372-a88f-87a32e6e31ec"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:22.893688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-63364c65-25d1-4254-ae95-ccfde6366c05 req-7d49467f-dd8e-4b93-b114-cd202bf52952 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:22.903576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-63364c65-25d1-4254-ae95-ccfde6366c05 req-7d49467f-dd8e-4b93-b114-cd202bf52952 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:22.903576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-63364c65-25d1-4254-ae95-ccfde6366c05 req-7d49467f-dd8e-4b93-b114-cd202bf52952 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:22.906860 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-63364c65-25d1-4254-ae95-ccfde6366c05 req-7d49467f-dd8e-4b93-b114-cd202bf52952 service nova] Creating event network-vif-deleted:6560b681-f269-4372-a88f-87a32e6e31ec for instance d6e4c258-1d44-44f1-8616-76dfc43772cc on n-h1-860282-1 Oct 04 22:31:22.911883 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-63364c65-25d1-4254-ae95-ccfde6366c05 req-7d49467f-dd8e-4b93-b114-cd202bf52952 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033463 Oct 04 22:31:22.912496 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3910/7838] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:31:23.294982 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-678131dc-fd2c-465a-bc21-74beef865bdd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:23.295770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-678131dc-fd2c-465a-bc21-74beef865bdd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:23.302972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-678131dc-fd2c-465a-bc21-74beef865bdd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:23.303480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-678131dc-fd2c-465a-bc21-74beef865bdd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:23.304074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-678131dc-fd2c-465a-bc21-74beef865bdd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:23.304800 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-678131dc-fd2c-465a-bc21-74beef865bdd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:23.305276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-678131dc-fd2c-465a-bc21-74beef865bdd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:23.305749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-678131dc-fd2c-465a-bc21-74beef865bdd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:23.339415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-678131dc-fd2c-465a-bc21-74beef865bdd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:23.340555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-678131dc-fd2c-465a-bc21-74beef865bdd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:23.340989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-678131dc-fd2c-465a-bc21-74beef865bdd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:23.341489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-678131dc-fd2c-465a-bc21-74beef865bdd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lazy-loading 'fault' on Instance uuid d6e4c258-1d44-44f1-8616-76dfc43772cc {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:31:23.382619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-678131dc-fd2c-465a-bc21-74beef865bdd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:23.391263 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-678131dc-fd2c-465a-bc21-74beef865bdd tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 200 len: 1356 microversion: 2.1 time: 0.100782 Oct 04 22:31:23.391985 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3929/7839] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:23 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 1356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:24.416567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cd8a0e78-2fbe-44c6-8669-fe21aecd6da6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:24.417268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cd8a0e78-2fbe-44c6-8669-fe21aecd6da6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: d6e4c258-1d44-44f1-8616-76dfc43772cc] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:24.423438 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd8a0e78-2fbe-44c6-8669-fe21aecd6da6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:24.423907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd8a0e78-2fbe-44c6-8669-fe21aecd6da6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:24.424344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd8a0e78-2fbe-44c6-8669-fe21aecd6da6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:24.425036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd8a0e78-2fbe-44c6-8669-fe21aecd6da6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:24.425526 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd8a0e78-2fbe-44c6-8669-fe21aecd6da6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:24.425957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cd8a0e78-2fbe-44c6-8669-fe21aecd6da6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:24.439643 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-cd8a0e78-2fbe-44c6-8669-fe21aecd6da6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] HTTP exception thrown: Instance d6e4c258-1d44-44f1-8616-76dfc43772cc could not be found. Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cd8a0e78-2fbe-44c6-8669-fe21aecd6da6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Request method failure captured: Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc HTTP/1.1 Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPLMZuTLnApqSMxiBV15PI5S_RjEXV0e6DgU6tkVSj3Qbs_Cnvc6Wu6b-YKVM5qs41najaSVYiQoC8_V32Y3kjBm4UYmmPnCk923S11FSQGy-h7LMSKU4E0ZEbT2AhOP4CO6e2ZA15WGFizXGUgRcI6so0AfyEB2d3Mi5xsLsph4NZQo Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: ef5ef0af634f40c598c43019f28afb5b Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-377632635 Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef5ef0af634f40c598c43019f28afb5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ef5ef0af634f40c598c43019f28afb5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ef5ef0af634f40c598c43019f28afb5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef5ef0af634f40c598c43019f28afb5b"}]}] Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestNetworkAdvancedServerOps-377632635 Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: ef5ef0af634f40c598c43019f28afb5b Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-377632635 Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestNetworkAdvancedServerOps-377632635-project Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3ead2dace0aa45419aa7f8a2cd8d2104 Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestNetworkAdvancedServerOps-377632635-project Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance d6e4c258-1d44-44f1-8616-76dfc43772cc could not be found. Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'd6e4c258-1d44-44f1-8616-76dfc43772cc'} Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6e4c258-1d44-44f1-8616-76dfc43772cc could not be found. Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6e4c258-1d44-44f1-8616-76dfc43772cc could not be found. Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:31:24.441256 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:31:24.446848 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:31:24.446848 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:31:24.446848 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:31:24.446848 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:31:24.446848 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:31:24.446848 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:31:24.446848 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6e4c258-1d44-44f1-8616-76dfc43772cc could not be found. Oct 04 22:31:24.446848 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:31:24.446848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cd8a0e78-2fbe-44c6-8669-fe21aecd6da6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Returning 404 to user: Instance d6e4c258-1d44-44f1-8616-76dfc43772cc could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:31:24.446848 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cd8a0e78-2fbe-44c6-8669-fe21aecd6da6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc" status: 404 len: 111 microversion: 2.1 time: 0.031409 Oct 04 22:31:24.446848 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3911/7840] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:24 2022] GET /compute/v2.1/servers/d6e4c258-1d44-44f1-8616-76dfc43772cc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:31:27.841924 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a1065c1c-1103-4cc0-8821-49df0d748f9b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '.version_select at 0x7f578b0b51f0>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:27.922515 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a1065c1c-1103-4cc0-8821-49df0d748f9b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-379590421" status: 202 len: 0 microversion: 2.1 time: 0.085160 Oct 04 22:31:27.923068 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3930/7841] 10.222.0.30 () {58 vars in 1281 bytes} [Tue Oct 4 22:31:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-379590421 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:31:27.957042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d0c53c11-54d6-49a0-8dbc-daea3eaf0f21 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'create', calling method: .version_select at 0x7f578b4551f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1382061906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJWuCHWYLql4buOSHftPEZ5KDCt7qbYbYJGC23HK5gYMIwix2W7ReTa0ABRAzkHpss4m5cy16H7vZTgol+jN/ksm4begnex7R5JnNBN41G+QHKda+PY6tre/YsZ2swh5Q=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:27.974826 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-d0c53c11-54d6-49a0-8dbc-daea3eaf0f21 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for project ef5ef0af634f40c598c43019f28afb5b. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:31:27.979917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-d0c53c11-54d6-49a0-8dbc-daea3eaf0f21 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for user 3ead2dace0aa45419aa7f8a2cd8d2104 and project ef5ef0af634f40c598c43019f28afb5b. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:31:28.060423 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d0c53c11-54d6-49a0-8dbc-daea3eaf0f21 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.107261 Oct 04 22:31:28.060949 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3912/7842] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 22:31:27 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:31:36.479085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:36.534572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1a5e42cf-f71f-4d30-beaa-30297878f015 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2007351290", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "c8df0e80-8d06-4101-a0a5-1fecc26da697"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1382061906", "security_groups": [{"name": "tempest-secgroup-smoke-1040373611"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:36.658669 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-1a5e42cf-f71f-4d30-beaa-30297878f015 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] validate_networks() for [('c8df0e80-8d06-4101-a0a5-1fecc26da697', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:31:37.051831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-1a5e42cf-f71f-4d30-beaa-30297878f015 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:31:37.052370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-1a5e42cf-f71f-4d30-beaa-30297878f015 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:31:37.052942 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-1a5e42cf-f71f-4d30-beaa-30297878f015 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:31:37.053470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-1a5e42cf-f71f-4d30-beaa-30297878f015 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:31:37.054006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-1a5e42cf-f71f-4d30-beaa-30297878f015 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:31:37.063953 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a5e42cf-f71f-4d30-beaa-30297878f015 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:37.064538 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a5e42cf-f71f-4d30-beaa-30297878f015 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:37.065076 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a5e42cf-f71f-4d30-beaa-30297878f015 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:37.065949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a5e42cf-f71f-4d30-beaa-30297878f015 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:37.066495 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a5e42cf-f71f-4d30-beaa-30297878f015 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:37.067027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1a5e42cf-f71f-4d30-beaa-30297878f015 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:37.085717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-1a5e42cf-f71f-4d30-beaa-30297878f015 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for project ef5ef0af634f40c598c43019f28afb5b. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:31:37.091540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-1a5e42cf-f71f-4d30-beaa-30297878f015 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for user 3ead2dace0aa45419aa7f8a2cd8d2104 and project ef5ef0af634f40c598c43019f28afb5b. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:31:37.104026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1a5e42cf-f71f-4d30-beaa-30297878f015 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:31:37.106409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1a5e42cf-f71f-4d30-beaa-30297878f015 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:31:37.216233 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1a5e42cf-f71f-4d30-beaa-30297878f015 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.743657 Oct 04 22:31:37.217211 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3931/7843] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:31:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:31:37.226326 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=16 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:37.230557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a176c58e-75a2-4921-b897-43fff0c56f2f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:37.231209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a176c58e-75a2-4921-b897-43fff0c56f2f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:37.287846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a176c58e-75a2-4921-b897-43fff0c56f2f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:37.297144 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a176c58e-75a2-4921-b897-43fff0c56f2f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1267 microversion: 2.1 time: 0.072562 Oct 04 22:31:37.298343 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3913/7844] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:37 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1267 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:31:38.322090 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-91373fe9-e081-4a20-81ba-005396225b2c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:38.322845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-91373fe9-e081-4a20-81ba-005396225b2c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:38.330909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91373fe9-e081-4a20-81ba-005396225b2c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:38.331506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91373fe9-e081-4a20-81ba-005396225b2c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:38.332243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91373fe9-e081-4a20-81ba-005396225b2c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:38.333054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91373fe9-e081-4a20-81ba-005396225b2c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:38.333730 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91373fe9-e081-4a20-81ba-005396225b2c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:38.334283 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-91373fe9-e081-4a20-81ba-005396225b2c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:38.405851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-91373fe9-e081-4a20-81ba-005396225b2c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:38.414231 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-91373fe9-e081-4a20-81ba-005396225b2c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1271 microversion: 2.1 time: 0.096997 Oct 04 22:31:38.414839 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3932/7845] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:38 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:39.437611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b2b588ef-a8ca-4279-9d67-414c06f56ca6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:39.438233 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b2b588ef-a8ca-4279-9d67-414c06f56ca6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:39.445966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b2b588ef-a8ca-4279-9d67-414c06f56ca6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:39.446462 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b2b588ef-a8ca-4279-9d67-414c06f56ca6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:39.449560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b2b588ef-a8ca-4279-9d67-414c06f56ca6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:39.449560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b2b588ef-a8ca-4279-9d67-414c06f56ca6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:39.449560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b2b588ef-a8ca-4279-9d67-414c06f56ca6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:39.449560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b2b588ef-a8ca-4279-9d67-414c06f56ca6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:39.513854 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b2b588ef-a8ca-4279-9d67-414c06f56ca6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:39.521561 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b2b588ef-a8ca-4279-9d67-414c06f56ca6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1325 microversion: 2.1 time: 0.087910 Oct 04 22:31:39.522138 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3914/7846] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:39 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1325 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:40.545458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1d3689f5-1cf0-451b-af63-39699c422e0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:40.546103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1d3689f5-1cf0-451b-af63-39699c422e0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:40.553094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d3689f5-1cf0-451b-af63-39699c422e0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:40.553649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d3689f5-1cf0-451b-af63-39699c422e0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:40.554084 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d3689f5-1cf0-451b-af63-39699c422e0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:40.554803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d3689f5-1cf0-451b-af63-39699c422e0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:40.555282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d3689f5-1cf0-451b-af63-39699c422e0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:40.555726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1d3689f5-1cf0-451b-af63-39699c422e0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:40.702357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1d3689f5-1cf0-451b-af63-39699c422e0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:40.710287 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1d3689f5-1cf0-451b-af63-39699c422e0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1393 microversion: 2.1 time: 0.168991 Oct 04 22:31:40.710891 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3933/7847] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:40 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:40.933745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-3a4180a2-0abe-460c-b174-c87300403a48 req-dc84da9d-d509-404d-af0d-070f45d0e9ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63e432d6-b368-412d-9684-56e485de5109", "tag": "85135b04-66cd-4381-9361-e381cf076644"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:40.947555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3a4180a2-0abe-460c-b174-c87300403a48 req-dc84da9d-d509-404d-af0d-070f45d0e9ac service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:40.947942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3a4180a2-0abe-460c-b174-c87300403a48 req-dc84da9d-d509-404d-af0d-070f45d0e9ac service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:40.948664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-3a4180a2-0abe-460c-b174-c87300403a48 req-dc84da9d-d509-404d-af0d-070f45d0e9ac service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:40.963209 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-3a4180a2-0abe-460c-b174-c87300403a48 req-dc84da9d-d509-404d-af0d-070f45d0e9ac service nova] Creating event network-changed:85135b04-66cd-4381-9361-e381cf076644 for instance 63e432d6-b368-412d-9684-56e485de5109 on n-h1-860282-1 Oct 04 22:31:40.970014 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-3a4180a2-0abe-460c-b174-c87300403a48 req-dc84da9d-d509-404d-af0d-070f45d0e9ac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040030 Oct 04 22:31:40.971512 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3915/7848] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:31:41.735681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b18e0b1b-995a-46eb-9921-a1603a77586d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:41.736309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b18e0b1b-995a-46eb-9921-a1603a77586d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:41.742211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b18e0b1b-995a-46eb-9921-a1603a77586d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:41.742712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b18e0b1b-995a-46eb-9921-a1603a77586d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:41.743162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b18e0b1b-995a-46eb-9921-a1603a77586d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:41.743867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b18e0b1b-995a-46eb-9921-a1603a77586d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:41.744423 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b18e0b1b-995a-46eb-9921-a1603a77586d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:41.744870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b18e0b1b-995a-46eb-9921-a1603a77586d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:41.880824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b18e0b1b-995a-46eb-9921-a1603a77586d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:41.889614 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b18e0b1b-995a-46eb-9921-a1603a77586d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1393 microversion: 2.1 time: 0.159347 Oct 04 22:31:41.890190 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3934/7849] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:41 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:42.912726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7078369b-02c6-4bd5-95b1-cae98f75f04d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:42.913466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7078369b-02c6-4bd5-95b1-cae98f75f04d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:42.920539 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7078369b-02c6-4bd5-95b1-cae98f75f04d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:42.921034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7078369b-02c6-4bd5-95b1-cae98f75f04d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:42.921501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7078369b-02c6-4bd5-95b1-cae98f75f04d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:42.922206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7078369b-02c6-4bd5-95b1-cae98f75f04d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:42.922670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7078369b-02c6-4bd5-95b1-cae98f75f04d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:42.923107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7078369b-02c6-4bd5-95b1-cae98f75f04d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:43.061626 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7078369b-02c6-4bd5-95b1-cae98f75f04d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:43.071910 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7078369b-02c6-4bd5-95b1-cae98f75f04d tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1393 microversion: 2.1 time: 0.163417 Oct 04 22:31:43.072431 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3916/7850] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:42 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:44.096091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dfb22878-d6c0-4662-9c56-e04f08f59943 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:44.096732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dfb22878-d6c0-4662-9c56-e04f08f59943 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:44.104706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dfb22878-d6c0-4662-9c56-e04f08f59943 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:44.105247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dfb22878-d6c0-4662-9c56-e04f08f59943 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:44.105854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dfb22878-d6c0-4662-9c56-e04f08f59943 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:44.106571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dfb22878-d6c0-4662-9c56-e04f08f59943 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:44.107042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dfb22878-d6c0-4662-9c56-e04f08f59943 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:44.107488 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dfb22878-d6c0-4662-9c56-e04f08f59943 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:44.244134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dfb22878-d6c0-4662-9c56-e04f08f59943 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:44.252074 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dfb22878-d6c0-4662-9c56-e04f08f59943 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1393 microversion: 2.1 time: 0.160937 Oct 04 22:31:44.252652 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3935/7851] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:44 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:45.274518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-eff5ff84-1cc7-48ae-bca8-95f5feb3c9f5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:45.275144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-eff5ff84-1cc7-48ae-bca8-95f5feb3c9f5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:45.278127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:45.283796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eff5ff84-1cc7-48ae-bca8-95f5feb3c9f5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:45.284294 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eff5ff84-1cc7-48ae-bca8-95f5feb3c9f5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:45.284745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eff5ff84-1cc7-48ae-bca8-95f5feb3c9f5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:45.285472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eff5ff84-1cc7-48ae-bca8-95f5feb3c9f5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:45.285946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eff5ff84-1cc7-48ae-bca8-95f5feb3c9f5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:45.286394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eff5ff84-1cc7-48ae-bca8-95f5feb3c9f5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:45.417366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-eff5ff84-1cc7-48ae-bca8-95f5feb3c9f5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:45.425865 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-eff5ff84-1cc7-48ae-bca8-95f5feb3c9f5 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1393 microversion: 2.1 time: 0.155102 Oct 04 22:31:45.426315 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3917/7852] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:45 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:45.596435 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-14bad034-8bd0-489c-88d6-5345f56952e7 req-325636dd-a2a0-40b6-8bc3-fdb773b3bede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e432d6-b368-412d-9684-56e485de5109", "name": "network-vif-plugged", "status": "completed", "tag": "85135b04-66cd-4381-9361-e381cf076644"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:45.606609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-14bad034-8bd0-489c-88d6-5345f56952e7 req-325636dd-a2a0-40b6-8bc3-fdb773b3bede service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:45.607332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-14bad034-8bd0-489c-88d6-5345f56952e7 req-325636dd-a2a0-40b6-8bc3-fdb773b3bede service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:45.607789 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-14bad034-8bd0-489c-88d6-5345f56952e7 req-325636dd-a2a0-40b6-8bc3-fdb773b3bede service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:45.618578 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-14bad034-8bd0-489c-88d6-5345f56952e7 req-325636dd-a2a0-40b6-8bc3-fdb773b3bede service nova] Creating event network-vif-plugged:85135b04-66cd-4381-9361-e381cf076644 for instance 63e432d6-b368-412d-9684-56e485de5109 on n-h1-860282-1 Oct 04 22:31:45.623965 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-14bad034-8bd0-489c-88d6-5345f56952e7 req-325636dd-a2a0-40b6-8bc3-fdb773b3bede service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032238 Oct 04 22:31:45.626125 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3936/7853] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:31:46.448260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6de358f3-9bd9-48dd-ba8b-6e7de8cb5537 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:46.448877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6de358f3-9bd9-48dd-ba8b-6e7de8cb5537 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:46.455896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6de358f3-9bd9-48dd-ba8b-6e7de8cb5537 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:46.456382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6de358f3-9bd9-48dd-ba8b-6e7de8cb5537 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:46.456823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6de358f3-9bd9-48dd-ba8b-6e7de8cb5537 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:46.457576 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6de358f3-9bd9-48dd-ba8b-6e7de8cb5537 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:46.458093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6de358f3-9bd9-48dd-ba8b-6e7de8cb5537 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:46.458527 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6de358f3-9bd9-48dd-ba8b-6e7de8cb5537 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:46.589944 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6de358f3-9bd9-48dd-ba8b-6e7de8cb5537 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:46.598100 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6de358f3-9bd9-48dd-ba8b-6e7de8cb5537 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1393 microversion: 2.1 time: 0.153755 Oct 04 22:31:46.598691 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3918/7854] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:46 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:47.620207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:47.621022 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:47.625807 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cd64448c-545d-4cb3-ac44-f35ff3f8685a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:47.626740 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cd64448c-545d-4cb3-ac44-f35ff3f8685a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:47.632851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd64448c-545d-4cb3-ac44-f35ff3f8685a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:47.633351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd64448c-545d-4cb3-ac44-f35ff3f8685a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:47.634381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd64448c-545d-4cb3-ac44-f35ff3f8685a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:47.634576 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd64448c-545d-4cb3-ac44-f35ff3f8685a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:47.635054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd64448c-545d-4cb3-ac44-f35ff3f8685a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:47.635500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cd64448c-545d-4cb3-ac44-f35ff3f8685a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:47.773997 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cd64448c-545d-4cb3-ac44-f35ff3f8685a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:47.782066 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cd64448c-545d-4cb3-ac44-f35ff3f8685a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1564 microversion: 2.1 time: 0.163672 Oct 04 22:31:47.782685 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3937/7855] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:47 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:47.804795 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6ef9b3be-6eb4-4489-9ae3-06224d5284f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:47.805534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6ef9b3be-6eb4-4489-9ae3-06224d5284f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:47.807599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:47.813303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ef9b3be-6eb4-4489-9ae3-06224d5284f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:47.815607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ef9b3be-6eb4-4489-9ae3-06224d5284f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:47.815607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ef9b3be-6eb4-4489-9ae3-06224d5284f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:47.815607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ef9b3be-6eb4-4489-9ae3-06224d5284f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:47.815607 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ef9b3be-6eb4-4489-9ae3-06224d5284f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:47.816020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6ef9b3be-6eb4-4489-9ae3-06224d5284f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:47.947567 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6ef9b3be-6eb4-4489-9ae3-06224d5284f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:47.956006 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6ef9b3be-6eb4-4489-9ae3-06224d5284f9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1564 microversion: 2.1 time: 0.155236 Oct 04 22:31:47.956583 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3919/7856] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:47 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:49.926089 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-06861b88-ee83-4427-9d00-7b807de903f1 req-3381ce29-cf33-4478-9a40-fac12721d554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63e432d6-b368-412d-9684-56e485de5109", "tag": "85135b04-66cd-4381-9361-e381cf076644"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:49.932639 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4cfc1b14-93f9-4708-8c8c-99410da95fa9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:49.933945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4cfc1b14-93f9-4708-8c8c-99410da95fa9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:49.941203 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-06861b88-ee83-4427-9d00-7b807de903f1 req-3381ce29-cf33-4478-9a40-fac12721d554 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:49.941712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-06861b88-ee83-4427-9d00-7b807de903f1 req-3381ce29-cf33-4478-9a40-fac12721d554 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:49.942149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-06861b88-ee83-4427-9d00-7b807de903f1 req-3381ce29-cf33-4478-9a40-fac12721d554 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:49.943658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cfc1b14-93f9-4708-8c8c-99410da95fa9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:49.944550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cfc1b14-93f9-4708-8c8c-99410da95fa9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:49.945517 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cfc1b14-93f9-4708-8c8c-99410da95fa9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:49.946501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cfc1b14-93f9-4708-8c8c-99410da95fa9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:49.947220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cfc1b14-93f9-4708-8c8c-99410da95fa9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:49.947908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4cfc1b14-93f9-4708-8c8c-99410da95fa9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:49.957459 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-06861b88-ee83-4427-9d00-7b807de903f1 req-3381ce29-cf33-4478-9a40-fac12721d554 service nova] Creating event network-changed:85135b04-66cd-4381-9361-e381cf076644 for instance 63e432d6-b368-412d-9684-56e485de5109 on n-h1-860282-1 Oct 04 22:31:49.963090 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-06861b88-ee83-4427-9d00-7b807de903f1 req-3381ce29-cf33-4478-9a40-fac12721d554 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040825 Oct 04 22:31:49.963736 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3920/7857] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:31:50.101398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4cfc1b14-93f9-4708-8c8c-99410da95fa9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:50.113663 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4cfc1b14-93f9-4708-8c8c-99410da95fa9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1564 microversion: 2.1 time: 0.194922 Oct 04 22:31:50.117534 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3938/7858] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:49 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1564 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:11.354191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=7 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:32:11.362050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=34 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:32:11.362050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ee30ad62-abb4-455b-8842-7997c162b927 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:32:11.362285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ee30ad62-abb4-455b-8842-7997c162b927 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:11.368232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ee30ad62-abb4-455b-8842-7997c162b927 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:11.368758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ee30ad62-abb4-455b-8842-7997c162b927 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:11.369178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ee30ad62-abb4-455b-8842-7997c162b927 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:11.369921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ee30ad62-abb4-455b-8842-7997c162b927 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:11.370389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ee30ad62-abb4-455b-8842-7997c162b927 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:11.370827 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ee30ad62-abb4-455b-8842-7997c162b927 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:11.420911 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ee30ad62-abb4-455b-8842-7997c162b927 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109/action" status: 200 len: 24578 microversion: 2.1 time: 0.068475 Oct 04 22:32:11.421821 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3921/7859] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:32:11 2022] POST /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109/action => generated 24578 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:32:17.823987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ff024cf2-69c6-4c96-9345-e3a231c35bdf tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:32:17.826166 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:32:17.826922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=40 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:32:17.831617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff024cf2-69c6-4c96-9345-e3a231c35bdf tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:17.832121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff024cf2-69c6-4c96-9345-e3a231c35bdf tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:17.832580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ff024cf2-69c6-4c96-9345-e3a231c35bdf tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:17.854744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ff024cf2-69c6-4c96-9345-e3a231c35bdf tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Going to try to stop instance {{(pid=122757) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 22:32:18.003901 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ff024cf2-69c6-4c96-9345-e3a231c35bdf tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109/action" status: 202 len: 0 microversion: 2.1 time: 0.183999 Oct 04 22:32:18.004516 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3939/7860] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:32:17 2022] POST /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:32:18.013867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1ccf5854-43f3-4082-8420-92d858cfad5e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:18.014691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1ccf5854-43f3-4082-8420-92d858cfad5e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:18.022015 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ccf5854-43f3-4082-8420-92d858cfad5e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:18.022496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ccf5854-43f3-4082-8420-92d858cfad5e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:18.022942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ccf5854-43f3-4082-8420-92d858cfad5e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:18.023643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ccf5854-43f3-4082-8420-92d858cfad5e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:18.024106 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ccf5854-43f3-4082-8420-92d858cfad5e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:18.024544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1ccf5854-43f3-4082-8420-92d858cfad5e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:18.164475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1ccf5854-43f3-4082-8420-92d858cfad5e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:18.172579 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1ccf5854-43f3-4082-8420-92d858cfad5e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1692 microversion: 2.1 time: 0.163644 Oct 04 22:32:18.173152 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3922/7861] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:18 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:19.197035 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-725dd6ea-321d-407c-b5bc-2558b3b4540b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:19.197799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-725dd6ea-321d-407c-b5bc-2558b3b4540b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:19.205122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-725dd6ea-321d-407c-b5bc-2558b3b4540b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:19.205691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-725dd6ea-321d-407c-b5bc-2558b3b4540b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:19.206161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-725dd6ea-321d-407c-b5bc-2558b3b4540b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:19.206878 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-725dd6ea-321d-407c-b5bc-2558b3b4540b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:19.207357 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-725dd6ea-321d-407c-b5bc-2558b3b4540b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:19.207806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-725dd6ea-321d-407c-b5bc-2558b3b4540b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:19.340706 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-725dd6ea-321d-407c-b5bc-2558b3b4540b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:19.349214 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-725dd6ea-321d-407c-b5bc-2558b3b4540b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1692 microversion: 2.1 time: 0.156502 Oct 04 22:32:19.354782 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3940/7862] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:19 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:20.375856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7c6c6cf4-c75c-41a7-bb11-c4b3c727ffe4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:20.377214 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7c6c6cf4-c75c-41a7-bb11-c4b3c727ffe4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:20.384635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c6c6cf4-c75c-41a7-bb11-c4b3c727ffe4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:20.385756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c6c6cf4-c75c-41a7-bb11-c4b3c727ffe4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:20.385756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c6c6cf4-c75c-41a7-bb11-c4b3c727ffe4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:20.386332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c6c6cf4-c75c-41a7-bb11-c4b3c727ffe4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:20.386800 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c6c6cf4-c75c-41a7-bb11-c4b3c727ffe4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:20.387378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7c6c6cf4-c75c-41a7-bb11-c4b3c727ffe4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:20.524184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7c6c6cf4-c75c-41a7-bb11-c4b3c727ffe4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:20.531995 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7c6c6cf4-c75c-41a7-bb11-c4b3c727ffe4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1692 microversion: 2.1 time: 0.160403 Oct 04 22:32:20.537022 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3923/7863] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:20 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:21.555660 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-40549710-29e3-41ff-8961-f4d6920911b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:21.556292 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-40549710-29e3-41ff-8961-f4d6920911b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:21.563074 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40549710-29e3-41ff-8961-f4d6920911b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:21.563572 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40549710-29e3-41ff-8961-f4d6920911b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:21.564056 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40549710-29e3-41ff-8961-f4d6920911b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:21.564839 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40549710-29e3-41ff-8961-f4d6920911b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:21.565315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40549710-29e3-41ff-8961-f4d6920911b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:21.565781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-40549710-29e3-41ff-8961-f4d6920911b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:21.696385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-40549710-29e3-41ff-8961-f4d6920911b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:21.704175 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-40549710-29e3-41ff-8961-f4d6920911b3 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1692 microversion: 2.1 time: 0.152494 Oct 04 22:32:21.705324 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3941/7864] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:21 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:22.727931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cfd831df-6872-493c-8d63-6639d6a1835b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:22.728554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cfd831df-6872-493c-8d63-6639d6a1835b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:22.735635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfd831df-6872-493c-8d63-6639d6a1835b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:22.736898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfd831df-6872-493c-8d63-6639d6a1835b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:22.737378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfd831df-6872-493c-8d63-6639d6a1835b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:22.738100 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfd831df-6872-493c-8d63-6639d6a1835b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:22.738564 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfd831df-6872-493c-8d63-6639d6a1835b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:22.739000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cfd831df-6872-493c-8d63-6639d6a1835b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:22.875240 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cfd831df-6872-493c-8d63-6639d6a1835b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:22.884618 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cfd831df-6872-493c-8d63-6639d6a1835b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1692 microversion: 2.1 time: 0.160622 Oct 04 22:32:22.885549 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3924/7865] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:22 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:23.919709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cf435e87-000e-464f-b737-1cf857953243 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:23.920359 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cf435e87-000e-464f-b737-1cf857953243 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:23.927787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf435e87-000e-464f-b737-1cf857953243 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:23.928293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf435e87-000e-464f-b737-1cf857953243 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:23.928753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf435e87-000e-464f-b737-1cf857953243 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:23.929480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf435e87-000e-464f-b737-1cf857953243 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:23.929958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf435e87-000e-464f-b737-1cf857953243 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:23.930413 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cf435e87-000e-464f-b737-1cf857953243 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:24.060884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cf435e87-000e-464f-b737-1cf857953243 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:24.069295 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cf435e87-000e-464f-b737-1cf857953243 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1692 microversion: 2.1 time: 0.153516 Oct 04 22:32:24.069907 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3942/7866] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:23 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:32:25.092935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bd2eb2a8-3ac0-4ac9-83a3-7ecbad3e9669 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:25.093588 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bd2eb2a8-3ac0-4ac9-83a3-7ecbad3e9669 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:25.101150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd2eb2a8-3ac0-4ac9-83a3-7ecbad3e9669 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:25.101699 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd2eb2a8-3ac0-4ac9-83a3-7ecbad3e9669 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:25.102157 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd2eb2a8-3ac0-4ac9-83a3-7ecbad3e9669 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:25.102906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd2eb2a8-3ac0-4ac9-83a3-7ecbad3e9669 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:25.103370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd2eb2a8-3ac0-4ac9-83a3-7ecbad3e9669 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:25.103807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bd2eb2a8-3ac0-4ac9-83a3-7ecbad3e9669 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:25.238763 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-bd2eb2a8-3ac0-4ac9-83a3-7ecbad3e9669 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:25.244090 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bd2eb2a8-3ac0-4ac9-83a3-7ecbad3e9669 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1692 microversion: 2.1 time: 0.155182 Oct 04 22:32:25.244668 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3925/7867] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:25 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:26.268225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8c51d6d8-6a61-4755-803a-b5beb65c8718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:26.268783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8c51d6d8-6a61-4755-803a-b5beb65c8718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:26.275696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c51d6d8-6a61-4755-803a-b5beb65c8718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:26.276205 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c51d6d8-6a61-4755-803a-b5beb65c8718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:26.276680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c51d6d8-6a61-4755-803a-b5beb65c8718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:26.277381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c51d6d8-6a61-4755-803a-b5beb65c8718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:26.277900 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c51d6d8-6a61-4755-803a-b5beb65c8718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:26.278340 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8c51d6d8-6a61-4755-803a-b5beb65c8718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:26.418595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8c51d6d8-6a61-4755-803a-b5beb65c8718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:26.427345 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8c51d6d8-6a61-4755-803a-b5beb65c8718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1692 microversion: 2.1 time: 0.163155 Oct 04 22:32:26.427932 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3943/7868] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:26 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:27.450499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ec678350-729a-4380-a399-9b44c6ad86ab tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:27.451101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ec678350-729a-4380-a399-9b44c6ad86ab tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:27.458298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec678350-729a-4380-a399-9b44c6ad86ab tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:27.458822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec678350-729a-4380-a399-9b44c6ad86ab tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:27.459268 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec678350-729a-4380-a399-9b44c6ad86ab tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:27.460007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec678350-729a-4380-a399-9b44c6ad86ab tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:27.460468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec678350-729a-4380-a399-9b44c6ad86ab tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:27.460902 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec678350-729a-4380-a399-9b44c6ad86ab tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:27.597023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ec678350-729a-4380-a399-9b44c6ad86ab tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:27.604758 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ec678350-729a-4380-a399-9b44c6ad86ab tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1692 microversion: 2.1 time: 0.158216 Oct 04 22:32:27.605326 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3926/7869] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:27 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:28.629202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c2d6b317-7ec7-4db0-9c94-ae9b473e9644 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:28.629874 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c2d6b317-7ec7-4db0-9c94-ae9b473e9644 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:28.636787 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2d6b317-7ec7-4db0-9c94-ae9b473e9644 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:28.637315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2d6b317-7ec7-4db0-9c94-ae9b473e9644 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:28.637848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2d6b317-7ec7-4db0-9c94-ae9b473e9644 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:28.638552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2d6b317-7ec7-4db0-9c94-ae9b473e9644 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:28.639027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2d6b317-7ec7-4db0-9c94-ae9b473e9644 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:28.639469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c2d6b317-7ec7-4db0-9c94-ae9b473e9644 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:28.773512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c2d6b317-7ec7-4db0-9c94-ae9b473e9644 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:28.781257 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c2d6b317-7ec7-4db0-9c94-ae9b473e9644 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1669 microversion: 2.1 time: 0.156816 Oct 04 22:32:28.781862 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3944/7870] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:28 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:29.876617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ae80c11c-370f-4133-9aa7-86a54447ea48 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:32:29.879572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ae80c11c-370f-4133-9aa7-86a54447ea48 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:29.886487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae80c11c-370f-4133-9aa7-86a54447ea48 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:29.886978 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae80c11c-370f-4133-9aa7-86a54447ea48 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:29.887420 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae80c11c-370f-4133-9aa7-86a54447ea48 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:29.888123 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae80c11c-370f-4133-9aa7-86a54447ea48 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:29.888584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae80c11c-370f-4133-9aa7-86a54447ea48 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:29.889017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ae80c11c-370f-4133-9aa7-86a54447ea48 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:29.938284 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ae80c11c-370f-4133-9aa7-86a54447ea48 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109/action" status: 200 len: 35885 microversion: 2.1 time: 0.065774 Oct 04 22:32:29.938924 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3927/7871] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:32:29 2022] POST /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109/action => generated 35885 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:32:29.951326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ae38f9d9-4587-47ab-8c2d-2a96bf657a03 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:32:29.958315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae38f9d9-4587-47ab-8c2d-2a96bf657a03 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:29.958825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae38f9d9-4587-47ab-8c2d-2a96bf657a03 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:29.959320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ae38f9d9-4587-47ab-8c2d-2a96bf657a03 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:29.981408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ae38f9d9-4587-47ab-8c2d-2a96bf657a03 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Going to try to start instance {{(pid=122757) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 22:32:30.176099 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ae38f9d9-4587-47ab-8c2d-2a96bf657a03 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109/action" status: 202 len: 0 microversion: 2.1 time: 0.226519 Oct 04 22:32:30.176625 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3945/7872] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:32:29 2022] POST /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:32:30.185651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-01066cd1-846e-4c17-a79d-73fc7a6a9b96 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:30.186367 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-01066cd1-846e-4c17-a79d-73fc7a6a9b96 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:30.194950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01066cd1-846e-4c17-a79d-73fc7a6a9b96 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:30.194950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01066cd1-846e-4c17-a79d-73fc7a6a9b96 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:30.194950 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01066cd1-846e-4c17-a79d-73fc7a6a9b96 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:30.195620 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01066cd1-846e-4c17-a79d-73fc7a6a9b96 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:30.196291 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01066cd1-846e-4c17-a79d-73fc7a6a9b96 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:30.197128 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01066cd1-846e-4c17-a79d-73fc7a6a9b96 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:30.343949 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-01066cd1-846e-4c17-a79d-73fc7a6a9b96 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:30.353681 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-01066cd1-846e-4c17-a79d-73fc7a6a9b96 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1678 microversion: 2.1 time: 0.172261 Oct 04 22:32:30.354272 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3928/7873] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:30 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:31.380922 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-43f0cbb2-ceba-45cc-914f-4d052969f1f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:31.381693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-43f0cbb2-ceba-45cc-914f-4d052969f1f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:31.388031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43f0cbb2-ceba-45cc-914f-4d052969f1f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:31.388544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43f0cbb2-ceba-45cc-914f-4d052969f1f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:31.389006 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43f0cbb2-ceba-45cc-914f-4d052969f1f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:31.389758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43f0cbb2-ceba-45cc-914f-4d052969f1f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:31.390248 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43f0cbb2-ceba-45cc-914f-4d052969f1f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:31.390693 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-43f0cbb2-ceba-45cc-914f-4d052969f1f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:31.530332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-43f0cbb2-ceba-45cc-914f-4d052969f1f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:31.539207 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-43f0cbb2-ceba-45cc-914f-4d052969f1f6 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1678 microversion: 2.1 time: 0.164327 Oct 04 22:32:31.539830 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3946/7874] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:31 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:32.563667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1b8a6b3a-adc1-4b74-9fe7-bf1ec7181050 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:32.564287 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1b8a6b3a-adc1-4b74-9fe7-bf1ec7181050 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:32.571735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b8a6b3a-adc1-4b74-9fe7-bf1ec7181050 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:32.572229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b8a6b3a-adc1-4b74-9fe7-bf1ec7181050 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:32.572677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b8a6b3a-adc1-4b74-9fe7-bf1ec7181050 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:32.573378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b8a6b3a-adc1-4b74-9fe7-bf1ec7181050 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:32.573865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b8a6b3a-adc1-4b74-9fe7-bf1ec7181050 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:32.574297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1b8a6b3a-adc1-4b74-9fe7-bf1ec7181050 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:32.706512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1b8a6b3a-adc1-4b74-9fe7-bf1ec7181050 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:32.714530 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1b8a6b3a-adc1-4b74-9fe7-bf1ec7181050 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1682 microversion: 2.1 time: 0.154815 Oct 04 22:32:32.715103 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3929/7875] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:32 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:54.898546 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7922b7ec-7c93-4d57-bc47-fa76bf6e90bb tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:32:54.902159 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7922b7ec-7c93-4d57-bc47-fa76bf6e90bb tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:54.904410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=16 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:32:54.905091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:32:54.910239 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7922b7ec-7c93-4d57-bc47-fa76bf6e90bb tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:54.912137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7922b7ec-7c93-4d57-bc47-fa76bf6e90bb tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:54.912137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7922b7ec-7c93-4d57-bc47-fa76bf6e90bb tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:54.912137 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7922b7ec-7c93-4d57-bc47-fa76bf6e90bb tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:54.912501 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7922b7ec-7c93-4d57-bc47-fa76bf6e90bb tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:54.912999 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7922b7ec-7c93-4d57-bc47-fa76bf6e90bb tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:54.966676 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7922b7ec-7c93-4d57-bc47-fa76bf6e90bb tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109/action" status: 200 len: 60448 microversion: 2.1 time: 0.073178 Oct 04 22:32:54.967357 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3947/7876] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:32:54 2022] POST /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109/action => generated 60448 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:33:02.370964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-31e099d8-51a8-4c9c-a22b-cf8786c5e762 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:02.371496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-31e099d8-51a8-4c9c-a22b-cf8786c5e762 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:02.374103 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=18 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:02.374577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-6ecc6cb4-362d-4e06-a2ca-5b7882d9f3aa req-ff51bee1-c080-48c6-a6f6-458a3adfd432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63e432d6-b368-412d-9684-56e485de5109", "tag": "85135b04-66cd-4381-9361-e381cf076644"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:33:02.376032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=50 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:02.377072 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:33:02.377204 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 22:33:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 (ip 10.222.0.30) !!! Oct 04 22:33:02.383451 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31e099d8-51a8-4c9c-a22b-cf8786c5e762 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:02.393102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31e099d8-51a8-4c9c-a22b-cf8786c5e762 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:02.393102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31e099d8-51a8-4c9c-a22b-cf8786c5e762 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:02.393102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31e099d8-51a8-4c9c-a22b-cf8786c5e762 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:02.393102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31e099d8-51a8-4c9c-a22b-cf8786c5e762 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:02.393102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-31e099d8-51a8-4c9c-a22b-cf8786c5e762 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:02.394890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6ecc6cb4-362d-4e06-a2ca-5b7882d9f3aa req-ff51bee1-c080-48c6-a6f6-458a3adfd432 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:02.395397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6ecc6cb4-362d-4e06-a2ca-5b7882d9f3aa req-ff51bee1-c080-48c6-a6f6-458a3adfd432 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:02.395851 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-6ecc6cb4-362d-4e06-a2ca-5b7882d9f3aa req-ff51bee1-c080-48c6-a6f6-458a3adfd432 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:02.407784 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-6ecc6cb4-362d-4e06-a2ca-5b7882d9f3aa req-ff51bee1-c080-48c6-a6f6-458a3adfd432 service nova] Creating event network-changed:85135b04-66cd-4381-9361-e381cf076644 for instance 63e432d6-b368-412d-9684-56e485de5109 on n-h1-860282-1 Oct 04 22:33:02.413922 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-6ecc6cb4-362d-4e06-a2ca-5b7882d9f3aa req-ff51bee1-c080-48c6-a6f6-458a3adfd432 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044746 Oct 04 22:33:02.414765 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3948/7877] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:33:02.415063 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-31e099d8-51a8-4c9c-a22b-cf8786c5e762 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:33:02.721192 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-31e099d8-51a8-4c9c-a22b-cf8786c5e762 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "DELETE /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 204 len: 0 microversion: 2.1 time: 0.353726 Oct 04 22:33:02.721192 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3930/7878] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:33:02 2022] DELETE /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:33:02.730955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-19b1f3d2-cfe0-4ba6-876d-19cc26a0bc0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:02.731835 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-19b1f3d2-cfe0-4ba6-876d-19cc26a0bc0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:02.739833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19b1f3d2-cfe0-4ba6-876d-19cc26a0bc0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:02.740455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19b1f3d2-cfe0-4ba6-876d-19cc26a0bc0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:02.741140 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19b1f3d2-cfe0-4ba6-876d-19cc26a0bc0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:02.741986 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19b1f3d2-cfe0-4ba6-876d-19cc26a0bc0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:02.742568 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19b1f3d2-cfe0-4ba6-876d-19cc26a0bc0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:02.743029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-19b1f3d2-cfe0-4ba6-876d-19cc26a0bc0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:02.880995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-19b1f3d2-cfe0-4ba6-876d-19cc26a0bc0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:02.889195 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-19b1f3d2-cfe0-4ba6-876d-19cc26a0bc0f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1688 microversion: 2.1 time: 0.162904 Oct 04 22:33:02.893181 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3949/7879] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:02 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:03.916348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a620b7ba-ebec-4c2c-bad6-19e6cfae0c29 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:03.917070 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a620b7ba-ebec-4c2c-bad6-19e6cfae0c29 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:03.924650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a620b7ba-ebec-4c2c-bad6-19e6cfae0c29 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:03.925159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a620b7ba-ebec-4c2c-bad6-19e6cfae0c29 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:03.925643 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a620b7ba-ebec-4c2c-bad6-19e6cfae0c29 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:03.926480 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a620b7ba-ebec-4c2c-bad6-19e6cfae0c29 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:03.926951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a620b7ba-ebec-4c2c-bad6-19e6cfae0c29 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:03.927958 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a620b7ba-ebec-4c2c-bad6-19e6cfae0c29 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:04.068828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a620b7ba-ebec-4c2c-bad6-19e6cfae0c29 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:04.076851 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a620b7ba-ebec-4c2c-bad6-19e6cfae0c29 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1688 microversion: 2.1 time: 0.165893 Oct 04 22:33:04.077544 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3931/7880] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:03 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:04.643684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-1c96ee24-a6ca-4e6f-9187-4b0f83aeba1f req-d2bd4b56-a96d-48cb-b2db-ccc32093b147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e432d6-b368-412d-9684-56e485de5109", "name": "network-vif-deleted", "tag": "85135b04-66cd-4381-9361-e381cf076644"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:33:04.654235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1c96ee24-a6ca-4e6f-9187-4b0f83aeba1f req-d2bd4b56-a96d-48cb-b2db-ccc32093b147 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:04.654744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1c96ee24-a6ca-4e6f-9187-4b0f83aeba1f req-d2bd4b56-a96d-48cb-b2db-ccc32093b147 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:04.655200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1c96ee24-a6ca-4e6f-9187-4b0f83aeba1f req-d2bd4b56-a96d-48cb-b2db-ccc32093b147 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:04.666946 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-1c96ee24-a6ca-4e6f-9187-4b0f83aeba1f req-d2bd4b56-a96d-48cb-b2db-ccc32093b147 service nova] Creating event network-vif-deleted:85135b04-66cd-4381-9361-e381cf076644 for instance 63e432d6-b368-412d-9684-56e485de5109 on n-h1-860282-1 Oct 04 22:33:04.673098 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-1c96ee24-a6ca-4e6f-9187-4b0f83aeba1f req-d2bd4b56-a96d-48cb-b2db-ccc32093b147 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033077 Oct 04 22:33:04.673758 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3950/7881] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:33:05.101611 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b3f272ba-550e-44ab-ba41-8d645a9ffe55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:05.102228 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b3f272ba-550e-44ab-ba41-8d645a9ffe55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:05.109468 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3f272ba-550e-44ab-ba41-8d645a9ffe55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:05.109906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3f272ba-550e-44ab-ba41-8d645a9ffe55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:05.110372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3f272ba-550e-44ab-ba41-8d645a9ffe55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:05.111068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3f272ba-550e-44ab-ba41-8d645a9ffe55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:05.111557 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3f272ba-550e-44ab-ba41-8d645a9ffe55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:05.111986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3f272ba-550e-44ab-ba41-8d645a9ffe55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:05.144556 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3f272ba-550e-44ab-ba41-8d645a9ffe55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:05.145047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3f272ba-550e-44ab-ba41-8d645a9ffe55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:05.145530 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3f272ba-550e-44ab-ba41-8d645a9ffe55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:05.146485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-b3f272ba-550e-44ab-ba41-8d645a9ffe55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lazy-loading 'fault' on Instance uuid 63e432d6-b368-412d-9684-56e485de5109 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:33:05.186452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b3f272ba-550e-44ab-ba41-8d645a9ffe55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:05.194806 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b3f272ba-550e-44ab-ba41-8d645a9ffe55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 200 len: 1357 microversion: 2.1 time: 0.098188 Oct 04 22:33:05.195510 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3932/7882] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:05 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 1357 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:06.220089 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-10bc2e1e-183b-4cf6-916b-c586e2161dd9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:06.220809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-10bc2e1e-183b-4cf6-916b-c586e2161dd9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: 63e432d6-b368-412d-9684-56e485de5109] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:06.227753 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10bc2e1e-183b-4cf6-916b-c586e2161dd9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:06.228250 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10bc2e1e-183b-4cf6-916b-c586e2161dd9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:06.228734 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10bc2e1e-183b-4cf6-916b-c586e2161dd9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:06.229458 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10bc2e1e-183b-4cf6-916b-c586e2161dd9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:06.229939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10bc2e1e-183b-4cf6-916b-c586e2161dd9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:06.230382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-10bc2e1e-183b-4cf6-916b-c586e2161dd9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:06.244452 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-10bc2e1e-183b-4cf6-916b-c586e2161dd9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] HTTP exception thrown: Instance 63e432d6-b368-412d-9684-56e485de5109 could not be found. Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-10bc2e1e-183b-4cf6-916b-c586e2161dd9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Request method failure captured: Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 HTTP/1.1 Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPLMZuTLnApqSMxiBV15PI5S_RjEXV0e6DgU6tkVSj3Qbs_Cnvc6Wu6b-YKVM5qs41najaSVYiQoC8_V32Y3kjBm4UYmmPnCk923S11FSQGy-h7LMSKU4E0ZEbT2AhOP4CO6e2ZA15WGFizXGUgRcI6so0AfyEB2d3Mi5xsLsph4NZQo Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: ef5ef0af634f40c598c43019f28afb5b Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-377632635 Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef5ef0af634f40c598c43019f28afb5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ef5ef0af634f40c598c43019f28afb5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ef5ef0af634f40c598c43019f28afb5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef5ef0af634f40c598c43019f28afb5b"}]}] Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestNetworkAdvancedServerOps-377632635 Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: ef5ef0af634f40c598c43019f28afb5b Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-377632635 Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestNetworkAdvancedServerOps-377632635-project Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 3ead2dace0aa45419aa7f8a2cd8d2104 Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestNetworkAdvancedServerOps-377632635-project Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 63e432d6-b368-412d-9684-56e485de5109 could not be found. Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '63e432d6-b368-412d-9684-56e485de5109'} Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63e432d6-b368-412d-9684-56e485de5109 could not be found. Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63e432d6-b368-412d-9684-56e485de5109 could not be found. Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:33:06.246108 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:33:06.251663 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:33:06.251663 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:33:06.251663 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:33:06.251663 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:33:06.251663 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:33:06.251663 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:33:06.251663 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63e432d6-b368-412d-9684-56e485de5109 could not be found. Oct 04 22:33:06.251663 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:33:06.251663 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-10bc2e1e-183b-4cf6-916b-c586e2161dd9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Returning 404 to user: Instance 63e432d6-b368-412d-9684-56e485de5109 could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:33:06.251663 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-10bc2e1e-183b-4cf6-916b-c586e2161dd9 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109" status: 404 len: 111 microversion: 2.1 time: 0.032749 Oct 04 22:33:06.251663 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3951/7883] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:06 2022] GET /compute/v2.1/servers/63e432d6-b368-412d-9684-56e485de5109 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:33:09.735821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-87dbb508-d949-42d1-baa1-f03166fee09a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '.version_select at 0x7f578bbca9d0>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:09.812700 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-87dbb508-d949-42d1-baa1-f03166fee09a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1382061906" status: 202 len: 0 microversion: 2.1 time: 0.080714 Oct 04 22:33:09.813239 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3933/7884] 10.222.0.30 () {58 vars in 1284 bytes} [Tue Oct 4 22:33:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1382061906 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:33:09.846131 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a4ec395d-9f53-4918-8dcb-d05549fff590 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'create', calling method: .version_select at 0x7f578b54f940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1866651510", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnmldtsmh45UJ4NQvNiXxY/UAzqYCE/djCvQKNVr8fKQfOarlkF2zZzoqh4oVfCqip1FUB8sEy01DFwfAjHCNG0pXTk+OV3SYk+J4jMY3Z9aFZs8ywVsxeTgw/vYJ8eaQ=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:33:09.863480 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-a4ec395d-9f53-4918-8dcb-d05549fff590 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for project ef5ef0af634f40c598c43019f28afb5b. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:33:09.868681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-a4ec395d-9f53-4918-8dcb-d05549fff590 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for user 3ead2dace0aa45419aa7f8a2cd8d2104 and project ef5ef0af634f40c598c43019f28afb5b. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:33:09.960170 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a4ec395d-9f53-4918-8dcb-d05549fff590 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.118003 Oct 04 22:33:09.960772 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3952/7885] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 22:33:09 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:33:17.987313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:17.991409 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-62f5af83-e9e4-46b5-a4a3-e1bb36fabdfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1482867966", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "networks": [{"uuid": "6494e5fb-5184-4dd6-849f-a1351443982e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1866651510", "security_groups": [{"name": "tempest-secgroup-smoke-64767540"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:33:18.121604 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-62f5af83-e9e4-46b5-a4a3-e1bb36fabdfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] validate_networks() for [('6494e5fb-5184-4dd6-849f-a1351443982e', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:33:18.608071 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-62f5af83-e9e4-46b5-a4a3-e1bb36fabdfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:33:18.608418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-62f5af83-e9e4-46b5-a4a3-e1bb36fabdfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:33:18.608899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-62f5af83-e9e4-46b5-a4a3-e1bb36fabdfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:33:18.609315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-62f5af83-e9e4-46b5-a4a3-e1bb36fabdfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:33:18.609774 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-62f5af83-e9e4-46b5-a4a3-e1bb36fabdfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:33:18.622101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62f5af83-e9e4-46b5-a4a3-e1bb36fabdfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:18.622712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62f5af83-e9e4-46b5-a4a3-e1bb36fabdfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:18.623637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62f5af83-e9e4-46b5-a4a3-e1bb36fabdfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:18.624811 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62f5af83-e9e4-46b5-a4a3-e1bb36fabdfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:18.625469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62f5af83-e9e4-46b5-a4a3-e1bb36fabdfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:18.626266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-62f5af83-e9e4-46b5-a4a3-e1bb36fabdfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:18.651899 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-62f5af83-e9e4-46b5-a4a3-e1bb36fabdfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for project ef5ef0af634f40c598c43019f28afb5b. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:33:18.658757 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-62f5af83-e9e4-46b5-a4a3-e1bb36fabdfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Getting quotas for user 3ead2dace0aa45419aa7f8a2cd8d2104 and project ef5ef0af634f40c598c43019f28afb5b. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:33:18.677085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-62f5af83-e9e4-46b5-a4a3-e1bb36fabdfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:33:18.680424 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-62f5af83-e9e4-46b5-a4a3-e1bb36fabdfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:33:18.811610 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-62f5af83-e9e4-46b5-a4a3-e1bb36fabdfe tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.826121 Oct 04 22:33:18.812371 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3934/7886] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:33:17 2022] POST /compute/v2.1/servers => generated 404 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:33:18.823145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=16 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:18.828072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4c893c11-f352-4df2-aeb9-987162d926e4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:18.829272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4c893c11-f352-4df2-aeb9-987162d926e4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:18.904944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4c893c11-f352-4df2-aeb9-987162d926e4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:18.917269 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4c893c11-f352-4df2-aeb9-987162d926e4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1267 microversion: 2.1 time: 0.096309 Oct 04 22:33:18.918895 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3953/7887] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:18 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:19.942043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ba44d10c-510d-43cc-92a3-2ede33af2f7b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:19.942648 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ba44d10c-510d-43cc-92a3-2ede33af2f7b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:19.954286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba44d10c-510d-43cc-92a3-2ede33af2f7b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:19.954785 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba44d10c-510d-43cc-92a3-2ede33af2f7b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:19.955224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba44d10c-510d-43cc-92a3-2ede33af2f7b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:19.955936 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba44d10c-510d-43cc-92a3-2ede33af2f7b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:19.956395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba44d10c-510d-43cc-92a3-2ede33af2f7b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:19.956822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ba44d10c-510d-43cc-92a3-2ede33af2f7b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:20.056583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ba44d10c-510d-43cc-92a3-2ede33af2f7b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:20.064324 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ba44d10c-510d-43cc-92a3-2ede33af2f7b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1263 microversion: 2.1 time: 0.127340 Oct 04 22:33:20.064894 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3935/7888] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:19 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1263 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:21.091418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f4ba2722-c45e-4be1-a844-9b970bb9f718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:21.093011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f4ba2722-c45e-4be1-a844-9b970bb9f718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:21.103842 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4ba2722-c45e-4be1-a844-9b970bb9f718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:21.107230 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4ba2722-c45e-4be1-a844-9b970bb9f718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:21.108850 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4ba2722-c45e-4be1-a844-9b970bb9f718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:21.109765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4ba2722-c45e-4be1-a844-9b970bb9f718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:21.110484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4ba2722-c45e-4be1-a844-9b970bb9f718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:21.111024 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f4ba2722-c45e-4be1-a844-9b970bb9f718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:21.191634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f4ba2722-c45e-4be1-a844-9b970bb9f718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:21.199792 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f4ba2722-c45e-4be1-a844-9b970bb9f718 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1337 microversion: 2.1 time: 0.115408 Oct 04 22:33:21.200392 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3954/7889] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:21 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1337 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:22.224384 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a9cdac8-79d7-4fd6-ad36-2c7812b08781 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:22.225000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7a9cdac8-79d7-4fd6-ad36-2c7812b08781 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:22.232102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a9cdac8-79d7-4fd6-ad36-2c7812b08781 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:22.232600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a9cdac8-79d7-4fd6-ad36-2c7812b08781 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:22.233042 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a9cdac8-79d7-4fd6-ad36-2c7812b08781 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:22.233769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a9cdac8-79d7-4fd6-ad36-2c7812b08781 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:22.234226 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a9cdac8-79d7-4fd6-ad36-2c7812b08781 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:22.234656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a9cdac8-79d7-4fd6-ad36-2c7812b08781 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:22.450976 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7a9cdac8-79d7-4fd6-ad36-2c7812b08781 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:22.458773 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7a9cdac8-79d7-4fd6-ad36-2c7812b08781 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1391 microversion: 2.1 time: 0.238306 Oct 04 22:33:22.459346 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3936/7890] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:22 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1391 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:23.019582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-9a4fba0b-cd24-4f79-82cc-4a6221842742 req-2145889e-9880-4902-a136-b3cfeed5b18f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f365db-fa51-4059-be89-c0bad2ac8165", "tag": "9968d86e-4e06-4bb2-805e-e2033207d7fc"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:33:23.032355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9a4fba0b-cd24-4f79-82cc-4a6221842742 req-2145889e-9880-4902-a136-b3cfeed5b18f service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:23.037773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9a4fba0b-cd24-4f79-82cc-4a6221842742 req-2145889e-9880-4902-a136-b3cfeed5b18f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:23.037773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9a4fba0b-cd24-4f79-82cc-4a6221842742 req-2145889e-9880-4902-a136-b3cfeed5b18f service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:23.048434 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-9a4fba0b-cd24-4f79-82cc-4a6221842742 req-2145889e-9880-4902-a136-b3cfeed5b18f service nova] Creating event network-changed:9968d86e-4e06-4bb2-805e-e2033207d7fc for instance c0f365db-fa51-4059-be89-c0bad2ac8165 on n-h2-860282-1 Oct 04 22:33:23.054898 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-9a4fba0b-cd24-4f79-82cc-4a6221842742 req-2145889e-9880-4902-a136-b3cfeed5b18f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041043 Oct 04 22:33:23.055890 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3955/7891] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:33:23.481722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-eb98b636-0282-466b-8858-513d9fbaef3e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:23.482344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-eb98b636-0282-466b-8858-513d9fbaef3e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:23.489244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eb98b636-0282-466b-8858-513d9fbaef3e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:23.489767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eb98b636-0282-466b-8858-513d9fbaef3e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:23.490212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eb98b636-0282-466b-8858-513d9fbaef3e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:23.490915 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eb98b636-0282-466b-8858-513d9fbaef3e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:23.491374 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eb98b636-0282-466b-8858-513d9fbaef3e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:23.491805 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-eb98b636-0282-466b-8858-513d9fbaef3e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:23.717728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-eb98b636-0282-466b-8858-513d9fbaef3e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:23.725607 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-eb98b636-0282-466b-8858-513d9fbaef3e tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1391 microversion: 2.1 time: 0.247875 Oct 04 22:33:23.726195 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3937/7892] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:23 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1391 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:24.749173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-67ee1d1b-1acb-40b6-aa23-8bb5a330bb91 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:24.750172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-67ee1d1b-1acb-40b6-aa23-8bb5a330bb91 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:24.756399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67ee1d1b-1acb-40b6-aa23-8bb5a330bb91 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:24.756905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67ee1d1b-1acb-40b6-aa23-8bb5a330bb91 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:24.757358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67ee1d1b-1acb-40b6-aa23-8bb5a330bb91 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:24.758954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67ee1d1b-1acb-40b6-aa23-8bb5a330bb91 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:24.759431 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67ee1d1b-1acb-40b6-aa23-8bb5a330bb91 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:24.759876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-67ee1d1b-1acb-40b6-aa23-8bb5a330bb91 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:24.898317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-67ee1d1b-1acb-40b6-aa23-8bb5a330bb91 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:24.907276 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-67ee1d1b-1acb-40b6-aa23-8bb5a330bb91 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1391 microversion: 2.1 time: 0.163216 Oct 04 22:33:24.907931 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3956/7893] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:24 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:25.930412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5bf93bba-9276-4138-b893-34bfb7d0a371 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:25.931017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5bf93bba-9276-4138-b893-34bfb7d0a371 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:25.937872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bf93bba-9276-4138-b893-34bfb7d0a371 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:25.938361 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bf93bba-9276-4138-b893-34bfb7d0a371 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:25.938806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bf93bba-9276-4138-b893-34bfb7d0a371 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:25.939498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bf93bba-9276-4138-b893-34bfb7d0a371 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:25.939954 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bf93bba-9276-4138-b893-34bfb7d0a371 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:25.940379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5bf93bba-9276-4138-b893-34bfb7d0a371 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:26.071793 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5bf93bba-9276-4138-b893-34bfb7d0a371 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:26.079777 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5bf93bba-9276-4138-b893-34bfb7d0a371 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1391 microversion: 2.1 time: 0.153294 Oct 04 22:33:26.081806 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3938/7894] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:25 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:27.103200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-db2dfff1-15c7-4446-a1a1-7744f8866897 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:27.103819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-db2dfff1-15c7-4446-a1a1-7744f8866897 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:27.111659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db2dfff1-15c7-4446-a1a1-7744f8866897 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:27.112173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db2dfff1-15c7-4446-a1a1-7744f8866897 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:27.112657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db2dfff1-15c7-4446-a1a1-7744f8866897 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:27.113387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db2dfff1-15c7-4446-a1a1-7744f8866897 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:27.113901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db2dfff1-15c7-4446-a1a1-7744f8866897 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:27.114351 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-db2dfff1-15c7-4446-a1a1-7744f8866897 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:27.254225 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-db2dfff1-15c7-4446-a1a1-7744f8866897 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:27.262287 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-db2dfff1-15c7-4446-a1a1-7744f8866897 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1391 microversion: 2.1 time: 0.163560 Oct 04 22:33:27.262898 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3957/7895] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:27 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:33:28.285736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-48762e49-37a6-43b0-acb7-f0e352726949 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:28.286362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-48762e49-37a6-43b0-acb7-f0e352726949 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:28.293379 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48762e49-37a6-43b0-acb7-f0e352726949 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:28.293891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48762e49-37a6-43b0-acb7-f0e352726949 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:28.294334 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48762e49-37a6-43b0-acb7-f0e352726949 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:28.295030 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48762e49-37a6-43b0-acb7-f0e352726949 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:28.295489 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48762e49-37a6-43b0-acb7-f0e352726949 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:28.295921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48762e49-37a6-43b0-acb7-f0e352726949 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:28.426349 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-48762e49-37a6-43b0-acb7-f0e352726949 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:28.434776 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-48762e49-37a6-43b0-acb7-f0e352726949 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1391 microversion: 2.1 time: 0.153005 Oct 04 22:33:28.435350 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3939/7896] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:28 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:29.332223 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-0f97cb12-bc99-48b6-a317-f20cd6df0256 req-4e3e97a7-c7b8-44dc-ac49-7ce3fcb502a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f365db-fa51-4059-be89-c0bad2ac8165", "name": "network-vif-plugged", "status": "completed", "tag": "9968d86e-4e06-4bb2-805e-e2033207d7fc"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:33:29.338910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=6 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:29.344122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0f97cb12-bc99-48b6-a317-f20cd6df0256 req-4e3e97a7-c7b8-44dc-ac49-7ce3fcb502a3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:29.344617 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0f97cb12-bc99-48b6-a317-f20cd6df0256 req-4e3e97a7-c7b8-44dc-ac49-7ce3fcb502a3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:29.345065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-0f97cb12-bc99-48b6-a317-f20cd6df0256 req-4e3e97a7-c7b8-44dc-ac49-7ce3fcb502a3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:29.356481 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-0f97cb12-bc99-48b6-a317-f20cd6df0256 req-4e3e97a7-c7b8-44dc-ac49-7ce3fcb502a3 service nova] Creating event network-vif-plugged:9968d86e-4e06-4bb2-805e-e2033207d7fc for instance c0f365db-fa51-4059-be89-c0bad2ac8165 on n-h2-860282-1 Oct 04 22:33:29.361752 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-0f97cb12-bc99-48b6-a317-f20cd6df0256 req-4e3e97a7-c7b8-44dc-ac49-7ce3fcb502a3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033362 Oct 04 22:33:29.362380 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3958/7897] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:33:29.458426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e8a7426d-58a4-4493-bee0-292ff858efd4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:29.459578 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e8a7426d-58a4-4493-bee0-292ff858efd4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:29.463687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:29.468311 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:29.473020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8a7426d-58a4-4493-bee0-292ff858efd4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:29.473534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8a7426d-58a4-4493-bee0-292ff858efd4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:29.473982 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8a7426d-58a4-4493-bee0-292ff858efd4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:29.474691 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8a7426d-58a4-4493-bee0-292ff858efd4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:29.475154 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8a7426d-58a4-4493-bee0-292ff858efd4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:29.475586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8a7426d-58a4-4493-bee0-292ff858efd4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:29.636472 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e8a7426d-58a4-4493-bee0-292ff858efd4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:29.644190 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e8a7426d-58a4-4493-bee0-292ff858efd4 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1391 microversion: 2.1 time: 0.190088 Oct 04 22:33:29.644782 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3940/7898] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:29 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1391 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:30.668511 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-03a31649-5276-4299-91db-f478240e0c82 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:30.669241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-03a31649-5276-4299-91db-f478240e0c82 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:30.676060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03a31649-5276-4299-91db-f478240e0c82 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:30.676567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03a31649-5276-4299-91db-f478240e0c82 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:30.677026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03a31649-5276-4299-91db-f478240e0c82 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:30.677769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03a31649-5276-4299-91db-f478240e0c82 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:30.678249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03a31649-5276-4299-91db-f478240e0c82 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:30.678696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-03a31649-5276-4299-91db-f478240e0c82 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:30.810447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-03a31649-5276-4299-91db-f478240e0c82 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:30.818219 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-03a31649-5276-4299-91db-f478240e0c82 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1391 microversion: 2.1 time: 0.154994 Oct 04 22:33:30.818811 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3959/7899] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:30 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:31.842393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-98b144c5-3800-4601-b8f2-082a3fe31629 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:31.842941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-98b144c5-3800-4601-b8f2-082a3fe31629 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:31.850796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98b144c5-3800-4601-b8f2-082a3fe31629 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:31.851926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98b144c5-3800-4601-b8f2-082a3fe31629 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:31.852391 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98b144c5-3800-4601-b8f2-082a3fe31629 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:31.853072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98b144c5-3800-4601-b8f2-082a3fe31629 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:31.853552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98b144c5-3800-4601-b8f2-082a3fe31629 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:31.853984 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-98b144c5-3800-4601-b8f2-082a3fe31629 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:31.991115 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-98b144c5-3800-4601-b8f2-082a3fe31629 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:31.998895 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-98b144c5-3800-4601-b8f2-082a3fe31629 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1563 microversion: 2.1 time: 0.160523 Oct 04 22:33:31.999739 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3941/7900] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:31 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:32.020845 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b589cc06-f048-432c-9b54-de62d7fb2160 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:32.021535 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b589cc06-f048-432c-9b54-de62d7fb2160 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:32.028790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b589cc06-f048-432c-9b54-de62d7fb2160 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:32.029298 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b589cc06-f048-432c-9b54-de62d7fb2160 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:32.029794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b589cc06-f048-432c-9b54-de62d7fb2160 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:32.030506 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b589cc06-f048-432c-9b54-de62d7fb2160 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:32.030984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b589cc06-f048-432c-9b54-de62d7fb2160 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:32.031443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b589cc06-f048-432c-9b54-de62d7fb2160 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:32.160970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b589cc06-f048-432c-9b54-de62d7fb2160 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:32.168853 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b589cc06-f048-432c-9b54-de62d7fb2160 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1563 microversion: 2.1 time: 0.151850 Oct 04 22:33:32.169452 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3960/7901] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:32 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:34.101650 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-678c5948-0314-49dd-9484-536a680d3247 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:34.102439 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-678c5948-0314-49dd-9484-536a680d3247 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:34.103604 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-94465994-8d74-428e-b918-bf30f6c8577b req-97026200-4346-48d6-8965-1a4b0393c448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f365db-fa51-4059-be89-c0bad2ac8165", "tag": "9968d86e-4e06-4bb2-805e-e2033207d7fc"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:33:34.106027 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:34.111144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:34.111767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-678c5948-0314-49dd-9484-536a680d3247 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:34.112368 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-678c5948-0314-49dd-9484-536a680d3247 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:34.112889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-678c5948-0314-49dd-9484-536a680d3247 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:34.113871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-678c5948-0314-49dd-9484-536a680d3247 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:34.114552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-678c5948-0314-49dd-9484-536a680d3247 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:34.115146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-678c5948-0314-49dd-9484-536a680d3247 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:34.116121 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-94465994-8d74-428e-b918-bf30f6c8577b req-97026200-4346-48d6-8965-1a4b0393c448 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:34.116631 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-94465994-8d74-428e-b918-bf30f6c8577b req-97026200-4346-48d6-8965-1a4b0393c448 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:34.117841 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-94465994-8d74-428e-b918-bf30f6c8577b req-97026200-4346-48d6-8965-1a4b0393c448 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:34.130536 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-94465994-8d74-428e-b918-bf30f6c8577b req-97026200-4346-48d6-8965-1a4b0393c448 service nova] Creating event network-changed:9968d86e-4e06-4bb2-805e-e2033207d7fc for instance c0f365db-fa51-4059-be89-c0bad2ac8165 on n-h2-860282-1 Oct 04 22:33:34.136869 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-94465994-8d74-428e-b918-bf30f6c8577b req-97026200-4346-48d6-8965-1a4b0393c448 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036912 Oct 04 22:33:34.137525 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3961/7902] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:33:34.342300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-678c5948-0314-49dd-9484-536a680d3247 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:34.350444 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-678c5948-0314-49dd-9484-536a680d3247 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1563 microversion: 2.1 time: 0.253096 Oct 04 22:33:34.358200 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3942/7903] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:34 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1563 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:59.610384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=36 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:59.614638 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-58594f9e-d811-462a-914a-d023297636cc tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:33:59.616983 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-58594f9e-d811-462a-914a-d023297636cc tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:59.623701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58594f9e-d811-462a-914a-d023297636cc tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:59.624479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58594f9e-d811-462a-914a-d023297636cc tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:59.624941 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58594f9e-d811-462a-914a-d023297636cc tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:59.625718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58594f9e-d811-462a-914a-d023297636cc tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:59.626197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58594f9e-d811-462a-914a-d023297636cc tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:59.626648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58594f9e-d811-462a-914a-d023297636cc tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:59.677520 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-58594f9e-d811-462a-914a-d023297636cc tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165/action" status: 200 len: 24568 microversion: 2.1 time: 0.069149 Oct 04 22:33:59.678171 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3962/7904] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:33:59 2022] POST /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165/action => generated 24568 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:34:10.830309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c226a722-7011-424b-a764-bcfc77fa3a6a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:34:10.830309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c226a722-7011-424b-a764-bcfc77fa3a6a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:10.830309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:34:10.830309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=50 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:34:10.830309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c226a722-7011-424b-a764-bcfc77fa3a6a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:10.830309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c226a722-7011-424b-a764-bcfc77fa3a6a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:10.830309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c226a722-7011-424b-a764-bcfc77fa3a6a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:10.830309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c226a722-7011-424b-a764-bcfc77fa3a6a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:10.830309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c226a722-7011-424b-a764-bcfc77fa3a6a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:10.830309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c226a722-7011-424b-a764-bcfc77fa3a6a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:10.848271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-c226a722-7011-424b-a764-bcfc77fa3a6a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lazy-loading 'flavor' on Instance uuid c0f365db-fa51-4059-be89-c0bad2ac8165 {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:34:11.111615 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c226a722-7011-424b-a764-bcfc77fa3a6a tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165/action" status: 202 len: 0 microversion: 2.1 time: 0.301197 Oct 04 22:34:11.112177 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3943/7905] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:34:10 2022] POST /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:34:11.121101 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7cfc7b77-c6fd-4f98-9dac-9fe783b5be55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:11.121872 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7cfc7b77-c6fd-4f98-9dac-9fe783b5be55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:11.125241 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:34:11.126055 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:34:11.134927 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7cfc7b77-c6fd-4f98-9dac-9fe783b5be55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:11.135860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7cfc7b77-c6fd-4f98-9dac-9fe783b5be55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:11.136045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7cfc7b77-c6fd-4f98-9dac-9fe783b5be55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:11.136640 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7cfc7b77-c6fd-4f98-9dac-9fe783b5be55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:11.137122 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7cfc7b77-c6fd-4f98-9dac-9fe783b5be55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:11.137612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7cfc7b77-c6fd-4f98-9dac-9fe783b5be55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:11.274399 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7cfc7b77-c6fd-4f98-9dac-9fe783b5be55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:11.282853 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7cfc7b77-c6fd-4f98-9dac-9fe783b5be55 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1690 microversion: 2.1 time: 0.166172 Oct 04 22:34:11.283438 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3963/7906] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:11 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:12.306928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f23e57ea-e9f0-438a-9c87-eeb106acaeaa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:12.307640 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f23e57ea-e9f0-438a-9c87-eeb106acaeaa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:12.315348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f23e57ea-e9f0-438a-9c87-eeb106acaeaa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:12.315836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f23e57ea-e9f0-438a-9c87-eeb106acaeaa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:12.316279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f23e57ea-e9f0-438a-9c87-eeb106acaeaa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:12.316975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f23e57ea-e9f0-438a-9c87-eeb106acaeaa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:12.317459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f23e57ea-e9f0-438a-9c87-eeb106acaeaa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:12.317891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f23e57ea-e9f0-438a-9c87-eeb106acaeaa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:12.452360 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f23e57ea-e9f0-438a-9c87-eeb106acaeaa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:12.460569 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f23e57ea-e9f0-438a-9c87-eeb106acaeaa tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1673 microversion: 2.1 time: 0.157997 Oct 04 22:34:12.461146 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3944/7907] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:12 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:13.899149 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-31d466fd-14fe-42f1-b346-eed17e8cb763 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:34:13.901349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-31d466fd-14fe-42f1-b346-eed17e8cb763 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:13.908567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31d466fd-14fe-42f1-b346-eed17e8cb763 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:13.909077 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31d466fd-14fe-42f1-b346-eed17e8cb763 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:13.909573 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31d466fd-14fe-42f1-b346-eed17e8cb763 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:13.910285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31d466fd-14fe-42f1-b346-eed17e8cb763 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:13.910756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31d466fd-14fe-42f1-b346-eed17e8cb763 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:13.911219 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-31d466fd-14fe-42f1-b346-eed17e8cb763 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:13.974477 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-31d466fd-14fe-42f1-b346-eed17e8cb763 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165/action" status: 200 len: 38403 microversion: 2.1 time: 0.079190 Oct 04 22:34:13.975158 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3964/7908] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:34:13 2022] POST /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165/action => generated 38403 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:34:13.987685 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7ed15f92-752a-4593-b639-376c924ba4db tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:34:13.988238 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7ed15f92-752a-4593-b639-376c924ba4db tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:13.995099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ed15f92-752a-4593-b639-376c924ba4db tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:13.995591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ed15f92-752a-4593-b639-376c924ba4db tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:13.996039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ed15f92-752a-4593-b639-376c924ba4db tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:13.996738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ed15f92-752a-4593-b639-376c924ba4db tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:13.997918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ed15f92-752a-4593-b639-376c924ba4db tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:13.998442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7ed15f92-752a-4593-b639-376c924ba4db tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:14.183619 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7ed15f92-752a-4593-b639-376c924ba4db tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165/action" status: 202 len: 0 microversion: 2.1 time: 0.199633 Oct 04 22:34:14.184150 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3945/7909] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:34:13 2022] POST /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:34:14.194859 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-382677fe-9169-4724-a663-747d4e61a0b0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:14.198831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-382677fe-9169-4724-a663-747d4e61a0b0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:14.203167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-382677fe-9169-4724-a663-747d4e61a0b0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:14.203686 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-382677fe-9169-4724-a663-747d4e61a0b0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:14.204156 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-382677fe-9169-4724-a663-747d4e61a0b0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:14.205169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-382677fe-9169-4724-a663-747d4e61a0b0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:14.205683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-382677fe-9169-4724-a663-747d4e61a0b0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:14.206227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-382677fe-9169-4724-a663-747d4e61a0b0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:14.344487 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-382677fe-9169-4724-a663-747d4e61a0b0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:14.352595 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-382677fe-9169-4724-a663-747d4e61a0b0 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1679 microversion: 2.1 time: 0.162392 Oct 04 22:34:14.353176 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3965/7910] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:14 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:15.378654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f47ac40f-5561-489e-9c08-2ecc82d5a602 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:15.379363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f47ac40f-5561-489e-9c08-2ecc82d5a602 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:15.385624 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f47ac40f-5561-489e-9c08-2ecc82d5a602 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:15.386118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f47ac40f-5561-489e-9c08-2ecc82d5a602 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:15.386562 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f47ac40f-5561-489e-9c08-2ecc82d5a602 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:15.387252 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f47ac40f-5561-489e-9c08-2ecc82d5a602 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:15.387716 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f47ac40f-5561-489e-9c08-2ecc82d5a602 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:15.388141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f47ac40f-5561-489e-9c08-2ecc82d5a602 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:15.526923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f47ac40f-5561-489e-9c08-2ecc82d5a602 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:15.536348 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f47ac40f-5561-489e-9c08-2ecc82d5a602 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1679 microversion: 2.1 time: 0.163050 Oct 04 22:34:15.536938 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3946/7911] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:15 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:16.560681 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1bf0693c-78cf-4468-8e21-741197e194ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:16.561314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1bf0693c-78cf-4468-8e21-741197e194ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:16.567748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bf0693c-78cf-4468-8e21-741197e194ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:16.568246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bf0693c-78cf-4468-8e21-741197e194ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:16.568703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bf0693c-78cf-4468-8e21-741197e194ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:16.569409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bf0693c-78cf-4468-8e21-741197e194ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:16.569904 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bf0693c-78cf-4468-8e21-741197e194ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:16.570346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1bf0693c-78cf-4468-8e21-741197e194ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:16.702300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1bf0693c-78cf-4468-8e21-741197e194ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:16.708961 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1bf0693c-78cf-4468-8e21-741197e194ff tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1682 microversion: 2.1 time: 0.152940 Oct 04 22:34:16.709559 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3966/7912] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:16 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:16.808382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-aa6ce461-473e-4b05-ae17-34f743c4a2d1 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:34:16.811428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-aa6ce461-473e-4b05-ae17-34f743c4a2d1 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:16.818369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa6ce461-473e-4b05-ae17-34f743c4a2d1 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:16.818917 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa6ce461-473e-4b05-ae17-34f743c4a2d1 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:16.819359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa6ce461-473e-4b05-ae17-34f743c4a2d1 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:16.820058 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa6ce461-473e-4b05-ae17-34f743c4a2d1 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:16.820514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa6ce461-473e-4b05-ae17-34f743c4a2d1 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:16.820955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-aa6ce461-473e-4b05-ae17-34f743c4a2d1 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:16.867393 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-aa6ce461-473e-4b05-ae17-34f743c4a2d1 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "POST /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165/action" status: 200 len: 38403 microversion: 2.1 time: 0.062855 Oct 04 22:34:16.868328 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3947/7913] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:34:16 2022] POST /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165/action => generated 38403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:34:17.891500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e032e8d9-4da4-45fd-85db-34739c636b6c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:17.892072 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e032e8d9-4da4-45fd-85db-34739c636b6c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:17.895101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-5b4917fc-bb56-4560-923f-1e48ee1d0ce1 req-402a9e91-e65c-4166-8eb9-3178c30f7b97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f365db-fa51-4059-be89-c0bad2ac8165", "tag": "9968d86e-4e06-4bb2-805e-e2033207d7fc"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:34:17.899281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e032e8d9-4da4-45fd-85db-34739c636b6c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:17.899868 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e032e8d9-4da4-45fd-85db-34739c636b6c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:17.900393 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e032e8d9-4da4-45fd-85db-34739c636b6c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:17.901651 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e032e8d9-4da4-45fd-85db-34739c636b6c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:17.902217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e032e8d9-4da4-45fd-85db-34739c636b6c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:17.902879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e032e8d9-4da4-45fd-85db-34739c636b6c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:17.905986 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5b4917fc-bb56-4560-923f-1e48ee1d0ce1 req-402a9e91-e65c-4166-8eb9-3178c30f7b97 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:17.906469 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5b4917fc-bb56-4560-923f-1e48ee1d0ce1 req-402a9e91-e65c-4166-8eb9-3178c30f7b97 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:17.906910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-5b4917fc-bb56-4560-923f-1e48ee1d0ce1 req-402a9e91-e65c-4166-8eb9-3178c30f7b97 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:17.918898 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-5b4917fc-bb56-4560-923f-1e48ee1d0ce1 req-402a9e91-e65c-4166-8eb9-3178c30f7b97 service nova] Creating event network-changed:9968d86e-4e06-4bb2-805e-e2033207d7fc for instance c0f365db-fa51-4059-be89-c0bad2ac8165 on n-h2-860282-1 Oct 04 22:34:17.925269 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-5b4917fc-bb56-4560-923f-1e48ee1d0ce1 req-402a9e91-e65c-4166-8eb9-3178c30f7b97 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034158 Oct 04 22:34:17.925931 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3948/7914] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:34:17.932028 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e032e8d9-4da4-45fd-85db-34739c636b6c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:34:18.238719 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e032e8d9-4da4-45fd-85db-34739c636b6c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 204 len: 0 microversion: 2.1 time: 0.350962 Oct 04 22:34:18.239332 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3967/7915] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:34:17 2022] DELETE /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:34:18.251019 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f80dab37-e5fe-444a-928e-cb90d5f8521c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:18.252117 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f80dab37-e5fe-444a-928e-cb90d5f8521c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:18.258524 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f80dab37-e5fe-444a-928e-cb90d5f8521c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:18.259022 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f80dab37-e5fe-444a-928e-cb90d5f8521c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:18.259677 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f80dab37-e5fe-444a-928e-cb90d5f8521c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:18.260609 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f80dab37-e5fe-444a-928e-cb90d5f8521c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:18.261075 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f80dab37-e5fe-444a-928e-cb90d5f8521c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:18.261544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f80dab37-e5fe-444a-928e-cb90d5f8521c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:18.400072 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f80dab37-e5fe-444a-928e-cb90d5f8521c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:18.408527 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f80dab37-e5fe-444a-928e-cb90d5f8521c tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1688 microversion: 2.1 time: 0.164665 Oct 04 22:34:18.409104 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3949/7916] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:18 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:19.433972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f67deba9-760f-4dad-9036-a2fbf6c8091b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:19.434709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f67deba9-760f-4dad-9036-a2fbf6c8091b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:19.441567 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f67deba9-760f-4dad-9036-a2fbf6c8091b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:19.442080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f67deba9-760f-4dad-9036-a2fbf6c8091b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:19.442548 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f67deba9-760f-4dad-9036-a2fbf6c8091b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:19.443277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f67deba9-760f-4dad-9036-a2fbf6c8091b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:19.443749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f67deba9-760f-4dad-9036-a2fbf6c8091b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:19.444199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f67deba9-760f-4dad-9036-a2fbf6c8091b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:19.582426 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f67deba9-760f-4dad-9036-a2fbf6c8091b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:19.590276 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f67deba9-760f-4dad-9036-a2fbf6c8091b tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1688 microversion: 2.1 time: 0.160715 Oct 04 22:34:19.590856 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3968/7917] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:19 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:20.505051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-9881c372-81d6-4343-9624-22893eca078d req-75cc349f-76d5-4a56-aeb3-37d9e0e8d2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f365db-fa51-4059-be89-c0bad2ac8165", "name": "network-vif-deleted", "tag": "9968d86e-4e06-4bb2-805e-e2033207d7fc"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:34:20.515392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9881c372-81d6-4343-9624-22893eca078d req-75cc349f-76d5-4a56-aeb3-37d9e0e8d2f9 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:20.515879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9881c372-81d6-4343-9624-22893eca078d req-75cc349f-76d5-4a56-aeb3-37d9e0e8d2f9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:20.516331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9881c372-81d6-4343-9624-22893eca078d req-75cc349f-76d5-4a56-aeb3-37d9e0e8d2f9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:20.530623 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-9881c372-81d6-4343-9624-22893eca078d req-75cc349f-76d5-4a56-aeb3-37d9e0e8d2f9 service nova] Creating event network-vif-deleted:9968d86e-4e06-4bb2-805e-e2033207d7fc for instance c0f365db-fa51-4059-be89-c0bad2ac8165 on n-h2-860282-1 Oct 04 22:34:20.535984 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-9881c372-81d6-4343-9624-22893eca078d req-75cc349f-76d5-4a56-aeb3-37d9e0e8d2f9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034613 Oct 04 22:34:20.536591 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3950/7918] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:34:20.613930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-de56d3c1-608d-49ea-91b2-ea337bbe877f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:20.614591 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-de56d3c1-608d-49ea-91b2-ea337bbe877f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:20.621445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de56d3c1-608d-49ea-91b2-ea337bbe877f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:20.622071 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de56d3c1-608d-49ea-91b2-ea337bbe877f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:20.622833 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de56d3c1-608d-49ea-91b2-ea337bbe877f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:20.623595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de56d3c1-608d-49ea-91b2-ea337bbe877f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:20.624346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de56d3c1-608d-49ea-91b2-ea337bbe877f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:20.624792 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-de56d3c1-608d-49ea-91b2-ea337bbe877f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:20.691460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-de56d3c1-608d-49ea-91b2-ea337bbe877f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ead2dace0aa45419aa7f8a2cd8d2104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5ef0af634f40c598c43019f28afb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:20.700968 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-de56d3c1-608d-49ea-91b2-ea337bbe877f tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 200 len: 1503 microversion: 2.1 time: 0.090316 Oct 04 22:34:20.701894 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3969/7919] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:20 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 1503 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:21.725995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-17b0e66c-fe2f-4ea4-b7eb-1f581a118418 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:21.726728 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-17b0e66c-fe2f-4ea4-b7eb-1f581a118418 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] [instance: c0f365db-fa51-4059-be89-c0bad2ac8165] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:21.733232 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17b0e66c-fe2f-4ea4-b7eb-1f581a118418 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:21.733823 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17b0e66c-fe2f-4ea4-b7eb-1f581a118418 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:21.734266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17b0e66c-fe2f-4ea4-b7eb-1f581a118418 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:21.734966 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17b0e66c-fe2f-4ea4-b7eb-1f581a118418 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:21.735422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17b0e66c-fe2f-4ea4-b7eb-1f581a118418 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:21.735848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17b0e66c-fe2f-4ea4-b7eb-1f581a118418 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:21.749544 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-17b0e66c-fe2f-4ea4-b7eb-1f581a118418 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] HTTP exception thrown: Instance c0f365db-fa51-4059-be89-c0bad2ac8165 could not be found. Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-17b0e66c-fe2f-4ea4-b7eb-1f581a118418 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Request method failure captured: Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 HTTP/1.1 Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPLMZuTLnApqSMxiBV15PI5S_RjEXV0e6DgU6tkVSj3Qbs_Cnvc6Wu6b-YKVM5qs41najaSVYiQoC8_V32Y3kjBm4UYmmPnCk923S11FSQGy-h7LMSKU4E0ZEbT2AhOP4CO6e2ZA15WGFizXGUgRcI6so0AfyEB2d3Mi5xsLsph4NZQo Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: ef5ef0af634f40c598c43019f28afb5b Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-377632635 Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef5ef0af634f40c598c43019f28afb5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ef5ef0af634f40c598c43019f28afb5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ef5ef0af634f40c598c43019f28afb5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef5ef0af634f40c598c43019f28afb5b"}]}] Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestNetworkAdvancedServerOps-377632635 Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: ef5ef0af634f40c598c43019f28afb5b Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-377632635 Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestNetworkAdvancedServerOps-377632635-project Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 3ead2dace0aa45419aa7f8a2cd8d2104 Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestNetworkAdvancedServerOps-377632635-project Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance c0f365db-fa51-4059-be89-c0bad2ac8165 could not be found. Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'c0f365db-fa51-4059-be89-c0bad2ac8165'} Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0f365db-fa51-4059-be89-c0bad2ac8165 could not be found. Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f365db-fa51-4059-be89-c0bad2ac8165 could not be found. Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:34:21.751267 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:34:21.756637 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:34:21.756637 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:34:21.756637 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:34:21.756637 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:34:21.756637 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:34:21.756637 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:34:21.756637 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f365db-fa51-4059-be89-c0bad2ac8165 could not be found. Oct 04 22:34:21.756637 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:34:21.756637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-17b0e66c-fe2f-4ea4-b7eb-1f581a118418 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Returning 404 to user: Instance c0f365db-fa51-4059-be89-c0bad2ac8165 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:34:21.756637 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-17b0e66c-fe2f-4ea4-b7eb-1f581a118418 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165" status: 404 len: 111 microversion: 2.1 time: 0.031988 Oct 04 22:34:21.756637 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3951/7920] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:21 2022] GET /compute/v2.1/servers/c0f365db-fa51-4059-be89-c0bad2ac8165 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:34:25.718232 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3e6c37e3-3927-4564-a690-df1a1f840922 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] Calling method '.version_select at 0x7f578b780b80>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:25.885839 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3e6c37e3-3927-4564-a690-df1a1f840922 tempest-TestNetworkAdvancedServerOps-377632635 tempest-TestNetworkAdvancedServerOps-377632635-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1866651510" status: 202 len: 0 microversion: 2.1 time: 0.171839 Oct 04 22:34:25.886694 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3970/7921] 10.222.0.30 () {58 vars in 1284 bytes} [Tue Oct 4 22:34:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1866651510 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:34:40.733618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=18 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:34:40.734388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:34:40.922181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-17c3157c-b126-42f7-9855-48dc813a5d10 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Action: 'create', calling method: .version_select at 0x7f5790d30c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1951085467", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcVmOFu6Ik60XNDHVNJfFWlNvi/2vrR8Np1Wo2WN32H8SRt2/3rPFJqo5fbh1eaq3q0ds0vAr3DHA4UP0QPCcMwWF9DAIPuGZ8pNUrmP9rXMeIqMmIELlQydbfW7mBSxw=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:34:40.946872 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-17c3157c-b126-42f7-9855-48dc813a5d10 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Getting quotas for project dd59893424064ce88d258278e5ead023. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:34:40.953863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-17c3157c-b126-42f7-9855-48dc813a5d10 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Getting quotas for user 503dac0152fd4639a94d119970d0d019 and project dd59893424064ce88d258278e5ead023. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:34:41.050985 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-17c3157c-b126-42f7-9855-48dc813a5d10 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.323173 Oct 04 22:34:41.052353 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3952/7922] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 22:34:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:34:43.498039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:34:43.499701 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:34:43.500894 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:34:43.501113 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 22:34:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Oct 04 22:34:43.506068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-47905d89-d9b2-412a-9e15-7e58eb5d236e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1934341963", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1951085467", "security_groups": [{"name": "tempest-secgroup-smoke-162412130"}], "networks": [{"uuid": "d24e14d2-d7ec-4cf1-bccd-e77d7fa86935"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:34:43.622951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-47905d89-d9b2-412a-9e15-7e58eb5d236e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] validate_networks() for [('d24e14d2-d7ec-4cf1-bccd-e77d7fa86935', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:34:44.113235 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-47905d89-d9b2-412a-9e15-7e58eb5d236e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:34:44.113786 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-47905d89-d9b2-412a-9e15-7e58eb5d236e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:34:44.114289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-47905d89-d9b2-412a-9e15-7e58eb5d236e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:34:44.115027 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-47905d89-d9b2-412a-9e15-7e58eb5d236e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:34:44.115672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-47905d89-d9b2-412a-9e15-7e58eb5d236e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:34:44.126579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47905d89-d9b2-412a-9e15-7e58eb5d236e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:44.127105 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47905d89-d9b2-412a-9e15-7e58eb5d236e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:44.127559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47905d89-d9b2-412a-9e15-7e58eb5d236e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:44.128310 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47905d89-d9b2-412a-9e15-7e58eb5d236e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:44.128779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47905d89-d9b2-412a-9e15-7e58eb5d236e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:44.129445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47905d89-d9b2-412a-9e15-7e58eb5d236e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:44.148699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-47905d89-d9b2-412a-9e15-7e58eb5d236e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Getting quotas for project dd59893424064ce88d258278e5ead023. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:34:44.154282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-47905d89-d9b2-412a-9e15-7e58eb5d236e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Getting quotas for user 503dac0152fd4639a94d119970d0d019 and project dd59893424064ce88d258278e5ead023. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:34:44.167092 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-47905d89-d9b2-412a-9e15-7e58eb5d236e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:34:44.169632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-47905d89-d9b2-412a-9e15-7e58eb5d236e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:34:44.270988 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-47905d89-d9b2-412a-9e15-7e58eb5d236e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.774764 Oct 04 22:34:44.271663 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3971/7923] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:34:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:34:44.285061 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-04345d30-f9c6-4a59-b2ba-be0f0bc75052 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:44.285751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-04345d30-f9c6-4a59-b2ba-be0f0bc75052 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:44.343758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-04345d30-f9c6-4a59-b2ba-be0f0bc75052 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:44.351492 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-04345d30-f9c6-4a59-b2ba-be0f0bc75052 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1247 microversion: 2.1 time: 0.072310 Oct 04 22:34:44.365634 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3953/7924] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:44 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1247 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:45.374980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a065e2f4-b301-4b14-b552-f6a8617dc794 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:45.375627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a065e2f4-b301-4b14-b552-f6a8617dc794 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:45.429980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a065e2f4-b301-4b14-b552-f6a8617dc794 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:45.437653 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a065e2f4-b301-4b14-b552-f6a8617dc794 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1247 microversion: 2.1 time: 0.067953 Oct 04 22:34:45.438280 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3972/7925] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:45 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1247 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:46.460606 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-382e14d6-c1b9-4132-b3e8-7e4cab3d5857 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:46.461298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-382e14d6-c1b9-4132-b3e8-7e4cab3d5857 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:46.468433 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-382e14d6-c1b9-4132-b3e8-7e4cab3d5857 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:46.468926 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-382e14d6-c1b9-4132-b3e8-7e4cab3d5857 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:46.469373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-382e14d6-c1b9-4132-b3e8-7e4cab3d5857 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:46.470133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-382e14d6-c1b9-4132-b3e8-7e4cab3d5857 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:46.470692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-382e14d6-c1b9-4132-b3e8-7e4cab3d5857 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:46.471125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-382e14d6-c1b9-4132-b3e8-7e4cab3d5857 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:46.540317 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-382e14d6-c1b9-4132-b3e8-7e4cab3d5857 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:46.549831 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-382e14d6-c1b9-4132-b3e8-7e4cab3d5857 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1307 microversion: 2.1 time: 0.093369 Oct 04 22:34:46.550679 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3954/7926] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:46 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:34:47.573829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6ef1859e-6f02-4954-a87d-0be136b744ec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:47.574987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6ef1859e-6f02-4954-a87d-0be136b744ec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:47.583691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ef1859e-6f02-4954-a87d-0be136b744ec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:47.584207 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ef1859e-6f02-4954-a87d-0be136b744ec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:47.584667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ef1859e-6f02-4954-a87d-0be136b744ec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:47.585391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ef1859e-6f02-4954-a87d-0be136b744ec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:47.585896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ef1859e-6f02-4954-a87d-0be136b744ec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:47.586349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6ef1859e-6f02-4954-a87d-0be136b744ec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:47.718967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6ef1859e-6f02-4954-a87d-0be136b744ec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:47.726750 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6ef1859e-6f02-4954-a87d-0be136b744ec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1372 microversion: 2.1 time: 0.157181 Oct 04 22:34:47.727342 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3973/7927] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:47 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:48.238463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-e9609689-0aae-4bc5-bb6f-dd7ac8acf2c0 req-30650077-fbe4-4d99-910f-4a1a9a6c45b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4753a169-179d-47a1-86c3-43b89e8c9ffa", "tag": "7b7e505f-ec79-49e6-bda8-5ecdcb98ca4a"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:34:48.249206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e9609689-0aae-4bc5-bb6f-dd7ac8acf2c0 req-30650077-fbe4-4d99-910f-4a1a9a6c45b5 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:48.249715 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e9609689-0aae-4bc5-bb6f-dd7ac8acf2c0 req-30650077-fbe4-4d99-910f-4a1a9a6c45b5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:48.250149 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-e9609689-0aae-4bc5-bb6f-dd7ac8acf2c0 req-30650077-fbe4-4d99-910f-4a1a9a6c45b5 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:48.261275 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-e9609689-0aae-4bc5-bb6f-dd7ac8acf2c0 req-30650077-fbe4-4d99-910f-4a1a9a6c45b5 service nova] Creating event network-changed:7b7e505f-ec79-49e6-bda8-5ecdcb98ca4a for instance 4753a169-179d-47a1-86c3-43b89e8c9ffa on n-h1-860282-1 Oct 04 22:34:48.267219 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-e9609689-0aae-4bc5-bb6f-dd7ac8acf2c0 req-30650077-fbe4-4d99-910f-4a1a9a6c45b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032932 Oct 04 22:34:48.268413 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3955/7928] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:34:48.751508 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1502bcd3-65f8-498a-beb0-979baea154e1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:48.752147 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1502bcd3-65f8-498a-beb0-979baea154e1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:48.758987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1502bcd3-65f8-498a-beb0-979baea154e1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:48.759491 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1502bcd3-65f8-498a-beb0-979baea154e1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:48.759951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1502bcd3-65f8-498a-beb0-979baea154e1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:48.760658 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1502bcd3-65f8-498a-beb0-979baea154e1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:48.761188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1502bcd3-65f8-498a-beb0-979baea154e1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:48.761670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1502bcd3-65f8-498a-beb0-979baea154e1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:48.895277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1502bcd3-65f8-498a-beb0-979baea154e1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:48.903128 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1502bcd3-65f8-498a-beb0-979baea154e1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1372 microversion: 2.1 time: 0.156425 Oct 04 22:34:48.917521 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3974/7929] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:48 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:49.931906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4598a743-dab8-4269-b5c1-328e32632909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:49.932618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4598a743-dab8-4269-b5c1-328e32632909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:49.940385 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4598a743-dab8-4269-b5c1-328e32632909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:49.940877 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4598a743-dab8-4269-b5c1-328e32632909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:49.941344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4598a743-dab8-4269-b5c1-328e32632909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:49.942073 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4598a743-dab8-4269-b5c1-328e32632909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:49.942535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4598a743-dab8-4269-b5c1-328e32632909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:49.942973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4598a743-dab8-4269-b5c1-328e32632909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:50.079220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4598a743-dab8-4269-b5c1-328e32632909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:50.087294 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4598a743-dab8-4269-b5c1-328e32632909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1372 microversion: 2.1 time: 0.159691 Oct 04 22:34:50.087883 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3956/7930] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:49 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:51.110831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4e3d8c8c-1e87-4ec7-9d88-69078a7ecef5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:51.111559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4e3d8c8c-1e87-4ec7-9d88-69078a7ecef5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:51.118391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e3d8c8c-1e87-4ec7-9d88-69078a7ecef5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:51.118907 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e3d8c8c-1e87-4ec7-9d88-69078a7ecef5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:51.119376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e3d8c8c-1e87-4ec7-9d88-69078a7ecef5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:51.120099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e3d8c8c-1e87-4ec7-9d88-69078a7ecef5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:51.120579 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e3d8c8c-1e87-4ec7-9d88-69078a7ecef5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:51.121033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4e3d8c8c-1e87-4ec7-9d88-69078a7ecef5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:51.254162 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4e3d8c8c-1e87-4ec7-9d88-69078a7ecef5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:51.261838 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4e3d8c8c-1e87-4ec7-9d88-69078a7ecef5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1372 microversion: 2.1 time: 0.155375 Oct 04 22:34:51.262430 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3975/7931] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:51 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:52.284322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-28335984-7835-4f5b-96aa-b3abd711288f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:52.285206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-28335984-7835-4f5b-96aa-b3abd711288f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:52.292753 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28335984-7835-4f5b-96aa-b3abd711288f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:52.293243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28335984-7835-4f5b-96aa-b3abd711288f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:52.293726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28335984-7835-4f5b-96aa-b3abd711288f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:52.294421 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28335984-7835-4f5b-96aa-b3abd711288f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:52.295399 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28335984-7835-4f5b-96aa-b3abd711288f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:52.295824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-28335984-7835-4f5b-96aa-b3abd711288f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:52.429663 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-28335984-7835-4f5b-96aa-b3abd711288f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:52.437349 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-28335984-7835-4f5b-96aa-b3abd711288f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1372 microversion: 2.1 time: 0.157028 Oct 04 22:34:52.438138 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3957/7932] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:52 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:34:52.658748 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-3d8af89e-7471-4873-a0bf-3631df21150a req-348fdb7e-2b1a-46fe-8dc0-0a4303f38769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4753a169-179d-47a1-86c3-43b89e8c9ffa", "name": "network-vif-plugged", "status": "completed", "tag": "7b7e505f-ec79-49e6-bda8-5ecdcb98ca4a"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:34:52.669300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3d8af89e-7471-4873-a0bf-3631df21150a req-348fdb7e-2b1a-46fe-8dc0-0a4303f38769 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:52.669876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3d8af89e-7471-4873-a0bf-3631df21150a req-348fdb7e-2b1a-46fe-8dc0-0a4303f38769 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:52.670334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-3d8af89e-7471-4873-a0bf-3631df21150a req-348fdb7e-2b1a-46fe-8dc0-0a4303f38769 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:52.684594 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-3d8af89e-7471-4873-a0bf-3631df21150a req-348fdb7e-2b1a-46fe-8dc0-0a4303f38769 service nova] Creating event network-vif-plugged:7b7e505f-ec79-49e6-bda8-5ecdcb98ca4a for instance 4753a169-179d-47a1-86c3-43b89e8c9ffa on n-h1-860282-1 Oct 04 22:34:52.690236 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-3d8af89e-7471-4873-a0bf-3631df21150a req-348fdb7e-2b1a-46fe-8dc0-0a4303f38769 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035461 Oct 04 22:34:52.690843 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3976/7933] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:34:53.460096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-ec6a39b8-c186-4871-a475-09fc6a327d94 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:53.460743 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-ec6a39b8-c186-4871-a475-09fc6a327d94 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:53.467776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec6a39b8-c186-4871-a475-09fc6a327d94 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:53.468262 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec6a39b8-c186-4871-a475-09fc6a327d94 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:53.468700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec6a39b8-c186-4871-a475-09fc6a327d94 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:53.469388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec6a39b8-c186-4871-a475-09fc6a327d94 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:53.469867 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec6a39b8-c186-4871-a475-09fc6a327d94 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:53.470296 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-ec6a39b8-c186-4871-a475-09fc6a327d94 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:53.601727 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-ec6a39b8-c186-4871-a475-09fc6a327d94 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:53.609437 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-ec6a39b8-c186-4871-a475-09fc6a327d94 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1372 microversion: 2.1 time: 0.153279 Oct 04 22:34:53.610027 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3958/7934] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:53 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:54.631455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:34:54.635756 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ef20a26b-111d-406b-a303-48b1a4e58557 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:54.636477 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ef20a26b-111d-406b-a303-48b1a4e58557 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:54.643378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef20a26b-111d-406b-a303-48b1a4e58557 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:54.645064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef20a26b-111d-406b-a303-48b1a4e58557 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:54.645064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef20a26b-111d-406b-a303-48b1a4e58557 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:54.645064 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef20a26b-111d-406b-a303-48b1a4e58557 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:54.645726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef20a26b-111d-406b-a303-48b1a4e58557 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:54.646183 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef20a26b-111d-406b-a303-48b1a4e58557 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:54.780369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ef20a26b-111d-406b-a303-48b1a4e58557 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:54.788277 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ef20a26b-111d-406b-a303-48b1a4e58557 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1556 microversion: 2.1 time: 0.158717 Oct 04 22:34:54.788860 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3977/7935] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:54 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:54.811219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9af6fb97-fbfb-4678-828b-1b928da17c0c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:54.811794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9af6fb97-fbfb-4678-828b-1b928da17c0c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:54.813812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:34:54.819577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9af6fb97-fbfb-4678-828b-1b928da17c0c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:54.820107 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9af6fb97-fbfb-4678-828b-1b928da17c0c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:54.820566 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9af6fb97-fbfb-4678-828b-1b928da17c0c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:54.821246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9af6fb97-fbfb-4678-828b-1b928da17c0c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:54.821736 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9af6fb97-fbfb-4678-828b-1b928da17c0c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:54.822170 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9af6fb97-fbfb-4678-828b-1b928da17c0c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:54.958164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9af6fb97-fbfb-4678-828b-1b928da17c0c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:54.965998 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9af6fb97-fbfb-4678-828b-1b928da17c0c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1556 microversion: 2.1 time: 0.159043 Oct 04 22:34:54.966573 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3959/7936] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:54 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:57.234227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-f0c34e1f-2601-450f-8f44-6d789c8b2c57 req-b6dc55df-f6e9-4e79-be67-fd8389a3b10a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4753a169-179d-47a1-86c3-43b89e8c9ffa", "tag": "7b7e505f-ec79-49e6-bda8-5ecdcb98ca4a"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:34:57.239034 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:34:57.245179 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f0c34e1f-2601-450f-8f44-6d789c8b2c57 req-b6dc55df-f6e9-4e79-be67-fd8389a3b10a service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:57.249575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f0c34e1f-2601-450f-8f44-6d789c8b2c57 req-b6dc55df-f6e9-4e79-be67-fd8389a3b10a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:57.249575 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-f0c34e1f-2601-450f-8f44-6d789c8b2c57 req-b6dc55df-f6e9-4e79-be67-fd8389a3b10a service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:57.257725 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-f0c34e1f-2601-450f-8f44-6d789c8b2c57 req-b6dc55df-f6e9-4e79-be67-fd8389a3b10a service nova] Creating event network-changed:7b7e505f-ec79-49e6-bda8-5ecdcb98ca4a for instance 4753a169-179d-47a1-86c3-43b89e8c9ffa on n-h1-860282-1 Oct 04 22:34:57.262924 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-f0c34e1f-2601-450f-8f44-6d789c8b2c57 req-b6dc55df-f6e9-4e79-be67-fd8389a3b10a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033397 Oct 04 22:34:57.263627 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3978/7937] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:36:51.306143 n-d-860282-1 devstack@n-api.service[122758]: ERROR oslo.messaging._drivers.impl_rabbit [-] [85957c5a-63ea-4587-9a7c-19b9c9ad6fe2] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:36:51.307009 n-d-860282-1 devstack@n-api.service[122758]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb95aab1-3781-4811-b11d-1606a5055a6d] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:36:51.307786 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:51.308599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=32 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:51.309722 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:36:51.309871 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 22:36:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa/action (ip 10.222.0.30) !!! Oct 04 22:36:51.310845 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:36:51.310967 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 22:36:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa/action (ip 10.222.0.30) !!! Oct 04 22:36:51.315719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-05d09e99-d54e-4d88-8bf3-d0e61b0f24de tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:36:51.316261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-05d09e99-d54e-4d88-8bf3-d0e61b0f24de tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:51.326849 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05d09e99-d54e-4d88-8bf3-d0e61b0f24de tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:51.327346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05d09e99-d54e-4d88-8bf3-d0e61b0f24de tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:51.327789 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05d09e99-d54e-4d88-8bf3-d0e61b0f24de tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:51.328501 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05d09e99-d54e-4d88-8bf3-d0e61b0f24de tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:51.328964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05d09e99-d54e-4d88-8bf3-d0e61b0f24de tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:51.329395 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-05d09e99-d54e-4d88-8bf3-d0e61b0f24de tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:51.355430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-05d09e99-d54e-4d88-8bf3-d0e61b0f24de tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lazy-loading 'flavor' on Instance uuid 4753a169-179d-47a1-86c3-43b89e8c9ffa {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:36:51.973259 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-05d09e99-d54e-4d88-8bf3-d0e61b0f24de tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "POST /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.668805 Oct 04 22:36:51.973985 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3960/7938] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:36:51 2022] POST /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa/action => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:36:51.980852 n-d-860282-1 devstack@n-api.service[122757]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09430b1c-e049-493f-9e8b-ffc95d4d7683] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:36:51.982680 n-d-860282-1 devstack@n-api.service[122757]: ERROR oslo.messaging._drivers.impl_rabbit [-] [02d9f940-80f2-491b-9a18-0a7fa72932fa] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:36:51.983668 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:51.984389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=30 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:51.985738 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:36:51.985871 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 22:36:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa (ip 10.222.0.30) !!! Oct 04 22:36:51.995204 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1015a4a4-5e87-43d9-bdc7-c199fc964957 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:51.995952 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1015a4a4-5e87-43d9-bdc7-c199fc964957 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:52.003933 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1015a4a4-5e87-43d9-bdc7-c199fc964957 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:52.005118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1015a4a4-5e87-43d9-bdc7-c199fc964957 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:52.005624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1015a4a4-5e87-43d9-bdc7-c199fc964957 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:52.006384 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1015a4a4-5e87-43d9-bdc7-c199fc964957 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:52.006876 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1015a4a4-5e87-43d9-bdc7-c199fc964957 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:52.007328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1015a4a4-5e87-43d9-bdc7-c199fc964957 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:52.196180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1015a4a4-5e87-43d9-bdc7-c199fc964957 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:52.204100 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1015a4a4-5e87-43d9-bdc7-c199fc964957 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1680 microversion: 2.1 time: 0.225347 Oct 04 22:36:52.204689 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3979/7939] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:51 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1680 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:53.229707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-58dc3502-5eb5-4b40-baf1-4106b5ce604b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:53.230344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-58dc3502-5eb5-4b40-baf1-4106b5ce604b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:53.239819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58dc3502-5eb5-4b40-baf1-4106b5ce604b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:53.240309 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58dc3502-5eb5-4b40-baf1-4106b5ce604b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:53.240750 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58dc3502-5eb5-4b40-baf1-4106b5ce604b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:53.241467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58dc3502-5eb5-4b40-baf1-4106b5ce604b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:53.241929 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58dc3502-5eb5-4b40-baf1-4106b5ce604b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:53.242358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-58dc3502-5eb5-4b40-baf1-4106b5ce604b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:53.246817 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] [85957c5a-63ea-4587-9a7c-19b9c9ad6fe2] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40102. Oct 04 22:36:53.251099 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb95aab1-3781-4811-b11d-1606a5055a6d] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40104. Oct 04 22:36:53.387150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-58dc3502-5eb5-4b40-baf1-4106b5ce604b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:53.395573 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-58dc3502-5eb5-4b40-baf1-4106b5ce604b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1680 microversion: 2.1 time: 0.171565 Oct 04 22:36:53.396148 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3961/7940] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:53 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:54.418771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1aa3d5a1-f049-4a92-9183-3d1ce67be383 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:54.419402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1aa3d5a1-f049-4a92-9183-3d1ce67be383 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:54.431991 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] [09430b1c-e049-493f-9e8b-ffc95d4d7683] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40110. Oct 04 22:36:54.437679 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] [02d9f940-80f2-491b-9a18-0a7fa72932fa] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40112. Oct 04 22:36:54.441951 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1aa3d5a1-f049-4a92-9183-3d1ce67be383 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:54.442486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1aa3d5a1-f049-4a92-9183-3d1ce67be383 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:54.442959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1aa3d5a1-f049-4a92-9183-3d1ce67be383 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:54.443675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1aa3d5a1-f049-4a92-9183-3d1ce67be383 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:54.444151 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1aa3d5a1-f049-4a92-9183-3d1ce67be383 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:54.444593 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1aa3d5a1-f049-4a92-9183-3d1ce67be383 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:54.577234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1aa3d5a1-f049-4a92-9183-3d1ce67be383 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:54.585632 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1aa3d5a1-f049-4a92-9183-3d1ce67be383 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1680 microversion: 2.1 time: 0.170786 Oct 04 22:36:54.586205 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3980/7941] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:54 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:55.610407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c38dc6f2-6d5f-4713-957e-6f79633e3f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:55.611026 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c38dc6f2-6d5f-4713-957e-6f79633e3f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:55.618683 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c38dc6f2-6d5f-4713-957e-6f79633e3f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:55.619152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c38dc6f2-6d5f-4713-957e-6f79633e3f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:55.619591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c38dc6f2-6d5f-4713-957e-6f79633e3f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:55.620283 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c38dc6f2-6d5f-4713-957e-6f79633e3f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:55.620740 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c38dc6f2-6d5f-4713-957e-6f79633e3f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:55.621169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c38dc6f2-6d5f-4713-957e-6f79633e3f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:55.751780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c38dc6f2-6d5f-4713-957e-6f79633e3f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:55.759602 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c38dc6f2-6d5f-4713-957e-6f79633e3f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1680 microversion: 2.1 time: 0.153207 Oct 04 22:36:55.760178 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3962/7942] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:55 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:56.783645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-35463dea-86d7-4c3e-beb7-04f355bc5abd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:56.784289 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-35463dea-86d7-4c3e-beb7-04f355bc5abd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:56.791883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35463dea-86d7-4c3e-beb7-04f355bc5abd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:56.792339 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35463dea-86d7-4c3e-beb7-04f355bc5abd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:56.792803 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35463dea-86d7-4c3e-beb7-04f355bc5abd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:56.793549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35463dea-86d7-4c3e-beb7-04f355bc5abd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:56.794036 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35463dea-86d7-4c3e-beb7-04f355bc5abd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:56.794490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-35463dea-86d7-4c3e-beb7-04f355bc5abd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:56.929793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-35463dea-86d7-4c3e-beb7-04f355bc5abd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:56.937637 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-35463dea-86d7-4c3e-beb7-04f355bc5abd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1680 microversion: 2.1 time: 0.157994 Oct 04 22:36:56.938214 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3981/7943] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:56 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:57.960543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-59e8f43c-bcf6-4e5c-ba48-dd3d0a7d56d4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:57.961164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-59e8f43c-bcf6-4e5c-ba48-dd3d0a7d56d4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:57.968050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59e8f43c-bcf6-4e5c-ba48-dd3d0a7d56d4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:57.968535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59e8f43c-bcf6-4e5c-ba48-dd3d0a7d56d4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:57.968975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59e8f43c-bcf6-4e5c-ba48-dd3d0a7d56d4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:57.969700 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59e8f43c-bcf6-4e5c-ba48-dd3d0a7d56d4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:57.970159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59e8f43c-bcf6-4e5c-ba48-dd3d0a7d56d4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:57.970582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-59e8f43c-bcf6-4e5c-ba48-dd3d0a7d56d4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:58.100927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-59e8f43c-bcf6-4e5c-ba48-dd3d0a7d56d4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:58.108726 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-59e8f43c-bcf6-4e5c-ba48-dd3d0a7d56d4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1680 microversion: 2.1 time: 0.152216 Oct 04 22:36:58.109300 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3963/7944] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:57 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:59.133021 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4d1fe8c8-70c3-4ffd-a691-f9605ecbe006 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:59.133711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4d1fe8c8-70c3-4ffd-a691-f9605ecbe006 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:59.140581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d1fe8c8-70c3-4ffd-a691-f9605ecbe006 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:59.141085 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d1fe8c8-70c3-4ffd-a691-f9605ecbe006 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:59.141577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d1fe8c8-70c3-4ffd-a691-f9605ecbe006 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:59.142285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d1fe8c8-70c3-4ffd-a691-f9605ecbe006 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:59.142763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d1fe8c8-70c3-4ffd-a691-f9605ecbe006 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:59.143210 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4d1fe8c8-70c3-4ffd-a691-f9605ecbe006 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:59.279377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4d1fe8c8-70c3-4ffd-a691-f9605ecbe006 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:59.287598 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4d1fe8c8-70c3-4ffd-a691-f9605ecbe006 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1680 microversion: 2.1 time: 0.158573 Oct 04 22:36:59.288186 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3982/7945] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:59 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:00.311594 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-5601adea-9677-46a7-bb1e-6efc6d8a8444 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:00.312171 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-5601adea-9677-46a7-bb1e-6efc6d8a8444 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:00.319751 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5601adea-9677-46a7-bb1e-6efc6d8a8444 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:00.320266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5601adea-9677-46a7-bb1e-6efc6d8a8444 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:00.320713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5601adea-9677-46a7-bb1e-6efc6d8a8444 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:00.321411 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5601adea-9677-46a7-bb1e-6efc6d8a8444 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:00.321898 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5601adea-9677-46a7-bb1e-6efc6d8a8444 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:00.322330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-5601adea-9677-46a7-bb1e-6efc6d8a8444 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:00.457141 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-5601adea-9677-46a7-bb1e-6efc6d8a8444 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:00.465236 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-5601adea-9677-46a7-bb1e-6efc6d8a8444 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1680 microversion: 2.1 time: 0.157710 Oct 04 22:37:00.465845 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3964/7946] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:00 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:01.488197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-275a2038-4046-42f6-a2c1-e876ac40ba07 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:01.488825 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-275a2038-4046-42f6-a2c1-e876ac40ba07 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:01.496571 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-275a2038-4046-42f6-a2c1-e876ac40ba07 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:01.497075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-275a2038-4046-42f6-a2c1-e876ac40ba07 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:01.497552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-275a2038-4046-42f6-a2c1-e876ac40ba07 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:01.498258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-275a2038-4046-42f6-a2c1-e876ac40ba07 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:01.498733 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-275a2038-4046-42f6-a2c1-e876ac40ba07 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:01.499174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-275a2038-4046-42f6-a2c1-e876ac40ba07 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:01.636806 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-275a2038-4046-42f6-a2c1-e876ac40ba07 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:01.644478 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-275a2038-4046-42f6-a2c1-e876ac40ba07 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1680 microversion: 2.1 time: 0.160236 Oct 04 22:37:01.645058 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3983/7947] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:01 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:02.668034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-306237d4-e708-406d-9940-b45ad6b16308 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:02.668644 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-306237d4-e708-406d-9940-b45ad6b16308 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:02.675613 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-306237d4-e708-406d-9940-b45ad6b16308 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:02.676098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-306237d4-e708-406d-9940-b45ad6b16308 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:02.676533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-306237d4-e708-406d-9940-b45ad6b16308 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:02.677220 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-306237d4-e708-406d-9940-b45ad6b16308 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:02.678593 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-306237d4-e708-406d-9940-b45ad6b16308 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:02.679025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-306237d4-e708-406d-9940-b45ad6b16308 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:02.811637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-306237d4-e708-406d-9940-b45ad6b16308 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:02.819336 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-306237d4-e708-406d-9940-b45ad6b16308 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1701 microversion: 2.1 time: 0.155229 Oct 04 22:37:02.819902 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3965/7948] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:02 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1701 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:03.843437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-feee95c1-956c-46e8-955a-72ffe4fc5725 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:03.844075 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-feee95c1-956c-46e8-955a-72ffe4fc5725 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:03.851042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-feee95c1-956c-46e8-955a-72ffe4fc5725 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:03.851779 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-feee95c1-956c-46e8-955a-72ffe4fc5725 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:03.852246 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-feee95c1-956c-46e8-955a-72ffe4fc5725 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:03.852958 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-feee95c1-956c-46e8-955a-72ffe4fc5725 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:03.853456 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-feee95c1-956c-46e8-955a-72ffe4fc5725 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:03.853909 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-feee95c1-956c-46e8-955a-72ffe4fc5725 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:03.988751 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-feee95c1-956c-46e8-955a-72ffe4fc5725 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:03.991852 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-feee95c1-956c-46e8-955a-72ffe4fc5725 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1701 microversion: 2.1 time: 0.152359 Oct 04 22:37:03.992424 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3984/7949] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:03 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1701 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:05.015695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-17417748-a3fe-4568-ac8a-dcd7ca320a61 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:05.016313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-17417748-a3fe-4568-ac8a-dcd7ca320a61 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:05.023855 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17417748-a3fe-4568-ac8a-dcd7ca320a61 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:05.024339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17417748-a3fe-4568-ac8a-dcd7ca320a61 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:05.024775 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17417748-a3fe-4568-ac8a-dcd7ca320a61 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:05.025485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17417748-a3fe-4568-ac8a-dcd7ca320a61 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:05.025943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17417748-a3fe-4568-ac8a-dcd7ca320a61 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:05.026372 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-17417748-a3fe-4568-ac8a-dcd7ca320a61 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:05.172330 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-17417748-a3fe-4568-ac8a-dcd7ca320a61 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:05.181889 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-17417748-a3fe-4568-ac8a-dcd7ca320a61 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1696 microversion: 2.1 time: 0.170116 Oct 04 22:37:05.182674 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3966/7950] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:05 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:06.209926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e63ed81c-27e0-44c8-82c3-daa48c820c1b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:06.211712 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e63ed81c-27e0-44c8-82c3-daa48c820c1b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:06.218315 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e63ed81c-27e0-44c8-82c3-daa48c820c1b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:06.219100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e63ed81c-27e0-44c8-82c3-daa48c820c1b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:06.219830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e63ed81c-27e0-44c8-82c3-daa48c820c1b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:06.221457 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e63ed81c-27e0-44c8-82c3-daa48c820c1b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:06.222849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e63ed81c-27e0-44c8-82c3-daa48c820c1b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:06.223323 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e63ed81c-27e0-44c8-82c3-daa48c820c1b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:06.375860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e63ed81c-27e0-44c8-82c3-daa48c820c1b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:06.389286 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e63ed81c-27e0-44c8-82c3-daa48c820c1b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1696 microversion: 2.1 time: 0.185233 Oct 04 22:37:06.403704 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3985/7951] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:06 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1696 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:07.290981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-2d6116f5-6ca2-48ca-9637-8c6d66a13f88 req-7cbd739a-9eba-4f4d-bd01-e5477ca1a348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4753a169-179d-47a1-86c3-43b89e8c9ffa", "name": "network-vif-plugged", "status": "completed", "tag": "7b7e505f-ec79-49e6-bda8-5ecdcb98ca4a"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:37:07.301758 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2d6116f5-6ca2-48ca-9637-8c6d66a13f88 req-7cbd739a-9eba-4f4d-bd01-e5477ca1a348 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:07.302278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2d6116f5-6ca2-48ca-9637-8c6d66a13f88 req-7cbd739a-9eba-4f4d-bd01-e5477ca1a348 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:07.302720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-2d6116f5-6ca2-48ca-9637-8c6d66a13f88 req-7cbd739a-9eba-4f4d-bd01-e5477ca1a348 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:07.314921 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-2d6116f5-6ca2-48ca-9637-8c6d66a13f88 req-7cbd739a-9eba-4f4d-bd01-e5477ca1a348 service nova] Creating event network-vif-plugged:7b7e505f-ec79-49e6-bda8-5ecdcb98ca4a for instance 4753a169-179d-47a1-86c3-43b89e8c9ffa on n-h1-860282-1 Oct 04 22:37:07.320801 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-2d6116f5-6ca2-48ca-9637-8c6d66a13f88 req-7cbd739a-9eba-4f4d-bd01-e5477ca1a348 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104675 Oct 04 22:37:07.322039 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3967/7952] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:37:07.422776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-1c9147e8-6ce5-4f81-b82c-87a19dc9245d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:07.425273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-1c9147e8-6ce5-4f81-b82c-87a19dc9245d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:07.439969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c9147e8-6ce5-4f81-b82c-87a19dc9245d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:07.440545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c9147e8-6ce5-4f81-b82c-87a19dc9245d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:07.441227 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c9147e8-6ce5-4f81-b82c-87a19dc9245d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:07.442161 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c9147e8-6ce5-4f81-b82c-87a19dc9245d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:07.443392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c9147e8-6ce5-4f81-b82c-87a19dc9245d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:07.444062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-1c9147e8-6ce5-4f81-b82c-87a19dc9245d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:07.629410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-1c9147e8-6ce5-4f81-b82c-87a19dc9245d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:07.638921 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-1c9147e8-6ce5-4f81-b82c-87a19dc9245d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1696 microversion: 2.1 time: 0.225566 Oct 04 22:37:07.639809 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3986/7953] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:07 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1696 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:08.667336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2f46e634-e372-46eb-a134-3a131b600c27 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:08.668066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2f46e634-e372-46eb-a134-3a131b600c27 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:08.674447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2f46e634-e372-46eb-a134-3a131b600c27 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:08.675169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2f46e634-e372-46eb-a134-3a131b600c27 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:08.675816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2f46e634-e372-46eb-a134-3a131b600c27 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:08.676536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2f46e634-e372-46eb-a134-3a131b600c27 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:08.677000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2f46e634-e372-46eb-a134-3a131b600c27 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:08.677497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2f46e634-e372-46eb-a134-3a131b600c27 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:08.847445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2f46e634-e372-46eb-a134-3a131b600c27 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:08.857072 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2f46e634-e372-46eb-a134-3a131b600c27 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1696 microversion: 2.1 time: 0.196685 Oct 04 22:37:08.858702 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3968/7954] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:08 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1696 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:09.882629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4f04c997-e640-4a38-b59e-b3e60246e9d1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:09.883929 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4f04c997-e640-4a38-b59e-b3e60246e9d1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:09.891308 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f04c997-e640-4a38-b59e-b3e60246e9d1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:09.891830 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f04c997-e640-4a38-b59e-b3e60246e9d1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:09.892300 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f04c997-e640-4a38-b59e-b3e60246e9d1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:09.893038 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f04c997-e640-4a38-b59e-b3e60246e9d1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:09.893679 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f04c997-e640-4a38-b59e-b3e60246e9d1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:09.894143 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4f04c997-e640-4a38-b59e-b3e60246e9d1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:10.057849 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4f04c997-e640-4a38-b59e-b3e60246e9d1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:10.066243 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4f04c997-e640-4a38-b59e-b3e60246e9d1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1696 microversion: 2.1 time: 0.188505 Oct 04 22:37:10.067173 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3987/7955] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:09 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1696 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:11.091444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-1867e50e-3706-4b46-b432-716eac7041e3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:11.093931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-1867e50e-3706-4b46-b432-716eac7041e3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:11.099571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1867e50e-3706-4b46-b432-716eac7041e3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:11.100146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1867e50e-3706-4b46-b432-716eac7041e3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:11.100598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1867e50e-3706-4b46-b432-716eac7041e3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:11.101307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1867e50e-3706-4b46-b432-716eac7041e3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:11.101791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1867e50e-3706-4b46-b432-716eac7041e3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:11.102215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-1867e50e-3706-4b46-b432-716eac7041e3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:11.238036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-1867e50e-3706-4b46-b432-716eac7041e3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:11.246949 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-1867e50e-3706-4b46-b432-716eac7041e3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1696 microversion: 2.1 time: 0.159474 Oct 04 22:37:11.249350 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3969/7956] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:11 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:12.272635 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2f0ad1fd-0eeb-4d14-9312-3eed01932b9d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:12.273709 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2f0ad1fd-0eeb-4d14-9312-3eed01932b9d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:12.280957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f0ad1fd-0eeb-4d14-9312-3eed01932b9d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:12.283397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f0ad1fd-0eeb-4d14-9312-3eed01932b9d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:12.283397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f0ad1fd-0eeb-4d14-9312-3eed01932b9d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:12.283397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f0ad1fd-0eeb-4d14-9312-3eed01932b9d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:12.283397 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f0ad1fd-0eeb-4d14-9312-3eed01932b9d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:12.284043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2f0ad1fd-0eeb-4d14-9312-3eed01932b9d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:12.436273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2f0ad1fd-0eeb-4d14-9312-3eed01932b9d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:12.446686 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2f0ad1fd-0eeb-4d14-9312-3eed01932b9d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1696 microversion: 2.1 time: 0.179126 Oct 04 22:37:12.462894 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3988/7957] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:12 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1696 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:13.475920 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fd10812f-dadd-414d-9c3d-851dc950e76a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:13.476558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fd10812f-dadd-414d-9c3d-851dc950e76a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:13.485610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd10812f-dadd-414d-9c3d-851dc950e76a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:13.485610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd10812f-dadd-414d-9c3d-851dc950e76a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:13.485610 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd10812f-dadd-414d-9c3d-851dc950e76a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:13.486182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd10812f-dadd-414d-9c3d-851dc950e76a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:13.487158 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd10812f-dadd-414d-9c3d-851dc950e76a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:13.487821 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fd10812f-dadd-414d-9c3d-851dc950e76a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:13.657875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fd10812f-dadd-414d-9c3d-851dc950e76a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:13.668631 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fd10812f-dadd-414d-9c3d-851dc950e76a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1696 microversion: 2.1 time: 0.197372 Oct 04 22:37:13.686078 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3970/7958] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:13 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1696 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:14.696321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a5903f30-6768-4070-97ad-25c8ca80cc5f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:14.698001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a5903f30-6768-4070-97ad-25c8ca80cc5f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:14.705788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5903f30-6768-4070-97ad-25c8ca80cc5f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:14.706584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5903f30-6768-4070-97ad-25c8ca80cc5f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:14.707132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5903f30-6768-4070-97ad-25c8ca80cc5f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:14.707955 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5903f30-6768-4070-97ad-25c8ca80cc5f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:14.708703 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5903f30-6768-4070-97ad-25c8ca80cc5f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:14.709975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a5903f30-6768-4070-97ad-25c8ca80cc5f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:14.860375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a5903f30-6768-4070-97ad-25c8ca80cc5f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:14.869781 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a5903f30-6768-4070-97ad-25c8ca80cc5f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1696 microversion: 2.1 time: 0.178584 Oct 04 22:37:14.870468 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3989/7959] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:14 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:15.894742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-159114d0-7c6d-44d1-923c-6cb4a976d2c0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:15.895348 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-159114d0-7c6d-44d1-923c-6cb4a976d2c0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:15.903038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-159114d0-7c6d-44d1-923c-6cb4a976d2c0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:15.903523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-159114d0-7c6d-44d1-923c-6cb4a976d2c0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:15.903964 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-159114d0-7c6d-44d1-923c-6cb4a976d2c0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:15.904651 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-159114d0-7c6d-44d1-923c-6cb4a976d2c0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:15.905105 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-159114d0-7c6d-44d1-923c-6cb4a976d2c0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:15.905819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-159114d0-7c6d-44d1-923c-6cb4a976d2c0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:16.045234 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-159114d0-7c6d-44d1-923c-6cb4a976d2c0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:16.053928 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-159114d0-7c6d-44d1-923c-6cb4a976d2c0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1696 microversion: 2.1 time: 0.162472 Oct 04 22:37:16.054524 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3971/7960] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:15 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:17.077864 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b3d8912d-115b-4048-bb75-e2b3c49ca43b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:17.078440 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b3d8912d-115b-4048-bb75-e2b3c49ca43b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:17.085884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3d8912d-115b-4048-bb75-e2b3c49ca43b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:17.086390 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3d8912d-115b-4048-bb75-e2b3c49ca43b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:17.086853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3d8912d-115b-4048-bb75-e2b3c49ca43b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:17.087565 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3d8912d-115b-4048-bb75-e2b3c49ca43b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:17.088042 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3d8912d-115b-4048-bb75-e2b3c49ca43b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:17.088496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b3d8912d-115b-4048-bb75-e2b3c49ca43b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:17.219533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b3d8912d-115b-4048-bb75-e2b3c49ca43b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:17.229325 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b3d8912d-115b-4048-bb75-e2b3c49ca43b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1678 microversion: 2.1 time: 0.155420 Oct 04 22:37:17.232004 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3990/7961] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:17 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:18.254150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8ebfab9c-ffc0-465c-9a65-bc21d8ca7909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:18.254762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8ebfab9c-ffc0-465c-9a65-bc21d8ca7909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:18.262547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ebfab9c-ffc0-465c-9a65-bc21d8ca7909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:18.263034 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ebfab9c-ffc0-465c-9a65-bc21d8ca7909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:18.263475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ebfab9c-ffc0-465c-9a65-bc21d8ca7909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:18.264169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ebfab9c-ffc0-465c-9a65-bc21d8ca7909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:18.264621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ebfab9c-ffc0-465c-9a65-bc21d8ca7909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:18.265045 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8ebfab9c-ffc0-465c-9a65-bc21d8ca7909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:18.402719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8ebfab9c-ffc0-465c-9a65-bc21d8ca7909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:18.407384 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8ebfab9c-ffc0-465c-9a65-bc21d8ca7909 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1678 microversion: 2.1 time: 0.157038 Oct 04 22:37:18.408230 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3972/7962] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:18 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:19.431531 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b15ae2a2-665b-4fcc-8463-a3edbf213cf9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:19.432169 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b15ae2a2-665b-4fcc-8463-a3edbf213cf9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:19.439277 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b15ae2a2-665b-4fcc-8463-a3edbf213cf9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:19.439785 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b15ae2a2-665b-4fcc-8463-a3edbf213cf9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:19.440251 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b15ae2a2-665b-4fcc-8463-a3edbf213cf9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:19.440967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b15ae2a2-665b-4fcc-8463-a3edbf213cf9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:19.441479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b15ae2a2-665b-4fcc-8463-a3edbf213cf9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:19.441934 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b15ae2a2-665b-4fcc-8463-a3edbf213cf9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:19.578944 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b15ae2a2-665b-4fcc-8463-a3edbf213cf9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:19.587009 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b15ae2a2-665b-4fcc-8463-a3edbf213cf9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1621 microversion: 2.1 time: 0.160081 Oct 04 22:37:19.587602 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3991/7963] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:19 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1621 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:19.609717 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cf268247-d979-4a5d-9ef9-96e5716e0c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:37:19.610344 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cf268247-d979-4a5d-9ef9-96e5716e0c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:19.618169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf268247-d979-4a5d-9ef9-96e5716e0c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:19.618654 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf268247-d979-4a5d-9ef9-96e5716e0c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:19.619093 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf268247-d979-4a5d-9ef9-96e5716e0c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:19.619792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf268247-d979-4a5d-9ef9-96e5716e0c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:19.620249 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf268247-d979-4a5d-9ef9-96e5716e0c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:19.620705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cf268247-d979-4a5d-9ef9-96e5716e0c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:19.661752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cf268247-d979-4a5d-9ef9-96e5716e0c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122758) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 22:37:19.918419 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cf268247-d979-4a5d-9ef9-96e5716e0c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "POST /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.312409 Oct 04 22:37:19.918967 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3973/7964] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:37:19 2022] POST /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:37:19.927281 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-820ca28a-d761-4e2a-a6c2-880b05d81bc6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:19.927975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-820ca28a-d761-4e2a-a6c2-880b05d81bc6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:19.934269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-820ca28a-d761-4e2a-a6c2-880b05d81bc6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:19.934775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-820ca28a-d761-4e2a-a6c2-880b05d81bc6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:19.935229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-820ca28a-d761-4e2a-a6c2-880b05d81bc6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:19.936009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-820ca28a-d761-4e2a-a6c2-880b05d81bc6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:19.936544 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-820ca28a-d761-4e2a-a6c2-880b05d81bc6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:19.936899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-820ca28a-d761-4e2a-a6c2-880b05d81bc6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:20.071103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-820ca28a-d761-4e2a-a6c2-880b05d81bc6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:20.078940 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-820ca28a-d761-4e2a-a6c2-880b05d81bc6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1629 microversion: 2.1 time: 0.155553 Oct 04 22:37:20.079542 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3992/7965] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:19 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1629 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:37:21.104099 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b3aa17b4-b1a5-4982-a36a-a4fa61aa8062 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:21.104724 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b3aa17b4-b1a5-4982-a36a-a4fa61aa8062 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:21.110969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3aa17b4-b1a5-4982-a36a-a4fa61aa8062 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:21.111466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3aa17b4-b1a5-4982-a36a-a4fa61aa8062 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:21.111908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3aa17b4-b1a5-4982-a36a-a4fa61aa8062 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:21.112630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3aa17b4-b1a5-4982-a36a-a4fa61aa8062 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:21.113301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3aa17b4-b1a5-4982-a36a-a4fa61aa8062 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:21.113761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b3aa17b4-b1a5-4982-a36a-a4fa61aa8062 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:21.119852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:37:21.215291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-ed6af735-c339-4a61-a3ea-04afa7613c8d req-4ef26eb9-a856-436f-aff0-1a9df0fdeb53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4753a169-179d-47a1-86c3-43b89e8c9ffa", "name": "network-vif-unplugged", "status": "completed", "tag": "7b7e505f-ec79-49e6-bda8-5ecdcb98ca4a"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:37:21.227004 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ed6af735-c339-4a61-a3ea-04afa7613c8d req-4ef26eb9-a856-436f-aff0-1a9df0fdeb53 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:21.227757 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ed6af735-c339-4a61-a3ea-04afa7613c8d req-4ef26eb9-a856-436f-aff0-1a9df0fdeb53 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:21.228287 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ed6af735-c339-4a61-a3ea-04afa7613c8d req-4ef26eb9-a856-436f-aff0-1a9df0fdeb53 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:21.239598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.compute.server_external_events [req-ed6af735-c339-4a61-a3ea-04afa7613c8d req-4ef26eb9-a856-436f-aff0-1a9df0fdeb53 service nova] Unable to find a host for instance 4753a169-179d-47a1-86c3-43b89e8c9ffa. Dropping event network-vif-unplugged {{(pid=122757) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 22:37:21.240547 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-ed6af735-c339-4a61-a3ea-04afa7613c8d req-4ef26eb9-a856-436f-aff0-1a9df0fdeb53 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031794 Oct 04 22:37:21.241330 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3993/7966] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 04 22:37:21.256412 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b3aa17b4-b1a5-4982-a36a-a4fa61aa8062 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:21.266862 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b3aa17b4-b1a5-4982-a36a-a4fa61aa8062 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1629 microversion: 2.1 time: 0.167811 Oct 04 22:37:21.267648 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3974/7967] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:21 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1629 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:22.292629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f6cb5b3f-bd2e-4522-bbd5-4f47cea98f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:22.293272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f6cb5b3f-bd2e-4522-bbd5-4f47cea98f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:22.296005 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=31 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:37:22.300865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6cb5b3f-bd2e-4522-bbd5-4f47cea98f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:22.301381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6cb5b3f-bd2e-4522-bbd5-4f47cea98f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:22.301879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6cb5b3f-bd2e-4522-bbd5-4f47cea98f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:22.302605 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6cb5b3f-bd2e-4522-bbd5-4f47cea98f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:22.303641 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6cb5b3f-bd2e-4522-bbd5-4f47cea98f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:22.304099 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f6cb5b3f-bd2e-4522-bbd5-4f47cea98f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:22.306837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=87 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:37:22.548385 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f6cb5b3f-bd2e-4522-bbd5-4f47cea98f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:22.557151 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f6cb5b3f-bd2e-4522-bbd5-4f47cea98f1a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1687 microversion: 2.1 time: 0.268406 Oct 04 22:37:22.557771 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3994/7968] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:22 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1687 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:23.378819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-d9a49404-c6ef-47d4-ad98-c460307494db req-2606427a-c271-4926-9ed2-c44ff7e5d877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4753a169-179d-47a1-86c3-43b89e8c9ffa", "tag": "7b7e505f-ec79-49e6-bda8-5ecdcb98ca4a"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:37:23.384485 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:37:23.389995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d9a49404-c6ef-47d4-ad98-c460307494db req-2606427a-c271-4926-9ed2-c44ff7e5d877 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:23.390483 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d9a49404-c6ef-47d4-ad98-c460307494db req-2606427a-c271-4926-9ed2-c44ff7e5d877 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:23.390970 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d9a49404-c6ef-47d4-ad98-c460307494db req-2606427a-c271-4926-9ed2-c44ff7e5d877 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:23.404167 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-d9a49404-c6ef-47d4-ad98-c460307494db req-2606427a-c271-4926-9ed2-c44ff7e5d877 service nova] Creating event network-changed:7b7e505f-ec79-49e6-bda8-5ecdcb98ca4a for instance 4753a169-179d-47a1-86c3-43b89e8c9ffa on n-h2-860282-1 Oct 04 22:37:23.409184 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-d9a49404-c6ef-47d4-ad98-c460307494db req-2606427a-c271-4926-9ed2-c44ff7e5d877 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093469 Oct 04 22:37:23.409841 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3975/7969] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:37:23.582332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6946eaf1-e488-4061-8eac-e70f98e50260 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:23.582968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6946eaf1-e488-4061-8eac-e70f98e50260 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:23.590724 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6946eaf1-e488-4061-8eac-e70f98e50260 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:23.591228 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6946eaf1-e488-4061-8eac-e70f98e50260 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:23.591684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6946eaf1-e488-4061-8eac-e70f98e50260 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:23.592405 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6946eaf1-e488-4061-8eac-e70f98e50260 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:23.592880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6946eaf1-e488-4061-8eac-e70f98e50260 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:23.593327 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6946eaf1-e488-4061-8eac-e70f98e50260 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:23.809334 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6946eaf1-e488-4061-8eac-e70f98e50260 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:23.817512 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6946eaf1-e488-4061-8eac-e70f98e50260 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1687 microversion: 2.1 time: 0.239192 Oct 04 22:37:23.818114 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3995/7970] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:23 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1687 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:24.843561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-13141e85-23ea-4989-a2b4-ceab57aa2152 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:24.845405 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-13141e85-23ea-4989-a2b4-ceab57aa2152 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:24.855342 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13141e85-23ea-4989-a2b4-ceab57aa2152 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:24.856192 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13141e85-23ea-4989-a2b4-ceab57aa2152 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:24.857600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13141e85-23ea-4989-a2b4-ceab57aa2152 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:24.858656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13141e85-23ea-4989-a2b4-ceab57aa2152 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:24.859222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13141e85-23ea-4989-a2b4-ceab57aa2152 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:24.859869 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-13141e85-23ea-4989-a2b4-ceab57aa2152 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:25.020726 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-13141e85-23ea-4989-a2b4-ceab57aa2152 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:25.028980 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-13141e85-23ea-4989-a2b4-ceab57aa2152 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1687 microversion: 2.1 time: 0.190935 Oct 04 22:37:25.029918 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3976/7971] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:24 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1687 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:26.052871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-cc8762a7-c6cb-4312-b7be-3b5e03298bc8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:26.054474 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-cc8762a7-c6cb-4312-b7be-3b5e03298bc8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:26.069141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc8762a7-c6cb-4312-b7be-3b5e03298bc8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:26.071188 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc8762a7-c6cb-4312-b7be-3b5e03298bc8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:26.073697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc8762a7-c6cb-4312-b7be-3b5e03298bc8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:26.074836 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc8762a7-c6cb-4312-b7be-3b5e03298bc8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:26.075499 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc8762a7-c6cb-4312-b7be-3b5e03298bc8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:26.076126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-cc8762a7-c6cb-4312-b7be-3b5e03298bc8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:26.244563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-cc8762a7-c6cb-4312-b7be-3b5e03298bc8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:26.253561 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-cc8762a7-c6cb-4312-b7be-3b5e03298bc8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1687 microversion: 2.1 time: 0.205021 Oct 04 22:37:26.254093 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3996/7972] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:26 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1687 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:27.286067 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7a30adb6-ec1a-4523-a514-d57d146070a1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:27.287718 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7a30adb6-ec1a-4523-a514-d57d146070a1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:27.295389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a30adb6-ec1a-4523-a514-d57d146070a1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:27.296064 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a30adb6-ec1a-4523-a514-d57d146070a1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:27.296509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a30adb6-ec1a-4523-a514-d57d146070a1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:27.297216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a30adb6-ec1a-4523-a514-d57d146070a1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:27.297692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a30adb6-ec1a-4523-a514-d57d146070a1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:27.298116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7a30adb6-ec1a-4523-a514-d57d146070a1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:27.458224 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7a30adb6-ec1a-4523-a514-d57d146070a1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:27.471413 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7a30adb6-ec1a-4523-a514-d57d146070a1 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1687 microversion: 2.1 time: 0.190607 Oct 04 22:37:27.483301 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3977/7973] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:27 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1687 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:28.497119 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-20173b0a-fa71-4855-b44d-df1cfc37378b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:28.497763 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-20173b0a-fa71-4855-b44d-df1cfc37378b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:28.517229 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20173b0a-fa71-4855-b44d-df1cfc37378b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:28.517798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20173b0a-fa71-4855-b44d-df1cfc37378b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:28.518258 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20173b0a-fa71-4855-b44d-df1cfc37378b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:28.518979 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20173b0a-fa71-4855-b44d-df1cfc37378b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:28.519482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20173b0a-fa71-4855-b44d-df1cfc37378b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:28.519893 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-20173b0a-fa71-4855-b44d-df1cfc37378b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:28.666987 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-20173b0a-fa71-4855-b44d-df1cfc37378b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:28.675794 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-20173b0a-fa71-4855-b44d-df1cfc37378b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1687 microversion: 2.1 time: 0.183154 Oct 04 22:37:28.676547 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3997/7974] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:28 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1687 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:29.700332 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-918dfac0-c2fc-436b-806d-7985ae3bfe93 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:29.701038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-918dfac0-c2fc-436b-806d-7985ae3bfe93 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:29.707983 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-918dfac0-c2fc-436b-806d-7985ae3bfe93 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:29.708498 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-918dfac0-c2fc-436b-806d-7985ae3bfe93 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:29.708923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-918dfac0-c2fc-436b-806d-7985ae3bfe93 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:29.709666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-918dfac0-c2fc-436b-806d-7985ae3bfe93 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:29.710136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-918dfac0-c2fc-436b-806d-7985ae3bfe93 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:29.710714 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-918dfac0-c2fc-436b-806d-7985ae3bfe93 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:29.852122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-918dfac0-c2fc-436b-806d-7985ae3bfe93 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:29.860112 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-918dfac0-c2fc-436b-806d-7985ae3bfe93 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1687 microversion: 2.1 time: 0.163756 Oct 04 22:37:29.860697 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3978/7975] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:29 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:30.885133 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b827bab7-ad10-44e0-b4d1-d91a88142131 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:30.885814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b827bab7-ad10-44e0-b4d1-d91a88142131 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:30.892949 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b827bab7-ad10-44e0-b4d1-d91a88142131 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:30.893489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b827bab7-ad10-44e0-b4d1-d91a88142131 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:30.893959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b827bab7-ad10-44e0-b4d1-d91a88142131 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:30.894687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b827bab7-ad10-44e0-b4d1-d91a88142131 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:30.895174 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b827bab7-ad10-44e0-b4d1-d91a88142131 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:30.895630 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-b827bab7-ad10-44e0-b4d1-d91a88142131 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:31.049674 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b827bab7-ad10-44e0-b4d1-d91a88142131 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:31.058061 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b827bab7-ad10-44e0-b4d1-d91a88142131 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1687 microversion: 2.1 time: 0.177506 Oct 04 22:37:31.058648 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3998/7976] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:30 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:32.083178 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-b50d8b2f-2adf-4eb6-aa14-5a0926911edd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:32.083812 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-b50d8b2f-2adf-4eb6-aa14-5a0926911edd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:32.090933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b50d8b2f-2adf-4eb6-aa14-5a0926911edd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:32.091428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b50d8b2f-2adf-4eb6-aa14-5a0926911edd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:32.091876 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b50d8b2f-2adf-4eb6-aa14-5a0926911edd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:32.092574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b50d8b2f-2adf-4eb6-aa14-5a0926911edd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:32.093038 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b50d8b2f-2adf-4eb6-aa14-5a0926911edd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:32.093508 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-b50d8b2f-2adf-4eb6-aa14-5a0926911edd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:32.239473 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-b50d8b2f-2adf-4eb6-aa14-5a0926911edd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:32.248205 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-b50d8b2f-2adf-4eb6-aa14-5a0926911edd tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1687 microversion: 2.1 time: 0.169043 Oct 04 22:37:32.258942 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3979/7977] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:32 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:33.272344 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-80f90383-d5d1-4f14-a477-9619881358eb tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:33.272945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-80f90383-d5d1-4f14-a477-9619881358eb tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:33.280352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80f90383-d5d1-4f14-a477-9619881358eb tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:33.280853 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80f90383-d5d1-4f14-a477-9619881358eb tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:33.281345 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80f90383-d5d1-4f14-a477-9619881358eb tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:33.282045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80f90383-d5d1-4f14-a477-9619881358eb tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:33.282516 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80f90383-d5d1-4f14-a477-9619881358eb tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:33.283428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-80f90383-d5d1-4f14-a477-9619881358eb tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:33.477796 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-80f90383-d5d1-4f14-a477-9619881358eb tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:33.486649 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-80f90383-d5d1-4f14-a477-9619881358eb tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1687 microversion: 2.1 time: 0.218319 Oct 04 22:37:33.487247 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 3999/7978] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:33 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1687 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:34.510112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-76ad75d5-b056-487b-b857-1b2f39477605 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:34.510858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-76ad75d5-b056-487b-b857-1b2f39477605 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:34.518324 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76ad75d5-b056-487b-b857-1b2f39477605 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:34.518807 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76ad75d5-b056-487b-b857-1b2f39477605 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:34.519242 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76ad75d5-b056-487b-b857-1b2f39477605 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:34.520037 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76ad75d5-b056-487b-b857-1b2f39477605 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:34.520735 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76ad75d5-b056-487b-b857-1b2f39477605 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:34.520921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-76ad75d5-b056-487b-b857-1b2f39477605 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:34.660431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-76ad75d5-b056-487b-b857-1b2f39477605 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:34.668295 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-76ad75d5-b056-487b-b857-1b2f39477605 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1687 microversion: 2.1 time: 0.162085 Oct 04 22:37:34.668893 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3980/7979] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:34 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:35.692264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-70558ba6-901c-48b7-bd52-3db634debe74 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:35.692945 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-70558ba6-901c-48b7-bd52-3db634debe74 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:35.701540 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70558ba6-901c-48b7-bd52-3db634debe74 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:35.702059 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70558ba6-901c-48b7-bd52-3db634debe74 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:35.702537 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70558ba6-901c-48b7-bd52-3db634debe74 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:35.703410 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70558ba6-901c-48b7-bd52-3db634debe74 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:35.704061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70558ba6-901c-48b7-bd52-3db634debe74 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:35.704636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-70558ba6-901c-48b7-bd52-3db634debe74 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:35.859313 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-70558ba6-901c-48b7-bd52-3db634debe74 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:35.867567 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-70558ba6-901c-48b7-bd52-3db634debe74 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1687 microversion: 2.1 time: 0.179239 Oct 04 22:37:35.868293 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4000/7980] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:35 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1687 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:36.891339 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-a474c86b-b213-4bc6-b128-82f69e845339 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:36.891968 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-a474c86b-b213-4bc6-b128-82f69e845339 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:36.898916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a474c86b-b213-4bc6-b128-82f69e845339 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:36.899404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a474c86b-b213-4bc6-b128-82f69e845339 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:36.899844 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a474c86b-b213-4bc6-b128-82f69e845339 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:36.900541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a474c86b-b213-4bc6-b128-82f69e845339 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:36.901008 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a474c86b-b213-4bc6-b128-82f69e845339 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:36.901452 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-a474c86b-b213-4bc6-b128-82f69e845339 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:37.038541 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-a474c86b-b213-4bc6-b128-82f69e845339 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:37.047137 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-a474c86b-b213-4bc6-b128-82f69e845339 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1687 microversion: 2.1 time: 0.159697 Oct 04 22:37:37.047837 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3981/7981] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:36 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:37:38.070043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2a149fb5-3ee5-4876-a0aa-bee79a908457 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:38.070688 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2a149fb5-3ee5-4876-a0aa-bee79a908457 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:38.077972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a149fb5-3ee5-4876-a0aa-bee79a908457 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:38.078505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a149fb5-3ee5-4876-a0aa-bee79a908457 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:38.078967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a149fb5-3ee5-4876-a0aa-bee79a908457 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:38.079683 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a149fb5-3ee5-4876-a0aa-bee79a908457 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:38.080186 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a149fb5-3ee5-4876-a0aa-bee79a908457 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:38.080633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2a149fb5-3ee5-4876-a0aa-bee79a908457 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:38.217957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2a149fb5-3ee5-4876-a0aa-bee79a908457 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:38.223475 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2a149fb5-3ee5-4876-a0aa-bee79a908457 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1687 microversion: 2.1 time: 0.157394 Oct 04 22:37:38.224061 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4001/7982] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:38 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:38.386561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-961fef7a-ed7c-4617-a44b-042789f0ca2c req-cc52a6a0-323d-4fc1-b38e-cb77fb9f7833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4753a169-179d-47a1-86c3-43b89e8c9ffa", "name": "network-vif-plugged", "status": "completed", "tag": "7b7e505f-ec79-49e6-bda8-5ecdcb98ca4a"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:37:38.397336 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-961fef7a-ed7c-4617-a44b-042789f0ca2c req-cc52a6a0-323d-4fc1-b38e-cb77fb9f7833 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:38.397896 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-961fef7a-ed7c-4617-a44b-042789f0ca2c req-cc52a6a0-323d-4fc1-b38e-cb77fb9f7833 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:38.398325 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-961fef7a-ed7c-4617-a44b-042789f0ca2c req-cc52a6a0-323d-4fc1-b38e-cb77fb9f7833 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:38.410174 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-961fef7a-ed7c-4617-a44b-042789f0ca2c req-cc52a6a0-323d-4fc1-b38e-cb77fb9f7833 service nova] Creating event network-vif-plugged:7b7e505f-ec79-49e6-bda8-5ecdcb98ca4a for instance 4753a169-179d-47a1-86c3-43b89e8c9ffa on n-h2-860282-1 Oct 04 22:37:38.415249 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-961fef7a-ed7c-4617-a44b-042789f0ca2c req-cc52a6a0-323d-4fc1-b38e-cb77fb9f7833 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032372 Oct 04 22:37:38.415849 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3982/7983] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:37:39.247552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f53084d3-1143-4442-a266-2730fa16df01 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:39.248814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f53084d3-1143-4442-a266-2730fa16df01 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:39.258262 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f53084d3-1143-4442-a266-2730fa16df01 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:39.258765 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f53084d3-1143-4442-a266-2730fa16df01 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:39.259218 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f53084d3-1143-4442-a266-2730fa16df01 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:39.259926 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f53084d3-1143-4442-a266-2730fa16df01 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:39.260408 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f53084d3-1143-4442-a266-2730fa16df01 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:39.260887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f53084d3-1143-4442-a266-2730fa16df01 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:39.405636 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f53084d3-1143-4442-a266-2730fa16df01 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:39.413665 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f53084d3-1143-4442-a266-2730fa16df01 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1687 microversion: 2.1 time: 0.170362 Oct 04 22:37:39.414264 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4002/7984] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:39 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:40.440023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-48957c58-61f4-4f1f-a1d4-e113be4bc113 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:40.440742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-48957c58-61f4-4f1f-a1d4-e113be4bc113 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:40.447382 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48957c58-61f4-4f1f-a1d4-e113be4bc113 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:40.447863 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48957c58-61f4-4f1f-a1d4-e113be4bc113 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:40.448310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48957c58-61f4-4f1f-a1d4-e113be4bc113 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:40.449011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48957c58-61f4-4f1f-a1d4-e113be4bc113 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:40.449497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48957c58-61f4-4f1f-a1d4-e113be4bc113 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:40.449927 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-48957c58-61f4-4f1f-a1d4-e113be4bc113 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:40.589969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-48957c58-61f4-4f1f-a1d4-e113be4bc113 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:40.598071 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-48957c58-61f4-4f1f-a1d4-e113be4bc113 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1687 microversion: 2.1 time: 0.163437 Oct 04 22:37:40.598657 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3983/7985] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:40 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:37:41.622062 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-54190ce8-20b0-45b9-9c46-d4986d325036 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:41.622719 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-54190ce8-20b0-45b9-9c46-d4986d325036 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:41.629642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54190ce8-20b0-45b9-9c46-d4986d325036 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:41.630144 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54190ce8-20b0-45b9-9c46-d4986d325036 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:41.630598 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54190ce8-20b0-45b9-9c46-d4986d325036 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:41.631302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54190ce8-20b0-45b9-9c46-d4986d325036 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:41.631775 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54190ce8-20b0-45b9-9c46-d4986d325036 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:41.632220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-54190ce8-20b0-45b9-9c46-d4986d325036 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:41.767068 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-54190ce8-20b0-45b9-9c46-d4986d325036 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:41.774847 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-54190ce8-20b0-45b9-9c46-d4986d325036 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1674 microversion: 2.1 time: 0.157036 Oct 04 22:37:41.775423 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4003/7986] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:41 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:56.644824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=17 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:38:56.645891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=50 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:38:56.648377 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=19 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:38:56.649220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=59 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:38:56.650210 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:38:56.650364 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 22:38:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Oct 04 22:38:56.652102 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-167c3f47-8810-43cf-af06-81a69aa83d96 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:56.652603 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:38:56.652719 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-167c3f47-8810-43cf-af06-81a69aa83d96 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:56.652811 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 22:38:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Oct 04 22:38:56.662276 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-167c3f47-8810-43cf-af06-81a69aa83d96 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:56.662779 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-167c3f47-8810-43cf-af06-81a69aa83d96 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:56.663229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-167c3f47-8810-43cf-af06-81a69aa83d96 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:56.663943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-167c3f47-8810-43cf-af06-81a69aa83d96 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:56.664065 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-a9a1a7cc-f4a0-4537-809c-b475883b0b49 req-88556cee-c93e-45df-a1e1-60318af4ebb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4753a169-179d-47a1-86c3-43b89e8c9ffa", "tag": "7b7e505f-ec79-49e6-bda8-5ecdcb98ca4a"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:38:56.664407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-167c3f47-8810-43cf-af06-81a69aa83d96 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:56.664907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-167c3f47-8810-43cf-af06-81a69aa83d96 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:56.679881 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a9a1a7cc-f4a0-4537-809c-b475883b0b49 req-88556cee-c93e-45df-a1e1-60318af4ebb9 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:56.680382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a9a1a7cc-f4a0-4537-809c-b475883b0b49 req-88556cee-c93e-45df-a1e1-60318af4ebb9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:56.680827 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a9a1a7cc-f4a0-4537-809c-b475883b0b49 req-88556cee-c93e-45df-a1e1-60318af4ebb9 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:56.693560 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-a9a1a7cc-f4a0-4537-809c-b475883b0b49 req-88556cee-c93e-45df-a1e1-60318af4ebb9 service nova] Creating event network-changed:7b7e505f-ec79-49e6-bda8-5ecdcb98ca4a for instance 4753a169-179d-47a1-86c3-43b89e8c9ffa on n-h2-860282-1 Oct 04 22:38:56.696335 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-167c3f47-8810-43cf-af06-81a69aa83d96 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:38:56.700711 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-a9a1a7cc-f4a0-4537-809c-b475883b0b49 req-88556cee-c93e-45df-a1e1-60318af4ebb9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055142 Oct 04 22:38:56.702051 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4004/7987] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:38:56.993322 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-167c3f47-8810-43cf-af06-81a69aa83d96 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 204 len: 0 microversion: 2.1 time: 0.351394 Oct 04 22:38:56.994272 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3984/7988] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:38:56 2022] DELETE /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:38:57.007306 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-4daee495-ce19-4f43-bede-91e68794242f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:57.008286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-4daee495-ce19-4f43-bede-91e68794242f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:57.015422 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4daee495-ce19-4f43-bede-91e68794242f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:57.016182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4daee495-ce19-4f43-bede-91e68794242f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:57.016634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4daee495-ce19-4f43-bede-91e68794242f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:57.017562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4daee495-ce19-4f43-bede-91e68794242f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:57.018037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4daee495-ce19-4f43-bede-91e68794242f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:57.018479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-4daee495-ce19-4f43-bede-91e68794242f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:57.164307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-4daee495-ce19-4f43-bede-91e68794242f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:57.172455 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-4daee495-ce19-4f43-bede-91e68794242f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1680 microversion: 2.1 time: 0.172422 Oct 04 22:38:57.173069 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4005/7989] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:56 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:58.197278 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e7424f0c-dbe6-4ce3-a472-a0269ed0c9f7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:58.198044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e7424f0c-dbe6-4ce3-a472-a0269ed0c9f7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:58.204943 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7424f0c-dbe6-4ce3-a472-a0269ed0c9f7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:58.205558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7424f0c-dbe6-4ce3-a472-a0269ed0c9f7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:58.205957 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7424f0c-dbe6-4ce3-a472-a0269ed0c9f7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:58.206780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7424f0c-dbe6-4ce3-a472-a0269ed0c9f7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:58.207303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7424f0c-dbe6-4ce3-a472-a0269ed0c9f7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:58.207725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e7424f0c-dbe6-4ce3-a472-a0269ed0c9f7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:58.354813 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e7424f0c-dbe6-4ce3-a472-a0269ed0c9f7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:58.364311 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e7424f0c-dbe6-4ce3-a472-a0269ed0c9f7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1680 microversion: 2.1 time: 0.171266 Oct 04 22:38:58.365107 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3985/7990] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:58 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:59.007311 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-9060841c-7b11-4d64-9064-032dfa17419f req-c8049e53-529d-4d02-a300-4fa155c6ae4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4753a169-179d-47a1-86c3-43b89e8c9ffa", "name": "network-vif-deleted", "tag": "7b7e505f-ec79-49e6-bda8-5ecdcb98ca4a"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:38:59.018271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9060841c-7b11-4d64-9064-032dfa17419f req-c8049e53-529d-4d02-a300-4fa155c6ae4b service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:59.024463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9060841c-7b11-4d64-9064-032dfa17419f req-c8049e53-529d-4d02-a300-4fa155c6ae4b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:59.024463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-9060841c-7b11-4d64-9064-032dfa17419f req-c8049e53-529d-4d02-a300-4fa155c6ae4b service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:59.031169 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-9060841c-7b11-4d64-9064-032dfa17419f req-c8049e53-529d-4d02-a300-4fa155c6ae4b service nova] Creating event network-vif-deleted:7b7e505f-ec79-49e6-bda8-5ecdcb98ca4a for instance 4753a169-179d-47a1-86c3-43b89e8c9ffa on n-h2-860282-1 Oct 04 22:38:59.037072 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-9060841c-7b11-4d64-9064-032dfa17419f req-c8049e53-529d-4d02-a300-4fa155c6ae4b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034155 Oct 04 22:38:59.037837 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4006/7991] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:38:59.393442 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-08c7a482-6257-45a5-9cc3-6a08e668a82d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:59.394738 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-08c7a482-6257-45a5-9cc3-6a08e668a82d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:59.402445 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08c7a482-6257-45a5-9cc3-6a08e668a82d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:59.402836 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08c7a482-6257-45a5-9cc3-6a08e668a82d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:59.403266 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08c7a482-6257-45a5-9cc3-6a08e668a82d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:59.404181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08c7a482-6257-45a5-9cc3-6a08e668a82d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:59.404639 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08c7a482-6257-45a5-9cc3-6a08e668a82d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:59.405068 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08c7a482-6257-45a5-9cc3-6a08e668a82d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:59.443688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08c7a482-6257-45a5-9cc3-6a08e668a82d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:59.444181 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08c7a482-6257-45a5-9cc3-6a08e668a82d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:59.444618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-08c7a482-6257-45a5-9cc3-6a08e668a82d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:59.445078 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.objects.instance [None req-08c7a482-6257-45a5-9cc3-6a08e668a82d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lazy-loading 'fault' on Instance uuid 4753a169-179d-47a1-86c3-43b89e8c9ffa {{(pid=122758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:38:59.488838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-08c7a482-6257-45a5-9cc3-6a08e668a82d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:59.497132 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-08c7a482-6257-45a5-9cc3-6a08e668a82d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 200 len: 1337 microversion: 2.1 time: 0.108628 Oct 04 22:38:59.503949 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3986/7992] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:59 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 1337 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:00.522587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0d543a20-2ee4-47cc-8d4d-0fc4a3e4b489 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:00.523316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-0d543a20-2ee4-47cc-8d4d-0fc4a3e4b489 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: 4753a169-179d-47a1-86c3-43b89e8c9ffa] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:00.530455 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d543a20-2ee4-47cc-8d4d-0fc4a3e4b489 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:00.530963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d543a20-2ee4-47cc-8d4d-0fc4a3e4b489 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:00.531416 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d543a20-2ee4-47cc-8d4d-0fc4a3e4b489 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:00.532130 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d543a20-2ee4-47cc-8d4d-0fc4a3e4b489 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:00.532602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d543a20-2ee4-47cc-8d4d-0fc4a3e4b489 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:00.533046 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-0d543a20-2ee4-47cc-8d4d-0fc4a3e4b489 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:00.547663 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.wsgi [None req-0d543a20-2ee4-47cc-8d4d-0fc4a3e4b489 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] HTTP exception thrown: Instance 4753a169-179d-47a1-86c3-43b89e8c9ffa could not be found. Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0d543a20-2ee4-47cc-8d4d-0fc4a3e4b489 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Request method failure captured: Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: request: GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa HTTP/1.1 Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: Accept: application/json Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: Accept-Encoding: identity Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: Connection: close Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: Content-Length: 0 Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: Content-Type: application/json Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: Host: 10.222.0.30 Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: Openstack-System-Scope: None Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: User-Agent: python-urllib3/1.26.12 Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-Auth-Token: gAAAAABjPLT69em2yxNdCsn-SgSPIMan-b5FGhcr9vPQa3Q23rza3AijTVDRtrSLnQGdicbxBz89BQjEiIzxqUEhmOALpwdWjOWREbr_vFLyVh-_8QQWMTPhUFfzoO770IIG-jgs0YfZC4J72U2uMjZMQqS4pW64bYiLAnbjnY6FiJIeMx77960 Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Id: None Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-Domain-Name: None Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-Identity-Status: Confirmed Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-Is-Admin-Project: True Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Id: default Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Domain-Name: Default Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Id: dd59893424064ce88d258278e5ead023 Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-Project-Name: tempest-TestShelveInstance-219297494 Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-Role: reader,member Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-Roles: reader,member Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd59893424064ce88d258278e5ead023"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dd59893424064ce88d258278e5ead023"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dd59893424064ce88d258278e5ead023"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd59893424064ce88d258278e5ead023"}]}] Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant: tempest-TestShelveInstance-219297494 Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Id: dd59893424064ce88d258278e5ead023 Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-Tenant-Name: tempest-TestShelveInstance-219297494 Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-User: tempest-TestShelveInstance-219297494-project Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Id: default Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-User-Domain-Name: Default Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-User-Id: 503dac0152fd4639a94d119970d0d019 Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: X-User-Name: tempest-TestShelveInstance-219297494-project Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: method: > Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: exception: Instance 4753a169-179d-47a1-86c3-43b89e8c9ffa could not be found. Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: action_args: {'id': '4753a169-179d-47a1-86c3-43b89e8c9ffa'} Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4753a169-179d-47a1-86c3-43b89e8c9ffa could not be found. Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4753a169-179d-47a1-86c3-43b89e8c9ffa could not be found. Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:39:00.549388 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:39:00.555581 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:39:00.555581 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:39:00.555581 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:39:00.555581 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:39:00.555581 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:39:00.555581 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4753a169-179d-47a1-86c3-43b89e8c9ffa could not be found. Oct 04 22:39:00.555581 n-d-860282-1 devstack@n-api.service[122757]: ERROR nova.api.openstack.wsgi Oct 04 22:39:00.555581 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-0d543a20-2ee4-47cc-8d4d-0fc4a3e4b489 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Returning 404 to user: Instance 4753a169-179d-47a1-86c3-43b89e8c9ffa could not be found. {{(pid=122757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:39:00.555581 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-0d543a20-2ee4-47cc-8d4d-0fc4a3e4b489 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa" status: 404 len: 111 microversion: 2.1 time: 0.034401 Oct 04 22:39:00.555581 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4007/7993] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:00 2022] GET /compute/v2.1/servers/4753a169-179d-47a1-86c3-43b89e8c9ffa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:39:00.775364 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c87ce592-bf27-4a47-8091-b104cbe1e35a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '.version_select at 0x7f5790054670>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:00.868141 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c87ce592-bf27-4a47-8091-b104cbe1e35a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1951085467" status: 202 len: 0 microversion: 2.1 time: 0.097442 Oct 04 22:39:00.868741 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3987/7994] 10.222.0.30 () {58 vars in 1254 bytes} [Tue Oct 4 22:39:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1951085467 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:39:00.893715 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ca02dbed-fb57-46ad-9175-97017384363a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Action: 'create', calling method: .version_select at 0x7f578ba32c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-789074138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOj/+YE2C4z6Di3U8SsPqlKWR0QNMWok1Mzku5LgK37OEN6CKs8SLBLmXTAhjJ8nyvlCXLR377vMJuclPl671M+Mv5t2FmozniycMVLP27zhf0bEeZ5dSSIxPGzVLyfu+g=="}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:39:00.910256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-ca02dbed-fb57-46ad-9175-97017384363a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Getting quotas for project dd59893424064ce88d258278e5ead023. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:39:00.915498 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-ca02dbed-fb57-46ad-9175-97017384363a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Getting quotas for user 503dac0152fd4639a94d119970d0d019 and project dd59893424064ce88d258278e5ead023. Resources: {'key_pairs'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:39:01.039882 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ca02dbed-fb57-46ad-9175-97017384363a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.150184 Oct 04 22:39:01.040606 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4008/7995] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 22:39:00 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:39:24.277208 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:24.278155 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:24.282577 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-54c8e940-587b-4c68-9e09-580b8b5c36aa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-197231501", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-789074138", "security_groups": [{"name": "tempest-secgroup-smoke-251293543"}], "networks": [{"uuid": "d24e14d2-d7ec-4cf1-bccd-e77d7fa86935"}], "block_device_mapping_v2": [{"uuid": "77389bd2-c74f-4646-83b8-ab8650834d43", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:39:24.400535 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-54c8e940-587b-4c68-9e09-580b8b5c36aa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] validate_networks() for [('d24e14d2-d7ec-4cf1-bccd-e77d7fa86935', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:39:24.826290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-54c8e940-587b-4c68-9e09-580b8b5c36aa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:39:24.826725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-54c8e940-587b-4c68-9e09-580b8b5c36aa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:39:24.827212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-54c8e940-587b-4c68-9e09-580b8b5c36aa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:39:24.827628 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-54c8e940-587b-4c68-9e09-580b8b5c36aa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:39:24.828050 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-54c8e940-587b-4c68-9e09-580b8b5c36aa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:39:24.836856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54c8e940-587b-4c68-9e09-580b8b5c36aa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:24.837341 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54c8e940-587b-4c68-9e09-580b8b5c36aa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:24.837824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54c8e940-587b-4c68-9e09-580b8b5c36aa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:24.838551 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54c8e940-587b-4c68-9e09-580b8b5c36aa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:24.839009 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54c8e940-587b-4c68-9e09-580b8b5c36aa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:24.839450 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-54c8e940-587b-4c68-9e09-580b8b5c36aa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:24.858555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-54c8e940-587b-4c68-9e09-580b8b5c36aa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Getting quotas for project dd59893424064ce88d258278e5ead023. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:39:24.863796 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-54c8e940-587b-4c68-9e09-580b8b5c36aa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Getting quotas for user 503dac0152fd4639a94d119970d0d019 and project dd59893424064ce88d258278e5ead023. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:39:24.922156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-54c8e940-587b-4c68-9e09-580b8b5c36aa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:39:24.924355 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-54c8e940-587b-4c68-9e09-580b8b5c36aa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77389bd2-c74f-4646-83b8-ab8650834d43',volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:39:25.302520 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-54c8e940-587b-4c68-9e09-580b8b5c36aa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.027102 Oct 04 22:39:25.303233 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3988/7996] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:39:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:39:25.314471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3413a004-a222-48f1-be87-37a6362d4331 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:25.315118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3413a004-a222-48f1-be87-37a6362d4331 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:25.319054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=12 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:25.319750 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:25.320401 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:25.374920 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3413a004-a222-48f1-be87-37a6362d4331 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:25.385030 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3413a004-a222-48f1-be87-37a6362d4331 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1087 microversion: 2.1 time: 0.071469 Oct 04 22:39:25.385030 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4009/7997] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:25 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1087 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:26.410127 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-501a9a25-db52-47b8-8cc8-e5df1df0d572 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:26.410838 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-501a9a25-db52-47b8-8cc8-e5df1df0d572 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:26.417652 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-501a9a25-db52-47b8-8cc8-e5df1df0d572 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:26.418150 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-501a9a25-db52-47b8-8cc8-e5df1df0d572 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:26.418596 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-501a9a25-db52-47b8-8cc8-e5df1df0d572 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:26.419298 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-501a9a25-db52-47b8-8cc8-e5df1df0d572 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:26.419760 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-501a9a25-db52-47b8-8cc8-e5df1df0d572 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:26.420904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-501a9a25-db52-47b8-8cc8-e5df1df0d572 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:26.487152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-501a9a25-db52-47b8-8cc8-e5df1df0d572 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:26.495408 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-501a9a25-db52-47b8-8cc8-e5df1df0d572 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1137 microversion: 2.1 time: 0.090697 Oct 04 22:39:26.496187 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3989/7998] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:26 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1137 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:27.518372 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-79c6ade6-3df4-4334-b861-4e39acf0a31c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:27.519070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-79c6ade6-3df4-4334-b861-4e39acf0a31c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:27.531003 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79c6ade6-3df4-4334-b861-4e39acf0a31c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:27.531758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79c6ade6-3df4-4334-b861-4e39acf0a31c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:27.532355 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79c6ade6-3df4-4334-b861-4e39acf0a31c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:27.533184 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79c6ade6-3df4-4334-b861-4e39acf0a31c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:27.533778 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79c6ade6-3df4-4334-b861-4e39acf0a31c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:27.534317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-79c6ade6-3df4-4334-b861-4e39acf0a31c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:27.613011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-79c6ade6-3df4-4334-b861-4e39acf0a31c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:27.621151 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-79c6ade6-3df4-4334-b861-4e39acf0a31c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1203 microversion: 2.1 time: 0.106923 Oct 04 22:39:27.621756 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4010/7999] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:27 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1203 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:28.645684 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9354a1a1-a908-454d-829a-7ac6fcb122b6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:28.646615 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9354a1a1-a908-454d-829a-7ac6fcb122b6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:28.653346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9354a1a1-a908-454d-829a-7ac6fcb122b6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:28.653941 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9354a1a1-a908-454d-829a-7ac6fcb122b6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:28.654477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9354a1a1-a908-454d-829a-7ac6fcb122b6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:28.655824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9354a1a1-a908-454d-829a-7ac6fcb122b6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:28.656783 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9354a1a1-a908-454d-829a-7ac6fcb122b6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:28.657389 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9354a1a1-a908-454d-829a-7ac6fcb122b6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:28.798601 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9354a1a1-a908-454d-829a-7ac6fcb122b6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:28.807940 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9354a1a1-a908-454d-829a-7ac6fcb122b6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1270 microversion: 2.1 time: 0.166209 Oct 04 22:39:28.808531 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3990/8000] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:28 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:29.130975 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-535c946f-d106-4b6e-9bb5-a65c08107535 req-2a3cf038-2804-448b-a52d-8e2775bf5b70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc11f030-0544-4922-afd9-b36609c852b8", "tag": "7fe18374-c7ed-4937-858a-47e48c907031"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:39:29.144590 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-535c946f-d106-4b6e-9bb5-a65c08107535 req-2a3cf038-2804-448b-a52d-8e2775bf5b70 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:29.145461 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-535c946f-d106-4b6e-9bb5-a65c08107535 req-2a3cf038-2804-448b-a52d-8e2775bf5b70 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:29.145940 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-535c946f-d106-4b6e-9bb5-a65c08107535 req-2a3cf038-2804-448b-a52d-8e2775bf5b70 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:29.161354 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-535c946f-d106-4b6e-9bb5-a65c08107535 req-2a3cf038-2804-448b-a52d-8e2775bf5b70 service nova] Creating event network-changed:7fe18374-c7ed-4937-858a-47e48c907031 for instance bc11f030-0544-4922-afd9-b36609c852b8 on n-h1-860282-1 Oct 04 22:39:29.167322 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-535c946f-d106-4b6e-9bb5-a65c08107535 req-2a3cf038-2804-448b-a52d-8e2775bf5b70 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126362 Oct 04 22:39:29.168210 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4011/8001] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:39:29.831952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8a5bbece-b921-4732-8c0d-9e63fab8760e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:29.836492 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8a5bbece-b921-4732-8c0d-9e63fab8760e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:29.841252 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a5bbece-b921-4732-8c0d-9e63fab8760e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:29.841928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a5bbece-b921-4732-8c0d-9e63fab8760e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:29.842523 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a5bbece-b921-4732-8c0d-9e63fab8760e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:29.843448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a5bbece-b921-4732-8c0d-9e63fab8760e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:29.844013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a5bbece-b921-4732-8c0d-9e63fab8760e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:29.844546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8a5bbece-b921-4732-8c0d-9e63fab8760e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:29.991832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-8a5bbece-b921-4732-8c0d-9e63fab8760e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:30.000256 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8a5bbece-b921-4732-8c0d-9e63fab8760e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1270 microversion: 2.1 time: 0.172260 Oct 04 22:39:30.000854 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3991/8002] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:29 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:31.023684 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-98f5341a-e367-4578-b0df-0a31c1c74e66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:31.024398 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-98f5341a-e367-4578-b0df-0a31c1c74e66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:31.031931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98f5341a-e367-4578-b0df-0a31c1c74e66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:31.034255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98f5341a-e367-4578-b0df-0a31c1c74e66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:31.034255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98f5341a-e367-4578-b0df-0a31c1c74e66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:31.034255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98f5341a-e367-4578-b0df-0a31c1c74e66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:31.034255 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98f5341a-e367-4578-b0df-0a31c1c74e66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:31.034692 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-98f5341a-e367-4578-b0df-0a31c1c74e66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:31.171818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-98f5341a-e367-4578-b0df-0a31c1c74e66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:31.179733 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-98f5341a-e367-4578-b0df-0a31c1c74e66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1270 microversion: 2.1 time: 0.160391 Oct 04 22:39:31.180317 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4012/8003] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:31 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:32.203822 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-c27765c2-d66d-44cd-bcc4-cd0b8d8b8592 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:32.204446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-c27765c2-d66d-44cd-bcc4-cd0b8d8b8592 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:32.211584 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c27765c2-d66d-44cd-bcc4-cd0b8d8b8592 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:32.212069 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c27765c2-d66d-44cd-bcc4-cd0b8d8b8592 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:32.212506 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c27765c2-d66d-44cd-bcc4-cd0b8d8b8592 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:32.213198 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c27765c2-d66d-44cd-bcc4-cd0b8d8b8592 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:32.213686 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c27765c2-d66d-44cd-bcc4-cd0b8d8b8592 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:32.214112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-c27765c2-d66d-44cd-bcc4-cd0b8d8b8592 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:32.350919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-c27765c2-d66d-44cd-bcc4-cd0b8d8b8592 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:32.359293 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-c27765c2-d66d-44cd-bcc4-cd0b8d8b8592 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1270 microversion: 2.1 time: 0.159763 Oct 04 22:39:32.359915 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3992/8004] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:32 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:33.383512 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f8eb43f8-ff29-4a17-a749-8ed423eb9c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:33.384126 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f8eb43f8-ff29-4a17-a749-8ed423eb9c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:33.390883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8eb43f8-ff29-4a17-a749-8ed423eb9c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:33.391418 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8eb43f8-ff29-4a17-a749-8ed423eb9c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:33.391871 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8eb43f8-ff29-4a17-a749-8ed423eb9c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:33.392577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8eb43f8-ff29-4a17-a749-8ed423eb9c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:33.393051 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8eb43f8-ff29-4a17-a749-8ed423eb9c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:33.393520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f8eb43f8-ff29-4a17-a749-8ed423eb9c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:33.528200 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f8eb43f8-ff29-4a17-a749-8ed423eb9c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:33.536616 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f8eb43f8-ff29-4a17-a749-8ed423eb9c2d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1258 microversion: 2.1 time: 0.156991 Oct 04 22:39:33.537256 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4013/8005] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:33 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:34.560159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-942aa412-e709-460e-bd73-3c5e2008a7e0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:34.560810 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-942aa412-e709-460e-bd73-3c5e2008a7e0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:34.568475 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-942aa412-e709-460e-bd73-3c5e2008a7e0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:34.568965 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-942aa412-e709-460e-bd73-3c5e2008a7e0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:34.569407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-942aa412-e709-460e-bd73-3c5e2008a7e0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:34.570133 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-942aa412-e709-460e-bd73-3c5e2008a7e0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:34.570591 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-942aa412-e709-460e-bd73-3c5e2008a7e0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:34.571023 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-942aa412-e709-460e-bd73-3c5e2008a7e0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:34.704121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-942aa412-e709-460e-bd73-3c5e2008a7e0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:34.712538 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-942aa412-e709-460e-bd73-3c5e2008a7e0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1258 microversion: 2.1 time: 0.156284 Oct 04 22:39:34.713123 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3993/8006] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:34 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:35.735518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-02eb2ef9-1ad9-49c7-8b8d-f93db17f25c6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:35.736653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-02eb2ef9-1ad9-49c7-8b8d-f93db17f25c6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:35.744265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02eb2ef9-1ad9-49c7-8b8d-f93db17f25c6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:35.744892 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02eb2ef9-1ad9-49c7-8b8d-f93db17f25c6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:35.745353 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02eb2ef9-1ad9-49c7-8b8d-f93db17f25c6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:35.748331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02eb2ef9-1ad9-49c7-8b8d-f93db17f25c6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:35.748331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02eb2ef9-1ad9-49c7-8b8d-f93db17f25c6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:35.748331 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-02eb2ef9-1ad9-49c7-8b8d-f93db17f25c6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:35.890376 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-02eb2ef9-1ad9-49c7-8b8d-f93db17f25c6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:35.898928 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-02eb2ef9-1ad9-49c7-8b8d-f93db17f25c6 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1258 microversion: 2.1 time: 0.167615 Oct 04 22:39:35.899510 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4014/8007] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:35 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:36.921125 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-592cab65-3800-4c95-9443-8cfd05c2ea67 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:36.921769 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-592cab65-3800-4c95-9443-8cfd05c2ea67 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:36.923674 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:36.924499 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:36.930215 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-592cab65-3800-4c95-9443-8cfd05c2ea67 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:36.930703 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-592cab65-3800-4c95-9443-8cfd05c2ea67 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:36.931140 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-592cab65-3800-4c95-9443-8cfd05c2ea67 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:36.931824 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-592cab65-3800-4c95-9443-8cfd05c2ea67 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:36.932286 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-592cab65-3800-4c95-9443-8cfd05c2ea67 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:36.932768 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-592cab65-3800-4c95-9443-8cfd05c2ea67 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:37.067794 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-592cab65-3800-4c95-9443-8cfd05c2ea67 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:37.075560 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-592cab65-3800-4c95-9443-8cfd05c2ea67 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1258 microversion: 2.1 time: 0.158410 Oct 04 22:39:37.076138 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3994/8008] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:36 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:38.099884 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-62eb9117-9de3-4df7-92a3-2e465735df37 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:38.100608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-62eb9117-9de3-4df7-92a3-2e465735df37 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:38.103589 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:38.108415 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-62eb9117-9de3-4df7-92a3-2e465735df37 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:38.108923 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-62eb9117-9de3-4df7-92a3-2e465735df37 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:38.109381 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-62eb9117-9de3-4df7-92a3-2e465735df37 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:38.110118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-62eb9117-9de3-4df7-92a3-2e465735df37 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:38.110597 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-62eb9117-9de3-4df7-92a3-2e465735df37 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:38.112061 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-62eb9117-9de3-4df7-92a3-2e465735df37 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:38.246972 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-62eb9117-9de3-4df7-92a3-2e465735df37 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:38.255488 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-62eb9117-9de3-4df7-92a3-2e465735df37 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1258 microversion: 2.1 time: 0.160534 Oct 04 22:39:38.256072 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4015/8009] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:38 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:39.278430 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-01a443a0-ede6-4eb7-bf36-791a96d1558a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:39.278971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-01a443a0-ede6-4eb7-bf36-791a96d1558a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:39.286709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01a443a0-ede6-4eb7-bf36-791a96d1558a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:39.287202 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01a443a0-ede6-4eb7-bf36-791a96d1558a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:39.287658 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01a443a0-ede6-4eb7-bf36-791a96d1558a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:39.288347 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01a443a0-ede6-4eb7-bf36-791a96d1558a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:39.288809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01a443a0-ede6-4eb7-bf36-791a96d1558a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:39.289241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-01a443a0-ede6-4eb7-bf36-791a96d1558a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:39.426729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-01a443a0-ede6-4eb7-bf36-791a96d1558a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:39.434616 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-01a443a0-ede6-4eb7-bf36-791a96d1558a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1258 microversion: 2.1 time: 0.160164 Oct 04 22:39:39.437002 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3995/8010] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:39 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:40.506804 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-362feeb4-0973-4762-8b32-581b44b1eff7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:40.507442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-362feeb4-0973-4762-8b32-581b44b1eff7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:40.513500 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-362feeb4-0973-4762-8b32-581b44b1eff7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:40.514009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-362feeb4-0973-4762-8b32-581b44b1eff7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:40.514469 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-362feeb4-0973-4762-8b32-581b44b1eff7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:40.515180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-362feeb4-0973-4762-8b32-581b44b1eff7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:40.515659 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-362feeb4-0973-4762-8b32-581b44b1eff7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:40.516211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-362feeb4-0973-4762-8b32-581b44b1eff7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:40.647880 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-362feeb4-0973-4762-8b32-581b44b1eff7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:40.655682 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-362feeb4-0973-4762-8b32-581b44b1eff7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1258 microversion: 2.1 time: 0.201139 Oct 04 22:39:40.656258 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4016/8011] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:40 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1258 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:41.678974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d44253be-18e6-4b8c-b945-344dec8c6ead tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:41.679585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d44253be-18e6-4b8c-b945-344dec8c6ead tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:41.686942 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d44253be-18e6-4b8c-b945-344dec8c6ead tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:41.687426 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d44253be-18e6-4b8c-b945-344dec8c6ead tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:41.687860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d44253be-18e6-4b8c-b945-344dec8c6ead tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:41.688548 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d44253be-18e6-4b8c-b945-344dec8c6ead tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:41.689937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d44253be-18e6-4b8c-b945-344dec8c6ead tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:41.690378 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d44253be-18e6-4b8c-b945-344dec8c6ead tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:41.819865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d44253be-18e6-4b8c-b945-344dec8c6ead tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:41.827482 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d44253be-18e6-4b8c-b945-344dec8c6ead tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1258 microversion: 2.1 time: 0.152682 Oct 04 22:39:41.828058 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3996/8012] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:41 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:42.850644 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c34c11af-bbe5-4d19-ab05-d260b144de51 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:42.851224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c34c11af-bbe5-4d19-ab05-d260b144de51 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:42.858123 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c34c11af-bbe5-4d19-ab05-d260b144de51 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:42.858632 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c34c11af-bbe5-4d19-ab05-d260b144de51 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:42.859094 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c34c11af-bbe5-4d19-ab05-d260b144de51 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:42.859817 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c34c11af-bbe5-4d19-ab05-d260b144de51 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:42.860297 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c34c11af-bbe5-4d19-ab05-d260b144de51 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:42.861256 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c34c11af-bbe5-4d19-ab05-d260b144de51 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:42.995616 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c34c11af-bbe5-4d19-ab05-d260b144de51 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:43.004026 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c34c11af-bbe5-4d19-ab05-d260b144de51 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1258 microversion: 2.1 time: 0.157428 Oct 04 22:39:43.004624 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4017/8013] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:42 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:44.027196 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7516a3a0-a130-4e6e-a942-08f58307f6f3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:44.027879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7516a3a0-a130-4e6e-a942-08f58307f6f3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:44.036049 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7516a3a0-a130-4e6e-a942-08f58307f6f3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:44.036546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7516a3a0-a130-4e6e-a942-08f58307f6f3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:44.036992 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7516a3a0-a130-4e6e-a942-08f58307f6f3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:44.037733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7516a3a0-a130-4e6e-a942-08f58307f6f3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:44.038199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7516a3a0-a130-4e6e-a942-08f58307f6f3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:44.038633 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7516a3a0-a130-4e6e-a942-08f58307f6f3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:44.131822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-45afafac-dda3-4652-a17f-41b766d848ab req-fca834f2-8501-4d81-a54d-aa31b4a2eb1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc11f030-0544-4922-afd9-b36609c852b8", "name": "network-vif-plugged", "status": "completed", "tag": "7fe18374-c7ed-4937-858a-47e48c907031"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:39:44.143178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-45afafac-dda3-4652-a17f-41b766d848ab req-fca834f2-8501-4d81-a54d-aa31b4a2eb1c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:44.143824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-45afafac-dda3-4652-a17f-41b766d848ab req-fca834f2-8501-4d81-a54d-aa31b4a2eb1c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:44.144276 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-45afafac-dda3-4652-a17f-41b766d848ab req-fca834f2-8501-4d81-a54d-aa31b4a2eb1c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:44.156276 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-45afafac-dda3-4652-a17f-41b766d848ab req-fca834f2-8501-4d81-a54d-aa31b4a2eb1c service nova] Creating event network-vif-plugged:7fe18374-c7ed-4937-858a-47e48c907031 for instance bc11f030-0544-4922-afd9-b36609c852b8 on n-h1-860282-1 Oct 04 22:39:44.161897 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-45afafac-dda3-4652-a17f-41b766d848ab req-fca834f2-8501-4d81-a54d-aa31b4a2eb1c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033801 Oct 04 22:39:44.166635 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4018/8014] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:39:44.182000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7516a3a0-a130-4e6e-a942-08f58307f6f3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:44.191805 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7516a3a0-a130-4e6e-a942-08f58307f6f3 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1258 microversion: 2.1 time: 0.168598 Oct 04 22:39:44.195381 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3997/8015] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:44 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:45.216837 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-63caf137-f4c1-4d25-8343-2794f755e341 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:45.217490 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-63caf137-f4c1-4d25-8343-2794f755e341 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:45.223769 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63caf137-f4c1-4d25-8343-2794f755e341 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:45.224270 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63caf137-f4c1-4d25-8343-2794f755e341 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:45.224749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63caf137-f4c1-4d25-8343-2794f755e341 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:45.225481 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63caf137-f4c1-4d25-8343-2794f755e341 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:45.225954 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63caf137-f4c1-4d25-8343-2794f755e341 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:45.226395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-63caf137-f4c1-4d25-8343-2794f755e341 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:45.363015 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-63caf137-f4c1-4d25-8343-2794f755e341 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:45.371271 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-63caf137-f4c1-4d25-8343-2794f755e341 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1258 microversion: 2.1 time: 0.159584 Oct 04 22:39:45.371850 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4019/8016] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:45 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:46.394868 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3df63b39-c549-4842-97ad-a853144dbf58 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:46.395520 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3df63b39-c549-4842-97ad-a853144dbf58 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:46.402428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3df63b39-c549-4842-97ad-a853144dbf58 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:46.402918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3df63b39-c549-4842-97ad-a853144dbf58 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:46.403358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3df63b39-c549-4842-97ad-a853144dbf58 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:46.404051 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3df63b39-c549-4842-97ad-a853144dbf58 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:46.404514 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3df63b39-c549-4842-97ad-a853144dbf58 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:46.404946 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3df63b39-c549-4842-97ad-a853144dbf58 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:46.539919 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3df63b39-c549-4842-97ad-a853144dbf58 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:46.548764 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3df63b39-c549-4842-97ad-a853144dbf58 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1441 microversion: 2.1 time: 0.157904 Oct 04 22:39:46.549529 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3998/8017] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:46 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1441 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:46.571549 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d026edaf-3103-4692-bb91-9f7e994655f0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:46.572178 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d026edaf-3103-4692-bb91-9f7e994655f0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:46.579389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d026edaf-3103-4692-bb91-9f7e994655f0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:46.580134 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d026edaf-3103-4692-bb91-9f7e994655f0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:46.580619 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d026edaf-3103-4692-bb91-9f7e994655f0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:46.581329 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d026edaf-3103-4692-bb91-9f7e994655f0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:46.581824 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d026edaf-3103-4692-bb91-9f7e994655f0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:46.582271 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d026edaf-3103-4692-bb91-9f7e994655f0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:46.712989 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d026edaf-3103-4692-bb91-9f7e994655f0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:46.721020 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d026edaf-3103-4692-bb91-9f7e994655f0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1441 microversion: 2.1 time: 0.153323 Oct 04 22:39:46.721637 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4020/8018] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:46 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1441 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:48.569292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-429407d0-9434-4f34-a4b6-1ad9139e1b6a req-abca7211-908a-41ee-b0fc-f6544d4a41ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc11f030-0544-4922-afd9-b36609c852b8", "tag": "7fe18374-c7ed-4937-858a-47e48c907031"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:39:48.583418 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-429407d0-9434-4f34-a4b6-1ad9139e1b6a req-abca7211-908a-41ee-b0fc-f6544d4a41ad service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:48.583994 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-429407d0-9434-4f34-a4b6-1ad9139e1b6a req-abca7211-908a-41ee-b0fc-f6544d4a41ad service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:48.584518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-429407d0-9434-4f34-a4b6-1ad9139e1b6a req-abca7211-908a-41ee-b0fc-f6544d4a41ad service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:48.599917 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-429407d0-9434-4f34-a4b6-1ad9139e1b6a req-abca7211-908a-41ee-b0fc-f6544d4a41ad service nova] Creating event network-changed:7fe18374-c7ed-4937-858a-47e48c907031 for instance bc11f030-0544-4922-afd9-b36609c852b8 on n-h1-860282-1 Oct 04 22:39:48.605239 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-429407d0-9434-4f34-a4b6-1ad9139e1b6a req-abca7211-908a-41ee-b0fc-f6544d4a41ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039714 Oct 04 22:39:48.605827 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 3999/8019] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:42:14.577860 n-d-860282-1 devstack@n-api.service[122757]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09430b1c-e049-493f-9e8b-ffc95d4d7683] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:42:14.578818 n-d-860282-1 devstack@n-api.service[122757]: ERROR oslo.messaging._drivers.impl_rabbit [-] [02d9f940-80f2-491b-9a18-0a7fa72932fa] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:42:14.579726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=26 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:14.580496 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=58 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:14.581491 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:42:14.581637 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 22:42:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8/action (ip 10.222.0.30) !!! Oct 04 22:42:14.582767 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:42:14.582923 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 22:42:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8/action (ip 10.222.0.30) !!! Oct 04 22:42:14.583900 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:42:14.584019 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 22:42:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8/action (ip 10.222.0.30) !!! Oct 04 22:42:14.589524 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-245c1ddc-fe93-4609-aa4c-504001d01509 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:14.590081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-245c1ddc-fe93-4609-aa4c-504001d01509 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:14.600647 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-245c1ddc-fe93-4609-aa4c-504001d01509 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:14.601152 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-245c1ddc-fe93-4609-aa4c-504001d01509 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:14.601710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-245c1ddc-fe93-4609-aa4c-504001d01509 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:14.602432 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-245c1ddc-fe93-4609-aa4c-504001d01509 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:14.602906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-245c1ddc-fe93-4609-aa4c-504001d01509 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:14.604037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-245c1ddc-fe93-4609-aa4c-504001d01509 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:14.629037 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.objects.instance [None req-245c1ddc-fe93-4609-aa4c-504001d01509 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lazy-loading 'flavor' on Instance uuid bc11f030-0544-4922-afd9-b36609c852b8 {{(pid=122757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:42:14.866805 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-245c1ddc-fe93-4609-aa4c-504001d01509 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "POST /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8/action" status: 202 len: 0 microversion: 2.1 time: 0.290398 Oct 04 22:42:14.867462 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4021/8020] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:42:14 2022] POST /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:42:14.873828 n-d-860282-1 devstack@n-api.service[122758]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb95aab1-3781-4811-b11d-1606a5055a6d] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:42:14.874709 n-d-860282-1 devstack@n-api.service[122758]: ERROR oslo.messaging._drivers.impl_rabbit [-] [85957c5a-63ea-4587-9a7c-19b9c9ad6fe2] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:42:14.875363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:14.876219 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=64 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:14.877487 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:42:14.877687 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 22:42:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 (ip 10.222.0.30) !!! Oct 04 22:42:14.879150 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:42:14.879285 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 22:42:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 (ip 10.222.0.30) !!! Oct 04 22:42:14.887074 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-019e6927-0c05-45f7-84a9-3a2c707e9a0f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:14.887784 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-019e6927-0c05-45f7-84a9-3a2c707e9a0f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:14.899108 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-019e6927-0c05-45f7-84a9-3a2c707e9a0f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:14.899595 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-019e6927-0c05-45f7-84a9-3a2c707e9a0f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:14.900032 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-019e6927-0c05-45f7-84a9-3a2c707e9a0f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:14.901381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-019e6927-0c05-45f7-84a9-3a2c707e9a0f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:14.901860 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-019e6927-0c05-45f7-84a9-3a2c707e9a0f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:14.902285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-019e6927-0c05-45f7-84a9-3a2c707e9a0f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:15.083502 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-019e6927-0c05-45f7-84a9-3a2c707e9a0f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:15.091789 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-019e6927-0c05-45f7-84a9-3a2c707e9a0f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1565 microversion: 2.1 time: 0.219805 Oct 04 22:42:15.092374 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4000/8021] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:14 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1565 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:16.117014 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8abe01fb-f4a5-4cba-af60-340482e843ee tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:16.117783 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8abe01fb-f4a5-4cba-af60-340482e843ee tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:16.126466 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8abe01fb-f4a5-4cba-af60-340482e843ee tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:16.126971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8abe01fb-f4a5-4cba-af60-340482e843ee tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:16.127428 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8abe01fb-f4a5-4cba-af60-340482e843ee tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:16.128135 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8abe01fb-f4a5-4cba-af60-340482e843ee tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:16.128609 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8abe01fb-f4a5-4cba-af60-340482e843ee tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:16.129054 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8abe01fb-f4a5-4cba-af60-340482e843ee tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:16.133676 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] [09430b1c-e049-493f-9e8b-ffc95d4d7683] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40678. Oct 04 22:42:16.137257 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] [02d9f940-80f2-491b-9a18-0a7fa72932fa] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40680. Oct 04 22:42:16.312448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8abe01fb-f4a5-4cba-af60-340482e843ee tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:16.320267 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8abe01fb-f4a5-4cba-af60-340482e843ee tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1565 microversion: 2.1 time: 0.208973 Oct 04 22:42:16.320844 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4022/8022] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:16 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1565 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:17.344381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-12742a22-8512-4cd8-8968-4b8b4d7a7035 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:17.344995 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-12742a22-8512-4cd8-8968-4b8b4d7a7035 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:17.353618 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12742a22-8512-4cd8-8968-4b8b4d7a7035 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:17.354869 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12742a22-8512-4cd8-8968-4b8b4d7a7035 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:17.355254 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12742a22-8512-4cd8-8968-4b8b4d7a7035 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:17.355955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12742a22-8512-4cd8-8968-4b8b4d7a7035 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:17.356415 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12742a22-8512-4cd8-8968-4b8b4d7a7035 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:17.356847 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-12742a22-8512-4cd8-8968-4b8b4d7a7035 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:17.363896 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb95aab1-3781-4811-b11d-1606a5055a6d] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40686. Oct 04 22:42:17.364655 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] [85957c5a-63ea-4587-9a7c-19b9c9ad6fe2] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40688. Oct 04 22:42:17.490871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-12742a22-8512-4cd8-8968-4b8b4d7a7035 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:17.499105 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-12742a22-8512-4cd8-8968-4b8b4d7a7035 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1565 microversion: 2.1 time: 0.158701 Oct 04 22:42:17.499688 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4001/8023] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:17 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:18.522939 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-34f1b986-e8b0-4ff1-8009-c54a728af44a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:18.523608 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-34f1b986-e8b0-4ff1-8009-c54a728af44a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:18.531852 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34f1b986-e8b0-4ff1-8009-c54a728af44a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:18.532358 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34f1b986-e8b0-4ff1-8009-c54a728af44a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:18.532815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34f1b986-e8b0-4ff1-8009-c54a728af44a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:18.533738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34f1b986-e8b0-4ff1-8009-c54a728af44a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:18.534198 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34f1b986-e8b0-4ff1-8009-c54a728af44a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:18.534717 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-34f1b986-e8b0-4ff1-8009-c54a728af44a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:18.677044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-34f1b986-e8b0-4ff1-8009-c54a728af44a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:18.685079 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-34f1b986-e8b0-4ff1-8009-c54a728af44a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1565 microversion: 2.1 time: 0.166252 Oct 04 22:42:18.685699 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4023/8024] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:18 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:19.712687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-07b98c5c-8f21-4efb-bb58-e0665de1e6a0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:19.712687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-07b98c5c-8f21-4efb-bb58-e0665de1e6a0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:19.717189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07b98c5c-8f21-4efb-bb58-e0665de1e6a0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:19.717722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07b98c5c-8f21-4efb-bb58-e0665de1e6a0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:19.718148 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07b98c5c-8f21-4efb-bb58-e0665de1e6a0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:19.718832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07b98c5c-8f21-4efb-bb58-e0665de1e6a0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:19.719285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07b98c5c-8f21-4efb-bb58-e0665de1e6a0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:19.719711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-07b98c5c-8f21-4efb-bb58-e0665de1e6a0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:19.849657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-07b98c5c-8f21-4efb-bb58-e0665de1e6a0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:19.857992 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-07b98c5c-8f21-4efb-bb58-e0665de1e6a0 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1565 microversion: 2.1 time: 0.152797 Oct 04 22:42:19.858588 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4002/8025] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:19 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:20.881587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-8f87cffa-6a95-4d23-b829-ffb3109e66e9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:20.882247 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-8f87cffa-6a95-4d23-b829-ffb3109e66e9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:20.889217 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f87cffa-6a95-4d23-b829-ffb3109e66e9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:20.889758 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f87cffa-6a95-4d23-b829-ffb3109e66e9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:20.890216 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f87cffa-6a95-4d23-b829-ffb3109e66e9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:20.890917 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f87cffa-6a95-4d23-b829-ffb3109e66e9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:20.891392 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f87cffa-6a95-4d23-b829-ffb3109e66e9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:20.891834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-8f87cffa-6a95-4d23-b829-ffb3109e66e9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:21.022369 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-8f87cffa-6a95-4d23-b829-ffb3109e66e9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:21.031004 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-8f87cffa-6a95-4d23-b829-ffb3109e66e9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1565 microversion: 2.1 time: 0.153431 Oct 04 22:42:21.031582 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4024/8026] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:20 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:22.054837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-02b61236-24c9-466e-b85c-0c137a4040c8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:22.055436 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-02b61236-24c9-466e-b85c-0c137a4040c8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:22.062434 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02b61236-24c9-466e-b85c-0c137a4040c8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:22.062921 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02b61236-24c9-466e-b85c-0c137a4040c8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:22.063358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02b61236-24c9-466e-b85c-0c137a4040c8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:22.064043 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02b61236-24c9-466e-b85c-0c137a4040c8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:22.064497 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02b61236-24c9-466e-b85c-0c137a4040c8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:22.064918 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-02b61236-24c9-466e-b85c-0c137a4040c8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:22.196134 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-02b61236-24c9-466e-b85c-0c137a4040c8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:22.204369 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-02b61236-24c9-466e-b85c-0c137a4040c8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1565 microversion: 2.1 time: 0.153479 Oct 04 22:42:22.204938 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4003/8027] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:22 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:23.228039 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6180fb8c-bb13-4b0b-b553-c53effaeeab4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:23.228667 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6180fb8c-bb13-4b0b-b553-c53effaeeab4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:23.236044 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6180fb8c-bb13-4b0b-b553-c53effaeeab4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:23.236545 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6180fb8c-bb13-4b0b-b553-c53effaeeab4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:23.236998 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6180fb8c-bb13-4b0b-b553-c53effaeeab4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:23.237725 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6180fb8c-bb13-4b0b-b553-c53effaeeab4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:23.238194 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6180fb8c-bb13-4b0b-b553-c53effaeeab4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:23.238634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6180fb8c-bb13-4b0b-b553-c53effaeeab4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:23.373552 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6180fb8c-bb13-4b0b-b553-c53effaeeab4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:23.381448 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6180fb8c-bb13-4b0b-b553-c53effaeeab4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1565 microversion: 2.1 time: 0.157348 Oct 04 22:42:23.382021 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4025/8028] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:23 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:24.404173 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-058f83df-f265-4259-b16e-fe842d987a18 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:24.404766 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-058f83df-f265-4259-b16e-fe842d987a18 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:24.411582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-058f83df-f265-4259-b16e-fe842d987a18 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:24.412060 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-058f83df-f265-4259-b16e-fe842d987a18 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:24.412493 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-058f83df-f265-4259-b16e-fe842d987a18 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:24.413206 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-058f83df-f265-4259-b16e-fe842d987a18 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:24.413698 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-058f83df-f265-4259-b16e-fe842d987a18 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:24.414122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-058f83df-f265-4259-b16e-fe842d987a18 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:24.895722 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-058f83df-f265-4259-b16e-fe842d987a18 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:24.904425 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-058f83df-f265-4259-b16e-fe842d987a18 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1565 microversion: 2.1 time: 0.504312 Oct 04 22:42:24.905356 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4004/8029] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:24 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1565 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:25.928173 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d0ed0797-b5e4-4401-b39c-5589452c2bb5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:25.928809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d0ed0797-b5e4-4401-b39c-5589452c2bb5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:25.936445 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0ed0797-b5e4-4401-b39c-5589452c2bb5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:25.936946 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0ed0797-b5e4-4401-b39c-5589452c2bb5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:25.937407 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0ed0797-b5e4-4401-b39c-5589452c2bb5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:25.938138 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0ed0797-b5e4-4401-b39c-5589452c2bb5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:25.938615 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0ed0797-b5e4-4401-b39c-5589452c2bb5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:25.939060 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d0ed0797-b5e4-4401-b39c-5589452c2bb5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:26.067728 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d0ed0797-b5e4-4401-b39c-5589452c2bb5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:26.075789 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d0ed0797-b5e4-4401-b39c-5589452c2bb5 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1565 microversion: 2.1 time: 0.151532 Oct 04 22:42:26.076370 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4026/8030] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:25 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:27.098961 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e02919ec-73f4-4ff7-926a-ecb6cd7e679d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:27.105846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e02919ec-73f4-4ff7-926a-ecb6cd7e679d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:27.107285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e02919ec-73f4-4ff7-926a-ecb6cd7e679d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:27.107776 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e02919ec-73f4-4ff7-926a-ecb6cd7e679d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:27.108216 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e02919ec-73f4-4ff7-926a-ecb6cd7e679d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:27.108908 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e02919ec-73f4-4ff7-926a-ecb6cd7e679d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:27.109369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e02919ec-73f4-4ff7-926a-ecb6cd7e679d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:27.109832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e02919ec-73f4-4ff7-926a-ecb6cd7e679d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:27.246931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e02919ec-73f4-4ff7-926a-ecb6cd7e679d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:27.254752 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e02919ec-73f4-4ff7-926a-ecb6cd7e679d tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1565 microversion: 2.1 time: 0.159668 Oct 04 22:42:27.255333 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4005/8031] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:27 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:28.278970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a30afd76-6d8c-404b-971a-6e195a7b168c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:28.279602 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a30afd76-6d8c-404b-971a-6e195a7b168c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:28.286699 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a30afd76-6d8c-404b-971a-6e195a7b168c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:28.287245 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a30afd76-6d8c-404b-971a-6e195a7b168c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:28.287697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a30afd76-6d8c-404b-971a-6e195a7b168c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:28.288404 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a30afd76-6d8c-404b-971a-6e195a7b168c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:28.288956 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a30afd76-6d8c-404b-971a-6e195a7b168c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:28.289394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a30afd76-6d8c-404b-971a-6e195a7b168c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:28.427208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a30afd76-6d8c-404b-971a-6e195a7b168c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:28.435774 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a30afd76-6d8c-404b-971a-6e195a7b168c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1565 microversion: 2.1 time: 0.161355 Oct 04 22:42:28.436348 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4027/8032] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:28 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:29.459549 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-7d586054-ab5e-4453-b007-f0187aad8f04 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:29.460199 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-7d586054-ab5e-4453-b007-f0187aad8f04 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:29.467146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d586054-ab5e-4453-b007-f0187aad8f04 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:29.467634 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d586054-ab5e-4453-b007-f0187aad8f04 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:29.468098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d586054-ab5e-4453-b007-f0187aad8f04 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:29.468792 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d586054-ab5e-4453-b007-f0187aad8f04 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:29.469245 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d586054-ab5e-4453-b007-f0187aad8f04 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:29.469772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-7d586054-ab5e-4453-b007-f0187aad8f04 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:29.604887 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-7d586054-ab5e-4453-b007-f0187aad8f04 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:29.612787 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-7d586054-ab5e-4453-b007-f0187aad8f04 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1566 microversion: 2.1 time: 0.157197 Oct 04 22:42:29.613367 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4006/8033] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:29 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:29.638550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-49f5c316-3f1e-4e42-a831-5e7c26fffb25 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:29.638550 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-49f5c316-3f1e-4e42-a831-5e7c26fffb25 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:29.644168 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49f5c316-3f1e-4e42-a831-5e7c26fffb25 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:29.644661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49f5c316-3f1e-4e42-a831-5e7c26fffb25 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:29.645110 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49f5c316-3f1e-4e42-a831-5e7c26fffb25 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:29.645843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49f5c316-3f1e-4e42-a831-5e7c26fffb25 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:29.646316 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49f5c316-3f1e-4e42-a831-5e7c26fffb25 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:29.646793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-49f5c316-3f1e-4e42-a831-5e7c26fffb25 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:29.726964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-49f5c316-3f1e-4e42-a831-5e7c26fffb25 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122757) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 22:42:30.071597 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-49f5c316-3f1e-4e42-a831-5e7c26fffb25 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "POST /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8/action" status: 202 len: 0 microversion: 2.1 time: 0.439545 Oct 04 22:42:30.072228 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4028/8034] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:42:29 2022] POST /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:42:30.081187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-666f8b89-16a7-4e0f-b70a-9f9939b74a8f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:30.083288 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-666f8b89-16a7-4e0f-b70a-9f9939b74a8f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:30.087828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-666f8b89-16a7-4e0f-b70a-9f9939b74a8f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:30.088307 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-666f8b89-16a7-4e0f-b70a-9f9939b74a8f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:30.088765 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-666f8b89-16a7-4e0f-b70a-9f9939b74a8f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:30.089512 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-666f8b89-16a7-4e0f-b70a-9f9939b74a8f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:30.090565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-666f8b89-16a7-4e0f-b70a-9f9939b74a8f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:30.090996 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-666f8b89-16a7-4e0f-b70a-9f9939b74a8f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:30.226191 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-666f8b89-16a7-4e0f-b70a-9f9939b74a8f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:30.234838 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-666f8b89-16a7-4e0f-b70a-9f9939b74a8f tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1514 microversion: 2.1 time: 0.157479 Oct 04 22:42:30.235257 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4007/8035] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:30 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:30.904623 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-74ade0c2-a71e-4b8b-94a5-60c83b623fd1 req-e1ad4339-78b4-40f2-8f78-a7039c3eed3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc11f030-0544-4922-afd9-b36609c852b8", "name": "network-vif-unplugged", "status": "completed", "tag": "7fe18374-c7ed-4937-858a-47e48c907031"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:30.919582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-74ade0c2-a71e-4b8b-94a5-60c83b623fd1 req-e1ad4339-78b4-40f2-8f78-a7039c3eed3e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:30.926023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-74ade0c2-a71e-4b8b-94a5-60c83b623fd1 req-e1ad4339-78b4-40f2-8f78-a7039c3eed3e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:30.926023 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-74ade0c2-a71e-4b8b-94a5-60c83b623fd1 req-e1ad4339-78b4-40f2-8f78-a7039c3eed3e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:30.931582 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.compute.server_external_events [req-74ade0c2-a71e-4b8b-94a5-60c83b623fd1 req-e1ad4339-78b4-40f2-8f78-a7039c3eed3e service nova] Unable to find a host for instance bc11f030-0544-4922-afd9-b36609c852b8. Dropping event network-vif-unplugged {{(pid=122757) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 22:42:30.932634 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-74ade0c2-a71e-4b8b-94a5-60c83b623fd1 req-e1ad4339-78b4-40f2-8f78-a7039c3eed3e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.091123 Oct 04 22:42:30.933906 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4029/8036] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 92 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 22:42:31.258230 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e8650d7d-0eea-4d3b-ba55-94ec20f51e6c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:31.258916 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e8650d7d-0eea-4d3b-ba55-94ec20f51e6c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:31.266036 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8650d7d-0eea-4d3b-ba55-94ec20f51e6c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:31.266571 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8650d7d-0eea-4d3b-ba55-94ec20f51e6c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:31.267815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8650d7d-0eea-4d3b-ba55-94ec20f51e6c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:31.267974 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8650d7d-0eea-4d3b-ba55-94ec20f51e6c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:31.268688 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8650d7d-0eea-4d3b-ba55-94ec20f51e6c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:31.269503 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e8650d7d-0eea-4d3b-ba55-94ec20f51e6c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:31.448515 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e8650d7d-0eea-4d3b-ba55-94ec20f51e6c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:31.456490 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e8650d7d-0eea-4d3b-ba55-94ec20f51e6c tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1514 microversion: 2.1 time: 0.202305 Oct 04 22:42:31.457205 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4008/8037] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:31 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1514 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:32.480883 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e936b13e-df0f-46c4-8ef4-bd83b8dad617 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:32.481556 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e936b13e-df0f-46c4-8ef4-bd83b8dad617 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:32.488366 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e936b13e-df0f-46c4-8ef4-bd83b8dad617 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:32.488865 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e936b13e-df0f-46c4-8ef4-bd83b8dad617 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:32.489318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e936b13e-df0f-46c4-8ef4-bd83b8dad617 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:32.490048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e936b13e-df0f-46c4-8ef4-bd83b8dad617 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:32.490515 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e936b13e-df0f-46c4-8ef4-bd83b8dad617 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:32.490957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e936b13e-df0f-46c4-8ef4-bd83b8dad617 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:32.628809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e936b13e-df0f-46c4-8ef4-bd83b8dad617 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:32.637639 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e936b13e-df0f-46c4-8ef4-bd83b8dad617 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1514 microversion: 2.1 time: 0.160439 Oct 04 22:42:32.638142 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4030/8038] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:32 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:33.661487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6b06bd0b-771a-4554-927f-17a804433318 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:33.662114 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6b06bd0b-771a-4554-927f-17a804433318 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:33.669773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b06bd0b-771a-4554-927f-17a804433318 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:33.670923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b06bd0b-771a-4554-927f-17a804433318 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:33.670923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b06bd0b-771a-4554-927f-17a804433318 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:33.671388 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b06bd0b-771a-4554-927f-17a804433318 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:33.671851 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b06bd0b-771a-4554-927f-17a804433318 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:33.672285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6b06bd0b-771a-4554-927f-17a804433318 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:33.804013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6b06bd0b-771a-4554-927f-17a804433318 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:33.812101 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6b06bd0b-771a-4554-927f-17a804433318 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1514 microversion: 2.1 time: 0.154618 Oct 04 22:42:33.812677 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4009/8039] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:33 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:34.835521 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-59303392-4681-4761-a864-6d293bf94a3e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:34.836202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-59303392-4681-4761-a864-6d293bf94a3e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:34.843222 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59303392-4681-4761-a864-6d293bf94a3e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:34.843738 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59303392-4681-4761-a864-6d293bf94a3e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:34.844197 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59303392-4681-4761-a864-6d293bf94a3e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:34.844911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59303392-4681-4761-a864-6d293bf94a3e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:34.845389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59303392-4681-4761-a864-6d293bf94a3e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:34.845870 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-59303392-4681-4761-a864-6d293bf94a3e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:34.986798 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-59303392-4681-4761-a864-6d293bf94a3e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:34.995263 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-59303392-4681-4761-a864-6d293bf94a3e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1514 microversion: 2.1 time: 0.163804 Oct 04 22:42:34.996535 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4031/8040] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:34 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:36.019231 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-70c172bb-fda4-4260-8530-d564aa714c17 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:36.019962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-70c172bb-fda4-4260-8530-d564aa714c17 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:36.027292 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70c172bb-fda4-4260-8530-d564aa714c17 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:36.027764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70c172bb-fda4-4260-8530-d564aa714c17 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:36.028205 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70c172bb-fda4-4260-8530-d564aa714c17 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:36.028904 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70c172bb-fda4-4260-8530-d564aa714c17 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:36.029358 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70c172bb-fda4-4260-8530-d564aa714c17 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:36.029817 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-70c172bb-fda4-4260-8530-d564aa714c17 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:36.169799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-70c172bb-fda4-4260-8530-d564aa714c17 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:36.177631 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-70c172bb-fda4-4260-8530-d564aa714c17 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1516 microversion: 2.1 time: 0.162380 Oct 04 22:42:36.178208 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4010/8041] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:36 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:42:37.201648 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c785b8ff-5c29-4736-8586-32c4ec45d84e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:37.202321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c785b8ff-5c29-4736-8586-32c4ec45d84e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:37.209448 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c785b8ff-5c29-4736-8586-32c4ec45d84e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:37.209967 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c785b8ff-5c29-4736-8586-32c4ec45d84e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:37.210429 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c785b8ff-5c29-4736-8586-32c4ec45d84e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:37.211145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c785b8ff-5c29-4736-8586-32c4ec45d84e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:37.211625 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c785b8ff-5c29-4736-8586-32c4ec45d84e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:37.212080 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c785b8ff-5c29-4736-8586-32c4ec45d84e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:37.348513 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c785b8ff-5c29-4736-8586-32c4ec45d84e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:37.357378 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c785b8ff-5c29-4736-8586-32c4ec45d84e tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1516 microversion: 2.1 time: 0.159700 Oct 04 22:42:37.357999 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4032/8042] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:37 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:38.382285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-9252cef6-d988-42ed-8f94-bd3668aabf66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:38.382910 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-9252cef6-d988-42ed-8f94-bd3668aabf66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:38.390111 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9252cef6-d988-42ed-8f94-bd3668aabf66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:38.390599 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9252cef6-d988-42ed-8f94-bd3668aabf66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:38.391048 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9252cef6-d988-42ed-8f94-bd3668aabf66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:38.391748 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9252cef6-d988-42ed-8f94-bd3668aabf66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:38.392209 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9252cef6-d988-42ed-8f94-bd3668aabf66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:38.392637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-9252cef6-d988-42ed-8f94-bd3668aabf66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:38.528951 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-9252cef6-d988-42ed-8f94-bd3668aabf66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:38.540307 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-9252cef6-d988-42ed-8f94-bd3668aabf66 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1516 microversion: 2.1 time: 0.161816 Oct 04 22:42:38.541316 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4011/8043] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:38 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:39.564432 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c9b75b71-8741-4dbc-8e9f-7f50b7388bed tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:39.565533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-c9b75b71-8741-4dbc-8e9f-7f50b7388bed tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:39.572844 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9b75b71-8741-4dbc-8e9f-7f50b7388bed tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:39.573347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9b75b71-8741-4dbc-8e9f-7f50b7388bed tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:39.574365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9b75b71-8741-4dbc-8e9f-7f50b7388bed tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:39.575444 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9b75b71-8741-4dbc-8e9f-7f50b7388bed tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:39.575919 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9b75b71-8741-4dbc-8e9f-7f50b7388bed tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:39.576362 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-c9b75b71-8741-4dbc-8e9f-7f50b7388bed tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:39.716707 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-c9b75b71-8741-4dbc-8e9f-7f50b7388bed tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:39.724685 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c9b75b71-8741-4dbc-8e9f-7f50b7388bed tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1516 microversion: 2.1 time: 0.164276 Oct 04 22:42:39.725263 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4033/8044] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:39 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:40.748590 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-93c3c83a-7b5f-4f0c-aa0a-5f1216ffacb8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:40.749251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-93c3c83a-7b5f-4f0c-aa0a-5f1216ffacb8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:40.756041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93c3c83a-7b5f-4f0c-aa0a-5f1216ffacb8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:40.756521 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93c3c83a-7b5f-4f0c-aa0a-5f1216ffacb8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:40.756952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93c3c83a-7b5f-4f0c-aa0a-5f1216ffacb8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:40.757665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93c3c83a-7b5f-4f0c-aa0a-5f1216ffacb8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:40.758120 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93c3c83a-7b5f-4f0c-aa0a-5f1216ffacb8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:40.758543 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-93c3c83a-7b5f-4f0c-aa0a-5f1216ffacb8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:40.895687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-93c3c83a-7b5f-4f0c-aa0a-5f1216ffacb8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:40.903823 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-93c3c83a-7b5f-4f0c-aa0a-5f1216ffacb8 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1516 microversion: 2.1 time: 0.159731 Oct 04 22:42:40.904400 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4012/8045] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:40 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:41.927352 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-176ac9de-e499-4f4f-ad3e-db8703fb1211 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:41.928048 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-176ac9de-e499-4f4f-ad3e-db8703fb1211 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:41.935211 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-176ac9de-e499-4f4f-ad3e-db8703fb1211 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:41.935722 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-176ac9de-e499-4f4f-ad3e-db8703fb1211 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:41.936180 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-176ac9de-e499-4f4f-ad3e-db8703fb1211 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:41.936896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-176ac9de-e499-4f4f-ad3e-db8703fb1211 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:41.937373 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-176ac9de-e499-4f4f-ad3e-db8703fb1211 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:41.937854 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-176ac9de-e499-4f4f-ad3e-db8703fb1211 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:42.228902 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-176ac9de-e499-4f4f-ad3e-db8703fb1211 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:42.237188 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-176ac9de-e499-4f4f-ad3e-db8703fb1211 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1572 microversion: 2.1 time: 0.313692 Oct 04 22:42:42.237807 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4034/8046] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:41 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1572 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:42.571047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-35cd1129-c7ec-4da4-a2f9-024f91d7d2d6 req-1fe93f5c-b824-4ad8-a5e8-3cbf80f421a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc11f030-0544-4922-afd9-b36609c852b8", "tag": "7fe18374-c7ed-4937-858a-47e48c907031"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:42.581052 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-35cd1129-c7ec-4da4-a2f9-024f91d7d2d6 req-1fe93f5c-b824-4ad8-a5e8-3cbf80f421a7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:42.581879 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-35cd1129-c7ec-4da4-a2f9-024f91d7d2d6 req-1fe93f5c-b824-4ad8-a5e8-3cbf80f421a7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:42.582598 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-35cd1129-c7ec-4da4-a2f9-024f91d7d2d6 req-1fe93f5c-b824-4ad8-a5e8-3cbf80f421a7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:42.596256 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-35cd1129-c7ec-4da4-a2f9-024f91d7d2d6 req-1fe93f5c-b824-4ad8-a5e8-3cbf80f421a7 service nova] Creating event network-changed:7fe18374-c7ed-4937-858a-47e48c907031 for instance bc11f030-0544-4922-afd9-b36609c852b8 on n-h2-860282-1 Oct 04 22:42:42.601573 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-35cd1129-c7ec-4da4-a2f9-024f91d7d2d6 req-1fe93f5c-b824-4ad8-a5e8-3cbf80f421a7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091926 Oct 04 22:42:42.602307 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4013/8047] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:42:43.261220 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d11df022-5609-4e2b-9a77-88115ba249f9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:43.261818 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d11df022-5609-4e2b-9a77-88115ba249f9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:43.269394 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d11df022-5609-4e2b-9a77-88115ba249f9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:43.269936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d11df022-5609-4e2b-9a77-88115ba249f9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:43.270400 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d11df022-5609-4e2b-9a77-88115ba249f9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:43.271113 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d11df022-5609-4e2b-9a77-88115ba249f9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:43.271592 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d11df022-5609-4e2b-9a77-88115ba249f9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:43.272045 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d11df022-5609-4e2b-9a77-88115ba249f9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:43.276132 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:43.409484 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d11df022-5609-4e2b-9a77-88115ba249f9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:43.417293 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d11df022-5609-4e2b-9a77-88115ba249f9 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1572 microversion: 2.1 time: 0.160137 Oct 04 22:42:43.417923 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4035/8048] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:43 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:44.442799 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0a030c07-2fc7-4a6c-a258-f4d80344e199 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:44.443428 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-0a030c07-2fc7-4a6c-a258-f4d80344e199 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:44.450310 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a030c07-2fc7-4a6c-a258-f4d80344e199 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:44.450819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a030c07-2fc7-4a6c-a258-f4d80344e199 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:44.451261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a030c07-2fc7-4a6c-a258-f4d80344e199 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:44.451952 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a030c07-2fc7-4a6c-a258-f4d80344e199 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:44.452416 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a030c07-2fc7-4a6c-a258-f4d80344e199 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:44.452846 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-0a030c07-2fc7-4a6c-a258-f4d80344e199 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:44.590659 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-0a030c07-2fc7-4a6c-a258-f4d80344e199 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:44.601063 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0a030c07-2fc7-4a6c-a258-f4d80344e199 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1572 microversion: 2.1 time: 0.163473 Oct 04 22:42:44.601685 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4014/8049] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:44 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1572 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:45.625910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-da5b745a-3e37-4de5-8c7d-8bcd1582122a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:45.626547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-da5b745a-3e37-4de5-8c7d-8bcd1582122a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:45.629265 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:45.634257 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da5b745a-3e37-4de5-8c7d-8bcd1582122a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:45.634649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da5b745a-3e37-4de5-8c7d-8bcd1582122a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:45.635108 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da5b745a-3e37-4de5-8c7d-8bcd1582122a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:45.635815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da5b745a-3e37-4de5-8c7d-8bcd1582122a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:45.636288 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da5b745a-3e37-4de5-8c7d-8bcd1582122a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:45.636732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da5b745a-3e37-4de5-8c7d-8bcd1582122a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:45.772299 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-da5b745a-3e37-4de5-8c7d-8bcd1582122a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:45.780163 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-da5b745a-3e37-4de5-8c7d-8bcd1582122a tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1572 microversion: 2.1 time: 0.158362 Oct 04 22:42:45.780733 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4036/8050] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:45 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1572 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:46.803747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f41c091b-5da3-4895-9c6e-7cf915afcbe4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:46.804314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f41c091b-5da3-4895-9c6e-7cf915afcbe4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:46.807241 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=31 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:46.812039 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f41c091b-5da3-4895-9c6e-7cf915afcbe4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:46.812533 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f41c091b-5da3-4895-9c6e-7cf915afcbe4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:46.812981 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f41c091b-5da3-4895-9c6e-7cf915afcbe4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:46.813706 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f41c091b-5da3-4895-9c6e-7cf915afcbe4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:46.814169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f41c091b-5da3-4895-9c6e-7cf915afcbe4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:46.818546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f41c091b-5da3-4895-9c6e-7cf915afcbe4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:46.818546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=87 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:46.947144 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f41c091b-5da3-4895-9c6e-7cf915afcbe4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:46.955748 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f41c091b-5da3-4895-9c6e-7cf915afcbe4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1572 microversion: 2.1 time: 0.156031 Oct 04 22:42:46.956329 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4015/8051] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:46 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:47.981249 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ef6d0699-36b3-4714-880a-00f99cd36166 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:47.981910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ef6d0699-36b3-4714-880a-00f99cd36166 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:47.989124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef6d0699-36b3-4714-880a-00f99cd36166 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:47.989672 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef6d0699-36b3-4714-880a-00f99cd36166 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:47.990128 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef6d0699-36b3-4714-880a-00f99cd36166 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:47.990828 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef6d0699-36b3-4714-880a-00f99cd36166 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:47.991584 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef6d0699-36b3-4714-880a-00f99cd36166 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:47.992024 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ef6d0699-36b3-4714-880a-00f99cd36166 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:48.126646 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ef6d0699-36b3-4714-880a-00f99cd36166 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:48.134425 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ef6d0699-36b3-4714-880a-00f99cd36166 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1572 microversion: 2.1 time: 0.157106 Oct 04 22:42:48.135003 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4037/8052] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:47 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:49.157707 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-66ca05a5-9e36-401c-bcc2-c28a1df7dcc2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:49.158333 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-66ca05a5-9e36-401c-bcc2-c28a1df7dcc2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:49.164772 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66ca05a5-9e36-401c-bcc2-c28a1df7dcc2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:49.165260 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66ca05a5-9e36-401c-bcc2-c28a1df7dcc2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:49.165742 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66ca05a5-9e36-401c-bcc2-c28a1df7dcc2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:49.166435 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66ca05a5-9e36-401c-bcc2-c28a1df7dcc2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:49.166894 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66ca05a5-9e36-401c-bcc2-c28a1df7dcc2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:49.167322 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66ca05a5-9e36-401c-bcc2-c28a1df7dcc2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:49.297935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-66ca05a5-9e36-401c-bcc2-c28a1df7dcc2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:49.305734 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-66ca05a5-9e36-401c-bcc2-c28a1df7dcc2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1572 microversion: 2.1 time: 0.152416 Oct 04 22:42:49.306315 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4016/8053] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:49 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:50.328752 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-753d6d86-f986-485e-ac20-bdc3d03570fa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:50.329382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-753d6d86-f986-485e-ac20-bdc3d03570fa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:50.336215 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-753d6d86-f986-485e-ac20-bdc3d03570fa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:50.336711 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-753d6d86-f986-485e-ac20-bdc3d03570fa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:50.337163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-753d6d86-f986-485e-ac20-bdc3d03570fa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:50.337908 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-753d6d86-f986-485e-ac20-bdc3d03570fa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:50.338378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-753d6d86-f986-485e-ac20-bdc3d03570fa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:50.338819 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-753d6d86-f986-485e-ac20-bdc3d03570fa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:50.474103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-753d6d86-f986-485e-ac20-bdc3d03570fa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:50.481906 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-753d6d86-f986-485e-ac20-bdc3d03570fa tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1572 microversion: 2.1 time: 0.157637 Oct 04 22:42:50.482837 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4038/8054] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:50 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:51.506522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f9bce999-1532-4d98-87d7-677ae9cea59b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:51.507136 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f9bce999-1532-4d98-87d7-677ae9cea59b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:51.514712 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9bce999-1532-4d98-87d7-677ae9cea59b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:51.515187 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9bce999-1532-4d98-87d7-677ae9cea59b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:51.515621 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9bce999-1532-4d98-87d7-677ae9cea59b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:51.516305 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9bce999-1532-4d98-87d7-677ae9cea59b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:51.516756 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9bce999-1532-4d98-87d7-677ae9cea59b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:51.517329 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f9bce999-1532-4d98-87d7-677ae9cea59b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:51.656484 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f9bce999-1532-4d98-87d7-677ae9cea59b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:51.664830 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f9bce999-1532-4d98-87d7-677ae9cea59b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1572 microversion: 2.1 time: 0.162562 Oct 04 22:42:51.665408 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4017/8055] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:51 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:52.688992 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-77ff8914-d52d-4fe3-96ff-3aee20ae3ff4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:52.689580 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-77ff8914-d52d-4fe3-96ff-3aee20ae3ff4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:52.696479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77ff8914-d52d-4fe3-96ff-3aee20ae3ff4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:52.696988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77ff8914-d52d-4fe3-96ff-3aee20ae3ff4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:52.697468 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77ff8914-d52d-4fe3-96ff-3aee20ae3ff4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:52.698182 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77ff8914-d52d-4fe3-96ff-3aee20ae3ff4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:52.698657 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77ff8914-d52d-4fe3-96ff-3aee20ae3ff4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:52.699107 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-77ff8914-d52d-4fe3-96ff-3aee20ae3ff4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:52.829171 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-77ff8914-d52d-4fe3-96ff-3aee20ae3ff4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:52.836944 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-77ff8914-d52d-4fe3-96ff-3aee20ae3ff4 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1572 microversion: 2.1 time: 0.152542 Oct 04 22:42:52.837550 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4039/8056] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:52 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:53.500831 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-01783fb2-ecf5-4b70-908d-3ae11f45fc57 req-d453997b-94af-4fa4-b449-b7bd7eaadef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc11f030-0544-4922-afd9-b36609c852b8", "name": "network-vif-plugged", "status": "completed", "tag": "7fe18374-c7ed-4937-858a-47e48c907031"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:53.511687 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-01783fb2-ecf5-4b70-908d-3ae11f45fc57 req-d453997b-94af-4fa4-b449-b7bd7eaadef3 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:53.512168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-01783fb2-ecf5-4b70-908d-3ae11f45fc57 req-d453997b-94af-4fa4-b449-b7bd7eaadef3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:53.512602 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-01783fb2-ecf5-4b70-908d-3ae11f45fc57 req-d453997b-94af-4fa4-b449-b7bd7eaadef3 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:53.523390 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-01783fb2-ecf5-4b70-908d-3ae11f45fc57 req-d453997b-94af-4fa4-b449-b7bd7eaadef3 service nova] Creating event network-vif-plugged:7fe18374-c7ed-4937-858a-47e48c907031 for instance bc11f030-0544-4922-afd9-b36609c852b8 on n-h2-860282-1 Oct 04 22:42:53.529940 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-01783fb2-ecf5-4b70-908d-3ae11f45fc57 req-d453997b-94af-4fa4-b449-b7bd7eaadef3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031735 Oct 04 22:42:53.530756 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4018/8057] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:42:53.860337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-d714b451-65a5-4f2c-bb3d-af14dbb7ac87 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:53.860968 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-d714b451-65a5-4f2c-bb3d-af14dbb7ac87 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:53.867793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d714b451-65a5-4f2c-bb3d-af14dbb7ac87 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:53.868317 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d714b451-65a5-4f2c-bb3d-af14dbb7ac87 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:53.868770 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d714b451-65a5-4f2c-bb3d-af14dbb7ac87 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:53.869489 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d714b451-65a5-4f2c-bb3d-af14dbb7ac87 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:53.869965 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d714b451-65a5-4f2c-bb3d-af14dbb7ac87 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:53.870402 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-d714b451-65a5-4f2c-bb3d-af14dbb7ac87 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:54.003890 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-d714b451-65a5-4f2c-bb3d-af14dbb7ac87 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:54.011783 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-d714b451-65a5-4f2c-bb3d-af14dbb7ac87 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1572 microversion: 2.1 time: 0.155555 Oct 04 22:42:54.012365 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4040/8058] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:53 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:55.037509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-cff410c7-ed20-41d4-be24-ec73efd57d89 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:55.038227 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-cff410c7-ed20-41d4-be24-ec73efd57d89 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:55.045193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cff410c7-ed20-41d4-be24-ec73efd57d89 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:55.045711 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cff410c7-ed20-41d4-be24-ec73efd57d89 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:55.046156 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cff410c7-ed20-41d4-be24-ec73efd57d89 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:55.046865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cff410c7-ed20-41d4-be24-ec73efd57d89 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:55.047308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cff410c7-ed20-41d4-be24-ec73efd57d89 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:55.047744 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-cff410c7-ed20-41d4-be24-ec73efd57d89 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:55.189211 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-cff410c7-ed20-41d4-be24-ec73efd57d89 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:55.197141 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-cff410c7-ed20-41d4-be24-ec73efd57d89 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1559 microversion: 2.1 time: 0.164825 Oct 04 22:42:55.197696 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4019/8059] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:55 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:35.653096 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=9 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:44:35.654505 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-ad7812ae-77bc-49f7-a47c-726e7a33dc3c req-aaa5057d-85d6-47a5-83b2-92b19abdab72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc11f030-0544-4922-afd9-b36609c852b8", "tag": "7fe18374-c7ed-4937-858a-47e48c907031"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:44:35.654978 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=25 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:44:35.660025 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fe3430ec-a990-4be6-93b0-12df7a64483b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:35.660670 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fe3430ec-a990-4be6-93b0-12df7a64483b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:35.662307 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=9 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:44:35.663224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=34 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:44:35.668905 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe3430ec-a990-4be6-93b0-12df7a64483b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:35.669572 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe3430ec-a990-4be6-93b0-12df7a64483b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:35.675645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe3430ec-a990-4be6-93b0-12df7a64483b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:35.675645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe3430ec-a990-4be6-93b0-12df7a64483b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:35.675645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe3430ec-a990-4be6-93b0-12df7a64483b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:35.675645 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fe3430ec-a990-4be6-93b0-12df7a64483b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:35.676069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ad7812ae-77bc-49f7-a47c-726e7a33dc3c req-aaa5057d-85d6-47a5-83b2-92b19abdab72 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:35.676069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ad7812ae-77bc-49f7-a47c-726e7a33dc3c req-aaa5057d-85d6-47a5-83b2-92b19abdab72 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:35.676069 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-ad7812ae-77bc-49f7-a47c-726e7a33dc3c req-aaa5057d-85d6-47a5-83b2-92b19abdab72 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:35.690773 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-ad7812ae-77bc-49f7-a47c-726e7a33dc3c req-aaa5057d-85d6-47a5-83b2-92b19abdab72 service nova] Creating event network-changed:7fe18374-c7ed-4937-858a-47e48c907031 for instance bc11f030-0544-4922-afd9-b36609c852b8 on n-h2-860282-1 Oct 04 22:44:35.697821 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-ad7812ae-77bc-49f7-a47c-726e7a33dc3c req-aaa5057d-85d6-47a5-83b2-92b19abdab72 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049843 Oct 04 22:44:35.699655 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4041/8060] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:44:35.704558 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fe3430ec-a990-4be6-93b0-12df7a64483b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:44:36.035825 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fe3430ec-a990-4be6-93b0-12df7a64483b tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 204 len: 0 microversion: 2.1 time: 0.384464 Oct 04 22:44:36.037473 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4020/8061] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:44:35 2022] DELETE /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:44:36.046634 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-883fbae5-5f06-4347-b7c0-0fdc966044bc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:36.048009 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-883fbae5-5f06-4347-b7c0-0fdc966044bc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:36.055642 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-883fbae5-5f06-4347-b7c0-0fdc966044bc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:36.056629 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-883fbae5-5f06-4347-b7c0-0fdc966044bc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:36.057269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-883fbae5-5f06-4347-b7c0-0fdc966044bc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:36.058221 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-883fbae5-5f06-4347-b7c0-0fdc966044bc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:36.058697 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-883fbae5-5f06-4347-b7c0-0fdc966044bc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:36.059328 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-883fbae5-5f06-4347-b7c0-0fdc966044bc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:36.212793 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-883fbae5-5f06-4347-b7c0-0fdc966044bc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:36.221114 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-883fbae5-5f06-4347-b7c0-0fdc966044bc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1565 microversion: 2.1 time: 0.179528 Oct 04 22:44:36.221747 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4042/8062] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:36 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:37.245346 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-51cfa83b-8b59-45ec-85bc-f12bcdde45fe tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:37.246101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-51cfa83b-8b59-45ec-85bc-f12bcdde45fe tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:37.253816 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51cfa83b-8b59-45ec-85bc-f12bcdde45fe tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:37.254313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51cfa83b-8b59-45ec-85bc-f12bcdde45fe tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:37.254761 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51cfa83b-8b59-45ec-85bc-f12bcdde45fe tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:37.255466 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51cfa83b-8b59-45ec-85bc-f12bcdde45fe tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:37.255931 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51cfa83b-8b59-45ec-85bc-f12bcdde45fe tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:37.256365 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-51cfa83b-8b59-45ec-85bc-f12bcdde45fe tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:37.429000 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-51cfa83b-8b59-45ec-85bc-f12bcdde45fe tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:37.437615 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-51cfa83b-8b59-45ec-85bc-f12bcdde45fe tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1565 microversion: 2.1 time: 0.196547 Oct 04 22:44:37.438138 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4021/8063] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:37 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1565 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:38.460829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-38b212ad-807b-450a-a73f-a21b909d49cc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:38.461404 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-9549c622-8d6a-4d39-a6a2-aaac06fa7928 req-97220882-1c95-4037-9c97-78b8b9730d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc11f030-0544-4922-afd9-b36609c852b8", "name": "network-vif-deleted", "tag": "7fe18374-c7ed-4937-858a-47e48c907031"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:44:38.461822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-38b212ad-807b-450a-a73f-a21b909d49cc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:38.468633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38b212ad-807b-450a-a73f-a21b909d49cc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:38.469894 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38b212ad-807b-450a-a73f-a21b909d49cc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:38.473935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38b212ad-807b-450a-a73f-a21b909d49cc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:38.473935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38b212ad-807b-450a-a73f-a21b909d49cc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:38.473935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38b212ad-807b-450a-a73f-a21b909d49cc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:38.473935 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-38b212ad-807b-450a-a73f-a21b909d49cc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:38.476259 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9549c622-8d6a-4d39-a6a2-aaac06fa7928 req-97220882-1c95-4037-9c97-78b8b9730d36 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:38.476746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9549c622-8d6a-4d39-a6a2-aaac06fa7928 req-97220882-1c95-4037-9c97-78b8b9730d36 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:38.477176 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-9549c622-8d6a-4d39-a6a2-aaac06fa7928 req-97220882-1c95-4037-9c97-78b8b9730d36 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:38.489870 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-9549c622-8d6a-4d39-a6a2-aaac06fa7928 req-97220882-1c95-4037-9c97-78b8b9730d36 service nova] Creating event network-vif-deleted:7fe18374-c7ed-4937-858a-47e48c907031 for instance bc11f030-0544-4922-afd9-b36609c852b8 on n-h2-860282-1 Oct 04 22:44:38.495055 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-9549c622-8d6a-4d39-a6a2-aaac06fa7928 req-97220882-1c95-4037-9c97-78b8b9730d36 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037948 Oct 04 22:44:38.495669 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4022/8064] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:44:38.544555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-38b212ad-807b-450a-a73f-a21b909d49cc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:38.553276 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-38b212ad-807b-450a-a73f-a21b909d49cc tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1380 microversion: 2.1 time: 0.096353 Oct 04 22:44:38.553915 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4043/8065] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:38 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1380 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:39.578617 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d6969400-5467-4360-8068-6912acd85ec2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:39.579321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d6969400-5467-4360-8068-6912acd85ec2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:39.585638 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6969400-5467-4360-8068-6912acd85ec2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:39.586124 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6969400-5467-4360-8068-6912acd85ec2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:39.586559 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6969400-5467-4360-8068-6912acd85ec2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:39.587244 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6969400-5467-4360-8068-6912acd85ec2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:39.587695 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6969400-5467-4360-8068-6912acd85ec2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:39.588118 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d6969400-5467-4360-8068-6912acd85ec2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:39.653755 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d6969400-5467-4360-8068-6912acd85ec2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:39.663052 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d6969400-5467-4360-8068-6912acd85ec2 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1218 microversion: 2.1 time: 0.090229 Oct 04 22:44:39.663640 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4023/8066] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:39 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:40.791970 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3845ba84-f8a0-465a-bb0a-018f949b7de7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:40.792622 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3845ba84-f8a0-465a-bb0a-018f949b7de7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:40.798963 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3845ba84-f8a0-465a-bb0a-018f949b7de7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:40.799541 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3845ba84-f8a0-465a-bb0a-018f949b7de7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:40.800001 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3845ba84-f8a0-465a-bb0a-018f949b7de7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:40.800731 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3845ba84-f8a0-465a-bb0a-018f949b7de7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:40.801202 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3845ba84-f8a0-465a-bb0a-018f949b7de7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:40.801671 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3845ba84-f8a0-465a-bb0a-018f949b7de7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:40.867263 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-3845ba84-f8a0-465a-bb0a-018f949b7de7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:40.876295 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3845ba84-f8a0-465a-bb0a-018f949b7de7 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1218 microversion: 2.1 time: 0.193185 Oct 04 22:44:40.876880 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4044/8067] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:40 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1218 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:41.899246 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2c7348ad-5419-45a1-932e-f9fdd1d629ca tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:41.899866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2c7348ad-5419-45a1-932e-f9fdd1d629ca tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:41.907352 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c7348ad-5419-45a1-932e-f9fdd1d629ca tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:41.907839 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c7348ad-5419-45a1-932e-f9fdd1d629ca tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:41.908271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c7348ad-5419-45a1-932e-f9fdd1d629ca tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:41.908955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c7348ad-5419-45a1-932e-f9fdd1d629ca tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:41.909407 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c7348ad-5419-45a1-932e-f9fdd1d629ca tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:41.909852 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2c7348ad-5419-45a1-932e-f9fdd1d629ca tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:41.973788 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2c7348ad-5419-45a1-932e-f9fdd1d629ca tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:41.981591 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2c7348ad-5419-45a1-932e-f9fdd1d629ca tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1218 microversion: 2.1 time: 0.086185 Oct 04 22:44:41.982168 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4024/8068] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:41 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:43.005365 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-57220435-8293-4da6-8981-e54b5ed56aec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:43.006145 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-57220435-8293-4da6-8981-e54b5ed56aec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:43.012930 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57220435-8293-4da6-8981-e54b5ed56aec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:43.013465 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57220435-8293-4da6-8981-e54b5ed56aec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:43.013931 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57220435-8293-4da6-8981-e54b5ed56aec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:43.014823 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57220435-8293-4da6-8981-e54b5ed56aec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:43.015332 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57220435-8293-4da6-8981-e54b5ed56aec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:43.015788 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-57220435-8293-4da6-8981-e54b5ed56aec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:43.079389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-57220435-8293-4da6-8981-e54b5ed56aec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '503dac0152fd4639a94d119970d0d019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59893424064ce88d258278e5ead023', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:43.089130 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-57220435-8293-4da6-8981-e54b5ed56aec tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 200 len: 1218 microversion: 2.1 time: 0.087835 Oct 04 22:44:43.089981 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4045/8069] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:42 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:44.114083 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-84b9a5a2-b112-4316-9ee3-f0a0a5ea3941 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:44.115646 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-84b9a5a2-b112-4316-9ee3-f0a0a5ea3941 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] [instance: bc11f030-0544-4922-afd9-b36609c852b8] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:44.122560 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84b9a5a2-b112-4316-9ee3-f0a0a5ea3941 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:44.123054 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84b9a5a2-b112-4316-9ee3-f0a0a5ea3941 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:44.123637 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84b9a5a2-b112-4316-9ee3-f0a0a5ea3941 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:44.124547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84b9a5a2-b112-4316-9ee3-f0a0a5ea3941 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:44.125020 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84b9a5a2-b112-4316-9ee3-f0a0a5ea3941 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:44.125476 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84b9a5a2-b112-4316-9ee3-f0a0a5ea3941 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:44.138736 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-84b9a5a2-b112-4316-9ee3-f0a0a5ea3941 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] HTTP exception thrown: Instance bc11f030-0544-4922-afd9-b36609c852b8 could not be found. Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-84b9a5a2-b112-4316-9ee3-f0a0a5ea3941 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Request method failure captured: Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 HTTP/1.1 Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPLT69em2yxNdCsn-SgSPIMan-b5FGhcr9vPQa3Q23rza3AijTVDRtrSLnQGdicbxBz89BQjEiIzxqUEhmOALpwdWjOWREbr_vFLyVh-_8QQWMTPhUFfzoO770IIG-jgs0YfZC4J72U2uMjZMQqS4pW64bYiLAnbjnY6FiJIeMx77960 Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: dd59893424064ce88d258278e5ead023 Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestShelveInstance-219297494 Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd59893424064ce88d258278e5ead023"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dd59893424064ce88d258278e5ead023"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dd59893424064ce88d258278e5ead023"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd59893424064ce88d258278e5ead023"}]}] Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestShelveInstance-219297494 Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: dd59893424064ce88d258278e5ead023 Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestShelveInstance-219297494 Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestShelveInstance-219297494-project Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: 503dac0152fd4639a94d119970d0d019 Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestShelveInstance-219297494-project Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance bc11f030-0544-4922-afd9-b36609c852b8 could not be found. Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'bc11f030-0544-4922-afd9-b36609c852b8'} Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc11f030-0544-4922-afd9-b36609c852b8 could not be found. Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc11f030-0544-4922-afd9-b36609c852b8 could not be found. Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:44:44.140906 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:44:44.146320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:44:44.146320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:44:44.146320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:44:44.146320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:44:44.146320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:44:44.146320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc11f030-0544-4922-afd9-b36609c852b8 could not be found. Oct 04 22:44:44.146320 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:44:44.146320 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-84b9a5a2-b112-4316-9ee3-f0a0a5ea3941 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Returning 404 to user: Instance bc11f030-0544-4922-afd9-b36609c852b8 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:44:44.146320 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-84b9a5a2-b112-4316-9ee3-f0a0a5ea3941 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8" status: 404 len: 111 microversion: 2.1 time: 0.032723 Oct 04 22:44:44.146320 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4025/8070] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:44 2022] GET /compute/v2.1/servers/bc11f030-0544-4922-afd9-b36609c852b8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:44:44.354243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-88e52436-01f3-47b3-b3d4-2ccd7d1d3c03 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] Calling method '.version_select at 0x7f578ba32940>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:44.431105 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-88e52436-01f3-47b3-b3d4-2ccd7d1d3c03 tempest-TestShelveInstance-219297494 tempest-TestShelveInstance-219297494-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-789074138" status: 202 len: 0 microversion: 2.1 time: 0.080771 Oct 04 22:44:44.431824 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4046/8071] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Oct 4 22:44:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-789074138 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:45:07.318487 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:07.320085 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:07.503297 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-0f696d88-c5e4-4e2e-8eae-846ef0e5dea4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Action: 'create', calling method: .version_select at 0x7f579443d940>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-481970667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsL7pCi2C64/iF9AcYmWPzto47SNZlsBY1NopdUqAvWywLYnLTxiVPv2hv15zrf7vaKNgeU6e3irCcHhM2dmwmrIM4oCS+IbwQAUZdCWYE36gpG1X5ETANMTKv4J1fJQA=="}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:45:07.520159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-0f696d88-c5e4-4e2e-8eae-846ef0e5dea4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Getting quotas for project 4f8a2a2fbd4140fa95571adbd3faf81f. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:45:07.525363 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-0f696d88-c5e4-4e2e-8eae-846ef0e5dea4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Getting quotas for user a1a3d0e56b064703984669d6476d7f0a and project 4f8a2a2fbd4140fa95571adbd3faf81f. Resources: {'key_pairs'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:45:07.611593 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-0f696d88-c5e4-4e2e-8eae-846ef0e5dea4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.298096 Oct 04 22:45:07.612529 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4026/8072] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Oct 4 22:45:07 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:45:10.116670 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=26 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:10.117559 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:10.121696 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-3f92565d-61da-4e52-9bea-935bb582632b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-975813027", "imageRef": "d55fbb2c-685c-4db7-a38c-ac6cf5459ad1", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-481970667", "security_groups": [{"name": "tempest-secgroup-smoke-887684979"}], "networks": [{"uuid": "cb6734e7-0de2-4515-89af-8c1b9f250b32"}]}} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:45:10.235633 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.network.neutron [None req-3f92565d-61da-4e52-9bea-935bb582632b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] validate_networks() for [('cb6734e7-0de2-4515-89af-8c1b9f250b32', None, None, None, None, None)] {{(pid=122757) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:45:10.644822 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-3f92565d-61da-4e52-9bea-935bb582632b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Flavor limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:45:10.645269 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-3f92565d-61da-4e52-9bea-935bb582632b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Image limits 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:45:10.645873 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-3f92565d-61da-4e52-9bea-935bb582632b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Flavor pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:45:10.646309 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-3f92565d-61da-4e52-9bea-935bb582632b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Image pref 0:0:0 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:45:10.646749 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.virt.hardware [None req-3f92565d-61da-4e52-9bea-935bb582632b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:45:10.656395 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f92565d-61da-4e52-9bea-935bb582632b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:10.656899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f92565d-61da-4e52-9bea-935bb582632b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:10.657360 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f92565d-61da-4e52-9bea-935bb582632b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:10.658142 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f92565d-61da-4e52-9bea-935bb582632b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:10.658621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f92565d-61da-4e52-9bea-935bb582632b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:10.659070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-3f92565d-61da-4e52-9bea-935bb582632b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:10.678057 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-3f92565d-61da-4e52-9bea-935bb582632b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Getting quotas for project 4f8a2a2fbd4140fa95571adbd3faf81f. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:45:10.683238 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.quota [None req-3f92565d-61da-4e52-9bea-935bb582632b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Getting quotas for user a1a3d0e56b064703984669d6476d7f0a and project 4f8a2a2fbd4140fa95571adbd3faf81f. Resources: {'instances', 'ram', 'cores'} {{(pid=122757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:45:10.696443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3f92565d-61da-4e52-9bea-935bb582632b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Going to run 1 instances... {{(pid=122757) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:45:10.699139 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-3f92565d-61da-4e52-9bea-935bb582632b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: 2a466408-258e-4fef-b316-758a3b024db6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55fbb2c-685c-4db7-a38c-ac6cf5459ad1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:45:10.811890 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-3f92565d-61da-4e52-9bea-935bb582632b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.696920 Oct 04 22:45:10.818959 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4047/8073] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:45:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:45:10.825056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-11a63e1d-8380-47fe-a785-dc8bf291ddc3 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:10.826589 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-11a63e1d-8380-47fe-a785-dc8bf291ddc3 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: 2a466408-258e-4fef-b316-758a3b024db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:10.886767 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-11a63e1d-8380-47fe-a785-dc8bf291ddc3 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:10.894134 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-11a63e1d-8380-47fe-a785-dc8bf291ddc3 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6" status: 200 len: 1247 microversion: 2.1 time: 0.073784 Oct 04 22:45:10.894707 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4027/8074] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:10 2022] GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6 => generated 1247 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:11.916813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9abe8abd-1880-4b95-b992-84cfa3d7071d tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:11.917463 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9abe8abd-1880-4b95-b992-84cfa3d7071d tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: 2a466408-258e-4fef-b316-758a3b024db6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:11.975190 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9abe8abd-1880-4b95-b992-84cfa3d7071d tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:11.982180 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9abe8abd-1880-4b95-b992-84cfa3d7071d tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6" status: 200 len: 1247 microversion: 2.1 time: 0.069359 Oct 04 22:45:12.010707 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4048/8075] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:11 2022] GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6 => generated 1247 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:13.006152 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6d65abc0-33a1-4af2-b667-d5d3cab259f7 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:13.006764 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6d65abc0-33a1-4af2-b667-d5d3cab259f7 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: 2a466408-258e-4fef-b316-758a3b024db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:13.013720 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d65abc0-33a1-4af2-b667-d5d3cab259f7 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:13.014213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d65abc0-33a1-4af2-b667-d5d3cab259f7 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:13.015419 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d65abc0-33a1-4af2-b667-d5d3cab259f7 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:13.016189 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d65abc0-33a1-4af2-b667-d5d3cab259f7 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:13.016657 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d65abc0-33a1-4af2-b667-d5d3cab259f7 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:13.017091 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d65abc0-33a1-4af2-b667-d5d3cab259f7 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:13.083705 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6d65abc0-33a1-4af2-b667-d5d3cab259f7 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:13.091477 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6d65abc0-33a1-4af2-b667-d5d3cab259f7 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6" status: 200 len: 1299 microversion: 2.1 time: 0.089440 Oct 04 22:45:13.092125 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4028/8076] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:13 2022] GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6 => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:14.116685 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-58cd8fbe-35c5-4909-9a81-e017dfae22c4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:14.117318 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-58cd8fbe-35c5-4909-9a81-e017dfae22c4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: 2a466408-258e-4fef-b316-758a3b024db6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:14.126746 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58cd8fbe-35c5-4909-9a81-e017dfae22c4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:14.127650 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58cd8fbe-35c5-4909-9a81-e017dfae22c4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:14.128326 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58cd8fbe-35c5-4909-9a81-e017dfae22c4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:14.129612 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58cd8fbe-35c5-4909-9a81-e017dfae22c4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:14.130272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58cd8fbe-35c5-4909-9a81-e017dfae22c4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:14.130723 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-58cd8fbe-35c5-4909-9a81-e017dfae22c4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:14.266776 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-58cd8fbe-35c5-4909-9a81-e017dfae22c4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:14.274507 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-58cd8fbe-35c5-4909-9a81-e017dfae22c4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6" status: 200 len: 1372 microversion: 2.1 time: 0.162014 Oct 04 22:45:14.275103 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4049/8077] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:14 2022] GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:14.856664 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-a939c0ae-8713-4dd1-82ad-64ed54aa4e7d req-7261851a-8f7e-44d2-a69d-6fb677829940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a466408-258e-4fef-b316-758a3b024db6", "tag": "3fcc8e69-d733-4fc2-b040-aea40a5bdd83"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:45:14.867005 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a939c0ae-8713-4dd1-82ad-64ed54aa4e7d req-7261851a-8f7e-44d2-a69d-6fb677829940 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:14.869212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a939c0ae-8713-4dd1-82ad-64ed54aa4e7d req-7261851a-8f7e-44d2-a69d-6fb677829940 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:14.869212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-a939c0ae-8713-4dd1-82ad-64ed54aa4e7d req-7261851a-8f7e-44d2-a69d-6fb677829940 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:14.879962 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-a939c0ae-8713-4dd1-82ad-64ed54aa4e7d req-7261851a-8f7e-44d2-a69d-6fb677829940 service nova] Creating event network-changed:3fcc8e69-d733-4fc2-b040-aea40a5bdd83 for instance 2a466408-258e-4fef-b316-758a3b024db6 on n-h1-860282-1 Oct 04 22:45:14.885241 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-a939c0ae-8713-4dd1-82ad-64ed54aa4e7d req-7261851a-8f7e-44d2-a69d-6fb677829940 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092563 Oct 04 22:45:14.886095 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4029/8078] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:45:15.297867 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-47dbbe58-20a3-4635-9bbc-38d13ceb5fff tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:15.298680 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-47dbbe58-20a3-4635-9bbc-38d13ceb5fff tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: 2a466408-258e-4fef-b316-758a3b024db6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:15.305691 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47dbbe58-20a3-4635-9bbc-38d13ceb5fff tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:15.306201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47dbbe58-20a3-4635-9bbc-38d13ceb5fff tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:15.306653 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47dbbe58-20a3-4635-9bbc-38d13ceb5fff tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:15.307361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47dbbe58-20a3-4635-9bbc-38d13ceb5fff tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:15.307860 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47dbbe58-20a3-4635-9bbc-38d13ceb5fff tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:15.308302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-47dbbe58-20a3-4635-9bbc-38d13ceb5fff tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:15.445852 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-47dbbe58-20a3-4635-9bbc-38d13ceb5fff tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:15.454795 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-47dbbe58-20a3-4635-9bbc-38d13ceb5fff tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6" status: 200 len: 1372 microversion: 2.1 time: 0.161042 Oct 04 22:45:15.455426 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4050/8079] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:15 2022] GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:16.480314 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f03d186b-188e-44b9-a1ba-09483507ce2e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:16.482044 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f03d186b-188e-44b9-a1ba-09483507ce2e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: 2a466408-258e-4fef-b316-758a3b024db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:16.489033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f03d186b-188e-44b9-a1ba-09483507ce2e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:16.489552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f03d186b-188e-44b9-a1ba-09483507ce2e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:16.489989 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f03d186b-188e-44b9-a1ba-09483507ce2e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:16.490680 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f03d186b-188e-44b9-a1ba-09483507ce2e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:16.491162 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f03d186b-188e-44b9-a1ba-09483507ce2e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:16.491587 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-f03d186b-188e-44b9-a1ba-09483507ce2e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:16.627261 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f03d186b-188e-44b9-a1ba-09483507ce2e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:16.635014 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f03d186b-188e-44b9-a1ba-09483507ce2e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6" status: 200 len: 1372 microversion: 2.1 time: 0.159852 Oct 04 22:45:16.635584 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4030/8080] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:16 2022] GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:17.657781 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f9f5fd49-0a63-4aba-9ca3-ed53e7bfadf4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:17.658416 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f9f5fd49-0a63-4aba-9ca3-ed53e7bfadf4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: 2a466408-258e-4fef-b316-758a3b024db6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:17.664766 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9f5fd49-0a63-4aba-9ca3-ed53e7bfadf4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:17.665656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9f5fd49-0a63-4aba-9ca3-ed53e7bfadf4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:17.666482 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9f5fd49-0a63-4aba-9ca3-ed53e7bfadf4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:17.667234 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9f5fd49-0a63-4aba-9ca3-ed53e7bfadf4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:17.667718 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9f5fd49-0a63-4aba-9ca3-ed53e7bfadf4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:17.668382 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f9f5fd49-0a63-4aba-9ca3-ed53e7bfadf4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:17.803732 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f9f5fd49-0a63-4aba-9ca3-ed53e7bfadf4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:17.812192 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f9f5fd49-0a63-4aba-9ca3-ed53e7bfadf4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6" status: 200 len: 1372 microversion: 2.1 time: 0.157845 Oct 04 22:45:17.812779 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4051/8081] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:17 2022] GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:18.835509 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-84018d3c-5108-479b-93ea-89c1107ebff2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:18.836121 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-84018d3c-5108-479b-93ea-89c1107ebff2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: 2a466408-258e-4fef-b316-758a3b024db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:18.842565 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84018d3c-5108-479b-93ea-89c1107ebff2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:18.843094 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84018d3c-5108-479b-93ea-89c1107ebff2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:18.843534 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84018d3c-5108-479b-93ea-89c1107ebff2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:18.844229 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84018d3c-5108-479b-93ea-89c1107ebff2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:18.844692 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84018d3c-5108-479b-93ea-89c1107ebff2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:18.845122 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-84018d3c-5108-479b-93ea-89c1107ebff2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:18.982313 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-84018d3c-5108-479b-93ea-89c1107ebff2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:18.991156 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-84018d3c-5108-479b-93ea-89c1107ebff2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6" status: 200 len: 1372 microversion: 2.1 time: 0.159873 Oct 04 22:45:18.991769 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4031/8082] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:18 2022] GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:19.660098 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-452e04a4-fb84-41e9-8c42-ca0caf624fea req-83d9af8b-28d2-4a5e-ac94-2f900c7efeb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a466408-258e-4fef-b316-758a3b024db6", "name": "network-vif-plugged", "status": "completed", "tag": "3fcc8e69-d733-4fc2-b040-aea40a5bdd83"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:45:19.670460 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-452e04a4-fb84-41e9-8c42-ca0caf624fea req-83d9af8b-28d2-4a5e-ac94-2f900c7efeb6 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:19.670959 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-452e04a4-fb84-41e9-8c42-ca0caf624fea req-83d9af8b-28d2-4a5e-ac94-2f900c7efeb6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:19.671411 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-452e04a4-fb84-41e9-8c42-ca0caf624fea req-83d9af8b-28d2-4a5e-ac94-2f900c7efeb6 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:19.683553 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-452e04a4-fb84-41e9-8c42-ca0caf624fea req-83d9af8b-28d2-4a5e-ac94-2f900c7efeb6 service nova] Creating event network-vif-plugged:3fcc8e69-d733-4fc2-b040-aea40a5bdd83 for instance 2a466408-258e-4fef-b316-758a3b024db6 on n-h1-860282-1 Oct 04 22:45:19.688900 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-452e04a4-fb84-41e9-8c42-ca0caf624fea req-83d9af8b-28d2-4a5e-ac94-2f900c7efeb6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032995 Oct 04 22:45:19.691167 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4052/8083] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:45:20.014271 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2fdff058-223e-4aab-b4ae-2fac138087cd tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:20.014881 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2fdff058-223e-4aab-b4ae-2fac138087cd tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: 2a466408-258e-4fef-b316-758a3b024db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:20.022581 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fdff058-223e-4aab-b4ae-2fac138087cd tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:20.023007 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fdff058-223e-4aab-b4ae-2fac138087cd tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:20.023444 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fdff058-223e-4aab-b4ae-2fac138087cd tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:20.024132 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fdff058-223e-4aab-b4ae-2fac138087cd tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:20.024585 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fdff058-223e-4aab-b4ae-2fac138087cd tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:20.025047 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2fdff058-223e-4aab-b4ae-2fac138087cd tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:20.157573 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2fdff058-223e-4aab-b4ae-2fac138087cd tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:20.165316 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2fdff058-223e-4aab-b4ae-2fac138087cd tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6" status: 200 len: 1372 microversion: 2.1 time: 0.155071 Oct 04 22:45:20.165928 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4032/8084] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:20 2022] GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:21.184710 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=2 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:21.189905 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-6699ee8c-1c36-44b2-9006-ab05efc4c5dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:21.190626 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-6699ee8c-1c36-44b2-9006-ab05efc4c5dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: 2a466408-258e-4fef-b316-758a3b024db6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:21.196840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6699ee8c-1c36-44b2-9006-ab05efc4c5dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:21.197337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6699ee8c-1c36-44b2-9006-ab05efc4c5dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:21.197816 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6699ee8c-1c36-44b2-9006-ab05efc4c5dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:21.198518 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6699ee8c-1c36-44b2-9006-ab05efc4c5dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:21.198988 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6699ee8c-1c36-44b2-9006-ab05efc4c5dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:21.199447 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-6699ee8c-1c36-44b2-9006-ab05efc4c5dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:21.339011 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-6699ee8c-1c36-44b2-9006-ab05efc4c5dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:21.347041 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-6699ee8c-1c36-44b2-9006-ab05efc4c5dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6" status: 200 len: 1556 microversion: 2.1 time: 0.163409 Oct 04 22:45:21.347619 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4053/8085] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:21 2022] GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6 => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:21.370190 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6d561220-54e4-46b1-aace-497761e2f848 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:21.370809 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6d561220-54e4-46b1-aace-497761e2f848 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: 2a466408-258e-4fef-b316-758a3b024db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:21.372791 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=6 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:21.379285 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d561220-54e4-46b1-aace-497761e2f848 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:21.383164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d561220-54e4-46b1-aace-497761e2f848 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:21.383164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d561220-54e4-46b1-aace-497761e2f848 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:21.383164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d561220-54e4-46b1-aace-497761e2f848 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:21.383164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d561220-54e4-46b1-aace-497761e2f848 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:21.383164 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6d561220-54e4-46b1-aace-497761e2f848 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:21.512168 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6d561220-54e4-46b1-aace-497761e2f848 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:21.520495 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6d561220-54e4-46b1-aace-497761e2f848 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6" status: 200 len: 1556 microversion: 2.1 time: 0.154200 Oct 04 22:45:21.521051 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4033/8086] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:21 2022] GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:23.504971 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-8368348e-3f09-404d-a7ef-5c03d87b807e req-785f902f-d6f8-40d2-80b6-0bdb5029255c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a466408-258e-4fef-b316-758a3b024db6", "tag": "3fcc8e69-d733-4fc2-b040-aea40a5bdd83"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:45:23.510203 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=8 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:23.516799 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8368348e-3f09-404d-a7ef-5c03d87b807e req-785f902f-d6f8-40d2-80b6-0bdb5029255c service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:23.518451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8368348e-3f09-404d-a7ef-5c03d87b807e req-785f902f-d6f8-40d2-80b6-0bdb5029255c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:23.518451 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-8368348e-3f09-404d-a7ef-5c03d87b807e req-785f902f-d6f8-40d2-80b6-0bdb5029255c service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:23.530338 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-8368348e-3f09-404d-a7ef-5c03d87b807e req-785f902f-d6f8-40d2-80b6-0bdb5029255c service nova] Creating event network-changed:3fcc8e69-d733-4fc2-b040-aea40a5bdd83 for instance 2a466408-258e-4fef-b316-758a3b024db6 on n-h1-860282-1 Oct 04 22:45:23.541004 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-8368348e-3f09-404d-a7ef-5c03d87b807e req-785f902f-d6f8-40d2-80b6-0bdb5029255c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039362 Oct 04 22:45:23.541392 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4054/8087] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:47:19.069884 n-d-860282-1 devstack@n-api.service[122758]: ERROR oslo.messaging._drivers.impl_rabbit [-] [85957c5a-63ea-4587-9a7c-19b9c9ad6fe2] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:47:19.071043 n-d-860282-1 devstack@n-api.service[122758]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb95aab1-3781-4811-b11d-1606a5055a6d] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:47:19.071582 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:19.072522 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=32 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:19.073463 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:47:19.073607 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 22:47:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6/action (ip 10.222.0.30) !!! Oct 04 22:47:19.075201 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:47:19.075341 n-d-860282-1 devstack@n-api.service[122758]: Tue Oct 4 22:47:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6/action (ip 10.222.0.30) !!! Oct 04 22:47:19.081010 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-bb97d3d5-689e-46f8-9c08-ab8b52f057a7 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1706860628"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:47:19.083922 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-bb97d3d5-689e-46f8-9c08-ab8b52f057a7 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: 2a466408-258e-4fef-b316-758a3b024db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:19.097907 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb97d3d5-689e-46f8-9c08-ab8b52f057a7 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:19.098414 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb97d3d5-689e-46f8-9c08-ab8b52f057a7 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:19.098856 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb97d3d5-689e-46f8-9c08-ab8b52f057a7 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:19.099555 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb97d3d5-689e-46f8-9c08-ab8b52f057a7 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:19.100014 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb97d3d5-689e-46f8-9c08-ab8b52f057a7 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:19.100447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-bb97d3d5-689e-46f8-9c08-ab8b52f057a7 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:19.680987 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-bb97d3d5-689e-46f8-9c08-ab8b52f057a7 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "POST /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6/action" status: 202 len: 0 microversion: 2.1 time: 0.612757 Oct 04 22:47:19.681671 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4034/8088] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:47:19 2022] POST /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 22:47:24.224493 n-d-860282-1 devstack@n-api.service[122757]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09430b1c-e049-493f-9e8b-ffc95d4d7683] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:47:24.225326 n-d-860282-1 devstack@n-api.service[122757]: ERROR oslo.messaging._drivers.impl_rabbit [-] [02d9f940-80f2-491b-9a18-0a7fa72932fa] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:47:24.225937 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:24.227208 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=30 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:24.228425 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:47:24.228596 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 22:47:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Oct 04 22:47:24.229827 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:47:24.229956 n-d-860282-1 devstack@n-api.service[122757]: Tue Oct 4 22:47:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Oct 04 22:47:24.237690 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-492523e8-28f6-4b4c-a003-8470b9460da2 req-09d295e9-734d-4343-8c96-0e4e44220860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a466408-258e-4fef-b316-758a3b024db6", "name": "network-vif-plugged", "status": "completed", "tag": "3fcc8e69-d733-4fc2-b040-aea40a5bdd83"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:47:24.254887 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-492523e8-28f6-4b4c-a003-8470b9460da2 req-09d295e9-734d-4343-8c96-0e4e44220860 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:24.255452 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-492523e8-28f6-4b4c-a003-8470b9460da2 req-09d295e9-734d-4343-8c96-0e4e44220860 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:24.258286 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-492523e8-28f6-4b4c-a003-8470b9460da2 req-09d295e9-734d-4343-8c96-0e4e44220860 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:24.270200 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-492523e8-28f6-4b4c-a003-8470b9460da2 req-09d295e9-734d-4343-8c96-0e4e44220860 service nova] Creating event network-vif-plugged:3fcc8e69-d733-4fc2-b040-aea40a5bdd83 for instance 2a466408-258e-4fef-b316-758a3b024db6 on n-h1-860282-1 Oct 04 22:47:24.276229 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-492523e8-28f6-4b4c-a003-8470b9460da2 req-09d295e9-734d-4343-8c96-0e4e44220860 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053412 Oct 04 22:47:24.276857 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4055/8089] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:47:35.378561 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:35.379345 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:35.386184 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-567a8e3f-1c6b-4170-90a6-aba03711758e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-719692234", "imageRef": "fe1de195-2ac8-4e08-8a63-b3008f5174ec", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-481970667", "security_groups": [{"name": "tempest-secgroup-smoke-887684979"}], "networks": [{"uuid": "cb6734e7-0de2-4515-89af-8c1b9f250b32"}]}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:47:35.412274 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb95aab1-3781-4811-b11d-1606a5055a6d] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 41238. Oct 04 22:47:35.414919 n-d-860282-1 devstack@n-api.service[122758]: INFO oslo.messaging._drivers.impl_rabbit [-] [85957c5a-63ea-4587-9a7c-19b9c9ad6fe2] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 41236. Oct 04 22:47:35.501197 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.network.neutron [None req-567a8e3f-1c6b-4170-90a6-aba03711758e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] validate_networks() for [('cb6734e7-0de2-4515-89af-8c1b9f250b32', None, None, None, None, None)] {{(pid=122758) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:47:35.968892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-567a8e3f-1c6b-4170-90a6-aba03711758e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Flavor limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:47:35.969370 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-567a8e3f-1c6b-4170-90a6-aba03711758e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Image limits 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:47:35.969875 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-567a8e3f-1c6b-4170-90a6-aba03711758e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Flavor pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:47:35.970315 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-567a8e3f-1c6b-4170-90a6-aba03711758e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Image pref 0:0:0 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:47:35.970729 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.virt.hardware [None req-567a8e3f-1c6b-4170-90a6-aba03711758e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:47:35.980665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-567a8e3f-1c6b-4170-90a6-aba03711758e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:35.981145 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-567a8e3f-1c6b-4170-90a6-aba03711758e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:35.981631 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-567a8e3f-1c6b-4170-90a6-aba03711758e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:35.982362 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-567a8e3f-1c6b-4170-90a6-aba03711758e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:35.982815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-567a8e3f-1c6b-4170-90a6-aba03711758e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:35.983267 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-567a8e3f-1c6b-4170-90a6-aba03711758e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:36.000906 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-567a8e3f-1c6b-4170-90a6-aba03711758e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Getting quotas for project 4f8a2a2fbd4140fa95571adbd3faf81f. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:47:36.006222 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.quota [None req-567a8e3f-1c6b-4170-90a6-aba03711758e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Getting quotas for user a1a3d0e56b064703984669d6476d7f0a and project 4f8a2a2fbd4140fa95571adbd3faf81f. Resources: {'instances', 'ram', 'cores'} {{(pid=122758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:47:36.018422 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-567a8e3f-1c6b-4170-90a6-aba03711758e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Going to run 1 instances... {{(pid=122758) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:47:36.020935 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-567a8e3f-1c6b-4170-90a6-aba03711758e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe1de195-2ac8-4e08-8a63-b3008f5174ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:47:36.145982 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-567a8e3f-1c6b-4170-90a6-aba03711758e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.770393 Oct 04 22:47:36.147318 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4035/8090] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Oct 4 22:47:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:47:36.161361 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a328091f-a4c3-47de-8180-4f70e0d86d9f tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:36.162809 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a328091f-a4c3-47de-8180-4f70e0d86d9f tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:36.175619 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] [09430b1c-e049-493f-9e8b-ffc95d4d7683] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 41254. Oct 04 22:47:36.191085 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] [02d9f940-80f2-491b-9a18-0a7fa72932fa] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 41256. Oct 04 22:47:36.278282 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a328091f-a4c3-47de-8180-4f70e0d86d9f tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:36.285225 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a328091f-a4c3-47de-8180-4f70e0d86d9f tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1247 microversion: 2.1 time: 0.130452 Oct 04 22:47:36.285860 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4056/8091] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:36 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1247 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:37.309801 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-f4724c99-e5ba-4722-ad78-88d428ddbd89 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:37.310455 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-f4724c99-e5ba-4722-ad78-88d428ddbd89 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:37.366166 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-f4724c99-e5ba-4722-ad78-88d428ddbd89 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:37.373291 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-f4724c99-e5ba-4722-ad78-88d428ddbd89 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1247 microversion: 2.1 time: 0.068580 Oct 04 22:47:37.373890 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4036/8092] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:37 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1247 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:38.323264 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-98d7c60d-6b64-49f6-a32d-ed2701d3a8be req-ef8a1d51-d957-4e90-9fb4-db2897eb26db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a466408-258e-4fef-b316-758a3b024db6", "name": "network-vif-unplugged", "status": "completed", "tag": "3fcc8e69-d733-4fc2-b040-aea40a5bdd83"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:47:38.333912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-98d7c60d-6b64-49f6-a32d-ed2701d3a8be req-ef8a1d51-d957-4e90-9fb4-db2897eb26db service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:38.334497 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-98d7c60d-6b64-49f6-a32d-ed2701d3a8be req-ef8a1d51-d957-4e90-9fb4-db2897eb26db service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:38.335091 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-98d7c60d-6b64-49f6-a32d-ed2701d3a8be req-ef8a1d51-d957-4e90-9fb4-db2897eb26db service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:38.345793 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-98d7c60d-6b64-49f6-a32d-ed2701d3a8be req-ef8a1d51-d957-4e90-9fb4-db2897eb26db service nova] Creating event network-vif-unplugged:3fcc8e69-d733-4fc2-b040-aea40a5bdd83 for instance 2a466408-258e-4fef-b316-758a3b024db6 on n-h1-860282-1 Oct 04 22:47:38.351696 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-98d7c60d-6b64-49f6-a32d-ed2701d3a8be req-ef8a1d51-d957-4e90-9fb4-db2897eb26db service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090336 Oct 04 22:47:38.352316 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4057/8093] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:47:38.398709 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-610756c2-a0ac-4826-bc01-344f017322b9 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:38.409892 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-610756c2-a0ac-4826-bc01-344f017322b9 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:38.464160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-610756c2-a0ac-4826-bc01-344f017322b9 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:38.471082 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-610756c2-a0ac-4826-bc01-344f017322b9 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1247 microversion: 2.1 time: 0.077848 Oct 04 22:47:38.474944 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4037/8094] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:38 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1247 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:39.496029 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-b7855f65-3de6-4b82-a2bc-a7a7bb714120 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:39.496744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-b7855f65-3de6-4b82-a2bc-a7a7bb714120 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:39.554654 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-b7855f65-3de6-4b82-a2bc-a7a7bb714120 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:39.562629 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-b7855f65-3de6-4b82-a2bc-a7a7bb714120 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1247 microversion: 2.1 time: 0.071662 Oct 04 22:47:39.563183 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4058/8095] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:39 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1247 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:40.585903 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-38ae3686-3419-4780-a323-67b3bb303a1b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:40.586554 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-38ae3686-3419-4780-a323-67b3bb303a1b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:40.594396 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38ae3686-3419-4780-a323-67b3bb303a1b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:40.594889 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38ae3686-3419-4780-a323-67b3bb303a1b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:40.595338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38ae3686-3419-4780-a323-67b3bb303a1b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:40.596033 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38ae3686-3419-4780-a323-67b3bb303a1b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:40.596496 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38ae3686-3419-4780-a323-67b3bb303a1b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:40.596928 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-38ae3686-3419-4780-a323-67b3bb303a1b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:40.658318 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-38ae3686-3419-4780-a323-67b3bb303a1b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:40.666737 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-38ae3686-3419-4780-a323-67b3bb303a1b tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1251 microversion: 2.1 time: 0.085294 Oct 04 22:47:40.667321 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4038/8096] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:40 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1251 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:41.689007 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e82476d2-bc60-4357-9fe2-883aff108b23 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:41.689687 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e82476d2-bc60-4357-9fe2-883aff108b23 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:41.697158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e82476d2-bc60-4357-9fe2-883aff108b23 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:41.697969 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e82476d2-bc60-4357-9fe2-883aff108b23 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:41.698442 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e82476d2-bc60-4357-9fe2-883aff108b23 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:41.699163 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e82476d2-bc60-4357-9fe2-883aff108b23 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:41.699649 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e82476d2-bc60-4357-9fe2-883aff108b23 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:41.700103 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e82476d2-bc60-4357-9fe2-883aff108b23 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:41.762346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e82476d2-bc60-4357-9fe2-883aff108b23 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:41.770287 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e82476d2-bc60-4357-9fe2-883aff108b23 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1243 microversion: 2.1 time: 0.085286 Oct 04 22:47:41.770866 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4059/8097] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:41 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1243 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:42.793308 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-d23fd203-7ad3-43e2-ae82-fb6c2fc7df67 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:42.793938 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-d23fd203-7ad3-43e2-ae82-fb6c2fc7df67 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:42.801012 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d23fd203-7ad3-43e2-ae82-fb6c2fc7df67 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:42.801542 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d23fd203-7ad3-43e2-ae82-fb6c2fc7df67 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:42.801988 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d23fd203-7ad3-43e2-ae82-fb6c2fc7df67 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:42.803213 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d23fd203-7ad3-43e2-ae82-fb6c2fc7df67 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:42.803662 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d23fd203-7ad3-43e2-ae82-fb6c2fc7df67 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:42.804092 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-d23fd203-7ad3-43e2-ae82-fb6c2fc7df67 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:42.889095 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-d23fd203-7ad3-43e2-ae82-fb6c2fc7df67 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:42.898096 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-d23fd203-7ad3-43e2-ae82-fb6c2fc7df67 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1305 microversion: 2.1 time: 0.108541 Oct 04 22:47:42.898514 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4039/8098] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:42 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1305 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:43.920443 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-bc42d173-80b5-41d4-a27b-38a63b5cbe4e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:43.921990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-bc42d173-80b5-41d4-a27b-38a63b5cbe4e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:43.931081 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc42d173-80b5-41d4-a27b-38a63b5cbe4e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:43.931744 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc42d173-80b5-41d4-a27b-38a63b5cbe4e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:43.932314 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc42d173-80b5-41d4-a27b-38a63b5cbe4e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:43.933199 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc42d173-80b5-41d4-a27b-38a63b5cbe4e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:43.933829 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc42d173-80b5-41d4-a27b-38a63b5cbe4e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:43.934391 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-bc42d173-80b5-41d4-a27b-38a63b5cbe4e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:44.093600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-bc42d173-80b5-41d4-a27b-38a63b5cbe4e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:44.103193 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-bc42d173-80b5-41d4-a27b-38a63b5cbe4e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1372 microversion: 2.1 time: 0.186737 Oct 04 22:47:44.104507 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4060/8099] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:43 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1372 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:45.129394 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-66435ad6-3529-49ac-b3c6-d23d951258e0 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:45.130250 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-66435ad6-3529-49ac-b3c6-d23d951258e0 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:45.140459 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66435ad6-3529-49ac-b3c6-d23d951258e0 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:45.141059 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66435ad6-3529-49ac-b3c6-d23d951258e0 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:45.141616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66435ad6-3529-49ac-b3c6-d23d951258e0 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:45.143574 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66435ad6-3529-49ac-b3c6-d23d951258e0 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:45.144390 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66435ad6-3529-49ac-b3c6-d23d951258e0 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:45.145552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-66435ad6-3529-49ac-b3c6-d23d951258e0 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:45.303431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-66435ad6-3529-49ac-b3c6-d23d951258e0 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:45.314376 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-66435ad6-3529-49ac-b3c6-d23d951258e0 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1372 microversion: 2.1 time: 0.189654 Oct 04 22:47:45.330570 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4040/8100] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:45 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1372 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:46.347831 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-e550673b-1a5c-4962-b26f-96febe377c12 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:46.351961 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-e550673b-1a5c-4962-b26f-96febe377c12 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:46.385387 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e550673b-1a5c-4962-b26f-96febe377c12 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:46.386320 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e550673b-1a5c-4962-b26f-96febe377c12 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:46.386957 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e550673b-1a5c-4962-b26f-96febe377c12 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:46.387848 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e550673b-1a5c-4962-b26f-96febe377c12 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:46.388409 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e550673b-1a5c-4962-b26f-96febe377c12 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:46.388916 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-e550673b-1a5c-4962-b26f-96febe377c12 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:46.521813 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-e550673b-1a5c-4962-b26f-96febe377c12 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:46.530688 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-e550673b-1a5c-4962-b26f-96febe377c12 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1372 microversion: 2.1 time: 0.193957 Oct 04 22:47:46.531277 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4061/8101] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:46 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:47:47.555547 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-284bbf5f-fbad-4c5d-933c-6044ae3573e1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:47.556366 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-284bbf5f-fbad-4c5d-933c-6044ae3573e1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:47.558552 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:47.566183 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-284bbf5f-fbad-4c5d-933c-6044ae3573e1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:47.568447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-284bbf5f-fbad-4c5d-933c-6044ae3573e1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:47.568447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-284bbf5f-fbad-4c5d-933c-6044ae3573e1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:47.568447 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-284bbf5f-fbad-4c5d-933c-6044ae3573e1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:47.568762 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-284bbf5f-fbad-4c5d-933c-6044ae3573e1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:47.569053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-284bbf5f-fbad-4c5d-933c-6044ae3573e1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:47.727321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-284bbf5f-fbad-4c5d-933c-6044ae3573e1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:47.735127 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-284bbf5f-fbad-4c5d-933c-6044ae3573e1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1372 microversion: 2.1 time: 0.184589 Oct 04 22:47:47.735710 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4041/8102] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:47 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:48.759349 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-a86fd19d-aeaf-4841-bd30-f621cb7307a6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:48.759984 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-a86fd19d-aeaf-4841-bd30-f621cb7307a6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:48.766936 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a86fd19d-aeaf-4841-bd30-f621cb7307a6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:48.767437 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a86fd19d-aeaf-4841-bd30-f621cb7307a6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:48.767891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a86fd19d-aeaf-4841-bd30-f621cb7307a6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:48.768595 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a86fd19d-aeaf-4841-bd30-f621cb7307a6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:48.769070 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a86fd19d-aeaf-4841-bd30-f621cb7307a6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:48.769555 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-a86fd19d-aeaf-4841-bd30-f621cb7307a6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:48.918614 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-a86fd19d-aeaf-4841-bd30-f621cb7307a6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:48.927963 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-a86fd19d-aeaf-4841-bd30-f621cb7307a6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1372 microversion: 2.1 time: 0.173122 Oct 04 22:47:48.936832 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4062/8103] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:48 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:49.951997 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-fc502e33-ca3b-4cd5-b384-9025505f12f2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:49.952835 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-fc502e33-ca3b-4cd5-b384-9025505f12f2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:49.954780 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell0:SELECT=10 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:49.961040 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc502e33-ca3b-4cd5-b384-9025505f12f2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:49.961580 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc502e33-ca3b-4cd5-b384-9025505f12f2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:49.962016 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc502e33-ca3b-4cd5-b384-9025505f12f2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:49.962725 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc502e33-ca3b-4cd5-b384-9025505f12f2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:49.963182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc502e33-ca3b-4cd5-b384-9025505f12f2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:49.963619 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-fc502e33-ca3b-4cd5-b384-9025505f12f2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:50.115066 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-fc502e33-ca3b-4cd5-b384-9025505f12f2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:50.123789 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-fc502e33-ca3b-4cd5-b384-9025505f12f2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1372 microversion: 2.1 time: 0.175725 Oct 04 22:47:50.124725 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4042/8104] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:49 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:51.149547 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-9434f02d-1b0d-40d6-86e9-25b3c724f391 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:51.150201 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-9434f02d-1b0d-40d6-86e9-25b3c724f391 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:51.152243 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell0:SELECT=4 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:51.158301 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9434f02d-1b0d-40d6-86e9-25b3c724f391 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:51.158814 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9434f02d-1b0d-40d6-86e9-25b3c724f391 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:51.159267 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9434f02d-1b0d-40d6-86e9-25b3c724f391 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:51.159995 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9434f02d-1b0d-40d6-86e9-25b3c724f391 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:51.160470 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9434f02d-1b0d-40d6-86e9-25b3c724f391 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:51.160912 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-9434f02d-1b0d-40d6-86e9-25b3c724f391 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:51.310618 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-9434f02d-1b0d-40d6-86e9-25b3c724f391 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:51.318474 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-9434f02d-1b0d-40d6-86e9-25b3c724f391 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1372 microversion: 2.1 time: 0.174057 Oct 04 22:47:51.319060 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4063/8105] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:51 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:52.342393 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-64e858ce-f867-412c-b83d-5b1330dd70ab tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:52.343773 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-64e858ce-f867-412c-b83d-5b1330dd70ab tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:52.351017 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64e858ce-f867-412c-b83d-5b1330dd70ab tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:52.352011 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64e858ce-f867-412c-b83d-5b1330dd70ab tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:52.352713 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64e858ce-f867-412c-b83d-5b1330dd70ab tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:52.353962 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64e858ce-f867-412c-b83d-5b1330dd70ab tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:52.354858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64e858ce-f867-412c-b83d-5b1330dd70ab tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:52.355656 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-64e858ce-f867-412c-b83d-5b1330dd70ab tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:52.493101 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-64e858ce-f867-412c-b83d-5b1330dd70ab tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:52.502017 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-64e858ce-f867-412c-b83d-5b1330dd70ab tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1372 microversion: 2.1 time: 0.163527 Oct 04 22:47:52.502658 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4043/8106] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:52 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:53.526475 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-24d9aca2-6da8-47f2-ba9f-df40b01b3913 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:53.527903 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-24d9aca2-6da8-47f2-ba9f-df40b01b3913 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:53.535293 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24d9aca2-6da8-47f2-ba9f-df40b01b3913 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:53.535815 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24d9aca2-6da8-47f2-ba9f-df40b01b3913 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:53.536285 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24d9aca2-6da8-47f2-ba9f-df40b01b3913 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:53.537018 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24d9aca2-6da8-47f2-ba9f-df40b01b3913 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:53.537534 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24d9aca2-6da8-47f2-ba9f-df40b01b3913 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:53.538033 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-24d9aca2-6da8-47f2-ba9f-df40b01b3913 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:53.738141 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-24d9aca2-6da8-47f2-ba9f-df40b01b3913 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:53.746751 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-24d9aca2-6da8-47f2-ba9f-df40b01b3913 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1372 microversion: 2.1 time: 0.224869 Oct 04 22:47:53.750683 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4064/8107] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:53 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1372 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:54.341635 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-1fac38ca-016e-4e25-97e0-fbdfc163b1d2 req-98205687-8207-455d-86f4-182151acc27e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3311896-7007-47ed-99be-b77ae68a54c5", "tag": "393549bc-41e7-43e6-af4d-38e080b805ff"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:47:54.351828 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1fac38ca-016e-4e25-97e0-fbdfc163b1d2 req-98205687-8207-455d-86f4-182151acc27e service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:54.352302 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1fac38ca-016e-4e25-97e0-fbdfc163b1d2 req-98205687-8207-455d-86f4-182151acc27e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:54.352739 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-1fac38ca-016e-4e25-97e0-fbdfc163b1d2 req-98205687-8207-455d-86f4-182151acc27e service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:54.365789 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-1fac38ca-016e-4e25-97e0-fbdfc163b1d2 req-98205687-8207-455d-86f4-182151acc27e service nova] Creating event network-changed:393549bc-41e7-43e6-af4d-38e080b805ff for instance c3311896-7007-47ed-99be-b77ae68a54c5 on n-h2-860282-1 Oct 04 22:47:54.372695 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-1fac38ca-016e-4e25-97e0-fbdfc163b1d2 req-98205687-8207-455d-86f4-182151acc27e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097646 Oct 04 22:47:54.373304 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4044/8108] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:47:54.770100 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-ce2f16d8-33ce-49e3-b7e0-c98982502ff1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:54.770879 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-ce2f16d8-33ce-49e3-b7e0-c98982502ff1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:54.778191 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce2f16d8-33ce-49e3-b7e0-c98982502ff1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:54.778698 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce2f16d8-33ce-49e3-b7e0-c98982502ff1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:54.779167 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce2f16d8-33ce-49e3-b7e0-c98982502ff1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:54.779899 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce2f16d8-33ce-49e3-b7e0-c98982502ff1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:54.780375 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce2f16d8-33ce-49e3-b7e0-c98982502ff1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:54.780826 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-ce2f16d8-33ce-49e3-b7e0-c98982502ff1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:54.917906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-ce2f16d8-33ce-49e3-b7e0-c98982502ff1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:54.926316 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-ce2f16d8-33ce-49e3-b7e0-c98982502ff1 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1372 microversion: 2.1 time: 0.160416 Oct 04 22:47:54.926928 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4065/8109] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:54 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:55.952665 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e59d26be-2515-423e-9807-8f1a44b38b39 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:55.953381 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e59d26be-2515-423e-9807-8f1a44b38b39 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:55.960431 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e59d26be-2515-423e-9807-8f1a44b38b39 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:55.961586 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e59d26be-2515-423e-9807-8f1a44b38b39 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:55.962041 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e59d26be-2515-423e-9807-8f1a44b38b39 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:55.962746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e59d26be-2515-423e-9807-8f1a44b38b39 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:55.963212 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e59d26be-2515-423e-9807-8f1a44b38b39 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:55.963693 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e59d26be-2515-423e-9807-8f1a44b38b39 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:56.101622 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e59d26be-2515-423e-9807-8f1a44b38b39 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:56.109319 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e59d26be-2515-423e-9807-8f1a44b38b39 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1372 microversion: 2.1 time: 0.160984 Oct 04 22:47:56.109961 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4045/8110] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:55 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:57.132479 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-7c4e6eec-17d5-4803-90f0-dcafd2e0d495 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:57.133891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-7c4e6eec-17d5-4803-90f0-dcafd2e0d495 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:57.140735 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c4e6eec-17d5-4803-90f0-dcafd2e0d495 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:57.141236 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c4e6eec-17d5-4803-90f0-dcafd2e0d495 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:57.141726 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c4e6eec-17d5-4803-90f0-dcafd2e0d495 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:57.142432 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c4e6eec-17d5-4803-90f0-dcafd2e0d495 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:57.142901 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c4e6eec-17d5-4803-90f0-dcafd2e0d495 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:57.143346 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-7c4e6eec-17d5-4803-90f0-dcafd2e0d495 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:57.280043 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-7c4e6eec-17d5-4803-90f0-dcafd2e0d495 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:57.287857 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-7c4e6eec-17d5-4803-90f0-dcafd2e0d495 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1372 microversion: 2.1 time: 0.159377 Oct 04 22:47:57.288480 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4066/8111] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:57 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:58.312146 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-6cd4e0a3-ad39-41b9-804e-e986d200a92c tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:58.312955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-6cd4e0a3-ad39-41b9-804e-e986d200a92c tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:58.319955 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cd4e0a3-ad39-41b9-804e-e986d200a92c tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:58.320998 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cd4e0a3-ad39-41b9-804e-e986d200a92c tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:58.321463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cd4e0a3-ad39-41b9-804e-e986d200a92c tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:58.322169 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cd4e0a3-ad39-41b9-804e-e986d200a92c tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:58.322630 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cd4e0a3-ad39-41b9-804e-e986d200a92c tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:58.323056 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-6cd4e0a3-ad39-41b9-804e-e986d200a92c tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:58.459463 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-6cd4e0a3-ad39-41b9-804e-e986d200a92c tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:58.467913 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-6cd4e0a3-ad39-41b9-804e-e986d200a92c tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1372 microversion: 2.1 time: 0.160075 Oct 04 22:47:58.468487 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4046/8112] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:58 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:59.493291 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-2e676956-1f47-412a-ad0d-296cd47b1670 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:59.493964 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-2e676956-1f47-412a-ad0d-296cd47b1670 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:59.500843 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e676956-1f47-412a-ad0d-296cd47b1670 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:59.501347 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e676956-1f47-412a-ad0d-296cd47b1670 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:59.501840 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e676956-1f47-412a-ad0d-296cd47b1670 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:59.502645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e676956-1f47-412a-ad0d-296cd47b1670 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:59.503150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e676956-1f47-412a-ad0d-296cd47b1670 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:59.503600 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-2e676956-1f47-412a-ad0d-296cd47b1670 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:59.640771 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-2e676956-1f47-412a-ad0d-296cd47b1670 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:59.649960 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-2e676956-1f47-412a-ad0d-296cd47b1670 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1372 microversion: 2.1 time: 0.161788 Oct 04 22:47:59.650551 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4067/8113] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:59 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:00.488959 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-4ecfa77d-d49f-4de9-943f-9ebdeea18373 req-7def3a5b-ec69-4911-a160-61d82dd2fa39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3311896-7007-47ed-99be-b77ae68a54c5", "name": "network-vif-plugged", "status": "completed", "tag": "393549bc-41e7-43e6-af4d-38e080b805ff"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:48:00.500369 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4ecfa77d-d49f-4de9-943f-9ebdeea18373 req-7def3a5b-ec69-4911-a160-61d82dd2fa39 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:00.500848 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4ecfa77d-d49f-4de9-943f-9ebdeea18373 req-7def3a5b-ec69-4911-a160-61d82dd2fa39 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:00.501279 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-4ecfa77d-d49f-4de9-943f-9ebdeea18373 req-7def3a5b-ec69-4911-a160-61d82dd2fa39 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:00.512239 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-4ecfa77d-d49f-4de9-943f-9ebdeea18373 req-7def3a5b-ec69-4911-a160-61d82dd2fa39 service nova] Creating event network-vif-plugged:393549bc-41e7-43e6-af4d-38e080b805ff for instance c3311896-7007-47ed-99be-b77ae68a54c5 on n-h2-860282-1 Oct 04 22:48:00.517204 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-4ecfa77d-d49f-4de9-943f-9ebdeea18373 req-7def3a5b-ec69-4911-a160-61d82dd2fa39 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032389 Oct 04 22:48:00.521793 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4047/8114] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:48:00.673577 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-60929ba4-f765-41a6-a29d-521813a9f376 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:00.674224 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-60929ba4-f765-41a6-a29d-521813a9f376 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:00.681921 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60929ba4-f765-41a6-a29d-521813a9f376 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:00.682682 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60929ba4-f765-41a6-a29d-521813a9f376 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:00.683150 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60929ba4-f765-41a6-a29d-521813a9f376 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:00.683882 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60929ba4-f765-41a6-a29d-521813a9f376 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:00.684378 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60929ba4-f765-41a6-a29d-521813a9f376 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:00.684834 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-60929ba4-f765-41a6-a29d-521813a9f376 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:00.820302 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-60929ba4-f765-41a6-a29d-521813a9f376 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:00.828018 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-60929ba4-f765-41a6-a29d-521813a9f376 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1372 microversion: 2.1 time: 0.158508 Oct 04 22:48:00.828600 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4068/8115] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:00 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:01.854131 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4e176853-7bfa-44cf-84b2-acd2a875a6c6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:01.854837 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4e176853-7bfa-44cf-84b2-acd2a875a6c6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:01.861028 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e176853-7bfa-44cf-84b2-acd2a875a6c6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:01.861815 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e176853-7bfa-44cf-84b2-acd2a875a6c6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:01.862251 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e176853-7bfa-44cf-84b2-acd2a875a6c6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:01.862939 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e176853-7bfa-44cf-84b2-acd2a875a6c6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:01.863392 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e176853-7bfa-44cf-84b2-acd2a875a6c6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:01.863819 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4e176853-7bfa-44cf-84b2-acd2a875a6c6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:01.997871 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-4e176853-7bfa-44cf-84b2-acd2a875a6c6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:02.005641 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4e176853-7bfa-44cf-84b2-acd2a875a6c6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1372 microversion: 2.1 time: 0.157396 Oct 04 22:48:02.006223 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4048/8116] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:01 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:03.030031 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-f821eed8-1fa0-4708-985c-4cc68be4e2ec tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:03.030661 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-f821eed8-1fa0-4708-985c-4cc68be4e2ec tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:03.039486 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f821eed8-1fa0-4708-985c-4cc68be4e2ec tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:03.040124 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f821eed8-1fa0-4708-985c-4cc68be4e2ec tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:03.040773 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f821eed8-1fa0-4708-985c-4cc68be4e2ec tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:03.042106 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f821eed8-1fa0-4708-985c-4cc68be4e2ec tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:03.042990 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f821eed8-1fa0-4708-985c-4cc68be4e2ec tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:03.043562 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-f821eed8-1fa0-4708-985c-4cc68be4e2ec tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:03.178370 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-f821eed8-1fa0-4708-985c-4cc68be4e2ec tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:03.186086 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-f821eed8-1fa0-4708-985c-4cc68be4e2ec tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1557 microversion: 2.1 time: 0.160052 Oct 04 22:48:03.186661 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4069/8117] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:03 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:03.208098 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-e180337a-bf4e-4a9a-9664-374f6350114f tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:48:03.208734 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-e180337a-bf4e-4a9a-9664-374f6350114f tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:48:03.216303 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e180337a-bf4e-4a9a-9664-374f6350114f tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:03.216798 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e180337a-bf4e-4a9a-9664-374f6350114f tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:03.217239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e180337a-bf4e-4a9a-9664-374f6350114f tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:03.217969 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e180337a-bf4e-4a9a-9664-374f6350114f tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:03.218427 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e180337a-bf4e-4a9a-9664-374f6350114f tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:03.218858 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-e180337a-bf4e-4a9a-9664-374f6350114f tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:03.357272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-e180337a-bf4e-4a9a-9664-374f6350114f tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:48:03.365603 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-e180337a-bf4e-4a9a-9664-374f6350114f tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1557 microversion: 2.1 time: 0.161271 Oct 04 22:48:03.366186 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4049/8118] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:48:03 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:48:05.647319 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-2fa981f7-010e-4948-9351-d0b8912f3f48 req-2a756a25-3870-4222-9672-654423a24255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3311896-7007-47ed-99be-b77ae68a54c5", "tag": "393549bc-41e7-43e6-af4d-38e080b805ff"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:48:05.658820 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2fa981f7-010e-4948-9351-d0b8912f3f48 req-2a756a25-3870-4222-9672-654423a24255 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:48:05.659389 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2fa981f7-010e-4948-9351-d0b8912f3f48 req-2a756a25-3870-4222-9672-654423a24255 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:48:05.659910 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-2fa981f7-010e-4948-9351-d0b8912f3f48 req-2a756a25-3870-4222-9672-654423a24255 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:48:05.671120 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-2fa981f7-010e-4948-9351-d0b8912f3f48 req-2a756a25-3870-4222-9672-654423a24255 service nova] Creating event network-changed:393549bc-41e7-43e6-af4d-38e080b805ff for instance c3311896-7007-47ed-99be-b77ae68a54c5 on n-h2-860282-1 Oct 04 22:48:05.676287 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-2fa981f7-010e-4948-9351-d0b8912f3f48 req-2a756a25-3870-4222-9672-654423a24255 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032653 Oct 04 22:48:05.676836 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4070/8119] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:49:34.573518 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:34.574290 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=66 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:34.579160 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-4caa2482-254c-4e92-86a0-81b7283a3bd2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-224074319"}} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:49:34.582301 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-4caa2482-254c-4e92-86a0-81b7283a3bd2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:34.588746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4caa2482-254c-4e92-86a0-81b7283a3bd2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:34.589272 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4caa2482-254c-4e92-86a0-81b7283a3bd2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:34.589752 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4caa2482-254c-4e92-86a0-81b7283a3bd2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:34.590477 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4caa2482-254c-4e92-86a0-81b7283a3bd2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:34.590933 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4caa2482-254c-4e92-86a0-81b7283a3bd2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:34.591359 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-4caa2482-254c-4e92-86a0-81b7283a3bd2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:34.997022 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-4caa2482-254c-4e92-86a0-81b7283a3bd2 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "POST /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5/action" status: 202 len: 0 microversion: 2.1 time: 0.425534 Oct 04 22:49:35.004506 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4050/8120] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Oct 4 22:49:34 2022] POST /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 22:49:40.781710 n-d-860282-1 devstack@n-api.service[122757]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09430b1c-e049-493f-9e8b-ffc95d4d7683] AMQP server on 10.222.0.30:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 22:49:40.783729 n-d-860282-1 devstack@n-api.service[122757]: ERROR oslo.messaging._drivers.impl_rabbit [-] [02d9f940-80f2-491b-9a18-0a7fa72932fa] AMQP server on 10.222.0.30:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 22:49:40.785118 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_api:SELECT=36 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:40.786493 n-d-860282-1 devstack@n-api.service[122757]: DEBUG dbcounter [-] [122757] Writing DB stats nova_cell1:SELECT=72 {{(pid=122757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:40.792587 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-a5d8da0f-4957-410d-a658-818cc33967c5 req-871def62-3f8a-4753-85b6-09203dc8bec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3311896-7007-47ed-99be-b77ae68a54c5", "name": "network-vif-plugged", "status": "completed", "tag": "393549bc-41e7-43e6-af4d-38e080b805ff"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:49:40.804896 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a5d8da0f-4957-410d-a658-818cc33967c5 req-871def62-3f8a-4753-85b6-09203dc8bec7 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:40.805533 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a5d8da0f-4957-410d-a658-818cc33967c5 req-871def62-3f8a-4753-85b6-09203dc8bec7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:40.806213 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-a5d8da0f-4957-410d-a658-818cc33967c5 req-871def62-3f8a-4753-85b6-09203dc8bec7 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:40.817524 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-a5d8da0f-4957-410d-a658-818cc33967c5 req-871def62-3f8a-4753-85b6-09203dc8bec7 service nova] Creating event network-vif-plugged:393549bc-41e7-43e6-af4d-38e080b805ff for instance c3311896-7007-47ed-99be-b77ae68a54c5 on n-h2-860282-1 Oct 04 22:49:40.822778 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-a5d8da0f-4957-410d-a658-818cc33967c5 req-871def62-3f8a-4753-85b6-09203dc8bec7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043880 Oct 04 22:49:40.823897 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4071/8121] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:49:52.758864 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_api:SELECT=2 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:52.759865 n-d-860282-1 devstack@n-api.service[122758]: DEBUG dbcounter [-] [122758] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:52.763778 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-8220fc22-f7b7-433b-947c-559d80a74787 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:52.764583 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8220fc22-f7b7-433b-947c-559d80a74787 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:52.773471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-1d4ce7f2-f38f-44e5-afa6-02b21ec73e3b req-fecd86dd-2cbc-42ff-b104-670272a935d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3311896-7007-47ed-99be-b77ae68a54c5", "tag": "393549bc-41e7-43e6-af4d-38e080b805ff"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:49:52.787546 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8220fc22-f7b7-433b-947c-559d80a74787 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:52.787888 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8220fc22-f7b7-433b-947c-559d80a74787 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:52.788331 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8220fc22-f7b7-433b-947c-559d80a74787 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:52.789053 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8220fc22-f7b7-433b-947c-559d80a74787 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:52.789544 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8220fc22-f7b7-433b-947c-559d80a74787 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:52.789975 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-8220fc22-f7b7-433b-947c-559d80a74787 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:52.801563 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1d4ce7f2-f38f-44e5-afa6-02b21ec73e3b req-fecd86dd-2cbc-42ff-b104-670272a935d0 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:52.804503 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1d4ce7f2-f38f-44e5-afa6-02b21ec73e3b req-fecd86dd-2cbc-42ff-b104-670272a935d0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:52.805273 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-1d4ce7f2-f38f-44e5-afa6-02b21ec73e3b req-fecd86dd-2cbc-42ff-b104-670272a935d0 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:52.811539 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] [02d9f940-80f2-491b-9a18-0a7fa72932fa] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 41578. Oct 04 22:49:52.818043 n-d-860282-1 devstack@n-api.service[122757]: INFO oslo.messaging._drivers.impl_rabbit [-] [09430b1c-e049-493f-9e8b-ffc95d4d7683] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 41576. Oct 04 22:49:52.820715 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-1d4ce7f2-f38f-44e5-afa6-02b21ec73e3b req-fecd86dd-2cbc-42ff-b104-670272a935d0 service nova] Creating event network-changed:393549bc-41e7-43e6-af4d-38e080b805ff for instance c3311896-7007-47ed-99be-b77ae68a54c5 on n-h2-860282-1 Oct 04 22:49:52.826016 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-1d4ce7f2-f38f-44e5-afa6-02b21ec73e3b req-fecd86dd-2cbc-42ff-b104-670272a935d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058887 Oct 04 22:49:52.826640 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4072/8122] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:49:52.830525 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-8220fc22-f7b7-433b-947c-559d80a74787 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Going to try to terminate instance {{(pid=122758) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:49:52.832821 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [req-66b3ae56-c183-4388-ae06-7b0b584bd62d req-c93ab27c-63b5-40f0-8672-537791e156d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3311896-7007-47ed-99be-b77ae68a54c5", "name": "network-vif-unplugged", "status": "completed", "tag": "393549bc-41e7-43e6-af4d-38e080b805ff"}]} {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:49:52.843278 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-66b3ae56-c183-4388-ae06-7b0b584bd62d req-c93ab27c-63b5-40f0-8672-537791e156d2 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:52.844172 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-66b3ae56-c183-4388-ae06-7b0b584bd62d req-c93ab27c-63b5-40f0-8672-537791e156d2 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:52.844624 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [req-66b3ae56-c183-4388-ae06-7b0b584bd62d req-c93ab27c-63b5-40f0-8672-537791e156d2 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:52.857189 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.compute.server_external_events [req-66b3ae56-c183-4388-ae06-7b0b584bd62d req-c93ab27c-63b5-40f0-8672-537791e156d2 service nova] Creating event network-vif-unplugged:393549bc-41e7-43e6-af4d-38e080b805ff for instance c3311896-7007-47ed-99be-b77ae68a54c5 on n-h2-860282-1 Oct 04 22:49:52.862706 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [req-66b3ae56-c183-4388-ae06-7b0b584bd62d req-c93ab27c-63b5-40f0-8672-537791e156d2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034490 Oct 04 22:49:52.863630 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4073/8123] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:49:53.091645 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-8220fc22-f7b7-433b-947c-559d80a74787 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 204 len: 0 microversion: 2.1 time: 0.334615 Oct 04 22:49:53.095711 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4051/8124] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:49:52 2022] DELETE /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:49:53.102794 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-5b8e31f4-c2c4-4347-a0ee-1815a3c20b75 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:53.103520 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-5b8e31f4-c2c4-4347-a0ee-1815a3c20b75 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:53.110621 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b8e31f4-c2c4-4347-a0ee-1815a3c20b75 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:53.111335 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b8e31f4-c2c4-4347-a0ee-1815a3c20b75 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:53.111797 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b8e31f4-c2c4-4347-a0ee-1815a3c20b75 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:53.112675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b8e31f4-c2c4-4347-a0ee-1815a3c20b75 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:53.113154 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b8e31f4-c2c4-4347-a0ee-1815a3c20b75 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:53.113627 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-5b8e31f4-c2c4-4347-a0ee-1815a3c20b75 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:53.260170 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-5b8e31f4-c2c4-4347-a0ee-1815a3c20b75 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:53.268292 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-5b8e31f4-c2c4-4347-a0ee-1815a3c20b75 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1681 microversion: 2.1 time: 0.170915 Oct 04 22:49:53.268890 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4074/8125] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:53 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:54.293923 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-3ef83a84-eb66-45d1-bd4f-dd74b358398e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:54.294733 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-3ef83a84-eb66-45d1-bd4f-dd74b358398e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:54.301616 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ef83a84-eb66-45d1-bd4f-dd74b358398e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:54.302747 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ef83a84-eb66-45d1-bd4f-dd74b358398e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:54.303182 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ef83a84-eb66-45d1-bd4f-dd74b358398e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:54.303866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ef83a84-eb66-45d1-bd4f-dd74b358398e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:54.304321 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ef83a84-eb66-45d1-bd4f-dd74b358398e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:54.304746 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-3ef83a84-eb66-45d1-bd4f-dd74b358398e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:54.442866 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-3ef83a84-eb66-45d1-bd4f-dd74b358398e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:54.450634 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-3ef83a84-eb66-45d1-bd4f-dd74b358398e tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1681 microversion: 2.1 time: 0.161659 Oct 04 22:49:54.451215 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4052/8126] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:54 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:55.475337 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-aa34527e-ed71-4f73-82c0-c4f35f02fbb6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:55.476127 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-aa34527e-ed71-4f73-82c0-c4f35f02fbb6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:55.483266 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa34527e-ed71-4f73-82c0-c4f35f02fbb6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:55.483906 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa34527e-ed71-4f73-82c0-c4f35f02fbb6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:55.484471 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa34527e-ed71-4f73-82c0-c4f35f02fbb6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:55.485656 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa34527e-ed71-4f73-82c0-c4f35f02fbb6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:55.486272 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa34527e-ed71-4f73-82c0-c4f35f02fbb6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:55.486790 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-aa34527e-ed71-4f73-82c0-c4f35f02fbb6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:55.495129 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-6414aed5-9be9-4db8-9e87-cd301376eb27 req-5c0aeaa1-ce5c-4497-8b9e-cb3c198c89ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3311896-7007-47ed-99be-b77ae68a54c5", "name": "network-vif-deleted", "tag": "393549bc-41e7-43e6-af4d-38e080b805ff"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:49:55.506193 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6414aed5-9be9-4db8-9e87-cd301376eb27 req-5c0aeaa1-ce5c-4497-8b9e-cb3c198c89ee service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:55.506676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6414aed5-9be9-4db8-9e87-cd301376eb27 req-5c0aeaa1-ce5c-4497-8b9e-cb3c198c89ee service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:55.507112 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-6414aed5-9be9-4db8-9e87-cd301376eb27 req-5c0aeaa1-ce5c-4497-8b9e-cb3c198c89ee service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:55.518426 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-6414aed5-9be9-4db8-9e87-cd301376eb27 req-5c0aeaa1-ce5c-4497-8b9e-cb3c198c89ee service nova] Creating event network-vif-deleted:393549bc-41e7-43e6-af4d-38e080b805ff for instance c3311896-7007-47ed-99be-b77ae68a54c5 on n-h2-860282-1 Oct 04 22:49:55.524462 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-6414aed5-9be9-4db8-9e87-cd301376eb27 req-5c0aeaa1-ce5c-4497-8b9e-cb3c198c89ee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034171 Oct 04 22:49:55.525082 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4053/8127] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:49:55.558148 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-aa34527e-ed71-4f73-82c0-c4f35f02fbb6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:55.566233 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-aa34527e-ed71-4f73-82c0-c4f35f02fbb6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 200 len: 1496 microversion: 2.1 time: 0.095444 Oct 04 22:49:55.567336 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4075/8128] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:55 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 1496 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:56.590745 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-50294544-7d51-4990-bd9b-61f140f4a6dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:56.591446 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-50294544-7d51-4990-bd9b-61f140f4a6dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: c3311896-7007-47ed-99be-b77ae68a54c5] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:56.598453 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50294544-7d51-4990-bd9b-61f140f4a6dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:56.598937 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50294544-7d51-4990-bd9b-61f140f4a6dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:56.599373 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50294544-7d51-4990-bd9b-61f140f4a6dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:56.600185 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50294544-7d51-4990-bd9b-61f140f4a6dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:56.600550 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50294544-7d51-4990-bd9b-61f140f4a6dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:56.600971 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-50294544-7d51-4990-bd9b-61f140f4a6dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:56.614101 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-50294544-7d51-4990-bd9b-61f140f4a6dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] HTTP exception thrown: Instance c3311896-7007-47ed-99be-b77ae68a54c5 could not be found. Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-50294544-7d51-4990-bd9b-61f140f4a6dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Request method failure captured: Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 HTTP/1.1 Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPLds0NxEeMaiMTyaXwti5TGlMXdtEkDNXWVqSs94CZibKdjot5tkCEScgivq8v4B3aUsQxZ5pnOLgsA9sRDeGG4mlY6DlATDt0J55596WjQvwOxm0bm1qLw4pf7jee2bImu7_ommB2ZfPgJPmpLL9n0TRav_dxMFUncsq8cuw6_ZDb4 Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 4f8a2a2fbd4140fa95571adbd3faf81f Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestSnapshotPattern-2018281261 Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4f8a2a2fbd4140fa95571adbd3faf81f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4f8a2a2fbd4140fa95571adbd3faf81f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4f8a2a2fbd4140fa95571adbd3faf81f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4f8a2a2fbd4140fa95571adbd3faf81f"}]}] Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestSnapshotPattern-2018281261 Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 4f8a2a2fbd4140fa95571adbd3faf81f Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestSnapshotPattern-2018281261 Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestSnapshotPattern-2018281261-project Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: a1a3d0e56b064703984669d6476d7f0a Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestSnapshotPattern-2018281261-project Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance c3311896-7007-47ed-99be-b77ae68a54c5 could not be found. Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': 'c3311896-7007-47ed-99be-b77ae68a54c5'} Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3311896-7007-47ed-99be-b77ae68a54c5 could not be found. Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3311896-7007-47ed-99be-b77ae68a54c5 could not be found. Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:49:56.616338 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:49:56.622116 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:49:56.622116 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:49:56.622116 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:49:56.622116 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:49:56.622116 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:49:56.622116 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3311896-7007-47ed-99be-b77ae68a54c5 could not be found. Oct 04 22:49:56.622116 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:49:56.622116 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-50294544-7d51-4990-bd9b-61f140f4a6dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Returning 404 to user: Instance c3311896-7007-47ed-99be-b77ae68a54c5 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:49:56.622116 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-50294544-7d51-4990-bd9b-61f140f4a6dc tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5" status: 404 len: 111 microversion: 2.1 time: 0.031199 Oct 04 22:49:56.622116 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4054/8129] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:56 2022] GET /compute/v2.1/servers/c3311896-7007-47ed-99be-b77ae68a54c5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:49:58.834847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-da1735cb-164b-4cb4-9b46-b99b4a8cae92 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:58.834847 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-da1735cb-164b-4cb4-9b46-b99b4a8cae92 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: 2a466408-258e-4fef-b316-758a3b024db6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:58.836239 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-b67ac798-4303-4b0b-b803-87cc1a8bb60a req-9ff75a44-aaff-4962-99fc-4617fad8f678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a466408-258e-4fef-b316-758a3b024db6", "tag": "3fcc8e69-d733-4fc2-b040-aea40a5bdd83"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:49:58.840891 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da1735cb-164b-4cb4-9b46-b99b4a8cae92 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:58.841675 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da1735cb-164b-4cb4-9b46-b99b4a8cae92 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:58.842321 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da1735cb-164b-4cb4-9b46-b99b4a8cae92 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:58.843053 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da1735cb-164b-4cb4-9b46-b99b4a8cae92 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:58.843532 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da1735cb-164b-4cb4-9b46-b99b4a8cae92 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:58.843980 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-da1735cb-164b-4cb4-9b46-b99b4a8cae92 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:58.858973 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b67ac798-4303-4b0b-b803-87cc1a8bb60a req-9ff75a44-aaff-4962-99fc-4617fad8f678 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:58.860818 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b67ac798-4303-4b0b-b803-87cc1a8bb60a req-9ff75a44-aaff-4962-99fc-4617fad8f678 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:58.862210 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-b67ac798-4303-4b0b-b803-87cc1a8bb60a req-9ff75a44-aaff-4962-99fc-4617fad8f678 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:58.874645 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-da1735cb-164b-4cb4-9b46-b99b4a8cae92 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: 2a466408-258e-4fef-b316-758a3b024db6] Going to try to terminate instance {{(pid=122757) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:49:58.875832 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-b67ac798-4303-4b0b-b803-87cc1a8bb60a req-9ff75a44-aaff-4962-99fc-4617fad8f678 service nova] Creating event network-changed:3fcc8e69-d733-4fc2-b040-aea40a5bdd83 for instance 2a466408-258e-4fef-b316-758a3b024db6 on n-h1-860282-1 Oct 04 22:49:58.882122 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-b67ac798-4303-4b0b-b803-87cc1a8bb60a req-9ff75a44-aaff-4962-99fc-4617fad8f678 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049916 Oct 04 22:49:58.882712 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4055/8130] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:49:59.139966 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-da1735cb-164b-4cb4-9b46-b99b4a8cae92 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6" status: 204 len: 0 microversion: 2.1 time: 0.310209 Oct 04 22:49:59.140602 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4076/8131] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Oct 4 22:49:58 2022] DELETE /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:49:59.149448 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-2e3b6e54-f1f9-4934-8ed4-cff1ac619f64 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:59.150159 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-2e3b6e54-f1f9-4934-8ed4-cff1ac619f64 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: 2a466408-258e-4fef-b316-758a3b024db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:59.156375 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e3b6e54-f1f9-4934-8ed4-cff1ac619f64 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:59.156861 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e3b6e54-f1f9-4934-8ed4-cff1ac619f64 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:59.157300 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e3b6e54-f1f9-4934-8ed4-cff1ac619f64 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:59.158013 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e3b6e54-f1f9-4934-8ed4-cff1ac619f64 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:59.158467 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e3b6e54-f1f9-4934-8ed4-cff1ac619f64 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:59.158891 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-2e3b6e54-f1f9-4934-8ed4-cff1ac619f64 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:59.324536 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.policy [None req-2e3b6e54-f1f9-4934-8ed4-cff1ac619f64 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122758) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:59.333625 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-2e3b6e54-f1f9-4934-8ed4-cff1ac619f64 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6" status: 200 len: 1681 microversion: 2.1 time: 0.188366 Oct 04 22:49:59.335423 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4056/8132] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:59 2022] GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6 => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:00.365780 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-dd3d325c-e8f3-42dc-b8d2-095e5ef9afd4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:00.366528 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-dd3d325c-e8f3-42dc-b8d2-095e5ef9afd4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: 2a466408-258e-4fef-b316-758a3b024db6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:00.373371 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd3d325c-e8f3-42dc-b8d2-095e5ef9afd4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:00.373911 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd3d325c-e8f3-42dc-b8d2-095e5ef9afd4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:00.374374 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd3d325c-e8f3-42dc-b8d2-095e5ef9afd4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:00.375096 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd3d325c-e8f3-42dc-b8d2-095e5ef9afd4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:00.375578 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd3d325c-e8f3-42dc-b8d2-095e5ef9afd4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:00.376026 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-dd3d325c-e8f3-42dc-b8d2-095e5ef9afd4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:00.508810 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-dd3d325c-e8f3-42dc-b8d2-095e5ef9afd4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:00.516548 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-dd3d325c-e8f3-42dc-b8d2-095e5ef9afd4 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6" status: 200 len: 1681 microversion: 2.1 time: 0.155796 Oct 04 22:50:00.517120 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4077/8133] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:00 2022] GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:01.341666 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [req-d41caf7b-23ed-4fac-92f4-333b5a069643 req-c8b6bce0-9712-420e-9ece-7da94364f308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a466408-258e-4fef-b316-758a3b024db6", "name": "network-vif-deleted", "tag": "3fcc8e69-d733-4fc2-b040-aea40a5bdd83"}]} {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:50:01.352177 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d41caf7b-23ed-4fac-92f4-333b5a069643 req-c8b6bce0-9712-420e-9ece-7da94364f308 service nova] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:01.352667 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d41caf7b-23ed-4fac-92f4-333b5a069643 req-c8b6bce0-9712-420e-9ece-7da94364f308 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:01.353104 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [req-d41caf7b-23ed-4fac-92f4-333b5a069643 req-c8b6bce0-9712-420e-9ece-7da94364f308 service nova] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:01.365402 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.compute.server_external_events [req-d41caf7b-23ed-4fac-92f4-333b5a069643 req-c8b6bce0-9712-420e-9ece-7da94364f308 service nova] Creating event network-vif-deleted:3fcc8e69-d733-4fc2-b040-aea40a5bdd83 for instance 2a466408-258e-4fef-b316-758a3b024db6 on n-h1-860282-1 Oct 04 22:50:01.370423 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [req-d41caf7b-23ed-4fac-92f4-333b5a069643 req-c8b6bce0-9712-420e-9ece-7da94364f308 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032566 Oct 04 22:50:01.371011 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4057/8134] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Oct 4 22:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:50:01.540459 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-deac8a2b-c46f-4f27-9f83-5a8ce9907637 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:01.541083 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.compute.api [None req-deac8a2b-c46f-4f27-9f83-5a8ce9907637 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: 2a466408-258e-4fef-b316-758a3b024db6] Fetching instance by UUID {{(pid=122757) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:01.556158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-deac8a2b-c46f-4f27-9f83-5a8ce9907637 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:01.556158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-deac8a2b-c46f-4f27-9f83-5a8ce9907637 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:01.556158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-deac8a2b-c46f-4f27-9f83-5a8ce9907637 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:01.556158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-deac8a2b-c46f-4f27-9f83-5a8ce9907637 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:01.556158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-deac8a2b-c46f-4f27-9f83-5a8ce9907637 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:01.556158 n-d-860282-1 devstack@n-api.service[122757]: DEBUG oslo_concurrency.lockutils [None req-deac8a2b-c46f-4f27-9f83-5a8ce9907637 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:01.616858 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.policy [None req-deac8a2b-c46f-4f27-9f83-5a8ce9907637 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a3d0e56b064703984669d6476d7f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a2a2fbd4140fa95571adbd3faf81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122757) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:01.625083 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-deac8a2b-c46f-4f27-9f83-5a8ce9907637 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6" status: 200 len: 1332 microversion: 2.1 time: 0.088622 Oct 04 22:50:01.625737 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4078/8135] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:01 2022] GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6 => generated 1332 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:02.650895 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-abb294dc-08ad-4f2b-a6c1-f0d785b0ad0a tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '>' {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:02.651600 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.compute.api [None req-abb294dc-08ad-4f2b-a6c1-f0d785b0ad0a tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] [instance: 2a466408-258e-4fef-b316-758a3b024db6] Fetching instance by UUID {{(pid=122758) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:02.657759 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abb294dc-08ad-4f2b-a6c1-f0d785b0ad0a tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:02.658243 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abb294dc-08ad-4f2b-a6c1-f0d785b0ad0a tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:02.658676 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abb294dc-08ad-4f2b-a6c1-f0d785b0ad0a tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:02.659357 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abb294dc-08ad-4f2b-a6c1-f0d785b0ad0a tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Acquiring lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:02.659806 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abb294dc-08ad-4f2b-a6c1-f0d785b0ad0a tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:02.660225 n-d-860282-1 devstack@n-api.service[122758]: DEBUG oslo_concurrency.lockutils [None req-abb294dc-08ad-4f2b-a6c1-f0d785b0ad0a tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Lock "016bade6-ba85-4482-99c1-a6ee7c8937c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:02.673197 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.wsgi [None req-abb294dc-08ad-4f2b-a6c1-f0d785b0ad0a tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] HTTP exception thrown: Instance 2a466408-258e-4fef-b316-758a3b024db6 could not be found. Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-abb294dc-08ad-4f2b-a6c1-f0d785b0ad0a tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Request method failure captured: Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: request: GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6 HTTP/1.1 Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: Accept: application/json Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: Accept-Encoding: identity Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: Connection: close Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: Content-Length: 0 Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: Content-Type: application/json Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: Host: 10.222.0.30 Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: Openstack-System-Scope: None Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: User-Agent: python-urllib3/1.26.12 Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-Auth-Token: gAAAAABjPLds0NxEeMaiMTyaXwti5TGlMXdtEkDNXWVqSs94CZibKdjot5tkCEScgivq8v4B3aUsQxZ5pnOLgsA9sRDeGG4mlY6DlATDt0J55596WjQvwOxm0bm1qLw4pf7jee2bImu7_ommB2ZfPgJPmpLL9n0TRav_dxMFUncsq8cuw6_ZDb4 Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Id: None Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-Domain-Name: None Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-Identity-Status: Confirmed Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-Is-Admin-Project: True Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Id: default Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Domain-Name: Default Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Id: 4f8a2a2fbd4140fa95571adbd3faf81f Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-Project-Name: tempest-TestSnapshotPattern-2018281261 Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-Role: reader,member Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-Roles: reader,member Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4f8a2a2fbd4140fa95571adbd3faf81f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4f8a2a2fbd4140fa95571adbd3faf81f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4f8a2a2fbd4140fa95571adbd3faf81f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4f8a2a2fbd4140fa95571adbd3faf81f"}]}] Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant: tempest-TestSnapshotPattern-2018281261 Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Id: 4f8a2a2fbd4140fa95571adbd3faf81f Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-Tenant-Name: tempest-TestSnapshotPattern-2018281261 Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-User: tempest-TestSnapshotPattern-2018281261-project Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Id: default Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-User-Domain-Name: Default Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-User-Id: a1a3d0e56b064703984669d6476d7f0a Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: X-User-Name: tempest-TestSnapshotPattern-2018281261-project Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: method: > Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: exception: Instance 2a466408-258e-4fef-b316-758a3b024db6 could not be found. Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: action_args: {'id': '2a466408-258e-4fef-b316-758a3b024db6'} Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: {{(pid=122758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a466408-258e-4fef-b316-758a3b024db6 could not be found. Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a466408-258e-4fef-b316-758a3b024db6 could not be found. Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:50:02.674832 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:50:02.681079 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:50:02.681079 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:50:02.681079 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:50:02.681079 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:50:02.681079 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:50:02.681079 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a466408-258e-4fef-b316-758a3b024db6 could not be found. Oct 04 22:50:02.681079 n-d-860282-1 devstack@n-api.service[122758]: ERROR nova.api.openstack.wsgi Oct 04 22:50:02.681079 n-d-860282-1 devstack@n-api.service[122758]: DEBUG nova.api.openstack.wsgi [None req-abb294dc-08ad-4f2b-a6c1-f0d785b0ad0a tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Returning 404 to user: Instance 2a466408-258e-4fef-b316-758a3b024db6 could not be found. {{(pid=122758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:50:02.681079 n-d-860282-1 devstack@n-api.service[122758]: INFO nova.api.openstack.requestlog [None req-abb294dc-08ad-4f2b-a6c1-f0d785b0ad0a tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6" status: 404 len: 111 microversion: 2.1 time: 0.031796 Oct 04 22:50:02.681079 n-d-860282-1 devstack@n-api.service[122758]: [pid: 122758|app: 0|req: 4058/8136] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:02 2022] GET /compute/v2.1/servers/2a466408-258e-4fef-b316-758a3b024db6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:50:02.908284 n-d-860282-1 devstack@n-api.service[122757]: DEBUG nova.api.openstack.wsgi [None req-c5a1bcc6-76fb-47aa-827a-2e38f02b39b6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] Calling method '.version_select at 0x7f57908f0670>' {{(pid=122757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:02.997622 n-d-860282-1 devstack@n-api.service[122757]: INFO nova.api.openstack.requestlog [None req-c5a1bcc6-76fb-47aa-827a-2e38f02b39b6 tempest-TestSnapshotPattern-2018281261 tempest-TestSnapshotPattern-2018281261-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-481970667" status: 202 len: 0 microversion: 2.1 time: 0.093268 Oct 04 22:50:02.998237 n-d-860282-1 devstack@n-api.service[122757]: [pid: 122757|app: 0|req: 4079/8137] 10.222.0.30 () {58 vars in 1254 bytes} [Tue Oct 4 22:50:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-481970667 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)